Senior Data Engineer
Core
Design, develop, and maintain robust data pipelines and ETL architectures to support advanced analytics, data science, and BI solutions for enterprises.
Role type
Senior IC data engineer
Builds
Data pipelines, data lakes, data warehouses, and analytics infrastructure
Domain
Enterprise data platforms, cloud data infrastructure
Deliverable
production ML models
Required skills
SQL, Apache Spark (Python/Scala), AWS/Azure cloud services, big data frameworks (Kafka, Flink), orchestration tools (Airflow, Prefect), CI/CD, version control
Preferred skills
ERP data integration, traditional ETL tools (Talend, Pentaho)
Responsibilities
Design and maintain optimal data pipeline and ETL architectures; Map out data systems and define integrations; Prepare and optimize data for predictive modeling; Integrate ERP data into enterprise data lakes; Enhance cloud data infrastructure on AWS or Azure; Utilize big data tools to optimize data acquisition; Build architectures for data lakes and warehouses; Develop data models for analytics and reports; Conduct code reviews and implement testing; Monitor and troubleshoot data ingestion workflows.
Seniority
Senior, hands-on IC