Data Engineer
Core
Designing, developing, and optimizing scalable data pipelines and infrastructure to support AI-driven applications and enable data-driven decision-making.
Role type
Data Engineer
Builds
Scalable ETL/ELT workflows, data warehouses, databases, and cloud storage solutions.
Domain
Cloud-based data platforms and AI/ML support
Deliverable
production ML models
Required skills
Python, SQL, Scala, ETL frameworks, workflow orchestration (Apache Airflow, DBT), Big Data technologies (Spark, Hadoop), Cloud platforms (AWS, GCP, Azure), relational and NoSQL databases (PostgreSQL, MongoDB), streaming technologies (Kafka, Kinesis, Pub/Sub)
Preferred skills
CI/CD for data engineering, data privacy regulations (GDPR, CCPA)
Technologies
Apache Airflow, DBT, Spark, Hadoop, AWS, GCP, Azure, S3, Redshift, BigQuery, Snowflake, Kafka, Kinesis, Pub/Sub, PostgreSQL, MongoDB
Responsibilities
Design and develop scalable ETL/ELT workflows for structured and unstructured data; Optimize data warehouses, databases, and cloud storage solutions; Work with APIs, streaming data, and batch processing to consolidate data from multiple sources; Monitor, troubleshoot, and improve data systems for speed and reliability; Collaborate with AI/ML teams to support data modeling and analytics initiatives; Ensure data quality, security, and compliance with industry best practices.
Seniority
Mid-to-Senior level