Senior Big Data Engineer
Core
Design and architect scalable, low-latency data solutions including data lakes, warehouses, and pipelines for a major US retailer's customer data science platform.
Role type
Senior Big Data Engineer
Builds
End-to-end data pipelines, analytics platforms, and intelligent data governance systems for Target Circle members.
Domain
Retail / Big Data Engineering
Deliverable
production ML models
Required skills
Python, Java, Scala, Apache Spark, Apache Kafka, Apache Airflow, Cloud platforms (Azure/GCP), Data governance tools, Git, RDBMS
Preferred skills
dbt, Snowflake, Databricks, Hadoop, MapReduce, Hive, Oozie, HBase
Technologies
Apache Kafka, Flink, Spark Streaming, Apache Airflow, Collibra, Alation, OpenMetadata, Azure, Google Cloud, Snowflake, Databricks, Hive, HBase, MapReduce
Responsibilities
Design end-to-end data solutions (data lakes, warehouses, ETL/ELT pipelines, APIs); Architect scalable data pipelines for high-velocity streams; Orchestrate complex workflows; Design intelligent systems for anomaly detection and process rerouting; Define data governance and quality standards; Lead architectural reviews; Partner with business/IT teams to translate needs into architecture; Ensure security and compliance.
Seniority
Senior, hands-on IC
