Online Sr Data Engineer - Remote
Core
Build data infrastructure, develop ETL pipelines, and create data analysis tools to transform customer data into actionable information for The Home Depot.
Role type
Senior IC data engineer (data platform & analytics)
Builds
Enterprise data pipelines, APIs, and data validation tools
Domain
Retail / Big Data Engineering
Required skills
Python, SQL, PySpark, Airflow, Google BigQuery, ETL pipeline development, batch and streaming data processing, data orchestration, CI/CD automation, metadata management, data stitching
Preferred skills
Predictive modeling, data mining, front-end development (React), cost optimization of data pipelines, mentoring junior engineers
Technologies
Python, SQL, PySpark, Airflow, Google BigQuery, DataProc, React, JavaScript
Responsibilities
Design and maintain database pipeline architectures; develop and test ETL jobs and automation scripts; build batch and streaming pipelines; optimize pipeline runtime and storage costs; collaborate with business partners to define data requirements; mentor junior engineers on data engineering principles.
Seniority
Senior, hands-on IC