Data Engineer Middle
Core
Design, develop, implement, and maintain data engineering solutions for reliable data integration, processing, and availability for analytical and business initiatives.
Role type
Middle Data Engineer
Builds
Data pipelines, Data Lake, and Data Warehouse architectures
Domain
Cloud Data Engineering (Azure, GCP)
Deliverable
production ML models
Required skills
Python (Pandas, PySpark), SQL, ETL/ELT, Data Modeling, CI/CD, Git/GitHub, Airflow
Preferred skills
Agentic Engineering, Retail data ecosystems, Walmart Cloud Native Platform (WCNP)
Technologies
Azure (Blob Storage, SQL Server), Google Cloud Platform (BigQuery), Apache Airflow
Responsibilities
Design and optimize ETL/ELT pipelines for large volumes of data; Implement data ingestion, cleaning, transformation, and storage in Data Lake/Warehouse architectures; Develop Python solutions for efficient data processing; Manage and optimize Azure Cloud and GCP environments; Create and optimize advanced SQL queries; Implement and administer workflows using Airflow; Participate in data model definition; Monitor and optimize data process and platform performance; Collaborate with Analytics, Data Science, and Business teams.
Seniority
Middle, hands-on IC
