Data Platform Engineer
Core
Design, develop, and optimize AWS-based ETL/ELT pipelines and data platform components to support organizational data strategy.
Role type
Senior IC data platform engineer (AWS)
Builds
End-to-end data solutions, reusable frameworks, and automated data pipelines
Domain
Cloud data engineering / AWS ecosystem
Required skills
AWS Glue, Python, PySpark, SQL, data pipeline design, data modeling, CI/CD implementation, troubleshooting complex data issues
Preferred skills
Experience with AWS data services (S3, Redshift, Lambda, Step Functions), data governance principles, Agile methodologies
Technologies
AWS Glue, Python, PySpark, AWS S3, AWS Lambda, AWS IAM, AWS CloudWatch, AWS Step Functions, AWS Redshift, SQL
Responsibilities
Design and maintain ETL/ELT pipelines; develop automation solutions; troubleshoot data processing and integration issues; monitor and optimize pipeline performance and cost; support CI/CD and deployment activities; collaborate with architects on system integration
Seniority
Senior, hands-on IC