AWS Glue Python Developer
Core
Design, develop, and support scalable cloud-based inbound and outbound file-based data integration and processing solutions using AWS Glue and Python.
Role type
Senior IC AWS Glue Python Developer
Builds
Batch inbound and outbound file processing pipelines, reusable data ingestion/transformation frameworks, and event-driven workflows.
Domain
Cloud Data Engineering / ETL
Deliverable
production ML models | product features
Required skills
Python (OOP, exception handling), AWS Glue, PySpark, Amazon S3, Amazon EventBridge, AWS Lambda, Amazon SNS/SQS, Amazon CloudWatch, AWS IAM, SQL, REST/SOAP APIs, file format parsing (CSV, XML, JSON, Excel, fixed/variable length), Git
Preferred skills
AWS Step Functions, AWS Glue Workflows, CI/CD tools (Jenkins, GitHub Actions, GitLab, AWS CodePipeline), data quality/reconciliation/lineage
Technologies
AWS Glue, PySpark, Python, Amazon S3, Amazon EventBridge, AWS Lambda, Amazon SNS, Amazon SQS, Amazon CloudWatch, AWS IAM, Oracle, PostgreSQL, MySQL, Amazon RDS, Jenkins, GitHub Actions, GitLab, AWS CodePipeline
Responsibilities
Design and develop inbound/outbound file processing using AWS Glue and PySpark; Develop reusable Python modules for data ingestion, validation, and error handling; Configure EventBridge rules for scheduling; Develop AWS Lambda functions for automation; Implement messaging solutions using SNS and SQS; Configure CloudWatch logs and alarms; Develop workflows using Glue Workflows or Step Functions; Integrate AWS services with databases and APIs; Optimize Glue jobs for performance and cost; Support production deployments and incident resolution; Collaborate with DevOps on CI/CD pipelines; Prepare technical documentation.
Seniority
Senior, hands-on IC