Software Engineer - Data Solutions, AI & Data Platform (AiDP)
Core
Design, build, and enhance scalable, efficient data platforms for real-time, near-real-time, and batch data pipelines to support machine learning and analytics at scale.
Role type
Senior IC data platform engineer
Builds
Production-grade data processing systems, data pipelines, and self-service data engineering applications
Domain
Cloud data engineering and big data analytics
Deliverable
production ML models
Required skills
Data warehousing, big data analytics, Python, SQL, PySpark, Apache Spark, Snowflake, Trino, Flink, Iceberg, open table formats, distributed data processing
Preferred skills
Python, Java, Scala, Apache Kafka, cloud platforms, AI model integration, large-scale platform migration
Technologies
Snowflake, Apache Spark, PySpark, Flink, Trino, Iceberg, Kafka, Python, Java, Scala
Responsibilities
Architect scalable data processing systems for real-time, near-real-time, and batch pipelines; Develop data engineering solutions in Python and advanced SQL; Design complex data processing logic for large-scale platforms; Develop self-service data engineering applications; Write efficient code for performant solutions; Monitor software to correct errors and implement new functionality.
Seniority
Senior, hands-on IC