AI/ML Data Engineer
Core
Design, develop, and optimize scalable data pipelines, workflows, and Feature Stores to ingest, transform, and manage diverse data (text, tables, images, video, audio) for AI/ML applications.
Role type
Senior IC Data Engineer (AI/ML focus)
Builds
End-to-end data engineering pipelines and Feature Stores for semi-structured and unstructured data
Domain
Networking, AI/ML, Data Engineering
Deliverable
production ML models
Required skills
Python, PySpark, SQL, RDBMS, ETL/ELT, Web crawling & scraping, Data modeling & governance
Preferred skills
Snowflake administration, Databricks, AWS services (S3, Glue, EMR, EC2, RDS, IAM), Kafka, Spark Streaming, GitHub Actions, RCA
Technologies
Python, PySpark, SQL, Snowflake, AWS, Databricks, Kafka, GitHub Actions
Responsibilities
Develop and maintain data pipelines and Feature Stores; Design and architect scalable data engineering solutions; Implement advanced data transformations and quality checks; Integrate data from diverse sources; Create and implement advanced data models and schemas.
Seniority
Senior, hands-on IC