Senior Data Engineer - Apartments.com - Irvine, CA
Core
Designing and maintaining automated data infrastructure, building secure data warehouses and lakehouses, and feeding data into KPI dashboards to track site performance and consumer behavior.
Role type
Senior Data Engineer (Data Platform & Analytics)
Builds
Automated data infrastructure, secure data warehouses/lakehouses, and KPI dashboards for site performance and product usage.
Domain
Real Estate / Commercial & Residential / Data Engineering
Deliverable
production ML models | dashboards & analysis
Required skills
Python, PySpark, SQL, Cloud data platforms (Databricks, Snowflake, BigQuery), AWS services, Spark jobs, ETL processes, Data modeling, AI/ML integration, Terraform, CI/CD, Data governance
Preferred skills
NoSQL databases (DynamoDB), Object storage (S3, GCS), Event streaming (Kafka), LLMs and prompt engineering, Container services
Technologies
Databricks, Snowflake, BigQuery, AWS, Spark, Terraform, Kafka, DynamoDB, S3, GCS, Power BI
Responsibilities
Design and implement dimensional modeling and cloud data platform structures; Develop data platform frameworks using Medallion Architecture; Build and optimize scalable data pipelines and Spark jobs; Integrate Machine Learning into data pipelines; Oversee automated data infrastructure and data tracking; Implement data governance, lineage, and monitoring frameworks; Mentor engineers and analysts.
Seniority
Senior, hands-on IC with mentorship responsibilities