BigData-Hadoop/Scala Engineer, AVP
Core
Design, develop, and maintain high-performance, fault-tolerant data pipelines and ETL solutions for data platforms.
Role type
Senior IC Big Data Engineer (Hadoop/Scala/Spark)
Builds
Data pipelines, ETL/ELT solutions, and data processing jobs
Domain
Big Data, Cloud Data Platforms (GCP)
Deliverable
production ML models
Required skills
Java, Scala, Apache Spark, Google Cloud Platform (Airflow, Dataproc, BigQuery), Data Warehousing, ETL/ELT, Data Modeling, Git, Problem-solving
Preferred skills
Python, Oracle, Unix/Linux scripting, AWS, Azure, CI/CD, DevOps, Data Governance, Angular, React, Financial Services domain
Technologies
Apache Spark, Airflow, Dataproc, BigQuery, Git, Oracle, Angular, React
Responsibilities
Design and develop high-performance data pipelines; Implement ETL solutions; Optimize data processing jobs for performance and cost; Ensure data quality, integrity, and security; Collaborate with data scientists and analysts; Mentor junior team members
Seniority
Senior, hands-on IC
