Associate Data Engineer
Core
Builds and maintains ETL/ELT data pipelines, ingests and transforms data from diverse sources, and supports data analysis for an online higher education platform.
Role type
Associate Data Engineer
Builds
Data pipelines and analytical reports for student-focused data analysis
Domain
Higher Education / Data Engineering
Deliverable
production ML models | data pipelines
Required skills
ETL/ELT pipeline development, SQL, NoSQL, Python, Java, Scala, Hadoop, Spark, Kafka, Databricks, data modeling, bug fixing, pipeline auditing
Preferred skills
REST/SOA/HTML development, IntelliJ/VS Code, JIRA, Git, Agile/Scrum, application integration with legacy systems, cloud-native development (AWS), JavaScript/TypeScript, UI frameworks (Angular, React, Vue.js), Oracle/MySQL interfaces, technical certifications
Technologies
Python, Java, Scala, Hadoop, Spark, Kafka, Databricks, AWS, SQL, NoSQL, JSON, XML, Angular, React, Vue.js, IntelliJ, VS Code, JIRA, Git, Oracle, MySQL
Responsibilities
Develops and builds ETL/ELT data pipelines; Creates and maintains optimal data pipeline architecture; Monitors and maintains ETL/ELT jobs and troubleshoots load issues; Manages change requests/ticket queues for analytical reports and ETL/ELT jobs; Performs data/technology discovery from new sources and third-party applications for data ingestion; Ingests and transforms structured, semi-structured, and unstructured data from various sources
Seniority
Associate, hands-on IC
