Data Engineer II
Core
Design data flow in hybrid environments, build ETL/ELT pipelines, and create data models for OLAP/OLTP projects.
Role type
Senior IC data engineer (big data)
Builds
ETL/ELT pipelines, data warehouse/ODS architectures, analytical reports, and dashboards
Domain
Higher education technology + big data
Required skills
ETL/ELT pipeline development, data modeling (dimensional/normalized), SQL, NoSQL, Python, Java, Scala, Hadoop, Spark, Kafka, Databricks, data quality auditing, cloud environment management
Preferred skills
Cognos, Tableau, Cloudera, Horton, Impala, Hive, AngularJS, HTML5, CSS/LESS, higher education domain knowledge
Technologies
Hadoop, Spark, Kafka, Databricks, Cloudera, Horton, Impala, Hive, Cognos, Tableau, Jira, Confluence, GitHub, JSON, XML
Responsibilities
Develop and maintain ETL/ELT data pipelines; design data and systems architecture for OLAP and OLTP projects; ensure optimal use of data stores; troubleshoot query performance and data quality issues; ingest and transform structured, semi-structured, and unstructured data; create complex reports and dashboards; monitor and maintain ETL/ELT jobs; perform data/technology discovery from new sources; analyze data sources and design data models for capture and transformation.
Seniority
Senior, hands-on IC
