Data Engineer
Core
Design, implement, and maintain scalable data pipelines, ETL processes, and data products to ensure high data quality and availability for government agencies and commercial partners.
Role type
Senior IC Data Engineer
Builds
Scalable data pipelines, APIs, data catalogs, and data-driven products
Domain
Government technology, cybersecurity, cloud data infrastructure
Required skills
Python, PySpark, SQL, AWS ETL tools (MSK, Firehose, SNS, Airflow), data modeling, data governance, metadata management, open table formats (Iceberg, Parquet), big data technologies (Hadoop, Spark)
Preferred skills
Data mesh principles, domain ownership, data product thinking, federated governance, mentoring
Technologies
AWS (S3, Redshift, Athena, MSK, Firehose, SNS), Airflow, Kafka, Hadoop, Spark, MySQL, NoSQL, DataZone
Responsibilities
Design and maintain scalable data pipelines and ETL processes; Create and manage APIs for data access and integration; Lead data modeling efforts to support business goals; Configure and maintain central data catalogs and governance platforms; Implement data governance best practices and compliance; Collaborate with cross-functional teams to build data-driven products; Support data consumers in using approved data products
Seniority
Mid-Senior, hands-on IC