Data Engineer
Core
Design, build, and maintain large-scale batch and real-time data pipelines, data warehouses, and data lakes for government agency clients.
Role type
Senior Data Engineer (Cloud & Big Data)
Builds
Scalable data-driven products, production-grade ETL/ELT pipelines, and backend APIs for government applications.
Domain
Public Sector / Government Agencies / Cloud Data Engineering
Required skills
SQL, Python, ETL/ELT pipeline design, Cloud platforms (AWS, Azure, Google Cloud), Big Data frameworks (Hadoop, Spark, Kafka), Database design (PostgreSQL, MongoDB, etc.), Web scraping, REST APIs, Data modeling
Preferred skills
Data governance, System design, Linux/Windows environments, Agile/CI-CD practices
Technologies
AWS (DMS, Lambda, ECS, Glue, S3, Athena), Azure, Google Cloud, SQL Server, SSIS, Kafka, RabbitMQ, Databricks, Hadoop, Spark, MongoDB, PostgreSQL, MySQL, Node.js, Selenium, BeautifulSoup
Responsibilities
Design and deploy data tables, views, and marts; perform data extraction, cleaning, and transformation; build and maintain efficient data pipelines; integrate data silos; collaborate with architects and analysts; develop backend APIs; work in Agile environments with code reviews.
Seniority
Mid-to-Senior, hands-on IC