CDI - Data Engineer F/H
Core
Develop, migrate, and optimize data pipelines and algorithms for the defense sector, focusing on industrializing solutions and building Big Data architectures.
Role type
Data Engineer
Builds
Production data pipelines, industrialized algorithms, and Big Data architectures
Domain
Defense / Data Engineering
Deliverable
production ML models
Required skills
Python, SQL, Linux, Git, Big Data technologies (NiFi, Kafka), algorithm migration (C++ to Python), dashboard development (Grafana), ETL automation
Preferred skills
Agile methodologies, DevOps principles, data security principles
Technologies
Python, SQL, Grafana, Linux, Git, NiFi, Kafka
Responsibilities
Migrate C++ algorithms to Python and develop new Python algorithms; Industrialize code for production (hardening, obfuscation, versioning, auditing); Deploy algorithms on platforms for validation and testing; Set up and manage Big Data architectures and automate ETL processes; Develop and optimize Grafana visualization dashboards; Optimize SQL queries; Collaborate with data science and business teams to understand needs and document processes.