Data Engineer / Ingénieur Data & Big Data (F/H)
Core
Building and maintaining a production Data Lake / Hadoop platform for a major social protection organization.
Role type
Senior Data Engineer (Big Data)
Builds
Data Lake platform, data pipelines, and SQL-based data extractions
Domain
Social protection / Big Data
Required skills
Hadoop/Cloudera, Hive, Impala, Python, SQL, Shell scripting, Spark, Linux, Git, reverse engineering, code reviews
Preferred skills
Power BI, SAS, social protection sector knowledge (pension), Agile/Scrum/Kanban
Responsibilities
Develop and maintain Data Lake feeding processes, evolve existing treatments based on new needs, create SQL extractions, automate with Shell scripts, optimize platform performance, conduct reverse engineering on complex architectures, provide Level 2 support, perform code reviews, document developments and processes, support users, manage activities via JIRA, transfer skills to team members
Seniority
Senior, hands-on IC
