Role: Data Engineer
Type : contract
Languages:
• Fluent in either Dutch or French
• Fluent in English
3-4 years of experience as a data engineer
We are seeking a skilled and experienced Data Engineer to join our Data team. You will be responsible for designing and implementing scalable, efficient, and robust data solutions, pipelines, models … The goal is to support our current and future data-driven initiatives.
Close collaboration with cross-functional teams, data analysts, project managers is a must in order to ensure that data is available, accessible, actionable...
Responsibilities
Design, implement, and maintain scalable data architectures, including databases, data lakes (on AWS), and data warehouses in line with the existing Engie tools and frameworks.
Build and optimize ETL (Extract, Transform, Load) processes to move data from various sources to data repositories.
Combine diverse data sources into cohesive, unified views (gold datasets) for analysis and reporting purposes.
Ensure data consistency, accuracy, and quality throughout the data lifecycle.
Develop and maintain code for data processing tasks using languages such as Python, Spark, SQL and ensure they are automated and run on a regular basis
Work closely with cross-functional teams, analysts, and software developers, to understand data requirements and deliver insight solutions
Work closely with business data owners to ensure and continuously enhance the quality of data in the data platform
Collaborate with various teams to ensure the scalability, security, and performance of data systems
Create and maintain comprehensive documentation for data processes, pipelines, and architectures
Monitor the data platform production systems
Hard skills:
• Must have:
o Proven experience as a Data Engineer or in a similar role
o Proven experience on Data Platform Management
o Effective Experience with AWS services such as S3, Athena, Glue, Redshift
o Effective experience in Databricks (preferably on AWS)
o Strong programming skills in Python, Spark, SQL or another data engineering language
o Experience with data processing technologies
o Knowledge of Agile processes (scrum, Kanban)
o Knowledge of Azure DevOps & release Pipelines
o AWS certifications (Cloud Data Engineer)
o Knowledge of Great Expectations is considered a plus
• Good to have:
o A first experience in utilities market is a plus
o Knowledge of technical systems like Salesforce, SAP ISU
o Knowledge of Agile tools like Azure DevOps or Jira
o AWS certifications (Solution Architect, Systems Administrator)
o Knowledge of Collibra is a plus
Soft skills:
• Must have:
o Team player
o Communication skills, especially for explaining technical concepts to nontechnical business leaders
o Ability to work in a multi-cultural and multinational environment
o Be adaptable to evolving technologies and changing project requirements.
o Proven organizational skills and attention to detail