Business Intelligence Data Engineer
About the Role:
We are seeking a highly skilled Business Intelligence Data Engineer to join our team. This role will involve developing, deploying, and maintaining scalable data pipelines from REST APIs using Python, SQL, and ETL tools (Azure Synapse) to ingest, transform, and prepare data for analysis and reporting.
Main Responsibilities:
* Design, develop, and deploy data pipelines to extract, transform, and load data into cloud-based Azure Data Lake storage;
* Process and transform complex JSON and GIS data into structured datasets optimized for analysis and reporting;
* Loading and organizing processed data into cloud-based Azure Data Lake storage ensuring accessibility and performance;
* Documenting ETL processes, metadata definitions, data lineage, and technical specifications to ensure transparency and reusability;
* Collaborating with data analysts, BI developers, and business stakeholders to understand data requirements and deliver reliable, well-documented datasets aligned with organizational needs;
* Implementing data quality checks, logging, and monitoring within data pipelines to support maintainability and troubleshooting.
Requirements and Qualifications:
To be successful in this role, you will need at least 5 years of excellent knowledge in Azure data lake storage and Oracle databases. Additionally, you should have excellent expertise in developing data pipelines from REST APIs and on integration (such as Python, Azure Synapse, SQL), as well as processing JSON and GIS data.
Certifications:
Mandatory certifications include Microsoft Azure Data Engineer Associate. Certifications such as Microsoft Certified: Azure Solutions Architect Expert, Microsoft Certified: Azure Developer Associate, and Microsoft Certified: Azure Database Administrator Associate are also highly desirable.