We are looking for a Data Engineer for an European energy company.
Main responsibilities
- Define the optimal architecture of the Data & Analytics platform enabling the availability and re-usability of all required data for the creation of analytics products
- Manage and monitor data pipelines to source and transform data to the Data & Analytics Platform(s)
- Integrate and transform new data sources (internal and external) by creating a full pipeline from ingestion to ETL process
- Deliver Data Provisioning to operational applications requiring transformation of data from several sources
- Optimize and expand the Data & Analytics platform data flows and data models, supporting in deploying analytics products
- Define and document detailed Data Engineering processes to guarantee efficient building and support of the data & analytics platform
- Assess the stability, robustness and efficiency of the implemented ELT processes and data pipelines and eventually re-design them
- Gather requirements and write technical specifications document
- Ensure and monitor high data quality standards with focus on data consistency
- Timely resolve incidents related to data interfaces and ELT processes
- Expand the current Data & Analytics platform to embed big data capability by investigating and sharing best practices
Requirements
- Masters degree in IT / Economics
- 5-6years of data engineer experience
- Fluent English
- Experience with data modelling (conceptual, logical, physical) and data modelling documentation
- Professional experience and conceptual knowledge of building and maintaining physical and logical data models, including data streaming
- Excellent knowledge and proven professional experience with MS Azure and Lakehouse architecture, in-depth knowledge and/or certification in Databricks (Spark)
- Well structured, analytically thinking and demonstrating the ability to explain processes in a clear and understandable manner to a non-technical audience
- System management expertise with monitoring, disaster recovery, backup, automated testing, automated schema migration, and continuous deployment
- Ability to take ownership and proven strive for excellence
What we offer
- Competitive base remuneration determined by actual experience and skills.
- Fringe benefits complementary to the base remuneration (cafeteria, bonus).
- 2-3 days a week home office provided.
- Working together with a dynamic team of IT professionals.