Data Platform Engineer (Medior/Senior) job

Date published: November 29, 2024

ID: 12974 Location: Budapest Task: Data Engineer

We are seeking a Data Platform Engineer to design and implement data solutions in Microsoft Azure in a professionally strong team. As a Data Platform Engineer, you will operate within some of our most versatile and complex client environments, utilizing technologies such as ETL tools, SQL, Power BI, Terraform, and Python.

Tasks & Responsibilities

  • Lead technical decisions for enterprise data architecture using Databricks or Microsoft Fabric
  • Develop strategies for cost-effective, high-performance data architectures, covering everything from data streams to analytical storage
  • Design and implement data solutions in Microsoft Azure based on project needs
  • Build and maintain ETL processes and data models for analytical pipelines, especially in Finance
  • Establish and uphold best practices for software development, like version control, testing, and CI
  • Support pre-sale activities, including RFPs, proposals, and client communications
  • Guide discussions on cloud data warehousing and machine learning platforms
  • Deliver cloud infrastructure solutions using Infrastructure-as-Code
  • Provide technical support for vendor and third-party engagements
  • Offer ongoing support for business and technology teams on platform strategy and quality assurance

Required Qualifications

  • Bachelor’s degree in Computer Science, IT, or a related field
  • Experience as a Data Architect/Engineer with hands-on expertise in Data Lakehouse, Data Lake, and data warehouse design
  • Strong knowledge of Databricks, data lakes, and Spark
  • Minimum 2 years of Databricks and 4 years of Azure experience (certifications preferred)
  • Proficiency with Azure DevOps and experience in DevOps pipelines
  • Familiarity with DataOps and MLOps
  • Proficient in Azure Data Services and Architecture, including Azure Data Factory, Azure SQL, and Power BI
  • Skills in Python, JavaScript, Terraform, and infrastructure-as-code

Nice to Have

  • Knowledge of Azure infrastructure and security, Docker, and Kubernetes (certifications are a plus).
  • Experience with Microsoft Fabric, ML platforms, and LLM-based AI applications (e.g., Azure OpenAI).
  • Familiarity with prompt engineering and LangChain.
  • Experience with Airflow, Collibra, open-source databases (e.g., Postgres, MySQL), AWS data services, IBM Watson, streaming tools (e.g., Kafka, Azure Stream Analytics), and Azure IoT Hub.

What we can offer

  • Up to fully remote working
  • Flexible working hours
  • Training and learning opportunities
  • Support and opportunities for professional development

Upload your resume

resume FILES *
Allowed File Types: DOC, DOCX, PDF, RTF.
MAXIMUM 2 files (MAXIMUM 10 MB per files).

dRAG & dROP THE FILES HERE
OR