Senior Data Engineer
Hays
Role: Data Engineer
We are looking for an experienced Data Engineer to support the development and optimisation of our data platform, with a strong focus on building and maintaining a modern, scalable architecture leveraging Azure Microsoft Fabric and medallion design principles.
12 months Contract
Key Responsibilities
- Design, build, and maintain high‑quality Gold layer data models that are analytics‑ready and aligned to business requirements, leveraging Microsoft Fabric (Lakehouse, Warehouse, and Semantic Models).
- Apply medallion architecture principles (Bronze, Silver, Gold) within Microsoft Fabric to deliver scalable, well‑structured data solutions.
- Develop and optimise data transformations using PySpark, SQL, and Fabric-native capabilities (e.g. Notebooks, Dataflows Gen2, Pipelines).
- Build and orchestrate end-to-end data pipelines in Microsoft Fabric, ensuring efficient ingestion, transformation, and delivery across environments.
- Establish, maintain, and troubleshoot API-based data integrations, including ingestion into Fabric OneLake and Lakehouse environments.
- Design data models that support reporting, analytics, and downstream consumption using Fabric Warehouses and Power BI semantic models, working closely with analysts and BI developers.
- Promote and support pipelines across multiple environments (e.g. dev, test, prod), including managing environment‑specific configurations and deployments within Azure / Fabric workspaces.
- Work effectively within an Agile delivery model, contributing to sprint planning, reviews, and iterative delivery.
- Collaborate with analytics, engineering, and business stakeholders to translate requirements into reliable data solutions built on Microsoft Fabric’s unified data platform.
- Contribute to documentation and promote best practices in data engineering, Fabric implementation, and modern data platform architecture.
Required Skills and Experience
- Strong hands-on experience with medallion architecture and layered data platform design, ideally implemented in Azure Microsoft Fabric or similar cloud data platforms.
- Proven experience working with Microsoft Fabric components such as Lakehouse, Data Warehouse, OneLake, Data Pipelines, and Notebooks.
- Proficiency in PySpark and SQL, including optimisation in distributed data environments.
- Strong understanding of data orchestration and pipeline development within Azure / Fabric ecosystems.
- Strong understanding of prompt engineering and data agents.
- Proven experience establishing and managing API integrations across environments, including ingestion into cloud data platforms.
- Experience designing analytics‑friendly data models (e.g. facts, dimensions, curated datasets), ideally aligned to Power BI and Fabric semantic modelling.
- Previous experience working in an Agile methodology (Scrum / Kanban).
If you are interested, please contact directly or can email ***email_hidden***