Data Engineer

BLACKROC Recruitment

Data Engineer

Initial 12 Month Contract

Brisbane + Hybrid Working

We are seeking an experienced Data Engineer to support the delivery of a high-profile enterprise data platform program within a large enterprise environment.

This is a hands-on role focused on designing, building and operating secure, reliable data pipelines and curated data products. You will work across Microsoft Fabric, Azure, SQL and PySpark to support the development of a centralised data platform that enables improved analytics, reporting and business insights. You will partner closely with data governance, reporting and business stakeholders to deliver privacy-by-design ingestion, high-quality datasets and performant semantic models for Power BI.

Key responsibilities

  • Build and operate data pipelines using Microsoft Fabric, including Pipelines, Dataflows Gen2, Notebooks/Spark, Lakehouse/OneLake and SQL Endpoints
  • Design and implement ingestion and transformation processes across Bronze, Silver and Gold layers
  • Develop curated datasets, dimensional models and semantic models to support Power BI reporting
  • Work with Microsoft Purview to support metadata discovery, classifications, sensitivity labels, lineage and governance requirements
  • Implement data quality checks, validation rules, automated testing and technical documentation
  • Apply security and privacy principles including least-privilege access, managed identities, masking and audit logging
  • Support CI/CD and deployment automation using Azure DevOps or equivalent tools
  • Configure monitoring, logging and alerting to ensure reliability, performance and cost effectiveness
  • Collaborate with data stewards, custodians, analysts, product owners and technical teams

About you

  • 5+ years’ experience in data engineering or similar roles
  • Strong experience building production-grade data pipelines and curated datasets
  • Demonstrated experience with Microsoft Fabric, or closely related Microsoft data platform technologies
  • Strong SQL and PySpark skills
  • Experience with Azure data services such as Azure Data Factory, Synapse or Databricks
  • Familiarity with medallion architecture, dimensional modelling and Power BI semantic models
  • Exposure to Microsoft Purview, data governance, data quality or lineage practices
  • Experience with Azure DevOps, CI/CD, Git-based workflows or environment promotion
  • Strong understanding of data security, privacy, RBAC, managed identities and audit logging
  • Excellent documentation, stakeholder engagement and communication skills

To apply, please send your resume or contact Abbie for a confidential discussion: ***email_hidden*** / 0413 444 157