Data Engineer
BLACKROC Recruitment
Data Engineer
Initial 12 Month Contract
Brisbane + Hybrid Working
We are seeking an experienced Data Engineer to support the delivery of a high-profile enterprise data platform program within a large enterprise environment.
This is a hands-on role focused on designing, building and operating secure, reliable data pipelines and curated data products. You will work across Microsoft Fabric, Azure, SQL and PySpark to support the development of a centralised data platform that enables improved analytics, reporting and business insights. You will partner closely with data governance, reporting and business stakeholders to deliver privacy-by-design ingestion, high-quality datasets and performant semantic models for Power BI.
Key responsibilities
- Build and operate data pipelines using Microsoft Fabric, including Pipelines, Dataflows Gen2, Notebooks/Spark, Lakehouse/OneLake and SQL Endpoints
- Design and implement ingestion and transformation processes across Bronze, Silver and Gold layers
- Develop curated datasets, dimensional models and semantic models to support Power BI reporting
- Work with Microsoft Purview to support metadata discovery, classifications, sensitivity labels, lineage and governance requirements
- Implement data quality checks, validation rules, automated testing and technical documentation
- Apply security and privacy principles including least-privilege access, managed identities, masking and audit logging
- Support CI/CD and deployment automation using Azure DevOps or equivalent tools
- Configure monitoring, logging and alerting to ensure reliability, performance and cost effectiveness
- Collaborate with data stewards, custodians, analysts, product owners and technical teams
About you
- 5+ years’ experience in data engineering or similar roles
- Strong experience building production-grade data pipelines and curated datasets
- Demonstrated experience with Microsoft Fabric, or closely related Microsoft data platform technologies
- Strong SQL and PySpark skills
- Experience with Azure data services such as Azure Data Factory, Synapse or Databricks
- Familiarity with medallion architecture, dimensional modelling and Power BI semantic models
- Exposure to Microsoft Purview, data governance, data quality or lineage practices
- Experience with Azure DevOps, CI/CD, Git-based workflows or environment promotion
- Strong understanding of data security, privacy, RBAC, managed identities and audit logging
- Excellent documentation, stakeholder engagement and communication skills
To apply, please send your resume or contact Abbie for a confidential discussion: ***email_hidden*** / 0413 444 157