Senior Data Engineer

Senior Data Engineer ( Databricks / Azure / SQL )

Melbourne / Hybrid

$150-170k base plus super

Talent Insights is partnering with a growing Data & AI consultancy that's expanding its engineering capability across enterprise clients

.This is an opportunity for an experienced Senior Data Engineer who enjoys leading technical delivery, mentoring engineers and helping organisations build modern data platforms that enable AI

.While you'll remain hands-on with technology, this isn't a role where you'll spend every day writing code. Instead, you'll balance technical leadership with engineering delivery by designing solutions, reviewing code, mentoring junior engineers and helping clients solve complex data challenges

.As the AI landscape continues to evolve, we're looking for someone who's genuinely curious about emerging technologies. You don't need years of commercial AI experience, but you should understand modern AI architectures and how data platforms underpin successful AI adoption

.

The role

You'll work across multiple client engagements, acting as the day-to-day technical lead for delivery teams while partnering with senior architects and practice leads. Projects span cloud data platforms, analytics engineering, AI enablement and modernisation initiatives across industries including financial services, retail, healthcare and the public sector.You'll be comfortable switching between technical design sessions with clients, supporting engineers through delivery and presenting architectural decisions to stakeholders .

Responsibilities for the Senior Data Engineer ( Databricks / Azure / SQL ) include:

• Lead the technical delivery of modern Data Engineering projects from design through to production.
• Design and build scalable cloud-based data platforms and pipelines.
• Define solution architecture, data models and engineering approaches that balance scalability, maintainability and cost.
• Establish engineering best practices across testing, CI/CD, security, governance and infrastructure as code.
• Review code, troubleshoot complex technical issues and ensure high-quality delivery.
• Mentor and coach junior engineers through code reviews, technical guidance and best practices.
• Work directly with clients to understand business requirements, manage technical scope and translate problems into practical solutions.
• Contribute to technical discovery, solution design, estimation and proposal development for new engagements.
• Stay current with emerging AI technologies and identify opportunities to incorporate them into client solutions.
• Collaborate across multiple concurrent client engagements while maintaining delivery quality.

Required experience for the Senior Data Engineer ( Databricks / Azure / SQL ) includes :

• 5+ years' experience delivering modern Data Engineering solutions.
• Strong experience designing and productionising cloud data platforms rather than simply delivering migrations or proofs of concept.
• Experience across Azure, Databricks, Snowflake or equivalent modern cloud data platforms.
• Excellent SQL, Python and data modelling skills.
• Experience designing scalable ETL/ELT pipelines and cloud-native architectures.
• Strong software engineering fundamentals including Git, automated testing, CI/CD and infrastructure as code.
• An understanding of data governance, security, access management and building maintainable production systems.
• Previous experience leading small engineering teams, mentoring junior engineers and reviewing technical work.Excellent stakeholder management and consulting skills.

AI Experience

Commercial AI delivery experience is welcomed but not

essential.

We're looking for engineers who understand the current AI landscape and the data foundations required to support production AI systems. Knowledge of the following would be highly regarded:

Retrieval-Augmented Generational (RAG)

Large Language Models (LLMs)Vector databases and embeddings

AI application architecturesAI governance and responsible AI

Building data platforms that support GenAI workloads

If you're actively experimenting with these technologies or investing in your learning, we'd love to hear from you

Technical Environment

Technology varies depending on client requirements, however experience with the following is highly regarded:

• Microsoft Azure
• Databricks
• Snowflake
• Python
• SQL
• Spark / PySpark
• Azure Data Factory, Synapse or Microsoft Fabric
• dbt
• Delta Lake & Unity Catalog
• Git
• CI/CD
• Terraform or Bicep
• Great Expectations or similar data quality frameworks

Why Join?

• Join a specialist Data & AI consultancy delivering high-impact transformation projects.
• Work across diverse industries with exposure to modern cloud, data and AI technologies.
• Shape technical direction rather than simply delivering tickets.
• Lead and mentor engineers while continuing to develop your own technical expertise.
• Flexible hybrid working with no mandated office days (client requirements may occasionally require onsite attendance).
• Strong investment in learning, certifications and career development.
• Collaborative culture with experienced technical leaders and architects.

Please note: Due to the nature of upcoming client engagements, Australian Citizenship is highly desirable, and the ability to obtain or hold a Baseline Security Clearance will be highly regarded.

Please click apply now or send your CV to ***email_hidden***