Tō kamupene hou | Your new company

Well‑established organisation within the public sector.

Tō tūranga hou | Your new role

• As a Senior Data Engineer (Databricks), you will design, build, and maintain scalable, secure, and high‑performing data platforms in a cloud environment. Your work will focus on delivering production‑ready ELT/ETL pipelines, Lakehouse/Medallion architectures, and governed data models using Databricks, Delta Lake, and distributed PySpark processing.
• You will develop robust ingestion frameworks for APIs, ERP systems, cloud sources, and enterprise datasets, implementing best‑practice data quality, reconciliation, observability, and performance optimisation. You will also integrate CI/CD deployment patterns, environment promotion, and secure configuration approaches to ensure reliability and repeatability across the data platform.
• Collaboration will be central to your role—you’ll partner with analysts, developers, architects, and platform teams, providing technical leadership, improving engineering standards, and contributing to a high‑quality, well‑documented, and scalable data ecosystem.

Ngā uara me ngā pūkenga e angitu ai koe | What you'll need to succeed

• Strong Databricks engineering capability — Python, PySpark, SQL, Delta Lake, Databricks Jobs/Workflows, and experience building scalable ELT/ETL pipelines.
• Experience designing modern Azure‑based data architectures, including Medallion (Bronze/Silver/Gold), incremental processing, and dimensional modelling.
• Proficiency with Azure data services, particularly Azure Databricks, Azure Data Factory (ADF), Azure Key Vault, Azure Storage, and Azure IAM/RBAC for secure access control.
• Good CI/CD and automation practices using Azure DevOps or other Git‑based workflows to manage deployments and promotion across environments.
• Strong collaboration and communication skills, working effectively with analysts, developers, and architects, and contributing to engineering standards and reusable patterns.
• Solid understanding of data quality and governance, including validation, reconciliation, observability, and delivering reliable production data outputs.

Me aha koe ināianei | What you need to do now

If you're interested in this role, click 'apply now' to forward an up-to-date copy of your CV, or call us now.

If this job isn't quite right for you, but you are looking for a new position, please contact us for a confidential discussion on your career.