Tō tūranga hou | Your new role

We are recruiting for one Data Engineer to work with us to build functionality in our new Modern Data Platform (MDP). We are looking for a Data Engineer to design, build, operationalise, secure and monitor data pipelines and data stores. This role involves working with the Data Architect and Data Analysts to model implementation options and build technical solutions that meet business requirements. This role also produces, tests and tunes code to agreed standards, meeting both functional and non-functional requirements. Key accountability includes:

• Designs, implements, and maintains complex data engineering solutions to acquire, prepare and present data.

• Monitors application of data standards and architectures, including security and compliance.

• Applies data engineering standards and tools to create and maintain data pipelines and extract, transform and load data.

• Plans and drives the development of data engineering solutions, ensuring that solutions balance functional and non-functional requirements.

• Applies knowledge of software development lifecycle and testing practices.

• Carries out Unit testing.

Ngā uara me ngā pūkenga e angitu ai koe | What you'll need to succeed

• Data Engineering: Proficient in data modelling, ETL pipeline design, and data partitioning optimisation.

• Databricks: Expertise in Delta Lake, Notebooks, SQL, and park, and pipeline orchestration (Databricks Jobs/Azure Data Factory).

• Cloud Computing (Azure): Skilled in Azure Data Lake Storage, Data Factory, and DevOps practices (Git, CI/CD, Agile).

• Data Governance and Security: Experienced in access control (Azure RBAC), Databricks management, encryption, and compliance (GDPR, HIPAA).

• Programming: Proficient in Python, PySpark, and SQL for building and optimising data pipelines.

• Automation: Skilled in orchestration (Apache Airflow/Databricks Workflows) and pipeline monitoring.

• Agile and Optimisation: Experience in Agile,

***Applicants for this position must have NZ residence or a valid NZ work visa***

Me aha koe ināianei | What you need to do now

If you're interested in this role, click 'apply now' to forward an up-to-date copy of your CV, or call us now.
E: Giovana.Piazzetta@hays.net.nz | 09 884 1523