• 12–18-month project contract
• Kenmore office, free parking onsite, 2 days WFH.
• Azure Databricks, Databricks platform & pipeline specialist

Senior Data Engineer – Azure Databricks (Lakehouse Specialist)

Churches of Christ is delivering a major uplift of our data platform, centred on a modern Azure Databricks Lakehouse. This initiative focuses on establishing governed, scalable, production‑grade Databricks capabilities to support analytics, reporting, and decision‑making across the organisation.

We are seeking a Senior Data Engineer with strong, hands‑on Azure Databricks experience to act as a Databricks platform and pipeline specialist. This is a hands‑on, senior role for someone who is comfortable designing Databricks‑native solutions, making architectural decisions, and shaping how data engineering is done across the organisation.

In addition to delivery, this role will mentor junior data engineers, helping uplift Databricks capability, standards, and best practices across the team.

What you will deliver

In this role, you will deliver production‑ready Databricks solutions, including:

• A Databricks Lakehouse architecture implemented using Bronze, Silver, and Gold layers.
• Declarative Databricks Lakeflow / DLT pipelines for:
  • Batch ingestion
  • Incremental and micro‑batch processing
  • Built‑in data quality expectations
• Ingestion pipelines for:
  • Relational SQL systems
  • REST API data sources using Databricks notebooks and pipelines.
• Transformations implemented using:
  • Databricks SQL
  • Declarative pipeline transforms (rather than ad‑hoc notebooks)
• Conformed dimensional models (Kimball / star schema) implemented in the Lakehouse.
• Secure, governed datasets using Unity Catalog, including:
  • Fine‑grained schema and table permissions
  • PII classification and data masking
  • Clear separation of Dev / Test / Prod environments
• AI/BI‑ready datasets and semantic models supporting:
  • Databricks AI/BI dashboards
  • Databricks Genie and natural‑language querying
  • Microsoft Power BI
• CI/CD‑enabled Databricks deployments using:
  • Azure DevOps
  • Databricks Asset Bundles
  • YAML‑driven configuration and promotion
• Improved platform performance, reliability, and cost efficiency through sound Databricks design
• Increased Databricks maturity across the team through mentoring, patterns, and shared standards

We are looking for a Data Engineer who:

• Has strong, hands‑on experience with Azure Databricks.
• Has built and supported production Databricks pipelines, not just prototypes.
• Is very strong in SQL (complex transformations, modelling, performance optimisation).
• Has experience with:
  • Databricks DLT / Lakeflow pipelines
  • Unity Catalog (governance, permissions, environments)
  • Databricks SQL
• Is confident using Python and Spark for data engineering workloads.
• Has a strong understanding of:
  • Medallion architecture.
  • Lakehouse design principles.
  • Kimball dimensional modelling, including SCD patterns.
• Has experience integrating data from multiple operational systems, including non‑SQL sources such as REST APIs.
• Are comfortable owning Databricks design decisions and explaining trade‑offs to stakeholders.
• Enjoys mentoring others and helping uplift team capability.

NOTE: Experience in aged care or healthcare is welcome but not required.

This role is not for you if:

• Your Databricks experience is limited to light exposure or casual notebook use.
• You prefer working primarily with non‑Databricks tools and platforms.
• You are mainly a BI developer rather than a data engineer.
• You are seeking a role with minimal ownership or architectural responsibility.
• You are seeking a fully remote position (this role requires regular on‑site collaboration in Kenmore).

We are intentionally seeking someone who is comfortable taking ownership and helping move the organisation forward.

This is a role where your decisions, designs, and leadership will shape how data engineering is done at Churches of Christ for years to come.

We recognise that strong Databricks expertise is in high demand and are committed to offering a package that reflects senior capability, including not‑for‑profit salary packaging benefits.

Who we are – Churches of Christ

Churches of Christ is one of Australia’s largest and most diverse not-for-profit organisations, delivering a range of care and community services across Residential Aged Care, Home Care and Retirement Living, Foster and Kinship Care and, Housing Support for over 140 years. 

We are guided by our values of Integrity, Compassion, Excellence and Courage, and we welcome everyone, of all backgrounds and faiths, as we foster a diverse and inclusive community for our people.

Why Join Our Team 

• Transformative leadership and a high performing team culture. 
• Opportunities for career development, stretch assignments and progression. 
• A growing national not-for-profit organisation with purpose and community impact. 
• Work in an inclusive, down to earth & welcoming culture. 
• 5 weeks annual leave
• Hybrid / flexible working arrangements to support your work life balance.
• Free on-site parking + on-site café with staff discount (at the Kenmore head office). 
• Not for profit salary packaging up to $18,549 which could be used for up to $15,900 (for common living expenses like rent, mortgage, school fees and many more) and up to $2,650 for meals and entertainment.