Senior Databricks Engineer

About the Role
In this role, you will lead the modernization of the Databricks platform while fostering the adoption of advanced features. Your responsibilities will include designing and delivering Lakeflow jobs, pipelines, and scalable Lakehouse solutions. You will also focus on implementing and optimizing Unity Catalog, DQX, DB Genie, and AI/BI workloads. A significant part of your role will be to establish engineering best practices, governance, and automation frameworks. Additionally, you will mentor teams and guide technical decision-making across the organization.

Responsibilities

• Lead modernization of Databricks platform and adoption of advanced features.
• Design and deliver Lakeflow jobs, pipelines, and scalable Lakehouse solutions.
• Implement and optimize Unity Catalog, DQX, DB Genie, AI/BI workloads.
• Establish engineering best practices, governance, and automation frameworks.
• Mentor teams and guide technical decision-making across the organization.

Requirements

• 6 plus years in data/platform engineering with deep Databricks expertise.
• Strong hands-on experience with Pyspark, Streaming, DBR, Lakeflow, UC, DQX, DB Genie, Delta Lake.
• Experience in ADF, Synapse and exposure to Azure DevOps.
• Proven leadership in large-scale Databricks or Lakehouse transformation projects.
• Strong out-of-the-box thinking, problem-solving, and deliverables leadership.