Databricks Administrator

About the Role

We are looking for a skilled and experienced Databricks Administrator to manage, optimize, and secure enterprise-scale Azure Databricks environments supporting mission-critical financial services workloads. The ideal candidate will be responsible for maintaining high availability, performance, and governance standards across Databricks workspaces, clusters, and integrations while driving automation and operational excellence.

Key Responsibilities

Environment Administration : Configure, manage, and maintain Databricks workspaces, clusters, jobs, and notebooks for enterprise data and analytics workloads.

Security & Access Management : Implement role-based access controls (RBAC), user provisioning, and workspace permissions aligned with corporate and regulatory security standards.

Performance Optimization : Monitor cluster utilization, troubleshoot performance bottlenecks, and ensure cost-efficient resource allocation.

Integrations : Manage seamless integration between Databricks and Azure services such as Azure Data Factory (ADF) , Synapse Analytics , Data Lake , Key Vault , and SQL Server .

Governance & Compliance : Ensure adherence to organizational data governance, security, and compliance policies within the financial services domain.

Automation & DevOps : Automate provisioning, monitoring, and maintenance tasks using Terraform , CI / CD pipelines , and REST APIs .

Collaboration : Work closely with Data Engineering, Analytics, and Cybersecurity teams to deliver robust and secure data platforms.

Documentation : Develop and maintain operational documentation, standard operating procedures (SOPs), and architectural best practices.

Required Qualifications

Minimum 6+ years of experience in Data Engineering, Cloud Administration, or Data Platform Management.

At least 2+ years of hands-on experience in Databricks Administration .

Proven expertise in Azure Databricks and related Azure ecosystem services (ADF, Synapse, Data Lake, Key Vault).

Strong command of SQL , Python , and / or PySpark for troubleshooting and validation.

In-depth understanding of IAM , RBAC , and workspace security models.

Experience with Terraform , CI / CD pipelines , and DevOps automation .

Knowledge of data governance , compliance , and security best practices in financial or regulated environments.

Excellent analytical, troubleshooting, and stakeholder communication skills.

Preferred Qualifications

Prior experience working in financial services or banking environments.

Exposure to Databricks Unity Catalog for governance and access control.

Relevant Microsoft Azure Certifications , such as :

DP-203 : Azure Data Engineer Associate

AZ-305 : Azure Solutions Architect Expert

Familiarity with monitoring and logging tools such as Azure Monitor , Log Analytics , or Splunk .

Education

Bachelor’s or master’s degree in computer science, Data Engineering , Information Systems , or a related discipline.

Why Join Us

Opportunity to work on cutting-edge data platforms within a global financial ecosystem.

Exposure to automation, governance, and AI-driven data engineering initiatives.

Collaborative, growth-oriented culture with continuous learning and upskilling opportunities.