Our client is seeking an experienced Databricks Platform Architect to design, deploy, configure, and secure enterprise Databricks environments on AWS. This role is primarily focused on Databricks platform architecture, Infrastructure-as-Code (Terraform), and enterprise platform engineering. Strong AWS networking expertise is beneficial but is not the primary focus of the role.
Responsibilities & Qualifications
- Design, configure, deploy, and secure Databricks platforms on AWS, including both Classic and Serverless Workspaces
- Architect enterprise Databricks environments, including workspace configuration, identity integration, cluster policies, secret management, and platform governance
- Author and maintain Terraform modules to provision and manage Databricks and AWS infrastructure using Infrastructure-as-Code (IaC)
- Implement secure platform architecture, including workspace isolation, IAM/SSO integration, cluster access controls, secret scopes, and secure connectivity patterns
- Partner with cloud, security, and platform engineering teams to design, validate, and deploy scalable Databricks solutions
- Produce architecture documentation, diagrams, standards, and operational runbooks
- Provide technical leadership, architecture guidance, and best practices for enterprise Databricks platform deployments
Required Skills
- 10+ years of experience in Cloud Platform Engineering, Data Platform Architecture, Infrastructure Engineering, or similar roles
- Deep hands-on experience with Databricks Platform Architecture, including deployment, configuration, security, and administration
- Experience designing and supporting both Classic and Serverless Databricks Workspaces
- Strong experience with Terraform and Infrastructure-as-Code (IaC)
- Experience with Databricks platform security, including:
- Workspace architecture
- Identity & SSO integration
- IAM integration
- Cluster policies
- Secret management / Secret Scopes
- Workspace isolation and governance
- Working knowledge of AWS infrastructure, including IAM, VPC, S3, PrivateLink, networking, routing, and identity integration required to deploy and support Databricks environments
- Strong troubleshooting, architecture, and technical documentation skills
- Excellent communication skills with the ability to work directly with customers, architects, and cross-functional engineering teams
Nice to Have
- Advanced AWS networking experience (VPC design, PrivateLink, Security Groups, NACLs, routing, etc.)
- Experience with Databricks security accreditation, governance, and compliance initiatives
- Experience building reusable Terraform modules and enterprise platform automation
- Experience leading architecture workshops and customer enablement sessions
