Databricks Architect

Our client is seeking an experienced Databricks Architect to design, deploy, and secure cloud data platforms on AWS. This role focuses on enterprise-scale workspace architecture, infrastructure-as-code implementation, and cross-functional technical leadership.

Responsibilities & Qualifications

  • Design and deploy Databricks classic and serverless workspaces on AWS, with expertise in networking, storage, and identity integration
  • Author and maintain Terraform modules to provision and manage AWS and Databricks resources in a repeatable, secure, and automated manner
  • Define and implement comprehensive platform security architecture, including workspace isolation, cluster access controls, secrets management, and network security patterns
  • Lead architecture enablement sessions and workshops with large, cross-functional customer teams to translate requirements into technical solutions
  • Guide customer teams through Databricks security accreditation and compliance processes
  • Partner with customer cloud, security, network, and platform engineering teams to validate architecture decisions and resolve deployment issues
  • Produce clear, professional architecture documentation, diagrams, and runbooks for platform configurations

Requirements

  • 10+ years of experience in cloud platform engineering, data architecture, or infrastructure design
  • Deep expertise with Databricks platform architecture and both classic and serverless deployment models
  • Advanced AWS knowledge, including IAM, VPC design, S3, PrivateLink, private endpoints, security groups, and network ACLs
  • Strong Terraform experience for infrastructure-as-code and cloud resource management
  • Demonstrated expertise in identity and SSO integration, workspace isolation, and cluster access control patterns
  • Knowledge of network security, secrets management, and secure architecture patterns in cloud environments
  • Excellent technical communication and documentation skills; ability to explain complex architecture to diverse stakeholder groups