Data Engineering Lead – Data, Cloud & AI

Our client is seeking a Data Engineering Lead – Data, Cloud & AI to architect and deliver modern cloud-based data platforms supporting analytics, AI, and machine learning workloads. This is a senior hands-on engineering role combining deep data engineering expertise with cloud and AI platform leadership.

Responsibilities & Qualifications

  • Contribute to and validate data and analytics architecture
  • Establish engineering standards and best practices across data platform initiatives
  • Design and build scalable data platforms using cloud-native services
  • Implement ingestion, transformation, and orchestration pipelines
  • Implement and support Data Product frameworks
  • Optimize platform performance and cost efficiency
  • Implement Infrastructure-as-Code and CI/CD pipeline integrations
  • Enable observability, reliability, and containerized workload standards
  • Enable ML pipelines and support model deployment and monitoring
  • Collaborate with data scientists and architects on feature engineering workflows

Requirements

  • 10+ years of data engineering experience
  • Strong Python and SQL skills
  • Experience with GCP data services (BigQuery, Dataflow, Vertex AI, Pub/Sub)
  • Experience with Snowflake or Databricks
  • Knowledge of ML workflows and platform engineering
  • Experience with streaming architectures
  • Experience with DevOps, automation, and Infrastructure-as-Code
  • Familiarity with AI/LLM code assist tools
  • Strong understanding of modern data modeling approaches