Senior Data Engineer

Our client is seeking a Senior Data Engineer with strong IBM DataStage expertise to design and build scalable ETL pipelines, focusing on file-based ingestion and transformation into SQL Server environments.

Responsibilities & Qualifications

  • Design and develop ETL pipelines using IBM InfoSphere DataStage
  • Build end-to-end data flows from file ingestion (CSV, fixed-width, etc.) to SQL Server tables
  • Perform data mapping, transformation logic, and validation based on business requirements
  • Optimize ETL performance using parallel job design, partitioning, and SQL tuning
  • Develop and maintain T-SQL queries, stored procedures, and data workflows
  • Implement robust logging, error handling, auditing, and reconciliation processes
  • Monitor, troubleshoot, and resolve data pipeline and ETL issues
  • Collaborate with cross-functional teams including data modelers, QA, and production support

Requirements

  • Strong hands-on experience with IBM DataStage (ETL development, transformations, job design)
  • Expertise in SQL Server with advanced T-SQL (joins, CTEs, performance tuning)
  • Experience with file-based data ingestion (CSV, fixed-width, delimited files)
  • Strong understanding of ETL design patterns, data validation, and data quality controls
  • Experience building restartable, scalable, and auditable ETL processes
  • Ability to troubleshoot end-to-end data issues across pipelines
  • Strong communication and documentation skills