Our client is seeking a Senior Data Engineer with strong IBM DataStage expertise to design and build scalable ETL pipelines, focusing on file-based ingestion and transformation into SQL Server environments.
Responsibilities & Qualifications
- Design and develop ETL pipelines using IBM InfoSphere DataStage
- Build end-to-end data flows from file ingestion (CSV, fixed-width, etc.) to SQL Server tables
- Perform data mapping, transformation logic, and validation based on business requirements
- Optimize ETL performance using parallel job design, partitioning, and SQL tuning
- Develop and maintain T-SQL queries, stored procedures, and data workflows
- Implement robust logging, error handling, auditing, and reconciliation processes
- Monitor, troubleshoot, and resolve data pipeline and ETL issues
- Collaborate with cross-functional teams including data modelers, QA, and production support
Requirements
- Strong hands-on experience with IBM DataStage (ETL development, transformations, job design)
- Expertise in SQL Server with advanced T-SQL (joins, CTEs, performance tuning)
- Experience with file-based data ingestion (CSV, fixed-width, delimited files)
- Strong understanding of ETL design patterns, data validation, and data quality controls
- Experience building restartable, scalable, and auditable ETL processes
- Ability to troubleshoot end-to-end data issues across pipelines
- Strong communication and documentation skills



