Our client, a top tier Management & Strategy Consulting firm if looking for a qualified Data Engineer. The ideal candidate will possess in-depth expertise in data integration, and transformation using Azure Data Factory, Data Flow, SQL Server, ETL processes, and data modelling. This role requires a highly skilled professional who can design and implement complex data solutions that drive business intelligence and analytics.
Essential Requirements and Responsibilities :
· Design, develop, and maintain robust ETL processes to integrate data from various sources into the data warehouse using Azure Data Factory and Data Flow.
· Ensure data quality and integrity throughout the ETL process
· Develop and maintain comprehensive data models and database structures on SQL Server.
· Implement best practices for data warehousing, including normalization, indexing, and query optimization.
· Design and build scalable, high-performance data solutions that meet business requirements.
· Create views and sql scripts to Power BI based reporting.
· Optimize and tune SQL queries, stored procedures, and data flows for maximum performance and efficiency.
· Monitor system performance and troubleshoot data-related issues as they arise.
· Collaborate with data analysts, data scientists, and business users to understand their data needs and provide technical support.
· Maintain comprehensive documentation of data processes, workflows, and system architecture.
· Ensure compliance with data governance policies and procedures.
· Minimum of 5-7 years of experience in data development, with a strong focus on Azure Data Factory, Data Flow, SQL Server, ETL, data modelling, and basic knowledge of Power BI.
· Proficient in Azure Data Factory, Data Flow, and other Azure data services.
· Extensive experience with SQL Server, including T-SQL, stored procedures, and performance tuning.
· Strong knowledge of ETL concepts and tools.
· Expertise in data modelling techniques and best practices.
· Experience with other Azure services such as Azure SQL Database, Azure Data Lake, and Azure Synapse Analytics.
· Familiarity with other BI tools and platforms a plus.
· Certifications in Azure or other relevant technologies a plus
Essential Requirements and Responsibilities :
· Design, develop, and maintain robust ETL processes to integrate data from various sources into the data warehouse using Azure Data Factory and Data Flow.
· Ensure data quality and integrity throughout the ETL process
· Develop and maintain comprehensive data models and database structures on SQL Server.
· Implement best practices for data warehousing, including normalization, indexing, and query optimization.
· Design and build scalable, high-performance data solutions that meet business requirements.
· Create views and sql scripts to Power BI based reporting.
· Optimize and tune SQL queries, stored procedures, and data flows for maximum performance and efficiency.
· Monitor system performance and troubleshoot data-related issues as they arise.
· Collaborate with data analysts, data scientists, and business users to understand their data needs and provide technical support.
· Maintain comprehensive documentation of data processes, workflows, and system architecture.
· Ensure compliance with data governance policies and procedures.
· Minimum of 5-7 years of experience in data development, with a strong focus on Azure Data Factory, Data Flow, SQL Server, ETL, data modelling, and basic knowledge of Power BI.
· Proficient in Azure Data Factory, Data Flow, and other Azure data services.
· Extensive experience with SQL Server, including T-SQL, stored procedures, and performance tuning.
· Strong knowledge of ETL concepts and tools.
· Expertise in data modelling techniques and best practices.
· Experience with other Azure services such as Azure SQL Database, Azure Data Lake, and Azure Synapse Analytics.
· Familiarity with other BI tools and platforms a plus.
· Certifications in Azure or other relevant technologies a plus
