Azure Data Engineer

Company Profile

At CGI, we’re a team of builders. We call our employees members because all who join CGI are building their own company \- one that has grown to 72,000 professionals located in 40 countries. Founded in 1976, CGI is a leading IT and business process services firm committed to helping clients succeed. We have the global resources, expertise, stability and dedicated professionals needed to achieve. At CGI, we’re a team of builders. We call our employees members because all who join CGI are building their own company \- one that has grown to 72,000 professionals located in 40 countries. Founded in 1976, CGI is a leading IT and business process services firm committed to helping clients succeed. We have the global resources, expertise, stability and dedicated professionals needed to achieve results for our clients \- and for our members. Come grow with us. Learn more at www.cgi.com.

This is a great opportunity to join a winning team. CGI offers a competitive compensation package with opportunities for growth and professional development. Benefits for full\-time, permanent members start on the first day of employment and include a paid time\-off program and profit participation and stock purchase plans. We wish to thank all applicants for their interest and effort in applying for this position, however, only candidates selected for interviews will be contacted. No unsolicited agency referrals please.

Job Title: Azure Data Engineer

Position: Senior Systems Engineer

Experience: 6\+ Years

Category: Software Development/ Engineering

Main location: Bangalore

Job Code: J1026\-2597

Employment Type: Full Time

Job Description

We are looking for an experienced Azure ETL Data Engineer with strong hands\-on expertise in designing, developing, and implementing scalable ETL pipelines and data integration solutions on the Microsoft Azure platform.

The candidate should have experience in Azure Data Factory, Azure Databricks, Azure Data Lake Storage, Azure SQL Database, and Azure Synapse Analytics, along with strong programming skills in Python, PySpark, Spark, and SQL.

The role involves migrating data from SQL Server to Azure, developing efficient data pipelines, implementing data transformation processes, and ensuring high\-quality data delivery. The candidate should be comfortable working in an Agile environment and managing end\-to\-end development activities from design through deployment and production support.

Key Responsibilities

• Design, develop, and implement scalable ETL/ELT pipelines using Azure Data Factory and Azure Databricks.
• Develop and maintain data integration and migration solutions from SQL Server to the Azure cloud platform.
• Build data transformation and processing workflows using Python, PySpark, Spark, and SQL.
• Work with Azure Data Lake Storage (ADLS), Azure SQL Database, and Azure Synapse Analytics for data storage and processing.
• Design and implement data models, including relational and dimensional data models.
• Optimize ETL workflows, SQL queries, and data pipelines to improve performance and efficiency.
• Implement data orchestration, scheduling, monitoring, and error\-handling mechanisms within Azure.
• Participate in end\-to\-end development activities, including requirement analysis, design, development, testing, deployment, and production support.
• Perform peer code reviews and ensure adherence to coding standards, architecture guidelines, and development best practices.
• Collaborate with cross\-functional teams, participate in Agile/Scrum ceremonies, and maintain technical documentation.
• Support testing cycles, production deployments, and troubleshooting of data pipeline issues.

Experience \& Qualifications

• 5–7 years of overall experience in Data Engineering / ETL development.
• Minimum 3\+ years of hands\-on experience in Microsoft Azure Data Engineering.
• Strong hands\-on experience in:

o Azure Data Factory (ADF)

o Azure Databricks

o Azure Data Lake Storage (ADLS)

o Azure SQL Database

o Azure Synapse Analytics

• Strong programming experience in Python, PySpark, and Spark.
• Strong SQL Server and T\-SQL knowledge, including SSIS.
• Experience in designing, developing, and maintaining ETL/ELT pipelines.
• Good understanding of data modelling, relational modelling, and dimensional modelling.
• Experience in handling structured and semi\-structured data formats such as JSON, XML, and CSV.
• Knowledge of database systems such as MS SQL Server and Oracle.
• Experience in data migration from SQL Server to Azure.
• Understanding of Azure data orchestration and workflow management.
• Knowledge of source code management and deployment tools such as Git and Jenkins.
• Experience in data file movement and integration through mailbox or other connectivity mechanisms.
• Bachelor's degree or equivalent technical qualification.

Preferred Skills

• Microsoft Azure Data Engineer certification (DP\-203 or equivalent).
• Exposure to Sqoop, Hadoop, and Shell scripting.
• Knowledge of Java and Scala programming.
• Experience working in Agile/Scrum development environments.
• Familiarity with JIRA, Confluence, and Microsoft Teams.
• Experience with Datadog for monitoring and observability.
• Knowledge of PowerShell scripting.
• Experience in CI/CD pipelines, automated deployments, and release management.
• Good understanding of cloud data architecture and performance optimization.

\#LI\-SA2

Note: This job description is a general outline of the responsibilities and qualifications typically associated with the Virtualization Specialist role. Actual duties and qualifications may vary based on the specific needs of the organization.

CGI is an equal opportunity employer. In addition, CGI is committed to providing accommodations for people with disabilities in accordance with provincial legislation. Please let us know if you require a reasonable accommodation due to a disability during any aspect of the recruitment process and we will work with you to address your needs.**Your future duties and responsibilities**

• *Required qualifications to be successful in this role**

• *Together, as owners, let’s turn meaningful insights into action.**

Life at CGI is rooted in ownership, teamwork, respect and belonging. Here, you’ll reach your full potential because…

You are invited to be an owner from day 1 as we work together to bring our Dream to life. That’s why we call ourselves CGI Partners rather than employees. We benefit from our collective success and actively shape our company’s strategy and direction.

Your work creates value. You’ll develop innovative solutions and build relationships with teammates and clients while accessing global capabilities to scale your ideas, embrace new opportunities, and benefit from expansive industry and technology expertise.

You’ll shape your career by joining a company built to grow and last. You’ll be supported by leaders who care about your health and well\-being and provide you with opportunities to deepen your skills and broaden your horizons.

That same commitment to fairness extends to how we use technology. To support our recruitment team, AI tools may be used to help assess applications though they never replace human judgement. All hiring decisions remain entirely in the hands of our recruitment professionals.

Come join our team—one of the largest IT and business consulting services firms in the world.