Jobs
I

Data Eng (ETL)

Induansh Private LimitedRemote1d ago
RemoteFull-timevia indeed

Required Skills

azureci/cddockergitgithub actionskafkakubernetesllmpythonsqlterraform

Job Description

Data Engineer (ETL) \| AI/ML \& Azure Data Platform

  • *Experience:** 7–8 Years
  • *Employment Type:** C2C / C2H
  • *Location:** Hybrid (Pan India)
  • *Shift:** 11:00 AM – 9:00 PM IST

Job Summary

We are seeking an experienced **Data Engineer** with expertise in **ETL/ELT development, Azure Data Platform, Python, Apache Spark, and AI/ML**. The ideal candidate will build scalable data pipelines, cloud\-native data solutions, and integrate AI/LLM capabilities into enterprise data platforms.

Key Responsibilities

  • Design and optimize ETL/ELT pipelines.
  • Develop scalable data processing solutions using Python and PySpark.
  • Build data lakes and warehouses using Azure Databricks and Snowflake.
  • Develop Azure Functions and integrate Azure Service Bus.
  • Automate infrastructure using Terraform and CI/CD pipelines.
  • Collaborate with AI/ML teams to integrate LLMs into data workflows.
  • Ensure data quality, scalability, and production support.

Required Skills

  • Data Engineering \& ETL/ELT
  • Python
  • Apache Spark (PySpark \& Spark SQL)
  • Azure Databricks (Unity Catalog)
  • Snowflake
  • Azure Functions \& Azure Service Bus
  • SQL
  • Terraform
  • Git, GitHub Actions, Artifactory \& SonarQube
  • AI/ML \& LLM Integration (Mandatory)

Preferred Skills

Azure Data Factory, Azure Synapse, Delta Lake, MLflow, Azure DevOps, Kafka, Docker, Kubernetes, Microsoft Fabric.

Qualifications

  • Bachelor's or Master's degree in Computer Science, IT, Engineering, or a related field.
  • 7–8 years of Data Engineering experience with Azure cloud services.
  • Strong analytical, problem\-solving, and communication skills.

Pay: ₹90,000\.00 \- ₹100,000\.00 per month

Experience

  • Azure: 7 years (Required)
  • Snowflake: 4 years (Required)
  • ETL: 5 years (Required)
  • AI/ML Integration: 3 years (Required)
  • Python: 3 years (Required)

Work Location: Hybrid remote in Pune, Maharashtra (Pune District)

Similar Jobs

Browse all jobs

Job Overview

Job type
Full-time
Work mode
Remote
Location
Anywhere in India
Posted
1d ago
Source
Indeed