Jobs
Y

Azure Databricks Engineer

Your's EfficientlyTN, IN1d ago
Full-timevia indeed

Required Skills

agileazureci/cdgitpower bipythonsql

Job Description

Key Responsibilities \* Design, develop, and maintain data pipelines using Azure Databricks, PySpark, and SQL. \* Build and optimize ETL/ELT workflows for processing structured and unstructured data. \* Work with Azure Data Factory, Azure Data Lake Storage (ADLS), and Azure Synapse Analytics. \* Implement data transformations, data quality checks, and performance optimization. \* Develop and manage Delta Lake tables and implement incremental data processing. \* Ensure data security, governance, reliability, and pipeline monitoring. \* Collaborate with data architects, analysts, and business stakeholders to deliver data solutions. Required Skills \* 5 years of experience in data engineering, with hands\-on Azure Databricks experience. \* Strong proficiency in Python, PySpark, and SQL. \* Experience with Apache Spark, Delta Lake, and ETL/ELT development. \* Good knowledge of Azure Data Factory, ADLS Gen2, and Azure cloud services. \* Experience in performance tuning, troubleshooting, and data pipeline optimization. \* Familiarity with Git, CI/CD pipelines, and Agile methodologies. Preferred Skills \* Experience with Azure DevOps, Unity Catalog, and data governance. \* Knowledge of data warehousing concepts and dimensional modelling. \* Exposure to Azure Synapse Analytics, Power BI, or Microsoft Fabric.

Pay: ₹50,000\.00 \- ₹1,880,000\.00 per month

Work Location: In person

Similar Jobs

Browse all jobs

Job Overview

Job type
Full-time
Work mode
On-site
Location
Chennai
Posted
1d ago
Source
Indeed