Jobs
H

Technical Lead

HCLTechMH, IN1d ago
Full-timevia indeed

Required Skills

azurepythonsqltableau

Job Description

Pune, Maharashtra

Job Summary

Data Engineer (Databricks) designs and maintains scalable, reliable data pipelines that transform raw data into analytics‑ready datasets for reporting and decision‑making. The role ensures high data quality, security, and performance across cloud‑based ETL workflows, while collaborating closely with analytics and business teams to enable trusted, data‑driven insights

Key Responsibilities

Design, develop, and maintain scalable data pipelines and ETL processes

Implement ETL processes to ingest, transform, and load data from various sources

Ensure data quality, security, and compliance

Optimize and fine\-tune data systems for performance and scalability

Develop and document data architecture and processes

Collaborate with data scientists and analysts to understand data requirements

Work closely with cross\-functional teams to support data\-driven decision\-making

Monitor and troubleshoot data pipeline issues

Troubleshoot and resolve data\-related issues and support users

Monitor ETL processes, proactively identifying and resolving issues or performance bottlenecks to maintain high system reliability.

Review data transformation and ingestion patterns, including CDC, schema evolution, and error handling for robust data operations.

Document ETL workflows, data mappings, and process changes to ensure transparency and clear communication across technical and non\-technical teams.

Stay updated with the latest features and best practices

Skill Requirements

Degree in Computer Science, Data Engineering, Information Technology or a related field

A minimum of 5 years of professional experience in data engineering or a related role

Proven experience as a Data Engineer with a focus on Databricks

Strong programming skills in SQL and Python

Experience with cloud computing platforms (preferably Microsoft Azure)

Ideally Experience with data virtualization tools (Denodo or Tableau)

Strong problem\-solving and analytical skills

Proficiency in CDC ingestion patterns (watermarks, change tables, log\-based ingestion).

Advanced error handling \& observability

Excellent communication and teamwork abilities

A passion for working with data and a desire to continuously learn and improve

Excellent English skills. German skills are a bonus

Microsoft Azure or Databricks certifications are a plus

Other Requirements

  • *4 \= Enable:** Performs diverse complex activities, supports and guides others, delegates tasks when appropriate, works autonomously under general direction, and contributes expertise to deliver team objectives
  • *\#body.unify div.unify\-button\-container .unify\-apply\-now:** focus, \#body.unify div.unify\-button\-container .unify\-apply\-\#body.unify div.unify\-button\-container .unify\-apply\-now: focus, \#body.unify div.unify\-button\-container .unify\-apply\-

Similar Jobs

Browse all jobs

Job Overview

Job type
Full-time
Work mode
On-site
Location
Mumbai
Posted
1d ago
Source
Indeed