Databricks Data Engineer

Databricks Data Engineer

• *Experience:** 6\+ Years

Job Overview

We are seeking an experienced Databricks Data Engineer to design, develop, optimize, and maintain scalable data solutions. The ideal candidate should have strong hands\-on experience with Databricks, Apache Spark, ETL/ELT pipelines, and cloud\-based data platforms.

Key Responsibilities

• Design, develop, and maintain scalable ETL/ELT data pipelines.
• Build and optimize end\-to\-end data workflows, including data ingestion, transformation, and reporting.
• Develop and manage large\-scale data processing solutions using Databricks and Apache Spark (PySpark/Scala).
• Optimize data pipelines for performance, reliability, scalability, and cost efficiency.
• Implement data architecture best practices and governance standards.
• Work with cloud platforms such as Azure, AWS, or GCP.
• Support reporting and analytics requirements through Power BI or Tableau integrations.
• Troubleshoot and resolve data platform performance issues.
• Ensure production readiness, monitoring, and stability of data solutions.
• Collaborate with business and technical stakeholders to deliver high\-quality data products.

Required SkillsTechnical Skills

• Databricks
• Apache Spark (PySpark and/or Scala)
• ETL/ELT Pipeline Development
• Data Engineering \& Data Architecture
• Large\-Scale Data Processing
• Data Pipeline Optimization \& Production Hardening
• Performance Tuning \& Cost Optimization
• End\-to\-End Data Workflow Development
• Power BI or Tableau
• AWS, Azure, or GCP
• Data Governance, Security \& Best Practices

Experience Requirements

• 6\+ years of experience in Data Engineering.
• Strong hands\-on experience with Databricks.
• Experience stabilizing, optimizing, and scaling enterprise data platforms.
• Experience working with large datasets and distributed processing frameworks.
• Ability to work independently in fast\-paced environments.
• Strong problem\-solving and analytical skills.

Preferred Qualifications

• Experience with Delta Lake and Data Lakehouse architecture.
• Experience implementing data quality and governance frameworks.
• Exposure to CI/CD and DevOps practices for data platforms.

Pay: ₹39,356\.57 \- ₹80,829\.63 per month

Application Question(s)

• Which cloud platforms have you worked on? (AWS/Azure/GCP)
• How many years of experience do you have with PySpark or Apache Spark?

Experience

• IT: 5 years (Required)
• Data Bricks: 3 years (Required)

Work Location: In person