Senior Databricks Developer with AI Expertise

\# DLTJP00064354 – Senior Databricks Developer with AI Expertise

\*\*Experience:\*\* 8\+ Years Overall (7\+ Years Relevant in Databricks)

\*\*Number of Positions:\*\* 1

\*\*Role Type:\*\* Individual Contributor (IC)

\*\*Work Locations:\*\* Hyderabad / Bangalore

\*\*Work Mode:\*\* Hybrid (Initially 5 Days Work from Office)

\*\*Interview Rounds:\*\* 2 Rounds

\*\*Interview Mode:\*\* Virtual

\*\*Rate Card:\*\* Maximum ₹2,000/hour

\#\# Position Summary

We are looking for a Senior Databricks Developer with deep expertise in Azure\-based data engineering and hands\-on experience designing, developing, and deploying enterprise AI, Large Language Model (LLM), and Generative AI solutions.

The role involves leading the design, architecture, and implementation of modern data platforms and AI solutions, including enterprise chatbots, conversational AI, automated executive reporting, AI\-driven data quality monitoring, and intelligent workflow automation.

\#\# Key Responsibilities

\- Design and build scalable, efficient, and reliable data pipelines to extract, transform, and load (ETL) data from various sources into data lakes or data warehouses.

\- Provide leadership on migration from Hadoop to Azure and guide data utilization across multiple portfolios, including AI and Generative AI capabilities in modern data platforms.

\- Develop and implement data models that optimize data storage, retrieval, and analysis.

\- Integrate data from databases, APIs, streaming platforms, third\-party systems, and AI/LLM\-enabled applications.

\- Perform data transformation, cleansing, preprocessing, and enrichment to ensure data quality and readiness for analytics, machine learning, and AI solutions.

\- Design and maintain data warehouses and data lakes for structured and unstructured data.

\- Implement data governance and security practices to protect sensitive data, ensure privacy, and support compliance with regulations such as GDPR and CCPA, including governance for AI and Generative AI solutions.

\- Monitor and optimize data processing and query performance, resolving bottlenecks to improve data retrieval, AI model performance, and analytical efficiency.

\- Collaborate with data analysts, data scientists, and AI engineering teams to provide reliable datasets for analytics, machine learning, and Generative AI initiatives.

\- Lead the design, architecture, and implementation of enterprise AI, Generative AI, and LLM solutions, including conversational AI, automated executive reporting, intelligent workflow automation, and AI\-driven data quality monitoring.

\#\# Mandatory Skills and Experience

\- 8\+ years of total experience, including 7\+ years of relevant Databricks experience.

\- Experience with Azure Cloud and Azure Databricks.

\- Strong programming and scripting skills in SQL, Spark, Scala, and/or Python.

\- Hands\-on experience designing, developing, and deploying enterprise AI, LLM, and Generative AI solutions.

\- Experience with Azure OpenAI, OpenAI, or similar LLM platforms.

\- Knowledge of prompt engineering, Retrieval\-Augmented Generation (RAG), vector databases, embeddings, and semantic search.

\- Experience with Jira, GitHub, and DevOps tools.

\- Familiarity with MLOps/LLMOps practices for AI deployment and lifecycle management.

\- Experience with data integration and ETL processes.

\- Knowledge of data modeling, dimensional modeling, and database schema design.

\- Experience with big data technologies and platforms.

\- Experience leading and implementing AI initiatives, including enterprise chatbots, conversational AI, AI\-powered leadership reporting, data quality monitoring, anomaly detection, and intelligent process automation.

\- Experience integrating AI and Generative AI capabilities with Databricks, enterprise data platforms, and cloud\-native services.

\- Understanding of data governance, data security, Responsible AI principles, and compliance requirements.

\- Strong problem\-solving, analytical thinking, communication, and collaboration skills.

\#\# Additional Technical Skills

\- \*\*Data Integration and ETL:\*\* Apache Kafka, Apache Spark, Apache Airflow, or Talend.

\- \*\*Big Data Technologies:\*\* Apache Hadoop, Apache Hive, Apache HBase, or Apache Cassandra.

\- \*\*Cloud Platforms:\*\* Cloud services for data storage, processing, analytics, and AI workloads.

\- \*\*AI and Data Engineering:\*\* ETL pipeline development, scripting, automation, and AI solution integration.

\- \*\*DevOps and AI Operations:\*\* Jira, GitHub, DevOps tools, MLOps, and LLMOps.

\#\# Ideal Candidate

The ideal candidate is a Senior Databricks Developer with deep expertise in Azure\-based data engineering and a proven track record of leading and hands\-on implementing enterprise AI, LLM, and Generative AI solutions, including chatbots, automated executive reporting, AI\-driven data quality monitoring, and intelligent data platform capabilities.

Pay: Up to ₹3,000,000\.00 per year

Work Location: Hybrid remote in Bangalore City, Bengaluru, Karnataka