We are looking for a Data Platform Lead to own the design, build, and governance of our enterprise data platform. This is a role within the Data COE, responsible for driving platform maturity across a federated, multi\-cloud environment. You will set engineering standards, eliminate data duplication and drift across domains, and enable reliable, governed data access \- without creating centralisation bottlenecks.
\- Design and evolve the enterprise data platform spanning Snowflake and Databricks across Azure and AWS
\- Build and maintain production\-grade ELT/ETL pipelines using Spark, dbt, Airflow, and Kafka
\- Define and enforce platform standards for ingestion, transformation, storage, and access across federated domain teams
\- Drive data quality, data contract adoption, and lineage visibility across the estate
\- Own cloud storage architecture across S3 and ADLS; lead CI/CD practices for all platform assets
\- Lead containerized workload deployment using Kubernetes for data platform services
\- Coordinate with domain teams to align on standards; represent platform engineering in architecture forums
\- Mentor mid\-level engineers and conduct technical design reviews for platform\-impacting changes
\- Snowflake \- expert\-level : data modelling, performance tuning, role\-based access, zero\-copy sharing, dynamic data masking
\- Databricks \- production experience : Delta Lake, Unity Catalog, cluster management, Databricks Workflows
\- Python and SQL \- strong proficiency; Scala advantageous
\- Apache Spark \- distributed data processing at scale
\- Apache Kafka \- real\-time event streaming, pipeline design, topic management
\- Apache Airflow \- pipeline orchestration, DAG design, dependency management
\- DBT \- transformation layer modelling, testing, documentation
\- Cloud storage \- S3 and ADLS; familiarity with Parquet, Delta, and partitioning strategies
\- Kubernetes \- container orchestration for data platform services
\- CI/CD \- GitHub Actions or equivalent for data platform assets (pipelines, schemas, infra)
Pay: ₹1,500,000\.00 per year
Work Location: In person
Senior DevOps Engineer
EquiLend · Bengaluru, Karnataka, India
Solution Architect
UST · Bengaluru, Karnataka, India
Cloud Identity Engineer
Atidan Technologies · India