Jobs
H

GCP Senior Data Engineer

HCLTechIN1d ago
Full-timevia indeed

Required Skills

ci/cdgcpmachine learningpythonsql

Job Description

  • *Job Summary**
  • --------------

We are looking for a **Senior Data Engineer with deep expertise in Google Cloud Platform (GCP)** to design, build, and optimize scalable data ecosystems. This role is critical in enabling data\-driven decision\-making by developing high\-performance data pipelines, ensuring data reliability, and supporting enterprise\-wide analytics initiatives.

You will work closely with cross\-functional stakeholders including data scientists, analysts, and business teams to translate business requirements into robust data solutions.

  • *Key Responsibilities**
  • -----------------------
  • *Data Engineering \& Architecture**
  • Design, build, and maintain scalable and high\-performance **data pipelines** on GCP.
  • Develop and manage modern **data architectures** to support batch and real\-time processing needs.
  • Implement reusable frameworks to standardize data ingestion and transformation processes.
  • *GCP\-Based Data Integration**

* Leverage **GCP services** such as

  • + **Dataflow**

+ **Big Query**

+ **Pub/Sub**

+ **Cloud Storage**

+ **Cloud SQL / Fire store**

  • Build and optimize data integration workflows ensuring efficiency and scalability.
  • *Data Management \& Optimization**
  • Optimize storage and query performance across GCP data platforms.
  • Ensure cost optimization, performance tuning, and scalable data design.
  • *Quality, Governance \& Security**
  • Implement robust **data quality checks**, validation frameworks, and monitoring mechanisms.
  • Ensure adherence to **data governance, security, and compliance standards**.
  • *Collaboration \& Stakeholder Management**
  • Partner with **data scientists, analysts, and business stakeholders** to understand requirements and deliver actionable insights.
  • Translate business problems into technical data solutions.
  • *Operations \& Reliability**
  • Monitor, troubleshoot, and ensure **high availability and performance** of data pipelines.
  • Implement logging, alerting, and observability frameworks.
  • *Leadership \& Mentoring**
  • Provide **technical leadership and mentorship** to junior engineers.
  • Drive best practices in coding, architecture, and deployment.
  • *Continuous Improvement**
  • Stay updated with the latest **GCP innovations and data engineering best practices**.
  • Proactively recommend improvements to enhance system performance and scalability.
  • *Required Qualifications \& Skills**
  • *Education \& Experience**
  • Bachelor’s or master’s degree in computer science, IT, or related field
  • **5\-6 \+ years** of experience in data engineering, with strong exposure to **GCP**
  • *Skill Requirements**
  • ---------------------
  • *Core Technical Skills (Must Have)**

* Strong hands\-on experience with

  • + **Dataflow, Big Query, Pub/Sub**

+ **Cloud Storage, Cloud SQL, Fire store**

* Expertise in

  • + **ETL/ELT processes**

+ **Data warehousing \& data modeling**

* Strong programming skills

  • + **Python, SQL**
  • *Key Competencies**
  • Strong analytical and problem\-solving skills
  • Attention to detail and commitment to data accuracy
  • Ability to work independently and in cross\-functional teams
  • Excellent communication and stakeholder management skills
  • *Preferred (Good\-to\-Have) Skills**
  • GCP Certifications (Professional Data Engineer / Cloud Architect)
  • Experience with **Big Data technologies** (Hadoop, Spark)
  • Exposure to **Machine Learning / AI workflows**

Familiarity with **DevOps practices \& CI/CD pipelines**

  • *Must Have Skill**
  • ------------------

GCP BigQuery,GCP Dataflow,MS SQL,Python

  • *Good to Have Skill**
  • ---------------------
  • *Other Requirements**
  • ---------------------
  • *Skill Evaluation Matrix**
  • *Skill Area**
  • *Mandatory**
  • *Expected Proficiency (0–5\)**

Data Pipeline Architecture

Yes

5

GCP Services (Dataflow, Big Query, Pub/Sub etc.)

Yes

5

Data Integration

Yes

4

Data Storage Optimization

Yes

4

Data Quality \& Security

Yes

4

Programming (Python, SQL)

Yes

4

Stakeholder Collaboration

Yes

3

Monitoring \& Troubleshooting

Yes

3

Leadership \& Mentoring

Yes

3

ETL \& Data Warehousing

No

3

Big Data (Hadoop/Spark)

No

3

DevOps

No

2

  • *Role Details**
  • **Location:** Hyderabad / Chennai (Hybrid)
  • **Positions Open:** 4
  • **Travel:** Not required
  • **Engagement Type:** Individual Contributor
  • **Projects:** Enterprise Data \& AI engagements

Similar Jobs

Browse all jobs

Job Overview

Job type
Full-time
Work mode
On-site
Location
IN
Posted
1d ago
Source
Indeed