GCP Senior Data Engineer
Join Our Community
Required Skills
Job Description
- *Job Summary**
- --------------
We are looking for a **Senior Data Engineer with deep expertise in Google Cloud Platform (GCP)** to design, build, and optimize scalable data ecosystems. This role is critical in enabling data\-driven decision\-making by developing high\-performance data pipelines, ensuring data reliability, and supporting enterprise\-wide analytics initiatives.
You will work closely with cross\-functional stakeholders including data scientists, analysts, and business teams to translate business requirements into robust data solutions.
- *Key Responsibilities**
- -----------------------
- *Data Engineering \& Architecture**
- Design, build, and maintain scalable and high\-performance **data pipelines** on GCP.
- Develop and manage modern **data architectures** to support batch and real\-time processing needs.
- Implement reusable frameworks to standardize data ingestion and transformation processes.
- *GCP\-Based Data Integration**
* Leverage **GCP services** such as
- + **Dataflow**
+ **Big Query**
+ **Pub/Sub**
+ **Cloud Storage**
+ **Cloud SQL / Fire store**
- Build and optimize data integration workflows ensuring efficiency and scalability.
- *Data Management \& Optimization**
- Optimize storage and query performance across GCP data platforms.
- Ensure cost optimization, performance tuning, and scalable data design.
- *Quality, Governance \& Security**
- Implement robust **data quality checks**, validation frameworks, and monitoring mechanisms.
- Ensure adherence to **data governance, security, and compliance standards**.
- *Collaboration \& Stakeholder Management**
- Partner with **data scientists, analysts, and business stakeholders** to understand requirements and deliver actionable insights.
- Translate business problems into technical data solutions.
- *Operations \& Reliability**
- Monitor, troubleshoot, and ensure **high availability and performance** of data pipelines.
- Implement logging, alerting, and observability frameworks.
- *Leadership \& Mentoring**
- Provide **technical leadership and mentorship** to junior engineers.
- Drive best practices in coding, architecture, and deployment.
- *Continuous Improvement**
- Stay updated with the latest **GCP innovations and data engineering best practices**.
- Proactively recommend improvements to enhance system performance and scalability.
- *Required Qualifications \& Skills**
- *Education \& Experience**
- Bachelor’s or master’s degree in computer science, IT, or related field
- **5\-6 \+ years** of experience in data engineering, with strong exposure to **GCP**
- *Skill Requirements**
- ---------------------
- *Core Technical Skills (Must Have)**
* Strong hands\-on experience with
- + **Dataflow, Big Query, Pub/Sub**
+ **Cloud Storage, Cloud SQL, Fire store**
* Expertise in
- + **ETL/ELT processes**
+ **Data warehousing \& data modeling**
* Strong programming skills
- + **Python, SQL**
- *Key Competencies**
- Strong analytical and problem\-solving skills
- Attention to detail and commitment to data accuracy
- Ability to work independently and in cross\-functional teams
- Excellent communication and stakeholder management skills
- *Preferred (Good\-to\-Have) Skills**
- GCP Certifications (Professional Data Engineer / Cloud Architect)
- Experience with **Big Data technologies** (Hadoop, Spark)
- Exposure to **Machine Learning / AI workflows**
Familiarity with **DevOps practices \& CI/CD pipelines**
- *Must Have Skill**
- ------------------
GCP BigQuery,GCP Dataflow,MS SQL,Python
- *Good to Have Skill**
- ---------------------
- *Other Requirements**
- ---------------------
- *Skill Evaluation Matrix**
- *Skill Area**
- *Mandatory**
- *Expected Proficiency (0–5\)**
Data Pipeline Architecture
Yes
5
GCP Services (Dataflow, Big Query, Pub/Sub etc.)
Yes
5
Data Integration
Yes
4
Data Storage Optimization
Yes
4
Data Quality \& Security
Yes
4
Programming (Python, SQL)
Yes
4
Stakeholder Collaboration
Yes
3
Monitoring \& Troubleshooting
Yes
3
Leadership \& Mentoring
Yes
3
ETL \& Data Warehousing
No
3
Big Data (Hadoop/Spark)
No
3
DevOps
No
2
- *Role Details**
- **Location:** Hyderabad / Chennai (Hybrid)
- **Positions Open:** 4
- **Travel:** Not required
- **Engagement Type:** Individual Contributor
- **Projects:** Enterprise Data \& AI engagements
Similar Jobs
- S
Java Backend Developer
SOLITAIRE INFOTECH · CH, IN
- S
Backend Developer
SAN LAK SERVICES PRIVATE LIMITED · Remote, IN
- C
Senior Backend Developer
Codemongoose Technology Pvt. Ltd. · MP, IN
Job Overview
- Job type
- Full-time
- Work mode
- On-site
- Location
- IN
- Posted
- 1d ago
- Source
- Indeed