Lead Data Engineer – GCP \| Dataflow \| Java \| BigQuery
● Work Mode: Hybrid (2\-3 Day work from Office)
● Location: Chennai / Bangalore / Coimbatore/Pune
● Experience: 7\-10 Years
● Contract Duration: 1 year
We are looking for a highly skilled Senior Data Engineer with strong expertise in Google Cloud
Platform (GCP), Apache Beam/Dataflow, Java, and BigQuery. The ideal candidate will be
responsible for designing, building, and optimizing scalable data pipelines and cloud\-based data
processing solutions for enterprise applications.
● Design and develop scalable ETL/ELT pipelines using GCP services.
● Build and maintain real\-time and batch data processing pipelines using Dataflow and
Apache Beam.
● Develop robust backend processing solutions using Java.
● Work extensively with BigQuery for data warehousing, analytics, and performance
optimization.
● Integrate data from multiple sources including APIs, databases, and streaming platforms.
● Optimize pipeline performance, cost, scalability, and reliability on GCP.
● Collaborate with cross\-functional teams including Architects, Analysts, DevOps, and
Business stakeholders.
● Ensure data quality, governance, monitoring, and security best practices.
● Troubleshoot production issues and provide long\-term scalable solutions.
Required Skills \& Qualifications
● Strong hands\-on experience with GCP services.
● Expertise in Google Dataflow / Apache Beam.
● Strong programming skills in Java.
● Hands\-on experience with BigQuery.
● Experience in building batch and streaming data pipelines.
● Good knowledge of SQL and data modeling concepts.
● Experience with CI/CD, Git, and Agile methodologies.
● Strong problem\-solving and debugging skills.
● Experience with Pub/Sub, Cloud Composer, Cloud Storage, Dataproc, or Kafka.
● Exposure to Python or Spark.
● Experience in handling large\-scale enterprise data platforms.
● Bachelor’s/Master’s degree in Computer Science, Engineering, or related field.
● GCP certifications are an added advantage.
Pay: ₹1,000,000\.57 \- ₹1,800,000\.63 per year
Work Location: In person
Senior Staff Developer - AI SOC Automation
Arctic Wolf Networks · Remote
Sen. Mobile App Tester
Testvox · Mumbai
GenAI / AI-ML Engineer
Premier IT Solutions · Ghaziabad