Lead I - Data Engineering

• *Role description**

.

• *Who we are:**

At UST, we help the world’s best organizations grow and succeed through transformation. Bringing together the right talent, tools, and ideas, we work with our client to co\-create lasting change. Together, with over 30,000 employees in 30\+ countries, we build for boundless impact—touching billions of lives in the process. Visit us at UST.com.

Summary

we have a opening for big data developer.

Roles and Responsibilities

1\.Design, develop, test, and deploy scalable Big Data solutions on AWS Cloud.

2\. Build and maintain batch and streaming data pipelines using Scala, Python, Spark, and PySpark.

3\. Analyze, process, and transform large volumes of structured and unstructured data.

4\. Develop and support distributed data processing frameworks and data ingestion platforms.

5\. Integrate new data sources and tools into existing big data ecosystems. 6\. Optimize performance of Spark, Hadoop, EMR, and distributed computing workloads.

7\. Design and implement cloud\-native APIs and microservices supporting data products and operational platforms.

8\. Collaborate with product owners, architects, QA teams, and business stakeholders throughout the software development lifecycle.

9\. Automate data workflows, deployments, monitoring, and operational processes.

10\. Evaluate emerging Big Data, AI, and cloud technologies and prototype innovative solutions.

11\. Ensure adherence to security, governance, reliability, and software engineering best practices.

Required Qualifications

1\. Bachelor's degree in Computer Science, Computer Engineering, Information Technology, or equivalent experience.

2\. 5\-8 years of experience in software engineering and Big Data application development.

3\. Strong hands\-on experience with: Scala Python Apache Spark / PySpark Hadoop ecosystem (HDFS, MapReduce, Hive) Kafka or similar event\-streaming technologies

4\. Strong AWS experience with services such as: EMR S3 EC2 ECS/EKS Airflow (MWAA preferred) Step Functions API Gateway Lambda DynamoDB and/or Aurora/RDS

5\. Experience building and supporting large\-scale batch and API\-based data processing solutions in AWS.

6\. Strong Linux and shell scripting skills.

7\. Experience with data ingestion, transformation, data modeling, schema design, and data lifecycle management.

8\. Strong understanding of performance tuning for Spark, Hadoop, EMR, and distributed systems.

9\.. Experience with Agile/Scrum development methodologies.

10\. Understanding of secure software development practices and cloud security fundamentals.

11\. Strong analytical, troubleshooting, and problem\-solving skills.

12\. Excellent written and verbal communication skills.

Preferred Qualifications

1\. Experience with Generative AI, AI\-assisted development tools (GitHub Copilot, Amazon Q, Cursor, etc.), and AI\-driven automation.

2\. Understanding of Large Language Models (LLMs), Retrieval\-Augmented Generation (RAG), Vector Databases, and AI/ML solution integration.

3\. Experience building AI\-enabled data platforms and data pipelines supporting ML workloads.

4\. Experience with DevOps and CI/CD tools such as Git, GitHub, GitLab, Bitbucket, Jenkins, Maven, Gradle, and Artifactory.

5\. Experience with containerization technologies such as Docker and Kubernetes.

6\. Knowledge of automated testing frameworks and data quality validation tools.

7\. Experience working in enterprise\-scale cloud environments.

8\. AWS certification(s) and/or Databricks certification(s) are a plus.

• *What we believe:**

We’re proud to embrace the same values that have shaped UST since the beginning. Since day one, we’ve been building enduring relationships and a culture of integrity. And today, it's those same values that are inspiring us to encourage innovation from everyone, to champion diversity and inclusion and to place people at the centre of everything we do.

• *Humility:**

We will listen, learn, be empathetic and help selflessly in our interactions with everyone.

• *Humanity:**

Through business, we will better the lives of those less fortunate than ourselves.

• *Integrity:**

We honour our commitments and act with responsibility in all our relationships.

• *Equal Employment Opportunity Statement**

UST is an Equal Opportunity Employer. We believe that no one should be discriminated against because of their differences, such as age, disability, ethnicity, gender, gender identity and expression, religion, or sexual orientation.

All employment decisions shall be made without regard to age, race, creed, colour, religion, sex, national origin, ancestry, disability status, veteran status, sexual orientation, gender identity or expression, genetic information, marital status, citizenship status or any other basis as protected by federal, state, or local law.

UST reserves the right to periodically redefine your roles and responsibilities based on the requirements of the organization and/or your performance.

• To support and promote the values of UST.

• Comply with all Company policies and procedures

• *Skills**

API Development, AWS, AWS Lambda, AWS Step Functions, Amazon API Gateway, Amazon Aurora, Amazon DynamoDB, Amazon EC2, Agile, Amazon ECS

• *About UST**

UST is a global digital transformation solutions provider. For more than 20 years, UST has worked side by side with the world’s best companies to make a real impact through transformation. Powered by technology, inspired by people and led by purpose, UST partners with their clients from design to operation. With deep domain expertise and a future\-proof philosophy, UST embeds innovation and agility into their clients’ organizations. With over 30,000 employees in 30 countries, UST builds for boundless impact—touching billions of lives in the process.