Jobs
H

Senior Technical Lead

HCLTechIN1d ago
Full-timevia indeed

Required Skills

awsbootstrapdynamodbkafkamachine learningpythonsql

Job Description

  • *Job Summary**
  • --------------
  • Understand customer requirements and render those as architectural models that will operate at large scale and high performance. Where customers have architectures prepared, validate them against non\-functional requirements and finalize the build model.
  • **Experience in creating and monitoring SNOW PIPE for continuous data ingestion from source.**
  • **Experience in Loading data into snowflake tables from the internal stage using Snow SQL (CLI)**
  • **Work alongside customers to build data management platforms using AWS products like Elastic Map Reduce (EMR), Redshift, Kinesis, Amazon Machine Learning, Amazon Athena, Lake Formation, S3, AWS Glue, DynamoDB, ElastiCache and the Relational Database Service (RDS)**
  • **Hands on experience in Python.**
  • **Well experience on other AWS services EC2, EMR, Redshift, S3, Streaming services like Kafka, Kinesis, HDFS.**
  • **Experience in AWS \+ Snowflake/Redshift implementation is Nice to have****.**
  • **Security of EMR cluster using KMS keys or customer managed keys**
  • **Deep experience on Snowflakes/AWS native data services including Glue, Glue Catalog, EMR, PySpark\-EMR, Data Sync, RDS, Data Exchange, Lake Formation, Athena, Apache Airflow and dbt.**
  • **(Secondary) Knowledge on Teradata SQL, Teradata Utilities – TPT, FASTLOAD, MLOAD, FASTEXPORT, TPUMP and Scripting \- Bteq \& Unix shell scripting**
  • **(Secondary)** **Knowledge of database technologies Teradata, DataStage, Cloudera, Big data Hadoop**
  • Render working, high performance data management solutions, as CloudFormation and reusable artifacts for implementation by the customer. Bootstrap using user data scripts will be added advantage
  • Prepare architecture and design briefs that outline the key features and decision points of the application built in the Data Lab
  • Work with customers to advise on changes as they put these systems live on AWS
  • Extract best\-practice knowledge, reference architectures, and patterns from these engagements for sharing with the worldwide AWS solution architect community
  • *Key Responsibilities**
  • -----------------------

Sr Data Engineer

  • *Skill Requirements**
  • ---------------------

snowflake, DBT, AWS and Data Engineering

  • *Must Have Skill**
  • ------------------

Amazon Web Services (AWS),Data Build Tool (DBT),Data Modelling,PySpark,Python,Snowflake

  • *Good to Have Skill**
  • ---------------------
  • *Other Requirements**
  • ---------------------

Similar Jobs

Browse all jobs

Job Overview

Job type
Full-time
Work mode
On-site
Location
IN
Posted
1d ago
Source
Indeed