Jobs
J

Senior Data Engineer

Jobbycart technologies private limitedTN, IN19h ago
Full-timevia indeed

Required Skills

azureci/cdpythonsqlterraform

Job Description

Builds and runs the pipelines that land, master and model data in Snowflake on Azure,

from ingestion through to the Gold layer that reporting runs on.

  • *What you'll do:**

 Build ingestion into Snowflake Bronze: Five Tran for Dynamics 365 CE and SQL

sources, and Azure Data Factory for flat files and APIs through ADLS stages, COPY

INTO and Snow pipe.

 Develop dbt models across Silver and Gold: staging, incremental models, snapshots

and SCD Type 2 history.

 Model effective\-dated advisor, firm and territory hierarchies so late\-arriving

transactions credit the right firm and territory.

 Integrate Snowflake with the Profisee MDM hub: publish curated records for

mastering, then land golden records and cross\-reference tables back in Snowflake

for downstream use.

 Build data quality checks and reconciliation between layers using dbt tests and

Snowflake data metric functions.

 Use streams, tasks and dynamic tables where they fit, and keep every load

idempotent and safe to re\-run.

 Manage warehouse sizing and compute cost for ingestion and transformation

workloads.

 Maintain dbt CI/CD and code review, and document models and lineage.

Must have

 5\+ years in data engineering, with at least 2 years hands\-on in Snowflake.

 dbt in production: incremental models, snapshots, tests and CI.

 Expert SQL and working Python.

 Azure data services: Data Factory, ADLS Gen2 and Key Vault.

 A managed ELT tool such as Five Tran, including handling of cost and schema

changes.

 Dimensional modelling, including slowly changing dimensions.

Nice to have

 Integration with an MDM hub (Profisee, Informatica MDM, Reltio, EBX or similar),

including golden\-record and cross\-reference handling.

 Dynamics 365 or Dataverse data.

 Financial services or asset management data: advisors, accounts, transactions,

holdings.

 Terraform or other infrastructure as code.

 SnowPro certification.

Pay: ₹509,000\.00 \- ₹1,000,000\.00 per year

Benefits

  • Health insurance

Application Question(s)

  • We can offer a maximum of 30% hike on your current salary. Would that be okay with you?

Experience

  • Data Engineer: 5 years (Preferred)

Work Location: In person

Similar Jobs

Browse all jobs

Job Overview

Job type
Full-time
Work mode
On-site
Location
Chennai
Posted
19h ago
Source
Indeed