Senior Data Engineer - FSD

• *Senior Data Engineer \- FSD** **/ Contractual \- Remote Position**
• *Experience \- 5 \- 7 Years Mandatory**

• *What roles and responsibilities will be performed by the selected candidate?**

• Data Engineering Specialist will be responsible for designing, implementing, and maintaining data solutions on Microsoft Azure Data platform and SQL Server.
• Collaborate with various stakeholders, and ensure efficient processing, storage, and retrieval of large volumes of data
• Technical Expertise and Responsibilities
• Design, build, and maintain scalable and reliable data pipelines.
• Should be able to design and build solutions in Azure data factory and Databricks to extract, transform and load data into different source and target systems.
• Should be able to analyze and understand the existing data landscape and provide recommendations/innovative ideas for rearchitecting / optimizing / streamlining to bring efficiency and scalability.
• Must be able to collaborate and effectively communicate with onshore counterparts to address technical gaps, requirement challenges, and other complex scenarios.
• Monitor and troubleshoot data systems to ensure high performance and reliability.
• It should be highly analytical and detail\-oriented with extensive familiarity with database management principles.
• Optimize data processes for speed and efficiency.
• Ensure the data architecture supports business requirements and data governance policies.
• Define and execute data engineering strategy in alignment with the company’s goals.
• Integrate data from various sources, ensuring data quality and consistency.
• Stay updated with emerging technologies and industry trends.
• Familiarity with ACH transaction lifecycle (debit, credit, returns, NOC, settlement), experience in financial data reconciliation and ledger\-based systems, understanding of bank integrations and multi\-bank processing workflows enabling and running data migrations across different databases and different servers
• Perform thorough testing and validation to support the accuracy of data transformations and data verification used in machine learning models.
• Analyze data and different systems to define data requirements.
• Should be well versed with Data Structures \& algorithms.
• Define data mapping working along with business and digital team and data team.
• Data pipeline maintenance/testing/performance validation
• Assemble large, complex data sets that meet functional / non\-functional business requirements.
• Analyze and identify gaps on data needs and work with business and IT to bring in alignment on data needs.
• Troubleshoot and resolve technical issues as they arise.
• Optimize data flow and collection for cross\-functional teams.
• Work closely with counterparts onshore, product owners, and business stakeholders to understand data needs and strategies.
• Collaborate with IT and DevOps teams to ensure data infrastructure aligns with overall IT architecture.
• Implement best practices for data security and privacy.
• Drive continuous improvement initiatives within the data engineering function
• Optimize data flow and collection for cross\-functional teams.
• Understand the impact of data conversions as they pertain to servicing operations.
• Manage higher volume and more complex cases with accuracy and efficiency.

• *What is the expectation from the candidate’s current role/profile?**

• Design and develop warehouse solutions using Azure SQL, ADLS, ADF, Azure Functions, Power BI.
• Should be proficient in SQL and Query optimization.
• Should have worked in onshore offshore model managing challenging scenarios.
• Expertise in working with large amounts of data (structured and unstructured), building data pipelines for ETL workloads and generating insights utilizing Data Science, Analytics.
• Expertise in Azure cloud services, and DevOps/CI/CD frameworks.
• Ability to work with ambiguity and vague requirements and transform them into deliverables.
• Good combination of technical and interpersonal skills with strong written and verbal communication; detail\-oriented with the ability to work independently.
• Drive automation efforts across the data analytics team utilizing Infrastructure as Code (IaC) using Terraform, Configuration Management, and Continuous Integration (CI) / Continuous Delivery (CD) tools.
• Help build architecture frameworks, best practices \& processes. Collaborate on Data warehouse architecture and technical design discussions.
• Expertise in Azure Data factory and should be familiar with building pipelines for ETL projects.
• Expertise in SQL knowledge and experience working with relational databases.
• Should have expertise in data life cycle, data ingestion, transformation, data loading, validation, and performance tuning.

• *Skills Required :**

Azure SQL \| Azure Data Factory \| ADLS \| Data Design patterns \| Azure Databricks \| Azure Fabric \| Power BI \| DevOps CI/CD \| Financial Domain

Pay: ₹150,000\.00 \- ₹160,000\.00 per month

Application Question(s)

• Whats your Current Location ?
• What your notice period ?
• Are you willing to work Remote Contractual Position?
• How many years of total Experience do you have ?
• Do you have hands on experience in Azure Data Factory, Data Design patterns, Databricks, Azure SQL and ADLS ?
• How strong is your SQL and query optimization experience?
• Have you worked in Banking/Financial Services/FinTech?
• Do you have hands\-on ACH/payment processing experience?
• Do you have experience in Azure Fabric, Power BI, DevOps CI/CD ?

Work Location: Remote