Custom Software Engineer

• *Project Role :** Custom Software Engineer

• *Project Role Description :** Develop custom software solutions to design, code, and enhance components across systems or applications. Use modern frameworks and agile practices to deliver scalable, high\-performing solutions tailored to specific business needs.

• *Must have skills :** Apache Kafka

• *Good to have skills :** Data Engineering, Microsoft Azure Databricks, Databricks Unified Data Analytics Platform

Minimum **12** year(s) of experience is required

• *Educational Qualification :** 15 years full time education

Summary

As a Custom Software Engineer, a typical day involves designing, building, and configuring applications that align with specific business processes and application requirements. This role requires continuous engagement with evolving project needs, ensuring that solutions are tailored effectively to support organizational goals. The workday often includes collaborating with various stakeholders to understand requirements, iterating on application designs, and refining configurations to optimize performance and usability. Attention to detail and adaptability are essential as the engineer navigates complex challenges to deliver robust software solutions that drive business success.

Job Description

We are looking for experienced Data Engineers/Technical Leads with strong expertise in Kafka and Databricks to support the design and delivery of modern data and event\-driven platforms.

Key Responsibilities

Design and develop scalable data engineering solutions using Databricks, PySpark, and Spark SQL.

Build and support real\-time data streaming solutions using Apache Kafka.

Develop and maintain Kafka producers, consumers, Kafka Streams, and integration frameworks.

Design and implement batch and streaming data pipelines for large\-scale data processing.

Work with Delta Lake, Lakehouse architecture, and enterprise data platforms.

Optimize data ingestion, transformation, and processing workloads for performance and scalability.

Collaborate with architects, business stakeholders, and development teams to deliver end\-to\-end data solutions.

Support cloud\-native implementations on Azure and participate in CI/CD and DevOps practices.

Ensure data quality, security, monitoring, and operational excellence across data platforms.

Provide technical leadership, mentor team members, and drive solution best practices.

Required Skills

Apache Kafka, Kafka Streams, Kafka Connect

Databricks, PySpark, Spark SQL

Delta Lake and Lakehouse Architecture

Real\-Time Data Processing and Event\-Driven Architecture

Data Modeling and Data Warehousing Concepts

Azure Cloud Services

CI/CD, Git, and DevOps Practices

Strong analytical, troubleshooting, and stakeholder management skills

15 years full time education