3Pillar is an AI transformation partner on a mission to help enterprises build the AI\-native products and intelligent agents that will define the next era of business. With teams across North America, Europe, Latin America, and Asia, we work with the most ambitious companies in financial services, healthcare, media, and technology — helping them move faster, modernize boldly, and compete on their own terms. Our HelixAI platform and Helix Pods delivery model put our engineers at the center of real agentic transformation — doing work that is open, portable, and built to last. We are building the future of enterprise AI
We are looking Lead Data Engineer to build, operate, and continuously improve the
data pipelines, retrieval infrastructure, and ML/LLMOps foundations that power our AI
initiatives. The resource will work on turning reference architectures and data contracts
into robust, production\-grade implementations that serve conversational AI assistants,
dashboard copilots, autonomous agents, RAG applications, and predictive ML models.
### **Key Responsibilities:**
Implement data quality checks, schema validation, and alerting at every pipeline stage.
Migrate legacy ETL/DWH to cloud\-native AWS/Azure architectures with measurable latency and cost improvements.
Maintain CI/CD pipelines: automated testing, deployment, rollback, and IaC (Terraform, GitHub Actions).
Implement chunking, metadata filtering, and re ranking — tuning for precision, recall, and latency.
Maintain data freshness and index consistency; instrument with context relevance and faithfulness metrics.
Build and version the feature store and semantic data contracts serving both ML models and LLM applications.
Manage metadata, data lineage, and audit trail instrumentation across the platform.
Support LLM fine\-tuning workflows — corpus curation, quality filtering, dataset formatting.
Implement automated evaluation pipelines: factual accuracy, hallucination detection, regression tracking.
Maintain production monitoring dashboards for pipeline health, model metrics, and alerting.
Implement agent observability: capture inputs, retrieved context, tool calls, reasoning traces, and outputs.
Maintain text\-to\-SQL layers, semantic query interfaces, and context APIs for conversational AI consumers.
Enforce data contracts and schema governance with automated breaking\-change detection and versioned migrations.
Build data quality monitoring (completeness, freshness, consistency) with automated alerting and root\-cause tooling.
Support compliance readiness: audit trails, data provenance, and regulatory documentation.### **Qualifications:**
aligned engineering.
### **Connect:**
Regards,
Kiran Dhanak
Talent Acquisition Manager
We may use artificial intelligence (AI) tools to support parts of the hiring process, such as reviewing applications, analyzing resumes, or assessing responses. These tools assist our recruitment team but do not replace human judgment. Final hiring decisions are ultimately made by humans. If you would like more information about how your data is processed, please contact us.
Programmer Analyst I, TITANS
Amazon Web Services (AWS) · Hyderabad, Telangana, India
Cloud Sales Representative, India Startups
Amazon Web Services (AWS) · Bengaluru, Karnataka, India
Sr. Staff SW Engineer (9+ years, Go, AWS, Distributed Transactions)
Pismo · Bengaluru East, Karnataka, India