Senior Software Engineer - QA

• *Experience:** 7–8 Years
• *Work Mode:** Remote
• *Working Hours:** 10:30 AM – 7:30 PM IST
• *Open Positions:** 2
• *Joining:** Immediate Joiners Only

• *Key Skills:** LLM \| Agentic AI \| Test Automation \| MCP Integration Testing \| RAGAS

• *Job Description:**

We are looking for an experienced Senior Software Engineer – QA with strong expertise in test automation, API testing, and AI testing practices. The ideal candidate should have hands\-on experience validating LLM\-based applications, Agentic AI workflows, MCP integrations, and RAG evaluation using RAGAS, along with a solid foundation in quality engineering.

• *Key Responsibilities:**

• Analyse business requirements, technical specifications, and architecture documents to define comprehensive test strategies.
• Design and execute test plans, test scenarios, and test cases for functional and non\-functional testing.
• Lead end\-to\-end testing activities, including functional, regression, integration, system, API, database, and end\-to\-end testing.
• Perform AI/LLM application testing, including response accuracy, relevance, hallucination detection, and reliability validation.
• Test Agentic AI workflows, tool\-calling mechanisms, multi\-step execution, and agent behaviour.
• Perform MCP integration testing to validate tool connectivity, communication, data exchange, and error handling.
• Use RAGAS to evaluate RAG applications, including retrieval quality, faithfulness, and answer relevance.
• Develop, maintain, and enhance automated test scripts and reusable automation frameworks.
• Perform API testing using Postman or REST Assured and validate backend integrations.
• Execute SQL\-based database validation to ensure data integrity and consistency.
• Integrate automated tests into CI/CD pipelines and support continuous testing initiatives.
• Review test cases and automation scripts, manage defects, and collaborate with development teams for timely resolution.
• Prepare test execution reports, quality metrics, and release readiness assessments.
• Mentor junior QA engineers and drive improvements in QA processes, automation coverage, and testing efficiency.
• Support production validation, defect triage, and root cause analysis.

• *Mandatory Skills:**

• 7–8 years of overall QA / Software Testing experience.
• Strong hands\-on experience in test automation and framework development.
• Relevant practical experience in AI/LLM application testing.
• Experience with or strong hands\-on exposure to Agentic AI and MCP integration testing.
• Experience with RAGAS for evaluating RAG/LLM applications.
• Strong API testing, SQL, integration testing, and regression testing skills.
• Familiarity with CI/CD pipelines and Agile methodologies.

Pay: ₹90,000\.00 \- ₹100,000\.00 per year

Work Location: Remote