- **Job Title:** AI Quality Engineer
- **Location:** Hybrid (**66% On\-site**)
- **Employment Type:** Full\-Time
- **Experience:** **2 \- 4 Years**
- **Department:** Engineering
Smarter.Codes is an **AI Startup Studio with 12 years of experience** building AI\-powered products. Our work has been adopted by organizations including the **US Airforce, Johnson \& Johnson, SGS Group, Finland Government**, and **thousands of SMBs** worldwide.
Beyond building startups for clients, we are actively investing in our own ventures focused on:
- **Developer Tools for AI Entrepreneurs**
- **Vertical AI Products**
- **Horizontal AI Solutions**
- **AI Infrastructure**
- **B2C Startups**
We are seeking a **detail\-oriented and analytical AI Quality Engineer** to build and scale quality systems for **AI\-powered software products**.
This is **not a traditional manual QA role**. The position combines
- **Automation Engineering**
- **AI Evaluation \& Benchmarking**
- **Document Fidelity Testing**
- **Product Quality Strategy**
- **Functional \& Regression Testing**
You will play a key role in ensuring our products are **reliable, accurate, scalable, and enterprise\-grade**.
- *Key ResponsibilitiesSoftware \& Product Quality**
- Design, execute, and maintain test cases for **Web Applications, APIs, and AI\-driven Systems**
- Perform **Functional Testing** and **Regression Testing**
- Ensure product **Consistency, Reliability, Usability, and Performance**
- *AI Evaluation \& Validation**
- Validate **AI\-generated outputs** using scoring systems and benchmarking methodologies
- Conduct **Semantic and Logical Validation** of AI responses
- Evaluate quality, accuracy, and consistency of AI\-generated content
- *Automation \& Engineering**
- Develop and maintain **Automation Testing Scripts and Frameworks using Python**
- Support quality validation within **CI/CD Pipelines**
- Collaborate with engineering teams to identify and resolve defects
- *Documentation \& Analysis**
- Create **Task Analysis Stories**
- Maintain structured QA documentation
- Analyze product behavior and proactively recommend quality improvements
- *Required Skills \& QualificationsTechnical Skills**
✔ Strong understanding of **Software Testing Fundamentals**
✔ Experience with **API Testing** and **Regression Testing**
✔ Familiarity with **Automation Testing Frameworks**
✔ Proficiency in **Python Scripting for Testing and Automation**
✔ Experience validating **Complex Document Formats**
✔ Familiarity with **CI/CD Pipelines** and Quality Validation Processes
✔ Understanding of **Structured Data Validation Techniques**
✔ Knowledge of **AI Evaluation Methodologies** and **Benchmarking Concepts**
- Experience with **Document Parsing Libraries**
- Familiarity with **DOCX and PDF Rendering Systems**
- Experience working with **Enterprise SaaS Products**
- Exposure to **AI Products** or **LLM\-based Systems**
- Knowledge of **Prompt Engineering**
- Familiarity with **Selenium** or **Playwright**
- **Ownership Mindset** with accountability for outcomes
- Strong **Documentation and Reporting Skills**
- **"Question Everything"** approach to validation and problem\-solving
- Ability to thrive in a **Fast\-Paced Startup Environment**
- *Compensation₹6 LPA – ₹9 LPA\+**
(*Subject to performance during the selection process*)
✅ Build products that are shaping the future of **AI**
✅ Work on **Vertical AI, Horizontal AI, and AI Infrastructure**
✅ Gain exposure to multiple startups and product environments
✅ Opportunity to grow from a **Contributor to a Future Co\-Founder**
✅ Be part of building the next generation of **world\-class AI companies**
Ability to commute/relocate
- Panchkula, Haryana (Panchkula): Reliably commute or planning to relocate before starting work (Preferred)
Application Question(s)
- Do you have hands\-on experience with automation testing? If yes, please specify your total years of experience in this area.
- Please share your current CTC and your expected CTC for this opportunity.
Work Location: Hybrid remote in Panchkula, Haryana (Panchkula)