LLM Test Engineer / AI Evaluation Engineer

Responsibilities

• Test AI conversations for accuracy, hallucinations and correct source citation
• Check role\-based answers, multilingual replies and out\-of\-scope handling
• Run safety tests such as prompt\-injection attempts
• Compare new prompt and model versions against the previous baseline
• Do manual, smoke and regression testing of the dashboard, chat widget and booking flows
• Write test cases and log clear, reproducible bugs on GitHub

Must\-have Skills

• Manual testing: test cases, positive/negative and boundary testing, regression, bug life cycle
• LLM testing: hands\-on with ChatGPT, Claude or Gemini; understands hallucinations and prompt behaviour
• Prompt engineering basics
• Strong attention to detail and written English
• Clear bug reporting

Pay: From ₹10,000\.00 per month

Work Location: In person