SENIOR AI QUALITY ANALYST
COUNTRY
Europe
FORMAT
Remote
Svitla Systems Inc. is looking for a **Senior AI Quality Analyst** for a full\-time position (40 hours per week) in Europe. Our client is an American mobile computing company. It's a central innovation team with engineers and researchers in London, Europe, the US, India, and Shanghai. They provide AI innovation and acceleration for the Business Units and are working on CV and GenAI solutions with an emphasis on device inference (Mostly Qualcomm chipsets). Researchers create/fine\-tune models and hand them over to the engineering team to optimize, quantize, etc. The team then builds an application solution with customers to show value.
The AI Quality Analyst is a critical role responsible for ensuring the performance, safety, and reliability of the cutting\-edge AI/ML models. You will be at the forefront of the development lifecycle, designing and executing comprehensive evaluation strategies to identify model weaknesses, potential biases, and critical edge cases. This role requires a blend of analytical rigor, technical aptitude, and a deep curiosity for how AI models behave in real\-world scenarios. You will not only find bugs but also provide actionable insights that drive model improvement and guide our research and development efforts.
REQUIREMENTS
- Proven experience in a quality assurance, testing, or data analysis role, preferably within the AI/ML domain.
- A deep understanding of the machine learning lifecycle and the common failure modes of AI models.
- Hands\-on experience with data annotation, data validation, and managing large datasets.
- Experience with bug tracking systems (e.g., Jira) and test case management tools.
- Meticulous attention to detail and a methodical approach to problem\-solving.
- Strong analytical skills with the ability to identify patterns in data and draw meaningful conclusions.
- Excellent communication skills, with the ability to clearly document bugs and articulate complex technical issues.
NICE TO HAVE
- Basic understanding of scripting (e.g., Python) for test automation and data manipulation.
- Familiarity with computer vision or other specific AI domains relevant to the work.
RESPONSIBILITIES
- Design, develop, and maintain a comprehensive suite of test cases and evaluation benchmarks. Proactively identify potential model failure points, including edge cases, adversarial inputs, and sources of bias.
- Conduct systematic error analysis to categorize model failures and identify underlying patterns. Triage defects, prioritize them based on severity and impact, and work with the development team to ensure resolution.
- Source, curate, and manage high\-quality datasets for model evaluation and testing. It includes performing data annotation and validation to ensure the integrity of our ground\-truth data.
- Perform unscripted, exploratory testing to discover unexpected model behaviors. Participate in red teaming exercises to intentionally challenge our models and identify potential safety and security vulnerabilities.
- Set up, maintain, and troubleshoot testing and demonstration environments to ensure a stable and reliable evaluation pipeline.
- Analyze and synthesize test results into clear, actionable reports for both technical and non\-technical stakeholders. Translate complex findings into concrete recommendations for model improvement.
- Actively participate in post\-hoc evaluation reviews and contribute to the continuous improvement of the testing methodologies, tools, and overall quality assurance processes.
WE OFFER
- US and EU projects based on advanced technologies.
- Competitive compensation based on skills and experience.
- Regular performance appraisals to support your growth.
- Flexibility in workspace, either remote or our welcoming office.
- Bonuses for article writing, public talks, and other activities.
- Generous time off, including vacation, national holidays, sick leaves, and family days.
- Personalized learning programs tailored to your interests and skill development.
- Free tech webinars and meetups organized by Svitla.
- Regular corporate online activities.
- Awesome team and a friendly, supportive community!
ABOUT SVITLA
- *Svitla Systems** is a global digital solutions company headquartered in the U.S. and operating across the Americas, Europe, Asia, and APAC. Since 2003, we have served a wide range of clients — from innovative start\-ups to Fortune 500 companies.
Our success is built on partnership. By integrating seamlessly with clients’ teams, we create lasting collaborations that drive real results.
We are strong advocates of workplace flexibility, remote culture, individual approach to professional and personal growth.
Svitla is proud to be an equal opportunity employer. All qualified applicants will receive consideration for cooperation without regard to age, gender identity, sexual orientation, religion, race, color, national origin, disability, or any other characteristic protected by applicable law.
Our global mission is to build a business that contributes to wellbeing of our partners, personnel, and their families, improves our communities, and makes a lasting difference in the world.
Together, we are coding a brighter tomorrow — and living it.
LET'S MEET IN PERSON
### **Diana****Kvashyna**
### **RECRUITER**
Email
d.kvashyna@svitla.com
LinkedIn
Diana Kvashyna