QA Engineer (AI)

What if the work you did every day could impact the lives of people you know? Or all of humanity?

At Illumina, we are expanding access to genomic technology to realize health equity for billions of people around the world. Our efforts enable life-changing discoveries that are transforming human health through the early detection and diagnosis of diseases and new treatment options for patients.

Working at Illumina means being part of something bigger than yourself. Every person, in every role, has the opportunity to make a difference. Surrounded by extraordinary people, inspiring leaders, and world changing projects, you will do more and become more than you ever thought possible.

Illumina’s AI Center of Excellence is seeking a passionate and attention-oriented QA AI Engineer to support our world class innovative solutions. As a QA Engineer (AI Systems & Automation), ensure product software and software development process conforms to applicable safety and quality system regulations and standards (e.g. IEC 62304, ISO 13485, IVDD/IVDR). Responsible for executing Software Life Cycle activities including developing and conducting training, with focus on new product development quality planning and risk management to positively impact the safety and efficacy of products. Identifies, documents, assesses, corrects, resolves, and prevents quality issues, risks, or vulnerabilities using risk analysis, root cause analysis tools, from initial product concept through transfer to sustaining. Supports post market activities related to product software anomalies.

Roles And Responsibilities

Core QA & Automation

• Develop and maintain test plans, test cases, traceability, and test data for product and AI features
• Execute manual and automated tests for web applications, APIs, data workflows, and AI/ML features
• Own automated regression suites, release readiness criteria, and provide clear go / no-go quality signals
• Participate in agile ceremonies, validate end-to-end functionality, and ensure user stories (including AI features) meet acceptance criteria
• Manage the full defect lifecycle, including triage, prioritization, root cause analysis, and verification of fixes
• Maintain QA documentation, runbooks, and quality dashboards
  
  

AI-Systems QA Responsibilities

• Design and execute test strategies for AI/LLM-powered capabilities, including virtual agents, chatbots, copilots, and RAG-based systems
• Use approved LLM-powered tools to accelerate test design, data generation, exploratory testing, and script authoring
• Auto-generate and maintain test scripts
• Define and monitor AI-specific quality metrics (accuracy vs. ground truth, hallucination and error rates, safety / policy adherence)
• Ensure AI and virtual agent experiences are accurate, consistent, and high quality
  
  

Non-Functional, Data Quality & Collaboration

• Plan and execute performance, load, and scalability testing
• Validate data integrity and transformation quality across complex biomedical data pipelines and AI-enhanced workflows
• Partner with engineers and data scientists to ensure AI/ML models and integrations are testable, observable, and measurable post-deployment
• Collaborate with development, DevOps, product, UX, and data teams to improve testability, shift-left quality, and increase automated coverage
• Integrate automation into CI/CD (e.g., GitHub Actions, Jenkins, Azure DevOps, GitLab CI), monitor test health and flakiness, and address coverage gaps
• Communicate quality risks, trends, and mitigation plans to technical and non-technical stakeholders, including government partners
  
  

Preferred Experience/Education/Skills

• Bachelor’s degree in computer science, Information Technology, Engineering, or related field
• 1+Years Software QA experience (manual and automation) in production environments
• 1+ Years Experience testing APIs and microservices architectures
• Hands-on experience integrating automated tests into CI/CD pipelines (GitHub Actions, Jenkins, Azure DevOps, or GitLab CI)
• Professional-level proficiency in Python or JavaScript for test automation
• Hands-on use of GenAI tools (e.g., ChatGPT, Claude, Copilot) for QA tasks such as test-case generation, data creation, and exploratory testing
• Understanding of AI/agentic concepts
• AI-driven data comparison and validation
• Proficiency with Jira or similar issue tracking tools
• Strong written and verbal communication skills, including the ability to explain AI-related quality risks to stakeholders
• Ability to prioritize, multitask, and operate effectively in complex, mission-driven environments
• Experience testing AI/ML-powered features (LLM applications, RAG systems, agents, recommendation engines, or chatbots)
• Experience with one or more:
• LangChain or LangGraph
• AWS Bedrock Agents or OpenAI Assistants API
• MCP (Multi-Context Protocol) or similar orchestration frameworks
• Experience designing or testing internal QA copilots or automation bots for test author or execution
• Prior QA experience in healthcare, life sciences, biomedical informatics, or other regulated data environments
  
  

We are a company deeply rooted in belonging, promoting an inclusive environment where employees feel valued and empowered to contribute to our mission. Built on a strong foundation, Illumina has always prioritized openness, collaboration, and seeking alternative perspectives to propel innovation in genomics. We are proud to confirm a zero-net gap in pay, regardless of gender, ethnicity, or race. We also have several Employee Resource Groups (ERG) that deliver career development experiences, increase cultural awareness, and offer opportunities to engage in social responsibility. We are proud to be an equal opportunity employer committed to providing employment opportunity regardless of sex, race, creed, color, gender, religion, marital status, domestic partner status, age, national origin or ancestry, physical or mental disability, medical condition, sexual orientation, pregnancy, military or veteran status, citizenship status, and genetic information. Illumina conducts background checks on applicants for whom a conditional offer of employment has been made. Qualified applicants with arrest or conviction records will be considered for employment in accordance with applicable local, state, and federal laws. Background check results may potentially result in the withdrawal of a conditional offer of employment. The background check process and any decisions made as a result shall be made in accordance with all applicable local, state, and federal laws. Illumina prohibits the use of generative artificial intelligence (AI) in the application and interview process. If you require accommodation to complete the application or interview process, please contact [email protected]. To learn more, visit: https://www.dol.gov/ofccp/regs/compliance/posters/pdf/eeopost.pdf. The position will be posted until a final candidate is selected or the requisition has a sufficient number of qualified applicants. This role is not eligible for visa sponsorship.