Cloud Specialist - QA (Agentic Ai)

Role Summary
Lead AI quality strategy, governance, and evaluation frameworks across Agentic AI systems.

Key Responsibilities

• Define enterprise-wide AI quality standards and benchmarks
• Design scalable evaluation frameworks (offline + online)
• Lead red-teaming, adversarial testing, and safety validation
• Build tooling for continuous evaluation and monitoring
• Partner with architects on guardrails and risk mitigation
• Mentor QA teams on AI-specific testing practices

Must-Have Skills

• 6–10+ years in QA/AI validation
• Deep expertise in LLM evaluation, hallucination detection, and bias testing
• Experience designing quality frameworks for production AI systems

Good to Have

• Regulatory/compliance exposure (especially insurance)
• Experience with observability and AI governance tools