Bestkaam Logo
Back to Jobs
Williams-Sonoma, Inc.

Lead Test Automation Engineer

Actively Reviewing

Williams-Sonoma, Inc.

Pune Full-Time 4–8 yrs exp Posted 1 month ago  · Apply by Aug 4, 2026

Job Title : Lead Test Automation Engineer (AI)

Work Location : India, Pune (Hybrid)



1. Job Summary / Purpose

We are seeking a Lead Test Automation Engineer who operates at the intersection of modern test automation and Agentic AI systems. This role focuses on designing workflows where AI agents can deliver tests end-to-end while ensuring quality through robust guardrails, validation systems, and security practices. The role is critical in enabling teams to scale productivity and deliver high-quality software in an AI-native development environment.

2. Key Responsibilities

  • Design and implement agentic workflows for end-to-end tests delivery using AI agents
  • Define and maintain guardrails such as AGENTS.md, validation checkpoints, and test frameworks
  • Architect and scale UI and API test automation frameworks
  • Write clear, maintainable, and reusable test specifications
  • Critically evaluate AI-generated code and test outputs for accuracy and completeness
  • Identify and mitigate AI-related security risks such as over-permissions, insecure dependencies, and data leakage
  • Establish metrics to measure team productivity and AI impact
  • Mentor team members on modern QA practices and AI-driven development workflows

3. Technical Skills (including Agentic AI)

  • Strong experience with test frameworks: JUnit, Cucumber, RestAssured, Mock frameworks
  • Expertise in UI automation tools such as Selenium, Playwright, or Cypress
  • Solid understanding of API testing and backend validation strategies
  • Strong SQL skills for data validation and debugging
  • Proficiency in Java or similar programming languages
  • Understanding of Agentic AI systems, workflows, and prompt/instruction design (e.g., AGENTS.md)
  • Ability to design test strategies for AI-generated code and workflows
  • Experience critically assessing AI outputs and improving their reliability
  • Demonstrated success signals: authorship of AGENTS.md, end-to-end agentic feature delivery, measurable improvements in team productivity

4. Soft Skills

  • Strong critical thinking and analytical skills
  • Ability to adapt quickly to evolving AI technologies and tools
  • Clear and effective communication, especially in writing specifications
  • Ownership mindset focused on team-level impact
  • Problem-solving mindset with attention to detail
  • Reviewing the work from junior members in the test automation team and help them grow to use Agentic AI workflows

5. Nice to Have

  • Experience with CI/CD pipelines and automated testing integration
  • Exposure to AI safety, governance, and secure system design
  • Experience testing microservices or distributed systems
  • Familiarity with modern DevOps practices

6. Minimum Qualifications

  • BE/BTech/ME/MTech/BS/MS in Computer Science or related field
  • 10+ years of experience in test automation or software engineering