Lead Test Automation Engineer
Williams-Sonoma, Inc.
Job Description
Job Title : Lead Test Automation Engineer (AI)
Work Location : India, Pune (Hybrid)
1. Job Summary / Purpose
We are seeking a Lead Test Automation Engineer who operates at the intersection of modern test automation and Agentic AI systems. This role focuses on designing workflows where AI agents can deliver tests end-to-end while ensuring quality through robust guardrails, validation systems, and security practices. The role is critical in enabling teams to scale productivity and deliver high-quality software in an AI-native development environment.
2. Key Responsibilities
- Design and implement agentic workflows for end-to-end tests delivery using AI agents
- Define and maintain guardrails such as AGENTS.md, validation checkpoints, and test frameworks
- Architect and scale UI and API test automation frameworks
- Write clear, maintainable, and reusable test specifications
- Critically evaluate AI-generated code and test outputs for accuracy and completeness
- Identify and mitigate AI-related security risks such as over-permissions, insecure dependencies, and data leakage
- Establish metrics to measure team productivity and AI impact
- Mentor team members on modern QA practices and AI-driven development workflows
3. Technical Skills (including Agentic AI)
- Strong experience with test frameworks: JUnit, Cucumber, RestAssured, Mock frameworks
- Expertise in UI automation tools such as Selenium, Playwright, or Cypress
- Solid understanding of API testing and backend validation strategies
- Strong SQL skills for data validation and debugging
- Proficiency in Java or similar programming languages
- Understanding of Agentic AI systems, workflows, and prompt/instruction design (e.g., AGENTS.md)
- Ability to design test strategies for AI-generated code and workflows
- Experience critically assessing AI outputs and improving their reliability
- Demonstrated success signals: authorship of AGENTS.md, end-to-end agentic feature delivery, measurable improvements in team productivity
4. Soft Skills
- Strong critical thinking and analytical skills
- Ability to adapt quickly to evolving AI technologies and tools
- Clear and effective communication, especially in writing specifications
- Ownership mindset focused on team-level impact
- Problem-solving mindset with attention to detail
- Reviewing the work from junior members in the test automation team and help them grow to use Agentic AI workflows
5. Nice to Have
- Experience with CI/CD pipelines and automated testing integration
- Exposure to AI safety, governance, and secure system design
- Experience testing microservices or distributed systems
- Familiarity with modern DevOps practices
6. Minimum Qualifications
- BE/BTech/ME/MTech/BS/MS in Computer Science or related field
- 10+ years of experience in test automation or software engineering
Required Skills
Similar Jobs
View all →
SAP ABAP Development for HANA
Aryvart Software Pvt Ltd
Sr. Data Analyst
RSCP
PHP Developer
Cloudnausor Technologies Pvt ltd
Quality Assurance Engineer
University of Michigan
Business Analyst with Mortgage SME
Cognizant
Share
Quick Apply
Upload your resume to apply for this position