About this role
Role Overview: Williams-Sonoma is seeking a Lead Test Automation Engineer to work at the intersection of modern test automation and Agentic AI systems. This role is critical for designing workflows where AI agents deliver end-to-end tests while ensuring quality through robust guardrails, validation systems, and security practices. You will enable teams to scale productivity and deliver high-quality software in an AI-native development environment. Key Responsibilities: Design and implement agentic workflows for end-to-end test delivery using AI agents. Define and maintain guardrails such as AGENTS.md, validation checkpoints, and test frameworks. Architect and scale UI and API test automation frameworks. Evaluate AI-generated code and test outputs for accuracy and completeness. Identify and mitigate AI-related security risks including over-permissions, insecure dependencies, and data leakage. Establish metrics to measure team productivity and AI impact. Mentor team members on modern QA practices and AI-driven development workflows. Qualifications: BS/MS in Computer Science or related field. Minimum 8 years of experience in test automation or software engineering. Strong expertise in UI automation tools (Selenium, Playwright, Cypress) and test frameworks (JUnit, Cucumber, RestAssured). Proficiency in Java and SQL. Solid understanding of API testing, backend validation, and distributed systems. Understanding of Agentic AI systems, workflows, and prompt/instruction design. Experience with CI/CD pipelines, AI safety, governance, and secure system design. Strong critical thinking, analytical, and problem-solving skills.