Quality Assurance Automation Engineer

Job Description

About the Role We are seeking an experienced QA Automation Engineer to strengthen our quality assurance team for our AI-driven conversational platform. The ideal candidate should have a strong foundation in software testing principles, hands-on experience with automation frameworks, and a keen interest in testing NLP or AI-based applications.? Key Responsibilities Design, develop, and maintain automated test scripts using tools such as Playwright, Selenium, or Appium. Develop automation strategies for testing AI-driven chat interfaces, APIs, and NLP model integrations. Conduct functional, regression, integration, usability, and performance testing of AI-based web applications. Validate conversational flows, API responses, and ensure accuracy, consistency, and contextual relevance of AI responses. Work closely with developers, ML engineers, and product managers to understand feature behavior and ensure comprehensive test coverage. Integrate automated tests with CI/CD pipelines (e.g., Jenkins, GitHub Actions, GitLab CI). Identify, isolate, and report defects with detailed logs, screenshots, and test data. Create and maintain test data sets for conversational and contextual validation scenarios. Analyze automation results and provide insights for continuous product quality improvement. Mentor and guide junior QA engineers to strengthen automation and testing best practices. Stay current with AI/NLP testing methodologies, automation tools, and emerging QA practices. Follow secure development, testing, and deployment guidelines to ensure data integrity and compliance. Requirements Bachelor?s degree in Computer Science, Information Technology, or equivalent experience. 3+ years of experience in QA automation for web or SaaS platforms. Strong proficiency in Python, Java, or JavaScript for test automation. Proficiency in API testing using Postman, RestAssured, or similar tools. Familiarity with testing AI or NLP-based systems is a strong plus. Solid understanding of SDLC, STLC, Agile/Scrum methodologies. Experience with Git, JIRA, and CI/CD integration. Strong analytical and problem-solving skills with attention to edge cases and response accuracy. Experience in writing MySQL/SQL queries for validation and data-driven testing. Excellent communication and collaboration skills for working in cross-functional teams. Strong attention to detail and quality-driven mindset. Preferred Skills ? Exposure to testing AI model APIs, prompt-response evaluation, or conversational workflows. Familiarity with performance testing tools (JMeter) and monitoring AI performance metrics (latency, response relevance). Knowledge of cloud environments (AWS, Azure, or GCP).