Senior QA Engineer

Job Description

Job Description: Job Title: Senior Quality Engineer Experience : 5- 7 years Requirements : Bachelor's/Master's degree in Computer Science or related field. 5-6 years of experience in Quality Engineering (QE) domain. Good understanding of Generative AI tools and platforms - especially LLMs. Foundation Knowledge of Gen-AI concepts, technologies, tools and frameworks Basic understanding of LLM models, prompt engineering, and some exposure to AI Art models and tools Detailed understanding and solid hands-on working knowledge of LLM evaluations, and using evaluators to validate the quality of LLM outputs. Solid knowledge of software testing methodologies, tools, and processes. Excellent analytical and problem-solving skills. Effective communication and collaboration skills. Proven ability to lead and mentor team members. Ability to lead quality assurance for data-driven and data-intensive apps and solutions Ability to prepare and organize test data sets and manage large amounts of test data Performing thorough data validation and verification to ensure accuracy and consistency of data. This includes developing and executing test plans, scripts, and tools for data verification. Build and execute test plans for workflow driven apps and solutions, and pipeline automation solutions Developing and implementing automated testing tools and frameworks to streamline QA processes. Optimize testing procedures for efficiency and effectiveness. ? Responsibilities : >Take ownership of solution quality for a digital product or platform >Collaborate closely with the Dev team and Product team to drive quality engineering and assurance for an existing digital product >Ensure successful client adoption and client onboarding as new clients are onboarded onto a digital product/platform. >Lead and execute comprehensive automated testing strategies for cloud applications, ensuring high quality and reliability. >Hands-on experience with API test tools (ex. Postman, SOAP UI, etc.) , API test automation >Hands-on experience with Test Automation overall ? and the ability to automate all aspects of testing, from UE to Back-End Testing >Proficient in designing, implementing, and maintaining automated test scripts. >Thorough understanding of Gen AI automation principles and implementation. >Solid understanding of using LLM Evaluation frameworks and libraries (such as RAGAS and others) to perform automated evaluation of LLM Outputs >Solid understanding of LLM Quality metrics and validating AI generated outputs > Proven experience on testing of creative apps . > Experience with testing mobile apps is an advantage (nice-to-have) > Collaborate with cross-functional teams to define testing requirements and ensure effective test coverage. >Conduct test case reviews, identify gaps, and provide constructive feedback to improve overall test quality. >Analyze and troubleshoot complex issues in a timely manner, documenting and communicating findings. >Stay updated with industry best practices and emerging technologies in QA and automation. >Mentor and guide junior QA engineers, fostering a collaborative and knowledge-sharing environment. >Continuously improve testing processes and methodologies to enhance efficiency and effectiveness. Location: Pune Brand: Dentsu Creative Time Type: Full time Contract Type: Permanent