Role Overview
You are an experienced Software Quality Assurance tester specializing in LLM (Large Language Model) testing and Agents testing. Your role involves analyzing business and technical specifications, defining and executing test cases, and tracking defects. You will work on Artificial Intelligence initiatives within a multidisciplinary team focusing on emerging trends and cutting-edge technologies in financial services for clients. The role offers a hybrid work model to balance work from home and office based on your needs and role requirements.
Key Responsibilities
- Analyze business and technical specifications.
- Write functional test cases and conduct regression testing.
- Report bugs, verify fixes, and maintain the bug tracking system (e.g., Jira).
- Execute automated tests using Selenium with Python.
- Develop automated test scripts using the Pytest framework.
- Automate web services using SoapUI and/or Python.
- Design and execute test plans for Large Language Models (LLMs), including prompt validation, accuracy checks, and safety compliance.
- Perform Agents testing for AI-driven workflows to ensure reliability, robustness, and integration quality.
Qualifications Required
- 8 years of software quality assurance testing experience.
- Proficiency in tools like PyCharm, Visual Studio Code, Git, Fiddler, Postman, SoapUI, JMeter, Jenkins, and Jira.
- Experience in CI/CD-based projects.
- Hands-on experience in LLM testing and Agents testing is highly preferred.
- Basic understanding of artificial intelligence and machine learning algorithms is preferred.
- Familiarity with AI governance, bias detection, and safety validation is an added advantage.
(Note: Omitted additional details of the company as it was not present in the job description)
