Position Summary
We are seeking a forward-thinking hands-on Quality Assurance Automation Lead (Assistant Manager) to join our ITS AI COE. In this role you will bridge the gap between high-level quality strategy and on-the-ground technical implementation. You will build and lead the daily execution of our automated testing strategies for enterprise applications, serving as the primary technical authority on test automation using Python and Playwright. Additionally, you will dedicate a portion of your focus to establishing quality guardrails for our emerging AI-driven solutions.
Work you'll do
As an AI QA Lead - Assistant Manager on the ITS AI COE team, you will be responsible for…
- Design, build, and maintain test automation frameworks using Python and Playwright for user interface and end-to-end testing
- Develop and execute test coverage for artificial intelligence features, including large language model guardrails for hallucinations, prompt injection, bias, toxicity, and jailbreak scenarios
- Drive automation across user interface and application programming interface layers to support coverage for core platforms and services
- Integrate automated testing into continuous integration and continuous delivery pipelines and maintain reporting dashboards for quality metrics, defect trends, and application health
- Collaborate with software engineers, artificial intelligence engineers, and product managers while mentoring junior quality assurance analysts on automation development and delivery practices
The team
Internal Services supports Deloitte professionals across the firm by providing operational support and advisory services that enable client-facing teams to focus on serving clients. This team spans Human Resources, Clients & Industries, Finance & Legal, Shared Services, National Quality & Risk Management, IT Services, and Workplace Services & Real Estate.
Location: Hyderabad
Shift Timings: 11 AM to 8 PM IST
Qualifications
Required:
- Bachelor’s or master’s degree in Computer Science, Software Engineering, or Information Technology
- 5 to 8 years of experience in test automation, including 2+ years of experience in artificial intelligence testing
- Experience building test automation frameworks using Python and Playwright
- Experience testing large language model applications, including guardrail testing for prompt injection, hallucination, bias, toxicity, and jailbreaks
- Experience testing Representational State Transfer application programming interfaces and microservices
- Experience integrating automated tests into continuous integration and continuous delivery pipelines in Azure DevOps
- Experience working in Agile or Scrum environments
Preferred:
- Experience with Pytest
- Experience with Ragas or LangSmith
- Experience creating automated test reporting dashboards
- Experience supporting enterprise applications
- Experience supervising or mentoring quality assurance analysts