Gen AI QA Lead

This role presents an exciting opportunity to contribute towards cutting-edge Gen AI solutions that will shape how PwC delivers value to our clients and our people. You will have an opportunity to work with a team of talented technology and business specialists to design and develop tailored Generative AI tools that transform key areas of our business and to foster a culture of innovation within PwC. As a Gen AI Quality Assurance Lead, you will be accountable for establishing quality assurance frameworks and processes to ensure Gen AI technology solutions undergo comprehensive and efficient testing. You will be also overseeing a team that designs, implements, and maintains both manual and automated testing procedures, and conducts functional, system, integration, and performance testing. Your role as a Gen AI QA Lead will be instrumental in delivering high-quality solutions that meet and exceed PwC's commitment to innovation, client satisfaction, and continued technological growth.

Meaningful work you'll be part of
As a Gen AI QA Lead (Manager) , you'll work as part of a team of problem solvers, helping to solve business issues, deliver high quality client service and operational efficiency. Responsibilities include but are not limited to:

• Lead and manage the Gen AI QA team, providing guidance, mentorship and support
• Manage allocation of Gen AI QA resources to projects based on capacity and skillset
• Develop, implement and enforce comprehensive testing frameworks, processes and tooling and continuously optimize them to enhance their effectiveness, speed and quality
• Ensure the quality and reliability of Gen AI solutions through rigorous testing and validation
• Contribute to insights, risk evaluations and estimation discussions to ensure alignment quality standards and that testing considerations are well-integrated into project planning
• Analyze project requirements, user feedback, and architectural and design documents to ensure completeness and testability
• Design, document and execute robust test strategies, test cases, scenarios, and scripts tailored to the specific requirements of Gen AI projects to ensure product quality
• Utilize defect tracking system to record, trace, and drive the resolution of defects and issues discovered during testing
• Investigate and determine the source of problems, which may include identifying test deficiencies or deviations from requirements
• Assist in reproducing issues and conducting root cause analysis to facilitate swift resolution

Experiences and skills you'll use to solve
• Experience performing different types of testing for complex applications and leading technology QA teams
• Experience using automated testing tools and platforms
•

Software development tools and defect tracking systems like Azure DevOps, Jira
• Automation testing tools (Playwright, JMeter, SoapUI, postman)

Database experience (SQL)
• Knowledge of Python for Gen AI development and testing
• Competent in designing and executing AI prompt engineering and testing scenarios, ensuring the robustness of AI and large language models
• Microsoft Copilot/Agents experience
• Working with high level UX principles such as user stories, persona building, prototype/prototype development approaches and information architecture and customer/product research methodologies (e.g., A/B testing and MVT)
• Experience with Agile methodologies
• PwC Canada is committed to cultivating an inclusive, hybrid work environment. Exact expectations for your team can be discussed with your interviewer.

Why you'll love PwC
We're inspiring and empowering our people to change the world. Powered by the latest technology, you'll be a part of diverse teams helping public and private clients build trust and deliver sustained outcomes. This meaningful work, and our continuous development environment, will take your career to the next level. We reward your impact, and support your wellbeing, through a competitive compensation package, inclusive benefits and flexibility programs that will help you thrive in work and life. Learn more about our Application Process and Total Rewards Package at: https://jobs-ca.pwc.com/ca/en/life-at-pwc

PwC Canada acknowledges that we work and live across Turtle Island, on the land that is now known as Canada, which are the lands of the ancestral, treaty and unceded territories of the First Nations, Métis and Inuit Peoples. We recognize the systemic racism, colonialism and oppression that Indigenous Peoples have experienced and still go through, and we commit to allyship and solidarity.

At PwC Canada, our most valuable asset is our people and we grow stronger as we learn from one another. We're committed to creating an equitable and inclusive community of solvers where everyone feels that they truly belong. We understand that experience comes in many forms and building trust in society and solving important problems is only possible if we reflect the mosaic of the society we live in.
We're committed to providing accommodations throughout the application, interview, and employment process. If you require an accommodation to be at your best, please let us know during the application process.