About this role
The Opportunity: Join the PwC Acceleration Center India to shape the future of business for a diverse global client portfolio. As a Deals Advisory - AI Engineer within the Forensic Technology practice, you will join the AI Research team to contribute to model benchmarking and experimentation capabilities. You will play a pivotal role in building and evolving AI benchmarking platforms, enabling robust model evaluation and influencing technical strategy. Responsibilities: - Develop and evolve AI benchmarking and experimentation platforms to support model evaluation. - Design and execute end-to-end benchmarking workflows to generate actionable insights. - Build scalable evaluation frameworks and metrics by integrating engineering with academic research. - Maintain and enhance experimentation infrastructure for production-grade engineering. - Produce clear insights and support technical demonstrations for clients. - Utilize Python for asynchronous programming, multithreading, and maintainable code. - Build automated testing pipelines to assess model performance. - Deploy machine learning workloads to cloud platforms (Azure, AWS, or GCP). - Implement CI/CD processes and containerization using Docker or Podman. - Apply knowledge of LLMs and utilize APIs for models like Azure and OpenAI. - Collaborate with forensic technology teams to address fraud, investigations, and regulatory challenges. Requirements: - Bachelor's degree. - 3-7 years of experience. - Oral and written proficiency in English. Preferred Qualifications: - Knowledge of statistics and experimental design. - Experience with LLM evaluation techniques, including LLM-as-a-Judge. - Strong analytical thinking and data analytics skills. - Experience in cybersecurity and market analysis. - Ability to build scalable AI research infrastructure.