About this role
The Staff Technical Product Manager will lead the transformation of AI evaluation as a core engineering capability, establishing Eval-Driven Development as a standard practice. This role involves defining custom metrics, rubrics, and evaluation strategies for enterprise AI applications and agentic workflows to ensure continuous measurement throughout the AI lifecycle.
Skills for this role
Product ManagementAI/LLM expertiseEvaluation ScienceQuality EngineeringPlatform StrategyLLM-as-a-JudgeAI observabilityCI/CDDeveloper platformsAgent evaluation