About this role
Lead the design, prototyping, and scaling of AI solutions across Humana, working cross-functionally with engineers, designers, data scientists, and business stakeholders to move use cases from discovery to production through Humana's enterprise AI governance. Own strategy, hands-on prototyping, requirements, delivery, and evaluation (golden sets, offline/live evals, metrics) for a complex AI product area.
Skills for this role
Product ManagementAI product developmentGenerative AIAI/MLLarge Language Models (LLMs)AgentsRetrieval-Augmented Generation (RAG)Prompt EngineeringEvaluation methodologyBuilding evaluation datasetsGolden setsGround truthOffline evaluationLive evaluationPrecisionRecallF1Hallucination rateLLM-as-judgeAgent frameworksGraphRAGKnowledge graphsReusable skillsPluginsAgentic codingClaude CodeCursorOpenAI CodexSolution architectureService design」「Requirements scoping