About this role
Lead the end-to-end development of chatbot and agent-AI interaction features, and design systems that allow agents to supervise, correct, and train AI models in real time. Collaborate with engineering, data science, operations, and design to build chatbot lifecycle tools and define product metrics and evaluation frameworks to track model quality, deflection rate, and CSAT impact.
Skills for this role
Chatbot developmentAI agent interaction designAgentic system designLarge Language Models (LLMs)Prompting strategiesPrompt orchestrationFine-tuningReinforcement learning from human feedbackHuman-in-the-loopFeedback loop designAnnotation workflowsTraining/annotation platformsIntent classificationKnowledge integrationAuto-evaluation pipelinesModel evaluation frameworksProduct metrics definitionCustomer Satisfaction (CSAT) analysisDeflection rate optimizationProduct managementCross-functional collaborationModel performance monitoringUser journey designConversational AI frameworksMulti-agent orchestrationData orientationModel quality tracking