New opportunity

Senior Applied AI Engineer

Qualitate · New York City, United States

About this role

Build the LLM and retrieval systems for Qualitate’s AI Moderator, designing agentic pipelines, scaling retrieval over proprietary data, and shipping production systems that turn expert interviews into structured, queryable intelligence.

Skills for this role

LLM orchestrationPrompt designSystem design for LLMsRetrieval-augmented generationTool/function callingStructured output designModel routingLatency optimizationEvaluation frameworks (offline and online)Monitoring for AI systemsGuardrails for AI systemsProduction APIsMicroservicesPythonTypeScriptVector databasesSearch and retrieval optimizationUnstructured data processingAudio processingSpeech-to-text (DeepgramAssemblyAIWhisper)ETLData engineeringAgentic conversational systemsMulti-turn conversational systemsLLM-as-judge