About this role
The AI Prompt Engineer will design, test, and optimize prompts and evaluation workflows to improve LLM performance in production pipelines. Responsibilities include building prompt libraries, running A/B tests, creating preference data for RLHF, and ensuring model safety and reliability across various AI applications.
Skills for this role
Prompt EngineeringLLM EvaluationRLHFPrompt EvaluationQA EvaluationNLPInstruction TuningSafety AlignmentRAGPythonA/B testingVector searchEmbedding evaluationContent safety labelingNamed entity recognitionInformation extractionLLM observability