About this role
Applied Scientist on the AGI team responsible for developing quality strategies and auditing frameworks for Amazon Nova LLMs and multimodal systems, performing manual and meta-audits, and building LLM-as-a-Judge systems and machine learning models for automated quality assessment.
Skills for this role
Machine LearningStatisticsQuality AssuranceAuditing MethodologiesAutomated Evaluation SystemsLarge Language Models (LLMs)Multimodal SystemsStandard Operating Procedures (SOPs)Quality MetricsSampling MethodologiesManual AuditingMeta-AuditsLLM-as-a-Judge SystemsEvaluation RubricsAutomated Quality AssessmentRoot Cause AnalysisData Collection WorkflowsPythonJavaC++SQLOracleData WarehouseAlgorithm ImplementationResearch Publications