About this role
The Applied Scientist will develop and lead quality strategies, auditing frameworks, and automated evaluation systems for LLM and multimodal models (Amazon Nova), perform manual and meta-audits, and build LLM-as-a-Judge systems and evaluation rubrics to ensure high-quality training and evaluation data.
Skills for this role
Machine LearningStatisticsQuality AssuranceAuditing MethodologiesAutomated Evaluation SystemsLarge Language Models (LLMs)Multimodal SystemsQuality MetricsSampling MethodologiesManual AuditingMeta-auditsLLM-as-a-Judge SystemsEvaluation RubricsAutomated Quality AssessmentData Collection WorkflowsSOP DevelopmentJavaC++PythonSQLOracleData WarehouseAlgorithm ImplementationResearch Publications