New opportunity

AI Observability Engineer

AIG PC Global Services, Inc. · Atlanta, United States

About this role

Responsible for monitoring model performance, data quality, bias and drift, and managing AI model management platforms and observability pipelines to ensure alignment with AIG’s Responsible AI principles. The role includes collaborating with product, legal, compliance and security teams, creating executive reports and RAI training, and evolving KPIs and observability capabilities.

Skills for this role

Machine LearningLarge Language Models (LLMs)Agentic AIRAGData PipelinesData AnalysisModel Performance MonitoringModel ObservabilityBias DetectionData Drift DetectionAI GovernanceResponsible AIAI EthicsModel Inference MonitoringOpenTelemetryDistributed TracingStructured LoggingFiddlerArizeLangSmithDashboardingAlertingKPIsModel Management PlatformsCross-functional CollaborationRegulatory Frameworks KnowledgeExecutive ReportingTraining Content Development