About this role
Lead Consultant in Test Automation responsible for driving the quality and reliability of AI and automation solutions across the enterprise and shaping enterprise-wide QA strategy for AI-powered systems. The role includes designing end-to-end automated testing for AI/ML workflows (model training, inference, integration), implementing AI-specific tests (model validation, bias detection, explainability), and leading teams to embed continuous monitoring and AI quality metrics into CI/CD pipelines.
Skills for this role
Test AutomationTest Automation FrameworksAI evaluation methodologiesModel benchmarkingQuality metricsModel validationBias detectionExplainability testingPerformance benchmarkingAPI testingUI testingData pipeline testingModel output testingCollaboration with data scientistsCollaboration with ML engineersCollaboration with software developersLLMsGenerative AIRAGAgentic AIRAGASDeepEvalLLM-as-a-JudgeLangFusePrompt ValidationPrompt Injection TestingAdversarial TestingRed TeamingData ValidationData Quality""Data Drift"