About this role
Lead and scale the engineering team building PermitFlow's core agentic infrastructure and evaluation systems, owning technical architecture, model serving, orchestration, and evaluation pipelines to improve automation accuracy and reliability in production.
Skills for this role
Agentic infrastructureProduction AI systemsModel servingOrchestrationLatency optimizationCost optimizationFailure handlingEvaluation infrastructureGolden datasetsLLM-as-judgeHuman annotationOnline monitoringDrift detectionRegression monitoringSystem designSoftware architectureModel behavior analysisEvaluation designObservabilityReliability engineeringHuman-in-the-loop systemsCode reviewArchitecture reviewHiring and leadership