About this role
Build infrastructure to create, experiment with, evaluate, and operate LLM and agentic workloads at scale, including synthetic data generation, evaluation pipelines, simulation environments, orchestration, and LLM infrastructure. The role focuses on making non-deterministic AI workloads observable, reproducible, measurable, and scalable for production use.
Skills for this role
Synthetic data generationAutomated labelingEvaluation infrastructureAgentic workflowsSimulation environmentsLLM infrastructureDistributed computeDistributed systemsPythonProduction-quality APIsDeveloper toolingAWSCompute orchestrationStorageNetworkingIsolation and sandboxingFailure handlingPrefectAirflowDagsterRayKubernetesObservabilityTelemetryReliabilityPerformanceDebuggingIncident responseCost managementExperimentation platforms