New opportunity

Senior AI/ML Engineering Manager

Bain & Company, Inc. · Atlanta, Austin, Chicago, Dallas, Houston, United States

About this role

Senior AI/ML Engineering Manager leads the Data and ML Engineering function for the Diligence Platform, owning teams that build feature and embedding pipelines, model serving and LLMOps infrastructure, and production RAG and retrieval systems. The role combines people management, hands-on technical direction, operational ownership, and hybrid in-office presence at least one day per week.

Skills for this role

ML EngineeringData EngineeringFeature pipelinesEmbedding pipelinesModel servingModel deploymentLLMOpsRetrieval systemsRAGModel registryMLflowPythonDatabricksAWSDockerKubernetesTerraformPortkeyLangChainLlamaIndexResponse cachingInference orchestration frameworksRequest batchingConcurrency tuningThroughput tuningLatency budgetingQuantisationChunking strategiesContextual embeddingHybrid retrieval