New opportunity

AI Platform Engineer

Massachusetts Mutual Life Insurance Co. · Boston, United States

About this role

Serve as the technical lead for MassMutual's AI Platform Engineering team, defining architecture and driving design, deployment, and production of AI platform components (LLM gateways, model serving, multi-tenant compute, and developer tooling) while owning reliability, governance, and cross-team alignment.

Skills for this role

Platform engineeringSREKubernetesCertified Kubernetes Administrator (CKA)Certified Kubernetes Application Developer (CKAD)Cloud-native architectureAWSGCPAzureNetworkingIdentity federationMulti-tenancy patternsTerraformPulumiArgoCDGitOpsInfrastructure as Code (IaC)Model servingInference pipelinesGPU resource managementLLM integrationLLM gateway designvLLMTritonRay ServeObservabilitySLO definitionIncident managementAccess managementAudit logging systems (audit logging)