About this role
Teladoc Health seeks a Staff AI Engineer, GenAI to architect, build, and operate scalable generative AI and machine learning solutions for its Data & AI Platform. The role combines hands-on engineering with technical direction and mentorship, working with data scientists, ML engineers, and platform teams to deliver reliable AI services for healthcare products.
Responsibilities
- Operationalize LLM applications using retrieval-augmented generation (RAG), vector search, prompt engineering, agentic AI, and Model Context Protocol (MCP). Lead production LLM and ML pipelines covering data transformation, feature engineering, training, tuning, and serving.
- Design data and AI workflows on Snowflake, Databricks, and Azure ML. Build secure, performant API-based model services using frameworks such as FastAPI and Flask.
- Implement CI/CD and MLOps/LLMOps practices, including experiment tracking, model versioning, observability, monitoring, and governance. Tools include GitHub Actions or Azure DevOps, MLflow, Docker, and Kubernetes.
- Diagnose inference latency, model drift, and production performance issues; document architecture and operational standards. Mentor engineers and collaborate with product, compliance, and security teams to integrate resilient AI services in a regulated healthcare environment. The position has no supervisory responsibilities.
Required qualifications
- A bachelor's degree in Computer Science, Engineering, Machine Learning, or a related field, or equivalent work experience; 8+ years in AI/ML engineering, including experience architecting and scaling production LLM/GenAI and ML systems.
- Experience deploying RAG, vector database integrations, and agentic or tool-augmented LLM systems; experience with Snowflake or Databricks as a core data or AI platform.
- Proven MLOps/LLMOps experience with automated delivery, serving, monitoring, and governance using tools such as Docker, Kubernetes, Azure ML, MLflow, and Terraform. Python and SQL proficiency and experience processing high-volume data with Spark or equivalent distributed systems are required, as is cross-disciplinary collaboration in regulated industries.
Preferred qualifications include strong communication and mentorship, API-driven AI development experience, relevant platform certifications, and healthcare AI or regulated AI deployment experience. This is a full-time remote role in the United States with a $200,000–$230,000 base salary range, eligibility-based performance bonus and benefits, a Flexible Vacation Policy, and 80 hours of annual Paid Sick, Safe, and Caregiver Leave. Applicants must be authorized to work in the United States without current or future visa sponsorship; Teladoc Health will not sponsor or transfer work visas for this position.