AI Architect/AI Engineer – Generative & Agentic AI

Cencora seeks a hands-on AI Architect to lead the design and delivery of enterprise-scale Generative and Agentic AI solutions. The role spans system architecture, rapid proofs of concept and MVPs, API-first integration, and technical governance, turning business needs into production-grade systems and mentoring engineering teams.

Responsibilities

• Own AI solution architecture from concept through production, including platforms built with LLMs, RAG pipelines, vector databases, and multi-agent orchestration.
• Develop POCs and MVPs to validate use cases and reduce technical risk. Design REST or GraphQL APIs that make AI capabilities available to applications and enterprise systems.
• Set architecture and coding standards and practices for prompt engineering, model evaluation, AI governance, and Responsible AI. Guide MLOps/LLMOps deployment, monitoring, and model and agent lifecycle management.
• Lead architecture reviews, present designs to executives and engineers, align stakeholders, mentor AI engineers, and assess cloud AI services for scalability, cost, security, and performance.

Required qualifications

• Bachelor’s or Master’s degree in Computer Science, AI, Data Science, or a related field; 6+ years of overall IT experience across software engineering, cloud architecture, and/or AI/ML; and 3+ years of hands-on architecture experience specifically with Generative or Agentic AI systems.
• Strong Python expertise; experience architecting LLM solutions; deep knowledge of RAG, vector databases, and embeddings; and architecture experience on at least one of Azure, AWS, or GCP, including native AI services.
• Proven MLOps/LLMOps experience covering CI/CD, Docker or Kubernetes, observability, and evaluation frameworks. Knowledge of AI governance, security, compliance, and Responsible AI, plus the ability to communicate architecture to executives and engineers.

Preferred qualifications

• Agent state management and persistent memory, Model Context Protocol, AI evaluation and observability tools, consulting or client-facing architecture, relevant cloud certifications, and NL-to-SQL, knowledge graphs, or GraphRAG.
• Healthcare knowledge is strongly preferred, particularly healthcare distribution, specialty pharmacy, or EMR/EHR data such as HL7, FHIR, claims, and NDC-level data.

The team uses Databricks, Azure AI Foundry, and models from providers including Anthropic and OpenAI. This is a remote, full-time position listed in Texas, United States, at 40 hours per week. Cencora lists medical, dental, and vision benefits, wellness and family-support resources, leave, and professional development opportunities.