About this role
The AI Platform Administrator is responsible for the end-to-end administration, deployment, and governance of the organization's Large Language Model landscape. This role covers both self-hosted models and commercial LLM services like Microsoft 365 Copilot, Azure OpenAI, Claude, and Gemini. The administrator acts as the primary point of contact for operations, user enablement, licensing, consumption monitoring, and policy enforcement, working across IT, Security, and Legal teams to maximize business value while mitigating risks. Responsibilities include: Administration: Deploying and maintaining self-hosted LLMs on-premises or in the cloud, optimizing infrastructure (GPU/CPU/memory), managing model lifecycles, and configuring access controls. Managing commercial LLM subscriptions, provisioning user access, and coordinating with vendors. Tracking and Governance: Maintaining a centralized inventory of licenses and API keys, monitoring usage metrics, enforcing data handling policies, and conducting audits. User Enablement: Developing training materials and onboarding guides to drive AI adoption. Reporting: Presenting usage and cost trends to leadership and recommending process improvements. Candidate Requirements: Candidates must have 10+ years of overall IT/systems administration experience, with at least 4 years specifically focused on AI/ML platform management. Required technical skills include hands-on experience with self-hosted and commercial LLM platforms, Microsoft Power Platform, cloud infrastructure (Azure/AWS), containerization (Docker/Kubernetes), and scripting (Python/Bash/PowerShell). A Bachelor’s degree in Engineering, Computer Science, or a related field is required. Preferred qualifications include AI-related certifications or Microsoft platform certifications. The role requires strong analytical, communication, and stakeholder management skills, along with a demonstrated ability to evaluate AI-generated outputs and identify business use cases.