New opportunity

AI INFRASTRUCTURE ENGINEER

A4I Lab (IIIT-B × Microsoft) · Bangalore, India

About this role

The A4I Lab (a partnership between Microsoft and IIIT-B) is seeking an AI Infrastructure Engineer to build and own the cloud backbone for autonomous multi-agent systems. This role focuses on engineering scalable, secure, and sustainable infrastructure for Digital Public Goods (DPGs) in sectors like education, healthcare, and agriculture. Responsibilities include designing multi-application cloud environments on Azure, implementing Infrastructure as Code (IaC) with Terraform and Ansible, and managing containerized AI services via Docker and Kubernetes. You will maintain CI/CD pipelines, evolve MLOps tooling, and ensure platform resilience through disaster recovery planning and robust observability stacks. Additionally, you will manage cloud cost governance and automate operational workflows using Python and Bash. Required qualifications include a Bachelor’s or Master’s degree in Computer Science or Engineering, 5-8 years of total experience, and at least 2 years specifically supporting live AI/ML workloads in production. Candidates must demonstrate experience managing infrastructure for multiple live applications simultaneously and possess a track record of cloud cost optimization. Preferred qualifications include experience with Azure AI services (Azure OpenAI, Cognitive Services), vector databases (pgvector, Qdrant), and open-source DPG deployments. This is a contract position based at IIIT Bangalore, extendable through March 2027.

For full details about this role, click “Apply on company site” to view the employer’s original posting.

Skills for this role

AzureAWSGCPTerraformAnsibleDockerKubernetesAKSGitHub ActionsAzure DevOpsPostgreSQLMongoDB AtlasCosmosDBAzure MonitorGrafanaPrometheusELKOpenSearchEntra IDCloudflarePythonBashMLOpsIaC

Your skill match

Checking your profile…

YOUR NEXT STEP

Get interview-ready for this role

A focused preparation guide, built around this job’s responsibilities and requirements.

✦ AI-generated guide
Preparation suggestions, not the employer’s actual interview questions. Always check the original posting for current requirements.
01

Understand the role

What matters most

  • Multi-Application Cloud Backbone Ownership

    The role requires managing a portfolio of live agentic AI applications simultaneously rather than a single environment. You must demonstrate the ability to design and maintain consistent, reproducible infrastructure across diverse projects using Azure, ensuring environment parity between staging and production.

  • Production-Grade AI/ML Infrastructure

    You must support live AI workloads, specifically managing containerized services like LLM inference endpoints, RAG pipelines, and vector databases. This includes implementing MLOps tooling for model versioning and monitoring to ensure reliable, auditable releases.

  • Infrastructure as Code and Automation

    Proactive automation is mandatory. You are expected to use Terraform and Ansible to eliminate manual provisioning and build self-healing operational workflows using Python and Bash, moving away from reactive ticket-based support.

  • Cloud Cost Governance and Optimization

    Given the focus on Digital Public Goods, you must actively manage cloud spend. This involves right-sizing resources, planning reserved capacity, and rationalizing multi-application Azure subscriptions to balance performance with strict cost ceilings.

Likely challenges to think through

  • Balancing High Availability with Cost Constraints

    The lab serves underserved communities with specific uptime needs, yet operates under strict cost ceilings. Prepare by being ready to discuss specific strategies for right-sizing infrastructure and choosing between managed services versus open-source alternatives to maintain resilience without overspending.

  • Managing Stateful AI Workloads in Kubernetes

    Supporting vector databases and RAG pipelines in AKS introduces complexity regarding stateful workload recovery and data persistence. Prepare by reviewing your experience with persistent volume claims, backup strategies for heterogeneous databases, and tested disaster recovery drills.

  • Securing Multi-Tenant and Sensitive Data

    Handling PI data and ensuring compliance in social-impact projects requires rigorous security. Prepare by detailing your experience with Entra ID, secrets management, and encryption, specifically how you enforce these across a portfolio of distinct applications.

03

Practice your answers

Technical practice

Designing Multi-Application Azure Environments

What to coverExplain your approach to managing a portfolio of distinct AI applications within a single Azure subscription or across multiple subscriptions. Focus on how you maintain environment parity between staging and production while ensuring security and resource isolation.

Implementing IaC for Complex AI Workloads

What to coverDescribe your workflow for using Terraform and Ansible to manage infrastructure. Discuss how you handle state management, modularity, and GitOps integration to ensure that infrastructure changes are reproducible and auditable.

Managing Stateful Workloads in Kubernetes

What to coverDiscuss the challenges of running stateful AI services, such as vector databases or RAG pipeline backends, on AKS. Explain how you handle persistent storage, data consistency, and graceful pod disruption during cluster scaling or upgrades.

Designing Disaster Recovery for Heterogeneous Data Stores

What to coverDetail your strategy for architecting DR plans across different database types like PostgreSQL, MongoDB Atlas, and CosmosDB. Address how you define and validate RTO/RPO targets in a cloud-native environment.

Building Observability for AI Pipelines

What to coverExplain how you would set up an end-to-end observability stack using Prometheus, Grafana, and ELK/OpenSearch for AI services. Focus on how you monitor inference latency, model performance, and infrastructure health simultaneously.

Cloud Cost Governance and Optimization

What to coverProvide examples of how you have performed cloud cost right-sizing and reserved capacity planning in a production environment. Explain the metrics you use to justify infrastructure spend versus performance requirements.

Securing AI Infrastructure

What to coverDescribe your approach to implementing Entra ID access control, secrets management, and encryption for sensitive data in AI applications. How do you ensure compliance with PI data handling requirements while maintaining operational agility?

Automating Operational Workflows with Python and Bash

What to coverProvide an example of a complex operational task you automated using Python or Bash to move from reactive support to self-healing infrastructure. Focus on the design principles that make your scripts production-ready and maintainable.

Scaling Vector Database Infrastructure

What to coverDiscuss the infrastructure considerations for deploying vector databases like pgvector or Qdrant at scale. Address how you handle indexing, memory requirements, and query performance for embedding pipelines.

Behavioural practice

Managing Conflicting Priorities Across Multiple Projects

What to coverDescribe a situation where you had to manage infrastructure for multiple live applications simultaneously. How did you prioritize tasks, handle resource contention, and ensure that a failure in one application did not impact the others?

Proactive Ownership of Infrastructure

What to coverGive an example of when you identified a systemic infrastructure issue before it became a critical incident. Explain the steps you took to own the resolution and prevent future occurrences without waiting for a ticket.

Collaborating with Non-Infrastructure Teams

What to coverDescribe a time you worked closely with AI architects or research teams to deploy a new model or service. How did you bridge the gap between their requirements and your infrastructure constraints to ensure a successful, scalable deployment?

Handling Production Incidents in High-Stakes Environments

What to coverShare an experience where you had to lead the response to a production outage in a critical system. How did you manage the incident, communicate with stakeholders, and perform a post-mortem to improve platform resilience?

02

Sharpen your knowledge

Topics to prepare

  • Production AI/ML Infrastructure Lifecycle

    Focus on the end-to-end management of AI workloads, specifically LLM inference endpoints and RAG pipelines. Exercise: Draft a conceptual architecture for deploying a RAG-based application on Azure Kubernetes Service (AKS), detailing how you would handle model versioning, inference monitoring, and stateful workload management.

  • Cloud Cost Governance and Optimization

    The role requires a proven track record of managing cloud spend for multiple live applications. Exercise: Create a strategy document outlining how you would implement right-sizing, reserved capacity planning, and automated cost-alerting for a multi-tenant Azure environment to ensure sustainability.

  • Disaster Recovery and Platform Resilience

    Focus on designing recovery strategies for heterogeneous data stores and Kubernetes clusters. Exercise: Design a disaster recovery plan for a multi-region deployment that includes specific RTO/RPO targets for PostgreSQL and CosmosDB, including a step-by-step procedure for a simulated failover drill.

Skills to revise

  • Infrastructure as Code (IaC) with Terraform/Ansible

    The role demands eliminating manual provisioning in favor of reproducible GitOps workflows. Exercise: Write a modular Terraform script to provision a secure Azure environment, including a virtual network, a managed Kubernetes cluster, and a Key Vault for secrets management.

  • Observability and Incident Response

    Proficiency in building dashboards and alerting for production systems is essential. Exercise: Configure a Prometheus/Grafana dashboard to monitor key metrics for an AI service, such as inference latency, request throughput, and pod resource utilization, and define an incident runbook for when thresholds are breached.

  • Python and Bash Automation

    Automation is required for operational workflows and self-healing infrastructure. Exercise: Develop a Python script that interacts with the Azure SDK to identify and report underutilized resources or to automate the rotation of secrets across your infrastructure.

04

Your preparation checklist

  • Prepare a Multi-Application Infrastructure Case Study

    Draft a concise technical summary of a past project where you managed infrastructure for multiple live applications simultaneously. Focus on how you maintained environment parity, handled shared resources, and ensured isolation between services using Terraform or Ansible.

  • Develop an AI/ML Production Deployment Walkthrough

    Create a high-level architectural diagram and explanation of a production pipeline you built for AI workloads. Highlight how you managed containerized inference endpoints (e.g., AKS), integrated vector databases, and implemented MLOps practices like model versioning or automated testing gates.

  • Document Cloud Cost Governance and Optimization

    Prepare a summary of your experience with cloud cost management. Include specific examples of how you identified waste, implemented right-sizing strategies, or utilized reserved capacity to meet strict budget constraints in a production Azure environment.

  • Draft a Disaster Recovery and Resilience Plan

    Outline your approach to designing backup and restoration strategies for stateful services like PostgreSQL or MongoDB. Be prepared to discuss how you define RTO/RPO targets and conduct DR drills for cloud-native applications.

  • Formulate Strategic Questions for the Interviewers

    Prepare thoughtful questions regarding the lab's specific challenges, such as: 'How does the team balance the need for rapid DPG deployment with the strict data sovereignty and security requirements of social impact projects?' or 'What are the primary bottlenecks currently faced in scaling the multi-agent system infrastructure?'

AI-generated from the job information · Prepared Oct 10, 2026 (UTC)Useful preparation, not a guarantee of eligibility or an offer.

Availability last checked: 18 Oct 2026. Status can change after a check; confirm on the employer’s website. Report an issue · Our checking policy

KEEP EXPLORING

Similar AI jobs

Related skills and specializations in India. Matched to this role, not your profile.

Explore more jobs
Finding similar opportunities…