New opportunity

Architect

Virtusa · Hyderabad, India

About this role

The AI Architect (Agentic Solutions & Engineering Enablement) will design and implement enterprise-grade, single-agent and multi-agent systems capable of autonomous reasoning, planning, memory management, and task decomposition. The role focuses on building advanced RAG pipelines, integrating tools via Model Context Protocol, and leveraging frameworks like LangGraph, Semantic Kernel, or AutoGen. Responsibilities include championing AI coding assistants, building reference architectures for engineering teams, establishing governance and compliance guardrails, and mentoring teams on prompt engineering and LLM orchestration. The architect will also oversee MLOps/LLMOps pipelines to ensure scalability, cost optimization, and robust telemetry monitoring. Required qualifications include 10-12+ years in software engineering, with at least 3 years focused on enterprise AI/ML and Generative AI systems. Candidates must possess deep hands-on proficiency in Python, modern LLM APIs, and vector databases, along with experience in cloud-native AI services such as AWS Bedrock, Azure AI Foundry, or Google Cloud Vertex AI.

For full details about this role, click “Apply on company site” to view the employer’s original posting.

Skills for this role

PythonGenerative AILLMsRAGLangChainLangGraphSemantic KernelAutoGenVector DatabasesOpenAIAnthropicAWS BedrockAzure AI FoundryGoogle Cloud Vertex AIAgentOpsPrompt EngineeringMLOpsLLMOpsModel Context Protocol

Your skill match

Checking your profile…

YOUR NEXT STEP

Get interview-ready for this role

A focused preparation guide, built around this job’s responsibilities and requirements.

✦ AI-generated guide
Preparation suggestions, not the employer’s actual interview questions. Always check the original posting for current requirements.
01

Understand the role

What matters most

  • Agentic System Design and Orchestration

    The primary technical focus is building enterprise-grade, multi-agent systems that handle autonomous reasoning, planning, and memory management. You must demonstrate proficiency in selecting and implementing frameworks like LangGraph, Semantic Kernel, or AutoGen to solve complex task decomposition problems.

  • Engineering Enablement and Governance

    You are expected to act as a bridge between AI capabilities and engineering productivity. This involves creating reference architectures, secure sandbox environments, and governance guardrails that allow engineering teams to adopt AI coding assistants and LLM-based tools safely and consistently.

  • LLMOps and Production Scalability

    Beyond initial design, you must oversee the full lifecycle of AI agents. This requires establishing robust MLOps/LLMOps pipelines that prioritize cost optimization, telemetry monitoring, and observability to ensure that deployed agents remain performant and reliable in production.

Likely challenges to think through

  • Balancing Autonomy with Enterprise Guardrails

    Designing autonomous agents that can perform task decomposition while adhering to strict corporate compliance and security policies is inherently difficult. Prepare to discuss how you implement human-in-the-loop checkpoints and automated guardrails to mitigate risks like hallucination or unauthorized data access.

  • Standardizing Agentic Workflows Across Teams

    Driving AI adoption across diverse engineering units requires balancing flexibility with standardization. You may face resistance or technical debt when introducing new frameworks like the Model Context Protocol. Prepare to explain your strategy for mentoring teams and building reusable components that simplify adoption without stifling innovation.

03

Practice your answers

Technical practice

Multi-Agent Orchestration Design

What to coverExplain your approach to designing multi-agent systems that require autonomous reasoning and task decomposition. Discuss how you manage state, memory, and communication between agents using frameworks like LangGraph or AutoGen.

Advanced RAG Pipeline Architecture

What to coverDescribe the components of an enterprise-grade RAG pipeline beyond basic retrieval. Focus on how you handle document chunking, vector database selection, re-ranking strategies, and integration with the Model Context Protocol.

Agent Observability and Guardrails

What to coverHow do you implement production-ready guardrails and human-in-the-loop checkpoints for autonomous agents? Explain your strategy for monitoring agent performance and telemetry using AgentOps or similar observability tools.

LLMOps and Scalability

What to coverDetail your experience in managing LLMOps pipelines for enterprise AI. Address how you handle cost optimization, model versioning, and scaling inference workloads across cloud-native platforms like AWS Bedrock or Azure AI Foundry.

Tool Integration via Model Context Protocol

What to coverExplain the role of the Model Context Protocol (MCP) in connecting LLMs to external data and tools. Discuss the trade-offs between using standardized protocols versus custom API integrations in a multi-agent environment.

Governance and Security in AI Development

What to coverWhat frameworks do you use to establish governance and compliance guardrails for AI-assisted software development? Discuss how you ensure secure workflows when integrating AI coding assistants into existing engineering pipelines.

Prompt Engineering and Orchestration Patterns

What to coverDiscuss advanced prompt engineering patterns you use to improve LLM reasoning and reliability. Explain how you mentor teams to move from simple prompting to complex orchestration workflows.

Cloud-Native AI Service Selection

What to coverCompare the capabilities of AWS Bedrock, Azure AI Foundry, and Google Cloud Vertex AI for building agentic solutions. Suggest criteria for selecting the appropriate cloud provider based on specific enterprise requirements.

Behavioural practice

Championing AI Adoption

What to coverDescribe a situation where you had to drive the adoption of new AI tools or methodologies within an engineering team. How did you address resistance and ensure the team felt supported during the transition?

Mentoring Technical Teams

What to coverProvide an example of how you have mentored engineers or tech leads on complex topics like LLM orchestration. How do you tailor your technical guidance to different skill levels?

Handling AI System Failures

What to coverTell me about a time an AI system you designed failed or behaved unexpectedly in production. What steps did you take to diagnose the issue, implement a fix, and prevent recurrence?

Balancing Innovation with Governance

What to coverDescribe a scenario where you had to balance the need for rapid AI experimentation with strict enterprise security and compliance policies. How did you reach a resolution that satisfied both needs?

02

Sharpen your knowledge

Topics to prepare

  • Multi-Agent Orchestration Patterns

    Review architectural patterns for autonomous reasoning, planning, and task decomposition. Exercise: Design a conceptual multi-agent workflow where one agent handles data retrieval, another performs reasoning, and a third manages human-in-the-loop verification. This is directly relevant to the requirement for building enterprise-grade agentic systems.

  • LLMOps and Agent Observability

    Study the lifecycle of LLM-based applications, focusing on telemetry, cost optimization, and governance. Exercise: Map out a monitoring strategy for an agentic system that tracks latency, token usage, and hallucination rates. This addresses the role's responsibility for overseeing MLOps/LLMOps pipelines and ensuring production-ready guardrails.

  • Model Context Protocol (MCP) and Integration

    Understand the standards for connecting AI models to external tools and data sources. Exercise: Research how MCP facilitates standardized tool integration and draft a plan for integrating a legacy database into an agentic workflow using this protocol. This is essential for the role's focus on building advanced RAG pipelines and tool integration.

Skills to revise

  • Agentic Framework Implementation

    Gain hands-on experience with LangGraph, Semantic Kernel, or AutoGen. Exercise: Build a simple stateful agent using LangGraph that includes a checkpointing mechanism for human-in-the-loop intervention. This directly maps to the required proficiency in orchestration libraries.

  • Cloud-Native AI Service Deployment

    Practice deploying models and RAG components using AWS Bedrock, Azure AI Foundry, or Google Cloud Vertex AI. Exercise: Configure a RAG pipeline using a managed vector database service on one of these platforms. This is critical for meeting the cloud-native infrastructure requirements of the role.

  • Advanced Prompt Engineering for Orchestration

    Develop techniques for complex prompt chaining and system instructions. Exercise: Create a set of system prompts for an agent that requires strict adherence to compliance guardrails and specific output formats. This is relevant to the mentoring responsibilities and the need for secure AI-assisted development.

04

Your preparation checklist

  • Prepare a multi-agent system case study

    Develop a technical walkthrough of a project where you designed a multi-agent system. Focus on how you handled task decomposition, memory management, and autonomous reasoning using frameworks like LangGraph or AutoGen.

  • Demonstrate RAG and MCP implementation experience

    Create a summary of an advanced RAG pipeline you have built. Be prepared to explain how you integrated external tools or APIs using the Model Context Protocol (MCP) to enhance agent capabilities.

  • Outline an AI governance and enablement strategy

    Draft a proposal for establishing AI governance guardrails and secure sandbox environments within an enterprise engineering team. Include how you would mentor teams on prompt engineering and safe LLM orchestration.

  • Review LLMOps and telemetry best practices

    Prepare to discuss your approach to MLOps/LLMOps, specifically focusing on cost optimization, scalability, and implementing robust telemetry monitoring for production-grade AI agents.

  • Formulate strategic questions for the interview

    Prepare questions regarding the current maturity of their internal developer platforms, how they balance speed of AI adoption with enterprise compliance, and the specific cloud-native AI services (AWS, Azure, or GCP) they prioritize for agentic workloads.

AI-generated from the job information · Prepared Oct 30, 2026 (UTC)Useful preparation, not a guarantee of eligibility or an offer.

Availability has not yet been verified. Status can change after a check; confirm on the employer’s website. Report an issue · Our checking policy

KEEP EXPLORING

Similar AI jobs

Related skills and specializations in India. Matched to this role, not your profile.

Explore more jobs
Finding similar opportunities…