New opportunity

Gen AI Architect

Cognizant · Chennai, India

About this role

Cognizant seeks a Gen AI Architect to lead the design, development and implementation of scalable Generative AI and agentic AI solutions for clients. The posting lists Chennai, India as the job location, describes the role location as Pan India, and specifies a hybrid work model.

Responsibilities

  • Architect high-performance AI solutions on Azure and/or AWS; build containerized applications with Docker and deploy them using Kubernetes.
  • Design multi-agent systems and retrieval-augmented generation (RAG) architectures. Set standards for prompt engineering, vector search and model orchestration.
  • Develop machine learning models with Python or R and frameworks such as TensorFlow, PyTorch or scikit-learn. Build and deploy solutions using AWS SageMaker, Azure AI or Google Vertex AI.
  • Establish LLM observability for performance, system health and usage analytics. Build MLOps pipelines for training, fine-tuning, evaluation, deployment and monitoring.
  • Integrate AI into enterprise products with cross-functional teams; optimize and troubleshoot applications, establish secure and maintainable architecture practices, mentor AI engineers and track advances in AI and cloud technology.

Requirements

  • The posting states 6 to 15 years of experience and separately requires a minimum of 8+ years in a technical architecture role.
  • Expertise in Azure and/or AWS architecture, Docker, Kubernetes, MLOps and cloud-based model deployment; experience with multi-agent orchestration and RAG.
  • Proficiency in Python or R and experience with TensorFlow, PyTorch or scikit-learn. Understanding of prompt engineering, vector search, LLM observability, Spring Boot, microservices, and enterprise AI security, scalability and governance.

The stated notice period is immediate to 90 days, and the role specifies an in-person interview mode.

For full details about this role, click “Apply on company site” to view the employer’s original posting.

Skills for this role

Generative AIAgentic AIAzureAWSDockerKubernetesLLM observabilityPythonRTensorFlowPyTorchscikit-learnAWS SageMakerAzure AIGoogle Vertex AIMulti-agent systemsRetrieval-Augmented GenerationPrompt engineeringVector searchModel orchestrationMLOpsModel fine-tuningSpring BootMicroservicesAI securityAI governance

Your skill match

Checking your profile…

YOUR NEXT STEP

Get interview-ready for this role

A focused preparation guide, built around this job’s responsibilities and requirements.

✦ AI-generated guide
Preparation suggestions, not the employer’s actual interview questions. Always check the original posting for current requirements.
01

Understand the role

What matters most

  • Cloud architecture and deployment

    The role leads scalable, high-performance GenAI solutions on Azure and/or AWS, including Docker applications orchestrated with Kubernetes. It also calls for cloud-native model deployment using SageMaker, Azure AI, or Vertex AI.

  • Agentic AI and RAG design

    The architect designs multi-agent systems and retrieval-augmented generation architectures, and sets standards for prompts, vector search, and model orchestration.

  • MLOps and LLM observability

    The posting assigns ownership of pipelines spanning training, fine-tuning, evaluation, deployment, and monitoring, alongside LLM performance, system-health, and usage analytics.

  • Enterprise integration and safeguards

    The role integrates AI into enterprise products with cross-functional teams, leads performance tuning and troubleshooting, and establishes secure, scalable, maintainable architecture practices.

  • Hands-on technical leadership

    The architect develops models using Python or R and named ML frameworks, mentors AI engineers, and is expected to bring substantial technical architecture experience.

Likely challenges to think through

  • Balancing agent autonomy with control

    Preparation hypothesis: Multi-agent workflows may add coordination and failure modes compared with simpler RAG designs. Prepare to explain when each architecture is justified and how you would evaluate output quality and operational behavior.

  • Reconciling performance with production safeguards

    Preparation hypothesis: High-performance cloud deployment may compete with security, governance, and maintainability. Prepare an architecture example that explains those trade-offs and how you would test and troubleshoot them.

  • Making model behavior observable across its lifecycle

    Preparation hypothesis: Connecting evaluation and MLOps pipelines to live LLM performance, health, and usage signals may be difficult. Prepare to describe which signals would trigger investigation, tuning, or a deployment decision.

03

Practice your answers

Technical practice

How would you architect a scalable Generative AI solution on Azure or AWS?

What to coverThe role calls for high-performance AI architecture on Azure and/or AWS. Suggested preparation: explain component boundaries, scaling choices, and how you would evaluate latency, reliability, and cost trade-offs.

How would you deploy and operate a containerized AI application?

What to coverThe posting specifies Docker applications deployed through Kubernetes. Suggested preparation: describe how you would package the application, manage deployment and scaling, and diagnose an unhealthy service.

How would you design and evaluate a RAG architecture?

What to coverThe role includes RAG architecture and vector search standards. Suggested preparation: discuss retrieval quality, grounding, and how you would distinguish retrieval failures from generation failures.

When would you use a multi-agent system, and how would you coordinate its agents?

What to coverThe posting calls for multi-agent design and orchestration. Suggested preparation: explain task boundaries, coordination and failure handling, including when a simpler approach would be preferable.

What standards would you set for prompts and model orchestration?

What to coverDefining and enforcing prompt-engineering and model-orchestration standards is a stated responsibility. Suggested preparation: address consistency, versioning, evaluation, and the trade-off between shared standards and application-specific needs.

What would you monitor in a production LLM application?

What to coverThe role calls for LLM observability covering performance, system health, and usage analytics. Suggested preparation: explain how those signals would help identify degradation and guide investigation without treating usage alone as a measure of quality.

How would you structure an enterprise MLOps pipeline?

What to coverThe posting names training, fine-tuning, evaluation, deployment, and monitoring as pipeline stages. Suggested preparation: describe the checks and handoffs between stages, including how evaluation results would inform a deployment decision.

How would you develop and deploy a model using the stated programming and cloud options?

What to coverThe role names Python or R, TensorFlow, PyTorch or scikit-learn, and cloud services such as SageMaker, Azure AI or Vertex AI. Suggested preparation: choose a relevant combination you can explain and discuss model development, deployment, and the trade-offs behind that choice.

How would you integrate AI into an enterprise product securely?

What to coverThe posting mentions Spring Boot, microservices, cross-functional product integration, and enterprise AI security and governance. Suggested preparation: describe service boundaries and how you would balance maintainability, scalability, access controls, and governance.

How would you troubleshoot a slow AI-driven application?

What to coverLeading performance tuning and troubleshooting is a stated responsibility. Suggested preparation: describe how you would isolate bottlenecks across retrieval, model calls, application services, and infrastructure, then verify that a change improved the relevant measure.

Behavioural practice

Tell me about a time you aligned teams on an AI integration.

What to coverThe role involves working with cross-functional teams to integrate AI into enterprise products. Suggested preparation: give a real example with the situation, your actions to resolve differing needs, and the result.

Describe a time you set an architecture standard others adopted.

What to coverThe posting calls for setting technical standards and secure, maintainable architecture practices. Suggested preparation: use a real situation to explain the trade-offs, how you gained adoption, and the result.

Tell me about a time you led a difficult performance investigation.

What to coverThe role includes leading optimization and troubleshooting of AI-driven applications. Suggested preparation: describe the situation, how you organized the investigation and decisions, and the measured or observed result.

Describe a time you mentored engineers through a technical challenge.

What to coverMentoring AI engineering teams on implementation practices is a stated responsibility. Suggested preparation: explain the situation, the guidance you provided without taking over the work, and the result.

Tell me about a time you evaluated an emerging AI or cloud approach.

What to coverThe posting expects the architect to stay current with Generative AI, Agentic AI, and cloud advances. Suggested preparation: use a real situation to show how you assessed an option, what action you took or recommended, and the result.

02

Sharpen your knowledge

Topics to prepare

  • Cloud architecture, security and governance

    Revise how an Azure and/or AWS design addresses performance, scalability, security and maintainability. Exercise: sketch a client-facing GenAI architecture and explain its capacity, access-control and governance decisions. The posting explicitly requires cloud architecture expertise and enterprise AI security, scalability and governance.

  • RAG, vector search and prompt standards

    Revise retrieval flow, vector-search relevance and prompt-design trade-offs. Exercise: draw a RAG request path and explain how you would assess retrieval quality versus response quality. The role designs RAG architectures and sets vector-search and prompt-engineering standards.

  • Multi-agent orchestration

    Revise how agents coordinate tasks, pass context and handle failures. Exercise: diagram a multi-agent workflow and identify where orchestration should stop or retry. The posting explicitly calls for multi-agent systems and orchestration experience.

  • MLOps and LLM observability

    Revise the links between training, fine-tuning, evaluation, deployment and monitoring. Exercise: map those stages to performance, system-health and usage measures, then explain how a regression would be investigated. All of these lifecycle stages and observability concerns appear in the posting.

  • Enterprise integration and microservices

    Revise service boundaries and how AI capabilities can be integrated into enterprise products. Exercise: sketch where an AI service would meet a Spring Boot microservice and explain failure handling and maintainability. The posting requires Spring Boot and microservices experience and calls for cross-functional integration.

Skills to revise

  • Containerize and orchestrate an AI application

    Practice packaging a small AI application with Docker and describing its Kubernetes deployment, scaling and troubleshooting steps. This directly reflects the required hands-on Docker and Kubernetes experience.

  • Implement and evaluate a model

    Practice a small model-development exercise in Python or R with TensorFlow, PyTorch or scikit-learn; explain the evaluation result and a limitation. These are the languages and frameworks named in the posting.

  • Prototype a retrieval workflow

    Practice connecting document retrieval, vector search and a prompt in a small RAG example; inspect a poor retrieval result and revise the flow. This is preparation for the advertised RAG, vector-search and prompt-engineering work, not a specified employer assignment.

  • Trace a multi-agent failure

    Practice stepping through a sample agent handoff, recording its inputs, outputs and failure point, then proposing a recovery path. This is a suggested exercise for the posting’s multi-agent design and orchestration responsibilities.

  • Plan cloud deployment and monitoring

    Practice outlining deployment of a model through AWS SageMaker, Azure AI or Google Vertex AI, including evaluation, monitoring and a response to degraded performance. The posting names these services and requires cloud-based model deployment, MLOps and LLM observability.

  • Explain an AI service integration

    Practice sketching an interface between an AI capability and a Spring Boot microservice, then walk through an error and its diagnosis. This is a suggested hands-on preparation exercise tied to the required Spring Boot experience and enterprise integration work.

04

Your preparation checklist

  • Map the stated requirements to evidence

    Prepare a one-page record of relevant architecture decisions and hands-on work. The posting lists 6–15 years overall and separately requires 8+ years in a technical architecture role; keep the two statements distinct rather than assuming one replaces the other.

  • Prepare an end-to-end project walkthrough

    If you have a relevant example, outline the problem, your decisions, architecture diagram, deployment, measurable results and trade-offs. Focus on scalable GenAI delivery on Azure and/or AWS, including Docker and Kubernetes where applicable.

  • Practice a RAG and multi-agent design exercise

    Sketch a hypothetical enterprise use case with retrieval, vector search, prompts and agent orchestration. Be ready to explain evaluation, failure handling, security boundaries and why each component is needed; this is preparation, not a stated interview exercise.

  • Document a model-to-production workflow

    Prepare an example or design covering Python or R model development, a relevant listed ML framework, cloud deployment, and MLOps stages from training or fine-tuning through evaluation, release and monitoring. Distinguish tools you have used from those you would propose.

  • Rehearse an operational troubleshooting scenario

    Walk through how you would investigate an AI application's performance or quality issue using LLM performance, system-health and usage signals. Explain the optimization choices and how you would validate the fix.

  • Show enterprise integration and technical leadership

    Prepare a concise example, if available, of integrating AI with microservices or Spring Boot, working across teams, setting security and governance practices, and mentoring engineers. State your own contribution and the resulting outcome.

  • Write targeted questions for the employer

    Ask which client use cases and cloud platforms matter most, how agentic AI and RAG are evaluated and governed, and what architecture ownership the role carries. Clarify the posting's Chennai listing versus Pan India role location, hybrid arrangement, in-person interview mode and immediate-to-90-day notice-period statement.

AI-generated from the job information · Prepared Sep 30, 2026 (UTC)Useful preparation, not a guarantee of eligibility or an offer.

Availability last checked: 4 Nov 2026. Status can change after a check; confirm on the employer’s website. Report an issue · Our checking policy

KEEP EXPLORING

Similar AI jobs

Related skills and specializations in India. Matched to this role, not your profile.

Explore more jobs
Finding similar opportunities…