New opportunity

AI / ML Engineer

Accenture · Pune, India

About this role

Accenture is hiring an AI / ML Engineer in Pune to develop production-ready applications and systems using AI tools, cloud AI services and generative AI models. The role focuses on large language models and may involve deep learning, neural networks, chatbots and image processing.

Responsibilities

  • Design and implement cloud or on-premises application pipelines, integrate AI models, and support deployment, optimization and high-quality outputs.
  • Serve as a subject-matter expert, manage and collaborate with the team, make team decisions, contribute to decisions across multiple teams and solve problems beyond the immediate team.
  • Mentor junior colleagues and evaluate and improve processes and workflows.

Requirements

  • The posting lists 5–10 years of experience and requires a minimum of 5 years of experience, including a minimum of 5 years with large language models.
  • Have 15 years of full-time education.
  • Bring experience in Java, Python and AI application development, particularly cloud-based model integration, deployment and optimization. Relevant frameworks listed include Spring AI, LangChain, LangGraph, LlamaIndex, Agno, Pydantic and TensorFlow.
  • Have hands-on experience with Azure AI services, including Azure OpenAI and Azure AI Search, for building and deploying AI applications at scale.
  • Apply advanced architecture patterns such as retrieval-augmented generation (RAG), Agentic RAG, MCP, Functional Calling and A2A, especially in Azure. Experience is also sought in prompt and context engineering, vector databases, embedding and chunking strategies, real-time data integration, and model-output evaluation and optimization.

For full details about this role, click “Apply on company site” to view the employer’s original posting.

Skills for this role

Large Language Models (LLMs)Generative AIPythonJavaSpring AILangChainLangGraphLlamaIndexAgnoPydanticTensorFlowAzure Cloud ServicesAzure OpenAIAzure AI SearchRetrieval-Augmented Generation (RAG)Agentic RAGMCPFunctional CallingA2APrompt engineeringContext engineeringVector databasesEmbeddingsChunkingReal-time data integrationModel evaluationModel optimizationCloud AI servicesTeam leadership

Your skill match

Checking your profile…

YOUR NEXT STEP

Get interview-ready for this role

A focused preparation guide, built around this job’s responsibilities and requirements.

✦ AI-generated guide
Preparation suggestions, not the employer’s actual interview questions. Always check the original posting for current requirements.
01

Understand the role

What matters most

  • Deliver production-ready AI pipelines

    The role calls for designing and implementing cloud or on-premises application pipelines and integrating generative AI models. Prepare to explain how you take an AI application from design through deployment and optimization.

  • Build LLM applications on Azure

    LLMs are the required skill, and the posting seeks hands-on use of Azure OpenAI and Azure AI Search to develop and deploy AI applications at scale. Prepare a concrete architecture example that shows how the services fit together.

  • Design retrieval and agentic workflows

    The posting names RAG, Agentic RAG, MCP, function calling and A2A, alongside embeddings, chunking and real-time data integration. Prepare to explain when a simpler retrieval design is sufficient and when additional orchestration is warranted.

  • Evaluate and improve output quality

    High-quality outputs, model-output evaluation and optimization are explicit parts of the role. Prepare to describe how you assess results, diagnose failures and use findings to improve an application.

  • Lead decisions across teams

    The engineer is expected to act as an SME, make team decisions, contribute to decisions across teams, mentor junior colleagues and improve workflows. Prepare examples that distinguish your technical decisions from your team-level contributions.

Likely challenges to think through

  • Balancing pipeline reliability with rapid iteration

    Likely preparation challenge, not a stated employer problem: generative AI components can change while the role still demands production-ready pipelines. Prepare to discuss how you would validate changes and maintain output quality during deployment and optimization.

  • Choosing retrieval complexity deliberately

    Likely preparation challenge: chunking, embeddings and real-time data integration create design choices, while agentic patterns add moving parts. Prepare to compare a basic RAG approach with an agentic one using retrieval quality, data freshness and ease of evaluation as criteria.

  • Making decisions across team boundaries

    Likely preparation challenge: the role combines hands-on engineering, team decisions, cross-team input and mentoring. Prepare an example of resolving competing technical preferences while keeping the implementation and team workflow clear.

03

Practice your answers

Technical practice

How would you design a production-ready application pipeline that integrates an LLM?

What to coverThe posting calls for production-ready cloud or on-premises pipelines and AI model integration. Preparation suggestion: explain the flow from application input to model output, including deployment boundaries, failure handling and how you would check output quality.

How would you integrate Azure OpenAI and Azure AI Search in an AI application?

What to coverThe posting specifically names both services and developing AI applications at scale. Preparation suggestion: describe each service’s role, how the application connects them and what you would consider when deploying the integration.

How would you choose embeddings and chunking strategies for a RAG system?

What to coverRAG, vector databases, embeddings and chunking strategies are all listed in the posting. Preparation suggestion: discuss how document structure and retrieval quality affect those choices, and how you would test whether retrieved context supports the answer.

When would you use Agentic RAG rather than a simpler RAG flow?

What to coverThe posting names both RAG and Agentic RAG as architecture patterns. Preparation suggestion: compare the value of additional retrieval or reasoning steps against added complexity, latency and the need to evaluate intermediate results.

How would you decide whether functional calling, MCP or A2A belongs in an AI application design?

What to coverThe posting lists functional calling, MCP and A2A, particularly in an Azure environment. Preparation suggestion: explain the interaction each pattern would support, where its boundaries lie and how you would avoid adding coordination complexity without a clear need.

How would you improve an LLM response through prompt and context engineering?

What to coverThe posting explicitly calls for experience in both areas and for high-quality outputs. Preparation suggestion: distinguish changes to instructions from changes to supplied context, then explain how you would compare their effects on representative outputs.

How would you choose between Java, Python and the listed AI frameworks for an application?

What to coverThe posting names Java, Python and frameworks including Spring AI, LangChain, LangGraph, LlamaIndex, Agno, Pydantic and TensorFlow. Preparation suggestion: ground the choice in the application’s integration needs and explain the trade-off between framework convenience and maintainability rather than claiming one stack is required.

How would you keep an AI application’s responses aligned with changing source data?

What to coverReal-time data integration is listed as relevant experience. Preparation suggestion: describe how you would make current data available to the application, handle unavailable or stale inputs and verify that responses reflect the intended data.

How would you evaluate whether model outputs are good enough for deployment?

What to coverThe posting calls for evaluating model output and ensuring high-quality outputs. Preparation suggestion: define task-specific quality criteria, use representative test cases and explain how you would investigate inconsistent or unsupported answers.

How would you troubleshoot and optimize a deployed AI application?

What to coverCloud-based model deployment and optimization are stated areas of experience. Preparation suggestion: explain how you would isolate whether a problem comes from application code, retrieval, context or the model, then weigh quality against latency and operating cost when making changes.

Behavioural practice

Tell me about a consequential technical decision you made for a team.

What to coverThe role includes responsibility for team decisions. Preparation suggestion: use a real situation, describe the options and your decision-making actions, then state the result and what evidence informed it.

Describe a time you worked across teams to resolve a delivery problem.

What to coverThe posting calls for collaboration, key decisions across multiple teams and solutions beyond the immediate team. Preparation suggestion: explain the situation, how you aligned the teams on an action and what changed as a result.

Tell me about a time you mentored a junior colleague on a technical challenge.

What to coverMentoring junior team members is an explicit responsibility. Preparation suggestion: describe the starting challenge, the support you provided and the observable result without substituting a hypothetical achievement.

Describe a process or workflow you evaluated and improved.

What to coverThe posting explicitly calls for continuous evaluation and improvement of processes and workflows. Preparation suggestion: give the situation, the evidence that prompted a change, the action you took and its measurable or observable result.

Tell me about a time you acted as a subject-matter expert while helping a team perform.

What to coverThe role expects an SME who collaborates with and manages the team to perform. Preparation suggestion: give a real situation, explain how you shared expertise while involving others in the action and describe the outcome for the team.

02

Sharpen your knowledge

Topics to prepare

  • LLM application design

    The posting names LLMs as the must-have skill and calls for production-ready generative AI applications. Revise how prompts, context, model integration and application pipelines affect output quality; sketch a design and explain its failure modes.

  • Retrieval architecture

    The posting explicitly names RAG, vector databases, embeddings and chunking. Compare two chunking strategies for the same document set, then explain how each could affect retrieval relevance and answer quality.

  • Agentic integration patterns

    The posting lists Agentic RAG, MCP, Functional Calling and A2A. Draw an interaction flow and explain when each pattern would be useful, where control passes between components and how you would handle a failed call.

  • Azure AI deployment architecture

    The posting calls for Azure OpenAI, Azure AI Search and cloud-based integration, deployment and optimization at scale. Diagram a production-ready pipeline using those services, including where real-time data enters and where outputs are checked.

  • Output evaluation and optimization

    Evaluating model output and optimizing it are explicit requirements. Define a small set of test questions and describe how you would assess answer quality, diagnose weak results and compare a revised configuration against the original.

  • Technical decisions across teams

    The role expects an SME who makes team decisions, contributes across teams, mentors juniors and improves workflows. Rehearse explaining an AI architecture trade-off, the evidence behind your decision and how you would help another team adopt it.

Skills to revise

  • Implement model integration in Python or Java

    The posting requires experience in both languages and lists frameworks including Spring AI and LangChain. As a revision exercise, write a small model-integration flow in one language, then outline how you would implement the same flow in the other; explain your framework choice without treating every listed framework as mandatory.

  • Build an Azure-backed retrieval flow

    Practise connecting Azure AI Search retrieval to an Azure OpenAI response, with document ingestion, citations and a fallback for missing evidence. This exercises the posting’s hands-on Azure requirements and RAG architecture; if services are unavailable, prepare the integration steps and interface code for review.

  • Tune prompts and retrieved context

    Given a few weak answers, revise the prompt and the selection of retrieved chunks, then compare the results against the originals. This directly practises the posting’s prompt engineering, context engineering and embedding/chunking requirements.

  • Test and improve model outputs

    Create a compact test set with expected answer characteristics, run it against two configurations and record which errors changed. This prepares for the stated responsibility to evaluate outputs and optimize AI applications.

  • Lead a design review

    As interview preparation, practise a short review of your pipeline design: present alternatives, invite objections, decide on a path and explain one workflow improvement to a junior colleague. This is a suggested exercise for the posting’s team-decision, mentoring and process-improvement responsibilities.

04

Your preparation checklist

  • Map the stated requirements

    Prepare a factual timeline of LLM and AI application work, plus education details, against the posting’s minimum five years with LLMs and 15 years of full-time education. Note evidence you can provide without claiming experience you do not have.

  • Build a production-project walkthrough

    Choose a project you can discuss and prepare a diagram showing the application pipeline, model integration, deployment and optimization. Identify your own decisions and outcomes; the role calls for production-ready cloud or on-premises systems.

  • Practice an Azure RAG design exercise

    As preparation, sketch an application using Azure OpenAI and Azure AI Search. Explain choices for retrieval, embeddings, chunking, context and data updates, then discuss when Agentic RAG, function calling, MCP or A2A would—or would not—help.

  • Prepare implementation evidence

    Gather a small code sample or pseudocode you can explain in Java or Python. Show how you integrated a model using a framework you have actually used, such as Spring AI, LangChain or LangGraph, and distinguish hands-on work from familiarity.

  • Show how you evaluate outputs

    Prepare an example of checking model-output quality, investigating failures and making an optimization decision. A sample test set and before-and-after results are useful preparation if you have them; the posting specifies evaluation and optimization but not a particular metric.

  • Document leadership decisions

    Outline one example each of a team decision, cross-team problem, junior-colleague mentoring and workflow improvement. State the situation, your contribution, the trade-off and the result, reflecting the role’s SME and team responsibilities.

  • Write questions for the employer

    Ask which AI applications are priorities, where Azure versus on-premises pipelines are used, how output quality is evaluated, and what decisions the AI / ML Engineer owns across teams. These are questions to clarify the role, not assumptions about its projects.

AI-generated from the job information · Prepared Sep 30, 2026 (UTC)Useful preparation, not a guarantee of eligibility or an offer.

Availability last checked: 5 Nov 2026. Status can change after a check; confirm on the employer’s website. Report an issue · Our checking policy

KEEP EXPLORING

Similar AI jobs

Related skills and specializations in India. Matched to this role, not your profile.

Explore more jobs
Finding similar opportunities…