Technical practice
How would you choose between a conventional ML approach and an LLM for a business use case?
What to coverSuggested preparation: Explain how the task, available data, evaluation criteria and operational constraints would guide the choice. Discuss when a simpler approach may be sufficient and how you would validate either option.
How would you use Python and data/ML libraries to prepare and evaluate a solution?
What to coverSuggested preparation: Describe relevant uses of Pandas, NumPy and scikit-learn for data inspection, preparation and baseline evaluation. Explain how you would check data quality and avoid drawing conclusions from an unsuitable evaluation.
What are the main components of a RAG application, and how would you evaluate its answers?
What to coverSuggested preparation: Walk through preparing source content, retrieving relevant material and using it to inform an LLM response. Distinguish retrieval failures from generation failures, and discuss relevance and answer-grounding checks.
How would you assess whether vector search is retrieving useful information?
What to coverSuggested preparation: Explain how content representation, chunking and retrieval settings can affect results. Discuss testing with representative queries and balancing relevance against retrieval cost or latency.
What would you check when integrating enterprise data into an AI application?
What to coverSuggested preparation: Cover data provenance, freshness, quality and access permissions across a pipeline. Explain how you would handle integration failures without silently serving misleading information.
When might an AI agent be useful, and what limits would you put on its actions?
What to coverSuggested preparation: Contrast a multi-step agent with a simpler application flow. Discuss how to assess whether the additional flexibility is worthwhile and how to constrain and test actions.
What would you consider when deploying an AI model or LLM-enabled application?
What to coverSuggested preparation: Describe how you would verify that the deployed solution behaves as evaluated, then monitor its usefulness and reliability. Address practical trade-offs such as response time, cost and maintainability without assuming a particular platform.
How would you test and monitor the reliability of an AI-enabled application?
What to coverSuggested preparation: Include representative inputs, failure cases and checks for changes in response quality or application errors. Explain which signals would prompt investigation and how findings would feed into improvements.
How would you handle errors, security and audit logging in an AI application?
What to coverSuggested preparation: Discuss safe failure behavior, appropriate access controls and logs that support investigation. Explain the trade-off between useful diagnostic records and limiting exposure of sensitive data.
How would you troubleshoot an AI solution that gives poor answers after a change?
What to coverSuggested preparation: Describe how you would narrow down whether the issue lies in data, retrieval, the model or application integration. Explain how you would compare behavior before and after the change and verify a fix.
Behavioural practice
Tell me about a time you translated stakeholder needs into a technical solution.
What to coverSuggested preparation: Give a real example with the situation, the questions you asked business or IT stakeholders, and the actions you took to clarify requirements. End with the result and how you checked that the solution met the need.
Describe a time user feedback changed your work during delivery.
What to coverSuggested preparation: Use a real example to explain the situation, how you handled feedback during iterative delivery or acceptance testing, and what you changed. State the result, including any trade-off you discussed with stakeholders.
Tell me about a difficult technical issue you helped resolve.
What to coverSuggested preparation: Set out the situation, your diagnostic actions and how you collaborated or escalated when needed. Explain the result and what you did to reduce the chance of recurrence.
Describe a time you learned an unfamiliar technology to address a practical need.
What to coverSuggested preparation: Give a real example covering why it was needed, how you sought guidance or tested your understanding, and what you contributed. Finish with the result and what you learned; the posting emphasizes curiosity and growth alongside experienced specialists.