Technical practice
Suggested practice question: How would you design an enterprise RAG application?
What to coverSuggested answer focus: Explain document ingestion, retrieval, prompt assembly, generation, and how you would evaluate the resulting answers. Discuss trade-offs between answer quality, latency, and operational complexity.
Suggested practice question: How would you choose and tune embeddings, semantic search, and a vector database?
What to coverSuggested answer focus: Describe how you would compare retrieval approaches using representative queries and relevant results. Explain how indexing and retrieval choices affect accuracy, scale, and response time.
Suggested practice question: How would you diagnose poor answers from a RAG pipeline?
What to coverSuggested answer focus: Separate retrieval failures from problems in how the model uses retrieved material. Describe targeted tests and changes you would make before deciding whether fine-tuning is warranted.
Suggested practice question: When would you use LoRA or QLoRA to fine-tune an LLM?
What to coverSuggested answer focus: Compare their resource and quality trade-offs with other model-adaptation approaches. Explain what training data and evaluation evidence you would need for a domain-specific use case.
Suggested practice question: How would you decide between a foundation model and a domain-specific LLM?
What to coverSuggested answer focus: Explain how business requirements, available data, and evaluation results would shape model selection or further training. Address the cost and maintenance implications of each approach.
Suggested practice question: How would you evaluate and optimize an LLM-powered application?
What to coverSuggested answer focus: Propose tests that reflect the intended business use case, then distinguish model-quality issues from application-level issues. Explain how you would weigh quality gains against inference cost and latency.
Suggested practice question: Where would LangChain, LangGraph, and Hugging Face fit in an LLM application?
What to coverSuggested answer focus: Describe which parts of a proposed application you would build with each framework and where simpler code might suffice. Discuss maintainability and scalability rather than assuming every framework is needed.
Suggested practice question: How would you take an LLM from development to production deployment?
What to coverSuggested answer focus: Walk through deployment-pipeline and application-code considerations using Python or Java, as appropriate. Explain how you would test changes and improve inference performance without losing sight of model quality.
Suggested practice question: How would you design an LLM service to scale?
What to coverSuggested answer focus: Discuss the boundaries between retrieval, application logic, and model inference in a distributed architecture. Explain how you would identify bottlenecks and make capacity-versus-latency trade-offs.
Suggested practice question: How would you operate and monitor a deployed LLM application?
What to coverSuggested answer focus: The posting lists cloud platforms, MLOps, CI/CD, containerization, and observability as preferred areas; describe how you would use relevant ones to release and monitor a system. Suggest signals for detecting service or model-performance degradation and how you would respond.
Behavioural practice
Suggested practice question: Tell me about a time you turned business requirements into an AI/ML approach.
What to coverSuggested answer focus: Use a real situation, your analysis of alternatives, and the recommendation you made. Explain the outcome and how business constraints influenced the decision.
Suggested practice question: Describe a time you worked across teams on a scalable system design.
What to coverSuggested answer focus: Set out the teams' differing concerns, your contribution to the design discussion, and the actions taken together. State the result and any trade-off the group accepted.
Suggested practice question: Tell me about a difficult problem in an AI application or deployment that you resolved.
What to coverSuggested answer focus: Describe the symptoms, how you narrowed down the cause, and what you changed. Give the observed result, distinguishing evidence from assumptions.
Suggested practice question: Describe a time evaluation results caused you to change a technical approach.
What to coverSuggested answer focus: Explain the original approach, what the evaluation revealed, and how you decided on a change. State the outcome, including any remaining limitation or trade-off.