Technical practice
How would you formulate an agent–environment–reward problem for a decision intelligence workflow?
What to coverSuggested preparation: Define the agent’s actions, observations, state assumptions and reward, then explain how the formulation captures the intended decision. Discuss how you would detect reward designs that encourage unreliable behaviour.
When would you frame an agent-learning problem as deep reinforcement learning, preference learning or supervised fine-tuning?
What to coverSuggested preparation: Compare the feedback and training data each approach needs and what each can optimise. Explain how you would choose among them for a stated reasoning objective.
How do PPO, DPO and GRPO differ as approaches to improving an agent?
What to coverSuggested preparation: Explain their learning signals and the practical trade-offs relevant to reasoning agents. Clarify which assumptions and available data would affect your choice rather than treating the algorithms as interchangeable.
How would you compare Chain-of-Thought, Tree-of-Thought and multi-step planning?
What to coverSuggested preparation: Describe the reasoning structure each provides and where additional search or planning complexity might be justified. Propose a comparison that measures answer quality and reliability alongside computational cost.
How would you curate a dataset for training and evaluating reasoning agents?
What to coverSuggested preparation: Address task coverage, data quality, leakage and separation of training from evaluation examples. Explain how the dataset would expose failures in multi-step reasoning rather than only measure easy cases.
How would you design a rigorous experiment to test whether an agent has become more reliable?
What to coverSuggested preparation: Specify baselines, meaningful metrics, controlled comparisons and analysis of variation or uncertainty. Include failure-case analysis and explain what evidence would support a real improvement rather than a noisy result.
How might graph updates and ontology refinement contribute to a learning knowledge system?
What to coverSuggested preparation: Explain how changes to relationships or concepts could affect an agent’s reasoning and how you would check their consistency. Discuss a way to evaluate whether an update helps the intended tasks without introducing new errors.
How would you choose between full supervised fine-tuning, LoRA and QLoRA for a transformer?
What to coverSuggested preparation: Compare adaptation scope, resource demands and potential quality trade-offs for an LLM reasoning task. Explain how you would evaluate the fine-tuned model against the original objective.
How would you structure a reproducible agent-learning experiment in PyTorch or TensorFlow?
What to coverSuggested preparation: Cover implementation checks, controlled runs and tracking of training and evaluation results. Explain how you would troubleshoot a result that changes unexpectedly between runs or frameworks.
What would you validate before translating a reasoning research result into a production system?
What to coverSuggested preparation: Identify the assumptions, evaluation evidence and failure modes AI engineers would need to understand. Discuss the trade-off between the research result’s performance and its operational complexity without assuming a specific production stack.
Behavioural practice
Tell me about a time you turned an open-ended research question into a tractable experiment.
What to coverSuggested preparation: Give the situation, the hypothesis and actions you took to narrow the question, and the result. Explain what the evidence changed about your next step.
Describe a time an experiment contradicted your expectations.
What to coverSuggested preparation: Set out the situation, how you checked the data or methodology, and what you changed. State the result and what you learned without presenting an inconclusive finding as a success.
Tell me about a time you worked with engineers to make a research result practically usable.
What to coverSuggested preparation: Describe the situation, your contribution and how you communicated limitations or trade-offs. Give the result, including what remained unresolved if applicable.
Describe a time you had to balance scientific exploration with practical impact.
What to coverSuggested preparation: Explain the competing priorities, the action you chose and your reasoning. Describe the result and how you determined whether the work was useful.