Technical practice
How would you explain the key decisions involved in fine-tuning an LLM for a specific context?
What to coverSuggested preparation: Explain how the starting model, training data and desired behavior shape a fine-tuning approach. Discuss how you would check whether the resulting model is more relevant and useful for that context.
How would you design an instruction fine-tuning dataset?
What to coverSuggested preparation: Describe how you would make instructions and target responses consistent with the intended tasks, then check data quality. Discuss the trade-off between broad instruction coverage and focus on the target context.
How would you adapt an LLM to a new domain?
What to coverSuggested preparation: Explain how you would identify domain-specific needs and choose suitable adaptation data. Describe how you would test domain relevance without overlooking performance on other intended tasks.
What preprocessing would you apply before fine-tuning?
What to coverSuggested preparation: Discuss cleaning, formatting and checking training examples for consistency and relevance. Explain how you would identify data issues that could undermine the model's results.
When might data augmentation help or hurt LLM fine-tuning?
What to coverSuggested preparation: Describe how additional examples could improve coverage of the target context. Address how you would check that augmented examples remain accurate and do not distort the intended behavior.
How would you use TensorFlow or PyTorch in a fine-tuning workflow?
What to coverSuggested preparation: Walk through the training steps you could implement or inspect in a framework you know. These frameworks are listed as familiarity skills, so focus on decisions you can explain rather than assuming one is required.
How would you evaluate whether fine-tuning improved model performance?
What to coverSuggested preparation: Explain how you would choose metrics and evaluation examples that reflect the specific context, then compare results with a baseline. Discuss what a metric might miss and how you would examine unsuccessful outputs.
What would you investigate if a fine-tuned model performed poorly on its target tasks?
What to coverSuggested preparation: Describe a systematic check of data quality, training choices and evaluation results. Explain how you would prioritize a change and test whether it addresses the observed problem.
What would you discuss with engineers when integrating a fine-tuned model into an application?
What to coverSuggested preparation: Cover the application's intended inputs and outputs, how the model will be used, and how results will be checked in that context. Explain which decisions need collaboration between model developers, data scientists and engineers.
Behavioural practice
Tell me about a time you worked independently on an unfamiliar technical problem.
What to coverSuggested preparation: Use a real situation to explain what you needed to learn, the actions you took and the result. Highlight how you developed enough understanding to make a useful contribution.
Describe a time you contributed a solution during a team discussion.
What to coverSuggested preparation: Explain the problem, your contribution and how you responded to others' input. Finish with the decision or outcome, making your own role clear.
Tell me about a time you collaborated across technical disciplines to put a model into use.
What to coverSuggested preparation: Describe the situation, how you coordinated responsibilities or resolved a mismatch, and the result. If your example did not involve an LLM, be clear about that rather than implying it did.
Describe a time you improved a model's performance.
What to coverSuggested preparation: State the initial problem and evidence, the change you proposed or helped implement, and the observed result. Distinguish your contribution from the team's work.
Tell me about a time you investigated a difficult work-related problem.
What to coverSuggested preparation: Set out the situation, how you narrowed down possible causes and what action you took. Close with the result and what the evidence did or did not establish.