Technical practice
How would you design an A/B test to determine whether a model improves a business outcome?
What to coverSuggested focus: Define the outcome, comparison groups and hypotheses before discussing statistical significance and practical impact. Explain how you would check whether the result supports an actionable decision.
How would you validate a model and diagnose overfitting?
What to coverSuggested focus: Discuss appropriate data splits, validation metrics and checks for leakage. Explain how regularization and the bias–variance trade-off would guide your next steps.
How would you choose an approach for a predictive-modeling problem?
What to coverSuggested focus: Compare a baseline with relevant options such as regression, decision trees, ensembles or SVMs. Address data characteristics, interpretability, robustness and evaluation rather than choosing the most complex model by default.
How would you build and evaluate a recommendation model?
What to coverSuggested focus: Explain how you would frame the recommendation objective, prepare available data and establish a baseline. Discuss evaluation against the intended outcome and trade-offs such as relevance, explainability and scalability.
When would you choose a Transformer rather than an RNN or LSTM for an NLP task?
What to coverSuggested focus: Compare how the architectures handle context and their computational trade-offs. Tie the choice to the task, available data and measured performance; the posting names these architectures but does not specify a particular NLP application.
How would you decide between prompt engineering and fine-tuning for an LLM solution?
What to coverSuggested focus: Compare the approaches in terms of task performance, data needs, maintenance and evaluation. Explain how you would test whether either approach improves the intended outcome.
How would you evaluate a retrieval-augmented generation solution?
What to coverSuggested focus: Discuss embedding-based retrieval, the quality of retrieved material and whether generated answers are supported by it. RAG and knowledge management appear in the posting’s skills list; a specific knowledge-base project is not stated.
How would you assess alignment and ethical risks in a Generative AI model?
What to coverSuggested focus: Describe tests for harmful or misleading outputs and how you would document limitations and mitigations. Explain how those findings would affect a deployment decision.
How would you turn a large dataset into a reliable, actionable analysis?
What to coverSuggested focus: Explain how you would use SQL, Python and statistical methods to inspect data quality, test assumptions and communicate findings. Describe how clean, modular, testable code would make the analysis reproducible.
What would you consider when moving a model from evaluation into production?
What to coverSuggested focus: Discuss reproducible pipelines, version control, containerization and monitoring model behavior after deployment. Relate scalability and explainability to the posting’s production goals, without assuming a particular cloud or pipeline tool is mandatory.
Behavioural practice
Tell me about a time you translated a business problem into a data-science solution.
What to coverSuggested focus: Use a real situation, the actions you took with stakeholders and the result. Explain how you clarified the objective and agreed on a useful measure of success.
Describe a time you worked with data engineering or product colleagues to deliver an ML solution.
What to coverSuggested focus: Set out the situation, your specific contribution and the result. Address how you resolved differing priorities or dependencies across teams.
Tell me about a time a model did not meet its evaluation goals.
What to coverSuggested focus: Describe the situation, how you investigated the shortfall and what resulted. Distinguish evidence-based changes from assumptions, including any decision not to deploy.
Describe a time you improved another data scientist’s work through mentorship or code review.
What to coverSuggested focus: Give a real situation, the feedback or support you provided and the result. Explain how you balanced technical standards with constructive collaboration.
Tell me about a time you evaluated a new research method for practical use.
What to coverSuggested focus: Describe the problem, how you compared the method with existing approaches and the outcome. Include any trade-offs that shaped whether it was suitable for production.