Technical practice
How would you take a GenAI proof of concept built in a customer's codebase through MVP to production integration?
What to coverSuggested preparation: explain how you would establish success criteria, work within the customer's infrastructure and constraints, and build alongside their engineers. Distinguish what must be validated at each stage before production deployment.
How would you size an inference deployment for a GenAI product expecting growth?
What to coverSuggested preparation: connect the expected traffic profile, model choice, latency targets, GPU capacity and cost to a deployment shape. Explain how you would revisit sizing as demand changes so infrastructure does not become the bottleneck.
How would you load-test an inference service and decide what to tune?
What to coverSuggested preparation: describe a realistic customer traffic profile and how you would establish latency, throughput and cost baselines. Explain how you would compare tuning options against those baselines rather than optimizing a single metric in isolation.
How would you validate a new model family on vLLM or SGLang?
What to coverSuggested preparation: discuss testing serving patterns, deployment shapes and quantization configurations against the intended workload. Address the trade-off between quality, latency, throughput and cost before choosing a configuration.
How would you debug a sudden production latency regression in a customer's Python-based model integration?
What to coverSuggested preparation: lay out how you would isolate the application, serving and infrastructure portions of the request path using production evidence. Explain how you would verify a fix against the customer's latency and throughput targets.
How would you plan a GPU model deployment within a customer's cloud and Kubernetes environment?
What to coverSuggested preparation: cover the information you would gather about the existing cloud infrastructure, GPU capacity and operational constraints before deploying. Explain how you would validate that the deployed service works within that environment, without assuming a particular cloud platform.
How would you advise a customer choosing among model families for a production use case?
What to coverSuggested preparation: start with the customer's quality targets and workload, then compare model behavior, inference cost and deployment implications. Explain what evidence would justify selecting a model or revisiting the choice.
When would you recommend SFT, DPO or RFT, and how would you structure a fine-tuning pipeline?
What to coverSuggested preparation: distinguish the methods by the training signal and outcome each needs, noting that SFT knowledge is required while DPO and RFT are a strong plus. Discuss data preparation, iteration and the trade-off between compute cost and measured quality without presuming every customer needs fine-tuning.
How would you design an evaluation framework that measures production quality rather than only benchmark performance?
What to coverSuggested preparation: tie evaluation cases and metrics to the customer's actual workflows and agreed success criteria. Explain how you would use results to compare models or fine-tuning iterations alongside compute cost.
How would you evaluate whether an agentic system or tool-use chain belongs in a customer's GenAI product?
What to coverSuggested preparation: treat this as an optional topic drawn from a preferred qualification, not a requirement for every engagement. Discuss what the workflow gains from tool use and how you would assess its production quality, latency and integration complexity against a simpler approach.
Behavioural practice
Tell me about a time you turned an ambiguous customer request into technical success criteria.
What to coverSuggested preparation: use a real situation, describe the discovery questions you asked and how you aligned the people involved before proposing a solution. Finish with the resulting criteria and what they changed about delivery.
Describe a time you explained the same technical trade-off to engineers and executives.
What to coverSuggested preparation: identify the decision, the different concerns each audience raised and how you adapted your explanation without changing the underlying facts. Give the action you took and the resulting decision or alignment.
Tell me about a time you built within a customer's environment while navigating their constraints.
What to coverSuggested preparation: choose a real example that shows your hands-on contribution and how you earned trust with the customer's team, particularly if you worked alongside them in person. Explain the constraints, your actions and the delivery result without implying an on-site example is mandatory.
Describe a time you helped resolve a production issue jointly with a customer team.
What to coverSuggested preparation: set out the impact, how you divided investigation or communication responsibilities, and the evidence that guided your actions. Close with the outcome and what changed afterward.
Tell me about a recurring customer problem you translated into a product improvement or reusable deployment pattern.
What to coverSuggested preparation: describe how you recognized the pattern, made the feedback specific for product or engineering colleagues, and contributed a fix, tool or documentation where applicable. State the result you could observe, rather than claiming a roadmap impact you cannot substantiate.