Technical practice
How would you design a RAG pipeline for a document intelligence application?
What to coverSuggested answer focus: Explain document preparation, embeddings, vector search, retrieval, and how retrieved context reaches the LLM. Discuss how you would assess answer quality and improve retrieval when relevant documents are missed.
How would you improve a chatbot or summarization engine that produces unreliable answers?
What to coverSuggested answer focus: Distinguish problems caused by prompts, retrieved context, and the model's output. Explain how you would evaluate changes for accuracy and reliability rather than relying on a few examples.
How would you integrate structured and unstructured data into an LLM application?
What to coverSuggested answer focus: Describe the different preparation and retrieval needs of SQL-accessible records and documents. Explain how you would preserve relevant context while checking that the data used is appropriate for the response.
How would you prepare features for a predictive modelling task?
What to coverSuggested answer focus: Cover data quality checks, preprocessing, SQL-based data handling, and feature engineering. Explain how you would prevent information leakage between training and validation data.
How would you evaluate and tune a predictive model?
What to coverSuggested answer focus: Explain how the business objective informs validation and metric choices, then describe a disciplined approach to hyperparameter tuning. Discuss accuracy, reliability, and scalability trade-offs when comparing models.
When would you use XGBoost rather than a PyTorch or TensorFlow model?
What to coverSuggested answer focus: Compare the approaches in terms of the data and prediction task, available training data, and deployment complexity. Explain how you would establish a baseline before choosing a more complex model.
How would you orchestrate a multi-step LLM workflow?
What to coverSuggested answer focus: Describe how components such as retrieval, model calls, and validation could be coordinated using LangChain, LlamaIndex, or LangGraph. Explain where an agent is useful and where a simpler, more predictable workflow may suffice.
How would you take an ML model from training to a versioned production deployment?
What to coverSuggested answer focus: Walk through validation, model versioning, deployment, and CI/CD checks for an ML workflow. Explain how you would make it possible to identify which model version is serving predictions.
How would you monitor and optimize a deployed AI application?
What to coverSuggested answer focus: Discuss model performance, drift, latency, and cost, which the posting identifies as production concerns. Explain how you would investigate a deterioration and weigh quality against operational constraints.
How would you address governance and security in an enterprise LLM application?
What to coverSuggested answer focus: Discuss controls over data access and model inputs and outputs, alongside evaluation for harmful or unreliable responses. Explain how those checks could fit into deployment and ongoing monitoring.
Behavioural practice
Tell me about a time you translated a business problem into an ML or AI solution.
What to coverSuggested answer focus: Use a real situation, your actions to clarify the objective with stakeholders, and the result. Explain how you decided what the system needed to do and how success would be judged.
Describe a time you worked with data engineering or product colleagues on a delivery.
What to coverSuggested answer focus: Give the situation, your specific contribution, and the result. Show how you resolved a data, integration, or requirements dependency across teams.
Tell me about a time a deployed model or application did not perform as expected.
What to coverSuggested answer focus: Describe the situation, the evidence you examined, the action you took, and the result. Be clear about how you distinguished a model-quality problem from a data or operational issue.
Describe a time you had to balance solution quality with latency or cost.
What to coverSuggested answer focus: Use a real situation, the options you considered, your decision, and its result. Explain what you measured and which trade-off mattered for the use case.
Tell me about a time you identified a security, governance, or responsible-AI concern.
What to coverSuggested answer focus: Describe the situation, the concern you identified, the action you took with relevant colleagues, and the result. Keep the example grounded in what you personally did rather than implying a policy or process at Cittabase.