Technical practice
How would you decide between prompting, fine-tuning, and building a custom LLM for an application?
What to coverThe role covers prompt engineering, fine-tuning, custom LLMs, and LLM internals. Preparation suggestion: Explain what each approach changes, how you would evaluate the resulting outputs, and the trade-offs in data needs and operational effort.
How would you design a RAG pipeline that integrates with an existing application?
What to coverThe posting calls for RAG, vector databases, indexing mechanisms, and integration with traditional applications. Preparation suggestion: Walk through document preparation, indexing, retrieval, and response generation, including how you would test retrieval quality and handle stale information.
When would you use an agentic workflow rather than a simpler LLM pipeline?
What to coverAgentic workflows and tools including LangGraph and Crew AI appear in the posting. Preparation suggestion: Describe a suitable workflow, how you would constrain and observe its steps, and when added complexity would not be justified.
How would you evaluate and troubleshoot the outputs of a generative AI application?
What to coverThe role explicitly includes LLM output evaluation and lists Langfuse. Preparation suggestion: Discuss test cases, criteria for output quality, and how recorded results could help distinguish retrieval, prompt, and model failures.
How would you architect and scale a generative AI application on AWS?
What to coverThe posting calls for scalable AWS applications and mentions Bedrock alongside several LLM options. Preparation suggestion: Explain how you would select a model and deployment approach, then assess latency, reliability, and cost as usage grows.
How would you build an automated pipeline from exploratory analysis to model retraining?
What to coverThe role includes EDA, data cleaning, preprocessing, and automated retraining. Preparation suggestion: Describe how you would find data-quality issues, prevent leakage, and validate both data and model changes before deployment.
How would you track experiments and monitor a deployed model in SageMaker?
What to coverThe posting specifies experiment tracking, validation, and SageMaker training, deployment, and monitoring. Preparation suggestion: Explain which inputs, model versions, and results you would record, and how monitoring findings would inform investigation or retraining.
How would you choose and validate a model for classification, clustering, or time-series forecasting?
What to coverThe posting spans supervised and unsupervised learning, predictive analytics, and time-series analysis. Preparation suggestion: Compare appropriate validation approaches and metrics for these different tasks, including why temporal ordering matters for forecasting.
How would your approach differ across image classification, detection, segmentation, and captioning?
What to coverAll four computer-vision tasks are named in the role, along with CNNs and deep-learning frameworks. Preparation suggestion: Contrast their outputs, annotation needs, and evaluation methods, and explain how error analysis would guide improvements.
How would you serve an ML model through an API while managing storage and retrieval?
What to coverThe posting lists REST API tools, Docker, SQL and NoSQL databases, data lakes and warehouses, and caching technologies. Preparation suggestion: Sketch a Python-based serving path and explain where persistent storage or caching would help, including the trade-off between response speed and fresh data.
Behavioural practice
Tell me about a time you turned a business challenge into an AI/ML problem.
What to coverThe role is framed around AI/ML applications that solve business challenges. Preparation suggestion: Use a real situation, your actions in defining the problem and success measure, and the result; distinguish what the model achieved from its business effect.
Tell me about a time you integrated an AI capability with an existing application.
What to coverThe posting specifically calls for RAG pipelines integrated with traditional applications. Preparation suggestion: Give a real situation, the actions you took to coordinate integration and resolve constraints, and the resulting application behaviour.
Tell me about a time you investigated a deployed model or application that was underperforming.
What to coverDeploying, tracking, monitoring, and maintaining AI/ML applications are stated responsibilities. Preparation suggestion: Describe the observed problem, your diagnostic actions, and the result, including what you could and could not conclude from the evidence.
Tell me about a time experiment results changed your approach.
What to coverThe role includes EDA, experiment tracking, and model validation. Preparation suggestion: Use a real situation to explain what the evidence showed, what you changed, and the result rather than presenting an unverified improvement.
Tell me about a time you balanced model quality against deployment constraints.
What to coverThe posting emphasizes scalable, efficient applications as well as model evaluation and deployment. Preparation suggestion: Describe a real situation, the options and trade-offs you considered, your action, and the observed result.