Technical practice
RAG Pipeline Architecture
What to coverExplain the end-to-end process of building a RAG pipeline, specifically focusing on ingestion, chunking strategies, and embedding generation. Discuss how you would choose an appropriate chunk size and overlap to balance context retention with retrieval accuracy.
Evaluating GenAI Solutions
What to coverHow do you design an evaluation framework for a production-grade LLM application? Address how you measure accuracy, latency, and safety, and describe the role of ground-truth datasets in your testing methodology.
Responsible AI and Guardrails
What to coverWhat specific techniques would you implement to ensure an AI application adheres to responsible AI standards? Discuss the use of content filtering, input/output guardrails, and human-in-the-loop oversight mechanisms.
Agentic AI Orchestration
What to coverDescribe your experience or approach to building agentic workflows where an LLM uses function calling to interact with external enterprise systems. How do you handle error states and ensure the model selects the correct tool for a given task?
Vector Search Optimization
What to coverWhen integrating with services like Azure AI Search, what factors influence the performance and relevance of vector search results? Explain how you would optimize indexing and retrieval for large-scale enterprise data.
Python for AI Engineering
What to coverThe role emphasizes clean, documented, and reusable Python code. How do you structure your AI components to ensure they are maintainable and testable within a CI/CD pipeline?
Managing LLM Latency
What to coverIn a production environment, what strategies would you employ to minimize latency in GenAI applications? Consider aspects like model selection, caching strategies, and asynchronous processing.
Azure AI Integration
What to coverGiven the WSP technology stack, how would you leverage Azure AI services (such as Azure OpenAI or Document Intelligence) to solve a specific business problem? Focus on the integration of these services with existing enterprise data sources.
Behavioural practice
Collaborating with Global Stakeholders
What to coverDescribe a situation where you had to communicate complex technical AI concepts to non-technical stakeholders. How did you ensure alignment on project goals and manage expectations regarding the limitations of the technology?
Handling Production Incidents
What to coverTell me about a time you had to troubleshoot a failure in a deployed AI or data pipeline. What was your process for identifying the root cause, and how did you implement a fix while minimizing downtime?
Adhering to Governance Standards
What to coverProvide an example of a project where you had to strictly follow organizational architecture or security standards. How did you balance the need for innovation with the requirement to comply with established governance?
Iterative Optimization
What to coverDescribe a project where you had to iterate on an AI solution based on performance monitoring or user feedback. What metrics did you track, and how did those insights drive your subsequent development decisions?