About this role
Support Qualcomm’s internal Generative AI initiatives in Bangalore through prompt engineering, feature validation, output-quality evaluation and program coordination. The platforms include search, summarization, RAG workflows, analytical agents and domain-specific AI assistants.
Responsibilities
- Track validation plans, deliverables, owners, dependencies, risks and action items; coordinate testing and feedback with engineering, product, platform and domain-expert teams. Maintain dashboards, issue logs and weekly progress reports.
- Create reusable prompt templates and libraries, including zero-shot, few-shot, role-based, multi-turn, edge-case and negative prompts. Compare variants for accuracy, relevance, completeness, consistency and latency, incorporating domain-expert feedback.
- Design and execute functional, sanity, regression, negative and exploratory tests. Trace requirements to expected outputs and acceptance criteria; check behavior from prompt through retrieved context to final response. Document defects and assess release readiness using Go / Watch / Risk indicators.
- Validate outputs against structured and unstructured sources, including internal knowledge bases, documents, JSON/XML, SharePoint, Confluence and Jira. Test RAG retrieval, semantic and keyword search, filters, source freshness and context quality; maintain golden datasets and benchmark queries.
- Evaluate factual correctness, clarity and formatting; investigate hallucinations and distinguish prompt, data, retrieval, model and product issues. Work with subject-matter experts on acceptance thresholds. Produce executive-ready summaries, facilitate reviews and track quality, coverage, defect-aging and closure metrics. Support basic automation for batch prompt execution and reporting where applicable.
Qualifications
Requires 2–6 years in program analysis, project coordination, validation, QA, data analysis or technical operations; hands-on exposure to GenAI tools, LLM applications, prompt engineering or AI-assisted workflows; knowledge of response evaluation, search, summarization and RAG; strong Excel, reporting, communication and attention to detail. Minimum education is an associate’s degree in a related field, or a high school diploma or equivalent with 2+ years of relevant work experience.
Preferred
A related bachelor’s degree; Power BI, Jira, Confluence, SharePoint or dashboarding experience; basic Python, SQL or scripting; semiconductor, SoC, embedded-systems, platform-engineering or technical-program-management background; experience validating AI, search, summarization or workflow-automation tools; and exposure to responsible AI, data privacy, model evaluation or enterprise GenAI governance.