New opportunity

Senior AI Engineer

Seven AI · Boston, United States

About this role

Seven AI seeks a Senior AI Engineer to build the LLM-powered systems behind its security agents, which support detection, investigation, response, and threat hunting. The role focuses on composing, optimizing, and scaling production AI systems rather than training models from scratch. It is based in Boston, MA, with a hybrid working arrangement.

Responsibilities

  • Architect retrieval workflows, context management, agent prompts, and structured output pipelines. Orchestrate AI workflows with LangChain, LlamaIndex, or similar frameworks and integrate them with product APIs and backend services.
  • Own prompt and template iteration, refining context strategies to improve quality and reliability. Evaluate real-world usefulness, factual correctness, latency, and user experience impact.
  • Partner with product, platform, and backend teams to deliver reliable, scalable production deployments with attention to performance, cost efficiency, and observability.

Requirements

  • 6+ years of software engineering experience, including at least 1 year building AI in production, and a BS in Computer Science or a related field.
  • Experience shipping LLM applications that materially contributed to a product, not only prototypes. Strong Python or equivalent coding skills, plus experience with API design, backend integration, database systems, and cloud deployment.
  • Hands-on experience with RAG, vector databases such as Pinecone or Weaviate, and workflow frameworks such as LangChain or Dust. Ability to design end-to-end solutions involving context windows, caching, tool calls, and multi-step reasoning.
  • Experience with multimodal models or multi-agent system design; familiarity with AI safety guardrails, hallucination mitigation, and structured output enforcement. A focus on safe, reliable outcomes for users is required.

Preferred

A master's degree in Computer Science or a related field. The posted base salary range is $150K–$230K per year, plus equity; final offers vary with experience, skills, and interview performance.

For full details about this role, click “Apply on company site” to view the employer’s original posting.

Skills for this role

Large Language Models (LLMs)Retrieval-Augmented Generation (RAG)Prompt EngineeringPythonLangChainLlamaIndexDustPineconeWeaviateVector DatabasesAPI DesignBackend IntegrationDatabase SystemsCloud DeploymentContext ManagementCachingTool CallingMulti-step ReasoningMultimodal ModelsMulti-agent SystemsAI Safety GuardrailsHallucination MitigationStructured OutputsAI EvaluationObservability

Your skill match

Checking your profile…

YOUR NEXT STEP

Get interview-ready for this role

A focused preparation guide, built around this job’s responsibilities and requirements.

✦ AI-generated guide
Preparation suggestions, not the employer’s actual interview questions. Always check the original posting for current requirements.
01

Understand the role

What matters most

  • Build retrieval and context systems

    The role owns retrieval workflows, RAG, context management, and agent prompts behind security agents. Be ready to explain architectural choices for context windows, vector retrieval, and multi-step reasoning on customer data.

  • Connect AI workflows to the product

    The posting calls for orchestrating workflows with LangChain, LlamaIndex, or similar tools and integrating them with product APIs and backend services. Prepare a production architecture example that shows how the AI components fit with APIs, databases, and cloud deployment.

  • Improve quality through real-world evaluation

    The engineer owns prompt and template iteration and tracks usefulness, factual correctness, latency, and user-experience impact—not just accuracy. Prepare to describe how evaluation results informed a change to prompts or context strategy.

  • Deliver safe, dependable agent outputs

    Structured output pipelines, hallucination mitigation, safety guardrails, and reliable user outcomes are explicit expectations. Be ready to discuss how tool calls and outputs are constrained or checked before they affect a security workflow.

  • Operate efficiently in production

    The role calls for scalable deployments with attention to performance, cost efficiency, and observability, in partnership with product, platform, and backend teams. Prepare to explain operational trade-offs from an LLM application that shipped beyond a prototype.

Likely challenges to think through

  • Keeping investigations grounded on real data

    Preparation hypothesis: The posting warns that retrieval and prompting can look convincing in a demo but fail on a customer's data. The trade-off is giving an agent enough relevant context without introducing distracting or unsupported evidence. Prepare an example of how you would diagnose retrieval failures and test factual correctness.

  • Balancing reasoning depth with responsiveness

    Preparation hypothesis: Context windows, caching, tool calls, and multi-step reasoning can improve an investigation while increasing latency and cost. Prepare to explain where you would cache, limit steps, or simplify a workflow, and which quality and latency measures would guide that choice.

  • Making agent outputs usable across services

    Preparation hypothesis: Structured outputs and backend integration must remain reliable even when model responses vary. The difficulty is preserving useful flexibility without passing malformed or unsafe results to downstream services. Prepare an example of output validation, failure handling, and how you would coordinate an integration boundary with backend teams.

03

Practice your answers

Technical practice

How would you design retrieval for an agent investigating security data?

What to coverThe role calls for RAG, vector databases, and retrieval workflows that work on real customer data. Suggested preparation: Explain how you would select relevant evidence, assess retrieval quality, and handle missing or conflicting results.

How would you manage an agent’s context window and iterate on its prompts?

What to coverThe posting assigns ownership of prompts, templates, and context strategies. Suggested preparation: Discuss what context to retain or omit, how you would test changes, and the trade-off between completeness, latency, and reliability.

How would you orchestrate tool calls and multi-step reasoning?

What to coverThe role includes agent workflows using frameworks such as LangChain or LlamaIndex and integration with backend services. Suggested preparation: Describe how you would sequence steps, pass state, handle tool failures, and decide when a simpler workflow is preferable.

How would you enforce a structured output contract for an agent?

What to coverStructured output pipelines and enforcement are explicit parts of the role. Suggested preparation: Cover schema validation, recovery from malformed outputs, and how downstream APIs should respond when required fields cannot be produced reliably.

How would you reduce hallucinations and keep an agent’s output safe?

What to coverThe posting emphasizes guardrails, hallucination mitigation, and safe outcomes for users. Suggested preparation: Explain how you would ground claims in available evidence, constrain unsupported conclusions, and handle uncertainty without implying that any particular guardrail is already in place.

How would you evaluate whether an LLM workflow helps users?

What to coverThe posting names usefulness, factual correctness, latency, and user experience impact as evaluation concerns. Suggested preparation: Explain how you would combine representative real-world cases with those measures and decide whether a change is worth its costs.

How would you integrate an LLM workflow with product APIs and backend services?

What to coverAPI design, backend integration, database systems, and cloud deployment are stated areas of experience. Suggested preparation: Discuss interface contracts, failure handling, and how you would keep the integration reliable as the workflow changes.

How would you make an LLM deployment observable and cost-efficient at scale?

What to coverThe role calls for scalable production deployments with attention to performance, cost, and observability. Suggested preparation: Identify signals you would monitor, how you would investigate regressions, and the trade-offs you would consider when changing a workflow.

Where would caching help or hurt an agent workflow?

What to coverCaching strategies are explicitly included in the end-to-end design expectations. Suggested preparation: Compare latency and cost savings with the risk of stale context or results, and describe how you would decide what is safe to reuse.

When would you choose a multi-agent or multimodal design over a simpler workflow?

What to coverThe posting asks for experience with multimodal models or multi-agent system design. Suggested preparation: Explain a use case for one of these approaches, what added complexity it introduces, and how you would establish that it improves the outcome.

Behavioural practice

Tell me about a time you took an LLM application beyond a prototype.

What to coverThe posting distinguishes shipped product contributions from prototypes. Suggested preparation: Use a real situation, your actions to make the system production-ready, and the resulting product outcome or lessons learned.

Describe a time you worked across product, platform, and backend teams on an integration.

What to coverCross-functional delivery is an explicit part of the role. Suggested preparation: Give the situation, how you resolved differing constraints or ownership questions, and the result of the collaboration.

Tell me about a reliability problem you investigated in a production system.

What to coverThe role emphasizes reliable deployments and observability. Suggested preparation: Describe the situation and signals available, the troubleshooting actions you took, and the result without presenting a hypothetical incident as personal experience.

Describe a time evidence changed your approach to an AI feature.

What to coverThe posting calls for prompt iteration and evaluation against real-world usefulness, correctness, latency, and user experience. Suggested preparation: Explain the situation, what evidence you used and changed, and the observed result.

Tell me about a time you balanced product usefulness with user safety.

What to coverSafe, reliable user outcomes are a stated priority. Suggested preparation: Give a real situation, the trade-off and actions you took, and the result, including any remaining limitation.

02

Sharpen your knowledge

Topics to prepare

  • Retrieval and context design

    The posting calls for RAG, vector databases, retrieval workflows, context windows, and caching. Suggested exercise: diagram how a security agent would retrieve relevant investigation records, select what fits in context, and handle missing or conflicting evidence.

  • Agent workflow architecture

    The role includes tool calls, multi-step reasoning, and experience with multimodal models or multi-agent design. Suggested exercise: sketch an investigation workflow with tool inputs, decision points, and failure paths; explain when a single agent would be simpler than multiple agents.

  • Prompt reliability and output safety

    The posting emphasizes prompt iteration, hallucination mitigation, guardrails, and structured output enforcement. Suggested exercise: compare prompt and context strategies for an evidence-based finding, including what should happen when evidence is insufficient or an output fails validation.

  • Product-facing AI evaluation

    The role tracks usefulness, factual correctness, latency, and user experience impact rather than accuracy alone. Suggested exercise: define a small evaluation set for security investigations and explain how you would compare two workflow versions across those measures.

  • Production system trade-offs

    The posting prioritizes scalable deployments, performance, cost efficiency, observability, and clean integration with product and backend teams. Suggested exercise: walk through an end-to-end design and identify likely bottlenecks, cost drivers, observable failure signals, and integration boundaries.

Skills to revise

  • Build a RAG retrieval path

    Hands-on RAG and vector database experience are explicit requirements; Pinecone and Weaviate are named examples. Suggested exercise: use sample investigation records to build a retrieval path, inspect irrelevant and missing results, and revise the context passed to the model.

  • Orchestrate a tool-using workflow

    The posting names LangChain, LlamaIndex, Dust, or similar frameworks for AI workflows. Suggested exercise: implement a short retrieval-to-tool-call-to-answer flow in one named framework and trace how state and errors move between steps.

  • Iterate prompts and enforce outputs

    Owning prompts, templates, context strategies, and structured outputs is part of the role. Suggested exercise: write two prompt versions for an investigation summary, require defined output fields, and test unsupported claims and malformed responses.

  • Integrate a Python backend

    Strong Python or equivalent coding, API design, backend integration, and database systems are stated requirements. Suggested exercise: expose a small AI workflow through an API, persist its inputs and results, and handle invalid requests and downstream failures.

  • Measure and diagnose quality

    The posting calls for real-world evaluation and production observability. Suggested exercise: run a fixed set of sample investigations through two versions, record factual correctness and latency alongside usefulness judgments, and explain a regression.

  • Plan a production deployment

    Cloud deployment experience and reliable, scalable, cost-efficient operation are explicit in the posting. Suggested exercise: outline how you would deploy the API-backed workflow to a cloud environment, including caching, monitoring, failure handling, and cost checks; no particular cloud provider is specified.

04

Your preparation checklist

  • Map the stated requirements to evidence

    Prepare a one-page evidence map for the posting’s 6+ years of software engineering, at least one year of production AI, relevant degree, and shipped LLM applications. Use only experience and credentials you can substantiate.

  • Build a production LLM project walkthrough

    If you have a relevant shipped project, prepare a concise account of your architecture, personal decisions, product contribution, deployment, measured outcomes, and lessons learned. The role emphasizes production systems over prototypes.

  • Sketch a security-agent workflow

    As a preparation exercise, diagram how an agent might retrieve evidence for an investigation, manage context, call tools, and return structured output. Explain vector retrieval, caching, multi-step reasoning, and where a human stays on the loop; do not present the sketch as 7AI’s architecture.

  • Prepare an evaluation and prompt-iteration example

    Show how you would compare prompt, template, and context changes using usefulness, factual correctness, latency, and user-experience measures named in the posting. Include an example failure and a proposed revision.

  • Work through a reliability failure scenario

    Prepare a brief response to unsupported claims, unsafe tool actions, or malformed outputs in an agent workflow. Discuss guardrails, hallucination mitigation, structured-output enforcement, and how you would check that the fix works.

  • Explain the path to production

    Prepare a diagram or talking points covering Python or equivalent code, API and backend integration, databases, cloud deployment, observability, scaling, and cost tradeoffs. Include how you would coordinate decisions with product, platform, and backend teams.

  • Draft questions for the employer

    Ask how 7AI evaluates agent usefulness on customer data, divides responsibility between agents and humans, and balances latency, cost, and reliability. These are questions to clarify the role, not assumptions about its current processes.

AI-generated from the job information · Prepared Sep 30, 2026 (UTC)Useful preparation, not a guarantee of eligibility or an offer.

Availability last checked: Nov 4, 2026. Status can change after a check; confirm on the employer’s website. Report an issue · Our checking policy

KEEP EXPLORING

Similar AI jobs

Related skills and specializations in United States. Matched to this role, not your profile.

Explore more jobs
Finding similar opportunities…