New opportunity

Software Engineer, AI/ML

Interfere · New York City, United States

About this role

Interfere is seeking a Software Engineer, AI/ML to own the intelligence layer of its product, which detects, explains, and helps teams fix failures in user experiences. The role combines research and production engineering, building agents, evaluations, and inference pipelines that work with real codebases and runtime data.

Responsibilities

  • Build agents that investigate codebases, traces, logs, and runtime behavior to find and explain bugs, including the sandboxes, browsers, and web research they use.
  • Develop LLM pipelines for triage, root-cause analysis, and automated fix proposals, with model routing that balances suitability and cost.
  • Build detection systems for anomalies in product behavior, performance, and user experience across noisy data.
  • Create evaluations, datasets, observability, and feedback loops to measure and improve agentic systems. Develop retrieval, indexing, context construction, and customer-stack integrations that help models understand codebases.
  • Use signals from bugs found and fixed to improve future detection.

Requirements

Experience shipping ML or LLM-powered systems used in production; experience with agent architectures, tool use, multi-step reasoning, or autonomous workflows in production; an ability to move between research and engineering, evaluate results, and independently take ambiguous AI problems from concept to deployment. The listing says applicants of any experience level, including new graduates, are welcome.

Preferred background: Code understanding or program analysis; retrieval, RAG, or context-construction systems; anomaly detection, time-series modeling, or learned monitoring. Production agentic systems, impactful evaluations, substantive open-source work, technical writing, or research are strong signals.

Logistics: This is a full-time, in-person role in New York City. The listed compensation is $160K–$250K annually plus 0.60%–1.00% equity, with health, dental, and vision benefits and relocation help. The listing says “US citizen/visa only” and also notes visa sponsorship for exceptional international candidates.

For full details about this role, click “Apply on company site” to view the employer’s original posting.

Skills for this role

AI agentsLarge language modelsMachine learningAgent architecturesTool useMulti-step reasoningAutonomous workflowsLLM pipelinesModel routingAI evaluationObservabilityContext engineeringRetrievalIndexingRAGAnomaly detectionTime-series modelingProgram analysisCode understandingRoot-cause analysisProduction ML systems

Your skill match

Checking your profile…

YOUR NEXT STEP

Get interview-ready for this role

A focused preparation guide, built around this job’s responsibilities and requirements.

✦ AI-generated guide
Preparation suggestions, not the employer’s actual interview questions. Always check the original posting for current requirements.
01

Understand the role

What matters most

  • Investigative agents

    Build production agents that use codebases, traces, logs, runtime behavior, sandboxes, browsers, and web research to find and explain bugs.

  • Triage and fix pipelines

    Develop LLM pipelines for triage, root-cause analysis, and fix proposals, routing each job to a suitable model at an appropriate cost.

  • Detection across noisy signals

    Detect anomalies in product behavior, performance, and user experience using real-world data.

  • Measured improvement

    Own evaluations, datasets, observability, and feedback loops; use bugs found and fixed to improve subsequent detection rather than relying on prompt intuition.

  • Customer-codebase context

    Build retrieval, indexing, context construction, and stack integrations so models can reason about customers’ codebases.

Likely challenges to think through

  • Distinguishing failures from noise

    Likely challenge, not a confirmed problem: sensitive detection could surface too many unhelpful alerts, while conservative detection could miss user-impacting failures. Prepare to explain how you would evaluate both missed failures and false alarms using product-behavior evidence.

  • Giving agents enough trustworthy context

    Likely challenge, not a confirmed problem: code, logs, and traces may be large or inconsistent across customer stacks, making complete context impractical and partial context misleading. Prepare a retrieval and investigation approach that preserves evidence for root-cause claims.

  • Shipping quickly without losing confidence

    Likely challenge, not a confirmed problem: the role combines 0→1 ownership and daily shipping with production use, measurable evaluations, and model-cost trade-offs. Prepare to describe a small deployable increment, its evaluation criteria, observability, and when a cheaper model would be insufficient.

03

Practice your answers

Technical practice

How would you design an agent to investigate a suspected bug across code, traces, logs, and runtime behavior?

What to coverThe role calls for agents that use these sources to find and explain bugs. Suggested answer: describe how the agent selects evidence, tests competing explanations, records its reasoning, and handles inconclusive results.

How would you give an investigative agent access to sandboxes, browsers, and web research?

What to coverThe posting explicitly includes these tools in agent investigations. Suggested answer: discuss when each tool is useful, how to limit its actions, and how to distinguish observed evidence from a model's inference.

How would you structure an LLM pipeline from triage through root-cause analysis to a proposed fix?

What to coverThese three stages are named responsibilities. Suggested answer: explain the inputs and outputs of each stage, how uncertainty passes between them, and what evidence would justify a fix proposal.

How would you route investigation tasks among models while controlling cost?

What to coverThe role includes sending each job to a suitable model at an appropriate cost. Suggested answer: compare routing by task difficulty and evidence needs, then explain how you would evaluate quality against cost rather than optimizing either alone.

How would you detect meaningful product-experience anomalies in noisy data?

What to coverThe posting calls for anomaly detection across product behavior, performance, and user experience. Suggested answer: define a useful signal and baseline, then address false alerts, missed failures, and changes in normal behavior.

How would you build an evaluation dataset for bug-finding and explanation agents?

What to coverInterfere lists evaluations and datasets as core work. Suggested answer: cover case selection, evidence-backed labels, measures for detection and explanation quality, and ways to avoid judging a system only on familiar cases.

What would you observe in production to tell whether an agentic system is improving?

What to coverThe role calls for observability and measurable feedback loops for systems used by real teams. Suggested answer: distinguish operational measures from outcome quality, and explain how you would investigate a metric change before attributing it to a model improvement.

How would you construct useful codebase context for a model?

What to coverThe posting names retrieval, indexing, context construction, and customer-stack integrations. Suggested answer: discuss how to find relevant code, connect it to runtime evidence, manage context limits, and check whether retrieval helped the investigation.

How would you turn bugs found and fixed into better future detection?

What to coverThe role explicitly calls for learning from resolved bugs. Suggested answer: describe how to capture trustworthy feedback, update detection or evaluations, and guard against treating an incorrect fix or incomplete diagnosis as ground truth.

What changes when an ML or LLM investigation system moves from prototype to production?

What to coverThe posting emphasizes systems real users depend on, rather than notebooks or demos. Suggested answer: address reliability, failure handling, measurement, and the trade-off between investigative depth and timely results.

Behavioural practice

Tell me about a time you took an ambiguous technical problem from idea to a useful result.

What to coverThe role calls for independently owning 0-to-1 AI work. Suggested answer: use a real situation, the scope and next step you chose, your actions, and the result; be clear about what remained uncertain.

Tell me about a time an evaluation changed your technical direction.

What to coverThe posting treats evaluations as a first-class engineering problem. Suggested answer: describe the initial approach, the evidence that challenged it, what you changed, and the resulting outcome.

Tell me about a time you learned an unfamiliar technology or domain quickly enough to deliver work.

What to coverThe posting values moving between research and engineering and learning unfamiliar technology quickly. Suggested answer: set out the situation, how you narrowed what to learn and tested it, and what your work achieved.

Tell me about a time you balanced shipping speed with maintainable engineering.

What to coverInterfere says it ships daily and deliberately without letting technical debt accumulate. Suggested answer: explain the time pressure, the trade-off you made, the actions that protected quality, and the result.

Tell me about a time you helped people with different roles reach a shared understanding of a problem.

What to coverThe product aims to give product, design, and engineering teams context for the same user-experience failure, and the posting emphasizes in-person architecture discussions. Suggested answer: describe the situation, how you presented evidence and handled differing priorities, and what the group decided or changed.

02

Sharpen your knowledge

Topics to prepare

  • Production agent architecture

    Posting: Production experience with agent architectures, tool use, multi-step reasoning, or autonomous workflows is requested. Suggested revision exercise: diagram an investigation agent that moves from a failure signal to code, traces, logs, and runtime evidence; explain how it handles inconclusive evidence and limits unnecessary tool calls.

  • Evaluation and feedback loops

    Posting: Evals are a first-class engineering problem, supported by datasets, observability, and feedback from bugs found and fixed. Suggested revision exercise: define a labeled set of bug investigations, measures for detection and root-cause quality, and a way to check whether a proposed change improves results.

  • LLM triage and model routing

    Posting: Pipelines must support triage, root-cause analysis, and fix proposals while routing work to suitable models at appropriate cost. Suggested revision exercise: sketch a routing policy for simple versus complex investigations and explain how you would compare quality and cost before changing it.

  • Production ML tradeoffs and ownership

    Posting: The role calls for shipped ML or LLM systems used by real users and ownership from an ambiguous problem through deployment. Suggested revision exercise: outline how you would narrow an ill-defined failure-detection problem, prototype one approach, evaluate it, and decide whether it is ready to ship.

  • Codebase context construction

    Posting: Retrieval, indexing, context construction, and customer-stack integrations are part of the role; prior experience with such systems is nice to have. Suggested revision exercise: compare ways to select relevant source-code context for a bug report and explain how you would detect missing or misleading context.

  • Anomalies in noisy product data

    Posting: The role includes detecting anomalies in behavior, performance, and user experience; anomaly-detection or time-series experience is nice to have. Suggested revision exercise: describe how you would distinguish a meaningful checkout-flow failure from normal variation and assess false alarms.

Skills to revise

  • Investigate a failure across evidence sources

    Posting: Agents investigate codebases, traces, logs, and runtime behavior to find and explain bugs. Suggested hands-on exercise: take a small reproducible application failure, trace it from the observed symptom through logs and source code, and write an evidence-backed root-cause explanation.

  • Build a bounded investigation agent

    Posting: The role includes agent tool use and the sandboxes and browsers used for investigation. Suggested hands-on exercise: prototype an agent that inspects a sample codebase and trace, records its tool-use steps, and stops with an explicit uncertainty statement when evidence is insufficient.

  • Run a comparative agent evaluation

    Posting: The team builds evals, datasets, and observability to measure agentic systems. Suggested hands-on exercise: assemble a small set of known failures, score two investigation approaches against the same cases, inspect incorrect explanations, and document the resulting design decision.

  • Construct and test codebase retrieval

    Posting: The role builds indexing, retrieval, and context for customer codebases. Suggested hands-on exercise: index a sample repository, retrieve context for a specific failure, and check whether the returned files contain the evidence needed to explain it. This is preparation for a stated responsibility, not a specified interview task.

  • Prototype and assess anomaly detection

    Posting: Detection must work across noisy real-world product and performance data. Suggested hands-on exercise: use a small labeled sequence of product events to flag unusual behavior, inspect missed failures and false alarms, and explain how confirmed fixes could inform subsequent detection.

04

Your preparation checklist

  • Select one work sample

    Interfere asks for a resume or LinkedIn profile, one piece of work, and a short note on why Interfere. Choose a sample that shows how you think and build; state your contribution and what the work demonstrates.

  • Prepare a production-system walkthrough

    The role calls for ML or LLM systems used by real users and production agent workflows. If you have a relevant example, prepare a diagram and a concise account of tool use, deployment, user impact, failures, and tradeoffs. Distinguish shipped work from prototypes.

  • Show how you measured improvement

    The listing treats evals as a first-class engineering problem. Prepare an example, if available, with a dataset, baseline, metrics, observed errors, and a decision the results changed. Otherwise, outline how you would evaluate bug explanations and fix proposals.

  • Practice an intelligence-layer design exercise

    As interview preparation, sketch how an agent could connect codebase retrieval with traces, logs, and browser investigation to produce a triage result and proposed fix. Explain context selection, sandbox boundaries, model-routing cost, and where human review belongs; this is a practice scenario, not a stated interview task.

  • Work through a noisy-detection example

    Prepare a hypothetical product-flow failure and explain how you would distinguish an anomaly from normal variation, measure false alerts and missed issues, and use confirmed fixes as feedback. Anomaly detection and learning from fixed bugs are responsibilities in the listing.

  • Rehearse a 0-to-1 decision story

    The role emphasizes taking ambiguous AI problems from concept to deployment. If you have an example, identify the initial uncertainty, the smallest useful prototype, the evidence used to choose a direction, and what you shipped or would change.

  • Bring focused questions to the founder and team

    The listed process includes a founder conversation and an onsite/work trial in New York. Prepare questions about how they define a detected failure, evaluate explanations and fixes with design partners, and balance daily shipping with reliable agent behavior.

AI-generated from the job information · Prepared Sep 30, 2026 (UTC)Useful preparation, not a guarantee of eligibility or an offer.

Availability last checked: Nov 4, 2026. Status can change after a check; confirm on the employer’s website. Report an issue · Our checking policy

KEEP EXPLORING

Similar AI jobs

Related skills and specializations in United States. Matched to this role, not your profile.

Explore more jobs
Finding similar opportunities…