New opportunity

AI Engineer

Optiver · New York, United States

About this role

Optiver is seeking an experienced AI Engineer for its Applied AI and Platform Engineering team in New York. The role owns the lifecycle of production AI systems that automate workflows, support decision-making and accelerate engineering, from identifying opportunities through deployment, operation and continuous improvement.

Responsibilities

  • Build AI products such as agent platforms, assistants, code review harnesses, evaluation frameworks and agentic research pipelines. Use Python and modern AI frameworks, integrating with internal systems, data platforms and third-party AI services.
  • Evaluate foundation models, agent architectures and workflows against capability, reliability, latency, security, cost and business impact. Define success metrics and develop benchmarking, evaluation and observability tools to assess quality, safety and production readiness.
  • Design scalable, resilient distributed systems with attention to state management, authentication, fault tolerance and operational reliability. Prototype emerging tools and models, then validate them against measurable criteria before production investment.
  • Work with trading, research and business teams to turn ambiguous needs into practical solutions and reusable platform capabilities. Deliver maintainable software through testing and code reviews; monitor and improve production quality, reliability, latency, cost, governance and user outcomes.

Requirements

  • Bachelor's degree in Computer Science, Artificial Intelligence or a related technical field, plus at least 6 years of professional software engineering experience, including extensive production Python development.
  • Strong grounding in software architecture, object-oriented design, design patterns, distributed systems, testing and resilient applications. Production experience designing, deploying and operating LLM applications, including model evaluation, prompt engineering, tool calling, context management, agent orchestration and common failure modes.
  • Experience with quantitative evaluation, external tools, APIs, Model Context Protocol (MCP) and AI application frameworks. Sound judgment about when to use AI rather than conventional automation, a product mindset, and strong communication and cross-functional collaboration skills.

Compensation and benefits: The stated base salary range is $200,000—$200,000 USD, with eligibility for a discretionary performance-based bonus. Benefits include a 401(k) match of up to 50%, insurance coverage, and 25 paid vacation days plus market holidays.

For full details about this role, click “Apply on company site” to view the employer’s original posting.

Skills for this role

PythonLarge Language ModelsAI AgentsFoundation ModelsPrompt EngineeringModel EvaluationAgent OrchestrationTool CallingContext ManagementModel Context Protocol (MCP)APIsDistributed SystemsSoftware ArchitectureObject-Oriented DesignDesign PatternsAutomated TestingObservabilityBenchmarkingState ManagementAuthenticationFault ToleranceSecurityCode ReviewCross-functional Collaboration

Your skill match

Checking your profile…

YOUR NEXT STEP

Get interview-ready for this role

A focused preparation guide, built around this job’s responsibilities and requirements.

✦ AI-generated guide
Preparation suggestions, not the employer’s actual interview questions. Always check the original posting for current requirements.
01

Understand the role

What matters most

  • Turn ambiguous needs into measurable products

    The role partners with trading, research, and business teams to identify opportunities, challenge assumptions, and turn use cases into practical solutions with measurable outcomes.

  • Own production AI end to end

    Optiver expects this engineer to design, deploy, operate, and continuously improve AI products such as assistants, agent platforms, evaluation frameworks, and research pipelines.

  • Make evidence-based AI decisions

    The role defines success metrics and uses benchmarks and observability to assess model and workflow quality, safety, production readiness, latency, cost, and business impact.

  • Build reliable, maintainable systems

    The posting emphasizes resilient distributed design, secure integration with internal and external systems, automated testing, code review, and operational reliability.

Likely challenges to think through

  • Choosing AI only when it earns its complexity

    Preparation hypothesis: an ambiguous workflow may be simpler and more dependable with deterministic automation. Prepare to explain how you would compare the two against user needs, measurable outcomes, failure risk, and operating cost.

  • Moving from prototype to production

    Preparation hypothesis: promising model behavior may not hold up under reliability, safety, latency, and cost constraints. Prepare a concrete example of setting evaluation criteria before a prototype and using results to decide whether to invest in deployment.

  • Keeping integrated agents dependable

    Preparation hypothesis: tool calls across internal systems, data platforms, and third-party services create trade-offs among capability, security, state management, and fault tolerance. Prepare to discuss how you would test failures, control access, observe behavior, and recover safely.

03

Practice your answers

Technical practice

When would you use an LLM instead of deterministic automation for a workflow?

What to coverSuggested answer focus (inferred from the posting): Compare the need for flexible interpretation with requirements for correctness, predictability, latency and cost. Explain how you would define a measurable outcome before choosing either approach.

How would you architect a production AI assistant in Python that integrates with internal systems?

What to coverSuggested answer focus (inferred from the posting): Describe service boundaries, interfaces to data and third-party AI services, and how you would keep the design maintainable. Address authentication, testing and operational ownership without assuming a particular internal stack.

How would you make an agent's tool calls reliable and secure?

What to coverSuggested answer focus (inferred from the posting): Discuss tool and API contracts, authorization, input validation, failure handling and safeguards around actions. Explain where MCP could fit as an integration interface, without treating it as a substitute for application-level controls.

How would you manage context and prompts in a production LLM application?

What to coverSuggested answer focus (inferred from the posting): Explain how you would select relevant context, handle limited context windows and test prompt changes. Include failure modes such as missing context, unsupported answers and unreliable tool use.

How would you choose between foundation models and agent architectures?

What to coverSuggested answer focus (inferred from the posting): Describe a comparison based on task capability, reliability, latency, security, cost and business impact. Explain how representative benchmarks and production constraints would affect the decision.

What evaluation framework would you build before releasing an AI workflow?

What to coverSuggested answer focus (inferred from the posting): Define task-specific success metrics, representative test cases and checks for quality, safety and failure modes. Explain how quantitative results would guide model or prompt iteration and a production-readiness decision.

How would you design state and fault tolerance for a distributed agent workflow?

What to coverSuggested answer focus (inferred from the posting): Discuss where workflow state lives, how to handle retries and partial failures, and how to avoid inconsistent or duplicated actions. Relate the design to scalability and operational reliability.

How would you test AI-assisted software and a code review harness?

What to coverSuggested answer focus (inferred from the posting): Separate deterministic software tests from evaluation of AI-generated output, and explain what each can establish. Describe how code review and automated checks would protect functional requirements and maintainability.

How would you monitor and improve an AI system after deployment?

What to coverSuggested answer focus (inferred from the posting): Identify signals for quality, reliability, latency, cost and user outcomes, alongside useful observability for diagnosing failures. Explain how you would use those signals to prioritize changes while maintaining governance.

How would you decide whether an emerging AI tool is ready for production investment?

What to coverSuggested answer focus (inferred from the posting): Propose a bounded prototype with measurable success criteria and compare its results with an existing approach. Address the trade-off between rapid experimentation and the work needed for a resilient, reusable production capability.

Behavioural practice

Tell me about a time you turned an ambiguous user need into a technical solution.

What to coverSuggested answer focus (inferred from the posting): Use a situation, your actions to clarify requirements with users, and the result. Explain how you determined whether the solution met a measurable business need.

Describe a time you challenged a stakeholder's proposed technical approach.

What to coverSuggested answer focus (inferred from the posting): Give a situation, how you communicated evidence and trade-offs, and the resulting decision. Show how you maintained collaboration while questioning assumptions.

Tell me about a production reliability issue you owned.

What to coverSuggested answer focus (inferred from the posting): Set out the situation, your diagnostic and corrective actions, and the result. Explain what you changed in monitoring, testing or system design to reduce recurrence.

Describe a time an experiment changed your implementation plan.

What to coverSuggested answer focus (inferred from the posting): State the initial hypothesis, the evaluation you performed, and what the results led you to do. Include how you balanced speed of iteration with evidence needed for further investment.

Tell me about a code review disagreement that improved software quality.

What to coverSuggested answer focus (inferred from the posting): Describe the situation, how you resolved the disagreement, and the outcome for the software or team. Focus on maintainability, correctness or testing rather than claiming a particular review process at Optiver.

02

Sharpen your knowledge

Topics to prepare

  • LLM application architecture

    The posting requires production experience with prompt engineering, context management, tool calling, agent orchestration, and common failure modes. Revision exercise: diagram an assistant’s request flow and explain how you would handle irrelevant context, incorrect tool results, and repeated agent actions.

  • Quantitative model evaluation

    Optiver calls for evaluation frameworks and metrics that guide model selection, prompt iteration, and production readiness. Revision exercise: define a test set, quality and safety metrics, and acceptance criteria for a hypothetical assistant; explain how you would compare two models.

  • Resilient distributed-system design

    The role emphasizes scalability, state management, authentication, fault tolerance, security, and operational reliability. Revision exercise: sketch a distributed AI service and reason through a failed dependency, a retry, and recovery of in-progress state.

  • Production trade-offs

    The posting asks for decisions based on capability, reliability, latency, security, cost, and business impact, followed by continuous improvement. Revision exercise: compare two hypothetical AI workflows across those dimensions and state what evidence would justify deployment.

  • Choosing AI versus conventional automation

    Optiver explicitly values judgment about when deterministic software is more appropriate than AI. Revision exercise: take an ambiguous workflow request, identify which steps need flexible interpretation and which can use fixed rules, then define a measurable outcome.

Skills to revise

  • Build a Python tool integration

    The role requires extensive production Python and experience integrating AI systems with APIs, external tools, and MCP. Suggested practice: implement a small Python tool-calling flow with input validation, authentication handling, timeouts, and clear error responses.

  • Implement an evaluation harness

    The posting names benchmarking, evaluation frameworks, and quantitative metrics. Suggested practice: write a repeatable test harness for a hypothetical assistant that records outputs, checks expected behavior, and compares quality, latency, and cost across revisions.

  • Test and review AI application code

    Optiver calls for automated testing, maintainable software, and thoughtful code reviews. Suggested practice: add tests for malformed tool responses and failure paths to a small Python service, then review the change for correctness and resilience.

  • Instrument and diagnose a service

    Operating and monitoring production AI systems is part of the advertised role. Suggested practice: add request-level measurements for errors, latency, and model usage to a sample service, then explain how the measurements would guide an improvement.

  • Turn user needs into a scoped prototype

    The role partners with trading, research, and business teams to refine ambiguous needs and validate prototypes against success criteria. Suggested practice: draft questions for a hypothetical stakeholder, a narrowly scoped prototype, and criteria for deciding whether to continue.

04

Your preparation checklist

  • Prepare a production AI project walkthrough

    The role covers the full lifecycle of production AI systems. Prepare one example you can discuss from problem definition and Python implementation through deployment, monitoring, and improvement; distinguish your own contributions from the team’s.

  • Document relevant engineering evidence

    The posting asks for 6+ years of software engineering, extensive production Python experience, and a related bachelor’s degree. Prepare a concise timeline and examples covering architecture, testing, code review, and resilient systems, using only experience you can substantiate.

  • Practice a distributed AI system design

    The role emphasizes scalability, state management, authentication, fault tolerance, security, and operational reliability. As a preparation exercise, sketch an AI assistant or agent platform, including component boundaries, failure handling, and operational tradeoffs.

  • Build an evaluation example

    The posting calls for quantitative model evaluation and production-readiness decisions. Prepare a sample benchmark plan with success metrics, test cases, and a way to compare quality, safety, reliability, latency, and cost.

  • Explain an LLM integration end to end

    The role names tool calling, context management, agent orchestration, APIs, MCP, and common failure modes. Prepare a diagram or walkthrough showing how an application uses these components and how it detects and handles failures.

  • Rehearse an AI-versus-automation decision

    Optiver asks for judgment about when AI is preferable to deterministic automation. Prepare a brief example that compares both approaches against user needs, measurable outcomes, risks, and maintenance costs.

  • Write questions for the team

    The role partners with trading, research, and business teams and evolves use cases into reusable capabilities. Prepare questions about how needs are prioritized, how production quality is measured, and what makes a prototype ready for broader use.

AI-generated from the job information · Prepared Sep 30, 2026 (UTC)Useful preparation, not a guarantee of eligibility or an offer.

Availability last checked: Nov 4, 2026. Status can change after a check; confirm on the employer’s website. Report an issue · Our checking policy

KEEP EXPLORING

Similar AI jobs

Related skills and specializations in United States. Matched to this role, not your profile.

Explore more jobs
Finding similar opportunities…