New opportunity

Senior ML / AI Engineer

Confido · New York, United States

About this role

Confido seeks a Senior ML / AI Engineer to build production AI systems for its financial automation and intelligence platform serving consumer packaged goods (CPG) brands. The role spans LLM-powered understanding of financial documents and predictive models that support brand decisions. It is based in the New York City office, with relocation supported.

Responsibilities

  • Own the AI/ML lifecycle from research and prototyping through production deployment and monitoring, partnering with engineering and product to integrate capabilities into the platform.
  • Extract structured data from complex financial documents, including invoices, deductions and retailer reports.
  • Develop agentic workflows that retrieve and reason over information in fragmented or legacy enterprise systems.
  • Build models to forecast brand sales and financial performance, detect anomalies in retailer and sales data, and recommend or optimize retailer promotions.

Requirements

  • The listing specifies 3+ years of experience overall; the role requirements specify 2+ years of applied AI/ML experience.
  • Experience building and deploying production ML systems and working with LLMs or NLP systems.
  • A strong product mindset and the ability to turn AI capabilities into practical applications.

Preferred

  • Experience fine-tuning LLMs such as Llama or GPT, building agentic workflows or retrieval systems, and working at a startup or in a fast-moving environment.

The position is full-time, pays $210,000–$280,000 USD annually, and is listed for US citizens or visa holders only. The interview process includes remote introductory and technical calls followed by an on-site session in the Chelsea office; Confido says it will fly in candidates who are not local.

For full details about this role, click “Apply on company site” to view the employer’s original posting.

Skills for this role

Machine LearningLarge Language ModelsNatural Language ProcessingDocument UnderstandingInformation ExtractionAI AgentsRetrieval SystemsPredictive ModelingSales ForecastingAnomaly DetectionRecommendation SystemsLLM Fine-TuningLlamaGPTProduction ML DeploymentML MonitoringProduct Collaboration

Your skill match

Checking your profile…

YOUR NEXT STEP

Get interview-ready for this role

A focused preparation guide, built around this job’s responsibilities and requirements.

✦ AI-generated guide
Preparation suggestions, not the employer’s actual interview questions. Always check the original posting for current requirements.
01

Understand the role

What matters most

  • Own production ML systems

    Lead work from research and prototyping through deployment and monitoring, then integrate AI capabilities into Confido’s platform with engineering and product.

  • Extract financial-document data

    Build LLM or NLP systems that turn complex invoices, deductions, and retailer reports into structured data.

  • Retrieve and reason across enterprise systems

    Develop agentic workflows that use information spread across fragmented or legacy systems.

  • Forecast and detect anomalies

    Build models for brand sales and financial performance forecasts and for anomaly detection in retailer and sales data.

  • Optimize retailer promotions

    Develop recommendation systems that help brands make decisions about retailer promotions.

Likely challenges to think through

  • Accuracy versus coverage in document ingestion

    A likely design challenge is handling varied financial documents without silently extracting incorrect values. Prepare to discuss validation, uncertainty handling, and how you would measure extraction quality; this is a preparation hypothesis, not a stated Confido problem.

  • Grounding workflows in fragmented data

    Retrieval across legacy systems may trade breadth of access against trustworthy, traceable answers. Prepare an approach to source attribution, missing information, and failure handling; the listing does not specify the systems or their condition.

  • Useful predictions versus misleading signals

    Forecasts, anomaly alerts, and promotion recommendations may involve different costs for false alarms and missed opportunities. Prepare to explain evaluation choices and how you would connect model outputs to product decisions; these trade-offs are inferred from the stated duties.

03

Practice your answers

Technical practice

How would you extract structured fields from invoices, deductions, and retailer reports?

What to coverSuggested preparation: Describe a pipeline for handling varied layouts, identifying fields, and validating extracted values against the source document. Discuss when LLM or NLP approaches are useful and how to handle missing or ambiguous information.

How would you evaluate a financial-document extraction system before release?

What to coverSuggested preparation: Define field-level accuracy measures and test across document types and layouts. Explain how you would examine consequential errors and decide when uncertain outputs need review.

How would you design an agentic workflow that retrieves and reasons over fragmented enterprise data?

What to coverSuggested preparation: Explain how the workflow would locate relevant information in legacy systems, maintain traceability to retrieved evidence, and avoid unsupported conclusions. Address what should happen when sources conflict or a system is unavailable.

How would you forecast brand sales and financial performance?

What to coverSuggested preparation: Discuss target and forecast-horizon selection, time-aware validation, and comparison with a simple baseline. Explain how changing retailer conditions or incomplete data could affect forecast usefulness.

How would you detect anomalies in retailer and sales data?

What to coverSuggested preparation: Distinguish unusual but legitimate variation from errors worth investigating, and explain how you would evaluate alerts when confirmed anomalies are scarce. Discuss the trade-off between missed issues and excessive false alarms.

How would you evaluate recommendations for retailer promotions?

What to coverSuggested preparation: Define the decision and outcome the recommendation is meant to improve, then discuss constraints and how you would compare it with current decisions. Explain why historical promotion results may not reliably predict the effect of a new recommendation.

How would you move an ML prototype into production and monitor it?

What to coverSuggested preparation: Walk through validation, integration, deployment, and monitoring, reflecting the lifecycle stated in the posting. Discuss how you would detect deteriorating output quality and investigate whether data changes or model behavior caused it.

When would you fine-tune an LLM instead of using an existing model?

What to coverSuggested preparation: Treat fine-tuning as an optional approach, since the posting lists it as nice to have. Compare expected quality gains with data, evaluation, and maintenance costs for a document-understanding task.

How would you integrate an AI capability into Confido’s platform?

What to coverSuggested preparation: Describe how you would agree on the user-facing task and success measures with product and engineering before choosing a model. Address the boundary between model output, application behavior, and handling uncertain results.

Behavioural practice

Tell me about a time you partnered with product and engineering to deliver an ML capability.

What to coverSuggested preparation: Use a situation/action/result example that shows how you clarified the practical need, resolved differing priorities, and contributed to integration. State the observed outcome rather than assuming the model’s technical performance translated into product value.

Tell me about a time you owned an ML system from prototype through production monitoring.

What to coverSuggested preparation: Describe the situation, the decisions and actions you personally owned at each stage, and the result. Include what you learned from production behavior that was not apparent in the prototype.

Tell me about a time you had to make an ML decision with incomplete information in a fast-moving environment.

What to coverSuggested preparation: Give a situation/action/result account of how you scoped the decision, tested assumptions, and managed the risk of moving quickly. This is a suggested practice topic based on the posting’s nice-to-have preference for comfort in fast-moving environments.

Tell me about a time an ML output failed or proved unreliable in real use.

What to coverSuggested preparation: Explain the situation, how you investigated and communicated the problem, the corrective action you took, and the result. Keep the example focused on accountable troubleshooting rather than claiming every failure was preventable.

02

Sharpen your knowledge

Topics to prepare

  • LLM and NLP document understanding

    Review how to extract structured fields from invoices, deductions, and retailer reports, including how to handle ambiguous or missing values. Exercise: sketch a field schema and define checks for extraction errors. Confido explicitly calls for financial-document extraction and experience with LLMs or NLP.

  • Production ML lifecycle

    Review the decisions involved in moving from research and prototypes to deployment and monitoring. Exercise: outline what you would test before releasing a document-extraction model and what failures you would monitor afterward. The posting assigns ownership across this lifecycle and requires production ML experience.

  • Retrieval and agentic reasoning

    Review how a workflow can retrieve information from fragmented or legacy systems, reason over conflicting results, and surface uncertainty. Exercise: diagram a retrieval-to-answer flow with failure cases. This is listed as a responsibility; prior agentic-workflow or retrieval-system experience is nice to have.

  • Forecasting and anomaly detection

    Review time-aware evaluation for sales and financial forecasts and ways to distinguish unusual retailer data from expected variation. Exercise: propose a validation plan for a brand-sales forecast and an anomaly alert. Both are explicit example problems.

  • Promotion recommendation objectives

    Review how a recommendation objective, constraints, and evaluation measure affect retailer-promotion decisions. Exercise: state what a promotion model would optimize and how you would check whether its recommendations help. Promotion optimization is an explicit responsibility; the specific objective is a preparation choice, not a stated requirement.

  • Product-minded ML tradeoffs

    Review how to weigh model quality against integration effort and operational reliability. Exercise: compare two approaches to automating invoice ingestion and explain which outcome matters to a product partner. The posting requires a strong product mindset and collaboration with engineering and product.

Skills to revise

  • Implement a document-extraction prototype

    Practice turning sample invoice or deduction text into validated structured records, then inspect incorrect and missing fields. This mirrors the posting’s financial-document ingestion work; no particular tool is specified.

  • Design a deployable ML service

    Practice drawing the inputs, prediction path, integration boundary, monitoring signals, and fallback for one Confido example problem. This prepares for the stated production-ML responsibility and the listed ML systems design interview session.

  • Build a small retrieval workflow

    As a suggested exercise, combine a few fragmented sample records, retrieve evidence for a question, and make the output traceable to those records. This reflects the agent-workflow responsibility, without treating any particular architecture as required.

  • Evaluate forecasts and anomaly flags

    Practice making time-ordered train/test splits on sample sales data, comparing forecasts with a simple baseline, and reviewing false anomaly alerts. These exercises map to the stated forecasting and retailer-data anomaly tasks.

  • Prototype promotion ranking

    As a suggested exercise, rank sample retailer promotions against an explicitly chosen objective and explain the tradeoffs to a product partner. Confido calls for promotion recommendation systems and practical applications, but does not prescribe a modeling method.

04

Your preparation checklist

  • Prepare a production ML project walkthrough

    Choose a real project you can discuss. Prepare a 90-minute walkthrough covering your decisions, LLM or NLP work if applicable, deployment, monitoring, results, and collaboration with engineering and product. The posting lists a 90-minute on-site project session.

  • Sketch a financial-document extraction system

    For a practice design exercise, outline how you would turn invoices, deductions, or retailer reports into structured data. Include evaluation, handling of uncertain fields, and how outputs would reach the platform; these are preparation choices, not a stated interview assignment.

  • Design a retrieval workflow for fragmented systems

    Draw a possible agentic workflow for retrieving information from legacy systems and reasoning over it. Be ready to explain how you would check retrieved evidence and handle missing or conflicting records.

  • Work through a CPG modeling example

    Prepare a small example for forecasting brand sales or financial performance, detecting retailer-data anomalies, or optimizing promotions. State the target, baseline, evaluation approach, and how a brand would use the result.

  • Document lifecycle and product tradeoffs

    Make a one-page account of how you have moved an AI/ML capability from prototype to production and monitoring, where your experience supports it. Identify decisions made with product and engineering and what you would improve.

  • Rehearse the advertised interview formats

    Practice a timed coding problem and a 60-minute ML systems design discussion. The posting also lists a 20-minute recruiting call, a 60-minute technical screen, and an on-site session with coding, project, and systems design; it does not specify their exact questions.

  • Bring focused questions for Confido

    Write questions about document-extraction quality, access to fragmented enterprise data, forecasting and promotion objectives, and how engineering and product evaluate deployed models. Prioritize what you need clarified rather than assuming current processes.

AI-generated from the job information · Prepared Sep 30, 2026 (UTC)Useful preparation, not a guarantee of eligibility or an offer.

Availability last checked: Nov 4, 2026. Status can change after a check; confirm on the employer’s website. Report an issue · Our checking policy

KEEP EXPLORING

Similar AI jobs

Related skills and specializations in United States. Matched to this role, not your profile.

Explore more jobs
Finding similar opportunities…