New opportunity

AI Principal Engineer

NAC Voya Services Company · CT-Windsor, One Orange Way; Minneapolis, MN; NY-New York, 200 Park Ave 15th Floor; GA-Atlanta, Powers Ferry Road; MO-Work@Home, Missouri

About this role

The AI Principal Engineer (IC Director) leads the design, development and delivery of production-grade AI solutions for Voya. This fully remote role has no regular in-office requirement. The engineer owns major platform components and technical direction across multiple initiatives, partnering with product, engineering, data and governance teams to deliver scalable, reliable and secure solutions in a highly regulated environment.

Responsibilities

  • Design and deploy AI solutions, including LLM-based applications, retrieval-augmented generation (RAG) pipelines and model-driven services. Translate business requirements into technical solutions and guide decisions on model selection, integrations, API design and scalability.
  • Set engineering practices for model evaluation, validation, testing, monitoring and operation. Maintain reliability, performance and maintainability while identifying technical risks and mitigation strategies.
  • Ensure compliance with enterprise security, privacy, governance and responsible AI standards. Mentor engineers and improve development and deployment practices across teams.

Required qualifications

  • Bachelor’s degree in Computer Science, Engineering, Mathematics or a related field; significant experience delivering production AI/ML systems and deploying, operating and maintaining models in production. No specific number of years is stated.
  • Strong proficiency in programming languages such as Python, TypeScript or Rust; experience with AI/ML frameworks, LLM technologies and modern data pipelines; and deep understanding of model lifecycle management, MLOps and production reliability.
  • Success leading complex technical initiatives, with strong analytical, problem-solving, systems-thinking and cross-functional collaboration skills.

Preferred qualifications

  • Advanced degree in a related field; experience with enterprise-scale generative AI, RAG, vector databases, AI orchestration frameworks, cloud-native AI platforms and distributed systems.
  • Experience in regulated or governance-focused environments; knowledge of responsible AI frameworks, model risk management and AI compliance; and experience mentoring engineers and influencing multi-team technical strategy.

Compensation and benefits: The listed annual base salary range is $149,820–$198,370 USD, with potential role-based incentives. Benefits include health, dental, vision and life insurance; a 401(k) with up to 6% company matching; a 4% employer-paid retirement plan; tuition reimbursement up to $5,250 annually; 20 days of paid time off, nine company holidays, a flexible Diversity Celebration Day and 40 hours of paid volunteer time annually.

For full details about this role, click “Apply on company site” to view the employer’s original posting.

Skills for this role

PythonTypeScriptRustArtificial IntelligenceMachine LearningGenerative AILarge Language ModelsRetrieval-Augmented GenerationVector DatabasesAI OrchestrationData PipelinesMLOpsModel Lifecycle ManagementModel EvaluationModel ValidationModel MonitoringAPI DesignCloud-Native AI PlatformsDistributed SystemsResponsible AIModel Risk ManagementAI GovernanceTechnical LeadershipMentoringSystems Thinking

Your skill match

Checking your profile…

YOUR NEXT STEP

Get interview-ready for this role

A focused preparation guide, built around this job’s responsibilities and requirements.

✦ AI-generated guide
Preparation suggestions, not the employer’s actual interview questions. Always check the original posting for current requirements.
01

Understand the role

What matters most

  • Deliver production-grade AI solutions

    Lead the design, development and deployment of LLM applications, RAG pipelines and model-driven services that produce business outcomes.

  • Own architecture and platform direction

    Set technical direction for major components or domains, including decisions on model selection, integrations, API design and scalability.

  • Make AI reliable in production

    Establish practices for evaluation, validation, testing, monitoring and operation while maintaining performance and maintainability.

  • Build in governance and security

    Ensure solutions meet enterprise security, privacy, governance and responsible AI standards in a highly regulated environment.

  • Lead across teams and initiatives

    Translate requirements with product, business and data stakeholders; manage technical risks and dependencies; mentor engineers and improve engineering practices.

Likely challenges to think through

  • Balancing AI quality with production constraints

    A likely challenge is choosing an LLM or RAG design that performs well without sacrificing scalability, reliability or maintainability. Prepare to explain how you would compare design options, evaluate outputs and monitor a deployed service.

  • Moving quickly within governance boundaries

    Delivery may require trade-offs between iteration speed and security, privacy and responsible AI standards. Prepare an example approach for identifying risks early and working with governance stakeholders on mitigations; the posting does not specify an approval process.

  • Keeping multiple initiatives technically coherent

    Owning major components while influencing several teams may make local delivery goals compete with shared platform standards. Prepare to discuss how you would resolve dependencies, communicate architectural decisions and mentor teams without assuming direct management authority.

03

Practice your answers

Technical practice

How would you turn a business need into a production-grade AI solution?

What to coverSuggested answer focus: Explain how you would clarify the intended outcome with product, business and data stakeholders, then decide whether an LLM application, RAG pipeline or model-driven service fits. Address scalability, reliability and security trade-offs before committing to an architecture.

How would you select a model for an enterprise AI application?

What to coverSuggested answer focus: Compare candidate models against task quality, performance, operating constraints and maintainability. Explain how evaluation results and enterprise governance requirements would inform the decision.

How would you design and troubleshoot a RAG pipeline?

What to coverSuggested answer focus: Describe the flow from data preparation and retrieval through generation, including where a vector database or orchestration framework might fit. Explain how you would distinguish retrieval failures from generation failures and evaluate the resulting answers.

What evaluation and validation practices would you establish before releasing an AI service?

What to coverSuggested answer focus: Separate model-quality evaluation from application and integration testing, and define measures tied to the business use case. Discuss how you would document limitations and decide whether observed results justify deployment.

How would you manage the lifecycle of a model operating in production?

What to coverSuggested answer focus: Walk through deployment, monitoring, updates and retirement, including how changes to models or data pipelines would be tested. Explain how you would preserve reliability while making changes.

How would you investigate a production AI service whose quality or performance has declined?

What to coverSuggested answer focus: Describe the signals you would monitor and how you would narrow the cause across data, model and service components. Discuss mitigation and recovery trade-offs, including when reverting a change would be appropriate.

How would you account for security, privacy and responsible AI in an AI design?

What to coverSuggested answer focus: Identify risks across data access, model behavior and system integrations, then explain how you would assess and mitigate them with governance stakeholders. Distinguish design-time checks from controls needed during operation in a regulated environment.

How would you design an API and integrations for a reusable AI platform component?

What to coverSuggested answer focus: Discuss interface boundaries, failure handling and how consuming systems would use the component reliably. Explain trade-offs between reuse across initiatives and the needs of a particular application.

How would you scale an enterprise generative AI service without sacrificing maintainability?

What to coverSuggested answer focus: Consider performance, reliability and component boundaries in a cloud-native or distributed architecture. Explain which constraints you would measure first and how the results would guide scaling decisions.

How would you set engineering practices for teams building AI services?

What to coverSuggested answer focus: Propose practices for testing, code quality, deployment and monitoring that teams could apply consistently. Explain how you would adapt those practices to a platform component versus an individual application without prescribing an unsupported tool.

Behavioural practice

When have you aligned technical and non-technical stakeholders on an AI solution?

What to coverSuggested preparation: Use a real situation in which requirements or priorities differed, describe the actions you took to reach a technical decision, and state the result. Make clear how product, business, data or governance perspectives affected the outcome.

When have you led technical direction across several initiatives?

What to coverSuggested preparation: Describe the situation, your actions in managing dependencies or competing priorities, and the result. Focus on decisions you owned and how you maintained delivery quality across teams.

When have you identified and mitigated a significant technical or governance risk?

What to coverSuggested preparation: Give a real situation, the evidence that exposed the risk, the actions you took with relevant stakeholders, and the result. Explain the trade-off between delivery and the applicable reliability, security or governance concern.

When have you mentored an engineer while improving engineering quality?

What to coverSuggested preparation: Set out the situation, the guidance or feedback you provided, and the observable result. Distinguish the engineer's growth from any wider improvement in team practices.

When have you influenced a change in development or deployment practices without direct authority?

What to coverSuggested preparation: Describe the situation, how you built support and addressed objections, and the result. Connect the example to evaluation, testing, monitoring or operational reliability where your experience supports it.

02

Sharpen your knowledge

Topics to prepare

  • Production AI architecture and model selection

    Revision exercise: compare two hypothetical designs for an LLM application, covering model choice, integrations, API boundaries and scalability trade-offs. The role explicitly owns technical direction and contributes to these architectural decisions.

  • Model lifecycle and production reliability

    Revision exercise: map a model from validation through deployment, monitoring, maintenance and rollback; identify failure signals and mitigations at each stage. The posting requires deep understanding of MLOps and production reliability.

  • Evaluation and validation strategy

    Revision exercise: define test cases, quality measures and release criteria for a hypothetical model-driven service, including how results would be monitored after launch. Establishing evaluation, validation and testing practices is an explicit responsibility.

  • Security, privacy and responsible AI

    Revision exercise: review a hypothetical AI architecture for data-exposure, governance and model-risk concerns, then explain proposed controls and unresolved trade-offs. The role must meet enterprise security, privacy, governance and responsible AI standards; model risk management is preferred knowledge.

  • RAG and enterprise-scale trade-offs

    Revision exercise: diagram retrieval, generation and data-pipeline stages, then explain where retrieval quality, latency and access controls could fail. The role explicitly includes RAG pipelines; vector databases, orchestration frameworks and distributed architectures appear as preferred experience.

  • Multi-team technical leadership

    Revision exercise: outline how to resolve a hypothetical disagreement between product, engineering, data and governance stakeholders, documenting the decision, risks and mentoring approach. The posting calls for cross-functional leadership across multiple initiatives and guidance of engineers.

Skills to revise

  • Prototype an AI service in a listed language

    Suggested exercise: use Python, TypeScript or Rust to build a small model-driven API with input checks, error handling and tests; explain its integration boundaries. Strong proficiency in languages such as these, API design and production AI delivery are stated in the posting.

  • Build and inspect a small RAG pipeline

    Suggested exercise: connect sample documents to retrieval and an LLM response, then test missing, irrelevant and restricted-source results. This practices the advertised RAG delivery work without assuming a particular vendor or framework.

  • Create an operational evaluation plan

    Suggested exercise: write a compact test set and a monitoring checklist for a hypothetical deployed model, specifying what would trigger investigation or rollback. The role establishes model testing and monitoring practices and maintains models in production.

  • Present an architecture decision

    Suggested exercise: prepare a one-page decision record comparing two AI solution approaches, with scalability, reliability, security, dependencies and mitigation plans; rehearse explaining it to technical and non-technical stakeholders. These are explicit principal-engineer responsibilities.

04

Your preparation checklist

  • Map evidence to the stated qualifications

    Create a one-page evidence sheet for the required degree, production AI/ML delivery and operations, a language such as Python, TypeScript or Rust, LLM frameworks, data pipelines and MLOps. Note gaps without inventing experience.

  • Prepare a production AI project walkthrough

    The role calls for production-grade AI with business impact. If you have a relevant example, outline the business requirement, your technical ownership, architecture, deployment, operating decisions and measured outcome.

  • Practice a scalable AI design exercise

    Sketch a hypothetical LLM application or RAG service, explaining model selection, retrieval and data flow, integrations, API design and scaling trade-offs. RAG and vector databases appear in the posting, with vector databases listed as preferred experience.

  • Draft an evaluation and operations plan

    Prepare a sample plan covering model evaluation, validation, testing, monitoring, lifecycle changes and production reliability. Include how you would identify a failure, mitigate it and maintain the service.

  • Work through governance and security trade-offs

    For the hypothetical design, identify privacy, security, governance and responsible-AI risks and propose controls and mitigations. Treat these as discussion proposals, not claims about Voya’s internal standards.

  • Document technical leadership examples

    If available, prepare examples showing how you led a complex initiative, resolved dependencies, worked with product, engineering, data and governance stakeholders, or mentored engineers. State your decisions and their outcomes.

  • Write questions for the employer

    Ask which platform components this IC Director role would own, how teams evaluate and operate AI in production, how governance partners participate in decisions, and what outcomes matter across initiatives.

AI-generated from the job information · Prepared Oct 1, 2026 (UTC)Useful preparation, not a guarantee of eligibility or an offer.

Availability last checked: Nov 4, 2026. Status can change after a check; confirm on the employer’s website. Report an issue · Our checking policy

KEEP EXPLORING

Similar AI jobs

Related skills and specializations in United States of America. Matched to this role, not your profile.

Explore more jobs
Finding similar opportunities…