New opportunity

Sr. Manager, AI Engineering

Blue Cross Blue Shield of Massachusetts · Boston, United States of America

About this role

Blue Cross Blue Shield of Massachusetts seeks a Sr. Manager, AI Engineering to lead the technical strategy and execution of agentic AI systems for its healthcare business. The role sets the architecture, frameworks and engineering practices for scalable, secure and reliable AI solutions while leading an AI development team.

Responsibilities

  • Establish the team’s technical vision and align it with business objectives. Design resilient agentic architectures that use advanced AI capabilities and external integrations.
  • Set coding standards, development guidelines and engineering best practices. Provide hands-on technical guidance and mentorship, and manage engineering teams in a matrix delivery organization using Agile methods.
  • Research and evaluate emerging agentic technologies, AI/ML models and tools. Own the security, performance and reliability of agentic solutions and implement governance practices.

Required qualifications

  • Bachelor’s degree in Computer Science, Engineering or a related technical field; 8–10 years of progressive leadership experience spanning functional and people management; and 5+ years managing technical teams in a matrix delivery organization using Agile methodologies.
  • Experience defining technical strategy, aligning teams with business goals, designing scalable agentic architectures and establishing development practices. Understanding of model training, Retrieval-Augmented Generation (RAG) and major AI platforms, including AWS, Azure and Google Cloud.
  • Deep expertise in governance, information security, solution architecture and systems integration, plus hands-on programming skills in Python, R or Java for building and implementing AI models.

Preferred qualifications

Experience developing and deploying agentic AI solutions on AWS, Azure or GCP; practitioner- or professional-level cloud certifications, such as AWS Certified Solutions Architect or Google Professional Cloud Architect.

The full-time role is based in Boston and is eligible for the Flex Persona for candidates local to the Boston office; the company describes flex roles as on-site two days per week. The posted salary range is $173,430.00–$211,970.00, with variable pay eligibility. Eligible employees receive paid time off, medical, dental and vision insurance, a 401(k) and well-being benefits.

For full details about this role, click “Apply on company site” to view the employer’s original posting.

Skills for this role

Agentic AIAI architectureSolution architectureSystems integrationRetrieval-Augmented Generation (RAG)Model trainingMachine learningPythonRJavaAWSAzureGoogle CloudInformation securityAI governanceAgile methodologiesTechnical leadershipPeople managementTechnical strategyCloud computing

Your skill match

Checking your profile…

YOUR NEXT STEP

Get interview-ready for this role

A focused preparation guide, built around this job’s responsibilities and requirements.

✦ AI-generated guide
Preparation suggestions, not the employer’s actual interview questions. Always check the original posting for current requirements.
01

Understand the role

What matters most

  • Align AI engineering with business goals

    The posting assigns this manager the technical vision for the AI engineering team and its alignment with broader business objectives. Prepare to explain how you would turn a business objective into architecture and delivery priorities.

  • Architect scalable agentic systems

    The role calls for robust, resilient agentic architectures with advanced AI capabilities and external integrations. Required knowledge includes model training, RAG and major AI platforms; cloud deployment experience is preferred. Prepare to explain architectural choices and their trade-offs.

  • Own system integrity and governance

    The manager owns security, performance and reliability of agentic solutions and implements governance practices. The posting also requires deep information-security and solution-architecture expertise. Prepare to describe how you would evaluate these concerns before and after deployment.

  • Set engineering standards while mentoring

    The role establishes coding standards and development practices, provides hands-on technical guidance, and mentors the AI development team. Prepare an example of improving engineering consistency without removing room for technical judgment.

  • Lead delivery and evaluate new technology

    The posting calls for managing technical teams in a matrix organization using Agile methods, while leading evaluation of emerging agentic technologies, models and tools. Prepare to show how you would make adoption decisions and keep delivery predictable.

Likely challenges to think through

  • Agent autonomy versus control

    Possible challenge, not a confirmed employer problem: more capable agents may be harder to govern and secure. Prepare to discuss where you would set boundaries on agent actions, how you would assess risk, and what evidence would justify greater autonomy.

  • Integration breadth versus reliability

    Possible challenge: external integrations and scalable agentic architectures can increase failure points and make performance harder to assess. Prepare to walk through resilience trade-offs, including how you would test and monitor an integrated system.

  • Experimentation versus predictable delivery

    Possible challenge: evaluating fast-changing models and tools may compete with Agile commitments across a matrix organization. Prepare to explain how you would compare new options, coordinate decisions across teams, and decide when an experiment is ready for engineering investment.

03

Practice your answers

Technical practice

How would you design a scalable, resilient agentic AI architecture?

What to coverThe role calls for scalable, robust agentic systems. Preparation suggestion: explain component boundaries, failure handling and the trade-offs between agent autonomy, control and operational complexity.

How would you integrate an agentic system with external services?

What to coverThe posting explicitly mentions external integrations and systems integration expertise. Preparation suggestion: discuss interface design, access controls, error handling and how you would contain the effects of an unavailable dependency.

When would you use Retrieval-Augmented Generation (RAG) in an agentic solution?

What to coverThe posting requires an understanding of RAG. Preparation suggestion: explain retrieval quality, grounding, evaluation and when another approach might better fit the task.

How would you decide whether model training is needed?

What to coverThe posting names model training as a core AI/ML concept. Preparation suggestion: compare training or adapting a model with using an existing model and RAG, addressing data needs, evaluation and maintenance costs.

How would you protect an agentic solution that accesses external systems?

What to coverThe role owns security and calls for information security expertise. Preparation suggestion: describe how you would limit access, validate actions and handle sensitive information without assuming a particular company system.

What governance practices would you establish for an AI agent ecosystem?

What to coverThe role explicitly calls for governance across agentic solutions. Preparation suggestion: explain decision ownership, review criteria and how changes to models, tools or agent behavior would be assessed and documented.

How would you diagnose poor performance or reliability in an agentic system?

What to coverThe posting assigns ownership of performance and reliability. Preparation suggestion: distinguish latency, dependency failures and inconsistent model behavior, then explain what evidence would guide improvements.

How would you evaluate AWS, Azure or Google Cloud for deploying an agentic solution?

What to coverThe posting names all three platforms and lists cloud deployment experience as preferred. Preparation suggestion: compare relevant capabilities, security, integration needs, operational burden and cost without assuming the company has chosen a platform.

How would you set and enforce coding standards for an AI development team?

What to coverThe role establishes development practices and requires hands-on skills in a language such as Python, R or Java. Preparation suggestion: describe review, testing and maintainability expectations, and how you would demonstrate them in code.

How would you evaluate an emerging agentic tool or AI/ML model?

What to coverThe role leads research and evaluation of new technologies and models. Preparation suggestion: define a representative use case and compare candidates on quality, security, reliability and integration effort before recommending adoption.

Behavioural practice

Tell me about a time you aligned a technical vision with business goals.

What to coverThe role calls for setting and championing the AI team's technical vision. Preparation suggestion: use a real situation, your actions to reconcile engineering and business priorities, and the resulting decision or outcome.

Tell me about a time you mentored an engineer through a difficult technical decision.

What to coverThe posting emphasizes hands-on guidance and mentorship. Preparation suggestion: describe the situation, how you supported the engineer without simply taking over, and the result for their work or development.

Tell me about a time you led delivery across a matrix organization.

What to coverThe role manages technical teams in a matrix delivery organization using Agile methods. Preparation suggestion: explain the situation, how you coordinated priorities and ownership, and what happened to delivery predictability.

Tell me about a time you improved engineering standards across a team.

What to coverThe posting assigns responsibility for establishing and refining coding standards and development guidelines. Preparation suggestion: give a real situation, the actions you took to gain adoption, and an observable result.

Tell me about a time you balanced innovation with system integrity.

What to coverThe role combines evaluation of new AI technologies with ownership of security, performance and reliability. Preparation suggestion: describe the situation, your evaluation and trade-off decisions, and the outcome without claiming a particular Blue Cross Blue Shield of Massachusetts project.

02

Sharpen your knowledge

Topics to prepare

  • Technical strategy and business alignment

    The role requires defining a technical vision aligned with business objectives. For revision, sketch a hypothetical AI engineering strategy and explain how you would prioritize architecture, delivery and measurable business goals; this is a preparation exercise, not a stated company plan.

  • Scalable agentic architecture and integration

    The posting calls for scalable, robust, resilient agentic systems with external integrations. For revision, draw a hypothetical architecture and explain component boundaries, integration points and how it would handle failures.

  • Governance, security and system integrity

    Deep governance and information-security expertise is required, and the manager owns security, performance and reliability. For revision, walk through a hypothetical design review, identifying risks, controls and ways to evaluate system behavior.

  • Model training, RAG and cloud platforms

    The required qualifications name model training, Retrieval-Augmented Generation (RAG), and AWS, Azure and Google Cloud. For revision, compare when a hypothetical solution would use RAG versus model training, then explain relevant platform considerations without assuming a company-standard platform.

  • Matrix leadership and Agile delivery

    The posting requires experience managing technical teams in a matrix delivery organization using Agile methods. For revision, outline how you would resolve a hypothetical cross-team priority conflict while maintaining predictable delivery and mentoring engineers.

Skills to revise

  • Architecture walkthrough

    Practice presenting and critiquing a hypothetical agentic-system diagram, including external integrations, scalability and failure recovery. This prepares for the role’s explicit architecture responsibilities; the example design is only a practice scenario.

  • AI-model programming

    Using one language named in the posting—Python, R or Java—practice building a small illustrative AI-model implementation and explaining its design choices. Hands-on programming for building and implementing AI models is explicitly required.

  • Engineering standards review

    Draft a short, hypothetical code-review checklist and development guideline, then explain how you would refine them with a team. The role explicitly sets and enforces coding standards and engineering best practices.

  • Technology evaluation

    Practice writing a brief comparison of two hypothetical agentic approaches against security, performance, reliability and integration criteria. The posting assigns the manager research and evaluation of emerging agentic technologies and AI/ML models; no particular tool is specified.

04

Your preparation checklist

  • Map your evidence to the role

    Prepare a one-page reference to examples of technical strategy, people and functional leadership, matrix-team Agile delivery, agentic architecture, security, integration, and hands-on AI programming. Note the required degree and experience periods; distinguish any preferred cloud deployment experience or certifications.

  • Rehearse a strategy-to-delivery story

    Prepare a project walkthrough showing how you aligned an AI engineering vision with business goals, made architecture decisions, set engineering standards, and measured the result. Keep your own decisions distinct from the team’s work.

  • Sketch an agentic system design

    As a practice exercise, draw a scalable agentic architecture with external integrations. Explain component boundaries, failure handling, performance and reliability tradeoffs; treat it as a hypothetical design, not a known company project.

  • Prepare a security and governance review

    Add a short risk register to the design covering information security, access to integrated systems, testing, monitoring, and governance decisions. Explain how you would verify controls rather than assume a particular internal policy.

  • Show technical depth and evaluation judgment

    Prepare a concise example of hands-on work in Python, R, or Java, plus an explanation of model training and RAG tradeoffs. Outline how you would evaluate an emerging agentic tool or model and compare relevant AWS, Azure, or Google Cloud options.

  • Rehearse matrix-team leadership examples

    Prepare two specific stories: one about mentoring engineers or improving development practices, and one about delivering through an Agile matrix organization. Identify stakeholders, decisions, conflicts, and outcomes.

  • Draft questions for the employer

    Ask which business objectives the AI team prioritizes, how architecture and governance decisions are owned, what external integrations matter most, and how success is measured for this senior manager role.

AI-generated from the job information · Prepared Sep 30, 2026 (UTC)Useful preparation, not a guarantee of eligibility or an offer.

Availability last checked: Nov 4, 2026. Status can change after a check; confirm on the employer’s website. Report an issue · Our checking policy

KEEP EXPLORING

Similar AI jobs

Related skills and specializations in United States of America. Matched to this role, not your profile.

Explore more jobs
Finding similar opportunities…