About this role
NRG’s Vivint Smart Home team seeks a Staff AI Platform Engineer to build a shared product-integrity layer for customer-facing AI systems. The role focuses on evaluation, observability, safety and launch-readiness infrastructure that supports measurable quality, reliability and customer impact across smart-home products.
Responsibilities
- Build shared evaluation infrastructure for models, prompts, agents and multimodal AI systems. Own golden datasets, regression suites, offline and online evaluations, and governance for LLM-as-judge approaches.
- Develop observability for model quality, latency, cost, drift, safety and customer impact. Establish launch-readiness gates for camera, agentic, personalization, multimodal and energy features.
- Set reusable standards for AI quality, monitoring, safety and operational readiness, working with Product, Analytics, Privacy, Security and Engineering.
Required qualifications
- Bachelor’s degree in Computer Science, Software Engineering, Data Science or a related field; 8+ years of software engineering, ML engineering or AI platform experience.
- Experience evaluating, deploying or monitoring production AI systems; strong Python and data engineering skills; experience with offline or online evaluation, data quality, model monitoring or observability systems.
- Familiarity with LLM evaluation, prompt evaluation, model regression testing or safety guardrails, plus strong communication skills and the ability to set standards across teams.
Preferred qualifications include LLM-as-judge, agent tracing, multimodal evaluations, golden datasets or automated regression suites; GCP, AWS, Vertex AI, SageMaker, MLflow, Datadog, OpenTelemetry or private cloud tooling; privacy-aware AI systems, customer trust metrics or launch-readiness processes; and experience supporting computer vision, generative AI, recommendation or edge AI products or building internal AI tooling. The posting lists Lehi, Utah, and a virtual Washington location. Highlighted perks include paid holidays and flexible paid time away, health coverage, a 401(k) with employer match, employee discounts and on-site amenities.