New opportunity

Data & AI Engineer

The Carlyle Group · Washington, D.C.; New York, NY, United States

About this role

Senior individual-contributor engineer responsible for building and operating AI-ready data pipelines, retrieval systems, semantic layers, and reusable data products that power LLMs, agents, and generative AI applications; will implement RAG, embedding/indexing pipelines, vector stores, and productionize agent-grounding use cases across the firm.

Skills for this role

Retrieval-Augmented Generation (RAG)Embedding workflowsVector storesVector databasesDatabricks Vector SearchpgvectorPineconeHybrid searchRe-rankingGrounding logicLLMsAgentsCopilotsTool integrationsFeature storesEvaluation datasetsSemantic modelsSemantic engineeringContext engineeringNatural-language analyticsConversational reportingELTStreamingdbtFivetranSnowflakeSnowflake CortexPythonSQLSpark (distributed processing frameworks)