About this role
Architect AI data foundations including ingestion, transformation, enrichment, and serving layers, and design data architectures supporting RAG, embeddings, feature stores, and training data pipelines. Define standards for data quality, lineage, versioning and governance, integrate data platforms with AI services, and enable observability and automated validation for AI workloads.
Skills for this role
Data ArchitectureData EngineeringData QualityData GovernanceRetrieval-Augmented Generation (RAG)EmbeddingsFeature storesTraining data pipelinesLLM and foundation model platformsAWS BedrockAzure OpenAIVertex AILangChainLangGraphCrewAIAutoGenGoogle ADKCI/CDMLOpsGitHub ActionsAzure DevOpsJenkinsSparkKafkaETLELTGreat ExpectationsAmazon DeequFeastEmbedding generation pipelines