New opportunity

AI Data Engineer

Wesfarmers · Melbourne, Australia

About this role

Designs and builds the data components and pipelines that AI and GenAI solutions depend on, using platforms such as Snowflake and Microsoft Fabric, and works with AI Engineers on RAG, embeddings, vector search, metadata and semantic structures. Ensures secure, governed and operational data access through testing, monitoring, orchestration and integration with applications and APIs.

Skills for this role

SnowflakeMicrosoft FabricData engineeringData pipelinesTransformationsData integrationAPIsRetrieval pipelinesRAGEmbeddingsVector searchVector databasesSemantic modelsOntologiesKnowledge graphsData modelsSemantic structuresData modellingData qualityData lineageData provenanceData governancePrivacySecurityIdentity and permissionsRelational dataSemi-structured dataUnstructured dataSparkdbt''dbt or similar transformation frameworks'