About this role
The Senior/Lead Data Engineer will design and build scalable data platforms using Databricks and PySpark, with a focus on supporting AI/ML workflows including LLMOps, RAG pipelines, and model evaluation. The role requires extensive experience in distributed data processing, enterprise CI/CD engineering, and building production-grade AI-enabled data platforms.
Skills for this role
DatabricksApache SparkPySparkPythonDelta LakeSpark SQLCI/CDGitLabREST APIsLLMOpsRAGVector DatabasesData GovernanceDistributed Data Processing