About this role
Architect end-to-end data and AI solutions including medallion Lakehouse on ADLS Gen2, streaming ingestion, and ML deployment pipelines; own architectural decisions and productionize ML/DL models via Azure ML and AKS while enforcing security and building CI/CD and MLOps pipelines.
Skills for this role
PythonPySparkSQLDatabricksDelta LakeSpark Structured StreamingADLS Gen2Azure Data Factory (ADF)SynapseAzure Machine LearningAKSEvent HubsKey VaultPostgreSQLSnowflakescikit-learnTensorFlowPyTorchMLflowPII handlingGDPRAzure DevOpsGitHub ActionsTerraformBicepDockerKubernetesFastAPIMedallion LakehousePartitioning (PySpark workloads)