About this role
Design and build scalable data pipelines and analytics data products in Databricks to process conversational data, AI agent logs, and telemetry for AI performance monitoring, customer journey analytics, and business impact measurement.
Skills for this role
PySparkDatabricksDataFramesStructured StreamingDelta LakeSQLQuery optimizationAWSAmazon RedshiftAmazon S3AWS GlueAmazon AthenaJSONSemi-structured data processingData modelingDimensional modelingData pipeline developmentData quality validationSchema enforcementMetadata documentationData lineage trackingPowerBIReal-time streamingEvent-driven architecturesConversational data processingAI/ML telemetryPerformance monitoring and analyticsContact center analytics