EY - GDS Consulting - AI And DATA - Databricks Architect - Senior Manager

The Senior Data & AI Architect will lead the design and delivery of scalable Data & AI solutions on the Databricks Lakehouse platform. This role requires deep technical expertise in data engineering and architecture, combined with hands-on experience in building Agentic AI and RAG solutions. The successful candidate will bridge the gap between complex technical architecture and strategic client engagement.

Key Responsibilities:

• Architect and deliver end-to-end Data & AI solutions including ingestion, transformation, storage, and governance.
• Design large-scale distributed data processing pipelines using Hadoop, Spark, and PySpark.
• Build Agentic AI solutions involving LLM integration, tool calling, and agent workflows.
• Implement RAG solutions including document chunking, embeddings, vector search, and evaluation.
• Define cloud data architecture on AWS/Azure with native Databricks integration.
• Lead technical proposals, RFP/RFI responses, and client workshops.
• Mentor engineering teams and enforce CI/CD and Git-based engineering best practices.

Requirements

• 13+ years of experience in Data Engineering and Data Architecture.
• Strong hands-on proficiency in Databricks, Hadoop, Spark/PySpark, and cloud platforms (AWS/Azure).
• Expertise in dimensional modeling and production-grade Python frameworks.
• Strong client-facing communication skills and experience in consulting or systems integration roles.

Preferred Qualifications

• Relevant certifications such as Databricks Certified Data Engineer/Solutions Architect or AWS/Azure certifications.
• Exposure to enterprise data governance, MLOps, or LLMOps practices.