Rahul Gosavi

Databricks Champion

Experience

Professional Journey

Role-by-role progression across enterprise data architecture, implementation, and community impact.

45%

45% Lower Compute Cost

Led Databricks cost optimization through custom utilities, workload analysis, cluster right-sizing, and disciplined operating standards.

Scale

Performance at Scale

Applied Photon, partitioning, Delta optimization, caching, and workload tuning; embedded performance practices into reusable standards.

Secure

Secure Delivery & Operations

Standardized Azure DevOps CI/CD, governance, access control, monitoring, recovery, and production support while mentoring engineers.

Career Timeline

  1. Current Role

    Lead Azure Data Engineer

    Leading architecture and engineering for enterprise data platform initiatives at Xebia Middle East.

  2. Data Engineering and Cloud Delivery

    Delivered Azure and Databricks solutions across ETL, streaming, and analytics workloads.

  3. Streaming and Reliability Focus

    Built resilient real-time pipelines with quality, observability, and cost-aware architecture patterns.

  4. Platform Engineering Foundation

    Established strong fundamentals in data pipelines, integration, and enterprise delivery practices.

Aviation

Lead Azure Data Engineer

Xebia IT Architects Middle East • Abu Dhabi, UAE

Apr 2023 - Present
  • Leading Connected Operations Data Platform architecture and engineering delivery
  • Built event-driven and batch data pipelines with strong quality and governance controls
  • Designed integration patterns using API-led architecture and cloud-native services
  • Driving engineering practices for reliability, scalability, and cost optimization
AzureDatabricksADFPySparkKafkaEvent HubsPower BI

Enterprise Data

Data Engineer

Yash Technologies • India

Dec 2022 - Apr 2023
  • Developed Azure Data Factory and Databricks transformation pipelines
  • Implemented distributed processing logic in PySpark for production data flows
  • Integrated analytics outputs for reporting and business monitoring
ADFDatabricksPySparkSnowflakePower BI

Cloud Data

Data Engineer

Infogain • India

Mar 2021 - Nov 2022
  • Engineered cloud-native processing pipelines on Azure Databricks
  • Built integrations across Synapse, ADX, and streaming workloads
  • Improved reliability and traceability in data movement and transformation
AzureDatabricksSynapseAzure Data ExplorerStreaming

Cloud and Data Platforms

Data Engineer

Accenture • India

Nov 2018 - Mar 2021
  • Built scalable data pipelines with Azure Data Factory and PySpark
  • Implemented streaming components with Event Hubs and Stream Analytics
  • Automated integrations and operational workflows for data delivery
ADFPySparkAzure Stream AnalyticsEvent HubsLogic AppsSQL

Initiatives

Major Enterprise Initiatives

Platform-defining work delivered as part of the Connected Operations data platform.

Connected Operations Platform

Enterprise Lakehouse foundation unifying governed operational data for airline decision-making.

Enterprise Data Quality Framework

Automated, metadata-driven validation and exception controls across thousands of business rules.

Metadata-Driven Framework

Reusable onboarding, orchestration, audit, and operational patterns across diverse data sources.

Databricks Cost Optimization

Engineering utilities and workload strategies delivering approximately 45% lower compute cost.

GitHub Copilot Productivity Utilities

Automated operational tasks, cluster management, metadata handling, and deployment activities.

Enterprise Streaming Platform

Event Hubs, Structured Streaming, Auto Loader, and Lakeflow pipelines for resilient real-time data.

API Integration Framework

Secure, reusable ingestion patterns for operational airline systems and REST endpoints.

Enterprise Lakehouse Architecture

Medallion, Delta Lake, Unity Catalog, security, governance, reliability, and operational standards.

LinkedIn Highlights

Curated posts from your LinkedIn activity across recognition, community sessions, and architecture topics.

Recognition

Databricks Partner Champion and Solution Architect Champion

Community and professional recognition milestone shared on LinkedIn.

View LinkedIn Post

Community Session

Xebia XKE Streaming at Scale

Cross-posted event highlight around streaming architecture and engineering practices.

View LinkedIn Post

Technical Thought Leadership

Azure and Databricks Data Engineering Highlight

Post focused on practical Azure and Databricks data engineering themes.

View LinkedIn Post

Innovation

AI Hackathon at Etihad Airways

Innovation and applied AI milestone shared in the context of enterprise collaboration.

View LinkedIn Post