Skip to content
Rahul Gosavi

Projects

Engineering work, explained

Case studies from enterprise data platforms on Azure and Databricks — the problem, the architecture, the decisions, and the lessons. Internal names and figures are left out unless approved.

Case studies

  • 01 / Case study

    Real-Time Airline Data Engineering

    Event-driven pipelines that move operational airline events from Event Hubs through stateful Structured Streaming into Cosmos DB — without losing data when clusters restart.

    • Azure Event Hubs
    • Databricks Structured Streaming
    • transformWithStateInPandas
    • RocksDB state store
    • Azure Cosmos DB

    Read case study

  • 02 / Case study

    Streaming Performance & Cost Optimization

    Making stateful streaming observable, fixing RocksDB-related driver memory growth, and cutting Databricks compute cost by around 45% through workload analysis and right-sizing.

    • Databricks
    • Structured Streaming
    • RocksDB
    • StreamingQueryListener
    • Delta Lake

    Read case study

  • 03 / Case study

    Enterprise Lakehouse & Data Architecture

    A governed Azure Databricks lakehouse with Bronze/Silver/Gold layers, metadata-driven onboarding, automated data quality, and CI/CD — built for many teams and many sources.

    • Azure
    • Azure Databricks
    • Delta Lake
    • Unity Catalog
    • Auto Loader

    Read case study

Platform initiatives

More of the work behind the platform

Initiatives delivered as part of the Connected Operations data platform at Xebia Middle East.

  • Connected Operations Platform

    Enterprise Lakehouse foundation unifying governed operational data for airline decision-making.

  • Enterprise Data Quality Framework

    Automated, metadata-driven validation and exception controls across thousands of business rules.

  • Metadata-Driven Framework

    Reusable onboarding, orchestration, audit, and operational patterns across diverse data sources.

  • Databricks Cost Optimization

    Engineering utilities and workload strategies delivering approximately 45% lower compute cost.

  • GitHub Copilot Productivity Utilities

    Automated operational tasks, cluster management, metadata handling, and deployment activities.

  • Enterprise Streaming Platform

    Event Hubs, Structured Streaming, Auto Loader, and Lakeflow pipelines for resilient real-time data.

  • API Integration Framework

    Secure, reusable ingestion patterns for operational airline systems and REST endpoints.

  • Enterprise Lakehouse Architecture

    Medallion, Delta Lake, Unity Catalog, security, governance, reliability, and operational standards.

Contact

Let's build, learn, and share something meaningful.

  • Speaking invitations
  • Technical collaborations
  • Community partnerships
  • Professional networking

Or email rahulgosavi.94@gmail.com