Rahul Gosavi

Databricks Champion

Blogs

Technical Blogs

Professional card-based view of articles with configurable categories and featured flags.

Data Engineering

Speed Up Your Azure Event Hub Ingestion with Python ThreadPoolExecutor

How ThreadPoolExecutor reduces I/O wait time and boosts throughput in streaming pipelines.

Apr 12, 2026 • 4 min read

AzureEvent HubsConcurrencyStructured Streaming
Read on Medium

Databricks

Why Your Cosmos DB Connector Fails in Databricks Spark Declarative Pipelines

A practical guide to alternatives for Cosmos DB ingestion in managed Databricks pipelines.

Mar 30, 2026 • 8 min read

DatabricksCosmos DBPipelinesArchitecture
Read on Medium

Streaming

Why Your Databricks Streaming Job is Leaking Driver Memory (And How to Fix It)

Root causes and production fixes for pinned RocksDB memory in Databricks Structured Streaming.

Feb 12, 2026 • 7 min read

DatabricksRocksDBStructured StreamingPerformance
Read on Medium

Streaming

Databricks: Monitoring RocksDB State Store in Structured Streaming

Capture state operator metrics for proactive monitoring and reliability at scale.

Feb 12, 2026 • 6 min read

DatabricksRocksDBObservabilityStreaming
Read on Medium

Azure

Real-Time Data Sync with Azure Cosmos DB Change Feed

A practical architecture for source-to-archive streaming synchronization.

Jan 15, 2026 • 6 min read

AzureCosmos DBChange FeedDatabricks
Read on Medium

Streaming

Mastering Stateful Streaming: A Technical Deep Dive

State operations, timers, debugging, and performance tuning for large-scale pipelines.

Nov 20, 2025 • 10 min read

Stateful StreamingDatabricksSparkArchitecture
Read on Medium

Architecture

From Chaos to Control: Our Journey to Production-Ready Stateful Streaming

A real-world journey to robust, scalable state management in streaming systems.

Nov 20, 2025 • 9 min read

ArchitectureState ManagementDatabricksStreaming
Read on Medium

AI / GenAI

My Experience: Building a Kids Memory Game with GitHub Copilot

How AI-assisted development enabled a complete interactive game build in hours.

Sep 4, 2025 • 7 min read

GitHub CopilotGenerative AIInnovationTutorials
Read on Medium

Data Quality

Preventing Data Loss in Real-time Streaming Pipelines When Databricks Clusters Restart

A production strategy for resilient Event Hub to Cosmos DB pipelines.

Jul 26, 2025 • 8 min read

Data QualityDatabricksEvent HubCosmos DB
Read on Medium

Azure

Creating a Linked Service in Azure Data Factory for Azure Cosmos DB Table API

Implementation patterns, limitations, and best practices for enterprise integration.

Jul 26, 2025 • 6 min read

AzureData FactoryCosmos DBTutorials
Read on Medium