Tag:streaming
Articles tagged "streaming".
- 31 MIN READ•Aug 24, 2026
The Hidden Cost of Tiny Iceberg Commits
Trace what one tiny Iceberg commit writes, then model hourly, per-minute, and per-second cadences so streaming costs become arithmetic, not adjectives.
Apache Icebergstreamingmetadata - 31 MIN READ•Aug 19, 2026
Mastering Apache Iceberg v3 Deletion Vectors for High-Throughput Streaming Ingest
Apache Iceberg v3 deletion vectors for high-throughput streaming ingest: how bitmaps and Puffin files fix CDC write amplification and read decay.
Apache Icebergv3deletion vectors - 21 MIN READ•Aug 4, 2026
How Iceberg V3 Deletion Vectors Fixed Merge-on-Read for Streaming Tables
How Iceberg V3 deletion vectors replaced accumulating positional delete files and made merge-on-read viable for streaming and CDC tables.
Apache IcebergIceberg V3Deletion Vectors - 21 MIN READ•Aug 4, 2026
Reading the Apache Iceberg V4 Proposals Before They Land
A field guide to the Apache Iceberg V4 proposals: adaptive metadata trees, single-file commits, typed statistics, column families, and what is safe.
Apache IcebergIceberg V4Metadata - 31 MIN READ•Jul 28, 2026
Why Iceberg V4 Wants to Retire Equality Deletes, and What Streaming Teams Should Do About It
Equality deletes made streaming upserts into Iceberg practical at the cost of read performance.
Apache IcebergStreamingData Engineering - 31 MIN READ•Jul 28, 2026
Apache Fluss and Kafka Solve Different Problems in an Iceberg Pipeline
Fluss puts a columnar, indexed hot tier between Kafka and Iceberg. Here's what it changes structurally, what Kafka still does better, and how to benchmark.
Apache IcebergApache FlussKafka - 31 MIN READ•Jul 28, 2026
Serving Sub-Second Queries Over an Iceberg Lakehouse With a Hot Tier
A lakehouse cannot serve sub-second queries over seconds-old data. A hot tier in front solves it, with consequences for consistency, governance.
Apache IcebergStreamingData Serving - 30 MIN READ•Jul 25, 2026
Freshness Is a Contract, Not a Note on a Dashboard
Data freshness needs to become an engineering contract with a measurable value, an owner, and consequences.
data freshnessdata qualityapache iceberg - 30 MIN READ•Jul 6, 2026
The State of Streaming to Apache Iceberg in July 2026: Every Path, Its Latency, and What to Do When Seconds Are Not Fast Enough
Every path for streaming data into Iceberg in 2026, Flink, Spark, Kafka Connect, broker-native, managed pipelines, with honest latency numbers.
Apache Icebergstreamingdata engineering - 5 MIN READ•Feb 18, 2026
Batch vs. Streaming: Choose the Right Processing Model
"We need real-time data. " This is one of the most expensive sentences in data engineering - because it''s rarely true, and implementing it when it''s not.
data engineeringbest practicesbatch processing - 3 MIN READ•Jul 29, 2025
Optimizing Compaction for Streaming Workloads in Apache Iceberg
Learn how to design fast, incremental compaction strategies in Apache Iceberg to support high-throughput streaming pipelines without disrupting freshness.
Apache IcebergData OptimizationStreaming - 6 MIN READ•Oct 16, 2024
Data Lakehouse Roundup 1 - News and Insights on the Lakehouse
What's Going on in the Data Lakehouse Space
data lakehousedata engineeringstreaming