Posts

All the articles I've posted.

• 8 MIN READ•Apr 29, 2026

  Performance and Apache Iceberg's Metadata

  Iceberg's three-layer metadata tree eliminates directory listing and enables multi-level data skipping. Here is how scan planning actually works.

  Apache Iceberg metadata performanceIceberg scan planningmanifest pruning
• 8 MIN READ•Apr 29, 2026

  How Databases Organize Data on Disk: Pages, Blocks, and File Formats

  Databases structure data on disk as heap files, sorted files, or LSM trees, then wrap it in formats like Parquet with metadata that lets engines skip irrelevant blocks.

  data file formatsParquet file formatdatabase storage internals
• 8 MIN READ•Apr 29, 2026

  The Metadata Structure of Modern Table Formats

  Iceberg uses a metadata tree, Delta Lake uses a transaction log, Hudi uses a timeline. Here is exactly how each format organizes metadata and why it matters.

  table format metadataApache Iceberg metadataDelta Lake transaction log