Mooncake: a real-time storage engine for Apache Iceberg

Mon, 11 Aug 2025 00:00:00 +0000

This technical overview assumes familiarity with Apache Iceberg, an open table format for analytical datasets. Iceberg is part of the general “Lakehouse” movement, where users:

Store large datasets using open file formats (Parquet + Metadata) in Object Storage
Query them directly by engines like Spark, Trino, Flink, and DuckDB using SQL
Get the benefits of ‘database features’ like schema evolution & time-travel
Scale practically infinitely, and aren’t locked into a vendor

Iceberg was built for slow-changing data + batch analytics & processing. That world is pretty clear and only improving with engines getting better at reading open formats.

whitepaper on Mooncake

Mooncake: a real-time storage engine for Apache Iceberg