musings on Mooncake

No, Iceberg won’t fix your data stack.

Mon, 21 Jul 2025 00:00:00 +0000

Life is expectations vs reality. Here is one for Apache Iceberg – a favorite amongst the data community.

Expectations: Iceberg is the solution to all my data pains

See, the core of Iceberg is pretty neat:

Keep all data in object storage in open file formats like Parquet.
Fool any execution engine (DuckDB, ClickHouse, Spark, Snowflake, etc.) into thinking these files are a table and query them with SQL directly.
[Ongoing progress] Get exceptional performance on these tables, without having to load data into a system-specific format.

And with clever design you get:

HTAP is Dead

Mon, 05 May 2025 00:00:00 +0000

This blog is inspired by Jordan Tigani’s blog titled “Big Data is Dead”. Jordan and I actually spent some time building an HTAP database at SingleStore.

The good old days (’80s)

Back in the ’80s, one relational database did everything. Transactions (OLTP) during the day and reports after hours (OLAP). Databases like Oracle V2 and IBM DB2 ran OLTP and OLAP on the same system; largely because data sets still fit on a few disks and compute was costly.

What does Analytics in Postgres really mean?

Sun, 23 Mar 2025 00:00:00 +0000

Few areas in databases are hotter right now than extending Postgres to support analytics queries. This isn’t a particularly novel area either –– there have been plenty of attempts in the last decade:

Here is what it means to our customers –– and why the problem remains largely unsolved, despite our first attempt with pg_mooncake.

Level 0: I just run analytics queries on my Postgres tables

You’ll be surprised how far this can go with proper indexes, statistics, query tuning, and materialized views—people really overthink this.

Things we learnt

Sun, 08 Sep 2024 00:00:00 +0000

The title should really be “Things we learnt, the hard way”.

As we start this new journey, we spent some time thinking about the axioms of data today. These are things we (or no one for that matter) can dispute.

1. If Postgres can do it, Postgres will do it

We’ve seen this one plenty of times now – it started with JSON, then moved to geo-spatial (PostGIS), and now we’re seeing it with vector search (pgvector).