Hacker News

DuckDB Ducklake

85 points by saikatsg ago | 11 comments

smithclay |next [-]

Don't think it's widely known or understood, but Ducklake doesn't require duckdb: it's just a (good) data lake spec that works in duckdb.

There's a cool alternate rust/datafusion ecosystem initiative going on at https://github.com/datafusion-contrib/datafusion-ducklake, and think the Quack protocol opens up a lot of cool possibilities too.

If you need an idea for what do do with ducklake: recommend throwing all of your agent traces in it.

celias |next |previous [-]

Motherduck is offering a free copy of O'reilly's "DuckLake: The Definitive Guide" book on their DuckLake web page

https://motherduck.com/product/ducklake/

engineeringwoke |next |previous [-]

It's alright, it's pretty alpha software. On v1.5.4, catalog filtered counts are broken, afaik. I went to main/v2 to fix it, and then the SQL parser in duckdb v2 is 10x slower, which was another wrench in the gears. It's been a bit of a pain tbh

jauco |root |parent [-]

Yep, they made the spec 1.0 but it isn’t 1.0 software. Browse the bugs before use.

When it works well it’s really nice. And it beats handrolling a multi level parquet store.

engineeringwoke |root |parent [-]

Absolutely. I love it, but you need a fork for now.

suchire |next |previous [-]

But "Duckpond" was right there!

HackerThemAll |next |previous [-]

DuckDB is the best thing world got since 1990s.

https://duckdb.org/2025/05/19/the-lost-decade-of-small-data....

loufe |next |previous [-]

Why program greenfield in C++? I know "made with rust" is a meme but seriously, why not a memory safe language in 2026?

esafak |root |parent [-]

DuckDB has been around since 2018. Naturally its offspring use C++.

OutOfHere |root |parent [-]

Rust has been out since 2010. It was recognized and popular by 2017.

esafak |root |parent [-]

It was not popular then (https://www.tiobe.com/tiobe-index/), and it was not selected by DuckDB. IF they feel C++ is holding them back they can rewrite it...

bnuttall |previous [-]

[flagged]