Hacker News

Why your social.org files can have millions of lines without performance issues

88 points by andros ago | 8 comments

dietr1ch |next [-]

So, It leverages on HTTP range requests to try fetching only what's needed, but to me it seems that it's something that should be efficiently achievable without having to have a unified document.

In my filesystem I could arrange things to be easy to fetch

ls ~/Org/Social/2025/10/

and then fetch the documents I didn't have.

I feel that all this logic is just to workaround problems that may arise when fetching multiple small files, mostly tied to overhead and artificial data ordering when fetching a set of tiny files. Hasn't HTTP3 fixed most of them already?

ChrisArchitect |next |previous [-]

Context FYI:

Org-social is a decentralized social network that runs on Org Mode

https://news.ycombinator.com/item?id=44889354

pshirshov |root |parent [-]

Out of curiosity, how popular it is?

frumiousirc |root |parent |next [-]

My most recent traversal of the social graph found 46 accessible nodes and 487 edges.

0_____0 |root |parent [-]

So, like ARPANET ca. 1980

andros |root |parent |previous [-]

It depends on the niche you're in. It's not at the level of X/Twitter or Mastodon. You need a minimum of technical knowledge.

mjmas |previous [-]

s/Lines/Millions of Lines/

dang |root |parent [-]

Fixed. Thanks!