Astro Hacker News - LLMs Play Zachtronics' TIS-100

rpdillon |next [-]

TIS-100 was a mind-expanding game for me. I kind of wish I'd finished it (I think I made it ~20 or so in). It always felt like the sort of game that should be ported to the web or to a TUI, even if just as a sandbox (not bringing over the specific puzzles). Should probably revisit it!

somat |root |parent [-]

There were several opensource tis-100 vm/interpreters made. Here is one I found, no idea if it is any good. https://github.com/melograph85/tis100

What I would always dream about was actual tis-100 like hardware, each module a small cheap microcontroller with 4 uarts(does that exist?) and a self interlocking module design so it is not constrained by a base chassis. And because I am insane, in-band programming, that is, each module needs to and can only be programmed by it's neighbors. It would be such a nightmare to actually make anything.

Heh, That would make for an interesting sequel. You thought tis-100 was obtuse and hard, now you have to design autonomous self duplicating code, it's the tis-400 virus processor.

aunderscored |root |parent |next [-]

Look no further than exapunks, Not quite dead on but close for "self replicating autonomous code"

endgame |root |parent |next |previous [-]

The grid of interlocking handshaking processors reminds me of GreenArrays chips.

joshu |root |parent |next [-]

don't forget transputers! literally four uarts...

vessenes |root |parent |previous [-]

As should the coding!

dark-star |root |parent |previous [-]

Hey, you just re-invented the Transputer!

https://en.wikipedia.org/wiki/Transputer

whazor |next |previous [-]

Really interesting how bad the models performed even though the solutions are widely available online.

xpct |next |previous [-]

Anyone have any ideas for how we can still have Zachtronics-likes with a human leaderboard in the future, or is that something that just won't be possible?

xnorswap |root |parent |next [-]

It's just not possible, see the fate of Advent of Code which removed the global leaderboard.

koutakun |root |parent [-]

>Advent of Code which removed the global leaderboard

I am still so sad about this, though it's probably better for the mental health of all of us who rarely ever hit the top 10.

ozyschmozy |root |parent |next |previous [-]

I think for the specific case of Zachtronics leaderboards, AI entries are overall a good thing. I use the leaderboards to see what's possible, and whether it's worth trying to optimize further in one area. Having AI entrants pushing the boundaries just means people will know to try harder and optimize more.

bspammer |root |parent |next [-]

[delayed]

embedding-shape |root |parent |previous [-]

I can definitely see value in that, "You know what's possible until some shows it", like world records in running and more.

But on the other hand, when I'm playing TIS-100 and similar games and get presented with a score and a leaderboard when finishing a level, I also don't want to see 100s of top LLMs, and no humans, but would much more prefer to see only humans to compare against, as I don't regularly "compete" against LLMs, and wouldn't see much point in that.

But yeah, online leaderboards are definitely dead now, unless we figure out some foolproof human attribution mechanism, which feels kind of further away than ever.

whoanoway |root |parent [-]

[dead]

Cthulhu_ |root |parent |next |previous [-]

Online? Not possible, but that's been happening for decades now with any online scored game (or online poker for that matter).

Streaming and / or physical tournaments are where it's at.

ivanjermakov |root |parent |next |previous [-]

Private leaderboards

chaostheory |root |parent |previous [-]

Probably doesn’t work for this game, but in-person tournaments will start being a thing for more games

xnorswap |next |previous [-]

One of my all-time favourite games. I almost completed it, but got stuck on one level I could never quite wrap my head around.

I don't want to spoil myself looking at solutions nor get help with LLMs, so every couple of years I try to revisit it, but it's difficult to dive straight back into a hard puzzle.

|next |previous [-]

ilkerguldali |previous [-]

[flagged]