Hacker News

DeepSeek V4 Flash 0731: 82.7% on Terminal-Bench 2.1 with a public harness

30 points by ubermon ago | 6 comments

polymer8563 |next [-]

From README for Ante:

"The core harness itself is developed in a private repository during the alpha"

lost all interest after that sentence, sad thing

kimjune01 |next |previous [-]

an audit for the bench for the curious:

https://www.june.kim/terminal-bench-frame

ubermon |root |parent [-]

yeah, that bench has a lot of room to improve, but it is the best we can find now

freakynit |previous [-]

Keeps throwing forbidden after logging-in to the dashboard and goes back to login screen. Tried 4 times.

swrrt |root |parent [-]

Oh, it seems fine for me. I can login actually. Maybe network/server instability?

freakynit |root |parent [-]

No idea..