Hacker News
DosTips, Windows scripting knowledge trove, scraped to death
47 points by iqml2568
ago
|
6 comments
kees99
|next
[-]
For what it's worth, according to internet archive, this banner has been there for a while.
At least since February: https://web.archive.org/web/20260211083755/https://www.dosti...
edg5000
|next
|previous
[-]
They're not yet gone based on the message. They just have to adjust their hardening. The title is a bit dramatic.
account42
|root
|parent
[-]
Or optimize the website. A knowledge base that isn't being actively updated shouldn't need to hit PHP to serve unauthenticated requests.
It doesn't excuse the scrapers but a lot of websites are just needlessly wasteful.
edg5000
|root
|parent
[-]
From what I hear it's misconfigured bots that can cause issues. This could happen for dynamic content, where the bot thinks there are a lot of unique pages and it just keeps scraping with slightly different query params for example, sometimes not rate limited nor limited to pages/day/IP. That's my read from the various posts I've read from web admins.