Blocking docs.nodebb.org from Claude?
-
I was asking Claude Desktop some questions about the NodeBB API and it was blocked from https://docs.nodebb.org/
I think it would also be helpful for Claude Code to be able to access those docs as well. In CF just block the "surge bots" from China and Singapore and that should help. Plus, isn't docs a static site?
-
@djensen47@community.nodebb.org hmmm, I don't think so, or at least not explicitly.
As far as I know while the nodebb.org domain is behind CF, the bot protection rules aren't enabled. We definitely don't have anubis installed on those properties yet.
I'll have to look into it.
-
-
That's using the desktop/web client.
And Claude Code appears to have a similar problem:
-
@djensen47@community.nodebb.org can you try again? I've turned off Bot Fight mode now.
-
It works from the web/desktop client.
It fails with Claude Code:
Unfortunately, the NodeBB docs site (docs.nodebb.org) is behind Cloudflare challenge protection, which blocks automated fetching. The pages return only Cloudflare's JavaScript challenge script instead of the actual content. -
I have the same problem with Claude Code on my site but my site isn't for developers.
-
@djensen47@community.nodebb.org could it be maybe Claude Code has cached the site? I'm not exactly sure what else to turn off
-
Unfortunately, I think you have to turn off the bot challenge completely. CF puts up a javascript challenge that wget and curl cannot bypass.
-
Can you try once more?
