Blocking docs.nodebb.org from Claude?
-
I was asking Claude Desktop some questions about the NodeBB API and it was blocked from https://docs.nodebb.org/
I think it would also be helpful for Claude Code to be able to access those docs as well. In CF just block the "surge bots" from China and Singapore and that should help. Plus, isn't docs a static site?
-
I was asking Claude Desktop some questions about the NodeBB API and it was blocked from https://docs.nodebb.org/
I think it would also be helpful for Claude Code to be able to access those docs as well. In CF just block the "surge bots" from China and Singapore and that should help. Plus, isn't docs a static site?
@djensen47@community.nodebb.org hmmm, I don't think so, or at least not explicitly.
As far as I know while the nodebb.org domain is behind CF, the bot protection rules aren't enabled. We definitely don't have anubis installed on those properties yet.
I'll have to look into it.
-
I was asking Claude Desktop some questions about the NodeBB API and it was blocked from https://docs.nodebb.org/
I think it would also be helpful for Claude Code to be able to access those docs as well. In CF just block the "surge bots" from China and Singapore and that should help. Plus, isn't docs a static site?
-
I was asking Claude Desktop some questions about the NodeBB API and it was blocked from https://docs.nodebb.org/
I think it would also be helpful for Claude Code to be able to access those docs as well. In CF just block the "surge bots" from China and Singapore and that should help. Plus, isn't docs a static site?
That's using the desktop/web client.
And Claude Code appears to have a similar problem:
-
That's using the desktop/web client.
And Claude Code appears to have a similar problem:
@djensen47@community.nodebb.org can you try again? I've turned off Bot Fight mode now.
-
I was asking Claude Desktop some questions about the NodeBB API and it was blocked from https://docs.nodebb.org/
I think it would also be helpful for Claude Code to be able to access those docs as well. In CF just block the "surge bots" from China and Singapore and that should help. Plus, isn't docs a static site?
It works from the web/desktop client.
It fails with Claude Code:
Unfortunately, the NodeBB docs site (docs.nodebb.org) is behind Cloudflare challenge protection, which blocks automated fetching. The pages return only Cloudflare's JavaScript challenge script instead of the actual content. -
I was asking Claude Desktop some questions about the NodeBB API and it was blocked from https://docs.nodebb.org/
I think it would also be helpful for Claude Code to be able to access those docs as well. In CF just block the "surge bots" from China and Singapore and that should help. Plus, isn't docs a static site?
I have the same problem with Claude Code on my site but my site isn't for developers.
-
I have the same problem with Claude Code on my site but my site isn't for developers.
@djensen47@community.nodebb.org could it be maybe Claude Code has cached the site? I'm not exactly sure what else to turn off
-
I was asking Claude Desktop some questions about the NodeBB API and it was blocked from https://docs.nodebb.org/
I think it would also be helpful for Claude Code to be able to access those docs as well. In CF just block the "surge bots" from China and Singapore and that should help. Plus, isn't docs a static site?
Unfortunately, I think you have to turn off the bot challenge completely. CF puts up a javascript challenge that wget and curl cannot bypass.
-
Unfortunately, I think you have to turn off the bot challenge completely. CF puts up a javascript challenge that wget and curl cannot bypass.
Can you try once more?
Hello! It looks like you're interested in this conversation, but you don't have an account yet.
Getting fed up of having to scroll through the same posts each visit? When you register for an account, you'll always come back to exactly where you were before, and choose to be notified of new replies (either via email, or push notification). You'll also be able to save bookmarks and upvote posts to show your appreciation to other community members.
With your input, this post could be even better 💗
Register Login