Directory

Crawl allowed? error No: blocked by robots.txt | WordPress.org

Resolved benfrankie
(@benfrankie)

2 years, 4 months ago

hi,
I’m using rankmaths’ default robots.txt but the search console says Crawl allowed? error No: blocked by robots.txt

how to fix this? https://social101.tinytake.com/msc/NjU4ODE2MF8xOTEwODg0NA https://social101.tinytake.com/msc/NjU4ODE2MV8xOTEwODg0NQ

Viewing 1 replies (of 1 total)

Plugin Support Rank Math Support
(@rankmathteam)

2 years, 4 months ago

Hello @benfrankie,

Thank you for contacting the support and sorry for any inconvenience that might have been caused due to that.

We checked your robots.txt file and it seems fine. You can try to refresh the version of the file Google is seeing by following the instructions here:
https://developers.google.com/search/docs/advanced/robots/submit-updated-robots-txt#refresh-googles-robots.txt-cache

Hope this helps. Please don’t hesitate to get in touch in case you need any other assistance.

Viewing 1 replies (of 1 total)

The topic ‘Crawl allowed? error No: blocked by robots.txt’ is closed to new replies.

In: Plugins
1 reply
2 participants
Last reply from: Rank Math Support
Last activity: 2 years, 4 months ago
Status: resolved