If you are receiving the error message "Our crawlers have been prevented from accessing your website," it means that certain IP addresses are being blocked from crawling your website. To fix this issue, you need to whitelist the following IP addresses.
The crawling requests will be sent from the following IPs:
94.130.93.30
168.119.141.170
168.119.99.190
168.119.99.191
168.119.99.192
168.119.99.193
168.119.99.194
68.183.60.34
134.209.42.109
68.183.60.80
68.183.54.131
68.183.49.222
68.183.149.30
68.183.157.22
68.183.149.129
The process for whitelisting IPs may vary depending on your hosting provider. Here is a step-by-step guide to fix this issue on Cloudflare.
Whitelisting IPs on Cloudflare:
Log in to your Cloudflare account.
Go to the Cloudflare dashboard for your website.
Click on the "Firewall" tab.
In the Firewall settings, click on "Tools" and then select "IP Access Rules."
Click on the "Create Rule" button.
Under "Rule Configuration," select "Whitelist" from the action dropdown menu.
In the "IP address" field, enter one of the IP addresses provided in the error message.
Leave the "Expression" field as "IP is."
Repeat steps 6-8 for all the IP addresses provided in the error message.
Click on the "Save and Deploy" button to apply the changes.
Once you have whitelisted the IP addresses, the crawlers should be able to access your website without any issues. If you are still experiencing problems, it is recommended to reach out to your hosting provider's support for further assistance.
Please note that the steps provided are general guidelines and may vary depending on your specific hosting setup. It's always a good idea to consult the documentation or support resources provided by your hosting provider for more detailed instructions.