What is robots.txt?
A robots.txt file is a file at the root of your site that indicates to robots which pages on your site are available for crawling.
Do I need robots.txt on my website?
Yes, it is a good idea to create a robots.txt file for your website so that search engines can easily index your content.
We will generate your robots.txt file each time you update your website pages. This process is fully automatic, and you will be able to access it under your domain www.yourdomain.com/robots.txt
Can I manually update my robots.txt?
As your file will change dynamically with adding or removing new pages, we are generating this file automatically. Therefore, you can't modify it manually.
Which plan do I need to have to generate it?
Starting from the "Basic" plan, we will generate this file for you. You will need to have your custom domain connected to your website so that we can populate it with valid URL links.