The following documentation offers step-by-step instructions for creating the virtual Robots.txt file.
Creating Virtual Robots.txt
-
Navigate to the WordPress dashboard -> SiteSEO -> PRO.
-
Click on the 'robots.txt' tab and Enable the 'robots.txt' feature if not already enabled.
-
Please enable the 'Enable robots.txt virtual file' checkbox.
-
To create a robots.txt file, you can use predefined snippets found at the bottom of the Virtual Robots.txt file textarea. Alternatively, you can manually insert the content inside the textarea.
-
After completing the editing, click 'Save changes' to apply your virtual robots.txt.
Viewing Virtual Robots.txt
-
To preview your virtual robots.txt file, click the 'View your robots.txt' button.
-
Alternatively, you can view the robots.txt by typing 'https://example.com/robots.txt' directly in your browser's address bar.
Note: If a physical robots.txt file exists on your server, the virtual configuration won't override it. Some hosts automatically add a physical robots.txt file, and creating your own is the only way to bypass it. In instances like with hosts such as Infomaniak, the virtual robots.txt from WP or SEOPress cannot override the physical file.