This Module Allows Users to Customize their robots.txt File, Informing Search Engine Crawlers About the Accessible URLs on your Site. Its Primary Purpose is to Prevent Overloading your Site with Requests.
Website Robots.Txt
Key Highlights
Effortlessly Configure the robots.txt File.
Can Effortlessly Configure the robots.txt File Based on the Different Modes.
Community & Enterprise Support.
Available in Odoo 17.0 Community and Enterprise.
Are you ready to make your business more
organized?
Improve now!
Custom Mode in robots.txt File.
Go to Website --> Settings --> SEO --> Edit robots.txt File and Choose the Mode from the Wizard.
Choose the Mode 'Allow All'.
Choose the Mode 'Disallow All'.
Configure robots.txt File Effortlessly.
Able to Choose Different Modes to Configure robot.txt File.
A robots.txt file is a text file used by websites to give instructions to web crawlers (like Googlebot) about which pages they can and cannot crawl and index.
A robots.txt file is necessary to manage search engine bots' access to your site's content. It helps you control which pages or files are accessible to bots and which are not, thereby optimizing your site's search engine performance and preventing overloading your server with unnecessary requests.
Latest Release 18.0.1.0.0
17th October, 2024- Initial Commit
