mirror of
https://github.com/getzola/zola
synced 2024-12-14 14:22:28 +00:00
d4b5c4fdc4
The [RFC](http://www.robotstxt.org/orig.html) mentions only `Disallow` directive, so it must appear in the file. `Allow` is an ad hoc agreement between search engines that no all of them follow.
339 B
339 B
+++ title = "Robots.txt" weight = 70 +++
Zola will look for a robots.txt file in the templates directory or
use the built-in one.
Robots.txt is the simplest of all templates: it only gets config
and the default is what most sites want:
User-agent: *
Disallow:
Allow: /
Sitemap: {{/* get_url(path="sitemap.xml") */}}