mirror of
https://github.com/getzola/zola
synced 2025-01-07 09:28:47 +00:00
d4b5c4fdc4
The [RFC](http://www.robotstxt.org/orig.html) mentions only `Disallow` directive, so it must appear in the file. `Allow` is an ad hoc agreement between search engines that no all of them follow.
17 lines
339 B
Markdown
17 lines
339 B
Markdown
+++
|
|
title = "Robots.txt"
|
|
weight = 70
|
|
+++
|
|
|
|
Zola will look for a `robots.txt` file in the `templates` directory or
|
|
use the built-in one.
|
|
|
|
Robots.txt is the simplest of all templates: it only gets `config`
|
|
and the default is what most sites want:
|
|
|
|
```jinja2
|
|
User-agent: *
|
|
Disallow:
|
|
Allow: /
|
|
Sitemap: {{/* get_url(path="sitemap.xml") */}}
|
|
```
|