zola/docs/content/documentation/templates/robots.md

+++
title = "Robots.txt"
weight = 70
+++

Zola will look for a `robots.txt` file in the `templates` directory or
use the built-in one.

Robots.txt is the simplest of all templates: it only gets the config
and the default is what most site want:

```jinja2
User-agent: *
```
Add more docs pages 2017-10-01 03:51:43 +00:00			`+++`
			`title = "Robots.txt"`
			`weight = 70`
			`+++`

Update docs to refer to zola 2018-10-18 21:09:32 +00:00			Zola will look for a `robots.txt` file in the `templates` directory or
Add more docs pages 2017-10-01 03:51:43 +00:00			`use the built-in one.`

Inject config in robots.txt context This allow to use base_url in robots.txt, to reference a sitemap for example. 2018-10-02 06:15:26 +00:00			`Robots.txt is the simplest of all templates: it only gets the config`
			`and the default is what most site want:`
Add more docs pages 2017-10-01 03:51:43 +00:00
			```jinja2
			`User-agent: *`
			```