zola/docs/content/documentation/templates/robots.md

+++
title = "Robots.txt"
weight = 70
+++

Zola will look for a `robots.txt` file in the `templates` directory or
use the built-in one.

Robots.txt is the simplest of all templates: it only gets `config`
and the default is what most sites want:

```jinja2
User-agent: *
```
Add more docs pages 2017-10-01 03:51:43 +00:00			`+++`
			`title = "Robots.txt"`
			`weight = 70`
			`+++`

Update docs to refer to zola 2018-10-18 21:09:32 +00:00			Zola will look for a `robots.txt` file in the `templates` directory or
Add more docs pages 2017-10-01 03:51:43 +00:00			`use the built-in one.`

Simple clean up of documentation. (#849) * Update installation.md * Update cli-usage.md * Update installation.md * Update directory-structure.md * Update configuration.md * Update overview.md * Update section.md * Update page.md * Update section.md * Update configuration.md * Update page.md * Update section.md * Update page.md * Update shortcodes.md * Update linking.md * Update table-of-contents.md * Update syntax-highlighting.md * Update taxonomies.md * Update search.md * Update sass.md * Update index.md * Update multilingual.md * Update overview.md * Update pages-sections.md * Update pagination.md * Update taxonomies.md * Update rss.md * Update sitemap.md * Update robots.md * Update 404.md * Update archive.md * Update overview.md * Update installing-and-using-themes.md * Update creating-a-theme.md * Update netlify.md * Update github-pages.md * Update gitlab-pages.md * Update index.md * Update page.md * Update section.md * Updates. 2019-11-26 19:30:30 +00:00			Robots.txt is the simplest of all templates: it only gets `config`
			`and the default is what most sites want:`
Add more docs pages 2017-10-01 03:51:43 +00:00
			```jinja2
			`User-agent: *`
			```