5 commits

Author	SHA1	Message	Date
bemyak	d4b5c4fdc4	Make robots.txt compliant with RFC (#1895) ... The [RFC](http://www.robotstxt.org/orig.html) mentions only `Disallow` directive, so it must appear in the file. `Allow` is an ad hoc agreement between search engines that no all of them follow.	2022-06-12 21:41:38 +02:00
Vincent Prouillet	f84ae7c93b	Rename all occurrences of gutenberg to zola in code	2018-10-18 22:50:06 +02:00
Greizgh	fec58054b4	Inject config in robots.txt context ... This allow to use base_url in robots.txt, to reference a sitemap for example.	2018-10-02 08:15:26 +02:00
Vincent Prouillet	2cf99c3cfc	Fix robots.txt template for real this time	2018-10-01 17:50:42 +02:00
Vincent Prouillet	a11f8232de	Fix robots.txt not being loaded in Tera ... Closes #443	2018-09-30 19:05:59 +02:00