28 commits

Author	SHA1	Message	Date
Tom Parker-Shemilt	89efda92e3	Azure devops does 302 twice, so need to cope with that	2020-02-10 21:02:28 +00:00
Tom Parker-Shemilt	4d048eba27	Add workaround for Youtube 302s (fixes #814)	2020-01-30 15:23:42 +00:00
Tom Parker-Shemilt	dec99f4416	Also look for travis.org as well as .com	2020-01-20 18:05:20 +00:00
Tom Parker-Shemilt	f0af98f3fc	Detect unknown status travis builds	2020-01-20 17:53:24 +00:00
Tom Parker-Shemilt	7ea1063c32	Update user-agent so Reddit stops complaining	2020-01-20 13:50:02 +00:00
Tom Parker-Shemilt	6cb9433de0	Look for links/images in HTML content in the Markdown	2020-01-18 14:01:05 +00:00
Tom Parker-Shemilt	a37b1cfee3	Redo error checking with failure and less verbose formatting	2020-01-17 23:24:03 +00:00
Tom Parker-Shemilt	5733288c9a	Record actual real errors	2020-01-13 22:21:03 +00:00
Tom Parker-Shemilt	f799381f75	Add 20 second timeout	2020-01-13 22:13:13 +00:00
Tom Parker-Shemilt	c25072ec06	Add workaround for github actions	2020-01-13 22:13:00 +00:00
Tom Parker-Shemilt	ff703bac03	Fix accept header so we also get github svgs	2020-01-13 21:53:25 +00:00
Tom Parker-Shemilt	a6b79d73ec	Also pick up image tags	2020-01-13 17:04:46 +00:00
Tom Parker-Shemilt	fd843a5dd8	Add extra debug on redirects	2020-01-13 16:17:24 +00:00
Tom Parker-Shemilt	39b2e4b3b6	Add text/hmtl header to fix crates.io	2020-01-13 16:07:48 +00:00
Tom Parker-Shemilt	70361602dd	Detect redirects	2020-01-13 08:39:38 +00:00
Tom Parker-Shemilt	67bfa13da5	Retry up to 5 times just in case on failure	2020-01-11 14:45:49 +00:00
Tom Parker-Shemilt	f6e1302d17	Limit running gets to 20 to stop issues with file handles	2020-01-11 12:06:40 +00:00
Tom Parker-Shemilt	57a7f96ba5	Start writing a rust-based url checker	2020-01-10 23:07:36 +00:00
kud1ing	0d11f0b0c5	remove	2017-05-03 18:46:46 +02:00
kud1ing	4b22d82e49	merge the deployment sections	2017-04-29 10:00:25 +02:00
kud1ing	2978c44acc	add section 'Text search'	2016-12-28 17:32:40 +01:00
kud1ing	d0d937e00a	collect the footer Markdown events	2016-12-10 21:49:04 +01:00
kud1ing	daae790834	flesh out the model some more	2016-12-10 20:59:18 +01:00
kud1ing	76bbf8d6d2	refactor	2016-12-10 20:47:16 +01:00
kud1ing	b9996a01cd	cleanup	2016-12-10 20:38:31 +01:00
kud1ing	98d01abf50	more high-level parsing	2016-12-10 20:32:42 +01:00
kud1ing	21f8b53241	cleanup	2016-12-10 19:23:48 +01:00
kud1ing	eb15075946	add a parser stub for the README.md file	2016-12-10 18:07:07 +01:00