67 commits

Author	SHA1	Message	Date
Nick Sweeting	071b39b944	nicer error formats	2019-01-20 14:08:33 -05:00
Nick Sweeting	de6eb649e0	disable wget timestamping if using warcs	2019-01-20 14:08:33 -05:00
Nick Sweeting	ce07a6c738	patch subprocess.run to have better timeout handling	2019-01-20 14:08:33 -05:00
Nick Sweeting	7ea36c4adb	bump timeouts and improve curl archive method	2019-01-20 14:08:33 -05:00
Nick Sweeting	c42fcd42d7	fetch warc file inline with wget instead of as separate step	2019-01-14 22:43:14 -05:00
Nick Sweeting	321cdeda11	add mirror to git clone	2019-01-12 20:13:13 -05:00
Nick Sweeting	6189b1a8af	fix invalid old config vars	2019-01-12 03:13:55 -05:00
Nick Sweeting	f83750c545	cleanup options and make cli flags better for chrome headless timeouts	2019-01-11 22:38:50 -05:00
Nick Sweeting	911b84a79b	make wget cli options easier to read	2019-01-11 22:13:51 -05:00
Nick Sweeting	b77476cb83	fix user agent quoting	2019-01-11 19:54:43 -05:00
Nick Sweeting	e8808b0a1f	add WARC downloading	2019-01-11 07:02:49 -05:00
Nick Sweeting	74189966bf	add link to media	2019-01-11 06:50:42 -05:00
Nick Sweeting	a15a331798	fix media download with longer timeout	2019-01-11 06:33:35 -05:00
Nick Sweeting	c33f7ba91c	add ability to fetch media	2019-01-11 05:52:29 -05:00
Nick Sweeting	0df098717a	make git domains configurable	2019-01-11 05:27:25 -05:00
Nick Sweeting	827e15b31a	add git downloading	2019-01-11 05:18:49 -05:00
Nick Sweeting	57d42339a4	rename pip dir archive to archivebox	2018-12-31 20:53:01 -05:00

Renamed from archiver/archive_methods.py (Browse further)