22 commits

Author	SHA1	Message	Date
Nick Sweeting	bd6d9c165b	enforce utf8 on literally all file operations because windows sucks	2021-03-27 01:16:29 -04:00
Nick Sweeting	acb932ba12	improve readability and mercury error handling and fix output path to be relative	2021-02-16 15:53:11 -05:00
Nick Sweeting	d0f8a5e710	change mercury atomic_write output order	2021-02-16 06:19:16 -05:00
Dan Arnfield	5420903102	Refactor should_save_extractor methods to accept overwrite parameter	2021-01-21 15:56:32 -06:00
JDC	b1f70b2197	Initial implementation	2020-12-06 01:12:45 +02:00
Nick Sweeting	a645f36b87	add comment about fake cmd	2020-09-01 19:42:22 -04:00
Cristian	66037535fd	feat: Add curl command on readability as default command to debug	2020-09-01 10:16:24 -05:00
Cristian	bf3ea42141	fix: Add a default cmd value to handle case where the html cannot be retrieved	2020-08-27 09:51:33 -05:00
Nick Sweeting	a2c158e43e	catch OSErrors due to missing path	2020-08-18 19:09:45 -04:00
Nick Sweeting	7144e0bdce	search for node dependencies in output dir first	2020-08-18 18:40:19 -04:00
Nick Sweeting	92de20af15	better detect missing dependencies on startup	2020-08-18 04:38:13 -04:00
Cristian	05c71fc302	fix: Organize readability extractor so a timeout does not break the whole process	2020-08-17 08:34:40 -05:00
Nick Sweeting	03b73bfe77	Update archivebox/extractors/readability.py	2020-08-14 12:55:22 -04:00
Cristian	5dc7e63792	feat: Update dockerfile to support readability	2020-08-11 11:52:43 -05:00
Cristian	2a68af1b94	tests: Add readability tests	2020-08-11 11:15:15 -05:00
Cristian	8aa7b34de7	tests: Add readability to ignored methods in tests	2020-08-11 08:58:49 -05:00
Cristian	dc87d8b68c	tests: Update failing tests	2020-08-11 08:48:13 -05:00
Cristian	0ec747f64e	feat: Look in wget, singlefile or dom outputs before attempting to download the information again	2020-08-11 08:37:12 -05:00
Cristian	a14762640e	feat: Avoid running readability when the target is a file	2020-08-11 08:37:12 -05:00
Cristian	61e08a7c43	docs: Update docs link	2020-08-11 08:37:12 -05:00
Cristian	b33c66a9f7	feat: Split output of readability into multiple files	2020-08-11 08:37:12 -05:00
Cristian	7e2b249388	feat: Initial version of readability extractor	2020-08-11 08:37:12 -05:00