17 commits

Author	SHA1	Message	Date
Nick Sweeting	d21bc86075	finish migrating almost all config to new system	2024-09-30 23:21:34 -07:00
Nick Sweeting	363a499289	move util.py into misc folder	2024-09-30 17:25:15 -07:00
Nick Sweeting	dfca4b13b2	move system.py into misc folder	2024-09-30 17:13:55 -07:00
Nick Sweeting	3e5b6ddeae	move config into dedicated global app	2024-09-30 15:59:05 -07:00
Nick Sweeting	457c42bf84	load EXTRACTORS dynamically using importlib.import_module	2024-05-11 22:28:59 -07:00
Ben Muthalaly	d8cf09c21e	Remove unnecessary variable length args for dedupe	2024-03-05 21:13:45 -06:00
Ben Muthalaly	d74ddd42ae	Flip dedupe precedence order	2024-03-01 14:50:32 -06:00
Ben Muthalaly	4e69d2c9e1	Add EXTRA_*_ARGS for wget, curl, and singlefile	2024-02-22 23:04:11 -06:00
Dan Arnfield	5420903102	Refactor should_save_extractor methods to accept overwrite parameter	2021-01-21 15:56:32 -06:00
Nick Sweeting	ac9e0e356d	config fixes	2020-10-31 07:57:11 -04:00
Cristian	563d0f94ec	feat: Use CURL_ARGS in favicon extractor	2020-10-22 08:46:16 -05:00
Cristian	2e1cdca789	feat: Use CURL_ARGS on header extractor	2020-10-22 08:46:16 -05:00
Cristian	62ed11a5ca	fix: Improve headers handling	2020-09-24 12:55:51 -05:00
Angel Rey	a40af98ced	removed static file check	2020-09-24 12:55:51 -05:00
Angel Rey	dc160daba8	Fixed lint	2020-09-23 11:07:00 -05:00
Angel Rey	7fd7dced9a	Added curl params	2020-09-23 11:07:00 -05:00
Angel Rey	852e3c9cff	Added headers extractor	2020-09-23 11:07:00 -05:00