3905 commits

This branch

This branch

All branches

Author	SHA1	Message	Date
jim winstead	9f462a87a8	Use feedparser for RSS parsing in generic_rss and pinboard_rss parsers ... The feedparser packages has 20 years of history and is very good at parsing RSS and Atom, so use that instead of ad-hoc regex and XML parsing. The medium_rss and shaarli_rss parsers weren't touched because they are probably unnecessary. (The special parse for pinboard is just needing because of how tags work.) Doesn't include tests because I haven't figured out how to run them in the docker development setup. Fixes #1171	2024-03-01 11:25:45 -08:00
jim winstead	1f828d9441	Add tests for generic_rss and pinboard_rss parsers	2024-03-01 11:22:28 -08:00
Nick Sweeting	a577d1ed23	Merge branch 'dev' into title-cookies-file	2024-02-29 21:29:36 -08:00
jim winstead	89ab18c772	Add generic_jsonl parser ... Resolves #1369	2024-02-29 18:18:27 -08:00
Nick Sweeting	7b042c854a	Fix generic_json parser (#1365) ... Fixes #1347.	2024-02-29 17:19:10 -08:00
Nick Sweeting	fe11e1c2f4	check if COOKIE_FILE is file	2024-02-28 18:19:44 -08:00
jim winstead	ccabda4c7d	Handle list of tags in JSON, and be more clever about comma vs. space	2024-02-28 17:38:49 -08:00
jim winstead	178e676e0f	Fix JSON parser by not always mangling the input ... Rather than by assuming the JSON file we are parsing has junk at the beginning (which maybe only used to happen?), try parsing it as-is first, and then fall back to trying again after skipping the first line Fixes #1347	2024-02-27 14:48:19 -08:00
Ben Muthalaly	68326a60ee	Add cookies file to http request in download_url	2024-02-27 15:30:31 -06:00
jim winstead	22f9a289d3	Use feedparser for RSS parsing in generic_rss and pinboard_rss parsers ... The feedparser packages has 20 years of history and is very good at parsing RSS and Atom, so use that instead of ad-hoc regex and XML parsing. The medium_rss and shaarli_rss parsers weren't touched because they are probably unnecessary. (The special parse for pinboard is just needing because of how tags work.) Doesn't include tests because I haven't figured out how to run them in the docker development setup. Fixes #1171	2024-02-25 12:34:51 -08:00
Nick Sweeting	f02b27920c	Update README.md	2024-02-23 23:21:23 -08:00
Nick Sweeting	597f1a39e0	Update README.md	2024-02-23 23:20:48 -08:00
Ben Muthalaly	4d9c5a7b4b	Add CHROME_EXTRA_ARGS ... Also fix `YOUTUBEDL_EXTRA_ARGS`.	2024-02-23 18:40:03 -06:00
Ben Muthalaly	ab8f395e0a	Add YOUTUBEDL_EXTRA_ARGS	2024-02-23 15:40:31 -06:00
Nick Sweeting	a00b34cc13	Update README.md	2024-02-23 12:58:28 -08:00
Nick Sweeting	c7cdc2fc27	Update README.md	2024-02-23 12:55:36 -08:00
Nick Sweeting	ab225104c5	Update README.md	2024-02-23 12:54:56 -08:00
Ben Muthalaly	4e69d2c9e1	Add EXTRA_*_ARGS for wget, curl, and singlefile	2024-02-22 23:04:11 -06:00
Nick Sweeting	31d05d8526	Merge branch 'main' into dev	2024-02-22 04:50:46 -08:00
Nick Sweeting	8b9bc3dec8	minor fixes	2024-02-22 04:50:22 -08:00
Nick Sweeting	6a4e568d1b	new archivebox update speed improvements	2024-02-22 04:50:22 -08:00
Nick Sweeting	2d32f05a62	lower default sonic log level	2024-02-22 04:50:22 -08:00
Nick Sweeting	3afd7b0cf0	add healthcheck to Dockerfile	2024-02-22 04:50:22 -08:00
Nick Sweeting	0899c298c0	ignore data dirs	2024-02-22 04:50:22 -08:00
Nick Sweeting	743e1ca7ad	Update README.md	2024-02-22 03:07:16 -08:00
Nick Sweeting	52faf81096	Update README.md	2024-02-22 02:42:25 -08:00
Nick Sweeting	9026726a00	Update README.md	2024-02-22 01:23:51 -08:00
Nick Sweeting	113895277d	Update README.md	2024-02-21 17:14:09 -08:00
Nick Sweeting	b3be86f2cf	Update .readthedocs.yaml	2024-02-20 17:58:27 -08:00
Nick Sweeting	8a25502650	Merge branch 'main' into dev	2024-02-20 17:41:10 -08:00
Nick Sweeting	87a86dd111	Update README.md	2024-02-19 00:23:44 -08:00
Nick Sweeting	9b1df2b381	Update README.md	2024-02-19 00:21:45 -08:00
Nick Sweeting	6de23cd8fe	Update README.md	2024-02-19 00:19:48 -08:00
Nick Sweeting	335e3aadb0	revert main changes	2024-02-18 20:01:06 -08:00
Nick Sweeting	20575e7cc8	Merge branch 'main' into dev	2024-02-18 19:15:40 -08:00
Nick Sweeting	841c01ec2c	bump required python version to 3.10 to match brew and apt	2024-02-18 19:14:08 -08:00
Nick Sweeting	f554ae903e	fix requirements.txt so docks build doesnt crash on missing ldap c headers	2024-02-18 19:13:40 -08:00
Nick Sweeting	fa24136ff7	Update setup.sh	2024-02-18 05:46:53 -08:00
Nick Sweeting	b706ab390d	Merge branch 'main' into dev	2024-02-18 05:40:49 -08:00
Nick Sweeting	84fe8e1c75	Update setup.sh	2024-02-18 05:40:30 -08:00
Nick Sweeting	8519c81711	Update setup.sh	2024-02-18 05:32:38 -08:00
Nick Sweeting	9373a2853e	Update setup.sh	2024-02-18 05:32:20 -08:00
Nick Sweeting	0b8ff4c84c	Update setup.sh	2024-02-18 05:28:48 -08:00
Nick Sweeting	0cdfab7f45	Update setup.sh	2024-02-18 05:27:17 -08:00
Nick Sweeting	e9f3b041ec	Update setup.sh	2024-02-18 05:21:27 -08:00
Nick Sweeting	968cd8f19c	Update README.md	2024-02-18 05:03:08 -08:00
Nick Sweeting	ae7cbf4c54	Update README.md	2024-02-18 04:55:33 -08:00
Nick Sweeting	f9ad8e911b	Update README.md	2024-02-18 04:54:27 -08:00
Nick Sweeting	bf0983ce77	Update README.md	2024-02-18 04:48:37 -08:00
Nick Sweeting	dd6bb4b274	Update README.md	2024-02-18 04:46:25 -08:00