1526 commits

This branch

This branch

All branches

Author	SHA1	Message	Date
Nick Sweeting	e3ac4c2405	htmldecode downloaded sources before parsing for links	2020-08-18 08:23:20 -04:00
Nick Sweeting	fc0d064ddf	add hints	2020-08-18 08:22:34 -04:00
Nick Sweeting	9d093a34f8	better dependency version check	2020-08-18 08:21:55 -04:00
Nick Sweeting	2f282402c7	add hint and prefix stdout utils	2020-08-18 08:21:36 -04:00
Nick Sweeting	2557a0da04	tweak cli output coloring	2020-08-18 08:16:18 -04:00
Nick Sweeting	d7d53cfb12	dont show skipped extractors to reduce visual noise	2020-08-18 08:13:35 -04:00
Nick Sweeting	5f84a7bc6e	better handle the case where json index lags behind sql index	2020-08-18 08:13:13 -04:00
Nick Sweeting	77d2f08a5c	show more info in merge conflict error message	2020-08-18 08:12:35 -04:00
Nick Sweeting	718d39e242	add common code extensions to default blacklist	2020-08-18 08:12:10 -04:00
Nick Sweeting	3658153cf8	fix url parsing through quotes	2020-08-18 08:04:57 -04:00
Nick Sweeting	a218ceb4e8	add test for overwrite flag	2020-08-18 04:52:56 -04:00
Nick Sweeting	a3155b88a1	better error message when nothing left to resume	2020-08-18 04:42:39 -04:00
Nick Sweeting	f8eb245519	better archivebox schedule CLI UX	2020-08-18 04:39:58 -04:00
Nick Sweeting	ec5609a09a	fix resume flag on archivebox update	2020-08-18 04:39:39 -04:00
Nick Sweeting	12f3977da5	fix source filenames missing domain	2020-08-18 04:39:29 -04:00
Nick Sweeting	ec1cce283e	include failed link updates in total count stats	2020-08-18 04:39:19 -04:00
Nick Sweeting	6e142e3531	match existing snapshots on url only, ignoring timestamp	2020-08-18 04:39:04 -04:00
Nick Sweeting	f371032b71	show warning when killing archivebox during index writing	2020-08-18 04:38:29 -04:00
Nick Sweeting	92de20af15	better detect missing dependencies on startup	2020-08-18 04:38:13 -04:00
Nick Sweeting	b681a477ae	add overwrite flag to add command to force re-archiving	2020-08-18 04:37:54 -04:00
Nick Sweeting	da671532a4	fix schedule cmd defaulting to day and remove week	2020-08-18 04:35:59 -04:00
Nick Sweeting	84a8b0d713	hide progress bars on mac	2020-08-18 03:27:52 -04:00
Nick Sweeting	b5745d5b6c	also add version egg info to git commits	2020-08-18 02:14:18 -04:00
Nick Sweeting	8f7ee58a3c	bump version	2020-08-18 02:12:33 -04:00
Nick Sweeting	29c8da83d6	0.4.16 release	2020-08-18 02:08:52 -04:00
Nick Sweeting	6ba4343db1	bump version and add croniter	2020-08-18 02:08:21 -04:00
Nick Sweeting	7c16944a44	Merge pull request #446 from cdvv7788/hotfix/#445	2020-08-18 02:06:32 -04:00
Nick Sweeting	7638dc45ea	0.4.15 release	2020-08-18 01:59:50 -04:00
Nick Sweeting	235eb20dbd	support cron in docker	2020-08-18 01:59:04 -04:00
Nick Sweeting	494be09bc2	add depth flag to schedule cmd	2020-08-18 01:58:54 -04:00
Nick Sweeting	09ad3a5303	Merge pull request #448 from pirate/skip-invalid-urls ... Skip invalid URLs when archiving	2020-08-18 00:53:31 -04:00
Nick Sweeting	ec4db1f75e	add chrome and firefox bookmarks export to history script	2020-08-18 00:36:46 -04:00
Cristian	05c71fc302	fix: Organize readability extractor so a timeout does not break the whole process	2020-08-17 08:34:40 -05:00
Nick Sweeting	225b63b732	skip invalid urls at all stages	2020-08-17 03:12:17 -04:00
Nick Sweeting	26022fc9fb	autocommit docs during release	2020-08-15 01:22:29 -04:00
Nick Sweeting	09b624f120	didnt realize grep supported negative indexes	2020-08-14 23:46:07 -04:00
Nick Sweeting	bdd111d548	you can always mount it manually with cli args	2020-08-14 23:38:47 -04:00
Nick Sweeting	e13d35807a	version bumped	2020-08-14 23:37:34 -04:00
Nick Sweeting	429f39dec1	0.4.14 release	2020-08-14 13:13:50 -04:00
Nick Sweeting	4a1d2a46ac	update docs	2020-08-14 13:13:37 -04:00
Nick Sweeting	58e928520a	tweak log output for skipped methods	2020-08-14 13:12:50 -04:00
Nick Sweeting	e835afcf70	Merge pull request #426 from cdvv7788/readability-extractor	2020-08-14 12:56:30 -04:00
Nick Sweeting	03b73bfe77	Update archivebox/extractors/readability.py	2020-08-14 12:55:22 -04:00
Nick Sweeting	050b717bb9	Merge branch 'master' into readability-extractor	2020-08-14 12:35:35 -04:00
Nick Sweeting	601e1543c8	bump singlefile version	2020-08-14 11:41:31 -04:00
Nick Sweeting	356cfb30cb	add archivebox version to github debug output	2020-08-14 00:39:02 -04:00
Nick Sweeting	d89a50e2fb	fix yaml	2020-08-14 00:35:43 -04:00
Nick Sweeting	abfce2a210	remove uneeded dependencies	2020-08-14 00:14:25 -04:00
Nick Sweeting	c37b58f100	remove python-dev after build process	2020-08-13 23:55:02 -04:00
Nick Sweeting	fedbfda668	add missing yes flag	2020-08-13 23:43:02 -04:00