4553 commits

This branch

This branch

All branches

Author	SHA1	Message	Date
Nick Sweeting	22901406aa	Update 2-feature_request.yml	2024-11-22 18:29:58 -05:00
Nick Sweeting	44d337a167	convert index.schema.ArchiveResult and Link to pydantic	2024-11-19 06:32:48 -08:00
Nick Sweeting	b948e49013	add urls log to Crawl model	2024-11-19 06:32:33 -08:00
Nick Sweeting	28386ff172	add jobs_dashboard.html back	2024-11-19 05:35:52 -08:00
Nick Sweeting	4dd53dc12a	Merge branch 'newchanges' into dev	2024-11-19 05:28:20 -08:00
Nick Sweeting	b852951c58	fix cli loading edge case where setup_django wasnt running when it should	2024-11-19 05:27:35 -08:00
Nick Sweeting	6b47510f70	always pre-setup binproviders	2024-11-19 05:24:12 -08:00
Nick Sweeting	f8e2f7c753	restore missing archivebox_update work	2024-11-19 05:09:19 -08:00
Nick Sweeting	52446b86ba	restore missing archivebox_status work	2024-11-19 05:08:41 -08:00
Nick Sweeting	0f536ff18b	restore missing archivebox_schedule work	2024-11-19 05:07:55 -08:00
Nick Sweeting	fe3320eff0	restore missing archivebox_remove work	2024-11-19 05:07:12 -08:00
Nick Sweeting	230bf34e14	restore missing archivebox_config work	2024-11-19 05:05:06 -08:00
Nick Sweeting	ee548eb16e	fix archivebox install not using LIB_DIR	2024-11-19 04:44:43 -08:00
Nick Sweeting	6740202d78	fix cli loading edge case where setup_django wasnt running when it should	2024-11-19 04:20:00 -08:00
Nick Sweeting	f21b86aba8	better cli colors	2024-11-19 04:10:07 -08:00
Nick Sweeting	0f860d40f1	working archivebox_status CLI cmd	2024-11-19 04:05:05 -08:00
Nick Sweeting	292730ebad	working archivebox_schedule cmd	2024-11-19 03:54:47 -08:00
Nick Sweeting	3a64ced697	fix archivebox delete errors	2024-11-19 03:45:44 -08:00
Nick Sweeting	0347b911aa	archivebox add and remove CLI cmds	2024-11-19 03:40:01 -08:00
Nick Sweeting	2595139180	improve statemachine logging and archivebox update CLI cmd	2024-11-19 03:31:05 -08:00
Nick Sweeting	c9a05c9d94	working archivebox update CLI cmd	2024-11-19 02:32:05 -08:00
Nick Sweeting	a0edf218e8	fix archivebox init and archivebox install CLI commands	2024-11-19 01:05:49 -08:00
Nick Sweeting	5f01fc8307	fix archivebox shell and manage CLI commands	2024-11-19 00:48:39 -08:00
Nick Sweeting	328eb98a38	move main funcs into cli files and switch to using click for CLI	2024-11-19 00:18:51 -08:00
Nick Sweeting	569081a9eb	rename abid_utils to base_models	2024-11-18 19:40:05 -08:00
Nick Sweeting	0db6437c4e	fix plural name for output_dir	2024-11-18 19:27:21 -08:00
Nick Sweeting	65afd405b1	merge seeds and crawls apps	2024-11-18 19:23:14 -08:00
Nick Sweeting	4c25e90378	move monkey_patches.py into archivebox.misc subfolder	2024-11-18 19:10:42 -08:00
Nick Sweeting	4a5d607296	move logging_util into archivebox.misc subfolder	2024-11-18 19:08:49 -08:00
Nick Sweeting	e469c5a344	merge queues and actors apps into new workers app	2024-11-18 18:52:48 -08:00
Nick Sweeting	e50f8cb3b6	fix abx handling of obj, module, and class based plugins, fix archivebox version cmd	2024-11-18 18:30:28 -08:00
Nick Sweeting	0acd388c02	fix imports and deps	2024-11-18 18:07:34 -08:00
Nick Sweeting	6b83b4c995	leave archivebox running when in archivebox update	2024-11-18 04:27:38 -08:00
Nick Sweeting	eeb2671e4d	API improvements	2024-11-18 04:27:38 -08:00
Nick Sweeting	c7bd9449d5	better jobs dashboard with faster refresh	2024-11-18 04:27:38 -08:00
Nick Sweeting	eb53145e4e	working state machine flow yay	2024-11-18 04:27:38 -08:00
Nick Sweeting	9adfe0e2e6	add code to log all SQL queries for DEBUG	2024-11-18 04:27:38 -08:00
Nick Sweeting	385ccaa14d	extend core models with ModelWithOutputDir	2024-11-18 04:27:38 -08:00
Nick Sweeting	1e3ce67834	fix API and CLU calls	2024-11-18 04:27:38 -08:00
Nick Sweeting	f65c2b40f8	tweak dashboard UI css	2024-11-18 04:27:38 -08:00
Nick Sweeting	f5727c7da2	rename actors to workers	2024-11-18 04:27:37 -08:00
Nick Sweeting	9b8cf7b4f0	simplify actor and orchestrator by removing threading code, fixing bugs	2024-11-18 04:27:37 -08:00
Nick Sweeting	af21c3428b	add ModelWithOutputDir base model to manage output directories and index writing	2024-11-18 04:27:37 -08:00
Nick Sweeting	c8b830b8dc	add ABIDModel.update_for_workers to update-in-place + bump retry_at time	2024-11-18 04:27:37 -08:00
Nick Sweeting	b852442efc	add crawls app back to django admin	2024-11-18 04:27:37 -08:00
Nick Sweeting	1ec2753664	fix statemachine create_root_snapshot and retry timing	2024-11-18 04:27:37 -08:00
Nick Sweeting	67c22b2df0	fix config set not working with constants	2024-11-18 04:27:37 -08:00
Nick Sweeting	2a66bb9a57	flip queue processing order to do most recent first	2024-11-18 04:27:37 -08:00
Nick Sweeting	148ea907bd	fix serious bug with Actor.get_next updating all rows instead of only top row	2024-11-18 04:27:37 -08:00
Nick Sweeting	18403b72f0	Update config.yml (#1598)	2024-11-17 23:40:51 -05:00