487 commits

Author	SHA1	Message	Date
Nick Sweeting	b948e49013	add urls log to Crawl model	2024-11-19 06:32:33 -08:00
Nick Sweeting	2595139180	improve statemachine logging and archivebox update CLI cmd	2024-11-19 03:31:05 -08:00
Nick Sweeting	c9a05c9d94	working archivebox update CLI cmd	2024-11-19 02:32:05 -08:00
Nick Sweeting	5f01fc8307	fix archivebox shell and manage CLI commands	2024-11-19 00:48:39 -08:00
Nick Sweeting	328eb98a38	move main funcs into cli files and switch to using click for CLI	2024-11-19 00:18:51 -08:00
Nick Sweeting	569081a9eb	rename abid_utils to base_models	2024-11-18 19:40:05 -08:00
Nick Sweeting	65afd405b1	merge seeds and crawls apps	2024-11-18 19:23:14 -08:00
Nick Sweeting	4c25e90378	move monkey_patches.py into archivebox.misc subfolder	2024-11-18 19:10:42 -08:00
Nick Sweeting	4a5d607296	move logging_util into archivebox.misc subfolder	2024-11-18 19:08:49 -08:00
Nick Sweeting	e469c5a344	merge queues and actors apps into new workers app	2024-11-18 18:52:48 -08:00
Nick Sweeting	0acd388c02	fix imports and deps	2024-11-18 18:07:34 -08:00
Nick Sweeting	eeb2671e4d	API improvements	2024-11-18 04:27:38 -08:00
Nick Sweeting	eb53145e4e	working state machine flow yay	2024-11-18 04:27:38 -08:00
Nick Sweeting	9adfe0e2e6	add code to log all SQL queries for DEBUG	2024-11-18 04:27:38 -08:00
Nick Sweeting	385ccaa14d	extend core models with ModelWithOutputDir	2024-11-18 04:27:38 -08:00
Nick Sweeting	f5727c7da2	rename actors to workers	2024-11-18 04:27:37 -08:00
Nick Sweeting	1ec2753664	fix statemachine create_root_snapshot and retry timing	2024-11-18 04:27:37 -08:00
Nick Sweeting	36d24cd8d7	add jobs dashboard	2024-11-17 20:09:55 -08:00
Nick Sweeting	8f8fbbb7a2	API fixes and add actors endpoints	2024-11-17 20:09:06 -08:00
Nick Sweeting	c8e186f21b	fix plugin loading order, admin, abx-pkg	2024-11-16 06:44:12 -08:00
Nick Sweeting	ba26d75079	add notes and label fields, fix model getters	2024-11-16 02:47:35 -08:00
Nick Sweeting	227fd4e1c6	fix statemachine progression for Snapshot, Crawl, and ArchiveResult	2024-11-16 02:46:45 -08:00
Nick Sweeting	ed43f1d027	better docstrings and comments	2024-11-15 23:21:40 -08:00
Nick Sweeting	a9a3b153b1	more StateMachine, Actor, and Orchestrator improvements	2024-11-04 07:08:39 -08:00
Nick Sweeting	48f8416762	add new core and crawsl statemachine manager	2024-11-03 00:41:11 -07:00
Nick Sweeting	9b24fe7390	merge dev	2024-11-02 17:34:33 -07:00
Nick Sweeting	721427a484	hide progress bar on startup	2024-10-31 07:11:15 -07:00
Nick Sweeting	70926f1d9f	replace os.access with os.path.isdir	2024-10-28 19:06:38 -07:00
Nick Sweeting	d93aa46949	fix django.forms.JSONField does not exist 500 error	2024-10-28 18:47:45 -07:00
Nick Sweeting	b3c1cb716e	move abx plugins inside vendor dir	2024-10-28 04:07:35 -07:00
Nick Sweeting	5d9a32c364	wip	2024-10-25 01:06:12 -07:00
Nick Sweeting	b61f6ff8d8	rename system_tasks queue to commands queue	2024-10-24 15:41:43 -07:00
Nick Sweeting	9e40dd69a4	more config improvements, move away from settings GLOBALS to getters	2024-10-24 14:50:07 -07:00
Nick Sweeting	312e40b95b	finally get rid of config/legacy in favor of configfile.py and django.py	2024-10-21 03:06:19 -07:00
Nick Sweeting	7a6f1f36d2	trigger abx.pm.hook.ready from core.AppConfig.ready	2024-10-21 01:31:02 -07:00
Nick Sweeting	d48a99ab64	only load django huey config when not getting help or version to avoid creating queue.sqlite3	2024-10-21 00:38:17 -07:00
Nick Sweeting	02a1fc3049	rename sessions app in INSTALLED_APPS to personas	2024-10-21 00:37:57 -07:00
Nick Sweeting	c9f88f5875	add sessions and seeds models	2024-10-15 22:32:13 -07:00
Nick Sweeting	80d8a6b667	split archivebox.use into archivebox.reads and archivebox.writes	2024-10-15 01:03:01 -07:00
Nick Sweeting	aaf069fab0	remove tags field from Machine admin	2024-10-15 01:02:13 -07:00
Nick Sweeting	01ba6d49d3	new vastly simplified plugin spec without pydantic	2024-10-14 21:50:47 -07:00
Nick Sweeting	d69df359ea	remove Crawl migration in favor of separate app	2024-10-14 17:41:07 -07:00
Nick Sweeting	943f843189	add core/admin_site	2024-10-14 17:40:35 -07:00
Nick Sweeting	59b669691f	fix Admin data view for Config to render both sections and individual values	2024-10-14 17:39:14 -07:00
Nick Sweeting	1d7f0ab20d	fix Tag creation via admin erroring because slug field is not filled	2024-10-14 17:38:53 -07:00
Nick Sweeting	c0b7887fd7	fix admin registration using abx hooks	2024-10-14 17:38:38 -07:00
Nick Sweeting	30923c340f	move mixins.py for search into search app	2024-10-14 17:37:30 -07:00
Nick Sweeting	8cff6ddfc6	move ldap_auth setup into LDAP plugin	2024-10-14 17:36:45 -07:00
Nick Sweeting	9a04ed7c76	move serve_static and shell_welcome_message into misc	2024-10-14 17:35:28 -07:00
Nick Sweeting	5ac941cf2e	resolve circular import in core/views	2024-10-14 15:43:53 -07:00