4553 commits

This branch

This branch

All branches

Author	SHA1	Message	Date
Nick Sweeting	3e5ae1600c	Update config.yml	2024-11-17 20:40:38 -08:00
Nick Sweeting	2ae70deaae	Update config.yml	2024-11-17 20:36:29 -08:00
Nick Sweeting	dbd6272d18	Update config.yml	2024-11-17 20:34:21 -08:00
Nick Sweeting	c206056f07	add better docstrings to abx package	2024-11-17 20:26:56 -08:00
Nick Sweeting	2c59524821	bump docs build	2024-11-17 20:15:47 -08:00
Nick Sweeting	2f30a35d2b	add extractors files to favicon and title plugins	2024-11-17 20:11:43 -08:00
Nick Sweeting	1b8bafdb56	add abx-spec-abx-pkg pkg	2024-11-17 20:10:33 -08:00
Nick Sweeting	36d24cd8d7	add jobs dashboard	2024-11-17 20:09:55 -08:00
Nick Sweeting	fb82fdae16	make actor pending include all obj with retry_at in the past	2024-11-17 20:09:38 -08:00
Nick Sweeting	8f8fbbb7a2	API fixes and add actors endpoints	2024-11-17 20:09:06 -08:00
Nick Sweeting	c8e186f21b	fix plugin loading order, admin, abx-pkg	2024-11-16 06:44:12 -08:00
Nick Sweeting	210fd935d7	make orchestrator run as long as any tasks are pending	2024-11-16 06:42:04 -08:00
Nick Sweeting	a4635fe65d	bump rc version	2024-11-16 02:49:38 -08:00
Nick Sweeting	b7df1ca3a7	add start orchestrator management command	2024-11-16 02:49:01 -08:00
Nick Sweeting	2291f02147	setup seed model	2024-11-16 02:48:17 -08:00
Nick Sweeting	8cd285e273	add Seed admin	2024-11-16 02:48:06 -08:00
Nick Sweeting	c2add7119c	make supervisord start orchestrator on startup	2024-11-16 02:47:51 -08:00
Nick Sweeting	ba26d75079	add notes and label fields, fix model getters	2024-11-16 02:47:35 -08:00
Nick Sweeting	227fd4e1c6	fix statemachine progression for Snapshot, Crawl, and ArchiveResult	2024-11-16 02:46:45 -08:00
Nick Sweeting	684a394cba	add HOSTNAME to config.permissions	2024-11-16 02:45:58 -08:00
Nick Sweeting	b4a5da3ffd	update archivebox add CLI command to use new actor system	2024-11-16 02:45:37 -08:00
Nick Sweeting	43514da0d0	add crawl and seed endpoints to REST API	2024-11-16 02:45:11 -08:00
Nick Sweeting	48bb634b75	fix orchestrator startup and add exit_on_idle option	2024-11-16 02:44:57 -08:00
Nick Sweeting	c3d692b5d5	fix minor actor erros around CLAIM_ATOMIC	2024-11-16 02:44:33 -08:00
Nick Sweeting	7c0e3dcc21	load crawls,seeds,actors apps as pluggy plugins	2024-11-16 02:44:11 -08:00
Nick Sweeting	ed43f1d027	better docstrings and comments	2024-11-15 23:21:40 -08:00
Nick Sweeting	6448968952	Use archivebox/sonic multi-arch container with bundled config file	2024-11-13 11:08:00 -05:00
Nick Sweeting	5cb1fd7803	bump docs changes	2024-11-13 03:19:34 -08:00
Nick Sweeting	ec100bfe29	fix docs build for vendored pkgs	2024-11-12 23:53:34 -08:00
Nick Sweeting	f0a7198861	bump docs changes	2024-11-12 22:51:22 -08:00
Nick Sweeting	57852fd89e	fix sphinx docs build	2024-11-12 22:20:11 -08:00
Nick Sweeting	840f831572	move readthedocs config into subdir	2024-11-12 22:10:00 -08:00
Nick Sweeting	c6710a8df3	Delete CNAME	2024-11-13 01:02:04 -05:00
Nick Sweeting	5ce25d7518	Delete click_test.py	2024-11-13 00:57:50 -05:00
Nick Sweeting	ad7eec26b2	bump docs changes	2024-11-12 21:57:03 -08:00
Nick Sweeting	a0f9d3fdbc	Update README.md	2024-11-12 06:55:39 -08:00
Nick Sweeting	a9a3b153b1	more StateMachine, Actor, and Orchestrator improvements	2024-11-04 07:08:39 -08:00
Nick Sweeting	5d3c2a8a99	Update docker_entrypoint.sh	2024-11-03 17:02:36 -08:00
Nick Sweeting	99ed97836f	Prevent accidentally mounting home folder as DATA_DIR	2024-11-03 16:40:23 -08:00
Nick Sweeting	cad1be950b	Require bash for setup.sh script instead of sh	2024-11-03 16:20:50 -08:00
Nick Sweeting	fd89de5b91	Update setup.sh	2024-11-03 16:15:09 -08:00
Nick Sweeting	1148cadd7a	Update __init__.py	2024-11-03 16:12:29 -05:00
Nick Sweeting	5872375a50	Update Dockerfile.simple	2024-11-03 16:04:04 -05:00
Nick Sweeting	b7b3addbab	v0.8.6-rc: Moving plugins to independent python packages with finite state machine interfaces (#1576)	2024-11-03 15:57:12 -05:00
Nick Sweeting	b6ab4e298e	merge dev	2024-11-03 12:56:44 -08:00
Nick Sweeting	758c0c6774	add user providable PLAYWRIGHT cache dir	2024-11-03 12:54:04 -08:00
Nick Sweeting	cc49ecb1b5	playwright: support PLAYWRIGHT_BROWSERS_PATH environment variable (#1583)	2024-11-03 15:47:47 -05:00
Nick Sweeting	50a85ec97b	Update archivebox/plugins_pkg/playwright/binproviders.py	2024-11-03 15:47:00 -05:00
Andrew Dunham	49c520914c	playwright: support PLAYWRIGHT_BROWSERS_PATH environment variable ... This environment variable is used by Playwright to configure where to install browsers. If specified, the given directory is used instead of the OS-specific cache folder. For compatibility with existing Playwright installations, and better control over where these binaries are installed, check the same environment variable in PlaywrightBinProvider. Signed-off-by: Andrew Dunham <andrew@du.nham.ca>	2024-11-03 13:59:20 -05:00
Nick Sweeting	48f8416762	add new core and crawsl statemachine manager	2024-11-03 00:41:11 -07:00