Commit graph

  • c2fa2458af
    Merge 44d337a167 into 315c9f3844 #1311 Nick Sweeting 2024-11-19 14:32:56 +0000
  • 44d337a167
    convert index.schema.ArchiveResult and Link to pydantic dev #1311 Nick Sweeting 2024-11-19 06:32:48 -0800
  • b948e49013
    add urls log to Crawl model Nick Sweeting 2024-11-19 06:32:33 -0800
  • 28386ff172
    add jobs_dashboard.html back Nick Sweeting 2024-11-19 05:35:52 -0800
  • 4dd53dc12a
    Merge branch 'newchanges' into dev Nick Sweeting 2024-11-19 05:28:20 -0800
  • b852951c58
    fix cli loading edge case where setup_django wasnt running when it should Nick Sweeting 2024-11-19 05:27:35 -0800
  • 6b47510f70
    always pre-setup binproviders Nick Sweeting 2024-11-19 05:24:12 -0800
  • f8e2f7c753
    restore missing archivebox_update work Nick Sweeting 2024-11-19 05:09:19 -0800
  • 52446b86ba
    restore missing archivebox_status work Nick Sweeting 2024-11-19 05:08:41 -0800
  • 0f536ff18b
    restore missing archivebox_schedule work Nick Sweeting 2024-11-19 05:07:55 -0800
  • fe3320eff0
    restore missing archivebox_remove work Nick Sweeting 2024-11-19 05:07:12 -0800
  • 230bf34e14
    restore missing archivebox_config work Nick Sweeting 2024-11-19 05:05:06 -0800
  • ee548eb16e
    fix archivebox install not using LIB_DIR Nick Sweeting 2024-11-19 04:44:43 -0800
  • 6740202d78
    fix cli loading edge case where setup_django wasnt running when it should Nick Sweeting 2024-11-19 04:20:00 -0800
  • f21b86aba8
    better cli colors Nick Sweeting 2024-11-19 04:10:07 -0800
  • 0f860d40f1
    working archivebox_status CLI cmd Nick Sweeting 2024-11-19 04:05:05 -0800
  • 292730ebad
    working archivebox_schedule cmd Nick Sweeting 2024-11-19 03:54:47 -0800
  • 3a64ced697
    fix archivebox delete errors Nick Sweeting 2024-11-19 03:45:44 -0800
  • 0347b911aa
    archivebox add and remove CLI cmds Nick Sweeting 2024-11-19 03:40:01 -0800
  • 2595139180
    improve statemachine logging and archivebox update CLI cmd Nick Sweeting 2024-11-19 03:31:05 -0800
  • c9a05c9d94
    working archivebox update CLI cmd Nick Sweeting 2024-11-19 02:31:59 -0800
  • a0edf218e8
    fix archivebox init and archivebox install CLI commands Nick Sweeting 2024-11-19 01:04:56 -0800
  • 5f01fc8307
    fix archivebox shell and manage CLI commands Nick Sweeting 2024-11-19 00:48:39 -0800
  • 328eb98a38
    move main funcs into cli files and switch to using click for CLI Nick Sweeting 2024-11-19 00:18:51 -0800
  • 569081a9eb
    rename abid_utils to base_models Nick Sweeting 2024-11-18 19:40:05 -0800
  • 0db6437c4e
    fix plural name for output_dir Nick Sweeting 2024-11-18 19:27:21 -0800
  • 65afd405b1
    merge seeds and crawls apps Nick Sweeting 2024-11-18 19:23:14 -0800
  • 4c25e90378
    move monkey_patches.py into archivebox.misc subfolder Nick Sweeting 2024-11-18 19:10:42 -0800
  • 4a5d607296
    move logging_util into archivebox.misc subfolder Nick Sweeting 2024-11-18 19:08:49 -0800
  • e469c5a344
    merge queues and actors apps into new workers app Nick Sweeting 2024-11-18 18:52:48 -0800
  • e50f8cb3b6
    fix abx handling of obj, module, and class based plugins, fix archivebox version cmd Nick Sweeting 2024-11-18 18:30:28 -0800
  • 0acd388c02
    fix imports and deps Nick Sweeting 2024-11-18 18:07:34 -0800
  • 6b83b4c995
    leave archivebox running when in archivebox update Nick Sweeting 2024-11-18 04:27:32 -0800
  • eeb2671e4d
    API improvements Nick Sweeting 2024-11-18 04:27:19 -0800
  • c7bd9449d5
    better jobs dashboard with faster refresh Nick Sweeting 2024-11-18 04:26:09 -0800
  • eb53145e4e
    working state machine flow yay Nick Sweeting 2024-11-18 04:25:45 -0800
  • 9adfe0e2e6
    add code to log all SQL queries for DEBUG Nick Sweeting 2024-11-18 02:26:17 -0800
  • 385ccaa14d
    extend core models with ModelWithOutputDir Nick Sweeting 2024-11-18 02:26:08 -0800
  • 1e3ce67834
    fix API and CLU calls Nick Sweeting 2024-11-18 02:25:49 -0800
  • f65c2b40f8
    tweak dashboard UI css Nick Sweeting 2024-11-18 02:25:33 -0800
  • f5727c7da2
    rename actors to workers Nick Sweeting 2024-11-18 02:25:00 -0800
  • 9b8cf7b4f0
    simplify actor and orchestrator by removing threading code, fixing bugs Nick Sweeting 2024-11-18 02:24:52 -0800
  • af21c3428b
    add ModelWithOutputDir base model to manage output directories and index writing Nick Sweeting 2024-11-18 02:24:10 -0800
  • c8b830b8dc
    add ABIDModel.update_for_workers to update-in-place + bump retry_at time Nick Sweeting 2024-11-18 02:23:50 -0800
  • b852442efc
    add crawls app back to django admin Nick Sweeting 2024-11-17 22:57:20 -0800
  • 1ec2753664
    fix statemachine create_root_snapshot and retry timing Nick Sweeting 2024-11-17 22:57:09 -0800
  • 67c22b2df0
    fix config set not working with constants Nick Sweeting 2024-11-17 22:56:30 -0800
  • 2a66bb9a57
    flip queue processing order to do most recent first Nick Sweeting 2024-11-17 22:56:13 -0800
  • 148ea907bd
    fix serious bug with Actor.get_next updating all rows instead of only top row Nick Sweeting 2024-11-17 22:56:03 -0800
  • 18403b72f0
    Update config.yml (#1598) Nick Sweeting 2024-11-17 23:40:51 -0500
  • 3e5ae1600c
    Update config.yml #1598 Nick Sweeting 2024-11-17 20:40:38 -0800
  • 2ae70deaae
    Update config.yml Nick Sweeting 2024-11-17 20:36:29 -0800
  • dbd6272d18
    Update config.yml Nick Sweeting 2024-11-17 20:34:21 -0800
  • c206056f07
    add better docstrings to abx package Nick Sweeting 2024-11-17 20:26:56 -0800
  • 2c59524821
    bump docs build Nick Sweeting 2024-11-17 20:15:47 -0800
  • 2f30a35d2b
    add extractors files to favicon and title plugins Nick Sweeting 2024-11-17 20:11:43 -0800
  • 1b8bafdb56
    add abx-spec-abx-pkg pkg Nick Sweeting 2024-11-17 20:10:33 -0800
  • 36d24cd8d7
    add jobs dashboard Nick Sweeting 2024-11-17 20:09:55 -0800
  • fb82fdae16
    make actor pending include all obj with retry_at in the past Nick Sweeting 2024-11-17 20:09:38 -0800
  • 8f8fbbb7a2
    API fixes and add actors endpoints Nick Sweeting 2024-11-17 20:09:06 -0800
  • c8e186f21b
    fix plugin loading order, admin, abx-pkg Nick Sweeting 2024-11-16 06:43:06 -0800
  • 210fd935d7
    make orchestrator run as long as any tasks are pending Nick Sweeting 2024-11-16 06:42:04 -0800
  • a4635fe65d
    bump rc version Nick Sweeting 2024-11-16 02:49:38 -0800
  • b7df1ca3a7
    add start orchestrator management command Nick Sweeting 2024-11-16 02:49:01 -0800
  • 2291f02147
    setup seed model Nick Sweeting 2024-11-16 02:48:17 -0800
  • 8cd285e273
    add Seed admin Nick Sweeting 2024-11-16 02:48:06 -0800
  • c2add7119c
    make supervisord start orchestrator on startup Nick Sweeting 2024-11-16 02:47:51 -0800
  • ba26d75079
    add notes and label fields, fix model getters Nick Sweeting 2024-11-16 02:47:35 -0800
  • 227fd4e1c6
    fix statemachine progression for Snapshot, Crawl, and ArchiveResult Nick Sweeting 2024-11-16 02:46:45 -0800
  • 684a394cba
    add HOSTNAME to config.permissions Nick Sweeting 2024-11-16 02:45:58 -0800
  • b4a5da3ffd
    update archivebox add CLI command to use new actor system Nick Sweeting 2024-11-16 02:45:37 -0800
  • 43514da0d0
    add crawl and seed endpoints to REST API Nick Sweeting 2024-11-16 02:45:11 -0800
  • 48bb634b75
    fix orchestrator startup and add exit_on_idle option Nick Sweeting 2024-11-16 02:44:57 -0800
  • c3d692b5d5
    fix minor actor erros around CLAIM_ATOMIC Nick Sweeting 2024-11-16 02:44:33 -0800
  • 7c0e3dcc21
    load crawls,seeds,actors apps as pluggy plugins Nick Sweeting 2024-11-16 02:44:11 -0800
  • ed43f1d027
    better docstrings and comments Nick Sweeting 2024-11-15 23:21:34 -0800
  • 6448968952
    Use archivebox/sonic multi-arch container with bundled config file Nick Sweeting 2024-11-13 11:08:00 -0500
  • 5cb1fd7803
    bump docs changes Nick Sweeting 2024-11-13 03:19:34 -0800
  • ec100bfe29
    fix docs build for vendored pkgs v0.8.6rc0 Nick Sweeting 2024-11-12 23:53:34 -0800
  • f0a7198861
    bump docs changes Nick Sweeting 2024-11-12 22:51:22 -0800
  • 57852fd89e
    fix sphinx docs build Nick Sweeting 2024-11-12 22:20:11 -0800
  • 840f831572
    move readthedocs config into subdir Nick Sweeting 2024-11-12 22:10:00 -0800
  • c6710a8df3
    Delete CNAME Nick Sweeting 2024-11-13 01:02:04 -0500
  • 5ce25d7518
    Delete click_test.py Nick Sweeting 2024-11-13 00:57:50 -0500
  • ad7eec26b2
    bump docs changes Nick Sweeting 2024-11-12 21:57:03 -0800
  • a0f9d3fdbc
    Update README.md Nick Sweeting 2024-11-12 06:55:39 -0800
  • a9a3b153b1
    more StateMachine, Actor, and Orchestrator improvements Nick Sweeting 2024-11-04 07:08:31 -0800
  • 5d3c2a8a99
    Update docker_entrypoint.sh Nick Sweeting 2024-11-03 17:02:36 -0800
  • 99ed97836f
    Prevent accidentally mounting home folder as DATA_DIR Nick Sweeting 2024-11-03 16:40:23 -0800
  • cad1be950b
    Require bash for setup.sh script instead of sh Nick Sweeting 2024-11-03 16:20:50 -0800
  • fd89de5b91
    Update setup.sh Nick Sweeting 2024-11-03 16:15:09 -0800
  • 1148cadd7a
    Update __init__.py Nick Sweeting 2024-11-03 16:12:29 -0500
  • 5872375a50
    Update Dockerfile.simple Nick Sweeting 2024-11-03 16:04:04 -0500
  • b7b3addbab
    v0.8.6-rc: Moving plugins to independent python packages with finite state machine interfaces (#1576) Nick Sweeting 2024-11-03 15:57:12 -0500
  • b6ab4e298e
    merge dev #1576 Nick Sweeting 2024-11-03 12:56:44 -0800
  • 758c0c6774
    add user providable PLAYWRIGHT cache dir Nick Sweeting 2024-11-03 12:54:04 -0800
  • cc49ecb1b5
    playwright: support PLAYWRIGHT_BROWSERS_PATH environment variable (#1583) Nick Sweeting 2024-11-03 15:47:47 -0500
  • 50a85ec97b
    Update archivebox/plugins_pkg/playwright/binproviders.py #1583 Nick Sweeting 2024-11-03 15:47:00 -0500
  • 49c520914c playwright: support PLAYWRIGHT_BROWSERS_PATH environment variable Andrew Dunham 2024-11-03 13:59:20 -0500
  • 48f8416762
    add new core and crawsl statemachine manager Nick Sweeting 2024-11-03 00:41:11 -0700