Mirrors/ArchiveBox
2
0
Fork 0
mirror of https://github.com/ArchiveBox/ArchiveBox synced 2024-11-26 14:10:20 +00:00
Code Issues Projects Releases Packages Wiki Activity
3997 commits 6 branches 78 tags 19 MiB
Commit graph

52 commits

Author SHA1 Message Date
Nick Sweeting
ed5357cec9
add migrations for datetime field renames 2024-09-04 23:44:13 -07:00
Nick Sweeting
cbf2a8fdc3
rename datetime fields to _at, massively improve ABID generation safety and determinism 2024-09-04 23:42:36 -07:00
Nick Sweeting
68a39b7392
remove .old_id entirely and make ABID generation only happen once on initial save 2024-09-04 16:40:15 -07:00
Nick Sweeting
1e73a06ba0
change ABIDModel.created to use AutoTimeField seeded on .save instead of auto_now_add so that ts_src for ABID is available on creation before DB row is created 2024-08-28 03:02:37 -07:00
Nick Sweeting
d0fefc0279
add chunk_size=500 to more iterator calls 2024-08-27 19:28:00 -07:00
Nick Sweeting
73a3e6aad0
handle tag with no slug or name 2024-08-22 18:25:15 -07:00
Nick Sweeting
1d31b88fa3
fix migration failing when Tag name is empty 2024-08-22 16:30:25 -07:00
Nick Sweeting
09553d8340
hardcode EXTRACTOR_CHOICES to prevent nondeterministic migrations 2024-08-22 15:36:02 -07:00
Nick Sweeting
afe1307617
fix created_by field migration to create User properly if none exists 2024-08-22 15:20:36 -07:00
Nick Sweeting
849b4963a1
add migrations 2024-08-20 01:58:44 -07:00
Nick Sweeting
9273db528e
fix abid generation migrations to be historically consistent 2024-08-20 01:58:19 -07:00
Nick Sweeting
344e902fc6
migrate SnapshotTag to use new snapshot id 2024-08-19 19:42:25 -07:00
Nick Sweeting
cf2faecf61
add migrations for SnapshotTag through model 2024-08-19 18:36:20 -07:00
Nick Sweeting
033ec08d0c
save snapshot ids during migration 2024-08-17 21:56:45 -07:00
Nick Sweeting
de489d3c60
minor snapshot details ui fixes and migrations log msg improvements 2024-06-04 04:17:32 -07:00
Nick Sweeting
a4cc10d7f8
add migrations for third round of field changes 2024-05-13 07:50:22 -07:00
Nick Sweeting
206e7e74b3
add migrations to create and populate ABIDField and UUIDField values 2024-05-13 05:13:42 -07:00
Nick Sweeting
457c42bf84
load EXTRACTORS dynamically using importlib.import_module 2024-05-11 22:28:59 -07:00
Ross Williams
310b4d1242 Add htmltotext extractor 
Saves HTML text nodes and selected element attributes in
`htmltotext.txt` for each Snapshot. Primarily intended to be used
for search indexing.
 2023-10-23 21:42:32 -04:00
Joseph Turian
22d8e57637 Add missing migration 0021 2022-09-14 09:36:17 +00:00
Nick Sweeting
6949803395 enforce new models to use uuid keys 2021-04-10 06:32:45 -04:00
Nick Sweeting
d73f7d7d96 add db_index on url field 2021-04-01 14:00:07 -04:00
Nick Sweeting
a58ad5b272 allow larger tags 2021-03-27 05:52:42 -04:00
Nick Sweeting
0036e9cce2 add migration 2021-02-28 22:55:12 -05:00
Nick Sweeting
acbce25201 missing migrations 2021-02-18 08:05:05 -05:00
Nick Sweeting
74a9dd8880 add missing migrations 2021-02-18 02:36:21 -05:00
Nick Sweeting
71cf8d5224 add migrations 2021-02-16 15:57:13 -05:00
Nick Sweeting
171bbeb69b catch exception on import of old index.json into ArchiveResult 2021-02-01 16:31:29 -05:00
Nick Sweeting
0aea5ed3e8 fix handling of skipped ArchiveResult entries with null output 2021-02-01 14:37:34 -05:00
Nick Sweeting
aa84a7ff2b fix migration creating conflicting tags based on slug 2021-02-01 05:13:23 -05:00
Nick Sweeting
b0096c7844 fix migration failing due to null cmd_versions in older archives 2021-01-12 17:14:01 +02:00
Cristian
14d1b3209e fix: Make cmd_version nullable 2021-01-06 20:03:40 +02:00
Cristian
c21af37ed4 fix: Give cmd_version a default value in case it is not present 2021-01-06 20:03:40 +02:00
Nick Sweeting
1c87c27105 patch migration JSONField as well 2020-12-11 20:50:45 +02:00
Cristian
4b3f72202b feat: Bump django, update migration and change cmd to use JSONField 2020-11-27 16:23:27 -05:00
Cristian
34a1a6d30d fix: Update model according to code review 2020-11-23 18:28:43 -05:00
Cristian
b237e412df feat: Finish reversal. Add ArchiveResults that are not found in the index.json 2020-11-12 10:30:41 -05:00
Cristian
f7f0bebdcc feat: Modify migration reverse function to restore index (WIP) 2020-11-11 15:26:54 -05:00
Cristian
b3e0400bc0 feat: initial functional version with icons calculated based on archive results 2020-11-04 10:31:20 -05:00
Cristian
309a87e8fe feat: Add extractor field to the database 2020-11-04 07:28:02 -05:00
Cristian
8f3c03a0f9 feat: Initial (and naive) ArchiveResult model 2020-11-03 09:54:02 -05:00
Cristian
62c78e1d10 refactor: Remove django-taggit and replace it with a local tags setup 2020-10-12 13:47:03 -05:00
Cristian
b9e5b781a7 fix: Avoid creating empty tag on migration 2020-10-07 09:59:49 -05:00
Cristian
62f3d648d4 fix: reverse_func functional 2020-10-07 09:46:10 -05:00
Angel Rey
62c9028212 Improved tags 2020-09-24 15:34:23 -05:00
Nick Sweeting
3aeca0e450 fix pending titles and favicons, improve add page, custom admin 2020-07-27 23:26:45 -04:00
Nick Sweeting
a79dd4685a make snapshots unique again 2020-07-13 12:21:52 -04:00
Nick Sweeting
264cae2b6a add migration 2020-06-30 06:42:17 -04:00
Nick Sweeting
43c471e4af cli experience improvements 2020-06-25 17:47:55 -04:00
Nick Sweeting
cb2dd1ee28 rename model Page to Snapshot 2019-04-30 23:44:51 -04:00