Commit graph

2570 commits

Author SHA1 Message Date
Nick Sweeting
534ae60ab0 dont overwrite the log on each run, and use dedicated log for scheduled archiving 2021-03-31 11:20:42 -04:00
Nick Sweeting
5d3a03b299 use stderr and hint in case of parser returning no urls instead of bare exception 2021-03-31 01:39:01 -04:00
Nick Sweeting
05da16db99 Merge branch 'dev' 2021-03-31 01:06:04 -04:00
Nick Sweeting
8ce93ff787 use KEY, NAME, and PARSER to define parsers instead of hardcoding in init 2021-03-31 01:05:49 -04:00
Nick Sweeting
36f0646501
Merge pull request #669 from FliegendeWurst/fix-issue-235
add command: --parser option (fixes #235)
2021-03-31 00:53:47 -04:00
Nick Sweeting
2656e59215
change list style 2021-03-31 00:47:42 -04:00
Nick Sweeting
fe2b682b1f
Merge pull request #680 from ArchiveBox/dev 2021-03-31 00:04:26 -04:00
Nick Sweeting
354b4627ed fix tests 2021-03-30 23:39:15 -04:00
Nick Sweeting
0090d36d23
add mercury in extractors list 2021-03-30 23:16:44 -04:00
Nick Sweeting
b4da26e990
Merge pull request #685 from ArchiveBox/dependabot/npm_and_yarn/y18n-5.0.5
Bump y18n from 5.0.1 to 5.0.5
2021-03-30 15:15:18 -04:00
dependabot[bot]
fc3798a9e8
Bump y18n from 5.0.1 to 5.0.5
Bumps [y18n](https://github.com/yargs/y18n) from 5.0.1 to 5.0.5.
- [Release notes](https://github.com/yargs/y18n/releases)
- [Changelog](https://github.com/yargs/y18n/blob/master/CHANGELOG.md)
- [Commits](https://github.com/yargs/y18n/compare/v5.0.1...v5.0.5)

Signed-off-by: dependabot[bot] <support@github.com>
2021-03-30 18:50:42 +00:00
Nick Sweeting
bd8a01e677 sigh vendor yet another dependency 2021-03-30 14:49:42 -04:00
FliegendeWurst
60bd9a902e add command: --parser option 2021-03-28 10:09:11 +02:00
Nick Sweeting
a58ad5b272 allow larger tags 2021-03-27 05:52:42 -04:00
Nick Sweeting
7e7c134ec0 use exc 2021-03-27 05:32:07 -04:00
Nick Sweeting
63919dc90a Merge branch 'debug-toolbar' into dev 2021-03-27 05:29:15 -04:00
Nick Sweeting
09842c1f7e autocreate logs dir 2021-03-27 05:28:54 -04:00
Nick Sweeting
5568b3b612 fix adding and removing tags via admin snapshot list 2021-03-27 05:27:02 -04:00
Nick Sweeting
6fb7bbf2fb
Merge pull request #655 from ArchiveBox/debug-toolbar 2021-03-27 05:14:51 -04:00
Nick Sweeting
49b77b91bb fix unused var 2021-03-27 05:12:54 -04:00
Nick Sweeting
5e57c9e371
Update README.md 2021-03-27 05:04:45 -04:00
Nick Sweeting
c6d8719e24
Update README.md 2021-03-27 05:01:27 -04:00
Nick Sweeting
54a923838f
Update README.md 2021-03-27 04:57:49 -04:00
Nick Sweeting
b272f26b98
Update README.md 2021-03-27 04:55:47 -04:00
Nick Sweeting
5aab5a2a2b
Update README.md 2021-03-27 04:54:59 -04:00
Nick Sweeting
3e26ae4a66 support finding multiple urls as substrings in text 2021-03-27 04:30:40 -04:00
Nick Sweeting
f3a3d76439 support adding urls with tags directly via CLI and add page 2021-03-27 04:30:15 -04:00
Nick Sweeting
5fb9ca389f check more url parsing invariants on startup 2021-03-27 03:57:22 -04:00
Nick Sweeting
fea0b89dbe add tag cli option 2021-03-27 03:57:05 -04:00
Nick Sweeting
334061f17e bump version number 2021-03-27 02:22:54 -04:00
Nick Sweeting
d486f8c162 use tempfile when logs dir is not available 2021-03-27 02:17:12 -04:00
Nick Sweeting
3c2f4c95cf fix unused import 2021-03-27 01:50:26 -04:00
Nick Sweeting
56c6b11b14 add comment 2021-03-27 01:19:32 -04:00
Nick Sweeting
bd6d9c165b enforce utf8 on literally all file operations because windows sucks 2021-03-27 01:16:29 -04:00
Nick Sweeting
185d2f9f9b check for JSON1 extesnion in Sqlite on startup 2021-03-27 00:27:58 -04:00
Nick Sweeting
177d22da50 fix clicking add tag when no tag is selected throwing 500 2021-03-01 01:39:06 -05:00
Nick Sweeting
76ff789164 fix tags page rendering when snapshot has no updated timestamp 2021-03-01 00:40:41 -05:00
Nick Sweeting
0036e9cce2 add migration 2021-02-28 22:55:12 -05:00
Nick Sweeting
9fc9f52cfb increase sqlite timeout and dont check for same thread condition 2021-02-28 22:55:00 -05:00
Nick Sweeting
1cabde3ccd remove atomic transactions 2021-02-28 22:54:40 -05:00
Nick Sweeting
844b5c5e20 minor db fix 2021-02-28 22:54:04 -05:00
Nick Sweeting
62089fdb22 close sqlite3 connections if unused 2021-02-28 22:53:34 -05:00
Nick Sweeting
6aef1dd98d dont check db if init is pending 2021-02-28 22:53:23 -05:00
Nick Sweeting
308be35367
Update bug_report.md 2021-02-24 23:08:27 -05:00
Nick Sweeting
acbce25201 missing migrations 2021-02-18 08:05:05 -05:00
Nick Sweeting
9ead76f9f8 cross link snapshot index, admin, and actions pages using uuids 2021-02-18 08:04:50 -05:00
Nick Sweeting
c257ae240e only enable debug toolbar if nothreading is on 2021-02-18 08:04:26 -05:00
Nick Sweeting
ca2bb673ea improve inline admin forms and add tags autocomplete 2021-02-18 08:04:14 -05:00
Nick Sweeting
33df9c1ebe fix after and before in remove tests 2021-02-18 06:21:44 -05:00
Nick Sweeting
9c07fbdc0b unused import fix 2021-02-18 05:56:00 -05:00