Commit graph

3256 commits

Author SHA1 Message Date
Nick Sweeting
6b35c30e17 fix armv7 build for Docker and bare metal 2023-10-30 23:25:51 -07:00
Nick Sweeting
62e077a5bc
Merge pull request #1241 from overhacked/fts5-search 2023-10-30 18:49:52 -07:00
Nick Sweeting
8467d89400
Merge pull request #1255 from c01o/fix_python_test 2023-10-30 18:48:28 -07:00
Nick Sweeting
3b005b5faf
Add PDM 2023-10-30 18:48:10 -07:00
Nick Sweeting
851f59b4ba
Merge pull request #1254 from c01o/dev 2023-10-30 18:44:55 -07:00
Nick Sweeting
9b0b7c6f64 remove setup.py and youtube-dl dependency 2023-10-30 18:40:55 -07:00
Nick Sweeting
db360dea1f
Fix writing to stderr from docker entrypoint 2023-10-30 15:44:33 -07:00
Nick Sweeting
e7795550fc
add help message to permissions error output 2023-10-30 15:39:12 -07:00
Nick Sweeting
e2bcb19603
Merge pull request #1259 from mAAdhaTTah/fix-readwise-token 2023-10-30 11:59:08 -07:00
mAAdhaTTah
18e89bee3d
Fix readwise token
Accidentally shipped this hard-coded. Token is long-size revoked,
but obviously hard to use this way!
2023-10-29 17:27:04 -04:00
Nick Sweeting
a680724367
Merge branch 'dev' into search_index_extract_html_text 2023-10-27 23:09:28 -07:00
Nick Sweeting
720061185c
Merge pull request #1195 from overhacked/method_allow_deny 2023-10-27 23:05:30 -07:00
c01o
bb1646ddc1 Fix python-tests dependency
Starting from b6113cc, it requires `build` package to be built.
2023-10-27 07:21:55 +09:00
c01o
619c5ae6a2 Upgrade test python version
`pyproject.toml` says the minimum requirement is python 3.9, no need to test on 3.7.
Actually `setuptools 68.1.0+` requires `python 3.8+`.
2023-10-27 07:18:46 +09:00
c01o
8c25a81009 Remove playwright from armv7 2023-10-27 05:59:25 +09:00
Nick Sweeting
7a80b61bea
Merge pull request #1252 from c01o/patch-1 2023-10-25 03:28:42 -07:00
c01o
08cffb8742
Fix docker build
Lack of `fi` resulted in a syntax error.
Also, change `;` to `||` to ensure it builds successfully on architectures other than `linux/arm/v7`.


```
[2023-10-24T10:46:49.941Z] ------
 > [dev_container_auto_added_stage_label 11/18] RUN mkdir -p "/home/archivebox/.config/chromium/Crash Reports/pending/"     && chown -R archivebox "/home/archivebox/.config"     ; if [[ "linux/amd64" == "linux/arm/v7" ]]; then $exit 0; else exit 1:
0.401 /bin/bash: -c: line 2: syntax error: unexpected end of file
------
WARNING: buildx: git was not found in the system. Current commit information was not captured by the build
[2023-10-24T10:46:49.942Z] Dockerfile-with-features:135
--------------------
 134 |         && ln -s "$CHROME_BINARY" /usr/bin/chromium-browser
 135 | >>> RUN mkdir -p "/home/${ARCHIVEBOX_USER}/.config/chromium/Crash Reports/pending/" \
 136 | >>>     && chown -R $ARCHIVEBOX_USER "/home/${ARCHIVEBOX_USER}/.config" \
 137 | >>>     ; if [[ "$TARGETPLATFORM" == "linux/arm/v7" ]]; then $exit 0; else exit 1
 138 |         # ignore failure for architectures where no playwright release is available yet
--------------------
ERROR: failed to solve: process "/bin/bash -c mkdir -p \"/home/${ARCHIVEBOX_USER}/.config/chromium/Crash Reports/pending/\"     && chown -R $ARCHIVEBOX_USER \"/home/${ARCHIVEBOX_USER}/.config\"     ; if [[ \"$TARGETPLATFORM\" == \"linux/arm/v7\" ]]; then $exit 0; else exit 1" did not complete successfully: exit code: 2
```
2023-10-24 19:58:23 +09:00
Ross Williams
310b4d1242 Add htmltotext extractor
Saves HTML text nodes and selected element attributes in
`htmltotext.txt` for each Snapshot. Primarily intended to be used
for search indexing.
2023-10-23 21:42:32 -04:00
Nick Sweeting
2681f752f1
ignore playwright chrome install on arm v7 2023-10-21 14:17:50 -07:00
Nick Sweeting
2928c19119 fix multiarch chromium install 2023-10-20 05:45:08 -07:00
Nick Sweeting
988b6585c9 better multiarch builds 2023-10-20 05:30:45 -07:00
Nick Sweeting
25d2c17bb1 add dev build helper script 2023-10-20 05:10:18 -07:00
Nick Sweeting
015737b1e4 fix buildx helper script 2023-10-20 05:10:03 -07:00
Nick Sweeting
bf7a6e4c09 add missing cpython packages needed for arm v8 docker build 2023-10-20 04:33:26 -07:00
Nick Sweeting
63ad43f46c
Merge branch 'dev' into method_allow_deny 2023-10-20 04:25:44 -07:00
Nick Sweeting
53355be46a
Merge branch 'dev' into fts5-search 2023-10-20 04:23:50 -07:00
Nick Sweeting
a58535baff
Merge pull request #1249 from ArchiveBox/pdm 2023-10-20 04:23:25 -07:00
Nick Sweeting
82d8662c74 add more readability error output 2023-10-20 04:14:28 -07:00
Nick Sweeting
f3e81c1487 bump npm lockfile 2023-10-20 04:09:03 -07:00
Nick Sweeting
76f9b91ed3 dockerfile fixes 2023-10-20 04:08:38 -07:00
Nick Sweeting
6736e63ef0 new Dockerfile layout with better layering 2023-10-20 02:47:34 -07:00
Nick Sweeting
86c662421b show FS_USER in version output debug string 2023-10-20 02:47:23 -07:00
Nick Sweeting
7910a5b34b fix pretty_path printing logic 2023-10-20 02:47:03 -07:00
Nick Sweeting
d4ca2d1154 update mercury bin path to postlight parser 2023-10-20 02:46:41 -07:00
Nick Sweeting
75eeb12ebe dont install youtubedl anymore 2023-10-20 02:46:09 -07:00
Nick Sweeting
16796a63fd share PUID and PGID with child procs from entrypoint 2023-10-20 02:45:54 -07:00
Nick Sweeting
e0e34e6377 update package.json and npm lockfile 2023-10-20 02:45:37 -07:00
Nick Sweeting
3b3bdab97d update ignore files 2023-10-20 02:45:20 -07:00
Nick Sweeting
63c276a93d redirect add page back to snapshots list automatically 2023-10-19 18:24:19 -07:00
Nick Sweeting
22bcffe5ee remove accidental duplicate template code 2023-10-19 18:24:05 -07:00
Nick Sweeting
85f8583d62 catch ldap configuration and packaging errors and make them non fatal 2023-10-19 18:05:59 -07:00
Nick Sweeting
53cff45ec0 switch from pipenv and setup.py to PDM for python packaging 2023-10-19 17:49:06 -07:00
Nick Sweeting
8caffc4b4e ignore .pdm-python file 2023-10-19 17:09:48 -07:00
Nick Sweeting
b6113cc00c use pypa build instead of setup.py build and move ldap to extras 2023-10-19 16:44:48 -07:00
Nick Sweeting
4b26ab9d1f only load image into docker when building, and push on deploy 2023-10-19 16:29:51 -07:00
Nick Sweeting
9fa210515e
Bump required python version to 3.9 in stdeb.cfg 2023-10-19 16:22:06 -07:00
Nick Sweeting
748363e685
Bump required Python version to 3.9 2023-10-19 16:21:32 -07:00
Nick Sweeting
6619e8005e
Update pip.yml github action python version 2023-10-19 16:20:43 -07:00
Nick Sweeting
a61f544547
Update SECURITY.md 2023-10-19 16:18:32 -07:00
Nick Sweeting
edde40898b
fix markdown underlining everything as link 2023-10-19 12:58:38 -07:00