Mirrors/ArchiveBox
2
0
Fork 0
mirror of https://github.com/ArchiveBox/ArchiveBox synced 2024-11-23 04:33:11 +00:00
Code Issues Projects Releases Packages Wiki Activity
2666 commits 6 branches 78 tags 19 MiB
Commit graph

2666 commits

This branch
This branch
All branches
Author SHA1 Message Date
Tim Schuster
ba8307c27e Quick Fix for Wrong Argument Splitting on wget 
When setting the user agent, the resulting CLI arguments for wget where `['wget', '--timestamping', '--adjust-extension', '--no-parent', '--page-requisites', '--convert-links', '-', '-', 'u', 's', 'e', 'r', '-', 'a', 'g', 'e', 'n', 't', '=', '"', 'L', 'y', 'n', 'x', '"', 'https://example.org']`, with this fix it turns into `['wget', '--timestamping', '--adjust-extension', '--no-parent', '--page-requisites', '--convert-links', '--user-agent="Lynx"', '', 'https://example.org']`
 2017-07-08 15:19:43 +02:00
Nick Sweeting
4bc3698ee3 Set theme jekyll-theme-minimal 2017-07-07 14:10:59 -05:00
Nick Sweeting
31924c091e add bookmarks output to gitignore 2017-07-06 17:33:57 -05:00
Nick Sweeting
a7d1213459 add note about logged-in sites 2017-07-06 16:58:53 -05:00
Nick Sweeting
7196486766 add docs for changing WGET_USER_AGENT option 2017-07-06 16:54:07 -05:00
Nick Sweeting
acf59faa06 add custom WGET_USER_AGENT override option 2017-07-06 16:51:41 -05:00
Nick Sweeting
83306391ed enforce utf-8 stdout encoding 2017-07-06 16:44:04 -05:00
Nick Sweeting
648223fc6c wonky exception 2017-07-05 17:30:00 -05:00
Nick Sweeting
5122fa0738 better format wget output 2017-07-05 17:28:09 -05:00
Nick Sweeting
02f711b8cb fix CHROME_BINARY and TIMEOUT configs not being used 2017-07-05 17:26:36 -05:00
Nick Sweeting
0d4ebe9418 show full bookmarked time in tooltip 2017-07-05 17:16:10 -05:00
Nick Sweeting
2265f2aaf0 properly handle querystrings for wget .html appended links 2017-07-05 17:15:56 -05:00
Nick Sweeting
6bb91fbb45 dont hide real exceptions 2017-07-05 17:15:39 -05:00
Nick Sweeting
4db30779a3 remove term Star from vocab 2017-07-05 17:15:17 -05:00
Nick Sweeting
b894e0ff92 properly handle Archive.org denied by robots.txt 2017-07-05 16:57:19 -05:00
Nick Sweeting
9e4b97340d update readme with new options 2017-07-05 16:44:25 -05:00
Nick Sweeting
a167d2a1f4 colorize output and add progress bar 2017-07-05 16:44:25 -05:00
Nick Sweeting
172c4ad5b8 Update README.md 2017-07-05 13:18:22 -05:00
Nick Sweeting
396aec61a7 Merge pull request #33 from bardisty/add-template-strings 
Use template strings for substitution in HTML output
 2017-07-05 13:17:25 -05:00
Brian Hardisty
26b5e4aa3c
Use $identifier over ${identifier} 
`${identifier}` has the potential to conflict with JavaScript template
literals.
 2017-07-05 03:22:11 -07:00
Brian Hardisty
28445d26e8
Remove obsolete note on double-bracketed CSS in templates 2017-07-05 03:07:21 -07:00
Brian Hardisty
31ec3203c5
Use template strings for substitution in HTML output 
`str.format()` can only use substitutions identified by braces (`{` and
`}`). This has the potential to conflict with other code in the HTML
template, such as CSS or JavaScript.

Template strings can use substitutions identified by `$` or `${}`, e.g.:
`$identifier` or `${identifier}`. These substitutions won't conflict
with CSS or JavaScript, allowing users to write HTML templates that
don't require double braces anywhere there's a substitution conflict.
This is especially useful when one is using a build tool to generate the
final CSS/JavaScript/HTML.

https://docs.python.org/3/library/string.html#template-strings
 2017-07-05 02:59:09 -07:00
Nick Sweeting
bca2dceec0 chrome upgrade instructions 2017-07-04 06:46:15 -05:00
Nick Sweeting
010c3d9771 upgrade chrome in setup.sh 2017-07-04 06:40:19 -05:00
Nick Sweeting
60ffe0b2b4 hardcode more encodings 2017-07-04 06:26:46 -05:00
Nick Sweeting
881de8adbe minor url fixes and refactoring 2017-07-04 06:24:03 -05:00
Nick Sweeting
0df2bfe4c8 readme update 2017-07-04 05:57:42 -05:00
Nick Sweeting
c768594b8b add python version check 2017-07-04 05:48:12 -05:00
Nick Sweeting
01687fbe89 enforce utf-8 index encoding 2017-07-04 05:42:31 -05:00
Nick Sweeting
fd1435164b split archive.py into multiple files, refactor config system 2017-07-04 05:38:07 -05:00
Nick Sweeting
f33330ebbf fix pdf and screenshot links 2017-07-04 04:28:38 -05:00
Nick Sweeting
7b72156afd update changelog 2017-07-04 04:22:25 -05:00
Nick Sweeting
e03886b85b add docs for new config options 2017-07-04 04:14:25 -05:00
Nick Sweeting
59dbf725a6 syntax error 2017-07-04 04:09:42 -05:00
Nick Sweeting
f0c7a6f558 fix archive url calculation for urls ending in slash 2017-07-04 04:09:00 -05:00
Nick Sweeting
747676dddd rename example for consistency 2017-07-04 04:06:24 -05:00
Nick Sweeting
16c75bba73 Update README.md 2017-07-04 04:04:01 -05:00
Nick Sweeting
d59bdbc86a fix archive urls not pointing to .html wget versions!! 2017-07-04 04:03:09 -05:00
Nick Sweeting
e0f702bccd always show cmd that failed for error messages 2017-07-04 04:02:47 -05:00
Nick Sweeting
432d5c2dbc default to fetching requisites 2017-07-04 03:29:42 -05:00
Nick Sweeting
e09c704d50 disable wget --mirror in favor of timestamping 2017-07-04 03:21:47 -05:00
Nick Sweeting
0551e5b9e0 fix archive.org chmod and wget error msg 2017-07-04 03:15:17 -05:00
Nick Sweeting
72d6eb9e1e add TIMEOUT and FETCH_WGET_IMAGES options, fix chmod dir 2017-07-04 03:09:47 -05:00
Nick Sweeting
555583b20b refactor chmod into function 2017-07-04 03:02:01 -05:00
Nick Sweeting
fa8a7bde80 more granular errors 2017-07-04 02:50:24 -05:00
Nick Sweeting
263f71862a wget images too, print stderr on fail 2017-07-04 02:42:57 -05:00
Nick Sweeting
1431cc3290 more troubleshooting help 2017-07-02 12:02:29 -05:00
Nick Sweeting
9f5fe726dd Merge pull request #30 from bardisty/fix-pinboard-json-timestamps-error 
Fix Pinboard JSON duplicate timestamps error
 2017-07-01 16:11:49 -05:00
Brian Hardisty
17cc60d38c
Add pinboard.json example file 2017-07-01 14:10:51 -07:00
Nick Sweeting
47ece9dc5a Update README.md 2017-07-01 14:25:30 -05:00