Mirrors/ArchiveBox
2
0
Fork 0
mirror of https://github.com/ArchiveBox/ArchiveBox synced 2024-11-22 12:13:05 +00:00
Code Issues Projects Releases Packages Wiki Activity
4318 commits 6 branches 78 tags 19 MiB
Commit graph

4318 commits

This branch
This branch
All branches
Author SHA1 Message Date
Nick Sweeting
e37401d74b Update fetch.py 2017-07-08 12:51:06 -05:00
Nick Sweeting
3d261c4734 Merge pull request #36 from tscs37/patch-1 
Quick Fix for Wrong Argument Splitting on wget
 2017-07-08 12:49:17 -05:00
Tim Schuster
ba8307c27e Quick Fix for Wrong Argument Splitting on wget 
When setting the user agent, the resulting CLI arguments for wget where `['wget', '--timestamping', '--adjust-extension', '--no-parent', '--page-requisites', '--convert-links', '-', '-', 'u', 's', 'e', 'r', '-', 'a', 'g', 'e', 'n', 't', '=', '"', 'L', 'y', 'n', 'x', '"', 'https://example.org']`, with this fix it turns into `['wget', '--timestamping', '--adjust-extension', '--no-parent', '--page-requisites', '--convert-links', '--user-agent="Lynx"', '', 'https://example.org']`
 2017-07-08 15:19:43 +02:00
Nick Sweeting
4bc3698ee3 Set theme jekyll-theme-minimal 2017-07-07 14:10:59 -05:00
Nick Sweeting
31924c091e add bookmarks output to gitignore 2017-07-06 17:33:57 -05:00
Nick Sweeting
a7d1213459 add note about logged-in sites 2017-07-06 16:58:53 -05:00
Nick Sweeting
7196486766 add docs for changing WGET_USER_AGENT option 2017-07-06 16:54:07 -05:00
Nick Sweeting
acf59faa06 add custom WGET_USER_AGENT override option 2017-07-06 16:51:41 -05:00
Nick Sweeting
83306391ed enforce utf-8 stdout encoding 2017-07-06 16:44:04 -05:00
Nick Sweeting
648223fc6c wonky exception 2017-07-05 17:30:00 -05:00
Nick Sweeting
5122fa0738 better format wget output 2017-07-05 17:28:09 -05:00
Nick Sweeting
02f711b8cb fix CHROME_BINARY and TIMEOUT configs not being used 2017-07-05 17:26:36 -05:00
Nick Sweeting
0d4ebe9418 show full bookmarked time in tooltip 2017-07-05 17:16:10 -05:00
Nick Sweeting
2265f2aaf0 properly handle querystrings for wget .html appended links 2017-07-05 17:15:56 -05:00
Nick Sweeting
6bb91fbb45 dont hide real exceptions 2017-07-05 17:15:39 -05:00
Nick Sweeting
4db30779a3 remove term Star from vocab 2017-07-05 17:15:17 -05:00
Nick Sweeting
b894e0ff92 properly handle Archive.org denied by robots.txt 2017-07-05 16:57:19 -05:00
Nick Sweeting
9e4b97340d update readme with new options 2017-07-05 16:44:25 -05:00
Nick Sweeting
a167d2a1f4 colorize output and add progress bar 2017-07-05 16:44:25 -05:00
Nick Sweeting
172c4ad5b8 Update README.md 2017-07-05 13:18:22 -05:00
Nick Sweeting
396aec61a7 Merge pull request #33 from bardisty/add-template-strings 
Use template strings for substitution in HTML output
 2017-07-05 13:17:25 -05:00
Brian Hardisty
26b5e4aa3c
Use $identifier over ${identifier} 
`${identifier}` has the potential to conflict with JavaScript template
literals.
 2017-07-05 03:22:11 -07:00
Brian Hardisty
28445d26e8
Remove obsolete note on double-bracketed CSS in templates 2017-07-05 03:07:21 -07:00
Brian Hardisty
31ec3203c5
Use template strings for substitution in HTML output 
`str.format()` can only use substitutions identified by braces (`{` and
`}`). This has the potential to conflict with other code in the HTML
template, such as CSS or JavaScript.

Template strings can use substitutions identified by `$` or `${}`, e.g.:
`$identifier` or `${identifier}`. These substitutions won't conflict
with CSS or JavaScript, allowing users to write HTML templates that
don't require double braces anywhere there's a substitution conflict.
This is especially useful when one is using a build tool to generate the
final CSS/JavaScript/HTML.

https://docs.python.org/3/library/string.html#template-strings
 2017-07-05 02:59:09 -07:00
Nick Sweeting
bca2dceec0 chrome upgrade instructions 2017-07-04 06:46:15 -05:00
Nick Sweeting
010c3d9771 upgrade chrome in setup.sh 2017-07-04 06:40:19 -05:00
Nick Sweeting
60ffe0b2b4 hardcode more encodings 2017-07-04 06:26:46 -05:00
Nick Sweeting
881de8adbe minor url fixes and refactoring 2017-07-04 06:24:03 -05:00
Nick Sweeting
0df2bfe4c8 readme update 2017-07-04 05:57:42 -05:00
Nick Sweeting
c768594b8b add python version check 2017-07-04 05:48:12 -05:00
Nick Sweeting
01687fbe89 enforce utf-8 index encoding 2017-07-04 05:42:31 -05:00
Nick Sweeting
fd1435164b split archive.py into multiple files, refactor config system 2017-07-04 05:38:07 -05:00
Nick Sweeting
f33330ebbf fix pdf and screenshot links 2017-07-04 04:28:38 -05:00
Nick Sweeting
7b72156afd update changelog 2017-07-04 04:22:25 -05:00
Nick Sweeting
e03886b85b add docs for new config options 2017-07-04 04:14:25 -05:00
Nick Sweeting
59dbf725a6 syntax error 2017-07-04 04:09:42 -05:00
Nick Sweeting
f0c7a6f558 fix archive url calculation for urls ending in slash 2017-07-04 04:09:00 -05:00
Nick Sweeting
747676dddd rename example for consistency 2017-07-04 04:06:24 -05:00
Nick Sweeting
16c75bba73 Update README.md 2017-07-04 04:04:01 -05:00
Nick Sweeting
d59bdbc86a fix archive urls not pointing to .html wget versions!! 2017-07-04 04:03:09 -05:00
Nick Sweeting
e0f702bccd always show cmd that failed for error messages 2017-07-04 04:02:47 -05:00
Nick Sweeting
432d5c2dbc default to fetching requisites 2017-07-04 03:29:42 -05:00
Nick Sweeting
e09c704d50 disable wget --mirror in favor of timestamping 2017-07-04 03:21:47 -05:00
Nick Sweeting
0551e5b9e0 fix archive.org chmod and wget error msg 2017-07-04 03:15:17 -05:00
Nick Sweeting
72d6eb9e1e add TIMEOUT and FETCH_WGET_IMAGES options, fix chmod dir 2017-07-04 03:09:47 -05:00
Nick Sweeting
555583b20b refactor chmod into function 2017-07-04 03:02:01 -05:00
Nick Sweeting
fa8a7bde80 more granular errors 2017-07-04 02:50:24 -05:00
Nick Sweeting
263f71862a wget images too, print stderr on fail 2017-07-04 02:42:57 -05:00
Nick Sweeting
1431cc3290 more troubleshooting help 2017-07-02 12:02:29 -05:00
Nick Sweeting
9f5fe726dd Merge pull request #30 from bardisty/fix-pinboard-json-timestamps-error 
Fix Pinboard JSON duplicate timestamps error
 2017-07-01 16:11:49 -05:00