Mirrors/ArchiveBox
2
0
Fork 0
mirror of https://github.com/ArchiveBox/ArchiveBox synced 2024-11-30 08:00:22 +00:00
Code Issues Projects Releases Packages Wiki Activity
212 commits 6 branches 78 tags 19 MiB
Commit graph

45 commits

Author SHA1 Message Date
Nick Sweeting
7db5e8f72e round duration number 2017-10-30 04:31:23 -05:00
Nick Sweeting
db26ab9aa9 add basic html and fancy link index options 2017-10-30 02:49:59 -05:00
Nick Sweeting
77ab8ebda6 cleanup archive.py 2017-10-23 04:56:21 -05:00
Nick Sweeting
eb47155a12 major refactor + ability to handle http downloads 2017-10-18 17:39:09 -05:00
Marco Rossi
17d07239f0 Add custom archive directory as configuration option. 2017-08-20 17:37:49 +02:00
Nick Sweeting
6bb91fbb45 dont hide real exceptions 2017-07-05 17:15:39 -05:00
Nick Sweeting
a167d2a1f4 colorize output and add progress bar 2017-07-05 16:44:25 -05:00
Nick Sweeting
fd1435164b split archive.py into multiple files, refactor config system 2017-07-04 05:38:07 -05:00
Nick Sweeting
f33330ebbf fix pdf and screenshot links 2017-07-04 04:28:38 -05:00
Nick Sweeting
59dbf725a6 syntax error 2017-07-04 04:09:42 -05:00
Nick Sweeting
f0c7a6f558 fix archive url calculation for urls ending in slash 2017-07-04 04:09:00 -05:00
Nick Sweeting
d59bdbc86a fix archive urls not pointing to .html wget versions!! 2017-07-04 04:03:09 -05:00
Nick Sweeting
e0f702bccd always show cmd that failed for error messages 2017-07-04 04:02:47 -05:00
Nick Sweeting
432d5c2dbc default to fetching requisites 2017-07-04 03:29:42 -05:00
Nick Sweeting
e09c704d50 disable wget --mirror in favor of timestamping 2017-07-04 03:21:47 -05:00
Nick Sweeting
0551e5b9e0 fix archive.org chmod and wget error msg 2017-07-04 03:15:17 -05:00
Nick Sweeting
72d6eb9e1e add TIMEOUT and FETCH_WGET_IMAGES options, fix chmod dir 2017-07-04 03:09:47 -05:00
Nick Sweeting
555583b20b refactor chmod into function 2017-07-04 03:02:01 -05:00
Nick Sweeting
fa8a7bde80 more granular errors 2017-07-04 02:50:24 -05:00
Nick Sweeting
263f71862a wget images too, print stderr on fail 2017-07-04 02:42:57 -05:00
Brian Hardisty
71159bdcaa
Fix Pinboard JSON duplicate timestamps error 
If the JSON exported by Pinboard contains duplicate timestamps, Python
returns a TypeError exception:

`TypeError: argument of type 'float' is not iterable`

This is because `time.mktime()` returns a floating point number.
Encasing `time.mktime()` in `str()` fixes the data type not being
iterable.

`time.mktime()` has also been encased in `int()` to remove the
unnecessary decimal value (`.0`) that gets returned for each time value,
and to keep the script consistent with the other export functions.
 2017-07-01 03:53:19 -07:00
Nick Sweeting
5f0ad792a7 add help message and docstrings 2017-06-30 03:23:45 -05:00
Nick Sweeting
9e816c6b71 whitespace 2017-06-30 02:47:19 -05:00
hannah98
b157bbd492 Override program variables with environment variables 2017-06-21 14:42:24 -05:00
Nick Sweeting
b00498dc42 handle failing screenshots and PDFs better 2017-06-15 19:12:56 -05:00
Nick Sweeting
5593c58a28 fix out dir permissions 2017-06-15 18:51:42 -05:00
Nick Sweeting
2d8364a7c7 fix permissions, output html, and timeouts 2017-06-15 18:49:16 -05:00
Nick Sweeting
35ee1f90cd make service argument optional 2017-06-15 18:35:04 -05:00
Nick Sweeting
5de6b3adc1 de-duplicate timstamps if using url 2017-06-15 17:33:51 -05:00
Nick Sweeting
8ac6096b39 print timestamps and show number of links in index 2017-06-15 17:33:51 -05:00
Nick Sweeting
7a81a9f143 submit full url with scheme to archive.org 2017-06-15 17:33:51 -05:00
Nick Sweeting
c292b377be add exception details 2017-06-15 17:33:51 -05:00
Nick Sweeting
fa79768f1e fix unecessary re-wgetting of websites 2017-06-15 17:33:51 -05:00
Nick Sweeting
15f051f8f7 minor tweaks 2017-06-15 00:45:40 -05:00
Arcady Chumachenko
666760fe06 Removed BeautifulSoup from dependencies 2017-06-11 19:45:22 +01:00
Arcady Chumachenko
8488c57026 #18 - Parse browser bookmarks 2017-06-08 21:52:39 +01:00
Nick Sweeting
0d6e9e6341 increase chmod timeout for large folders 2017-05-31 14:31:16 -05:00
Nick Sweeting
99d5150b6e add archive.org submitting support, better parsing 2017-05-29 13:00:46 -05:00
Nick Sweeting
92f7b399ca readability url and title fixes 2017-05-22 10:40:16 -05:00
Nicolas Simon
ab3fc13dec Fix default parameters parsing 2017-05-06 14:23:49 +02:00
Nicolas Simon
f6149af5a9 Fix name typo in debug when no links found 2017-05-06 14:22:48 +02:00
Sconeyard
6211c0800c Add pinboard support 
renaming a few variable names to be more neutral towards new services
 2017-05-06 01:36:46 +02:00
Nick Sweeting
1508c6a37d add sample input comment 2017-05-05 10:54:18 -04:00
Nick Sweeting
9bce8f4c8b minor refactoring 2017-05-05 07:27:10 -04:00
Nick Sweeting
206b5fc57f initial commiit 2017-05-05 05:00:30 -04:00