46 commits

Author	SHA1	Message	Date
Nick Sweeting	d32afec54b	consistent naming and args refactor	2017-10-30 06:09:33 -05:00
Nick Sweeting	7db5e8f72e	round duration number	2017-10-30 04:31:23 -05:00
Nick Sweeting	db26ab9aa9	add basic html and fancy link index options	2017-10-30 02:49:59 -05:00
Nick Sweeting	77ab8ebda6	cleanup archive.py	2017-10-23 04:56:21 -05:00
Nick Sweeting	eb47155a12	major refactor + ability to handle http downloads	2017-10-18 17:39:09 -05:00
Marco Rossi	17d07239f0	Add custom archive directory as configuration option.	2017-08-20 17:37:49 +02:00
Nick Sweeting	6bb91fbb45	dont hide real exceptions	2017-07-05 17:15:39 -05:00
Nick Sweeting	a167d2a1f4	colorize output and add progress bar	2017-07-05 16:44:25 -05:00
Nick Sweeting	fd1435164b	split archive.py into multiple files, refactor config system	2017-07-04 05:38:07 -05:00
Nick Sweeting	f33330ebbf	fix pdf and screenshot links	2017-07-04 04:28:38 -05:00
Nick Sweeting	59dbf725a6	syntax error	2017-07-04 04:09:42 -05:00
Nick Sweeting	f0c7a6f558	fix archive url calculation for urls ending in slash	2017-07-04 04:09:00 -05:00
Nick Sweeting	d59bdbc86a	fix archive urls not pointing to .html wget versions!!	2017-07-04 04:03:09 -05:00
Nick Sweeting	e0f702bccd	always show cmd that failed for error messages	2017-07-04 04:02:47 -05:00
Nick Sweeting	432d5c2dbc	default to fetching requisites	2017-07-04 03:29:42 -05:00
Nick Sweeting	e09c704d50	disable wget --mirror in favor of timestamping	2017-07-04 03:21:47 -05:00
Nick Sweeting	0551e5b9e0	fix archive.org chmod and wget error msg	2017-07-04 03:15:17 -05:00
Nick Sweeting	72d6eb9e1e	add TIMEOUT and FETCH_WGET_IMAGES options, fix chmod dir	2017-07-04 03:09:47 -05:00
Nick Sweeting	555583b20b	refactor chmod into function	2017-07-04 03:02:01 -05:00
Nick Sweeting	fa8a7bde80	more granular errors	2017-07-04 02:50:24 -05:00
Nick Sweeting	263f71862a	wget images too, print stderr on fail	2017-07-04 02:42:57 -05:00
Brian Hardisty	71159bdcaa	Fix Pinboard JSON duplicate timestamps error ... If the JSON exported by Pinboard contains duplicate timestamps, Python returns a TypeError exception: `TypeError: argument of type 'float' is not iterable` This is because `time.mktime()` returns a floating point number. Encasing `time.mktime()` in `str()` fixes the data type not being iterable. `time.mktime()` has also been encased in `int()` to remove the unnecessary decimal value (`.0`) that gets returned for each time value, and to keep the script consistent with the other export functions.	2017-07-01 03:53:19 -07:00
Nick Sweeting	5f0ad792a7	add help message and docstrings	2017-06-30 03:23:45 -05:00
Nick Sweeting	9e816c6b71	whitespace	2017-06-30 02:47:19 -05:00
hannah98	b157bbd492	Override program variables with environment variables	2017-06-21 14:42:24 -05:00
Nick Sweeting	b00498dc42	handle failing screenshots and PDFs better	2017-06-15 19:12:56 -05:00
Nick Sweeting	5593c58a28	fix out dir permissions	2017-06-15 18:51:42 -05:00
Nick Sweeting	2d8364a7c7	fix permissions, output html, and timeouts	2017-06-15 18:49:16 -05:00
Nick Sweeting	35ee1f90cd	make service argument optional	2017-06-15 18:35:04 -05:00
Nick Sweeting	5de6b3adc1	de-duplicate timstamps if using url	2017-06-15 17:33:51 -05:00
Nick Sweeting	8ac6096b39	print timestamps and show number of links in index	2017-06-15 17:33:51 -05:00
Nick Sweeting	7a81a9f143	submit full url with scheme to archive.org	2017-06-15 17:33:51 -05:00
Nick Sweeting	c292b377be	add exception details	2017-06-15 17:33:51 -05:00
Nick Sweeting	fa79768f1e	fix unecessary re-wgetting of websites	2017-06-15 17:33:51 -05:00
Nick Sweeting	15f051f8f7	minor tweaks	2017-06-15 00:45:40 -05:00
Arcady Chumachenko	666760fe06	Removed BeautifulSoup from dependencies	2017-06-11 19:45:22 +01:00
Arcady Chumachenko	8488c57026	#18 - Parse browser bookmarks	2017-06-08 21:52:39 +01:00
Nick Sweeting	0d6e9e6341	increase chmod timeout for large folders	2017-05-31 14:31:16 -05:00
Nick Sweeting	99d5150b6e	add archive.org submitting support, better parsing	2017-05-29 13:00:46 -05:00
Nick Sweeting	92f7b399ca	readability url and title fixes	2017-05-22 10:40:16 -05:00
Nicolas Simon	ab3fc13dec	Fix default parameters parsing	2017-05-06 14:23:49 +02:00
Nicolas Simon	f6149af5a9	Fix name typo in debug when no links found	2017-05-06 14:22:48 +02:00
Sconeyard	6211c0800c	Add pinboard support ... renaming a few variable names to be more neutral towards new services	2017-05-06 01:36:46 +02:00
Nick Sweeting	1508c6a37d	add sample input comment	2017-05-05 10:54:18 -04:00
Nick Sweeting	9bce8f4c8b	minor refactoring	2017-05-05 07:27:10 -04:00
Nick Sweeting	206b5fc57f	initial commiit	2017-05-05 05:00:30 -04:00