Commit graph

911 commits

Author SHA1 Message Date
Nick Sweeting
c28c0d0e71 enable gzip auto decompression 2019-03-22 23:01:01 -04:00
Nick Sweeting
f7a0568a6c better chrome options loading 2019-03-22 23:00:53 -04:00
Nick Sweeting
ef865dd76a better stats collection and printing 2019-03-22 23:00:43 -04:00
Nick Sweeting
4c499d77b6 move dependency checking into config file 2019-03-22 22:05:45 -04:00
Nick Sweeting
096832210c better logging totals counts 2019-03-22 21:38:24 -04:00
Nick Sweeting
d06775923b move latest to derived data using history 2019-03-22 21:38:08 -04:00
Nick Sweeting
69f837bbf6 simplify chrome_user_data_dir default 2019-03-22 21:37:02 -04:00
Nick Sweeting
8f73fdbe09 fix chrome profile precedence order to be equal 2019-03-22 21:31:55 -04:00
saritchie
745a05fab8
Spelling error in ReadMe
In 'User Interface & Intended Purpose' section:
"builk" -> "built".
2019-03-22 15:40:45 -07:00
Nick Sweeting
bd9f3e313f better logging during long output 2019-03-22 15:09:39 -04:00
Nick Sweeting
1c5732d5c6 improve logging of skipped links 2019-03-22 14:01:29 -04:00
Nick Sweeting
5101b30f02
fix indentation 2019-03-22 13:35:25 -04:00
Nick Sweeting
ee3e8d4926
Update bug_report.md 2019-03-22 12:53:58 -04:00
Nick Sweeting
47855b05cf
Update feature_request.md 2019-03-22 12:45:59 -04:00
Nick Sweeting
855710ac60
Update feature_request.md 2019-03-22 12:44:08 -04:00
Nick Sweeting
1a183c2cdd
Update feature_request.md 2019-03-22 12:43:04 -04:00
Nick Sweeting
3566d9f5b1
Update PULL_REQUEST_TEMPLATE.md 2019-03-22 12:39:32 -04:00
Nick Sweeting
0075daa45c
Merge pull request #187 from simon987/master
Fix succeded typo
2019-03-22 12:35:15 -04:00
Nick Sweeting
cfdb101c56
Merge pull request #189 from simon987/fix-summary-188
Fix for #188
2019-03-21 21:25:31 -04:00
simon987
1c7dafb378 Fix for #188 2019-03-21 20:12:27 -04:00
simon987
fa425b563e Fix succeded typo 2019-03-21 19:59:09 -04:00
Nick Sweeting
d798117081 better separation of archive method checking and running logic 2019-03-21 05:35:41 -04:00
Nick Sweeting
e6bd1f8ca8 major codebase-wide code cleanups 2019-03-21 01:28:12 -04:00
Nick Sweeting
c806068683 fix missing import 2019-03-20 21:12:43 -04:00
Nick Sweeting
5ee1c39720 remove flawed link_type concept in favor of simpler staticfile detection 2019-03-20 21:11:29 -04:00
Nick Sweeting
c79e1df8b2 use hints system to pass stdout and errors up to the traceback 2019-03-20 21:10:09 -04:00
Nick Sweeting
c38de3bbe7 nicer iframes on detail pages 2019-03-20 04:30:44 -04:00
Nick Sweeting
e4c7683983 move js to head and optimize for loading speed 2019-03-20 04:30:28 -04:00
Nick Sweeting
c2ea90ed39 better favicon loading 2019-03-20 04:30:00 -04:00
Nick Sweeting
1772bbfb13 minor ui tweaks 2019-03-20 02:57:06 -04:00
Nick Sweeting
ac56023bfd fix wget_output_path relative location building 2019-03-20 02:37:27 -04:00
Nick Sweeting
9c166d5bcf add more files links to index details page 2019-03-20 02:37:13 -04:00
Nick Sweeting
7f84c4b3c8 dont show in progresss message or regen index on exit 2019-03-20 02:36:55 -04:00
Nick Sweeting
f9a7c530b9 fix pinboard RSS parser 2019-03-19 18:44:22 -04:00
Nick Sweeting
61ec4971e9 fix nested archive index page and improve wget output finding 2019-03-19 18:10:11 -04:00
Nick Sweeting
eb5cc8078a better UX before titles have been fetched during archiving progress 2019-03-19 18:10:11 -04:00
Nick Sweeting
914750c453 better title regex to match titles surrounded by newlines 2019-03-19 18:10:11 -04:00
Nick Sweeting
1b5201fd58 re-save index on Ctrl+c to hide in progress message on html output 2019-03-19 18:10:11 -04:00
Nick Sweeting
6f5abd49b4
Merge pull request #183 from n0ncetonic/patch-1
Adds CHROME_USER_AGENT
2019-03-19 15:14:23 -04:00
Nick Sweeting
efaa83aab6
Update README.md 2019-03-19 13:54:53 -04:00
Nick Sweeting
5c6f980183
Update README.md 2019-03-19 13:41:19 -04:00
Nick Sweeting
76c41039a6
Update README.md 2019-03-19 13:40:30 -04:00
Nick Sweeting
81a7bb0549
Update README.md 2019-03-19 13:23:16 -04:00
noncetonic
28758cf16c
Adds CHROME_USER_AGENT 2019-03-19 10:15:52 -07:00
Nick Sweeting
7acc12ded0
Merge pull request #181 from n0ncetonic/feature/chrome_user-agent
Feature/chrome user agent
2019-03-19 11:16:18 -04:00
Nick Sweeting
49c428cb6c
make both user agents equal 2019-03-19 11:16:00 -04:00
noncetonic
8b648696fc
Changes HEADLESS_USER_AGENT to CHROME_USER_AGENT 2019-03-19 08:14:06 -07:00
noncetonic
e230e27929
Changes HEADLESS_USER_AGENT to CHROME_USER_AGENT 2019-03-19 08:13:27 -07:00
noncetonic
a13f22d15a
Adds support for HEADLESS_USER_AGENT for Chrome 2019-03-19 05:32:48 -07:00
noncetonic
127c72bd79
Adds HEADLESS_USER_AGENT variable
Allows setting Headless Chrome's User-Agent to bypass rudimentary anti-scraper/anti-bot checks by sites. https://intoli.com/blog/making-chrome-headless-undetectable/ has more detections if there is desire to get serious about anti-detection
2019-03-19 05:30:06 -07:00