Commit graph

826 commits

Author SHA1 Message Date
Nick Sweeting
eb5cc8078a better UX before titles have been fetched during archiving progress 2019-03-19 18:10:11 -04:00
Nick Sweeting
914750c453 better title regex to match titles surrounded by newlines 2019-03-19 18:10:11 -04:00
Nick Sweeting
1b5201fd58 re-save index on Ctrl+c to hide in progress message on html output 2019-03-19 18:10:11 -04:00
Nick Sweeting
6f5abd49b4
Merge pull request #183 from n0ncetonic/patch-1
Adds CHROME_USER_AGENT
2019-03-19 15:14:23 -04:00
Nick Sweeting
efaa83aab6
Update README.md 2019-03-19 13:54:53 -04:00
Nick Sweeting
5c6f980183
Update README.md 2019-03-19 13:41:19 -04:00
Nick Sweeting
76c41039a6
Update README.md 2019-03-19 13:40:30 -04:00
Nick Sweeting
81a7bb0549
Update README.md 2019-03-19 13:23:16 -04:00
noncetonic
28758cf16c
Adds CHROME_USER_AGENT 2019-03-19 10:15:52 -07:00
Nick Sweeting
7acc12ded0
Merge pull request #181 from n0ncetonic/feature/chrome_user-agent
Feature/chrome user agent
2019-03-19 11:16:18 -04:00
Nick Sweeting
49c428cb6c
make both user agents equal 2019-03-19 11:16:00 -04:00
noncetonic
8b648696fc
Changes HEADLESS_USER_AGENT to CHROME_USER_AGENT 2019-03-19 08:14:06 -07:00
noncetonic
e230e27929
Changes HEADLESS_USER_AGENT to CHROME_USER_AGENT 2019-03-19 08:13:27 -07:00
noncetonic
a13f22d15a
Adds support for HEADLESS_USER_AGENT for Chrome 2019-03-19 05:32:48 -07:00
noncetonic
127c72bd79
Adds HEADLESS_USER_AGENT variable
Allows setting Headless Chrome's User-Agent to bypass rudimentary anti-scraper/anti-bot checks by sites. https://intoli.com/blog/making-chrome-headless-undetectable/ has more detections if there is desire to get serious about anti-detection
2019-03-19 05:30:06 -07:00
Nick Sweeting
57c91e900c
Update README.md 2019-03-19 04:55:22 -04:00
Nick Sweeting
a3737898e2
Update README.md 2019-03-19 04:51:49 -04:00
Nick Sweeting
806746985a
Update README.md 2019-03-19 04:50:55 -04:00
Nick Sweeting
932772f224
Update README.md 2019-03-19 04:49:33 -04:00
Nick Sweeting
7d5656e1d8
Update README.md 2019-03-19 04:47:14 -04:00
Nick Sweeting
2f31dab7b0
Update README.md 2019-03-19 03:00:15 -04:00
Nick Sweeting
bccd5b2a21
Update README.md 2019-03-19 02:00:40 -04:00
Nick Sweeting
cee7050feb
Update README.md 2019-03-19 01:59:05 -04:00
Nick Sweeting
80e693b912
Update README.md 2019-03-19 01:54:15 -04:00
Nick Sweeting
b7770e18c2
Update README.md 2019-03-19 01:53:18 -04:00
Nick Sweeting
db55c0ba69
Update README.md 2019-03-19 01:48:34 -04:00
Nick Sweeting
3bdfdd7f23
Update README.md 2019-03-19 01:46:01 -04:00
Nick Sweeting
7b3868f9e3
Update README.md 2019-03-19 01:42:32 -04:00
Nick Sweeting
82d0f437cb
Update README.md 2019-03-19 01:36:24 -04:00
Nick Sweeting
6a75e8f7cd
Update README.md 2019-03-19 01:25:00 -04:00
Nick Sweeting
a868dc320c
Update README.md 2019-03-19 01:20:34 -04:00
Nick Sweeting
53127fc469
Update README.md 2019-03-19 01:19:04 -04:00
Nick Sweeting
c729a80eae
Update ArchiveBox.conf.default 2019-03-18 23:13:40 -04:00
Nick Sweeting
fdf1aab1e9
nicer config header 2019-03-18 23:12:23 -04:00
Nick Sweeting
34a44929a7
Update README.md 2019-03-16 05:20:14 -04:00
Nick Sweeting
b0b7eac647
Update README.md 2019-03-16 05:18:22 -04:00
Nick Sweeting
8da3e0757e
Update README.md 2019-03-16 05:14:21 -04:00
Nick Sweeting
500c33a467
Update README.md 2019-03-16 05:13:17 -04:00
Nick Sweeting
df642f3a8e
Update README.md 2019-03-16 05:12:46 -04:00
Nick Sweeting
e26d806f2b
Update README.md 2019-03-16 05:12:05 -04:00
Nick Sweeting
b02d54ea77
Update README.md 2019-03-16 05:10:59 -04:00
Nick Sweeting
41b2e8f40d update docs 2019-03-15 11:43:38 -04:00
Nick Sweeting
f0cf17722b
Update README.md 2019-03-13 00:59:21 -04:00
Nick Sweeting
f7afef9416
Update README.md 2019-03-13 00:51:20 -04:00
Nick Sweeting
30b852e80c
Update README.md 2019-03-13 00:45:01 -04:00
Nick Sweeting
df0e8b7420
Update README.md 2019-03-12 21:35:00 -04:00
Nick Sweeting
b8189aecc1
Update README.md 2019-03-12 21:34:19 -04:00
Nick Sweeting
7a4ef747ab
Update README.md 2019-03-12 20:22:24 -04:00
Nick Sweeting
3385ce7153
Update README.md 2019-03-12 20:19:36 -04:00
Nick Sweeting
a7e46e4720
Update README.md 2019-03-12 20:17:05 -04:00