noncetonic
127c72bd79
Adds HEADLESS_USER_AGENT variable
...
Allows setting Headless Chrome's User-Agent to bypass rudimentary anti-scraper/anti-bot checks by sites. https://intoli.com/blog/making-chrome-headless-undetectable/ has more detections if there is desire to get serious about anti-detection
2019-03-19 05:30:06 -07:00
Nick Sweeting
c729a80eae
Update ArchiveBox.conf.default
2019-03-18 23:13:40 -04:00
Nick Sweeting
fdf1aab1e9
nicer config header
2019-03-18 23:12:23 -04:00
Nick Sweeting
0552ce81ed
better ArchiveBox.conf.default file
2019-02-21 15:56:31 -05:00
Nick Sweeting
1834acfb5f
add cookies example config to conf.default file
2019-02-21 12:58:51 -05:00
Nick Sweeting
5a7d00a639
fetch page title during archiving process
2019-02-19 01:44:54 -05:00
Nick Sweeting
20de451515
add linux config example
2019-01-23 01:48:04 -05:00
Nick Sweeting
95301c9306
better default config
2019-01-23 01:42:55 -05:00
Nick Sweeting
a5fe91da9d
add default config
2019-01-23 01:30:10 -05:00
Nick Sweeting
ea905d68bb
fix etc nginx and Docker config
2019-01-16 09:20:15 -05:00
Nick Sweeting
2903fead90
fix nginx example config to use new name
2018-12-31 20:55:38 -05:00
Nick Sweeting
5fcb5681f7
Create README.md
2018-12-21 18:14:37 -05:00
Nick Sweeting
e4ca64fa40
add example cron
2018-12-21 18:01:55 -05:00
Nick Sweeting
b1a47d775b
add sample nginx config
2018-10-13 22:47:30 -04:00