Commit graph

14 commits

Author SHA1 Message Date
noncetonic
127c72bd79
Adds HEADLESS_USER_AGENT variable
Allows setting Headless Chrome's User-Agent to bypass rudimentary anti-scraper/anti-bot checks by sites. https://intoli.com/blog/making-chrome-headless-undetectable/ has more detections if there is desire to get serious about anti-detection
2019-03-19 05:30:06 -07:00
Nick Sweeting
c729a80eae
Update ArchiveBox.conf.default 2019-03-18 23:13:40 -04:00
Nick Sweeting
fdf1aab1e9
nicer config header 2019-03-18 23:12:23 -04:00
Nick Sweeting
0552ce81ed better ArchiveBox.conf.default file 2019-02-21 15:56:31 -05:00
Nick Sweeting
1834acfb5f add cookies example config to conf.default file 2019-02-21 12:58:51 -05:00
Nick Sweeting
5a7d00a639 fetch page title during archiving process 2019-02-19 01:44:54 -05:00
Nick Sweeting
20de451515 add linux config example 2019-01-23 01:48:04 -05:00
Nick Sweeting
95301c9306 better default config 2019-01-23 01:42:55 -05:00
Nick Sweeting
a5fe91da9d add default config 2019-01-23 01:30:10 -05:00
Nick Sweeting
ea905d68bb fix etc nginx and Docker config 2019-01-16 09:20:15 -05:00
Nick Sweeting
2903fead90 fix nginx example config to use new name 2018-12-31 20:55:38 -05:00
Nick Sweeting
5fcb5681f7
Create README.md 2018-12-21 18:14:37 -05:00
Nick Sweeting
e4ca64fa40 add example cron 2018-12-21 18:01:55 -05:00
Nick Sweeting
b1a47d775b add sample nginx config 2018-10-13 22:47:30 -04:00