Commit graph

32 commits

Author SHA1 Message Date
JDC
b1d70185ed Increase word_objects for Sonic default config 2020-12-06 01:14:38 +02:00
JDC
9bd40ed7f6 Max out number of queries 2020-12-06 01:13:39 +02:00
JDC
a38e3e0c90 Get searc backend password from env var SEARCH_BACKEND_PASSWORD 2020-12-06 01:13:39 +02:00
JDC
0773f12034 Add sonic to docker-compose 2020-12-06 01:13:38 +02:00
Nick Sweeting
0e2ccbc10d update urls to new repo path 2020-11-23 02:06:46 -05:00
Jon Konrath
c52bb722e7
Typo - CHROME was spelled CROME x2 2020-07-29 11:45:55 -07:00
imlonghao
d9348ec82b
Delete isolated quote in ArchiveBox.conf.default 2020-07-30 00:00:50 +08:00
Nick Sweeting
cb67b09f9d Merge branch 'master' into django 2020-06-25 21:30:29 -04:00
misha
1aa2a5b069 15042020 2020-04-15 11:54:53 +03:00
misha
18f0f66f1e 05042020 2020-04-05 18:22:59 +03:00
Nick Sweeting
3c3b2ee621 expose more django server config options 2019-05-02 19:15:16 -04:00
Nick Sweeting
05f327fab0 add more topics and categories to setup.py for pypi indexing 2019-04-26 14:42:28 -04:00
Nick Sweeting
4d6ad7a65d add archivebox config command and move config into sections 2019-04-25 19:03:38 -04:00
Nick Sweeting
5ef5415f3f rename archive toggles from FETCH_ to SAVE_ for clarity 2019-04-24 04:09:25 -04:00
Nick Sweeting
735db84022 add some missing defaults to Archivebox.conf.default 2019-04-23 22:36:43 -04:00
Nick Sweeting
f6a25d9c12 better Archivebox.conf.default examples 2019-03-30 15:45:48 -04:00
Nick Sweeting
49c428cb6c
make both user agents equal 2019-03-19 11:16:00 -04:00
noncetonic
8b648696fc
Changes HEADLESS_USER_AGENT to CHROME_USER_AGENT 2019-03-19 08:14:06 -07:00
noncetonic
127c72bd79
Adds HEADLESS_USER_AGENT variable
Allows setting Headless Chrome's User-Agent to bypass rudimentary anti-scraper/anti-bot checks by sites. https://intoli.com/blog/making-chrome-headless-undetectable/ has more detections if there is desire to get serious about anti-detection
2019-03-19 05:30:06 -07:00
Nick Sweeting
c729a80eae
Update ArchiveBox.conf.default 2019-03-18 23:13:40 -04:00
Nick Sweeting
fdf1aab1e9
nicer config header 2019-03-18 23:12:23 -04:00
Nick Sweeting
0552ce81ed better ArchiveBox.conf.default file 2019-02-21 15:56:31 -05:00
Nick Sweeting
1834acfb5f add cookies example config to conf.default file 2019-02-21 12:58:51 -05:00
Nick Sweeting
5a7d00a639 fetch page title during archiving process 2019-02-19 01:44:54 -05:00
Nick Sweeting
20de451515 add linux config example 2019-01-23 01:48:04 -05:00
Nick Sweeting
95301c9306 better default config 2019-01-23 01:42:55 -05:00
Nick Sweeting
a5fe91da9d add default config 2019-01-23 01:30:10 -05:00
Nick Sweeting
ea905d68bb fix etc nginx and Docker config 2019-01-16 09:20:15 -05:00
Nick Sweeting
2903fead90 fix nginx example config to use new name 2018-12-31 20:55:38 -05:00
Nick Sweeting
5fcb5681f7
Create README.md 2018-12-21 18:14:37 -05:00
Nick Sweeting
e4ca64fa40 add example cron 2018-12-21 18:01:55 -05:00
Nick Sweeting
b1a47d775b add sample nginx config 2018-10-13 22:47:30 -04:00