16 commits

Author	SHA1	Message	Date
Nick Sweeting	05f327fab0	add more topics and categories to setup.py for pypi indexing	2019-04-26 14:42:28 -04:00
Nick Sweeting	4d6ad7a65d	add archivebox config command and move config into sections	2019-04-25 19:03:38 -04:00
Nick Sweeting	5ef5415f3f	rename archive toggles from FETCH_ to SAVE_ for clarity	2019-04-24 04:09:25 -04:00
Nick Sweeting	735db84022	add some missing defaults to Archivebox.conf.default	2019-04-23 22:36:43 -04:00
Nick Sweeting	f6a25d9c12	better Archivebox.conf.default examples	2019-03-30 15:45:48 -04:00
Nick Sweeting	49c428cb6c	make both user agents equal	2019-03-19 11:16:00 -04:00
noncetonic	8b648696fc	Changes HEADLESS_USER_AGENT to CHROME_USER_AGENT	2019-03-19 08:14:06 -07:00
noncetonic	127c72bd79	Adds HEADLESS_USER_AGENT variable ... Allows setting Headless Chrome's User-Agent to bypass rudimentary anti-scraper/anti-bot checks by sites. https://intoli.com/blog/making-chrome-headless-undetectable/ has more detections if there is desire to get serious about anti-detection	2019-03-19 05:30:06 -07:00
Nick Sweeting	c729a80eae	Update ArchiveBox.conf.default	2019-03-18 23:13:40 -04:00
Nick Sweeting	fdf1aab1e9	nicer config header	2019-03-18 23:12:23 -04:00
Nick Sweeting	0552ce81ed	better ArchiveBox.conf.default file	2019-02-21 15:56:31 -05:00
Nick Sweeting	1834acfb5f	add cookies example config to conf.default file	2019-02-21 12:58:51 -05:00
Nick Sweeting	5a7d00a639	fetch page title during archiving process	2019-02-19 01:44:54 -05:00
Nick Sweeting	20de451515	add linux config example	2019-01-23 01:48:04 -05:00
Nick Sweeting	95301c9306	better default config	2019-01-23 01:42:55 -05:00
Nick Sweeting	a5fe91da9d	add default config	2019-01-23 01:30:10 -05:00