Commit graph

678 commits

Author SHA1 Message Date
Raman Gupta
5417aba1ca
Updated CMD 2019-03-03 16:37:13 -05:00
Raman Gupta
5a55b9540e
Updated symlink to correct src and target 2019-03-03 16:36:31 -05:00
Raman Gupta
4917147447
Changed command to reference proper target 2019-03-02 13:35:23 -05:00
Raman Gupta
3c934c2708
Changed CMD point to reference proper target 2019-03-02 13:32:48 -05:00
Raman Gupta
8d48b4f8df
Update Dockerfile 2019-03-02 13:25:52 -05:00
Raman Gupta
99e4622185
Remove redundant linking since repo includes link 2019-03-02 12:36:03 -05:00
Raman Gupta
5b5a602c8a
test skipping Puppeteer's Chromium download 2019-03-02 11:58:20 -05:00
Nick Sweeting
63e6ed8ca9
Update README.md 2019-03-01 04:21:49 -05:00
Nick Sweeting
5d56aac77d
update docs index 2019-03-01 04:20:49 -05:00
Nick Sweeting
ec48b96afb update docs 2019-02-28 14:09:03 -05:00
Nick Sweeting
0245a565bd
Add docs links to dockerfile 2019-02-28 14:04:37 -05:00
Nick Sweeting
3e6bcb3b39
add docs links and usage to docker-compose.yml 2019-02-28 13:59:52 -05:00
Nick Sweeting
552734241b put git clones in a git folder to avoid retries 2019-02-27 15:55:39 -05:00
Nick Sweeting
3eaa76267e fix keyerror domain bug 2019-02-27 15:42:53 -05:00
Nick Sweeting
0e2928e758
Update README.md 2019-02-27 13:39:35 -05:00
Nick Sweeting
54a03095db
Update README.md 2019-02-27 13:37:57 -05:00
Nick Sweeting
b4dc80b0a7 when checking link invariants, check for regex match as well 2019-02-27 04:50:29 -05:00
Nick Sweeting
fa6f53f2af used derived info for all derivable info 2019-02-27 04:50:29 -05:00
Nick Sweeting
ef4c446c8b new compiled URL regex with better markdown support 2019-02-27 04:50:29 -05:00
Nick Sweeting
b2c22a73e6 move parsers to global instead of func 2019-02-27 04:50:29 -05:00
Nick Sweeting
af7e8df0eb rename download url func 2019-02-27 04:50:29 -05:00
Nick Sweeting
09d79e55a0 remove derivable link info from links 2019-02-27 04:50:29 -05:00
Nick Sweeting
eb003f6a26 better function naming 2019-02-27 04:50:29 -05:00
Nick Sweeting
328a59749b better remote file downloading cli output messages 2019-02-27 04:50:29 -05:00
Nick Sweeting
44ed46b465
link all bins instead of just archivebox 2019-02-26 21:09:38 -05:00
Nick Sweeting
b03e9fade8 better link corruption guards, remove title prefetching, save index after run 2019-02-21 17:45:28 -05:00
Nick Sweeting
c95632883e fix without_hash to without_fragment 2019-02-21 16:03:19 -05:00
Nick Sweeting
366e880a54 update docs submodule HEAD 2019-02-21 16:01:30 -05:00
Nick Sweeting
0552ce81ed better ArchiveBox.conf.default file 2019-02-21 15:56:31 -05:00
Nick Sweeting
d689264365 add new config and dependency options 2019-02-21 15:47:15 -05:00
Nick Sweeting
1834acfb5f add cookies example config to conf.default file 2019-02-21 12:58:51 -05:00
Nick Sweeting
34cfde0c4e dont fetch titles when FETCH_TITLE=False 2019-02-21 12:58:51 -05:00
Nick Sweeting
d52c9c5304 allow passing COOKIES_FILE to wget 2019-02-21 12:58:51 -05:00
Nick Sweeting
2a3fbfd2a0
Merge pull request #147 from nicolaschan/patch-1
Don't run ls if using non-default directory
2019-02-19 14:08:45 -05:00
Nicolas Chan
c834b2ef13
Don't run ls if using non-default directory
Previously, an error message would appear if using a non-default directory because it would run `ls` on the non-existent default directory:

```bash
ls: cannot access '/home/nicolas/Library/Application Support/Firefox/Profiles/*.default/places.sqlite': No such file or directory
```
2019-02-19 00:37:03 -08:00
Nick Sweeting
935dcac0c7 fix title showing up as None in some UI spots 2019-02-19 02:40:02 -05:00
Nick Sweeting
eff0100971 fix RSS parser bailing out when lines have whitespace before tags 2019-02-19 02:31:53 -05:00
Nick Sweeting
3571ef24e4 fix logic for ONLY_NEW accidentally replacing all links 2019-02-19 02:21:28 -05:00
Nick Sweeting
1b36d5b29c fix pocket timestamps defaulting to now 2019-02-19 01:54:09 -05:00
Nick Sweeting
2c9aad559d use urllib for url parsing instead of hand written string commands 2019-02-19 01:45:19 -05:00
Nick Sweeting
8576a2f061 better parser explanation comment 2019-02-19 01:45:03 -05:00
Nick Sweeting
5a7d00a639 fetch page title during archiving process 2019-02-19 01:44:54 -05:00
Nick Sweeting
bb5879a4f7 fix some parser errors not being caught by bail out process 2019-02-18 23:45:49 -05:00
Nick Sweeting
74b99fe9eb fix import_path None error 2019-02-12 20:04:03 -05:00
Nick Sweeting
e6d5cd4432 ignore robots.txt when using wget 2019-02-06 22:06:36 -08:00
Nick Sweeting
56d382235f better progress output 2019-02-06 22:06:36 -08:00
Nick Sweeting
33ba29ea90 add optional parser error message 2019-02-06 22:06:36 -08:00
Nick Sweeting
5441abdcc2
Update README.md 2019-02-06 16:45:22 -08:00
Nick Sweeting
2496564750
Update README.md 2019-02-06 15:40:53 -08:00
Nick Sweeting
ce257949b4 fix double parsing by accident 2019-02-04 22:08:08 -08:00