Nick Sweeting
c684eb045d
Merge pull request #115 from karlicoss/fix-descriptor-leak
...
Fix 'Too many open files' error.
2018-11-26 16:22:32 -05:00
Dima Gerasimov
03c1b0009c
Fix 'Too many open files' error.
...
Happened before after continuous archiving of few hundreds links.
Fix by:
* setting process object to `None` to trigger GC finalizer cleanup of pipe descriptors
* protecting against double cleanup
2018-11-26 02:29:56 +00:00
Dima Gerasimov
b0ffc9c076
Add dummy favicon entry so FETCH_FAVICON='False' isn't failing
2018-11-25 23:55:12 +00:00
Nick Sweeting
91d60364de
Update README.md
2018-11-22 22:47:35 -05:00
Nick Sweeting
e302199f54
Merge pull request #112 from karlicoss/purger
...
Add script to remove entries from index
2018-11-12 10:51:53 -05:00
Dmitrii Gerasimov
157f1be0d0
fix typo in readme
2018-11-12 08:17:30 +00:00
Dima Gerasimov
75c062f33e
Add script to remove entries from index
2018-11-09 20:12:37 +00:00
Nick Sweeting
3ef4fa2387
Update README.md
2018-11-05 15:36:11 -05:00
Nick Sweeting
5260de403e
Update README.md
2018-10-31 00:09:29 -04:00
Nick Sweeting
678ce229c4
Merge pull request #107 from f0086/import-only-new-links
...
Optionally import only new links
2018-10-25 23:31:16 -04:00
Nick Sweeting
a2f5fa8ba6
Use a more appropriate coding style from @pirate.
...
Co-Authored-By: f0086 <mail@aaron-fischer.net>
2018-10-24 21:10:41 +02:00
Nick Sweeting
dbb87311ed
Update README.md
2018-10-23 12:54:03 -04:00
Nick Sweeting
fd6553f958
Update README.md
2018-10-23 12:18:34 -04:00
Nick Sweeting
65c8d70e9b
Update README.md
2018-10-23 12:10:36 -04:00
Aaron Fischer
ebc327bb89
Make O(n^2) loop to an O(n) problem.
2018-10-21 22:36:32 +02:00
Aaron Fischer
b1b6be4f13
merge_links() used wrong index
...
Because merge_links() use the index, we need to get the new_links() _before_ we manipulate the index with write_links_index(). This has the negative side effect that the "Adding X new links ..." will output twice (because we execute merge_links() twice. For that, we only output stuff when the only_new is not set.
2018-10-19 22:35:08 +02:00
Aaron Fischer
69c007ce85
Optionally import only new links
...
When importing a huge list of links periodically (from a big dump of
links from a bookmark service for example) with a lot of broken links,
this links will always be rechecked. To skip this, the environment
variable ONLY_NEW can be used to only import new links and skip the rest
altogether. This partially fixes #95 .
2018-10-19 21:34:57 +02:00
Nick Sweeting
bf6e8f03e4
Merge pull request #105 from flagello/fix-archive-dot-org
...
Fix archive_dot_org
2018-10-16 15:12:28 -04:00
William Esz
a59d609571
Fix archive_dot_org submit_url
...
It was removing functional query parameters. (e.g., https://news.ycombinator.com/item?id=18216459 )
2018-10-15 13:09:31 +02:00
William Esz
8b850393df
Fix archive_dot_org CMD
...
`curl -I {url}` returns 404
2018-10-15 13:07:20 +02:00
Nick Sweeting
b1a47d775b
add sample nginx config
2018-10-13 22:47:30 -04:00
Nick Sweeting
46ad4fd163
fix python io encoding
2018-10-13 22:12:31 -04:00
Nick Sweeting
6c6bdaa3d7
add chrome sandbox option
2018-10-13 22:12:26 -04:00
Nick Sweeting
a6650dfca0
move requirements down a level
2018-10-12 23:48:15 -04:00
Nick Sweeting
5b0a5efb29
add requirements.txt
2018-10-12 23:47:06 -04:00
Nick Sweeting
b882db5828
Merge pull request #104 from nodh/fix_issue_103
...
Enable importing files from wallabag
2018-10-08 12:52:16 -04:00
Christian Kollmann
fbc90b4279
Enable importing files from wallabag
2018-10-08 18:45:51 +02:00
Nick Sweeting
0c8cfeac1f
Merge pull request #98 from Strubbl/patch-1
...
Update setup-bookmark-archiver
2018-09-24 16:32:50 -04:00
Nick Sweeting
bad3af86f9
Merge pull request #100 from Strubbl/patch-2
...
fix shaarli docu link in Readme
2018-09-24 16:32:20 -04:00
Strubbl
eec01e211e
fix shaarli docu link in Readme
2018-09-24 21:54:30 +02:00
Strubbl
f2c2568ac7
Update setup-bookmark-archiver
...
install python3-requests as a dependency, because a new bare ubuntu installation does not have it installed by default
2018-09-24 19:52:37 +02:00
Strubbl
aabe739b36
Update setup-bookmark-archiver
...
say yes to installing dependencies via apt
2018-09-24 19:31:22 +02:00
Nick Sweeting
6dafd53007
Merge pull request #97 from pigmonkey/configurableoutput
...
support a configurable output directory
2018-09-21 22:06:19 -04:00
Pig Monkey
7ed4f8deed
support a configurable output directory
...
Closes #94
2018-09-21 17:41:11 -07:00
Nick Sweeting
ae7ed7be54
Update README.md
2018-09-20 12:32:41 -04:00
Nick Sweeting
a8aeb3caad
Update README.md
2018-09-20 12:32:14 -04:00
Nick Sweeting
d46caf604d
Merge pull request #96 from fgtham/fix_issue_74
...
fix unstable sorting between consecutive runs
2018-09-19 21:55:36 -04:00
Florian Tham
5450afd18b
fixes unstable sorting between consecutive runs
2018-09-15 00:08:59 +02:00
Nick Sweeting
8a23358fc8
create robots.txt in output dir
2018-09-12 19:26:00 -04:00
Nick Sweeting
451cea47e6
Update setup-bookmark-archiver
2018-09-12 16:35:16 -04:00
root
7d4bc77439
new gitignore
2018-09-11 02:22:27 -04:00
Nick Sweeting
ff10253cef
fix user agent breaking all wgets
2018-09-10 22:31:19 -04:00
Nick Sweeting
80c02bed55
Merge pull request #88 from issmirnov/patch-1
...
Reformat gitingore into sections
2018-08-12 05:28:08 +02:00
Ivan Smirnov
59e7ad316f
Reformat gitingore into sections
2018-08-06 23:43:07 -07:00
Nick Sweeting
9e0f66c27b
fix broken archive url
2018-07-08 11:36:35 +01:00
Nick Sweeting
735f530516
hide scrollbars in screenshots
2018-06-17 19:09:09 -04:00
Nick Sweeting
738513ead8
regigger wget exception handling order
2018-06-17 19:09:01 -04:00
Nick Sweeting
70530060c2
make ts naming consistent
2018-06-17 18:35:09 -04:00
Nick Sweeting
062d2ddc98
fix archive_url broken on first run
2018-06-17 18:32:52 -04:00
Nick Sweeting
47c3d563b2
tweak index columns and footer links
2018-06-17 18:32:42 -04:00
