Mirrors/ArchiveBox
2
0
Fork 0
mirror of https://github.com/ArchiveBox/ArchiveBox synced 2024-11-23 04:33:11 +00:00
Code Issues Projects Releases Packages Wiki Activity
No description
484 commits 6 branches 78 tags 19 MiB
Python 70.1%
HTML 25.9%
Shell 2.5%
Dockerfile 0.9%
CSS 0.6%
Find a file
Nick Sweeting f25be8bc24 add chrome user agent example in config
2019-01-20 14:08:33 -05:00
.github fix coc email 2018-12-21 18:22:40 -05:00
archivebox add chrome user agent example in config 2019-01-20 14:08:33 -05:00
bin install youtubedl in setup 2019-01-12 03:14:07 -05:00
docs@428ae5422f update docs 2019-01-14 22:43:14 -05:00
etc fix etc nginx and Docker config 2019-01-16 09:20:15 -05:00
.dockerignore fix etc nginx and Docker config 2019-01-16 09:20:15 -05:00
.gitignore Update .gitignore 2018-12-31 20:57:12 -05:00
.gitmodules add docs 2018-12-31 20:59:36 -05:00
_config.yml Set theme jekyll-theme-merlot 2019-01-10 14:00:41 -05:00
archive fix the setup/archive symlinks 2018-12-21 22:10:25 +00:00
CNAME Create CNAME 2018-12-31 21:18:34 -05:00
docker-compose.yml fix etc nginx and Docker config 2019-01-16 09:20:15 -05:00
Dockerfile fix etc nginx and Docker config 2019-01-16 09:20:15 -05:00
LICENSE Initial commit 2017-05-05 04:50:15 -04:00
README.md Update README.md 2019-01-18 17:45:48 -05:00
setup clean up binaries in PATH 2018-12-21 18:21:03 -05:00

README.md

Logo

ArchiveBox
The open source self-hosted web archive Github Stars Twitter URL

(Recently renamed from Bookmark Archiver)

"Your own personal Way-Back Machine"

💻 Demo | Website | Source | Changelog | Roadmap

▶️ Quickstart | Details | Configuration | Troubleshooting

ArchiveBox saves an archived copy of the websites you visit into a local browsable folder (the actual content of each site, not just the list of links). It can archive your entire browsing history, or import links from bookmarks managers, rss, text files and more.

Can import links from:

  • Browser history or bookmarks (Chrome, Firefox, Safari, IE, Opera)
  • Pocket
  • Pinboard
  • RSS or plain text lists
  • Shaarli, Delicious, Instapaper, Reddit Saved Posts, Wallabag, Unmark.it, and more!

Can save these things for each site:

  • Favicon
  • Browsable static HTML archive (wget)
  • PDF (Chrome headless)
  • Screenshot (Chrome headless)
  • HTML DUMP after 2s of JS running in Chrome headless
  • Git repo download (git clone)
  • Media download (youtube-dl: video, audio, subtitles, including playlists)
  • WARC archive (wget warc)
  • Submits URL to archive.org
  • Index summary pages: index.html & index.json

The archiving is additive, so you can schedule ./archive to run regularly and pull new links into the index. All the saved content is static and indexed with JSON files, so it lives forever & is easily parseable, it requires no always-running backend.

DEMO: archive.sweeting.me 网站存档 / 爬虫

git clone https://github.com/pirate/ArchiveBox.git
cd ArchiveBox
./setup

# Export your bookmarks, then run the archive command to start archiving!
./archive ~/Downloads/firefox_bookmarks.html

# Or to add just one page to your archive
echo 'https://example.com' | ./archive

Documentation

We use the Github wiki system for documentation.

You can also access the docs locally by looking in the ArchiveBox/docs/ folder.

Getting Started

Reference

More Info

Screenshots

Desktop ScreenshotMobile Screenshot
CLI Screenshot

Twitter URL