Ansible NAS

After getting burned by broken FreeNAS updates one too many times, I figured I could do a much better job myself using just a stock Ubuntu install, some clever Ansible config and a bunch of Docker containers.

What Ansible-NAS Can Set Up

• An awesome dashboard to your home server (Heimdall)
• Any number of Samba shares or NFS exports for you to store your stuff
• A BitTorrent client
• A Usenet downloader
• Various media management tools - Sonarr, Sickchill, CouchPotato, Radarr, Bazarr
• Media streaming via Plex, Emby or Jellyfin
• Music streaming with Airsonic
• An RSS newsfeed reader - Miniflux
• A Dropbox replacement via Nextcloud
• Various ways to see stats about your NAS - Glances, dashboards in Grafana
• A backup tool - allows scheduled backups to Amazon S3, OneDrive, Dropbox etc
• An IRC bouncer and web-based client
• Source control with Gitea
• SSL secured external access to applications via Traefik
• A Docker host with Portainer for image and container management
• An automatic dynamic DNS updater if you use Cloudflare to host your domain DNS
• A Personal finance manager
• eBook management with calibre-web
• Content management with Joomla
• A dual panel local file manager
• Self-service media request web application

Docker Containers Used

• Airsonic - catalog and stream music
• Bazarr - companion to Radarr and Sonarr for downloading subtitles
• Bitwarden_rs - Self-Hosting port of password manager
• Calibre - eBook Library
• Cloud Commander - A dual panel file manager with integrated web console and text editor
• Cloudflare DDNS - automatically update Cloudflare with your IP address
• CouchPotato - for downloading and managing movies
• Duplicati - for backing up your stuff
• Emby - Media streaming and management
• Firefly III - Free and open source personal finance manager
• get_iplayer - download programmes from BBC iplayer
• Gitea - Self-hosted Github clone
• Glances - for seeing the state of your system via a web browser
• Grafana - Dashboarding tool
• Guacamole - Web based remote desktop gateway, supports VNC, RDP and SSH
• Heimdall - Home server dashboard
• Home Assistant - Open source home automation
• InfluxDB - Time series database used for stats collection
• Jackett - API Support for your favorite torrent trackers
• Jellyfin - The Free Software Media System
• Joomla - Open source content management system
• MiniDlna - simple media server which is fully compliant with DLNA/UPnP-AV clients
• Miniflux - An RSS news reader
• Mosquitto - An open source MQTT broker
• MyMediaForAlexa - Lets you stream your music collection to your alexa device
• Netdata - An extremely comprehensive system monitoring solution
• Nextcloud - A self-hosted Dropbox alternative
• NZBget - The most efficient usenet downloader
• Ombi - web application that automatically gives your users the ability to request content
• openHAB - A vendor and technology agnostic open source automation software for your home
• Plex - Plex Media Server
• Portainer - for managing Docker and running custom images
• pyLoad - A download manager with a friendly web-interface
• Radarr - for organising and downloading movies
• Sickchill - for managing TV episodes
• Sonarr - for downloading and managing TV episodes
• Tautulli - Monitor Your Plex Media Server
• Telegraf - Metrics collection agent
• The Lounge - Web based always-on IRC client
• TimeMachine - Samba-based mac backup server
• Traefik - Web proxy and SSL certificate manager
• Transmission - BitTorrent client (with OpenVPN if you have a supported VPN provider)
• Wallabag - Save and classify articles. Read them later.
• Watchtower - Monitor your Docker containers and update them if a new version is available
• ZNC - IRC bouncer to stay connected to favourite IRC networks and channels

What This Could Do

Ansible-NAS can run anything that's in a Docker image, which is why Portainer is included. A NAS configuration is a pretty personal thing based on what you download, what media you view, how many photos you take...so it's difficult to please everyone.

That said, if specific functionality you want isn't included and you think others could benefit, add it and raise a PR!

What This Doesn't Do

Ansible NAS doesn't set up your disk partitions, primarily because getting it wrong can be incredibly destructive. That aside, configuring partitions is usually a one-time (or very infrequent) event, so there's not much to be gained by automating it. Check out the docs for recommended setups.

Quick Start

💀 Before running anything, check out the playbook and understand what it does. Run it against a VM and make sure you're happy. Do not blindly download code from the internet and trust that it's going to work as you expect. 💀

1. Enable the Ubuntu Universe repository: sudo add-apt-repository universe
2. Install Ansible: sudo apt install ansible
3. git clone https://github.com/davestephens/ansible-nas.git && cd ansible-nas
4. Copy group_vars/all.yml.dist to group_vars/all.yml.
5. Open up group_vars/all.yml and follow the instructions there for configuring your Ansible NAS.
6. If you plan to use Transmission with OpenVPN, also copy group_vars/vpn_credentials.yml.dist to group_vars/vpn_credentials.yml and fill in your settings.
7. Copy inventory.dist to inventory and update it.
8. Install the dependent roles: ansible-galaxy install -r requirements.yml (you might need sudo to install Ansible roles)
9. Run the playbook - something like ansible-playbook -i inventory nas.yml -b -K should do you nicely.

Documentation

You can read the docs here. PRs for more documentation always welcome!

Migrating from FreeNAS

Assuming that your Ubuntu system disk is separate from your storage (it should be!):

1. Ensure you have a working backup of your data.
2. Check that the working backup you think you have actually works.
3. SSH to the server and run zpool list to determine available ZFS pools.
4. zpool import <pool_name> against each of the pools you want to attach.
5. chown -R root:root /mnt/<pool_name> to fix the ownership of the data.
6. Follow the Quick Start instructions above.

Requirements

• Ansible NAS targets the latest Ubuntu LTS release, which is currently Ubuntu Server 18.04.3 LTS.
• You can run Ansible-NAS on whatever you like, read the docs for more info. I use an HP Microserver.

Getting Help

Getting help is easy! You can:

• Read the docs
• Raise an issue
• Chat on Gitter

Contributing

Contributions are welcome, please feel free to raise a PR!

• Restrict pull requests to one piece of functionality or bugfix at a time.
• Test your new functionality or bugfix using the included tests/test-vagrant.sh script to spin up a test VM. Note that Ansible-NAS requires Vagrant version 2.2.2 or later, so for stock Ubuntu 18.04.2, you will have to download and install the newest version from https://www.vagrantup.com/downloads.html.
• Run ansible-lint against the playbook before committing. (There is a VSCode task set up to run the right command for you)
• Please know that your efforts are appreciated, thanks! 👍

Development of Ansible-NAS is carried out in Visual Studio Code - you'll get some nice recommended extensions and task setups if you do the same.

Support

If you've enjoyed Ansible-NAS as much as I do working on it, please consider buying me a coffee ☕

Thanks

Thanks to the awesome dudes at JetBrains for supplying core contributors with JetBrains Open Source licenses!