h4cker/build_your_own_lab/docker_resources.md
2018-07-28 21:24:14 -04:00

22 KiB
Raw Blame History

Docker Resources

Where to start

Cheatsheets by

  • @eon01
  • [@dimonomid][docker-quick-ref] (PDF)
  • @JensPiegsa
  • [@wsargent][docker-cheat-sheet]

Container Composition

  • bocker (2) - Write Dockerfile completely in Bash. Extensible and simple. --> Reusable by @icy
  • box - Build Dockerfile images with a mruby DSL, includes flattening and layer manipulation
  • Capitan - Composable docker orchestration with added scripting support by @byrnedo.
  • compose_plantuml - Generate Plantuml graphs from docker-compose files by @funkwerk
  • Composerize - Convert docker run commands into docker-compose files
  • crowdr - Tool for managing multiple Docker containers (docker-compose alternative) by @polonskiy
  • docker-compose-graphviz - Turn a docker-compose.yml files into Graphviz .dot files by @abesto
  • draw-compose - Utility to draw a schema of a docker compose by @Alexis-benoist
  • elsy - An opinionated, multi-language, build tool based on Docker and Docker Compose
  • habitus - A Build Flow Tool for Docker by @cloud66
  • plash - A container run and build engine - runs inside docker.
  • rocker-compose - Docker composition tool with idempotency features for deploying apps composed of multiple containers. By @grammarly
  • rocker - Extended Dockerfile builder. Supports multiple FROMs, MOUNTS, templates, etc. by grammarly.
  • Stacker - Docker Compose Templates. Stacker provides an abstraction layer over Docker Compose and a better DX (developer experience).

Deployment and Infrastructure

  • blackfish - a CoreOS VM to build swarm clusters for Dev & Production by @DataMC
  • Centurion - Centurion is a mass deployment tool for Docker fleets. It takes containers from a Docker registry and runs them on a fleet of hosts with the correct environment variables, host volume mappings, and port mappings. By @newrelic
  • Clocker - Clocker creates and manages a Docker cloud infrastructure. Clocker supports single-click deployments and runtime management of multi-node applications that run as containers distributed across multiple hosts, on both Docker and Marathon. It leverages [Calico][calico] and [Weave][weave] for networking and [Brooklyn][brooklyn] for application blueprints. By @brooklyncentral
  • Conduit - Experimental deployment system for Docker by @ehazlett
  • depcon - Depcon is written in Go and allows you to easily deploy Docker containers to Apache Mesos/Marathon, Amazon ECS and Kubernetes. By [@gonodr][gondor]
  • Grafeas - A common API for metadata about containers, from image and build details to security vulnerabilities. By Grafeas

Monitoring

  • Axibase Collector - Axibase Collector streams performance counters, configuration changes and lifecycle events from the Docker engine(s) into Axibase Time Series Database for roll-up dashboards and integration with upstream monitoring systems.
  • cAdvisor - Analyzes resource usage and performance characteristics of running containers. Created by @Google
  • Docker-Alertd - Monitor and send alerts based on docker container resource usage/statistics
  • Docker-Flow-Monitor - Reconfigures Prometheus when a new service is updated or deployed automatically by [@vfarcic][vfarcic]
  • [Docker-Fluentd][fluentd] - Docker container to Log Other Containers' Logs. One can aggregate the logs of Docker containers running on the same host using Fluentd by [@kiyoto][kiyoto]
  • Glances - A cross-platform curses-based system monitoring tool written in Python by @nicolargo
  • Grafana Docker Dashboard Template - A template for your Docker, Grafana and Prometheus stack [@vegasbrianc][vegasbrianc]
  • InfluxDB, cAdvisor, Grafana - InfluxDB Time series DB in combination with Grafana and cAdvisor by [@vegasbrianc][vegasbrianc]
  • LogJam - Logjam is a log forwarder designed to listen on a local port, receive log entries over UDP, and forward these messages on to a log collection server (such as logstash) by @gocardless
  • [Logsene for Docker][spm] Monitoring of Metrics, Events and Logs implemented in Node.js. Integrated logagent-js to detect and parse various log formats. [@sematext][sematext]
  • Logspout - Log routing for Docker container logs by [@gliderlabs][gliderlabs]
  • Out-of-the-box Host/Container Monitoring/Logging/Alerting Stack - Docker host and container monitoring, logging and alerting out of the box using cAdvisor, Prometheus, Grafana for monitoring, Elasticsearch, Kibana and Logstash for logging and elastalert and Alertmanager for alerting. Set up in 5 Minutes. Secure mode for production use with built-in [Automated Nginx Reverse Proxy (jwilder's)][nginxproxy].
  • Zabbix Docker module - Zabbix module that provides discovery of running containers, CPU/memory/blk IO/net container metrics. Systemd Docker and LXC execution driver is also supported. It's a dynamically linked shared object library, so its performance is (~10x) better, than any script solution.
  • Zabbix Docker - Monitor containers automatically using zabbix LLD feature.

Networking

  • [Calico-Docker][calico] - Calico is a pure layer 3 virtual network that allows containers over multiple docker-hosts to talk to each other.
  • Flannel - Flannel is a virtual network that gives a subnet to each host for use with container runtimes. By [@coreos][coreos]
  • netshoot - The netshoot container has a powerful set of networking tools to help troubleshoot Docker networking issues by @nicolaka
  • [Weave][weave] (The Docker network) - Weave creates a virtual network that connects Docker containers deployed across multiple hosts.

Orchestration

  • athena - An automation platform with a plugin architecture that allows you to easily create and share services.
  • CloudSlang - CloudSlang is a workflow engine to create Docker process automation
  • clusterdock - Docker container orchestration to enable the testing of long-running cluster deployments
  • ContainerShip A simple container management platform
  • Crane - Control plane based on docker built-in swarm @Dataman-Cloud
  • Docker Flow Swarm Listener - Docker Flow Swarm Listener project is to listen to Docker Swarm events and send requests when a change occurs. By [@vfarcic][vfarcic]
  • Haven - Haven is a simplified container management platform that integrates container, application, cluster, image, and registry managements. By @codeabovelab
  • Helios - A simple platform for deploying and managing containers across an entire fleet of servers by @spotify
  • Kontena - Application Containers for Masses website
  • Kubernetes - Open source orchestration system for Docker containers by Google
  • ManageIQ - Discover, optimize and control your hybrid IT. By ManageIQ
  • Mantl - Mantl is a modern platform for rapidly deploying globally distributed services
  • Marathon - Marathon is a private PaaS built on Mesos. It automatically handles hardware or software failures and ensures that an app is "always on"
  • Mesos - Resource/Job scheduler for containers, VM's and physical hosts @apache
  • Nebula - A Docker orchestration tool designed to manage massive scale distributed clusters.
  • Nomad - Easily deploy applications at any scale. A Distributed, Highly Available, Datacenter-Aware Scheduler by [@hashicorp][hashicorp]
  • Rancher - An open source project that provides a complete platform for operating Docker in production by [@rancher][rancher].
  • Swarmpit - Lightweight Docker Swarm orchestration. Swarmpit provides clean way to manage your Docker Swarm cluster with various handful features such Service management, smart search, shared access and private registries.

PaaS

  • CaptainDuckDuck - Open source Heroku-like platform with a one-liner installer and a GUI for managing apps - with serveral one-click databases and apps.
  • Convox Rack - Convox Rack is open source PaaS built on top of expert infrastructure automation and devops best practices.
  • Dcw - Docker-compose SSH wrapper: a very poor man PaaS, exposing the docker-compose and custom-container commands defined in container labels.
  • [Dokku][dokku] - Docker powered mini-Heroku that helps you build and manage the lifecycle of applications (originally by [@progrium][progrium])
  • Empire - A PaaS built on top of Amazon EC2 Container Service (ECS)
  • Flynn - A next generation open source platform as a service
  • [OpenShift][openshift] - An open source PaaS built on [Kubernetes][kubernetes] and optimized for Dockerized app development and deployment by Red Hat
  • Tsuru - Tsuru is an extensible and open source Platform as a Service software
  • Workflow - The open source PaaS for Kubernetes by Deis. Formerly Deis v1.
  • ZEIT Now - A universal serverless single-command deploy for Node.js applications or any application with a Dockerfile.

Reverse Proxy

  • docker-flow-proxy - Reconfigures proxy every time a new service is deployed, or when a service is scaled. By [@vfarcic][vfarcic]
  • fabio - A fast, modern, zero-conf load balancing HTTP(S) router for deploying microservices managed by consul. By @magiconair (Frank Schroeder)
  • Let's Encrypt Nginx-proxy Companion - A lightweight companion container for the nginx-proxy. It allow the creation/renewal of Let's Encrypt certificates automatically. By @JrCs
  • muguet - DNS Server & Reverse proxy for Docker environments. By @mattallty
  • [nginx-proxy][nginxproxy] - Automated nginx proxy for Docker containers using docker-gen by [@jwilder][jwilder]
  • Swarm Ingress Router - Route DNS names to Swarm services based on labels. By @tpbowden
  • Swarm Router - A «zero config» service name based router for docker swarm mode with a fresh and more secure approach. By @flavioaiello
  • Træfɪk - Automated reverse proxy and load-balancer for Docker, Mesos, Consul, Etcd... By @EmileVauge

Security

  • Anchor Engine - Analyze images for CVE vulnerabilities and against custom security policies by [@Anchor][anchore]
  • bane - AppArmor profile generator for Docker containers by [@genuinetools][genuinetools]
  • CIS Docker Benchmark - This [InSpec][inspec] compliance profile implement the CIS Docker 1.12.0 Benchmark in an automated way to provide security best-practice tests around Docker daemon and containers in a production environment. By @dev-sec
  • Clair - Clair is an open source project for the static analysis of vulnerabilities in appc and docker containers. By [@coreos][CoreOS]
  • Dagda - Dagda is a tool to perform static analysis of known vulnerabilities, trojans, viruses, malware & other malicious threats in docker images/containers and to monitor the docker daemon and running docker containers for detecting anomalous activities. By @eliasgranderubio
  • docker-bench-security - script that checks for dozens of common best-practices around deploying Docker containers in production. By [@docker][docker]
  • notary - a server and a client for running and interacting with trusted collections. By @TUF
  • oscap-docker - OpenSCAP provides oscap-docker tool which is used to scan Docker containers and images. By RedHat
  • Sysdig Falco - Sysdig Falco is an open source container security monitor. It can monitor application, container, host, and network activity and alert on unauthorized activity.

Service Discovery

  • docker-consul by [@progrium][progrium]
  • etcd - A highly-available key value store for shared configuration and service discovery by [@coreOS][coreos]
  • istio - An open platform to connect, manage, and secure microservices by @IstioMesh
  • registrator - Service registry bridge for Docker by [@gliderlabs][gliderlabs] and [@progrium][progrium]

Volume Management / Data

  • Blockbridge - The Blockbridge plugin is a volume plugin that provides access to an extensible set of container-based persistent storage options. It supports single and multi-host Docker environments with features that include tenant isolation, automated provisioning, encryption, secure deletion, snapshots and QoS. By [@blockbridge][blockbridge]
  • Convoy - an open-source Docker volume driver that can snapshot, backup and restore Docker volumes anywhere. By [@rancher][rancher]
  • Docker Machine NFS Activates NFS for an existing boot2docker box created through Docker Machine on OS X.
  • Docker Unison A docker volume container using Unison for fast two-way folder sync. Created as an alternative to slow boot2docker volumes on OS X. By @leighmcculloch
  • Local Persist Specify a mountpoint for your local volumes (created via docker volume create) so that files will always persist and so you can mount to different directories in different containers.
  • Minio - S3 compatible object storage server in Docker containers
  • Netshare Docker NFS, AWS EFS, Ceph & Samba/CIFS Volume Plugin. By @ContainX
  • REX-Ray provides a vendor agnostic storage orchestration engine. The primary design goal is to provide persistent storage for Docker, Kubernetes, and Mesos. By@thecodeteam (DELL Technologies)

Awesome Lists

Videos