ctf-tools/README.md

ctf-tools

This is a collection of setup scripts to create an install of various security research tools. Of course, this isn't a hard problem, but it's really nice to have them in one place that's easily deployable to new machines and so forth. The install-scripts for these tools are checked regularly, the results can be found on the build status page.

Installers for the following tools are included:

Category	Tool	Description
binary	afl	State-of-the-art fuzzer.
binary	angr	Next-generation binary analysis engine from Shellphish.
binary	barf	Binary Analysis and Reverse-engineering Framework.
binary	bindead	A static analysis tool for binaries.
binary	checksec	Check binary hardening settings.
binary	codereason	Semantic Binary Code Analysis Framework.
binary	crosstool-ng	Cross-compilers and cross-architecture tools.
binary	cross2	A set of cross-compilation tools from a Japanese book on C.
binary	elfkickers	A set of utilities for working with ELF files.
binary	elfparser	Quickly determine the capabilities of an ELF binary through static analysis.
binary	evilize	Tool to create MD5 colliding binaries
binary	gdb	Up-to-date gdb with python2 bindings.
binary	gdb-heap	gdb extension for debugging heap issues.
binary	gef	Enhanced environment for gdb.
binary	hongfuzz	A general-purpose, easy-to-use fuzzer with interesting analysis options.
binary	libheap	gdb python library for examining the glibc heap (ptmalloc)
binary	miasm	Reverse engineering framework in Python.
binary	one_gadget	Magic gadget search for libc.
binary	panda	Platform for Architecture-Neutral Dynamic Analysis.
binary	pathgrind	Path-based, symbolically-assisted fuzzer.
binary	peda	Enhanced environment for gdb.
binary	preeny	A collection of helpful preloads (compiled for many architectures!).
binary	pwndbg	Enhanced environment for gdb. Especially for pwning.
binary	pwntools	Useful CTF utilities.
binary	python-pin	Python bindings for pin.
binary	qemu	Latest version of qemu!
binary	qira	Parallel, timeless debugger.
binary	radare2	Some crazy thing crowell likes.
binary	rappel	A linux-based assembly REPL.
binary	ropper	Another gadget finder.
binary	rp++	Another gadget finder.
binary	rr	Record and Replay Debugging Framework
binary	scratchabit	Easily retargetable and hackable interactive disassembler
binary	scratchablock	Yet another crippled decompiler project
binary	seccomp-tools	Provides powerful tools for seccomp analysis
binary	shellnoob	Shellcode writing helper.
binary	shellsploit	Shellcode development kit.
binary	snowman	Cross-architecture decompiler.
binary	taintgrind	A valgrind taint analysis tool.
binary	valgrind	A Dynamic Binary Instrumentation framwork with some built-in tools.
binary	villoc	Visualization of heap operations.
binary	virtualsocket	A nice library to interact with binaries.
binary	wcc	The Witchcraft Compiler Collection is a collection of compilation tools to perform binary black magic on the GNU/Linux and other POSIX platforms.
binary	xrop	Gadget finder.
binary	manticore	Manticore is a prototyping tool for dynamic binary analysis, with support for symbolic execution, taint analysis, and binary instrumentation.
forensics	binwalk	Firmware (and arbitrary file) analysis tool.
forensics	dislocker	Tool for reading Bitlocker encrypted partitions.
forensics	exetractor	Unpacker for packed Python executables. Supports PyInstaller and py2exe.
forensics	firmware-mod-kit	Tools for firmware packing/unpacking.
forensics	pdf-parser	Tool for digging in PDF files
forensics	peepdf	Powerful Python tool to analyze PDF documents.
forensics	scrdec	A decoder for encoded Windows Scripts.
forensics	testdisk	Testdisk and photorec for file recovery.
crypto	cribdrag	Interactive crib dragging tool (for crypto).
crypto	fastcoll	An md5sum collision generator.
crypto	foresight	A tool for predicting the output of random number generators. To run, launch "foresee".
crypto	featherduster	An automated, modular cryptanalysis tool.
crypto	galois	A fast galois field arithmetic library/toolkit.
crypto	hashkill	Hash cracker.
crypto	hashpump	A tool for performing hash length extension attaacks.
crypto	hashpump-partialhash	Hashpump, supporting partially-unknown hashes.
crypto	hash-identifier	Simple hash algorithm identifier.
crypto	libc-database	Build a database of libc offsets to simplify exploitation.
crypto	littleblackbox	Database of private SSL/SSH keys for embedded devices.
crypto	msieve	Msieve is a C library implementing a suite of algorithms to factor large integers.
crypto	nonce-disrespect	Nonce-Disrespecting Adversaries: Practical Forgery Attacks on GCM in TLS.
crypto	pemcrack	SSL PEM file cracker.
crypto	pkcrack	PkZip encryption cracker.
crypto	python-paddingoracle	Padding oracle attack automation.
crypto	reveng	CRC finder.
crypto	ssh_decoder	A tool for decoding ssh traffic. You will need ruby1.8 from https://launchpad.net/~brightbox/+archive/ubuntu/ruby-ng to run this. Run with ssh_decoder --help for help, as running it with no arguments causes it to crash.
crypto	sslsplit	SSL/TLS MITM.
crypto	xortool	XOR analysis tool.
crypto	yafu	Automated integer factorization.
web	burpsuite	Web proxy to do naughty web stuff.
web	commix	Command injection and exploitation tool.
web	dirb	Web path scanner.
web	dirsearch	Web path scanner.
web	mitmproxy	CLI Web proxy and python library.
web	sqlmap	SQL injection automation engine.
web	subbrute	A DNS meta-query spider that enumerates DNS records, and subdomains.
stego	sound-visualizer	Audio file visualization.
stego	steganabara	Another image steganography solver.
stego	stegdetect	Steganography detection/breaking tool.
stego	stegsolve	Image steganography solver.
stego	zsteg	detect stegano-hidden data in PNG & BMP.
android	apktool	Dissect, dis-assemble, and re-pack Android APKs
android	android-sdk	The android SDK (adb, emulator, etc).
misc	xspy	Tiny tool to spy on X sessions.
misc	z3	Theorem prover from Microsoft Research.
misc	jdgui	Java decompiler.
misc	veles	Binary data analysis and visulalization tool.
misc	youtube-dl	Latest version of the popular youtube downloader.

There are also a couple of installers for useful libraries included. Currently only the python bindings for these libraries are installed.

Category	Library	Description
binary	capstone	Multi-architecture disassembly framework.
binary	keystone	Lightweight multi-architecture assembler framework.
binary	unicorn	Multi-architecture CPU emulator framework.
binary	lief	Library to Instrument Executable Formats.

There are also some installers for non-CTF stuff to break the monotony!

Category	Tool	Description
game	Dwarf Fortress	Something to help you relax after a CTF!
tor-browser	tor-browser	Useful when you need to hit a web challenge from different IPs.
pyvmmonitor	pyvmmonitor	PyVmMonitor is a profiler with a simple goal: being the best way to profile a Python program.

Usage

To use, do:

# set up the path
/path/to/ctf-tools/bin/manage-tools setup
source ~/.bashrc

# list the available tools
manage-tools list

# install gdb, allowing it to try to sudo install dependencies
manage-tools -s install gdb

# install pwntools, but don't let it sudo install dependencies
manage-tools install pwntools

# uninstall gdb
manage-tools uninstall gdb

# uninstall all tools
manage-tools uninstall all

# search for a tool
manage-tools search preload

Where possible, the tools keep the installs very self-contained (i.e., in to tool/ directory), and most uninstalls are just calls to git clean (NOTE, this is NOT careful; everything under the tool directory, including whatever you were working on, is blown away during an uninstall). One exception to this are python tools, which are installed using the pip package manager if possible. A ctftools virtualenv is created during the manage-tools setup command and can be accessed using the command workon ctftools.

Help!

Something not working? I didn't write (almost) any of these tools, but hit up #ctf-tools on freenode if you're desperate. Maybe some kind soul will help!

Docker (version 1.7+)

By popular demand, a Dockerfile has been included. You can build a docker image with:

git clone https://github.com/zardus/ctf-tools
docker build -t ctf-tools .

And run it with:

docker run -it ctf-tools

The built image will have ctf-tools cloned and ready to go, but you will still need to install the tools themselves (see above).

Alternatively, you can also pull ctf-tools (with some tools preinstalled) from dockerhub:

docker run -it zardus/ctf-tools

Vagrant

You can build a Vagrant VM with:

wget https://raw.githubusercontent.com/zardus/ctf-tools/master/Vagrantfile
vagrant up

And connect to it via:

vagrant ssh

Kali Linux

Kali Linux (Sana and Rolling), due to manually setting certain libraries to not use the latest version available (sometimes being out of date by years) causes some tools to not install at all, or fail in strange ways. AFL and Panda comes to mind, in fact any tool that uses QEMU 2.30 will probably fail during compilation under Kali. Overriding these libraries breaks other tools included in Kali so your only solution is to either live with some of Kali's tools being broken, or running another distribution seperately such as Ubuntu.

Most tools aren't affected though.

Adding Tools

To add a tool (say, named toolname), do the following:

1. Create a toolname directory.
2. Create an install script.
3. (optional) if special uninstall steps are required, create an uninstall script.

Install Scripts

The install script will be run with $PWD being toolname. It should install the tool into this directory, in as contained a manner as possible. Ideally, full uninstallation should be possible with a git clean.

The install script should create a bin directory and put its executables there. These executables will be automatically linked into the main bin directory for the repo. They could be launched from any directory, so don't make assumptions about the location of $0!

License

The individual tools are all licensed under their own licenses. As for ctf-tools itself, it is "starware". If you find it useful, star it on github (https://github.com/zardus/ctf-tools).

Good luck!

See Also

There's a curated list of CTF tools, but without installers, here: https://github.com/apsdehal/aWEsoMe-cTf.

There's a Vagrant config with a lot of the bigger frameworks here: https://github.com/thebarbershopper/epictreasure.

Tools in the official Debian/Ubuntu repos

These tools are present in the Debian or Ubuntu repos (in an adequately new version). They're not included in ctf-tools, but are included here as notes for the author.

Category	Package	Description	Package
forensics	foremost	File carver.	foremost
dsniff	dsniff	Grabs passwords and other data from pcaps/network streams.	dsniff
stego	pngtools	PNG's analysis tool.

Tools with unofficial Debian/Ubuntu repos or debs

Category	Package	Description	Repo/deb
stego	sound-visualizer	Audio file visualization.	deb