No description
Find a file
Siddharth Dushantha f7b5fb45bd
Merge pull request #508 from sherlock-project/sdushantha-patch-2
Use stem from PyPi insted of Git version, fixes #496
2020-01-09 15:30:42 +01:00
images renamed screenshots to images 2019-07-16 16:29:51 +02:00
tests Remove timeout global and make it available on the command line. Change default to no timeout. 2019-12-07 17:24:09 -06:00
.dockerignore ISSUE-238 Improved build steps in Dockerfile to allow caching and improved docker instructions 2019-07-13 22:18:18 +02:00
.gitignore Add an .excluded_sites list to allow pass tests 2019-12-05 14:26:17 -03:00
.travis.yml Add Python 3.8 to tests. 2019-10-19 22:29:54 -05:00
CODE_OF_CONDUCT.md Add CODE_OF_CONDUCT.md 2019-01-05 00:45:54 +03:30
CONTRIBUTING.md Update notes in contribute guide about removed sites. Add sites that were removed into a seprate json file: this will make it easier to test them in the future. 2019-10-20 06:48:39 -05:00
data.json Update version and site list. 2019-12-31 10:47:17 -06:00
data_bad_site.json Reinstate "easyen". Looks like some of the links on the site redirect to an internal index, but if you start out with a valid username, things do work. 2019-12-31 10:32:26 -06:00
docker-compose.yml Use the correct name for the image 2019-12-04 11:00:31 -03:00
Dockerfile Fixed docker file, git is not included in alpine by default 2019-12-20 14:47:16 +00:00
LICENSE updated license 2019-12-19 22:31:15 +01:00
load_proxies.py Try to back out "Fix stray f's that break on Linux" #198. The user was getting a syntax error from the format strings (probably from using an old version of Python). But, blindly removing the f-strings broke the actual functionality. 2019-05-15 07:39:39 -05:00
README.md Update version and site list. 2019-12-31 10:47:17 -06:00
removed_sites.md Reinstate "easyen". Looks like some of the links on the site redirect to an internal index, but if you start out with a valid username, things do work. 2019-12-31 10:32:26 -06:00
requirements.txt Use stem from PyPi insted of Git version 2020-01-09 15:20:07 +01:00
sherlock.py Update version and site list. 2019-12-31 10:47:17 -06:00
site_list.py Change method used to get site ranking. Not only has alexa.com changed the format of their web site, they also seem to have gotten even more picky about people scraping it. So, use their API to query the site data. 2019-05-28 07:26:30 -05:00
sites.md Update version and site list. 2019-12-31 10:47:17 -06:00


Hunt down social media accounts by username across social networks
Website docker image

Demo    |    Installation    |    Usage    |    Docker Notes    |    Adding New Sites

Demo

Use this link to test Sherlock directly in your browser: https://elody.com/scenario/plan/16/

Installation

NOTE: Python 3.6 or higher is required.

# clone the repo
$ git clone https://github.com/sherlock-project/sherlock.git

# change the working directory to sherlock
$ cd sherlock

# install python3 and python3-pip if they are not installed

# install the requirements
$ python3 -m pip install -r requirements.txt

Open in Cloud Shell

Usage

$ python3 sherlock.py --help
usage: sherlock.py [-h] [--version] [--verbose] [--rank]
                   [--folderoutput FOLDEROUTPUT] [--output OUTPUT] [--tor]
                   [--unique-tor] [--csv] [--site SITE_NAME]
                   [--proxy PROXY_URL] [--json JSON_FILE]
                   [--proxy_list PROXY_LIST] [--check_proxies CHECK_PROXY]
                   [--timeout TIMEOUT] [--print-found]
                   USERNAMES [USERNAMES ...]

Sherlock: Find Usernames Across Social Networks (Version 0.10.3)

positional arguments:
  USERNAMES             One or more usernames to check with social networks.

optional arguments:
  -h, --help            show this help message and exit
  --version             Display version information and dependencies.
  --verbose, -v, -d, --debug
                        Display extra debugging information and metrics.
  --rank, -r            Present websites ordered by their Alexa.com global
                        rank in popularity.
  --folderoutput FOLDEROUTPUT, -fo FOLDEROUTPUT
                        If using multiple usernames, the output of the results
                        will be saved to this folder.
  --output OUTPUT, -o OUTPUT
                        If using single username, the output of the result
                        will be saved to this file.
  --tor, -t             Make requests over Tor; increases runtime; requires
                        Tor to be installed and in system path.
  --unique-tor, -u      Make requests over Tor with new Tor circuit after each
                        request; increases runtime; requires Tor to be
                        installed and in system path.
  --csv                 Create Comma-Separated Values (CSV) File.
  --site SITE_NAME      Limit analysis to just the listed sites. Add multiple
                        options to specify more than one site.
  --proxy PROXY_URL, -p PROXY_URL
                        Make requests over a proxy. e.g.
                        socks5://127.0.0.1:1080
  --json JSON_FILE, -j JSON_FILE
                        Load data from a JSON file or an online, valid, JSON
                        file.
  --proxy_list PROXY_LIST, -pl PROXY_LIST
                        Make requests over a proxy randomly chosen from a list
                        generated from a .csv file.
  --check_proxies CHECK_PROXY, -cp CHECK_PROXY
                        To be used with the '--proxy_list' parameter. The
                        script will check if the proxies supplied in the .csv
                        file are working and anonymous.Put 0 for no limit on
                        successfully checked proxies, or another number to
                        institute a limit.
  --timeout TIMEOUT     Time (in seconds) to wait for response to requests.
                        Default timeout of 60.0s.A longer timeout will be more
                        likely to get results from slow sites.On the other
                        hand, this may cause a long delay to gather all
                        results.
  --print-found         Do not output sites where the username was not found.

To search for only one user:

python3 sherlock.py user123

To search for more than one user:

python3 sherlock.py user1 user2 user3

Accounts found will be stored in an individual text file with the corresponding username (e.g user123.txt).

Anaconda (Windows) Notes

If you are using Anaconda in Windows, using 'python3' might not work. Use 'python' instead.

Docker Notes

If docker is installed you can build an image and run this as a container.

docker build -t mysherlock-image .

Once the image is built, sherlock can be invoked by running the following:

docker run --rm -t mysherlock-image user123

The optional --rm flag removes the container filesystem on completion to prevent cruft build-up. See: https://docs.docker.com/engine/reference/run/#clean-up---rm

The optional -t flag allocates a pseudo-TTY which allows colored output. See: https://docs.docker.com/engine/reference/run/#foreground

Use the following command to access the saved results:

docker run --rm -t -v "$PWD/results:/opt/sherlock/results" mysherlock-image -o /opt/sherlock/results/text.txt user123

The -v "$PWD/results:/opt/sherlock/results" option tells docker to create (or use) the folder results in the present working directory and to mount it at /opt/sherlock/results on the docker container. The -o /opt/sherlock/results/text.txt option tells sherlock to output the result.

Or you can use "Docker Hub" to run sherlock:

docker run theyahya/sherlock user123

Using docker-compose

You can use the docker-compose.yml file from the repository and use this command:

docker-compose run sherlock -o /opt/sherlock/results/text.txt user123

Adding New Sites

Please look at the Wiki entry on adding new sites to understand the issues.

NOTE: Sherlock is not accepting adult sites in the standard list.

Tests

Thank you for contributing to Sherlock!

Before creating a pull request with new development, please run the tests to ensure that everything is working great. It would also be a good idea to run the tests before starting development to distinguish problems between your environment and the Sherlock software.

The following is an example of the command line to run all the tests for Sherlock. This invocation hides the progress text that Sherlock normally outputs, and instead shows the verbose output of the tests.

$ python3 -m unittest tests.all --buffer --verbose

Note that we do currently have 100% test coverage. Unfortunately, some of the sites that Sherlock checks are not always reliable, so it is common to get response errors.

If some sites are failing due to conection problems (site is down, in maintainence, etc) you can exclude them from tests by creating a tests/.excluded_sites file with a list of sites to ignore (one site name per line).

Stargazers over time

Stargazers over time

License

MIT © Sherlock Project
Original Creator - Siddharth Dushantha