Commit graph

2461 commits

Author SHA1 Message Date
Yahya SayadArbabi
d1ef3f6f0b Merge branch 'naueramant_master' 2019-01-03 03:56:28 +03:30
Yahya SayadArbabi
b7da0e9781 Merge branch 'JonanOribe_patch-1' 2019-01-03 03:48:28 +03:30
Jonas Tranberg
de31a311ef Added 9GAG support 2019-01-02 20:45:49 +01:00
Jon Ander Oribe
005e9591c1
Adding a counter of resources
At the end of the process we can see how many results we have
2019-01-02 16:43:38 +01:00
Yahya SayadArbabi
f7daae14e3 Merge branch 'cclauss_patch-3' 2019-01-02 13:25:47 +03:30
Yahya SayadArbabi
85c80952c9 Merge branch 'simplify_print_error' 2019-01-02 13:18:54 +03:30
Chris Blumentritt
b96da0b547 Adding docker support 2018-12-31 14:53:27 -06:00
Christopher K. Hoadley
448f072e36 Merge branch 'pr/n49_cblument' 2018-12-31 09:59:15 -06:00
Chris Blumentritt
ce53663331 Use os.path.join to build file path for data file
fixes #47
2018-12-31 09:46:42 -06:00
Christopher K. Hoadley
8090a96c57 Fix merge problem in pull request #43. Previously, there was just one for loop that iterated thru all of the sites. But, with the addition of the parallel functionality, there are now two for loops. The dictionary changes were not done in the second loop, which caused bogus results. 2018-12-31 06:08:20 -06:00
cclauss
05cbeb5c2c
Add a shebang line: #! /usr/bin/env python3 2018-12-31 08:32:35 +01:00
cclauss
c0ac0d9f9d
Update sherlock.py 2018-12-31 07:44:27 +01:00
cclauss
96c3ce7625
Simplify print_error() 2018-12-31 07:40:05 +01:00
cclauss
3200eb3ad5
Run isort on the imports
[isort](https://github.com/timothycrosley/isort/blob/develop/README.rst) cleans up the imports for readability.
2018-12-31 07:27:54 +01:00
Chris Blumentritt
cf7ec54f23 Script can now load the data.json file when invoked from different directory
If the script is run from a different directory than the where it
resides then it would fail to load because it could not find data.json.
fixes #47
2018-12-30 23:52:23 -06:00
Christopher K. Hoadley
f9d59270a3 Merge branch 'pr/n43_cclauss'. Use new pattern for getting "urlMain" data as well. 2018-12-30 18:22:30 -06:00
Christopher K. Hoadley
e2c4dbf1ef Merge branch 'pr/n4_svisser' 2018-12-30 17:46:02 -06:00
cclauss
28f023a339
Use dict.get() on optional parameters 2018-12-30 23:39:08 +01:00
cclauss
60555eeda7
Use dict.items() to simplify interaction with dict (again)
#20 again...
2018-12-30 23:22:29 +01:00
Siddharth Dushantha
03c41ee555
Version bump
From now on, the version will be the date and the format is from big to small. Year, Month, Day. 
Just like youtube-dl does it.
2018-12-30 21:39:45 +01:00
Siddharth Dushantha
3105a79b86
new version and version format
From now on, the version will be the date and the format is from big to small. Year, Month, Day
2018-12-30 21:37:38 +01:00
Siddharth Dushantha
57a4448264
modified the comment about the user agent #41 2018-12-30 21:25:04 +01:00
Christopher K. Hoadley
4ecaad6289 Update script to use with-as structure for files. Add number of supported sites to title. Add status message. 2018-12-30 11:50:10 -06:00
Christopher K. Hoadley
d97338c8bb Merge branch 'pr/n22_anto-christo' 2018-12-30 11:27:51 -06:00
Christopher Kent Hoadley
6257015550
Merge pull request #39 from boardens/patch-1
Added support for 14 social networks.  We really need to agree on the Scope Of Sherlock, but there is no reason to not add these in.
2018-12-30 11:22:08 -06:00
Christopher K. Hoadley
55b6ffa5ba Simeon Visser noticed that "enforce utf-8 encoding when we open data.json" (#8) got undone in the previous merge. Include it again. 2018-12-30 11:16:15 -06:00
Siddharth Dushantha
fe2feff7a7
Added the image back. 2018-12-30 09:46:59 +01:00
Siddharth Dushantha
0f9519365f
Merge pull request #3 from nareddyt/async-requests
Run HTTP requests in parallel
2018-12-30 07:26:16 +01:00
Tejasvi Nareddy
78a3451c03 Merge remote-tracking branch 'upstream/master' into async-requests
# Conflicts:
#	.gitignore
#	requirements.txt
#	sherlock.py
2018-12-30 00:10:31 -05:00
anto-christo
a3ff122d9d Add link to sites.md in readme and merge with master 2018-12-30 04:57:10 +05:30
anto-christo
26adc32497 Add script for listing sites in sites.md 2018-12-30 04:46:43 +05:30
Boardens
fd11e601f3
Added support for 14 social networks
Changes :
- Added Pixabay
- Added Giphy
- Added Taringa
- Added SourceForge
- Added Codepen
- Added Launchpad
- Added Photobucket
- Added Wix
- Added Crevado
- Added Carbonmade
- Added Coroflot
- Added Jimdo
- Added Repl.it
- Added Issuu

Notes:
- Unable to add Twitch, Tumblr, Big Cartel, Trello.
2018-12-29 23:31:36 +01:00
Christopher Kent Hoadley
9b83571981
Merge pull request #31 from mpieters93/tor
Added options to connect over TOR
2018-12-29 09:33:13 -06:00
mpieters93
51ce9fc10b
Merge branch 'master' into tor 2018-12-29 15:59:30 +01:00
Siddharth Dushantha
ff2f26eb3f
Merge pull request #35 from rajdeepbharati/master
Added support for Quora.
2018-12-29 13:18:59 +01:00
Rajdeep Bharati
373083446e Added support for Quora. 2018-12-29 11:20:18 +05:30
Christopher K. Hoadley
601d3d9495 Update readme with new csv option. 2018-12-28 22:55:13 -06:00
Christopher Kent Hoadley
9f72252564
Merge pull request #33 from sdushantha/hoadlck-csv
Add CSV Report For Results
2018-12-28 22:37:15 -06:00
Christopher K. Hoadley
d9e600d05d Add support for writing to Comma-Separated Values (CSV) File with all of the results. Unfortunately, the request text is so long that it is not visible in spreadsheet programs. So, I am leaving this off for now. 2018-12-28 22:32:30 -06:00
Christopher K. Hoadley
b17072b3cd Change sherlock method to return dictionary summarizing all results. This will allow the caller to have raw information for other reports. 2018-12-28 22:28:47 -06:00
Mike Pieters
6cd18fb5bb Update README to reflect added TOR arguments 2018-12-29 03:27:31 +01:00
Mike Pieters
feef27b2e4 Removed accidental whitespace 2018-12-29 02:45:19 +01:00
Christopher Kent Hoadley
b9ff065932
Merge pull request #28 from MagicFab/patch-1
Update README.MD with Python 3.6 (or later) requirement
2018-12-28 19:44:09 -06:00
Christopher K. Hoadley
7d4f1c68ff Add main URL for each social networking site. This is needed for future development (e.g. csv report generation, and autogeneraton of supported site report). Wanted to get this in early so that anyone adding more social network sites in the future would know to put this other piece of information in. 2018-12-28 19:38:26 -06:00
Mike Pieters
49f65021bb Adds option to use new TOR circuit for each request 2018-12-29 02:31:31 +01:00
Fabian Rodriguez
7f26889de4
Update README.md for Python 3.6+ req.
Update README.md for Python 3.6+ req.
2018-12-28 19:59:04 -05:00
Mike Pieters
b2cb0506a3 Adds option to connect over TOR 2018-12-29 01:50:25 +01:00
Christopher Kent Hoadley
3d971d573a
Merge pull request #29 from aggiebill/patch-1
Ignore txt files, except requirements.txt
2018-12-28 16:49:02 -06:00
Aggie Bill
01a64ba172
Ignore txt files, except requirements.txt 2018-12-28 17:44:01 -05:00
Siddharth Dushantha
c3d8a669f1
modified the description of Sherlock 2018-12-28 21:56:54 +01:00