Christopher K. Hoadley
5d16a720a5
Update site list and version.
2019-12-24 16:57:32 -06:00
Christopher K. Hoadley
e0d2102810
Limit Number Of Parallel Requests To 20 (Instead Of Number Of Sites)
...
Previous code was allocating room for as many workers as there was sites. The problem is that as the number of sites has grown, there has not been enough memory to allocate all of those requests. In reality, having all of these requests in parallel does not really speed the processing: on my computer, the time to do a query for all of the sites was 1 minute 10 seconds before the change, and was 1 minute 9 seconds after the change.
Limiting the number of workers to 10 did increase the query time to 1 minute 17s. I am not sure if that is just inconsistencies in network traffic, but I will leave the limit at 20 for now.
Note that with the limit of 20, my query detected more sites than it did previously. It appears that some of the requests were failing on my computer because of memory reasons (as opposed to actual detection on the site).
2019-12-24 16:56:10 -06:00
Christopher K. Hoadley
4b6d2c1166
Do not create session and request objects if we are going to end up creating new one for Tor requests. This just wastes time.
2019-12-24 16:25:37 -06:00
Siddharth Dushantha
e664273746
added d3RU, fixes #470
2019-12-24 10:12:25 +01:00
Siddharth Dushantha
94141f1818
Merge pull request #469 from AL3INO/master
...
Fixed_LabPentestIt
2019-12-21 18:48:27 +01:00
AL3INO
de00894c1e
Updated data.json
...
Fixed username_claimed for labpentestit
2019-12-21 23:21:34 +11:00
Siddharth Dushantha
2723553069
added labpentestit
2019-12-20 20:59:29 +01:00
Siddharth Dushantha
8bc9ee39a3
added datingRU
2019-12-20 18:10:39 +01:00
Siddharth Dushantha
4a7662b08e
added hackster
2019-12-20 10:10:24 +01:00
Siddharth Dushantha
475ad6abd0
version bump 0.9.15 --> 0.9.16
2019-12-20 10:03:27 +01:00
Siddharth Dushantha
b4dafa1742
Merge pull request #463 from Scoder12/no-color
...
Add --no-color option
2019-12-20 10:00:31 +01:00
Scoder12
e8949666fb
Add --no-color option
2019-12-19 15:37:12 -08:00
Siddharth Dushantha
d6410268ee
updated license
2019-12-19 22:31:15 +01:00
Siddharth Dushantha
a739ebf0e7
changed copyright holder to Sherlock Project
2019-12-19 22:30:42 +01:00
Siddharth Dushantha
f63e17066d
added a few more sites
2019-12-18 21:38:55 +01:00
Siddharth Dushantha
c864318b6f
Removed install_packages.sh
...
It is not really useful because people who are using this script use Linux and all Linux distros come with Python and pip, so there is no need to have a script to install it. Also, it only works on Linux.
2019-12-18 21:22:55 +01:00
Siddharth Dushantha
d5c0e2a9c2
Merge pull request #449 from LameLemon/bodybuilding
...
Added BodyBuilding
2019-12-13 14:02:46 +01:00
Lame Lemon
bbedf13071
Added BodyBuilding
2019-12-13 12:27:10 +00:00
Siddharth Dushantha
bfa73e8165
Version bump 0.9.14 --> 0.9.15
2019-12-13 12:54:05 +01:00
Siddharth Dushantha
937f562456
Merge pull request #448 from boschhd/patch-1
...
Remove an extra space in data.json
2019-12-13 12:52:17 +01:00
Harald Bosch
f0d314771c
Remove an extra space in data.json
...
Fix #447
Remove an extra space in data.json which causes a KeyError
2019-12-13 11:33:37 +01:00
Siddharth Dushantha
d9c6a987a4
Merge pull request #444 from Czechball/master
...
added 7 new sites
2019-12-12 19:36:25 +01:00
Czechball
499392dc6a
added GunsAndAmmo
2019-12-12 16:16:13 +01:00
Czechball
0c73df829b
added akniga
2019-12-12 16:14:50 +01:00
Czechball
7827f0f978
added leasehackr
2019-12-12 16:13:13 +01:00
Czechball
bae5316e51
added HackTheBox
2019-12-12 16:12:10 +01:00
Czechball
7bbd7767a7
added TrashboxRU
2019-12-12 16:11:11 +01:00
Czechball
11bacb3382
added babyRU and babyblogRU
2019-12-12 16:08:43 +01:00
Siddharth Dushantha
a6f7884480
Merge pull request #442 from Czechball/master
...
added 3 new sites
2019-12-12 06:10:25 +01:00
Czechball
43c5605576
Merge https://github.com/sherlock-project/sherlock
2019-12-09 10:01:33 +01:00
Christopher K. Hoadley
6d28376ad0
Merge remote-tracking branch 'origin/master'
2019-12-08 07:30:50 -06:00
Christopher K. Hoadley
69b818bb3b
Update version and help text.
2019-12-08 07:30:02 -06:00
Christopher K. Hoadley
fdc45b9f2c
Update user URL for CashMe. Looks like the site changed their layout.
2019-12-08 07:29:15 -06:00
Siddharth Dushantha
d6694fc954
added spletnik, fixes #434
2019-12-08 12:34:18 +01:00
Christopher K. Hoadley
15157fd7da
Update version and help text.
2019-12-07 17:43:09 -06:00
Christopher K. Hoadley
4f1e2d0545
Update site list.
2019-12-07 17:42:45 -06:00
Christopher K. Hoadley
dc9813fa8d
Fix Avizo name.
2019-12-07 17:40:46 -06:00
Christopher K. Hoadley
7e2eb5bab3
Clean up code that only reads the headers if we are doing HTTP Status detection. Remove special check for GitHub: everything works fine without it.
2019-12-07 17:29:07 -06:00
Christopher K. Hoadley
208db5a7c1
Remove unneeded assignment of results before main Sherlock call.
2019-12-07 17:27:11 -06:00
Christopher K. Hoadley
a228a00753
Clarify meaning of "Total Websites" count. It is really "Total Websites Username Detected On".
2019-12-07 17:25:18 -06:00
Christopher K. Hoadley
2c2c6dd42f
Get rid of global variable amount. This is no longer used.
2019-12-07 17:24:48 -06:00
Christopher K. Hoadley
b1efe75eee
Remove timeout global and make it available on the command line. Change default to no timeout.
2019-12-07 17:24:09 -06:00
Christopher K. Hoadley
09d3a1b042
Merge remote-tracking branch 'pr/fix/timeout-requests'
2019-12-07 16:15:59 -06:00
Siddharth Dushantha
35e8dd97e6
Merge pull request #339 from amirmojiry/develop
...
add Facename
2019-12-06 19:50:27 +01:00
Siddharth Dushantha
bb3a59dfb3
added 8 more sites
2019-12-06 19:43:06 +01:00
Siddharth Dushantha
9b24296dc2
Merge pull request #421 from Czechball/master
...
added 5 new sites
2019-12-06 07:13:01 +01:00
Czechball
b18ad06e02
added CloudflareCommunity
2019-12-05 21:09:59 +01:00
Czechball
3c0f9ae093
added NICommunityForum
2019-12-05 21:04:05 +01:00
Czechball
a05ecf75cd
added OurDJTalk
2019-12-05 21:00:21 +01:00
Czechball
8114a8200a
added AudioJungle
2019-12-05 20:48:29 +01:00