Commit graph

993 commits

Author SHA1 Message Date
Christopher K. Hoadley
2b0f1fd55c Merge remote-tracking branch 'origin/master' into site_updates2 2019-12-31 07:55:28 -06:00
Christopher K. Hoadley
5f5a81b083 Fix "Football" claimed username. 2019-12-31 07:47:04 -06:00
Siddharth Dushantha
8c289b1db3
version bump 0.10.1 --> 0.10.2 2019-12-31 14:42:28 +01:00
Christopher K. Hoadley
b9e89edc82 Remove "RamblerDating". As of 2019-12-31, site always times out. 2019-12-31 07:39:52 -06:00
Siddharth Dushantha
37160f259c
Merge pull request #498 from sherlock-project/sdushantha-patch-1
added many more sites requested by @torerobo
2019-12-31 14:39:16 +01:00
Siddharth Dushantha
7441eac71c
added many more sites requested by @torerobo 2019-12-31 14:36:40 +01:00
Christopher K. Hoadley
2ad96a8a7b Remove "YandexMarket". As of 2019-12-31, all usernames are reported as existing. 2019-12-31 07:36:09 -06:00
Christopher K. Hoadley
83ecddac91 Remove "easyen". As of 2019-12-31, usernames appear to redirect to an internal index. 2019-12-31 07:22:21 -06:00
Christopher K. Hoadley
3deb08d724 Fix "opennet" claimed username. 2019-12-31 07:14:09 -06:00
Christopher K. Hoadley
71a6697b20 Remove "Codementor". All usernames come back as unclaimed. 2019-12-31 07:08:37 -06:00
Christopher K. Hoadley
519795a1c8 Update claimed username for "toster". 2019-12-31 06:52:24 -06:00
Christopher K. Hoadley
216e1ea40c Update user URL for "Zomato". Site did work before, but it is better to use preferred location. 2019-12-31 06:51:14 -06:00
Christopher K. Hoadley
b28462d5c9 Fix claimed username for "LOR". 2019-12-31 06:45:02 -06:00
Christopher K. Hoadley
ef0352b0fc Do not use API call for "Brew". It probably needs to be authenticated now. 2019-12-31 06:43:04 -06:00
Christopher K. Hoadley
67693767e2 Update claimed user name for "Gitee". 2019-12-31 06:42:19 -06:00
Christopher K. Hoadley
b1fc363d31 Remove "KiwiFarms". You now have to be logged in to see any profile. 2019-12-31 06:30:53 -06:00
Christopher K. Hoadley
ea173cf313 Fix unclaimed user name for "Insanejournal". 2019-12-31 06:24:56 -06:00
Christopher Kent Hoadley
d47a8b6f72
Merge pull request #486 from sherlock-project/site_updates
Fix "interpals", Add "Windy", "uid", And "opensource"
2019-12-29 11:53:10 -06:00
Christopher K. Hoadley
9abae2e341 Update version and site list. 2019-12-29 11:48:53 -06:00
Christopher K. Hoadley
1373c4c2f9 Add "uid" support. 2019-12-29 11:45:43 -06:00
Christopher K. Hoadley
e40051204c Add "opensource" support. 2019-12-29 11:45:21 -06:00
Christopher K. Hoadley
4144b7ff50 Add Windy support. 2019-12-29 11:32:32 -06:00
Christopher K. Hoadley
a036ca1f32 Fix error message for interpals. 2019-12-29 11:29:55 -06:00
Siddharth Dushantha
deabd42a08
Merge pull request #473 from zero77/patch-2
Update data.json
2019-12-27 21:49:29 +01:00
zero77
b5f676be95
Update data.json
Added https://allmylinks.com
2019-12-27 14:26:54 +00:00
Christopher Kent Hoadley
3eb478e58f
Merge pull request #471 from sherlock-project/limit_request_workers
Limit Number Of Parallel Requests To 20 (Instead Of Number Of Sites)
2019-12-24 17:04:15 -06:00
Christopher K. Hoadley
5d16a720a5 Update site list and version. 2019-12-24 16:57:32 -06:00
Christopher K. Hoadley
e0d2102810 Limit Number Of Parallel Requests To 20 (Instead Of Number Of Sites)
Previous code was allocating room for as many workers as there was sites.  The problem is that as the number of sites has grown, there has not been enough memory to allocate all of those requests.  In reality, having all of these requests in parallel does not really speed the processing: on my computer, the time to do a query for all of the sites was 1 minute 10 seconds before the change, and was 1 minute 9 seconds after the change.

Limiting the number of workers to 10 did increase the query time to 1 minute 17s.  I am not sure if that is just inconsistencies in network traffic, but I will leave the limit at 20 for now.

Note that with the limit of 20, my query detected more sites than it did previously.  It appears that some of the requests were failing on my computer because of memory reasons (as opposed to actual detection on the site).
2019-12-24 16:56:10 -06:00
Christopher K. Hoadley
4b6d2c1166 Do not create session and request objects if we are going to end up creating new one for Tor requests. This just wastes time. 2019-12-24 16:25:37 -06:00
Siddharth Dushantha
e664273746
added d3RU, fixes #470 2019-12-24 10:12:25 +01:00
Siddharth Dushantha
94141f1818
Merge pull request #469 from AL3INO/master
Fixed_LabPentestIt
2019-12-21 18:48:27 +01:00
AL3INO
de00894c1e
Updated data.json
Fixed username_claimed for labpentestit
2019-12-21 23:21:34 +11:00
Siddharth Dushantha
2723553069
added labpentestit 2019-12-20 20:59:29 +01:00
Siddharth Dushantha
8bc9ee39a3
added datingRU 2019-12-20 18:10:39 +01:00
ZephrFish
5a92ce2f55
Fixed docker file, git is not included in alpine by default 2019-12-20 14:47:16 +00:00
Siddharth Dushantha
4a7662b08e
added hackster 2019-12-20 10:10:24 +01:00
Siddharth Dushantha
475ad6abd0
version bump 0.9.15 --> 0.9.16 2019-12-20 10:03:27 +01:00
Siddharth Dushantha
b4dafa1742
Merge pull request #463 from Scoder12/no-color
Add --no-color option
2019-12-20 10:00:31 +01:00
Scoder12
e8949666fb
Add --no-color option 2019-12-19 15:37:12 -08:00
Siddharth Dushantha
d6410268ee
updated license 2019-12-19 22:31:15 +01:00
Siddharth Dushantha
a739ebf0e7
changed copyright holder to Sherlock Project 2019-12-19 22:30:42 +01:00
Siddharth Dushantha
f63e17066d
added a few more sites 2019-12-18 21:38:55 +01:00
Siddharth Dushantha
c864318b6f
Removed install_packages.sh
It is not really useful because people who are using this script use Linux and all Linux distros come with Python and pip, so there is no need to have a script to install it. Also, it only works on Linux.
2019-12-18 21:22:55 +01:00
Siddharth Dushantha
d5c0e2a9c2
Merge pull request #449 from LameLemon/bodybuilding
Added BodyBuilding
2019-12-13 14:02:46 +01:00
Lame Lemon
bbedf13071 Added BodyBuilding 2019-12-13 12:27:10 +00:00
Siddharth Dushantha
bfa73e8165
Version bump 0.9.14 --> 0.9.15 2019-12-13 12:54:05 +01:00
Siddharth Dushantha
937f562456
Merge pull request #448 from boschhd/patch-1
Remove an extra space in data.json
2019-12-13 12:52:17 +01:00
Harald Bosch
f0d314771c
Remove an extra space in data.json
Fix #447
Remove an extra space in data.json which causes a KeyError
2019-12-13 11:33:37 +01:00
Siddharth Dushantha
d9c6a987a4
Merge pull request #444 from Czechball/master
added 7 new sites
2019-12-12 19:36:25 +01:00
Czechball
499392dc6a added GunsAndAmmo 2019-12-12 16:16:13 +01:00