Christopher K. Hoadley
b9e89edc82
Remove "RamblerDating". As of 2019-12-31, site always times out.
2019-12-31 07:39:52 -06:00
Siddharth Dushantha
37160f259c
Merge pull request #498 from sherlock-project/sdushantha-patch-1
...
added many more sites requested by @torerobo
2019-12-31 14:39:16 +01:00
Siddharth Dushantha
7441eac71c
added many more sites requested by @torerobo
2019-12-31 14:36:40 +01:00
Christopher K. Hoadley
2ad96a8a7b
Remove "YandexMarket". As of 2019-12-31, all usernames are reported as existing.
2019-12-31 07:36:09 -06:00
Christopher K. Hoadley
83ecddac91
Remove "easyen". As of 2019-12-31, usernames appear to redirect to an internal index.
2019-12-31 07:22:21 -06:00
Christopher K. Hoadley
3deb08d724
Fix "opennet" claimed username.
2019-12-31 07:14:09 -06:00
Christopher K. Hoadley
71a6697b20
Remove "Codementor". All usernames come back as unclaimed.
2019-12-31 07:08:37 -06:00
Christopher K. Hoadley
519795a1c8
Update claimed username for "toster".
2019-12-31 06:52:24 -06:00
Christopher K. Hoadley
216e1ea40c
Update user URL for "Zomato". Site did work before, but it is better to use preferred location.
2019-12-31 06:51:14 -06:00
Christopher K. Hoadley
b28462d5c9
Fix claimed username for "LOR".
2019-12-31 06:45:02 -06:00
Christopher K. Hoadley
ef0352b0fc
Do not use API call for "Brew". It probably needs to be authenticated now.
2019-12-31 06:43:04 -06:00
Christopher K. Hoadley
67693767e2
Update claimed user name for "Gitee".
2019-12-31 06:42:19 -06:00
Christopher K. Hoadley
b1fc363d31
Remove "KiwiFarms". You now have to be logged in to see any profile.
2019-12-31 06:30:53 -06:00
Christopher K. Hoadley
ea173cf313
Fix unclaimed user name for "Insanejournal".
2019-12-31 06:24:56 -06:00
Christopher Kent Hoadley
d47a8b6f72
Merge pull request #486 from sherlock-project/site_updates
...
Fix "interpals", Add "Windy", "uid", And "opensource"
2019-12-29 11:53:10 -06:00
Christopher K. Hoadley
9abae2e341
Update version and site list.
2019-12-29 11:48:53 -06:00
Christopher K. Hoadley
1373c4c2f9
Add "uid" support.
2019-12-29 11:45:43 -06:00
Christopher K. Hoadley
e40051204c
Add "opensource" support.
2019-12-29 11:45:21 -06:00
Christopher K. Hoadley
4144b7ff50
Add Windy support.
2019-12-29 11:32:32 -06:00
Christopher K. Hoadley
a036ca1f32
Fix error message for interpals.
2019-12-29 11:29:55 -06:00
Siddharth Dushantha
deabd42a08
Merge pull request #473 from zero77/patch-2
...
Update data.json
2019-12-27 21:49:29 +01:00
zero77
b5f676be95
Update data.json
...
Added https://allmylinks.com
2019-12-27 14:26:54 +00:00
Christopher Kent Hoadley
3eb478e58f
Merge pull request #471 from sherlock-project/limit_request_workers
...
Limit Number Of Parallel Requests To 20 (Instead Of Number Of Sites)
2019-12-24 17:04:15 -06:00
Christopher K. Hoadley
5d16a720a5
Update site list and version.
2019-12-24 16:57:32 -06:00
Christopher K. Hoadley
e0d2102810
Limit Number Of Parallel Requests To 20 (Instead Of Number Of Sites)
...
Previous code was allocating room for as many workers as there was sites. The problem is that as the number of sites has grown, there has not been enough memory to allocate all of those requests. In reality, having all of these requests in parallel does not really speed the processing: on my computer, the time to do a query for all of the sites was 1 minute 10 seconds before the change, and was 1 minute 9 seconds after the change.
Limiting the number of workers to 10 did increase the query time to 1 minute 17s. I am not sure if that is just inconsistencies in network traffic, but I will leave the limit at 20 for now.
Note that with the limit of 20, my query detected more sites than it did previously. It appears that some of the requests were failing on my computer because of memory reasons (as opposed to actual detection on the site).
2019-12-24 16:56:10 -06:00
Christopher K. Hoadley
4b6d2c1166
Do not create session and request objects if we are going to end up creating new one for Tor requests. This just wastes time.
2019-12-24 16:25:37 -06:00
Siddharth Dushantha
e664273746
added d3RU, fixes #470
2019-12-24 10:12:25 +01:00
Siddharth Dushantha
94141f1818
Merge pull request #469 from AL3INO/master
...
Fixed_LabPentestIt
2019-12-21 18:48:27 +01:00
AL3INO
de00894c1e
Updated data.json
...
Fixed username_claimed for labpentestit
2019-12-21 23:21:34 +11:00
Siddharth Dushantha
2723553069
added labpentestit
2019-12-20 20:59:29 +01:00
Siddharth Dushantha
8bc9ee39a3
added datingRU
2019-12-20 18:10:39 +01:00
ZephrFish
5a92ce2f55
Fixed docker file, git is not included in alpine by default
2019-12-20 14:47:16 +00:00
Siddharth Dushantha
4a7662b08e
added hackster
2019-12-20 10:10:24 +01:00
Siddharth Dushantha
475ad6abd0
version bump 0.9.15 --> 0.9.16
2019-12-20 10:03:27 +01:00
Siddharth Dushantha
b4dafa1742
Merge pull request #463 from Scoder12/no-color
...
Add --no-color option
2019-12-20 10:00:31 +01:00
Scoder12
e8949666fb
Add --no-color option
2019-12-19 15:37:12 -08:00
Siddharth Dushantha
d6410268ee
updated license
2019-12-19 22:31:15 +01:00
Siddharth Dushantha
a739ebf0e7
changed copyright holder to Sherlock Project
2019-12-19 22:30:42 +01:00
Siddharth Dushantha
f63e17066d
added a few more sites
2019-12-18 21:38:55 +01:00
Siddharth Dushantha
c864318b6f
Removed install_packages.sh
...
It is not really useful because people who are using this script use Linux and all Linux distros come with Python and pip, so there is no need to have a script to install it. Also, it only works on Linux.
2019-12-18 21:22:55 +01:00
Siddharth Dushantha
d5c0e2a9c2
Merge pull request #449 from LameLemon/bodybuilding
...
Added BodyBuilding
2019-12-13 14:02:46 +01:00
Lame Lemon
bbedf13071
Added BodyBuilding
2019-12-13 12:27:10 +00:00
Siddharth Dushantha
bfa73e8165
Version bump 0.9.14 --> 0.9.15
2019-12-13 12:54:05 +01:00
Siddharth Dushantha
937f562456
Merge pull request #448 from boschhd/patch-1
...
Remove an extra space in data.json
2019-12-13 12:52:17 +01:00
Harald Bosch
f0d314771c
Remove an extra space in data.json
...
Fix #447
Remove an extra space in data.json which causes a KeyError
2019-12-13 11:33:37 +01:00
Siddharth Dushantha
d9c6a987a4
Merge pull request #444 from Czechball/master
...
added 7 new sites
2019-12-12 19:36:25 +01:00
Czechball
499392dc6a
added GunsAndAmmo
2019-12-12 16:16:13 +01:00
Czechball
0c73df829b
added akniga
2019-12-12 16:14:50 +01:00
Czechball
7827f0f978
added leasehackr
2019-12-12 16:13:13 +01:00
Czechball
bae5316e51
added HackTheBox
2019-12-12 16:12:10 +01:00
