Mirrors/sherlock
2
0
Fork 0
mirror of https://github.com/sherlock-project/sherlock synced 2024-11-24 04:43:08 +00:00
Code Issues Projects Releases Packages Wiki Activity
957 commits 13 branches 2 tags 27 MiB
Commit graph

957 commits

This branch
This branch
All branches
Author SHA1 Message Date
Jakob Guddas
7f8b5957ef Change "Duolingo" support with urlProbe 2020-01-11 17:55:04 +01:00
Jakob Guddas
aa038b925a Add "Duolingo" support 2020-01-11 16:52:02 +01:00
Siddharth Dushantha
639d781a02
Version bump 0.10.3 --> 0.10.4 2020-01-09 15:31:31 +01:00
Siddharth Dushantha
f7b5fb45bd
Merge pull request #508 from sherlock-project/sdushantha-patch-2 
Use stem from PyPi insted of Git version, fixes #496
 2020-01-09 15:30:42 +01:00
Siddharth Dushantha
3ae7a5819d
Use stem from PyPi insted of Git version 2020-01-09 15:20:07 +01:00
Siddharth Dushantha
514ce0cb08
Merge pull request #466 from ZephrFish/patch-1 
Fixed docker file, git is not included in alpine by default
 2020-01-01 15:51:57 +01:00
Christopher Kent Hoadley
37cc116dd9
Merge pull request #500 from sherlock-project/site_updates3 
More Site Addition And Fixes
 2019-12-31 10:50:43 -06:00
Christopher K. Hoadley
0fd89843b2 Update version and site list. 2019-12-31 10:47:17 -06:00
Christopher K. Hoadley
0fc25e979c Add "nnRU". 2019-12-31 10:36:32 -06:00
Christopher K. Hoadley
9ea42a3207 Add "ingvarr.net.ru". 2019-12-31 10:34:46 -06:00
Christopher K. Hoadley
6369e23ad5 Reinstate "easyen". Looks like some of the links on the site redirect to an internal index, but if you start out with a valid username, things do work. 2019-12-31 10:32:26 -06:00
Christopher K. Hoadley
4c6f9acd53 Fix claimed username for "phpRU". 2019-12-31 10:29:30 -06:00
Christopher Kent Hoadley
5123bf1f74
Merge pull request #499 from sherlock-project/site_updates2 
More Fixes To Site Coverage
 2019-12-31 08:05:16 -06:00
Christopher K. Hoadley
5649d6b721 Update version and site list. 2019-12-31 08:00:17 -06:00
Christopher K. Hoadley
2b0f1fd55c Merge remote-tracking branch 'origin/master' into site_updates2 2019-12-31 07:55:28 -06:00
Christopher K. Hoadley
5f5a81b083 Fix "Football" claimed username. 2019-12-31 07:47:04 -06:00
Siddharth Dushantha
8c289b1db3
version bump 0.10.1 --> 0.10.2 2019-12-31 14:42:28 +01:00
Christopher K. Hoadley
b9e89edc82 Remove "RamblerDating". As of 2019-12-31, site always times out. 2019-12-31 07:39:52 -06:00
Siddharth Dushantha
37160f259c
Merge pull request #498 from sherlock-project/sdushantha-patch-1 
added many more sites requested by @torerobo
 2019-12-31 14:39:16 +01:00
Siddharth Dushantha
7441eac71c
added many more sites requested by @torerobo 2019-12-31 14:36:40 +01:00
Christopher K. Hoadley
2ad96a8a7b Remove "YandexMarket". As of 2019-12-31, all usernames are reported as existing. 2019-12-31 07:36:09 -06:00
Christopher K. Hoadley
83ecddac91 Remove "easyen". As of 2019-12-31, usernames appear to redirect to an internal index. 2019-12-31 07:22:21 -06:00
Christopher K. Hoadley
3deb08d724 Fix "opennet" claimed username. 2019-12-31 07:14:09 -06:00
Christopher K. Hoadley
71a6697b20 Remove "Codementor". All usernames come back as unclaimed. 2019-12-31 07:08:37 -06:00
Christopher K. Hoadley
519795a1c8 Update claimed username for "toster". 2019-12-31 06:52:24 -06:00
Christopher K. Hoadley
216e1ea40c Update user URL for "Zomato". Site did work before, but it is better to use preferred location. 2019-12-31 06:51:14 -06:00
Christopher K. Hoadley
b28462d5c9 Fix claimed username for "LOR". 2019-12-31 06:45:02 -06:00
Christopher K. Hoadley
ef0352b0fc Do not use API call for "Brew". It probably needs to be authenticated now. 2019-12-31 06:43:04 -06:00
Christopher K. Hoadley
67693767e2 Update claimed user name for "Gitee". 2019-12-31 06:42:19 -06:00
Christopher K. Hoadley
b1fc363d31 Remove "KiwiFarms". You now have to be logged in to see any profile. 2019-12-31 06:30:53 -06:00
Christopher K. Hoadley
ea173cf313 Fix unclaimed user name for "Insanejournal". 2019-12-31 06:24:56 -06:00
Christopher Kent Hoadley
d47a8b6f72
Merge pull request #486 from sherlock-project/site_updates 
Fix "interpals", Add "Windy", "uid", And "opensource"
 2019-12-29 11:53:10 -06:00
Christopher K. Hoadley
9abae2e341 Update version and site list. 2019-12-29 11:48:53 -06:00
Christopher K. Hoadley
1373c4c2f9 Add "uid" support. 2019-12-29 11:45:43 -06:00
Christopher K. Hoadley
e40051204c Add "opensource" support. 2019-12-29 11:45:21 -06:00
Christopher K. Hoadley
4144b7ff50 Add Windy support. 2019-12-29 11:32:32 -06:00
Christopher K. Hoadley
a036ca1f32 Fix error message for interpals. 2019-12-29 11:29:55 -06:00
Siddharth Dushantha
deabd42a08
Merge pull request #473 from zero77/patch-2 
Update data.json
 2019-12-27 21:49:29 +01:00
zero77
b5f676be95
Update data.json 
Added https://allmylinks.com
 2019-12-27 14:26:54 +00:00
Christopher Kent Hoadley
3eb478e58f
Merge pull request #471 from sherlock-project/limit_request_workers 
Limit Number Of Parallel Requests To 20 (Instead Of Number Of Sites)
 2019-12-24 17:04:15 -06:00
Christopher K. Hoadley
5d16a720a5 Update site list and version. 2019-12-24 16:57:32 -06:00
Christopher K. Hoadley
e0d2102810 Limit Number Of Parallel Requests To 20 (Instead Of Number Of Sites) 
Previous code was allocating room for as many workers as there was sites.  The problem is that as the number of sites has grown, there has not been enough memory to allocate all of those requests.  In reality, having all of these requests in parallel does not really speed the processing: on my computer, the time to do a query for all of the sites was 1 minute 10 seconds before the change, and was 1 minute 9 seconds after the change.

Limiting the number of workers to 10 did increase the query time to 1 minute 17s.  I am not sure if that is just inconsistencies in network traffic, but I will leave the limit at 20 for now.

Note that with the limit of 20, my query detected more sites than it did previously.  It appears that some of the requests were failing on my computer because of memory reasons (as opposed to actual detection on the site).
 2019-12-24 16:56:10 -06:00
Christopher K. Hoadley
4b6d2c1166 Do not create session and request objects if we are going to end up creating new one for Tor requests. This just wastes time. 2019-12-24 16:25:37 -06:00
Siddharth Dushantha
e664273746
added d3RU, fixes #470 2019-12-24 10:12:25 +01:00
Siddharth Dushantha
94141f1818
Merge pull request #469 from AL3INO/master 
Fixed_LabPentestIt
 2019-12-21 18:48:27 +01:00
AL3INO
de00894c1e
Updated data.json 
Fixed username_claimed for labpentestit
 2019-12-21 23:21:34 +11:00
Siddharth Dushantha
2723553069
added labpentestit 2019-12-20 20:59:29 +01:00
Siddharth Dushantha
8bc9ee39a3
added datingRU 2019-12-20 18:10:39 +01:00
ZephrFish
5a92ce2f55
Fixed docker file, git is not included in alpine by default 2019-12-20 14:47:16 +00:00
Siddharth Dushantha
4a7662b08e
added hackster 2019-12-20 10:10:24 +01:00