Christopher K. Hoadley
5d16a720a5
Update site list and version.
2019-12-24 16:57:32 -06:00
Christopher K. Hoadley
e0d2102810
Limit Number Of Parallel Requests To 20 (Instead Of Number Of Sites)
...
Previous code was allocating room for as many workers as there was sites. The problem is that as the number of sites has grown, there has not been enough memory to allocate all of those requests. In reality, having all of these requests in parallel does not really speed the processing: on my computer, the time to do a query for all of the sites was 1 minute 10 seconds before the change, and was 1 minute 9 seconds after the change.
Limiting the number of workers to 10 did increase the query time to 1 minute 17s. I am not sure if that is just inconsistencies in network traffic, but I will leave the limit at 20 for now.
Note that with the limit of 20, my query detected more sites than it did previously. It appears that some of the requests were failing on my computer because of memory reasons (as opposed to actual detection on the site).
2019-12-24 16:56:10 -06:00
Christopher K. Hoadley
4b6d2c1166
Do not create session and request objects if we are going to end up creating new one for Tor requests. This just wastes time.
2019-12-24 16:25:37 -06:00
Siddharth Dushantha
475ad6abd0
version bump 0.9.15 --> 0.9.16
2019-12-20 10:03:27 +01:00
Scoder12
e8949666fb
Add --no-color option
2019-12-19 15:37:12 -08:00
Siddharth Dushantha
bfa73e8165
Version bump 0.9.14 --> 0.9.15
2019-12-13 12:54:05 +01:00
Christopher K. Hoadley
69b818bb3b
Update version and help text.
2019-12-08 07:30:02 -06:00
Christopher K. Hoadley
15157fd7da
Update version and help text.
2019-12-07 17:43:09 -06:00
Christopher K. Hoadley
7e2eb5bab3
Clean up code that only reads the headers if we are doing HTTP Status detection. Remove special check for GitHub: everything works fine without it.
2019-12-07 17:29:07 -06:00
Christopher K. Hoadley
208db5a7c1
Remove unneeded assignment of results before main Sherlock call.
2019-12-07 17:27:11 -06:00
Christopher K. Hoadley
a228a00753
Clarify meaning of "Total Websites" count. It is really "Total Websites Username Detected On".
2019-12-07 17:25:18 -06:00
Christopher K. Hoadley
2c2c6dd42f
Get rid of global variable amount. This is no longer used.
2019-12-07 17:24:48 -06:00
Christopher K. Hoadley
b1efe75eee
Remove timeout global and make it available on the command line. Change default to no timeout.
2019-12-07 17:24:09 -06:00
Paulo Diovani
c34eb843b6
Set a timeout limit (10s) for requests
2019-12-04 18:34:09 -03:00
Siddharth Dushantha
a5157c2699
version bump 0.9.11 --> 0.9.12
2019-12-04 21:48:55 +01:00
Christopher K. Hoadley
e39c817159
Teknik is not responding properly and is causing Sherlock to hang. Remove it. Update version and site list.
2019-11-30 16:24:04 -06:00
Christopher K. Hoadley
b91a039a9b
Remove regular expression checks for Twitter and instagram. The new entries may the JSON invalid. Update version and site list.
2019-11-30 15:51:24 -06:00
Christopher K. Hoadley
68da60aafa
Update version and site list.
2019-11-30 06:10:30 -06:00
Christopher K. Hoadley
a257cd7ddf
Update version and site list.
2019-11-29 14:35:07 -06:00
Christopher K. Hoadley
64eb20e03c
Update version.
2019-11-29 08:08:27 -06:00
guipleite
81c8c6f0c4
check print invalid
2019-11-29 11:01:05 -03:00
guipleite
ad2a935950
fixes issue #362
2019-11-29 09:56:56 -03:00
Christopher K. Hoadley
6535e79b42
Update version and site list.
2019-11-28 10:42:11 -06:00
Shahlin
68e92783b9
Fixed grammar, typos, comments
2019-11-26 20:42:06 +04:00
Christopher K. Hoadley
87257fe16f
Update version and site list.
2019-11-25 21:19:40 -06:00
Christopher K. Hoadley
288d4fb525
Update version and site list.
2019-11-11 05:41:09 -06:00
Christopher K. Hoadley
9cb5db156c
Update version and site list.
2019-11-08 07:10:14 -06:00
Christopher K. Hoadley
0cad205b90
Update version and site list.
2019-11-05 06:59:03 -06:00
Christopher K. Hoadley
988bd0559f
Update version and site list.
2019-10-26 15:20:12 -05:00
Christopher K. Hoadley
7086eab981
Update version and site list.
2019-10-20 10:47:57 -05:00
Christopher K. Hoadley
1f38d5372b
Merge branch 'pr/n256_irazasyed'. Use minimal addiotional request header required for Zomato to be happy.
2019-10-20 10:46:11 -05:00
Christopher K. Hoadley
5f65ddbf1f
Merge branch 'pr/n329_LameLemon'
2019-10-20 10:17:24 -05:00
Christopher K. Hoadley
0d5a22368d
Update version and site list. After removing all of the sites that were giving incorrect results, there are only 176 sites (previously, there were 184).
2019-10-19 22:25:00 -05:00
Christopher K. Hoadley
ab781e227f
Update version. Update site list.
2019-10-19 21:08:35 -05:00
Lame Lemon
2d623d26f6
Added support for custom headers
2019-10-02 17:09:50 +01:00
Christopher K. Hoadley
75bbae8c3c
Convert Trip to use more reliable HTTP Status detection method. The site gives a clean 410 error. They changed their site response, so we were getting false positives.
2019-09-29 11:17:55 -05:00
Christopher K. Hoadley
7cb631ff3e
Update version.
2019-09-24 06:42:03 -05:00
Christopher K. Hoadley
516a4b5f03
Update version.
2019-09-05 06:56:45 -05:00
Christopher K. Hoadley
8dc39ecdf0
Update version.
2019-08-31 21:00:12 -05:00
Christopher K. Hoadley
9c66a19901
Update version.
2019-08-25 18:25:49 -05:00
Christopher K. Hoadley
6914c308a3
Update sites and version.
2019-08-24 19:35:01 -05:00
Siddharth Dushantha
864b94df67
updated site list
2019-08-11 12:51:45 +02:00
Siddharth Dushantha
1c0dac4eeb
version bump
2019-08-09 10:11:54 +02:00
Siddharth Dushantha
5d4aa6f0f7
Updated site list
2019-08-09 08:55:38 +02:00
Yahya SayadArbabi
9a28e638ce
Bump version
2019-07-23 11:49:31 +04:30
Yahya SayadArbabi
8750e12c07
Bump version
2019-07-23 11:29:14 +04:30
Christopher K. Hoadley
74e675764a
Update site list. Update version. Update help printout in readme.
2019-07-20 15:51:02 -05:00
Christopher K. Hoadley
d78ded1128
Update site list and ranking. Update version.
2019-07-17 22:44:16 -05:00
Yahya SayadArbabi
01c5a2da23
Bump version
2019-07-17 19:26:15 +04:30
Yahya SayadArbabi
75d60ce28b
Bump version
2019-07-17 19:23:22 +04:30
