Commit graph

209 commits

Author SHA1 Message Date
Siddharth Dushantha
639d781a02
Version bump 0.10.3 --> 0.10.4 2020-01-09 15:31:31 +01:00
Christopher K. Hoadley
0fd89843b2 Update version and site list. 2019-12-31 10:47:17 -06:00
Siddharth Dushantha
8c289b1db3
version bump 0.10.1 --> 0.10.2 2019-12-31 14:42:28 +01:00
Christopher K. Hoadley
9abae2e341 Update version and site list. 2019-12-29 11:48:53 -06:00
Christopher K. Hoadley
5d16a720a5 Update site list and version. 2019-12-24 16:57:32 -06:00
Christopher K. Hoadley
e0d2102810 Limit Number Of Parallel Requests To 20 (Instead Of Number Of Sites)
Previous code was allocating room for as many workers as there was sites.  The problem is that as the number of sites has grown, there has not been enough memory to allocate all of those requests.  In reality, having all of these requests in parallel does not really speed the processing: on my computer, the time to do a query for all of the sites was 1 minute 10 seconds before the change, and was 1 minute 9 seconds after the change.

Limiting the number of workers to 10 did increase the query time to 1 minute 17s.  I am not sure if that is just inconsistencies in network traffic, but I will leave the limit at 20 for now.

Note that with the limit of 20, my query detected more sites than it did previously.  It appears that some of the requests were failing on my computer because of memory reasons (as opposed to actual detection on the site).
2019-12-24 16:56:10 -06:00
Christopher K. Hoadley
4b6d2c1166 Do not create session and request objects if we are going to end up creating new one for Tor requests. This just wastes time. 2019-12-24 16:25:37 -06:00
Siddharth Dushantha
475ad6abd0
version bump 0.9.15 --> 0.9.16 2019-12-20 10:03:27 +01:00
Scoder12
e8949666fb
Add --no-color option 2019-12-19 15:37:12 -08:00
Siddharth Dushantha
bfa73e8165
Version bump 0.9.14 --> 0.9.15 2019-12-13 12:54:05 +01:00
Christopher K. Hoadley
69b818bb3b Update version and help text. 2019-12-08 07:30:02 -06:00
Christopher K. Hoadley
15157fd7da Update version and help text. 2019-12-07 17:43:09 -06:00
Christopher K. Hoadley
7e2eb5bab3 Clean up code that only reads the headers if we are doing HTTP Status detection. Remove special check for GitHub: everything works fine without it. 2019-12-07 17:29:07 -06:00
Christopher K. Hoadley
208db5a7c1 Remove unneeded assignment of results before main Sherlock call. 2019-12-07 17:27:11 -06:00
Christopher K. Hoadley
a228a00753 Clarify meaning of "Total Websites" count. It is really "Total Websites Username Detected On". 2019-12-07 17:25:18 -06:00
Christopher K. Hoadley
2c2c6dd42f Get rid of global variable amount. This is no longer used. 2019-12-07 17:24:48 -06:00
Christopher K. Hoadley
b1efe75eee Remove timeout global and make it available on the command line. Change default to no timeout. 2019-12-07 17:24:09 -06:00
Paulo Diovani
c34eb843b6 Set a timeout limit (10s) for requests 2019-12-04 18:34:09 -03:00
Siddharth Dushantha
a5157c2699
version bump 0.9.11 --> 0.9.12 2019-12-04 21:48:55 +01:00
Christopher K. Hoadley
e39c817159 Teknik is not responding properly and is causing Sherlock to hang. Remove it. Update version and site list. 2019-11-30 16:24:04 -06:00
Christopher K. Hoadley
b91a039a9b Remove regular expression checks for Twitter and instagram. The new entries may the JSON invalid. Update version and site list. 2019-11-30 15:51:24 -06:00
Christopher K. Hoadley
68da60aafa Update version and site list. 2019-11-30 06:10:30 -06:00
Christopher K. Hoadley
a257cd7ddf Update version and site list. 2019-11-29 14:35:07 -06:00
Christopher K. Hoadley
64eb20e03c Update version. 2019-11-29 08:08:27 -06:00
guipleite
81c8c6f0c4 check print invalid 2019-11-29 11:01:05 -03:00
guipleite
ad2a935950 fixes issue #362 2019-11-29 09:56:56 -03:00
Christopher K. Hoadley
6535e79b42 Update version and site list. 2019-11-28 10:42:11 -06:00
Shahlin
68e92783b9 Fixed grammar, typos, comments 2019-11-26 20:42:06 +04:00
Christopher K. Hoadley
87257fe16f Update version and site list. 2019-11-25 21:19:40 -06:00
Christopher K. Hoadley
288d4fb525 Update version and site list. 2019-11-11 05:41:09 -06:00
Christopher K. Hoadley
9cb5db156c Update version and site list. 2019-11-08 07:10:14 -06:00
Christopher K. Hoadley
0cad205b90 Update version and site list. 2019-11-05 06:59:03 -06:00
Christopher K. Hoadley
988bd0559f Update version and site list. 2019-10-26 15:20:12 -05:00
Christopher K. Hoadley
7086eab981 Update version and site list. 2019-10-20 10:47:57 -05:00
Christopher K. Hoadley
1f38d5372b Merge branch 'pr/n256_irazasyed'. Use minimal addiotional request header required for Zomato to be happy. 2019-10-20 10:46:11 -05:00
Christopher K. Hoadley
5f65ddbf1f Merge branch 'pr/n329_LameLemon' 2019-10-20 10:17:24 -05:00
Christopher K. Hoadley
0d5a22368d Update version and site list. After removing all of the sites that were giving incorrect results, there are only 176 sites (previously, there were 184). 2019-10-19 22:25:00 -05:00
Christopher K. Hoadley
ab781e227f Update version. Update site list. 2019-10-19 21:08:35 -05:00
Lame Lemon
2d623d26f6 Added support for custom headers 2019-10-02 17:09:50 +01:00
Christopher K. Hoadley
75bbae8c3c Convert Trip to use more reliable HTTP Status detection method. The site gives a clean 410 error. They changed their site response, so we were getting false positives. 2019-09-29 11:17:55 -05:00
Christopher K. Hoadley
7cb631ff3e Update version. 2019-09-24 06:42:03 -05:00
Christopher K. Hoadley
516a4b5f03 Update version. 2019-09-05 06:56:45 -05:00
Christopher K. Hoadley
8dc39ecdf0 Update version. 2019-08-31 21:00:12 -05:00
Christopher K. Hoadley
9c66a19901 Update version. 2019-08-25 18:25:49 -05:00
Christopher K. Hoadley
6914c308a3 Update sites and version. 2019-08-24 19:35:01 -05:00
Siddharth Dushantha
864b94df67 updated site list 2019-08-11 12:51:45 +02:00
Siddharth Dushantha
1c0dac4eeb
version bump 2019-08-09 10:11:54 +02:00
Siddharth Dushantha
5d4aa6f0f7 Updated site list 2019-08-09 08:55:38 +02:00
Yahya SayadArbabi
9a28e638ce Bump version 2019-07-23 11:49:31 +04:30
Yahya SayadArbabi
8750e12c07 Bump version 2019-07-23 11:29:14 +04:30