Commit graph

97 commits

Author SHA1 Message Date
Christopher K. Hoadley
a18065c1a7 Bump version. Update usage results in readme. 2019-01-22 20:55:10 -06:00
Christopher K. Hoadley
a538c07ab3 Merge branch 'pr/n133_cclauss' 2019-01-22 20:51:32 -06:00
Christopher K. Hoadley
65b38592c4 Change "response_url" detection strategy completely.
Previously, there was a problem with sites that redirect an attempt to view a non-existing username to the main site. For example, if you try to go to https://devrant.com/users/dfoxxxxxxxxx (a user name that does not exist), then we get a redirect to the https://devrant.com/ root of the site. But, the "response_url" checking algorithm was only looking for the configured error URL being included in the response.  So, these sites always indicated that the username was not found.

Update the "response_url" detection method so that the request does not allow redirects. If we get a 200 response of some type, then the username has been found. However, if we get something like a 302, then we know that the username was not found as we are being redirected.

This whole method seems fragile, but I did exhaustively test all of the supported sites, and they all work.  So, this change is clearly an improvement.
2019-01-22 20:37:05 -06:00
cclauss
0b3c5f2ba0
Fix the top of the deerstalker
https://en.m.wikipedia.org/wiki/Deerstalker
2019-01-22 20:15:13 +01:00
cclauss
a380e48057
Make BANNER an r'string' and move it up front
Sherlock has a cool logo so this PR moves it to the top of sherlock.py to show it off when potential contributors read our source.  It also makes a BANNER an __r'string'__ so we do not need backslashes to escape characters and the ascii art is more what-you-see-is-what-you-get.  This also suppresses [a bunch of flake8 complaints](https://travis-ci.com/TheYahya/sherlock/jobs/172028552#L490-L503) about _invalid escape sequences_.  Finally this PR runs isort on the imports for readability.  Standard Lib imports come first, etc.
2019-01-22 18:55:03 +01:00
Christopher K. Hoadley
4c6bb61483 Update version number. This version does have basic tests. 2019-01-21 19:27:08 -06:00
Christopher K. Hoadley
ee4cd8e14b While running tests, I was getting a ResourceWarning about an unclosed file. The result file was not being closed, so it was a valid warning. Close the file to avoid this warning. 2019-01-21 16:30:07 -06:00
Yahya SayadArbabi
d4e29b1327 bump version 2019-01-19 19:24:02 +03:30
Yahya SayadArbabi
ff9e239928 bump version 2019-01-15 00:32:30 +03:30
SebastianElvis
29d89921d0 add proxy functionality 2019-01-12 12:55:19 +08:00
Yahya SayadArbabi
ed196b7466 bump version 2019-01-10 17:23:55 +03:30
Yahya SayadArbabi
1c5e07645e Merge branch 'Made_parameter_for_site_name_not_case_sensitive' 2019-01-10 17:22:56 +03:30
Yahya SayadArbabi
2247f556f2 bump version 2019-01-10 17:17:17 +03:30
Master
b245a6e5cc fixed wrong condition place 2019-01-09 19:46:02 +02:00
Master
34a0db9cd8 implemented #115: make parameter for site name not case sensitive 2019-01-09 19:43:00 +02:00
Tejasvi (Teju) Nareddy
d0ecb70d84
Merge pull request #109 from nareddyt/response-time-metrics
Response time metrics
2019-01-08 19:08:47 -05:00
Yahya SayadArbabi
5ed2c9a740 bump version 2019-01-09 01:03:11 +03:30
Tejasvi Nareddy
038d531483 doc: response time
- Document new feature for response times
- Refactor
2019-01-07 12:04:55 -05:00
Tejasvi Nareddy
4c3967fd6d feat: expose response times
- Add hook to FuturesSession to calculate absolute response time (ms)
- In verbose mode, display response times for each request
- Always outputs response times to CSV
2019-01-06 22:33:36 -05:00
Yahya SayadArbabi
7e5bac0cb8 bump version 2019-01-06 14:02:35 +03:30
Yahya SayadArbabi
18ee78f9e0 Merge branch 'masta2898/master' 2019-01-06 14:01:45 +03:30
Yahya SayadArbabi
c165952ca8 bump version 2019-01-06 13:55:50 +03:30
Christopher K. Hoadley
33e8beb5b4 Add command line option to only run a report on specified sites (as opposed to all of them). Move loading of JSON file out of the query logic proper: we need to keep the database and the query logic separate anyway for future changes, so this is a first step in the refactoring. Update readme file with latest information. 2019-01-05 22:52:53 -06:00
Christopher K. Hoadley
4596f7121e Specify the encoding to be UTF-8 for the csv file. The Rajče.net site was causing this to fail. 2019-01-05 20:39:56 -06:00
Master
5dc147e39a efficient usage of GET request only for github 2019-01-05 23:05:23 +02:00
Yahya SayadArbabi
81d15482f7 bump version 2019-01-06 00:30:32 +03:30
Master
69cdbe83f2 fix #95: head request may cause 301 redirect which can be interpreted wrong i.e. github's cause 2019-01-05 19:45:19 +02:00
Master
1e50c92d8b update from upstream 2019-01-05 18:50:01 +02:00
Yahya SayadArbabi
0d85703093 bump version 2019-01-05 16:57:31 +03:30
QuantumSheep
2e4b3a32ad Stops opening the file at each writing 2019-01-05 13:43:03 +01:00
Yahya SayadArbabi
f27d2b2aed bump version 2019-01-05 11:14:13 +03:30
Yahya SayadArbabi
cc22d88679 bump version 2019-01-05 09:38:28 +03:30
nil0x42
2791e1553a
Fix incorrect file save notification
When username argument was provided with uppercase chars, sherlock
said that file was saved into "UserName.txt" instead of "username.txt" (fname var)
2019-01-04 23:59:58 +00:00
Yahya SayadArbabi
683ca99316 bump version 2019-01-05 01:20:41 +03:30
Yahya SayadArbabi
de1d0d643c bump version 2019-01-04 19:34:00 +03:30
Yahya SayadArbabi
a63c14071b Merge branch 'Use_Colorama_syntax_for_better_readability' 2019-01-04 19:33:25 +03:30
Yahya SayadArbabi
30eb9c76ec bump version 2019-01-04 11:51:07 +03:30
Yahya SayadArbabi
287305a12c bump version 2019-01-04 11:42:00 +03:30
Yahya SayadArbabi
3b5263c5bd Add Wikipedia 2019-01-04 11:02:19 +03:30
Jen-Chieh
df1f35bc88 Use Colorama for better readability. 2019-01-04 13:17:23 +08:00
Andrew Yatzkan
2d50409428 Changed error code from 404 to not 2XX 2019-01-03 18:04:52 -06:00
Andrew Yatzkan
ab99ee016e Made .txt file case insensitive 2019-01-03 17:44:24 -06:00
Yahya SayadArbabi
ffbd5b3d4b Fix versioning 2019-01-04 01:20:59 +03:30
Yahya SayadArbabi
992e22059a bump version 2019-01-04 01:18:10 +03:30
Yahya SayadArbabi
f4c490d25e run "isort" 2019-01-04 01:16:55 +03:30
Yahya SayadArbabi
853008c075 Merge branch 'jcs-PR/color' 2019-01-04 01:05:26 +03:30
Yahya SayadArbabi
f984b447c0 Run "isort" 2019-01-04 01:05:12 +03:30
Jonas Tranberg
e51da5b712 If only status_code is needed use HEAD instead of GET request to avoid body download 2019-01-03 18:39:43 +01:00
Yahya SayadArbabi
e6256e70a6 Bump version 2019-01-03 17:44:35 +03:30
jenchieh
43f4e893f3 Initialize Colorama and import it. 2019-01-03 18:18:04 +08:00