Christopher K. Hoadley
a538c07ab3
Merge branch 'pr/n133_cclauss'
2019-01-22 20:51:32 -06:00
Christopher K. Hoadley
65b38592c4
Change "response_url" detection strategy completely.
...
Previously, there was a problem with sites that redirect an attempt to view a non-existing username to the main site. For example, if you try to go to https://devrant.com/users/dfoxxxxxxxxx (a user name that does not exist), then we get a redirect to the https://devrant.com/ root of the site. But, the "response_url" checking algorithm was only looking for the configured error URL being included in the response. So, these sites always indicated that the username was not found.
Update the "response_url" detection method so that the request does not allow redirects. If we get a 200 response of some type, then the username has been found. However, if we get something like a 302, then we know that the username was not found as we are being redirected.
This whole method seems fragile, but I did exhaustively test all of the supported sites, and they all work. So, this change is clearly an improvement.
2019-01-22 20:37:05 -06:00
cclauss
0b3c5f2ba0
Fix the top of the deerstalker
...
https://en.m.wikipedia.org/wiki/Deerstalker
2019-01-22 20:15:13 +01:00
cclauss
a380e48057
Make BANNER an r'string' and move it up front
...
Sherlock has a cool logo so this PR moves it to the top of sherlock.py to show it off when potential contributors read our source. It also makes a BANNER an __r'string'__ so we do not need backslashes to escape characters and the ascii art is more what-you-see-is-what-you-get. This also suppresses [a bunch of flake8 complaints](https://travis-ci.com/TheYahya/sherlock/jobs/172028552#L490-L503 ) about _invalid escape sequences_. Finally this PR runs isort on the imports for readability. Standard Lib imports come first, etc.
2019-01-22 18:55:03 +01:00
Christopher K. Hoadley
4c6bb61483
Update version number. This version does have basic tests.
2019-01-21 19:27:08 -06:00
Christopher K. Hoadley
ee4cd8e14b
While running tests, I was getting a ResourceWarning about an unclosed file. The result file was not being closed, so it was a valid warning. Close the file to avoid this warning.
2019-01-21 16:30:07 -06:00
Yahya SayadArbabi
d4e29b1327
bump version
2019-01-19 19:24:02 +03:30
Yahya SayadArbabi
ff9e239928
bump version
2019-01-15 00:32:30 +03:30
SebastianElvis
29d89921d0
add proxy functionality
2019-01-12 12:55:19 +08:00
Yahya SayadArbabi
ed196b7466
bump version
2019-01-10 17:23:55 +03:30
Yahya SayadArbabi
1c5e07645e
Merge branch 'Made_parameter_for_site_name_not_case_sensitive'
2019-01-10 17:22:56 +03:30
Yahya SayadArbabi
2247f556f2
bump version
2019-01-10 17:17:17 +03:30
Master
b245a6e5cc
fixed wrong condition place
2019-01-09 19:46:02 +02:00
Master
34a0db9cd8
implemented #115 : make parameter for site name not case sensitive
2019-01-09 19:43:00 +02:00
Tejasvi (Teju) Nareddy
d0ecb70d84
Merge pull request #109 from nareddyt/response-time-metrics
...
Response time metrics
2019-01-08 19:08:47 -05:00
Yahya SayadArbabi
5ed2c9a740
bump version
2019-01-09 01:03:11 +03:30
Tejasvi Nareddy
038d531483
doc: response time
...
- Document new feature for response times
- Refactor
2019-01-07 12:04:55 -05:00
Tejasvi Nareddy
4c3967fd6d
feat: expose response times
...
- Add hook to FuturesSession to calculate absolute response time (ms)
- In verbose mode, display response times for each request
- Always outputs response times to CSV
2019-01-06 22:33:36 -05:00
Yahya SayadArbabi
7e5bac0cb8
bump version
2019-01-06 14:02:35 +03:30
Yahya SayadArbabi
18ee78f9e0
Merge branch 'masta2898/master'
2019-01-06 14:01:45 +03:30
Yahya SayadArbabi
c165952ca8
bump version
2019-01-06 13:55:50 +03:30
Christopher K. Hoadley
33e8beb5b4
Add command line option to only run a report on specified sites (as opposed to all of them). Move loading of JSON file out of the query logic proper: we need to keep the database and the query logic separate anyway for future changes, so this is a first step in the refactoring. Update readme file with latest information.
2019-01-05 22:52:53 -06:00
Christopher K. Hoadley
4596f7121e
Specify the encoding to be UTF-8 for the csv file. The Rajče.net site was causing this to fail.
2019-01-05 20:39:56 -06:00
Master
5dc147e39a
efficient usage of GET request only for github
2019-01-05 23:05:23 +02:00
Yahya SayadArbabi
81d15482f7
bump version
2019-01-06 00:30:32 +03:30
Master
69cdbe83f2
fix #95 : head request may cause 301 redirect which can be interpreted wrong i.e. github's cause
2019-01-05 19:45:19 +02:00
Master
1e50c92d8b
update from upstream
2019-01-05 18:50:01 +02:00
Yahya SayadArbabi
0d85703093
bump version
2019-01-05 16:57:31 +03:30
QuantumSheep
2e4b3a32ad
Stops opening the file at each writing
2019-01-05 13:43:03 +01:00
Yahya SayadArbabi
f27d2b2aed
bump version
2019-01-05 11:14:13 +03:30
Yahya SayadArbabi
cc22d88679
bump version
2019-01-05 09:38:28 +03:30
nil0x42
2791e1553a
Fix incorrect file save notification
...
When username argument was provided with uppercase chars, sherlock
said that file was saved into "UserName.txt" instead of "username.txt" (fname var)
2019-01-04 23:59:58 +00:00
Yahya SayadArbabi
683ca99316
bump version
2019-01-05 01:20:41 +03:30
Yahya SayadArbabi
de1d0d643c
bump version
2019-01-04 19:34:00 +03:30
Yahya SayadArbabi
a63c14071b
Merge branch 'Use_Colorama_syntax_for_better_readability'
2019-01-04 19:33:25 +03:30
Yahya SayadArbabi
30eb9c76ec
bump version
2019-01-04 11:51:07 +03:30
Yahya SayadArbabi
287305a12c
bump version
2019-01-04 11:42:00 +03:30
Yahya SayadArbabi
3b5263c5bd
Add Wikipedia
2019-01-04 11:02:19 +03:30
Jen-Chieh
df1f35bc88
Use Colorama for better readability.
2019-01-04 13:17:23 +08:00
Andrew Yatzkan
2d50409428
Changed error code from 404 to not 2XX
2019-01-03 18:04:52 -06:00
Andrew Yatzkan
ab99ee016e
Made .txt file case insensitive
2019-01-03 17:44:24 -06:00
Yahya SayadArbabi
ffbd5b3d4b
Fix versioning
2019-01-04 01:20:59 +03:30
Yahya SayadArbabi
992e22059a
bump version
2019-01-04 01:18:10 +03:30
Yahya SayadArbabi
f4c490d25e
run "isort"
2019-01-04 01:16:55 +03:30
Yahya SayadArbabi
853008c075
Merge branch 'jcs-PR/color'
2019-01-04 01:05:26 +03:30
Yahya SayadArbabi
f984b447c0
Run "isort"
2019-01-04 01:05:12 +03:30
Jonas Tranberg
e51da5b712
If only status_code is needed use HEAD instead of GET request to avoid body download
2019-01-03 18:39:43 +01:00
Yahya SayadArbabi
e6256e70a6
Bump version
2019-01-03 17:44:35 +03:30
jenchieh
43f4e893f3
Initialize Colorama and import it.
2019-01-03 18:18:04 +08:00
Jon Ander Oribe
005e9591c1
Adding a counter of resources
...
At the end of the process we can see how many results we have
2019-01-02 16:43:38 +01:00
