Commit graph

2405 commits

Author SHA1 Message Date
Christopher Kent Hoadley
8dfe820067
Merge pull request #135 from TheYahya/hoadlck-response_url-site-fixes
Response URL Site Detection Strategy Overhaul
2019-01-22 20:45:46 -06:00
Christopher K. Hoadley
65b38592c4 Change "response_url" detection strategy completely.
Previously, there was a problem with sites that redirect an attempt to view a non-existing username to the main site. For example, if you try to go to https://devrant.com/users/dfoxxxxxxxxx (a user name that does not exist), then we get a redirect to the https://devrant.com/ root of the site. But, the "response_url" checking algorithm was only looking for the configured error URL being included in the response.  So, these sites always indicated that the username was not found.

Update the "response_url" detection method so that the request does not allow redirects. If we get a 200 response of some type, then the username has been found. However, if we get something like a 302, then we know that the username was not found as we are being redirected.

This whole method seems fragile, but I did exhaustively test all of the supported sites, and they all work.  So, this change is clearly an improvement.
2019-01-22 20:37:05 -06:00
Christopher K. Hoadley
bb66d6a992 Update Pinterest and WordPress user URLs to exactly match what the site ends up with. If the request does not have the trailing "/", then the site will forward us to that URL. 2019-01-22 20:19:34 -06:00
Christopher K. Hoadley
ae657460c8 Add coverage tests for all sites that use the response URL detection method. This test fails because Sherlock does not handle all of these sites properly. 2019-01-22 20:16:19 -06:00
Yahya SayadArbabi
fba27cd709
Merge pull request #134 from Czechball/master
Added asciinema demo
2019-01-23 01:32:25 +03:30
Czechball
6441005784 Merge https://github.com/TheYahya/sherlock 2019-01-22 21:03:37 +01:00
cclauss
0b3c5f2ba0
Fix the top of the deerstalker
https://en.m.wikipedia.org/wiki/Deerstalker
2019-01-22 20:15:13 +01:00
cclauss
a380e48057
Make BANNER an r'string' and move it up front
Sherlock has a cool logo so this PR moves it to the top of sherlock.py to show it off when potential contributors read our source.  It also makes a BANNER an __r'string'__ so we do not need backslashes to escape characters and the ascii art is more what-you-see-is-what-you-get.  This also suppresses [a bunch of flake8 complaints](https://travis-ci.com/TheYahya/sherlock/jobs/172028552#L490-L503) about _invalid escape sequences_.  Finally this PR runs isort on the imports for readability.  Standard Lib imports come first, etc.
2019-01-22 18:55:03 +01:00
Christopher Kent Hoadley
cb715a6447
Add Travis CI Status Image 2019-01-22 11:44:18 -06:00
Christopher Kent Hoadley
560f7991d0
Merge pull request #130 from cclauss/patch-5
Use Travis Continuous Integration to test all code changes
2019-01-22 11:27:25 -06:00
cclauss
b584a45966
Test files names do not comply with pytest discovery 2019-01-22 10:35:55 +01:00
cclauss
290e5efefc
Also try running the unittests with pytest 2019-01-22 10:30:32 +01:00
cclauss
11d262eee0
Add the new unittests to the Travis CI runs.
Add @hoadlck unittests.
2019-01-22 10:26:16 +01:00
cclauss
32693682e6
Use Travis Continuous Integration to run flake8 on all code changes
https://github.com/marketplace/category/continuous-integration

To start the automated testing of all pull requests, log into https://travis-ci.com/TheYahya using GitHub credentials and turn the repo switch ___on___.

Other tests can be added to the __script:__ section.
2019-01-22 09:31:36 +01:00
Christopher Kent Hoadley
ec8e32ed9a
Merge pull request #127 from TheYahya/hoadlck-tests-take2
Add Basic Testing Infrastructure
2019-01-21 19:37:12 -06:00
Christopher K. Hoadley
4c6bb61483 Update version number. This version does have basic tests. 2019-01-21 19:27:08 -06:00
Christopher K. Hoadley
f6860510ea Add basic test infrastructure using unittest. Add tests to verify the 3 mechanisms of determining that a username is *not* supported on a given site.
Created SherlockBaseTest() class that provides infrastructure for the tests.

TODO:  It seems that devRant is not detecting users that certainly exist.
TODO:  While running tests, there is a ResourceWarning from an unclosed SSLSocket.  This needs work.
2019-01-21 19:26:07 -06:00
Christopher Kent Hoadley
7c196a0d7a
Merge pull request #126 from TheYahya/hoadlck-close-file
Explicitly Close Result Text File
2019-01-21 16:32:29 -06:00
Christopher K. Hoadley
ee4cd8e14b While running tests, I was getting a ResourceWarning about an unclosed file. The result file was not being closed, so it was a valid warning. Close the file to avoid this warning. 2019-01-21 16:30:07 -06:00
Yahya SayadArbabi
cc7127c8fc Merge brach 'jusdepatate/patch-1' 2019-01-19 19:36:08 +03:30
Yahya SayadArbabi
d4e29b1327 bump version 2019-01-19 19:24:02 +03:30
Yahya SayadArbabi
e92225aaa2 Update license 2019-01-19 19:23:42 +03:30
Yahya SayadArbabi
4951151f4a Merge branch 'HA71/master' 2019-01-19 19:21:11 +03:30
Yahya SayadArbabi
26a4d71875 Update readme 2019-01-19 19:20:51 +03:30
Jus de Patate
7eeaabf17e
Update sites.md 2019-01-19 16:12:12 +01:00
HATI
d24387e30a
Update sites.md 2019-01-19 14:46:39 +01:00
HATI
82bd042960
Update README.md 2019-01-19 14:45:51 +01:00
Jus de Patate
78818559b5
Add Star Citizen and EVE Online 2019-01-19 11:40:20 +01:00
Yahya SayadArbabi
9460bfbeed
Merge pull request #121 from JakeConnors376W/master
Improve README
2019-01-17 10:19:56 +03:30
JakeConnors376W
d71ce73b3c
Merge pull request #1 from JakeConnors376W/JakeConnors376W-update-documentation
Update README.md
2019-01-16 16:30:51 -08:00
JakeConnors376W
2ce0e01afa
Update README.md
Make more concise
2019-01-16 16:11:57 -08:00
Yahya SayadArbabi
efd8867e5e
Merge pull request #119 from theodosisathanasakis/readmebranch
install python3 and python3-pip if not exist
2019-01-16 20:55:48 +03:30
theodosisathanasakis
2e0bface8a install python3 and python3-pip if not exist 2019-01-16 18:18:10 +02:00
HATI
2bb8b4876c
Update data.json 2019-01-16 17:16:31 +01:00
HATI
df6c323e4a
Update sites.md 2019-01-16 17:15:46 +01:00
HATI
b82a692886
Update data.json 2019-01-16 11:18:55 +01:00
HATI
33a65c57e1
Update sites.md 2019-01-16 11:16:50 +01:00
Tejasvi (Teju) Nareddy
ccf3b62a87
Merge pull request #92 from theodosisathanasakis/script
Script now supports Debian/Ubuntu, Arch, Fedora, CentOS/RHEL and OpenSUSE based distos
2019-01-15 22:23:33 -05:00
Czechball
e41687bd9e Merge https://github.com/Czechball/sherlock 2019-01-15 10:21:29 +01:00
Yahya SayadArbabi
49e2d8eb97 Merge branch 'Fixed_#99' 2019-01-15 00:38:12 +03:30
Yahya SayadArbabi
ff9e239928 bump version 2019-01-15 00:32:30 +03:30
Yahya SayadArbabi
c397a6ce54 Merge branch 'SebastianElvis/feature/socks' 2019-01-15 00:32:07 +03:30
SebastianElvis
29d89921d0 add proxy functionality 2019-01-12 12:55:19 +08:00
Master
a42b632228 changed message to prevent false positive in case of username 'error' 2019-01-10 21:11:55 +02:00
Master
93b9aa1476 fixed #99: virustotal false positive 2019-01-10 20:35:05 +02:00
Yahya SayadArbabi
ed196b7466 bump version 2019-01-10 17:23:55 +03:30
Yahya SayadArbabi
1c5e07645e Merge branch 'Made_parameter_for_site_name_not_case_sensitive' 2019-01-10 17:22:56 +03:30
Yahya SayadArbabi
b6f9696a39 Merge branch 'ivan-achlaqullah/add_site' 2019-01-10 17:18:30 +03:30
Yahya SayadArbabi
2247f556f2 bump version 2019-01-10 17:17:17 +03:30
Master
b245a6e5cc fixed wrong condition place 2019-01-09 19:46:02 +02:00