Mirrors/sherlock
2
0
Fork 0
mirror of https://github.com/sherlock-project/sherlock synced 2024-12-18 16:03:21 +00:00
Code Issues Projects Releases Packages Wiki Activity
956 commits 13 branches 2 tags 27 MiB
Commit graph

956 commits

This branch
This branch
All branches
Author SHA1 Message Date
Christopher K. Hoadley
710468ded9 Someone has claimed the user name "noonewouldeverusethis7" on BuzzFeed and Canva. The irony is not lost on me. 
I don't get how the name was chosen.  I doubt that it was coincidence. Is there some monitoring of queries to the sites, and someone is claiming them?  Or, is someone in the Sherlock community just being a pain?
 2019-02-06 15:21:48 -06:00
Christopher K. Hoadley
957f48581a Add Unsplash to tests. 2019-02-03 19:38:16 -06:00
Christopher Kent Hoadley
d35675457d
Merge pull request #161 from crock/add-steamgroup-support 
Added Steam Group support, Added .idea dir to .gitignore
 2019-02-03 13:39:59 -06:00
Alex Crocker
a89b1d8b3a changed test variables to match example 2019-02-03 14:18:16 -05:00
Alex Crocker
d4e1b6fc9b added claimed/unclaimed keys for testing 2019-02-03 14:01:27 -05:00
Alex Crocker
5d2106c441 Added Steam Group support, Added .ideadir to .gitignore 2019-02-03 14:01:27 -05:00
Christopher Kent Hoadley
febcb0718d
Merge pull request #162 from TheYahya/hoadlck-test-speedup 
Tests Speedup
 2019-02-03 12:31:07 -06:00
Christopher K. Hoadley
c5a76da21d Add VSCO to tests. 2019-02-03 11:49:37 -06:00
Christopher K. Hoadley
dfddfbc838 Add Vimeo to tests. 2019-02-03 11:48:26 -06:00
Christopher K. Hoadley
8c401b1a7b Add Venmo to tests. 2019-02-03 11:46:28 -06:00
Christopher K. Hoadley
5bc6261a90 Fix YouPic detection. It was saying that usernames where available which were taken. Add to tests. 2019-02-03 11:20:05 -06:00
Christopher K. Hoadley
bc6bc0a8f1 Add BitBucket to tests. 2019-02-03 11:18:33 -06:00
Christopher K. Hoadley
dea8c29351 Change tests so that all sites that share a common username are executed in parallel. Just the little bit of extra processing halves the time taken for the tests (~15s verus ~34s). This will only get worse as the test coverage improves... 2019-02-03 11:14:45 -06:00
Christopher Kent Hoadley
5eb06e3502
Add Contribution File 
I mainly wanted to add this file so that people adding new sites would add test usernames.  But, this document should be filled out with more detail on the other types of changes....
 2019-02-02 22:11:05 -06:00
Christopher Kent Hoadley
ec993fa941
Merge pull request #160 from TheYahya/hoadlck-json-driven-tests 
JSON Driven Tests
 2019-02-02 21:34:50 -06:00
Christopher K. Hoadley
ea90e7fa95 Bump version and add link to Wiki on procedure to add new sites. 2019-02-02 21:24:46 -06:00
Christopher K. Hoadley
bf0959d84b Convert all supported Response URL sites to use JSON driven tests. 2019-02-02 20:46:53 -06:00
Christopher K. Hoadley
a576af358f Convert all supported HTTP Status Code sites to use JSON driven tests. 2019-02-02 20:40:16 -06:00
Christopher K. Hoadley
be59b91107 Add information about a claimed and an unclaimed username to the site information. This will allow the tests to directly source the information from the JSON data. It will also allow people who add new sites to also add test data (which will automatically get tested). Add a new test method which finds all sites of a given detect algorithm, and which also has test vectors, and runs tests against them. 
At the current time, the test vectors are optional.  But, once when there is finally complete coverage, then they will be required.  Anyone who adds a site without also adding test data will trigger a failure.
 2019-02-02 20:32:06 -06:00
Yahya SayadArbabi
aa67a3d792 Merge branch 'eladbarack-master' 2019-02-02 17:49:56 +03:30
Yahya SayadArbabi
8a87513a0d bump version 2019-02-02 17:49:46 +03:30
eladbarack
318736b61a Added Investing.com & Twitch 2019-02-02 14:24:28 +02:00
Yahya SayadArbabi
7c34cd6ba1 Merge branch 'DigitallyBorn/master' 2019-02-01 21:58:32 +03:30
Yahya SayadArbabi
800431b424 bump version 2019-02-01 21:57:40 +03:30
Ricky Smith
d4dbc94267 Move to multi-stage docker build 
Also add additional packages to the build container for hosts that don't know anything about python, like Docker Desktop on OSX/Windows.
 2019-01-31 16:11:12 -05:00
Christopher Kent Hoadley
6b31cd87e3
Merge pull request #156 from TheYahya/hoadlck-tests-coverage 
Add More Tests For Sites
 2019-01-30 18:41:54 -06:00
Christopher K. Hoadley
7fb6d26cc7 Previous code was failing the flake8 tests because the random module was not imported. 2019-01-30 18:37:03 -06:00
Christopher K. Hoadley
83aed9aeee Add test methods for Error Message detection method as well. Add Dribbble to tests. 2019-01-30 18:24:28 -06:00
Christopher K. Hoadley
6fc5c131db Convert Designspiration to use the Status Code detection method. The site gives a clean 404 error. Add to tests. 2019-01-30 18:15:42 -06:00
Christopher K. Hoadley
26ef2e1b9b Convert Codementor to use the Status Code detection method. The site gives a clean 404 error. Add to tests. 2019-01-30 18:10:06 -06:00
Christopher K. Hoadley
110b93a757 Convert Codecademy to use the Status Code detection method. The site gives a clean 404 error. Add to tests. 2019-01-30 18:07:29 -06:00
Christopher K. Hoadley
223d9716cb Convert BuzzFeed to use the Status Code detection method. The site gives a clean 404 error. Add to tests. 2019-01-30 18:04:24 -06:00
Christopher K. Hoadley
08ac008828 Convert Behance to use the Status Code detection method. The site gives a clean 404 error. Add to tests. 2019-01-30 17:58:14 -06:00
Christopher K. Hoadley
65e3820608 Convert Bandcamp to use the Status Code detection method. The site gives a clean 404 error. Add to tests. 2019-01-30 17:54:22 -06:00
Christopher K. Hoadley
c76b4524da Convert BLIP.fm to use the Status Code detection method. The site gives a clean 404 error. Add to tests. 2019-01-30 17:51:46 -06:00
Christopher K. Hoadley
8a82d883c6 Convert AngelList to use the Status Code detection method. The site gives a clean 404 error. Add to tests. 2019-01-30 17:49:04 -06:00
Christopher K. Hoadley
89787b1509 Add test methods for HTTP Status detection method as well. 2019-01-30 17:45:36 -06:00
Christopher K. Hoadley
bd941c8034 Convert Academia.edu to use the Status Code detection method. The site gives a clean 404 error. 2019-01-30 17:44:09 -06:00
Christopher K. Hoadley
f609320d3c Convert Canva to the more robust Response URL detection method. Add to tests to ensure that it is covered. 2019-01-30 17:25:05 -06:00
Yahya SayadArbabi
916fdd0603 Merge branch 'BlucyBlue-master' 2019-01-29 13:46:44 +03:30
Yahya SayadArbabi
f69be05803 Rebase & bump version 2019-01-29 10:11:18 +03:30
BlucyBlue
465f4c85c3 Typo in printout when reading proxies from file. 2019-01-29 10:10:31 +03:30
BlucyBlue
9f523365f7 Finally importing load_proxies module. 2019-01-29 10:10:31 +03:30
BlucyBlue
8587d1a835 If the ProxyError gets raised in the 'get_response' function, the request will be tried with another proxy selected from the 'proxy_list' global var. New parameter 'retry_no' is the number of retries that will be made before throwing a final ProxyError. 2019-01-29 10:10:31 +03:30
BlucyBlue
6bf8358342 Set new parameter 'retry_no' of the 'get_response' function to 3 (can be changed). This will be used if retrying a ProxyError. 2019-01-29 10:10:31 +03:30
BlucyBlue
855f154d9b If the 'proxy_list' we select a random member and pass it as the proxy to the session. If the list is empty, the proxy parameter will be set to arg.proxy, which defaults to None if the user did not pass an individual proxy as well. 2019-01-29 10:10:31 +03:30
BlucyBlue
2accdcafea If the user selected --check_proxies option along with --proxy_list option, proxies loaded from the .csv file are checked using the check_proxies function from the load_proxies module. Proxies which pass the test are stored in the proxy_list global var. 2019-01-29 10:10:06 +03:30
BlucyBlue
6cc4e22898 If the user selected --proxy_list option, we attempt to read proxies from the csv, and store the list in global var proxy_list. 2019-01-29 10:10:06 +03:30
BlucyBlue
bd683022b3 Exception is raised if both a single proxy and the proxy_list are used. As needed, this can be changed to merging the single proxy with the proxy list, but seems a bit unnecessary at this time. 2019-01-29 10:10:06 +03:30
BlucyBlue
dc32d473e0 Exception will now be raised if etiher a single proxy or proxy_list options are used along with Tor. 2019-01-29 10:10:06 +03:30