Mirrors/sherlock
2
0
Fork 0
mirror of https://github.com/sherlock-project/sherlock synced 2024-11-22 11:53:03 +00:00
Code Issues Projects Releases Packages Wiki Activity
2468 commits 13 branches 2 tags 27 MiB
Commit graph

2468 commits

This branch
This branch
All branches
Author SHA1 Message Date
Siddharth Dushantha
6182c3c250 changed error checking method 
Checking for the status code wasn't stable. Therefore checking for error
messages is better
 2024-05-06 22:14:51 +02:00
github-actions[bot]
b3bb3aef61 Updated Site List 2024-05-06 19:58:10 +00:00
Siddharth Dushantha
884019a9e9
Merge pull request #2098 from Ableytner/master 
Add AniWorld
 2024-05-06 19:57:57 +00:00
github-actions[bot]
014b4bcdf1 Updated Site List 2024-05-06 19:48:52 +00:00
Siddharth Dushantha
efd5f36674
Merge pull request #2101 from ppfeister/feature/youtube 
Restore YouTube
 2024-05-06 19:48:37 +00:00
Paul Pfeister
56b61f34de Restore YouTube 2024-05-06 14:48:27 -04:00
github-actions[bot]
80a513a948 Updated Site List 2024-05-06 15:30:01 +00:00
Siddharth Dushantha
b3a56100c8
Merge pull request #2038 from Gowthamk007m/master 
Added Blipfoto and LibraryThing
 2024-05-06 15:29:49 +00:00
Gowtham K M
26f6bcb7f5
Merge branch 'sherlock-project:master' into master 2024-05-06 19:46:59 +05:30
Gowtham K M
8608aa5747 Blipfoto error checking reverted to status_code 2024-05-06 19:46:31 +05:30
github-actions[bot]
31ab96675c Updated Site List 2024-05-06 10:13:08 +00:00
Siddharth Dushantha
67cae59d73
Merge pull request #2100 from ppfeister/feature/linkedin 
Add LinkedIn
 2024-05-06 10:12:54 +00:00
Gowtham K M
e99e2b11d7
Merge branch 'sherlock-project:master' into master 2024-05-06 11:49:35 +05:30
Gowtham K M
ba1377a570 Update error type to 'message' and set errorMsg to 'This user doesn't exist' 2024-05-06 11:48:55 +05:30
Paul Pfeister
2da7195ba8 Add PUT request_method 2024-05-06 01:13:20 -04:00
Paul Pfeister
d8aaeea168 Add regex 2024-05-06 01:09:31 -04:00
Paul Pfeister
ffa2310630 Add LinkedIn 
LinkedIn requires users to be signed in for normal visitation, but certain high-trust crawlers are allowed as well. Here, we masquerade as Googlebot to get past the 999.
 2024-05-06 00:49:13 -04:00
Paul Pfeister
198798d28b Add basic schema 2024-05-06 00:09:00 -04:00
Ableytner
e2faa8a281 remove default username_unclaimed 2024-05-05 20:24:59 +02:00
Ableytner
f224cbe656 add AniWorld 2024-05-05 19:46:14 +02:00
github-actions[bot]
49b190f841 Updated Site List 2024-05-05 11:45:24 +00:00
Siddharth Dushantha
743aa8d320
Merge pull request #2097 from sherlock-project/hudsonrock 
added HudsonRock
 2024-05-05 11:45:12 +00:00
Siddharth Dushantha
f035cc329d added HudsonRock 2024-05-05 13:41:10 +02:00
github-actions[bot]
58a2cc9c43 Updated Site List 2024-05-04 18:12:10 +00:00
Siddharth Dushantha
667289a23a
Merge pull request #2092 from ppfeister/feature/new_targets 
Collection of new and restored targets
 2024-05-04 18:11:58 +00:00
Siddharth Dushantha
a7f94d6ee6
Merge branch 'master' into feature/new_targets 2024-05-04 18:02:16 +00:00
Siddharth Dushantha
122082a602
Merge pull request #2069 from ppfeister/feature/antiwaf 
Reduce false positives (those caused by WAFs and bot detection)
 2024-05-04 13:12:45 +00:00
github-actions[bot]
71bdf63c19 Updated Site List 2024-05-04 13:08:04 +00:00
Siddharth Dushantha
482982c4e4
Merge pull request #2068 from ppfeister/master 
Reduce false positives (those not caused by WAFs or bot detection)
 2024-05-04 13:07:53 +00:00
Ryan
9137ee4f09
Add ruff to pr tests (#2093) 2024-04-27 12:41:30 +02:00
Paul Pfeister
2bf6ee4d2e Fix 1337x 2024-04-25 19:44:43 -04:00
Paul Pfeister
7bf4be4b70 Add Untappd 
Untappd is behind Cloudflare, but this doesn't seem to impact early requests. After being ratelimited, sherlock-project/sherlock#2069 will suppress any possible WAF-induced false positives.
Closes sherlock-project/sherlock#1780
 2024-04-25 19:27:58 -04:00
Paul Pfeister
760bc98a45 Re-add Instagram 
Instagram has been added back to the site list using the old picuki probe. This service DOES use Cloudflare, but it will function perfectly fine until rate limited. Once rate limited, sherlock-project/sherlock#2069 will suppress any false positives.
 2024-04-25 18:33:51 -04:00
Paul Pfeister
89251745d9 Add Codeberg 2024-04-25 18:02:01 -04:00
Paul Pfeister
db213de326 Remove unnecessary errorMsg 2024-04-25 17:53:45 -04:00
Paul Pfeister
7c94534732 Add CSSBattle ~properly~ 2024-04-25 17:49:29 -04:00
Paul Pfeister
137009ef37 Add Spells8 (and sort) 
Resolves sherlock-project/sherlock#2091
 2024-04-25 17:21:27 -04:00
Paul Pfeister
51959f95a7 Update sites list 2024-04-14 15:35:23 -04:00
Paul Pfeister
2a5fbd9e97 Remove BitcoinForum instead of suppress 2024-04-14 15:32:19 -04:00
Paul Pfeister
ca9a78757f Add CyberDefenders 2024-04-11 21:45:22 -04:00
Paul Pfeister
5c23b1555c Update default User-Agent 
I've noticed that many bot-detection pages are able to be avoided by using this UA. Unless there's a reason to stay on the old old old one, we may as well update it and reduce our WAF hits.
 2024-04-11 21:23:11 -04:00
Paul Pfeister
9f6cd80e28 Add PentesterLab 2024-04-11 21:05:13 -04:00
Paul Pfeister
27e98abbc8 Add some new targets 
+ TorrentGalaxy
+ 1337x
+ HackenProof
 2024-04-11 19:11:49 -04:00
Paul Pfeister
d59661903a Update site lists 2024-04-11 17:43:32 -04:00
Paul Pfeister
e43c6047be Fix status_code default logic bug 2024-04-11 17:39:23 -04:00
Paul Pfeister
060088f7a1 Fix status_code logic bug 2024-04-11 17:28:39 -04:00
Paul Pfeister
da3c90fce8 Fix Telegram F+ 2024-04-10 22:39:55 -04:00
Paul Pfeister
482f216ff9 Fix Kongregate F+ 
Attempts were met with a Varnish error page presenting 54113 (possibly Fastly related).

Change to User Agent necessary to avoid Varnish/Fastly issues.
Change to Accept necessary to avoid infinite 302 redirection.
Without BOTH of these changes, attempts will fail.

Both changes being made also permit the use of status_code rather than message.
 2024-04-10 22:24:36 -04:00
Paul Pfeister
4006556daa Remove G2G for F+ 2024-04-10 21:50:36 -04:00
Paul Pfeister
48212f09be Fix adtl Genius A/U F+ 2024-04-10 17:50:42 -04:00