Commit graph

2279 commits

Author SHA1 Message Date
Paul Pfeister
25e0acd98e Skip content filter for explicitly chosen targets
Targets specified via --site will no longer be excluded when --nsfw is not set, even if flagged as nsfw. If the target was specifically listed by the user, it's probably because they want that target.

Fixes sherlock-project/sherlock#2103
2024-05-07 03:08:39 -04:00
Paul Pfeister
2ff115fb4c Fix displayed hyperlinks
Fixes sherlock-project/sherlock#2102
2024-05-07 02:17:40 -04:00
Paul Pfeister
0a2978abeb Remove ~correct~ Steam from Removed_Sites 2024-05-07 02:00:49 -04:00
Paul Pfeister
7370a4dcda Restore SteamID
Seems to work now. May need to be adapted for regional issues.
Closes sherlock-project/sherlock#1815
Closes sherlock-project/sherlock#1848
2024-05-07 00:31:57 -04:00
Paul Pfeister
2575450bef Add BugCrowd 2024-05-07 00:22:12 -04:00
Paul Pfeister
d118c1c43c Disallow other $ keys 2024-05-06 19:58:40 -04:00
Paul Pfeister
0446779a3c Simplify schema with defs 2024-05-06 19:25:38 -04:00
Paul Pfeister
e4cbd3d8ad Add target top-level hint 2024-05-06 18:56:53 -04:00
Paul Pfeister
80d0434bb3 Require keys based on errorType value 2024-05-06 18:49:48 -04:00
Paul Pfeister
cc0b57c0af Prevent mixing of error values 2024-05-06 18:37:21 -04:00
Paul Pfeister
4b2f8ad2d0 Bring comments into compliance with schema 2024-05-06 18:05:37 -04:00
github-actions[bot]
f5796c24b3 Updated Site List 2024-05-06 20:17:56 +00:00
Siddharth Dushantha
56957408f5
Merge pull request #1990 from nicholasmurillo/my-opensource-contribution
Added Kick
2024-05-06 20:17:43 +00:00
Siddharth Dushantha
6182c3c250 changed error checking method
Checking for the status code wasn't stable. Therefore checking for error
messages is better
2024-05-06 22:14:51 +02:00
github-actions[bot]
b3bb3aef61 Updated Site List 2024-05-06 19:58:10 +00:00
Siddharth Dushantha
884019a9e9
Merge pull request #2098 from Ableytner/master
Add AniWorld
2024-05-06 19:57:57 +00:00
github-actions[bot]
014b4bcdf1 Updated Site List 2024-05-06 19:48:52 +00:00
Siddharth Dushantha
efd5f36674
Merge pull request #2101 from ppfeister/feature/youtube
Restore YouTube
2024-05-06 19:48:37 +00:00
Paul Pfeister
56b61f34de Restore YouTube 2024-05-06 14:48:27 -04:00
github-actions[bot]
80a513a948 Updated Site List 2024-05-06 15:30:01 +00:00
Siddharth Dushantha
b3a56100c8
Merge pull request #2038 from Gowthamk007m/master
Added Blipfoto and LibraryThing
2024-05-06 15:29:49 +00:00
Gowtham K M
26f6bcb7f5
Merge branch 'sherlock-project:master' into master 2024-05-06 19:46:59 +05:30
Gowtham K M
8608aa5747 Blipfoto error checking reverted to status_code 2024-05-06 19:46:31 +05:30
github-actions[bot]
31ab96675c Updated Site List 2024-05-06 10:13:08 +00:00
Siddharth Dushantha
67cae59d73
Merge pull request #2100 from ppfeister/feature/linkedin
Add LinkedIn
2024-05-06 10:12:54 +00:00
Gowtham K M
e99e2b11d7
Merge branch 'sherlock-project:master' into master 2024-05-06 11:49:35 +05:30
Gowtham K M
ba1377a570 Update error type to 'message' and set errorMsg to 'This user doesn't exist' 2024-05-06 11:48:55 +05:30
Paul Pfeister
2da7195ba8 Add PUT request_method 2024-05-06 01:13:20 -04:00
Paul Pfeister
d8aaeea168 Add regex 2024-05-06 01:09:31 -04:00
Paul Pfeister
ffa2310630 Add LinkedIn
LinkedIn requires users to be signed in for normal visitation, but certain high-trust crawlers are allowed as well. Here, we masquerade as Googlebot to get past the 999.
2024-05-06 00:49:13 -04:00
Paul Pfeister
198798d28b Add basic schema 2024-05-06 00:09:00 -04:00
Ableytner
e2faa8a281 remove default username_unclaimed 2024-05-05 20:24:59 +02:00
Ableytner
f224cbe656 add AniWorld 2024-05-05 19:46:14 +02:00
github-actions[bot]
49b190f841 Updated Site List 2024-05-05 11:45:24 +00:00
Siddharth Dushantha
743aa8d320
Merge pull request #2097 from sherlock-project/hudsonrock
added HudsonRock
2024-05-05 11:45:12 +00:00
Siddharth Dushantha
f035cc329d added HudsonRock 2024-05-05 13:41:10 +02:00
github-actions[bot]
58a2cc9c43 Updated Site List 2024-05-04 18:12:10 +00:00
Siddharth Dushantha
667289a23a
Merge pull request #2092 from ppfeister/feature/new_targets
Collection of new and restored targets
2024-05-04 18:11:58 +00:00
Siddharth Dushantha
a7f94d6ee6
Merge branch 'master' into feature/new_targets 2024-05-04 18:02:16 +00:00
Siddharth Dushantha
122082a602
Merge pull request #2069 from ppfeister/feature/antiwaf
Reduce false positives (those caused by WAFs and bot detection)
2024-05-04 13:12:45 +00:00
github-actions[bot]
71bdf63c19 Updated Site List 2024-05-04 13:08:04 +00:00
Siddharth Dushantha
482982c4e4
Merge pull request #2068 from ppfeister/master
Reduce false positives (those not caused by WAFs or bot detection)
2024-05-04 13:07:53 +00:00
Ryan
9137ee4f09
Add ruff to pr tests (#2093) 2024-04-27 12:41:30 +02:00
Paul Pfeister
2bf6ee4d2e Fix 1337x 2024-04-25 19:44:43 -04:00
Paul Pfeister
7bf4be4b70 Add Untappd
Untappd is behind Cloudflare, but this doesn't seem to impact early requests. After being ratelimited, sherlock-project/sherlock#2069 will suppress any possible WAF-induced false positives.
Closes sherlock-project/sherlock#1780
2024-04-25 19:27:58 -04:00
Paul Pfeister
760bc98a45 Re-add Instagram
Instagram has been added back to the site list using the old picuki probe. This service DOES use Cloudflare, but it will function perfectly fine until rate limited. Once rate limited, sherlock-project/sherlock#2069 will suppress any false positives.
2024-04-25 18:33:51 -04:00
Paul Pfeister
89251745d9 Add Codeberg 2024-04-25 18:02:01 -04:00
Paul Pfeister
db213de326 Remove unnecessary errorMsg 2024-04-25 17:53:45 -04:00
Paul Pfeister
7c94534732 Add CSSBattle ~properly~ 2024-04-25 17:49:29 -04:00
Paul Pfeister
137009ef37 Add Spells8 (and sort)
Resolves sherlock-project/sherlock#2091
2024-04-25 17:21:27 -04:00