Commit graph

2285 commits

Author SHA1 Message Date
Paul Pfeister
82d7e9ce43 Fix CNET F+
CNET appears to have changed some things...
'null null' text has been removed with a redesign, and invalid users now return a 404 so we don't need a whole GET and English-only check.
2024-05-07 20:55:25 -04:00
Siddharth Dushantha
d0c8282e5e
Merge pull request #2099 from ppfeister/feature/schema
Set schema for manifest
2024-05-07 19:25:59 +00:00
Siddharth Dushantha
c9394451fb
Merge pull request #2105 from ppfeister/bugfix/broken-urls-2102
Fix displayed hyperlinks
2024-05-07 18:26:11 +00:00
github-actions[bot]
c470cabe7c Updated Site List 2024-05-07 18:25:51 +00:00
Siddharth Dushantha
5c7debec38
Merge pull request #2104 from ppfeister/feature/new-targets
Add BugCrowd, SteamID
2024-05-07 18:25:33 +00:00
Paul Pfeister
d85c07384f pr action doesn't appreciate explicit type notation apparently 2024-05-07 03:13:05 -04:00
Paul Pfeister
25e0acd98e Skip content filter for explicitly chosen targets
Targets specified via --site will no longer be excluded when --nsfw is not set, even if flagged as nsfw. If the target was specifically listed by the user, it's probably because they want that target.

Fixes sherlock-project/sherlock#2103
2024-05-07 03:08:39 -04:00
Paul Pfeister
2ff115fb4c Fix displayed hyperlinks
Fixes sherlock-project/sherlock#2102
2024-05-07 02:17:40 -04:00
Paul Pfeister
0a2978abeb Remove ~correct~ Steam from Removed_Sites 2024-05-07 02:00:49 -04:00
Paul Pfeister
7370a4dcda Restore SteamID
Seems to work now. May need to be adapted for regional issues.
Closes sherlock-project/sherlock#1815
Closes sherlock-project/sherlock#1848
2024-05-07 00:31:57 -04:00
Paul Pfeister
2575450bef Add BugCrowd 2024-05-07 00:22:12 -04:00
Paul Pfeister
d118c1c43c Disallow other $ keys 2024-05-06 19:58:40 -04:00
Paul Pfeister
0446779a3c Simplify schema with defs 2024-05-06 19:25:38 -04:00
Paul Pfeister
e4cbd3d8ad Add target top-level hint 2024-05-06 18:56:53 -04:00
Paul Pfeister
80d0434bb3 Require keys based on errorType value 2024-05-06 18:49:48 -04:00
Paul Pfeister
cc0b57c0af Prevent mixing of error values 2024-05-06 18:37:21 -04:00
Paul Pfeister
4b2f8ad2d0 Bring comments into compliance with schema 2024-05-06 18:05:37 -04:00
github-actions[bot]
f5796c24b3 Updated Site List 2024-05-06 20:17:56 +00:00
Siddharth Dushantha
56957408f5
Merge pull request #1990 from nicholasmurillo/my-opensource-contribution
Added Kick
2024-05-06 20:17:43 +00:00
Siddharth Dushantha
6182c3c250 changed error checking method
Checking for the status code wasn't stable. Therefore checking for error
messages is better
2024-05-06 22:14:51 +02:00
github-actions[bot]
b3bb3aef61 Updated Site List 2024-05-06 19:58:10 +00:00
Siddharth Dushantha
884019a9e9
Merge pull request #2098 from Ableytner/master
Add AniWorld
2024-05-06 19:57:57 +00:00
github-actions[bot]
014b4bcdf1 Updated Site List 2024-05-06 19:48:52 +00:00
Siddharth Dushantha
efd5f36674
Merge pull request #2101 from ppfeister/feature/youtube
Restore YouTube
2024-05-06 19:48:37 +00:00
Paul Pfeister
56b61f34de Restore YouTube 2024-05-06 14:48:27 -04:00
github-actions[bot]
80a513a948 Updated Site List 2024-05-06 15:30:01 +00:00
Siddharth Dushantha
b3a56100c8
Merge pull request #2038 from Gowthamk007m/master
Added Blipfoto and LibraryThing
2024-05-06 15:29:49 +00:00
Gowtham K M
26f6bcb7f5
Merge branch 'sherlock-project:master' into master 2024-05-06 19:46:59 +05:30
Gowtham K M
8608aa5747 Blipfoto error checking reverted to status_code 2024-05-06 19:46:31 +05:30
github-actions[bot]
31ab96675c Updated Site List 2024-05-06 10:13:08 +00:00
Siddharth Dushantha
67cae59d73
Merge pull request #2100 from ppfeister/feature/linkedin
Add LinkedIn
2024-05-06 10:12:54 +00:00
Gowtham K M
e99e2b11d7
Merge branch 'sherlock-project:master' into master 2024-05-06 11:49:35 +05:30
Gowtham K M
ba1377a570 Update error type to 'message' and set errorMsg to 'This user doesn't exist' 2024-05-06 11:48:55 +05:30
Paul Pfeister
2da7195ba8 Add PUT request_method 2024-05-06 01:13:20 -04:00
Paul Pfeister
d8aaeea168 Add regex 2024-05-06 01:09:31 -04:00
Paul Pfeister
ffa2310630 Add LinkedIn
LinkedIn requires users to be signed in for normal visitation, but certain high-trust crawlers are allowed as well. Here, we masquerade as Googlebot to get past the 999.
2024-05-06 00:49:13 -04:00
Paul Pfeister
198798d28b Add basic schema 2024-05-06 00:09:00 -04:00
Ableytner
e2faa8a281 remove default username_unclaimed 2024-05-05 20:24:59 +02:00
Ableytner
f224cbe656 add AniWorld 2024-05-05 19:46:14 +02:00
github-actions[bot]
49b190f841 Updated Site List 2024-05-05 11:45:24 +00:00
Siddharth Dushantha
743aa8d320
Merge pull request #2097 from sherlock-project/hudsonrock
added HudsonRock
2024-05-05 11:45:12 +00:00
Siddharth Dushantha
f035cc329d added HudsonRock 2024-05-05 13:41:10 +02:00
github-actions[bot]
58a2cc9c43 Updated Site List 2024-05-04 18:12:10 +00:00
Siddharth Dushantha
667289a23a
Merge pull request #2092 from ppfeister/feature/new_targets
Collection of new and restored targets
2024-05-04 18:11:58 +00:00
Siddharth Dushantha
a7f94d6ee6
Merge branch 'master' into feature/new_targets 2024-05-04 18:02:16 +00:00
Siddharth Dushantha
122082a602
Merge pull request #2069 from ppfeister/feature/antiwaf
Reduce false positives (those caused by WAFs and bot detection)
2024-05-04 13:12:45 +00:00
github-actions[bot]
71bdf63c19 Updated Site List 2024-05-04 13:08:04 +00:00
Siddharth Dushantha
482982c4e4
Merge pull request #2068 from ppfeister/master
Reduce false positives (those not caused by WAFs or bot detection)
2024-05-04 13:07:53 +00:00
Ryan
9137ee4f09
Add ruff to pr tests (#2093) 2024-04-27 12:41:30 +02:00
Paul Pfeister
2bf6ee4d2e Fix 1337x 2024-04-25 19:44:43 -04:00