Paul Pfeister
eeacf511dc
Add try-catch to pop
2024-05-07 23:50:18 -04:00
Matheus Felipe
c7f935099e
Fix parser regression ( #2109 )
2024-05-08 00:37:39 -03:00
Paul Pfeister
78d255ee56
Fix parser regression
...
Added exception catch for TypeErrors due to future addition of keys, allowing Sherlock to continue past those errors.
Removed $schema to accomodate older versions of the parser. This key will be added back in sherlock-project/sherlock#2088 (or other version incrementing change).
2024-05-07 22:32:49 -04:00
Paul Pfeister
de21308219
Fix Linktree F+
...
Linktree only permits usernames with the given regex and 404s otherwise
2024-05-07 21:16:24 -04:00
Paul Pfeister
82d7e9ce43
Fix CNET F+
...
CNET appears to have changed some things...
'null null' text has been removed with a redesign, and invalid users now return a 404 so we don't need a whole GET and English-only check.
2024-05-07 20:55:25 -04:00
Siddharth Dushantha
d0c8282e5e
Merge pull request #2099 from ppfeister/feature/schema
...
Set schema for manifest
2024-05-07 19:25:59 +00:00
Siddharth Dushantha
c9394451fb
Merge pull request #2105 from ppfeister/bugfix/broken-urls-2102
...
Fix displayed hyperlinks
2024-05-07 18:26:11 +00:00
github-actions[bot]
c470cabe7c
Updated Site List
2024-05-07 18:25:51 +00:00
Siddharth Dushantha
5c7debec38
Merge pull request #2104 from ppfeister/feature/new-targets
...
Add BugCrowd, SteamID
2024-05-07 18:25:33 +00:00
Paul Pfeister
d85c07384f
pr action doesn't appreciate explicit type notation apparently
2024-05-07 03:13:05 -04:00
Paul Pfeister
25e0acd98e
Skip content filter for explicitly chosen targets
...
Targets specified via --site will no longer be excluded when --nsfw is not set, even if flagged as nsfw. If the target was specifically listed by the user, it's probably because they want that target.
Fixes sherlock-project/sherlock#2103
2024-05-07 03:08:39 -04:00
Paul Pfeister
2ff115fb4c
Fix displayed hyperlinks
...
Fixes sherlock-project/sherlock#2102
2024-05-07 02:17:40 -04:00
Paul Pfeister
0a2978abeb
Remove ~correct~ Steam from Removed_Sites
2024-05-07 02:00:49 -04:00
Paul Pfeister
7370a4dcda
Restore SteamID
...
Seems to work now. May need to be adapted for regional issues.
Closes sherlock-project/sherlock#1815
Closes sherlock-project/sherlock#1848
2024-05-07 00:31:57 -04:00
Paul Pfeister
2575450bef
Add BugCrowd
2024-05-07 00:22:12 -04:00
Paul Pfeister
d118c1c43c
Disallow other $ keys
2024-05-06 19:58:40 -04:00
Paul Pfeister
0446779a3c
Simplify schema with defs
2024-05-06 19:25:38 -04:00
Paul Pfeister
e4cbd3d8ad
Add target top-level hint
2024-05-06 18:56:53 -04:00
Paul Pfeister
80d0434bb3
Require keys based on errorType value
2024-05-06 18:49:48 -04:00
Paul Pfeister
cc0b57c0af
Prevent mixing of error values
2024-05-06 18:37:21 -04:00
Paul Pfeister
4b2f8ad2d0
Bring comments into compliance with schema
2024-05-06 18:05:37 -04:00
github-actions[bot]
f5796c24b3
Updated Site List
2024-05-06 20:17:56 +00:00
Siddharth Dushantha
56957408f5
Merge pull request #1990 from nicholasmurillo/my-opensource-contribution
...
Added Kick
2024-05-06 20:17:43 +00:00
Siddharth Dushantha
6182c3c250
changed error checking method
...
Checking for the status code wasn't stable. Therefore checking for error
messages is better
2024-05-06 22:14:51 +02:00
github-actions[bot]
b3bb3aef61
Updated Site List
2024-05-06 19:58:10 +00:00
Siddharth Dushantha
884019a9e9
Merge pull request #2098 from Ableytner/master
...
Add AniWorld
2024-05-06 19:57:57 +00:00
github-actions[bot]
014b4bcdf1
Updated Site List
2024-05-06 19:48:52 +00:00
Siddharth Dushantha
efd5f36674
Merge pull request #2101 from ppfeister/feature/youtube
...
Restore YouTube
2024-05-06 19:48:37 +00:00
Paul Pfeister
56b61f34de
Restore YouTube
2024-05-06 14:48:27 -04:00
github-actions[bot]
80a513a948
Updated Site List
2024-05-06 15:30:01 +00:00
Siddharth Dushantha
b3a56100c8
Merge pull request #2038 from Gowthamk007m/master
...
Added Blipfoto and LibraryThing
2024-05-06 15:29:49 +00:00
Gowtham K M
26f6bcb7f5
Merge branch 'sherlock-project:master' into master
2024-05-06 19:46:59 +05:30
Gowtham K M
8608aa5747
Blipfoto error checking reverted to status_code
2024-05-06 19:46:31 +05:30
github-actions[bot]
31ab96675c
Updated Site List
2024-05-06 10:13:08 +00:00
Siddharth Dushantha
67cae59d73
Merge pull request #2100 from ppfeister/feature/linkedin
...
Add LinkedIn
2024-05-06 10:12:54 +00:00
Gowtham K M
e99e2b11d7
Merge branch 'sherlock-project:master' into master
2024-05-06 11:49:35 +05:30
Gowtham K M
ba1377a570
Update error type to 'message' and set errorMsg to 'This user doesn't exist'
2024-05-06 11:48:55 +05:30
Paul Pfeister
2da7195ba8
Add PUT request_method
2024-05-06 01:13:20 -04:00
Paul Pfeister
d8aaeea168
Add regex
2024-05-06 01:09:31 -04:00
Paul Pfeister
ffa2310630
Add LinkedIn
...
LinkedIn requires users to be signed in for normal visitation, but certain high-trust crawlers are allowed as well. Here, we masquerade as Googlebot to get past the 999.
2024-05-06 00:49:13 -04:00
Paul Pfeister
198798d28b
Add basic schema
2024-05-06 00:09:00 -04:00
Ableytner
e2faa8a281
remove default username_unclaimed
2024-05-05 20:24:59 +02:00
Ableytner
f224cbe656
add AniWorld
2024-05-05 19:46:14 +02:00
github-actions[bot]
49b190f841
Updated Site List
2024-05-05 11:45:24 +00:00
Siddharth Dushantha
743aa8d320
Merge pull request #2097 from sherlock-project/hudsonrock
...
added HudsonRock
2024-05-05 11:45:12 +00:00
Siddharth Dushantha
f035cc329d
added HudsonRock
2024-05-05 13:41:10 +02:00
github-actions[bot]
58a2cc9c43
Updated Site List
2024-05-04 18:12:10 +00:00
Siddharth Dushantha
667289a23a
Merge pull request #2092 from ppfeister/feature/new_targets
...
Collection of new and restored targets
2024-05-04 18:11:58 +00:00
Siddharth Dushantha
a7f94d6ee6
Merge branch 'master' into feature/new_targets
2024-05-04 18:02:16 +00:00
Siddharth Dushantha
122082a602
Merge pull request #2069 from ppfeister/feature/antiwaf
...
Reduce false positives (those caused by WAFs and bot detection)
2024-05-04 13:12:45 +00:00
