Paul Pfeister
25e0acd98e
Skip content filter for explicitly chosen targets
...
Targets specified via --site will no longer be excluded when --nsfw is not set, even if flagged as nsfw. If the target was specifically listed by the user, it's probably because they want that target.
Fixes sherlock-project/sherlock#2103
2024-05-07 03:08:39 -04:00
github-actions[bot]
f5796c24b3
Updated Site List
2024-05-06 20:17:56 +00:00
Siddharth Dushantha
56957408f5
Merge pull request #1990 from nicholasmurillo/my-opensource-contribution
...
Added Kick
2024-05-06 20:17:43 +00:00
Siddharth Dushantha
6182c3c250
changed error checking method
...
Checking for the status code wasn't stable. Therefore checking for error
messages is better
2024-05-06 22:14:51 +02:00
github-actions[bot]
b3bb3aef61
Updated Site List
2024-05-06 19:58:10 +00:00
Siddharth Dushantha
884019a9e9
Merge pull request #2098 from Ableytner/master
...
Add AniWorld
2024-05-06 19:57:57 +00:00
github-actions[bot]
014b4bcdf1
Updated Site List
2024-05-06 19:48:52 +00:00
Siddharth Dushantha
efd5f36674
Merge pull request #2101 from ppfeister/feature/youtube
...
Restore YouTube
2024-05-06 19:48:37 +00:00
Paul Pfeister
56b61f34de
Restore YouTube
2024-05-06 14:48:27 -04:00
github-actions[bot]
80a513a948
Updated Site List
2024-05-06 15:30:01 +00:00
Siddharth Dushantha
b3a56100c8
Merge pull request #2038 from Gowthamk007m/master
...
Added Blipfoto and LibraryThing
2024-05-06 15:29:49 +00:00
Gowtham K M
26f6bcb7f5
Merge branch 'sherlock-project:master' into master
2024-05-06 19:46:59 +05:30
Gowtham K M
8608aa5747
Blipfoto error checking reverted to status_code
2024-05-06 19:46:31 +05:30
github-actions[bot]
31ab96675c
Updated Site List
2024-05-06 10:13:08 +00:00
Siddharth Dushantha
67cae59d73
Merge pull request #2100 from ppfeister/feature/linkedin
...
Add LinkedIn
2024-05-06 10:12:54 +00:00
Gowtham K M
e99e2b11d7
Merge branch 'sherlock-project:master' into master
2024-05-06 11:49:35 +05:30
Gowtham K M
ba1377a570
Update error type to 'message' and set errorMsg to 'This user doesn't exist'
2024-05-06 11:48:55 +05:30
Paul Pfeister
d8aaeea168
Add regex
2024-05-06 01:09:31 -04:00
Paul Pfeister
ffa2310630
Add LinkedIn
...
LinkedIn requires users to be signed in for normal visitation, but certain high-trust crawlers are allowed as well. Here, we masquerade as Googlebot to get past the 999.
2024-05-06 00:49:13 -04:00
Ableytner
e2faa8a281
remove default username_unclaimed
2024-05-05 20:24:59 +02:00
Ableytner
f224cbe656
add AniWorld
2024-05-05 19:46:14 +02:00
github-actions[bot]
49b190f841
Updated Site List
2024-05-05 11:45:24 +00:00
Siddharth Dushantha
743aa8d320
Merge pull request #2097 from sherlock-project/hudsonrock
...
added HudsonRock
2024-05-05 11:45:12 +00:00
Siddharth Dushantha
f035cc329d
added HudsonRock
2024-05-05 13:41:10 +02:00
github-actions[bot]
58a2cc9c43
Updated Site List
2024-05-04 18:12:10 +00:00
Siddharth Dushantha
667289a23a
Merge pull request #2092 from ppfeister/feature/new_targets
...
Collection of new and restored targets
2024-05-04 18:11:58 +00:00
Siddharth Dushantha
a7f94d6ee6
Merge branch 'master' into feature/new_targets
2024-05-04 18:02:16 +00:00
Siddharth Dushantha
122082a602
Merge pull request #2069 from ppfeister/feature/antiwaf
...
Reduce false positives (those caused by WAFs and bot detection)
2024-05-04 13:12:45 +00:00
github-actions[bot]
71bdf63c19
Updated Site List
2024-05-04 13:08:04 +00:00
Siddharth Dushantha
482982c4e4
Merge pull request #2068 from ppfeister/master
...
Reduce false positives (those not caused by WAFs or bot detection)
2024-05-04 13:07:53 +00:00
Ryan
9137ee4f09
Add ruff to pr tests ( #2093 )
2024-04-27 12:41:30 +02:00
Paul Pfeister
2bf6ee4d2e
Fix 1337x
2024-04-25 19:44:43 -04:00
Paul Pfeister
7bf4be4b70
Add Untappd
...
Untappd is behind Cloudflare, but this doesn't seem to impact early requests. After being ratelimited, sherlock-project/sherlock#2069 will suppress any possible WAF-induced false positives.
Closes sherlock-project/sherlock#1780
2024-04-25 19:27:58 -04:00
Paul Pfeister
760bc98a45
Re-add Instagram
...
Instagram has been added back to the site list using the old picuki probe. This service DOES use Cloudflare, but it will function perfectly fine until rate limited. Once rate limited, sherlock-project/sherlock#2069 will suppress any false positives.
2024-04-25 18:33:51 -04:00
Paul Pfeister
89251745d9
Add Codeberg
2024-04-25 18:02:01 -04:00
Paul Pfeister
db213de326
Remove unnecessary errorMsg
2024-04-25 17:53:45 -04:00
Paul Pfeister
7c94534732
Add CSSBattle ~properly~
2024-04-25 17:49:29 -04:00
Paul Pfeister
137009ef37
Add Spells8 (and sort)
...
Resolves sherlock-project/sherlock#2091
2024-04-25 17:21:27 -04:00
Paul Pfeister
51959f95a7
Update sites list
2024-04-14 15:35:23 -04:00
Paul Pfeister
2a5fbd9e97
Remove BitcoinForum instead of suppress
2024-04-14 15:32:19 -04:00
Paul Pfeister
ca9a78757f
Add CyberDefenders
2024-04-11 21:45:22 -04:00
Paul Pfeister
5c23b1555c
Update default User-Agent
...
I've noticed that many bot-detection pages are able to be avoided by using this UA. Unless there's a reason to stay on the old old old one, we may as well update it and reduce our WAF hits.
2024-04-11 21:23:11 -04:00
Paul Pfeister
9f6cd80e28
Add PentesterLab
2024-04-11 21:05:13 -04:00
Paul Pfeister
27e98abbc8
Add some new targets
...
+ TorrentGalaxy
+ 1337x
+ HackenProof
2024-04-11 19:11:49 -04:00
Paul Pfeister
d59661903a
Update site lists
2024-04-11 17:43:32 -04:00
Paul Pfeister
e43c6047be
Fix status_code default logic bug
2024-04-11 17:39:23 -04:00
Paul Pfeister
060088f7a1
Fix status_code logic bug
2024-04-11 17:28:39 -04:00
Paul Pfeister
da3c90fce8
Fix Telegram F+
2024-04-10 22:39:55 -04:00
Paul Pfeister
482f216ff9
Fix Kongregate F+
...
Attempts were met with a Varnish error page presenting 54113 (possibly Fastly related).
Change to User Agent necessary to avoid Varnish/Fastly issues.
Change to Accept necessary to avoid infinite 302 redirection.
Without BOTH of these changes, attempts will fail.
Both changes being made also permit the use of status_code rather than message.
2024-04-10 22:24:36 -04:00
Paul Pfeister
4006556daa
Remove G2G for F+
2024-04-10 21:50:36 -04:00
