Commit graph

124 commits

Author SHA1 Message Date
Paul Pfeister
7370a4dcda Restore SteamID
Seems to work now. May need to be adapted for regional issues.
Closes sherlock-project/sherlock#1815
Closes sherlock-project/sherlock#1848
2024-05-07 00:31:57 -04:00
Paul Pfeister
56b61f34de Restore YouTube 2024-05-06 14:48:27 -04:00
Paul Pfeister
ffa2310630 Add LinkedIn
LinkedIn requires users to be signed in for normal visitation, but certain high-trust crawlers are allowed as well. Here, we masquerade as Googlebot to get past the 999.
2024-05-06 00:49:13 -04:00
Siddharth Dushantha
a7f94d6ee6
Merge branch 'master' into feature/new_targets 2024-05-04 18:02:16 +00:00
Paul Pfeister
760bc98a45 Re-add Instagram
Instagram has been added back to the site list using the old picuki probe. This service DOES use Cloudflare, but it will function perfectly fine until rate limited. Once rate limited, sherlock-project/sherlock#2069 will suppress any false positives.
2024-04-25 18:33:51 -04:00
Paul Pfeister
2a5fbd9e97 Remove BitcoinForum instead of suppress 2024-04-14 15:32:19 -04:00
Paul Pfeister
27e98abbc8 Add some new targets
+ TorrentGalaxy
+ 1337x
+ HackenProof
2024-04-11 19:11:49 -04:00
Paul Pfeister
4006556daa Remove G2G for F+ 2024-04-10 21:50:36 -04:00
Paul Pfeister
0b610b49ae Update removed sites list 2024-04-08 15:13:28 -04:00
Siddharth Dushantha
51e49dd120 removed ebio.gg 2023-12-21 17:40:24 +01:00
Siddharth Dushantha
599ce759fd removed Whonix Forum 2023-12-21 17:38:17 +01:00
Siddharth Dushantha
2ebcfc7614 removed Virgool 2023-12-21 17:34:37 +01:00
Siddharth Dushantha
7c918fe532 removed Lolchess 2023-12-21 17:32:30 +01:00
Siddharth Dushantha
a626008bbf removed TikTok 2023-12-21 17:27:59 +01:00
Siddharth Dushantha
5cbd922c7d removed GunsAndAmmo 2023-08-29 13:54:30 +02:00
Siddharth Dushantha
3b4b818c44 removed YouTube 2023-08-29 13:47:01 +02:00
Siddharth Dushantha
5872269820 removed Quizlet 2023-08-29 13:40:44 +02:00
Siddharth Dushantha
9214fc4369 removed Munzee 2023-08-29 13:31:56 +02:00
Siddharth Dushantha
b47c458d6c removed IRL as its been shut down 2023-08-29 13:28:44 +02:00
Siddharth Dushantha
6cfda957e2 removed Enjin as its been closed down 2023-08-29 13:20:39 +02:00
Siddharth Dushantha
e64df73757 removed ForumhouseRU 2023-04-21 11:09:35 +02:00
Siddharth Dushantha
13e37217ad removed ok.ru 2023-04-21 11:07:56 +02:00
Siddharth Dushantha
88af0bb705 removed Instagram due to false positives 2023-04-21 11:00:16 +02:00
Abhishek Verma
4253ddb2e5
removed onlyfans.com
Recently, @ThePornHelper raised an issue related to OnlyFans false negative. After going through the issue, I tried checking for some popular onlyfans creators on sherlock and as per the issue raised all of them were giving false negative.

So, I checked with the current method of checking the username availability. It the following API url:

`https://onlyfans.com/api2/v2/users/grandmasterchefjojo`

It returns a 400 error code and doesn't work at all.

Why it's happening? It requires a token be passed in the headers to for it to work.

After this, I tried using BurpSuite to find any other way to check availability and unfortunately there aren't any.

Even the wrong onlyfans.com/thisusernamedoesntexist777 URL also returns 200 in HTTP response.

So, it's better to remove OnlyFans from supported sites list and add it to removed_sites.json

Thanks.
2023-04-20 03:12:04 +05:30
Tim Wolf
b54d6aaf94 coil.com removed 2023-04-12 10:11:35 -04:00
Siddharth Dushantha
1317b5acf6 removed Tinder 2023-03-15 11:57:12 +01:00
Siddharth Dushantha
144464281b removed We Heart It 2023-02-25 21:21:43 +01:00
Siddharth Dushantha
bc0d4b6f65 added Venmo, closes #1553
Credits @P3nt3st3r123
2023-02-16 22:33:06 +01:00
Siddharth Dushantha
87b056461b removed several false positives 2023-02-15 17:36:40 +01:00
Siddharth Dushantha
7818ef567a removed BinarySearch.io 2023-02-08 21:05:18 +01:00
denavdot
4cfda3926d added missing positional argument in sites.py
fixed some error and duplicates in `data.json`and `removed_sites.json`
2023-02-05 01:49:16 +03:30
Dena
cdfc8fdbfb
Merge branch 'master' into master 2023-02-04 23:03:56 +03:30
Siddharth Dushantha
845418f23a
Revert "Fixed boingboing.net" 2023-02-04 19:20:26 +01:00
Rhythm Bansal
ff1686152b
Merge branch 'master' into boingboing 2023-02-04 23:42:56 +05:30
Siddharth Dushantha
229b09841e
Merge pull request #1581 from mrsofiane/fix-add-spotify-to-work
fix: add Spotify to work again
2023-02-04 10:00:46 -08:00
Siddharth Dushantha
2773c6081c removed Facebook due to false positives 2023-02-04 18:01:44 +01:00
Siddharth Dushantha
db6b0ddb6d removed Zoomit due to false postives 2023-02-04 17:57:58 +01:00
Siddharth Dushantha
d426f39d49 removed Arduino due to false positives 2023-02-04 17:50:38 +01:00
Dena
0f36c50b5b
Merge branch 'master' into master 2022-12-26 23:09:14 +03:30
r3g_5z
3e8b8beec4
Remove mastodon.technology
Signed-off-by: r3g_5z <june@girlboss.ceo>
2022-12-18 17:22:13 -05:00
DenavDot
aca2629475 Remove fixed value of "username unclaimed" #1628 2022-12-03 16:31:05 +03:30
Rhythm Bansal
372547266d removed boingboing.net from removed_sites.json 2022-10-26 16:20:57 +05:30
Sofiane Louchene
28b762a598 fix: add Spotify to work again 2022-10-24 00:07:44 +02:00
Sofiane Louchene
0f7afa9bd0 fix: add Youtube to work again 2022-10-17 14:09:53 +02:00
Siddharth Dushantha
c8daa0ffe5 removed Google Developer 2022-10-09 12:57:20 +02:00
Siddharth Dushantha
5051e27bc4 removed GuruShots 2022-09-08 15:37:12 +02:00
Siddharth Dushantha
a6d88b4765 removed GitHub Support Community 2022-09-06 09:52:25 +02:00
Siddharth Dushantha
861855754d removed Ello 2022-09-06 09:43:40 +02:00
BassCoder2808
84dfcff7ec removed merge conflicts 2022-07-26 20:06:50 +05:30
BassCoder2808
20bfe3441b added removed sites to removed_sites.json 2022-07-26 09:34:25 +05:30