Commit graph

31 commits

Author SHA1 Message Date
Siddharth Dushantha
8eaaae19a1 mark nsfw sites as nsfw in site list 2023-02-26 11:51:56 +01:00
Siddharth Dushantha
0be9fb1c40 Made the code simpler 2023-02-15 20:54:36 +01:00
Siddharth Dushantha
cf5756578d updated site list and added favicon to site.md 2022-09-08 17:23:50 +02:00
benni347
f4673cc13c Refractored sites.py, sherlock.py and notify.py. 2022-01-31 11:06:29 +01:00
Seth Falco
a0360d4725
chore: make quotes in repo consistent 2021-12-11 17:34:35 +01:00
Seth Falco
fbf879611b
chore: add editorconfig 2021-09-24 16:48:54 +02:00
NirajNair
d404fe73fc Changes made to site_list.py to reduce commit size 2020-12-19 15:57:23 +05:30
NirajNair
5098b67aa6 Changes made to site_list.py to reduce commit size 2020-12-19 15:51:16 +05:30
Siddharth Dushantha
3a8ed636f5 cleaned up site_list.py and updated site.md 2020-08-07 21:55:33 +02:00
Siddharth Dushantha
490a26248a removed ranking from site_list.py and organized data.json by alphabetic
order
2020-08-07 21:07:20 +02:00
Christopher K. Hoadley
2b99aeef0f Fix path to data file when doing site update. 2020-05-08 23:39:41 -05:00
Christopher K. Hoadley
92879af8eb Merge remote-tracking branch 'origin/master' into restructure_take1
# Conflicts:
#	README.md
#	sherlock/sherlock.py
2020-04-12 10:53:28 -05:00
Armin
bc3e58d599 removed unused variable 2020-03-14 00:21:15 +03:30
Christopher K. Hoadley
d17268e737 Move content into sherlock sub-directory inside of repo. This directory will look very much like what the packaged version of Sherlock will look like when it is installed in the site-packages area.
No real restructuring of the code has happened.  This just gives a view of the directory structure.
2019-10-26 22:42:03 -05:00
Christopher K. Hoadley
bd70be289b Change method used to get site ranking. Not only has alexa.com changed the format of their web site, they also seem to have gotten even more picky about people scraping it. So, use their API to query the site data.
Not sure why the API was not used earlier.  It is much more efficient as much less data is passed.  And, it is less likely to have its format changed randomly.  It did flake out on some sites one time I used it.  But, then it worked reliably next.  I am not going to do many requests, as it probably has some query rate limit.
2019-05-28 07:26:30 -05:00
jenchieh
8b6b14fc6a Fixed mixed of tabs and spaces in a single file. 2019-03-09 19:33:42 +08:00
aditisrinivas97
619d9ab6bc
Fix issue with site name and url 2019-01-27 16:45:01 +05:30
Avinash Shenoy
3db3f4558b
Parallelized updating alexa ranking 2019-01-27 15:20:45 +05:30
Avinash Shenoy
1442f333c2
Parallelised updating Alexa.com ranking of sites
Script now fetches Alexa ranks for sites concurrently on separate threads. Cuts down the time to sync ranks from approximately **5 minutes** to about **18 seconds**.
2019-01-27 15:01:55 +05:30
ptalmeida
826af1ec19 remove unused import 2019-01-25 12:45:55 +00:00
ptalmeida
9c45146da1 remove unused import 2019-01-24 12:54:09 +00:00
ptalmeida
cc2b1cb27a Improve terminal appearence for site_list.py 2019-01-24 12:50:02 +00:00
ptalmeida
40fc51fc32 add rank paramether to site_list.py
--rank or -r to update all page ranks
2019-01-24 12:35:08 +00:00
ptalmeida
ad4c321f3f Correct print look 2019-01-24 11:16:23 +00:00
ptalmeida
04ee711872 Merge remote-tracking branch 'upstream/master' 2019-01-24 11:13:43 +00:00
ptalmeida
46705ad0a1 Add Alexa.com rank updating functionality to site_list.py 2019-01-24 11:01:34 +00:00
Yahya SayadArbabi
f641649be7 Sort "sites.md" 2019-01-23 23:02:35 +03:30
Pedro Almeida
1ed24f5993
correct code 2019-01-23 14:19:36 +00:00
ptalmeida
2ef168d924 Add website sorting code to site_list.py
Includes a fix in indentation
2019-01-23 14:14:37 +00:00
Christopher K. Hoadley
4ecaad6289 Update script to use with-as structure for files. Add number of supported sites to title. Add status message. 2018-12-30 11:50:10 -06:00
anto-christo
26adc32497 Add script for listing sites in sites.md 2018-12-30 04:46:43 +05:30