Christopher K. Hoadley
bd70be289b
Change method used to get site ranking. Not only has alexa.com changed the format of their web site, they also seem to have gotten even more picky about people scraping it. So, use their API to query the site data.
...
Not sure why the API was not used earlier. It is much more efficient as much less data is passed. And, it is less likely to have its format changed randomly. It did flake out on some sites one time I used it. But, then it worked reliably next. I am not going to do many requests, as it probably has some query rate limit.
2019-05-28 07:26:30 -05:00
jenchieh
8b6b14fc6a
Fixed mixed of tabs and spaces in a single file.
2019-03-09 19:33:42 +08:00
aditisrinivas97
619d9ab6bc
Fix issue with site name and url
2019-01-27 16:45:01 +05:30
Avinash Shenoy
3db3f4558b
Parallelized updating alexa ranking
2019-01-27 15:20:45 +05:30
Avinash Shenoy
1442f333c2
Parallelised updating Alexa.com ranking of sites
...
Script now fetches Alexa ranks for sites concurrently on separate threads. Cuts down the time to sync ranks from approximately **5 minutes** to about **18 seconds**.
2019-01-27 15:01:55 +05:30
ptalmeida
826af1ec19
remove unused import
2019-01-25 12:45:55 +00:00
ptalmeida
9c45146da1
remove unused import
2019-01-24 12:54:09 +00:00
ptalmeida
cc2b1cb27a
Improve terminal appearence for site_list.py
2019-01-24 12:50:02 +00:00
ptalmeida
40fc51fc32
add rank paramether to site_list.py
...
--rank or -r to update all page ranks
2019-01-24 12:35:08 +00:00
ptalmeida
ad4c321f3f
Correct print look
2019-01-24 11:16:23 +00:00
ptalmeida
04ee711872
Merge remote-tracking branch 'upstream/master'
2019-01-24 11:13:43 +00:00
ptalmeida
46705ad0a1
Add Alexa.com rank updating functionality to site_list.py
2019-01-24 11:01:34 +00:00
Yahya SayadArbabi
f641649be7
Sort "sites.md"
2019-01-23 23:02:35 +03:30
Pedro Almeida
1ed24f5993
correct code
2019-01-23 14:19:36 +00:00
ptalmeida
2ef168d924
Add website sorting code to site_list.py
...
Includes a fix in indentation
2019-01-23 14:14:37 +00:00
Christopher K. Hoadley
4ecaad6289
Update script to use with-as structure for files. Add number of supported sites to title. Add status message.
2018-12-30 11:50:10 -06:00
anto-christo
26adc32497
Add script for listing sites in sites.md
2018-12-30 04:46:43 +05:30