Mirrors/ArchiveBox
2
0
Fork 0
mirror of https://github.com/ArchiveBox/ArchiveBox synced 2024-11-26 14:10:20 +00:00
Code Issues Projects Releases Packages Wiki Activity

show dots as progress bar for titles fetching

Browse source
This commit is contained in:
Nick Sweeting 2019-02-04 22:07:59 -08:00
parent ee93807a0a
commit 1ca27a60b2
1 changed files with 1 additions and 0 deletions
Show stats Download patch file Download diff file Expand all files Collapse all files

1
archivebox/util.py
View file

@ -234,6 +234,7 @@ def fetch_page_title(url, default=True):
try:
sys.stdout.write('.')
sys.stdout.flush()
html_content = urllib.request.urlopen(url, timeout=10).read().decode('utf-8')
match = re.search('<title>(.*?)</title>', html_content)
return match.group(1) if match else default or None