Mirrors/yt-dlp
2
0
Fork 0
mirror of https://github.com/yt-dlp/yt-dlp.git synced 2024-12-14 23:32:33 +00:00
Code Issues Projects Releases Packages Wiki Activity
22245 commits 3 branches 103 tags 245 MiB
Commit graph

3448 commits

Author SHA1 Message Date
bashonly
03e85ea99d
[ie/youtube] Fix heatmap extraction (#8299) 
Closes #8189
Authored by: bashonly
 2023-10-06 20:00:15 -05:00
Aleri Kaisattera
792f1e64f6
[ie/theta] Remove extractors (#8251) 
Authored by: alerikaisattera
 2023-10-06 23:56:47 +00:00
trainman261
19c90e405b
[cleanup] Update extractor tests (#7718) 
Authored by: trainman261
 2023-10-06 23:56:19 +00:00
garret
e831c80e8b
[ie/nhk] Fix VOD extraction (#8249) 
Closes #8242
Authored by: garret1317
 2023-10-06 23:05:48 +00:00
Raphaël Droz
0e722f2f3c
[ie/lbry] Extract uploader_id (#8244) 
Closes #123
Authored by: drzraf
 2023-10-06 22:59:42 +00:00
Esme
47c598783c
[ie/erocast] Add extractor (#8264) 
Closes #4001
Authored by: madewokherd
 2023-10-06 22:58:28 +00:00
AS6939
35d9cbaf96
[ie/iq.com] Fix extraction and subtitles (#8260) 
Closes #7734, Closes #8123
Authored by: AS6939
 2023-10-06 22:56:12 +00:00
garret
2ad3873f0d
[ie/radiko] Improve extraction (#8221) 
Authored by: garret1317
 2023-10-06 22:53:11 +00:00
Umar Getagazov
2f2dda3a7e
[ie/substack] Fix download cookies bug (#8219) 
Authored by: handlerug
 2023-10-06 22:48:54 +00:00
Umar Getagazov
fbcc299bd8
[ie/substack] Fix embed extraction (#8218) 
Authored by: handlerug
 2023-10-06 22:45:46 +00:00
Raphaël Droz
48cceec1dd
[ie/lbry] Add playlist support (#8213) 
Closes #5982, Closes #8204
Authored by: drzraf, bashonly, Grub4K
 2023-10-06 22:38:26 +00:00
xofe
a9efb4b8d7
[ie/abc.net.au:iview] Improve episode extraction (#8201) 
Authored by: xofe
 2023-10-06 22:35:11 +00:00
c-basalt
f980df734c
[ie/neteasemusic] Fix extractors (#8181) 
Closes #4388
Authored by: c-basalt
 2023-10-06 22:31:33 +00:00
gillux
91a670a4f7
[ie/LiTV] Fix extractor (#7785) 
Closes #5456
Authored by: jiru
 2023-10-06 22:27:54 +00:00
bashonly
b095fd3fa9
[ie/WrestleUniverseVOD] Call API with device ID (#8272) 
Closes #8271
Authored by: bashonly
 2023-10-04 18:01:52 +00:00
bashonly
0730d5a966
[ie/gofile] Fix token cookie bug 
Authored by: bashonly
 2023-10-04 13:00:33 -05:00
Simon Sawicki
cc8d844152
[ie/xhamster:user] Support creator urls (#8232) 
Authored by: Grub4K
 2023-10-03 11:33:40 +02:00
coletdjnz
eb5bdbfa70
[ie/youtube] Raise a warning for Incomplete Data instead of an error (#8238) 
Closes https://github.com/yt-dlp/yt-dlp/issues/8206

Adds `raise_incomplete_data` extractor arg to revert this behaviour and raise an error.

Authored by: coletdjnz
Co-authored-by: Simon Sawicki <contact@grub4k.xyz>
 2023-10-03 06:42:30 +00:00
github-actions
c54ddfba0f Release 2023.09.24 
Created by: Grub4K

:ci skip all :ci run dl
 2023-09-24 00:38:42 +00:00
Simon Sawicki
de015e9307
[core] Prevent RCE when using --exec with %q (CVE-2023-40581) 
The shell escape function is now using `""` instead of `\"`. `utils.Popen` has been patched to properly quote commands.

Prior to this fix using `--exec` together with `%q` when on Windows could cause remote code to execute. See https://github.com/yt-dlp/yt-dlp/security/advisories/GHSA-42h4-v29r-42qg for reference.

Authored by: Grub4K
 2023-09-24 02:29:01 +02:00
Simon Sawicki
61bdf15fc7
[core] Raise minimum recommended Python version to 3.8 (#8183) 
Authored by: Grub4K
 2023-09-24 02:24:47 +02:00
bashonly
1eaca74bc2
[ie/nfl.com:plus:replay] Fix extractor (#7838) 
Closes #7836
Authored by: bashonly
 2023-09-23 23:47:14 +00:00
Mozi
92feb5654c
[ie/brilliantpala] Add extractors (#6680) 
Authored by: pzhlkj6612
 2023-09-23 23:42:29 +00:00
Mozi
698beb9a49
[ie/niconicochannelplus] Add extractors (#5686) 
Closes #2537
Authored by: pzhlkj6612
 2023-09-23 22:36:34 +00:00
garret
15591940ff
[ie/cineverse] Add extractors (#8146) 
Also removes AsianCrushIE and AsianCrushPlaylistIE (URLs do not work anymore & old IDs are unavailable).

Closes #8109
Authored by: garret1317
 2023-09-23 22:27:13 +00:00
Mozi
6636021206
[ie/PIAULIZAPortal] Add extractor (#7903) 
Authored by: pzhlkj6612
 2023-09-23 22:15:01 +00:00
garret
eaee21bf71
[ie/Monstercat] Add extractor (#8133) 
Closes #8067
Authored by: garret1317
 2023-09-23 22:13:48 +00:00
bashonly
5ca095cbcd
[cleanup] Misc (#8182) 
Closes #7796, Closes #8028
Authored by: barsnick, sqrtNOT, gamer191, coletdjnz, Grub4K, bashonly
 2023-09-23 20:00:31 +00:00
bashonly
c2da0b5ea2
[ie/ArteTV] Fix HLS formats extraction 
Closes #8156
Authored by: bashonly
 2023-09-23 14:54:00 -05:00
Atsushi Watanabe
c1d71d0d9f
[ie/twitcasting] Support --wait-for-video (#7975) 
Authored by: at-wat
 2023-09-21 23:04:05 +00:00
std-move
568f080518
[ie/iprima] Fix extractor (#7216) 
Closes #7229
Authored by: std-move
 2023-09-21 22:20:52 +00:00
bashonly
904a19ee93
[ie] Make _search_nuxt_data more lenient 
Authored by: std-move

Co-authored-by: std-move <26625259+std-move@users.noreply.github.com>
 2023-09-21 16:54:57 -05:00
bashonly
52414d64ca
[utils] js_to_json: Handle Array objects 
Authored by: Grub4K, std-move

Co-authored-by: std-move <26625259+std-move@users.noreply.github.com>
Co-authored-by: Simon Sawicki <accounts@grub4k.xyz>
 2023-09-21 16:51:57 -05:00
std-move
2269065ad6
[ie/NovaEmbed] Fix extractor (#7910) 
Closes #8025
Authored by: std-move
 2023-09-21 18:19:52 +00:00
kylegustavo
a5e264d74b
[ie/Expressen] Improve _VALID_URL (#8153) 
Closes #8141
Authored by: kylegustavo
 2023-09-21 17:46:49 +00:00
ClosedPort22
b84fda7388
[ie/bilibili] Extract Dolby audio formats (#8142) 
Closes #4050
Authored by: ClosedPort22
 2023-09-21 17:45:18 +00:00
Simon
5fccabac27
[ie/rbgtum] Fix extraction and support new URL format (#7690) 
Authored by: simon300000
 2023-09-21 17:37:58 +00:00
c-basalt
21f40e75df
[ie/douyutv] Fix extractors (#7652) 
Closes #2494, Closes #7295
Authored by: c-basalt
 2023-09-21 17:34:35 +00:00
Elyse
b3febedbeb
[ie/Canal1,CaracolTvPlay] Add extractors (#7151) 
Closes #5826
Authored by: elyse0
 2023-09-21 17:30:32 +00:00
Mozi
295fbb3ae3
[ie/eplus:inbound] Add extractor (#5782) 
Authored by: pzhlkj6612
 2023-09-21 17:28:20 +00:00
bashonly
35f9a306e6
[dependencies] Handle deprecation of sqlite3.version (#8167) 
Closes #8152
Authored by: bashonly
 2023-09-21 15:58:53 +00:00
Simon Sawicki
b532556d0a
[ie/pr0gramm] Rewrite extractor (#8151) 
Authored by: Grub4K
 2023-09-19 21:52:44 +02:00
Rohan Dey
cf11b40ac4
[ie/media.ccc.de:lists] Fix extraction (#8144) 
Closes #8138
Authored by: Rohxn16
 2023-09-18 23:39:20 +00:00
niemands
40999467f7
[ie/pornbox] Add extractor (#7386) 
Authored by: niemands
 2023-09-18 23:37:17 +00:00
u-spec-png
8ac5b6d96a
[ie/N1Info:article] Fix extractor (#7373) 
Authored by: u-spec-png
 2023-09-18 23:36:10 +00:00
c-basalt
69b03f84f8
[ie/weibo] Fix extractor and support user extraction (#7657) 
Closes #3964, Closes #4673, Closes #6979
Authored by: c-basalt
 2023-09-18 23:06:36 +00:00
c-basalt
9e68747f96
[ie/bilibili] Add support for series, favorites and watch later (#7518) 
Closes #6719
Authored by: c-basalt
 2023-09-18 23:02:00 +00:00
Elyse
ba8e9eb2c8
[ie/radiofrance] Add support for livestreams, podcasts, playlists (#7006) 
Closes #4282
Authored by: elyse0
 2023-09-18 21:08:40 +00:00
coletdjnz
20fbbd9249
[networking] Fix various socks proxy bugs (#8065) 
- Fixed support for IPv6 socks proxies
- Fixed support for IPv6 over socks5
- Fixed --source-address not being obeyed for socks4 and socks5
- Fixed socks4a when the destination address is an IPv4 address

Closes https://github.com/yt-dlp/yt-dlp/issues/7959
Fixes https://github.com/ytdl-org/youtube-dl/issues/15368

Authored by: coletdjnz
Co-authored-by: Simon Sawicki <accounts@grub4k.xyz>
Co-authored-by: bashonly <bashonly@bashonly.com>
 2023-09-18 07:33:26 +00:00
Sebastian Koch
81f46ac573
[ie/massengeschmack.tv] Fix title extraction (#7813) 
Authored by: sb0stn
 2023-09-17 20:54:00 +00:00
aky-01
63e0c5748c
[ie/IndavideoEmbed] Fix extraction (#8129) 
Closes #7190
Authored by: aky-01
 2023-09-17 15:16:11 +00:00
Simon
efa2339502
[ie/lecturio] Improve _VALID_URL (#7649) 
Authored by: simon300000
 2023-09-17 15:11:22 +00:00
soundchaser128
58493923e9
[ie/rule34video] Extract tags (#7117) 
Authored by: soundchaser128
 2023-09-17 15:09:42 +00:00
Simon Sawicki
836e06d246
[core] Fix support for upcoming Python 3.12 (#8130) 
This also adds the following test runners:
- `3.12-dev` on `ubuntu-latest`
- `3.12-dev` on `windows-latest`
- `pypy-3.10` on `ubuntu-latest`

Authored by: Grub4K
 2023-09-17 12:56:50 +02:00
bashonly
94389b225d
[ie/RTVSLO] Fix format extraction (#8131) 
Closes #8020
Authored by: bashonly
 2023-09-17 02:42:42 +00:00
bashonly
9652bca1bd
[ie/web.archive:vlive] Remove extractor (#8132) 
Closes #8122
Authored by: bashonly
 2023-09-17 00:38:09 +00:00
bashonly
538d37671a
[ie/AmazonMiniTV] Fix extractors 
Closes #7817
Authored by: GautamMKGarg, bashonly

Co-authored by: GautamMKGarg <GautamMKgarg@gmail.com>
 2023-09-16 19:03:30 -05:00
bashonly
2da7bcca16
Revert 9d376c4dae 
Authored by: bashonly
 2023-09-16 18:57:14 -05:00
garret
eda0e415d2
[ie/bbc] Extract tracklist as chapters (#7788) 
Authored by: garret1317
 2023-09-16 22:47:49 +00:00
bashonly
20c3c9b433
[ie/reddit] Extract subtitles 
Closes #7814
Authored by: bashonly
 2023-09-16 16:23:54 -05:00
bashonly
635ae31f68
[ie/mediastream] Make embed extraction non-fatal 
Authored by: bashonly
 2023-09-16 16:22:21 -05:00
bashonly
5367585219
[ie/generic] Fix KVS thumbnail extraction 
Closes #8045
Authored by: bashonly
 2023-09-16 16:20:34 -05:00
fireattack
308936619c
[ie/facebook] Improve format sorting (#8074) 
Authored by: fireattack
 2023-09-16 21:18:04 +00:00
c-basalt
5be7e97886
[ie/sohu] Fix extractor (#7628) 
Closes #1667, Closes #7463
Authored by: c-basalt, bashonly
 2023-09-16 21:13:04 +00:00
barsnick
b4c1c408c6
[ie/Bild.de] Extract HLS formats (#8032) 
Closes #7951
Authored by: barsnick
 2023-09-16 21:11:05 +00:00
Tristan Lee
23d829a342
[ie/Rumble] Fix embed extraction (#8035) 
Authored by: trislee
 2023-09-16 21:08:15 +00:00
04-pasha-04
0ce1f48bf1
[ie/funker530] Fix extraction (#8040) 
Authored by: 04-pasha-04
 2023-09-16 21:06:00 +00:00
Mozi
ecef42c3ad
[ie/zaiko] Improve thumbnail extraction (#8054) 
Authored by: pzhlkj6612
 2023-09-16 21:04:10 +00:00
ApoorvShah111
a83da3717d
[ie/nitter] Fix title extraction fallback (#8102) 
Closes #7575
Authored by: ApoorvShah111
 2023-09-16 21:01:26 +00:00
Aniruddh Joshi
9d376c4dae
[ie/AmazonMiniTV] Fix extractor (#8103) 
Closes #7817
Authored by: Aniruddh-J
 2023-09-16 20:58:21 +00:00
c-basalt
5336bf57a7
[ie/bilibili] Extract format_id (#7555) 
Authored by: c-basalt
 2023-09-16 20:53:57 +00:00
makeworld
9bf14be775
[ie/cbc] Ignore any 426 from API (#7689) 
Closes #7477
Authored by: makew0rld
 2023-09-16 20:49:43 +00:00
c-basalt
cebbd33b1c
[ie/twitcasting] Improve _VALID_URL (#8120) 
Closes #7597
Authored by: c-basalt
 2023-09-16 20:43:12 +00:00
bashonly
069cbece9d
[ie/tiktok] Fix webpage extraction 
Closes #8089
Authored by: bashonly
 2023-09-16 13:28:14 -05:00
Simon Sawicki
f659e64394
[ie/bpb] Overhaul extractor (#8119) 
Authored by: Grub4K
 2023-09-16 17:50:06 +02:00
Jérôme Duval
7d3d658f4c
[ie/TV5MondePlus] Fix extractor (#7952) 
Closes #4978
Authored by: korli, dirkf
 2023-09-16 14:24:11 +00:00
hatsomatt
98eac0e6ba
[ie/videa] Fix extraction (#8003) 
Closes #7427
Authored by: hatsomatt, aky-01

Co-authored-by: aky-01 <65510015+aky-01@users.noreply.github.com>
 2023-09-16 14:02:37 +00:00
zhallgato
6e07e4bc7e
[ie/mediaklikk] Fix extractor (#8086) 
Fixes https://github.com/yt-dlp/yt-dlp/issues/8053

Authored by: bashonly, zhallgato
 2023-09-16 10:12:18 +00:00
barsnick
aee6b9b88c
[ie/Axs] Add extractor (#8094) 
Authored by: barsnick
 2023-09-16 10:04:08 +00:00
Kshitiz Gupta
578a82e497
[ie/banbye] Support video ids containing a hyphen (#8059) 
Fixes https://github.com/yt-dlp/yt-dlp/issues/7895

Authored by: kshitiz305
 2023-09-16 09:43:05 +00:00
SevenLives
497bbbbd73
[ie/abematv] Fix proxy handling (#8046) 
Fixes https://github.com/yt-dlp/yt-dlp/issues/8036

Authored by: SevenLives
 2023-09-16 09:37:04 +00:00
garret
7b71643cc9
[ie/mixcloud] Update API URL (#8114) 
Closes #8104
Authored by: garret1317
 2023-09-15 17:18:51 +00:00
bashonly
66cc64ff66
[ie/zoom] Extract duration 
Closes #8080
Authored by: bashonly
 2023-09-11 09:51:39 -05:00
bashonly
a006ce2b27
[ie/twitter] Fix retweet extraction and syndication API (#8016) 
Authored by: bashonly
 2023-09-09 15:14:49 +00:00
Szaby Grünwald
5d0395498d
[ie/wdr] Fix extraction (#7979) 
Closes #7461
Authored by: szabyg
 2023-09-08 12:54:41 +00:00
ifan-t
fe371dcf0b
[ie/S4C] Add series support and extract subs/thumbs (#7776) 
Authored by: ifan-t
 2023-09-08 12:25:43 +00:00
ringus1
d3d81cc98f
[ie/facebook] Fix webpage extraction (#7890) 
Closes #7901
Authored by: ringus1
 2023-09-05 20:35:23 +00:00
bashonly
99c99c7185
[ie/gofile] Update token 
Closes #7235
Authored by: bashonly
 2023-09-05 14:58:02 -05:00
bashonly
c6ef553792
[ie/twitter:spaces] Pass referer header to downloader 
Closes #8029
Authored by: bashonly
 2023-09-05 01:54:14 -05:00
bashonly
69dbfe01c4
Bugfix for bae4834245 
Authored by: bashonly
 2023-09-04 11:18:59 -05:00
Mattias Wadman
2301b5c1b7
[ie/SVTPlay] Fix extraction (#7789) 
Closes #5595
Authored by: wader, dirkf
 2023-09-02 14:40:11 +00:00
Simon Sawicki
77bff23ee9
Bugfix for 59e92b1f18 
Closes #8012

Authored by: Grub4K
 2023-09-02 15:18:04 +02:00
Rajeshwaran
7237c8dca0
[ie/hotstar] Extract release_year (#7869) 
Authored by: Rajeshwaran2001
 2023-08-31 20:48:52 +00:00
bashonly
30ea88591b
[ie/hotstar] Make metadata extraction non-fatal 
Authored by: bashonly
 2023-08-31 15:45:11 -05:00
Grabien
630a55df8d
[ie/Mediaite] Fix extraction (#7923) 
Authored by: Grabien
 2023-08-30 23:49:42 +00:00
RedDeffender
bae4834245
[ie/NoodleMagazine] Fix extraction (#7830) 
Closes #7917
Authored by: RedDeffender
 2023-08-30 23:26:45 +00:00
bashonly
099fb1b35c
Bugfix for b9f2bc2dbe 
Authored by: bashonly
 2023-08-29 08:06:02 -05:00
Omar Atef
4b3a6ef1b3
[ie/hungama] Overhaul extractors (#7757) 
Closes #7754
Authored by: Yalab7, bashonly
 2023-08-29 00:49:29 +00:00
Stavros Ntentos
665876034c
[ie/antenna] Support antenna.gr (#7584) 
Authored by: stdedos
 2023-08-29 00:05:49 +00:00
Nathan Touzé
b9f2bc2dbe
[ie/Dropbox] Fix extractor (#7926) 
Closes #7005, Closes #7696
Authored by: nathantouze, bashonly, denhotte
 2023-08-28 21:33:48 +00:00
sepro
c2d8ee0000
[ie/weverse] Support extraction without auth (#7924) 
Authored by: seproDev
 2023-08-28 21:09:14 +00:00
bashonly
56b3dc0335
[ie/StagePlus] Fix m3u8 extraction (#7929) 
Closes #7928
Authored by: bashonly
 2023-08-27 23:33:25 +00:00
bashonly
d7aee8e310
[ie/Mzaalo] Improve _VALID_URL 
Authored by: bashonly
 2023-08-27 18:08:36 -05:00
Simon Sawicki
59e92b1f18
[rh/urllib] Simplify gzip decoding (#7611) 
Authored by: Grub4K
 2023-08-27 00:13:30 +02:00
Davin Kevin
7cccab79e7
[ie/wat.tv] Fix extraction (#7898) 
Closes #7303
Authored by: davinkevin
 2023-08-20 17:25:49 +00:00
trainman261
ed71189781
[ie/CBCPlayerPlaylist] Add extractor (#7870) 
Authored by: trainman261
 2023-08-20 16:35:57 +00:00
bashonly
a0de8bb860
[ie/zee5] Update access token endpoint (#7914) 
Closes #7911
Authored by: bashonly
 2023-08-20 16:10:15 +00:00
garret
876b70c8ed
[ie/tbsjp] Add episode, program, playlist extractors (#7765) 
Authored by: garret1317
 2023-08-14 18:29:04 +00:00
trainman261
339c339fec
[ie/CBCPlayer] Extract HLS formats and subtitles (#7484) 
Authored by: trainman261
 2023-08-12 23:58:55 +00:00
bashonly
dab87ca236
[cookies] Containers JSON should be opened as utf-8 (#7800) 
Closes #7797
Authored by: bashonly
 2023-08-12 21:30:23 +00:00
coletdjnz
378ae9f9fb
[ie/youtube] Fix consent cookie (#7774) 
Fixes #7594

Authored by: coletdjnz
 2023-08-12 04:26:08 +00:00
coletdjnz
db7b054a61
[networking] Add request handler preference framework (#7603) 
Preference functions that take a request and a request handler instance can be registered to prioritize different request handlers per request.

Authored by: coletdjnz
Co-authored-by: pukkandan <pukkandan.ytdlp@gmail.com>
 2023-08-04 22:17:48 +00:00
Franklin Lee
db97438940
[ie/PicartoVod] Fix extractor (#7727) 
Closes #2926
Authored by: Frankgoji
 2023-08-01 18:21:16 +00:00
ifan-t
b9de629d78
[ie/S4C] Add extractor (#7730) 
Authored by: ifan-t
 2023-08-01 18:01:59 +00:00
ringus1
a854fbec56
[ie/facebook] Add dash manifest URL (#7743) 
Fixes #7742
Authored by: ringus1
 2023-08-01 19:43:54 +05:30
ischmidt20
30b29f3715
[ie/fox] Support foxsports.com (#7724) 
Authored by: ischmidt20
 2023-08-01 12:54:04 +05:30
Steve
6d6081dda1
[extractor/pbs] Add extractor PBSKidsIE (#7602) 
Authored by: snixon
Fixes #2440
 2023-07-31 22:38:37 +05:30
bashonly
6014355c61
[ie/twitter] Add fallback, improve error handling (#7621) 
Closes #7579, Closes #7625
Authored by: bashonly
 2023-07-29 23:37:06 +00:00
pukkandan
f73c118035
FFmpegFixupM3u8PP may need to run with ffmpeg 
Bug in 62b5c94cad
Closes #7725
 2023-07-30 04:24:46 +05:30
coletdjnz
546b2c28a1
[ie/youtube] Fix player_params arg being converted to lowercase 
Fix bug in ba06d77a31

Authored by: coletdjnz
 2023-07-30 10:50:25 +12:00
pukkandan
6148833f5c
[cleanup] Misc 2023-07-30 04:06:18 +05:30
pukkandan
8cb7fc44db
Fix --check-formats 
Bug in bc344cd456
 2023-07-30 03:23:13 +05:30
pukkandan
3f7965105d
[utils] HTTPHeaderDict: Handle byte values 2023-07-30 03:18:10 +05:30
bashonly
b09bd0c196
[ie/tiktok] Fix audio-only format extraction (#7712) 
Closes #6608
Authored by: bashonly
 2023-07-29 16:14:16 +00:00
bashonly
127a224606
[ie/LBRY] Fix original format extraction (#7711) 
Authored by: bashonly
 2023-07-29 16:01:43 +00:00
bashonly
86eeb044c2
[ie/hotstar] Support /clips/ URLs (#7710) 
Closes #7699
Authored by: bashonly
 2023-07-29 15:47:43 +00:00
bashonly
9a04113dfb
[ie/Reddit] Fix thumbnail extraction 
Authored by: bashonly
 2023-07-29 10:30:32 -05:00
coletdjnz
ba06d77a31
[ie/youtube] Add player_params extractor arg (#7719) 
Authored by: coletdjnz
 2023-07-29 06:20:42 +00:00
coletdjnz
4bf912282a
[networking] Remove dot segments during URL normalization (#7662) 
This implements RFC3986 5.2.4 remove_dot_segments during the URL normalization process.

Closes #3355, #6526

Authored by: coletdjnz
 2023-07-28 22:40:20 +00:00
nnoboa
a15fcd299e
[ie/Wimbledon] Add extractor (#7551) 
Closes #7462
Authored by: nnoboa
 2023-07-28 18:52:07 +00:00
Amirreza Aflakparast
c03a58ec99
[ie/MotorTrendOnDemand] Update _VALID_URL (#7683) 
Closes #7680
Authored by: AmirAflak
 2023-07-28 18:51:16 +00:00
coletdjnz
bbeacff7fc
[networking] Ignore invalid proxies in env (#7704) 
Authored by: coletdjnz
 2023-07-27 20:26:02 +05:30
bashonly
dae349da97
[ie/WrestleUniversePPV] Fix HLS AES key extraction 
Fix bug in ef8fb7f029

Closes #7708
Authored by: bashonly
 2023-07-27 09:53:22 -05:00
bashonly
550e65410a
[ie] Extract subtitles from SMIL manifests (#7667) 
Authored by: bashonly, pukkandan
 2023-07-24 00:09:52 +00:00
bashonly
39837ae319
[ie/triller] Fix unlisted video extraction (#7670) 
Authored by: bashonly
 2023-07-23 23:29:45 +00:00
coletdjnz
86aea0d3a2
[networking] Add strict Request extension checking (#7604) 
Authored by: coletdjnz
Co-authored-by: pukkandan <pukkandan.ytdlp@gmail.com>
 2023-07-23 05:17:15 +00:00
bashonly
11de6fec9c
[ie/PatreonCampaign] Fix extraction (#7664) 
Authored by: bashonly
 2023-07-22 13:10:25 +00:00
pukkandan
a250b24733
[compat] Ensure submodules are imported correctly 
Closes #7663
 2023-07-22 18:10:35 +05:30
pukkandan
25b6e8f946
Fix e0c4db04dc for pypy 2023-07-22 10:17:36 +05:30
pukkandan
e705738338
[ie/unsupported] List more sites with DRM 
Closes #7323, #3072, #5740, #5767, #6125
 2023-07-22 09:56:56 +05:30
pukkandan
62b5c94cad
[cleanup] Misc fixes 
Closes #7528
 2023-07-22 09:09:52 +05:30
pukkandan
e0c4db04dc
[compat] Add types.NoneType 2023-07-22 09:00:45 +05:30
pukkandan
81b4712bca
[extractor] Fix --load-pages 2023-07-22 09:00:44 +05:30
pukkandan
994f7ef8e6
[ie/generic] Fix generic title for embeds 
Closes #7067
 2023-07-22 08:57:44 +05:30
pukkandan
a264433c9f
[outtmpl] Fix replacement for playlist_index 2023-07-22 08:57:43 +05:30
pukkandan
9f66247289
[ie/abematv] Temporary fix for protocol handler 
Closes #7622
 2023-07-22 08:57:42 +05:30
bashonly
e57eb98222
[fd/external] Fix ffmpeg input from stdin (#7655) 
Bugfix for 1ceb657bdd

Authored by: bashonly
 2023-07-22 02:32:49 +00:00
Simon Sawicki
9b16762f48
[ie/crunchyroll] Remove initial state extraction (#7632) 
Authored by: Grub4K
 2023-07-20 22:09:52 +02:00
bashonly
65cfa2b057
[ie/MuseAI] Add extractor (#7614) 
Closes #7543
Authored by: bashonly
 2023-07-20 14:15:21 +00:00
bashonly
f4ea501551
[ie/MagellanTV] Add extractor (#7616) 
Closes #7529
Authored by: bashonly
 2023-07-20 14:02:50 +00:00
bashonly
af86873218
[utils] Improve parse_duration 
Authored by: bashonly
 2023-07-20 08:40:31 -05:00
bashonly
75dc8e673b
[networking] Fix --legacy-server-connect (#7645) 
Bugfix for 227bf1a33b

Authored by: bashonly
 2023-07-20 13:31:17 +00:00
bashonly
71baa490eb
[networking] Fix POST requests with zero-length payloads (#7648) 
Bugfix for 227bf1a33b

Authored by: bashonly
 2023-07-20 13:23:30 +00:00
bashonly
613dbce177
[ie/twitter:spaces] Fix format protocol (#7550) 
Closes #7536
Authored by: bashonly
 2023-07-15 21:10:12 +00:00
Văn Anh
bb5d84c9d2
[ie/facebook:reel] Fix extraction (#7564) 
Closes #7469
Authored by: demon071, bashonly
 2023-07-15 21:03:23 +00:00
zhong-yiyu
1d3d579c21
[ie/pornhub] Update access cookies for UK (#7591) 
Closes #7590
Authored by: zhong-yiyu
 2023-07-15 20:54:19 +00:00
bashonly
42ded0a429
[fd/external] Fixes to cookie handling 
- Fix bug in `axel` Cookie header arg
- Pass cookies to `curl` as strings
- Write session cookies for `aria2c` and `wget`

Closes #7539
Authored by: bashonly
 2023-07-15 15:25:51 -05:00
bashonly
6c5211cebe
[core] Fix HTTP headers and cookie handling 
- Remove `Cookie` header from `http_headers` immediately after loading into cookiejar
- Restore compat for `--load-info-json` cookies
- Add more tests
- Fix improper passing of Cookie header by `MailRu` extractor

Closes #7558
Authored by: bashonly, pukkandan
 2023-07-15 15:25:45 -05:00
Aaruni Kaushik
2b029ca0a9
[cleanup] Add color to download-archive message (#5138) 
Authored by: aaruni96, Grub4K, pukkandan
Closes #4913
 2023-07-16 00:45:08 +05:30
pukkandan
131d132da5
[build] Make sure deprecated modules are added 2023-07-15 16:47:55 +05:30
coletdjnz
3d2623a898
[compat, networking] Deprecate old functions (#2861) 
Authored by: coletdjnz, pukkandan
 2023-07-15 16:18:35 +05:30
coletdjnz
227bf1a33b
[networking] Rewrite architecture (#2861) 
New networking interface consists of a `RequestDirector` that directs
each `Request` to appropriate `RequestHandler` and returns the
`Response` or raises `RequestError`. The handlers define adapters to
transform its internal Request/Response/Errors to our interfaces.

User-facing changes:
- Fix issues with per request proxies on redirects for urllib
- Support for `ALL_PROXY` environment variable for proxy setting
- Support for `socks5h` proxy
   - Closes https://github.com/yt-dlp/yt-dlp/issues/6325, https://github.com/ytdl-org/youtube-dl/issues/22618, https://github.com/ytdl-org/youtube-dl/pull/28093
- Raise error when using `https` proxy instead of silently converting it to `http`

Authored by: coletdjnz
 2023-07-15 16:18:35 +05:30
pukkandan
c365dba843
[networking] Add module (#2861) 
No actual changes - code is only moved around
 2023-07-15 16:18:34 +05:30
pukkandan
1b392f905d
[utils] Add temporary shim for logging 
Related: #5680, #7517
 2023-07-15 16:18:34 +05:30
coletdjnz
1ba6fe9db5
[ie/youtube:tab] Detect looping feeds (#6621) 
Closes https://github.com/yt-dlp/yt-dlp/issues/5555

Note: the first page may still be repeated, however this is better than nothing.

Authored by: coletdjnz
 2023-07-15 03:20:24 +00:00
Finn R. Gärtner
1bcb9fe871
[ie/piapro] Support /content URL (#7592) 
Authored by: FinnRG
 2023-07-14 23:39:02 +05:30
Neurognostic
8a4cd12c8f
[pp/EmbedThumbnail] Support m4v (#7583) 
Authored by: Neurognostic
 2023-07-14 02:09:21 +05:30
Aleri Kaisattera
2cfe221fbb
[ie/streamanity] Remove (#7571) 
Service is dead
Authored by: alerikaisattera
 2023-07-13 19:47:05 +05:30
Mahmoud Abdel-Fattah
2af4eeb772
[utils] clean_podcast_url: Handle more trackers (#7556) 
Authored by: mabdelfattah, bashonly
Closes #7544
 2023-07-11 06:30:38 +05:30
Zprokkel
325191d0c9
[ie/vrt] Update token signing key (#7519) 
Authored by: Zprokkel
 2023-07-10 13:15:47 +00:00
GD-Slime
bdd0b75e3f
[ie/BiliBiliBangumi] Fix extractors (#7337) 
- Overhaul BiliBiliBangumi extractor for the site's new API
- Add BiliBiliBangumiSeason extractor
- Refactor BiliBiliBangumiMedia extractor

Closes #6701, Closes #7400
Authored by: GD-Slime
 2023-07-08 22:26:03 +00:00
bashonly
92315c0377
[extractor/twitter] Fix GraphQL and legacy API (#7516) 
Authored by: bashonly
 2023-07-06 19:39:51 +00:00
pukkandan
b03fa78345
Revert 49296437a8 2023-07-06 14:19:32 -05:00
github-actions
cc0619f62d Release 2023.07.06 
Created by: pukkandan

:ci skip all :ci run dl
 2023-07-06 18:57:59 +00:00
Simon Sawicki
3121512228
[core] Change how Cookie headers are handled 
Cookies are now saved and loaded under `cookies` key in the info dict
instead of `http_headers.Cookie`. Cookies passed in headers are
auto-scoped to the input URLs with a warning.

Ref: https://github.com/yt-dlp/yt-dlp/security/advisories/GHSA-v8mc-9377-rwjj

Authored by: Grub4K
 2023-07-06 23:14:39 +05:30
coletdjnz
f8b4bcc0a7
[core] Prevent Cookie leaks on HTTP redirect 
Ref: https://github.com/yt-dlp/yt-dlp/security/advisories/GHSA-v8mc-9377-rwjj

Authored by: coletdjnz
 2023-07-06 23:14:39 +05:30
bashonly
1ceb657bdd
[fd/external] Scope cookies 
- ffmpeg: Calculate cookies from cookiejar and pass with `-cookies` arg instead of `-headers`
- aria2c, curl, wget: Write cookiejar to file and use external FD built-in cookiejar support
- httpie: Calculate cookies from cookiejar instead of `http_headers`
- axel: Calculate cookies from cookiejar and disable http redirection if cookies are passed
    - May break redirects, but axel simply don't have proper cookie support

Ref: https://github.com/yt-dlp/yt-dlp/security/advisories/GHSA-v8mc-9377-rwjj

Authored by: bashonly, coletdjnz
 2023-07-06 23:14:38 +05:30
pukkandan
ad8902f616
[ie/vidlii] Handle relative URLs 
Closes #7480
 2023-07-06 21:40:09 +05:30
pukkandan
94ed638a43
[ie/youtube] Avoid false DRM detection (#7396) 
Some master manifests contain a mix of DRM and non-DRM formats
 2023-07-06 21:40:07 +05:30
pukkandan
bc344cd456
[core] Allow extractors to mark formats as potentially DRM (#7396) 
This is useful for HLS where detecting whether the format is
actually DRM requires the child manifest to be downloaded.

Makes the error message when using `--test` inconsistent,
but doesn't really matter.
 2023-07-06 21:40:01 +05:30
pukkandan
906c0bdcd8
[formats] Fix best fallback for storyboards 
Partial fix for #7478
 2023-07-06 21:39:58 +05:30
pukkandan
337734d4a8
[cleanup] Misc 2023-07-06 21:39:55 +05:30
pukkandan
47bcd43724
[outtmpl] Pad playlist_index etc even when with internal formatting 
Closes #7501
 2023-07-06 20:22:03 +05:30
pukkandan
662ef1e910
[downloader/http] Avoid infinite loop when no data is received 
Closes #7504
 2023-07-06 20:22:00 +05:30
coletdjnz
90db9a3c00
[extractor/youtube:stories] Remove (#7459) 
YouTube killed them

https://web.archive.org/web/20230630153050/https://support.google.com/youtube/thread/217640760
 2023-07-06 19:02:41 +05:30
bashonly
49296437a8
[extractor/twitter] Fix unauthenticated extraction (#7476) 
Closes #7473
Authored by: bashonly
 2023-07-05 16:27:36 +00:00
bashonly
1cffd621cb
[extractor/twitter:spaces] Fix extraction (#7512) 
Closes #7455
Authored by: bashonly
 2023-07-05 03:05:52 +00:00
RfadnjdExt
3b7f5300c5
[extractor/googledrive] Fix source format extraction (#7395) 
Closes #7344
Authored by: RfadnjdExt
 2023-07-05 02:17:13 +00:00
coletdjnz
4dc4d8473c
[extractor/youtube] Ignore incomplete data for comment threads by default (#7475) 
For both `--ignore-errors` and `--ignore-errors only_download`. Pass `--no-ignore-errors` to not ignore.

Closes https://github.com/yt-dlp/yt-dlp/issues/7474

Authored by: coletdjnz
 2023-07-03 10:47:10 +00:00
c-basalt
8776349ef6
[extractor/vk] VKPlay, VKPlayLive: Add extractors (#7358) 
Closes #7107
Authored by: c-basalt
 2023-07-02 19:31:00 +00:00
urectanc
af1fd12f67
[extractor/stacommu] Add extractors (#7432) 
Authored by: urectanc
 2023-06-30 18:27:07 +00:00
coletdjnz
fcbc9ed760
[extractor/youtube:tab] Support shorts-only playlists (#7425) 
Fixes https://github.com/yt-dlp/yt-dlp/issues/7424

Authored by: coletdjnz
Co-authored-by: pukkandan <pukkandan.ytdlp@gmail.com>
 2023-06-29 23:26:27 +00:00
bashonly
a2be9781fb
[extractor/Douyin] Fix extraction from webpage 
Closes #7431
Authored by: bashonly
 2023-06-27 16:50:02 -05:00
Xiao Han
8f05fbae2a
[extractor/abc] Fix extraction (#7434) 
Closes #6433
Authored by: meliber
 2023-06-27 21:16:57 +00:00
Aman Salwan
5b4b92769a
[extractor/crunchyroll:music] Fix _VALID_URL (#7439) 
Closes #7419
Authored by: AmanSal1, rdamas

Co-authored-by: Robert Damas <robert.damas@byom.de>
 2023-06-27 20:28:23 +00:00
pukkandan
91302ed349
[utils] clean_podcast_url: Handle protocol in redirect URL 
Closes #7430
 2023-06-26 16:19:49 +05:30
pukkandan
f393bbe724
[extractor/sbs] Python 3.7 compat 
Closes #7410
 2023-06-26 16:14:20 +05:30
pukkandan
8a8af356e3
[downloader/aria2c] Add --no-conf 
Closes #7404
 2023-06-26 16:13:31 +05:30
pukkandan
d949c10c45
[extractor/youtube] Process post_live over 2 hours 2023-06-26 07:25:52 +05:30
bashonly
ef8509c300
[extractor/kick] Fix _VALID_URL 
Closes #7384
Authored by: bashonly
 2023-06-25 17:04:42 -05:00
nnoboa
5e16cf92eb
[extractor/AdultSwim] Extract subtitles from m3u8 (#7421) 
Authored by: nnoboa
Closes #6191
 2023-06-26 01:52:38 +05:30
bashonly
f0a1ff1181
[extractor/qdance] Add extractor (#7420) 
Closes #7385
Authored by: bashonly
 2023-06-25 18:13:28 +00:00
pukkandan
58786a10f2
[extractor/youtube] Add extractor-arg formats 
Closes #7417
 2023-06-25 20:14:37 +05:30
pukkandan
e59e20744e
Bugfix for b4e0d75848 2023-06-22 23:45:53 +05:30
Simon
89bed01374
[extractor/youtube] Fix comments' is_favorited (#7390) 
Authored by: bbilly1
Closes #7389
 2023-06-22 23:38:42 +05:30
github-actions
de4cf77ec1 Release 2023.06.22 
Created by: pukkandan

:ci skip all :ci run dl
 2023-06-22 08:09:31 +00:00
pukkandan
812cdfa06c
[cleanup] Misc 2023-06-22 13:31:07 +05:30
pukkandan
cd810afe2a
[extractor/youtube] Improve nsig function name extraction 2023-06-22 13:27:18 +05:30
pukkandan
b4e0d75848
Improve --download-sections 
* Support negative time-ranges
* Add `*from-url` to obey time-ranges in URL

Closes #7248
 2023-06-22 13:03:07 +05:30
Berkan Teber
71dc18fa29
[extractor/youtube] Improve description parsing performance (#7315) 
* The parsing is skipped when not needed
* The regex is improved by simulating atomic groups with lookaheads

Authored by: pukkandan, berkanteber
 2023-06-22 12:57:54 +05:30
bashonly
98cb1eda7a
[extractor/rheinmaintv] Add extractor (#7311) 
Authored by: barthelmannk

Co-authored-by: barthelmannk <81305638+barthelmannk@users.noreply.github.com>
 2023-06-22 05:24:52 +00:00
bashonly
774aa09dd6
[extractor/dplay] GlobalCyclingNetworkPlus: Add extractor (#7360) 
* Allows `country` API param to be configured with `--xff`/`geo_bypass_country`

Closes #7324
Authored by: bashonly
 2023-06-22 05:16:39 +00:00
rexlambert22
f2ff0f6f19
[extractor/motherless] Add gallery support, fix groups (#7211) 
Authored by: rexlambert22
 2023-06-22 00:00:54 +00:00
pukkandan
5fd8367496
[extractor] Support multiple _VALID_URLs (#5812) 
Authored by: nixxo
 2023-06-22 03:19:55 +05:30
pukkandan
0dff8e4d1e
Indicate filesize approximated from tbr better 2023-06-22 01:37:55 +05:30
pukkandan
1e75d97db2
[extractor/youtube] Add ios to default clients used 
* IOS is affected neither by 403 or by nsig so helps mitigate them preemptively
* IOS also has higher bit-rate "premium" formats though they are not labeled as such
 2023-06-22 01:36:06 +05:30
pukkandan
81ca451480
[extractor/youtube] Workaround 403 for android formats 
Ref: https://github.com/TeamNewPipe/NewPipe/issues/9038#issuecomment-1289756816
 2023-06-22 00:15:22 +05:30
Roland Hieber
3f756c8c40
[extractor/nebula] Fix extractor (#7156) 
Closes #7017
Authored by: Lamieur, rohieb

Co-authored-by: Lam <github@Lam.pl>
 2023-06-21 08:29:34 +00:00
bashonly
7f9c6a63b1
[cleanup] Misc 
Authored by: bashonly
 2023-06-21 03:24:24 -05:00
OverlordQ
db22142f6f
[extractor/dropout] Fix season extraction (#7304) 
Authored by: OverlordQ
 2023-06-21 07:17:07 +00:00
pukkandan
d7cd97e8d8
Fix bug in db3ad8a676 
Closes #7367
 2023-06-21 12:13:27 +05:30
github-actions
d1b2156149 Release 2023.06.21 
Created by: pukkandan

:ci skip all :ci run dl
 2023-06-21 04:02:40 +00:00
pukkandan
42f2d40b47
Update to ytdl-commit-07af47 
[YouTube] Improve fix for ae8ba2c
07af47960f
 2023-06-21 09:21:23 +05:30
pukkandan
1619ab3e67
Bugfix for ebe1b4e34f 2023-06-21 09:21:22 +05:30
pukkandan
84078a8b38
[core] Fix filepath being copied to underlying format dict 
Closes #6536
 2023-06-21 09:21:21 +05:30
pukkandan
ad54c9130e
[cleanup] Misc 
Closes #6288, Closes #7197, Closes #7265, Closes #7353, Closes #5773
Authored by: mikf, freezboltz, pukkandan
 2023-06-21 09:21:20 +05:30
Nicolai Dagestad
db3ad8a676
Add option --netrc-cmd (#6682) 
Authored by: NDagestad, pukkandan
Closes #1706
 2023-06-21 08:37:42 +05:30
MMM
af7585c824
[extractor/tagesschau] Fix single audio urls (#6626) 
Authored by: flashdagger
 2023-06-21 08:14:12 +05:30
pukkandan
02948a17d9
[update] Do not restart into versions without --update-to 2023-06-21 06:10:40 +05:30
pukkandan
424f3bf033
[downloader/fragment] Do not sleep between fragments 
Closes #6599
 2023-06-21 06:10:39 +05:30
pukkandan
ebe1b4e34f
[outtmpl] Fix some minor bugs 
Closes #7164
 2023-06-21 06:10:39 +05:30
pukkandan
a35af4306d
[utils] strftime_or_none: Handle negative timestamps 
Closes #6706
Authored by pukkandan, dirkf
 2023-06-21 06:10:39 +05:30
pukkandan
93b39cdbd9
Add --compat-option playlist-match-filter 
Closes #6073
 2023-06-21 06:10:39 +05:30
pukkandan
97afb093d4
[extractor/youtube] Ignore wrong fps of some formats 2023-06-21 06:10:39 +05:30
pukkandan
2e023649ea
[cookies] Revert compatibility breakage in b38d4c941d 2023-06-21 06:10:38 +05:30
pukkandan
51a07b0dca
[extractor/youtube] Prioritize premium formats 
Closes #7283
 2023-06-21 06:10:38 +05:30
pukkandan
eedda5252c
[utils] FormatSorter: Improve size and br 
Closes #1596

Previously, when some formats have accurate size and some approximate,
the ones with accurate size was always prioritized

For formats with known tbr and unknown vbr/abr, we were setting
(vbr=tbr, abr=0) for sorting to work. This is no longer needed.

Authored by pukkandan, u-spec-png
 2023-06-21 06:10:38 +05:30
Mozi
5cc09c004b
[extractor/zaiko] ZaikoETicket: Add extractor (#7347) 
Authored by: pzhlkj6612
 2023-06-20 04:22:36 +00:00
Vladislav
6f69101dc9
[extractor/yappy] YappyProfile: Add extractor (#7346) 
Authored by: 7vlad7
 2023-06-19 20:43:35 +00:00
garret
81c8b9bdd9
[extractor/nhk] NhkRadiruLive: Add extractor (#7332) 
Authored by: garret1317
 2023-06-19 13:25:27 +00:00
pukkandan
01aba2519a
[jsinterp] Fix global object extraction 
Closes #7327
 2023-06-18 04:11:15 +05:30
pukkandan
13ff780953
[postprocessor] Print newline for --progress-template 
Closes #7193
 2023-06-17 01:43:09 +05:30
pukkandan
ff9b0e071f
[extractor/youtube] Determine audio language using automatic captions 2023-06-17 01:43:03 +05:30
toomyzoom
0a5d7c39e1
[extractor/iwara] Fix authentication (#7137) 
Closes #7035, Closes #7207
Authored by: toomyzoom
 2023-06-15 23:23:01 +00:00
TxI5
125ffaa173
[extractor/tv4] Fix extractor (#5649) 
Closes #5535
Authored by: TxI5, dirkf
 2023-06-15 17:57:25 +00:00
foreignBlade
f9213f8a2d
[extractor/stripchat] Fix extractor (#7306) 
Closes #7305
Authored by: foreignBlade
 2023-06-15 10:56:26 +00:00
Jeong, Heon
fdd69db389
[extractor/afreecatv] Fix extractor (#6283) 
Closes #6133
Authored by: blmarket
 2023-06-14 19:01:18 +00:00
Elyse
83465fc410
[extractor/ettutv] Add extractor (#6579) 
Closes #6359
Authored by: elyse0
 2023-06-14 18:54:06 +00:00
RjY
6daaf21092
[extractor/discogs] Add extractor (#6624) 
Authored by: rjy
 2023-06-14 18:40:06 +00:00
hoaluvn
7bcd481321
[extractor/urplay] Extract all subtitles (#7309) 
Authored by: hoaluvn
 2023-06-14 21:22:17 +05:30