k4rli/youtube-dl
1
0
Fork 0
Code Issues Pull Requests Actions Packages Projects Releases Wiki Activity
18,919 Commits 1 Branch 0 Tags
32b8d317805b7f947b62af812e64789d1c5728a0
Commit Graph
100 Commits
This Branch
This Branch
All Branches
Author SHA1 Message Date
dirkf 32b8d31780 [YouTube] Support shorts playlist 
* only 1..100: yt-dlp/yt-dlp#11130
 2025-04-08 01:59:00 +01:00
dirkf 570b868078 [cache] Use esc_rfc3986 to encode cache key 2025-04-08 01:59:00 +01:00
dirkf 2190e89260 [utils] Support optional safe argument for escape_rfc3986() 2025-04-08 01:59:00 +01:00
dirkf 7e136639db [compat] Improve Py2 compatibility for URL Quoting 2025-04-08 01:59:00 +01:00
dirkf cedeeed56f [cache] Align further with yt-dlp 
* use compat_os_makedirs
* support non-ASCII characters in cache key
* improve logging
 2025-04-08 01:59:00 +01:00
dirkf add4622870 [compat] Add compat_os_makedirs 
* support exists_ok parameter in Py < 3.2
 2025-04-08 01:59:00 +01:00
dirkf 9a6ddece4d [core] Refactor message routines to align better with yt-dlp 
* in particular, support `only_once` in the same methods
 2025-04-08 01:59:00 +01:00
dirkfandGitHub 3eb8d22ddb [JSInterp] Temporary fix for #33102 2025-03-31 04:21:09 +01:00
dirkf 4e714f9df1 [Misc] Correct [_]IE_DESC/NAME in a few IEs 
* thx seproDev, yt-dlp/yt-dlp/pull/12694/commits/ae69e3c
* also add documenting comment in `InfoExtractor`
 2025-03-26 12:47:19 +00:00
dirkf c1ea7f5a24 [ITV] Mark ITVX not working 
* update old shim
* correct [_]IE_DESC
 2025-03-26 12:17:49 +00:00
dirkf 2b4fbfce25 [YouTube] Support player 4fcd6e4a 
thx seproDev, bashonly: yt-dlp/yt-dlp#12748
 2025-03-26 02:27:25 +00:00
dirkf 1bc45b8b6c [JSInterp] Use , for join() with null/undefined argument 
Eg: [1,2,3].join(null) -> '1,2,3'
 2025-03-25 22:35:06 +00:00
dirkf b982d77d0b [YouTube] Align signature tests with yt-dlp 
thx bashonly, yt-dlp/yt-dlp#12725
 2025-03-25 22:35:06 +00:00
dirkf c55dbf4838 [YouTube] Update signature extraction for players 643afba4, 363db69b 2025-03-25 22:35:06 +00:00
dirkf 087d865230 [YouTube] Support new player URL patterns 2025-03-25 22:35:06 +00:00
dirkf a4fc1151f1 [JSInterp] Improve indexing 
* catch invalid list index with `ValueError` (eg [1, 2]['ab'] -> undefined)
* allow assignment outside existing list (eg var l = [1,2]; l[9] = 0;)
 2025-03-25 22:35:05 +00:00
dirkf a464c159e6 [YouTube] Make _extract_player_info() use _search_regex() 2025-03-25 22:35:05 +00:00
dirkf 7dca08eff0 [YouTube] Also get original of translated automatic captions 2025-03-25 22:35:05 +00:00
dirkf 2239ee7965 [YouTube] Get subtitles/automatic captions from both web and API responses 2025-03-25 22:35:05 +00:00
dirkfandsepro da7223d4aa [YouTube] Improve support for tce-style player JS 
* improve extraction of global "useful data" Array from player JS
* also handle tv-player and add tests: thx seproDev (yt-dlp/yt-dlp#12684)

Co-Authored-By: sepro <sepro@sepr0.com>
 2025-03-21 16:26:25 +00:00
dirkfandsepro 37c2440d6a [YouTube] Update player client data 
thx seproDev (yt-dlp/yt-dlp#12603)

Co-authored-by: sepro <sepro@sepr0.com>
 2025-03-21 16:13:24 +00:00
dirkf 420d53387c [JSInterp] Improve tests 
* from yt-dlp/yt-dlp#12313
* also fix d7c2708
 2025-03-11 02:00:24 +00:00
dirkf 32f89de92b [YouTube] Update TVHTML5 client parameters 
* resolves #33078
 2025-03-11 02:00:24 +00:00
dirkf 283dca56fe [YouTube] Initially support tce-style player JS 
* resolves #33079
 2025-03-11 02:00:24 +00:00
dirkf 422b1b31cf [YouTube] Temporarily redirect from tce-style player JS 2025-03-11 02:00:24 +00:00
dirkf 1dc27e1c3b [JSInterp] Make indexing error handling more conformant 
* by default TypeError -> undefined, else raise
* set allow_undefined=True/False to override
 2025-03-11 02:00:24 +00:00
dirkf af049e309b [JSInterp] Handle undefined, etc, passed to JS_RegExp and Exception 2025-03-11 02:00:24 +00:00
dirkf 94849bc997 [JSInterp] Improve Date processing 
* add JS_Date class implementing JS Date
* support constructor args other than date string
* support static methods of Date
* Date objects are still automatically coerced to timestamp before using in JS.
 2025-03-11 02:00:24 +00:00
dirkf 974c7d7f34 [compat] Fix inheriting from compat_collections_chain_map 
* see ytdl-org/youtube-dl#33079#issuecomment-2704038049
 2025-03-11 02:00:24 +00:00
dirkf 8738407d77 [compat] Support zstd Content-Encoding 
* see RFC 8878 7.2
 2025-03-11 02:00:24 +00:00
dirkf cecaa18b80 [compat] Clean-up 
* make workaround_optparse_bug9161 private
* add comments
* avoid leaving test objects behind
 2025-03-11 02:00:24 +00:00
dirkfandGitHub 673277e510 [YouTube] Fix 91b1569 2025-02-28 01:02:20 +00:00
dirkfGitHubsepro
 		91b1569f68 [YouTube] Fix channel playlist extraction (#33074) 
* [YouTube] Extract playlist items from LOCKUP_VIEW_MODEL_...
* resolves #33073
* thx seproDev (yt-dlp/yt-dlp#11615)

Co-authored-by: sepro <sepro@sepr0.com>
 2025-02-28 00:02:10 +00:00
dirkf 711e72c292 [JSInterp] Fix bit-shift coercion for player 9c6dfc4a 2025-02-07 00:01:50 +00:00
dirkf 26b6f15d14 [compat] Make casefold private 
* if required, not supported:
`from youtube_dl.casefold import _casefold as casefold`
 2025-02-07 00:01:50 +00:00
dirkf 5975d7bb96 [YouTube] Use X-Goog-Visitor-Id 
* required with tv player client
* resolves #33030
 2025-01-22 06:52:40 +00:00
dirkf 63fb0fc415 [YouTube] Retain .videoDetails members from all player responses 2025-01-20 13:23:54 +00:00
dirkf b09442a2f4 [YouTube] Also use ios client when is_live 2025-01-19 01:18:34 +00:00
dirkf 55ad8a24ca [YouTube] Support ... /feeds/videos.xml?playlist_id={pl_id} 2025-01-15 03:22:56 +00:00
dirkf 21fff05121 [YouTube] Switch to TV API client 
* thx yt-dlp/yt-dlp#12059
 2025-01-15 03:19:15 +00:00
dirkf 1036478d13 [YouTube] Endure subtitle URLs are complete 
* WEB URLs are, MWEB not
* resolves #33017
 2025-01-06 01:39:04 +00:00
dirkf 00ad2b8ca1 [YouTube] Refactor subtitle processing 
* move to internal function
* use `traverse-obj()`
 2025-01-06 01:24:30 +00:00
dirkf ab7c61ca29 [YouTube] Apply code style changes, trailing commas, etc 2025-01-06 01:22:16 +00:00
dirkf 176fc2cb00 [YouTube] Avoid early crash if webpage can't be read 
* see issue #33013
 2024-12-31 14:51:29 +00:00
dirkf d55d1f423d [YouTube] Always extract using MWEB API client 
* temporary fix-up for 403 on download
* MWEB parameters from yt-dlp 2024-12-06
 2024-12-16 12:38:51 +00:00
dirkfandbashonly eeafbbc3e5 [YouTube] Fix signature function extraction for 2f1832d2 
* `_` was omitted from patterns
* thx yt-dlp/yt-dlp#11801

Co-authored-by: bashonly
 2024-12-16 12:38:51 +00:00
dirkf cd7c7b5edb [YouTube] Simplify pattern for nsig function name extraction 2024-12-16 12:38:51 +00:00
dirkf eed784e15f [YouTube] Pass nsig value as return hook, fixes player 3bb1f723 2024-12-16 12:38:51 +00:00
dirkfandbashonly b4469a0f65 [YouTube] Handle player 3bb1f723 
* fix signature code extraction
* raise if n function returns input value
* add new tests from yt-dlp

Co-authored-by: bashonly
 2024-12-16 12:38:51 +00:00
dirkf ce1e556b8f [jsinterp] Add return hook for player 3bb1f723 
* set var `_ytdl_do_not_return` to a specific value in the scope of a function
* if an expression to be returned has that value, `return` becomes `void`
 2024-12-16 12:38:51 +00:00
dirkf f487b4a02a [jsinterp] Strip /* comments */ when parsing 
* NB: _separate() is looking creaky
 2024-12-16 12:38:51 +00:00
dirkf 60835ca16c [jsinterp] Fix and improve "methods" 
* push, unshift return new length
* impove edge cases for push/pop, shift/unshift, forEach, indexOf, charCodeAt
* increase test coverage
 2024-12-16 12:38:51 +00:00
dirkf 94fd774608 [jsinterp] Fix and improve split/join 
* improve split/join edge cases
* correctly implement regex split (not like re.split)
 2024-12-16 12:38:51 +00:00
dirkf 5dee6213ed [jsinterp] Fix and improve arithmetic operations 
* addition becomes concat with a string operand
* improve handling of edgier cases
* arithmetic in float like JS (more places need cast to int?)
* increase test coverage
 2024-12-16 12:38:51 +00:00
dirkf 81e64cacf2 [jsinterp] Support multiple indexing (eg a[1][2]) 
* extend single indexing with improved RE (should probably use/have used _separate_at_paren())
* fix some cases that should have given undefined, not throwing
* standardise RE group names
* support length of objects, like {1: 2, 3: 4, length: 42}
 2024-12-16 12:38:51 +00:00
dirkf c1a03b1ac3 [jsinterp] Fix and improve loose and strict equality operations 
* reimplement loose equality according to MDN (eg, 1 == "1")
* improve strict equality (eg, "abc" === "abc" but 'abc' is not 'abc')
* add tests for above
 2024-12-16 12:38:51 +00:00
dirkf 118c6d7a17 [jsinterp] Implement typeof operator 2024-12-16 12:38:51 +00:00
dirkf f28d7178e4 [InfoExtractor] Use kwarg maxsplit for re.split 
* May become kw-only in future Pythons
 2024-12-16 12:38:51 +00:00
dirkf c5098961b0 [Youtube] Rework n function extraction pattern 
Now also succeeds with player b12cc44b
 2024-08-06 20:59:09 +01:00
dirkf dbc08fba83 [jsinterp] Improve slice implementation for player b12cc44b 
Partly taken from yt-dlp/yt-dlp#10664, thx seproDev
        Fixes #32896
 2024-08-06 20:51:38 +01:00
dirkf e1b3fa242c [Youtube] Find n function name in player 3400486c 
Fixes #32877
 2024-07-25 00:16:00 +01:00
dirkf 451046d62a [Youtube] Make n-sig throttling diagnostic up-to-date 2024-07-24 14:33:34 +01:00
dirkf 16f5bbc464 [YouTube] Fix nsig processing for player b22ef6e7 
* improve extraction of function name (like yt-dlp/yt-dlp#10390)
* always use JSInterp to extract function code (yt-dlp/yt-dlp#10396, thx seproDev, pukkandan)
 2024-07-11 00:50:46 +01:00
dirkf d35ce6ce95 [jsinterp] Support functionality for player b22ef6e7 
* support `prototype` for call() and apply() (yt-dlp/yt-dlp#10392, thx Grub4k)
* map JS `Array` to `list`
 2024-07-11 00:50:46 +01:00
dirkf 76ac69917e [jsinterp] Further improve expression parsing (fix fd8242e) 
Passes tests from yt-dlp
 2024-07-11 00:50:46 +01:00
dirkf 756f6b45c7 [jsinterp] Re-align JSInterp and tests (esp.) with yt-dlp 
Thx: various yt-dlp authors
 2024-07-11 00:50:46 +01:00
dirkf a452f9437c [core] Fix PR #32830 for fixed extensionless output template 2024-07-07 22:33:32 +01:00
dirkf 37cea84f77 [core,utils] Support unpublicised --no-check-extensions 2024-07-02 15:38:50 +01:00
dirkf 4652109643 [core,utils] Implement unsafe file extension mitigation 
* from https://github.com/yt-dlp/yt-dlp/security/advisories/GHSA-79w7-vh3h-8g4, thx grub4k
 2024-07-02 15:38:50 +01:00
dirkf 3c466186a8 [utils] Back-port Namespace and MEDIA_EXTENSIONS from yt-dlp 
Thx pukkandan
* Namespace: https://github.com/yt-dlp/yt-dlp/commit/591bb9d355
* MEDIA_EXTENSIONS: https://github.com/yt-dlp/yt-dlp/commit/8dc5930511
 2024-07-02 15:38:50 +01:00
dirkf 4d05f84325 [PalcoMP3] Conform to new linter rule 
* no space after @ in decorator
 2024-06-20 20:03:49 +01:00
dirkf e0094e63c3 [jsinterp] Various tweaks 
* treat Infinity like NaN
* cache operator list
 2024-06-20 20:03:49 +01:00
dirkf fd8242e3ef [jsinterp] Fix and improve expression parsing 
* improve BODMAS (fixes https://github.com/ytdl-org/youtube-dl/issues/32815)
* support more weird expressions with multiple unary ops
 2024-06-20 20:03:49 +01:00
dirkf ad01fa6cca [jsinterp] Add Debugger from yt-dlp 
* https://github.com/yt-dlp/yt-dlp/commit/8f53dc4
* thx pukkandan
 2024-06-20 20:03:49 +01:00
dirkf 2eac0fa379 [utils] Save orig_msg in ExtractorError 2024-06-20 20:03:49 +01:00
dirkf a48fe7491d [ORF] Skip tests with limited availability 2024-06-11 12:52:13 +01:00
dirkf e20ca543f0 [ORF] Re-factor and updateORFFM4StoryIE 
* fix getting media via DASH instead of inaccessible mp4
* also get in-page YT media
 2024-06-11 12:52:13 +01:00
dirkf e39466051f [ORF] Support sound.orf.at, updating ORFRadioIE 
* maintain support for xx.orf.at/player/... URLs
* add `ORFRadioCollectionIE` to support playlists in ORF Sound
* back-port and re-work `ORFPodcastIE` from https://github.com/yt-dlp/yt-dlp/pull/8486, thx Esokrates
 2024-06-11 12:52:13 +01:00
dirkf d95c0d203f [ORF] Support on.orf.at, replacing ORFTVthekIE 
* add `ORFONIE`, back-porting yt-dlp PR https://github.com/yt-dlp/yt-dlp/pull/9113 and friends: thx HobbyistDev, TuxCoder, seproDev
* re-factor to support livestreams via new `ORFONliveIE`
 2024-06-11 12:52:13 +01:00
dirkf 3bde6a5752 [test] Improve download test 
* skip reason can't be unicode in Py2
* remove duplicate assert...Equal functions
 2024-06-11 12:52:13 +01:00
dirkf 50f6c5668a [core] Re-factor with _fill_common_fields() as used in yt-dlp 2024-06-11 12:52:13 +01:00
dirkf b4ff08bd2d [core] Safer handling of nested playlist data 2024-06-11 12:52:13 +01:00
dirkf 21924742f7 [InfoExtractor] Misc yt-dlp back-ports, etc 
* add _yes_playlist() method
* avoid crash using _NETRC_MACHINE
* use _search_json() in _search_nextjs_data()
* _search_nextjs_data() default is JSON, not text
* test for above
 2024-05-30 15:46:36 +01:00
dirkf 768ccccd9b [compat] Avoid type comparison in compat_ord 
NB This isn't actually a compat fn; it should be utils.int_from_int_or_char
 2024-05-30 15:46:36 +01:00
dirkf eee9a247eb [utils] Split out traversal.py dummy and traversal tests 2024-05-30 15:46:36 +01:00
dirkf 34484e49f5 [compat] Improve compat_etree_iterfind for Py2.6 
Adapted from https://raw.githubusercontent.com/python/cpython/2.7/Lib/xml/etree/ElementPath.py
 2024-05-30 15:46:36 +01:00
dirkf 06da64ee51 [utils] Update traverse_obj() from yt-dlp 
* remove `is_user_input` option per https://github.com/yt-dlp/yt-dlp/pull/8673
* support traversal of compat_xml_etree_ElementTree_Element per https://github.com/yt-dlp/yt-dlp/pull/8911
* allow un/branching using all and any per https://github.com/yt-dlp/yt-dlp/pull/9571
* support traversal of compat_cookies.Morsel and multiple types in `set()` keys per https://github.com/yt-dlp/yt-dlp/pull/9577
thx Grub4k for these
* also, move traversal tests to a separate class
* allow for unordered dicts in tests for Py<3.7
 2024-05-30 15:46:36 +01:00
dirkfandGitHub a08f2b7e45 [workflows/ci.yml] Temporary workaround for Python 3.5 _pip_ failures 
https://github.com/actions/setup-python/issues/866
 2024-05-15 16:57:59 +01:00
dirkf 668332b973 [YouPorn] Add playlist extractors 
* YouPornCategoryIE
* YouPornChannelIE
* YouPornCollectionIE
* YouPornStarIE
* YouPornTagIE
* YouPornVideosIE,
 2024-04-22 01:34:26 +01:00
dirkf 0b2ce3685e [YouPorn] Improve extraction 
* detect unwatchable videos
* improve duration extraction
* fix count extraction and support large values
* detect and remove SEO spam boilerplate description
 2024-04-22 01:34:26 +01:00
dirkf c2766cb80e [test/test_download] Support 'playlist_maxcount:count' expected value 
* parallel to `playlist_mincount'
* specify both for a range of playlist lengths
* if max < min the test will always fail!
 2024-04-22 01:34:26 +01:00
dirkf eb38665438 [YouPorn] Incorporate yt-dlp PR 8827 
* from https://github.com/yt-dlp/yt-dlp/pull/8827
* extract from webpage instead of broken API URL
* thx The-MAGI
 2024-04-22 01:34:26 +01:00
dirkf e0727e4ab6 [postprocessor/ffmpeg] Fix finding ffprobe (bug in 21792b8) 
Fixes https://github.com/ytdl-org/youtube-dl/commit/21792b88b791b16e3ab0a0fb2e26e5bb8a4e2ff3#commitcomment-140705274, thx: vonProteus
 2024-04-07 15:33:30 +01:00
dirkf 21792b88b7 [external/FFmpeg] Fix and improve --ffmpeg-location handling 
* pass YoutubeDL (FileDownloader) to FFmpegPostProcessor constructor
* consolidate path search in FFmpegPostProcessor
* make availability of FFmpegFD depend on existence of FFmpegPostProcessor
* detect ffmpeg executable on instantiation of FFmpegFD
* resolves #32735
 2024-03-27 13:11:17 +00:00
dirkf d8f134a664 [downloader/external] Fix "Resource Warning" in downloader test 
* add compat_subprocess_Popen context manager
* apply context manager in FFmpegFD._call_downloader()
 2024-03-27 13:11:17 +00:00
dirkf 31a15a7c8d [compat] Simplify/fix compat_html_parser_HTMLParseError 2024-03-27 13:11:17 +00:00
dirkf 19dc10b986 [utils] Apply compat_contextlib_suppress 2024-03-27 13:11:17 +00:00
dirkf 182f63e82a [compat] Add compat_contextlib_suppress 
with compat_contextlib_suppress(*Exceptions):
    # code that fails silently for any of Exceptions
 2024-03-27 13:11:17 +00:00
dirkf aef24d97e9 [Videa] Align with yt-dlp 2024-03-08 13:14:52 +00:00
dirkf f7b30e3f73 [XFileShare] Update extractor for 2024 
* simplify aa_decode()
* review and update supported sites and tests
* in above, include FileMoon.sx, and remove separate module
* incorporate changes from yt-dlp
* allow for decoding multiple scripts (eg, FileMoon)
* use new JWPlayer extraction
 2024-03-08 13:03:42 +00:00