k4rli/youtube-dl
1
0
Fork 0
Code Issues Pull Requests Actions Packages Projects Releases Wiki Activity
11,871 Commits 1 Branch 0 Tags
1b3d5e05a824f880f1171eb840235e13cd8848dc
Commit Graph
100 Commits
This Branch
This Branch
All Branches
Author SHA1 Message Date
Jaime Marquínez Ferrándiz 1b3d5e05a8 Move the extreactors import to youtube_dl/extractor/extractors.py 2016-04-08 21:47:51 +02:00
Jaime Marquínez Ferrándiz e52d7f85f2 Delay initialization of InfoExtractors until they are needed 2016-04-08 21:43:24 +02:00
Jaime Marquínez Ferrándiz ec4a4c6fcc Makefile: remove ISSUE_TEMPLATE.md from the 'all' target (fixes #9088) 
It isn't included in the tar file, causing build failures.
Since it's only used for GitHub, I think we don't need to store it in the tar file.
 2016-04-06 14:16:05 +02:00
Jaime Marquínez Ferrándiz be0c7009fb Makefile: use full path for the ISSUE_TEMPLATE.md file 2016-04-06 14:09:31 +02:00
Jaime Marquínez Ferrándiz 5bf28d7864 [utils] dfxp2srt: add additional namespace 
Used by the ZDF subtitles (#9081).
 2016-04-04 20:46:35 +02:00
Jaime Marquínez Ferrándiz 8c7d6e8e22 [zdf] Extract subtitles (closes #9081) 2016-04-04 20:44:06 +02:00
Jaime Marquínez Ferrándiz 2defa7d75a [instagram:user] Fix extraction (fixes #9059) 
The URL for the next page was incorrect and we always got the same page, therefore it got trapped in an infinite loop.
 2016-04-02 18:03:56 +02:00
Jaime Marquínez Ferrándiz 6d628fafca [camwithher] Remove extra blank line 2016-04-01 20:45:21 +02:00
Jaime Marquínez Ferrándiz 0f28777f58 [cbsnews] Remove unused import 2016-04-01 20:43:14 +02:00
Jaime Marquínez Ferrándiz 329c1eae54 [aenetworks] Make pep8 happy 2016-04-01 20:42:19 +02:00
Jaime Marquínez Ferrándiz 7da2c87119 Add extractor for thescene.com (closes #8929) 2016-03-22 22:17:59 +01:00
Jaime Marquínez Ferrándiz 920d318d3c README: document that BSD make is also supported (#8902) 2016-03-20 10:55:14 +01:00
Jaime Marquínez Ferrándiz 3ff63fb365 Makefile: make it compatible with bmake 
It's the portable version of BSD make: http://crufty.net/help/sjg/bmake.html
The syntax for conditionals is different in GNU make and BSD make, so we use the shell
 2016-03-19 21:51:13 +01:00
Jaime Marquínez Ferrándiz 5c7cd37ebd tox.ini: Exclude test_iqiyi_sdk_interpreter.py 2016-03-19 21:50:16 +01:00
Jaime Marquínez Ferrándiz 782b1b5bd1 [utils] lookup_unit_table: Match word boundary instead of end of string 2016-03-19 11:44:49 +01:00
Jaime Marquínez Ferrándiz 09fc33198a utils: lookup_unit_table: Use a stricter regex 
In parse_count multiple units start with the same letter, so it would match different units depending on the order they were sorted when iterating over them.
 2016-03-18 19:23:06 +01:00
Jaime Marquínez Ferrándiz f6f6217a98 [facebook] Don't override variable in list comprehension 2016-03-10 15:17:04 +01:00
Jaime Marquínez Ferrándiz 3233a68fbb [utils] update_url_query: Encode the strings in the query dict 
The test case with {'test': '第二行тест'} was failing on python 2 (the non-ascii characters were replaced with '?').
 2016-03-04 22:18:40 +01:00
Jaime Marquínez Ferrándiz 3e76968220 [rtve.es:live] Fix extraction 
* Update _VALID_URL to match the current URLs
* Use the m3u8 manifest since I haven't figured out how to use the rtmp stream
 2016-02-29 20:57:26 +01:00
Jaime Marquínez Ferrándiz 9173202b84 [zdf] Ignore hls manifests that use https (closes #8665) 
The certificates are misconfigured, you get the following error mesage:

    ssl.CertificateError: hostname u'zdf-hdios-none-i.zdf.de' doesn't match either of 'a248.e.akamai.net', '*.akamaihd.net', '*.akamaihd-staging.net', '*.akamaized.net', '*.akamaized-staging.net'
 2016-02-28 14:06:26 +01:00
Jaime Marquínez Ferrándiz 765ac263db [utils] mimetype2ext: return 'm4a' for 'audio/mp4' (fixes #8620) 
The youtube extractor was using 'mp4' for them, therefore filters like 'bestaudio[ext=m4a]' stopped working (94278f7202 broke it).
 2016-02-20 19:55:10 +01:00
Jaime Marquínez Ferrándiz 7023251239 [comedycentral] Support /shows URLs (fixes #8405) 2016-02-13 12:26:27 +01:00
Jaime Marquínez Ferrándiz 7032833011 [iprima] Follow pep8 2016-02-06 21:37:28 +01:00
Jaime Marquínez Ferrándiz d4f8e83404 [FFmpegSubtitlesConvertorPP] remove unused variable 2016-02-06 19:04:53 +01:00
Jaime Marquínez Ferrándiz 7b8b007cd9 [FFmpegSubtitlesConvertorPP] remove intermediate srt files 2016-02-06 19:04:18 +01:00
Jaime Marquínez Ferrándiz 3547d26587 [FFmpegSubtitlesConvertorPP] correctly update the extension (fixes #8444) 2016-02-06 18:58:18 +01:00
Jaime Marquínez Ferrándiz 7e62c2eb6d [FFmpegSubtitlesConvertorPP] fix not working when srt is used as the intermediate format between ttml/dfxp and other format 
It was trying to use the ttml/dfxp file with ffmpeg, which doesn't have support for them.
I broke it in e04398e397.
 2016-02-06 18:51:05 +01:00
Jaime Marquínez Ferrándiz 3f7e8750d4 [arte.tv:+7] Fix extraction (fixes #8427) 2016-02-04 20:16:47 +01:00
Jaime Marquínez Ferrándiz 87de7069b9 [utils] dfxp2srt: make TTMLPElementParser inherit from object 
For consistency between python 2 and 3.
 2016-02-02 22:30:13 +01:00
Jaime Marquínez Ferrándiz 3ccb0655c1 [youtube] Use 'orderedSet' instead of 'set' to preserve the order 2016-01-31 15:11:00 +01:00
Jaime Marquínez Ferrándiz e04398e397 [FFmpegSubtitlesConvertorPP] delete old subtitle files (fixes #8382) 2016-01-31 14:22:36 +01:00
Jaime Marquínez Ferrándiz 7d106a65ca Add --hls-use-mpegts option 
When using the mpegts container hls vidoes can be played while being downloaded (useful if you are recording a live stream).
VLC and mpv play them file, but QuickTime doesn't.
 2016-01-30 12:26:40 +01:00
Jaime Marquínez Ferrándiz 2b4f5e68d1 [azubu] Add extractor for live streams (closes #8343) 2016-01-29 15:36:33 +01:00
Jaime Marquínez Ferrándiz 70029bc348 [youtube:user] Require 'https?://' in the url (fixes #8356) 
It was matching www.youtube.com/embed/WpfukLMe1TM.
The generic extractor automatically adds http:// if it's missing.
 2016-01-29 11:27:11 +01:00
Jaime Marquínez Ferrándiz 32d77eeb04 [downloader/common] report_retry: Don't crash when retries is infinite (fixes #8299) 2016-01-22 14:49:17 +01:00
Jaime Marquínez Ferrándiz 4519c1f43c [vimeo] 'ext' must be a string, not a tuple (fixes #8288) 
There was an ',' at the end of the line.
 2016-01-21 12:43:45 +01:00
Jaime Marquínez Ferrándiz 9d90e7de03 [downloader/hls] Ask ffmpeg to quit when interrupting youtube-dl with 'Ctrl+C' (#8252) 
Otherwise the mp4 file can't be played.
 2016-01-19 22:07:14 +01:00
Jaime Marquínez Ferrándiz 30e2f2d76f [YoutubeDL] use a more correct terminology in the error message for file:// URLs 2016-01-14 16:28:46 +01:00
Jaime Marquínez Ferrándiz 4240d50496 [YoutubeDL] improve error message for file:/// URLs 2016-01-14 14:07:54 +01:00
Jaime Marquínez Ferrándiz 6240b0a278 [YoutubeDL] urlopen: use build_opener again 
Otherwise we would need to manually add handlers like HTTPRedirectHandler, instead we add a customized FileHandler instance that raises an error.
 2016-01-14 08:16:39 +01:00
Jaime Marquínez Ferrándiz e37afbe0b8 [YoutubeDL] urlopen: disable the 'file:' protocol (#8227) 
If someone is running youtube-dl on a server to deliver files, the user could input 'file:///some/important/file' and youtube-dl would save that file as a video giving access to sensitive information to the user.
'file:' urls can be filtered, but the user can use an URL to a crafted m3u8 manifest like:

    #EXTM3U
    #EXT-X-MEDIA-SEQUENCE:0
    #EXTINF:10.0
    file:///etc/passwd
    #EXT-X-ENDLIST

With this patch 'file:' URLs raise URLError like for unknown protocols.
 2016-01-14 00:24:04 +01:00
Jaime Marquínez Ferrándiz 3c91e41614 [downloader/fragment] Don't fail if the 'Content-Length' header is missing 
In some dailymotion videos (like http://www.dailymotion.com/video/x3k0dtv from #8156) the segments URLs don't have the 'Content-Length' header and HttpFD sets the 'totat_bytes' field to None, so we also use '0' in that case (since we do different math operations with it).
 2016-01-10 14:41:38 +01:00
Jaime Marquínez Ferrándiz 7e8a800f29 [bigflix] Use correct indentation to make flake8 happy 2016-01-10 14:26:27 +01:00
Jaime Marquínez Ferrándiz 27783821af [xhamster] Remove unused import 2016-01-09 11:16:23 +01:00
Jaime Marquínez Ferrándiz 3f17c357d9 [downloader/hls] Don't let ffmpeg read from stdin (#8139) 
If you run 'while read aurl ; do youtube-dl "${aurl}"; done < path_to_batch_file'  (batch_file contains one url per line that uses the hls downloader) each call to youtube-dl consumed some characters and 'read' would assing to 'aurl' a non valid url

(This is the same problem that was fixed for the ffmpeg postprocessors in cffcbc02de)
 2016-01-04 18:35:31 +01:00
Jaime Marquínez Ferrándiz ca227c8698 [yahoo] Support pages that use an alias (fixes #8084) 2016-01-01 14:32:00 +01:00
Jaime Marquínez Ferrándiz 69f8595256 [espn] Extract better titles 2015-12-31 20:06:21 +01:00
Jaime Marquínez Ferrándiz 930087f2f6 [espn] Support 'intl' videos (#7858) 2015-12-31 20:04:17 +01:00
Jaime Marquínez Ferrándiz 9f9f7664b5 [espn] Update test 2015-12-31 19:52:48 +01:00
Jaime Marquínez Ferrándiz c7932289e7 [cbsnews] Fix extraction of the URL for the 'RtmpDesktop' format (fixes #8048) 2015-12-30 23:57:19 +01:00
Jaime Marquínez Ferrándiz 53365f74a7 Credit @flatgreen for FranceCultureEmission (#8022) 2015-12-29 16:14:05 +01:00
Jaime Marquínez Ferrándiz 7447661e9b [franceculture] Fix test 2015-12-28 20:05:47 +01:00
Jaime Marquínez Ferrándiz 6c6b8bd5cc [cspan] Fix extraction (fixes #8032) 2015-12-28 13:50:29 +01:00
Jaime Marquínez Ferrándiz 04e24906be [cspan] Initialize 'video_type' to avoid 'UnboundLocalError' exceptions (#8032) 2015-12-28 13:06:30 +01:00
Jaime Marquínez Ferrándiz a8f1d167f6 [arte] Prefer json URLs that contain the video id from the 'vid' parameter in the URL (fixes #7920) 2015-12-23 18:00:46 +01:00
Jaime Marquínez Ferrándiz 7fe37d8a05 [appletrailers] Improve regex for fixing '<img>' tags (#7953) 2015-12-23 14:48:40 +01:00
Jaime Marquínez Ferrándiz 47f48f5d85 [test/test_all_urls] Update pbs extractor name 
It's in lowercase now (since e15e2ef7a0).
 2015-12-08 21:12:13 +01:00
Jaime Marquínez Ferrándiz 77334ccb44 [metacafe] Fix age limit extraction 2015-12-05 16:12:50 +01:00
Jaime Marquínez Ferrándiz 796db21295 [metacafe] Fix video url extraction (closes #7763) 2015-12-05 16:12:02 +01:00
Jaime Marquínez Ferrándiz 55bec9b658 [clipfish] Remove unused import and style fix 2015-12-04 14:29:37 +01:00
Jaime Marquínez Ferrándiz 2a63b0f110 [mixcloud] Fix extraction of the audio url (fixes #7751) 2015-12-04 14:26:34 +01:00
Jaime Marquínez Ferrándiz 7b1e379ca9 [gametrailers] Fix extraction (fixes #7722) 
They have stopped using the MTV system.
 2015-12-03 13:47:21 +01:00
Jaime Marquínez Ferrándiz 63b4295d20 [youtube:playlist] fix title extraction (fixes #7544 and #7545) 2015-11-18 18:28:05 +01:00
Jaime Marquínez Ferrándiz 609af1ae1c [dplay] Add 'encoding: utf-8' line 2015-11-17 17:58:16 +01:00
Jaime Marquínez Ferrándiz 4cd759f73d [dplay] Add extractor (closes #7515) 
Since I haven't figured out how to download the hds stream, we use the hls one instead.
 2015-11-17 17:52:29 +01:00
Jaime Marquínez Ferrándiz e156e70281 [rtve] Remove unused import 2015-11-17 16:23:29 +01:00
Jaime Marquínez Ferrándiz 0f72beb515 [periscope] Remove unused imports 2015-11-14 18:31:33 +01:00
Jaime Marquínez Ferrándiz b703ebeeaf [twitter] Don't fail if the description doesn't contain an URL (fixes #7489) 2015-11-13 19:09:42 +01:00
Jaime Marquínez Ferrándiz b84a5f0337 [twitter] Update tests checksums 2015-11-13 18:55:07 +01:00
Jaime Marquínez Ferrándiz 1ebb4717df [cbsnews] Fix construction of 'play_path' in some videos (fixes #7394) 2015-11-12 21:02:56 +01:00
Jaime Marquínez Ferrándiz d5c181a14e [movieclips] Fix extraction (fixes #7404) 
They use theplatform now.
Changed the test, because the old one seems to be georestricted.
 2015-11-08 11:49:51 +01:00
Jaime Marquínez Ferrándiz cff551c0b0 [googleplus] Fix extraction of formats 2015-11-07 18:43:22 +01:00
Jaime Marquínez Ferrándiz cb5a470635 [vimeo] Remove unused import 2015-11-04 16:18:51 +01:00
Jaime Marquínez Ferrándiz 6a75040278 [utils] unified_strdate: Return None if the date format can't be recognized (fixes #7340) 
This issue was introduced with ae12bc3ebb, it returned 'None'.
 2015-11-02 14:08:38 +01:00
Jaime Marquínez Ferrándiz eb97f46e8b [mitele] Fix extraction and update test checksum (fixes #7343) 2015-11-02 12:46:10 +01:00
Jaime Marquínez Ferrándiz c3040bd00a [kika] Cleanup 
Closes #6957.
 2015-10-31 16:32:35 +01:00
Jaime Marquínez Ferrándiz 8c1aa28c27 [kika] Replace non working tests and recognize 'einzelsendung' urls. 2015-10-31 16:14:36 +01:00
Jaime Marquínez Ferrándiz ae37338e68 [compat] compat_etree_fromstring: clarify comment 2015-10-29 13:58:40 +01:00
Jaime Marquínez Ferrándiz 7ccb2b84dd [francetv] fix style issues reported by flake8 
* Don't redefine variable in list comprehension
* Line missing indentation
 2015-10-28 08:22:04 +01:00
Jaime Marquínez Ferrándiz f78546272c [compat] compat_etree_fromstring: also decode the text attribute 
Deletes parse_xml from utils, because it also does it.
 2015-10-26 16:41:24 +01:00
Jaime Marquínez Ferrándiz 387db16a78 [compat] compat_etree_fromstring: only decode bytes objects 2015-10-25 20:30:54 +01:00
Jaime Marquínez Ferrándiz 36e6f62cd0 Use a wrapper around xml.etree.ElementTree.fromstring in python 2.x (#7178) 
Attributes aren't unicode objects, so they couldn't be directly used in info_dict fields (for example '--write-description' doesn't work with bytes).
 2015-10-25 20:13:16 +01:00
Jaime Marquínez Ferrándiz 50b936936d [tutv] Fix test 2015-10-24 14:22:47 +02:00
Jaime Marquínez Ferrándiz d97da29da2 [abc] Support more URL formats 2015-10-24 12:43:02 +02:00
Jaime Marquínez Ferrándiz 36d7281037 [spiegeltv] Fix style issue 
Use two spaces before comment.
 2015-10-24 12:42:08 +02:00
Jaime Marquínez Ferrándiz 865d1fbafc [extractor/common] Remove unused import 2015-10-24 12:39:23 +02:00
Jaime Marquínez Ferrándiz 6856139705 [mitele] Fix test checksum 2015-10-24 12:13:26 +02:00
Jaime Marquínez Ferrándiz c93153852f [mitele] Don't encode the URL query (closes #7280) 
This seems to produce sporadic errors when trying to access the URL, because on python 3.x when you do '%s' % b'somedata' you get "b'somedata'".
 2015-10-24 12:10:53 +02:00
Jaime Marquínez Ferrándiz 5c43afd40f [youtube:channel] Support age restricted channels (fixes #7277) 2015-10-23 14:23:45 +02:00
Jaime Marquínez Ferrándiz 9170ca5b16 [youtube:channel] Fix test 2015-10-23 14:16:08 +02:00
Jaime Marquínez Ferrándiz 65d49afa48 [test/test_download] Use extract_flat = 'in_playlist' for playlist items 
Some playlist extractors return a 'url' result, which wouldn't be resolved.
 2015-10-23 14:12:46 +02:00
Jaime Marquínez Ferrándiz 8c3533ba97 [adultswim] Don't default to the native m3u8 downloader (closes #7243) 
Some of the streams are encrypted, which is not supported .
 2015-10-21 23:57:23 +02:00
Jaime Marquínez Ferrándiz dd67702a3e [imdb] Fix extraction (fixes #7220) 2015-10-18 14:13:06 +02:00
Jaime Marquínez Ferrándiz 6df7179e6c [rte] Actually recognize https urls 
There was a missing 's' before the '?'.
 2015-10-17 11:53:59 +02:00
Jaime Marquínez Ferrándiz 36eb802baf [rte] Replace expired test 
According to their webpage it should be available until October 2035.
 2015-10-17 11:49:51 +02:00
Jaime Marquínez Ferrándiz 1f36085df9 [vimeo] Fix extraction of password protected videos (fixes #7169) 2015-10-14 13:41:39 +02:00
Jaime Marquínez Ferrándiz 506e261d20 [channel9] strip 'session_day' 2015-10-13 21:18:30 +02:00
Jaime Marquínez Ferrándiz b30c4992a9 [channel9] Return a single dictionary for single videos (closes #7086) 
Returning a list is deprecated.
 2015-10-13 21:14:33 +02:00
Jaime Marquínez Ferrándiz 57d1db8dd0 [rtbf] Fix extraction (closes #7133) 2015-10-11 22:45:13 +02:00
Jaime Marquínez Ferrándiz b203095d4c [europa] Style fix: add whitespace after comma 2015-10-02 22:40:35 +02:00