k4rli/youtube-dl
1
0
Fork 0
Code Issues Pull Requests Actions Packages Projects Releases Wiki Activity
16,738 Commits 1 Branch 0 Tags
31fbedc06a349bc555ab934588544f75734e3a55
Commit Graph
100 Commits
This Branch
This Branch
All Branches
Author SHA1 Message Date
Jaime Marquínez Ferrándiz 020c5df52d [elpais] Fix extraction for some URLs (closes #11765) 2017-02-01 23:48:34 +01:00
Jaime Marquínez Ferrándiz da0baba5c8 [rtve] Fix extraction for some videos 
For example http://www.rtve.es/alacarta/videos/documentos-tv/documentos-tv-descredito/3574098/.
 2016-07-29 17:20:27 +02:00
Jaime Marquínez Ferrándiz bb9f3bfedf Revert "[rtve] Fix extraction (#10076)" 
This reverts commit c39b2ed990.

Apparently outside of Spain using 'auth/resources' is required (#10097).
 2016-07-29 17:14:04 +02:00
Jaime Marquínez Ferrándiz 233b58dec7 Add extractor for rtve.es/television (fixes #10076) 2016-07-13 21:02:34 +02:00
Jaime Marquínez Ferrándiz c39b2ed990 [rtve] Fix extraction (#10076) 
For http://www.rtve.es/alacarta/videos/documentos-tv/documentos-tv-revolucion-del-movil/3069778/ using 'auth/resources' fails, and other URLs seem to work fine.
 2016-07-13 20:23:27 +02:00
Jaime Marquínez Ferrándiz 4cb13d0d6a [hrti] Don't redefine variable in list comprehension 2016-07-02 23:02:14 +02:00
Jaime Marquínez FerrándizandSergey M․ a9eede3913 [test/compat] compat_shlex_split: test with newlines 2016-07-01 03:30:35 +07:00
Jaime Marquínez FerrándizandSergey M․ 9e29ef13a3 [options] Accept quoted string across multiple lines (#9940) 
Like:

    -f "
    bestvideo+bestaudio/
    best
    "
 2016-07-01 03:30:31 +07:00
Jaime Marquínez Ferrándiz 169d836feb lazy-extractors: Fix after commit 6e6b9f600f 
The problem was in the following code:

    class ArteTVPlus7IE(ArteTVBaseIE):

        ...

        @classmethod
        def suitable(cls, url):
            return False if ArteTVPlaylistIE.suitable(url) else super(ArteTVPlus7IE, cls).suitable(url)

And its sublcasses like ArteTVCinemaIE.

Since in the lazy_extractors.py file ArteTVCinemaIE was not a subclass of ArteTVPlus7IE, super(ArteTVPlus7IE, cls) failed.

To fix it we have to make it a subclass. Since the order of _ALL_CLASSES is arbitrary we must sort them so that the base classes are defined first. We also must add base classes like YoutubeBaseInfoExtractor.
 2016-06-22 19:20:50 +02:00
Jaime Marquínez Ferrándiz e67f688025 [compat] Add 'compat_input' to __all__ 2016-06-05 23:16:08 +02:00
Jaime Marquínez Ferrándiz 4c718d3c50 [rtve] Recognize 'filmoteca' URLs 2016-05-21 17:37:35 +02:00
Jaime Marquínez Ferrándiz 1b6182d8f7 [youtube:playlist] Fetch all the videos in a mix (fixes #3837) 
Since there doesn't seem to be any indication, it stops when there aren't new videos in the webpage.
 2016-04-17 17:07:57 +02:00
Jaime Marquínez Ferrándiz 6a801f4470 [test/InfoExtractors] add test for _download_json 2016-04-09 23:18:41 +02:00
Jaime Marquínez Ferrándiz eb9c3edd5e [test/utils] Add test for date_from_str 2016-04-09 22:40:05 +02:00
Jaime Marquínez Ferrándiz 5a9858bfa9 setup.py: add command for building the lazy_extractors module 2016-04-08 21:50:54 +02:00
Jaime Marquínez Ferrándiz 8a5dc1c1e1 lazy extractors: Initialize the real info extractor 
According to the docs '__init__' is only called automatically if '__new__' returns an instance of the original class.
 2016-04-08 21:50:54 +02:00
Jaime Marquínez Ferrándiz e0986e31cf lazy extractors: Output if it's enabled in the verbose log 2016-04-08 21:50:54 +02:00
Jaime Marquínez Ferrándiz 6b97ca96fc lazy extractors: Style fixes 
* Sort extractors alphabetically
* Add newlines when needed (youtube_dl/extractors/lazy_extractors.py pass the flake8 test now)
 2016-04-08 21:50:54 +02:00
Jaime Marquínez Ferrándiz c1ce6acdd7 lazy extractors: Fix building with python2.6 2016-04-08 21:50:07 +02:00
Jaime Marquínez Ferrándiz 0d778b1db9 lazy extractors: specify the encoding 
When building with python3 the unicode characters are not escaped, python2 needs to know the encoding.
 2016-04-08 21:50:07 +02:00
Jaime Marquínez Ferrándiz 779822d945 Add experimental support for lazy loading the info extractors 
'make lazy-extractors' creates the youtube_dl/extractor/lazy_extractors.py (imported by youtube_dl/extractor/__init__.py), which contains simplified classes that only have the 'suitable' class method and that load the appropiate class with the '__new__' method when a instance is created.
 2016-04-08 21:50:07 +02:00
Jaime Marquínez Ferrándiz 1b3d5e05a8 Move the extreactors import to youtube_dl/extractor/extractors.py 2016-04-08 21:47:51 +02:00
Jaime Marquínez Ferrándiz e52d7f85f2 Delay initialization of InfoExtractors until they are needed 2016-04-08 21:43:24 +02:00
Jaime Marquínez Ferrándiz ec4a4c6fcc Makefile: remove ISSUE_TEMPLATE.md from the 'all' target (fixes #9088) 
It isn't included in the tar file, causing build failures.
Since it's only used for GitHub, I think we don't need to store it in the tar file.
 2016-04-06 14:16:05 +02:00
Jaime Marquínez Ferrándiz be0c7009fb Makefile: use full path for the ISSUE_TEMPLATE.md file 2016-04-06 14:09:31 +02:00
Jaime Marquínez Ferrándiz 5bf28d7864 [utils] dfxp2srt: add additional namespace 
Used by the ZDF subtitles (#9081).
 2016-04-04 20:46:35 +02:00
Jaime Marquínez Ferrándiz 8c7d6e8e22 [zdf] Extract subtitles (closes #9081) 2016-04-04 20:44:06 +02:00
Jaime Marquínez Ferrándiz 2defa7d75a [instagram:user] Fix extraction (fixes #9059) 
The URL for the next page was incorrect and we always got the same page, therefore it got trapped in an infinite loop.
 2016-04-02 18:03:56 +02:00
Jaime Marquínez Ferrándiz 6d628fafca [camwithher] Remove extra blank line 2016-04-01 20:45:21 +02:00
Jaime Marquínez Ferrándiz 0f28777f58 [cbsnews] Remove unused import 2016-04-01 20:43:14 +02:00
Jaime Marquínez Ferrándiz 329c1eae54 [aenetworks] Make pep8 happy 2016-04-01 20:42:19 +02:00
Jaime Marquínez Ferrándiz 7da2c87119 Add extractor for thescene.com (closes #8929) 2016-03-22 22:17:59 +01:00
Jaime Marquínez Ferrándiz 920d318d3c README: document that BSD make is also supported (#8902) 2016-03-20 10:55:14 +01:00
Jaime Marquínez Ferrándiz 3ff63fb365 Makefile: make it compatible with bmake 
It's the portable version of BSD make: http://crufty.net/help/sjg/bmake.html
The syntax for conditionals is different in GNU make and BSD make, so we use the shell
 2016-03-19 21:51:13 +01:00
Jaime Marquínez Ferrándiz 5c7cd37ebd tox.ini: Exclude test_iqiyi_sdk_interpreter.py 2016-03-19 21:50:16 +01:00
Jaime Marquínez Ferrándiz 782b1b5bd1 [utils] lookup_unit_table: Match word boundary instead of end of string 2016-03-19 11:44:49 +01:00
Jaime Marquínez Ferrándiz 09fc33198a utils: lookup_unit_table: Use a stricter regex 
In parse_count multiple units start with the same letter, so it would match different units depending on the order they were sorted when iterating over them.
 2016-03-18 19:23:06 +01:00
Jaime Marquínez Ferrándiz f6f6217a98 [facebook] Don't override variable in list comprehension 2016-03-10 15:17:04 +01:00
Jaime Marquínez Ferrándiz 3233a68fbb [utils] update_url_query: Encode the strings in the query dict 
The test case with {'test': '第二行тест'} was failing on python 2 (the non-ascii characters were replaced with '?').
 2016-03-04 22:18:40 +01:00
Jaime Marquínez Ferrándiz 3e76968220 [rtve.es:live] Fix extraction 
* Update _VALID_URL to match the current URLs
* Use the m3u8 manifest since I haven't figured out how to use the rtmp stream
 2016-02-29 20:57:26 +01:00
Jaime Marquínez Ferrándiz 9173202b84 [zdf] Ignore hls manifests that use https (closes #8665) 
The certificates are misconfigured, you get the following error mesage:

    ssl.CertificateError: hostname u'zdf-hdios-none-i.zdf.de' doesn't match either of 'a248.e.akamai.net', '*.akamaihd.net', '*.akamaihd-staging.net', '*.akamaized.net', '*.akamaized-staging.net'
 2016-02-28 14:06:26 +01:00
Jaime Marquínez Ferrándiz 765ac263db [utils] mimetype2ext: return 'm4a' for 'audio/mp4' (fixes #8620) 
The youtube extractor was using 'mp4' for them, therefore filters like 'bestaudio[ext=m4a]' stopped working (94278f7202 broke it).
 2016-02-20 19:55:10 +01:00
Jaime Marquínez Ferrándiz 7023251239 [comedycentral] Support /shows URLs (fixes #8405) 2016-02-13 12:26:27 +01:00
Jaime Marquínez Ferrándiz 7032833011 [iprima] Follow pep8 2016-02-06 21:37:28 +01:00
Jaime Marquínez Ferrándiz d4f8e83404 [FFmpegSubtitlesConvertorPP] remove unused variable 2016-02-06 19:04:53 +01:00
Jaime Marquínez Ferrándiz 7b8b007cd9 [FFmpegSubtitlesConvertorPP] remove intermediate srt files 2016-02-06 19:04:18 +01:00
Jaime Marquínez Ferrándiz 3547d26587 [FFmpegSubtitlesConvertorPP] correctly update the extension (fixes #8444) 2016-02-06 18:58:18 +01:00
Jaime Marquínez Ferrándiz 7e62c2eb6d [FFmpegSubtitlesConvertorPP] fix not working when srt is used as the intermediate format between ttml/dfxp and other format 
It was trying to use the ttml/dfxp file with ffmpeg, which doesn't have support for them.
I broke it in e04398e397.
 2016-02-06 18:51:05 +01:00
Jaime Marquínez Ferrándiz 3f7e8750d4 [arte.tv:+7] Fix extraction (fixes #8427) 2016-02-04 20:16:47 +01:00
Jaime Marquínez Ferrándiz 87de7069b9 [utils] dfxp2srt: make TTMLPElementParser inherit from object 
For consistency between python 2 and 3.
 2016-02-02 22:30:13 +01:00
Jaime Marquínez Ferrándiz 3ccb0655c1 [youtube] Use 'orderedSet' instead of 'set' to preserve the order 2016-01-31 15:11:00 +01:00
Jaime Marquínez Ferrándiz e04398e397 [FFmpegSubtitlesConvertorPP] delete old subtitle files (fixes #8382) 2016-01-31 14:22:36 +01:00
Jaime Marquínez Ferrándiz 7d106a65ca Add --hls-use-mpegts option 
When using the mpegts container hls vidoes can be played while being downloaded (useful if you are recording a live stream).
VLC and mpv play them file, but QuickTime doesn't.
 2016-01-30 12:26:40 +01:00
Jaime Marquínez Ferrándiz 2b4f5e68d1 [azubu] Add extractor for live streams (closes #8343) 2016-01-29 15:36:33 +01:00
Jaime Marquínez Ferrándiz 70029bc348 [youtube:user] Require 'https?://' in the url (fixes #8356) 
It was matching www.youtube.com/embed/WpfukLMe1TM.
The generic extractor automatically adds http:// if it's missing.
 2016-01-29 11:27:11 +01:00
Jaime Marquínez Ferrándiz 32d77eeb04 [downloader/common] report_retry: Don't crash when retries is infinite (fixes #8299) 2016-01-22 14:49:17 +01:00
Jaime Marquínez Ferrándiz 4519c1f43c [vimeo] 'ext' must be a string, not a tuple (fixes #8288) 
There was an ',' at the end of the line.
 2016-01-21 12:43:45 +01:00
Jaime Marquínez Ferrándiz 9d90e7de03 [downloader/hls] Ask ffmpeg to quit when interrupting youtube-dl with 'Ctrl+C' (#8252) 
Otherwise the mp4 file can't be played.
 2016-01-19 22:07:14 +01:00
Jaime Marquínez Ferrándiz 30e2f2d76f [YoutubeDL] use a more correct terminology in the error message for file:// URLs 2016-01-14 16:28:46 +01:00
Jaime Marquínez Ferrándiz 4240d50496 [YoutubeDL] improve error message for file:/// URLs 2016-01-14 14:07:54 +01:00
Jaime Marquínez Ferrándiz 6240b0a278 [YoutubeDL] urlopen: use build_opener again 
Otherwise we would need to manually add handlers like HTTPRedirectHandler, instead we add a customized FileHandler instance that raises an error.
 2016-01-14 08:16:39 +01:00
Jaime Marquínez Ferrándiz e37afbe0b8 [YoutubeDL] urlopen: disable the 'file:' protocol (#8227) 
If someone is running youtube-dl on a server to deliver files, the user could input 'file:///some/important/file' and youtube-dl would save that file as a video giving access to sensitive information to the user.
'file:' urls can be filtered, but the user can use an URL to a crafted m3u8 manifest like:

    #EXTM3U
    #EXT-X-MEDIA-SEQUENCE:0
    #EXTINF:10.0
    file:///etc/passwd
    #EXT-X-ENDLIST

With this patch 'file:' URLs raise URLError like for unknown protocols.
 2016-01-14 00:24:04 +01:00
Jaime Marquínez Ferrándiz 3c91e41614 [downloader/fragment] Don't fail if the 'Content-Length' header is missing 
In some dailymotion videos (like http://www.dailymotion.com/video/x3k0dtv from #8156) the segments URLs don't have the 'Content-Length' header and HttpFD sets the 'totat_bytes' field to None, so we also use '0' in that case (since we do different math operations with it).
 2016-01-10 14:41:38 +01:00
Jaime Marquínez Ferrándiz 7e8a800f29 [bigflix] Use correct indentation to make flake8 happy 2016-01-10 14:26:27 +01:00
Jaime Marquínez Ferrándiz 27783821af [xhamster] Remove unused import 2016-01-09 11:16:23 +01:00
Jaime Marquínez Ferrándiz 3f17c357d9 [downloader/hls] Don't let ffmpeg read from stdin (#8139) 
If you run 'while read aurl ; do youtube-dl "${aurl}"; done < path_to_batch_file'  (batch_file contains one url per line that uses the hls downloader) each call to youtube-dl consumed some characters and 'read' would assing to 'aurl' a non valid url

(This is the same problem that was fixed for the ffmpeg postprocessors in cffcbc02de)
 2016-01-04 18:35:31 +01:00
Jaime Marquínez Ferrándiz ca227c8698 [yahoo] Support pages that use an alias (fixes #8084) 2016-01-01 14:32:00 +01:00
Jaime Marquínez Ferrándiz 69f8595256 [espn] Extract better titles 2015-12-31 20:06:21 +01:00
Jaime Marquínez Ferrándiz 930087f2f6 [espn] Support 'intl' videos (#7858) 2015-12-31 20:04:17 +01:00
Jaime Marquínez Ferrándiz 9f9f7664b5 [espn] Update test 2015-12-31 19:52:48 +01:00
Jaime Marquínez Ferrándiz c7932289e7 [cbsnews] Fix extraction of the URL for the 'RtmpDesktop' format (fixes #8048) 2015-12-30 23:57:19 +01:00
Jaime Marquínez Ferrándiz 53365f74a7 Credit @flatgreen for FranceCultureEmission (#8022) 2015-12-29 16:14:05 +01:00
Jaime Marquínez Ferrándiz 7447661e9b [franceculture] Fix test 2015-12-28 20:05:47 +01:00
Jaime Marquínez Ferrándiz 6c6b8bd5cc [cspan] Fix extraction (fixes #8032) 2015-12-28 13:50:29 +01:00
Jaime Marquínez Ferrándiz 04e24906be [cspan] Initialize 'video_type' to avoid 'UnboundLocalError' exceptions (#8032) 2015-12-28 13:06:30 +01:00
Jaime Marquínez Ferrándiz a8f1d167f6 [arte] Prefer json URLs that contain the video id from the 'vid' parameter in the URL (fixes #7920) 2015-12-23 18:00:46 +01:00
Jaime Marquínez Ferrándiz 7fe37d8a05 [appletrailers] Improve regex for fixing '<img>' tags (#7953) 2015-12-23 14:48:40 +01:00
Jaime Marquínez Ferrándiz 47f48f5d85 [test/test_all_urls] Update pbs extractor name 
It's in lowercase now (since e15e2ef7a0).
 2015-12-08 21:12:13 +01:00
Jaime Marquínez Ferrándiz 77334ccb44 [metacafe] Fix age limit extraction 2015-12-05 16:12:50 +01:00
Jaime Marquínez Ferrándiz 796db21295 [metacafe] Fix video url extraction (closes #7763) 2015-12-05 16:12:02 +01:00
Jaime Marquínez Ferrándiz 55bec9b658 [clipfish] Remove unused import and style fix 2015-12-04 14:29:37 +01:00
Jaime Marquínez Ferrándiz 2a63b0f110 [mixcloud] Fix extraction of the audio url (fixes #7751) 2015-12-04 14:26:34 +01:00
Jaime Marquínez Ferrándiz 7b1e379ca9 [gametrailers] Fix extraction (fixes #7722) 
They have stopped using the MTV system.
 2015-12-03 13:47:21 +01:00
Jaime Marquínez Ferrándiz 63b4295d20 [youtube:playlist] fix title extraction (fixes #7544 and #7545) 2015-11-18 18:28:05 +01:00
Jaime Marquínez Ferrándiz 609af1ae1c [dplay] Add 'encoding: utf-8' line 2015-11-17 17:58:16 +01:00
Jaime Marquínez Ferrándiz 4cd759f73d [dplay] Add extractor (closes #7515) 
Since I haven't figured out how to download the hds stream, we use the hls one instead.
 2015-11-17 17:52:29 +01:00
Jaime Marquínez Ferrándiz e156e70281 [rtve] Remove unused import 2015-11-17 16:23:29 +01:00
Jaime Marquínez Ferrándiz 0f72beb515 [periscope] Remove unused imports 2015-11-14 18:31:33 +01:00
Jaime Marquínez Ferrándiz b703ebeeaf [twitter] Don't fail if the description doesn't contain an URL (fixes #7489) 2015-11-13 19:09:42 +01:00
Jaime Marquínez Ferrándiz b84a5f0337 [twitter] Update tests checksums 2015-11-13 18:55:07 +01:00
Jaime Marquínez Ferrándiz 1ebb4717df [cbsnews] Fix construction of 'play_path' in some videos (fixes #7394) 2015-11-12 21:02:56 +01:00
Jaime Marquínez Ferrándiz d5c181a14e [movieclips] Fix extraction (fixes #7404) 
They use theplatform now.
Changed the test, because the old one seems to be georestricted.
 2015-11-08 11:49:51 +01:00
Jaime Marquínez Ferrándiz cff551c0b0 [googleplus] Fix extraction of formats 2015-11-07 18:43:22 +01:00
Jaime Marquínez Ferrándiz cb5a470635 [vimeo] Remove unused import 2015-11-04 16:18:51 +01:00
Jaime Marquínez Ferrándiz 6a75040278 [utils] unified_strdate: Return None if the date format can't be recognized (fixes #7340) 
This issue was introduced with ae12bc3ebb, it returned 'None'.
 2015-11-02 14:08:38 +01:00
Jaime Marquínez Ferrándiz eb97f46e8b [mitele] Fix extraction and update test checksum (fixes #7343) 2015-11-02 12:46:10 +01:00
Jaime Marquínez Ferrándiz c3040bd00a [kika] Cleanup 
Closes #6957.
 2015-10-31 16:32:35 +01:00
Jaime Marquínez Ferrándiz 8c1aa28c27 [kika] Replace non working tests and recognize 'einzelsendung' urls. 2015-10-31 16:14:36 +01:00
Jaime Marquínez Ferrándiz ae37338e68 [compat] compat_etree_fromstring: clarify comment 2015-10-29 13:58:40 +01:00
Jaime Marquínez Ferrándiz 7ccb2b84dd [francetv] fix style issues reported by flake8 
* Don't redefine variable in list comprehension
* Line missing indentation
 2015-10-28 08:22:04 +01:00