k4rli/youtube-dl
1
0
Fork 0
Code Issues Pull Requests Actions Packages Projects Releases Wiki Activity
10,882 Commits 1 Branch 0 Tags
18e6c97c48f883911649d9b3d64127379a8b1df4
Commit Graph
100 Commits
This Branch
This Branch
All Branches
Author SHA1 Message Date
Yen Chi Hsuan 141a273a8b [qqmusic] Update tests 2016-01-02 22:39:09 +08:00
Yen Chi Hsuan 2fffb1dcd0 [qqmusic:playlist] Capture errors and update tests 2016-01-02 22:33:33 +08:00
Yen Chi Hsuan e698e4e533 Merge branch 'remitamine-baidu' 2016-01-02 21:50:17 +08:00
Yen Chi Hsuan b7546397f0 [baidu] Use list comprehension 2016-01-02 21:46:40 +08:00
Yen Chi Hsuan 0311677258 [baidu] Add notes for API calls 2016-01-02 21:44:49 +08:00
Yen Chi Hsuan a1d9f6c5dc [baidu] Improve playlist description 2016-01-02 21:36:35 +08:00
Yen Chi Hsuan c579c5e967 [baidu] Cleanups 2016-01-02 21:31:02 +08:00
Yen Chi Hsuan c9c194053d Merge branch 'baidu' of https://github.com/remitamine/youtube-dl into remitamine-baidu 2016-01-02 21:27:32 +08:00
Yen Chi Hsuan 034caf70b2 [youku] Fix extraction (#8068) 2016-01-01 13:33:01 +08:00
Yen Chi Hsuan c047270c02 [utils] Remove Content-encoding from headers after decompression 
With cn_verification_proxy, our http_response() is called twice, one from
PerRequestProxyHandler.proxy_open() and another from normal
YoutubeDL.urlopen(). As a result, for proxies honoring Accept-Encoding, the
following bug occurs:

$ youtube-dl -vs --cn-verification-proxy https://secure.uku.im:993 "test:letv"
[debug] System config: []
[debug] User config: []
[debug] Command-line args: ['-vs', '--cn-verification-proxy', 'https://secure.uku.im:993', 'test:letv']
[debug] Encodings: locale UTF-8, fs utf-8, out UTF-8, pref UTF-8
[debug] youtube-dl version 2015.12.23
[debug] Git HEAD: 97f18fa
[debug] Python version 3.5.1 - Linux-4.3.3-1-ARCH-x86_64-with-arch-Arch-Linux
[debug] exe versions: ffmpeg 2.8.4, ffprobe 2.8.4, rtmpdump 2.4
[debug] Proxy map: {}
[TestURL] Test URL: http://www.letv.com/ptv/vplay/22005890.html
[Letv] 22005890: Downloading webpage
[Letv] 22005890: Downloading playJson data
ERROR: Unable to download JSON metadata: Not a gzipped file (b'{"') (caused by OSError('Not a gzipped file (b\'{"\')',)); please report this issue on https://yt-dl.org/bug . Make sure you are using the latest version; see  https://yt-dl.org/update  on how to update. Be sure to call youtube-dl with the --verbose flag and include its complete output.
  File "/home/yen/Executables/Multimedia/youtube-dl/youtube_dl/extractor/common.py", line 330, in _request_webpage
    return self._downloader.urlopen(url_or_request)
  File "/home/yen/Executables/Multimedia/youtube-dl/youtube_dl/YoutubeDL.py", line 1886, in urlopen
    return self._opener.open(req, timeout=self._socket_timeout)
  File "/usr/lib/python3.5/urllib/request.py", line 471, in open
    response = meth(req, response)
  File "/home/yen/Executables/Multimedia/youtube-dl/youtube_dl/utils.py", line 773, in http_response
    raise original_ioerror
  File "/home/yen/Executables/Multimedia/youtube-dl/youtube_dl/utils.py", line 761, in http_response
    uncompressed = io.BytesIO(gz.read())
  File "/usr/lib/python3.5/gzip.py", line 274, in read
    return self._buffer.read(size)
  File "/usr/lib/python3.5/gzip.py", line 461, in read
    if not self._read_gzip_header():
  File "/usr/lib/python3.5/gzip.py", line 409, in _read_gzip_header
    raise OSError('Not a gzipped file (%r)' % magic)
 2015-12-28 01:09:18 +08:00
Yen Chi Hsuan 59185202c6 [iqiyi] Add tests for #7894 2015-12-28 00:19:36 +08:00
Yen Chi Hsuan db2fe38b55 [utils] Support alternative timestamp format in TTML 
Fixes #7608
 2015-12-19 19:29:51 +08:00
Yen Chi Hsuan d631d5f9f2 [utils] Fix TTML conversion 
Tolerate invalid timestamps (closes #7909)
 2015-12-19 18:21:42 +08:00
Yen Chi Hsuan 10171468d9 [iqiyi] Update key (closes #7896) 2015-12-18 18:20:41 +08:00
Yen Chi Hsuan bf597a6dd1 Merge pull request #7895 from Blue9/patch-1 
Fix hyperlink to youtube-dl options
 2015-12-18 18:10:41 +08:00
Yen Chi Hsuan eb0bdc2c3e [novamov] Fix again 2015-12-14 02:50:59 +08:00
Yen Chi Hsuan 6583c741cd [novamov] Fix filekey extraction and reupload test video 2015-12-14 02:34:20 +08:00
Yen Chi Hsuan 02a63fadc3 [infoq] Refactor and support the Chinese version 
Closes #7576
 2015-12-13 19:16:58 +08:00
Yen Chi Hsuan 22d07ba4e4 [infoq] Fix extraction for HTTP URLs (closes #7739) 2015-12-13 17:29:27 +08:00
Yen Chi Hsuan f6abca506e [nowvideo] Skip deleted test case 2015-12-13 15:43:20 +08:00
Yen Chi Hsuan b5424acdb9 [novamov] Improve existence checking 2015-12-13 15:43:20 +08:00
Yen Chi Hsuan 47c7f3d995 [novamov] Fix filekey extraction (closes #7764) 2015-12-13 15:43:20 +08:00
Yen Chi Hsuan deb1e8d20e [youku] Put the missing item to get_hd 2015-12-12 15:49:19 +08:00
Yen Chi Hsuan 174964a7bc Credit @Celthi for fixing Youku extractor 2015-12-12 15:34:40 +08:00
Yen Chi Hsuan 9c568178fb Merge branch 'Celthi-youku_bugfix' 2015-12-12 15:26:43 +08:00
Yen Chi Hsuan dbb7d7e26c [youku] Reorder format items 2015-12-12 15:24:58 +08:00
Yen Chi Hsuan ade2340971 [youku] Simplify 2015-12-12 15:19:14 +08:00
Yen Chi Hsuan 4d77550cf0 [youku] Fix tests 2015-12-12 14:57:14 +08:00
Yen Chi Hsuan c683454e7e [youku] MD5 is unstable 2015-12-12 14:48:46 +08:00
Yen Chi Hsuan f133fd326b [youku] Cleanup and PEP8 2015-12-12 14:41:53 +08:00
Yen Chi Hsuan 1faa66f005 Merge branch 'youku_bugfix' of https://github.com/Celthi/youtube-dl into Celthi-youku_bugfix 2015-12-12 14:36:29 +08:00
Yen Chi Hsuan 8773f3158f [safari] Use postdata_urlencode (#7465) 2015-12-12 14:28:05 +08:00
Yen Chi Hsuan b6afc225c8 [vevo] Use _download_smil to provide informative error messages 2015-12-11 19:16:51 +08:00
Yen Chi Hsuan ad30dc1e20 [vevo] Allow calling API without https 
Not all proxies allow CONNECT
 2015-12-11 19:07:13 +08:00
Yen Chi Hsuan ff51983e15 [vevo] Handle videos without video_info (#7802) 2015-12-11 18:52:03 +08:00
Yen Chi Hsuan 4b94288301 [vevo] Use _match_id 2015-12-11 17:32:29 +08:00
Yen Chi Hsuan 4bf99ade15 [vevo] Catch the georestriction message (#7802) 2015-12-11 14:25:01 +08:00
Yen Chi Hsuan 8364b6b0b1 [iqiyi] Update key 
Closes #7772
 2015-12-06 16:41:02 +08:00
Yen Chi Hsuan 38d05d17e5 [fc2] Fix test_FC2_1 2015-12-05 21:10:26 +08:00
Yen Chi Hsuan db9bd5267f [keezmovies] Fix extraction 
Also fixes #7752
 2015-12-05 17:26:13 +08:00
Yen Chi Hsuan 0bc4ee60e0 [bbc] Fix test_BBC_6 2015-12-05 16:55:53 +08:00
Yen Chi Hsuan a3ef0e1cdd [bbc.co.uk] Skip removed test video 2015-12-05 16:55:53 +08:00
Yen Chi Hsuan 679bacf0b5 [bbc.co.uk] Fix test_BBCCoUk 
This is similar to the one in #7756, So also fixes #7756.
 2015-12-05 16:55:53 +08:00
Yen Chi Hsuan 64b7e89c0c [srf] Support audios (closes #7760) 2015-12-05 16:26:30 +08:00
Yen Chi Hsuan 049d71d874 [youtube] Simplify and make sure header values are strings 2015-11-29 19:52:48 +08:00
Yen Chi Hsuan ef428960c9 Merge pull request #7691 from ryandesign/use-PYTHON-env-var 
Always use PYTHON env var in Makefile
 2015-11-29 13:08:46 +08:00
Yen Chi Hsuan 992fc9d6e1 [utils] Refactor handle_youtubedl_headers for future extension 2015-11-29 12:58:29 +08:00
Yen Chi Hsuan 0424ec307b [utils] Correct docstring of YoutubeDLHandler 2015-11-29 12:46:04 +08:00
Yen Chi Hsuan ac5a69af45 [youtube] Disable compression for live streams 2015-11-29 12:44:24 +08:00
Yen Chi Hsuan 94e8c80473 [downloader/hls] Respect Youtubedl-* headers 2015-11-29 12:43:59 +08:00
Yen Chi Hsuan 87f0e62d94 [utils] Separate codes for handling Youtubedl-* headers 2015-11-29 12:42:50 +08:00
Yen Chi Hsuan 4b3fbafdd2 [options] Changed wording for --list-formats 
As proposed by @dstftw at 9bff48a0e7
 2015-11-28 14:14:20 +08:00
Yen Chi Hsuan 9d0e366880 [downloader/hls] Remove Accept-encoding from headers passed to ffmpeg 
Fails for Youtube Gaming live streams (#7671)
 2015-11-27 21:37:45 +08:00
Yen Chi Hsuan 9bff48a0e7 [options] Clarify --list-formats needs videos (closes #7669) 2015-11-27 21:24:39 +08:00
Yen Chi Hsuan 750b9ff032 [generic] Extract M3U8 formats (closes #7582) 2015-11-21 16:43:01 +08:00
Yen Chi Hsuan 28602e747c [generic] Refactor 2015-11-21 16:08:54 +08:00
Yen Chi Hsuan 6cc37c69e2 [generic] Unescape URLs from JWPlayer (#7582) 2015-11-21 14:12:34 +08:00
Yen Chi Hsuan c39fd7b1ca [UDNEmbed] Fix generic UDN pages 
Closes #7547
 2015-11-19 22:32:56 +08:00
Yen Chi Hsuan 9d584da7d0 [xfileshare] Correct _VALID_URL 2015-11-14 17:27:32 +08:00
Yen Chi Hsuan 31752f76f7 [twitter:card] Add add_ie for the external test 2015-11-14 17:03:26 +08:00
Yen Chi Hsuan 5f1b2aea80 [twitter:card] Support vine.co embeds (closes #7496) 2015-11-14 17:02:07 +08:00
Yen Chi Hsuan cf5881fc4d Credit @ferama 
For providing idea for vidto.me (#7167) and extending nowvideo support (#6760)
 2015-11-12 21:33:46 +08:00
Yen Chi Hsuan a4c2ab35c1 Merge remote-tracking branch 'upstream/master' 2015-11-12 00:08:42 +08:00
Yen Chi Hsuan 8b8a39e279 [vidto] Several simplifications and improvements 
1. Use InfoExtractor._hidden_inputs
2. Fetch title from <title> tag
3. Cookies are preserved automatically
4. Use single quotes everywhere
5. Do not declare variables for one-time use only
 2015-11-11 23:17:59 +08:00
Yen Chi Hsuan 6abce58a12 Credit @sieben for fixing wsj extractor 2015-11-11 20:16:18 +08:00
Yen Chi Hsuan 990e6e8fa3 [vidto] Minor fixes 
1. import order
2. fatal is already True in helper functions
 2015-11-11 20:13:03 +08:00
Yen Chi Hsuan bfd88516eb Merge pull request #7454 from sieben/duplicate_keys 
Remove duplicate key
 2015-11-11 20:00:13 +08:00
Yen Chi Hsuan 37120974dc [vidto] PEP8 2015-11-11 02:02:46 +08:00
Yen Chi Hsuan 50f84a9ae1 [youtube] Support new base.js html5 player 2015-11-10 12:55:01 +08:00
Yen Chi Hsuan ff29bf81f8 [jsinterp] Support alternative function definition form 2015-11-10 12:54:02 +08:00
Yen Chi Hsuan 123c781044 Merge pull request #7382 from remitamine/miomio 
[miomio] fix info extraction (fixes #7366)
 2015-11-06 14:50:39 +08:00
Yen Chi Hsuan 236cb2131b Merge remote-tracking branch 'upstream/master' 2015-11-04 00:54:27 +08:00
Yen Chi Hsuan 66d041f250 [test/subtitles] Add test for DemocracynowIE 2015-11-04 00:53:30 +08:00
Yen Chi Hsuan f3cb54e6d9 Merge branch 'atomicdryad-pr-democracynow' 2015-11-04 00:45:18 +08:00
Yen Chi Hsuan 0aeb9a106e [democracynow] Prevent required fields to be None 2015-11-04 00:13:00 +08:00
Yen Chi Hsuan fd8102820c [democracynow] Rename js to json_data 2015-11-04 00:09:55 +08:00
Yen Chi Hsuan fc68d52bb9 [democracynow] Add MD5 sums 2015-11-03 21:24:10 +08:00
Yen Chi Hsuan dde9fe9788 [democracynow] Simplify 2015-11-03 21:16:42 +08:00
Yen Chi Hsuan 78d7ee19dc [democracynow] Fix _TESTS 2015-10-31 22:21:52 +08:00
Yen Chi Hsuan 33a513faf7 Merge branch 'pr-democracynow' of https://github.com/atomicdryad/youtube-dl into atomicdryad-pr-democracynow 2015-10-31 22:06:05 +08:00
Yen Chi Hsuan a65402ef42 [bbc.co.uk:article] Add new extractor (#7257) 2015-10-22 21:13:03 +08:00
Yen Chi Hsuan 7033bc1a51 [bbc] Fix test_BBC_9 2015-10-22 21:12:29 +08:00
Yen Chi Hsuan 89d5fbf354 [iqiyi] Update key 2015-10-22 17:47:11 +08:00
Yen Chi Hsuan 4285a47f40 Merge pull request #7208 from yan12125/letv-fix 
[Letv] Fix extraction
 2015-10-18 22:32:10 +08:00
Yen Chi Hsuan 05a3879f1c [letv] Update M3U8's MIME type 
The new MIME type appears in the following places:
https://www.iana.org/assignments/media-types/media-types.xhtml#application
https://hg.python.org/cpython/file/tip/Lib/mimetypes.py
 2015-10-18 19:19:46 +08:00
Yen Chi Hsuan 4a7b790384 [twitter:card] Support YouTube embeds 2015-10-18 19:07:37 +08:00
Yen Chi Hsuan 09ff81316e Merge branch 'atomicdryad-pr-twitter' 2015-10-18 18:44:21 +08:00
Yen Chi Hsuan c88aec845a [twitter] Fix short URL extraction 2015-10-18 18:23:56 +08:00
Yen Chi Hsuan 77a54b6a65 [twitter:card] Use _html_search_regex 2015-10-18 18:08:24 +08:00
Yen Chi Hsuan 575036b405 [twitter] Simplify and improve 2015-10-18 18:04:13 +08:00
Yen Chi Hsuan f6dfd6603a [twitter] Use _html_search_regex 2015-10-18 17:18:01 +08:00
Yen Chi Hsuan e04edad621 [twitter] Inherit from InfoExtractor directly 2015-10-18 17:16:57 +08:00
Yen Chi Hsuan f322bfb063 [twitter:card] Remove unneeded 'ext' 2015-10-18 17:15:47 +08:00
Yen Chi Hsuan 014e880372 [twitter] Add IE_NAMEs 2015-10-18 17:13:58 +08:00
Yen Chi Hsuan 01d22d4703 [twitter] Use _download_xml 2015-10-18 17:11:55 +08:00
Yen Chi Hsuan 48aae2d2cf [twitter] Update tests 2015-10-18 17:07:48 +08:00
Yen Chi Hsuan c571dea953 Merge branch 'pr-twitter' of https://github.com/atomicdryad/youtube-dl into atomicdryad-pr-twitter 2015-10-18 16:49:56 +08:00
Yen Chi Hsuan 8b172c2e10 [YoutubeDL] Use DataHandler 2015-10-18 13:44:22 +08:00
Yen Chi Hsuan 0a67a3632b [compat] Add compat_urllib_request_DataHandler 2015-10-18 13:44:21 +08:00
Yen Chi Hsuan 985e4fdc07 [downloader/hls] Add headers only for http(s) URLs 
ffmpeg 2.8.1 raises an error with -headers and non-http input files.
 2015-10-18 13:44:21 +08:00