k4rli/youtube-dl
1
0
Fork 0
Code Issues Pull Requests Actions Packages Projects Releases Wiki Activity
15,169 Commits 1 Branch 0 Tags
85f5a74b6cf44b0c8b612c264c36eaabd958f501
Commit Graph
100 Commits
This Branch
This Branch
All Branches
Author SHA1 Message Date
Yen Chi Hsuan 85f5a74b6c [tbs] Mark as broken and skip invalid tests 2017-07-20 21:19:09 +08:00
Yen Chi Hsuan d20b1c6725 [dispeak] Recognize sevt subdomain (closes #13276) 2017-07-20 18:14:14 +08:00
Yen Chi Hsuan 3615bfe1b4 [twitter] Fix remaining tests 2017-07-11 16:46:37 +08:00
Yen Chi Hsuan e8f20ffa03 [vine] Make sure the title won't be empty 
And fix a relevant TwitterCard test case
 2017-07-11 16:05:15 +08:00
Yen Chi Hsuan 9be31e771c [twitter] Support HLS streams in vmap URLs 2017-07-11 15:48:48 +08:00
Yen Chi Hsuan 7f176ac477 [periscope] Support pscp.tv URLs in embedded frames 
And fix a relevant twitter test
 2017-07-11 15:35:19 +08:00
Yen Chi Hsuan 2edfd745df [twitter] Extract mp4 urls via mobile API (closes #12726) 2017-07-11 15:19:36 +08:00
Yen Chi Hsuan 708f6f511e [niconico] Fix authentication error handling (closes #12486) 2017-07-11 15:04:45 +08:00
Yen Chi Hsuan bb13949197 [niconico] Check login errors (#12486) 2017-07-11 15:03:11 +08:00
Yen Chi Hsuan c3c94ca4a4 [giantbomb] Extract m3u8 formats (closes #13626) 2017-07-10 21:34:27 +08:00
Yen Chi Hsuan eadd313321 [yam] Remove extractor 
mymedia.yam.com is dead. An wikipedia user also pointed out that Yam's
blog service is no longer available. [1]

[1] https://zh.wikipedia.org/zh-tw/%E5%A4%A9%E7%A9%BA%E9%83%A8%E8%90%BD
 2017-07-08 15:48:05 +08:00
Yen Chi Hsuan babbc04d45 [xuite] Move to the new HTML5 API and reduce # of requests 2017-07-05 23:27:12 +08:00
Yen Chi Hsuan 609ff8ca19 [utils] Support attributes with no values in get_elements_by_attribute() 2017-07-05 23:27:12 +08:00
Yen Chi Hsuan 136503e302 [ChangeLog] Update after #13494 2017-06-26 19:56:07 +08:00
Yen Chi Hsuan cc2ffe5afe [pandora.tv] Fix upload_date extraction (closes #12846) 2017-06-19 16:20:36 +08:00
Yen Chi Hsuan 473e87064b [devscripts/prepare_manpage] Fix deprecated escape sequence on py36 2017-06-17 17:37:25 +08:00
Yen Chi Hsuan 4f90d2aeac [Makefile] Excluding __pycache__ correctly (#13400) 2017-06-17 17:09:24 +08:00
Yen Chi Hsuan 6a9cb29509 [extractor/common] Fix json dumping with --geo-bypass 
The line "[debug] Using fake IP %s (%s) as X-Forwarded-For." was printed
to stdout even with -j/-J, which breaks the resultant JSON.
 2017-06-15 13:04:36 +08:00
Yen Chi Hsuan ca27037171 [bilibili] Fix extraction of videos with double quotes in titles 
Closes #13387
 2017-06-15 11:19:03 +08:00
Yen Chi Hsuan d10d0e3cf8 [README.md] Add an example for how to use .netrc on Windows 
That's a Python bug: http://bugs.python.org/issue28334
Most likely it will be fixed in Python 3.7: https://github.com/python/cpython/pull/123
 2017-05-29 14:58:07 +08:00
Yen Chi Hsuan a49eccdfa7 [youtube] Parse player_url if format URLs are encrypted or DASH MPDs are requested 
Fixes #13211
 2017-05-28 20:20:20 +08:00
Yen Chi Hsuan b407d8533d [utils] Drop an compatibility wrapper for Python < 2.6 
addinfourl.getcode is added since Python 2.6a1. As youtube-dl now
requires 2.6+, this is no longer necessary.

See https://github.com/python/cpython/commit/9b0d46db115c10767b240a0a64286214b50fe6ad
 2017-05-27 23:05:02 +08:00
Yen Chi Hsuan d16c0121b9 [youku] Extract more metadata (closes #10433) 2017-05-27 00:08:37 +08:00
Yen Chi Hsuan 98a0618941 [ChangeLog] Update after the fix for #11381 2017-05-26 23:22:54 +08:00
Yen Chi Hsuan fd545fc6d1 Revert "[youtube] Don't use the DASH manifest from 'get_video_info' if 'use_cipher_signature' is True (#5118)" 
This reverts commit 87dc451108.
 2017-05-26 23:22:54 +08:00
Yen Chi Hsuan c130f0a37b [tudou] Merge into youku extractor (fixes #12214) 
Also, there are no tudou playlists anymore. All playlist URLs points to youku
playlists.
 2017-05-26 23:04:42 +08:00
Yen Chi Hsuan d3d4ba7f24 [youku:show] Fix extraction 2017-05-26 21:59:16 +08:00
Yen Chi Hsuan 5552c9eb0f [utils] Recognize more patterns in strip_jsonp() 
Used in Youku Show pages
 2017-05-26 21:58:18 +08:00
Yen Chi Hsuan 59ed87cbd9 [youku] Fix extraction (closes #13191) 2017-05-26 19:16:52 +08:00
Yen Chi Hsuan 5192ee17e7 [postprocessor/ffmpeg] Fix metadata filename handling on Python 2 
Fixes #13182
 2017-05-25 22:07:03 +08:00
Yen Chi Hsuan 116283ff64 [liveleak] Fix extraction (#12053) 2017-05-12 19:15:33 +08:00
Yen Chi Hsuan 7274f3d0e9 [douyu] Support Douyu shows (closes #12228) 2017-05-12 18:44:24 +08:00
Yen Chi Hsuan 10c87c151b [utils] Rename try_multipart_encode to _multipart_encode_impl 
To state that this is an internal function and people should be careful
when using it outside youtube-dl.
 2017-05-06 19:06:18 +08:00
Yen Chi Hsuan 228cd9bb90 [bilibili] Fix video downloading (closes #13001) 2017-05-06 18:58:38 +08:00
Yen Chi Hsuan b2ad479d17 [utils] Fix multipart_encode for Python < 3.5 2017-05-05 20:51:59 +08:00
Yen Chi Hsuan 4ac6dc3732 [vice] Support Vice articles (closes #12968) 2017-05-05 20:26:51 +08:00
Yen Chi Hsuan cc7bda4fff [vice] Fix extraction for non en_us videos (closes #12967) 2017-05-05 20:01:02 +08:00
Yen Chi Hsuan 50ad078b7b [gdcvault] Fix extraction for videos with gdc-player.html 
Closes #12733
 2017-05-05 15:13:40 +08:00
Yen Chi Hsuan 0c26548601 [cda] Implement birthday verification (closes #12789) 2017-05-04 16:26:17 +08:00
Yen Chi Hsuan 5401bea27f [leeco] Fix extraction (closes #12974) 
Seems on mobile devices a similar API is used, but I always get an AD
with mimicking that API.
 2017-05-04 03:18:56 +08:00
Yen Chi Hsuan ba5c3caf88 [washingtonpost] Fix invalid escape sequence on Python 3.6 2017-04-30 02:15:28 +08:00
Yen Chi HsuanandGitHub 27e70a8f6c Merge pull request #12869 from Tithen-Firion/cbc-update-tests 
[cbc] update test cases
 2017-04-29 21:34:18 +08:00
Yen Chi HsuanandGitHub a1ebfd4494 Merge pull request #12854 from Tithen-Firion/appletrailer-test-fix 
[appletrailers] update test cases
 2017-04-29 19:24:38 +08:00
Yen Chi HsuanandGitHub d19093bd50 Merge pull request #12906 from Tithen-Firion/clean-html-fix 
[utils] Fix inconsistent output of clean_html
 2017-04-29 15:58:45 +08:00
Yen Chi Hsuan 24eb7c2578 [xtube] Fix extraction with non-standard JSON 'sources' 
Closes #12734

Thanks @paulguy for the fix!
 2017-04-29 15:55:08 +08:00
Yen Chi Hsuan b62985a9a5 [youtube] Recognize another HTML5 player URL (#12885) 2017-04-28 16:25:04 +08:00
Yen Chi Hsuan e31fed95b4 [youtube] Recognize new locale-based player URLs (fixes #12885) 2017-04-28 15:48:30 +08:00
Yen Chi Hsuan 9f54ae2873 Ignore and clean *.ytdl files 2017-04-25 22:42:55 +08:00
Yen Chi Hsuan 01cb57016f [iqiyi] Fix extraction of Yule videos 2017-04-25 22:23:57 +08:00
Yen Chi Hsuan fbf56be213 [iqiyi] Fix playlist detection (#12504) 2017-04-22 22:11:37 +08:00
Yen Chi Hsuan 54f54fcca7 [socks] Report errors elegantly when credentails are required but missing 
In some non-standard implementations, the server may respond AUTH_USER_PASS
even if's not listed in available authentication methods. (it should
respond AUTH_NO_ACCEPTABLE per standards)
 2017-04-22 21:48:41 +08:00
Yen Chi Hsuan facfd79f9a [azubu] Remove extractor as the site is gone (closes #12813) 2017-04-22 21:20:25 +08:00
Yen Chi Hsuan 3110bb937d [porn91] Fix extraction (closes #12814) 2017-04-22 21:16:36 +08:00
Yen Chi Hsuan 06d0ad9a4e [brightcove] Support URLs with bcpid instead of playerID 
Fixes #12482
 2017-04-18 23:04:22 +08:00
Yen Chi Hsuan 34d98cc411 [tv2hu] Fix invalid escape sequence on Py3.6 2017-04-13 16:52:52 +08:00
Yen Chi Hsuan 4c03973296 [airmozilla] Fix extraction (closes #12670) 2017-04-08 15:39:58 +08:00
Yen Chi Hsuan f7923a4c39 [ChangeLog] Update after #12307 2017-03-26 22:07:12 +08:00
Yen Chi HsuanandGitHub cc63259d18 Merge pull request #12307 from rndusr/fix/str-item-assignment 
Fix "'str' object does not support item assignment"
 2017-03-26 21:51:09 +08:00
Yen Chi Hsuan 51ef4919df [afreecatv] Fix extraction (closes #12179) 2017-03-26 01:32:07 +08:00
Yen Chi Hsuan 68220649fa [ChangeLog] Update after #12099 2017-03-19 20:42:17 +08:00
Yen Chi Hsuan ea883a687c [openload] Fix extraction (closes #10408) 
Thanks to @makgun02

Ref: http://pastebin.com/raw/JX9gHFUz
 2017-03-17 15:22:34 +08:00
Yen Chi Hsuan 4605c94d1a [__init__] Fix missing subtitles if --add-metadata is used (#12423) 
The previous fix for #5594 is incorrect
 2017-03-11 19:37:45 +08:00
Yen Chi Hsuan 0f6b87d067 [miomio] Fix extraction 
Closes #12291
Closes #12388
Closes #12402
 2017-03-08 19:46:58 +08:00
Yen Chi Hsuan fe646a2f10 [twitch] PEP8 2017-03-07 15:34:06 +08:00
Yen Chi Hsuan 54a3a8827b [__init__] Metadata should be added after conversion 
Fixes #5594
 2017-03-06 18:09:12 +08:00
Yen Chi Hsuan 92cb5763f4 [ChangeLog] Update after #12357 2017-03-06 18:04:19 +08:00
Yen Chi Hsuan d2b64e04b4 [addanime] Skip an invalid test 2017-03-06 00:35:04 +08:00
Yen Chi Hsuan 6f4e4132d8 [douyutv] Switch to the PC API to escape the 5-min limitation 
Thanks @spacemeowx2 for the algo.

Ref: https://gist.github.com/spacemeowx2/629b1d131bd7e240a7d28742048e80fc

Closes #12316
 2017-03-04 23:23:18 +08:00
Yen Chi Hsuan 11bb6ad1a5 [facebook] Fix extraction (closes #12323) 
Almost all videos now use the pagelet type 'permalink_video_pagelet'
 2017-03-02 20:51:24 +08:00
Yen Chi Hsuan c9612c0487 [youtube] Mark errors about rental videos as expected 
Closes #12324
 2017-03-02 16:59:53 +08:00
Yen Chi Hsuan af5049f128 [adobepass] Add Charter Spectrum (#11465) 
Thanks @tv21 for the fix!
 2017-03-02 02:15:51 +08:00
Yen Chi Hsuan 7c4aa6fd6f [daisuki] Add subtitles (#4738) 2017-02-28 22:29:01 +08:00
Yen Chi Hsuan 9bd05b5a18 [daisuki] Add new extractor (closes #4738) 2017-02-28 22:19:26 +08:00
Yen Chi Hsuan 0a5445ddbe [utils] Add bytes_to_long() and long_to_bytes() 
Used in daisuki.net (#4738)

Both are adapted from public domain PyCrypto:
https://github.com/dlitz/pycrypto/blob/master/lib/Crypto/Util/number.py
 2017-02-28 22:10:31 +08:00
Yen Chi Hsuan f48409c7ac [utils] Add pkcs1pad 
Used in daisuki.net (#4738)
 2017-02-28 22:10:31 +08:00
Yen Chi Hsuan c9619f0a17 [aes] Add aes_cbc_encrypt 
Used in daisuki.net (#4738)
 2017-02-28 22:10:31 +08:00
Yen Chi Hsuan f4c68ba372 [douyu] Fix extraction and update _TESTS 
They've switched from flv to hls

Closes #12301
 2017-02-28 21:41:03 +08:00
Yen Chi Hsuan 892b47ab6c [scivee] Remove extractor (#9315) 
The Wikipedia page is changed from active to down:
https://en.wikipedia.org/w/index.php?title=SciVee&diff=prev&oldid=723161154

Some other interesting bits:

$ nslookup www.scivee.tv
Server:         8.8.8.8
Address:        8.8.8.8#53

Non-authoritative answer:
www.scivee.tv   canonical name = scivee.rcsb.org.
Name:   scivee.rcsb.org
Address: 132.249.231.211

$ nslookup rcsb.org
Server:         8.8.8.8
Address:        8.8.8.8#53

Non-authoritative answer:
Name:   rcsb.org
Address: 132.249.231.77

Both IPs are from UCSD. I guess it's maintained by a lab and they don't
maintain it anymore.
 2017-02-27 21:34:33 +08:00
Yen Chi Hsuan a5cf17989b [MDR] Relax _VALID_URL and playerURL matching and update _TESTS 
Ref: #12169
 2017-02-26 17:24:54 +08:00
Yen Chi Hsuan 9d0c08a02c [vevo] Fix videos with the new streams/streamsV3 format (closes #11719) 2017-02-26 00:15:49 +08:00
Yen Chi Hsuan db182c63fb [njpwworld] Add new extractor (closes #11561) 2017-02-25 18:44:39 +08:00
Yen Chi Hsuan eeb0a95684 [extractor/common] Add 'preference' to _parse_html5_media_entries 
Some websites, like NJPWorld, put different qualities on different
player pages.
 2017-02-25 18:40:05 +08:00
Yen Chi Hsuan b5869560a4 [crunchyroll] Fix descriptions with double quotes (closes #12124) 2017-02-23 00:08:45 +08:00
Yen Chi Hsuan 8936f68a0b [travis] Run tests in parallel 
[test_download] Print test names in case of network errors

[test_download] Add comments for nose parameters

[test_download] Modify outtmpl to prevent info JSON filename conflicts

Thanks @jaimeMF for the idea.

[travis] Only download tests should be run in parallel
 2017-02-19 21:26:35 +08:00
Yen Chi Hsuan fef51645d6 [theplatform] Recognize URLs with whitespaces (closes #12044) 2017-02-17 23:13:51 +08:00
Yen Chi Hsuan a4a554a793 [generic] Try parsing JWPlayer embedded videos (closes #12030) 2017-02-16 23:44:03 +08:00
Yen Chi Hsuan f8514630db [einthusan] Fix extraction (closes #11416) 
The old test URLs are no longer valid, so I replace them with the one
from #11416
 2017-02-12 20:53:55 +08:00
Yen Chi Hsuan 8d38dafbbf ChangeLog: update after #12085 2017-02-12 00:45:37 +08:00
Yen Chi HsuanandGitHub f3915452de Merge pull request #12085 from wiiaboo/python2 
utils.py: Workaround TypeError with Python 2.7.13 in Windows
 2017-02-12 00:42:43 +08:00
Yen Chi Hsuan 68c22c4c15 [iqiyi] Update _TESTS 2017-02-11 22:27:45 +08:00
Yen Chi Hsuan 815482d4eb Credit @motophil for gaskrank.py (#11685) 2017-02-06 00:38:22 +08:00
Yen Chi Hsuan 9c14fe9681 [gaskrank] Minor change and update ChangeLog after #11685 2017-02-06 00:25:28 +08:00
Yen Chi Hsuan 019f4c0371 [bandcamp] Fix extraction for incomplete albums 
Closes #11727
 2017-02-05 22:47:04 +08:00
Yen Chi Hsuan 2ab2c0d1f5 [iwara] Add width (closes #11724) 
The heuristic is from #11724
 2017-02-05 22:30:13 +08:00
Yen Chi Hsuan caf0f5f8b7 [iwara] Fix extraction (closes #11781) 2017-02-05 21:48:13 +08:00
Yen Chi Hsuan e4e50f60b1 [googledrive] Fix extraction on Python 3.6 
Since Python 3.6, invalid escape sequences are deprecated. It's likely
that there are invalid escape sequences somewhere on the webpage, so
instead of unescaping the whole webpage, just unescape the URL.

See https://bugs.python.org/issue27364. That change was designed for
string literals, while it affects the 'unicode_escape' encoding as well.
The code path is:

str.decode('unicode_escape')
    codecs.unicode_escape_decode()
        PyUnicode_DecodeUnicodeEscape()
 2017-02-05 21:41:08 +08:00
Yen Chi Hsuan daac118bf4 [ChangeLog] Update after #11901 2017-02-03 18:56:40 +08:00
Yen Chi HsuanandGitHub 8939f784d9 Merge pull request #11901 from ThomasChr/randonplaylistorder 
New parameter --playlist-random to randomize playlist download order. Fixes #11889
 2017-02-03 18:53:14 +08:00
Yen Chi Hsuan d7f9242e30 [ChangeLog] Update after #11565 2017-02-03 12:13:24 +08:00
Yen Chi Hsuan a22b2fd19b [youtube] Fix ytsearch* when cookies are provided 
Closes #11924

The API with `page` is no longer used in browsers, and YouTube always
returns {'reload': 'now'} when cookies are provided.

See http://youtube.github.io/spfjs/documentation/start/ for how SPF
works. Basically appending static link with a `spf` parameter yields the
corresponding dynamic link.
 2017-02-03 01:28:24 +08:00