k4rli/youtube-dl
1
0
Fork 0
Code Issues Pull Requests Actions Packages Projects Releases Wiki Activity
14,789 Commits 1 Branch 0 Tags
24eb7c257807aceef713f6d01824cf600a9d6232
Commit Graph
100 Commits
This Branch
This Branch
All Branches
Author SHA1 Message Date
Yen Chi Hsuan 24eb7c2578 [xtube] Fix extraction with non-standard JSON 'sources' 
Closes #12734

Thanks @paulguy for the fix!
 2017-04-29 15:55:08 +08:00
Yen Chi Hsuan b62985a9a5 [youtube] Recognize another HTML5 player URL (#12885) 2017-04-28 16:25:04 +08:00
Yen Chi Hsuan e31fed95b4 [youtube] Recognize new locale-based player URLs (fixes #12885) 2017-04-28 15:48:30 +08:00
Yen Chi Hsuan 9f54ae2873 Ignore and clean *.ytdl files 2017-04-25 22:42:55 +08:00
Yen Chi Hsuan 01cb57016f [iqiyi] Fix extraction of Yule videos 2017-04-25 22:23:57 +08:00
Yen Chi Hsuan fbf56be213 [iqiyi] Fix playlist detection (#12504) 2017-04-22 22:11:37 +08:00
Yen Chi Hsuan 54f54fcca7 [socks] Report errors elegantly when credentails are required but missing 
In some non-standard implementations, the server may respond AUTH_USER_PASS
even if's not listed in available authentication methods. (it should
respond AUTH_NO_ACCEPTABLE per standards)
 2017-04-22 21:48:41 +08:00
Yen Chi Hsuan facfd79f9a [azubu] Remove extractor as the site is gone (closes #12813) 2017-04-22 21:20:25 +08:00
Yen Chi Hsuan 3110bb937d [porn91] Fix extraction (closes #12814) 2017-04-22 21:16:36 +08:00
Yen Chi Hsuan 06d0ad9a4e [brightcove] Support URLs with bcpid instead of playerID 
Fixes #12482
 2017-04-18 23:04:22 +08:00
Yen Chi Hsuan 34d98cc411 [tv2hu] Fix invalid escape sequence on Py3.6 2017-04-13 16:52:52 +08:00
Yen Chi Hsuan 4c03973296 [airmozilla] Fix extraction (closes #12670) 2017-04-08 15:39:58 +08:00
Yen Chi Hsuan f7923a4c39 [ChangeLog] Update after #12307 2017-03-26 22:07:12 +08:00
Yen Chi HsuanandGitHub cc63259d18 Merge pull request #12307 from rndusr/fix/str-item-assignment 
Fix "'str' object does not support item assignment"
 2017-03-26 21:51:09 +08:00
Yen Chi Hsuan 51ef4919df [afreecatv] Fix extraction (closes #12179) 2017-03-26 01:32:07 +08:00
Yen Chi Hsuan 68220649fa [ChangeLog] Update after #12099 2017-03-19 20:42:17 +08:00
Yen Chi Hsuan ea883a687c [openload] Fix extraction (closes #10408) 
Thanks to @makgun02

Ref: http://pastebin.com/raw/JX9gHFUz
 2017-03-17 15:22:34 +08:00
Yen Chi Hsuan 4605c94d1a [__init__] Fix missing subtitles if --add-metadata is used (#12423) 
The previous fix for #5594 is incorrect
 2017-03-11 19:37:45 +08:00
Yen Chi Hsuan 0f6b87d067 [miomio] Fix extraction 
Closes #12291
Closes #12388
Closes #12402
 2017-03-08 19:46:58 +08:00
Yen Chi Hsuan fe646a2f10 [twitch] PEP8 2017-03-07 15:34:06 +08:00
Yen Chi Hsuan 54a3a8827b [__init__] Metadata should be added after conversion 
Fixes #5594
 2017-03-06 18:09:12 +08:00
Yen Chi Hsuan 92cb5763f4 [ChangeLog] Update after #12357 2017-03-06 18:04:19 +08:00
Yen Chi Hsuan d2b64e04b4 [addanime] Skip an invalid test 2017-03-06 00:35:04 +08:00
Yen Chi Hsuan 6f4e4132d8 [douyutv] Switch to the PC API to escape the 5-min limitation 
Thanks @spacemeowx2 for the algo.

Ref: https://gist.github.com/spacemeowx2/629b1d131bd7e240a7d28742048e80fc

Closes #12316
 2017-03-04 23:23:18 +08:00
Yen Chi Hsuan 11bb6ad1a5 [facebook] Fix extraction (closes #12323) 
Almost all videos now use the pagelet type 'permalink_video_pagelet'
 2017-03-02 20:51:24 +08:00
Yen Chi Hsuan c9612c0487 [youtube] Mark errors about rental videos as expected 
Closes #12324
 2017-03-02 16:59:53 +08:00
Yen Chi Hsuan af5049f128 [adobepass] Add Charter Spectrum (#11465) 
Thanks @tv21 for the fix!
 2017-03-02 02:15:51 +08:00
Yen Chi Hsuan 7c4aa6fd6f [daisuki] Add subtitles (#4738) 2017-02-28 22:29:01 +08:00
Yen Chi Hsuan 9bd05b5a18 [daisuki] Add new extractor (closes #4738) 2017-02-28 22:19:26 +08:00
Yen Chi Hsuan 0a5445ddbe [utils] Add bytes_to_long() and long_to_bytes() 
Used in daisuki.net (#4738)

Both are adapted from public domain PyCrypto:
https://github.com/dlitz/pycrypto/blob/master/lib/Crypto/Util/number.py
 2017-02-28 22:10:31 +08:00
Yen Chi Hsuan f48409c7ac [utils] Add pkcs1pad 
Used in daisuki.net (#4738)
 2017-02-28 22:10:31 +08:00
Yen Chi Hsuan c9619f0a17 [aes] Add aes_cbc_encrypt 
Used in daisuki.net (#4738)
 2017-02-28 22:10:31 +08:00
Yen Chi Hsuan f4c68ba372 [douyu] Fix extraction and update _TESTS 
They've switched from flv to hls

Closes #12301
 2017-02-28 21:41:03 +08:00
Yen Chi Hsuan 892b47ab6c [scivee] Remove extractor (#9315) 
The Wikipedia page is changed from active to down:
https://en.wikipedia.org/w/index.php?title=SciVee&diff=prev&oldid=723161154

Some other interesting bits:

$ nslookup www.scivee.tv
Server:         8.8.8.8
Address:        8.8.8.8#53

Non-authoritative answer:
www.scivee.tv   canonical name = scivee.rcsb.org.
Name:   scivee.rcsb.org
Address: 132.249.231.211

$ nslookup rcsb.org
Server:         8.8.8.8
Address:        8.8.8.8#53

Non-authoritative answer:
Name:   rcsb.org
Address: 132.249.231.77

Both IPs are from UCSD. I guess it's maintained by a lab and they don't
maintain it anymore.
 2017-02-27 21:34:33 +08:00
Yen Chi Hsuan a5cf17989b [MDR] Relax _VALID_URL and playerURL matching and update _TESTS 
Ref: #12169
 2017-02-26 17:24:54 +08:00
Yen Chi Hsuan 9d0c08a02c [vevo] Fix videos with the new streams/streamsV3 format (closes #11719) 2017-02-26 00:15:49 +08:00
Yen Chi Hsuan db182c63fb [njpwworld] Add new extractor (closes #11561) 2017-02-25 18:44:39 +08:00
Yen Chi Hsuan eeb0a95684 [extractor/common] Add 'preference' to _parse_html5_media_entries 
Some websites, like NJPWorld, put different qualities on different
player pages.
 2017-02-25 18:40:05 +08:00
Yen Chi Hsuan b5869560a4 [crunchyroll] Fix descriptions with double quotes (closes #12124) 2017-02-23 00:08:45 +08:00
Yen Chi Hsuan 8936f68a0b [travis] Run tests in parallel 
[test_download] Print test names in case of network errors

[test_download] Add comments for nose parameters

[test_download] Modify outtmpl to prevent info JSON filename conflicts

Thanks @jaimeMF for the idea.

[travis] Only download tests should be run in parallel
 2017-02-19 21:26:35 +08:00
Yen Chi Hsuan fef51645d6 [theplatform] Recognize URLs with whitespaces (closes #12044) 2017-02-17 23:13:51 +08:00
Yen Chi Hsuan a4a554a793 [generic] Try parsing JWPlayer embedded videos (closes #12030) 2017-02-16 23:44:03 +08:00
Yen Chi Hsuan f8514630db [einthusan] Fix extraction (closes #11416) 
The old test URLs are no longer valid, so I replace them with the one
from #11416
 2017-02-12 20:53:55 +08:00
Yen Chi Hsuan 8d38dafbbf ChangeLog: update after #12085 2017-02-12 00:45:37 +08:00
Yen Chi HsuanandGitHub f3915452de Merge pull request #12085 from wiiaboo/python2 
utils.py: Workaround TypeError with Python 2.7.13 in Windows
 2017-02-12 00:42:43 +08:00
Yen Chi Hsuan 68c22c4c15 [iqiyi] Update _TESTS 2017-02-11 22:27:45 +08:00
Yen Chi Hsuan 815482d4eb Credit @motophil for gaskrank.py (#11685) 2017-02-06 00:38:22 +08:00
Yen Chi Hsuan 9c14fe9681 [gaskrank] Minor change and update ChangeLog after #11685 2017-02-06 00:25:28 +08:00
Yen Chi Hsuan 019f4c0371 [bandcamp] Fix extraction for incomplete albums 
Closes #11727
 2017-02-05 22:47:04 +08:00
Yen Chi Hsuan 2ab2c0d1f5 [iwara] Add width (closes #11724) 
The heuristic is from #11724
 2017-02-05 22:30:13 +08:00
Yen Chi Hsuan caf0f5f8b7 [iwara] Fix extraction (closes #11781) 2017-02-05 21:48:13 +08:00
Yen Chi Hsuan e4e50f60b1 [googledrive] Fix extraction on Python 3.6 
Since Python 3.6, invalid escape sequences are deprecated. It's likely
that there are invalid escape sequences somewhere on the webpage, so
instead of unescaping the whole webpage, just unescape the URL.

See https://bugs.python.org/issue27364. That change was designed for
string literals, while it affects the 'unicode_escape' encoding as well.
The code path is:

str.decode('unicode_escape')
    codecs.unicode_escape_decode()
        PyUnicode_DecodeUnicodeEscape()
 2017-02-05 21:41:08 +08:00
Yen Chi Hsuan daac118bf4 [ChangeLog] Update after #11901 2017-02-03 18:56:40 +08:00
Yen Chi HsuanandGitHub 8939f784d9 Merge pull request #11901 from ThomasChr/randonplaylistorder 
New parameter --playlist-random to randomize playlist download order. Fixes #11889
 2017-02-03 18:53:14 +08:00
Yen Chi Hsuan d7f9242e30 [ChangeLog] Update after #11565 2017-02-03 12:13:24 +08:00
Yen Chi Hsuan a22b2fd19b [youtube] Fix ytsearch* when cookies are provided 
Closes #11924

The API with `page` is no longer used in browsers, and YouTube always
returns {'reload': 'now'} when cookies are provided.

See http://youtube.github.io/spfjs/documentation/start/ for how SPF
works. Basically appending static link with a `spf` parameter yields the
corresponding dynamic link.
 2017-02-03 01:28:24 +08:00
Yen Chi Hsuan bd8f48c78b [bilibili] Support new Bangumi URLs (closes #11845) 
To reduce complexity, I don't support old Bangumi URLs directly via
_VALID_URL. Instead, I choose to let it go to generic redirection. An
example can be found in #10190:

http://bangumi.bilibili.com/anime/v/40062
 2017-02-02 21:51:31 +08:00
Yen Chi Hsuan 000f207944 [prosiebensat1] Update ChangeLog 2017-02-01 23:16:35 +08:00
Yen Chi Hsuan fe5aa197b5 [prosiebensat1] PEP8 and update _TESTS 2017-02-01 23:13:45 +08:00
Yen Chi Hsuan 2b2d5d319b [crunchyroll] Remove ScaledBorderAndShadow settings 
See https://github.com/rg3/youtube-dl/pull/9028, especially @lachs0r's
comments for the reason behind this change
 2017-02-01 16:39:32 +08:00
Yen Chi Hsuan bc35ed3fb6 [nextmedia] Add support for NextTV (壹電視) 2017-01-23 23:38:31 +08:00
Yen Chi Hsuan 0c1c6f4b9f [utils] Add another date format seen in NextTV 2017-01-23 23:37:32 +08:00
Yen Chi Hsuan 7c20b7484c [nextmedia] Support redirected URLs 2017-01-22 02:06:34 +08:00
Yen Chi Hsuan f3c21cb7a7 [cspan] Fix _TESTS 2017-01-20 22:27:13 +08:00
Yen Chi Hsuan 972efe60c3 [generic] Remove a dead test 
The web page does not contain a video anymore

Ref: #2694, #2696
 2017-01-20 22:27:13 +08:00
Yen Chi Hsuan 4447fb2332 [cspan] Support Ustream embedded videos 
Closes #11547
 2017-01-20 22:27:13 +08:00
Yen Chi Hsuan d77ac73790 [ustream] Add UstreamIE._extract_url() 
Ref: #11547
 2017-01-20 22:27:13 +08:00
Yen Chi HsuanandGitHub 1076858f76 Merge pull request #11778 from h4ck3rm1k3/master 
Fix typos
 2017-01-19 19:32:29 +08:00
Yen Chi Hsuan 16e2c8f771 [brightcove] Recognize another player ID 
Closes #11688
 2017-01-16 00:06:52 +08:00
Yen Chi Hsuan dcae7b3fdc [niconico] Allow login via cookies 
Some codes are borrowed from #7968, which is by @jlhg

Closes #7968
 2017-01-15 22:51:54 +08:00
Yen Chi Hsuan 8e4988f1a2 [niconico] Remove codes for downloading anonymously 
Apparently Niconico now blocks playing without an account

Closes #11170
 2017-01-15 22:10:57 +08:00
Yen Chi Hsuan 1219201143 [ChangeLog] Update after #11581 
[ci skip]
 2017-01-06 01:07:30 +08:00
Yen Chi Hsuan ec85ded83c Fix "invalid escape sequences" error on Python 3.6 2017-01-06 00:58:56 +08:00
Yen Chi Hsuan 24d8a75982 [discoverygo] Fix JSON data parsing 
HTMLParser, which is used by extract_attributes, already unescapes
attribute values with HTMLParser.unescape. They shouldn't be unescaped
again, to there may be parsing errors.

Ref: #11219, #11522
 2017-01-05 18:50:34 +08:00
Yen Chi HsuanandGitHub d546d4c8e0 Merge pull request #11578 from rpunkfu/patch-2 
Update Readme: Set HOME properly in install command
 2017-01-02 13:50:26 +08:00
Yen Chi Hsuan 4606c34e19 [extractor/common] Allow non-lang in subtitles' keys 
See 264e77c406
 2016-12-25 01:50:50 +08:00
Yen Chi Hsuan 8ab7e6c4cc [kaltura] Improve widget ID extraction (closes #11480) 2016-12-20 18:45:52 +08:00
Yen Chi Hsuan 5c32a5be95 [openload] Recognize oload.tv URLs (#10408) 2016-12-15 17:51:26 +08:00
Yen Chi Hsuan 30918999f5 [facebook] Recognize .onion URLs (closes #11443) 2016-12-15 01:04:49 +08:00
Yen Chi Hsuan 6c20a0bb99 [openload] Fix extraction (closes #10408) 2016-12-09 02:15:16 +08:00
Yen Chi Hsuan 4bd7d9d4ae [socks] Refine exception model for better error handling 
1. ProxyError now inherits from socket.error instead of IOError

The only functions socks.py overrides are connect and connect_ex. In
Python 2.x and Python <= 3.2, socket functions raises socket.error. In
newer Python versions, those functions raises OSError instead. The name
socket.error is preserved as an alias of OSError for backward
compability. To keep socks.py compatible with Python's standard library,
it should raise the same exception as raw sockets.

See PEP 3151 (https://www.python.org/dev/peps/pep-3151/) for more
information about the change in Python 3.3.

2. Raise EOFError instead of IOError when the socket receives less data
than it expects

There's no common convention, but both ftplib and telnetlib raises
EOFError for similar situations. socks.py follows them.

Closes #11355

In #11355, only Python 2 is affected. In Python 3, both socket.error and
IOError are alias of OSError, so AbstractHTTPHandler.do_open correctly
catches the error and thus InfoExtractor._is_valid_url works fine.
 2016-12-05 00:43:37 +08:00
Yen Chi Hsuan 8344296619 [socks] Fix error reporting (#11355) 2016-12-03 21:53:41 +08:00
Yen Chi Hsuan d17bfe4095 [thisoldhouse] Recognize /tv-episode/ URLs and update _TESTS 
Closes #11271
 2016-12-01 14:56:52 +08:00
Yen Chi Hsuan 51b1378eed Ignore and clean .swf files 
Some videos on NicoNico are swf
 2016-11-27 22:01:07 +08:00
Yen Chi Hsuan 44444f0d3b [cbslocal] Support newyork.cbslocal.com 
Closes #11285
 2016-11-24 20:32:17 +08:00
Yen Chi Hsuan 1d6ae5628f [amcnetworks] Recognize more BBC America URLs 
Closes #11263
 2016-11-22 20:40:57 +08:00
Yen Chi Hsuan 2574721a81 Clean and ignore more file types 
ape is another audio codec seen in kuwo. See
https://en.wikipedia.org/wiki/Monkey's_Audio
 2016-11-21 12:50:13 +08:00
Yen Chi Hsuan dbcc4a6b32 [CONTRIBUTING.md] Fix broken links (#11239) 2016-11-21 12:25:19 +08:00
Yen Chi HsuanandGitHub 0bb58a208b Merge pull request #11239 from josephfrazier/patch-1 
[CONTRIBUTING.md] Fix broken link
 2016-11-21 12:24:11 +08:00
Yen Chi Hsuan 2176e466e0 Merge branch 'DarkstaIkers-master' 2016-11-20 00:07:35 +08:00
Yen Chi Hsuan 303b38fa84 [ChangeLog] Update for #9028 2016-11-20 00:06:44 +08:00
Yen Chi Hsuan fb27d0ce5e Merge branch 'master' of https://github.com/DarkstaIkers/youtube-dl into DarkstaIkers-master 2016-11-20 00:05:11 +08:00
Yen Chi Hsuan 582be35847 Update coding style after pycodestyle 2.1.0 
In pycodestyle 2.1.0, E305 was introduced, which requires two blank
lines after top level declarations, too.

See https://github.com/PyCQA/pycodestyle/issues/400

See also #10689; thanks @stepshal for first mentioning this issue and
initial patches
 2016-11-17 19:45:42 +08:00
Yen Chi HsuanandGitHub 315cb86a95 Merge pull request #11210 from FooBarQuaxx/patch-2 
Strip only args urls
 2016-11-16 23:29:37 +08:00
Yen Chi Hsuan d76767c90e [ChangeLog] Update after #11122 landed 2016-11-16 20:47:15 +08:00
Yen Chi HsuanandGitHub eceba9f805 Merge pull request #11122 from kasper93/openload 
[openload] Fix extraction.
 2016-11-16 20:43:19 +08:00
Yen Chi Hsuan 3eaaa8abac [audioboom] Recognize /posts/ URLs (closes #11149) 2016-11-10 14:52:34 +08:00
Yen Chi Hsuan 5d47b38cf5 [tmz:article] Fix extraction (closes #11052) 2016-11-08 21:53:41 +08:00
Yen Chi Hsuan 3a86b2c51e Ignore and clean .wav files 2016-11-03 18:55:55 +08:00
Yen Chi Hsuan d9ee2e5cf6 [facebook] Remove SWF params so that 1080P are detected 
Closes #11073

In the provided link, SWF params give up to 720P, and VideoConfig
gives 1080P for both best and bestvideo. I guess all Facebook videos
supports HTML5 now, so I remove the old detection for SWF params
 2016-10-30 18:20:55 +08:00