k4rli/youtube-dl
1
0
Fork 0
Code Issues Pull Requests Actions Packages Projects Releases Wiki Activity
15,187 Commits 1 Branch 0 Tags
e3ce912c3d767fcb1a1225d05ac64da1acab94aa
Commit Graph
100 Commits
This Branch
This Branch
All Branches
Author SHA1 Message Date
Yen Chi Hsuan e3ce912c3d [niconico] improve error reporting (#13696) 2017-07-23 16:25:30 +08:00
Yen Chi Hsuan 73095e013f [options] Typo 2017-07-23 16:24:18 +08:00
Yen Chi Hsuan 905d18a7aa [options] Correctly hide login info from debug outputs (#13696) 
Iterate over opts instead of PRIVATE_OPTS for both performance and
correctness
 2017-07-23 16:22:14 +08:00
Yen Chi Hsuan 3fcf346ac1 [youku:show] Refine playlist extraction 
Handle playlists that the initial page is not the first page
 2017-07-20 23:20:46 +08:00
Yen Chi Hsuan fa63cf6c23 [youku:show] Fix playlist extraction (closes #13248) 2017-07-20 22:57:51 +08:00
Yen Chi Hsuan 85f5a74b6c [tbs] Mark as broken and skip invalid tests 2017-07-20 21:19:09 +08:00
Yen Chi Hsuan d20b1c6725 [dispeak] Recognize sevt subdomain (closes #13276) 2017-07-20 18:14:14 +08:00
Yen Chi Hsuan 3615bfe1b4 [twitter] Fix remaining tests 2017-07-11 16:46:37 +08:00
Yen Chi Hsuan e8f20ffa03 [vine] Make sure the title won't be empty 
And fix a relevant TwitterCard test case
 2017-07-11 16:05:15 +08:00
Yen Chi Hsuan 9be31e771c [twitter] Support HLS streams in vmap URLs 2017-07-11 15:48:48 +08:00
Yen Chi Hsuan 7f176ac477 [periscope] Support pscp.tv URLs in embedded frames 
And fix a relevant twitter test
 2017-07-11 15:35:19 +08:00
Yen Chi Hsuan 2edfd745df [twitter] Extract mp4 urls via mobile API (closes #12726) 2017-07-11 15:19:36 +08:00
Yen Chi Hsuan 708f6f511e [niconico] Fix authentication error handling (closes #12486) 2017-07-11 15:04:45 +08:00
Yen Chi Hsuan bb13949197 [niconico] Check login errors (#12486) 2017-07-11 15:03:11 +08:00
Yen Chi Hsuan c3c94ca4a4 [giantbomb] Extract m3u8 formats (closes #13626) 2017-07-10 21:34:27 +08:00
Yen Chi Hsuan eadd313321 [yam] Remove extractor 
mymedia.yam.com is dead. An wikipedia user also pointed out that Yam's
blog service is no longer available. [1]

[1] https://zh.wikipedia.org/zh-tw/%E5%A4%A9%E7%A9%BA%E9%83%A8%E8%90%BD
 2017-07-08 15:48:05 +08:00
Yen Chi Hsuan babbc04d45 [xuite] Move to the new HTML5 API and reduce # of requests 2017-07-05 23:27:12 +08:00
Yen Chi Hsuan 609ff8ca19 [utils] Support attributes with no values in get_elements_by_attribute() 2017-07-05 23:27:12 +08:00
Yen Chi Hsuan 136503e302 [ChangeLog] Update after #13494 2017-06-26 19:56:07 +08:00
Yen Chi Hsuan cc2ffe5afe [pandora.tv] Fix upload_date extraction (closes #12846) 2017-06-19 16:20:36 +08:00
Yen Chi Hsuan 473e87064b [devscripts/prepare_manpage] Fix deprecated escape sequence on py36 2017-06-17 17:37:25 +08:00
Yen Chi Hsuan 4f90d2aeac [Makefile] Excluding __pycache__ correctly (#13400) 2017-06-17 17:09:24 +08:00
Yen Chi Hsuan 6a9cb29509 [extractor/common] Fix json dumping with --geo-bypass 
The line "[debug] Using fake IP %s (%s) as X-Forwarded-For." was printed
to stdout even with -j/-J, which breaks the resultant JSON.
 2017-06-15 13:04:36 +08:00
Yen Chi Hsuan ca27037171 [bilibili] Fix extraction of videos with double quotes in titles 
Closes #13387
 2017-06-15 11:19:03 +08:00
Yen Chi Hsuan d10d0e3cf8 [README.md] Add an example for how to use .netrc on Windows 
That's a Python bug: http://bugs.python.org/issue28334
Most likely it will be fixed in Python 3.7: https://github.com/python/cpython/pull/123
 2017-05-29 14:58:07 +08:00
Yen Chi Hsuan a49eccdfa7 [youtube] Parse player_url if format URLs are encrypted or DASH MPDs are requested 
Fixes #13211
 2017-05-28 20:20:20 +08:00
Yen Chi Hsuan b407d8533d [utils] Drop an compatibility wrapper for Python < 2.6 
addinfourl.getcode is added since Python 2.6a1. As youtube-dl now
requires 2.6+, this is no longer necessary.

See https://github.com/python/cpython/commit/9b0d46db115c10767b240a0a64286214b50fe6ad
 2017-05-27 23:05:02 +08:00
Yen Chi Hsuan d16c0121b9 [youku] Extract more metadata (closes #10433) 2017-05-27 00:08:37 +08:00
Yen Chi Hsuan 98a0618941 [ChangeLog] Update after the fix for #11381 2017-05-26 23:22:54 +08:00
Yen Chi Hsuan fd545fc6d1 Revert "[youtube] Don't use the DASH manifest from 'get_video_info' if 'use_cipher_signature' is True (#5118)" 
This reverts commit 87dc451108.
 2017-05-26 23:22:54 +08:00
Yen Chi Hsuan c130f0a37b [tudou] Merge into youku extractor (fixes #12214) 
Also, there are no tudou playlists anymore. All playlist URLs points to youku
playlists.
 2017-05-26 23:04:42 +08:00
Yen Chi Hsuan d3d4ba7f24 [youku:show] Fix extraction 2017-05-26 21:59:16 +08:00
Yen Chi Hsuan 5552c9eb0f [utils] Recognize more patterns in strip_jsonp() 
Used in Youku Show pages
 2017-05-26 21:58:18 +08:00
Yen Chi Hsuan 59ed87cbd9 [youku] Fix extraction (closes #13191) 2017-05-26 19:16:52 +08:00
Yen Chi Hsuan 5192ee17e7 [postprocessor/ffmpeg] Fix metadata filename handling on Python 2 
Fixes #13182
 2017-05-25 22:07:03 +08:00
Yen Chi Hsuan 116283ff64 [liveleak] Fix extraction (#12053) 2017-05-12 19:15:33 +08:00
Yen Chi Hsuan 7274f3d0e9 [douyu] Support Douyu shows (closes #12228) 2017-05-12 18:44:24 +08:00
Yen Chi Hsuan 10c87c151b [utils] Rename try_multipart_encode to _multipart_encode_impl 
To state that this is an internal function and people should be careful
when using it outside youtube-dl.
 2017-05-06 19:06:18 +08:00
Yen Chi Hsuan 228cd9bb90 [bilibili] Fix video downloading (closes #13001) 2017-05-06 18:58:38 +08:00
Yen Chi Hsuan b2ad479d17 [utils] Fix multipart_encode for Python < 3.5 2017-05-05 20:51:59 +08:00
Yen Chi Hsuan 4ac6dc3732 [vice] Support Vice articles (closes #12968) 2017-05-05 20:26:51 +08:00
Yen Chi Hsuan cc7bda4fff [vice] Fix extraction for non en_us videos (closes #12967) 2017-05-05 20:01:02 +08:00
Yen Chi Hsuan 50ad078b7b [gdcvault] Fix extraction for videos with gdc-player.html 
Closes #12733
 2017-05-05 15:13:40 +08:00
Yen Chi Hsuan 0c26548601 [cda] Implement birthday verification (closes #12789) 2017-05-04 16:26:17 +08:00
Yen Chi Hsuan 5401bea27f [leeco] Fix extraction (closes #12974) 
Seems on mobile devices a similar API is used, but I always get an AD
with mimicking that API.
 2017-05-04 03:18:56 +08:00
Yen Chi Hsuan ba5c3caf88 [washingtonpost] Fix invalid escape sequence on Python 3.6 2017-04-30 02:15:28 +08:00
Yen Chi HsuanandGitHub 27e70a8f6c Merge pull request #12869 from Tithen-Firion/cbc-update-tests 
[cbc] update test cases
 2017-04-29 21:34:18 +08:00
Yen Chi HsuanandGitHub a1ebfd4494 Merge pull request #12854 from Tithen-Firion/appletrailer-test-fix 
[appletrailers] update test cases
 2017-04-29 19:24:38 +08:00
Yen Chi HsuanandGitHub d19093bd50 Merge pull request #12906 from Tithen-Firion/clean-html-fix 
[utils] Fix inconsistent output of clean_html
 2017-04-29 15:58:45 +08:00
Yen Chi Hsuan 24eb7c2578 [xtube] Fix extraction with non-standard JSON 'sources' 
Closes #12734

Thanks @paulguy for the fix!
 2017-04-29 15:55:08 +08:00
Yen Chi Hsuan b62985a9a5 [youtube] Recognize another HTML5 player URL (#12885) 2017-04-28 16:25:04 +08:00
Yen Chi Hsuan e31fed95b4 [youtube] Recognize new locale-based player URLs (fixes #12885) 2017-04-28 15:48:30 +08:00
Yen Chi Hsuan 9f54ae2873 Ignore and clean *.ytdl files 2017-04-25 22:42:55 +08:00
Yen Chi Hsuan 01cb57016f [iqiyi] Fix extraction of Yule videos 2017-04-25 22:23:57 +08:00
Yen Chi Hsuan fbf56be213 [iqiyi] Fix playlist detection (#12504) 2017-04-22 22:11:37 +08:00
Yen Chi Hsuan 54f54fcca7 [socks] Report errors elegantly when credentails are required but missing 
In some non-standard implementations, the server may respond AUTH_USER_PASS
even if's not listed in available authentication methods. (it should
respond AUTH_NO_ACCEPTABLE per standards)
 2017-04-22 21:48:41 +08:00
Yen Chi Hsuan facfd79f9a [azubu] Remove extractor as the site is gone (closes #12813) 2017-04-22 21:20:25 +08:00
Yen Chi Hsuan 3110bb937d [porn91] Fix extraction (closes #12814) 2017-04-22 21:16:36 +08:00
Yen Chi Hsuan 06d0ad9a4e [brightcove] Support URLs with bcpid instead of playerID 
Fixes #12482
 2017-04-18 23:04:22 +08:00
Yen Chi Hsuan 34d98cc411 [tv2hu] Fix invalid escape sequence on Py3.6 2017-04-13 16:52:52 +08:00
Yen Chi Hsuan 4c03973296 [airmozilla] Fix extraction (closes #12670) 2017-04-08 15:39:58 +08:00
Yen Chi Hsuan f7923a4c39 [ChangeLog] Update after #12307 2017-03-26 22:07:12 +08:00
Yen Chi HsuanandGitHub cc63259d18 Merge pull request #12307 from rndusr/fix/str-item-assignment 
Fix "'str' object does not support item assignment"
 2017-03-26 21:51:09 +08:00
Yen Chi Hsuan 51ef4919df [afreecatv] Fix extraction (closes #12179) 2017-03-26 01:32:07 +08:00
Yen Chi Hsuan 68220649fa [ChangeLog] Update after #12099 2017-03-19 20:42:17 +08:00
Yen Chi Hsuan ea883a687c [openload] Fix extraction (closes #10408) 
Thanks to @makgun02

Ref: http://pastebin.com/raw/JX9gHFUz
 2017-03-17 15:22:34 +08:00
Yen Chi Hsuan 4605c94d1a [__init__] Fix missing subtitles if --add-metadata is used (#12423) 
The previous fix for #5594 is incorrect
 2017-03-11 19:37:45 +08:00
Yen Chi Hsuan 0f6b87d067 [miomio] Fix extraction 
Closes #12291
Closes #12388
Closes #12402
 2017-03-08 19:46:58 +08:00
Yen Chi Hsuan fe646a2f10 [twitch] PEP8 2017-03-07 15:34:06 +08:00
Yen Chi Hsuan 54a3a8827b [__init__] Metadata should be added after conversion 
Fixes #5594
 2017-03-06 18:09:12 +08:00
Yen Chi Hsuan 92cb5763f4 [ChangeLog] Update after #12357 2017-03-06 18:04:19 +08:00
Yen Chi Hsuan d2b64e04b4 [addanime] Skip an invalid test 2017-03-06 00:35:04 +08:00
Yen Chi Hsuan 6f4e4132d8 [douyutv] Switch to the PC API to escape the 5-min limitation 
Thanks @spacemeowx2 for the algo.

Ref: https://gist.github.com/spacemeowx2/629b1d131bd7e240a7d28742048e80fc

Closes #12316
 2017-03-04 23:23:18 +08:00
Yen Chi Hsuan 11bb6ad1a5 [facebook] Fix extraction (closes #12323) 
Almost all videos now use the pagelet type 'permalink_video_pagelet'
 2017-03-02 20:51:24 +08:00
Yen Chi Hsuan c9612c0487 [youtube] Mark errors about rental videos as expected 
Closes #12324
 2017-03-02 16:59:53 +08:00
Yen Chi Hsuan af5049f128 [adobepass] Add Charter Spectrum (#11465) 
Thanks @tv21 for the fix!
 2017-03-02 02:15:51 +08:00
Yen Chi Hsuan 7c4aa6fd6f [daisuki] Add subtitles (#4738) 2017-02-28 22:29:01 +08:00
Yen Chi Hsuan 9bd05b5a18 [daisuki] Add new extractor (closes #4738) 2017-02-28 22:19:26 +08:00
Yen Chi Hsuan 0a5445ddbe [utils] Add bytes_to_long() and long_to_bytes() 
Used in daisuki.net (#4738)

Both are adapted from public domain PyCrypto:
https://github.com/dlitz/pycrypto/blob/master/lib/Crypto/Util/number.py
 2017-02-28 22:10:31 +08:00
Yen Chi Hsuan f48409c7ac [utils] Add pkcs1pad 
Used in daisuki.net (#4738)
 2017-02-28 22:10:31 +08:00
Yen Chi Hsuan c9619f0a17 [aes] Add aes_cbc_encrypt 
Used in daisuki.net (#4738)
 2017-02-28 22:10:31 +08:00
Yen Chi Hsuan f4c68ba372 [douyu] Fix extraction and update _TESTS 
They've switched from flv to hls

Closes #12301
 2017-02-28 21:41:03 +08:00
Yen Chi Hsuan 892b47ab6c [scivee] Remove extractor (#9315) 
The Wikipedia page is changed from active to down:
https://en.wikipedia.org/w/index.php?title=SciVee&diff=prev&oldid=723161154

Some other interesting bits:

$ nslookup www.scivee.tv
Server:         8.8.8.8
Address:        8.8.8.8#53

Non-authoritative answer:
www.scivee.tv   canonical name = scivee.rcsb.org.
Name:   scivee.rcsb.org
Address: 132.249.231.211

$ nslookup rcsb.org
Server:         8.8.8.8
Address:        8.8.8.8#53

Non-authoritative answer:
Name:   rcsb.org
Address: 132.249.231.77

Both IPs are from UCSD. I guess it's maintained by a lab and they don't
maintain it anymore.
 2017-02-27 21:34:33 +08:00
Yen Chi Hsuan a5cf17989b [MDR] Relax _VALID_URL and playerURL matching and update _TESTS 
Ref: #12169
 2017-02-26 17:24:54 +08:00
Yen Chi Hsuan 9d0c08a02c [vevo] Fix videos with the new streams/streamsV3 format (closes #11719) 2017-02-26 00:15:49 +08:00
Yen Chi Hsuan db182c63fb [njpwworld] Add new extractor (closes #11561) 2017-02-25 18:44:39 +08:00
Yen Chi Hsuan eeb0a95684 [extractor/common] Add 'preference' to _parse_html5_media_entries 
Some websites, like NJPWorld, put different qualities on different
player pages.
 2017-02-25 18:40:05 +08:00
Yen Chi Hsuan b5869560a4 [crunchyroll] Fix descriptions with double quotes (closes #12124) 2017-02-23 00:08:45 +08:00
Yen Chi Hsuan 8936f68a0b [travis] Run tests in parallel 
[test_download] Print test names in case of network errors

[test_download] Add comments for nose parameters

[test_download] Modify outtmpl to prevent info JSON filename conflicts

Thanks @jaimeMF for the idea.

[travis] Only download tests should be run in parallel
 2017-02-19 21:26:35 +08:00
Yen Chi Hsuan fef51645d6 [theplatform] Recognize URLs with whitespaces (closes #12044) 2017-02-17 23:13:51 +08:00
Yen Chi Hsuan a4a554a793 [generic] Try parsing JWPlayer embedded videos (closes #12030) 2017-02-16 23:44:03 +08:00
Yen Chi Hsuan f8514630db [einthusan] Fix extraction (closes #11416) 
The old test URLs are no longer valid, so I replace them with the one
from #11416
 2017-02-12 20:53:55 +08:00
Yen Chi Hsuan 8d38dafbbf ChangeLog: update after #12085 2017-02-12 00:45:37 +08:00
Yen Chi HsuanandGitHub f3915452de Merge pull request #12085 from wiiaboo/python2 
utils.py: Workaround TypeError with Python 2.7.13 in Windows
 2017-02-12 00:42:43 +08:00
Yen Chi Hsuan 68c22c4c15 [iqiyi] Update _TESTS 2017-02-11 22:27:45 +08:00
Yen Chi Hsuan 815482d4eb Credit @motophil for gaskrank.py (#11685) 2017-02-06 00:38:22 +08:00
Yen Chi Hsuan 9c14fe9681 [gaskrank] Minor change and update ChangeLog after #11685 2017-02-06 00:25:28 +08:00
Yen Chi Hsuan 019f4c0371 [bandcamp] Fix extraction for incomplete albums 
Closes #11727
 2017-02-05 22:47:04 +08:00
Yen Chi Hsuan 2ab2c0d1f5 [iwara] Add width (closes #11724) 
The heuristic is from #11724
 2017-02-05 22:30:13 +08:00
Yen Chi Hsuan caf0f5f8b7 [iwara] Fix extraction (closes #11781) 2017-02-05 21:48:13 +08:00