youtube-dl
8 years agoMerge branch 'akamai_pv' of https://github.com/remitamine/youtube-dl into remitamine...
Yen Chi Hsuan [Mon, 25 Apr 2016 13:02:02 +0000 (21:02 +0800)]
Merge branch 'akamai_pv' of https://github.com/remitamine/youtube-dl into remitamine-akamai_pv

8 years ago[extractor/common] do not process f4m manifest that contain akamai playerVerification...
remitamine [Thu, 30 Jul 2015 16:34:38 +0000 (17:34 +0100)]
[extractor/common] do not process f4m manifest that contain akamai playerVerificationChallenge

8 years ago[openload] Make thumbnail optional
Sergey M․ [Sun, 24 Apr 2016 18:26:06 +0000 (00:26 +0600)]
[openload] Make thumbnail optional

8 years ago[openload] Add test
Sergey M․ [Sun, 24 Apr 2016 18:22:55 +0000 (00:22 +0600)]
[openload] Add test

8 years ago[openload] Fix ext extraction
Sergey M․ [Sun, 24 Apr 2016 18:03:29 +0000 (00:03 +0600)]
[openload] Fix ext extraction

8 years ago[utils] Allow None mimetypes in mimetype2ext
Sergey M․ [Sun, 24 Apr 2016 18:03:12 +0000 (00:03 +0600)]
[utils] Allow None mimetypes in mimetype2ext

8 years ago[openload] Fix title extraction (Closes #9298)
Sergey M․ [Sun, 24 Apr 2016 18:01:37 +0000 (00:01 +0600)]
[openload] Fix title extraction (Closes #9298)

8 years ago[douyutv] Improve extraction and update tests
Yen Chi Hsuan [Sun, 24 Apr 2016 15:52:17 +0000 (23:52 +0800)]
[douyutv] Improve extraction and update tests

The JSON API sometimes return HTML pages with errors

8 years ago[xminus] Fix extraction (closes #9228)
Yen Chi Hsuan [Sun, 24 Apr 2016 15:18:34 +0000 (23:18 +0800)]
[xminus] Fix extraction (closes #9228)

8 years agorelease 2016.04.24
Philipp Hagemeister [Sun, 24 Apr 2016 15:06:46 +0000 (17:06 +0200)]
release 2016.04.24

8 years ago[kwuo:song] Fix extraction and update the test
Yen Chi Hsuan [Sun, 24 Apr 2016 14:19:26 +0000 (22:19 +0800)]
[kwuo:song] Fix extraction and update the test

8 years ago[viewster] improve http formats extraction
remitamine [Sun, 24 Apr 2016 13:33:47 +0000 (14:33 +0100)]
[viewster] improve http formats extraction

8 years ago[kuwo:category] Fix the test
Yen Chi Hsuan [Sun, 24 Apr 2016 13:16:06 +0000 (21:16 +0800)]
[kuwo:category] Fix the test

Sometimes there are 24 songs and sometimes 30 lol

8 years ago[ThePlatform] Fix tests failed since 79ba9140dc8fcf5883b7473596e8f20cba6b479f
Yen Chi Hsuan [Sun, 24 Apr 2016 12:44:52 +0000 (20:44 +0800)]
[ThePlatform] Fix tests failed since 79ba9140dc8fcf5883b7473596e8f20cba6b479f

8 years ago[onionstudios] Fix description extraction
Yen Chi Hsuan [Sun, 24 Apr 2016 12:41:17 +0000 (20:41 +0800)]
[onionstudios] Fix description extraction

\1 does not work in []. Fixes test_Generic_75
(http://www.clickhole.com/video/dont-understand-bitcoin-man-will-mumble-explanatio-2537)

8 years ago[mwave] Skip checking unstable MD5
Yen Chi Hsuan [Sun, 24 Apr 2016 12:04:21 +0000 (20:04 +0800)]
[mwave] Skip checking unstable MD5

On my PC the checksum is 02eda6d09fb63131a17a8d44e6237463, while a
recent Travis CI build
(https://travis-ci.org/rg3/youtube-dl/jobs/125341081) shows it's
c930e27b7720aaa3c9d0018dfc8ff6cc

8 years ago[yahoo] Improve error detection and update tests
Yen Chi Hsuan [Sun, 24 Apr 2016 10:11:51 +0000 (18:11 +0800)]
[yahoo] Improve error detection and update tests

8 years ago[yahoo] Extract all <iframe>s
Yen Chi Hsuan [Sun, 24 Apr 2016 09:46:25 +0000 (17:46 +0800)]
[yahoo] Extract all <iframe>s

Fixes test_yahoo_6

(https://ca.finance.yahoo.com/news/hackers-sony-more-trouble-well-154609075.html)

8 years ago[yahoo] Update some tests
Yen Chi Hsuan [Sun, 24 Apr 2016 09:28:18 +0000 (17:28 +0800)]
[yahoo] Update some tests

One has new fields as ThePlatformIE changed, and others have changed
files.

8 years ago[yahoo] Extend _VALID_URL and fix extraction
Yen Chi Hsuan [Sun, 24 Apr 2016 09:01:18 +0000 (17:01 +0800)]
[yahoo] Extend _VALID_URL and fix extraction

Closes #9271

8 years ago[generic] Unescape the video URL
Yen Chi Hsuan [Sun, 24 Apr 2016 08:23:21 +0000 (16:23 +0800)]
[generic] Unescape the video URL

Fixes #9279

8 years ago[README.md] Document track metafields in output template
Sergey M [Sun, 24 Apr 2016 06:22:18 +0000 (12:22 +0600)]
[README.md] Document track metafields in output template

8 years ago[viewster] simplify qualities_basename regex
remitamine [Sun, 24 Apr 2016 02:06:46 +0000 (03:06 +0100)]
[viewster] simplify qualities_basename regex

8 years ago[viewster] extract all http formats
remitamine [Sun, 24 Apr 2016 01:32:56 +0000 (02:32 +0100)]
[viewster] extract all http formats

8 years ago[dplay] Sign unsigned final download hls URLs
Sergey M․ [Sat, 23 Apr 2016 11:28:45 +0000 (17:28 +0600)]
[dplay] Sign unsigned final download hls URLs

8 years ago[dplay] Extract subtitles (Closes #9284)
Sergey M․ [Sat, 23 Apr 2016 10:50:31 +0000 (16:50 +0600)]
[dplay] Extract subtitles (Closes #9284)

8 years ago[dplay] Improve extraction and document workarounds and tests
Sergey M․ [Sat, 23 Apr 2016 10:36:17 +0000 (16:36 +0600)]
[dplay] Improve extraction and document workarounds and tests

8 years ago[dplay] Try secure api for no tld (Closes #9282)
Sergey M․ [Sat, 23 Apr 2016 09:59:30 +0000 (15:59 +0600)]
[dplay] Try secure api for no tld (Closes #9282)

8 years ago[nhl] Add new extractor(closes #8419)(closes #8798)
remitamine [Fri, 22 Apr 2016 19:17:20 +0000 (20:17 +0100)]
[nhl] Add new extractor(closes #8419)(closes #8798)

8 years ago[youku] Skip streams with channel_type=tail
Yen Chi Hsuan [Fri, 22 Apr 2016 18:51:17 +0000 (02:51 +0800)]
[youku] Skip streams with channel_type=tail

Fixes #9275

These video segments look like ads and they don't appear in the web
player.

8 years ago[nbc] add support for today.com(closes #2909)
remitamine [Fri, 22 Apr 2016 17:07:40 +0000 (18:07 +0100)]
[nbc] add support for today.com(closes #2909)

8 years ago[iqiyi] Improve error detection (#9276)
Yen Chi Hsuan [Fri, 22 Apr 2016 16:06:49 +0000 (00:06 +0800)]
[iqiyi] Improve error detection (#9276)

8 years ago[eagleplatform] extract all http formats
remitamine [Fri, 22 Apr 2016 13:32:38 +0000 (14:32 +0100)]
[eagleplatform] extract all http formats

8 years ago[newstube] extract http formats(closes #9253)
remitamine [Fri, 22 Apr 2016 10:26:43 +0000 (11:26 +0100)]
[newstube] extract http formats(closes #9253)

8 years ago[rtbf] improve extraction(fixes #9267)
remitamine [Thu, 21 Apr 2016 21:52:49 +0000 (22:52 +0100)]
[rtbf] improve extraction(fixes #9267)

8 years ago[tubitv] fix extraction(closes #8741)
remitamine [Thu, 21 Apr 2016 19:29:42 +0000 (20:29 +0100)]
[tubitv] fix extraction(closes #8741)

8 years ago[vimeo] Pass Referer for check-password request
Sergey M․ [Thu, 21 Apr 2016 18:02:39 +0000 (00:02 +0600)]
[vimeo] Pass Referer for check-password request

8 years ago[dump] Remove extractor
Sergey M․ [Thu, 21 Apr 2016 17:31:34 +0000 (23:31 +0600)]
[dump] Remove extractor

8 years agoAdd --hls-prefer-ffmpeg
Sergey M․ [Thu, 21 Apr 2016 17:02:17 +0000 (23:02 +0600)]
Add --hls-prefer-ffmpeg

8 years ago[planetaplay] Remove remainings of extractor
Sergey M․ [Thu, 21 Apr 2016 16:57:38 +0000 (22:57 +0600)]
[planetaplay] Remove remainings of extractor

8 years ago[options] Remove experimental mark for --hls-prefer-native
Sergey M․ [Thu, 21 Apr 2016 16:44:01 +0000 (22:44 +0600)]
[options] Remove experimental mark for --hls-prefer-native

8 years ago[planetaplay] Remove extractor (Closes #9256)
Sergey M․ [Thu, 21 Apr 2016 16:33:54 +0000 (22:33 +0600)]
[planetaplay] Remove extractor (Closes #9256)

8 years ago[tvigle] Skip hls completely (#9259)
Sergey M․ [Thu, 21 Apr 2016 16:15:20 +0000 (22:15 +0600)]
[tvigle] Skip hls completely (#9259)

8 years ago[mgtv] Fix _VALID_URL and add localized name
Yen Chi Hsuan [Thu, 21 Apr 2016 16:05:48 +0000 (00:05 +0800)]
[mgtv] Fix _VALID_URL and add localized name

8 years ago[dispeak] Rename DigitalSpeaking to DigitallySpeaking
Yen Chi Hsuan [Thu, 21 Apr 2016 16:02:58 +0000 (00:02 +0800)]
[dispeak] Rename DigitalSpeaking to DigitallySpeaking

8 years ago[dispeak] Several fixes
Yen Chi Hsuan [Thu, 21 Apr 2016 15:58:36 +0000 (23:58 +0800)]
[dispeak] Several fixes

8 years agoMerge pull request #9110 from remitamine/parse_duration
Sergey M [Thu, 21 Apr 2016 15:53:16 +0000 (22:53 +0700)]
Merge pull request #9110 from remitamine/parse_duration

[utils] imporove parse_duration to handle more formats

8 years ago[utils] imporove parse_duration to handle more formats
remitamine [Thu, 7 Apr 2016 18:30:47 +0000 (19:30 +0100)]
[utils] imporove parse_duration to handle more formats

8 years ago[mgtv] Add new extractor (closes #9212)
Yen Chi Hsuan [Thu, 21 Apr 2016 15:29:51 +0000 (23:29 +0800)]
[mgtv] Add new extractor (closes #9212)

8 years ago[dispeak/gdcvault] Add the test case from #5784
Yen Chi Hsuan [Thu, 21 Apr 2016 11:46:32 +0000 (19:46 +0800)]
[dispeak/gdcvault] Add the test case from #5784

8 years ago[dispeak] Add new extractor
Yen Chi Hsuan [Thu, 21 Apr 2016 11:36:33 +0000 (19:36 +0800)]
[dispeak] Add new extractor

Both GDCVault and GPUTechConf uses the service of DigitalSpeaking.

8 years ago[gdcvault] Fix for videos with hard-coded hostnames
Yen Chi Hsuan [Thu, 21 Apr 2016 10:07:03 +0000 (18:07 +0800)]
[gdcvault] Fix for videos with hard-coded hostnames

Fixes #9248

8 years ago[streetvoice] Fix extraction
Yen Chi Hsuan [Thu, 21 Apr 2016 05:07:53 +0000 (13:07 +0800)]
[streetvoice] Fix extraction

The old API results in URLs with HTTP 403 from time to time.

Hopefully fixes #9219.

8 years ago[extractor/common] Allow empty post data
Yen Chi Hsuan [Thu, 21 Apr 2016 05:06:06 +0000 (13:06 +0800)]
[extractor/common] Allow empty post data

8 years ago[tvigle] Fix extraction (Closes #9259)
Sergey M․ [Wed, 20 Apr 2016 17:52:41 +0000 (23:52 +0600)]
[tvigle] Fix extraction (Closes #9259)

8 years ago[quickvid] Remove extractor (Closes #9258)
Sergey M․ [Wed, 20 Apr 2016 17:29:02 +0000 (23:29 +0600)]
[quickvid] Remove extractor (Closes #9258)

8 years ago[youtube] Capture and output login error message
Sergey M․ [Wed, 20 Apr 2016 16:14:32 +0000 (22:14 +0600)]
[youtube] Capture and output login error message

8 years ago[people] Remove bogus comment
Sergey M․ [Tue, 19 Apr 2016 21:40:02 +0000 (03:40 +0600)]
[people] Remove bogus comment

8 years ago[people] Add extractor
Sergey M․ [Tue, 19 Apr 2016 21:37:23 +0000 (03:37 +0600)]
[people] Add extractor

8 years agorelease 2016.04.19
Philipp Hagemeister [Tue, 19 Apr 2016 01:03:52 +0000 (03:03 +0200)]
release 2016.04.19

8 years ago[vimeo] Improve _VALID_URL (Closes #9229)
Sergey M․ [Mon, 18 Apr 2016 15:40:28 +0000 (21:40 +0600)]
[vimeo] Improve _VALID_URL (Closes #9229)

8 years ago[theonion] Remove extractor (Closes #9220)
Sergey M․ [Sun, 17 Apr 2016 17:12:23 +0000 (23:12 +0600)]
[theonion] Remove extractor (Closes #9220)

It now uses generic onionstudios embed

8 years ago[youtube:playlist] Fetch all the videos in a mix (fixes #3837)
Jaime Marquínez Ferrándiz [Sun, 17 Apr 2016 15:07:57 +0000 (17:07 +0200)]
[youtube:playlist] Fetch all the videos in a mix (fixes #3837)

Since there doesn't seem to be any indication, it stops when there aren't new videos in the webpage.

8 years ago[vice] remove unused import and variable
remitamine [Sun, 17 Apr 2016 13:06:19 +0000 (14:06 +0100)]
[vice] remove unused import and variable

8 years ago[musicplayon] Relax _VALID_URL and improve metadata extraction
Yen Chi Hsuan [Sun, 17 Apr 2016 09:22:59 +0000 (17:22 +0800)]
[musicplayon] Relax _VALID_URL and improve metadata extraction

In r'pl=\d+&play=\d+' pages, several metadata items are missing

Closes #9222.

8 years ago[musicplayon] Fix extraction (closes #9222)
Yen Chi Hsuan [Sun, 17 Apr 2016 07:08:51 +0000 (15:08 +0800)]
[musicplayon] Fix extraction (closes #9222)

8 years agoMerge pull request #9195 from remitamine/ffmpeg-pipe
remitamine [Sat, 16 Apr 2016 21:00:49 +0000 (22:00 +0100)]
Merge pull request #9195 from remitamine/ffmpeg-pipe

[downloader/external] enable piping for FFmpegFD(closes #2124)

8 years ago[ffmpeg] Clarify rationale for pipe(-) exclusion in _ffmpeg_filename_argument
remitamine [Sat, 16 Apr 2016 20:49:13 +0000 (21:49 +0100)]
[ffmpeg] Clarify rationale for pipe(-) exclusion in _ffmpeg_filename_argument

8 years ago[onionstudios] extract m3u8 formats
remitamine [Sat, 16 Apr 2016 19:53:13 +0000 (20:53 +0100)]
[onionstudios] extract m3u8 formats

8 years ago[ffmpeg] check for - file name in _ffmpeg_filename_argument
remitamine [Sat, 16 Apr 2016 18:45:56 +0000 (19:45 +0100)]
[ffmpeg] check for - file name in _ffmpeg_filename_argument

8 years ago[kuwo:category] Update the test
Yen Chi Hsuan [Sat, 16 Apr 2016 18:38:05 +0000 (02:38 +0800)]
[kuwo:category] Update the test

Now the webpage says there are 24 songs.

8 years ago[nerdist] Remove extractor
Sergey M․ [Sat, 16 Apr 2016 18:16:31 +0000 (00:16 +0600)]
[nerdist] Remove extractor

It now uses brightcove

8 years ago[vice] extract youtube embed
remitamine [Sat, 16 Apr 2016 16:48:34 +0000 (17:48 +0100)]
[vice] extract youtube embed

8 years ago[cbs] Remove unused import
Sergey M․ [Sat, 16 Apr 2016 16:47:10 +0000 (22:47 +0600)]
[cbs] Remove unused import

8 years ago[extractor/generic] Improve instagram embeds (Closes #9213)
Sergey M․ [Sat, 16 Apr 2016 16:39:20 +0000 (22:39 +0600)]
[extractor/generic] Improve instagram embeds (Closes #9213)

8 years ago[instagram] Add support for iframe embeds
Sergey M․ [Sat, 16 Apr 2016 16:31:05 +0000 (22:31 +0600)]
[instagram] Add support for iframe embeds

8 years ago[instagram] Add support for embed URLs
Sergey M․ [Sat, 16 Apr 2016 16:23:08 +0000 (22:23 +0600)]
[instagram] Add support for embed URLs

8 years ago[mooshare] Remove extractor
Sergey M․ [Sat, 16 Apr 2016 15:31:50 +0000 (21:31 +0600)]
[mooshare] Remove extractor

8 years ago[mdr] Fix extraction and update tests
Yen Chi Hsuan [Sat, 16 Apr 2016 13:57:28 +0000 (21:57 +0800)]
[mdr] Fix extraction and update tests

It's strange that the date is changed. Anyway, new data matches what the
webpage says.

8 years ago[huffpost] Fix a typo
Yen Chi Hsuan [Sat, 16 Apr 2016 13:41:22 +0000 (21:41 +0800)]
[huffpost] Fix a typo

8 years ago[generic] Fix test_Generic_2
Yen Chi Hsuan [Sat, 16 Apr 2016 11:44:12 +0000 (19:44 +0800)]
[generic] Fix test_Generic_2

Now a HEAD request returns 400 Bad Request

8 years ago[ustream] Fix /embed/ URLs and add a test
Yen Chi Hsuan [Sat, 16 Apr 2016 11:39:25 +0000 (19:39 +0800)]
[ustream] Fix /embed/ URLs and add a test

8 years ago[tudou] Improve error detection (closes #9175)
Yen Chi Hsuan [Sat, 16 Apr 2016 11:11:25 +0000 (19:11 +0800)]
[tudou] Improve error detection (closes #9175)

8 years ago[twitter] Don't check /cards/ URLs
Yen Chi Hsuan [Sat, 16 Apr 2016 10:57:50 +0000 (18:57 +0800)]
[twitter] Don't check /cards/ URLs

Fixes #9181

In this tweet, there are two cards:
1. https://twitter.com/i/cards/tfw/v1/719944006306701313
   This shows #TeamCap vs. #TeamIronMan
2. https://twitter.com/i/videos/tweet/719944021058060289
   This is the real video and can be handled by TwitterCardIE

In all current test_Twitter* tests, /videos/tweet/ approach works fine.

8 years ago[bbc] Fix a test
Yen Chi Hsuan [Sat, 16 Apr 2016 10:00:19 +0000 (18:00 +0800)]
[bbc] Fix a test

8 years ago[audiomack] Update the test
Yen Chi Hsuan [Sat, 16 Apr 2016 09:54:39 +0000 (17:54 +0800)]
[audiomack] Update the test

The original test raises 404

8 years ago[varzesh3] Add md5 to the test
Yen Chi Hsuan [Sat, 16 Apr 2016 09:37:44 +0000 (17:37 +0800)]
[varzesh3] Add md5 to the test

8 years ago[newgrounds] Support videos (closes #9138)
Yen Chi Hsuan [Sat, 16 Apr 2016 09:36:30 +0000 (17:36 +0800)]
[newgrounds] Support videos (closes #9138)

8 years ago[cbs] do not catch Exceptions raised by by _extract_theplatform_smil
remitamine [Sat, 16 Apr 2016 09:25:59 +0000 (10:25 +0100)]
[cbs] do not catch Exceptions raised by by _extract_theplatform_smil

8 years ago[theplatform] remove _sort_formats from _extract_theplatform_smil
remitamine [Sat, 16 Apr 2016 09:23:56 +0000 (10:23 +0100)]
[theplatform] remove _sort_formats from _extract_theplatform_smil

8 years ago[varzesh3] Fix metadata extraction (closes #9197)
Yen Chi Hsuan [Sat, 16 Apr 2016 09:13:22 +0000 (17:13 +0800)]
[varzesh3] Fix metadata extraction (closes #9197)

8 years ago[gazeta] Relax _VALID_URL and update tests
Yen Chi Hsuan [Sat, 16 Apr 2016 08:48:47 +0000 (16:48 +0800)]
[gazeta] Relax _VALID_URL and update tests

Closes #9196

8 years ago[eagleplatform] Fix error handling
Yen Chi Hsuan [Sat, 16 Apr 2016 08:47:16 +0000 (16:47 +0800)]
[eagleplatform] Fix error handling

8 years ago[puls4] Fix error detection (#9194)
Yen Chi Hsuan [Sat, 16 Apr 2016 08:22:44 +0000 (16:22 +0800)]
[puls4] Fix error detection (#9194)

8 years ago[sportbox] Fix SportBoxEmbedIE
Yen Chi Hsuan [Sat, 16 Apr 2016 08:13:14 +0000 (16:13 +0800)]
[sportbox] Fix SportBoxEmbedIE

Also fixes test_Generic_29 (http://www.vestifinance.ru/articles/25753)

8 years ago[cbs] extract rtmp formats
remitamine [Fri, 15 Apr 2016 21:38:37 +0000 (22:38 +0100)]
[cbs] extract rtmp formats

8 years ago[youtube:user] check if the url didn't match only the other youtube extractors
remitamine [Fri, 15 Apr 2016 18:04:37 +0000 (19:04 +0100)]
[youtube:user] check if the url didn't match only the other youtube extractors

8 years ago[karaoketv] Fix extraction
Sergey M․ [Fri, 15 Apr 2016 15:26:54 +0000 (21:26 +0600)]
[karaoketv] Fix extraction

8 years ago[iqiyi] Also suuport pps.tv URLs
Yen Chi Hsuan [Fri, 15 Apr 2016 14:39:18 +0000 (22:39 +0800)]
[iqiyi] Also suuport pps.tv URLs

PPS is acquired by Baidu and merged with iQiyi in 2013 [1]. Now they
have the same page layouts.

[1] http://www.chinanews.com/it/2013/05-07/4792526.shtml

8 years ago[karaoketv] Update and mark as not _WORKING
Yen Chi Hsuan [Fri, 15 Apr 2016 13:49:17 +0000 (21:49 +0800)]
[karaoketv] Update and mark as not _WORKING