youtube-dl
8 years agoMerge branch 'Weiqitv' of https://github.com/FounderSG/youtube-dl into FounderSG...
Yen Chi Hsuan [Tue, 19 Jan 2016 15:39:32 +0000 (23:39 +0800)]
Merge branch 'Weiqitv' of https://github.com/FounderSG/youtube-dl into FounderSG-Weiqitv

8 years ago[extractor/generic] Extend dailymotion embed regex
Sergey M․ [Tue, 19 Jan 2016 15:20:45 +0000 (21:20 +0600)]
[extractor/generic] Extend dailymotion embed regex

8 years ago[dailymotion] Extend _VALID_URL
Sergey M․ [Tue, 19 Jan 2016 15:20:14 +0000 (21:20 +0600)]
[dailymotion] Extend _VALID_URL

8 years ago[youtube] Skip test
Sergey M․ [Tue, 19 Jan 2016 14:56:04 +0000 (20:56 +0600)]
[youtube] Skip test

8 years ago[youtube] Capture and output unavailable message
Sergey M․ [Tue, 19 Jan 2016 14:54:43 +0000 (20:54 +0600)]
[youtube] Capture and output unavailable message

8 years ago[youtube] Clarify test_Youtube_18
Sergey M․ [Mon, 18 Jan 2016 17:19:38 +0000 (23:19 +0600)]
[youtube] Clarify test_Youtube_18

8 years ago[youtube] Fix URL expansion in video description
Sergey M․ [Mon, 18 Jan 2016 17:17:45 +0000 (23:17 +0600)]
[youtube] Fix URL expansion in video description

Fixes test_Youtube_18

8 years ago[atresplayer] Skip HLS completely (Closes #8261)
Sergey M․ [Sun, 17 Jan 2016 16:14:07 +0000 (22:14 +0600)]
[atresplayer] Skip HLS completely (Closes #8261)

8 years agoMerge pull request #8262 from jwilk/https-everywhere
Yen Chi Hsuan [Sun, 17 Jan 2016 14:10:03 +0000 (22:10 +0800)]
Merge pull request #8262 from jwilk/https-everywhere

[ustream] Use HTTPS for GitHub URL

8 years ago[ustream] Use HTTPS for GitHub URL
Jakub Wilk [Sun, 17 Jan 2016 14:06:00 +0000 (15:06 +0100)]
[ustream] Use HTTPS for GitHub URL

8 years ago[ae] Rename to aenetworks and clarify extractor name and description
Sergey M․ [Sat, 16 Jan 2016 21:02:45 +0000 (03:02 +0600)]
[ae] Rename to aenetworks and clarify extractor name and description

8 years ago[compat] Clarify the versions requiring compat_kwargs
Yen Chi Hsuan [Sat, 16 Jan 2016 14:17:31 +0000 (22:17 +0800)]
[compat] Clarify the versions requiring compat_kwargs

It's supported since 2.7.0 alpha 1 and 2.6.5 rc 1. See
https://hg.python.org/cpython/file/v2.7a1/Misc/NEWS#l337
https://hg.python.org/cpython/file/v2.6.5rc1/Misc/NEWS#l28

8 years ago[ae] Fix _TESTS
Yen Chi Hsuan [Sat, 16 Jan 2016 12:56:53 +0000 (20:56 +0800)]
[ae] Fix _TESTS

8 years ago[bbc] Use _search_json_ld
Yen Chi Hsuan [Sat, 16 Jan 2016 12:46:28 +0000 (20:46 +0800)]
[bbc] Use _search_json_ld

8 years ago[extractor/common] Allow passing more parameters to _search_json_ld
Yen Chi Hsuan [Sat, 16 Jan 2016 12:45:36 +0000 (20:45 +0800)]
[extractor/common] Allow passing more parameters to _search_json_ld

8 years ago[README.md] Add protocol usage example in format selection
Sergey M [Sat, 16 Jan 2016 04:15:24 +0000 (10:15 +0600)]
[README.md] Add protocol usage example in format selection

8 years ago[YoutubeDL] Ensure protocol is always present
Sergey M․ [Sat, 16 Jan 2016 04:10:28 +0000 (10:10 +0600)]
[YoutubeDL] Ensure protocol is always present

8 years ago[README.md] Improve format selection documentation
Sergey M [Sat, 16 Jan 2016 03:49:54 +0000 (09:49 +0600)]
[README.md] Improve format selection documentation

8 years ago[README.md] Mention new string operators for format selection
Sergey M [Sat, 16 Jan 2016 01:31:14 +0000 (07:31 +0600)]
[README.md] Mention new string operators for format selection

8 years ago[YoutubeDL] Introduce CSS3 like string operators
Yen Chi Hsuan [Wed, 13 Jan 2016 08:24:48 +0000 (16:24 +0800)]
[YoutubeDL] Introduce CSS3 like string operators

8 years agoMerge pull request #8246 from dstftw/initial-json-ld-metadata-support
Sergey M [Sat, 16 Jan 2016 01:20:15 +0000 (07:20 +0600)]
Merge pull request #8246 from dstftw/initial-json-ld-metadata-support

Initial JSON-LD metadata extraction support

8 years agoMerge pull request #8245 from dstftw/auto-generate-title-fields
Sergey M [Sat, 16 Jan 2016 01:20:03 +0000 (07:20 +0600)]
Merge pull request #8245 from dstftw/auto-generate-title-fields

[YoutubeDL] Auto generate title fields corresponding to the *_number fields

8 years ago[cultureunplugged] Improve (Closes #8060)
Sergey M․ [Sat, 16 Jan 2016 01:10:51 +0000 (07:10 +0600)]
[cultureunplugged] Improve (Closes #8060)

8 years ago[zippcast] Improve (Closes #8198)
Sergey M․ [Sat, 16 Jan 2016 00:25:25 +0000 (06:25 +0600)]
[zippcast] Improve (Closes #8198)

8 years ago'[ZippCast] Add new extractor'
ckuu [Sun, 10 Jan 2016 11:20:59 +0000 (15:20 +0400)]
'[ZippCast] Add new extractor'
Closes rg3/youtube-dl#6591

8 years agorelease 2016.01.15
Philipp Hagemeister [Fri, 15 Jan 2016 18:43:04 +0000 (19:43 +0100)]
release 2016.01.15

8 years ago[ae] Use JSON-LD for TV series metadata
Sergey M․ [Fri, 15 Jan 2016 18:36:49 +0000 (00:36 +0600)]
[ae] Use JSON-LD for TV series metadata

8 years ago[extractor/common] Add initial support for JSON-LD metadata extraction into info_dict
Sergey M․ [Fri, 15 Jan 2016 18:36:02 +0000 (00:36 +0600)]
[extractor/common] Add initial support for JSON-LD metadata extraction into info_dict

8 years ago[YoutubeDL] Auto generate title fields corresponding to the *_number fields
Sergey M․ [Fri, 15 Jan 2016 18:09:54 +0000 (00:09 +0600)]
[YoutubeDL] Auto generate title fields corresponding to the *_number fields

Auto generate title fields corresponding to the *_number fields when missing in order to always have clean titles. This is very common for TV series.

8 years ago[cwtv] Add new extractor
remitamine [Fri, 15 Jan 2016 16:45:51 +0000 (17:45 +0100)]
[cwtv] Add new extractor

8 years ago[ae] Improve _VALID_URL
Sergey M․ [Fri, 15 Jan 2016 16:13:48 +0000 (22:13 +0600)]
[ae] Improve _VALID_URL

8 years ago[ae] Add extractor import
Sergey M․ [Fri, 15 Jan 2016 16:12:51 +0000 (22:12 +0600)]
[ae] Add extractor import

8 years ago[history] Remove import (Closes #8243)
Sergey M․ [Fri, 15 Jan 2016 16:10:07 +0000 (22:10 +0600)]
[history] Remove import (Closes #8243)

8 years ago[xtube:user] Fix extraction (Closes #8224)
Sergey M․ [Fri, 15 Jan 2016 15:35:20 +0000 (21:35 +0600)]
[xtube:user] Fix extraction (Closes #8224)

8 years ago[xtube] Add shortcut
Sergey M․ [Fri, 15 Jan 2016 15:28:36 +0000 (21:28 +0600)]
[xtube] Add shortcut

8 years ago[ae] Add support for fyi.tv, aetv.com and mylifetime.com(closes #3599)
remitamine [Fri, 15 Jan 2016 15:18:07 +0000 (16:18 +0100)]
[ae] Add support for fyi.tv, aetv.com and mylifetime.com(closes #3599)

8 years ago[history] add support for episode pages(fixes #8240)
remitamine [Fri, 15 Jan 2016 14:16:57 +0000 (15:16 +0100)]
[history] add support for episode pages(fixes #8240)

8 years ago[theplatform] extend _VALID_URL regex
remitamine [Fri, 15 Jan 2016 14:12:35 +0000 (15:12 +0100)]
[theplatform] extend _VALID_URL regex

8 years agoRevert "[history] fix signature and media url extraction(fixes #8240)"
remitamine [Fri, 15 Jan 2016 13:54:39 +0000 (14:54 +0100)]
Revert "[history] fix signature and media url extraction(fixes #8240)"

This reverts commit ffbc0baf72f456b1f4f4ac989e4a7b75b69c7a54.

8 years ago[history] fix signature and media url extraction(fixes #8240)
remitamine [Fri, 15 Jan 2016 11:34:28 +0000 (12:34 +0100)]
[history] fix signature and media url extraction(fixes #8240)

8 years agoMerge pull request #8228 from jaimeMF/disable-file-handler
Sergey M [Thu, 14 Jan 2016 17:20:02 +0000 (22:20 +0500)]
Merge pull request #8228 from jaimeMF/disable-file-handler

[YoutubeDL] urlopen: disable the 'file:' protocol (#8227)

8 years agoCredit @TomGijselinck for canvas (#7145)
Sergey M․ [Thu, 14 Jan 2016 17:15:26 +0000 (23:15 +0600)]
Credit @TomGijselinck for canvas (#7145)

8 years ago[canvas] Improve (Closes #7145)
Sergey M․ [Thu, 14 Jan 2016 17:15:12 +0000 (23:15 +0600)]
[canvas] Improve (Closes #7145)

8 years ago[Canvas] Add new extractor
Tom Gijselinck [Mon, 12 Oct 2015 07:07:18 +0000 (09:07 +0200)]
[Canvas] Add new extractor

8 years ago[prosiebensat1] Fix some extraction and update tests
Sergey M․ [Thu, 14 Jan 2016 16:45:09 +0000 (22:45 +0600)]
[prosiebensat1] Fix some extraction and update tests

8 years ago[prosiebensat1] add support for 7tv.de
Lucas [Wed, 13 Jan 2016 15:11:49 +0000 (16:11 +0100)]
[prosiebensat1] add support for 7tv.de

8 years ago[ntvde] Improve regex
Sergey M․ [Thu, 14 Jan 2016 16:12:24 +0000 (22:12 +0600)]
[ntvde] Improve regex

8 years ago[orf:fm4] Add test
Sergey M․ [Thu, 14 Jan 2016 16:11:33 +0000 (22:11 +0600)]
[orf:fm4] Add test

8 years ago[orf:fm4] Extend _VALID_URL (Closes #8234)
Sergey M․ [Thu, 14 Jan 2016 16:07:42 +0000 (22:07 +0600)]
[orf:fm4] Extend _VALID_URL (Closes #8234)

8 years ago[ntvde] Fix extraction
Sergey M․ [Thu, 14 Jan 2016 16:05:04 +0000 (22:05 +0600)]
[ntvde] Fix extraction

8 years ago[unistra] Fix extraction
Sergey M․ [Thu, 14 Jan 2016 15:53:24 +0000 (21:53 +0600)]
[unistra] Fix extraction

8 years ago[vodlocker] Fix extraction (Closes #8231)
Sergey M․ [Thu, 14 Jan 2016 15:48:08 +0000 (21:48 +0600)]
[vodlocker] Fix extraction (Closes #8231)

8 years ago[YoutubeDL] use a more correct terminology in the error message for file:// URLs
Jaime Marquínez Ferrándiz [Thu, 14 Jan 2016 15:28:46 +0000 (16:28 +0100)]
[YoutubeDL] use a more correct terminology in the error message for file:// URLs

8 years agorelease 2016.01.14
Philipp Hagemeister [Thu, 14 Jan 2016 14:43:21 +0000 (15:43 +0100)]
release 2016.01.14

8 years ago[beeg] Update API URL
Sergey M․ [Thu, 14 Jan 2016 13:57:56 +0000 (19:57 +0600)]
[beeg] Update API URL

8 years ago[beeg] Fix extraction (Closes #8225)
Sergey M․ [Thu, 14 Jan 2016 13:57:20 +0000 (19:57 +0600)]
[beeg] Fix extraction (Closes #8225)

8 years ago[YoutubeDL] improve error message for file:/// URLs
Jaime Marquínez Ferrándiz [Thu, 14 Jan 2016 13:07:54 +0000 (14:07 +0100)]
[YoutubeDL] improve error message for file:/// URLs

8 years ago[YoutubeDL] urlopen: use build_opener again
Jaime Marquínez Ferrándiz [Thu, 14 Jan 2016 07:14:01 +0000 (08:14 +0100)]
[YoutubeDL] urlopen: use build_opener again

Otherwise we would need to manually add handlers like HTTPRedirectHandler, instead we add a customized FileHandler instance that raises an error.

8 years ago[YoutubeDL] urlopen: disable the 'file:' protocol (#8227)
Jaime Marquínez Ferrándiz [Wed, 13 Jan 2016 23:16:23 +0000 (00:16 +0100)]
[YoutubeDL] urlopen: disable the 'file:' protocol (#8227)

If someone is running youtube-dl on a server to deliver files, the user could input 'file:///some/important/file' and youtube-dl would save that file as a video giving access to sensitive information to the user.
'file:' urls can be filtered, but the user can use an URL to a crafted m3u8 manifest like:

    #EXTM3U
    #EXT-X-MEDIA-SEQUENCE:0
    #EXTINF:10.0
    file:///etc/passwd
    #EXT-X-ENDLIST

With this patch 'file:' URLs raise URLError like for unknown protocols.

8 years ago[tudou] Add support for Albums and Playlists and extract more metadata
remitamine [Wed, 13 Jan 2016 12:29:00 +0000 (13:29 +0100)]
[tudou] Add support for Albums and Playlists and extract more metadata

8 years ago[youtube] Fix acodec and vcodec order
Yen Chi Hsuan [Wed, 13 Jan 2016 09:05:38 +0000 (17:05 +0800)]
[youtube] Fix acodec and vcodec order

In RFC6381, there's no rule stating that the first part of codecs should
be video and the second part should be audio, while it seems the case
for data reported by YouTube.

8 years ago[pluralsight] Fix new player (Closes #8215)
Sergey M․ [Wed, 13 Jan 2016 02:18:37 +0000 (08:18 +0600)]
[pluralsight] Fix new player (Closes #8215)

8 years ago[downloader/fragment] Move helper data to context dict
Sergey M․ [Tue, 12 Jan 2016 18:00:31 +0000 (00:00 +0600)]
[downloader/fragment] Move helper data to context dict

8 years ago[dailymotion] Prefer direct links (Closes #8156)
Sergey M․ [Tue, 12 Jan 2016 17:23:39 +0000 (23:23 +0600)]
[dailymotion] Prefer direct links (Closes #8156)

8 years ago[downloader/fragment] More smooth calculations
Sergey M․ [Tue, 12 Jan 2016 17:18:38 +0000 (23:18 +0600)]
[downloader/fragment] More smooth calculations

`downloaded_bytes` is now updated on each fragment progress hook invocation

8 years ago[downloader/fragment] Remove unused code and fix zero division error
Sergey M․ [Tue, 12 Jan 2016 16:09:38 +0000 (22:09 +0600)]
[downloader/fragment] Remove unused code and fix zero division error

8 years ago[iprima] Mark broken
Sergey M․ [Mon, 11 Jan 2016 16:00:17 +0000 (22:00 +0600)]
[iprima] Mark broken

8 years ago[videott] Mark broken
Sergey M․ [Mon, 11 Jan 2016 15:58:32 +0000 (21:58 +0600)]
[videott] Mark broken

8 years ago[videomega] Mark broken
Sergey M․ [Mon, 11 Jan 2016 15:56:19 +0000 (21:56 +0600)]
[videomega] Mark broken

8 years agoRevert "fix typos"
remitamine [Sun, 10 Jan 2016 18:27:22 +0000 (19:27 +0100)]
Revert "fix typos"

This reverts commit 36a0e46c39ea4f211dea9944177976e8f8364736.

8 years agofix typos
remitamine [Sun, 10 Jan 2016 16:55:41 +0000 (17:55 +0100)]
fix typos

8 years agoFix typos
Jakub Wilk [Sun, 10 Jan 2016 15:17:47 +0000 (16:17 +0100)]
Fix typos

Closes #8200.

8 years ago[downloader/fragment] Don't fail if the 'Content-Length' header is missing
Jaime Marquínez Ferrándiz [Sun, 10 Jan 2016 13:32:53 +0000 (14:32 +0100)]
[downloader/fragment] Don't fail if the 'Content-Length' header is missing

In some dailymotion videos (like http://www.dailymotion.com/video/x3k0dtv from #8156) the segments URLs don't have the 'Content-Length' header and HttpFD sets the 'totat_bytes' field to None, so we also use '0' in that case (since we do different math operations with it).

8 years ago[bigflix] Use correct indentation to make flake8 happy
Jaime Marquínez Ferrándiz [Sun, 10 Jan 2016 13:26:27 +0000 (14:26 +0100)]
[bigflix] Use correct indentation to make flake8 happy

8 years ago[shahid] raise ExtractorError if the video is DRM protected
remitamine [Sun, 10 Jan 2016 06:55:58 +0000 (07:55 +0100)]
[shahid] raise ExtractorError if the video is DRM protected

8 years ago[dcn] extract video ids in season entries
remitamine [Sun, 10 Jan 2016 06:45:41 +0000 (07:45 +0100)]
[dcn] extract video ids in season entries

8 years ago[bigflix] Improve formats extraction
Sergey M․ [Sun, 10 Jan 2016 04:49:27 +0000 (10:49 +0600)]
[bigflix] Improve formats extraction

8 years ago[bigflix] Extract all formats
Sergey M․ [Sun, 10 Jan 2016 04:31:36 +0000 (10:31 +0600)]
[bigflix] Extract all formats

8 years agoCredit @vickyg3 for bigflix (#8194)
Sergey M․ [Sun, 10 Jan 2016 04:03:56 +0000 (10:03 +0600)]
Credit @vickyg3 for bigflix (#8194)

8 years agoMerge pull request #8194 from vickyg3/bigflix_ie
Sergey M [Sun, 10 Jan 2016 04:02:18 +0000 (09:02 +0500)]
Merge pull request #8194 from vickyg3/bigflix_ie

[Bigflix] Add new extractor for bigflix.com

8 years ago[Bigflix] Add new extractor for bigflix.com
Vignesh Venkat [Sat, 9 Jan 2016 23:31:50 +0000 (15:31 -0800)]
[Bigflix] Add new extractor for bigflix.com

Add an IE to support bigflix.com. It uses some sort of silverlight
plugin whose video url is being populated using base64 encoded
flashvars. So it is quite straightforward to extract.

8 years ago[canalc2] Fix extraction (Closes #8191)
Sergey M․ [Sat, 9 Jan 2016 19:37:10 +0000 (01:37 +0600)]
[canalc2] Fix extraction (Closes #8191)

8 years ago[xhamster] Remove unused import
Jaime Marquínez Ferrándiz [Sat, 9 Jan 2016 10:16:23 +0000 (11:16 +0100)]
[xhamster] Remove unused import

8 years agorelease 2016.01.09
Philipp Hagemeister [Sat, 9 Jan 2016 00:16:08 +0000 (01:16 +0100)]
release 2016.01.09

8 years ago[vimeo] Add test for #8187
Sergey M․ [Fri, 8 Jan 2016 21:07:29 +0000 (03:07 +0600)]
[vimeo] Add test for #8187

8 years ago[vimeo] Check source file URL (Closes #8187)
Sergey M․ [Fri, 8 Jan 2016 21:06:09 +0000 (03:06 +0600)]
[vimeo] Check source file URL (Closes #8187)

8 years ago[xhamster] Update tests
Sergey M․ [Fri, 8 Jan 2016 18:36:43 +0000 (00:36 +0600)]
[xhamster] Update tests

8 years ago[xhamster] Fix uploader extraction
Sergey M․ [Fri, 8 Jan 2016 18:36:19 +0000 (00:36 +0600)]
[xhamster] Fix uploader extraction

8 years ago[xhamster] Change title regex precedence
Sergey M․ [Fri, 8 Jan 2016 18:31:24 +0000 (00:31 +0600)]
[xhamster] Change title regex precedence

8 years ago[xhamster] Fix view count extraction
Sergey M․ [Fri, 8 Jan 2016 18:29:10 +0000 (00:29 +0600)]
[xhamster] Fix view count extraction

8 years ago[xhamster] Fix duration extraction
Sergey M․ [Fri, 8 Jan 2016 18:26:37 +0000 (00:26 +0600)]
[xhamster] Fix duration extraction

8 years ago[xhamster] Fix upload date extraction
Sergey M․ [Fri, 8 Jan 2016 18:21:57 +0000 (00:21 +0600)]
[xhamster] Fix upload date extraction

8 years ago[xhamster] Improve title extraction
Sergey M․ [Fri, 8 Jan 2016 18:19:36 +0000 (00:19 +0600)]
[xhamster] Improve title extraction

8 years agoMerge pull request #8182 from atomic83/patch-1
Sergey M [Fri, 8 Jan 2016 18:04:32 +0000 (23:04 +0500)]
Merge pull request #8182 from atomic83/patch-1

Extract xHamster title fix

8 years agoExtract xHamster title fix
atomic83 [Fri, 8 Jan 2016 11:58:05 +0000 (12:58 +0100)]
Extract xHamster title fix

8 years ago[vimeo] Automatically pickup full movie when rented (Closes #8171)
Sergey M․ [Fri, 8 Jan 2016 04:41:24 +0000 (10:41 +0600)]
[vimeo] Automatically pickup full movie when rented (Closes #8171)

8 years ago[ivideon] Add support for map bound URLs
Sergey M․ [Thu, 7 Jan 2016 23:11:23 +0000 (05:11 +0600)]
[ivideon] Add support for map bound URLs

8 years ago[adultswim] Skip georestricted hls (Closes #8168)
Sergey M․ [Thu, 7 Jan 2016 21:19:47 +0000 (03:19 +0600)]
[adultswim] Skip georestricted hls (Closes #8168)

8 years ago[soundcloud:likes] Adapt to API changes (Closes #8166)
Sergey M․ [Thu, 7 Jan 2016 19:54:31 +0000 (01:54 +0600)]
[soundcloud:likes] Adapt to API changes (Closes #8166)

8 years ago[youtube] Support expanding alternative format of links in description (Closes #8164)
Sergey M․ [Thu, 7 Jan 2016 18:52:55 +0000 (00:52 +0600)]
[youtube] Support expanding alternative format of links in description (Closes #8164)