youtube-dl
7 years ago[test_all_urls] PEP 8 and change wording
Sergey M․ [Mon, 27 Jun 2016 15:11:45 +0000 (22:11 +0700)]
[test_all_urls] PEP 8 and change wording

7 years agoNew test-case: extractor names are supposed to be unique
Matthieu Muffato [Sun, 26 Jun 2016 22:31:55 +0000 (23:31 +0100)]
New test-case: extractor names are supposed to be unique

@dstftw explained in
https://github.com/rg3/youtube-dl/pull/9918#issuecomment-228625878 that
extractor names are supposed to be unique. @dstftw has fixed the two
offending extractors, and here I add a test to ensure this does not
happen in the future.

7 years ago[skynewsarabia:article] Clarify IE_NAME
Sergey M․ [Sun, 26 Jun 2016 22:08:09 +0000 (05:08 +0700)]
[skynewsarabia:article] Clarify IE_NAME

7 years ago[sr:mediathek] Clarify IE_NAME
Sergey M․ [Sun, 26 Jun 2016 22:07:12 +0000 (05:07 +0700)]
[sr:mediathek] Clarify IE_NAME

7 years ago[extractor/generic] Improve kaltura embed detection (Closes #9911)
Sergey M․ [Sun, 26 Jun 2016 21:11:53 +0000 (04:11 +0700)]
[extractor/generic] Improve kaltura embed detection (Closes #9911)

7 years ago[msn] Add test URL with non-alphanumeric characters
Sergey M․ [Sun, 26 Jun 2016 15:02:46 +0000 (22:02 +0700)]
[msn] Add test URL with non-alphanumeric characters

7 years agorelease 2016.06.26
Sergey M․ [Sun, 26 Jun 2016 14:15:24 +0000 (21:15 +0700)]
release 2016.06.26

7 years ago[msn] Fix extraction (Closes #8960, closes #9542)
Sergey M․ [Sun, 26 Jun 2016 14:10:05 +0000 (21:10 +0700)]
[msn] Fix extraction (Closes #8960, closes #9542)

7 years ago[extractor/common] Fix sorting with custom field preference
Sergey M․ [Sun, 26 Jun 2016 14:09:07 +0000 (21:09 +0700)]
[extractor/common] Fix sorting with custom field preference

7 years ago[MSN] add new extractor
TRox1972 [Thu, 19 May 2016 18:59:59 +0000 (20:59 +0200)]
[MSN] add new extractor

7 years ago[vidbit] Improve (Closes #9759)
Sergey M․ [Sun, 26 Jun 2016 09:59:28 +0000 (16:59 +0700)]
[vidbit] Improve (Closes #9759)

7 years ago[utils] Add support for name list in _html_search_meta
Sergey M․ [Sun, 26 Jun 2016 09:57:14 +0000 (16:57 +0700)]
[utils] Add support for name list in _html_search_meta

7 years ago[Vidbit] Add new extractor
TRox1972 [Sun, 12 Jun 2016 01:18:56 +0000 (03:18 +0200)]
[Vidbit] Add new extractor

7 years ago[iqiyi] Remove codes for debugging
Yen Chi Hsuan [Sun, 26 Jun 2016 07:45:41 +0000 (15:45 +0800)]
[iqiyi] Remove codes for debugging

7 years ago[iqiyi] Partially fix IqiyiIE
Yen Chi Hsuan [Sun, 26 Jun 2016 07:18:32 +0000 (15:18 +0800)]
[iqiyi] Partially fix IqiyiIE

Use the HTML5 API. Only low-resolution formats available

Related: #9839

Thanks @zhangn1985 for the overall algorithm (soimort/you-get#1224)

7 years ago[le] Move urshift() to utils.py
Yen Chi Hsuan [Sun, 26 Jun 2016 07:17:26 +0000 (15:17 +0800)]
[le] Move urshift() to utils.py

7 years ago[utils] Add urshift()
Yen Chi Hsuan [Sun, 26 Jun 2016 07:16:49 +0000 (15:16 +0800)]
[utils] Add urshift()

Used in IqiyiIE and LeIE

7 years ago[generic] Fix test_Generic_76
Yen Chi Hsuan [Sun, 26 Jun 2016 03:54:52 +0000 (11:54 +0800)]
[generic] Fix test_Generic_76

Broken: https://travis-ci.org/rg3/youtube-dl/jobs/140251658

7 years agoFix misspelling
stepshal [Sat, 25 Jun 2016 18:23:48 +0000 (01:23 +0700)]
Fix misspelling

7 years ago[svtplay] Extend _VALID_URL (#9900)
Sergey M․ [Sat, 25 Jun 2016 17:29:53 +0000 (00:29 +0700)]
[svtplay] Extend _VALID_URL (#9900)

7 years ago[iqiyi] Mark broken
Sergey M․ [Sat, 25 Jun 2016 17:25:41 +0000 (00:25 +0700)]
[iqiyi] Mark broken

7 years agoCredit @JakubAdamWieczorek for #9813
Sergey M․ [Sat, 25 Jun 2016 16:35:57 +0000 (23:35 +0700)]
Credit @JakubAdamWieczorek for #9813

7 years ago[polskieradio] Add test with video
Sergey M․ [Sat, 25 Jun 2016 16:31:21 +0000 (23:31 +0700)]
[polskieradio] Add test with video

7 years ago[polskieradio] Improve extraction (Closes #9813)
Sergey M․ [Sat, 25 Jun 2016 16:18:40 +0000 (23:18 +0700)]
[polskieradio] Improve extraction (Closes #9813)

7 years ago[polskieradio] Add support for Polskie Radio.
Jakub Adam Wieczorek [Thu, 16 Jun 2016 19:00:27 +0000 (21:00 +0200)]
[polskieradio] Add support for Polskie Radio.

Polskie Radio is the main Polish state-funded radio broadcasting service.

7 years ago[utils] Add strip_or_none
Sergey M․ [Sat, 25 Jun 2016 15:32:02 +0000 (22:32 +0700)]
[utils] Add strip_or_none

7 years ago[utils] Add unified_timestamp
Sergey M․ [Sat, 25 Jun 2016 15:30:35 +0000 (22:30 +0700)]
[utils] Add unified_timestamp

7 years agorelease 2016.06.25
Sergey M․ [Fri, 24 Jun 2016 20:03:20 +0000 (03:03 +0700)]
release 2016.06.25

7 years ago[setup.py] Add file version information and quotes consistency (Closes #9878)
Sergey M․ [Fri, 24 Jun 2016 19:50:12 +0000 (02:50 +0700)]
[setup.py] Add file version information and quotes consistency (Closes #9878)

7 years ago[youtube] Fix and skip some tests
Sergey M․ [Fri, 24 Jun 2016 15:47:19 +0000 (22:47 +0700)]
[youtube] Fix and skip some tests

7 years ago[youtube] Relax URL expansion in description
Sergey M․ [Fri, 24 Jun 2016 15:37:13 +0000 (22:37 +0700)]
[youtube] Relax URL expansion in description

7 years ago[youtube] Fix 141 format tests
Sergey M․ [Fri, 24 Jun 2016 15:27:55 +0000 (22:27 +0700)]
[youtube] Fix 141 format tests

7 years ago[mixcloud] View count and like count may be absent
Yen Chi Hsuan [Fri, 24 Jun 2016 09:26:12 +0000 (17:26 +0800)]
[mixcloud] View count and like count may be absent

Closes #9874

7 years ago[vimeo:review] Fix extraction for password-protected videos
Yen Chi Hsuan [Fri, 24 Jun 2016 08:48:37 +0000 (16:48 +0800)]
[vimeo:review] Fix extraction for password-protected videos

Closes #9853

7 years ago[appletrailers] correct thumbnail fallback
Remita Amine [Thu, 23 Jun 2016 18:03:34 +0000 (19:03 +0100)]
[appletrailers] correct thumbnail fallback

7 years ago[dcn] extend _VALID_URL for awaan.ae and extract all available formats
Remita Amine [Thu, 23 Jun 2016 16:22:15 +0000 (17:22 +0100)]
[dcn] extend _VALID_URL for awaan.ae and extract all available formats

7 years ago[appletrailers] extract info from an alternative source if available(closes #8422...
Remita Amine [Thu, 23 Jun 2016 14:49:42 +0000 (15:49 +0100)]
[appletrailers] extract info from an alternative source if available(closes #8422)(closes #8422)

7 years ago[tvp] extract all formats and detect erros
Remita Amine [Thu, 23 Jun 2016 03:34:07 +0000 (04:34 +0100)]
[tvp] extract all formats and detect erros

7 years agorelease 2016.06.23.1
Sergey M․ [Thu, 23 Jun 2016 02:42:56 +0000 (09:42 +0700)]
release 2016.06.23.1

7 years ago[jsinterp] Relax JS function regex (Closes #9863)
Sergey M․ [Thu, 23 Jun 2016 02:41:34 +0000 (09:41 +0700)]
[jsinterp] Relax JS function regex (Closes #9863)

7 years ago[nbc:nbcnews] improve extraction and add msnbc to the extractor
Remita Amine [Thu, 23 Jun 2016 00:36:19 +0000 (01:36 +0100)]
[nbc:nbcnews] improve extraction and add msnbc to the extractor

7 years ago[tf1] fix wat id extraction(closes #9862)
Remita Amine [Wed, 22 Jun 2016 23:13:52 +0000 (00:13 +0100)]
[tf1] fix wat id extraction(closes #9862)

7 years agorelease 2016.06.23
Sergey M․ [Wed, 22 Jun 2016 21:29:34 +0000 (04:29 +0700)]
release 2016.06.23

7 years ago[vk] Remove unused import
Sergey M․ [Wed, 22 Jun 2016 21:27:10 +0000 (04:27 +0700)]
[vk] Remove unused import

7 years ago[xnxx] Improve _VALID_URL (Closes #9858)
Sergey M․ [Wed, 22 Jun 2016 21:26:49 +0000 (04:26 +0700)]
[xnxx] Improve _VALID_URL (Closes #9858)

7 years ago[xnxx] Replace test
Sergey M․ [Wed, 22 Jun 2016 21:24:00 +0000 (04:24 +0700)]
[xnxx] Replace test

7 years ago[xnxx] fix url regex
rr- [Wed, 22 Jun 2016 15:24:35 +0000 (17:24 +0200)]
[xnxx] fix url regex

The pattern has changed from "video123412" to "video-o8xa19".
The changes maintain backwards compatibility with old-style URLs.

7 years ago[vk] Modernize
Sergey M․ [Wed, 22 Jun 2016 21:18:43 +0000 (04:18 +0700)]
[vk] Modernize

7 years ago[vk] Workaround buggy new.vk.com Set-Cookie headers
Sergey M․ [Wed, 22 Jun 2016 21:17:13 +0000 (04:17 +0700)]
[vk] Workaround buggy new.vk.com Set-Cookie headers

7 years ago[vimeo:album] Add paged example URL
Sergey M․ [Wed, 22 Jun 2016 19:00:03 +0000 (02:00 +0700)]
[vimeo:album] Add paged example URL

7 years ago[vimeo:album] Impove _VALID_URL
Sergey M․ [Wed, 22 Jun 2016 18:56:58 +0000 (01:56 +0700)]
[vimeo:album] Impove _VALID_URL

7 years ago[vimeo:channel] Improve playlist extraction
Sergey M․ [Wed, 22 Jun 2016 18:28:36 +0000 (01:28 +0700)]
[vimeo:channel] Improve playlist extraction

7 years ago[vimeo:channel] Add video id to url_result
Purdea Andrei [Tue, 21 Jun 2016 21:34:57 +0000 (00:34 +0300)]
[vimeo:channel] Add video id to url_result

This will allow us to decide much faster that we don't want an already archived video,
and will allow having to download webpages for each video that has already been downloaded,
thus significantly speeding up the archival of channels that have no new content.

7 years ago[vimeo] Override original URL only when necessary
Sergey M․ [Wed, 22 Jun 2016 17:51:36 +0000 (00:51 +0700)]
[vimeo] Override original URL only when necessary

7 years agolazy-extractors: Fix after commit 6e6b9f600f2f447604f6108fb6486b73cc25def1
Jaime Marquínez Ferrándiz [Wed, 22 Jun 2016 17:13:46 +0000 (19:13 +0200)]
lazy-extractors: Fix after commit 6e6b9f600f2f447604f6108fb6486b73cc25def1

The problem was in the following code:

    class ArteTVPlus7IE(ArteTVBaseIE):

        ...

        @classmethod
        def suitable(cls, url):
            return False if ArteTVPlaylistIE.suitable(url) else super(ArteTVPlus7IE, cls).suitable(url)

And its sublcasses like ArteTVCinemaIE.

Since in the lazy_extractors.py file ArteTVCinemaIE was not a subclass of ArteTVPlus7IE, super(ArteTVPlus7IE, cls) failed.

To fix it we have to make it a subclass. Since the order of _ALL_CLASSES is arbitrary we must sort them so that the base classes are defined first. We also must add base classes like YoutubeBaseInfoExtractor.

7 years ago[Vine] Extract view count
TRox1972 [Tue, 21 Jun 2016 09:36:54 +0000 (11:36 +0200)]
[Vine] Extract view count

7 years agorelease 2016.06.22
Sergey M․ [Wed, 22 Jun 2016 16:43:24 +0000 (23:43 +0700)]
release 2016.06.22

7 years ago[svt] Various improvements
Sergey M․ [Wed, 22 Jun 2016 16:36:07 +0000 (23:36 +0700)]
[svt] Various improvements

+ [svt:play] Add fallback path looking for video id and fix extraction for oppetarkiv
* [svt:base] Detect geo restriction
* [svt:base] Extract series related metadata

7 years agoFix issue downloading facebook videos
Shai Coleman [Wed, 22 Jun 2016 11:52:15 +0000 (12:52 +0100)]
Fix issue downloading facebook videos

youtube-dl expects the format items to be returned as a list,
but when there's only one item Facebook returns a dict instead,
this wraps the dict in a list if necessary

7 years ago[gametrailers] Remove extractor
Sergey M․ [Tue, 21 Jun 2016 15:31:41 +0000 (22:31 +0700)]
[gametrailers] Remove extractor

gametrailers closed (see http://www.polygon.com/2016/2/8/10944452/gametrailers-shuts-down-after-13-year-run)

7 years ago[gamespot] extract all formats
Remita Amine [Tue, 21 Jun 2016 12:36:56 +0000 (13:36 +0100)]
[gamespot] extract all formats

7 years ago[svt] Fix extraction for SVTPlay (closes #9809)
Yen Chi Hsuan [Tue, 21 Jun 2016 09:55:53 +0000 (17:55 +0800)]
[svt] Fix extraction for SVTPlay (closes #9809)

7 years ago[cbs] Remove unused import
Sergey M․ [Mon, 20 Jun 2016 15:40:33 +0000 (22:40 +0700)]
[cbs] Remove unused import

7 years ago[streamcloud] Capture error message (#9840)
Sergey M․ [Mon, 20 Jun 2016 15:40:22 +0000 (22:40 +0700)]
[streamcloud] Capture error message (#9840)

7 years agorelease 2016.06.20
Sergey M․ [Mon, 20 Jun 2016 13:50:01 +0000 (20:50 +0700)]
release 2016.06.20

7 years ago[downloader/hls] Simplify and carry long lines
Sergey M․ [Mon, 20 Jun 2016 14:55:17 +0000 (21:55 +0700)]
[downloader/hls] Simplify and carry long lines

7 years agoRevert "[jsinterp] Avoid double key lookup for setting new key"
Philipp Hagemeister [Mon, 20 Jun 2016 11:29:13 +0000 (13:29 +0200)]
Revert "[jsinterp] Avoid double key lookup for setting new key"

This reverts commit 7c05097633138459e9bdf7e10738e021b04689a7.

7 years ago[cbs] fix _VALID_URL
Remita Amine [Sun, 19 Jun 2016 22:55:19 +0000 (23:55 +0100)]
[cbs] fix _VALID_URL

7 years ago[cbs,cbsnews,cbssports] reduce requests while extracting all formats
Remita Amine [Sun, 19 Jun 2016 22:40:00 +0000 (23:40 +0100)]
[cbs,cbsnews,cbssports] reduce requests while extracting all formats

7 years ago[theplatform] reduce requests for theplatform feed info extraction
Remita Amine [Sun, 19 Jun 2016 22:37:05 +0000 (23:37 +0100)]
[theplatform] reduce requests for theplatform feed info extraction

7 years ago[radiojavan] PEP8
Yen Chi Hsuan [Sun, 19 Jun 2016 05:32:08 +0000 (13:32 +0800)]
[radiojavan] PEP8

E275 is added in pycodestyle 2.6

See https://github.com/PyCQA/pycodestyle/pull/491

7 years agoMerge pull request #8201 from remitamine/hls-aes
Yen Chi Hsuan [Sun, 19 Jun 2016 05:25:08 +0000 (13:25 +0800)]
Merge pull request #8201 from remitamine/hls-aes

[downloader/hls] Add support for AES-128 encrypted segments in hlsnative downloader

7 years ago[foxsports] extract http formats
Remita Amine [Sun, 19 Jun 2016 04:45:48 +0000 (05:45 +0100)]
[foxsports] extract http formats

7 years ago[downloader/hls] Add support for AES-128 encrypted segments in hlsnative downloader
remitamine [Sun, 10 Jan 2016 19:09:53 +0000 (20:09 +0100)]
[downloader/hls] Add support for AES-128 encrypted segments in hlsnative downloader

7 years agorelease 2016.06.19.1
Sergey M․ [Sat, 18 Jun 2016 20:57:14 +0000 (03:57 +0700)]
release 2016.06.19.1

7 years ago[vimeo] Fix rented videos (Closes #9830)
Sergey M․ [Sat, 18 Jun 2016 20:56:01 +0000 (03:56 +0700)]
[vimeo] Fix rented videos (Closes #9830)

7 years ago[jsinterp] Avoid double key lookup for setting new key
Lucas Moura [Sat, 18 Jun 2016 20:01:47 +0000 (17:01 -0300)]
[jsinterp] Avoid double key lookup for setting new key

In order to add a new key to both __objects and __functions dicts on jsinterp.py, it is
necessary to first verify if a key was present and if not, create the key and
assign it to a value.

However, this can be done with a single step using dict setdefault method.

7 years agorelease 2016.06.19
Sergey M․ [Sat, 18 Jun 2016 19:30:29 +0000 (02:30 +0700)]
release 2016.06.19

7 years ago[r7] Fix extraction and add support for articles (Closes #9826)
Sergey M․ [Sat, 18 Jun 2016 19:25:34 +0000 (02:25 +0700)]
[r7] Fix extraction and add support for articles (Closes #9826)

7 years ago[closertotruth] Update and improve (Closes #8680)
Sergey M․ [Sat, 18 Jun 2016 17:35:29 +0000 (00:35 +0700)]
[closertotruth] Update and improve (Closes #8680)

7 years ago[closertotruth] Add extractor
Steven Gosseling [Fri, 26 Feb 2016 12:31:52 +0000 (13:31 +0100)]
[closertotruth] Add extractor

Removed print statement from code.

Replaced two regex searches with the corret ones.

Removed some unnecessary semicolumns

fixed title extraction

refactored everything to search_regex

processed comments on commit 5650b0d, fixed feedback from flake8

Improved regexes and returns info dict now.

Added support for closertotruth interview URL

Added support for episodes page

7 years ago[arte:+7] Simplify _VALID_URL
Sergey M․ [Sat, 18 Jun 2016 15:23:48 +0000 (22:23 +0700)]
[arte:+7] Simplify _VALID_URL

7 years ago[README.md] Remove 'small' from description (#9814)
Sergey M․ [Sat, 18 Jun 2016 15:08:48 +0000 (22:08 +0700)]
[README.md] Remove 'small' from description (#9814)

7 years ago[arte:+7] Expand _VALID_URL (Closes #9820)
Sergey M․ [Sat, 18 Jun 2016 14:42:17 +0000 (21:42 +0700)]
[arte:+7] Expand _VALID_URL (Closes #9820)

7 years ago[extractors] Update references to sportschau (#9799)
Yen Chi Hsuan [Sat, 18 Jun 2016 05:43:47 +0000 (13:43 +0800)]
[extractors] Update references to sportschau (#9799)

7 years ago[sportschau.de] Fix extraction and moved to its own file (closes #9799)
Yen Chi Hsuan [Sat, 18 Jun 2016 05:42:58 +0000 (13:42 +0800)]
[sportschau.de] Fix extraction and moved to its own file (closes #9799)

7 years ago[ard] Remove SportschauIE, which is now based on WDR (#9799)
Yen Chi Hsuan [Sat, 18 Jun 2016 05:41:50 +0000 (13:41 +0800)]
[ard] Remove SportschauIE, which is now based on WDR (#9799)

7 years ago[wdr] Add WDRBaseIE, for Sportschau (#9799)
Yen Chi Hsuan [Sat, 18 Jun 2016 05:40:55 +0000 (13:40 +0800)]
[wdr] Add WDRBaseIE, for Sportschau (#9799)

7 years ago[br] Skip invalid tests
Yen Chi Hsuan [Sat, 18 Jun 2016 04:53:48 +0000 (12:53 +0800)]
[br] Skip invalid tests

7 years ago[azubu] Don't fail on optional fields
Yen Chi Hsuan [Sat, 18 Jun 2016 04:39:08 +0000 (12:39 +0800)]
[azubu] Don't fail on optional fields

7 years ago[bbc] Skip a geo-restricted test case
Yen Chi Hsuan [Sat, 18 Jun 2016 04:35:55 +0000 (12:35 +0800)]
[bbc] Skip a geo-restricted test case

7 years ago[arte] Update _TESTS and fix for pages with multiple YouTube videos
Yen Chi Hsuan [Sat, 18 Jun 2016 04:34:58 +0000 (12:34 +0800)]
[arte] Update _TESTS and fix for pages with multiple YouTube videos

Some tests are from #6895 and #6613

7 years ago[aftonbladet] Fix extraction
Yen Chi Hsuan [Sat, 18 Jun 2016 04:27:39 +0000 (12:27 +0800)]
[aftonbladet] Fix extraction

7 years ago[adobetv] Use embedded data in the webpage
Yen Chi Hsuan [Sat, 18 Jun 2016 04:21:40 +0000 (12:21 +0800)]
[adobetv] Use embedded data in the webpage

Sometimes the HTML webpage is returned even with '?format=json'

7 years ago[mtvservices] Fix ext for RTMP streams
Yen Chi Hsuan [Sat, 18 Jun 2016 04:19:06 +0000 (12:19 +0800)]
[mtvservices] Fix ext for RTMP streams

7 years ago[bet] Moved to MTVServices
Yen Chi Hsuan [Sat, 18 Jun 2016 04:17:24 +0000 (12:17 +0800)]
[bet] Moved to MTVServices

7 years agorelease 2016.06.18.1
Sergey M․ [Fri, 17 Jun 2016 23:20:34 +0000 (06:20 +0700)]
release 2016.06.18.1

7 years agorelease 2016.06.18
Sergey M․ [Fri, 17 Jun 2016 23:00:05 +0000 (06:00 +0700)]
release 2016.06.18

7 years ago[pornhd] Add working test
Sergey M․ [Fri, 17 Jun 2016 22:50:17 +0000 (05:50 +0700)]
[pornhd] Add working test

7 years ago[pornhd] Detect removed videos and modernize
Sergey M․ [Fri, 17 Jun 2016 22:42:20 +0000 (05:42 +0700)]
[pornhd] Detect removed videos and modernize