youtube-dl
9 years ago[YoutubeDL] only add normal subtitles to the 'requested_subtitles' field if 'writesub...
Jaime Marquínez Ferrándiz [Sun, 22 Feb 2015 10:37:27 +0000 (11:37 +0100)]
[YoutubeDL] only add normal subtitles to the 'requested_subtitles' field if 'writesubtitles' is True

9 years ago[test/YoutubeDL] Add test for subtitles
Jaime Marquínez Ferrándiz [Sun, 22 Feb 2015 10:26:27 +0000 (11:26 +0100)]
[test/YoutubeDL] Add test for subtitles

Updated the offlinetest make target to not skip it

9 years ago[ted] Always extract the subtitles
Jaime Marquínez Ferrándiz [Sat, 21 Feb 2015 21:33:11 +0000 (22:33 +0100)]
[ted] Always extract the subtitles

The required info is already in the webpage

9 years ago[YoutubeDL] don't set the 'requested_subtitles' without writesubtitles or writeautoma...
Jaime Marquínez Ferrándiz [Sat, 21 Feb 2015 21:31:53 +0000 (22:31 +0100)]
[YoutubeDL] don't set the 'requested_subtitles' without writesubtitles or writeautomaticsub

9 years agoRemove the SubtitlesInfoExtractor class
Jaime Marquínez Ferrándiz [Thu, 19 Feb 2015 22:24:24 +0000 (23:24 +0100)]
Remove the SubtitlesInfoExtractor class

No longer needed

9 years ago[bbccouk] Convert to new subtitles system
Jaime Marquínez Ferrándiz [Thu, 19 Feb 2015 15:46:41 +0000 (16:46 +0100)]
[bbccouk] Convert to new subtitles system

I haven't found any video available outside the UK, so I haven't added tests.

I have updated how the srt file is build, because (at least for www.bbc.co.uk/programmes/p02j9b69) the subtitles is inside 'span' elements.

9 years ago[theplatform] Convert to new subtitles system
Jaime Marquínez Ferrándiz [Thu, 19 Feb 2015 13:54:50 +0000 (14:54 +0100)]
[theplatform] Convert to new subtitles system

9 years ago[viki] Convert to new subtitles system
Jaime Marquínez Ferrándiz [Wed, 18 Feb 2015 19:37:16 +0000 (20:37 +0100)]
[viki] Convert to new subtitles system

9 years ago[rai] Convert to new subtitles system
Jaime Marquínez Ferrándiz [Wed, 18 Feb 2015 19:14:42 +0000 (20:14 +0100)]
[rai] Convert to new subtitles system

9 years ago[nrk] Convert to new subtitles system
Jaime Marquínez Ferrándiz [Wed, 18 Feb 2015 17:57:01 +0000 (18:57 +0100)]
[nrk] Convert to new subtitles system

9 years ago[mtv] Convert to new subtitles system
Jaime Marquínez Ferrándiz [Wed, 18 Feb 2015 17:27:45 +0000 (18:27 +0100)]
[mtv] Convert to new subtitles system

9 years ago[npo] Convert to new subtitles system
Jaime Marquínez Ferrándiz [Wed, 18 Feb 2015 16:57:10 +0000 (17:57 +0100)]
[npo] Convert to new subtitles system

9 years ago[lynda] Convert to new subtitles system
Jaime Marquínez Ferrándiz [Wed, 18 Feb 2015 16:46:33 +0000 (17:46 +0100)]
[lynda] Convert to new subtitles system

9 years ago[drtv] Convert to new subtitles system
Jaime Marquínez Ferrándiz [Wed, 18 Feb 2015 16:20:22 +0000 (17:20 +0100)]
[drtv] Convert to new subtitles system

9 years ago[mit] Don't set the subtitles field
Jaime Marquínez Ferrándiz [Wed, 18 Feb 2015 15:54:36 +0000 (16:54 +0100)]
[mit] Don't set the subtitles field

YouTube already provides them in more formats

9 years ago[YoutubeDL] use the 'render_table' function for listing the subtitles
Jaime Marquínez Ferrándiz [Tue, 17 Feb 2015 21:59:19 +0000 (22:59 +0100)]
[YoutubeDL] use the 'render_table' function for listing the subtitles

9 years ago[extractor/common] Simplify subtitles handling methods
Jaime Marquínez Ferrándiz [Tue, 17 Feb 2015 21:16:29 +0000 (22:16 +0100)]
[extractor/common] Simplify subtitles handling methods

Initially I was going to use a single method for handling both subtitles and automatic captions, that's why I used the 'list_subtitles' and the 'subtitles' variables.

9 years ago[bliptv] Convert to new subtitles system
Jaime Marquínez Ferrándiz [Tue, 17 Feb 2015 20:56:25 +0000 (21:56 +0100)]
[bliptv] Convert to new subtitles system

9 years ago[walla] Convert to new subtitles system
Jaime Marquínez Ferrándiz [Tue, 17 Feb 2015 20:23:09 +0000 (21:23 +0100)]
[walla] Convert to new subtitles system

9 years ago[ceskatelevize] Convert to new subtitles system
Jaime Marquínez Ferrándiz [Tue, 17 Feb 2015 20:17:47 +0000 (21:17 +0100)]
[ceskatelevize] Convert to new subtitles system

9 years ago[youtube] Convert to new subtitles system
Jaime Marquínez Ferrándiz [Mon, 16 Feb 2015 20:44:17 +0000 (21:44 +0100)]
[youtube] Convert to new subtitles system

The automatic captions are stored in the 'automactic_captions' field, which is used if no normal subtitles are found for an specific language.

9 years ago[dailymotion] Convert to new subtitles system
Jaime Marquínez Ferrándiz [Mon, 16 Feb 2015 20:28:06 +0000 (21:28 +0100)]
[dailymotion] Convert to new subtitles system

9 years ago[YoutubeDL] store the subtitles to download in the 'requested_subtitles' field
Jaime Marquínez Ferrándiz [Mon, 16 Feb 2015 20:12:31 +0000 (21:12 +0100)]
[YoutubeDL] store the subtitles to download in the 'requested_subtitles' field

We need to keep the orginal subtitles information, so that the '--load-info' option can be used to list or select the subtitles again.
We'll also be able to have a separate field for storing the automatic captions info.

9 years ago[vimeo] Convert to new subtitles system
Jaime Marquínez Ferrándiz [Sun, 15 Feb 2015 17:52:07 +0000 (18:52 +0100)]
[vimeo] Convert to new subtitles system

Removed some tests, the behaviour should be checked in a test for the YoutubeDL class

9 years ago[atresplayer] Convert to new subtitles system
Jaime Marquínez Ferrándiz [Sun, 15 Feb 2015 17:32:40 +0000 (18:32 +0100)]
[atresplayer] Convert to new subtitles system

9 years ago[crunchyroll] Convert to new subtitles system
Jaime Marquínez Ferrándiz [Sun, 15 Feb 2015 17:21:42 +0000 (18:21 +0100)]
[crunchyroll] Convert to new subtitles system

9 years agoImprove subtitles support
Jaime Marquínez Ferrándiz [Sun, 15 Feb 2015 17:03:41 +0000 (18:03 +0100)]
Improve subtitles support

For each language the extractor builds a list with the available formats sorted (like for video formats), then YoutubeDL selects one of them using the '--sub-format' option which now allows giving the format preferences (for example 'ass/srt/best').
For each format the 'url' field can be set so that we only download the contents if needed, or if the contents needs to be processed (like in crunchyroll) the 'data' field can be used.

The reasons for this change are:
* We weren't checking that the format given with '--sub-format' was available, checking it in each extractor would be repetitive.
* It allows to easily support giving a format preference.
* The subtitles were automatically downloaded in the extractor, but I think that if you use for example the '--dump-json' option you want to finish as fast as possible.

Currently only the ted extractor has been updated, but the old system still works.

9 years ago[test/subtitles] Fix some tests
Jaime Marquínez Ferrándiz [Sun, 15 Feb 2015 13:59:00 +0000 (14:59 +0100)]
[test/subtitles] Fix some tests

The checksym for the CeskaTelevize subtitles has changed again, so we just test that it has a reasonable length.

9 years ago[bbccouk] Fix fallback to legacy playlist
Sergey M․ [Sun, 15 Feb 2015 10:32:38 +0000 (16:32 +0600)]
[bbccouk] Fix fallback to legacy playlist

9 years ago[history] Add extractor (Closes #4934)
Sergey M․ [Sat, 14 Feb 2015 22:57:52 +0000 (04:57 +0600)]
[history] Add extractor (Closes #4934)

9 years ago[theplatform] Add URL sign capability
Sergey M․ [Sat, 14 Feb 2015 22:56:12 +0000 (04:56 +0600)]
[theplatform] Add URL sign capability

9 years ago[extractor/common] Fix link to external documentation
Jaime Marquínez Ferrándiz [Sat, 14 Feb 2015 21:20:24 +0000 (22:20 +0100)]
[extractor/common] Fix link to external documentation

9 years agoRemove unused imports
Jaime Marquínez Ferrándiz [Sat, 14 Feb 2015 21:18:09 +0000 (22:18 +0100)]
Remove unused imports

9 years ago[streamcz] Fix extraction (Closes #4940)
Naglis Jonaitis [Sat, 14 Feb 2015 15:48:04 +0000 (17:48 +0200)]
[streamcz] Fix extraction (Closes #4940)

9 years ago[drtuber] Add one more title regex
Sergey M․ [Sat, 14 Feb 2015 12:50:13 +0000 (18:50 +0600)]
[drtuber] Add one more title regex

9 years agoMerge pull request #4951 from peugeot/beeg
Sergey M. [Sat, 14 Feb 2015 12:46:49 +0000 (18:46 +0600)]
Merge pull request #4951 from peugeot/beeg

[beeg] fix test

9 years agoMerge pull request #4950 from peugeot/drtuber
Sergey M. [Sat, 14 Feb 2015 12:46:43 +0000 (18:46 +0600)]
Merge pull request #4950 from peugeot/drtuber

[drtuber] fix extraction

9 years ago[beeg] fix test
peugeot [Sat, 14 Feb 2015 12:42:42 +0000 (13:42 +0100)]
[beeg] fix test

9 years ago[drtuber] fix extraction
peugeot [Sat, 14 Feb 2015 12:40:35 +0000 (13:40 +0100)]
[drtuber] fix extraction

9 years ago[sunporno] Keep old video regex just in case
Sergey M․ [Sat, 14 Feb 2015 12:33:52 +0000 (18:33 +0600)]
[sunporno] Keep old video regex just in case

9 years agoMerge pull request #4949 from peugeot/sunporno
Sergey M. [Sat, 14 Feb 2015 12:32:18 +0000 (18:32 +0600)]
Merge pull request #4949 from peugeot/sunporno

[sunporno] fix extraction

9 years ago[sunporno] fix extraction
peugeot [Sat, 14 Feb 2015 12:29:44 +0000 (13:29 +0100)]
[sunporno] fix extraction

9 years agoCredit @ryandesign for nbcnews nightly news (#4948)
Sergey M․ [Sat, 14 Feb 2015 11:44:24 +0000 (17:44 +0600)]
Credit @ryandesign for nbcnews nightly news (#4948)

9 years agoMerge branch 'ryandesign-nbc-nightly-news'
Sergey M․ [Sat, 14 Feb 2015 11:42:32 +0000 (17:42 +0600)]
Merge branch 'ryandesign-nbc-nightly-news'

9 years ago[nbcnews] Simplify
Sergey M․ [Sat, 14 Feb 2015 11:42:12 +0000 (17:42 +0600)]
[nbcnews] Simplify

9 years agoSupport NBC Nightly News broadcasts
Ryan Schmidt [Sat, 14 Feb 2015 10:10:23 +0000 (04:10 -0600)]
Support NBC Nightly News broadcasts

9 years ago[postprocessor/ffmpeg] Don't let ffmpeg read from stdin (fixes #4945)
Jaime Marquínez Ferrándiz [Fri, 13 Feb 2015 21:25:34 +0000 (22:25 +0100)]
[postprocessor/ffmpeg] Don't let ffmpeg read from stdin (fixes #4945)

If you run 'while read aurl ; do youtube-dl --extract-audio "${aurl}"; done < path_to_batch_file'  (batch_file contains one url per line) each call to youtube-dl consumed some characters and 'read' would assing to 'aurl' a non valid url, something like 'tube.com/watch?v=<id>'.

9 years ago[1tv] Cover arbitraty URLs
Sergey M․ [Fri, 13 Feb 2015 20:04:28 +0000 (02:04 +0600)]
[1tv] Cover arbitraty URLs

9 years ago[camdemy] Fix _VALID_URL
Sergey M․ [Fri, 13 Feb 2015 14:10:42 +0000 (20:10 +0600)]
[camdemy] Fix _VALID_URL

9 years ago[test/subtitles] Update checksums
Jaime Marquínez Ferrándiz [Fri, 13 Feb 2015 13:43:50 +0000 (14:43 +0100)]
[test/subtitles] Update checksums

9 years ago[bambuser] Fix 'uploader_id' extraction (fixes #4944)
Jaime Marquínez Ferrándiz [Fri, 13 Feb 2015 10:36:33 +0000 (11:36 +0100)]
[bambuser] Fix 'uploader_id' extraction (fixes #4944)

9 years agoMerge branch 'robin007bond-nporadio'
Sergey M․ [Thu, 12 Feb 2015 19:37:27 +0000 (01:37 +0600)]
Merge branch 'robin007bond-nporadio'

9 years ago[npo:radio] Move to extractor to common npo place and add extractor for fragments
Sergey M․ [Thu, 12 Feb 2015 19:36:54 +0000 (01:36 +0600)]
[npo:radio] Move to extractor to common npo place and add extractor for fragments

9 years ago[nporadio] Edit to confirm to flake8 standards
robin [Thu, 12 Feb 2015 18:27:59 +0000 (19:27 +0100)]
[nporadio] Edit to confirm to flake8 standards

9 years ago[NPORadio] Added extractor for live radio
robin [Thu, 12 Feb 2015 18:19:55 +0000 (19:19 +0100)]
[NPORadio] Added extractor for live radio

9 years ago[camdemy] Simplify and make more robust (#4938)
Philipp Hagemeister [Thu, 12 Feb 2015 07:55:06 +0000 (08:55 +0100)]
[camdemy] Simplify and make more robust (#4938)

Do not throw errors if view count or upload date extraction fails.
Dispose of re.MULTILINE, which had absolutely no effect without any ^ or $ in sight.
Follow PEP8 naming conventions.

9 years agoMerge remote-tracking branch 'yan12125/IE_camdemy'
Philipp Hagemeister [Thu, 12 Feb 2015 07:44:39 +0000 (08:44 +0100)]
Merge remote-tracking branch 'yan12125/IE_camdemy'

9 years ago[camdemy] Python2 compatibility
Yen Chi Hsuan [Thu, 12 Feb 2015 06:23:25 +0000 (14:23 +0800)]
[camdemy] Python2 compatibility

9 years ago[camdemy] Add support for folders
Yen Chi Hsuan [Thu, 12 Feb 2015 06:13:19 +0000 (14:13 +0800)]
[camdemy] Add support for folders

9 years agorelease 2015.02.11
Philipp Hagemeister [Wed, 11 Feb 2015 18:02:39 +0000 (19:02 +0100)]
release 2015.02.11

9 years ago[youtube] Extract average rating (closes #2362)
Jaime Marquínez Ferrándiz [Wed, 11 Feb 2015 17:39:31 +0000 (18:39 +0100)]
[youtube] Extract average rating (closes #2362)

9 years agoflake8: Ignore some error added in pep8 1.6
Jaime Marquínez Ferrándiz [Wed, 11 Feb 2015 17:08:42 +0000 (18:08 +0100)]
flake8: Ignore some error added in pep8 1.6

* E402: we exectute code between imports, like modifying 'sys.path' in the tests
* E731: we assign to lambdas in a lot of places, we may want to consider defining functions in a single line instead (what pep8 recommends)

9 years ago[aes] style: Put __all__ variable at the end of the file
Jaime Marquínez Ferrándiz [Wed, 11 Feb 2015 17:07:12 +0000 (18:07 +0100)]
[aes] style: Put __all__ variable at the end of the file

9 years ago[dotsub] Fix extraction and modernize
Sergey M․ [Wed, 11 Feb 2015 16:33:03 +0000 (22:33 +0600)]
[dotsub] Fix extraction and modernize

9 years ago[test/parameters.json] Set 'fixup' to 'never'
Jaime Marquínez Ferrándiz [Wed, 11 Feb 2015 16:25:04 +0000 (17:25 +0100)]
[test/parameters.json] Set 'fixup' to 'never'

The fixed audio files for Youtube have a size lower that the minimum required.

9 years ago[camdemy] Detection of external sources
Yen Chi Hsuan [Wed, 11 Feb 2015 16:11:33 +0000 (00:11 +0800)]
[camdemy] Detection of external sources

9 years ago[dctptv] Skip rtmp download
Sergey M․ [Wed, 11 Feb 2015 16:10:33 +0000 (22:10 +0600)]
[dctptv] Skip rtmp download

9 years ago[canalplus] Add support for itele.fr URLs (Closes #4931)
Naglis Jonaitis [Wed, 11 Feb 2015 14:21:52 +0000 (16:21 +0200)]
[canalplus] Add support for itele.fr URLs (Closes #4931)

9 years ago[teamcoco] Fix video id extraction
Naglis Jonaitis [Wed, 11 Feb 2015 13:47:19 +0000 (15:47 +0200)]
[teamcoco] Fix video id extraction

9 years ago[camdemy] Add new extractor
Yen Chi Hsuan [Wed, 11 Feb 2015 08:39:15 +0000 (16:39 +0800)]
[camdemy] Add new extractor

Single file download done, while folder extaction in plan

9 years ago[ntvru] Adapt to new direct delivery and modernize (Closes #4918)
Sergey M․ [Tue, 10 Feb 2015 15:35:34 +0000 (21:35 +0600)]
[ntvru] Adapt to new direct delivery and modernize (Closes #4918)

9 years agorelease 2015.02.10.5
Philipp Hagemeister [Tue, 10 Feb 2015 14:56:04 +0000 (15:56 +0100)]
release 2015.02.10.5

9 years ago[escapist] Filter video differently (Fixes #4919)
Philipp Hagemeister [Tue, 10 Feb 2015 14:55:51 +0000 (15:55 +0100)]
[escapist] Filter video differently (Fixes #4919)

9 years ago[escapist] Modernize
Philipp Hagemeister [Tue, 10 Feb 2015 14:45:36 +0000 (15:45 +0100)]
[escapist] Modernize

9 years agorelease 2015.02.10.4
Philipp Hagemeister [Tue, 10 Feb 2015 10:28:34 +0000 (11:28 +0100)]
release 2015.02.10.4

9 years ago[YoutubeDL] Do not perform filter matching on partial results (Fixes #4921)
Philipp Hagemeister [Tue, 10 Feb 2015 10:28:28 +0000 (11:28 +0100)]
[YoutubeDL] Do not perform filter matching on partial results (Fixes #4921)

9 years agorelease 2015.02.10.3
Philipp Hagemeister [Tue, 10 Feb 2015 04:42:47 +0000 (05:42 +0100)]
release 2015.02.10.3

9 years ago[ccc] Add new extractor (Fixes #4890)
Philipp Hagemeister [Tue, 10 Feb 2015 04:42:41 +0000 (05:42 +0100)]
[ccc] Add new extractor (Fixes #4890)

9 years ago[test/test_youtube_signature] Use fake YDL
Philipp Hagemeister [Tue, 10 Feb 2015 04:28:59 +0000 (05:28 +0100)]
[test/test_youtube_signature] Use fake YDL

9 years ago[firstpost] Modernize
Philipp Hagemeister [Tue, 10 Feb 2015 04:28:48 +0000 (05:28 +0100)]
[firstpost] Modernize

9 years ago[vimeo:album] Add support for album passwords (Fixes #4917)
Philipp Hagemeister [Tue, 10 Feb 2015 03:53:21 +0000 (04:53 +0100)]
[vimeo:album] Add support for album passwords (Fixes #4917)

9 years ago[options] Add alias --dump-header for --print-traffic
Philipp Hagemeister [Tue, 10 Feb 2015 03:52:33 +0000 (04:52 +0100)]
[options] Add alias --dump-header for --print-traffic

9 years ago[options] Add --no-color
Philipp Hagemeister [Tue, 10 Feb 2015 03:22:10 +0000 (04:22 +0100)]
[options] Add --no-color

9 years ago[pornhd] Fix extraction (fixes #4915)
Philipp Hagemeister [Tue, 10 Feb 2015 02:41:31 +0000 (03:41 +0100)]
[pornhd] Fix extraction (fixes #4915)

9 years agorelease 2015.02.10.2
Philipp Hagemeister [Tue, 10 Feb 2015 02:32:55 +0000 (03:32 +0100)]
release 2015.02.10.2

9 years ago[YoutubeDL] Add generic video filtering (Fixes #4916)
Philipp Hagemeister [Tue, 10 Feb 2015 02:32:21 +0000 (03:32 +0100)]
[YoutubeDL] Add generic video filtering (Fixes #4916)

This functionality is intended to eventually encompass the current format filtering.

9 years agorelease 2015.02.10.1
Philipp Hagemeister [Tue, 10 Feb 2015 00:46:09 +0000 (01:46 +0100)]
release 2015.02.10.1

9 years ago[commonmistakes] Detect BOMs at the beginning of URLs
Philipp Hagemeister [Tue, 10 Feb 2015 00:39:43 +0000 (01:39 +0100)]
[commonmistakes] Detect BOMs at the beginning of URLs

Reported at https://bugzilla.redhat.com/show_bug.cgi?id=1093517 .

9 years ago[bandcamp] Correct variable name
Philipp Hagemeister [Tue, 10 Feb 2015 00:37:14 +0000 (01:37 +0100)]
[bandcamp] Correct variable name

9 years agoUse snake_case instead of camelCase
Philipp Hagemeister [Tue, 10 Feb 2015 00:36:38 +0000 (01:36 +0100)]
Use snake_case instead of camelCase

9 years ago[commonmistakes] Correct logic error
Philipp Hagemeister [Tue, 10 Feb 2015 00:34:01 +0000 (01:34 +0100)]
[commonmistakes] Correct logic error

9 years agorelease 2015.02.10
Philipp Hagemeister [Tue, 10 Feb 2015 00:19:52 +0000 (01:19 +0100)]
release 2015.02.10

9 years ago[extractor/common] Wrap extractor errors (Fixes #1194)
Philipp Hagemeister [Tue, 10 Feb 2015 00:13:57 +0000 (01:13 +0100)]
[extractor/common] Wrap extractor errors (Fixes #1194)

For now, we just wrap some common errors. More may follow. We do not want to catch actual programming errors in the extractors, such as 1 // 0.

9 years ago[bandcamp] Use our API to get more stable error messages (#1194)
Philipp Hagemeister [Mon, 9 Feb 2015 18:08:51 +0000 (19:08 +0100)]
[bandcamp] Use our API to get more stable error messages (#1194)

9 years ago[svtplay] Correct test case
Philipp Hagemeister [Mon, 9 Feb 2015 15:05:01 +0000 (16:05 +0100)]
[svtplay] Correct test case

9 years agorelease 2015.02.09.3
Philipp Hagemeister [Mon, 9 Feb 2015 14:59:19 +0000 (15:59 +0100)]
release 2015.02.09.3

9 years agoMerge branch 'master' of github.com:rg3/youtube-dl
Philipp Hagemeister [Mon, 9 Feb 2015 14:59:14 +0000 (15:59 +0100)]
Merge branch 'master' of github.com:rg3/youtube-dl

9 years ago[trilulilu] Add support for videos without category in the URL (Closes #4067)
Naglis Jonaitis [Mon, 9 Feb 2015 14:55:31 +0000 (16:55 +0200)]
[trilulilu] Add support for videos without category in the URL (Closes #4067)

Also, update the testcase, detect private/country restricted videos and modernize a bit.

9 years ago[YoutubeDL] Do not show worst in --list-formats output
Philipp Hagemeister [Mon, 9 Feb 2015 14:57:40 +0000 (15:57 +0100)]
[YoutubeDL] Do not show worst in --list-formats output

Nobody wants to know what the worst possible format is. And if they do, they can still provide -f worst.

9 years ago[svtplay] Add new extractor (Fixes #4914)
Philipp Hagemeister [Mon, 9 Feb 2015 14:56:46 +0000 (15:56 +0100)]
[svtplay] Add new extractor (Fixes #4914)