youtube-dl
10 years ago[setup.py] Only print a warning if documentation files are missing (Fixes #780)
Philipp Hagemeister [Mon, 27 Jan 2014 05:22:15 +0000 (06:22 +0100)]
[setup.py] Only print a warning if documentation files are missing (Fixes #780)

10 years ago[huffpost] Add support
Philipp Hagemeister [Mon, 27 Jan 2014 04:47:30 +0000 (05:47 +0100)]
[huffpost] Add support

10 years agoMerge pull request #2221 from Rudloff/master
Philipp Hagemeister [Mon, 27 Jan 2014 02:03:26 +0000 (18:03 -0800)]
Merge pull request #2221 from Rudloff/master

Removed websurg extractor

10 years ago[youtube] Encode the data when submitting the form for confirming the age
Jaime Marquínez Ferrándiz [Sat, 25 Jan 2014 16:22:41 +0000 (17:22 +0100)]
[youtube] Encode the data when submitting the form for confirming the age

Needed on python 3

10 years ago[youtube] Use https: in more urls
Jaime Marquínez Ferrándiz [Sat, 25 Jan 2014 16:11:55 +0000 (17:11 +0100)]
[youtube] Use https: in more urls

10 years ago[test/youtube_lists] Change the list used for testing the Top Lists extractor
Jaime Marquínez Ferrándiz [Sat, 25 Jan 2014 15:55:59 +0000 (16:55 +0100)]
[test/youtube_lists] Change the list used for testing the Top Lists extractor

The ‘Top tracks’ list is not always present in the channel page

10 years ago[youtube:toplist] Make the regex for finding the playlist link more flexible
Jaime Marquínez Ferrándiz [Sat, 25 Jan 2014 14:47:03 +0000 (15:47 +0100)]
[youtube:toplist] Make the regex for finding the playlist link more flexible

`title={foo}` may not be at the end of the `href` string.

10 years agoSome pep8 style fixes
Jaime Marquínez Ferrándiz [Sat, 25 Jan 2014 11:02:43 +0000 (12:02 +0100)]
Some pep8 style fixes

10 years ago[extractor/common] Encode the url when calculating the md5 with `—write-pages` option
Jaime Marquínez Ferrándiz [Sat, 25 Jan 2014 14:31:58 +0000 (15:31 +0100)]
[extractor/common] Encode the url when calculating the md5 with `—write-pages` option

This doesn’t cause any problem in python 2.*, but on python 3 the `md5` function only accepts bytes.

10 years ago[rtlnow] Simplify
Philipp Hagemeister [Sat, 25 Jan 2014 13:18:54 +0000 (14:18 +0100)]
[rtlnow] Simplify

10 years agoProperly escape ‘.’ in some _VALID_URL properties
Jaime Marquínez Ferrándiz [Sat, 25 Jan 2014 10:48:08 +0000 (11:48 +0100)]
Properly escape ‘.’ in some _VALID_URL properties

10 years agoAdd an extractor for freespeech.org (closes #2234)
Jaime Marquínez Ferrándiz [Sat, 25 Jan 2014 10:31:30 +0000 (11:31 +0100)]
Add an extractor for freespeech.org (closes #2234)

10 years agorelease 2014.01.23.4
Philipp Hagemeister [Thu, 23 Jan 2014 23:06:55 +0000 (00:06 +0100)]
release 2014.01.23.4

10 years ago[youtube] Fix new formats
Philipp Hagemeister [Thu, 23 Jan 2014 23:06:26 +0000 (00:06 +0100)]
[youtube] Fix new formats

10 years agorelease 2014.01.23.3
Philipp Hagemeister [Thu, 23 Jan 2014 22:55:53 +0000 (23:55 +0100)]
release 2014.01.23.3

10 years ago[youtube] Add new formats (Fixes #2221)
Philipp Hagemeister [Thu, 23 Jan 2014 22:54:06 +0000 (23:54 +0100)]
[youtube] Add new formats (Fixes #2221)

10 years agoRemoved websurg extractor
Pierre Rudloff [Thu, 23 Jan 2014 22:42:34 +0000 (23:42 +0100)]
Removed websurg extractor

10 years agoAdd build instructions (Fixes #2218)
Philipp Hagemeister [Thu, 23 Jan 2014 22:28:29 +0000 (23:28 +0100)]
Add build instructions (Fixes #2218)

10 years ago[youtube] Do not break upon unknown formats
Philipp Hagemeister [Thu, 23 Jan 2014 22:21:42 +0000 (23:21 +0100)]
[youtube] Do not break upon unknown formats

10 years agorelease 2014.01.23.2
Philipp Hagemeister [Thu, 23 Jan 2014 18:05:05 +0000 (19:05 +0100)]
release 2014.01.23.2

10 years agoDo not count unmatched videos for --max-downloads (Fixes #2211)
Philipp Hagemeister [Thu, 23 Jan 2014 17:56:36 +0000 (18:56 +0100)]
Do not count unmatched videos for --max-downloads (Fixes #2211)

10 years agoMention default for -f (Fixes #2215)
Philipp Hagemeister [Thu, 23 Jan 2014 17:50:04 +0000 (18:50 +0100)]
Mention default for -f (Fixes #2215)

10 years ago[youtube:truncated_url] Also match mail subscription links (#2214)
Philipp Hagemeister [Thu, 23 Jan 2014 15:14:54 +0000 (16:14 +0100)]
[youtube:truncated_url] Also match mail subscription links (#2214)

10 years ago[sina] Recognize http://video.sina.com.cn/v/b/{id}-*.html urls (fixes #2212)
Jaime Marquínez Ferrándiz [Thu, 23 Jan 2014 13:03:14 +0000 (14:03 +0100)]
[sina] Recognize video.sina.com.cn/v/b/{id}-*.html urls (fixes #2212)

10 years ago[sina] use unicode_literals
Jaime Marquínez Ferrándiz [Thu, 23 Jan 2014 13:00:29 +0000 (14:00 +0100)]
[sina] use unicode_literals

10 years agorelease 2014.01.23.1
Philipp Hagemeister [Thu, 23 Jan 2014 09:37:34 +0000 (10:37 +0100)]
release 2014.01.23.1

10 years agoCorrect --max-downloads with --ignore-errors
Philipp Hagemeister [Thu, 23 Jan 2014 09:36:47 +0000 (10:36 +0100)]
Correct --max-downloads with --ignore-errors

10 years agoClarify update output (Fixes #2205)
Philipp Hagemeister [Thu, 23 Jan 2014 09:24:44 +0000 (10:24 +0100)]
Clarify update output (Fixes #2205)

No, we are not intentionally hiding the version number. Why would we?

10 years ago[rottentomatoes] Use unicode_literals
Philipp Hagemeister [Thu, 23 Jan 2014 03:05:58 +0000 (04:05 +0100)]
[rottentomatoes] Use unicode_literals

10 years ago[xhamster] Futher simplification
Philipp Hagemeister [Thu, 23 Jan 2014 03:04:35 +0000 (04:04 +0100)]
[xhamster] Futher simplification

10 years ago[xhamster] Use unicode_literals
Philipp Hagemeister [Thu, 23 Jan 2014 02:52:59 +0000 (03:52 +0100)]
[xhamster] Use unicode_literals

10 years ago[xhamster] Add support for hd video
Mike Col [Thu, 23 Jan 2014 02:51:09 +0000 (03:51 +0100)]
[xhamster] Add support for hd video

Signed-off-by: Philipp Hagemeister <phihag@phihag.de>
10 years agorelease 2014.01.23
Philipp Hagemeister [Wed, 22 Jan 2014 23:13:00 +0000 (00:13 +0100)]
release 2014.01.23

10 years ago[nowness] Add support
Philipp Hagemeister [Wed, 22 Jan 2014 23:12:47 +0000 (00:12 +0100)]
[nowness] Add support

10 years ago[gamespot] Fix regexp
Philipp Hagemeister [Wed, 22 Jan 2014 21:31:19 +0000 (22:31 +0100)]
[gamespot] Fix regexp

10 years agoMove --youtube-include-dash-manifest into correct option group
Philipp Hagemeister [Wed, 22 Jan 2014 21:17:53 +0000 (22:17 +0100)]
Move --youtube-include-dash-manifest into correct option group

10 years agorelease 2014.01.22.5
Philipp Hagemeister [Wed, 22 Jan 2014 20:57:17 +0000 (21:57 +0100)]
release 2014.01.22.5

10 years ago[youtube] Make DASH manifest download conditional for now
Philipp Hagemeister [Wed, 22 Jan 2014 20:56:37 +0000 (21:56 +0100)]
[youtube] Make DASH manifest download conditional for now

DASH download fails on many videos (all with encrypted signatures? not sure yet), for example 07FYdnEawAQ, with a 403.

10 years agoAdd __len__ to PagedLists
Philipp Hagemeister [Wed, 22 Jan 2014 20:43:33 +0000 (21:43 +0100)]
Add __len__ to PagedLists

10 years ago[newgrounds] Simplify
Philipp Hagemeister [Wed, 22 Jan 2014 20:41:28 +0000 (21:41 +0100)]
[newgrounds] Simplify

10 years agorelease 2014.01.22.4
Philipp Hagemeister [Wed, 22 Jan 2014 20:01:52 +0000 (21:01 +0100)]
release 2014.01.22.4

10 years agoMerge branch 'paged-lists'
Philipp Hagemeister [Wed, 22 Jan 2014 19:00:16 +0000 (20:00 +0100)]
Merge branch 'paged-lists'

Conflicts:
test/test_utils.py
youtube_dl/extractor/youtube.py

10 years agoMerge branch 'youtube-dash-manifest'
Philipp Hagemeister [Wed, 22 Jan 2014 18:58:31 +0000 (19:58 +0100)]
Merge branch 'youtube-dash-manifest'

Conflicts:
youtube_dl/extractor/youtube.py

10 years ago[xvideos] Simplify
Philipp Hagemeister [Wed, 22 Jan 2014 18:02:48 +0000 (19:02 +0100)]
[xvideos] Simplify

10 years ago[xvideos] Fix thumbnail extraction
Mike Col [Wed, 22 Jan 2014 18:01:41 +0000 (19:01 +0100)]
[xvideos] Fix thumbnail extraction

Signed-off-by: Philipp Hagemeister <phihag@phihag.de>
10 years ago[cspan] Disable test
Philipp Hagemeister [Wed, 22 Jan 2014 14:10:00 +0000 (15:10 +0100)]
[cspan] Disable test

It works fine from all my machines, no matter where, but from travis, we get lots of 403s.
Maybe another project is scraping CSPAN from travis and they're blocking the travis machines?

10 years agoDocument -f worstaudio as well
Philipp Hagemeister [Wed, 22 Jan 2014 13:55:45 +0000 (14:55 +0100)]
Document -f worstaudio as well

10 years agorelease 2014.01.22.3
Philipp Hagemeister [Wed, 22 Jan 2014 13:53:36 +0000 (14:53 +0100)]
release 2014.01.22.3

10 years agoDefault to -f best-audio when only audio is requested
Philipp Hagemeister [Wed, 22 Jan 2014 13:53:23 +0000 (14:53 +0100)]
Default to -f best-audio when only audio is requested

10 years agoUse unicode_literals in test_YoutubeDL
Philipp Hagemeister [Wed, 22 Jan 2014 13:47:58 +0000 (14:47 +0100)]
Use unicode_literals in test_YoutubeDL

10 years agoAdd -f bestaudio (Fixes #2163)
Philipp Hagemeister [Wed, 22 Jan 2014 13:47:29 +0000 (14:47 +0100)]
Add -f bestaudio (Fixes #2163)

10 years agorelease 2014.01.22.2
Philipp Hagemeister [Wed, 22 Jan 2014 13:33:16 +0000 (14:33 +0100)]
release 2014.01.22.2

10 years agoAdd new --default-search option (#2193)
Philipp Hagemeister [Wed, 22 Jan 2014 13:16:43 +0000 (14:16 +0100)]
Add new --default-search option (#2193)

10 years ago[comedycentral] Use the generic `_real_extract` provided by the base class
Jaime Marquínez Ferrándiz [Wed, 22 Jan 2014 10:44:26 +0000 (11:44 +0100)]
[comedycentral] Use the generic `_real_extract` provided by the base class

10 years agoMerge pull request #2195 from dstftw/master
Jaime Marquínez Ferrándiz [Wed, 22 Jan 2014 10:39:17 +0000 (02:39 -0800)]
Merge pull request #2195 from dstftw/master

[space] Add support for mobile URLs

10 years ago[southparkstudios] Use the generic `_real_extract` provided by the base class
Jaime Marquínez Ferrándiz [Wed, 22 Jan 2014 10:35:17 +0000 (11:35 +0100)]
[southparkstudios] Use the generic `_real_extract` provided by the base class

10 years ago[space] Add support for mobile URLs
dst [Wed, 22 Jan 2014 10:25:32 +0000 (17:25 +0700)]
[space] Add support for mobile URLs

10 years ago[cspan] Make ‘www’ optional and improve the regex for extracting the id (fixes #2194)
Jaime Marquínez Ferrándiz [Wed, 22 Jan 2014 10:06:03 +0000 (11:06 +0100)]
[cspan] Make ‘www’ optional and improve the regex for extracting the id (fixes #2194)

10 years ago[gametrailers] Use the generic `_real_extract` provided by the base class
Jaime Marquínez Ferrándiz [Wed, 22 Jan 2014 09:51:17 +0000 (10:51 +0100)]
[gametrailers] Use the generic `_real_extract` provided by the base class

10 years ago[comedycentral] Use unicode_literals
Philipp Hagemeister [Wed, 22 Jan 2014 02:50:49 +0000 (03:50 +0100)]
[comedycentral] Use unicode_literals

10 years ago[comedycentral] Adapt testcase
Philipp Hagemeister [Wed, 22 Jan 2014 02:49:16 +0000 (03:49 +0100)]
[comedycentral] Adapt testcase

In contrast to other sites, ComedyCentral seems to understand how to sensibly use MTV IE, but the additional text shouldn't hurt.

10 years ago[imdb:list] Switch to loading the webpage
Philipp Hagemeister [Wed, 22 Jan 2014 02:41:19 +0000 (03:41 +0100)]
[imdb:list] Switch to loading the webpage

The RSS method seems to be defunct.

10 years ago[d8] typo
Philipp Hagemeister [Wed, 22 Jan 2014 02:10:31 +0000 (03:10 +0100)]
[d8] typo

10 years ago[d8] disable test; video got deleted
Philipp Hagemeister [Wed, 22 Jan 2014 02:09:21 +0000 (03:09 +0100)]
[d8] disable test; video got deleted

10 years ago[novamov] Skip tests
Philipp Hagemeister [Wed, 22 Jan 2014 02:04:10 +0000 (03:04 +0100)]
[novamov] Skip tests

10 years agorelease 2014.01.22.1
Philipp Hagemeister [Wed, 22 Jan 2014 01:17:00 +0000 (02:17 +0100)]
release 2014.01.22.1

10 years ago[ringtv] Fix and add news extraction
Philipp Hagemeister [Wed, 22 Jan 2014 01:16:40 +0000 (02:16 +0100)]
[ringtv] Fix and add news extraction

10 years ago[mtv] Update tests and xpath function for new title extraction
Philipp Hagemeister [Wed, 22 Jan 2014 01:04:51 +0000 (02:04 +0100)]
[mtv] Update tests and xpath function for new title extraction

10 years ago[Wimp] Use new URL relay method
Philipp Hagemeister [Wed, 22 Jan 2014 01:01:23 +0000 (02:01 +0100)]
[Wimp] Use new URL relay method

10 years ago[hotnewhiphop] Retrieve media key
Philipp Hagemeister [Wed, 22 Jan 2014 00:55:50 +0000 (01:55 +0100)]
[hotnewhiphop] Retrieve media key

10 years ago[gametrailers/mtv] Fix pre-3.x compatibility function for find_xpath_attr
Philipp Hagemeister [Wed, 22 Jan 2014 00:04:07 +0000 (01:04 +0100)]
[gametrailers/mtv] Fix pre-3.x compatibility function for find_xpath_attr

Fixes #2189

10 years ago[servingsys] Do not run test on travis
Philipp Hagemeister [Tue, 21 Jan 2014 23:27:17 +0000 (00:27 +0100)]
[servingsys] Do not run test on travis

Apparantly, even the advertisers do geoblocking now!?
From the US, this isn't outright blocked, but there are no videos returned.

10 years agorelease 2014.01.22
Philipp Hagemeister [Tue, 21 Jan 2014 23:21:41 +0000 (00:21 +0100)]
release 2014.01.22

10 years agoMerge branch 'master' of github.com:rg3/youtube-dl
Philipp Hagemeister [Tue, 21 Jan 2014 23:21:27 +0000 (00:21 +0100)]
Merge branch 'master' of github.com:rg3/youtube-dl

Conflicts:
youtube_dl/extractor/mtv.py

10 years ago[gametrailers] Use unicode_literals
Philipp Hagemeister [Tue, 21 Jan 2014 23:03:46 +0000 (00:03 +0100)]
[gametrailers] Use unicode_literals

Conflicts:
youtube_dl/extractor/gametrailers.py

10 years ago[mtv] Use unicode_literals
Philipp Hagemeister [Tue, 21 Jan 2014 23:07:02 +0000 (00:07 +0100)]
[mtv] Use unicode_literals

10 years ago[mtv] Fix title for gametrailers (Fixes #2188)
Philipp Hagemeister [Tue, 21 Jan 2014 23:17:33 +0000 (00:17 +0100)]
[mtv] Fix title for gametrailers (Fixes #2188)

We now prefer the title including the category, because that title is what is presented at the actual sites.

10 years ago[brightcove] Fix extraction of embedded videos
Jaime Marquínez Ferrándiz [Tue, 21 Jan 2014 21:04:46 +0000 (22:04 +0100)]
[brightcove] Fix extraction of embedded videos

There was a leading ‘:’ in the regex.
The ‘flashvars’ parameter is not always available.

10 years ago[brightcove] Fix check for url in the result
Jaime Marquínez Ferrándiz [Tue, 21 Jan 2014 20:53:10 +0000 (21:53 +0100)]
[brightcove] Fix check for url in the result

It may have the ‘formats’ field instead of ‘url’.

10 years ago[mtv] Add an extractor for mtviggy.com (#2072)
Jaime Marquínez Ferrándiz [Tue, 21 Jan 2014 19:59:31 +0000 (20:59 +0100)]
[mtv] Add an extractor for mtviggy.com (#2072)

10 years agoAdd an extractor for spike.com (#2072)
Jaime Marquínez Ferrándiz [Tue, 21 Jan 2014 19:54:47 +0000 (20:54 +0100)]
Add an extractor for spike.com (#2072)

Added a generic _real_extract to MTVServicesInfoExtractor

10 years ago[mtv] Check for geo-blocked videos in the xml document, not in the xml’s string
Jaime Marquínez Ferrándiz [Tue, 21 Jan 2014 18:57:38 +0000 (19:57 +0100)]
[mtv] Check for geo-blocked videos in the xml document, not in the xml’s string

Allows to use the `_download_xml` method

10 years ago[mtv] Use unicode_literals
Jaime Marquínez Ferrándiz [Tue, 21 Jan 2014 18:44:47 +0000 (19:44 +0100)]
[mtv] Use unicode_literals

10 years agorelease 2014.01.21.1
Philipp Hagemeister [Tue, 21 Jan 2014 17:21:53 +0000 (18:21 +0100)]
release 2014.01.21.1

10 years ago[vk] Add support for HQ videos (Fixes #2187)
Philipp Hagemeister [Tue, 21 Jan 2014 17:21:44 +0000 (18:21 +0100)]
[vk] Add support for HQ videos (Fixes #2187)

10 years ago[facebook] Add support for embeds
Philipp Hagemeister [Tue, 21 Jan 2014 17:10:14 +0000 (18:10 +0100)]
[facebook] Add support for embeds

Example URL: http://www.hostblogger.de/blog/archives/6181-Auto-jagt-Betonmischer.html

10 years ago[vk] Use unicode_literals
Philipp Hagemeister [Tue, 21 Jan 2014 16:32:03 +0000 (17:32 +0100)]
[vk] Use unicode_literals

10 years ago[vk] avoid built-in names
Philipp Hagemeister [Tue, 21 Jan 2014 16:29:04 +0000 (17:29 +0100)]
[vk] avoid built-in names

10 years ago[redtube] Use unicode_literals
Philipp Hagemeister [Tue, 21 Jan 2014 13:16:44 +0000 (14:16 +0100)]
[redtube] Use unicode_literals

10 years ago[redtube] Add support for thumbnails
Mike Col [Tue, 21 Jan 2014 13:12:59 +0000 (14:12 +0100)]
[redtube] Add support for thumbnails

Signed-off-by: Philipp Hagemeister <phihag@phihag.de>
10 years agorelease 2014.01.21
Philipp Hagemeister [Tue, 21 Jan 2014 13:07:41 +0000 (14:07 +0100)]
release 2014.01.21

10 years ago[servingsys] Add support
Philipp Hagemeister [Tue, 21 Jan 2014 01:09:49 +0000 (02:09 +0100)]
[servingsys] Add support

This also adds support for brightcove advertisements.
Fixes #2181

10 years ago[extractor/common] Clarify when and when not we generate the filename
Philipp Hagemeister [Tue, 21 Jan 2014 00:41:13 +0000 (01:41 +0100)]
[extractor/common] Clarify when and when not we generate the filename

10 years ago[generic] Improve testcase
Philipp Hagemeister [Tue, 21 Jan 2014 00:40:34 +0000 (01:40 +0100)]
[generic] Improve testcase

10 years agoDeal with implicitly UTF-16 decoded webpages
Philipp Hagemeister [Tue, 21 Jan 2014 00:39:39 +0000 (01:39 +0100)]
Deal with implicitly UTF-16 decoded webpages

These webpages don't specify an encoding and rely on the BOM

10 years agoCorrect XML ampersand fixup
Philipp Hagemeister [Mon, 20 Jan 2014 21:11:34 +0000 (22:11 +0100)]
Correct XML ampersand fixup

10 years agorelease 2014.01.20
Philipp Hagemeister [Mon, 20 Jan 2014 10:44:37 +0000 (11:44 +0100)]
release 2014.01.20

10 years agoAdd infrastructure for paged lists
Philipp Hagemeister [Mon, 20 Jan 2014 10:36:47 +0000 (11:36 +0100)]
Add infrastructure for paged lists

This commit allows to download pages in playlists as needed instead of all at once.
Before this commit,
    youtube-dl http://www.youtube.com/user/ANNnewsCH/videos --playlist-end 2 --skip-download
took quite some time - now it's almost instantaneous.
As an example, the youtube:user extractor has been converted.
Fixes #2175

10 years ago[youtube] Fall back to header if playlist title is not available
Philipp Hagemeister [Mon, 20 Jan 2014 01:45:49 +0000 (02:45 +0100)]
[youtube] Fall back to header if playlist title is not available

Sometimes (in about 10% of requests), the og:title is missing for a weird reason.
See #2170 for an example

10 years ago[myspace] More robust mediatype check
Philipp Hagemeister [Mon, 20 Jan 2014 01:44:08 +0000 (02:44 +0100)]
[myspace] More robust mediatype check