Add infrastructure for paged lists
authorPhilipp Hagemeister <phihag@phihag.de>
Mon, 20 Jan 2014 10:36:47 +0000 (11:36 +0100)
committerPhilipp Hagemeister <phihag@phihag.de>
Mon, 20 Jan 2014 10:36:47 +0000 (11:36 +0100)
commitb7ab05908440915c6c5faa541abe00c62a88bc27
tree3b7e87361b7dce60ff7bdbe13bd33844fcb7d18e
parentc91778f8c0ba120378cb806f694fdc3f94a5634c
Add infrastructure for paged lists

This commit allows to download pages in playlists as needed instead of all at once.
Before this commit,
    youtube-dl http://www.youtube.com/user/ANNnewsCH/videos --playlist-end 2 --skip-download
took quite some time - now it's almost instantaneous.
As an example, the youtube:user extractor has been converted.
Fixes #2175
test/test_utils.py
youtube_dl/YoutubeDL.py
youtube_dl/extractor/youtube.py
youtube_dl/utils.py