395c74615c
Revert "[extractor/generic] Make _search_json_ld non fatal"
...
This reverts commit 958849275f
8 years ago
958849275f
[extractor/generic] Make _search_json_ld non fatal
8 years ago
217d5ae013
[vodplatform] Add new extractor
8 years ago
db19df6ca0
[extractor/generic] Add test for #10179
8 years ago
94aae01548
[extractor/generic] Extract all soundcloud embeds ( Closes #10179 )
8 years ago
326fa4e6e5
[generic] Skip an invalid test
8 years ago
05d1e7aaa9
[generic] Fix an MTV test and another test that breaks nosetests
8 years ago
1979969f91
[extractor/generic] Add support for arkena embeds
8 years ago
371ddb14fe
[extractor/generic] Change twitter:player embeds priority to lowest ( Closes #10090 )
8 years ago
c03adf90bd
[generic] Add the test. Closes #1638
8 years ago
6e6b70d65f
[extractor/generic] Properly comment out a test
8 years ago
0de168f7ed
[extractor/generic] Detect schema.org/VideoObject embeds
8 years ago
ad213a1d74
[francetv] Recognize more Dailymotion embedded videos
...
Closes #9955
8 years ago
81953d1ae5
[kaltura] add support videos stored on custom kaltura servers( closes #5557 )
8 years ago
dbf0157a26
[generic] Add MD5 checksums
8 years ago
7deef1ba67
[generic] Support Wordpress "YouTube Video Importer" plugin
...
Closes #9938
8 years ago
fd6ca38262
[facebook] Improve Facebook embedded detection
...
Related to #9938 .
Another example comes from 9834872bf6
8 years ago
7dbeee7e22
[generic] make twitter:player extraction non fatal
8 years ago
329179073b
[generic] add generic support for twitter:player embeds
8 years ago
06a96da15b
[eagleplatform] Improve embed detection and extract in separate routine ( Closes #9926 )
8 years ago
c287f2bc60
[extractor/generic] Use _extract_url for kaltura embeds ( Closes #9922 )
8 years ago
427cd050a3
[extractor/generic] Improve kaltura embed detection ( Closes #9911 )
8 years ago
7d52c052ef
[generic] Fix test_Generic_76
...
Broken: https://travis-ci.org/rg3/youtube-dl/jobs/140251658
8 years ago
c5edd147d1
[generic] Remove an invalid test
...
Now handled by telewebion.py
8 years ago
1fa309da40
[generic] Update test_Generic_40
...
The original link now redirects to an YouTube user channel.
8 years ago
cc4444662c
[generic] Remove Vulture embed detection
...
Vulture.com videos now hosts on YouTube, Vimeo, MTV, NBC News or Hulu.
Here's an example of Hulu:
http://www.vulture.com/2016/06/kimmel-interviews-mariah-carey-in-a-bathtub.html
8 years ago
de3eb07ed6
[generic] Detect NBC News embeds
8 years ago
48a5eabc48
[extractor/generic] Add support vessel embeds ( Closes #7083 )
8 years ago
811586ebcf
[generic] Update the UDNEmbed test case
8 years ago
28bab13348
[generic,viewlift] Move a test case to the specialized extractor
8 years ago
877032314f
[generic] Improve Kaltura detection
...
Closes #4004
8 years ago
78d3b3e213
[generic] Improve Livestream detection ( closes #2234 )
8 years ago
4a12077855
[genric] Eliminate duplicated video URLs ( closes #6562 )
8 years ago
4d8819d249
[extractor/generic] Add support for theplatform embeds ( Closes #8636 , closes #9476 )
8 years ago
6c114b1210
[extractor/generic] Remove generic id and title from wistia extractionand update tests
8 years ago
7ded6545ed
[extractor/generic] Add test for wistia standard embed
8 years ago
aa5957ac49
[extractor/generic] Add support for async wistia embeds ( Closes #9549 )
8 years ago
6f41b2bcf1
[extractor/generic] Improve 3qsdn embeds support ( Closes #9453 )
8 years ago
5d39176f6d
[extractor/generic:3qsdn] Add support for embeds
8 years ago
67167920db
[viewlift] replace SnagFilms extractors
...
- add support for other sites that use the same logic
- improve format extraction and sorting
8 years ago
4645432d7a
[eagleplatform] Checking direct HTTP links
...
Sometimes they fail with 404
8 years ago
0738187f9b
[ThePlatform] Fix tests failed since 79ba9140dc
8 years ago
949b6497cc
[generic] Unescape the video URL
...
Fixes #9279
8 years ago
11e60fcad8
[extractor/generic] Improve instagram embeds ( Closes #9213 )
8 years ago
ef0e4e7bc0
[generic] Fix test_Generic_2
...
Now a HEAD request returns 400 Bad Request
8 years ago
b8f67449ec
[generic] Add support for LiveLeak embeds
8 years ago
134c207e3f
[arte.tv:embed] Extended support ( #2620 )
8 years ago
f9b1529af8
[generic] remove sbnation test(handled by VoxMediaIE)
8 years ago
19dbaeece3
Remove _sort_formats from _extract_*_formats methods
...
Now _sort_formats should be called explicitly.
_sort_formats has been added to all the necessary places in code.
Closes #8051
8 years ago
d10fe8358c
[generic] Add a test case for brightcove embed
...
Closes #8862
8 years ago
5a51775a58
[generic] Extract Instagram embeds ( #8817 )
8 years ago
088e1aac59
[generic] Support Vine embeds ( #8817 )
8 years ago
0d769bcb78
[extractor/generic] Fix missing byte literal prefix
8 years ago
edd9b71c2c
[extractor/generic] Add a test for m3u playlist served without proper Content-Type
8 years ago
5940862d5a
[extractor/generic] Detect m3u playlists served without proper Content-Type
8 years ago
de6c51e88e
[extractor/generic] Fix direct link semantics
8 years ago
303dcdb995
[extractor/generic] Simplify upload_date extraction
8 years ago
20938f768b
[extractor/generic] Add another test for generic m3u8
8 years ago
955737b2d4
[extractor/generic] Force Content-Type to lowecase
8 years ago
263eff9537
[extractor/generic] Properly extract format id from Content-Type
...
Fixes extraction for cases like: audio/x-mpegURL; charset=utf-8
8 years ago
3f2f4a94aa
[extractor/generic] Extract f4m formats from final URLs
8 years ago
f930e0c76e
[extractor/generic] Extract f4m formats and refactor common info
8 years ago
2c9ca78281
[extractor/generic] Add support for tnaflix network embeds ( Closes #7505 )
8 years ago
33d4fdabfa
[extractor/generic] Add support for ok embeds ( #8619 )
8 years ago
9d939cec48
[extractor/generic] Add direct mpd url test
8 years ago
7be747b921
[extractor/generic] Pass mpd base url to _parse_mpd_formats
8 years ago
5a4905924d
[extractor/generic] Improve dailymotion embed detection ( Closes #8521 , closes #8325 )
8 years ago
28ad7df65d
[generic] detect MPD manfiest only from the content
8 years ago
79a3508579
[extractor/generic] Detect DASH manifests in found URLs and extract mpd formats
8 years ago
1b840245bd
[extractor/generic] Detect DASH manifests and extract mpd formats
8 years ago
bcbbb98bfe
[generic] extract dash formats detected using content type
8 years ago
eadc3ccd50
[generic] extract m3u8 formats when mpegurl content type detected
8 years ago
1bf996fa5c
[generic] Add support for Limelight API
8 years ago
aecfcd4e59
[ultimedia] Rename to digiteka
8 years ago
1fa2b9841d
[extractor/generic] Extend dailymotion embed regex
8 years ago
dfb1b1468c
Fix typos
...
Closes #8200 .
8 years ago
ff18735cb2
[extractor/generic] Add support for videomore embeds
8 years ago
06e4874c99
Merge branch 'jukebox' of https://github.com/remitamine/youtube-dl into remitamine-jukebox
8 years ago
7ba71e30fb
Merge branch 'bliptv' of github.com:remitamine/youtube-dl into remitamine-bliptv
8 years ago
7cb0952474
[makertv] improve extraction
8 years ago
a8ae232fa9
Merge branch 'googledrive' of github.com:remitamine/youtube-dl into remitamine-googledrive
8 years ago
5b251628e9
[googledrive] Modernize
8 years ago
45dad7ba1b
[extractor/generic] Use _extract_url for pladform
9 years ago
53e06b2507
[ooyala] fix duration scale
9 years ago
c3d3110f6a
Merge pull request #7185 from remitamine/ooyala
...
[ooyala] extract more formats and metadata
9 years ago
78653a33aa
Merge remote-tracking branch 'upstream/master' into bliptv
9 years ago
5c2266df4b
Switch codebase to use sanitized_Request instead of
...
compat_urllib_request.Request
[downloader/dash] Use sanitized_Request
[downloader/http] Use sanitized_Request
[atresplayer] Use sanitized_Request
[bambuser] Use sanitized_Request
[bliptv] Use sanitized_Request
[brightcove] Use sanitized_Request
[cbs] Use sanitized_Request
[ceskatelevize] Use sanitized_Request
[collegerama] Use sanitized_Request
[extractor/common] Use sanitized_Request
[crunchyroll] Use sanitized_Request
[dailymotion] Use sanitized_Request
[dcn] Use sanitized_Request
[dramafever] Use sanitized_Request
[dumpert] Use sanitized_Request
[eitb] Use sanitized_Request
[escapist] Use sanitized_Request
[everyonesmixtape] Use sanitized_Request
[extremetube] Use sanitized_Request
[facebook] Use sanitized_Request
[fc2] Use sanitized_Request
[flickr] Use sanitized_Request
[4tube] Use sanitized_Request
[gdcvault] Use sanitized_Request
[extractor/generic] Use sanitized_Request
[hearthisat] Use sanitized_Request
[hotnewhiphop] Use sanitized_Request
[hypem] Use sanitized_Request
[iprima] Use sanitized_Request
[ivi] Use sanitized_Request
[keezmovies] Use sanitized_Request
[letv] Use sanitized_Request
[lynda] Use sanitized_Request
[metacafe] Use sanitized_Request
[minhateca] Use sanitized_Request
[miomio] Use sanitized_Request
[meovideo] Use sanitized_Request
[mofosex] Use sanitized_Request
[moniker] Use sanitized_Request
[mooshare] Use sanitized_Request
[movieclips] Use sanitized_Request
[mtv] Use sanitized_Request
[myvideo] Use sanitized_Request
[neteasemusic] Use sanitized_Request
[nfb] Use sanitized_Request
[niconico] Use sanitized_Request
[noco] Use sanitized_Request
[nosvideo] Use sanitized_Request
[novamov] Use sanitized_Request
[nowness] Use sanitized_Request
[nuvid] Use sanitized_Request
[played] Use sanitized_Request
[pluralsight] Use sanitized_Request
[pornhub] Use sanitized_Request
[pornotube] Use sanitized_Request
[primesharetv] Use sanitized_Request
[promptfile] Use sanitized_Request
[qqmusic] Use sanitized_Request
[rtve] Use sanitized_Request
[safari] Use sanitized_Request
[sandia] Use sanitized_Request
[shared] Use sanitized_Request
[sharesix] Use sanitized_Request
[sina] Use sanitized_Request
[smotri] Use sanitized_Request
[sohu] Use sanitized_Request
[spankwire] Use sanitized_Request
[sportdeutschland] Use sanitized_Request
[streamcloud] Use sanitized_Request
[streamcz] Use sanitized_Request
[tapely] Use sanitized_Request
[tube8] Use sanitized_Request
[tubitv] Use sanitized_Request
[twitch] Use sanitized_Request
[twitter] Use sanitized_Request
[udemy] Use sanitized_Request
[vbox7] Use sanitized_Request
[veoh] Use sanitized_Request
[vessel] Use sanitized_Request
[vevo] Use sanitized_Request
[viddler] Use sanitized_Request
[videomega] Use sanitized_Request
[viewvster] Use sanitized_Request
[viki] Use sanitized_Request
[vk] Use sanitized_Request
[vodlocker] Use sanitized_Request
[voicerepublic] Use sanitized_Request
[wistia] Use sanitized_Request
[xfileshare] Use sanitized_Request
[xtube] Use sanitized_Request
[xvideos] Use sanitized_Request
[yandexmusic] Use sanitized_Request
[youku] Use sanitized_Request
[youporn] Use sanitized_Request
[youtube] Use sanitized_Request
[patreon] Use sanitized_Request
[extractor/common] Remove unused import
[nfb] PEP 8
9 years ago
750b9ff032
[generic] Extract M3U8 formats ( closes #7582 )
9 years ago
28602e747c
[generic] Refactor
9 years ago
6cc37c69e2
[generic] Unescape URLs from JWPlayer ( #7582 )
9 years ago
6da620de58
[kaltura] Add test for referrer protected video ( #7409 )
9 years ago
5b5fae5f20
[generic] Use referrer from source kaltura embed URLs ( #7409 )
9 years ago
c39fd7b1ca
[UDNEmbed] Fix generic UDN pages
...
Closes #7547
9 years ago
3b7d9aa487
Rename all references to legacy studio Brightcove extractor
9 years ago
1f4b722b00
[generic] Clarify Brightcove Legacy Studio comment
9 years ago
f6519f89b0
[generic] Extract Brightcove New Studio embeds
9 years ago
5c17f0a67a
[brightcove:embedinpage] Rename extractor to brightcove new
...
It's not actually embed_in_page but "New Studio" and allows both iframe and embed_in_page embeds
9 years ago
4fcaa4f4a5
[brightcove] Rename extractor to brightcove legacy
...
Old embedding approaches are now "Legacy Studio"
9 years ago
a2973eb597
Merge branch 'brightcove_in_page_embed' of https://github.com/remitamine/youtube-dl into remitamine-brightcove_in_page_embed
9 years ago
6a5d6de1e3
[generic] Improve kaltura embed detection (2)
9 years ago
1c31a5b0e0
[generic] Improve kaltura embed detection ( Closes #7409 )
9 years ago
30eecc6a04
Merge pull request #7296 from jaimeMF/xml_attrib_unicode
...
Use a wrapper around xml.etree.ElementTree.fromstring in python 2.x (…
9 years ago
e327b736ca
[generic] Update test
9 years ago
f78546272c
[compat] compat_etree_fromstring: also decode the text attribute
...
Deletes parse_xml from utils, because it also does it.
9 years ago
cce9d15d01
[ooyala] extract domain,handle errors and change related tests
9 years ago
77302fe5c9
[bliptv] remove extractor and add support for site replacement(makertv)
9 years ago
dd467d33d0
[extractor/generic] Add support for condenast script embeds ( Closes #6885 , closes #6991 )
9 years ago
46fde8a1a2
[extractor/generic] Use _extract_url for mtvservices
9 years ago
6aeba407db
[jukebox] remove extractor and handle it using generic extractor
9 years ago
6c91a5a7f5
[extractor/generic] Fix following redirect in Refresh HTTP header on python 2
9 years ago
ed1269000f
[brightcove] add support for brightcove in page embed( fixes #6824 )
9 years ago
12439dd5ec
[generic] Capture <audio> tags in addition to <video> tags
9 years ago
1f8125805e
[generic] Add test for screenwavemedia embed
9 years ago
efd712c69b
[generic] Use screenwavemedia embed pattern
9 years ago
8ca31a0e05
[generic] Look for ScreenwaveMedia embeds
9 years ago
0791ac1b44
[extractor/generic] Clarify comment
9 years ago
1de5cd3ba5
[extractor/generic] Add test for xspf playlist
9 years ago
729accb482
[extractor/generic] Add support for xspf playlists
9 years ago
d5d7bdaeb5
Merge pull request #6428 from dstftw/improve-generic-smil-support
...
Improve generic SMIL support
9 years ago
bf94d763ba
[extractor/generic] Add test for #6485
9 years ago
8a37aa1517
[extractor/generic] Expand ooyala regex ( Closes #6485 )
9 years ago
54a9328b20
[generic] Expand jwplayer support
9 years ago
8765222d22
[extractor/generic] Add generic SMIL tests
9 years ago
e5e8d20a3a
[extractor/generic] Improve generic SMIL detection
9 years ago
88ed52aec9
[bbc] Add support for direct bbc.co.uk embeds
9 years ago
653789afc7
add google drive embeds
9 years ago
b37317d8b0
[generic] Unescape HTML escape sequences in redirect urls ( fixes #6311 )
9 years ago
a1b85269a4
[extractor/generic] Support vid.me embeds
9 years ago
cbd55ade68
[extractor/generic] Add support for francetv embeds
9 years ago
f7e6f7fa23
[extractor/generic] Use compat_urllib_parse_unquote
9 years ago
45eedbe58c
Generic: use compat_urllib_parse_unquote to prevent utf8 mangling
...
of the entire page in python 2.
-requires- fixed compat_urllib_parse_unquote
example - the following will save with a mangled playlist title,
instead of the kanji for 'tsunami'. This affects all utf8encoded
urls as well
youtube-dl -f18 -o '%(playlist_title)s-%(title)s.%(ext)s' \
61c14c1e3a/tsunami.html
9 years ago
bf20b9c540
[extractor/generic] Add test for myvi embed
9 years ago
6dd94d3a79
[myvi:embed] Rename to myvi
9 years ago
e6c2d9ad29
[extractor/generic:myvi] Add support for myvi embeds
9 years ago
66e568de3b
[extractor/generic] Improve kaltura embeds support ( Closes #6137 )
9 years ago
b8c1cc1a51
[extractor/generic] Add test for snagfilms embeds
9 years ago
eedd20ef96
[extractor/generic] Add support for snagfilms embeds
9 years ago
8084be78c5
[extractor/generic] Add test for OnionStudios embeds
9 years ago
1ac1c4c26e
[extractor/generic] Add support for OnionStudios embeds ( Closes #5841 )
9 years ago
3c3b4176bd
Merge pull request #5961 from dstftw/force-generic-extractor
...
Add --force-generic-extractor
9 years ago
2fece970b8
[extractor/generic] Clarify generic extraction warning
9 years ago
a5158f38a3
[generic/adobetv] Support AdobeTVVideo embeds ( #6039 )
9 years ago
c76799c555
[extractor/generic] Add test for xhamster embed
9 years ago
2bb5b6d0a1
[generic] Add support for xhamster embeds
9 years ago
756f574e4e
[dailymotion/generic] Add DailymotionCloudIE
9 years ago
b407e173e4
[vimeo/generic] Move detection logic from GenericIE to VimeoIE
9 years ago
78e2b74bb9
[tumblr] Add support for pornhub embeds ( Closes #5963 )
9 years ago
65d161c480
[extractor/generic] Add support for pornhub embeds
9 years ago
d22dec74ff
Add `--force-generic-extractor`
...
For some extractors that are hard to workout a good _VALID_URL we use very vague and unrestrictive ones,
e.g. just allowing anything after hostname and capturing part of URL as id.
If some of these extractors happen to have an video embed of some different hoster or platform
and this scenario was not handled in extractor itself we end up with inability to download this embed
until extractor is fixed to support embed of this kind.
Forcing downloader to use the generic extractor can be a neat temporary solution for this problem.
Example: FiveTV extractor with Tvigle embed - http://www.5-tv.ru/rabota/broadcasts/48/
9 years ago
9872d3110c
[extractor/generic] Add support for tvigle embeds
9 years ago
b859971873
[extractor/generic] Rename tvc embed url variable
9 years ago
f37bdbe537
[extractor/generic] Add test for tvc embed
9 years ago
2da09ff8b0
[extractor/generic] Fix tvc ie_key
9 years ago
954c1d0529
[tvc] Refactor extractor names
9 years ago
494f20cbdc
[extractor/generic] Add support for tvc embeds
9 years ago
97b570a94c
[generic] Improve rtl.nl embeds detection ( Closes #5950 )
9 years ago
b26733ba7f
[brightcove] Allow single quotes in Brightcove URLs ( fixes #5901 )
9 years ago
c5138a7ce4
[extractor/generic] Clarify test comment
9 years ago
c5fa81fe81
[extractor/generic] Put all direct link tests near to each other for better navigation
9 years ago
a074e92296
[extractor/generic] Add test for large compressed media
9 years ago
1ddb9456c4
[extractor/generic] Use compat_urllib_parse_unquote for unquoting video_id and title from URL
9 years ago
58bde34a23
[extractor/generic] Force Accept-Encoding to any for extraction pass
9 years ago
339516072b
[extractor/generic] Unescape video_id and title extracted from URL
9 years ago
25c3a7348f
[generic] Fix typo
9 years ago
b827a6015c
[generic] Add test for sportbox embeds
9 years ago
d40a3b5b55
[generic] Add support for sportbox embeds
9 years ago
3b5f65a64c
[mlb] Fix extraction of articles
...
And move test from generic, since it's directly handled by MLBIE
9 years ago
dc455a5f88
[extractor/generic] Add test for svt embed
9 years ago
bab19a8e91
[extractor/generic] Add support for svt embeds ( Closes #5622 )
9 years ago
406224be52
[extractor/generic] Fix following incomplete redirects ( #5640 )
9 years ago
8001607e90
[generic] Detect more MLB videos ( fixes #5443 )
9 years ago
0954cd8aa4
[Cinemassacre] Add detection for videos from blip.tv
9 years ago
2fe1b5bd2a
[CSpan] Add detection for Senate ISVP. Closes #5302
9 years ago
6225984681
[generic] Update pladform embed test
9 years ago
d6fd958c5f
[generic] Extract videos from SMIL manifests ( closes #5145 and fixes #5135 )
9 years ago
c798f15b98
[generic] Add test for playwire embed ( #5430 )
9 years ago
2dcc114f84
[generic] Add support for playwire embeds ( Closes #5430 )
9 years ago
01c58f8473
[generic] Fix test generic_51
...
The website replaced the original video with a new one
9 years ago
edfcf7abe2
[generic] Support another type of Ooyala embedded video
9 years ago
a4257017ef
[generic] Add tests for Crooks and Liars embeds
9 years ago
18153f1b32
[generic] Add support for Crooks and Liars embeds
9 years ago
0a1603634b
[utils] Remove url_infer_protocol
9 years ago
418c5cc3fc
[udn] Add new extractor
9 years ago
facecb84a1
[generic] Add working NBC Sports vplayer test
9 years ago
a2edf2e7ff
[NBC/ThePlatform/Generic] Add a generic detector for NBCSportsVPlayer and enhance error detection in ThePlatformIE
9 years ago
ad320e9b83
[generic] Add support for 5min embeds ( #5310 )
9 years ago
2051acdeb2
[extractor/generic] Add test for Libsyn embed
9 years ago
cefdf970cc
[extractor/generic] Support Libsyn embeds
9 years ago
3378d67a18
[generic] Add support for nytimes embeds ( Closes #5234 )
9 years ago
ed9a25dd61
[generic] Generalize redirect regex
9 years ago
84f8101606
[generic] Follow redirects specified by `Refresh` HTTP header
9 years ago
f838875726
[pladform] Add support for embeds
9 years ago
d47ae7f620
[eagleplatform] Add support for ClipYou embeds
9 years ago
135c9c42bf
[eagleplatform] Add support for embeds
9 years ago
76c73715fb
[generic] Parse RSS enclosure URLs ( Fixes #5091 )
9 years ago
e3216b82bf
[generic] Support dynamic Kaltura embeds ( #5016 ) ( #5073 )
9 years ago
13d8fbef30
[generic] Don't set the 'title' if it's not defined in the entry ( closes #5061 )
...
Some of them may be an 'url' result, which in general don't have the 'title' field.
9 years ago
255fca5eea
[generic] Add support for Zapiks embeds ( #5014 )
9 years ago
f37e3f99f0
[generic] Correct test case
...
Video has been reuploaded / edited
9 years ago
11e611a7fa
Extend various playlist tests
9 years ago
Sergey M․
Remita Amine
Yen Chi Hsuan
Kacper Michajłow
Jakub Wilk
Jaime Marquínez Ferrándiz
felix
fnord
Naglis Jonaitis
Philipp Hagemeister