Commit Graph

594 Commits (9e5ca66f16998eb2a680e23a6e769e34001898c5)

Author SHA1 Message Date
Yen Chi Hsuan 09747ba766
[liveleak] Support another liveleak embedding pattern (closes #13336) 7 years ago
Sergey M․ 5551d7714d
[generic] Convert redirect URLs to unicode strings (closes #13951) 7 years ago
Sergey M․ eb02940cc7
[generic] Add test for #13895 7 years ago
Sergey M․ 1663bd6e1c
[generic] Replace vzaar embed test 7 years ago
tetra-eder 41918eaa5c [generic] Add support for vzaar embeds 7 years ago
Grzegorz Ruciński 198d4cb40c [generic] Add support for another ooyala embed pattern (closes #13727) 7 years ago
Sergey M․ 95908ce453
[extractor/generic] PEP 8 7 years ago
Philipp Hagemeister 24e966e8da [megaphone] Add extractor 7 years ago
Sergey M․ bb176df3bb
[spiegel:article] Move test 7 years ago
Sergey M․ 3f59b0154a
[nexx:embed] Add extractor for iframe embeds 7 years ago
Sergey M․ 4e826cd9ae
[nexx] Add extractor (closes #10807, closes #13465) 7 years ago
Robin Neatherway 2583c0b54e Fix bugs caused by typos 7 years ago
Sergey M․ 71a1db8919
[dailymail] Add support for embeds 7 years ago
Sergey M․ 73cf76a93f
[joj] Rewrite and add support for generic embeds (closes #13268) 7 years ago
Sergey M․ 4328ddf82b
[extractor/common] Add support for AMP tags in _parse_html5_media_entries 7 years ago
Sergey M․ 250b042c7e
[generic] Add tests for #13557 7 years ago
Sergey M․ 665e945246
[eagleplatform] Add support for referrer protected videos (closes #13557) 7 years ago
Sergey M․ b311b0ead2
[generic] Extract more generic metadata (closes #13527) 7 years ago
Sergey M․ fd1c5fba6b
[facebook] Add test for plugin video embed (#13493) 7 years ago
Sergey M․ 0646e34c7d
[facebook] Add support for plugin video embeds and multiple embeds (closes #13493) 7 years ago
Sergey M․ 4e3637034c
[extractor/generic] Ensure format id is unicode string 7 years ago
Sergey M․ 2b8e6a68f8
[extractor/generic] Add test for mediaset embed 7 years ago
Sergey M․ 5d29af3d15
[extractor/generic] Add support for mediaset embeds 7 years ago
Sergey M․ 946826eec7
[extractor/generic] Remove duplicate limelight code 7 years ago
Sergey M․ 58bb440283
[extractor/generic] Extract wistia embed code into separate method 7 years ago
Remita Amine 6c52477f59 [condenast] improve embed support 7 years ago
Sergey M․ 9edf47df7b
[brightcove] Allow whitespace around attribute names in embedded code 7 years ago
John Hawkinson 557194591a
[washingtonpost] Add support for embeds (closes #12699) 7 years ago
Sergey M․ 7986c3abcd
[anvato] Improve extraction (closes #12913)
* Promote to regular shortcut based extractor
* Add mcp to access key mapping table
* Add support for embeds extraction
* Add support for anvato embeds in generic extractor
7 years ago
Yen Chi Hsuan 06d0ad9a4e
[brightcove] Support URLs with bcpid instead of playerID
Fixes #12482
7 years ago
Sergey M․ ab87c26009
[extractor/generic] Add test for #12761 7 years ago
Sergey M․ e5d39886ec
[limelight] Improve embeds extraction (closes #12761)
* Move extraction code to extractor
* Add extraction for LimelightEmbeddedPlayerFlash embeds
* Extract multiple video
7 years ago
Sergey M․ 413c1f8e2f
[extractor/generic] Extract RSS entries as url_transparent (#11163) 7 years ago
Sergey M․ 0254f93b08
[brightcove] Validate ambiguous embeds' URLs (closes #9163, closes #12005, closes #12178, closes #12480) 7 years ago
John Hawkinson 40158f55c9
[brightcove] Relax video tag embeds extraction
BrightcoveNewIE.extract_urls(): Handle player data when it is all in
attributes of the <video> tag, and also the id is
data-brightcove-video-id not data-video-id.

Add test to generic extractor, note HEAD gives 404, no checksum computed(?).
7 years ago
Remita Amine 0ee79a378a [generic] exclude urls with xml ext from valid video urls(closes #10768)(closes #11654) 7 years ago
John Hawkinson 61568e50cf [generic] Add support for <object> youtube embeds (closes #12637) 7 years ago
John Hawkinson a01825a541 [kaltura] Add support for iframe embeds 7 years ago
Remita Amine 3e943cfe09 [generic] pass base_url to _parse_jwplayer_data 7 years ago
Random User 4f06c1c9fc Merge branch 'master' of github.com-rndusr:rg3/youtube-dl into fix/str-item-assignment 7 years ago
Random User c73e330e7a _find_jwplayer_data() returns dict or None
This simplifies code for callers of `_find_jwplayer_data()` which no longer have
to run `_parse_json()` on the return value.

It also makes sure that `_find_jwplayer_data()` returns either a `dict` or
`None` and nothing else.
7 years ago
Random User 03486dbb01 Add test for JWPlayer where config is passed as variable 7 years ago
John Hawkinson e8e4cc5a6a
[generic] Replace LazyYT test with skiplagged
discourse.ubuntu.com has gone away, repalce with skiplagged.com.
Be nice to have a non-frontpage URL that might be more stable,
though I don't have one. Maybe this should move to html
in test/test_InfoExtractor.py?
7 years ago
Sergey M․ 54b960f340
[generic] Do not follow redirects to the same URL 7 years ago
John Hawkinson 97952bdb78 [generic] Add test for Senate ISVP iframe embed 7 years ago
John Hawkinson 46b18f2349 [BostonGlobe] New. Nonstandard version of Brightcove.
Has a "data-brightcove-video-id" instead of a "data-video-id," otherwise
pretty much just Brightcove. Except the Globe isn't all Brightcove
videos, so fallback to Generic, too.

Also, abstract playlist_from_matches() from generic.py to common.py, and use
it here.

History of these changes can be found in
51170427d4b1143572a498dedaee61863a5b2c5b.
7 years ago
Sergey M․ a309684285
[extractor/generic] Add forgotten return for jwplayer formats 7 years ago
Sergey M․ c2ee861c6d
[extractor/generic] Make title optional for jwplayer embeds (closes #12410) 7 years ago
Sergey M․ b68a812ea8
[extractor/generic] Add test for brigthcove UUID-like videoPlayer 7 years ago
Sergey M․ eb3079b6ce
[generic] Add support for rutube embeds 7 years ago
Yen Chi Hsuan fef51645d6
[theplatform] Recognize URLs with whitespaces (closes #12044) 7 years ago
Yen Chi Hsuan a4a554a793
[generic] Try parsing JWPlayer embedded videos (closes #12030) 7 years ago
Remita Amine 454e5cdb17 [limelight] add support referer protected videos 7 years ago
Remita Amine 9dad941853 [disney] improve extraction
- add support for more urls
- detect expired videos
- skip Adobe Flash Access protected videos

closes #4975
closes #11000
closes #11882
closes #11936
7 years ago
Sergey M․ 5620f840f6
[extractor/generic] Add test for #11993 and more metadata for rtmp 7 years ago
Sergey M․ b7a8c1bcfa
[extractor/generic] Improve rtmp support (closes #11993) 7 years ago
Sergey M․ 6ef3e65a7b
[videopress] Add extractor 7 years ago
Sergey M․ 17f8deeb48
[extractor/generic] Add support for openload embeds (closes #11536, closes #11812) 7 years ago
Yen Chi Hsuan 972efe60c3
[generic] Remove a dead test
The web page does not contain a video anymore

Ref: #2694, #2696
7 years ago
Yen Chi Hsuan d77ac73790
[ustream] Add UstreamIE._extract_url()
Ref: #11547
7 years ago
Sergey M․ b687c85eab
[extractor/generic] Add support for 20 minuten embeds (closes #11683, closes #11751) 7 years ago
Yen Chi Hsuan 16e2c8f771
[brightcove] Recognize another player ID
Closes #11688
7 years ago
Remita Amine 9837cb7507 [ooyala] add support for videos with embedToken(#11684) 7 years ago
Yen Chi Hsuan ec85ded83c
Fix "invalid escape sequences" error on Python 3.6 7 years ago
Sergey M․ 027e231295
[tunein] Add support for embeds (closes #11579) 7 years ago
Sergey M․ e186a9ec03
[videa] Add support for videa embeds 7 years ago
Sergey M․ 53a664edf4
[brightcove:legacy] Improve embeds detection (closes #11523) 8 years ago
Remita Amine b1c357975d [piksel] Add new extractor(closes #11246) 8 years ago
Yen Chi Hsuan 8ab7e6c4cc
[kaltura] Improve widget ID extraction (closes #11480) 8 years ago
felix 8953319916 [screenwavemedia] Remove extractor
Rewrite TeamFourStar and Normalboots extractors in terms of JWPlatform
8 years ago
Sergey M․ 83f1481baa
[extractor/generic] Add support for webcaster.pro embeds 8 years ago
Sergey M․ 8f8f182d0b
[extractor/generic] Improve limelight embeds support 8 years ago
Sergey M․ b52c9ef165
[extractor/generic] Improve support for pornhub embeds (closes #11100) 8 years ago
Sergey M․ e28ed498e6
[extractor/generic] Add support for redtube embds (closes #11099) 8 years ago
Sergey M․ 37e7a71c6c
[extractor/generic] Add support for drtuber embds (closes #11098) 8 years ago
Sergey M․ 4119a96ce5
[extractor/generic] Skip URLs we came from when delegating ISM extraction 8 years ago
Sergey M․ 26aae56690
[extractor/generic] Improve ISM extraction 8 years ago
Sergey M․ cc99a77ac1
[extractor/generic] Add support for ISM manifests 8 years ago
Sergey M․ 773017c648
[rentv] Move rentv test from generic extractor and add only matching tests 8 years ago
Yen Chi Hsuan 9dcd6fd3aa
[generic,commonprotocols] Move mms suuport from GenericIE
And use _generic_* helpers in those extractors
8 years ago
Yen Chi Hsuan 3d83a1ae92
[generic] Support direct MMS links (closes #10838) 8 years ago
Sergey M․ 09b9c45e24
[generic] Add support for multiple vimeo embeds (Closes #10862) 8 years ago
Déstin Reed dcdb292fdd
Unify coding cookie 8 years ago
Yen Chi Hsuan bd26441205
[utils] Fix xattr error handling 8 years ago
Sergey M․ 86f4d14f81
Refactor fragments interface and dash segments downloader
- Eliminate segment_urls and initialization_url
+ Introduce manifest_url (manifest may contain unfragmented data in this case url will be used for direct media URL and manifest_url for manifest itself correspondingly)
* Rewrite dashsegments downloader to use fragments data
* Improve generic mpd extraction
8 years ago
Remita Amine d05ef09d9d [mangomolo] fix domain regex 8 years ago
Remita Amine 7d273a387a [mangomolo] add support for Mangomolo embeds 8 years ago
Sergey M․ a5ff05df1a
[extractor/generic] Add vimeo embed that requires Referer passed 8 years ago
Remita Amine 93b8404599 [generic,vodplatform] improve embed regex 8 years ago
Yen Chi Hsuan 39efc6e3e0 [generic] Update some _TESTS 8 years ago
Sergey M․ fd3ec986a4
[generic] Fix dbtv test (Closes #10364) 8 years ago
Déstin Reed b0c8f2e9c8
[DBTV:generic] Add support for embeds 8 years ago
Sergey M․ 2a1321a272
[vbox7:generic] Add support for vbox7 embeds 8 years ago
Sergey M․ 082395d0a0
[extractor/generic] Add proper default to _search_json_ld call 8 years ago
Sergey M․ 395c74615c
Revert "[extractor/generic] Make _search_json_ld non fatal"
This reverts commit 958849275f.
8 years ago
Sergey M․ 958849275f
[extractor/generic] Make _search_json_ld non fatal 8 years ago
Remita Amine 217d5ae013 [vodplatform] Add new extractor 8 years ago
Sergey M․ db19df6ca0
[extractor/generic] Add test for #10179 8 years ago
Sergey M․ 94aae01548
[extractor/generic] Extract all soundcloud embeds (Closes #10179) 8 years ago
Yen Chi Hsuan 326fa4e6e5
[generic] Skip an invalid test 8 years ago
Yen Chi Hsuan 05d1e7aaa9
[generic] Fix an MTV test and another test that breaks nosetests 8 years ago
Sergey M․ 1979969f91
[extractor/generic] Add support for arkena embeds 8 years ago
Sergey M․ 371ddb14fe
[extractor/generic] Change twitter:player embeds priority to lowest (Closes #10090) 8 years ago
Yen Chi Hsuan c03adf90bd
[generic] Add the test. Closes #1638 8 years ago
Sergey M․ 6e6b70d65f
[extractor/generic] Properly comment out a test 8 years ago
Sergey M․ 0de168f7ed
[extractor/generic] Detect schema.org/VideoObject embeds 8 years ago
Yen Chi Hsuan ad213a1d74
[francetv] Recognize more Dailymotion embedded videos
Closes #9955
8 years ago
Remita Amine 81953d1ae5 [kaltura] add support videos stored on custom kaltura servers(closes #5557) 8 years ago
Yen Chi Hsuan dbf0157a26 [generic] Add MD5 checksums 8 years ago
Yen Chi Hsuan 7deef1ba67 [generic] Support Wordpress "YouTube Video Importer" plugin
Closes #9938
8 years ago
Yen Chi Hsuan fd6ca38262 [facebook] Improve Facebook embedded detection
Related to #9938.

Another example comes from 9834872bf6.
8 years ago
Remita Amine 7dbeee7e22 [generic] make twitter:player extraction non fatal 8 years ago
Remita Amine 329179073b [generic] add generic support for twitter:player embeds 8 years ago
Sergey M․ 06a96da15b
[eagleplatform] Improve embed detection and extract in separate routine (Closes #9926) 8 years ago
Sergey M․ c287f2bc60
[extractor/generic] Use _extract_url for kaltura embeds (Closes #9922) 8 years ago
Sergey M․ 427cd050a3
[extractor/generic] Improve kaltura embed detection (Closes #9911) 8 years ago
Yen Chi Hsuan 7d52c052ef
[generic] Fix test_Generic_76
Broken: https://travis-ci.org/rg3/youtube-dl/jobs/140251658
8 years ago
Yen Chi Hsuan c5edd147d1
[generic] Remove an invalid test
Now handled by telewebion.py
8 years ago
Yen Chi Hsuan 1fa309da40
[generic] Update test_Generic_40
The original link now redirects to an YouTube user channel.
8 years ago
Yen Chi Hsuan cc4444662c [generic] Remove Vulture embed detection
Vulture.com videos now hosts on YouTube, Vimeo, MTV, NBC News or Hulu.
Here's an example of Hulu:
http://www.vulture.com/2016/06/kimmel-interviews-mariah-carey-in-a-bathtub.html
8 years ago
Yen Chi Hsuan de3eb07ed6
[generic] Detect NBC News embeds 8 years ago
Sergey M․ 48a5eabc48
[extractor/generic] Add support vessel embeds (Closes #7083) 8 years ago
Yen Chi Hsuan 811586ebcf
[generic] Update the UDNEmbed test case 8 years ago
Yen Chi Hsuan 28bab13348
[generic,viewlift] Move a test case to the specialized extractor 8 years ago
Yen Chi Hsuan 877032314f
[generic] Improve Kaltura detection
Closes #4004
8 years ago
Yen Chi Hsuan 78d3b3e213
[generic] Improve Livestream detection (closes #2234) 8 years ago
Yen Chi Hsuan 4a12077855
[genric] Eliminate duplicated video URLs (closes #6562) 8 years ago
Sergey M․ 4d8819d249
[extractor/generic] Add support for theplatform embeds (Closes #8636, closes #9476) 8 years ago
Sergey M․ 6c114b1210
[extractor/generic] Remove generic id and title from wistia extractionand update tests 8 years ago
Sergey M․ 7ded6545ed
[extractor/generic] Add test for wistia standard embed 8 years ago
Sergey M․ aa5957ac49
[extractor/generic] Add support for async wistia embeds (Closes #9549) 8 years ago
Sergey M․ 6f41b2bcf1
[extractor/generic] Improve 3qsdn embeds support (Closes #9453) 8 years ago
Sergey M․ 5d39176f6d
[extractor/generic:3qsdn] Add support for embeds 8 years ago
remitamine 67167920db [viewlift] replace SnagFilms extractors
- add support for other sites that use the same logic
- improve format extraction and sorting
8 years ago
Yen Chi Hsuan 4645432d7a
[eagleplatform] Checking direct HTTP links
Sometimes they fail with 404
8 years ago
Yen Chi Hsuan 0738187f9b
[ThePlatform] Fix tests failed since 79ba9140dc 8 years ago
Yen Chi Hsuan 949b6497cc
[generic] Unescape the video URL
Fixes #9279
8 years ago
Sergey M․ 11e60fcad8
[extractor/generic] Improve instagram embeds (Closes #9213) 8 years ago
Yen Chi Hsuan ef0e4e7bc0
[generic] Fix test_Generic_2
Now a HEAD request returns 400 Bad Request
8 years ago
Kacper Michajłow b8f67449ec [generic] Add support for LiveLeak embeds 8 years ago
Yen Chi Hsuan 134c207e3f
[arte.tv:embed] Extended support (#2620) 8 years ago
remitamine f9b1529af8 [generic] remove sbnation test(handled by VoxMediaIE) 8 years ago
Sergey M․ 19dbaeece3 Remove _sort_formats from _extract_*_formats methods
Now _sort_formats should be called explicitly.
_sort_formats has been added to all the necessary places in code.

Closes #8051
8 years ago
Yen Chi Hsuan d10fe8358c [generic] Add a test case for brightcove embed
Closes #8862
8 years ago
Yen Chi Hsuan 5a51775a58 [generic] Extract Instagram embeds (#8817) 8 years ago
Yen Chi Hsuan 088e1aac59 [generic] Support Vine embeds (#8817) 8 years ago
Sergey M․ 0d769bcb78 [extractor/generic] Fix missing byte literal prefix 8 years ago
Sergey M․ edd9b71c2c [extractor/generic] Add a test for m3u playlist served without proper Content-Type 8 years ago
Sergey M․ 5940862d5a [extractor/generic] Detect m3u playlists served without proper Content-Type 8 years ago
Sergey M․ de6c51e88e [extractor/generic] Fix direct link semantics 8 years ago