Commit graph

404 commits

Author SHA1 Message Date
Yen Chi Hsuan
92cb5763f4
[ChangeLog] Update after #12357 2017-03-06 18:04:19 +08:00
Sergey M․
1664702626
release 2017.03.06 2017-03-06 04:04:39 +07:00
Sergey M․
3f116b189b
[ChangeLog] Actualize 2017-03-06 04:01:21 +07:00
Sergey M․
afa4597618
release 2017.03.05 2017-03-05 02:23:08 +07:00
Sergey M․
75027364ba
[ChangeLog] Actualize 2017-03-05 02:22:02 +07:00
Yen Chi Hsuan
6f4e4132d8
[douyutv] Switch to the PC API to escape the 5-min limitation
Thanks @spacemeowx2 for the algo.

Ref: https://gist.github.com/spacemeowx2/629b1d131bd7e240a7d28742048e80fc

Closes #12316
2017-03-04 23:23:18 +08:00
Sergey M․
250eea6821
release 2017.03.02 2017-03-02 22:33:22 +07:00
Sergey M․
28d15b73f8
[ChangeLog] Actualize 2017-03-02 22:29:56 +07:00
Yen Chi Hsuan
11bb6ad1a5
[facebook] Fix extraction (closes #12323)
Almost all videos now use the pagelet type 'permalink_video_pagelet'
2017-03-02 20:51:24 +08:00
Sergey M․
1dc24093f8
release 2017.02.28 2017-02-28 23:59:22 +07:00
Sergey M․
11bae9cdde
[ChangeLog] Actualize 2017-02-28 23:49:24 +07:00
Yen Chi Hsuan
9bd05b5a18 [daisuki] Add new extractor (closes #4738) 2017-02-28 22:19:26 +08:00
Yen Chi Hsuan
f4c68ba372
[douyu] Fix extraction and update _TESTS
They've switched from flv to hls

Closes #12301
2017-02-28 21:41:03 +08:00
Sergey M․
ef48a1175d
release 2017.02.27 2017-02-27 23:26:07 +07:00
Sergey M․
c6184bcf7b
[ChangeLog] Actualize 2017-02-27 23:24:03 +07:00
Yen Chi Hsuan
892b47ab6c
[scivee] Remove extractor (#9315)
The Wikipedia page is changed from active to down:
https://en.wikipedia.org/w/index.php?title=SciVee&diff=prev&oldid=723161154

Some other interesting bits:

$ nslookup www.scivee.tv
Server:         8.8.8.8
Address:        8.8.8.8#53

Non-authoritative answer:
www.scivee.tv   canonical name = scivee.rcsb.org.
Name:   scivee.rcsb.org
Address: 132.249.231.211

$ nslookup rcsb.org
Server:         8.8.8.8
Address:        8.8.8.8#53

Non-authoritative answer:
Name:   rcsb.org
Address: 132.249.231.77

Both IPs are from UCSD. I guess it's maintained by a lab and they don't
maintain it anymore.
2017-02-27 21:34:33 +08:00
Yen Chi Hsuan
a5cf17989b
[MDR] Relax _VALID_URL and playerURL matching and update _TESTS
Ref: #12169
2017-02-26 17:24:54 +08:00
Yen Chi Hsuan
9d0c08a02c
[vevo] Fix videos with the new streams/streamsV3 format (closes #11719) 2017-02-26 00:15:49 +08:00
Yen Chi Hsuan
db182c63fb
[njpwworld] Add new extractor (closes #11561) 2017-02-25 18:44:39 +08:00
Sergey M․
204efc8509
release 2017.02.24.1 2017-02-24 21:59:39 +07:00
Sergey M․
5d3a51e1b9
[ChangeLog] Actualize 2017-02-24 21:57:39 +07:00
Sergey M․
6b097cff27
release 2017.02.24 2017-02-24 06:09:15 +07:00
Sergey M․
f2f7961820
[ChangeLog] Actualize 2017-02-24 06:07:41 +07:00
Sergey M․
345b24538b
release 2017.02.22 2017-02-22 23:50:42 +07:00
Sergey M․
63a29b6118
[ChangeLog] Actualize 2017-02-22 23:45:01 +07:00
Yen Chi Hsuan
b5869560a4
[crunchyroll] Fix descriptions with double quotes (closes #12124) 2017-02-23 00:08:45 +08:00
Sergey M․
8c6c88c7da
release 2017.02.21 2017-02-21 23:48:24 +07:00
Sergey M․
159aaaa9d0
[ChangeLog] Actualize 2017-02-21 23:46:58 +07:00
Sergey M․
28e35f5070
release 2017.02.17 2017-02-17 23:59:56 +07:00
Sergey M․
cf3704c132
[ChangeLog] Actualize 2017-02-17 23:48:30 +07:00
Yen Chi Hsuan
fef51645d6
[theplatform] Recognize URLs with whitespaces (closes #12044) 2017-02-17 23:13:51 +08:00
Yen Chi Hsuan
a4a554a793
[generic] Try parsing JWPlayer embedded videos (closes #12030) 2017-02-16 23:44:03 +08:00
Sergey M․
2480b056c1
release 2017.02.16 2017-02-16 00:10:04 +07:00
Sergey M․
3aa25395aa
[ChangeLog] Actualize 2017-02-16 00:08:56 +07:00
Sergey M․
58a65ba852
release 2017.02.14 2017-02-14 01:09:18 +07:00
Sergey M․
cedf08ff54
[ChangeLog] Actualize 2017-02-14 01:07:35 +07:00
Yen Chi Hsuan
f8514630db
[einthusan] Fix extraction (closes #11416)
The old test URLs are no longer valid, so I replace them with the one
from #11416
2017-02-12 20:53:55 +08:00
Yen Chi Hsuan
8d38dafbbf
ChangeLog: update after #12085 2017-02-12 00:45:37 +08:00
Sergey M․
9b92a5917b
release 2017.02.11 2017-02-11 03:24:00 +07:00
Sergey M․
3e2274c8b7
[ChangeLog] Actualize 2017-02-11 17:08:22 +07:00
Sergey M․
55d4de2283
release 2017.02.10 2017-02-10 01:27:33 +07:00
Sergey M․
61ee556aea
[ChangeLog] Actualize 2017-02-10 01:26:00 +07:00
Sergey M․
013877298d
release 2017.02.07 2017-02-07 02:04:50 +07:00
Sergey M․
c87f95f991
[ChangeLog] Actualize 2017-02-07 01:58:57 +07:00
Yen Chi Hsuan
9c14fe9681
[gaskrank] Minor change and update ChangeLog after #11685 2017-02-06 00:25:28 +08:00
Yen Chi Hsuan
019f4c0371
[bandcamp] Fix extraction for incomplete albums
Closes #11727
2017-02-05 22:47:04 +08:00
Yen Chi Hsuan
caf0f5f8b7
[iwara] Fix extraction (closes #11781) 2017-02-05 21:48:13 +08:00
Yen Chi Hsuan
e4e50f60b1
[googledrive] Fix extraction on Python 3.6
Since Python 3.6, invalid escape sequences are deprecated. It's likely
that there are invalid escape sequences somewhere on the webpage, so
instead of unescaping the whole webpage, just unescape the URL.

See https://bugs.python.org/issue27364. That change was designed for
string literals, while it affects the 'unicode_escape' encoding as well.
The code path is:

str.decode('unicode_escape')
    codecs.unicode_escape_decode()
        PyUnicode_DecodeUnicodeEscape()
2017-02-05 21:41:08 +08:00
Sergey M․
a713a86755
release 2017.02.04.1 2017-02-04 23:26:39 +07:00
Sergey M․
7bccd5fc8a
[ChangeLog] Actualize 2017-02-04 23:23:38 +07:00
Sergey M․
3144eccf55
[ChangeLog] Actualize 2017-02-04 23:22:28 +07:00
Sergey M․
31487eb974
release 2017.02.04 2017-02-04 22:57:48 +07:00
Yen Chi Hsuan
daac118bf4
[ChangeLog] Update after #11901 2017-02-03 18:56:40 +08:00
Yen Chi Hsuan
d7f9242e30
[ChangeLog] Update after #11565 2017-02-03 12:13:24 +08:00
Yen Chi Hsuan
a22b2fd19b
[youtube] Fix ytsearch* when cookies are provided
Closes #11924

The API with `page` is no longer used in browsers, and YouTube always
returns {'reload': 'now'} when cookies are provided.

See http://youtube.github.io/spfjs/documentation/start/ for how SPF
works. Basically appending static link with a `spf` parameter yields the
corresponding dynamic link.
2017-02-03 01:28:24 +08:00
Yen Chi Hsuan
bd8f48c78b
[bilibili] Support new Bangumi URLs (closes #11845)
To reduce complexity, I don't support old Bangumi URLs directly via
_VALID_URL. Instead, I choose to let it go to generic redirection. An
example can be found in #10190:

http://bangumi.bilibili.com/anime/v/40062
2017-02-02 21:51:31 +08:00
Jaime Marquínez Ferrándiz
020c5df52d [elpais] Fix extraction for some URLs (closes #11765) 2017-02-01 23:48:34 +01:00
Sergey M․
5069594993
release 2017.02.01 2017-02-01 03:20:09 +07:00
Sergey M․
b996b88092
[ChangeLog] Actualize 2017-02-01 23:29:59 +07:00
Yen Chi Hsuan
000f207944
[prosiebensat1] Update ChangeLog 2017-02-01 23:16:35 +08:00
Sergey M․
d7e215b42d
release 2017.01.31 2017-01-31 22:24:45 +07:00
Sergey M․
3a528ffd89
[ChangeLog] Actualize 2017-01-31 22:22:42 +07:00
Sergey M․
4d2fdb07c4
release 2017.01.29 2017-01-29 13:21:42 +07:00
Sergey M․
fe323a4800
[ChangeLog] Actualize 2017-01-29 21:21:26 +07:00
Sergey M․
d41ed6d243
release 2017.01.28 2017-01-28 00:33:55 +07:00
Sergey M․
815d2a36d8
[ChangeLog] Actualize 2017-01-28 00:03:21 +07:00
Sergey M․
2417d41535
release 2017.01.25 2017-01-25 23:36:03 +07:00
Sergey M․
2c302cf66b
[ChangeLog] Actualize 2017-01-25 23:33:46 +07:00
Sergey M․
c3a65c3de0
release 2017.01.24 2017-01-24 02:58:37 +07:00
Sergey M․
ee4c091ce5
[ChangeLog] Actualize 2017-01-24 02:56:19 +07:00
Yen Chi Hsuan
bc35ed3fb6
[nextmedia] Add support for NextTV (壹電視) 2017-01-23 23:38:31 +08:00
Sergey M․
9d5b29c881
release 2017.01.22 2017-01-22 18:59:04 +07:00
Sergey M․
6c031a35f3
[ChangeLog] Actualize 2017-01-22 18:57:15 +07:00
Yen Chi Hsuan
7c20b7484c
[nextmedia] Support redirected URLs 2017-01-22 02:06:34 +08:00
Yen Chi Hsuan
4447fb2332
[cspan] Support Ustream embedded videos
Closes #11547
2017-01-20 22:27:13 +08:00
Sergey M․
1560baacc6
release 2017.01.18 2017-01-18 23:10:00 +07:00
Sergey M․
460f61fac4
[ChangeLog] Actualize 2017-01-18 23:06:46 +07:00
Sergey M․
c1c2fe2045
release 2017.01.16 2017-01-16 23:44:04 +07:00
Sergey M․
ddd53c392e
[ChangeLog] Actualize 2017-01-16 23:42:04 +07:00
Yen Chi Hsuan
16e2c8f771
[brightcove] Recognize another player ID
Closes #11688
2017-01-16 00:06:52 +08:00
Yen Chi Hsuan
dcae7b3fdc
[niconico] Allow login via cookies
Some codes are borrowed from #7968, which is by @jlhg

Closes #7968
2017-01-15 22:51:54 +08:00
Sergey M․
5d4c7daa49
release 2017.01.14 2017-01-14 07:31:07 +07:00
Sergey M․
0b94510cd0
[ChangeLog] Actualize 2017-01-14 07:30:32 +07:00
Sergey M․
31ea2ad89d
release 2017.01.10 2017-01-10 21:29:20 +07:00
Sergey M․
2184d44361
[ChangeLog] Actualize 2017-01-10 21:27:17 +07:00
Philipp Hagemeister
bfedb2cc5a small fix to Changelog format 2017-01-09 11:26:01 +01:00
Philipp Hagemeister
8084951b7f [egghead:course] Add support for egghead.io course playlists
Individual egghead videos are already handled by the generic/Wistia extractors.
2017-01-09 11:24:40 +01:00
Sergey M․
e7ea724cb9
release 2017.01.08 2017-01-08 20:58:43 +07:00
Sergey M․
e60166020b
[ChangeLog] Actualize 2017-01-08 20:56:38 +07:00
Yen Chi Hsuan
1219201143
[ChangeLog] Update after #11581
[ci skip]
2017-01-06 01:07:30 +08:00
Yen Chi Hsuan
24d8a75982
[discoverygo] Fix JSON data parsing
HTMLParser, which is used by extract_attributes, already unescapes
attribute values with HTMLParser.unescape. They shouldn't be unescaped
again, to there may be parsing errors.

Ref: #11219, #11522
2017-01-05 18:50:34 +08:00
Sergey M․
7232bb299b
release 2017.01.05 2017-01-05 04:10:15 +07:00
Sergey M․
2b12e34076
[ChangeLog] Actualize 2017-01-05 04:07:32 +07:00
Sergey M․
2021b650dd
release 2017.01.02 2017-01-02 23:55:04 +07:00
Sergey M․
b890caaf21
[ChangeLog] Actualize 2017-01-02 23:54:29 +07:00
Sergey M․
dc48a35404
release 2016.12.31 2016-12-31 23:58:41 +07:00
Sergey M․
1ea0b727c4
[ChangeLog] Actualize 2016-12-31 23:53:30 +07:00
Sergey M․
5e77c0b58e
release 2016.12.22 2016-12-22 22:52:54 +07:00
Remita Amine
ab3091feda
[ChangeLog] Actualize 2016-12-22 22:51:51 +07:00
Sergey M․
90352a8041
release 2016.12.20 2016-12-20 22:39:39 +07:00
Sergey M․
1f6a79b0af
[ChangeLog] Actualize 2016-12-20 22:37:06 +07:00
Yen Chi Hsuan
8ab7e6c4cc
[kaltura] Improve widget ID extraction (closes #11480) 2016-12-20 18:45:52 +08:00
Sergey M․
f73d7d5074
release 2016.12.18 2016-12-18 19:50:33 +07:00
Sergey M․
52a1d48d9f
[ChangeLog] Actualize 2016-12-18 19:48:59 +07:00
Sergey M․
38be3bc568
release 2016.12.15 2016-12-15 21:16:55 +07:00
Sergey M․
d7ef47bffd
[ChangeLog] Actualize 2016-12-15 21:15:45 +07:00
Yen Chi Hsuan
5c32a5be95 [openload] Recognize oload.tv URLs (#10408) 2016-12-15 17:51:26 +08:00
Yen Chi Hsuan
30918999f5
[facebook] Recognize .onion URLs (closes #11443) 2016-12-15 01:04:49 +08:00
Sergey M․
3c1e9dc4ec
release 2016.12.12 2016-12-12 01:44:50 +07:00
Sergey M․
62faf9b55e
[ChangeLog] Actualize 2016-12-12 01:41:08 +07:00
Sergey M․
18ece70c4d
release 2016.12.09 2016-12-09 02:46:18 +07:00
Sergey M․
9ed3495eae
[ChangeLog] Actualize 2016-12-09 02:41:49 +07:00
Yen Chi Hsuan
6c20a0bb99
[openload] Fix extraction (closes #10408) 2016-12-09 02:15:16 +08:00
Yen Chi Hsuan
d17bfe4095
[thisoldhouse] Recognize /tv-episode/ URLs and update _TESTS
Closes #11271
2016-12-01 14:56:52 +08:00
Sergey M․
73ec479c7d
release 2016.12.01 2016-12-01 00:15:12 +07:00
Sergey M․
f150530f4d
[ChangeLog] Actualize 2016-12-01 00:13:06 +07:00
Sergey M․
2b380fc299
release 2016.11.27 2016-11-27 20:05:32 +07:00
Sergey M․
294d4926d7
[ChangeLog] Actualize 2016-11-27 20:04:03 +07:00
Yen Chi Hsuan
44444f0d3b
[cbslocal] Support newyork.cbslocal.com
Closes #11285
2016-11-24 20:32:17 +08:00
Sergey M․
3b5daf0736
release 2016.11.22 2016-11-22 22:32:16 +07:00
Sergey M․
c8f56741dd
[ChangeLog] Actualize 2016-11-22 22:29:37 +07:00
Yen Chi Hsuan
1d6ae5628f
[amcnetworks] Recognize more BBC America URLs
Closes #11263
2016-11-22 20:40:57 +08:00
Yen Chi Hsuan
303b38fa84
[ChangeLog] Update for #9028 2016-11-20 00:06:44 +08:00
Sergey M․
08ec95a6db
[ChangeLog] Actualize 2016-11-19 03:10:20 +07:00
Sergey M․
b25459b88a
release 2016.11.18 2016-11-18 00:25:24 +07:00
Sergey M․
5f75c4a4ad
[ChangeLog] Actualize 2016-11-18 00:19:55 +07:00
Yen Chi Hsuan
d76767c90e
[ChangeLog] Update after #11122 landed 2016-11-16 20:47:15 +08:00
Sergey M․
6b4dfa2819
release 2016.11.14.1 2016-11-14 02:48:15 +07:00
Sergey M․
9f60134a9d
[ChangeLog] Actualize 2016-11-14 02:46:12 +07:00
Sergey M․
b3d4bd05f9
release 2016.11.14 2016-11-14 02:39:50 +07:00
Sergey M․
dbffd00ba9
[ChangeLog] Actualize 2016-11-14 02:37:21 +07:00
Yen Chi Hsuan
3eaaa8abac [audioboom] Recognize /posts/ URLs (closes #11149) 2016-11-10 14:52:34 +08:00
Sergey M․
db3367f43e
release 2016.11.08.1 2016-11-08 22:30:53 +07:00
Sergey M․
6590925c27
[ChangeLog] Actualize 2016-11-08 22:29:16 +07:00
Sergey M․
c58e07a7aa
release 2016.11.08 2016-11-08 22:11:21 +07:00
Sergey M․
f700afa24c
[ChangeLog] Actualize 2016-11-08 22:09:03 +07:00
Yen Chi Hsuan
5d47b38cf5 [tmz:article] Fix extraction (closes #11052) 2016-11-08 21:53:41 +08:00
DarkZeros
cb882540e8 [mitele] Fix extraction after website redesign (fixes #10824) 2016-11-07 11:13:59 +01:00
Sergey M․
b30e4c2754
release 2016.11.04 2016-11-04 22:07:54 +07:00
Sergey M․
09ffe34b00
[ChangeLog] Actualize 2016-11-04 21:59:42 +07:00
Sergey M․
cc99a77ac1
[extractor/generic] Add support for ISM manifests 2016-11-02 03:01:13 +07:00
Sergey M․
8956d6608a
release 2016.11.02 2016-11-02 02:39:36 +07:00
Sergey M․
a18aeee803
[ChangeLog] Actualize 2016-11-02 02:33:17 +07:00
Sergey M․
e70a5e6566
release 2016.10.30 2016-10-30 18:24:49 +07:00
Sergey M․
3bf55be466
[ChangeLog] Actualize 2016-10-30 18:19:29 +07:00
Yen Chi Hsuan
d9ee2e5cf6
[facebook] Remove SWF params so that 1080P are detected
Closes #11073

In the provided link, SWF params give up to 720P, and VideoConfig
gives 1080P for both best and bestvideo. I guess all Facebook videos
supports HTML5 now, so I remove the old detection for SWF params
2016-10-30 18:20:55 +08:00
Yen Chi Hsuan
e1a0b3b81c
[imgur] Recognize /r/ URLs (closes #11071) 2016-10-30 17:02:03 +08:00
Yen Chi Hsuan
f02700a1fa
[openload] Fix extraction (#10408)
Thanks @TwelveCharzz again for studying openload codes
2016-10-29 18:00:30 +08:00
Yen Chi Hsuan
a5a8877f9c
[adultswim] Fix extraction (closes #10979) 2016-10-27 02:16:48 +08:00
Yen Chi Hsuan
ec8705117a
[hornbunny] Fix extraction (#10981) 2016-10-27 00:10:51 +08:00