Bug#914126: svtplay-dl: bugs out on urplay.se
On Tue, 5 Mar 2019, Olof Johansson wrote:
> On 19-01-09 19:16 +0100, Cristian Ionescu-Idbohrn wrote:
> > It redirects to streaming-loadbalancer.ur.se/loadbalancer.json
> > (130.242.59.74), which seems to be _the real problem_ (supports _only_
> > TLS 1.0/SSL3). loadbalancer.json is just one line (with no line
> > terminators):
> >
> > {"geoip_country_code":"SE","redirect":"streaming4.ur.se"}
> >
> > It redirects to streaming4.ur.se (130.242.59.77), which also seems to
> > be ok (supports TLS 1.2).
>
> Could you try using svtplay-dl with urplay again? From my end it
> seems to be working now all of a sudden. Maybe they've upgraded
> their loadbalancers?
Yes, that's what they did:
https://www.ssllabs.com/ssltest/analyze.html?d=streaming-loadbalancer.ur.se
Tested this:
$ svtplay-dl --verbose -g
https://urplay.se/program/209693-omojliga-jarnvagar-tagen-och-bergen
It works on buster/testing but on current stable/stretch svtplay-dl
fails:
DEBUG [1551860566.52] /usr/bin/svtplay-dl/svtplay_dl/utils/__init__.py/request:
HTTP getting
'https://urplay.se/program/209693-omojliga-jarnvagar-tagen-och-bergen'
DEBUG [1551860567.31] /usr/bin/svtplay-dl/svtplay_dl/utils/__init__.py/request:
HTTP getting u'//streaming-loadbalancer.ur.se/loadbalancer.json'
ERROR [1551860567.31] /usr/bin/svtplay-dl/svtplay_dl/__init__.py/get_one_media:
version: 1.9.1
Traceback (most recent call last):
File "/usr/lib/python2.7/runpy.py", line 174, in _run_module_as_main
"__main__", fname, loader, pkg_name)
File "/usr/lib/python2.7/runpy.py", line 72, in _run_code
exec code in run_globals
File "/usr/bin/svtplay-dl/__main__.py", line 13, in
File "/usr/bin/svtplay-dl/svtplay_dl/__init__.py", line 459, in main
File "/usr/bin/svtplay-dl/svtplay_dl/__init__.py", line 192, in get_media
File "/usr/bin/svtplay-dl/svtplay_dl/__init__.py", line 239, in get_one_media
File "/usr/bin/svtplay-dl/svtplay_dl/service/urplay.py", line 49, in get
AttributeError: 'NoneType' object has no attribute 'text'
Cheers,
--
Cristian
Bug#914126: svtplay-dl: bugs out on urplay.se
Hi,
On 19-01-09 19:16 +0100, Cristian Ionescu-Idbohrn wrote:
> It redirects to streaming-loadbalancer.ur.se/loadbalancer.json
> (130.242.59.74), which seems to be _the real problem_ (supports _only_
> TLS 1.0/SSL3). loadbalancer.json is just one line (with no line
> terminators):
>
> {"geoip_country_code":"SE","redirect":"streaming4.ur.se"}
>
> It redirects to streaming4.ur.se (130.242.59.77), which also seems to
> be ok (supports TLS 1.2).
Could you try using svtplay-dl with urplay again? From my end it
seems to be working now all of a sudden. Maybe they've upgraded
their loadbalancers?
--
Olof
Bug#914126: svtplay-dl: bugs out on urplay.se
forwarded 914126 https://github.com/spaam/svtplay-dl/issues/1034
thanks
On 19-01-09 19:16 +0100, Cristian Ionescu-Idbohrn wrote:
> Now that 2.1-1 is available in unstable, I tested. The problem
> persists :(
Yes, noticed that too unfortunately (but we suspected as much).
> It redirects to streaming-loadbalancer.ur.se/loadbalancer.json
> (130.242.59.74), which seems to be _the real problem_ (supports _only_
> TLS 1.0/SSL3). loadbalancer.json is just one line (with no line
> terminators):
>
> {"geoip_country_code":"SE","redirect":"streaming4.ur.se"}
...
> I wonder if this could be worked around, as it must affect all
> python3 based svtplay-dl, AFAICU. Please forward upstream.
Thanks for investigating; forwarded to upstream's github as #1034.
--
olof
Bug#914126: svtplay-dl: bugs out on urplay.se
On Fri, 23 Nov 2018, Olof Johansson wrote:
> On 18-11-19 18:37 +0100, Cristian Ionescu-Idbohrn wrote:
> > This is what I see:
> ...
> > requests.exceptions.SSLError:
> > HTTPSConnectionPool(host='streaming-loadbalancer.ur.se', port=443): Max
> > retries exceeded with url: /loadbalancer.json (Caused by
> > SSLError(SSLError("bad handshake: Error([('SSL routines',
> > 'ssl_choose_client_version', 'unsupported protocol')],)",),))
> >
> > when trying to download:
> >
> > https://urplay.se/program/204949-roster-fran-australiens-aboriginer
> >
> > for example. Works fine when playing it in chromium, though.
> >
> > Downloading from svtplay.se works fine, though.
>
> Thanks for the report, I have been postponing upgrading to the
> new 2.0+ version, but should get on that asap. Hopefully that
> should solve it.
Now that 2.1-1 is available in unstable, I tested. The problem
persists :(
Checked using https://www.ssllabs.com/ssltest/analyze.html.
urplay.se (212.116.95.198, 212.116.95.234, etc.) seems ok (supports
TLS 1.2).
It redirects to streaming-loadbalancer.ur.se/loadbalancer.json
(130.242.59.74), which seems to be _the real problem_ (supports _only_
TLS 1.0/SSL3). loadbalancer.json is just one line (with no line
terminators):
{"geoip_country_code":"SE","redirect":"streaming4.ur.se"}
It redirects to streaming4.ur.se (130.242.59.77), which also seems to
be ok (supports TLS 1.2).
I wonder if this could be worked around, as it must affect all
python3 based svtplay-dl, AFAICU. Please forward upstream.
Cheers,
--
Cristian
Bug#914126: svtplay-dl: bugs out on urplay.se
On Sat, 24 Nov 2018, Cristian Ionescu-Idbohrn wrote:
> On Fri, 23 Nov 2018, Olof Johansson wrote:
> > On 18-11-19 18:37 +0100, Cristian Ionescu-Idbohrn wrote:
> > > This is what I see:
> > ...
> > > requests.exceptions.SSLError:
> > > HTTPSConnectionPool(host='streaming-loadbalancer.ur.se', port=443): Max
> > > retries exceeded with url: /loadbalancer.json (Caused by
> > > SSLError(SSLError("bad handshake: Error([('SSL routines',
> > > 'ssl_choose_client_version', 'unsupported protocol')],)",),))
> > >
> > > when trying to download:
> > >
> > > https://urplay.se/program/204949-roster-fran-australiens-aboriginer
> > >
> > > for example. Works fine when playing it in chromium, though.
> > >
> > > Downloading from svtplay.se works fine, though.
> >
> > Thanks for the report, I have been postponing upgrading to the
> > new 2.0+ version, but should get on that asap. Hopefully that
> > should solve it.
>
> Doesn't seem so :( I tested with master (2.1-14-g72143b7). Similar
> problem. Attaching a trace done with that version.
FWIW, `curl' is showing a similar error when attempting to download:
$ curl -v https://streaming-loadbalancer.ur.se/loadbalancer.json
* Trying 130.242.59.74...
* TCP_NODELAY set
* Connected to streaming-loadbalancer.ur.se (130.242.59.74) port 443
(#0)
* ALPN, offering h2
* ALPN, offering http/1.1
* successfully set certificate verify locations:
* CAfile: none
CApath: /etc/ssl/certs
* TLSv1.3 (OUT), TLS handshake, Client hello (1):
* TLSv1.3 (IN), TLS handshake, Server hello (2):
* TLSv1.3 (OUT), TLS alert, protocol version (582):
* error:1425F102:SSL routines:ssl_choose_client_version:unsupported
protocol
* Closing connection 0
curl: (35) error:1425F102:SSL
routines:ssl_choose_client_version:unsupported protocol
But `wget' manages to do it:
$ wget -O - --quiet
https://streaming-loadbalancer.ur.se/loadbalancer.json;echo
{"geoip_country_code":"SE","redirect":"streaming4.ur.se"}
`svtplay-dl` 1.9.1-0.1 on stretch manages to download:
$ svtplay-dl --verbose -P hls -g
https://urplay.se/program/204949-roster-fran-australiens-aboriginer
DEBUG [1543070399.9]
/usr/bin/svtplay-dl/svtplay_dl/utils/__init__.py/request: HTTP getting
'https://urplay.se/program/204949-roster-fran-australiens-aboriginer'
DEBUG [1543070400.01]
/usr/bin/svtplay-dl/svtplay_dl/utils/__init__.py/request: HTTP getting
u'https://streaming-loadbalancer.ur.se/loadbalancer.json'
DEBUG [1543070400.11]
/usr/bin/svtplay-dl/svtplay_dl/utils/__init__.py/request: HTTP getting
u'http://streaming4.ur.se/urplay/_definst_/mp4:se/204000-204999/204949-11.mp4/playlist.m3u8'
DEBUG [1543070400.3]
/usr/bin/svtplay-dl/svtplay_dl/utils/__init__.py/request: HTTP getting
u'http://streaming4.ur.se/urplay/_definst_/mp4:se/204000-204999/204949-5.mp4/playlist.m3u8'
DEBUG [1543070400.72]
/usr/bin/svtplay-dl/svtplay_dl/utils/__init__.py/protocol_prio: Protocol
priority scores (higher is better): {'dash': 5, 'hds': 3, 'hls': 4, 'http': 2,
'rtmp': 1}
https://streaming4.ur.se/urplay/_definst_/mp4:se/204000-204999/204949-5.mp4/chunklist_w64863179.m3u8
So, it seems the problem might very well be openssl both in buster and
sid, but I may be wrong.
On sid:
$ openssl s_client -connect streaming-loadbalancer.ur.se:443;echo $?
CONNECTED(0003)
140235689968640:error:1425F102:SSL
routines:ssl_choose_client_version:unsupported
protocol:../ssl/statem/statem_lib.c:1940:
---
no peer certificate available
---
No client certificate CA names sent
---
SSL handshake has read 86 bytes and written 327 bytes
Verification: OK
---
New, (NONE), Cipher is (NONE)
Secure Renegotiation IS NOT supported
Compression: NONE
Expansion: NONE
No ALPN negotiated
Early data was not sent
Verify return code: 0 (ok)
---
fails. See Bug#912737 too. But it succedes if I force TLS down to
TLSv1:
$ openssl s_client -tls1 -connect streaming-loadbalancer.ur.se:443;echo
$?
CONNECTED(0003)
depth=2 C = US, O = DigiCert Inc, OU = www.digicert.com, CN = DigiCert
Global Root CA
verify return:1
depth=1 C = US, O = DigiCert Inc, OU = www.digicert.com, CN = Thawte
RSA CA 2018
verify return:1
depth=0 C = SE, L = Stockholm, O = Sveriges Utbildningsradio AB, OU =
IT, CN = *.ur.se
verify return:1
139650269000704:error:141A318A:SSL routines:tls_process_ske_dhe:dh key
too small:../ssl/statem/statem_clnt.c:2160:
---
Certificate chain
0 s:C = SE, L = Stockholm, O = Sveriges Utbildningsradio AB, OU = IT,
CN = *.ur.se
i:C = US, O = DigiCert Inc, OU = www.digicert.com, CN = Thawte RSA
CA 2018
1 s:C = US,
Bug#914126: svtplay-dl: bugs out on urplay.se
On Fri, 23 Nov 2018, Olof Johansson wrote:
> On 18-11-19 18:37 +0100, Cristian Ionescu-Idbohrn wrote:
> > This is what I see:
> ...
> > requests.exceptions.SSLError:
> > HTTPSConnectionPool(host='streaming-loadbalancer.ur.se', port=443): Max
> > retries exceeded with url: /loadbalancer.json (Caused by
> > SSLError(SSLError("bad handshake: Error([('SSL routines',
> > 'ssl_choose_client_version', 'unsupported protocol')],)",),))
> >
> > when trying to download:
> >
> > https://urplay.se/program/204949-roster-fran-australiens-aboriginer
> >
> > for example. Works fine when playing it in chromium, though.
> >
> > Downloading from svtplay.se works fine, though.
>
> Thanks for the report, I have been postponing upgrading to the
> new 2.0+ version, but should get on that asap. Hopefully that
> should solve it.
Doesn't seem so :( I tested with master (2.1-14-g72143b7). Similar
problem. Attaching a trace done with that version.
Cheers,
--
Cristian$ ~/DEVEL/svtplay-dl/svtplay-dl --verbose -P hls -g
https://urplay.se/program/204949-roster-fran-australiens-aboriginer
DEBUG [1543056480.152882]
~/DEVEL/svtplay-dl/svtplay-dl/svtplay_dl/utils/getmedia.py/get_media: version:
2.1-14-g72143b7
DEBUG [1543056480.1539545]
~/DEVEL/svtplay-dl/svtplay-dl/svtplay_dl/service/__init__.py/__init__: service:
urplay
DEBUG [1543056480.1540117]
~/DEVEL/svtplay-dl/svtplay-dl/svtplay_dl/utils/http.py/request: HTTP getting
'https://urplay.se/program/204949-roster-fran-australiens-aboriginer'
DEBUG [1543056480.155448]
/usr/lib/python3/dist-packages/urllib3/connectionpool.py/_new_conn: Starting
new HTTPS connection (1): urplay.se:443
DEBUG [1543056480.2892246]
/usr/lib/python3/dist-packages/urllib3/connectionpool.py/_make_request:
https://urplay.se:443 "GET /program/204949-roster-fran-australiens-aboriginer
HTTP/1.1" 200 16422
DEBUG [1543056480.292382]
~/DEVEL/svtplay-dl/svtplay-dl/svtplay_dl/utils/http.py/request: HTTP getting
'https://streaming-loadbalancer.ur.se/loadbalancer.json'
DEBUG [1543056480.2933757]
/usr/lib/python3/dist-packages/urllib3/connectionpool.py/_new_conn: Starting
new HTTPS connection (1): streaming-loadbalancer.ur.se:443
DEBUG [1543056480.3410475]
/usr/lib/python3/dist-packages/urllib3/util/retry.py/increment: Incremented
Retry for (url='/loadbalancer.json'): Retry(total=4, connect=5, read=5,
redirect=None, status=None)
WARNING [1543056480.341197]
/usr/lib/python3/dist-packages/urllib3/connectionpool.py/urlopen: Retrying
(Retry(total=4, connect=5, read=5, redirect=None, status=None)) after
connection broken by 'SSLError(SSLError("bad handshake: Error([('SSL routines',
'ssl_choose_client_version', 'unsupported protocol')],)",),)':
/loadbalancer.json
DEBUG [1543056480.3413193]
/usr/lib/python3/dist-packages/urllib3/connectionpool.py/_new_conn: Starting
new HTTPS connection (2): streaming-loadbalancer.ur.se:443
DEBUG [1543056480.3939955]
/usr/lib/python3/dist-packages/urllib3/util/retry.py/increment: Incremented
Retry for (url='/loadbalancer.json'): Retry(total=3, connect=5, read=5,
redirect=None, status=None)
WARNING [1543056480.994881]
/usr/lib/python3/dist-packages/urllib3/connectionpool.py/urlopen: Retrying
(Retry(total=3, connect=5, read=5, redirect=None, status=None)) after
connection broken by 'SSLError(SSLError("bad handshake: Error([('SSL routines',
'ssl_choose_client_version', 'unsupported protocol')],)",),)':
/loadbalancer.json
DEBUG [1543056480.9951062]
/usr/lib/python3/dist-packages/urllib3/connectionpool.py/_new_conn: Starting
new HTTPS connection (3): streaming-loadbalancer.ur.se:443
DEBUG [1543056481.0753078]
/usr/lib/python3/dist-packages/urllib3/util/retry.py/increment: Incremented
Retry for (url='/loadbalancer.json'): Retry(total=2, connect=5, read=5,
redirect=None, status=None)
WARNING [1543056482.2757819]
/usr/lib/python3/dist-packages/urllib3/connectionpool.py/urlopen: Retrying
(Retry(total=2, connect=5, read=5, redirect=None, status=None)) after
connection broken by 'SSLError(SSLError("bad handshake: Error([('SSL routines',
'ssl_choose_client_version', 'unsupported protocol')],)",),)':
/loadbalancer.json
DEBUG [1543056482.2761137]
/usr/lib/python3/dist-packages/urllib3/connectionpool.py/_new_conn: Starting
new HTTPS connection (4): streaming-loadbalancer.ur.se:443
DEBUG [1543056482.3429654]
/usr/lib/python3/dist-packages/urllib3/util/retry.py/increment: Incremented
Retry for (url='/loadbalancer.json'): Retry(total=1, connect=5, read=5,
redirect=None, status=None)
WARNING [1543056484.7437494]
/usr/lib/python3/dist-packages/urllib3/connectionpool.py/urlopen: Retrying
(Retry(total=1, connect=5, read=5, redirect=None, status=None)) after
connection broken by 'SSLError(SSLError("bad handshake: Error([('SSL routines',
'ssl_choose_client_version', 'unsupported protocol')],)",),)':
/loadbalancer.json
DEBUG [1543056484.7439423]
/usr/lib/python3/dist-packages/urllib3/connectionpool.py/_new_conn: Starting
new HTTPS connection (5):
Bug#914126: svtplay-dl: bugs out on urplay.se
On 18-11-19 18:37 +0100, Cristian Ionescu-Idbohrn wrote:
> This is what I see:
...
> requests.exceptions.SSLError:
> HTTPSConnectionPool(host='streaming-loadbalancer.ur.se', port=443): Max
> retries exceeded with url: /loadbalancer.json (Caused by
> SSLError(SSLError("bad handshake: Error([('SSL routines',
> 'ssl_choose_client_version', 'unsupported protocol')],)",),))
>
> when trying to download:
>
> https://urplay.se/program/204949-roster-fran-australiens-aboriginer
>
> for example. Works fine when playing it in chromium, though.
>
> Downloading from svtplay.se works fine, though.
Thanks for the report, I have been postponing upgrading to the
new 2.0+ version, but should get on that asap. Hopefully that
should solve it.
--
olof
Bug#914126: svtplay-dl: bugs out on urplay.se
Package: svtplay-dl
Version: 1.9.11-1
Severity: important
This is what I see:
DEBUG [1542646174.83] /usr/bin/svtplay-dl/svtplay_dl/__init__.py/get_media:
version: 1.9.11
DEBUG [1542646174.83] /usr/bin/svtplay-dl/svtplay_dl/utils/__init__.py/request:
HTTP getting
'https://urplay.se/program/204949-roster-fran-australiens-aboriginer'
DEBUG [1542646174.95] /usr/bin/svtplay-dl/svtplay_dl/utils/__init__.py/request:
HTTP getting u'https://streaming-loadbalancer.ur.se/loadbalancer.json'
Traceback (most recent call last):
File "/usr/lib/python2.7/runpy.py", line 174, in _run_module_as_main
"__main__", fname, loader, pkg_name)
File "/usr/lib/python2.7/runpy.py", line 72, in _run_code
exec code in run_globals
File "/usr/bin/svtplay-dl/__main__.py", line 13, in
File "/usr/bin/svtplay-dl/svtplay_dl/__init__.py", line 511, in main
File "/usr/bin/svtplay-dl/svtplay_dl/__init__.py", line 217, in get_media
File "/usr/bin/svtplay-dl/svtplay_dl/__init__.py", line 265, in get_one_media
File "/usr/bin/svtplay-dl/svtplay_dl/service/urplay.py", line 52, in get
File "/usr/bin/svtplay-dl/svtplay_dl/utils/__init__.py", line 68, in request
File "/usr/lib/python2.7/dist-packages/requests/sessions.py", line 524, in
request
resp = self.send(prep, **send_kwargs)
File "/usr/lib/python2.7/dist-packages/requests/sessions.py", line 637, in
send
r = adapter.send(request, **kwargs)
File "/usr/lib/python2.7/dist-packages/requests/adapters.py", line 514, in
send
raise SSLError(e, request=request)
requests.exceptions.SSLError:
HTTPSConnectionPool(host='streaming-loadbalancer.ur.se', port=443): Max retries
exceeded with url: /loadbalancer.json (Caused by SSLError(SSLError("bad
handshake: Error([('SSL routines', 'ssl_choose_client_version', 'unsupported
protocol')],)",),))
when trying to download:
https://urplay.se/program/204949-roster-fran-australiens-aboriginer
for example. Works fine when playing it in chromium, though.
Downloading from svtplay.se works fine, though.
-- System Information:
Debian Release: buster/sid
APT prefers unstable
APT policy: (500, 'unstable'), (1, 'experimental')
Architecture: amd64 (x86_64)
Foreign Architectures: i386
Kernel: Linux 4.18.0-1-amd64 (SMP w/8 CPU cores)
Locale: LANG=C, LC_CTYPE=C (charmap=ANSI_X3.4-1968), LANGUAGE=en_US:en
(charmap=ANSI_X3.4-1968)
Shell: /bin/sh linked to /bin/dash
Init: sysvinit (via /sbin/init)
Versions of packages svtplay-dl depends on:
ii ffmpeg 10:4.1-dmo2
ii python 2.7.15-3
ii python-crypto2.6.1-9+b1
ii python-requests 2.20.0-2
ii rtmpdump 2:2.4~20160119.gitfa8646dae-dmo5
svtplay-dl recommends no packages.
svtplay-dl suggests no packages.
-- no debconf information
Cheers,
--
Cristian
