Re: Starting November 11, 2014 output filenames missing underline/underscore
artisticforge . artisticfo...@gmail.com wrote: Hello; while looking at the BBC Radio Wales issue, I noticed a separate issue. Starting November 11th, output file names for programmes from the National BBC Radio Stations and at least 2 of the larger local radio Stations are missing the underline/underscore, which replaced the blank space in the file name. i am using get_iplayer-bb82110, which is get_iplayer-2.90 with additional editing. The release notes for 2.87 describe changes in the way punctuation characters etc are removed from filenames. See: https://github.com/dinkypumpkin/get_iplayer/wiki/release287 Having said that, filenames here have spaces in them; perhaps because I use the --whitespace option? -- Jeremy Nicoll - my opinions are my own. ___ get_iplayer mailing list get_iplayer@lists.infradead.org http://lists.infradead.org/mailman/listinfo/get_iplayer
Re: peculiar to BBC Radio Wales?
artisticforge . artisticfo...@gmail.com wrote: concerning the below: INFO: 1 Matching Programmes INFO: Programme not in history WARNING: Page parsing may fail with HTML::Parser versions before 3.71. You have version 3.69. I am running Debian Wheezy and Debian has not upgrade those modules as of yet. I am an Electrical Engineer, B.S.E.E., University of Illinois, Urbana-Champaign, IL. so I do know how to read and I am aware of possible issues that the fore mentioned mismatch may cause. I had all ready proven to myself that the mismatch was not the issue. Then you should have said so. No-one here is clairvoyant. -- Jeremy Nicoll - my opinions are my own. ___ get_iplayer mailing list get_iplayer@lists.infradead.org http://lists.infradead.org/mailman/listinfo/get_iplayer
Re: Starting November 11, 2014 output filenames missing underline/underscore
On 17/11/2014 06:17, artisticforge . wrote: while looking at the BBC Radio Wales issue, I noticed a separate issue. Starting November 11th, output file names for programmes from the National BBC Radio Stations and at least 2 of the larger local radio Stations are missing the underline/underscore, which replaced the blank space in the file name. Should be fixed in Git. https://github.com/dinkypumpkin/get_iplayer/wiki/installation#githead ___ get_iplayer mailing list get_iplayer@lists.infradead.org http://lists.infradead.org/mailman/listinfo/get_iplayer
Re: peculiar to BBC Radio Wales?
Hello Like get_iplayer, I to may real soon now be obsolete as in dead. So forgive me for not filling in a the required blanks when posting. I have survived three events any one of which should have killed me. Trust me, there things worse than death. I spend my days either inspecting the ceiling or seating in a wheelchair. Morphine, keeps the pain at bay. Sent from my iPad terry l. ridder On Nov 17, 2014, at 4:54, Jeremy Nicoll - ml get_iplayer jn.ml.gti...@wingsandbeaks.org.uk wrote: artisticforge . artisticfo...@gmail.com wrote: concerning the below: INFO: 1 Matching Programmes INFO: Programme not in history WARNING: Page parsing may fail with HTML::Parser versions before 3.71. You have version 3.69. I am running Debian Wheezy and Debian has not upgrade those modules as of yet. I am an Electrical Engineer, B.S.E.E., University of Illinois, Urbana-Champaign, IL. so I do know how to read and I am aware of possible issues that the fore mentioned mismatch may cause. I had all ready proven to myself that the mismatch was not the issue. Then you should have said so. No-one here is clairvoyant. -- Jeremy Nicoll - my opinions are my own. ___ get_iplayer mailing list get_iplayer@lists.infradead.org http://lists.infradead.org/mailman/listinfo/get_iplayer ___ get_iplayer mailing list get_iplayer@lists.infradead.org http://lists.infradead.org/mailman/listinfo/get_iplayer
Re: peculiar to BBC Radio Wales?
Hello
The patch suggested works.
The work now is to incorporate this into get_iplayer so that a ms4
failure falls over to try ms5.
The patched get_iplayer has downloaded Roy Noble and Beverley's World
of Music from BBC radio Wales.
On Mon, Nov 17, 2014 at 1:22 AM, Vangelis forthnet
northmed...@the.forthnet.gr wrote:
On Mon Nov 17 00:31:24 GMT 2014, artisticforge wrote:
today, of the three BBC Radio Wales programmes that I normally get
all are having to be downloaded as liveradio with radiomode=wma
the three programmes are Roy Noble,
(snip)
I have a gut feeling that this is a permanent change.
Greetings, Terry :-)
Unfortunately, your gut feeling is right;
this is another prelude of more changes to come;
this issue of yours has the same root cause as the
one reported in the following support forum thread:
https://squarepenguin.co.uk/forums/topic/downloads-from-bbc-radio-nan-gaidheal-and-radio-ulster-have-failed/
The BBC are testing (?) the new changes starting with the Nations Radios...
You being this highly educated, I'll provide some technical details that I'm
sure
will puzzle the non-savvy...
Taking as an example the Roy Noble radio programme, with PID=b04nj385,
the legacy XML playlist that GiP first tries:
http://www.bbc.co.uk/iplayer/playlist/b04nj385
returns: noItems reason=preAvailability/.
GiP has been recently patched and so then tries
the new JSON playlist:
http://www.bbc.co.uk/programmes/b04nj385/playlist.json
This, when parsed, returns: vPID=b04nj37m.
vPID string is used to rertrieve the stream details.
GiP up to now uses exclusively the legacy
mediaselector/4 API (I'll call it ms4 for brevity):
http://www.bbc.co.uk/mediaselector/4/mtis/stream/b04nj37m
The BBC have left but the wma stream data (48kbps bitrate),
the rtmp stream data previously also present there have vanished...
So GiP only sees the wma radiomode as being available for
recording...
The Beeb have in turn implemented the new mediaselector/5
(ms5) API for this radio show and, evidently, many others from
the Nations radios.
This new ms5 URL varies according to the client device the stream
is destined for - this is the mediaset part of the URL; for desktops
laptops, mediaset=pc and the URL looks like:
http://open.live.bbc.co.uk/mediaselector/5/select/version/2.0/mediaset/pc/vpid/b04nj37m
As you can see, ONLY THE RTMP STREAMS are therein
(radiomodes flashaacstd flashaaclow). This is because, as they have
already announced, the wma streams will be axed in the end of the year...
For info, other mediasets that I have found browsing their code are:
mediaset/journalism-pc/
mediaset/mobile-phone-basic/
mediaset/mobile-phone-main/
mediaset/mobile-tablet-main/
mediaset/journalism-http-tablet/
and others...
So, for a mobile tablet the ms5 URL would be:
http://open.live.bbc.co.uk/mediaselector/5/select/version/2.0/mediaset/mobile-tablet-main/vpid/b04nj37m
(you'll notice therein the details of the akamai_hls_open streams,
delivered over http - they have also heralded the implementation of
AdobeHDS streams for AOD sometime in 2015).
Now, if you still want the rtmp stream of Roy Noble dumped to disk,
you can:
1. Manually retrieve the stream parameters from the ms5 page and
then manually compose a working rtmpdump command - I have posted
templates for both ak ll CDNs some weeks ago in the list:
http://lists.infradead.org/pipermail/get_iplayer/attachments/20141007/8253d96d/attachment.txt
2. patch your local copy of GiP to use the ms5 URL -
Make a copy of your version of the script and edit it with an editor.
Sadly I am not a coder, so I had to apply a butcher method myself
(this is because from the start of September, the majority of visual content
(usually clips of TV programmes) offered to non-UK users of iplayer
is using exclusively the ms5 infrastructure).
In the get_stream_data subroutine, change
my $media_stream_data_prefix =
'http://www.bbc.co.uk/mediaselector/4/mtis/stream/'; # $verpid
to
my $media_stream_data_prefix =
'http://open.live.bbc.co.uk/mediaselector/5/select/version/2.0/mediaset/pc/vpid/';
# $verpid
Also, the ms5 pages do not contain the kind= entry, but the supplier=
entry
with equal value can be used in its place.
So, some
$cattribs-{kind}
entries in the GiP code (inside the get_stream_data_cdn subroutine)
for flash on demand streams must be changed to
$cattribs-{supplier}
BUT FIRST, comment out the following code:
# Get authstring from more specific mediaselector if this mode is
specified - fails sometimes otherwise
# if ( $cattribs-{authString} $cattribs-{supplier} =~
/^(limelight|akamai|level3|sis|iplayertok)$/ (grep /^$mode$/, (split /,/,
$mattribs-{modelist})) ) {
# Build URL
# my $media_stream_data_prefix =
'http://open.live.bbc.co.uk/mediaselector/5/select/version/2.0/mediaset/pc/vpid/';
# my $url =
Trouble getting get_iplayer.cgi to run under Cygwin
Dear all, I have encountered a bit of a problem when I try to run get_iplayer.cgi using Cygwin environment. So far I have: (1) installed base Cygwin environment; (2) installed all get_iplayer dependencies using Cygwin Ports (http://cygwinports.org) (3) installed all Perl modules required by get_iplayer/get_iplayer.cgi using cpanm (4) moved both get_iplayer and get_iplayer.cgi to /usr/bin under Cygwin subdirectory structure (5) run successfully get_iplayer from command line (I updated cache and downloaded couple of radio programs); However, when I issue following command: get_iplayer.cgi --listen=127.0.0.1 --port=1935 --getiplayer=/usr/bin/get_iplayer --debug it returns information shown below (between ---). I would really appreciate your help with this issue. Where should I look, what should I check, what am I missing? Best regards, MS --- get_iplayer.cgi --listen=127.0.0.1 --port=1935 --debug --getiplayer=/usr/bin/get_iplayer INFO: Command: /usr/bin/get_iplayer --encoding-locale=UTF-8 --encoding-console-out=UTF-8 --nopurge --nocopyright --showoptions INFO: Command: /usr/bin/get_iplayer --encoding-locale=UTF-8 --encoding-console-out=UTF-8 --nopurge --nocopyright --showoptions INFO: Command: /usr/bin/get_iplayer --encoding-locale=UTF-8 --encoding-console-out=UTF-8 --nopurge --nocopyright --listplugins INFO: Listening on 127.0.0.1:1935 REQUEST HEADER: Host: localhost:1935 REQUEST HEADER: Connection: keep-alive REQUEST HEADER: Cache-Control: max-age=0 REQUEST HEADER: Accept: text/html,application/xhtml+xml,application/xml;q=0.9,image/webp,*/*;q=0.8 REQUEST HEADER: User-Agent: Mozilla/5.0 (Windows NT 6.1; WOW64) AppleWebKit/537.36 (KHTML, like Gecko) Chrome/38.0.2125.122 Safari/537.36 REQUEST HEADER: DNT: 1 REQUEST HEADER: Accept-Encoding: gzip,deflate,sdch REQUEST HEADER: Accept-Language: en-GB,en;q=0.8,de;q=0.6,pl;q=0.4,en-US;q=0.2 GET: / DEBUG: Using PVRHOLDOFF = -- DEBUG: Using CATEGORY = -- DEBUG: Using MODES = default -- DEBUG: Using REVERSE = 0 -- DEBUG: Using EXCLUDECHANNEL = -- DEBUG: Using HIDDENTAB = no -- DEBUG: Using AUTOPVRRUN = 4 -- DEBUG: Using STREAMTYPE = -- DEBUG: Using SINCE = -- DEBUG: Using FORCE = 0 -- DEBUG: Using SORT = index -- DEBUG: Using RECORDINGTAB = no -- DEBUG: Using BEFORE = -- DEBUG: Using URL = -- DEBUG: Using REFRESHFUTURE = 0 -- DEBUG: Using FUTURE = 0 -- DEBUG: Using SUBTITLES = 0 -- DEBUG: Using SEARCHFIELDS = name -- DEBUG: Using PROGTYPES = tv -- DEBUG: Using EXCLUDE = -- DEBUG: Using INFO = 0 -- DEBUG: Using PROXY = -- DEBUG: Using AUTOWEBREFRESH = 1 -- DEBUG: Using ACTION = -- DEBUG: Using VFR = -- DEBUG: Using EXCLUDECATEGORY = -- DEBUG: Using COLUMNSTAB = no -- DEBUG: Using NEXTPAGE = search_progs -- DEBUG: Using CHANNEL = -- DEBUG: Using STREAMINGTAB = no -- DEBUG: Using SEARCHTAB = yes -- DEBUG: Using SEARCH = .* -- DEBUG: Using PAGESIZE = 20 -- DEBUG: Using HISTORY = 0 -- DEBUG: Using DISPLAYTAB = no -- DEBUG: Using VERSIONLIST = default -- DEBUG: Using HIDE = 0 -- DEBUG: Using COLS = -- DEBUG: Using OUTPUT = -- DEBUG: Using SAVE = 0 -- DEBUG: Using VSIZE = -- DEBUG: Using THUMB = 0 -- DEBUG: Using METADATA = -- DEBUG: Using BITRATE = -- DEBUG: Using HIDEDELETED = 0 -- DEBUG: Using PAGENO = 1 -- HEADERS: Date: Mon, 17 Nov 2014 17:31:37 GMT Content-Type: text/html; charset=utf-8 DEBUG: get_iplayer options: modes=default force=0 refreshfuture=0 future=0 subtitles=0 fields=name type=tv search=.* history=0 versionlist=default hide=0 thumb=0 skipdeleted=0 nopurge=1 listformat=ENTRY|index|thumbnail|pid|available|type|name|episode|versions|duration|desc|channel|categories|timeadded|guidance|web|seriesnum|episodenum|filename|mode page=1 pagesize=20 sortmatches=index INFO: Command: /usr/bin/get_iplayer --encoding-locale=UTF-8 --encoding-console-out=UTF-8 --nocopyright --expiry=9 --webrequest modes%3Ddefault?force%3D0?refreshfuture%3D0?future%3D0?subtitles%3D0?fields%3Dname?type%3Dtv?search%3D.%2A?history%3D0?versionlist%3Ddefault?hide%3D0?thumb%3D0?skipdeleted%3D0?nopurge%3D1?listformat%3DENTRY%7C%3Cindex%3E%7C%3Cthumbnail%3E%7C%3Cpid%3E%7C%3Cavailable%3E%7C%3Ctype%3E%7C%3Cname%3E%7C%3Cepisode%3E%7C%3Cversions%3E%7C%3Cduration%3E%7C%3Cdesc%3E%7C%3Cchannel%3E%7C%3Ccategories%3E%7C%3Ctimeadded%3E%7C%3Cguidance%3E%7C%3Cweb%3E%7C%3Cseriesnum%3E%7C%3Cepisodenum%3E%7C%3Cfilename%3E%7C%3Cmode%3E?page%3D1?pagesize%3D20?sortmatches%3Dindex ERROR: Command failed to execute: No child processes INFO: Command exit code 72057594037927935 filename: No such file or directory at /usr/bin/get_iplayer.cgi line 2341 -- ___ get_iplayer mailing list get_iplayer@lists.infradead.org http://lists.infradead.org/mailman/listinfo/get_iplayer
Re: peculiar to BBC Radio Wales?
On 17/11/2014 00:31, artisticforge . wrote: today, of the three BBC Radio Wales programmes that I normally get all are having to be downloaded as liveradio with radiomode=wma the three programmes are Roy Noble, Celtic Heartbeat and Beverley's World of Music First cut at a fix now in Git: https://github.com/dinkypumpkin/get_iplayer/wiki/installation#githead There have a been several similar problems reported lately (all with nations radio programmes so far), enough to be more than coincidental. I'm assuming that the mediaselector/4 API is on the way to being killed, or left to rot, at least in part. Whatever the case, some RTMP streams are disappearing. So, for anyone using this patch: - I've changed get_iplayer to use the mediaselector/5 API by default. If you don't know what mediaselector/5 API means, all you need to know is that it is a newer BBC interface for retrieving media stream parameters. It should return RTMP stream data that is missing from the older mediaselector/4 API for some programmes. - AFAICT, this change seems to work for iPlayer content and BBC news site videos. In the past, there were some other esoteric audio/video things that get_iplayer could download. I don't remember what they were specifically, or if they are still around. If you find some non-iPlayer content along those lines that no longer works, feel free to post it. However, my attitude is that anything that is not iPlayer content can be thrown under the bus it it's any trouble to fix. - wma mode (radio) and flashlow mode (tv) are not available. WMA is going bye-bye in 6 weeks, so you should be weaning yourself off it anyway. Lower-quality modes for video are now only available in the mobile device mediasets. If you don't know what mediaset means in this context, all you need to is that it is a construct used to segment the available media streams into groups for different types of devices, e.g., mobile vs desktop. It may be possible to bring in the low-quality video modes from mobile mediasets, but that is a headache for another time. - Use --mediaselector=4 to return to the old behaviour, e.g., in order to get wma or flashlow mode. There is no guarantee it will work, however. ___ get_iplayer mailing list get_iplayer@lists.infradead.org http://lists.infradead.org/mailman/listinfo/get_iplayer
Re: peculiar to BBC Radio Wales?
Hello; The new patch appears to be working just fine. I fired up get-iplayer-automater under snow leopard on my one mac-mini. i replaced the get_iplayer with the new patched version. i see no reason why it will not work, but going to test more just to make sure. get_iplayer-patch-ms5 is running excellent under Debian Linux Wheezy. On Mon, Nov 17, 2014 at 2:01 PM, dinkypumpkin dinkypump...@gmail.com wrote: On 17/11/2014 00:31, artisticforge . wrote: today, of the three BBC Radio Wales programmes that I normally get all are having to be downloaded as liveradio with radiomode=wma the three programmes are Roy Noble, Celtic Heartbeat and Beverley's World of Music First cut at a fix now in Git: https://github.com/dinkypumpkin/get_iplayer/wiki/installation#githead There have a been several similar problems reported lately (all with nations radio programmes so far), enough to be more than coincidental. I'm assuming that the mediaselector/4 API is on the way to being killed, or left to rot, at least in part. Whatever the case, some RTMP streams are disappearing. So, for anyone using this patch: - I've changed get_iplayer to use the mediaselector/5 API by default. If you don't know what mediaselector/5 API means, all you need to know is that it is a newer BBC interface for retrieving media stream parameters. It should return RTMP stream data that is missing from the older mediaselector/4 API for some programmes. - AFAICT, this change seems to work for iPlayer content and BBC news site videos. In the past, there were some other esoteric audio/video things that get_iplayer could download. I don't remember what they were specifically, or if they are still around. If you find some non-iPlayer content along those lines that no longer works, feel free to post it. However, my attitude is that anything that is not iPlayer content can be thrown under the bus it it's any trouble to fix. - wma mode (radio) and flashlow mode (tv) are not available. WMA is going bye-bye in 6 weeks, so you should be weaning yourself off it anyway. Lower-quality modes for video are now only available in the mobile device mediasets. If you don't know what mediaset means in this context, all you need to is that it is a construct used to segment the available media streams into groups for different types of devices, e.g., mobile vs desktop. It may be possible to bring in the low-quality video modes from mobile mediasets, but that is a headache for another time. - Use --mediaselector=4 to return to the old behaviour, e.g., in order to get wma or flashlow mode. There is no guarantee it will work, however. ___ get_iplayer mailing list get_iplayer@lists.infradead.org http://lists.infradead.org/mailman/listinfo/get_iplayer -- terry l. ridder ___ get_iplayer mailing list get_iplayer@lists.infradead.org http://lists.infradead.org/mailman/listinfo/get_iplayer
Re: Slow radio downloads
On 18 November 2014 at 00:05 Alan Milewczyk a...@soulman1949.com wrote: Is anyone else experiencing painfully slow radio downloads (Radio 4 and Radio4Extra)? No problems here at 06h15 - seems pretty much what I'm used to at this time of the morning. -- TQ via webmail ___ get_iplayer mailing list get_iplayer@lists.infradead.org http://lists.infradead.org/mailman/listinfo/get_iplayer
Re: Slow radio downloads
On 18/11/2014 06:18, TQ wrote: On 18 November 2014 at 00:05 Alan Milewczyk a...@soulman1949.com wrote: Is anyone else experiencing painfully slow radio downloads (Radio 4 and Radio4Extra)? No problems here at 06h15 - seems pretty much what I'm used to at this time of the morning. Thanks guys. Very odd, after a few hours of this strange behaviour, all of a sudden the radio download speeds went back to normal, just like someone turning the tap on fully. Alan ___ get_iplayer mailing list get_iplayer@lists.infradead.org http://lists.infradead.org/mailman/listinfo/get_iplayer
