RE: BBC Ceases To Use MP3...

2015-02-10 Thread C E Macfarlane
Yes this switch over occurred a few weeks back for Nations programming.

I've no objection per se, but unfortunately the switch over has been
accompanied by a huge increase in burbling and even breaks in the recorded
sound.  Whether that's because m4a encoding takes more system resources and
the system can't keep pace, or some other fault, I don't know enough to
tell.  All that I (burble) really know is (burble) that (break) Radio Nan
Gaidheal (burble) keeps destroying (break) the music with incessant (burble)
glitches, and it's (burble) driving me mad.

 -Original Message-
 From: get_iplayer [mailto:get_iplayer-boun...@lists.infradead.org]On
 Behalf Of CJB
 Sent: 09 February 2015 14:55
 To: get_iplayer-request
 Subject: BBC Ceases To Use MP3...


 ... well - at least for the Radio Lancashire folk prog. 'The Drift.'
 This used to download in MP3 format along with hundreds of #'s. Now it
 appears to be in M4A - the Beeb's usual format for audios. Just an
 observation. CJB.

 ___
 get_iplayer mailing list
 get_iplayer@lists.infradead.org
 http://lists.infradead.org/mailman/listinfo/get_iplayer


___
get_iplayer mailing list
get_iplayer@lists.infradead.org
http://lists.infradead.org/mailman/listinfo/get_iplayer


Re: Unable to download a pid

2015-02-10 Thread Arthur Murray
On Tue, Feb 10, 2015 at 12:01 AM, Vangelis forthnet
northmed...@the.forthnet.gr wrote:
 On Mon Feb 9 17:55:07 GMT 2015, Arthur Murray wrote:

 Trying to get this in HD:
 b04xw2x8
 (snip)
 It fails to get (404)
 (snip)
 How do I get gip to use it?


 Your issue has the same root cause as the one
 discussed in recent thread
 http://lists.infradead.org/pipermail/get_iplayer/2015-January/007105.html



 C:\Program Files\get_iplayerperl get_iplayer-291.pl --pid=b04xw2x8
 --playlist-m
 etadata --modes=flashhd --force --raw --subtitles

Thanks. I'll try that the next time this happens.



 And if you are still after the Level 3 HD version, as per your post:
 http://lists.infradead.org/pipermail/get_iplayer/2015-February/007108.html
 then TOUGH LUCK! (that is if you are accessing L3 from overseas...).

 I have solved the flashhd2 mode mystery:
 In the previous week, (almost all) L3 streams were failing (if the servers
 were accessed from non-UK IPs) with the infamous:
 ERROR: Closing connection: NetStream.Failed
 However, many of those were still failing even from within the UK...
 It has now become evident the Beeb were messing with L3 CDN
 servers configuration...

 This week, L3 streams are failing from non-UK IPs with a related error:
 ERROR: Closing connection: NetStream.Play.StreamNotFound
 that would suggest the file hadn't been uploaded to the server;
 however, the same L3 streams DO DOWNLOAD FINE from
 within the UK (physically or virtually).

 The Beeb have re-configured the Level 3 CDN servers and have
 implemented some new kind of geo-filter; in contrast to the
 geo-block on the Akamai CDN servers, where you are denied
 access to the stream early on in the download attempt
 ([ AccessManager.Reject ] : Access denied!
 shows up in a rtmpdump -V log), with this new geo-filter on
 the L3 CDN you are allowed to connect to the server,
 however createStream  play error out, hence the
 StreamNotFound message...
 This new protection method affects uploads after Feb 1st;
 older ones (while still available) do not suffer from it...

I don't know if that makes sense.  Some streams are not found, but
some die at some random percent. Why send any data? Why cut off at
random times?  No one would deliberately design such a wacky system.

There are multiple IP #s behind the L3 IP name.  Perhaps some servers
have more of the file than others.  If you wait longer, even more of
the file becomes available (sometimes), so it could just be slowly
syncing, and maybe sometimes it fails to sync leaving the file
incomplete.  Prime time shows have a higher percent chance of being
incomplete in my experience.  It is a busy time with limited bandwidth
to L3 perhaps.

I don't know if there is a way to use rtmpdump to see if a file is
complete on the server (force a resume at 99% without having any of
the file?)

I was able to complete a full (recent, Feb 1st) HD file 5 minutes
ago. (b052tkyt)

___
get_iplayer mailing list
get_iplayer@lists.infradead.org
http://lists.infradead.org/mailman/listinfo/get_iplayer


Re: Unable to download a pid

2015-02-10 Thread Vangelis forthnet

On Mon Feb 9 17:55:07 GMT 2015, Arthur Murray wrote:


Trying to get this in HD:
b04xw2x8
(snip)
It fails to get (404)
(snip)
How do I get gip to use it?


Your issue has the same root cause as the one
discussed in recent thread
http://lists.infradead.org/pipermail/get_iplayer/2015-January/007105.html

I'll assume you are running tag version 2.91
(you fail to indicate which...).

http://www.bbc.co.uk/programmes/b04xw2x8.rdf

produces no less than 5 po:version entries, with
multiple vPIDs= b04xw2x6, b04zq2w0, p02gjlp6, b051c4lc, b0520nmw.
Your copy of GiP tries the second one, which fails;
URL sniffing has told you that the last one is the correct one.
Use the --playlist-metadata switch so that GiP uses
the older (but more reliable?) method of accessing
XML/JSON playlists to find the vPID:

C:\Program Files\get_iplayerperl 
get_iplayer-291.pl --pid=b04xw2x8 --playlist-m

etadata --modes=flashhd --force --raw --subtitles
get_iplayer v2.91, Copyright (C) 2008-2010 Phil Lewis
 This program comes with ABSOLUTELY NO WARRANTY; for details 
use --warranty.
 This is free software, and you are welcome to redistribute it under 
certain

 conditions; use --conditions for details.

INFO: Episode-only pid detected
INFO: Trying pid: b04xw2x8 using type: tv
INFO: Trying to stream pid using type tv
INFO: pid not found in tv cache
Matches:

INFO: 1 Matching Programmes
INFO: Checking existence of default version
INFO: flashhd1,flashhd2 modes will be tried for version default
INFO: Trying flashhd1 mode to record tv:  - -
INFO: File name prefix = The_Super-Rich_and_Us_-__b04xw2x8_default

INFO: Downloading Subtitles to 'D:\Vangelis\iPlayer 
Recordings/The_Super-Rich_an

d_Us_-__b04xw2x8_default.srt'
RTMPDump v2.4 GIT-2015-01-15 (Compiled by KSV)
(c) 2010 Andrej Stepanchuk, Howard Chu, The Flvstreamer Team; license: GPL
Connecting ...
INFO: Connected...
Starting download at: 0.000 kB
INFO: Metadata:
INFO:   duration3539.04
INFO:   moovPosition36.00
INFO:   width   1280.00
INFO:   height  720.00
INFO:   videocodecidavc1
INFO:   audiocodecidmp4a
INFO:   avcprofile  100.00
INFO:   avclevel41.00
INFO:   aacaot  2.00
INFO:   videoframerate  25.00
INFO:   audiosamplerate 48000.00
INFO:   audiochannels   2.00
INFO: trackinfo:
INFO:   length  88476000.00
INFO:   timescale   25000.00
INFO:   languageund
INFO: sampledescription:
INFO:   sampletype  avc1
INFO:   length  169873408.00
INFO:   timescale   48000.00
INFO:   languageund
INFO: sampledescription:
INFO:   sampletype  mp4a
23985.530 kB / 80.00 sec (2.2%)

And if you are still after the Level 3 HD version, as per your post:
http://lists.infradead.org/pipermail/get_iplayer/2015-February/007108.html
then TOUGH LUCK! (that is if you are accessing L3 from overseas...).

I have solved the flashhd2 mode mystery:
In the previous week, (almost all) L3 streams were failing (if the servers
were accessed from non-UK IPs) with the infamous:
ERROR: Closing connection: NetStream.Failed
However, many of those were still failing even from within the UK...
It has now become evident the Beeb were messing with L3 CDN
servers configuration...

This week, L3 streams are failing from non-UK IPs with a related error:
ERROR: Closing connection: NetStream.Play.StreamNotFound
that would suggest the file hadn't been uploaded to the server;
however, the same L3 streams DO DOWNLOAD FINE from
within the UK (physically or virtually).

The Beeb have re-configured the Level 3 CDN servers and have
implemented some new kind of geo-filter; in contrast to the
geo-block on the Akamai CDN servers, where you are denied
access to the stream early on in the download attempt
([ AccessManager.Reject ] : Access denied!
shows up in a rtmpdump -V log), with this new geo-filter on
the L3 CDN you are allowed to connect to the server,
however createStream  play error out, hence the
StreamNotFound message...
This new protection method affects uploads after Feb 1st;
older ones (while still available) do not suffer from it...
As Joey Tribbiani would have said:
The Beeb's gotta do what the Beeb's gotta do!

V. 



___
get_iplayer mailing list
get_iplayer@lists.infradead.org
http://lists.infradead.org/mailman/listinfo/get_iplayer


Re: New Linux Installation Question

2015-02-10 Thread Colin Law
On 9 February 2015 at 23:33, Budge aje...@errichel.co.uk wrote:

 On 02/09/2015 09:49 PM, Colin Law wrote:
 On 9 February 2015 at 21:39, Budge aje...@errichel.co.uk wrote:
 On 02/09/2015 09:04 PM, Colin Law wrote:
 On 9 February 2015 at 20:50, Budge aje...@errichel.co.uk wrote:
 Hi and thanks for the advice.  I had understood however that

 -rwxr-xr-x 1 meant that user had write permissions.  I could of course 
 change ownership but why have I not had this issue before?
 That says that the owner has write permission.  But who is the owner?
 ls -l /usr/local/bin/get_iplayer
 will tell you.

 Most likely the owner is root, as you probably used sudo to put the file 
 there.

 Colin


 Hi Colin,
 Yes root is the owner.  File is in /usr/local/bin.  What is best/correct
 approach, to give everyone permission, change it temporarily or change
 ownership?
 You should not give everyone permission to it.

 Someone asked earlier what command you were running that gave this
 error.  It should only happen if get-iplayer is attempting an update.

 In fact it is not a good idea to install manually into that folder
 anyway.  If you were to install get-iplayer from the repository it
 would overwrite it.  It would be more usual to manually install to
 /usr/local/bin, though that wil not affect the permissions issue.

 Colin

 Hi Colin,
 The problem occurred when I ran get_iplayer from my home directory for
 the first time, which is when the plugins are sorted out.
 I cannot follow your last paragraph which appears contradictory.  I did
 install into /usr/local/bin manually as per wiki and I have sorted out
 problem now.

Sorry, you are correct, I misread where you had installed it to for
some inexplicable reason.

Colin

___
get_iplayer mailing list
get_iplayer@lists.infradead.org
http://lists.infradead.org/mailman/listinfo/get_iplayer


Re: Multiple pids - another way, in some cases

2015-02-10 Thread Budge

On 11/01/2014 03:09 PM, roadcone wrote:
 For those new to using the command line or terminal and wanting
 to secure all programs from a series, there may be an alternative
 to harvesting and entering multiple pids.

 In some cases the program series may have a series web page. For
 example, Germany: Memories of a Nation has this one:

 http://www.bbc.co.uk/programmes/b04dwbwz/broadcasts/2014/11

 The pid from that url is b04dwbwz but that will not --get you
 anything apart from a list of pids for the individual programs. Add:

 --pid-recursive

 to your command and get_iplayer will try to get each individual
 program. It will fail where the program is too old, not yet
 broadcast, already in your download history or some other BBC
 problem and as a consequence, you will get loads of error messages
 but it will get what is available that you do not already have.
 This is not a panacea but may help in some cases though do check
 the downloads are what you expect as you may need to go hunt the
 errant episode manually.

 ___
 get_iplayer mailing list
 get_iplayer@lists.infradead.org
 http://lists.infradead.org/mailman/listinfo/get_iplayer

Just a quick line to thank you for this brilliant tip.   Just lost a
bunch of files for a couple of series and this works a treat.  They are
being replaced as I type.

___
get_iplayer mailing list
get_iplayer@lists.infradead.org
http://lists.infradead.org/mailman/listinfo/get_iplayer


Re: Multiple pids - another way, in some cases

2015-02-10 Thread Andrew Moore


Budge wrote:
Just a quick line to thank you for this brilliant tip. 


Amen to that, amazing tool - I use it a lot on radio too.
On long-running series (like DR Who TV) it will find all old episode PIDs and 
list them as not available, but just leave it chugging away and it'll get all 
available content - even the 2 minute trailers etc.
Not sure if --pid-recursive is a recent addition, but thanks for it anyway - 
saves a helluva lot of time copying individual PIDs

___
get_iplayer mailing list
get_iplayer@lists.infradead.org
http://lists.infradead.org/mailman/listinfo/get_iplayer


RE: BBC Ceases To Use MP3...

2015-02-10 Thread C E Macfarlane
I'm listening to my get_iplayer download of this right now, and, although
it's not as bad as many, probably most, of the January episodes were, there
were several little pops in Cathy-Ann MacPhee's unaccompanied rendering of
Fath Mo Mhulad from about 6 mins in and since ...
http://www.bbc.co.uk/programmes/b050rjwr


www.macfh.co.uk/CEMH.html

UK Residents:

If you feel can possibly support it
please sign the following ePetition
before closing time of 30/03/2015 23:59:-

http://epetitions.direct.gov.uk/petitions/71556


 -Original Message-
 From: get_iplayer [mailto:get_iplayer-boun...@lists.infradead.org]On
 Behalf Of Christopher Woods
 Sent: 10 February 2015 20:03
 To: get_iplayer@lists.infradead.org
 Subject: RE: BBC Ceases To Use MP3...


 If you can point me to some examples, that'd be useful.

 Chris

 On 2015-02-10 17:32, C E Macfarlane wrote:
  Yes this switch over occurred a few weeks back for Nations
  programming.
 
  I've no objection per se, but unfortunately the switch over has been
  accompanied by a huge increase in burbling and even breaks in the
  recorded
  sound.  Whether that's because m4a encoding takes more system
  resources and
  the system can't keep pace, or some other fault, I don't
 know enough
  to
  tell.  All that I (burble) really know is (burble) that
 (break) Radio
  Nan
  Gaidheal (burble) keeps destroying (break) the music with incessant
  (burble)
  glitches, and it's (burble) driving me mad.
 
  -Original Message-
  From: get_iplayer
  [mailto:get_iplayer-boun...@lists.infradead.org]On
  Behalf Of CJB
  Sent: 09 February 2015 14:55
  To: get_iplayer-request
  Subject: BBC Ceases To Use MP3...
 
 
  ... well - at least for the Radio Lancashire folk prog. 'The
  Drift.'
  This used to download in MP3 format along with
 hundreds of #'s.
  Now it
  appears to be in M4A - the Beeb's usual format for
 audios. Just
  an
  observation. CJB.
 
  ___
  get_iplayer mailing list
  get_iplayer@lists.infradead.org
  http://lists.infradead.org/mailman/listinfo/get_iplayer
 
 
  ___
  get_iplayer mailing list
  get_iplayer@lists.infradead.org
  http://lists.infradead.org/mailman/listinfo/get_iplayer

 --
 CustomMade

 ___
 get_iplayer mailing list
 get_iplayer@lists.infradead.org
 http://lists.infradead.org/mailman/listinfo/get_iplayer


___
get_iplayer mailing list
get_iplayer@lists.infradead.org
http://lists.infradead.org/mailman/listinfo/get_iplayer


Re: Help needed with BBC Collections Archive programmes

2015-02-10 Thread M Clark
 Sent: Tuesday, February 10, 2015 at 12:54 AM
 From: Vangelis forthnet northmed...@the.forthnet.gr
 To: get_iplayer@lists.infradead.org
 Subject: Re: Help needed with BBC Collections Archive programmes

 On Sat Feb 7 15:20:59 GMT 2015, M Clark wrote:
 
  Finally, is this the correct place to report 'problems'?
  There are two more I'd like to bring to attention before they trap others.
  I have work-arounds so in no way are they critical but would be 
  'nice-to-haves'.
 
 Hello again...
 If you ask me, the best place to report problems
 would be the GitHub issue tracker @
 
 https://github.com/get-iplayer/get_iplayer/issues
 
 dinkypumpkin would definitely see it there;
 you'd have to register an account first...
 
 Then there's the Support Forum owned by
 Square Penguin (registration needed):
 
 https://squarepenguin.co.uk/all-forums/
 
 which is aimed more at the average GiP user;
 dinkypumpkin is Keymaster there...
 
 The mailing list..., well you know that already!
 Dinkypumpkin DOES read it (as your latest
 issue proved), but recently he stays shy from
 posting here directly (in fact, his latest post
 was on Dec 29th 2014...)
 
 I am sorry I can't help you further with your issue;
 I am using custom filenames via the --file-prefix
 option, i.e. I do not rely on the auto-generated
 filenames for downloads.
 Have you explored using it too with the
 substitution parametres of your liking?
 
 http://linuxcentre.net/getiplayer/documentation#Substitution%20Parameters
 https://github.com/get-iplayer/get_iplayer/wiki/documentation#substitution-parameters
 
 Kind regards,
 Vangelis. 
 

Thanks Vangelis for the documentation pointers.  For some reason I thought the 
Options file only related to CLI.  Will have a play.

I feared your response suggestions :-) .  Post 3 times?  Hmmm.

I did have a problem with broken links on https://squarepenguin.co.uk/ when 
trying to find out how to use g-ip on Linux.  Found info eventually but still 
using Windows...

Regards.

___
get_iplayer mailing list
get_iplayer@lists.infradead.org
http://lists.infradead.org/mailman/listinfo/get_iplayer


RE: BBC Ceases To Use MP3...

2015-02-10 Thread Christopher Woods

If you can point me to some examples, that'd be useful.

Chris

On 2015-02-10 17:32, C E Macfarlane wrote:
Yes this switch over occurred a few weeks back for Nations 
programming.


I've no objection per se, but unfortunately the switch over has been
accompanied by a huge increase in burbling and even breaks in the 
recorded
sound.  Whether that's because m4a encoding takes more system 
resources and
the system can't keep pace, or some other fault, I don't know enough 
to
tell.  All that I (burble) really know is (burble) that (break) Radio 
Nan
Gaidheal (burble) keeps destroying (break) the music with incessant 
(burble)

glitches, and it's (burble) driving me mad.


-Original Message-
From: get_iplayer 
[mailto:get_iplayer-boun...@lists.infradead.org]On

Behalf Of CJB
Sent: 09 February 2015 14:55
To: get_iplayer-request
Subject: BBC Ceases To Use MP3...


... well - at least for the Radio Lancashire folk prog. 'The 
Drift.'
This used to download in MP3 format along with hundreds of #'s. 
Now it
appears to be in M4A - the Beeb's usual format for audios. Just 
an

observation. CJB.

___
get_iplayer mailing list
get_iplayer@lists.infradead.org
http://lists.infradead.org/mailman/listinfo/get_iplayer



___
get_iplayer mailing list
get_iplayer@lists.infradead.org
http://lists.infradead.org/mailman/listinfo/get_iplayer


--
CustomMade

___
get_iplayer mailing list
get_iplayer@lists.infradead.org
http://lists.infradead.org/mailman/listinfo/get_iplayer


Slanty apostrophy problem ‘solved’

2015-02-10 Thread M Clark
I'm using WebPVR on Windows and fall foul when queuing a programme that 
contains a slanty apostrophy somewhere in its entry.
This abends the web interface and I have to restart Web PVR Manager.
Message is; Can't escape \x{2019}, try uri_escape_utf8() instead at 
get_iplayer.cgi line 475.
Thank you Perl.
Changed line 475 from uri_escape to uri_escape_utf8.
Re-ran.
Abend.
Message; Undefined subroutine main::uri_escape_utf8 called at get_iplayer.cgi 
line 475, GEN2 line 13.
Thank you Perl.
Changed 'use URI::Escape qw(uri_escape);' to 'use URI::Escape 
qw(uri_escape_utf8);'
Re-ran.
Partial success.
Queued: radio: 'Witness - Finlandâs Winter War' (p02jcq3q)
No Perl, that's not what I want.

So backed out changes added the following above line 475 [ $val = 
uri_escape($val); ].

$val =~ tr/\x{2019}\x{2018}/''/;

Which gives what I want.
Queued: radio: 'Witness - Finland's Winter War' (p02jcq3q).

Puts on Tin Hat and awaits flak for committing programming sin of hard-coded 
magic-numbers.

Also I've had similar problem with, I think, x{2103} or x{2013}, certainly 
something else, so I'll have to add to this translate sometime in the future.

So I know a little bit more about Perl but there must be a better solution 
given that neither uri_escape nor uri_escape_utf8 can handle this problem 
'correctly'.


Regards.

___
get_iplayer mailing list
get_iplayer@lists.infradead.org
http://lists.infradead.org/mailman/listinfo/get_iplayer


Re: Multiple pids - another way, in some cases

2015-02-10 Thread Guy Rolls
It's very useful,  I first used it soon after roadcone posted here - 
thanks.  I had just discovered The Infinite Monkey Cage and decided to 
download all of the episodes of the current series if I could get 
them.   Imagine my surprise when I returned to the laptop to find that 
it had downloaded all 54 eposodes from Seriues 1 to Series 10!


On 10/02/2015 11:58, Andrew Moore wrote:


Amen to that, amazing tool - I use it a lot on radio too.
On long-running series (like DR Who TV) it will find all old episode PIDs and 
list them as not available, but just leave it chugging away and it'll get all 
available content - even the 2 minute trailers etc.
Not sure if --pid-recursive is a recent addition, but thanks for it anyway - 
saves a helluva lot of time copying individual PIDs

___
get_iplayer mailing list
get_iplayer@lists.infradead.org
http://lists.infradead.org/mailman/listinfo/get_iplayer



___
get_iplayer mailing list
get_iplayer@lists.infradead.org
http://lists.infradead.org/mailman/listinfo/get_iplayer


Re: BBC Ceases To Use MP3...

2015-02-10 Thread Vangelis forthnet

On Tue Feb 10 03:42:48 GMT 2015, I wrote:


There is one notable exception to this
at the time of writing: BBC Radio 3!

http://open.live.bbc.co.uk/mediaselector/5/select/mediaset/http-icy-aac-lc-a/vpid/bbc_radio_three/
http://open.live.bbc.co.uk/mediaselector/5/select/mediaset/http-icy-aac-lc-b/vpid/bbc_radio_three/
http://open.live.bbc.co.uk/mediaselector/5/select/mediaset/http-icy-he-aacv2-a/vpid/bbc_radio_three/

all produce still working AAC streams


Sadly, tonight even those are now DEAD!

V.



___
get_iplayer mailing list
get_iplayer@lists.infradead.org
http://lists.infradead.org/mailman/listinfo/get_iplayer


Re: Unable to download a pid

2015-02-10 Thread alastair

On 10/02/15 08:01, Vangelis forthnet wrote:
 On Mon Feb 9 17:55:07 GMT 2015, Arthur Murray wrote:

 Trying to get this in HD:
 b04xw2x8
 (snip)
 It fails to get (404)
 (snip)
 How do I get gip to use it?

 Your issue has the same root cause as the one
 discussed in recent thread
 http://lists.infradead.org/pipermail/get_iplayer/2015-January/007105.html

 I'll assume you are running tag version 2.91
 (you fail to indicate which...).

 http://www.bbc.co.uk/programmes/b04xw2x8.rdf

 produces no less than 5 po:version entries, with
 multiple vPIDs= b04xw2x6, b04zq2w0, p02gjlp6, b051c4lc, b0520nmw.
 Your copy of GiP tries the second one, which fails;
 URL sniffing has told you that the last one is the correct one.
 Use the --playlist-metadata switch so that GiP uses
 the older (but more reliable?) method of accessing
 XML/JSON playlists to find the vPID:

It seems I may have a couple of files which failed to download during an
overnight pvr cron job.  Would it be acceptable to include
--playlist-metadata switch in prefs so that the pvr download will
proceed or would this frustrate the downloads which otherwise would work?

BTW what is a verpid please?

Finally I used the git head version of GiP for a while but now I am
using tag version 2.91.  Is there a patched version available which
obviates the need for the playlist-metadata switch?

Budge

___
get_iplayer mailing list
get_iplayer@lists.infradead.org
http://lists.infradead.org/mailman/listinfo/get_iplayer