Re: VERSION-get_iplayer Says 2.94.

[Vangelis forthnet]

On Wed Mar 15 01:41:50 GMT 2017, tellyaddict wrote:


For the time being I have downgraded back to 2.96
because it can see more metadata than 2.99 can.
As 2.96 can see more metadata,
downloads are still getting filenames that mean something.
2.99 cannot see enough metadata to make a meaningful filename.


A relevant forum post by the same person is:

https://squarepenguin.co.uk/forums/thread-1205-post-5410.html#pid5410

Hi tellyaddict/tvfan

Being of an inquisitive nature, I decided
to conduct some experiments to investigate
the "filename" issue you have reported...

I initially did not have to download anything,
I used a template GiP command like:

perl get_iplayer-2.9x.pl --pid= -i | FindStr fileprefix

where x=(5|6|7|8|9)

BTW, GiP 2.94 can't download anything by the --pid
method currently, because it's missing

https://github.com/get-iplayer/get_iplayer/commit/b9adeaa8f7171a3ac469c66a51f6cd167200c23a

which was pushed after tag 2.94 and prior to 2.95.

I first examined a radio show, pid=b08gwqyf
I refreshed the radio cache manually (in 2.99) by issuing:

perl get_iplayer-299.pl --type=radio -f --force --ybbcy

This uses the AOD radio feeds and is quick (2.5min).
Then I used

perl get_iplayer-2.9x.pl --type=radio --pid=b08gwqyf -i | FindStr fileprefix

The  substitution parameter is as follows:

2.99
The_Official_Chart_with_Greg_James_-_2017-03-10_b08gwqyf_original
2.98
The_Official_Chart_with_Greg_James_-_2017-03-10_b08gwqyf_original
2.97
The_Official_Chart_with_Greg_James_-_2017-03-10_b08gwqyf_default
2.96
The_Official_Chart_with_Greg_James_-_2017-03-10_b08gwqyf_default
2.95
The_Official_Chart_with_Greg_James_-_2017-03-10_b08gwqyf_default

The key thing with radio is to include --type=radio and have the show
present within the radio.cache; if the --type switch is omitted, then

2.99
get_iplayer_-_b08gwqyf_b08gwqyf_original
2.98
get_iplayer_-_b08gwqyf_b08gwqyf_original
2.97
The_Official_Chart_with_Greg_James_2017-03-10_-__b08gwqyf_default
2.96
The_Official_Chart_with_Greg_James_-_2017-03-10_b08gwqyf_default
2.95
The_Official_Chart_with_Greg_James_-_2017-03-10_b08gwqyf_default

So, GiP 2.97 is the last to compose a meaningful fileprefix, but 2.98+
should work if --type=radio is specified and --pid present within the 
radio.cache.


Then I examined a short video clip, pid=p04sjnfq. By default, this pid is
not to be found inside tv.cache, even with the tv schedule feeds running...
I used

perl get_iplayer-2.9x.pl --pid=p04sjnfq -i | FindStr fileprefix

Results:

2.99
get_iplayer_-_p04sjnfq_p04sjnfq_original.mp4
2.98
get_iplayer_-_p04sjnfq_p04sjnfq_original.mp4
2.97
The_Sky_at_Night_Telescope_Takeover_Trail_-_Telescope_Takeover_p04sjnfq_default
2.96
The_Sky_at_Night_Telescope_Takeover_Trail_-_Telescope_Takeover_p04sjnfq_default
2.95
The_Sky_at_Night_Telescope_Takeover_Trail_-_Telescope_Takeover_p04sjnfq_default

So, again, 2.97 is the last to compose a proper fileprefix.
Tracking down the GiP code in the GitHub repo,
I identified the culprit commit to be:

https://github.com/get-iplayer/get_iplayer/commit/1b5160b03cf8eb064c28b37e7030fd990708f51f

pushed after 2.97 and before 2.98...

About the thumbnails discussion:

1. A fine tool to tell whether the thumbnail you're seeing
is an embedded one to the MP4 file or one generated
by Windows Explorer (natively in Win7+ for video) is MediaInfo:

https://mediaarea.net/en/MediaInfo/Download

In the generated log, search for "Cover: Yes";
if it's present, it's an embedded one...

According to my download tests, all radio .m4a files
with GiP 2.95+ have embedded thumbnails,
in some cases the wrong ones...

But with video downloads, the versions of GiP that
generate proper filenames (i.e. 2.95, 2.96, 2.97)
produce tagged .mp4 files without embedded thumbnails.

On the contrary, 2.98+, which generate the "generic"
filenames, yield tagged mp4 files with an embedded
thumbnail - I haven't tracked down this behaviour yet...

Regards 



___
get_iplayer mailing list
get_iplayer@lists.infradead.org
http://lists.infradead.org/mailman/listinfo/get_iplayer

Re: VERSION-get_iplayer Says 2.94.

[tellyaddict]

> I'm using 2.94 and finding --pid does not work now the BBC data has gone
> AWOL again.

Correct! An extra fallback was added from 2.95 onwards for this sort of 
scenario.

> What are the downsides to manually moving up to 2.99? 

I don't think there's any problem manually updating. For the time being I have 
downgraded back to 2.96 because it can see more metadata than 2.99 can. As 2.96 
can see more metadata, downloads are still getting filenames that mean 
something. 2.99 cannot see enough metadata to make a meaningful filename.

> Shouldn't the guidance message about --pid still working be made condition on 
> a version since otherwise it's causing confusion.

Sort of... Dinky has always made it clear that he will only offer support for 
the most current version of GiP although other users may still support you on 
an older version. Because of this, if Dinky reports that --pid is still 
working, it means he has tested it on the current release which is 2.99.

So the guidance message about --pid still working is technically attached to 
the condition that you are using the most up to date version available. 
Although I agree there will only probably be a handful of users who understand 
that. 2.94 though is coming up to being 2 years old and a lot has changed over 
those 2 years.

___
get_iplayer mailing list
get_iplayer@lists.infradead.org
http://lists.infradead.org/mailman/listinfo/get_iplayer

Re: 2.99 Not Downloading Hi-Res Audio

[RS]

From: C E Macfarlane
Sent: Tuesday, March 14, 2017 23:00


As per title, until today have been using 2.97, tried 2.99 just now and
can't get it to work ...



WARNING: Could not download programme metadata from
http://www.bbc.co.uk/programmes/b08h4hy8.xml


There is another thread today (now yesterday) about this.


WARNING: Some recording modes were remapped to new values
WARNING: Input mode list remapped from 'dashhigh,flashaachigh,hafhigh' to
'dafhigh,flashaachigh,hafhigh'


Modes have been renamed in v2.98 and v2.99.  The new names are here.
https://github.com/get-iplayer/get_iplayer/wiki/modesref

That page begins,
"STOP: You almost certainly do not need the reference information contained 
in this document. Most users only need to configure maximum recording 
quality, and then only if the defaults are not acceptable. Read the 
Recording Quality documentation instead and configure your maximum recording 
quality as described there. Only refer to this document if you need to know 
specifics for a particular recording mode or shortcut."


Does anyone agree that you don't need the reference information when the 
mode names and aliases keep changing?



Does 2.99 require a Perl package not required by previous versions?
I have not seen anything that says it does.  Although I originally used the 
Windows installer, to go from v2.97 to 2.98 I just replaced get_iplayer.pl 
and get_iplayer.cgi.  The DVF modes need ffmpeg v3.0 or greater.  Problems 
could be caused by the absence of metadata feeds.




___
get_iplayer mailing list
get_iplayer@lists.infradead.org
http://lists.infradead.org/mailman/listinfo/get_iplayer

VERSION-get_iplayer Says 2.94.

[Ralph Corderoy]

Hi,

I'm using 2.94 and finding --pid does not work now the BBC data has gone
AWOL again.  Examining recent archives of this list suggest 2.99 is
required.  But I'd already used `get_iplayer -u'.

INFO: Current version is 2.94
INFO: Checking for latest version from www.infradead.org
INFO: Getting page http://www.infradead.org/get_iplayer/VERSION-get_iplayer
INFO: No update is necessary (latest version = 2.94)

And indeed http://www.infradead.org/get_iplayer/VERSION-get_iplayer says
`2.94'.

Is it time VERSION-get_iplayer got bumped?  What are the downsides to
manually moving up to 2.99?  Shouldn't the guidance message about --pid
still working be made condition on a version since otherwise it's
causing confusion.

-- 
Cheers, Ralph.
https://plus.google.com/+RalphCorderoy

___
get_iplayer mailing list
get_iplayer@lists.infradead.org
http://lists.infradead.org/mailman/listinfo/get_iplayer

Re: Refresh Cache Total Failure

[Shevek]

On 14 March 2017 at 23:38, CJB  wrote:
>
> WARNING: Failed to download programme schedule
> http://www.bbc.co.uk/bbcalba/programmes/schedules/last_week.xml
>


> etc., etc.
>

http://lists.infradead.org/pipermail/get_iplayer/2017-March/010310.html

http://lists.infradead.org/pipermail/get_iplayer/2017-March/010321.html

http://lists.infradead.org/pipermail/get_iplayer/2017-March/010325.html

https://squarepenguin.co.uk/forums/thread-1193.html

https://squarepenguin.co.uk/forums/thread-1194.html

etc., etc.

___
get_iplayer mailing list
get_iplayer@lists.infradead.org
http://lists.infradead.org/mailman/listinfo/get_iplayer

Refresh Cache Total Failure

[CJB]

Resfresh Cache

The cache will auto-refresh every 1 hour(s) if you leave this page open

Windows users: You may encounter errors if you perform other tasks in
the Web PVR Manager while this page is reloading

INFO: Getting tv Index Feeds (this may take a few minutes)

WARNING: Failed to download programme schedule
http://www.bbc.co.uk/bbcalba/programmes/schedules/last_week.xml

WARNING: Failed to download programme schedule
http://www.bbc.co.uk/bbcalba/programmes/schedules/this_week.xml

WARNING: Failed to download programme schedule
http://www.bbc.co.uk/bbcfour/programmes/schedules/last_week.xml

WARNING: Failed to download programme schedule
http://www.bbc.co.uk/bbcfour/programmes/schedules/this_week.xml

WARNING: Failed to download programme schedule
http://www.bbc.co.uk/bbcnews/programmes/schedules/last_week.xml

WARNING: Failed to download programme schedule
http://www.bbc.co.uk/bbcnews/programmes/schedules/this_week.xml

WARNING: Failed to download programme schedule
http://www.bbc.co.uk/bbcone/programmes/schedules/cambridge/last_week.xml

WARNING: Failed to download programme schedule
http://www.bbc.co.uk/bbcone/programmes/schedules/cambridge/this_week.xml

WARNING: Failed to download programme schedule
http://www.bbc.co.uk/bbcone/programmes/schedules/channel_islands/last_week.xml

WARNING: Failed to download programme schedule
http://www.bbc.co.uk/bbcone/programmes/schedules/channel_islands/this_week.xml

WARNING: Failed to download programme schedule
http://www.bbc.co.uk/bbcone/programmes/schedules/east/last_week.xml

WARNING: Failed to download programme schedule
http://www.bbc.co.uk/bbcone/programmes/schedules/east/this_week.xml

WARNING: Failed to download programme schedule
http://www.bbc.co.uk/bbcone/programmes/schedules/east_midlands/last_week.xml

WARNING: Failed to download programme schedule
http://www.bbc.co.uk/bbcone/programmes/schedules/east_midlands/this_week.xml

WARNING: Failed to download programme schedule
http://www.bbc.co.uk/bbcone/programmes/schedules/east_yorkshire/last_week.xml

etc., etc.

CJB

___
get_iplayer mailing list
get_iplayer@lists.infradead.org
http://lists.infradead.org/mailman/listinfo/get_iplayer

Re: 2.99 Not Downloading Hi-Res Audio

[artisticforge .]

hello

what was the command line that you used?
also what OS. Mac OS X, Linux, Windows

that part of the Perl code is attempting to resume a download.
it is attempting to open the data file. it appears to be confused
by the absence of a class.



On Tue, Mar 14, 2017 at 6:00 PM, C E Macfarlane
 wrote:
> As per title, until today have been using 2.97, tried 2.99 just now and
> can't get it to work ...
>
> The log file shows the following:
>
> Matches:
> 13919:  Caithream Ciil - 14/03/2017, BBC Radio Nan Gaidheal, b08h4hy8
> 14497:  Crunluath - 02/03/2017, BBC Radio Nan Gaidheal, b08h1dph
> 24066:  Tuesday Folk - 07/03/2017, BBC Radio Scotland, b08h0kg3
> 10325:  A' Mire ri Mir - 14/03/2017, BBC Radio Nan Gaidheal, b08h4hy4
>
> INFO: 4 Matching Programmes
> WARNING: Could not download programme metadata from
> http://www.bbc.co.uk/programmes/b08h4hy8.xml
> WARNING: Some recording modes were remapped to new values
> WARNING: Input mode list remapped from 'dashhigh,flashaachigh,hafhigh' to
> 'dafhigh,flashaachigh,hafhigh'
> WARNING: Please update your preferences
> INFO: Checking existence of original version
> INFO: dafhigh1,dafhigh2,dafhigh3,dafhigh4,hafhigh1,hafhigh2 modes will be
> tried for version original
> INFO: Trying dafhigh1 mode to record radio: Caithream Ciil -
> 14/03/2017
> INFO: File name prefix = Caithream Ciuil - 2017-03-14
> Can't locate object method "autoflush" via package "FileHandle" at
> /opt/share/get_iplayer/get_iplayer line 8517.
>
> Does 2.99 require a Perl package not required by previous versions?  That's
> what the message suggests to me at a first glance, but I can't see anything
> like that in the Release Notes, only dependencies removed for 2.98.
>
> Regards, Charles.
>
> --
> www.macfh.co.uk/MacFH.html
>
>
> ___
> get_iplayer mailing list
> get_iplayer@lists.infradead.org
> http://lists.infradead.org/mailman/listinfo/get_iplayer



-- 
terry l. ridder ><>

___
get_iplayer mailing list
get_iplayer@lists.infradead.org
http://lists.infradead.org/mailman/listinfo/get_iplayer

2.99 Not Downloading Hi-Res Audio

[C E Macfarlane]

As per title, until today have been using 2.97, tried 2.99 just now and
can't get it to work ...

The log file shows the following:

Matches:
13919:  Caithream Ciil - 14/03/2017, BBC Radio Nan Gaidheal, b08h4hy8
14497:  Crunluath - 02/03/2017, BBC Radio Nan Gaidheal, b08h1dph
24066:  Tuesday Folk - 07/03/2017, BBC Radio Scotland, b08h0kg3
10325:  A' Mire ri Mir - 14/03/2017, BBC Radio Nan Gaidheal, b08h4hy4

INFO: 4 Matching Programmes
WARNING: Could not download programme metadata from
http://www.bbc.co.uk/programmes/b08h4hy8.xml
WARNING: Some recording modes were remapped to new values
WARNING: Input mode list remapped from 'dashhigh,flashaachigh,hafhigh' to
'dafhigh,flashaachigh,hafhigh'
WARNING: Please update your preferences
INFO: Checking existence of original version
INFO: dafhigh1,dafhigh2,dafhigh3,dafhigh4,hafhigh1,hafhigh2 modes will be
tried for version original
INFO: Trying dafhigh1 mode to record radio: Caithream Ciil -
14/03/2017
INFO: File name prefix = Caithream Ciuil - 2017-03-14
Can't locate object method "autoflush" via package "FileHandle" at
/opt/share/get_iplayer/get_iplayer line 8517.

Does 2.99 require a Perl package not required by previous versions?  That's
what the message suggests to me at a first glance, but I can't see anything
like that in the Release Notes, only dependencies removed for 2.98.

Regards, Charles.

--
www.macfh.co.uk/MacFH.html


___
get_iplayer mailing list
get_iplayer@lists.infradead.org
http://lists.infradead.org/mailman/listinfo/get_iplayer

Re: Workaround for "aactomp3"

[RS]

From: RS Sent: Tuesday, March 14, 2017 16:12



In the meantime you could experiment with something like
--command-tv rename .mp4   .mp4
I haven't tried it, so you may need to add some quotes.


Sorry I am being silly.  A simpler solution is
--prefs-add --fileprefix=""

Alternatively you could add  to your existing fileprefix, so 
,  and  will be populated again when the 
metadata feeds are restored, and in the meantime  and 
 will show 






___
get_iplayer mailing list
get_iplayer@lists.infradead.org
http://lists.infradead.org/mailman/listinfo/get_iplayer

Shell script to get PIDs from schedules (again)

[Peter Scott]

I've fixed it.

 http://peterscott.eu/freeScripts/getPids_html

appears to work for TV as well now.

Sorry I can't get these three posts to link.  I'm having trouble using gmail
to reply to the list.

Peter
-- 
email: p.sc...@shu.ac.uk
website: http://peterscott.eu
NB: My mobile is a "not at home" phone; I don't hear or see it at home.

___
get_iplayer mailing list
get_iplayer@lists.infradead.org
http://lists.infradead.org/mailman/listinfo/get_iplayer

Re: Workaround for "aactomp3"

[RS]

From: Chris Marriott Sent: Tuesday, March 14, 2017 15:46


Both "dafstd" and "hafstd" are, for some reason, only downloading at about 
2Mbits/sec. For TV downloads with "hlsstd", by comparison, I'm getting 
12MBit/sec (what I'd expect from my Internet connection speed which is 
about 13.5Mbit/sec). Are these new modes always slower than the old flash 
modes? (I am in the UK, if that makes any difference.)


Speeds increased dramatically when I moved to Virgin Media.  There was also 
a big increase when I changed from Flashhd to HLShd, from 20-30Mbit/s to 
50-80Mbit/s.  Radio was slower at about 4Mbit/s for HAFstd but with DAFstd 
it seems to have gone up to about 40Mbit/s.  Some TV programmes are slower, 
at about 20Mbit/s, but I don't know why.




___
get_iplayer mailing list
get_iplayer@lists.infradead.org
http://lists.infradead.org/mailman/listinfo/get_iplayer

Re: Workaround for "aactomp3"

[Andy Moore]

Many thanks, I've just seen an 'unmissable' post on the forums about it (which 
I managed to miss)
Apologies for the hijack 



- Original Message -
From: RS 
Sent: Tuesday, March 14, 2017 4:12 PM
Subject: Re: Workaround for "aactomp3"


It is not caused by the update to v2.99.  The uninformative file names are 
caused by the loss of metadata feeds.  If the feeds are restored the 
programme names will probably be as they were.  In the meantime you could 
experiment with something like
--command-tv rename .mp4   .mp4
I haven't tried it, so you may need to add some quotes.




___
get_iplayer mailing list
get_iplayer@lists.infradead.org
http://lists.infradead.org/mailman/listinfo/get_iplayer

___
get_iplayer mailing list
get_iplayer@lists.infradead.org
http://lists.infradead.org/mailman/listinfo/get_iplayer

Shell script to get PIDs from schedules (again)

[Peter Scott]

I spoke too soon!  It works for radio three and four, maybe others but not TV.

Peter
-- 
email: p.sc...@shu.ac.uk
website: http://peterscott.eu
NB: My mobile is a "not at home" phone; I don't hear or see it at home.

___
get_iplayer mailing list
get_iplayer@lists.infradead.org
http://lists.infradead.org/mailman/listinfo/get_iplayer

Re: Workaround for "aactomp3"

[RS]

From: Andy Moore
Sent: Tuesday, March 14, 2017 15:39


Kinda related; Is there a way to get programme names showing in the 
downloaded file?
I just updated and whereas my previous downloads showed the programme and 
episode details, they now just look like this;



get_iplayer_-_b06fwync_b06fwync_original.mp3
Downloaded with ; get_iplayer --pid=b06fwync


It is not caused by the update to v2.99.  The uninformative file names are 
caused by the loss of metadata feeds.  If the feeds are restored the 
programme names will probably be as they were.  In the meantime you could 
experiment with something like

--command-tv rename .mp4   .mp4
I haven't tried it, so you may need to add some quotes.




___
get_iplayer mailing list
get_iplayer@lists.infradead.org
http://lists.infradead.org/mailman/listinfo/get_iplayer

Re: Workaround for "aactomp3"

[Chris Marriott]

Thanks, Richard.

Both "dafstd" and "hafstd" are, for some reason, only downloading at about 
2Mbits/sec. For TV downloads with "hlsstd", by comparison, I'm getting 
12MBit/sec (what I'd expect from my Internet connection speed which is about 
13.5Mbit/sec). Are these new modes always slower than the old flash modes? 
(I am in the UK, if that makes any difference.)


Thanks,

Chris

-Original Message- 
From: RS

Sent: Tuesday, March 14, 2017 3:32 PM
To: get_iplayer@lists.infradead.org
Subject: Re: Workaround for "aactomp3"


From: Chris Marriott Sent: Tuesday, March 14, 2017 14:55


A final question if I may: to download radio programmes I previously used 
"--mode=flashaacstd". What is the nearest equivalent to this with 2.99, 
please?


You can use --radiomode=dafstd or --radiomode=hafstd for 128kbit/s.  DAFstd
seems to be about 10 times as fast (40Mbit/s).

If you go abroad you can use --radiomode=dafmed for 96kbit/s.  Someone said
HAFstd worked abroad, but I haven't tried it.



___
get_iplayer mailing list
get_iplayer@lists.infradead.org
http://lists.infradead.org/mailman/listinfo/get_iplayer 



___
get_iplayer mailing list
get_iplayer@lists.infradead.org
http://lists.infradead.org/mailman/listinfo/get_iplayer

Re: Workaround for "aactomp3"

[Andy Moore]

Kinda related; Is there a way to get programme names showing in the downloaded 
file?
I just updated and whereas my previous downloads showed the programme and 
episode details, they now just look like this;

get_iplayer_-_b06fwync_b06fwync_original.mp3
Downloaded with ; get_iplayer --pid=b06fwync

Thanks

___
get_iplayer mailing list
get_iplayer@lists.infradead.org
http://lists.infradead.org/mailman/listinfo/get_iplayer

Re: Workaround for "aactomp3"

[RS]

From: Chris Marriott Sent: Tuesday, March 14, 2017 14:55


A final question if I may: to download radio programmes I previously used 
"--mode=flashaacstd". What is the nearest equivalent to this with 2.99, 
please?


You can use --radiomode=dafstd or --radiomode=hafstd for 128kbit/s.  DAFstd 
seems to be about 10 times as fast (40Mbit/s).


If you go abroad you can use --radiomode=dafmed for 96kbit/s.  Someone said 
HAFstd worked abroad, but I haven't tried it.




___
get_iplayer mailing list
get_iplayer@lists.infradead.org
http://lists.infradead.org/mailman/listinfo/get_iplayer

Re: Workaround for "aactomp3"

[Chris Marriott]

Thank you, penguin, that's extremely helpful.

A final question if I may: to download radio programmes I previously used 
"--mode=flashaacstd". What is the nearest equivalent to this with 2.99, 
please?


Thanks,

Chris


-Original Message- 
From: SquarePenguin

Sent: Tuesday, March 14, 2017 2:43 PM
To: get_iplayer@lists.infradead.org
Subject: Re: Workaround for "aactomp3"

On 14/03/17 14:38, Chris Marriott wrote:

For downloading radio programs I
relied on the "aactomp3" option to automatically generate MP3 files, but
this has been removed from v2.99.


There is a wiki article dedicated to addressing this issue:

https://github.com/get-iplayer/get_iplayer/wiki/aactomp3

___
get_iplayer mailing list
get_iplayer@lists.infradead.org
http://lists.infradead.org/mailman/listinfo/get_iplayer 



___
get_iplayer mailing list
get_iplayer@lists.infradead.org
http://lists.infradead.org/mailman/listinfo/get_iplayer

Workaround for "aactomp3"

[Chris Marriott]

I've just upgrade GiP from 2.94 to 2.99 because of the metadata feed issue, 
and now I have a slight problem. For downloading radio programs I relied on 
the "aactomp3" option to automatically generate MP3 files, but this has been 
removed from v2.99. ISTR reading on the list a while ago that there was a 
workaround available to get the functionality back. Could anyone remind me 
what it is, please?


Many thanks,

Chris


___
get_iplayer mailing list
get_iplayer@lists.infradead.org
http://lists.infradead.org/mailman/listinfo/get_iplayer

Re: Workaround for "aactomp3"

[SquarePenguin]

On 14/03/17 14:38, Chris Marriott wrote:
> For downloading radio programs I
> relied on the "aactomp3" option to automatically generate MP3 files, but
> this has been removed from v2.99.

There is a wiki article dedicated to addressing this issue:

https://github.com/get-iplayer/get_iplayer/wiki/aactomp3

___
get_iplayer mailing list
get_iplayer@lists.infradead.org
http://lists.infradead.org/mailman/listinfo/get_iplayer

Re: Loss of XML feeds...

[artisticforge .]

hello

it was actually reasonable for time. I just finished running my
modified refresh cache shell script.
Granted i excluded regional & local. So it was not a true apple/apple test.

it will limp along until the BBC finally puts it down, so to speak.


On Tue, Mar 14, 2017 at 2:52 AM, Alan Milewczyk  wrote:
> On 14/03/2017 14:18, Vangelis forthnet wrote:
>>
>>
>> For "academic" reasons,
>>
>> perl get_iplayer-299.pl --type=tv -f --force --ybbcy
>> --refresh-exclude="BBCAlba,BBC Parliament,S4C,CBeebies"
>>
>> took 12min to build a tv.cache of 1086 entries (YMMV);
>> local channels are ignored by default.
>> --ybbcy switch applies to GiP 2.95+
>>
>
> The mind boggles how long it would take to build the radio.cache! :-(
>
> As it stands the current TV situation is not a massive problem for me as I
> mostly use PIDs because of the relatively small programmes I download.
> Radio, on the other hand is a totally different matter with a very large
> number of relatively short programmes, especially on Radio 4/4Extra and it's
> too much of a pain to go PID-hunting for each and every one! :-(
>
> A
>
>
> ___
> get_iplayer mailing list
> get_iplayer@lists.infradead.org
> http://lists.infradead.org/mailman/listinfo/get_iplayer



-- 
terry l. ridder ><>

___
get_iplayer mailing list
get_iplayer@lists.infradead.org
http://lists.infradead.org/mailman/listinfo/get_iplayer

Shell script to get PIDs from schedules (again)

[Peter Scott]

Amazingly my old screen-scraping script still works!

You can get it here:

 http://peterscott.eu/freeScripts/getPids_html

Peter
-- 
email: p.sc...@shu.ac.uk
website: http://peterscott.eu
NB: My mobile is a "not at home" phone; I don't hear or see it at home.

___
get_iplayer mailing list
get_iplayer@lists.infradead.org
http://lists.infradead.org/mailman/listinfo/get_iplayer

Re: No programme schedules?

[RS]

From: Chris Marriott Sent: Tuesday, March 14, 2017 12:33


I'm not getting the program name as the filename but that is of course 
related to the removal of the metadata feeds.


If you look at the output from --info, quite a lot of metadata is available 
from the source it uses.  I guess that could be used to generate the 
filename if the feeds are not restored.  name, longname and nameshort are no 
good, but title and desc may be useable.





___
get_iplayer mailing list
get_iplayer@lists.infradead.org
http://lists.infradead.org/mailman/listinfo/get_iplayer

Re: No programme schedules?

[Chris Marriott]

Thanks, Richard. I've installed GiP 2.99 and that works fine. As you kindly 
pointed out, "--mode=hlsstd" gets me the same size file I had previously 
with "flashhigh". I'm not getting the program name as the filename but that 
is of course related to the removal of the metadata feeds.


I'm very grateful for the assistance.

Chris


-Original Message- 
From: RS

Sent: Tuesday, March 14, 2017 11:45 AM
To: get_iplayer@lists.infradead.org
Subject: Re: No programme schedules?


From: Chris Marriott Sent: Tuesday, March 14, 2017 08:17


What am I doing wrong, please? When I try to download using a PID it fails. 
Eg, I'm trying to download episode 3 of "Meet the Lords". I type:



get_iplayer --mode=flashhigh --pid=b08jljrn


Try upgrading to v2.99 and using --tvmode=hlsstd,hlsxstd,hvflow

Flash has not been removed from v2.99, but it soon will be.  Flashhigh no
longer exists in v2.99.  I am assuming you want Flashstd, 640x360 25fps.
The equivalent is HLSstd.  Otherwise choose the mode you want from
https://github.com/get-iplayer/get_iplayer/wiki/modesref



___
get_iplayer mailing list
get_iplayer@lists.infradead.org
http://lists.infradead.org/mailman/listinfo/get_iplayer 



___
get_iplayer mailing list
get_iplayer@lists.infradead.org
http://lists.infradead.org/mailman/listinfo/get_iplayer

Re: No programme schedules?

[RS]

From: RS 
Sent: Tuesday, March 14, 2017 11:45 



Otherwise choose the mode you want from
https://github.com/get-iplayer/get_iplayer/wiki/modesref


You can see which modes are available, and the estimated files sizes, with
get_iplayer --pid b08jljrn --info



___
get_iplayer mailing list
get_iplayer@lists.infradead.org
http://lists.infradead.org/mailman/listinfo/get_iplayer

Re: No programme schedules?

[RS]

From: Chris Marriott Sent: Tuesday, March 14, 2017 08:17


What am I doing wrong, please? When I try to download using a PID it fails. 
Eg, I'm trying to download episode 3 of "Meet the Lords". I type:



get_iplayer --mode=flashhigh --pid=b08jljrn


Try upgrading to v2.99 and using --tvmode=hlsstd,hlsxstd,hvflow

Flash has not been removed from v2.99, but it soon will be.  Flashhigh no 
longer exists in v2.99.  I am assuming you want Flashstd, 640x360 25fps. 
The equivalent is HLSstd.  Otherwise choose the mode you want from

https://github.com/get-iplayer/get_iplayer/wiki/modesref



___
get_iplayer mailing list
get_iplayer@lists.infradead.org
http://lists.infradead.org/mailman/listinfo/get_iplayer

BBC RSS adaptor changes

[Mike Ralphson]

Following the BBC's (temporary?) disabling of the /programmes API JSON feed, 
I've moved the BBC-RSS adaptor here (https://bbc-rss.herokuapp.com) to a new, 
but slower, feed (thankfully not having to resort to scraping).

All the links in the available radio and TV columns have changed, but I have 
set up redirects from the old locations. The links in the upcoming column were 
already using the new feed. I suggest you leave existing links pointing to the 
redirects for now in case we switch back.

As I say, the new feed is somewhat slower, so if you are able to control it, I 
would suggest setting the timeout in your RSS reader / fetcher to something in 
the order of 60 seconds. If this poses significant problems going forward I 
will look at adding some cacheing.

Individual PID feeds for brands/series (if anyone was using them) are still 
broken for the moment.

Please let me know of any problems, either here or as an issue on GitHub - 
https://github.com/mermade/bbc-rss

Best, Mike

___
get_iplayer mailing list
get_iplayer@lists.infradead.org
http://lists.infradead.org/mailman/listinfo/get_iplayer

Re: No programme schedules?

[Chris Marriott]

What am I doing wrong, please? When I try to download using a PID it fails. 
Eg, I'm trying to download episode 3 of "Meet the Lords". I type:


get_iplayer --mode=flashhigh --pid=b08jljrn

and I get:

get_iplayer v2.94, Copyright (C) 2008-2010 Phil Lewis
 This program comes with ABSOLUTELY NO WARRANTY; for details 
use --warranty.
 This is free software, and you are welcome to redistribute it under 
certain

 conditions; use --conditions for details.

WARNING: rdf URL contained no data
WARNING: PID URL contained no RDF data. Trying to record PID directly.
INFO: Trying pid: b08jljrn using type: tv
INFO: Trying to stream pid using type tv
INFO: pid not found in tv cache
Matches:

INFO: 1 Matching Programmes
WARNING: Could not download programme metadata from 
http://www.bbc.co.uk/programmes/b08jljrn.xml

ERROR: Failed to get version pid metadata from iplayer site

Do I need to install a later version of GiP?

Thanks,

Chris



-Original Message- 
From: Nick Payne

Sent: Tuesday, March 14, 2017 1:35 AM
To: get_iplayer@lists.infradead.org
Subject: Re: No programme schedules?

On 14/03/2017 11:53 AM, tellyaddict wrote:
Downloading is impossible by any method at the moment due to the missing 
xml feeds.

Not so. I started a D/L using --pid= a few minutes ago, and it's running
as I type...

___
get_iplayer mailing list
get_iplayer@lists.infradead.org
http://lists.infradead.org/mailman/listinfo/get_iplayer 



___
get_iplayer mailing list
get_iplayer@lists.infradead.org
http://lists.infradead.org/mailman/listinfo/get_iplayer

Re: Loss of XML feeds...

[Alan Milewczyk]

On 14/03/2017 14:18, Vangelis forthnet wrote:


For "academic" reasons,

perl get_iplayer-299.pl --type=tv -f --force --ybbcy 
--refresh-exclude="BBCAlba,BBC Parliament,S4C,CBeebies"


took 12min to build a tv.cache of 1086 entries (YMMV);
local channels are ignored by default.
--ybbcy switch applies to GiP 2.95+



The mind boggles how long it would take to build the radio.cache! :-(

As it stands the current TV situation is not a massive problem for me as 
I mostly use PIDs because of the relatively small programmes I 
download.  Radio, on the other hand is a totally different matter with a 
very large number of relatively short programmes, especially on Radio 
4/4Extra and it's too much of a pain to go PID-hunting for each and 
every one! :-(


A

___
get_iplayer mailing list
get_iplayer@lists.infradead.org
http://lists.infradead.org/mailman/listinfo/get_iplayer

Re: Loss of XML feeds...

[Vangelis forthnet]

[Apologies, but my mailer has, mysteriously so,
malformatted the last part of my previous post;
reposting for clarity:]

Of course the maintainer is fully aware of its existence,
but has withheld reference to it
because it is to be used only as a last resort;
it involves web-scraping HTML pages for TV and
(along the various limitations cited in the commit'smessage)
has a serious toll on the beeb's servers!
We, as GiP users, do not want to bring the beeb's servers
down to a crawl...
For "academic" reasons,

perl 
get_iplayer-299.pl --type=tv -f --force --ybbcy --refresh-exclude="BBCAlba,BBC 
Parliament,S4C,CBeebies"


took 12min to build a tv.cache of 1086 entries (YMMV);
local channels are ignored by default.
--ybbcy switch applies to GiP 2.95+

As is the wish of the maintainer,
for further directions & guidance
keep your eyes open in the Support Forums:

https://squarepenguin.co.uk/forums/

Kind regards 



___
get_iplayer mailing list
get_iplayer@lists.infradead.org
http://lists.infradead.org/mailman/listinfo/get_iplayer

Loss of XML feeds...

[Vangelis forthnet]

... Of course this is no news for those of you
frequenting recently the Support Forums

https://squarepenguin.co.uk/forums/thread-1193.html

and this mailing list

http://lists.infradead.org/pipermail/get_iplayer/2017-March/010310.html

A github issue has been created by the code maintainer:

https://github.com/get-iplayer/get_iplayer/issues/323

Some personal thoughts/remarks:


This is ostensibly a temporary situation,
but there is no way to to know if that is true.


Last time I refreshed the tv.cache was early Monday (Mar 13th) morning;
in the afternoon it was broken; even if the loss is indeed temporary,
what is trully ominous is the forewarning showed if one loads manually
in a browser one sample TV schedule URL, e.g.
http://www.bbc.co.uk/bbcone/programmes/schedules/london/this_week.xml =>
[quote]
In May 2017, regrettably, this system will permanently cease producing XML 
and rdf outputs.

A JSON service will be kept in place for a period following this
[/quote]
So even if the feeds are restored, say, tomorrow, they'll vanish for good
only in roughly six weeks' time - which is pretty soon... :-(
So, undoubtedly, this fact has to be adressed by the coder: move to
the eventual JSON feeds - but then what?


This has broken programme indexing and cache refresh


This is true for the tv.cache; luckily, because of

https://github.com/get-iplayer/get_iplayer/commit/0ad570d54221e53870f56fbafe95f564c84a75e2

after GiP fails to download any radio schedules due to the feeds
being currently broken, it falls back to the AOD feeds
(thank The Lord they still exist!) and hence it populates
the radio.cache. Issuing

perl get_iplayer-299.pl --type=radio -f --force

I get in the end a radio.cache of 13598 entries at
the time of writing, but, alas, covering only the
last 7 days of broadcast, as is noted in the commit message:


Only last 7 days can be indexed from AOD feeds,
and no future programme listings will be available.



Downloading with --pid still works,
but the programme metadata will be unreliable.
For the moment, just don't use get_iplayer.


...But if you must use GiP, then the --pid method,
as pointed out also in the list, STILL WORKS; the
caveat is imperfect/incomplete file names and file tags...
you can use the --file-prefix switch to manually craft
a correct file title (or just rename a file post fetch)
and use 3rd party MP4 taggers to edit the file tag...

The main issue I have with my radio downloads is
that some of them have wrong embedded thumbnails!
I have to retrieve the correct one by
1. Loading the JSON playlist:
http://www.bbc.co.uk/programmes//playlist.json
2. scrolling down to, e.g.

holdingImage": "//ichef.bbci.co.uk/images/ic/976x549/p038jcmv.jpg"

and then compose a URI for the 640x360 thumbnail:

http://ichef.bbci.co.uk/images/ic/640x360/p038jcmv.jpg

A batch file fetches the thumbnail via curl,
and then deletes the wrong one and embeds
the new one via mp4art.exe
If I can manually identify the correct thumbnail,
but GiP cannot while the XML feeds are down,
then I conclude this is a bug; for any party interested,
--pid=b08gwqyf gets tagged with a thumbnail of
Reggie Yates, while the correct one (as shown in
http://www.bbc.co.uk/programmes/b08gwqyf )
is one of Greg James.


An announcement will be made in the forums
if/when the BBC data returns.


tellyaddict/tvfan asked in the forums:


Isn't there already a fall back option built in
that was added after the last few times this happened?


He was in fact alluding to

https://github.com/get-iplayer/get_iplayer/commit/14d26af99a57cc51c23ace383e7cf3225a23e13e
(and for those not on Windows it also includes:
https://github.com/get-iplayer/get_iplayer/commit/ee7a04934daeec327cd4bfaddeab6b0225a07b44 )Of course 
the maintainer is fully awareof its existence, but has withheld referenceto it because it is to be used 
only as a last resort;it involves web-scraping HTML pages for TV and(along the various limitations 
cited in the commit'smessage) has a serious toll on the beeb's servers!We, as GiP users, do not want to 
bring the beeb'sservers down to a crawl...For "academic" reasons,perl get_iplayer-299.pl 
--type=tv -f --force --ybbcy --refresh-exclude="BBCAlba,BBC Parliament,S4C,CBeebies"took 
12min to build a tv.cache of 1086 entries (YMMV);local channels are ignored by default. --ybbcy switch 
appliesto GiP 2.95+As is the wish of the maintainer, for further directions& guidance keep your 
eyes open in the Support Forums:https://squarepenguin.co.uk/forums/Kind regards

___
get_iplayer mailing list
get_iplayer@lists.infradead.org
http://lists.infradead.org/mailman/listinfo/get_iplayer