Re: Format of options file
I don't know the history of this thread, but a Windows perl will use the
`:crlf` layer which is fine for both Windows (CR LF) and Linux (LF) line
terminations. The CR will be removed, and every line read will end with LF
("\n")
The most common problem arises when a Linux perl attempts to read a Windows
text file. The default PerlIO stack on Linux is an empty one, so the CR LF
characters appear intact in every line read
There are a few solutions:
1/ Change the default PerlIO layers
use open qw/ :std :crlf /
will cause every file to be opened with the Windows `:crlf` layer, which
removes any CR if it is there. It doesn't affect Linux files at all
2/ If you *always* `chomp` every line, then use
s/\R\z//
instead, which will remove any line termination character or character pair
3/ If you *always* `split` every line using the default of `split ' ', $_` then
there is nothing to do: CR is considered to be a whitespace character and will
be removed from the fields
There are clearly variations on this idea, but it shouldn't be hard to resolve
from here
Can someone please tell me whether I have answered the original question, or if
I'm miles off?
Rob Dixon
Norfolk
England
-Original Message-
From: Ralph Corderoy <ra...@inputplus.co.uk>
To: get_iplayer@lists.infradead.org
Sent: Tue, 06 Mar 2018 13:30
Subject: Re: Format of options file
Hi David,
> binmode does still work AFAIK, but a more modern and flexible method
> is to use the crlf I/O layer, which is documented here:
> https://perldoc.perl.org/PerlIO.html
>
> Note however that an awful lot of perl code just doesn't bother.
Windows stacks the `:crlf' layer by default. I *think* Richard's trying
to avoid that because he wants his get_iplayer to use POSIX text files
on Linux, as normal, and Windows.
--
Cheers, Ralph.
https://plus.google.com/+RalphCorderoy
___
get_iplayer mailing list
get_iplayer@lists.infradead.org
http://lists.infradead.org/mailman/listinfo/get_iplayer
___
get_iplayer mailing list
get_iplayer@lists.infradead.org
http://lists.infradead.org/mailman/listinfo/get_iplayer
Re: Synology
On 09/02/2015 21:09, Dennis Smith wrote: Hi guys, Anyone know if there is an easy way to install Get_iPlayer to my Synology NAS, even if all I get is a basic web interface with E.G. nearly blank webpage to look at and a box to paste a URL into and a download button, defaulting to a dedicated download folder? Anything like this would be ideal, anything more a bonus. Hello Dennis The release notes for version 2.85 say Patched to work with Perl on Synology NAS The commits were done by Dinky Pumpkin, so I imagine he will be able to tell you what that implies. Rob --- This email has been checked for viruses by Avast antivirus software. http://www.avast.com ___ get_iplayer mailing list get_iplayer@lists.infradead.org http://lists.infradead.org/mailman/listinfo/get_iplayer
Re: Information Overload on GiP Changes
On 01/11/2014 17:50, Nick wrote: On Sat, 01 Nov 2014 10:59:14 + Tom madtom1...@googlemail.com wrote: [...JS] - and like any other programming language you can write rubbish programs with it and as many people do, and everyone in the world can see it, it gets the blame when its really MS who sold the lie that 'computing' was easy that should get a good kicking. Tom A technology on the cutting edge of humanity's inventiveness is complicated and so inherently difficult? Really? Ah. Did I miss the sarcasm? Rob --- This email is free from viruses and malware because avast! Antivirus protection is active. http://www.avast.com ___ get_iplayer mailing list get_iplayer@lists.infradead.org http://lists.infradead.org/mailman/listinfo/get_iplayer
Re: Solutions to loss of RSS feed
On 01/11/2014 16:32, Budgie wrote: Hi Rob, Because I never use iPlayer I am not sure what functionality the BBC offer but I have found the GiP PVR function invaluable for grabbing radio programmes which I wish to hear but which are not necessarily on at specific times. I do not have time to pour over schedules. Take for example Trollopes' Barchester Chronicles. These are being broadcast from time to time in groups according to length. Having the PVR set up for these I do not have to search through the schedules and the episodes appear in my file from time to time. I have a few other likely candidate programmes which I download by default and then delete the rubbish when I have time to listen. I do not recall a similar functionality being available on iPlayer but it is the only intelligent means of catering for people who are busy or away from their computers for days at a time. I wonder if this might form the basis of an argument for gaining a Nitro Key to create an app which provides a similar service? Thank you, that's very helpful. It looks like the Nitro interface is a BBC-only thing until next year at least, but I've tagged your email and will use it for ammunition. Rob --- This email is free from viruses and malware because avast! Antivirus protection is active. http://www.avast.com ___ get_iplayer mailing list get_iplayer@lists.infradead.org http://lists.infradead.org/mailman/listinfo/get_iplayer
Re: Information Overload on GiP Changes
On 01/11/2014 17:50, Nick wrote: On Sat, 01 Nov 2014 10:59:14 + Tom madtom1...@googlemail.com wrote: [...JS] - and like any other programming language you can write rubbish programs with it and as many people do, and everyone in the world can see it, it gets the blame when its really MS who sold the lie that 'computing' was easy that should get a good kicking. Tom A technology on the cutting edge of humanity's inventiveness is complicated and so inherently difficult? Really? Yes, really. I don't understand why you find that difficult to accept. Rob --- This email is free from viruses and malware because avast! Antivirus protection is active. http://www.avast.com ___ get_iplayer mailing list get_iplayer@lists.infradead.org http://lists.infradead.org/mailman/listinfo/get_iplayer
Re: Solutions to loss of RSS feed
The Nitro API is freely available to anyone who applies for a licence. There would be no reverse engineering involved. On 31/10/2014 21:38, Ian Macdonald wrote: I have always just used the command line, but the last option seems best, it depends on how much effort is required to reverse engineer the API, though it is legal to reverse engineer in Europe, you may have a problem if you apply for a license and use that as a basis to engineer a solution, as it may be against the T's C's --- This email is free from viruses and malware because avast! Antivirus protection is active. http://www.avast.com ___ get_iplayer mailing list get_iplayer@lists.infradead.org http://lists.infradead.org/mailman/listinfo/get_iplayer
Re: Solutions to loss of RSS feed
On 31/10/2014 23:42, Jeremy Nicoll - ml get_iplayer wrote: Ian Macdonald ianma...@gmail.com wrote: I have always just used the command line, but the last option seems best, it depends on how much effort is required to reverse engineer the API... The problem isn't the API, so far as I understand it. The problem is that any request has to include a 'key'. That's a number which the BBC will use to associate such a request with the registered user/app that is making the request. Not only is it impossible for anyone outwith the BBC to get a registration (and hence a key) at the moment, the comments made by someone at the BBC which were posted in another thread suggest that they'd not grant a key to an app like get_iplayer. There is a simple application form, which I filled in today, to get a licence for accessing the Nitro API, and there's no implication that there's a BBC-staff-only restriction. I'll keep people updated about what I hear back. Rob --- This email is free from viruses and malware because avast! Antivirus protection is active. http://www.avast.com ___ get_iplayer mailing list get_iplayer@lists.infradead.org http://lists.infradead.org/mailman/listinfo/get_iplayer
Re: Solutions to loss of RSS feed
On 31/10/2014 23:12, Stuart Henderson wrote: On 2014/10/31 21:21, Rob Dixon wrote: - Write a new application that uses the Nitro API, ostensibly to provide a different and more flexible way of viewing the BBC schedule, but capable of exporting the information for use in get_iplayer. This could even reconstruct the old XML RSS feeds, but I don't see a reason to add such an awkward intermediate format. This last option seems to me to be the most likely to succeed. I have applied for a licence for my own use and I shall be experimenting with what is possible. After some experimentation I will be glad to add an export along the lines I have described, to be specified by those responsible for get_iplayer. Whether or not this could export something that would be useful to get_iplayer, it would be useful in itself. I've certainly used get_iplayer a few times to look for programmes of interest because the search facilities areslightly better than the BBC's website ;)... and then gone to watch them using a BBC-Approved Method. Precisely, and I assume I would have no problem getting a licence to write something of that sort. The fact that it may export something that could be useful for get_iplayer is incidental. Rob --- This email is free from viruses and malware because avast! Antivirus protection is active. http://www.avast.com ___ get_iplayer mailing list get_iplayer@lists.infradead.org http://lists.infradead.org/mailman/listinfo/get_iplayer
Re: Solutions to loss of RSS feed
On 31/10/2014 23:18, David Woodhouse wrote: Whether or not this could export something that would be useful to get_iplayer, it would be useful in itself. I've certainly used get_iplayer a few times to look for programmes of interest because the search facilities areslightly better than the BBC's website ;)... and then gone to watch them using a BBC-Approved Method. I think this approach is best. Let's have a clean separation between the code which can actually download media (which get_iplayer can still do given a PID), and the code for searching/indexing. There's no reason to object to the latter in a standalone tool. Hell, make it output links to the official BBC iPlayer site or automatically spawn them in a browser. Just let us configure which 'browser' it should invoke, and then nobody needs to lose sleep over the fact that *some* people might actually use it to invoke the new, slimline, get_iplayer instead of a real browser. Yes. Something that can ingest the available data and spit it out as a GUI or in any number of export formats is what I had in mind. Rob --- This email is free from viruses and malware because avast! Antivirus protection is active. http://www.avast.com ___ get_iplayer mailing list get_iplayer@lists.infradead.org http://lists.infradead.org/mailman/listinfo/get_iplayer
Re: Solutions to loss of RSS feed
On 31/10/2014 23:24, Budgie wrote: On 31/10/14 21:21, Rob Dixon wrote: - Write a new application that uses the Nitro API, ostensibly to provide a different and more flexible way of viewing the BBC schedule, but capable of exporting the information for use in get_iplayer. This could even reconstruct the old XML RSS feeds, but I don't see a reason to add such an awkward intermediate format. This last option seems to me to be the most likely to succeed. I have applied for a licence for my own use and I shall be experimenting with what is possible. After some experimentation I will be glad to add an export along the lines I have described, to be specified by those responsible for get_iplayer. Having posted a request for help on finding out more about Nitro I have just found a relevant BBC Nitro page. Having read their objectives: The best integrations will do all three: they will surface the huge amount of available content (currently more than 500,000 programmes) in easy to navigate ways, they will be part of the open web, and they will entertain and inform users. I wonder what exactly the BBC has against GiP. I certainly like the sound of the last option and wish you well with your project. I can understand completely what the BBC has against get_iplayer: that their licencing system and any copyrights may be circumvented. How to reassure the cooperation that this won't be a problem is a separate consideration. As I explained, I have applied for a developer's licence and received confirmation that my application will be assessed. However, since it is a Friday I wouldn't hold your breath for any news. I have read the objectives that you copy here and the application that I had in mind matches pretty much exactly. Thank you for your good wishes. Rob --- This email is free from viruses and malware because avast! Antivirus protection is active. http://www.avast.com ___ get_iplayer mailing list get_iplayer@lists.infradead.org http://lists.infradead.org/mailman/listinfo/get_iplayer
Re: Solutions to loss of RSS feed
On 31/10/2014 23:55, David Lake (dlake) wrote: Check the banner at the top of the page. Beta The BBC Developer site is currently open for registration to BBC Employees. Account requests from other users are not currently being activated. Please check back soon for more info. Then check this post in the forum: https://developer.bbc.co.uk/content/how-long-does-approval-process-take-nitro-app Hmm. Well my application wasn't refused directly, so there is some hope. I shall pursue this line and relate anything relevant that I find that I can reveal. Rob --- This email is free from viruses and malware because avast! Antivirus protection is active. http://www.avast.com ___ get_iplayer mailing list get_iplayer@lists.infradead.org http://lists.infradead.org/mailman/listinfo/get_iplayer
Re: Information Overload on GiP Changes
On 31/10/2014 23:11, Budgie wrote: Also I see references to JSON. OK, JavaScript Object Notation but what does it mean to me and where does it fit in with GiP and BBC. I thought, in my ignorance, that JavaScript was going the way of the brown ball. Certainly I get grave warnings when it is used or fails to work on the web management interface of my L2 managed switch. If you know enough to understand what JavaScript is, then you will know that at present it is tied inextricably to intelligent web sites. It is by several leagues the chosen way to write dynamic web sites (those sites that can modify the contents of the display without reference back to the web server. You're right that JavaScript isn't well-liked, but at present it is the only option. However, its data literals are quite adequate, and something similar is used by languages like Perl and Python. So that standard has been extracted and named JSON independently of the language itself, and pretty much every language has a module or library available that will read and write such data. It is also a subset of the YAML data specification language, which has no ties at all to any languages, much like XML, so if your program will read or write YAML then it will also read JSON. I hope that helps, Rob --- This email is free from viruses and malware because avast! Antivirus protection is active. http://www.avast.com ___ get_iplayer mailing list get_iplayer@lists.infradead.org http://lists.infradead.org/mailman/listinfo/get_iplayer
Re: Solutions to loss of RSS feed
On 01/11/2014 00:03, Jeremy Nicoll - ml get_iplayer wrote: On all three of: https://developer.bbc.co.uk/nitro https://developer.bbc.co.uk/nitropubliclicence https://developer.bbc.co.uk/content/nitro-quickstart I get a banner across the top of the page that says: The BBC Developer site is currently open for registration to BBC Employees. Account requests from other users are not currently being activated. What makes you think differently? I'm not interested in any caustic comments, and I will not just fall on my face and wail with you. I had overlooked that banner as it looks exactly like the ubiquitous we use cookies message. I have applied for a licence and have met no barriers so far. Besides, this page, posted by David Lake https://developer.bbc.co.uk/content/how-long-does-approval-process-take-nitro-app has this to say We plan to open it fully to the public later this year and since this year has only two months to go, I'm not beyond waiting for a change. Rob --- This email is free from viruses and malware because avast! Antivirus protection is active. http://www.avast.com ___ get_iplayer mailing list get_iplayer@lists.infradead.org http://lists.infradead.org/mailman/listinfo/get_iplayer
Re: Proof-of-concept scraper for iPlayer web frontend TV data to JSON
On 01/11/2014 00:27, dinkypumpkin wrote: I tried this same approach, but it foundered on radio programmes. There is just too much stuff there. It's soul-crushingly slow to scrape the iPlayer Radio site, at least for a desktop cache. It would be great to have everything available on iPlayer searchable off-site, but there is too much of it for get_iplayer's current local caching model. I'm going to have another go at some point. There is no real need to download *all* of the schedule information; after all, only a fraction of it will ever be of any use to an individual user. I would use the BBC server to do the search for me, after which there is little work to be done. For instance, if I look for all Book at Bedtime episodes with this URL http://www.bbc.co.uk/radio/programmes/a-z/by/book%20at%20bedtime/player then I am taken a page with a link to the series at http://www.bbc.co.uk/programmes/b006qtlx/episodes/player?page=1 through to `page=6`. That amounts to 52 programmes which, even on my meagre 13 megabit connection that takes less than ten seconds, and the results could be cached for practically instantaneous response for a similar request in the future. There is also the possibility of writing a batch solution that makes a query only every minute or so and could be run continuously or overnight. I'm more than happy to write a proof of concept if you're interested. I have it half-written already just to get that timing information. The one thing that bothers me is the terms and conditions of the web site. I scanned through them quickly and couldn't find anything about robotic access, but it would be a first if there isn't anything there. If it's just a matter of obeying the /robots.txt then I'm more than happy to go ahead. Let me know how I can help. Rob --- This email is free from viruses and malware because avast! Antivirus protection is active. http://www.avast.com ___ get_iplayer mailing list get_iplayer@lists.infradead.org http://lists.infradead.org/mailman/listinfo/get_iplayer
Re: Proof-of-concept scraper for iPlayer web frontend TV data to JSON
On 01/11/2014 01:29, Steven Maude wrote: At a glance, robots.txt doesn't seem to disallow accessing the sections needed. In the terms of use, there is this though: (d) You agree to use BBC Online Services and access, download, view and/or listen to BBC Content as supplied to you by the BBC and you may not, and you may not assist anyone to, or attempt to, reverse engineer, decompile, disassemble, adapt, modify, copy, reproduce, lend, hire, rent, perform, sub-license, make available to the public, create derivative works from, broadcast, distribute, commercially exploit, transmit or otherwise use in any way BBC Online Services and/or BBC Content in whole or in part except to the extent permitted in these Terms of Use, any relevant Additional Terms and at law. If I'm downloading pages automatically and automatically reading certain sections of the HTML, is that viewing it as supplied to me by the BBC? I'm no lawyer, but on the face of it I would say we're clear. as supplied to you by the BBC says to me that it mustn't be modified, not that it mustn't be stored. Rob --- This email is free from viruses and malware because avast! Antivirus protection is active. http://www.avast.com ___ get_iplayer mailing list get_iplayer@lists.infradead.org http://lists.infradead.org/mailman/listinfo/get_iplayer
Re: Proof-of-concept scraper for iPlayer web frontend TV data to JSON
On 01/11/2014 00:27, dinkypumpkin wrote: On 31/10/2014 00:08, Steven Maude wrote: https://github.com/StevenMaude/nitroradical Thanks for that. From underneath 10,000 lines of Perl I gaze longingly at that lovely strictly-indented, sigil-less Python. I also think there could be some mileage in looking at the JavaScript on the radio A-Z pages at http://www.bbc.co.uk/radio/programmes/a-z Unlike the specific channel and category schedules, these pages have no programme information except what is created dynamically by JavaScript, and that is relatively fast. Rob --- This email is free from viruses and malware because avast! Antivirus protection is active. http://www.avast.com ___ get_iplayer mailing list get_iplayer@lists.infradead.org http://lists.infradead.org/mailman/listinfo/get_iplayer
Re: Banned From Posting?
On 31/07/2014 19:20, Shevek wrote: On 31 July 2014 17:37, Chris J Brady chrisjbr...@yahoo.com wrote: My last post was bounced back with a suspicious header. Yet anothersnafu due to Yahoo I suppose. CJB. Chris, also ALL your emails to the group end up in my Spam folder (Gmail) Shevek, I presume you're saying that your spam filter puts all those posts there, rather than that you have no wish to see anything that Chris writes?! Rob --- This email is free from viruses and malware because avast! Antivirus protection is active. http://www.avast.com ___ get_iplayer mailing list get_iplayer@lists.infradead.org http://lists.infradead.org/mailman/listinfo/get_iplayer
Re: Subtitles Round 3
On 28/09/2013 00:27, dinkypumpkin wrote: I wasn't satisfied by my earlier attempt at subtitles, so I've had another go. This time I decided to attack the problem the get_iplayer way: Add more options! Although that's not the choice I would have made, your decisions so far have created a superb utility so I am behind you. But it will be very difficult to choose between subtitle options before you can see the results, and it strikes me that this would be much better if it was somehow available as a post-processing option that could be applied to existing TTML files from a previous download (as if from a --subsraw option). At present my options file has both `raw` and `subsraw` anyway, so I can modify the video/audio/subtitle content as I wish after the download. But while choosing a video mode (and corresponding implicit audio mode) is simple, a subtitle transformation depends more on what is available that what is desired. As a relevant aside, and in the spirit of Perl, it would be nice to be able to request a --thumbsize index of -1, i.e. the largest. The biggest thumbnail file I have is 150KB, which is tiny compared to the very smallest fifteen-minute audio-only radio file at just over 1MB. My options file currently has a `thumbsize` of 640, but it is highly unlikely that the maximum-available thumbnail size will remain at 640 pixels wide. Thanks for the impressive work that is being done. Rob ___ get_iplayer mailing list get_iplayer@lists.infradead.org http://lists.infradead.org/mailman/listinfo/get_iplayer
Re: Changed subtitle format
On 23/09/2013 17:15, dinkypumpkin wrote: On 23/09/2013 06:39, Jonathan Larmour wrote: I'm attaching a patch which does fix the problem, although I'm sure someone with better perl skills than me (which is most people, as I don't really use perl) can make it a bit better. Thanks. I've trimmed your patch a bit: https://github.com/dinkypumpkin/get_iplayer/commit/3f377f0a1c16904c9801213bbed2c666f4cd6e7a.patch I highly recommend moving to XML::Parser::Lite for handling the XML that get_iplayer has to deal with. It is self-contained and pure Perl, and only two-hundred or so lines of code. Rob ___ get_iplayer mailing list get_iplayer@lists.infradead.org http://lists.infradead.org/mailman/listinfo/get_iplayer
Re: Changed subtitle format
On 23/09/2013 22:42, Jonathan Larmour wrote: I'm attaching a, hopefully final, patch. New! Now with comments! Thanks for doing this Jonathan. Your code looks right, for what that's worth. Once thing this thread has brought to my attention is that the srt files that get_iplayer produces have each subtitle compacted into a single line. That doesn't seem like a good idea to me, and I wonder if that's something we should take the opportunity to change while we're here. Rob ___ get_iplayer mailing list get_iplayer@lists.infradead.org http://lists.infradead.org/mailman/listinfo/get_iplayer
Re: Changed subtitle format
On 23/09/2013 23:05, dinkypumpkin wrote: On 23/09/2013 22:52, Rob Dixon wrote: One thing this thread has brought to my attention is that the srt files that get_iplayer produces have each subtitle compacted into a single line. That doesn't seem like a good idea to me, and I wonder if that's something we should take the opportunity to change while we're here. If any subtitle users have a view on this one way or the other, chime in. get_iplayer doesn't honour explicit line breaks in subtitles, but it could. Sometimes they're bogus (at end of line with no following text), but in general I presume they're included to keep eyes focused in the centre of screen to make subs easier to read. If you view programmes on the iPlayer site, the line breaks are honoured. In theory there could be *many* lines of text in a subtitle that, if concatenated into a single line, would reach beyond the width of the screen. Remember also that separate lines are used to indicate different speakers, and that information is being lost at present. Rob ___ get_iplayer mailing list get_iplayer@lists.infradead.org http://lists.infradead.org/mailman/listinfo/get_iplayer
Re: Changed subtitle format
On 24/09/2013 00:44, dinkypumpkin wrote: On 23/09/2013 23:16, Rob Dixon wrote: Unfortunately, that's not how the subtitles arrive from the Beeb. There are line breaks within a single speaker's lines, and sometimes no line break or other structural change to demarcate the transition between speakers in a single subtitle. That isn't my experience - certainly not across all programmes. Current editions of QI, for instance, have the text split between voices in several places. The splits also seem to be at punctuation where possible, rather than at an arbitrary half-way point. I believe the subtitles XML file contains the text formatted as it was transcribed and intended to be viewed. The old format has text colour changes to mark transition between speakers in a single subtitle, but the newer format doesn't appear to use that device. I suspect that depends on the source of the subtitles. Captions that the BBC has commissioned itself are uncoloured, but if they come from a third party - often subtitles for films are of this type - then they can vary a lot in style and content, and for instance may be labelled with the speaker's name, or placed on the appropriate side of the screen. My vote is with keeping the newlines as they are in the XML when translating to SRT. (I have a short Perl program that does just that using XML::Parser::Lite if it is of any interest.) Rob ___ get_iplayer mailing list get_iplayer@lists.infradead.org http://lists.infradead.org/mailman/listinfo/get_iplayer
Re: Recording Proms 2013 Highlights
On 08/09/2013 12:45, tgil...@mygilkes.co.uk wrote: Does anybody know how to record the Proms 2013 highlights from here :- http://www.bbc.co.uk/events/edrnc8 e.g. :- 2013 BBC Proms Montage http://www.bbc.co.uk/events/edrnc8/videos/p00yjyg2#p01g86k6 If you go into any of the *subsections* of that page that contains video clips and mouse over the thumbnails, you will see links like the one you show. The *last* part, after the #, is the programme ID that you can use to download the clip. For instance get_iplayer --pid p01g86k6 will retrieve the montage for you. HTH, Rob ___ get_iplayer mailing list get_iplayer@lists.infradead.org http://lists.infradead.org/mailman/listinfo/get_iplayer
Re: can someone point me to the list instructions please ...
On 30/08/2013 23:10, David Woodhouse wrote: On Fri, 2013-08-30 at 13:59 +0100, Mable Syrup wrote: I'm sure there must be something, but I can't find it. I want to reply to different items in a thread in a manner that preserves the threading. I don't really understand why this is an issue. It's all really really simple I'm sorry David, but I find this very offensive. Mable has a problem understanding the complexities of replying to a post using his SMTP client while keeping to the list's rules. I'm pleased that you understand the whole thing comprehensively yourself but, as you reply goes on to demonstrate in your post, it is a horribly complex business. It is wrong of you to belittle those who are unfamiliar with SMTP and have to ask for advice. I am certain that there is a field where what is obvious baffles you completely. Until very recently, this list was a generous and encouraging place. Please lets not start the I'm clever and I know good wars. Rob ___ get_iplayer mailing list get_iplayer@lists.infradead.org http://lists.infradead.org/mailman/listinfo/get_iplayer
Re: can someone point me to the list instructions please ...
On 31/08/2013 22:09, David Woodhouse wrote: On Sat, 2013-08-31 at 20:46 +0100, Rob Dixon wrote: I'm sorry David, but I find this very offensive. Before we continue, I would ask you to watch this video: http://www.snotr.com/video/8285/Steve_Hughes_-_Offended Watch it from 3:20 to 5:45. Before reading any further, please. I would much rather you explained to me directly what you wanted to say by linking this clip. I know Steve Hughes is a stand-up comedian; if you are having trouble explaining yourself then perhaps it would be better to cite a more authoritative source. Mable has a problem understanding the complexities of replying to a post using his SMTP client while keeping to the list's rules. I'm pleased that you understand the whole thing comprehensively yourself but, as you reply goes on to demonstrate in your post, it is a horribly complex business. You seem to think that I was impugning Mable Syrup's intelligence when I said it was simple. You're wrong; I wasn't. I don't think you mean impugning. It doesn't make sense in that context. But really? You think you can say without any implication that a thing someone doesn't understand is simple? This is the get_iplayer list. It is appropriate here to be as bland as possible, and to concentrate on facts and specifics about the functionality or otherwise of get_iplayer. There are places for blasé undermining of people's shortcomings, but this is not one of them. Please try to restrict you comments to technical topics. Rob ___ get_iplayer mailing list get_iplayer@lists.infradead.org http://lists.infradead.org/mailman/listinfo/get_iplayer
Re: can someone point me to the list instructions please ...
On 31/08/2013 23:48, Stuart Henderson wrote: As David is the list owner, I think it's reasonable for him to comment on list admin matters.. You are quite right. I was unaware of David's position as list owner and wouldn't have challenged his entitlement to say whatever he wants. My problem is with him claiming asylum in his *literal* meaning being inoffensive. It is a position that we see over and over again in defence of advertising and public relations practices. But the fact that the *list owner* thinks it acceptable to post in that vein discourages me from reading or contributing any further. No doubt David will be pleased to lose another dissenter. Rob ___ get_iplayer mailing list get_iplayer@lists.infradead.org http://lists.infradead.org/mailman/listinfo/get_iplayer
Re: can someone point me to the list instructions please ...
On 30/08/2013 13:59, Mable Syrup wrote: I'm sure there must be something, but I can't find it. I want to reply to different items in a thread in a manner that preserves the threading. The correct thing to do depends on the mail client you are using. I see you are on the Yahoo Mail Web Service, which I think has a `Reply` and a `Reply to All` button. The safest thing to do is use `Reply to All` and check the `To` and `Cc` fields on your replt message. If you want to send a courtesy copy to the original sender then leave his address in there, otherwise remove it and leave just the list address. You may find that using just `Reply` creates a reply message with just the list address in the `To` line. If so then this is the one you want to use, but it is most likely to be addressed to just the originator of the message. Any reply that goes to the list will maintain the threading of the messages. The only way to break it is by creating and sending a new message manually, or forwarding one to the list. Summary: See if `Reply` creates a message addressed to the list, if so (probably not) then use that. If not then use `Reply to All` and remove the original poster's address unless you want to send a courtesy copy. You may be interested in this. http://www.mail-list.com/reply-to-sender-reply-to-list-reply-to-all/ Rob ___ get_iplayer mailing list get_iplayer@lists.infradead.org http://lists.infradead.org/mailman/listinfo/get_iplayer
Re: Problem with Series
On 19/07/2013 10:57, J K.Eason wrote: Using 2.83 on WinXP I've downloaded an episode of the A Series of Psychotic Episodes radio series with the following included in my options file: subdirformat nameshort The output directory that was created has been given the name A. Using --info, it appears that the word Series in the Title has caused nameshort to be defined as just that - although name is complete. If that word hadn't been included in the title, I idly wonder if Episodes would have caused a glitch. I wonder if that's another side effect of a colon (illegal Windows character) in the filename? This is either an internal get_iplayer problem or something at BBC's end. The `descshort` metadata for the programme is just `A`. Rob ___ get_iplayer mailing list get_iplayer@lists.infradead.org http://lists.infradead.org/mailman/listinfo/get_iplayer
Re: Problem with Series
On 19/07/2013 11:10, Rob Dixon wrote: On 19/07/2013 10:57, J K.Eason wrote: Using 2.83 on WinXP I've downloaded an episode of the A Series of Psychotic Episodes radio series with the following included in my options file: subdirformat nameshort The output directory that was created has been given the name A. Using --info, it appears that the word Series in the Title has caused nameshort to be defined as just that - although name is complete. If that word hadn't been included in the title, I idly wonder if Episodes would have caused a glitch. I wonder if that's another side effect of a colon (illegal Windows character) in the filename? This is either an internal get_iplayer problem or something at BBC's end. The `descshort` metadata for the programme is just `A`. `descshort` meaning `nameshort`. Rob ___ get_iplayer mailing list get_iplayer@lists.infradead.org http://lists.infradead.org/mailman/listinfo/get_iplayer
Re: Netiquette - bottom posting - outdated?
On 19/07/2013 06:19, Xtra wrote: Having read (and agreed) with many of the items in the http://lists.infradead.org/mailman/listinfo/get_iplayer can I suggest however, that the requirement for bottom posting is out-dated? This requirement dates from 2003 and I believe that the world has has since changed and moved on. Few people these days have the the time or inclination to scroll through often repeated screeds of historical background to finally get to the latest contribution concerning a topic that they may already be involved in and up to speed on. Top-posting a reply seems more efficient while providing the history (below it) if a newcomer is interested. I don't know how others feel, but time for me, and in most other forums, runs downwards. I wonder what you think has happened since 2003 that changes the way well-formatted list postings are constructed? Your frustration seems to be with those who cannot or will not write a well-mannered message rather than with the requirements themselves. Top posting may be a panacea for lazy posting, but best of all is well-thought-out bottom-posting, which is neither TL;DR (too long-winded to be of interest) nor so brief as to be incomprehensible for want of context. Your final sentence seems to contradict you. Sure, time runs downwards. So the latest post should be at the bottom? Rob ___ get_iplayer mailing list get_iplayer@lists.infradead.org http://lists.infradead.org/mailman/listinfo/get_iplayer
Re: Problem with Series
On 19/07/2013 12:33, dinkypumpkin wrote:
On 19/07/2013 11:58, Rob Dixon wrote:
$prog-{nameshort} =~ s/:?\s*Series\s+.+?(:\s*|$)//i;
A Series of Psychotic Episodes appears to be the only TV or radio
programmeaffected. If anyone knows of another, reply here.
That is the only current programme where `Series` doesn't mean programme
series.
I wonder if this doesn't belong in `main::split_title`?
Rob
___
get_iplayer mailing list
get_iplayer@lists.infradead.org
http://lists.infradead.org/mailman/listinfo/get_iplayer
Re: Problem with Series
On 19/07/2013 13:08, dinkypumpkin wrote: On 19/07/2013 12:43, Rob Dixon wrote: I wonder if this doesn't belong in `main::split_title`? I don't think so. split_title produces the correct programme name. It's just the shortening that goes awry. And I'm wondering if it instead split the title into nameseries episode there would be nothing to do later on? Rob ___ get_iplayer mailing list get_iplayer@lists.infradead.org http://lists.infradead.org/mailman/listinfo/get_iplayer
Re: Problem with Series
On 19/07/2013 11:58, Rob Dixon wrote:
On 19/07/2013 11:10, Rob Dixon wrote:
On 19/07/2013 10:57, J K.Eason wrote:
Using 2.83 on WinXP I've downloaded an episode of the A Series of
Psychotic Episodes radio series with the following included in my
options file:
subdirformat nameshort
The output directory that was created has been given the name A.
Using --info, it appears that the word Series in the Title has
caused nameshort to be defined as just that - although name is
complete.
If that word hadn't been included in the title, I idly wonder if
Episodes would have caused a glitch.
I wonder if that's another side effect of a colon (illegal Windows
character) in the filename?
This is either an internal get_iplayer problem or something at BBC's
end. The `descshort` metadata for the programme is just `A`.
OK this is a job for Dinky. The problem is in sub get_metadata in
package Programme::bbciplayer.
In the block commented
# Create a stripped episode and series with numbers removed + senum
s##e## element.
the last line does this
$prog-{nameshort} =~ s/:?\s*Series\s+.+?(:\s*|$)//i;
which effectively deletes Series and anything following it from the
programme name. In this case leaving just A.
If you want to fix it temporarily for yourselves, then find this line
and change it to
$prog-{nameshort} =~ s/:?\s*Series\s+\d.+?(:\s*|$)//i;
which will only delete Series with a number after it. A more elaborate
fix is in order, but the worst this will do is leave a series number on
a programme name if it happens to be numbered in English, like Series
two etc.
Apologies again, this should be
$prog-{nameshort} =~ s/:?\s*Series\s+\d.*?(:\s*|$)//i;
otherwise it will remove Series... only if the series number isn't at
the end of the name.
Rob
___
get_iplayer mailing list
get_iplayer@lists.infradead.org
http://lists.infradead.org/mailman/listinfo/get_iplayer
Re: Listformat
On 23/06/2013 15:41, Kapitano wrote: I want to set the listformat to nameshort senum episodeshort. But the line in the options file listformat nameshort senum episodeshort produces a list of programmes all called nameshort senum episodeshort. The line listformat hello world causes GiP to list all programmes as the string hello world. listformat pid,name givespid,name. The same happens using --listformat in the command line. What am I doing wrong? As dinkypumpkin says, you have happened upon three of the fields that are unavailable at the point of creating the list of programs. Here is a list of the fields available for TV programmes when I run get_iplayer, together with their corresponding values. As you can see, by no means all of them are useful things that you would want in your file name. available = Unknown, categories = Children's,Entertainment Comedy,TV, channel= CBBC, desc = Actors from the cast of EastEnders share their memories from when they were 12., duration = Unknown, episode= 2. Eastenders, episodenum = 2, guidance = , index = 1, name = 12 Again: Series 3, pid= b01xvry7, seriesnum = 3, thumbnail = http://www.bbc.co.uk/iplayer/images/episode/b01xvry7_150_84.jpg;, timeadded = 1369101616, type = tv, versions = default, web= http://www.bbc.co.uk/programmes/b01xvry7.html;, Note also that the default format is something like --listformat=index: typenameepisode, channel, categories, versions although there is no exact equivalent because the program omits fields that are unavailable instead of leaving blanks. Also the default is different for other programme types. HTH, Rob ___ get_iplayer mailing list get_iplayer@lists.infradead.org http://lists.infradead.org/mailman/listinfo/get_iplayer
Re: Saved Filename options
The --fileprefix option is fairly dumb, and won't do anything more than just include the named fields into the pattern you specify. Something using the --command option would be possible, but I can't get the command-line processor to pass the value of filename through on a Windows system. You ought to be able to say something like --command perl -e \($new = $old = shift) =~ s/\-+\././; rename $old, $new\ \filename\ but no matter what I do I get The system cannot find the path specified. from the command processor, even before get_iplayer gets a look at it. Rob On 04/02/2013 11:53, YelloYeti wrote: A rather trivial question, but hopefully someone can come up with a solution: my options file has the entry: fileprefix nameshort-episodeshort-senum Which when I grab an episode of a series gives me exactly what I want. When I grab a 'one-off' programme, i.e. there is no series/episode, I end up with a file called name--.mp4 Is there some invocation I can use in the options file which will automagically get rid of the trailing '-' characters? YY ___ get_iplayer mailing list get_iplayer@lists.infradead.org http://lists.infradead.org/mailman/listinfo/get_iplayer ___ get_iplayer mailing list get_iplayer@lists.infradead.org http://lists.infradead.org/mailman/listinfo/get_iplayer
Re: Smart naming of output files
On 29/07/2012 12:08, Rob Dixon wrote: On 29/07/2012 09:13, J K.Eason wrote: In the same vein, I'd like to be able to get filenames without the PID and 'default' tacked on the end. It's a real pain having to rename them every time. Hi John You need to adjust the file-prefix option. By default it's set to name - episode pid version and if all you want to do is remove the PID from the name you can just add --file-prefix name - episode version to your command line. If there is anything you want to make permanent then add it to your preferences file using get_iplayer --prefs-add --file-prefix name - episode version Use the --info option to see what information fields are available, and note that you can add whatever characters you like between the fields. You can also change the directory where the file is stored using the --subdir-format option in the same way. You also wanted the `default` removed. That is the `version` field so you end up with just --file-prefix name - episode Rob ___ get_iplayer mailing list get_iplayer@lists.infradead.org http://lists.infradead.org/mailman/listinfo/get_iplayer
max_analyze_duration 5000000 reached
Hi all I've seen the error message max_analyze_duration 500 reached at 5014000 Estimating duration from bitrate, this may be inaccurate appear in log files a few times on this list, but no one seems to have raised it as a problem. I'm aware that it probably makes no significant difference to the reencoded files, but I don't like warning messages and I would like to learn more about it. After a few web searches I have found nothing really relevant except that it relates to an ffmpeg option -analyzeduration. That brings up the question of whether it is possible to adjust the ffmpeg default configuation settings used by get_iplayer. Any help from anyone would be most welcome. Rob ___ get_iplayer mailing list get_iplayer@lists.infradead.org http://lists.infradead.org/mailman/listinfo/get_iplayer
Re: Signed programmes not downloading
On 23/02/2012 11:41, dinkypumpkin wrote:
On 23/02/2012 08:53, Rob Dixon wrote:
I have noticed recently that signed television programmes are breaking
get_iplayer. An interim fix that seems to work (there may be a better
indicator than the one I have chosen) is to add the line
$url .= '/sign' if $prog-{channel} and $prog-{channel} eq 'Signed';
after line 4939 in the 2.80 release of get_iplayer.pl which reads
$url .= '/ad' if defined $opt-{versionlist} $opt-{versionlist} ne
'default';
I've just downloaded several signed programmes without a hitch, so
please expand on breaking get_iplayer. Does it actually fall over, or
do you just not get the programme you expected? If it falls over, does
it print an error message? More helpful would be to show us your command
line and the output (from release version) when run with --verbose.
Ordinarily, the choice of playlist URL with non-default versions
wouldn't make a difference. If the change you described actually has an
effect, it suggests there may be something unusual with BBC metadata for
your programmes, but we don't know what those programmes are.
Update, the output with --verbose enabled is below.
Cheerrs,
Rob
C:\Program Files (x86)\get_iplayerget_iplayer --overwrite --force --verbose
--pid b01b45zh -g
get_iplayer v2.80, Copyright (C) 2008-2010 Phil Lewis
This program comes with ABSOLUTELY NO WARRANTY; for details use --warranty.
This is free software, and you are welcome to redistribute it under certain
conditions; use --conditions for details.
INFO: User prefs dir: C:\Users\Rob/.get_iplayer
INFO: System options dir: C:\ProgramData/get_iplayer/options
Current options:
atomicparsley = .\AtomicParsley\AtomicParsley\AtomicParsley.exe
fatfilename = 1
ffmpeg = .\FFmpeg\ffmpeg-0.8-win32-static\bin\ffmpeg.exe
flvstreamer = .\RTMPDump\rtmpdump.exe
force = 1
lame = .\LAME\lame.exe
metadata = generic
mmsnothread = 1
mplayer = .\MPlayer\MPlayer-1.0rc2\mplayer.exe
nopurge = 1
output = \\synology\download\iPlayer
outputradio = \\synology\download\iPlayer\Radio
outputtv = \\synology\download\iPlayer\TV
overwrite = 1
pid = b01b45zh
subdir = 1
subdirformat = nameshort
subtitles = 1
thumb = 1
verbose = 1
vlc = .\VLC\vlc-1.1.11\vlc.exe
whitespace = 1
INFO: Search args: '.*'
INFO: Will try prog types: tv
INFO: Got 901 file cache entries for tv
INFO Trying to stream pid using type tv
INFO: pid found in cache
Matches:
329:Horizon - 2011-2012: 7. Playing God, Audio Described, Audio
Described,Factual,Science Nature,Science Technology,Sign Zone,TV,
audiodescribed,signed
INFO: 1 Matching Programmes
INFO: Getting page http://feeds.bbc.co.uk/iplayer/episode/b01b45zh
INFO: Getting page http://www.bbc.co.uk/programmes/b01b45zh.rdf
http://www.bbc.co.uk/iplayer/playlist/b01b45zh
INFO: iPlayer metadata URL = http://www.bbc.co.uk/iplayer/playlist/b01b45zh
INFO: Getting page http://www.bbc.co.uk/iplayer/playlist/b01b45zh
WARNING: No programmes are available for this pid
ERROR: Could not get version pid metadata
ERROR: Could not get programme metadata
C:\Program Files (x86)\get_iplayer
___
get_iplayer mailing list
get_iplayer@lists.infradead.org
http://lists.infradead.org/mailman/listinfo/get_iplayer
Re: Signed programmes not downloading
On 23/02/2012 14:13, dinkypumpkin wrote: On 23/02/2012 13:38, Rob Dixon wrote: If I use, for instance get_iplayer --pid b01b45zh -g to retrieve the Horizon programme 2011-2012: 7. Playing God, it correctly shows me the info line and then says WARNING: No programmes are available for this pid This is because it is pulling the XML metadata from http://www.bbc.co.uk/iplayer/playlist/b01b45zh which has a noItems reason=/ element instead of from http://www.bbc.co.uk/iplayer/playlist/b01b45zh/sign which is valid for signed programmes. Thanks for the info. Your problem has nothing to do with the playlist XML. You need to specify that you want the signed version by adding --versions signed to the command line. See the man page or --longhelp output. get_iplayer only attempts to download the default version unless you specify otherwise. The 'noItems reason=/' is correct in this case since there is no default version of the programme available. This is true for programmes which are, e.g., only broadcast in the Sign Zone and are thus only available in signed and/or audiodescribed versions. OK, but it seems counterintuitive that if I enter get_iplayer Horizon without specifying any specific version, I get 328:Horizon - 2009-2010: 4. Who's Afraid of a Big Black Hole?, BBC Two, Audio Described,Factual,Science Nature,Science Technology,TV, default,audiodescribed 329:Horizon - 2011-2012: 7. Playing God, Audio Described, Audio Described,Factual,Science Nature,Science Technology,Sign Zone,TV, audiodescribed,signed but then I use get_iplayer 329 -g and it tells me WARNING: No programmes are available for this pid So I have to notice that the listing is of a signed version and say so when I ask for the download, when get_iplayer knows the version is has displayed is a signed one all along! The fix I made was just to modify the URL if the programme selected from the match list happened to be signed. Rob ___ get_iplayer mailing list get_iplayer@lists.infradead.org http://lists.infradead.org/mailman/listinfo/get_iplayer
Fwd: Re: For discussion - signed-only programmes displayed in match list won't download without explicit version
From: Thomas Willson thomas.will...@me.com Forwarded from a private message. Original Message Subject: Re: For discussion - signed-only programmes displayed in match list won't download without explicit version Date: Thu, 23 Feb 2012 10:49:01 -0800 To: Rob Dixon rob.di...@gmx.com ___ get_iplayer mailing list get_iplayer@lists.infradead.org http://lists.infradead.org/mailman/listinfo/get_iplayer I think it would be useful if rather than No programmed are available it said that the programme was only available in signed and/or audiodescribed versions. ___ get_iplayer mailing list get_iplayer@lists.infradead.org http://lists.infradead.org/mailman/listinfo/get_iplayer
--fields option not working as expected
Hi all I wonder if someone can shed some light on whether this is a bug or I am simply misunderstanding the documentation? If I use something like get_iplayer Panorama the programme is listed correctly. It also works fine if I say get_iplayer Panorama --fields name or get_iplayer Panorama --fields desc but if I use any other field that, according to the --info output, contains the string Panorama (such as descshort, nameshort, title etc.) no programmes are found. I would appreciate any help with this. Rob ___ get_iplayer mailing list get_iplayer@lists.infradead.org http://lists.infradead.org/mailman/listinfo/get_iplayer
