Re: releaseyear metadata get_iplayer extracts for Films
On 06/03/2024 18:49, David wrote: I am using get_iplayer v3.35 to extract metadata for Films and have a question about how its populating releaseyear. Using the following examples:- get_iplayer --metadata-only pid=m001jwmx See https://www.bbc.co.uk/programmes/m001jwmx get_iplayer --metadata-only pid=b00748sh See https://www.bbc.co.uk/programmes/b00748sh m001jwmx, The Beach, returns releaseyear as 2023, whereas I'm expecting 2000. That was the year it was first broadcast by the BBC, as explained below. b00748sh. The French Connection, returns releaseyear as 2006, as expected. Eh? Surely this film is way older than that? ISTR first seeing it in the 70s? Let's see what IMDB says, yes, thought so, 1971. https://www.imdb.com/title/tt0067116/ I note that the release notes for 3.32 state, "Added a substitution parameter, which is the year a programme was originally released, if available - otherwise set to . The two items are often the same for TV and radio episodes, but may be different for films and archive programmes, e.g., Radio 4 Extra shows." Which partly explains the above. Unfortunately neither of my examples is currently listed in the iPlayer schedules on so I am unable to confirm via the website if the Beach does not the original release year (so its extracting ), but all my spot checks of current films on the iPlayer website have the orginal release date shown, so it would be surprising if the Beach did not have it, which makes me wonder if there is some other reason why get_iplayer cannot return it? Can anyone advise? As above, use the form ... https://www.bbc.co.uk/programmes/ ... to find a page for a programme that remains accessible even after it has lapsed from iPlayer. ___ get_iplayer mailing list get_iplayer@lists.infradead.org http://lists.infradead.org/mailman/listinfo/get_iplayer
Re: End of get_iplayer is nigh?
On 13/02/2024 18:48, David Woodhouse wrote: On Tue, 2024-02-13 at 18:13 +, Jonathan Larmour wrote: This BBC News article has appeared today: https://www.bbc.co.uk/news/technology-68283165 -=-=-=-=-=-=-=-=-=- The BBC's iPlayer streaming service is to end downloads for users who watch on desktop or laptop computers. Programmes will still be available to download on tablets and phones via the mobile iPlayer app. Currently viewers on PCs and Macs can save programmes via the iPlayer Downloads app, but that will be closed. The changes were "due to the low number of people using it and the cost required to keep it going" the BBC said. "This does not affect downloads on the BBC iPlayer mobile or tablet apps and viewers can continue to stream programmes on BBC iPlayer on their PCs and Macs," a spokesperson added. The BBC has published a timeline of the planned changes: 2 February - new downloads of the BBC iPlayer Downloads app end 11 March - downloading programmes from the web will end. Users will still be able to watch any existing downloads until 8 April 8 April - the BBC iPlayer Downloads app will be closed My understanding is that get_iplayer works by scraping the BBC iplayer web frontend for the download information. So does this mean that the BBC will finally close the last available method for letting get_iplayer work? Hm? My reading of that is just that they're just going to stop building the native applications for Windows and MacOS, which they believe were the only way to download programmes on those platforms. The web site will still work for streaming (and scraping), won't it? So unless they use a different CDN for the PC/Mac downloads, and that's the *only* CDN that get_iplayer knows how to use, I'm not sure we care? Reading what happens on 11th March more closely, I suppose it depends on whether GiP uses the download information from the iPlayer site, or the streaming information. If the former, at best it will need updating to use the latter instead, supposing that is possible, whereas if it already uses the latter nothing will change. Does anyone here happen to know which type of data GiP scrapes? ___ get_iplayer mailing list get_iplayer@lists.infradead.org http://lists.infradead.org/mailman/listinfo/get_iplayer
Re: m001vkll puzzle
On 21/01/2024 14:36, Jim web wrote: In article , MacFH - C E Macfarlane - News wrote: Not sure where you got the pid m001vxvk from Used gip to give me the info on the pid. That showed that the 'editorial' version had a different pid as per above. Ah! Didn't notice that. (1) BTW I checked and I already have a number of AV files from iPlayer that are around 7GB or more. So EXT4 still seems fine to me. 8-> No need for 'Nice Try FS' or Fat. Yes, I replied to James Robinson correcting him as follows, but forgot to "Reply to all", so originally only he saw it: On 20/01/2024 16:03, James Robinson wrote: > > You need NTFS for it to work for bigger files than 4 GB No he doesn't! As he has already stated, he uses Linux which has a choice of different possible file systems, and he is only using any form of FAT for the boot partition, which in Linux is commonly only a few GB containing boot files; for the main OS partitions most probably he's using ext4, which is the default for most modern Linux distros that I've tried. Ext4 can handle large files no problem at all: https://en.wikipedia.org/wiki/Ext4#Features ___ get_iplayer mailing list get_iplayer@lists.infradead.org http://lists.infradead.org/mailman/listinfo/get_iplayer
Re: m001vkll puzzle
On 21/01/2024 11:51, Jim web wrote: Question: Should simply giving the pid as m001vxvk rather than m001vkll cause gip to get the full-length version? Or is that not sufficient? As yet I've always used the pid of the webpage address for an item. Not sure where you got the pid m001vxvk from, but anyway ... https://www.bbc.co.uk/programmes/m001vxvk ... redirects automatically [probably a 301 or 302] to ... https://www.bbc.co.uk/programmes/m001vkll ... so no difference should be expected, but I thought I'd try it anyway: perl \get_iplayer.pl --profile-dir= --pid m001vxvk -g ... results in ... get_iplayer v3.30, Copyright (C) 2008-2010 Phil Lewis This program comes with ABSOLUTELY NO WARRANTY; for details use --warranty. This is free software, and you are welcome to redistribute it under certain conditions; use --conditions for details. WARNING: Could not determine PID type (m001vxvk). Trying to record PID directly. Episodes: get_iplayer - m001vxvk, BBC iPlayer, m001vxvk INFO: 1 total programmes WARNING: PID m001vxvk does not refer to an iPlayer programme episode or clip. Download may fail and metadata may be inac curate. WARNING: No programmes are available for this PID with version(s): default However, I can confirm that, as suggested by 'iz', adding ... --versions=editorial ... to the command line does download the full programme. I now have: Select Committees Horizon IT Scandal Inquiry.mp4, 6.55GB, 3:9:23 long, 1280x720x50 I also now wonder: Are BBC Parliament (and News) Channel items available a 'genuine' HD? Or is that simply causing a transcode upwards with no improvement, just more data to shovel? It says fhd under --info, so yes to fhd, but I've no idea whether it's upscaled or not, you'd have to ask your pals at the Beeb. Anyway, why waste disk space for a news item where quality doesn't really matter? It's not as though it's a wildlife documentary. I've assumed that BBC Parliament/News was simple 'SD' formats, because I only use DVB-T2 for broadcast. But is this wrong? If so, knowing HD is available is useful should it be preferred for some specific content reason. I didn't specify the quality on my test download, if I had it would have been just SD because that's all the content merits, but again you'd need to use the --info switch on the particular programme of interest to see what it is available as. ___ get_iplayer mailing list get_iplayer@lists.infradead.org http://lists.infradead.org/mailman/listinfo/get_iplayer
Re: m001vkll puzzle
On 20/01/2024 17:35, Jim web wrote: In article , MacFH - C E Macfarlane - News wrote: oad it as a test, and have just noticed that it finished around 1330hrs. It downloaded successfully as "Select Committees Horizon IT Scandal Inquiry.mp4" 3.09GB, 1:33:18 long, 1280x720x50 and random seeking within the file seems to play back successfully. The command given was: perl \get_iplayer.pl --profile-dir= --pid m001vkll -g Erm, 1h33m is the first half. The webpage says the full programme is just over 3 hours long. And if you watch it, some of what the page says is covered seems awol. What I go is also a tad over 3GB, both times I tried. Playing either file is fine ... for what it contains. Just that the following section of the sitting seems not to be present. Sorry, there was such a break between setting the test download going and my noticing that it had finished that I must have forgotten the times involved. I should have checked against your OP before posting, but didn't, for which, apologies. It does seem to be a problem at the source, doesn't it? ISTR that there used to be some webpage where you can report specific iPlayer problems like this, but all I can find now are: The usual iPlayer FAQs for the technologically challenged covering problems at the user end and don't seem to acknowledge the possibility of problems their end and provide an option for reporting them, though there is a "Live Chat" option on an overlay mid-right: https://www.bbc.co.uk/iplayer/help On the web page that you linked for the programme itself, there are two possible links, of which the best is probably the "Contact us" link in the BBC Parliament logo bottom right, which leads here: http://news.bbc.co.uk/democracylive/hi/bbc_parliament/newsid_3005000/3005343.stm There's another generic "Contact the BBC" in the footer, but I think I'd probably try the one above first, as from experience I know that this one leads into an endless maze of FAQs from which it is difficult to escape to anywhere that allows you to meaningfully contact a real human being. https://www.bbc.co.uk/contact ___ get_iplayer mailing list get_iplayer@lists.infradead.org http://lists.infradead.org/mailman/listinfo/get_iplayer
Re: m001vkll puzzle
On 20/01/2024 11:16, Jim web wrote: Puzzled by this item for the following reasons: I watched the broadcast on the BBC Parliament (DVB-T2) channel and that ended before the 'second half' of the panel sitting. However I downloaded a copy using gip on the 16th. This *also* was ended part-way though the sitting. So I checked the webpage and that states the duration is over 3 hours. Yet what I got was 1h 33m long. Webpage is at https://www.bbc.co.uk/programmes/m001vkll This morning I tried again in case they'd changed this. The result gave me a *different* filename for the same PID, and again despight the webpage indicating it was the full sitting of the committee, only the first 1h 33m. Puzzled by both the truncation differering from what the webpage claims, and the change of file name. Am I doing something wrong? Not seen this effect before in years of using gip for many items. Looks like an initial error at source which has now been corrected. After reading your post around lunch-time, I set it to download it as a test, and have just noticed that it finished around 1330hrs. It downloaded successfully as "Select Committees Horizon IT Scandal Inquiry.mp4" 3.09GB, 1:33:18 long, 1280x720x50 and random seeking within the file seems to play back successfully. The command given was: perl \get_iplayer.pl --profile-dir= --pid m001vkll -g ___ get_iplayer mailing list get_iplayer@lists.infradead.org http://lists.infradead.org/mailman/listinfo/get_iplayer
Re: Is there an issue with current Shakespeare episodes
On 31/10/2023 01:34, MacFH - C E Macfarlane - News wrote: On 30/10/2023 19:49, Budge wrote: I was able to retrieve my old options file from an older installation but it was well out of date so have rebuilt my prefs and now have:- refreshexcludegroups = local tvmode = fhd,hd,sd,web,mobile,default radiomode = high,std,med,low,default refreshexclude = CBBC,CBeebies,Radio 2,Radio,1 For an options file, I don't think the '=' characters need to be there, though I don't know if having them there actually does any harm, so I think this should probably be (putting the channels in alpha order for neatness' sake): refreshexclude CBBC,CBeebies,BBC Radio 1,BBC Radio 2 If that doesn't work, you could also try using: exclude-channel CBBC,CBeebies,BBC Radio 1,BBC Radio 2 Sorry, no hyphen if editing options directly with a text editor ... excludechannel CBBC,CBeebies,BBC Radio 1,BBC Radio 2 ... or else ... GiP --exclude-channel "CBBC,CBeebies,BBC Radio 1,BBC Radio 2" --prefs-add Failing that, play around with the options listed under: --helplong ___ get_iplayer mailing list get_iplayer@lists.infradead.org http://lists.infradead.org/mailman/listinfo/get_iplayer
Re: Is there an issue with current Shakespeare episodes
On 30/10/2023 19:49, Budge wrote: I was able to retrieve my old options file from an older installation but it was well out of date so have rebuilt my prefs and now have:- refreshexcludegroups = local tvmode = fhd,hd,sd,web,mobile,default radiomode = high,std,med,low,default refreshexclude = CBBC,CBeebies,Radio 2,Radio,1 For an options file, I don't think the '=' characters need to be there, though I don't know if having them there actually does any harm, so I think this should probably be (putting the channels in alpha order for neatness' sake): refreshexclude CBBC,CBeebies,BBC Radio 1,BBC Radio 2 If that doesn't work, you could also try using: exclude-channel CBBC,CBeebies,BBC Radio 1,BBC Radio 2 Failing that, play around with the options listed under: --helplong type = tv,radio atomicparsley = /usr/bin/AtomicParsley output = /home/alastair/Downloads/BBC_GiP_Downloads refreshinclude = Radio 3,Radio 4 ___ get_iplayer mailing list get_iplayer@lists.infradead.org http://lists.infradead.org/mailman/listinfo/get_iplayer
Re: Is there an issue with current Shakespeare episodes
On 30/10/2023 19:49, Budge wrote: This doesn't work and my pvr list which includes "Beck" the TV programme also downloads several radio programmes with names which start with Beck but are from radio stations I didn't want ie:- 32522: radio, Becky Measures - 01/10/2023, BBC Radio Sheffield, p0gd3ch9 36658: radio, Rob Beckett - El Loco, BBC Radio 2, m001qv02 36659: radio, Rob Beckett - Pranks, cranks, and a joke for the Yanks, BBC Radio 2, m001r0ds 36660: radio, Rob Beckett - Richard Osman sits in, BBC Radio 2, m001r91r 36661: radio, Rob Beckett - Richard Osman sits in, BBC Radio 2, m001rgfc 36662: radio, Rob Beckett - Richard Osman sits in, BBC Radio 2, m001rp9c INFO: 6 matching programmes How may I prevent this which didn't happen previously please? You could try ... \bBeck\b ... which should ensure that the PVR search only find items where Beck is an entire word, or possibly ... ^Beck$ ... which should find items where the entire field consists only of the word 'Beck'. ___ get_iplayer mailing list get_iplayer@lists.infradead.org http://lists.infradead.org/mailman/listinfo/get_iplayer
Re: Overwriting lower quality files
On 01/10/2023 21:31, MrBrunes wrote: For encoding rates I appreciate the theory with historical programmes but I've found in practice that there are noticeably fewer blocky video artefacts with dashfhd1 vs SD. It depends very much on the type of SD. Some more recent encodings are using XSD as opposed to SD, and they're awful - in wildlife programmes rivers flow stop-start, etc - but the older SD encodings to which I was referring were fine. It also seems to depend on who does the encoding, some occasional individual programmes were done really badly, and for them any re-encoding, even just again as SD, is likely to be an improvement, and that's probably what you're seeing with HD or FHD. Comparing audio, MediaInfo says: hlshd1AAC LC SBR96kps 48kHz dashfhd1AAC LC128kbps 48kHz i.e. there is a difference with HD encodings, and I'd assume that given a lossy encoder then a higher bitrate is to be preferred. I suspect the 96kps is probably a one-off error. For some time now, the BBC have been using 128kbps for everything (except possibly xsd, as I never download those I wouldn't know). ISTR that there was a time in the past when they tried higher audio bitrates for HD, but people complained that their equipment couldn't play them back, so they lowered them back to 128. ___ get_iplayer mailing list get_iplayer@lists.infradead.org http://lists.infradead.org/mailman/listinfo/get_iplayer
Re: Overwriting lower quality files
On 30/09/2023 12:05, MrBrunes wrote: I've just realised that some of my historical downloads of TOTP are in SD or non-50fps HD but the download history doesn't seem to note the quality, so I need to force download them again. Since new programmes are currently made available each week (for 30d) I thought I could add "force 1" to the PVR search for that programme, but then this will obvs download files that are already in 50fps. Also it will keep downloading files each time they are made available. I thought of deleting all the TOTP lines in download_history as that at least would prevent them from being downloaded again subsequently, but I don't know if this is an easy thing to do (can't see if my text editor can do this (Notepad++). Is there a better, more efficient method of doing this? I've refrained from replying before because I thought you might not welcome my advice, which is simply: don't waste your time! Remember that ... As far as video resolution goes, TOTP2 dates from analogue days, which IMS at its best was roughly equivalent to the 720 x 576 of a DVD, but often when rebroadcast digitally was worse, for example ITV broadcast at 544 x 576 for a long time, and I have a series of programmes about Stonehenge recorded, IMS originally onto VHS, variously from UK TV and Ch 5 for which the resolution width is often actually less than the height, though whether that's down to the original broadcast or the VHS I can not now recall. Currently SD downloads as 960 x 540 & HD as 1080 x 720, so there's really little to be gained by HD over SD given the source material is not likely to be much if at all better than the former. Secondly, as far as the audio resolution is concerned - and call me old-fashioned if you must, but I thought the most important thing about music is, well, the music, not the video - both SD & HD have only 128k stereo @ 48k, so there can be no improvement there, either. However, if you insist on allowing the devil to make work for idle hands, I will point out that you don't need a special program to sort your download history, merely a spreadsheet. Depending in which flavour of Office that you use, import the file as text specifying the vertical bar '|' as the field separator character, and perhaps also specifying the duration to be a numeric field and everything else as text. That will enable you to sort by column within column, etc. ___ get_iplayer mailing list get_iplayer@lists.infradead.org http://lists.infradead.org/mailman/listinfo/get_iplayer
Re: Deleting One Off / Single Entry PVR Searches?
On 07/09/2023 19:09, Peter Kok wrote: Is there a command line that would enable deletion / removal of one off / single entry PVR searches? For instance, The Banksy Story - Omnibus 2, BBC Radio 4, m001p237, isn't available (never was), but continues to be part of the PVR Scheduler listing / programmes (as unfulfilled) in my instance. Run GetIPlayer --helplong and look for the --pvr-del option. ___ get_iplayer mailing list get_iplayer@lists.infradead.org http://lists.infradead.org/mailman/listinfo/get_iplayer
Re: Programmes over 30 days old - incorrect warning
On 28/06/2023 23:11, fred.d wrote: Recently (last couple of months) I've been receiving the warning message "You have programmes over 30 days old that should be deleted." As I've changed my download directory a couple of times over the last year I suspected that I'd just forgotten one somewhere. However I've gone looking and can't find anything. I thought that using the suggested method of finding them "... --history ...720..." would help but it simply lists about 4400 of the 5400 items that I've downloaded over the years. ...so I went into the download history file which does show the download directory for each file. I then tried to cross reference the error list of about 4400 with this but of the samples I've looked at so far (about 50) none of the downloaded files exist. Any ideas why I would be getting the warning? Any suggestions for further investigation or fix? It's something I can practically ignore, but I'd like to know why... Basically, GiP used, and apparently still does, check for downloaded programmes which are older than, I think, 30 days, but you could turn this off via a command-line option, most probably, it was ... --nopurge ... or perhaps ... --no-purge ... but now ... --help-long ... no longer displays this option. However, despite this, the option still works if placed in your preferences file. Append the line ... nopurge 1 ... in your GiP options file, and it should kill the message. ___ get_iplayer mailing list get_iplayer@lists.infradead.org http://lists.infradead.org/mailman/listinfo/get_iplayer
Re: Some questions on PVR
On 12/05/2023 23:34, Kevin Lynch wrote: On Fri, 12 May 2023 at 19:17, MacFH - C E Macfarlane - News wrote: Amid a lack of current programmes to test with, that was just a guess on my part; it could well be that your suggestion turns out better than mine. C:\Users\kevin>get_iplayer --info --pid b09k1f9h All that you say is true, but the above is not one of the programmes the OP was asking about, none of which appear to be available ATM, hence my saying that I couldn't verify anything for those programmes. ___ get_iplayer mailing list get_iplayer@lists.infradead.org http://lists.infradead.org/mailman/listinfo/get_iplayer
Re: Some questions on PVR
On 12/05/2023 15:52, Kevin Lynch wrote: Further to my previous email - I missed C E Macfarlane's clarification and waded in with my workaround. MacFH - C E Macfarlane - News news at macfh.co.uk Fri May 12 01:29:47 PDT 2023 As ATM running GiP currently finds no programmes with "In Our Time" or "Melvyn Bragg", I can't be of any definite help, but I suspect that perhaps ... --type podcast ... should be ... --versions podcast Amid a lack of current programmes to test with, that was just a guess on my part; it could well be that your suggestion turns out better than mine. ___ get_iplayer mailing list get_iplayer@lists.infradead.org http://lists.infradead.org/mailman/listinfo/get_iplayer
Re: Some questions on PVR
On 12/05/2023 09:09, Budge wrote: As I start anew with GiP I have now been able to resurrect my old history and pvr list which had been dormant on a backup for years and append my recent downloads. So far so good although the pvr list needs editing! I have a couple of questions:- In running my old pvr list the system stopped at an entry in which I had specified "type podcast." Since I have not seen any reference to podcasts so far in the longhelp page does this mean that podcasts no longer work or is it that I have to use a different technique now? When the pvr threw up this:- INFO: PVR Run: 'In_Our_Time_With_Melvyn_Bragg' ERROR: Invalid type 'podcast' specified. Valid types are: tv,radio and then stopped. Is it possible for the system to skip and move on rather than exiting on Error? Still working on this so forgive me if questions are naive. As ATM running GiP currently finds no programmes with "In Our Time" or "Melvyn Bragg", I can't be of any definite help, but I suspect that perhaps ... --type podcast ... should be ... --versions podcast ___ get_iplayer mailing list get_iplayer@lists.infradead.org http://lists.infradead.org/mailman/listinfo/get_iplayer
Re: PROBLEM DOWNLOADING BBC RADIO PROGRAMMES
On 30/03/2023 17:23, GRAHAM Holliday wrote: get_iplayer --pid=m001jtc0 --type=radio , Downloads here alright with get_iplayer v3.30, but note that there's a trailing comma in your command line, and you don't usually need equals signs, but I don't think either of those would be showstoppers. ___ get_iplayer mailing list get_iplayer@lists.infradead.org http://lists.infradead.org/mailman/listinfo/get_iplayer
Re: OT yt-dlp and Python snag
On 28/03/2023 15:51, Jim web wrote: Sorry to hear about your wife, commiserations to you both. In article , MacFH - C E Macfarlane - News wrote: Might as well be sure, so what happens when you type: python --version If that comes up with 3.7 as desired, what do you get for: pip --help It gives me Python 2.7.17 However if I look in usr/lib/ I can see directories for Python 2.7, 3, 3.6, 3.7, and 3.8. Different versions of Java, Perl, and Python can be a right royal PITA - seemingly endless updates seem to require anything based on them that you are using needing programs to be rewritten and/or recompiled. If you have a genuine need for different versions as opposed to having arrived with multiple versions merely by happenstance, one possible workaround is to have some means of determining the default version for a given shell instance. For example, in Unbuntu 18, I get ... # which python /usr/bin/python # ls -al /usr/bin/python /usr/bin/python->python2.7 ... and ... # ls -al /usr/bin/python* ... is also quite instructive, but would be overkill to transcribe in its entirety here! This gives the possibility of a given shell instance pointing that link to whichever version of python that it needs, either directly or via an environment variable, as it launches ... # ln -s -f /usr/bin/python2.7 /usr/bin/python ... or ... # export PYTH_VER=2.7 # ln -s -f /usr/bin/python${PYTH_VER} /usr/bin/python ... however, although I have seen it done this way, I DON'T RECOMMEND IT, because if you have two shells running simultaneously requiring different versions of python [the rest of this sentence is left as an exercise to the programmer]! Better is to use a different alias within each shell ... # python --version Python 2.7.17 # alias python=/usr/bin/python3.6 # python --version Python 3.6.9 If this works, fine, but if, say, more than one change to the environment is needed, perhaps because the PATH or LIB variables need to include the directories for a different versions of Python or some such, then use an environment variable in all the settings so that between different shells you have to change only the value of that: # python --version Python 3.6.9 # export PYTH_VER=2.7 # alias python=/usr/bin/python${PYTH_VER} # python --version Python 2.7.17 HTHs ___ get_iplayer mailing list get_iplayer@lists.infradead.org http://lists.infradead.org/mailman/listinfo/get_iplayer
Re: modes=good gone?
On 28/03/2023 15:56, Chris Brady wrote: Am trying to download tv using modes=good for low res. but adequate watchable quality However this is not now working and I am getting the default of HD with 2GB file sizes I only want files about 300KB in lo res What do I use now? Thank you. Mode settings have been replaced by quality settings, as follows: --quality ,,... TV and radio recording quality preference. See --tv-quality and --radio-quality for available values and defaults. Default: default for programme type. --radio-quality ,,... Radio recording quality preference (overrides --quality): high,std,med,low,default (Aliases: 320k,128k,96k,48k). Comma-delimited list in descending order of preference. Default: high,std,med,low. --tv-lower-bitrate, --tvlbr Prefer 25fps (or lower-bitrate 50fps) streams for TV programmes if available. --tv-quality ,,... TV recording quality preference (overrides --quality): fhd,hd,sd,web,mobile,default (Aliases: 1080p,720p,540p,396p,288p). Comma-delimited list in descending order of preference. Default: hd,sd,web,mobile For further help, use the --helplong switch. ___ get_iplayer mailing list get_iplayer@lists.infradead.org http://lists.infradead.org/mailman/listinfo/get_iplayer
Re: Fwd: Re: output format
On 28/03/2023 15:43, MacFH - C E Macfarlane - News wrote: Tch! Both Fred and then myself forgot to reply to all ... Forwarded Message Subject: Re: output format Date: Tue, 28 Mar 2023 01:13:58 +0100 From: MacFH - C E Macfarlane - News To: fred.d On 27/03/2023 18:54, fred.d wrote: On 27/03/2023 18:22, MacFH - C E Macfarlane - News wrote: On 27/03/2023 17:56, fred.d wrote: Recently started using gip to download sounds and audio files. Unfortunately I've got my prefs set to force output to mpeg .TS. Result is my downloaded audio is being converted to .ts files unless I override the command line with --raw when downloading audio :-( What command-line option are you using to set this? options config file: mpegts 1 Equivalent to ... --mpeg-ts Ensure raw audio and video files are re-muxed into MPEG-TS file regardless of stream format. Overrides --raw. Does anyone know a way to configure gip Video output format separately from Audio output format? I've had a quick look at all the options I have docs on but I can't see anything obvious. Difficult to say without knowing how you set the preference in the first place. I think you have two options. The following examples use "Bells On Sunday" (radio) and weather forecasts (TV) as being conveniently short programmes with correspondingly small download sizes to test with. Also, make sure you read the notes below before trying anything out: 1. Leave the option --mpeg-ts as is, but add an additional post-download option for audio files using --command-radio to convert the download to m4a (or any other audio format of your choice). The downside of this is that it may sometimes mean converting audio files twice, depending on the format of the original download. Example: --command-radio "ffmpeg -i '' -c:a copy '.m4a' && del '" --type radio --pid m001jkbm --raw -g Not sure how this happened when cutting & pasting but every example is missing a closing single quote just before the closing double quote, as follows: del ''" [<-here] So the above should have read: --command-radio "ffmpeg -i '' -c:a copy '.m4a' && del ''" --type radio --pid m001jkbm --raw -g 2. Remove that option altogether and use the --raw option instead, and give different --command-radio and --command-tv options to get the two different types into the respective end formats required. This should ensure that each type only gets converted once. Examples: --command-radio "ffmpeg -i '' -c:a copy '.m4a' && del '" --type radio --pid m001jkbm --raw -g --command-tv "ffmpeg -i '' -c:a copy -c:v copy '.mp4' & del '" --type tv --tv-quality sd --pid m001kjpf --raw -g As above, should have read: --command-radio "ffmpeg -i '' -c:a copy '.m4a' && del ''" --type radio --pid m001jkbm --raw -g --command-tv "ffmpeg -i '' -c:a copy -c:v copy '.mp4' & del ''" --type tv --tv-quality sd --pid m001kjpf --raw -g Sorry about that. IMPORTANT! Notes: Firstly, note that unless you want to keep the originally downloaded file as well as the converted file, you have to include a command to delete it, the double ampersand means that the del command only happens if the ffmpeg command didn't produce an error code when making the conversion. The command is for a Windows set up, you'd use rm instead of DEL on a Linux system. Secondly, the above FFMPEG commands are greatly simplified from the original commands that GiP would have fed to FFMPEG without the --mpeg-ts or --raw options being specified, which may be why the video one above corresponding to 2 below gave an avalanche of 'Invalid DTS' messages that don't occur when you let GiP do the job. As the weather video played back alright, I didn't bother to investigate that further. 1) ffmpeg -loglevel fatal -stats -y -i "\Bells On Sunday - Cathedral Church Of St Mary The Virgin With St Paul In Blackburn Lancashire.hls.ts" "-c:v" copy "-c:a" copy "-bsf:a" aac_adtstoasc -movflags faststart "\Bells On Sunday - Cathedral Church Of St Mary The Virgin With St Paul In Blackburn Lancashire.partial.m4a" 2) ffmpeg -loglevel fatal -stats -y -i "\Weather For The Week Ahead - 2023-03-27.hls.ts" "-c:v" copy "-c:a" copy "-bsf:a" aac_adtstoasc -movflags faststart "\Weather For The Week Ahead - 2023-03-27.partial.mp4" Thirdly, the available substitution parameters to use in the filenames are here, but not all will have values in all circumstances, for example was empty when I tried it https://github.com/get-iplayer/get_iplayer/wiki/subparams Lastly, I know that once upon another life in some obscure case I tried to use a post-download command before, but struggled with it for hours, and now can't remember whether actually I ever even go
Fwd: Re: output format
Tch! Both Fred and then myself forgot to reply to all ... Forwarded Message Subject: Re: output format Date: Tue, 28 Mar 2023 01:13:58 +0100 From: MacFH - C E Macfarlane - News To: fred.d On 27/03/2023 18:54, fred.d wrote: On 27/03/2023 18:22, MacFH - C E Macfarlane - News wrote: On 27/03/2023 17:56, fred.d wrote: Recently started using gip to download sounds and audio files. Unfortunately I've got my prefs set to force output to mpeg .TS. Result is my downloaded audio is being converted to .ts files unless I override the command line with --raw when downloading audio :-( What command-line option are you using to set this? options config file: mpegts 1 Equivalent to ... --mpeg-ts Ensure raw audio and video files are re-muxed into MPEG-TS file regardless of stream format. Overrides --raw. Does anyone know a way to configure gip Video output format separately from Audio output format? I've had a quick look at all the options I have docs on but I can't see anything obvious. Difficult to say without knowing how you set the preference in the first place. I think you have two options. The following examples use "Bells On Sunday" (radio) and weather forecasts (TV) as being conveniently short programmes with correspondingly small download sizes to test with. Also, make sure you read the notes below before trying anything out: 1. Leave the option --mpeg-ts as is, but add an additional post-download option for audio files using --command-radio to convert the download to m4a (or any other audio format of your choice). The downside of this is that it may sometimes mean converting audio files twice, depending on the format of the original download. Example: --command-radio "ffmpeg -i '' -c:a copy '.m4a' && del '" --type radio --pid m001jkbm --raw -g 2. Remove that option altogether and use the --raw option instead, and give different --command-radio and --command-tv options to get the two different types into the respective end formats required. This should ensure that each type only gets converted once. Examples: --command-radio "ffmpeg -i '' -c:a copy '.m4a' && del '" --type radio --pid m001jkbm --raw -g --command-tv "ffmpeg -i '' -c:a copy -c:v copy '.mp4' & del '" --type tv --tv-quality sd --pid m001kjpf --raw -g IMPORTANT! Notes: Firstly, note that unless you want to keep the originally downloaded file as well as the converted file, you have to include a command to delete it, the double ampersand means that the del command only happens if the ffmpeg command didn't produce an error code when making the conversion. The command is for a Windows set up, you'd use rm instead of DEL on a Linux system. Secondly, the above FFMPEG commands are greatly simplified from the original commands that GiP would have fed to FFMPEG without the --mpeg-ts or --raw options being specified, which may be why the video one above corresponding to 2 below gave an avalanche of 'Invalid DTS' messages that don't occur when you let GiP do the job. As the weather video played back alright, I didn't bother to investigate that further. 1) ffmpeg -loglevel fatal -stats -y -i "\Bells On Sunday - Cathedral Church Of St Mary The Virgin With St Paul In Blackburn Lancashire.hls.ts" "-c:v" copy "-c:a" copy "-bsf:a" aac_adtstoasc -movflags faststart "\Bells On Sunday - Cathedral Church Of St Mary The Virgin With St Paul In Blackburn Lancashire.partial.m4a" 2) ffmpeg -loglevel fatal -stats -y -i "\Weather For The Week Ahead - 2023-03-27.hls.ts" "-c:v" copy "-c:a" copy "-bsf:a" aac_adtstoasc -movflags faststart "\Weather For The Week Ahead - 2023-03-27.partial.mp4" Thirdly, the available substitution parameters to use in the filenames are here, but not all will have values in all circumstances, for example was empty when I tried it https://github.com/get-iplayer/get_iplayer/wiki/subparams Lastly, I know that once upon another life in some obscure case I tried to use a post-download command before, but struggled with it for hours, and now can't remember whether actually I ever even got it to work! A significant part of the problem was that, as above, you need to put some parameters in quotes, for example filenames with spaces, but they tend to get stripped off by GetIPlayer when it feeds the quoted parameters to the external command. I remember a lot of faffing around with single quotes inside double, and vice versa, trying to get it to work, but above examples do work on my system! ___ get_iplayer mailing list get_iplayer@lists.infradead.org http://lists.infradead.org/mailman/listinfo/get_iplayer
Re: output format
On 27/03/2023 17:56, fred.d wrote: Recently started using gip to download sounds and audio files. Unfortunately I've got my prefs set to force output to mpeg .TS. Result is my downloaded audio is being converted to .ts files unless I override the command line with --raw when downloading audio :-( What command-line option are you using to set this? Does anyone know a way to configure gip Video output format separately from Audio output format? I've had a quick look at all the options I have docs on but I can't see anything obvious. Difficult to say without knowing how you set the preference in the first place. Note: I use .ts for historical reasons for video. I also have a decent .ts editor (TS-DOCTOR) that I like the interface for and it's quick to use and still handles 95% of content wonderfully. So quick, frame accurate, lossless editing with no hassle. I've not found anything that's as easy to find edit points quickly using a keyboard when editing other video formats. Most of them use timelines as they are designed more for assembling than straight editing. To be fair I have only tried free software such as shotcut and openshot so there may be something else out there that's better. If so maybe it's time to change base format to .mkv or mp4. I'm not averse to change, it's just that I need an editor that's as easy and quick to use. Perhaps keep the file as *.ts until you've finished editing it, then convert it to something more mainstream such as *.mp4. The problem with *.mp4 is that it can be very difficult to edit accurately, as each 'packet' of video can be several seconds long, and you can't easily edit within a packet, only at packet boundaries, so keeping it as *.ts until its final version would make sense. Note: I suspect 'packet' is the wrong word there, but I can't remember the correct terminology. Hopefully you understand what I'm trying to say. ___ get_iplayer mailing list get_iplayer@lists.infradead.org http://lists.infradead.org/mailman/listinfo/get_iplayer
Re: OT yt-dlp and Python snag
On 27/03/2023 18:10, MacFH - C E Macfarlane - News wrote: On 27/03/2023 10:44, Jim web wrote: Glad to see you're still alive and kicking. I'd noticed your absence in another place and was a little worried for you. This is OT but I'm hoping some here will be using yt-dlp and can help! I do use yt-dlp occasionally, but it's the Win32 pre-compiled version, so I kept quiet initially hoping that someone else would be able to give you some worthwhile help, but, as the problem doesn't seem to going anywhere, I'll see what I can do ... The version of yt-dlip I've been using has been upped to the current one. This now refuses to work unless I also go to Python 3.7 so I have installed the basics of that... I think. However... Might as well be sure, so what happens when you type: python --version If that comes up with 3.7 as desired, what do you get for: pip --help On Ubuntu 18 I get: Command 'pip' not found, but can be installed with: sudo apt install python-pip Now when I try to run it is fails by saying No module "contextvars". Once pip is installed, try: pip install contextvars Meant to include this: https://docs.python.org/3.7/library/contextvars.html ___ get_iplayer mailing list get_iplayer@lists.infradead.org http://lists.infradead.org/mailman/listinfo/get_iplayer
Re: OT yt-dlp and Python snag
On 27/03/2023 10:44, Jim web wrote: Glad to see you're still alive and kicking. I'd noticed your absence in another place and was a little worried for you. This is OT but I'm hoping some here will be using yt-dlp and can help! I do use yt-dlp occasionally, but it's the Win32 pre-compiled version, so I kept quiet initially hoping that someone else would be able to give you some worthwhile help, but, as the problem doesn't seem to going anywhere, I'll see what I can do ... The version of yt-dlip I've been using has been upped to the current one. This now refuses to work unless I also go to Python 3.7 so I have installed the basics of that... I think. However... Might as well be sure, so what happens when you type: python --version If that comes up with 3.7 as desired, what do you get for: pip --help On Ubuntu 18 I get: Command 'pip' not found, but can be installed with: sudo apt install python-pip Now when I try to run it is fails by saying No module "contextvars". Once pip is installed, try: pip install contextvars ___ get_iplayer mailing list get_iplayer@lists.infradead.org http://lists.infradead.org/mailman/listinfo/get_iplayer
Re: Discrepancy between iplayer & get_iplayer
On 23/03/2023 17:50, Expert Geeks wrote: I'm having an odd issue where downloading the Select Committee of the 'Conduct of Boris Johnson' is a file of 58 minutes regardless of the quality (hd, sd & web tried). The file downloaded is always 670mb (or thereabouts) so the quality seems to be being ignored. In the following ... gipl ... is a DOSKey abbreviation for ... perl \get_iplayer.pl gipl --tv-quality sd --pid m001krfw --info | find "qualit" qualities: editorial: sd,web,mobile qualities: original: sd,web,mobile qualitysizes:editorial: sd=2298MB,web=2295MB,mobile=720MB [estimated sizes] qualitysizes:original: sd=698MB,web=675MB,mobile=212MB [estimated sizes] So there's no hd version, and consequently attempting to download it will have merely loaded the sd version instead. Further, the sd and web versions are almost the same size anyway. The file is also the same regardless of the method, --pid m001krfw or searching by name, whereas the version on the iplayer in the browser is the full 170 minutes. https://www.bbc.co.uk/iplayer/episode/m001krfw/select-committees-conduct-of-boris-johnson-inquiry?page=1 gipl --tv-quality sd --pid m001krfw --info | find "duration" duration:3000 durations: editorial: 10200 durations: original: 3000 10200s = 170m 3000s = 50m So the two different durations are for two different versions, presumably with the default being the shorter one, and consequently you need to specify the editorial version if that's what you want. From a brief test here ... gipl --pid m001krfw --versions editorial -g ... looks like it should do it. You may question the sanity of someone that wants to watch 58 minutes of blather and bluster, let alone 170 minutes.. but I'm curious why the disparity and whether it's possible to get the full version. Indeed, what a waste of 170m! It's Boris Johnson, so, if you can see his mouth moving, you know he's lying! ___ get_iplayer mailing list get_iplayer@lists.infradead.org http://lists.infradead.org/mailman/listinfo/get_iplayer
Re: $opt->{nowarntvlicence} how to set?
On 03/01/2023 23:20, Kevin Lynch wrote: Rebuilding my get_iplayer environment. I don't want the TV Licence warning appearing in my logs. What's the syntax get_iplayer --prefs-add --nowarntvlicence=1 Unknown option: nowarntvlicence The search term 'licence' gets no hits anywhere in the long help output of the v3.30 script. Further, if you search the script for 'nowarntvlicence', you find only two hits in the following section beginning at line 3,722 (email linewrap not in original): if ( $prog->{type} eq "tv" && ! $opt->{nowarntvlicence} ) { $opt->{nowarntvlicence} = 1; main::logger "WARNING: A UK TV licence is required to access BBC iPlayer TV content legally\n"; } What this seems to indicate is that the script author was allowing for some mechanism to exist for not displaying the message, but didn't actually get so far as implementing it fully, otherwise the string would also appear earlier in the script where the command-line parameters and preferences files are read. Thus I guess you'd have to add the missing coding yourself to implement it. ___ get_iplayer mailing list get_iplayer@lists.infradead.org http://lists.infradead.org/mailman/listinfo/get_iplayer
Re: Channel 4 Time Team videos
On 23/06/2022 12:14, Geoff Smith wrote: Non-BBC on demand programmes I play full screen on a spare PC, with an ad-blocker (which only rarely gets detected), and record using the free version of OBS Studio. It works fine on a W10 machine but not W7, but I can't figure why. This version works for me with W7: https://web.archive.org/web/20220509151916/https://cdn-fastly.obsproject.com/downloads/OBS-Studio-27.2.4-Full-Installer-x64.exe ___ get_iplayer mailing list get_iplayer@lists.infradead.org http://lists.infradead.org/mailman/listinfo/get_iplayer
Re: Glastonbury results
On 28/06/2022 17:43, B wrote: I was trying to use the GiP PVR to download all the Glasto programmes but for some reason the search returns fewer results than expected. Namely searching for "glastonbury" as "name" in tv & radio gets 89 hits and that includes some from other years. But https://www.bbc.co.uk/iplayer/episodes/b007r6vx/glastonbury says 142 Episodes Available and if I do that from get_iplayer manually i.e. get_iplayer --pid b007r6vx --pid-recursive --subtitles --metadata --thumbnail --tv-quality=fhd it returns: INFO: 205 total programmes Why the large difference? The same thing tends to happen with Wimbledon and other large events. I suspect that some of the 'extra' programmes are Red Button, iPlayer only, or otherwise outside the remit or the time frame of the programme searching mechanism. I would suggest using the --pid --pid-recursive method instead. ___ get_iplayer mailing list get_iplayer@lists.infradead.org http://lists.infradead.org/mailman/listinfo/get_iplayer
Re: Nottingham Open Tennis - What happened to Day 3?
On 26/06/2022 14:27, Mark Carroll wrote: On 26 Jun 2022, MacFH wrote: Except the tournament was two weeks ago, and the other days are already half-way to their expiry date, so 'soon' is beginning to look like 'never'! 'Never' is in fact correct. I've sometimes had useful feedback or help from the BBC when mentioning this kind of thing to them via the online feedback form stuff, sometimes it's a rights issue but sometimes it's just a correctable slip-up at their end. At least, they might be able to help far better than we: if BBC iPlayer's not showing it, fair chance get-iplayer isn't either! "Hi Mr [snip], Thanks for contacting BBC iPlayer support about Day 3 of the Nottingham tennis. Unfortunately, this cannot be made available on iPlayer due to technical difficulties. We're very sorry for the inconvenience but we have now removed the Coming Soon label from the episode. I wish I had better news for you but thanks for taking the time to let us know. All the best, [snip]" One wonders what the 'technical difficulties' might be, given all the rest of the tournament, presumably created by the same staff using the same equipment, is available. ___ get_iplayer mailing list get_iplayer@lists.infradead.org http://lists.infradead.org/mailman/listinfo/get_iplayer
Re: Nottingham Open Tennis - What happened to Day 3?
On 26/06/2022 11:56, J K.Eason wrote: *From:* MacFH - C E Macfarlane - News *To:* get_iplayer@lists.infradead.org *Date:* Sun, 26 Jun 2022 10:46:00 +0100 Anyone know why Day Three of this year's Nottingham Open is not available? All the others download alright: https://www.bbc.co.uk/programmes/p0cb8p1k "This episode will be available soon" on the web page seems fairly conclusive... Except the tournament was two weeks ago, and the other days are already half-way to their expiry date, so 'soon' is beginning to look like 'never'! ___ get_iplayer mailing list get_iplayer@lists.infradead.org http://lists.infradead.org/mailman/listinfo/get_iplayer
Nottingham Open Tennis - What happened to Day 3?
Anyone know why Day Three of this year's Nottingham Open is not available? All the others download alright: https://www.bbc.co.uk/programmes/p0cb8p1k ___ get_iplayer mailing list get_iplayer@lists.infradead.org http://lists.infradead.org/mailman/listinfo/get_iplayer
Re: '5 Live Science' not being found to download
On 20/04/2022 10:17, MacFH - C E Macfarlane - News wrote: I've also managed to adapt my calling program to allow parameters such as --pid in the lists of search terms, simply by not quoting any search term beginning with '--' before feeding it to GiP, so the one for low-def radio now has a line that reads '--pid p02pc9ny --pid-recursive' to pick up future podcast editions. Normality now restored. Except it's not. I hadn't quite realised the full extent of what was going on. Having a '--pid' parameter in the command-line fed to GiP kills all the other search terms in its command-line, and it searches only for PIDs. I sense another modification to GiP coming on to enable normal searches and PIDs to be used together. ___ get_iplayer mailing list get_iplayer@lists.infradead.org http://lists.infradead.org/mailman/listinfo/get_iplayer
Re: '5 Live Science' not being found to download
On 22/04/2022 16:01, Jim web wrote: In article <5f9d21ff-9029-2096-b4c4-ff35b74f0...@macfh.co.uk>, MacFH - C E Macfarlane - News wrote: * The lists and their intended use are: Full HD TV - A new one similar to the next, which I've just created after discovering here that these downloads are available, so I haven't yet quite decided on absolute criteria to distinguish between the two. HD TV - For David Attenborough and other nature documentaries, films, etc. [snip] I tend to fetch a wider variety of items, so usually go via the schedules. My better half/controller also prefers some things that bore me, and I need to keep those in mind as well. :-) Is there an easy way to see what is fetchable as the "Full HD" though? Not really. If you have a particular programme in mind, then the following would tell you ... Linux: GiP --info | grep -i 'fhd' GiP --pid --info | grep -i 'fhd' Windows (which I know you don't use, but others do): GiP --info | find /i "fhd" GiP --pid --info | find /i "fhd" Notes (as I'm sure you would realise, but others may not): 1) Absence of output means the programme is not Full HD. 2) If the version finds more than one programme, then the above won't tell you which hits any results apply to! 3) The above relies on the string 'fhd' not appearing anywhere in the output except in the lines relating to tv quality. To be more precise would require a slightly more sophisticated approach, but wouldn't be difficult to achieve. For example pipe the output through a search for 'qualities:' before the one for 'fhd'. In general I'd not bother as the usual HD seems Ok to me, but it may be useful for items where image quality is particularly important. Does the "Full HD" have better sound than the now-standard 192k for TV? (The old 320k for TV having sadly been knocked on the head when someone at the BBC noticed it was still going out without them intending it!) Sadly, it's actually even worse than that ... Art That Made Us Beauty Of Maps Gilbert & Sullivan - The Gondoliers Scotland's Sacred Islands ... all 1920x1080x50 but 128kbps,Stereo,48kHz! Logic has not been the BBC's strong point for a good long while, probably since the scrapping of the old R/technical standards department(s), whatever it/they were actually called (never having worked for them I've only heard others' occasional comments on this). ___ get_iplayer mailing list get_iplayer@lists.infradead.org http://lists.infradead.org/mailman/listinfo/get_iplayer
Re: '5 Live Science' not being found to download
On 22/04/2022 12:22, Peter Scott wrote: On 21.04.2022 23.38, MacFH - C E Macfarlane - News wrote: What are the URLs of the listing pages you are using to get the PIDs? I have a python script that shows BBC listings with pids. You can find it here: https://github.com/cmsps Thanks, will take a look. ___ get_iplayer mailing list get_iplayer@lists.infradead.org http://lists.infradead.org/mailman/listinfo/get_iplayer
Re: '5 Live Science' not being found to download
On 22/04/2022 10:41, Jim web wrote: In article , MacFH - C E Macfarlane - News wrote: On 20/04/2022 12:27, Jim web wrote: In article , MacFH - C E Macfarlane - News wrote: I can understand that this might happen if the PIDs are the same, but it's not my experience. '5 Live Science' is the first time I've come up against this. I specify items via pid as per their listings in the daily shedules. R4 items then tend to come as the longer 'podcast' version in terms of content. But having the pid shown on the BBC R4 schedules. However I don't normally look at "!Zounds" so don't know about any items that are podcasts which aren't broadcast. What are the URLs of the listing pages you are using to get the PIDs? Example: Today's R4 page that I'd use is this https://www.bbc.co.uk/schedules/p00fzl7j If I then hover the mouse pointer over an item FireFox shows the address/pid at the bottom left of its window. e.g. For the "Midnight News" I see "m0016hg6". I then give that to gip and it fetches the file. In many cases this then gives me a 'podcast' version - i.e. longer than the broadcast slot and often with a top/tail about podcasts, etc. FWIW I go though the listings and make a text file listing the pids of items I want. I then DND that file onto a simple ROX-Filer app I've written. This then chugs though fetching them as I do something else - e.g. make breakfast. :-) Also did that to fetch the 'RKO story' and the following films this morning. (Listed on BBC4 TV last night.) Whilst I made breakfast. Also means I can fetch before 9am and the data isn't counted towards my monthly data 'cap'. Looking forwards to seeing (almost) "The Thing" again as I've just finished the book "Astounding" about John W. Campbell and his main authors. Thanks for the URLs and explanation. FWIW, I use Digiguide, so don't see PIDs, which is why I enquired about that. As I think I've explained before, I have five lists of search terms*, each of which, in the order below in turn, is read by a self-written multi-purpose Perl script and fed in a call to GiP as a list of search terms. I can also specify extra search terms on the command-line for it, to accommodate anything I see in the schedules that's not already in the lists. I could and used to automate this further, by having it run on an overnight schedule on my old NAS. However, as GiP and my own Perl script evolved, I found that some of the modules needed, particularly for the former, wouldn't install because of the age of the Perl system on it, which I found I couldn't upgrade, and the NAS was seeming increasingly slow compared to the increasing demands being placed upon it. So I've upgraded it to a new one, but haven't got around to putting Perl or GiP on that. Instead I run GiP manually every evening on this PC, by calling my script. * The lists and their intended use are: Full HD TV - A new one similar to the next, which I've just created after discovering here that these downloads are available, so I haven't yet quite decided on absolute criteria to distinguish between the two. HD TV - For David Attenborough and other nature documentaries, films, etc. SD TV - Other documentaries such as The Sky At Night, sports coverage, or anything where the content is highly ephemeral and so not worth the extra download time and space of better resolution. HiDef Radio - For music. Radio - For science reports, other ephemeral content, etc. ___ get_iplayer mailing list get_iplayer@lists.infradead.org http://lists.infradead.org/mailman/listinfo/get_iplayer
Re: '5 Live Science' not being found to download
On 20/04/2022 12:27, Jim web wrote: In article , MacFH - C E Macfarlane - News wrote: I can understand that this might happen if the PIDs are the same, but it's not my experience. '5 Live Science' is the first time I've come up against this. I specify items via pid as per their listings in the daily shedules. R4 items then tend to come as the longer 'podcast' version in terms of content. But having the pid shown on the BBC R4 schedules. However I don't normally look at "!Zounds" so don't know about any items that are podcasts which aren't broadcast. What are the URLs of the listing pages you are using to get the PIDs? ___ get_iplayer mailing list get_iplayer@lists.infradead.org http://lists.infradead.org/mailman/listinfo/get_iplayer
Re: '5 Live Science' not being found to download
On 18/04/2022 14:26, Jim web wrote: I may be missing the point. But for ages now whenever I fetch a radio programme I get the 'podcast' version. I've assumed this was the norm, nowdays. I can understand that this might happen if the PIDs are the same, but it's not my experience. '5 Live Science' is the first time I've come up against this. ___ get_iplayer mailing list get_iplayer@lists.infradead.org http://lists.infradead.org/mailman/listinfo/get_iplayer
Re: '5 Live Science' not being found to download
On 19/04/2022 09:51, Andy Wedge wrote: From: get_iplayer On Behalf Of MacFH - C E Macfarlane - News Sent: 19 April 2022 01:41 You've failed to notice that the podcasts have different PIDs from the episodes previously downloaded, so they'll all download again. I've use the --pid-recursive option with a series pid for multiple podcast series and the individual episodes certainly do not have different pids from those already downloaded. My scheduled GiP runs just download the latest episodes. If you are experiencing episodes being downloaded time and again the I would suggest you either have the --force option on somewhere or your download history is being cleared. No, the podcast series have different pids from the corresponding main downloads, for example ... Original series: b043wvt9 Podcast series: p02pc9ny Most recent three episodes from original series flagged as unavailable: 5 Live Science - Buying Breast Milk Online, BBC Radio 5 live, m00161g8 5 Live Science - Science in Film, BBC Radio 5 live, m001682t 5 Live Science - Hot Cross Puns: Easter Science Q & A, BBC Radio 5 live, m0016jdn Podcast editions which are available: 5 Live Science Podcast - Buying Breast Milk Online, BBC Radio 5 Live, p0bz4ztr 5 Live Science Podcast - Science in Film, BBC Radio 5 Live, p0c06v0k 5 Live Science Podcast - Hot Cross Puns: Easter Science Q & A, BBC Radio 5 Live, p0c1g25k ... and unsurprisingly therefore using '--pid p02pc9ny --pid-recursive' they did indeed all download again, merely for me to delete them. ___ get_iplayer mailing list get_iplayer@lists.infradead.org http://lists.infradead.org/mailman/listinfo/get_iplayer
Re: '5 Live Science' not being found to download
On 19/04/2022 11:03, iz wrote: On 18 Apr 2022, at 15:17, MacFH - C E Macfarlane - News wrote: --type radio --pid p02pc9ny --pid-recursive ... it finds all the previous versions before April this year that I've already downloaded, listened to, and then deleted, and I don't want to waste my bandwith downloading 550 or so programmes that I've already heard. You can use --pid p02pc9ny --pid-recursive --hide --mark-downloaded to add to download history all previous podcast episodes not already downloaded. Use --pid p02pc9ny --pid-recursive --hide on subsequent runs to pick up new episodes. Ah, thank you, I wasn't aware of the '--mark-downloaded' parameter, and did in the end download them all just to delete them. At least I'll know for next time, thanks again. I've also managed to adapt my calling program to allow parameters such as --pid in the lists of search terms, simply by not quoting any search term beginning with '--' before feeding it to GiP, so the one for low-def radio now has a line that reads '--pid p02pc9ny --pid-recursive' to pick up future podcast editions. Normality now restored. ___ get_iplayer mailing list get_iplayer@lists.infradead.org http://lists.infradead.org/mailman/listinfo/get_iplayer
Re: '5 Live Science' not being found to download
On 18/04/2022 19:54, fred.d wrote: > >> On 18 Apr 2022, MacFH wrote: >> >> ... it finds all the previous versions before April this year that >> I've already downloaded, listened to, and then deleted, and I don't >> want to waste my bandwith downloading 550 or so programmes that I've >> already heard. > > On your point about recursive - By default GiP will tell you that > stuff you have downloaded has "already been downloaded" and not > attempt it again (download_history file in your profile directory is a > record of...). So if you have a series or parent PID that's recursive > this should be really simple. You've failed to notice that the podcasts have different PIDs from the episodes previously downloaded, so they'll all download again. ___ get_iplayer mailing list get_iplayer@lists.infradead.org http://lists.infradead.org/mailman/listinfo/get_iplayer
Re: '5 Live Science' not being found to download
On 18/04/2022 13:53, Mark Carroll wrote: On 18 Apr 2022, MacFH wrote: Since the beginning of April the above programme has not been downloaded by GiP, as follows: > perl \get_iplayer.pl --profile-dir= --type radio "5 Live Science" -g (snip) ... but clicking the podcast tab on that page reveals that there are so-called 'podcast' editions of the missing programmes available ... https://www.bbc.co.uk/programmes/p02pc9ny/episodes/downloads How can I make GiP find these 'podcast' versions as well as or instead of the 'normal' downloads which are no longer being made available? https://github.com/get-iplayer/get_iplayer says, "podcasts directly via PID or URL". Indeed, for the latest, if I try, get_iplayer --pid=p0c1g25k then it downloads just fine. Hope that helps. Oh yes, I can download them via the PID, indeed have already done so, but that requires a specific extra command over and above my daily run which searches for, among other things, 'Science'. Further, I'd have to look up the PID of each new episode, because if I try ... --type radio --pid p02pc9ny --pid-recursive ... it finds all the previous versions before April this year that I've already downloaded, listened to, and then deleted, and I don't want to waste my bandwith downloading 550 or so programmes that I've already heard. What I was asking is how to make GiP *find* them for itself? ___ get_iplayer mailing list get_iplayer@lists.infradead.org http://lists.infradead.org/mailman/listinfo/get_iplayer
'5 Live Science' not being found to download
Since the beginning of April the above programme has not been downloaded by GiP, as follows: > perl \get_iplayer.pl --profile-dir= --type radio "5 Live Science" -g get_iplayer v3.29, Copyright (C) 2008-2010 Phil Lewis This program comes with ABSOLUTELY NO WARRANTY; for details use --warranty. This is free software, and you are welcome to redistribute it under certain conditions; use --conditions for details. Matches: 30065: 5 Live Science - Buying Breast Milk Online, BBC Radio 5 live, m00161g8 30066: 5 Live Science - Science in Film, BBC Radio 5 live, m001682t 30067: 5 Live Science - Hot Cross Puns: Easter Science Q & A, BBC Radio 5 live, m0016jdn INFO: 3 matching programmes WARNING: No media streams found for requested programme versions and recording modes. WARNING: The programme may no longer be available - check the iPlayer or Sounds site. WARNING: The programme may only be available in an unsupported format (e.g., Flash) - check the iPlayer or Sounds site. WARNING: If you use a VPN/VPS/Smart DNS/web proxy, it may have been blocked. [repeated for the other two episodes] Going on to the BBC website reveals that the above programme IDs lead to pages saying 'Sorry, this episode is not currently available", for example ... https://www.bbc.co.uk/programmes/m0016jdn ... but clicking the podcast tab on that page reveals that there are so-called 'podcast' editions of the missing programmes available ... https://www.bbc.co.uk/programmes/p02pc9ny/episodes/downloads How can I make GiP find these 'podcast' versions as well as or instead of the 'normal' downloads which are no longer being made available? (The above command-line with the --type parameter excluded or set to 'podcast' both fail.) ___ get_iplayer mailing list get_iplayer@lists.infradead.org http://lists.infradead.org/mailman/listinfo/get_iplayer
Merging options
I've posted before about the possibility of having command-line options merge with, rather than overwrite, the same options from the preferences file, called 'options' that lives in a user's GiP profile directory, the most obvious need being to be able to provide *additional* exclude options via the command-line to supplement those already in the 'options' file. For anyone interested, the following changes to a subroutine allow this to happen, and, in fact, because the same subroutine is used throughout the options hierarchy, it will apply where any option of higher precedence would otherwise overwrite an option of lower precedence. The way it works is, if the option's value begins with '+', then the plus-sign is discarded and the remainder of the option's value is merged with any pre-existing value rather than overwriting it. It should be noted that it's only meaningful to use it where options consist of comma-separated values. I don't understand the wider options programming well enough to feel confident about suggesting how within GiP to vet against use of a plus-sign on an unsuitable option, but in another program which I use everyday and which calls GiP to download four daily programme lists - HDTV, SDTV, HD Radio, LD Radio (though this latter is rather redundant now) - I simply check whether the option name is contained in a list of options where merging would be valid. For those who are interested, the changes required to GiP v3.29 to have this happen are as follows: Line 64, add the following line (you may need to use 'cpan' to install the module beforehand, but I had it already): use Uniq; Lines 2674 onwards, alter the subroutine 'sub copy_set_options_from' to read as follows (beware possible unwanted line wrap): # Copies values in one instance to another only if they are set with a value/defined # Usage: $opt->copy_set_options_from( $opt_cmdline ); sub copy_set_options_from { my $this_to = shift; my $this_from = shift; # # CEM Change - Merge rather than overwrite # higher priority options whose value begins with a '+' # # Original code: # Merge cmdline options into $opt instance (only those options defined) # for ( keys %{$this_from} ) { # $this_to->{$_} = $this_from->{$_} if defined $this_from->{$_}; # } # # Replacement code: for ( keys %{$this_from} ) { if( defined($this_from->{$_}) ) { # If 'from' value begins with a plus sign ... if( $this_from->{$_} =~ m/^\+/ ) { # ... its value merges with existing value $this_to->{$_} = join( ',', Uniq::uniq( sort(split(',',$this_to->{$_}),split(',',substr($this_from->{$_}, 1)) ) ) ); } else { # ... else it overwrites existing value $this_to->{$_} = $this_from->{$_}; } } } } If anyone's interested, I have a number of other patches to GiP which I regularly apply, some being additions to existing coding, some modifications or replacements of it: 3 different ones in different places which attempt try to fix the BBC's haphazard application of single-quotes and apostrophes by converting them all to the simple ASCII equivalent. I can't help feeling that it shouldn't be necessary to apply the same patch in three different places, but GiP is so convoluted that at the time I was doing this work I was unable to find a single 'pressure point' at which to apply the fix and have it work unfailingly in all circumstances. 1 to leave genuine single quotes and apostrophes, once converted as above, within file names, and to replace colons with ' - ' 1 to remove 'Series' and 'Episode' from programme names, leaving just the numbers. 1 to proper (aka camel) case file names 1 to always display the file name that will be used, aka the file-prefix ___ get_iplayer mailing list get_iplayer@lists.infradead.org http://lists.infradead.org/mailman/listinfo/get_iplayer
Re: Problems downloading Winter Olympics
On 06/03/2022 18:07, Paul Phillips wrote: The change in video quality available is described on this page for version 3.29. https://github.com/get-iplayer/get_iplayer/wiki/release320to329#release329 I've seen a doubling in file sizes to approx 4GB per hour when selecting fhd video quality Both my simple mathematical calculation and the above linked page suggests that they shouldn't be more than about 1.5 to 1.6 times the size of an HD download. ___ get_iplayer mailing list get_iplayer@lists.infradead.org http://lists.infradead.org/mailman/listinfo/get_iplayer
Re: Problems downloading Winter Olympics
On 06/03/2022 02:25, MacFH - C E Macfarlane - News wrote: On 05/03/2022 21:00, Paul Phillips wrote: Where you downloading in HD or Full HD (1080) ? FWIW, I downloaded all the above using the following command ... perl \get_iplayer.pl --profile-dir= --type tv --tvmode hlshd,dvfhd,hvfhd,dvfsd,hvfsd,dvfxsd,hvfxsd --pid --file-prefix "" -g ... noting that at one time my mode list was giving warning messages, though still working, but that I think this is a corrected version that did not. The answer to your question is in the command-line above. I wasn't aware that you might be able to download any higher than 1280*720@50p, but the '--info' command for your first download above ... --info --pid p0blc3vb ... gives ... modesizes: original:hvfhd1=14877MB,[...],dvfhd1=3986MB,[etc] ... suggesting that hvfhd might well be 1280*1080@50p, while my parameter for '--tvmode' above tries to get the old hlshd (720@25p) mode if available, then tries dvfhd (720@50p) if there's no 25p, so it would never have tried to download hvfhd, and my size for that file is the same as for dvfhd above. Perhaps I should try changing my default order for some things such as films, but I certainly won't for the Winter Olympics, which essentially are mostly throwaway items. However, out of interest, I've just tried giving the parameter as ... --type tv --tvmode hvfhd ... but the result was not touted to be 14GB or so ... INFO: Downloading tv: 'Winter Olympics: Beijing 2022 - Mixed Doubles Curling - Great Britain v Italy (p0blc3vb) [original]' 2.9% of ~4332.24 MB @ 15.4 Mb/s ETA: 00:36:44 (hvfhd1/un) [audio+video] ... so it began normally enough, but didn't actually seem to be downloading at significantly better quality than I already have, so I stopped it. A further thought ... if the hvfhd mode above was really 1080p, one would expect that its filesize would be approximately that of a 720p mode x 1080 / 720 or about 6GB, so I have no idea where the figure of 14GB is supposed to come from and suspect that it's a software error. JOOI, I've investigated this further by downloading the first episode of Green Planet in hvfhd, just to see if it would be 1080p, but it wasn't, it was 720p, so I'm still not aware of anything that suggests that iPlayer downloads are available in 1080p. AFAAIA, apart possibly from some test downloads, they've always been available only in 720p or below, never 1080p. ___ get_iplayer mailing list get_iplayer@lists.infradead.org http://lists.infradead.org/mailman/listinfo/get_iplayer
Re: Problems downloading Winter Olympics
Duh! Forgot to 'reply all' to include the mailing list ... On 05/03/2022 21:00, Paul Phillips wrote: Where you downloading in HD or Full HD (1080) ? See below! On Sat, 5 Mar 2022 at 20:54, MacFH - C E Macfarlane - News wrote: On 05/03/2022 19:50, Paul Phillips wrote: Hi, I am having difficulty downloading some of the Winter Olympics - it seems to affect broadcasts that are from the red button / digital channel. It ends up downloading small sound-only recordings - not even sound for the whole episode NB - My settings are set to record in FHD (full HD) Examples programmes that won't download: https://www.bbc.co.uk/iplayer/episode/p0blc3vb/winter-olympics-mixed-doubles-curling-great-britain-v-italy?seriesId=b00qfb83-424-day-1 Downloaded fine for me in HD, duration 1:44:49 https://www.bbc.co.uk/iplayer/episode/p0blc4sk/winter-olympics-shorttrack-speed-skating-mixed-relay-final?seriesId=b00qfb83-424-day-1 Ditto, duration 11:08 https://www.bbc.co.uk/iplayer/episode/p0bknsqp/winter-olympics-mixed-doubles-curling-great-britain-v-australia Ditto, duration 3:20:42, ends with pairs skating. I haven't watched any all the way through, but skipping through allowing short sections to play, they all seem fine, though one passage on the last had some video corruption. Other Winter Olympics episodes download ok,, e.g. Today at the Games, in full HD (1080) It seems to me, Red Button recordings on iPlayer don't work, But TV channel ones do I use WebPVR and my recording quality settings are: fhd,hd,sd,web,mobile,high FWIW, I downloaded all the above using the following command ... perl \get_iplayer.pl --profile-dir= --type tv --tvmode hlshd,dvfhd,hvfhd,dvfsd,hvfsd,dvfxsd,hvfxsd --pid --file-prefix "" -g ... noting that at one time my mode list was giving warning messages, though still working, but that I think this is a corrected version that did not. The answer to your question is in the command-line above. I wasn't aware that you might be able to download any higher than 1280*720@50p, but the '--info' command for your first download above ... --info --pid p0blc3vb ... gives ... modesizes: original:hvfhd1=14877MB,[...],dvfhd1=3986MB,[etc] ... suggesting that hvfhd might well be 1280*1080@50p, while my parameter for '--tvmode' above tries to get the old hlshd (720@25p) mode if available, then tries dvfhd (720@50p) if there's no 25p, so it would never have tried to download hvfhd, and my size for that file is the same as for dvfhd above. Perhaps I should try changing my default order for some things such as films, but I certainly won't for the Winter Olympics, which essentially are mostly throwaway items. However, out of interest, I've just tried giving the parameter as ... --type tv --tvmode hvfhd ... but the result was not touted to be 14GB or so ... INFO: Downloading tv: 'Winter Olympics: Beijing 2022 - Mixed Doubles Curling - Great Britain v Italy (p0blc3vb) [original]' 2.9% of ~4332.24 MB @ 15.4 Mb/s ETA: 00:36:44 (hvfhd1/un) [audio+video] ... so it began normally enough, but didn't actually seem to be downloading at significantly better quality than I already have, so I stopped it. ___ get_iplayer mailing list get_iplayer@lists.infradead.org http://lists.infradead.org/mailman/listinfo/get_iplayer
Re: Problems downloading Winter Olympics
On 05/03/2022 19:50, Paul Phillips wrote: Hi, I am having difficulty downloading some of the Winter Olympics - it seems to affect broadcasts that are from the red button / digital channel. It ends up downloading small sound-only recordings - not even sound for the whole episode NB - My settings are set to record in FHD (full HD) Examples programmes that won't download: https://www.bbc.co.uk/iplayer/episode/p0blc3vb/winter-olympics-mixed-doubles-curling-great-britain-v-italy?seriesId=b00qfb83-424-day-1 Downloaded fine for me in HD, duration 1:44:49 https://www.bbc.co.uk/iplayer/episode/p0blc4sk/winter-olympics-shorttrack-speed-skating-mixed-relay-final?seriesId=b00qfb83-424-day-1 Ditto, duration 11:08 https://www.bbc.co.uk/iplayer/episode/p0bknsqp/winter-olympics-mixed-doubles-curling-great-britain-v-australia Ditto, duration 3:20:42, ends with pairs skating. I haven't watched any all the way through, but skipping through allowing short sections to play, they all seem fine, though one passage on the last had some video corruption. Other Winter Olympics episodes download ok,, e.g. Today at the Games, in full HD (1080) It seems to me, Red Button recordings on iPlayer don't work, But TV channel ones do I use WebPVR and my recording quality settings are: fhd,hd,sd,web,mobile,high FWIW, I downloaded all the above using the following command ... perl \get_iplayer.pl --profile-dir= --type tv --tvmode hlshd,dvfhd,hvfhd,dvfsd,hvfsd,dvfxsd,hvfxsd --pid --file-prefix "" -g ... noting that at one time my mode list was giving warning messages, though still working, but that I think this is a corrected version that did not. ___ get_iplayer mailing list get_iplayer@lists.infradead.org http://lists.infradead.org/mailman/listinfo/get_iplayer
Re: OT help with wget
I've sometimes used this bash script, which originally I wrote to download a section of a site concerning some hardware I owned when the site looked like it was about to close down, which in fact it did, so in due course I was glad that I'd had the foresight. I usually find that it gets related images, etc, except where they aren't stored in the same sub tree as the root document. (Note, beware unintended line wrap) wGetList.sh === #!/bin/sh # The name of the directory containing this script DIRY="${0%/*}/" # echo "Directory: ${DIRY}" # The filename of this script SCRIPT="${0##*/}" # echo "Filename: ${SCRIPT}" # User Agent string - Chrome UAGENT="--user-agent='Mozilla/5.0 (Windows NT 6.1; Win64; x64; rv:56.0) Gecko/20100101 Firefox/56.0'" # Options for wget command OPTIONS="-F -r -c -nc -t 3 -T 60 --retry-connrefused -w 20 --random-wait --waitretry=60 --no-check-certificate ${UAGENT}" # Input list of URLs to retrieve LIST="" LOG="" if [ "${1:0:4}" != "http" ] then if [ -f "${1}" ] then LIST="-i ${1}" LOG="${1%.*}.log" shift OPTIONS="${OPTIONS} ${LIST} ${*}" else echo "WARNING - url list file '$1' not found!" exit 1 fi else OPTIONS="${OPTIONS} ${*}" LOG="${1##*//}" LOG="${LOG%%/*}.log" fi # WGET the files in the list of URLs echo "echo ${OPTIONS} | xargs wget > \"${LOG}\" 2>&1" echo ${OPTIONS} | xargs wget > "${LOG}" 2>&1 & On 17/02/2022 17:03, Dave Widgery wrote: Hi Sorry I know this is very OT but i thought there might be a few people here that might be able to help and possibly email me directly. We have several blogs (using googles blogger) that my wife has created over the years, but I want to create local copy's on my PC. I used the following command. wget --mirror --convert-links --adjust-extension --page-requisites --no-parent http://.blogspot.com and it created a full structure of the blog on my PC but it still relies on links to external websites for the images, can anybody suggest how to get it to also download copy's of the all the images as well? Again sorry for the OT post but I have been going round in circles for a while. Dave ___ get_iplayer mailing list get_iplayer@lists.infradead.org http://lists.infradead.org/mailman/listinfo/get_iplayer ___ get_iplayer mailing list get_iplayer@lists.infradead.org http://lists.infradead.org/mailman/listinfo/get_iplayer
Re: Adding Perl modules?
On 07/12/2021 06:39, David Taylor wrote: I would like to add the Win32::API to the Perl which comes with get_iplayer. Is that possible? Surely, on a Windows machine, all the necessary Win32::* should be installed already? What does the following command sequence give for you, my output is as below: >cpan cpan> m Win32::API Module id = Win32::API CPAN_USERID BULKDD (Daniel Dragan ) CPAN_VERSION 0.84 CPAN_FILEB/BU/BULKDD/Win32/Win32-API-0.84.tar.gz MANPAGE Win32::API - Perl Win32 API Import Facility INST_FILEC:\Programs\Perl\lib\Win32\API.pm INST_VERSION 0.84 cpan> q Lockfile removed. More generally, if you want to see all the modules beginning with 'win32', you can substitute the following for the cpan command: cpan> m /^win32.*/ Here is the script I'm trying to run. It analyses two directories for their total size and returns an output in a format suitable for MRTG. Perhaps I should just substitute Win64 for Win32? I've only used Win32 before. Here's the script in case it clarifies things... ~ # From: http://www.perlmonks.org/?node_id=2311 # and: https://rt.cpan.org/Public/Bug/Display.html?id=61520 # Note that Windows Vista/Server 2008 or later is required for GetTickCount64. # This version returns bytes, not MB. use strict; use Win32::API; use Sys::Hostname; my $GetTickCount; $GetTickCount = Win32::API->new("kernel32", "int GetTickCount64()"); my $uptime; my $dir1 = '.'; my $dir2 = '.'; if (@ARGV[0] ne "") { $dir1 = @ARGV[0]; } if (@ARGV[1] ne "") { $dir2 = @ARGV[1]; } print _tree_size($dir1) . "\n"; print _tree_size($dir2) . "\n"; $uptime = $GetTickCount->Call() / 1000; printf "%d day(s) %dh %dm\n", int($uptime/86400), int(($uptime/3600)%24), int(($uptime%3600)/60); print "PC " . hostname . "\n"; exit 0; sub dir_tree_size { my $dir = shift; my ($i,$total, $f); $total = 0; opendir DIR, $dir; my @files = grep !/^\.\.?$/, readdir DIR; for $i (@files) { $f = "$dir/$i"; if(-d $f) { $total += dir_tree_size($f) } else { $total += -s $f} } return $total; } ~ Although I've written one quite complicated script in Perl, to call GetIPlayer as it happens, I don't program in it often enough to class myself as expert enough to help with the above, but perhaps this helps, it shells out to DOS: https://bytes.com/topic/perl/answers/852485-directory-size-windows-activeperl ___ get_iplayer mailing list get_iplayer@lists.infradead.org http://lists.infradead.org/mailman/listinfo/get_iplayer
Re: Failing to download iPlayer file
> -Original Message- > From: get_iplayer On Behalf Of Michael Eacott > Sent: 20 April 2021 18:32 > To: get_iplayer@lists.infradead.org > Subject: Failing to download iPlayer file > > My apologies for not using my registered read only email address of xmich...@eacott.org.uk that I cannot send from and also not changing my email client Thunderbird default from html format to plain text. > > I wanted to download this video > https://www.bbc.co.uk/iplayer/episode/p099f5jp/greta-thunberg-a-year-to-change-the-world-series-1-episode-2 > I used this command get-iplayer -pid=p099f5jp --modes=hvfxsd1 tvmode good --type=tv > > Here's the Terminal window > > get-iplayer -pid=p099f5jp --modes=hvfxsd1 tvmode good --type=tv get_iplayer v3.27, Copyright (C) 2008-2010 Phil Lewis > This program comes with ABSOLUTELY NO WARRANTY; for details use --warranty. > This is free software, and you are welcome to redistribute it under certain > conditions; use --conditions for details. > > Matches: > 6696:Spooks: The Greater Good - -, BBC One, b06dngb6 > 7282:The Good Dinosaur - -, BBC One, b07h1m7d > INFO: 2 matching programmes > > So what may I be doing wrong please? On 20/04/2021 18:45, Steve Rochford wrote: I think that you've missed out the "--" in front of pid (it looks like you've got a single -) get-iplayer --pid=p099f5jp --modes=hvfxsd1 tvmode good --type=tv What's weird is that you don't get an error but you get the info on 2 completely unrelated programmes! No, it's perfectly logical, it's just that the single dash in front of pid was not his only error, he's also missed out the double dash in front of 'tvmode', so GiP interpreted both 'tvmode' and 'good' as search terms, and thus found 2 programmes with 'good' in the title. ___ get_iplayer mailing list get_iplayer@lists.infradead.org http://lists.infradead.org/mailman/listinfo/get_iplayer
Re: get_iplayer Remux: Programme "already in history" error
On 08/01/2021 11:03, Chris Walker wrote: On Thu, 2021-01-07 at 20:26 +, Xander Squier wrote: We had hoped to resume from where it left-off: Convert the available download to MP4 -> automatic tagging. It seems however that custom ffmpeg settings push get_iplayer to skip the tagging anyway, regardless of user options. If this isn't the case then we'd be grateful to know otherwise. If you want the tags for you file, then use GiP to do it for you with the command --tag-only or hadn't you spotted that option? I don't know how much data is in the raw file but if you have lots of files, then surely it's a simple matter to script something to go through them all and issue the command to re-tag them assuming you can extract the pid from the file. If not, then it's more convoluted to extract the pid from the download history and match that to your raw file. You can also incorporate your ffmpeg command in that script. Can't you? Also, IIRC tagging is done by AtomicParsley, not FFMPEG. ___ get_iplayer mailing list get_iplayer@lists.infradead.org http://lists.infradead.org/mailman/listinfo/get_iplayer
Re: GiP doesn't like double quotes?
On 25/10/2020 10:29, Chris Walker wrote: I wanted to only download series 18 or later of Mock the Week so cobbled together this :- get_iplayer "Mock the Week: Series \b(1[8-9]|2[0-9])\b" It will run manually but not when run as part of the pvr. Substituting single quotes for doubles made it work. Any ideas why? Because, as with bash, Perl treats the contents of single quotes literally, while it interprets the contents of double quotes. What exact misinterpretation of the double quoted example is making it fail, I'm not enough of a Perl expert to be certain, but almost certainly that'll be why. ___ get_iplayer mailing list get_iplayer@lists.infradead.org http://lists.infradead.org/mailman/listinfo/get_iplayer
Re: Changing Default Download Location
On 29/10/2020 12:56, Darran Ross wrote: I'm a newcomer to the list, and from what I've read so far this will be a very basic question for many of you, but I could use your help. I'm trying to change the download location by entering the following, get_iplayer --prefs-add --output "E:\Recordings\Get iPlayer" but all downloads are going to C:\Recordings\Get iPlayer instead. Can someone tell a relative newbie where he's going wrong with this? That looks right, so it suggests that your preferences file is not being read, or that you have two in different locations. As others have said you can check the options file in your profile. If that looks correct, then you have to find out why that profile is not being used when you download. If you want us to be able to help you further, you'd probably need to give us an example of a download command-line that fails to use the correct directory, or are you using the web-interface, which I don't use and therefore know little about, but which may have a different method of configuring defaults? ___ get_iplayer mailing list get_iplayer@lists.infradead.org http://lists.infradead.org/mailman/listinfo/get_iplayer
Re: Existing version of Perl.
On 14/10/2020 16:27, David J Taylor wrote: I already have ActiveState Perl (v5.16.3) installed and in constant use. Is there a way to prevent the Windows installer overwriting that version of Perl, and allowing get-iplayer to use it? I never use the Windows Installer myself, like you I have a pre-existing version of Perl. Most probably, although I haven't actually tried it with this installer, you can open the installer's archive with a program such as 7-zip, which is a useful tool to have installed anyway, and extract the various folders manually, as desired. My arrangement works for me and is thus: C:\Programs\Perl C:\Programs\AtomicParsley C:\Programs\FFMPEG C:\Programs\GetIPlayer C:\Programs\RTMPDump* Then you have to ensure that the directories ... C:\Programs\Perl\site\bin; C:\Programs\Perl\bin; C:\Programs\AtomicParsley; C:\Programs\FFMPEG\bin; C:\Programs\RTMPDump\bin;* ... are included in your path, and that *.pl files are associated with being run by Perl. *These are historical and may not still be required. ___ get_iplayer mailing list get_iplayer@lists.infradead.org http://lists.infradead.org/mailman/listinfo/get_iplayer
GiP Errors Tonight
Starting this evening, I'm getting the following errors on all attempts to download HiDef radio downloads using GetIPlayer v3.23: ERROR: Failed to download URL (3/3): https://cp143012-i.akamaihd.net/i/prod_af_mp4_aaclc_128/iplayerstream/p08l7cgq_m000ldbs_cUnknown_1596528177531.mp4/master.m3u8?hdnea=st=1596569237~exp=1596590837~acl=/*p08l7cgq_m000ldbs_cUnknown_1596528177531.mp4*~hmac=1a62dbee88eb7a62bfe51df5ec55705349eea484d3f369744fa2684aeffbbdc8 ERROR: Response: 500 Can't connect to cp143012-i.akamaihd.net:443 ERROR: Ignore this error if programme download is successful I presume this particular server is down, because ultimately GiP seems to find another one, and the download succeeds, although somewhat slowly, but the latter may be because I seem to be suffering very slow speeds just now ... Response time (latency): 839 ms, Download speed: 0.7 Mbps, Upload speed: 1.5 Mbps ... but is this the cause of the above error as well? Anyone else having this problem? ___ get_iplayer mailing list get_iplayer@lists.infradead.org http://lists.infradead.org/mailman/listinfo/get_iplayer
Re: lists.infradead.org mailing list memberships reminder
Please see below ... On 01/07/2020 12:31, David Woodhouse wrote: On Wed, 2020-07-01 at 12:12 +0100, MacFH - C E Macfarlane wrote: Jeez, "a couple of years ago"???!!! Don't they make backups more often than that???!!! No, I didn't. Annoyingly, I did have a friend who'd been staying with us during lockdown — he was here "for a few weeks while his house purchase went through" when it hit — who had purchased a new backup server of his own and was mocking me into compliance when I admitted I didn't have proper backups. I had *almost* got round to buying a shiny new machine of my own when the RAID failed in the machine that was lists.infradead.org, and I realised that the crappy Dell hardware RAID controller had *already* dropped a disk for some reason without me realising, so it was now completely gone. So the last "backup" is from when the lists were last hosted on a different machine of mine, before it was all moved over to the now-dead one. And is from May 2018. I'm sorry if I sounded rather exasperated, because a month or two back I spent a couple of days changing all my newsgroup, software, and similar email lists to go to my news account, so that I could reinstitute my signatures on my personal account now that I'm using a client that will let me set up separate signatures for different accounts, and, not realising this was the only subscription of mine to lists.infradead.org, I had visions of having to do much of that work again. I didn't realise that you were running all this yourself from your own home or office, and I don't know how much it all costs you personally, so I hesitate to recommend anything, but I have three laptops all of which have separate system and data partitions, and every evening before signing out of any that I've been working on that day I backup all changes on the data partition to a NAS, and this in turn backs up to the older one it replaced overnight. Periodically I also take an image of the operating system partition, which is saved on the data partition, so this, too, will get backed up to the NASs the evening after it is made. The new NAS is a QNAP TS-251+ with BIG disks, the old one a Zyxel NSA221 with smaller disks, and the arrangement seems to work very well for me, though there will eventually come a time when the new NAS will be too full to be backed up to the smaller drives of the old NAS, and then I will have to think again. Meanwhile, there are things I could delete to delay that crisis. Doubtless that's why this has all come to the wrong email address again, and presumably I'll have to change them all again :-( Yes. Apologies for that. It's backed up now not that that helps. Maybe after next time I'll start *verifying* my backups too. I've fixed the address again now, anyway, but thanks for the explanation. ___ get_iplayer mailing list get_iplayer@lists.infradead.org http://lists.infradead.org/mailman/listinfo/get_iplayer
Re: lists.infradead.org mailing list memberships reminder
Please see below ... On 01/07/2020 10:46, David Woodhouse wrote: The list server did die a week or so ago and has been restored to a backup from a couple of years ago, so it's possible that I had disabled the pointless monthly reminders in the interim and they've just been reenabled by the restore — but I didn't think so. Jeez, "a couple of years ago"???!!! Don't they make backups more often than that???!!! Doubtless that's why this has all come to the wrong email address again, and presumably I'll have to change them all again :-( ___ get_iplayer mailing list get_iplayer@lists.infradead.org http://lists.infradead.org/mailman/listinfo/get_iplayer
Re: BUG (I think) excludecategory doesn't work with "Children's"
Please see below ... On 23/02/2020 00:07, RS wrote: On Sat, 22 Feb 2020 23:51:36 + MacFH - C E Macfarlane wrote: As per title, I have the following lines in my options file, but I still get CBBC programmes, with & without the double quotes around Children's ... excludecategory Sign Zone,Learning,"Children's",Primary,Secondary refreshexclude BBC Radio 1,BBC 1Xtra,BBC Three,CBBC,CBeebies,BBC Two Scotland,S4C Anything to be done? According to the documentation https://github.com/get-iplayer/get_iplayer/wiki/options#search-options --exclude-category excludecategory Narrow search to exclude matched categories (comma-separated regex list). Defaults to substring match. Only works with --history. Ah! I have text file dump of the --help option output, but that last sentence is beyond the RHS of the screen, so that explains why it wasn't working! However, IMV, this needs to change - it would be a far more useful option to have it apply generally. What are others' thoughts? ___ get_iplayer mailing list get_iplayer@lists.infradead.org http://lists.infradead.org/mailman/listinfo/get_iplayer
Re: BUG (I think) excludecategory doesn't work with "Children's"
Please see below ... On 22/02/2020 23:58, Nick wrote: On Sat, 22 Feb 2020 23:51:36 + MacFH - C E Macfarlane wrote: As per title, I have the following lines in my options file, but I still get CBBC programmes, with & without the double quotes around Children's ... excludecategory Sign Zone,Learning,"Children's",Primary,Secondary refreshexclude BBC Radio 1,BBC 1Xtra,BBC Three,CBBC,CBeebies,BBC Two Scotland,S4C Anything to be done? Escape it with a backslash? Children\'s Or maybe a wildcard, Children* or perhaps Children.* I've already tried, to no avail, the following and similar combinations thereof ... "Children's" Children\'s Children.s ... but thanks anyway. ___ get_iplayer mailing list get_iplayer@lists.infradead.org http://lists.infradead.org/mailman/listinfo/get_iplayer
BUG (I think) excludecategory doesn't work with "Children's"
As per title, I have the following lines in my options file, but I still get CBBC programmes, with & without the double quotes around Children's ... excludecategory Sign Zone,Learning,"Children's",Primary,Secondary refreshexclude BBC Radio 1,BBC 1Xtra,BBC Three,CBBC,CBeebies,BBC Two Scotland,S4C Anything to be done? ___ get_iplayer mailing list get_iplayer@lists.infradead.org http://lists.infradead.org/mailman/listinfo/get_iplayer
Re: Available: Yes, Prime Minister, The Tangled Web.
Please see below ... On 16/02/2020 11:14, Ralph Corderoy wrote: Hi, I've deleted the emails from the earlier thread discussing PID b037tb14 being unavailable. I agree, it was then. In another periodic run of my PVR queue, it downloaded. Duration: 00:28:15.04, start: 0.00, bitrate: 247 kb/s Stream #0:0(und): Video: h264 (Main) (avc1 / 0x31637661), yuv420p(tv, bt470bg), 960x540 [SAR 1:1 DAR 16:9], 1597 kb/s, 25 fps, 25 tbr, 90k tbn, 50 tbc (default) Stream #0:1(eng): Audio: aac (HE-AAC) (mp4a / 0x6134706D), 48000 Hz, stereo, fltp, 96 kb/s (default) https://www.bbc.co.uk/programmes/b037tb14 matches this with a ‘Watch now’. The thread starts with MacFH at http://lists.infradead.org/pipermail/get_iplayer/2020-February/012683.html Yes, thanks, I'd already discovered that when it downloaded automatically for me to, but when I tried to alert the group about it, I got the following reply: Your mail to 'get_iplayer' with the subject Re: No Prime Minister? Is being held until the list moderator can review it for approval. The reason it is being held: Message has a suspicious header Either the message will get posted to the list, or you will receive notification of the moderator's decision. If you would like to cancel this posting, please visit the following URL: http://lists.infradead.org/mailman/confirm/get_iplayer/bbf08ac219873b5da575728b40381a550cd7b10f I've heard of others receiving such blocks, but have not previously had the problem myself, and the only thing that might have changed is that Thunderbird has updated itself a few times recently. If anyone can make sense of the problem, here's the source code of my original mail: From - Fri Feb 14 21:49:52 2020 X-Mozilla-Status: 0001 X-Mozilla-Status2: 0080 X-Mozilla-Keys: To: get_iplayer@lists.infradead.org From: MacFH - C E Macfarlane Subject: Re: No Prime Minister? Message-ID: <028e46a1-9455-cfaf-8e95-0f2918ca3...@macfh.co.uk> Date: Fri, 14 Feb 2020 21:49:49 + User-Agent: Mozilla/5.0 (Windows NT 6.1; WOW64; rv:68.0) Gecko/20100101 Thunderbird/68.5.0 MIME-Version: 1.0 Content-Type: text/plain; charset=utf-8; format=flowed Content-Transfer-Encoding: 7bit Content-Language: en-GB Suddenly this has become available: https://www.bbc.co.uk/programmes/b037tb14 ___ get_iplayer mailing list get_iplayer@lists.infradead.org http://lists.infradead.org/mailman/listinfo/get_iplayer
Re: Slow speed
Resending as the addressing of the original seemed questionable - please see below ... On 15/02/2020 13:14, Paul Thornett wrote: It seems to me that downloads have become very slow, often not completing. Has anyone else noticed this phenomenon? I've not noticed it using a 4G connection. You don't give your broadband connection type, but perhaps bad weather has enabled water ingress into your landline somewhere along its route? ___ get_iplayer mailing list get_iplayer@lists.infradead.org http://lists.infradead.org/mailman/listinfo/get_iplayer
Re: No Prime Minister?
Thanks, it's a kind thought, but, as others have pointed out, I'd better say no thanks. On 07/02/2020 09:26, Sharon Kimble wrote: I have both complete series (Yes Minister and Yes Prime Minister) which I can make available if we can work out how to get them to you. I think that I would probably zip them up into an archive, and then just provide a link to download them from one of my websites for a limited period. So, please let me know if you're interested or just want one episode? Thanks Sharon. ___ get_iplayer mailing list get_iplayer@lists.infradead.org http://lists.infradead.org/mailman/listinfo/get_iplayer ___ get_iplayer mailing list get_iplayer@lists.infradead.org http://lists.infradead.org/mailman/listinfo/get_iplayer
Re: No Prime Minister?
Please see below ... On 05/02/2020 13:31, Mark Goodge wrote: Older stuff can, possibly a little counter-intuitively, be more problematic than recent material, as, at the time it was made, there was no expectation that the BBC would ever want repeat transmission rights for anything other than broadcast TV. The only other distribution method, at the time, would have been home video, and the rights to that were often negotiated separately so that those involved in the production could get their cut there, too. Since iPlayer is neither home video nor broadcast, there's nothing to cover it in the original contracts. I see, bit of a bummer, but thanks for the explanation. Certainly, it does seem counter-intuitive and somewhat ridiculous that we can't download such an old but popular series. I loved both Yes Minister and Yes Prime Minister, but have none of them recorded. ___ get_iplayer mailing list get_iplayer@lists.infradead.org http://lists.infradead.org/mailman/listinfo/get_iplayer
Re: No Prime Minister?
Please see below ... On 05/02/2020 09:28, Don Grunbaum wrote: >> - Original Message - >> From: MacFH - C E Macfarlane >> To: >> Sent: 04/02/2020 21:49:16 >> Subject: Re: No Prime Minister? >> >> >> https://www.bbc.co.uk/programmes/b037tb14 > > As the BBC say (paraphrasing), not all programmes are available on iPlayer. This is generally for contractual reasons. It seems that this is one of those programmes that aren't available. It has applied (for example) to old Monty Python programmes in the past. > > ___ > get_iplayer mailing list > get_iplayer@lists.infradead.org > http://lists.infradead.org/mailman/listinfo/get_iplayer Thanks, but I knew that, and it seems to me rather strange that an own BBC 30 years' old series should be subject to such a constraint, and wondered if anyone happened to know anything more specific. ___ get_iplayer mailing list get_iplayer@lists.infradead.org http://lists.infradead.org/mailman/listinfo/get_iplayer
Re: Podcast - no pid?
I thought YouTubeDownloader might have done it, but I couldn't get it to work. On 04/02/2020 22:05, CJB wrote: Sorry - my mistake. CJB On 04/02/2020, James Scholes wrote: Why are you expecting that get_iplayer will be able to download anything from the British Library? Regards, James Scholes On 04/02/2020 at 3:13 pm, CJB wrote: Am trying to download all in this series https://sounds.bl.uk/World-and-traditional-music/Bob-Davenport-Archive/025M-C1047X0012XX-1500V0 Is there anyway I can do this with get_iplayer? Thanks Chrs B- ___ get_iplayer mailing list get_iplayer@lists.infradead.org http://lists.infradead.org/mailman/listinfo/get_iplayer ___ get_iplayer mailing list get_iplayer@lists.infradead.org http://lists.infradead.org/mailman/listinfo/get_iplayer ___ get_iplayer mailing list get_iplayer@lists.infradead.org http://lists.infradead.org/mailman/listinfo/get_iplayer ___ get_iplayer mailing list get_iplayer@lists.infradead.org http://lists.infradead.org/mailman/listinfo/get_iplayer
Re: No Prime Minister?
Sorry, meant to include a link to the programme page: https://www.bbc.co.uk/programmes/b037tb14 On 04/02/2020 21:42, MacFH - C E Macfarlane wrote: Does anyone happen to know why the episode of Yes, Prime Minster shown a couple of days ago can not be downloaded? ___ get_iplayer mailing list get_iplayer@lists.infradead.org http://lists.infradead.org/mailman/listinfo/get_iplayer ___ get_iplayer mailing list get_iplayer@lists.infradead.org http://lists.infradead.org/mailman/listinfo/get_iplayer
No Prime Minister?
Does anyone happen to know why the episode of Yes, Prime Minster shown a couple of days ago can not be downloaded? ___ get_iplayer mailing list get_iplayer@lists.infradead.org http://lists.infradead.org/mailman/listinfo/get_iplayer
Re: Sky at Night
Hi Jim ... On 30/12/2019 17:34, Jim web wrote: I'm having a problem with getting the most recent 'Sky at Night' programme https://www.bbc.co.uk/programmes/m00042l2 My normal procedure worked for that programme last night, the command given would have been : gip --type tv --tvmode hlshd,dvfhd,hvfhd,dvfsd,hvfsd,dvfxsd,hvfxsd "Sky At Night" -g Regards, Charles. ___ get_iplayer mailing list get_iplayer@lists.infradead.org http://lists.infradead.org/mailman/listinfo/get_iplayer
Re: world service 96k
Please see below ... On 03/12/2019 16:23, RS wrote: However I then looked at what was available from get_iplayer v3.23 for the 28 November 2019 Science in Action (w3csym2r). The only version is the podcast version, but with these modes. modes: podcast: dafhigh1,dafhigh2,dafhigh3,dafhigh4,hafstd1,hafstd2,hlastd1,dafstd1, dafstd2,dafstd3,dafstd4,dafmed1,dafmed2,dafmed3,dafmed4,haflow1,haflow2, hlalow1,daflow1,daflow2,daflow3,daflow4 Yes, I've just checked that this was true, and so was able to download it in std, my default for such programmes. However, the last time I downloaded it, it definitely seemed only to come only in med, hlamed1 to be exact. End Of Last Week: w3csym2r|Science In Action|New Malaria Target|radio|1575132305|hlamed1|D:\Media\Downloads\Science In Action - New Malaria Target.m4a|original|1590|Molecular research opens the way to prevent antimalarial resistance|BBC World Service|Factual,Science & Nature,Magazines & Reviews|https://ichef.bbci.co.uk/images/ic/192x108/p07wbzsp.jpg||https://www.bbc.co.uk/programmes/w3csym2r||| Today: w3csym2r|Science In Action|New Malaria Target|radio|1575396236|dafstd1|D:\Media\Downloads\Science In Action - New Malaria Target.m4a|podcast|1758|Molecular research opens the way to prevent antimalarial resistance|BBC World Service|Factual,Science & Nature,Magazines & Reviews|https://ichef.bbci.co.uk/images/ic/192x108/p07wbzsp.jpg||https://www.bbc.co.uk/programmes/w3csym2r||| ___ get_iplayer mailing list get_iplayer@lists.infradead.org http://lists.infradead.org/mailman/listinfo/get_iplayer
Re: world service 96k
Please see below ... On 03/12/2019 13:53, Paul Thornett wrote: What about downloading subtitles and, if necessary, constructing a Matroska file (.mkv) containing video, audio and subtitle? I can provide more info on how to do this if you're interested. I suppose it would depend on the program - last night I was watching an Horizon programme that I'd downloaded a few weeks back, 'The Honest Supermarket', and when Hannah Fry said that recently the sales of bottled water had, for the first time, exceeded the sales of cola, I couldn't distinguish the word 'cola' on first hearing. For Horizon, I suppose I wouldn't really mind subtitles, but for 'Seven Worlds One Planet' certainly I would *not* want subtitles all over the beautiful scenery! I think I could probably work out how to use subtitles if it comes to that, but don't let that stop you posting something that might usefully benefit others, as well as perhaps myself. Thanks and regards, Charles. ___ get_iplayer mailing list get_iplayer@lists.infradead.org http://lists.infradead.org/mailman/listinfo/get_iplayer
Re: world service 96k
Please see below ... On 03/12/2019 09:51, Jim Lesurf wrote: I' ve now switched to using the new version of GIP and using the 'DASH' approach for fetching. Many thanks for the new version. :-) For TV this works fine. And for *most* radio it also works fine. But since I'm writing this you'll have guessed there is a trailing, "...however..." :-) Using " --type=radio --mode=daf " I can get 320k aac from R4/3 fine. But when I tried some World Service examples ('More or Less") they came as 96k aac. So far I can't find a sign or way of getting them as 320k. I'm pretty sure I could get 320k from WS in the past. And the last time I checked, Scotland was still within the UK. So am I doing something wrong, or has something changed, or do I mis-remember... or is there a way now to get 320k from WS? Yes, I've noticed this too. Fortunately for me, the only WS item I download is "Science In Action", which usually I delete after I've listened to it, so, as long as the quality is good enough to be listenable, I don't really mind. However, like you, I'm beginning to get concerned at the moving deck-chairs because it usually means that something good disappears and what we're left with is not as good. The loss of hi-def audio in hi-def video is a classic case in point: Why would *anyone* think that the quality of the audio track is any less important than the quality of the video track, *especially* where music is concerned, such as with the Proms? Given the above, I didn't bother to download the TV version of a single prom this year. The above also makes me wonder if this is the reason that increasingly I find I have to turn the volume up when watching TV, because words get lost in the 'mush'. Of course, I'm getter older too, but I've particularly noticed this on downloads from the beginning of this year, so I'm beginning to suspect that the problem is the poor quality of the audio tracks. When watching on my bedside TV, I used to have the volume slider about a third of the way across, but now it's more like half, and yet *still* I find that words are swallowed up and I have to 'rewind', and listen to a sentence again with the volume turned up so loud that it would be uncomfortable to keep it so for any length of time. ___ get_iplayer mailing list get_iplayer@lists.infradead.org http://lists.infradead.org/mailman/listinfo/get_iplayer
Re: 3.23 released was Re: 403 Forbidden Errors on Playlists
Please see below ... On 30/11/2019 06:31, Geoff Smith wrote: https://github.com/get-iplayer/get_iplayer/wiki/release320to329#release323 Usual thanks to the maintainer. Installed and running apparently successfully, seconded. ___ get_iplayer mailing list get_iplayer@lists.infradead.org http://lists.infradead.org/mailman/listinfo/get_iplayer
Re: Digging for Britain Episode
This is downloading for me now, video included, dvfhd2/ll. If I findin the morning that it has failed I'll post about it probably around lunchtime, possibly before, otherwise assume that it's worked. On 28/11/2019 00:04, artisticforge Niemand wrote: Hello The 2nd tv episode which has downloaded audio. what has changed? how do I tell GIP is just download TV as Video? I have never had to do that. below is the output INFO: Trying 'dvfhd1' mode: attempt 3 / 3 INFO: Creating subdirectory /home/user/get_iplayer.dir/Digging_for_Britain_Series_8 for programme INFO: File name prefix = Digging_for_Britain_Series_8_-_02._North_m000bpm4_original INFO: Begin downloading at: 0.00 MB (00:00:00) [1] INFO: Downloaded: 0.00 MB (00:00:00) [0] in 00:00:00 @ 0.00 Mb/s (dvfhd1/bi) [audio] WARNING: Failed to download file segment [0] WARNING: Response: 400 Bad Request WARNING: File segment URL: https://mm.bidi.bbc.co.uk/vod-dash-uk/usp/auth/vod/piff_abr_full_hd/3d4b79-m000bpm2/vf_m000bpm2_d5e32c73-5b7c-4fcc-8706-84cd19 WARNING: Stopped downloading at: 0.00 MB (00:00:00) [0] INFO: Trying 'dvfhd2' mode: attempt 1 / 3 INFO: Creating subdirectory /home/user/get_iplayer.dir/Digging_for_Britain_Series_8 for programme INFO: File name prefix = Digging_for_Britain_Series_8_-_02._North_m000bpm4_original INFO: Begin downloading at: 0.00 MB (00:00:00) [1] INFO: Downloaded: 57.21 MB (00:58:48) [919] in 00:08:05 @ 0.94 Mb/s (dvfhd2/ll) [audio] INFO: Begin downloading at: 0.00 MB (00:00:00) [1] 5.2% 116.37 MB / ~2235.87 MB (00:03:04 / 00:58:48) [ 48 / 919] @ 4.7 Mb/s ETA: 01:00:25 (dvfhd2/ll) [video] ___ get_iplayer mailing list get_iplayer@lists.infradead.org http://lists.infradead.org/mailman/listinfo/get_iplayer
Re: odd problem with downloading
Got it to download with --tvmode hvfhd,hvfxsd,hvfsd to define the acceptable TV modes. On 27/11/2019 14:34, MacFH - C E Macfarlane wrote: Please see below ... On 25/11/2019 23:52, artisticforge Niemand wrote: Hello I was eventually able to get it downloaded by restarting it from the command line. Still doesn't work for me. there are a couple other oddities currently with the bbc. Yes, for example the 403 messages. On Mon, Nov 25, 2019 at 4:25 PM Nick Payne wrote: On 26/11/2019 8:59 am, MacFH - C E Macfarlane wrote: On 25/11/2019 01:58, artisticforge Niemand wrote: Hello Downloading the current episode of Seven Worlds One Planet starts out okay, when if has to restart the download it fails. I'm not even getting that far, I get ... Seven Worlds One Planet - 01 05 Europe.audio.m4a (length 0) Seven Worlds One Planet - 01 05 Europe.audio.txt (length 1KB) ... and that's all. Going to the programme page ... https://www.bbc.co.uk/iplayer/episode/m000bqjg/seven-worlds-one-planet-series-1-5-europe ... that seems to begin alright, and there's no mention of problems with it in the iPlayer help page, so I'm not sure what to try next. Ditto here. Other programs download without any problem, including other episodes of the same series, so it seems to be something awry with this one. The log shows: INFO: File name prefix = Seven_Worlds_One_Planet-s01e05-Europe INFO: Begin downloading at: 0.00 MB (00:00:00) [1] INFO: Downloaded: 0.00 MB (00:00:00) [0] in 00:00:01 @ 0.00 Mb/s (dvfhd1/bi) [audio] WARNING: Failed to download file segment [0] WARNING: Response: 400 Bad Request WARNING: File segment URL: https://mm.bidi.bbc.co.uk/vod-dash-uk/usp/auth/vod/piff_abr_full_hd/71da27-m000c5x9/vf_m000c5x9_2572b580-43d1-4adb-977a-af2c23928a8b.ism.hlsv2.ism/dash/vf_m000c5x9_2572b580-43d1-4adb-977a-af2c23928a8b.ism.hlsv2-audio_eng_1=128000.dash?at=4NFhVUwGd8b75c9fff30a80a11f90e7f98750cd9c669ed6d5983325e3e680 WARNING: Stopped downloading at: 0.00 MB (00:00:00) [0] and GiP then tries for the editorial version and finds no streams available. Yes, still the same. ___ get_iplayer mailing list get_iplayer@lists.infradead.org http://lists.infradead.org/mailman/listinfo/get_iplayer ___ get_iplayer mailing list get_iplayer@lists.infradead.org http://lists.infradead.org/mailman/listinfo/get_iplayer
Re: odd problem with downloading
Please see below ... On 25/11/2019 23:52, artisticforge Niemand wrote: Hello I was eventually able to get it downloaded by restarting it from the command line. Still doesn't work for me. there are a couple other oddities currently with the bbc. Yes, for example the 403 messages. On Mon, Nov 25, 2019 at 4:25 PM Nick Payne wrote: On 26/11/2019 8:59 am, MacFH - C E Macfarlane wrote: On 25/11/2019 01:58, artisticforge Niemand wrote: Hello Downloading the current episode of Seven Worlds One Planet starts out okay, when if has to restart the download it fails. I'm not even getting that far, I get ... Seven Worlds One Planet - 01 05 Europe.audio.m4a(length 0) Seven Worlds One Planet - 01 05 Europe.audio.txt(length 1KB) ... and that's all. Going to the programme page ... https://www.bbc.co.uk/iplayer/episode/m000bqjg/seven-worlds-one-planet-series-1-5-europe ... that seems to begin alright, and there's no mention of problems with it in the iPlayer help page, so I'm not sure what to try next. Ditto here. Other programs download without any problem, including other episodes of the same series, so it seems to be something awry with this one. The log shows: INFO: File name prefix = Seven_Worlds_One_Planet-s01e05-Europe INFO: Begin downloading at: 0.00 MB (00:00:00) [1] INFO: Downloaded: 0.00 MB (00:00:00) [0] in 00:00:01 @ 0.00 Mb/s (dvfhd1/bi) [audio] WARNING: Failed to download file segment [0] WARNING: Response: 400 Bad Request WARNING: File segment URL: https://mm.bidi.bbc.co.uk/vod-dash-uk/usp/auth/vod/piff_abr_full_hd/71da27-m000c5x9/vf_m000c5x9_2572b580-43d1-4adb-977a-af2c23928a8b.ism.hlsv2.ism/dash/vf_m000c5x9_2572b580-43d1-4adb-977a-af2c23928a8b.ism.hlsv2-audio_eng_1=128000.dash?at=4NFhVUwGd8b75c9fff30a80a11f90e7f98750cd9c669ed6d5983325e3e680 WARNING: Stopped downloading at: 0.00 MB (00:00:00) [0] and GiP then tries for the editorial version and finds no streams available. Yes, still the same. ___ get_iplayer mailing list get_iplayer@lists.infradead.org http://lists.infradead.org/mailman/listinfo/get_iplayer
Re: odd problem with downloading
On 25/11/2019 01:58, artisticforge Niemand wrote: Hello Downloading the current episode of Seven Worlds One Planet starts out okay, when if has to restart the download it fails. I'm not even getting that far, I get ... Seven Worlds One Planet - 01 05 Europe.audio.m4a (length 0) Seven Worlds One Planet - 01 05 Europe.audio.txt (length 1KB) ... and that's all. Going to the programme page ... https://www.bbc.co.uk/iplayer/episode/m000bqjg/seven-worlds-one-planet-series-1-5-europe ... that seems to begin alright, and there's no mention of problems with it in the iPlayer help page, so I'm not sure what to try next. ___ get_iplayer mailing list get_iplayer@lists.infradead.org http://lists.infradead.org/mailman/listinfo/get_iplayer
Re: OT Video Conversion
Please see below ... On 13/10/2019 16:25, Dave Widgery wrote: Hi I would like to copy some of my DVD collection onto hard disk to make them easier to access and I am getting very frustrated with downloading programs that claim to be free versions only to find out that in fact that it is a trial version, or in the case of a comprehensive program like Handbrake that is free but takes for ever to run on my pc. ffmpeg seams to be a very efficient program for converting video, is it possible to use it to extract video directly from the DVD video files, if so can anyone point me in the direction of a tutorial that explains how to do it. I realise that it is unlikely to work directly from the DVD so I am using DVDshrink which allows me to create a hard disk decrypted version of the DVD ahead of any other video processing Actually I have been using Handbrake, and yes it does take some time, but I think any program would, because I suspect re-encoding is needed. A media file consists of parcels of data inside a file, so from the point of view of the parcels, there are at least two possible variables, the internal format of the parcels themselves, and the external format of how the parcels are stored in the file. Hence media copying and conversion operations fall into two categories, those that only need to alter the format of how the parcels are stored in the file - relatively quick - and those that need to re-encode the parcels themselves - relatively slow. I think converting it from *.VOB to *.mp4 or *.mk4 is one of the latter, and, if I'm right about that, it doesn't matter which program you use, it will take significantly longer. Certainly I know that when I've set FFMPEG to re-encode, it too takes ages. I'd stick with Handbrake, because it's pretty good. ___ get_iplayer mailing list get_iplayer@lists.infradead.org http://lists.infradead.org/mailman/listinfo/get_iplayer
Re: GiP v3.17 - Cannot download programme schedules tonight
Please see below ... On 20/08/2019 14:03, John Reay wrote: The latest version on the ppa for my distro (Mint 19) is still 3.21 :( ...guess I'll have to wait a day or two. Why don't you install the latest package available to you and then simply overwrite the files with v3.22 ones? I've now installed 3.22 and it's working, so thanks to all for the advice. ___ get_iplayer mailing list get_iplayer@lists.infradead.org http://lists.infradead.org/mailman/listinfo/get_iplayer
Re: GiP v3.17 - Cannot download programme schedules tonight
Please see below ... On 20/08/2019 10:30, RS wrote: On 20/08/2019 09:52, MacFH - C E Macfarlane wrote: Thanks for the various replies ... On 20/08/2019 00:17, RS wrote: On 19/08/2019 23:44, I wrote: On 19/08/2019 23:29, Mark Carroll wrote: On 19 Aug 2019, MacFH wrote: As per subject, cannot access any programme schedules using GiP v3.17 tonight. For example ... WARNING: Got 0 programmes for BBC One Scotland schedule page (JSON): https://www.bbc.co.uk/schedules/p00fzl6v/2019/w33 (snip) Anyone else seeing this? Yes, using v3.22 seems to help but at first glance it still doesn't seem to find as much television as I'd have expected. -- Mark This is what has been said in the forum. https://forums.squarepenguin.co.uk/thread-2073-post-8717.html#pid8717 I haven't yet tried v3.22 so I can't comment on whether it works. v3.22 found 1363 new tv programmes and 1143 radio programmes for the last day or so, so I think it is probably working alright. As I wondered, obviously time to update. Tx again. If you are using Linux you may need to update manually. There is not yet an updated PPA for ubuntu. I'm currently using GiP on W7, but I always update the script manually anyway, because I make a number of modifications to it. The purpose of these are to: :-( Replace as far as possible the BBC's disastrously inconsistent and obscure encoding of apostrophes with ASCII 0x27 * Camel case all titles and filenames * Remove 'Series ' and 'Episode ', leaving just the numbers * Remove leading 'A ' and 'The ', or else append them as ', A' and ', The' - currently I do the former ___ get_iplayer mailing list get_iplayer@lists.infradead.org http://lists.infradead.org/mailman/listinfo/get_iplayer
Re: GiP v3.17 - Cannot download programme schedules tonight
Thanks for the various replies ... On 20/08/2019 00:17, RS wrote: On 19/08/2019 23:44, I wrote: On 19/08/2019 23:29, Mark Carroll wrote: On 19 Aug 2019, MacFH wrote: As per subject, cannot access any programme schedules using GiP v3.17 tonight. For example ... WARNING: Got 0 programmes for BBC One Scotland schedule page (JSON): https://www.bbc.co.uk/schedules/p00fzl6v/2019/w33 (snip) Anyone else seeing this? Yes, using v3.22 seems to help but at first glance it still doesn't seem to find as much television as I'd have expected. -- Mark This is what has been said in the forum. https://forums.squarepenguin.co.uk/thread-2073-post-8717.html#pid8717 I haven't yet tried v3.22 so I can't comment on whether it works. v3.22 found 1363 new tv programmes and 1143 radio programmes for the last day or so, so I think it is probably working alright. As I wondered, obviously time to update. Tx again. ___ get_iplayer mailing list get_iplayer@lists.infradead.org http://lists.infradead.org/mailman/listinfo/get_iplayer
GiP v3.17 - Cannot download programme schedules tonight
As per subject, cannot access any programme schedules using GiP v3.17 tonight. For example ... WARNING: Got 0 programmes for BBC One Scotland schedule page (JSON): https://www.bbc.co.uk/schedules/p00fzl6v/2019/w33 ... but ... https://www.bbc.co.uk/schedules/p00fzl6v/2019/w33 ... loads in a browser alright. Anyone else seeing this? ___ get_iplayer mailing list get_iplayer@lists.infradead.org http://lists.infradead.org/mailman/listinfo/get_iplayer
SOT: BBC iPlayer gets Ofcom green light to make shows available for a year
"BBC iPlayer gets Ofcom green light to make shows available for a year The BBC's iPlayer now has permission to routinely keep shows available for a year rather than just 30 days, after Ofcom said it could expand its service. Some shows will be available for even longer, the broadcasting watchdog said." https://www.bbc.co.uk/news/entertainment-arts-49191885 ___ get_iplayer mailing list get_iplayer@lists.infradead.org http://lists.infradead.org/mailman/listinfo/get_iplayer
Re: Excessive Bounces
Please see below ... On 28/07/2019 14:29, Mark Carroll wrote: On 28 Jul 2019, RS wrote: One thing that seems to be being suggested is that I should use my own domain name for email. My own experience of doing that has been that I get swamped with spam. I do this. This isn't the place for an extended discussion of antispam approaches but many people find that graylisting helps and personally I find that not much spam gets through if I just tarpit any IPs currently appearing on certain blackhole lists. It's hardly an option for the typical get_iplayer user though. As do I. Of course it's made a more obvious solution because I already have a domain for my website, and it wouldn't make any sense to host my own mail anywhere else, nevertheless I was already considering it when my website was still on my ISP's space - wanting *both* mail and webspace independent of my ISP was the reason for taking out a domain. In these days where ISPs commonly treat old users as scum and new users get all the best offers, most decidedly you don't want to be held to ransom by the fact that your ISP is also hosting your mail and website. FWIW ... 1) My email at macfh.co.uk is hosted by 1&1 - other good webhosts are available, see below - and doesn't receive these bounce messages. 2) Your own domain can cost as little as £1/yr - that's an offer presumably of limited duration and presumably just for the name without necessarily any associated space, but it makes the point that you don't have to rob a bank to create your own domain. For example: https://duckduckgo.com/?q=uk+buy+domain+name ___ get_iplayer mailing list get_iplayer@lists.infradead.org http://lists.infradead.org/mailman/listinfo/get_iplayer
Re: Forum - HVF 320kbps audio streams no longer available
Please see below ... On 17/07/2019 16:26, James Scholes wrote: Scratch what I said previously, the format of the URLs has changed and the 320K streams are still available. Just posted the info here: https://forums.squarepenguin.co.uk/thread-2062.html And dinky had replied: "That is not a new URL format. You've just happened on a TV programme with 320k audio still available." I'm not going to attempt to arbitrate between you !-) Let's instead look at the script. First we have to know what difference if any the script version makes. I'm still using 3.17, and checking back I find that everything I've downloaded in almost-HD since 1/1/2019 is at 128kbps audio or less, whereas others say that the problem started for them around the beginning of July, so what versions are others using, and does the new v3.21 apparently announced today resolve the problem? If not ... In v3.17 of the script, I get the impression that the selection of streams is done in lines 5474 onwards: my $best_audio; # etc. Line 5511 appears to be the one that matches both the audio stream designation that you discussed in the forum: my ($ab, $vb) = ($1, $2) if $stream->{'URL'} =~ /audio.*?=(\d+)-video.*?=(\d+)/; Although I've created a major Perl program which works very well, Perl Regular Expressions (REs), which are what are doing the matching and capturing in this line, are something that I use so infrequently that I have to look them up whenever I do. As far as I can tell the above should match the new audio designation with its added suffix of '_eng', but I'd feel more confident if other Perl programmers here would verify this. As far as I can tell any problem lies somewhere else in the program logic surrounding the above line. ___ get_iplayer mailing list get_iplayer@lists.infradead.org http://lists.infradead.org/mailman/listinfo/get_iplayer
Re: Forum - HVF 320kbps audio streams no longer available
Please see below ... On 17/07/2019 10:28, RS wrote: This forum post may be of interest to some here. errfmt: I've noticed that the 320kbps audio streams that used to be default for hvfhd/hvfsd/hvfxsd TV seem to have disappeared and have been replaced with 128kbps streams. Looking at my series downloads the change appears to have happened around 3rd week in June, for instance Episode 4 of the 'The Planets' downloaded on 19th June has 320kbps stream, Episode 5 downloaded on 1st July has 128kbps stream. As far as I can tell all current programmes now only have the 128kbps stream available (I noticed this because Glastonbury downloads were all 128kbps). I suspect this a BBC change and there will be nothing that can be done in get_iplayer to re-enable 320kbps (but I hope I'm wrong!). dinky: Nothing get_iplayer can do about it. If someone knows that 320k audio TV streams still exist somewhere, start a new thread and explain how to find them. Thread closed. https://forums.squarepenguin.co.uk/showthread.php?tid=2055 Fortunately for me, the 320kbps radio show downloads are still available. I've just checked and all my recent downloads up to last night are all the same file size as they always have been. Unless anyone has anything more definite, such as a statement from the BBC, that suggests to me "cock-up" rather than "change of policy". Perhaps someone in a position to do so so may care to contact the BBC to enquire/complain. An obvious choice for this would be Jim, but I know that he's not been in the best of health recently, nevertheless if he or anyone else with contacts is reading this and decides to act, we may be able to find out. ___ get_iplayer mailing list get_iplayer@lists.infradead.org http://lists.infradead.org/mailman/listinfo/get_iplayer
Re: New distro.
Please see below ... On 24/06/2019 16:04, Vangelis forthnet wrote: On Mon Jun 24 11:25:50 BST 2019, MacFH - C E Macfarlane wrote: I'm surprised it worked for you, because AFAICR I'd understood that the version of Strawberry Perl used was supposed not to support XP. ... The latest GiP installer (v3.20.0) bundles a self-contained (portable) mini-package of Strawberry Perl 5.26.2.1-win32, back from mid-April 2018: https://imgur.com/AZZC0PF http://strawberryperl.com/release-notes/5.26.2.1-32bit.html As you might see, the Release Notes do NOT specify a minimum winOS version as "system requirements"; I was able to launch perl 5.26.2.1 successfully under Vista SP2 x86, but, sadly, am nowhere near an XP box to test; my gut feeling is it should properly launch there, too (I'd expect one to have kept the XP sytem as updated as possible - MSVC++ redistributables installed, etc.). The GiP installer has been compiled in the InnoSetup format, one can decompile it - for testing purposes - without actually running it via the latest version of Inno Setup Unpacker: http://innounp.sourceforge.net/ Simply, I must be wrong, yet I do seem to remember some discussion about this somewhere before, with someone on XP being unable to run newer versions of GiP. ___ get_iplayer mailing list get_iplayer@lists.infradead.org http://lists.infradead.org/mailman/listinfo/get_iplayer
Re: New distro.
Please see below ... On 23/06/2019 02:29, Peter S Kirk wrote: On 22 Jun 2019 at 22:37, MacFH - C E Macfarlane MacFH - C E Macfarlane wrote: On 22/06/2019 18:52, Peter S Kirk wrote: XP SP3 32bit GiP 3.14.0 FFMPEG N-76331-gf8d429e When upgrading from 2.x to 3.x, did you run a Windows installer or just copy in new files by hand or by using git or equivalent? Ran GiP windows installer then replaced ffmpeg with XP version fyi I use pvr not cli, if ffmpeg not XP compat file remains as untagged .ts I use only the CLI. I'm surprised it worked for you, because AFAICR I'd understood that the version of Strawberry Perl used was supposed not to support XP. ___ get_iplayer mailing list get_iplayer@lists.infradead.org http://lists.infradead.org/mailman/listinfo/get_iplayer
Re: New distro.
Please see below ... On 22/06/2019 18:52, Peter S Kirk wrote: XP SP3 32bit GiP 3.14.0 FFMPEG N-76331-gf8d429e When upgrading from 2.x to 3.x, did you run a Windows installer or just copy in new files by hand or by using git or equivalent? ___ get_iplayer mailing list get_iplayer@lists.infradead.org http://lists.infradead.org/mailman/listinfo/get_iplayer
Re: New distro.
On 21/06/2019 18:51, Peter S Kirk wrote: I run GiP under XP 32 with no problem. iirc all that is needed is to replace ffmpeg with last XP compat version# Which version? My recollection is that GiP support for XP died around the end of v2.x, whereas we're now on 3.2x. ___ get_iplayer mailing list get_iplayer@lists.infradead.org http://lists.infradead.org/mailman/listinfo/get_iplayer
Re: New distro.
Please see below ... On 20/06/2019 12:49, Jeremy Nicoll - ml gip wrote: On 2019-06-19 09:34, Jim Lesurf wrote: I've just installed the current xfce mint long-term-support distro on my main 'work' machine. Having transferred my own programs, data, etc, I find that gip now doesn't work. This seems to be because at least some of the relevant perl modules aren't installed by default. When I used to run get_iplayer under Windows, I used to install the perl of my choice, then ran cpan cpanminus to install 'cpanminus', then used that to install the perl modules that the g_ip documentation said I'd need. A quick google suggests that under linux one might use one's distro's package manager (apt or whatever) to install perl, and cpan, but then just use cpan to install perl modules (apparently outwith the control of apt or whatever). How is a perl user supposed to know whether to go to cpan/cpanminus route or expect their distro's package manager to deal with this I think we all have our methods, and I'm not convinced that mine or anyone else's is better than other possible methods, but in the confusion of suggestions, there is the possibility of important information being lost or obscured, which is that both under Linux & Windows, the LibXML libraries are a potential deadfall. In Windows, especially under 32-bit, you have to do quite a lot of pissing about to get LibXML to work with Perl at all - about a year or so ago I posted here detailed instructions for installing and running GiP on Win XP, previously assumed to be no longer possible, which covered that ground and more - and even under Linux, if you try to configure and compile the libraries manually, you may fail. As many have suggested, in Linux the easiest way is to install the relevant packages using apt-get or whatever. ___ get_iplayer mailing list get_iplayer@lists.infradead.org http://lists.infradead.org/mailman/listinfo/get_iplayer
Re: New distro.
Hi Jim ... On 19/06/2019 09:34, Jim Lesurf wrote: I've just installed the current xfce mint long-term-support distro on my main 'work' machine. Having transferred my own programs, data, etc, I find that gip now doesn't work. This seems to be because at least some of the relevant perl modules aren't installed by default. However I can't work out which one(s) I need because the package names listed by synaptic I can't relate to the specific items/locations gip lists as being awol. The problem seems to be with "XML/libXML.pm" - although it may well be more than that. I can't tell as I know zip about perl. Can someone please explain which packages I should install for gip to work as usual? I need various modules for Perl to run GiP, GetFlashVideos (doesn't work any more, use YouTube-Dl instead), and the W3c web page checking script. The complete list I have been using is as follows, but it's been a long time since I used it last, so I don't know how up-to-date it is, and I've forgotten which modules relate to which requirement: Authen::SASL Compress::Zlib Crypt::Rijndael LWP Module::Find MP3::Info MP3::Tag Net::SMTP::SSL Net::SMTP::TLS Net::SMTP::TLS::ButMaintained Term::ProgressBar WWW::Mechanize XML::Simple Data::AMF AFAICR, LibXML is a dependency of XML::Simple, and, as you suggest, on Ubuntu systems you install a module using apt-get. I setup and configure Ubuntu using a bash script, and its module list contains libxml2 and libxml2-dev, so most probably they're the ones you need. HTHs Charles. ___ get_iplayer mailing list get_iplayer@lists.infradead.org http://lists.infradead.org/mailman/listinfo/get_iplayer
Re: get_iplayer odd behaviour
Please see below ... On 12/06/2019 15:11, artisticforge Niemand wrote: Hello get_iplayer-3.18 (yes, i know it is not the latest) aperiodically while downloading a media file will drop the connection, reconnect and upon reconnecting starts re downloading from Zero bytes. it just did it on a file that was 95% complete over 4GB all ready downloaded upon reconnecting it began downloading all over again from the beginning. What causes this to happen? I am not asking that it be "solved". I would just like to know why it happens. Usually this means that you're connection is either flaky and the connection really is being dropped, or else so slow that either GiP or the BBC server thinks that the connection has been lost and pulls the plug on it anyway. I used to have this happen frequently, but that was at the time of v2.x, and with that version you could use options to extend GiP timeout period, but I'm not sure that those options are still valid in v3.x. FTR they were: Radio hlsradioopts --timeout 100 rtmpradioopts --timeout 100 Video hlstvopts --timeout 100 rtmptvopts --timeout 100 ___ get_iplayer mailing list get_iplayer@lists.infradead.org http://lists.infradead.org/mailman/listinfo/get_iplayer
Re: New Computer
Please see below ... On 03/04/2019 16:17, CJB wrote: > Hi - thanks for all of th tips. It all worked OK Glad to have helped. > except that TextPad > refused to delete all of the duplicate lines. I'm surprised by that, but perhaps that's one of the ways they cripple the free-trial version. > And I found the History file actually duplicated in both folders: > > .get_iplayer > .get_iplayer/pvr That's odd. I suspect the one in the pvr sub-directory must have been created spuriously somehow. > But the web PVR does seem to run OK. Perhaps I should have mentioned that the duplicated lines don't matter, except that they slow down GiP unnecessarily, and therefore it's best to remove them. I'm not sure what's causing the extra copy of the history file in pvr, but it may that something is changing to that sub-directory either before GiP is called, or else during its running. ___ get_iplayer mailing list get_iplayer@lists.infradead.org http://lists.infradead.org/mailman/listinfo/get_iplayer
Re: New Computer
Please see below ... On 03/04/2019 12:56, S Byers wrote: Small additional issue is merging the two History files! As previously noted, though with a slight error, if the two PCs have different *download directories*, then the paths in the history files will be different. If reconciliation between the two is going to be a regular job, then I've written a Perl script that does it, however, it takes some setting up to get it running in the first place, and so certainly would be overkill for a one-off job. I never got very far with the documentation of it, but the script itself is quite well documented in the form of comments. FTR, it's here: www.macfh.co.uk/Test/GiP.html However, you will most likely want to do this once, and therefore by hand. You will need a decent text editor, perhaps Notepad will do, but it will require a great deal more boring manual work than using something like Textpad, which I have used for many years and have no hesitation in recommending. You can download a free trial version, which AFAICR will allow saving, and if you like it you can pay a relatively small sum and get to keep what is just about the best programmer's text editor there is. My sole gripe about it is that the author will not produce a Linux version. Note also that it will automatically back-up every so many minutes, thus overwriting the file you are working on with your recent changes - mostly this is desirable, but sometimes it's a nuisance. https://www.textpad.com/ A procedure for reconciling the history would be as follows. 1 Back up the history files on both PCs; 2 Also make a working copy of each to a different name, giving the copies on each PC *different* names from each other; 3 Copy the working copy from one of the PCs to the other; 4 On the PC that now has both, load each into different tabs of a good text editor; 5 For each file in its tab, do a global change and replace to remove the paths of the downloads in field 7 and replace it with a dummy that will be found uniquely in a subsequent global change & replace - '<<>>', without the single quotes, would do very nicely. 6 Select all of one file in its tab and copy and paste it at the end of the other, thus appending it. You can now close the source tab and work only with the merged tab. 7 You now have to sort the file in the merged tab and delete all the duplicated lines. This is where Textpad scores over other editors such as Notepad, in it choose ... Tools, Sort, and select Delete duplicate lines ... whereas for Notepad, I'm afraid it's got to be done by hand, though you can at least sort it by copying and pasting it into a single column of a spreadsheet, sorting it there, and then copying and pasting it back into the text editor again. 8 Once, however it has been done, the duplicates have been removed from the merged tab, save this file twice, once to each of the working copy names. 9 Reload each working copy, for the moment they are identical, in a separate tab. 10 In each tab do a global change and replace to change '<<>>', or whatever dummy was chosen, back to the correct download path for each PC. 11 Check each file carefully to ensure it looks correct. 12 Save the results. 12 Copy the one working copy back to its own PC, and on each PC, remembering that you should have begun by making a backup of each download history, copy the working copy over the actual download history. ___ get_iplayer mailing list get_iplayer@lists.infradead.org http://lists.infradead.org/mailman/listinfo/get_iplayer
Re: New Computer
Please see below ... On 03/04/2019 09:36, CJB wrote: > Just a quick question - installing get_player on a new computer I need > to transfer the History and PVR List files across (likely using a USB > drive). I know that they are in the \User\get_iplayer folder. But what > are these called? And what other files need to be copied across. > Thanks. Chris B. \download_history \pvr The latter is a subdirectoy. But why not just copy the whole profile directory? That's what I would do. There are other things in it which certainly used to be important and may still be so, such as: .swfinfo cookies.desktop options *.cache Note that if you've moved the profile directory to elsewhere on the new computer, all the paths in the download_history will be wrong. This will probably only matter in unusual circumstances, but you could do a global change and replace and save the file as edited. Mention of which reminds me ... Note also that if you are moving these files from, say, a Windows PC to a Linux PC, you will need to change the line-endings in the files using dos2unix or similar. ___ get_iplayer mailing list get_iplayer@lists.infradead.org http://lists.infradead.org/mailman/listinfo/get_iplayer
Re: Steam radio...
Please see below ... On 17/03/2019 16:32, Nick wrote: On Sun, 17 Mar 2019 14:08:32 + (GMT) Jim web wrote: I'll experiment a bit more, then abandon this if I get no-where. I can live without the relevant files. I was just curious about the 'radio' ones in particular. Either way: thanks to everyone for the help/ideas. Jim I got all the video files in one go with this lengthy, but one line command: wget -qO- http://www.bbc.co.uk/archive/steamtrains/ | grep 'http://www.bbc.co.uk\1@' | sort | uniq | xargs -L1 get_iplayer.294 This got the audio files. The difference being a class in the HTML that grep looks for. And gip needed an extra clue about what it was downloading. wget -qO- http://www.bbc.co.uk/archive/steamtrains/ | grep 'more_home" href="/archive/steamtrains/[0-9]*\.shtml' | sed -e 's@.*\(/archive/steamtrains/[0-9]*\.shtml\).*@http://www.bbc.co.uk\1@' | sort | uniq | xargs -L1 get_iplayer.294 --type radio --modes=flashaudio1 With some modificiations to suit my circumstances, this looks as though it's working for me, though I'm still on the TV, so haven't tried the radio. Well done that man! ___ get_iplayer mailing list get_iplayer@lists.infradead.org http://lists.infradead.org/mailman/listinfo/get_iplayer
Re: Steam radio...
Please see below ... On 17/03/2019 15:37, RS wrote: wget http://www.bbc.co.uk/mediaselector/4/gtis/?server=cp47317.edgefcs.net=archive/white/OAT_BBC_7312=akamai=ondemand You beat me to it! However, your error message was caused by failing to put quotes around the URL ... $ wget "http://www.bbc.co.uk/mediaselector/4/gtis/?server=cp47317.edgefcs.net=archive/white/OAT_BBC_7312=akamai=ondemand; --2019-03-17 16:08:20-- http://www.bbc.co.uk/mediaselector/4/gtis/?server=cp47317.edgefcs.net=archive/white/OAT_BBC_7312=akamai=ondemand Resolving www.bbc.co.uk... 212.58.244.66, 212.58.249.208 Connecting to www.bbc.co.uk|212.58.244.66|:80... connected. HTTP request sent, awaiting response... 200 OK Length: 366 [text/xml] Saving to: `index.html@server=cp47317.edgefcs.net=archive%2Fwhite%2FOAT_BBC_7312=akamai=ondemand' 100%[==>] 366 1.48K/s in 0.2s 2019-03-17 16:08:20 (1.48 KB/s) - `index.html@server=cp47317.edgefcs.net=archive%2Fwhite%2FOAT_BBC_7312= akamai=ondemand' saved [366/366] The downloaded file's contents were revealed by cat as follows ... $ cat "index.html@server=cp47317.edgefcs.net=archive%2Fwhite%2FOAT_BBC_7312=akamai=ondemand" version="0.1">cp47317.edgefcs.netarchive/white/OAT_BBC_7312auth=daEaaa_dZdMdPd5a9a.cfbgducycHcdbec6-bCJNd1-bWG-BnoGBqEqGEuEowEaifp=v001slist=archive/white/OAT_BBC_7312akamaiondemandUK ___ get_iplayer mailing list get_iplayer@lists.infradead.org http://lists.infradead.org/mailman/listinfo/get_iplayer
Re: Steam radio...
Please see below ... On 17/03/2019 10:10, Jim web wrote: Can someone explain what I'm doing wrong or missing? If not, I'll look at the 'youtube' approach. (Will that work for 'radio' examples, BTW?) I can't necessarily help with this specific problem, but recently I was trying to download a video on this page https://www.bbc.co.uk/music/artists/49cb68dc-f515-498a-b38b-c5e5d8c31085 ... of Olivia Chaney singing Roman Holiday, but initially was unable to do so. Eventually I copied all the page's HTML source into a programmer's text editor (the wonderful TextPad), and used regular expression find and replace to remove everything except the BBC links in the page source, which left me with them in a list with no duplicates; then it was simply a question of trying each one until I found one that GiP or YTD would download, which eventually I did. FTR, in case it may be helpful in spotting a pattern, it was ... perl C:\Programs\GetIPlayer\get_iplayer.pl --pid p06ks6fd ... that worked. Undeniably a tedious chore, but successful in the end. ___ get_iplayer mailing list get_iplayer@lists.infradead.org http://lists.infradead.org/mailman/listinfo/get_iplayer
Re: Feature/Changed Behaviour Request To Exclude Option
Please see below ... On 22/02/2019 12:25, MacFH - C E Macfarlane wrote: Please see below ... On 21/02/2019 22:35, David Cantrell wrote: On 2019-02-21 20:38, MacFH - C E Macfarlane wrote: Currently, if you specify an --exclude option on the command line, it overwrites any exclusions permanently specified in the options file. Would it not make more sense that any exclusions specified on the command line are *added* to those in the options file? A common idiom in other tools is to have something like: --exclude blah # exclude blah and *only* blah --exclude +blah # exclude blah in addition to anything else already excluded Certainly, that would be ideal in giving us the best of both worlds. However, there is a problem, perhaps two, with that particular syntax in GiP. The first is that the exclude option is a Regular Expression, so the + sign has a special meaning, and gives an RE error when used as above. The possible second is that on Windows machines + is a parameter separator for some commands, for example COPY. So we'd need a similar syntax, but using a different prefix symbol. A tilde ~ might be a good choice for this, as, AFAIK, it is inert in most operating systems; that is to say, I'm not aware of any special meaning attached to it within command lines. As for actual perl code to merge the options, the merge itself is very easy to do - my gip.pl script that I've linked before does it when merging two option files from two different PCs. I suspect the major difficulty, at least for me not knowing my way around the get_iplayer.pl script, is ensuring that the command-line is parsed appropriately and the parameter, including the special prefix character, is passed intact to the section of code that deals with exclusions. There are probably other parameters where such a syntax would be useful. ___ get_iplayer mailing list get_iplayer@lists.infradead.org http://lists.infradead.org/mailman/listinfo/get_iplayer