BBC Archive - Great Egg race download problems
Hi, I've been trying to work out how to download episodes of the Great Egg Race from the BBC archive site. I'm actually just wanting to watch them, to be honest, but not on a desktop and the episodes seem to be only on Flash, so mobile devices don't play them. Specifically http://www.bbc.co.uk/archive/great_egg_race/10801.shtml and using get_player (2.91) on OS X Yosemite gives: $ get_iplayer --url http://www.bbc.co.uk/archive/great_egg_race/10801.shtml INFO: Trying pid: http://www.bbc.co.uk/archive/great_egg_race/10801.shtml using type: tv INFO: Trying to stream pid using type tv INFO: pid not found in tv cache Matches: INFO: 1 Matching Programmes ERROR: Failed to get version pid metadata from iplayer site INFO: Trying pid: http://www.bbc.co.uk/archive/great_egg_race/10801.shtml using type: radio INFO: Trying to stream pid using type radio INFO: pid not found in radio cache Matches: INFO: 1 Matching Programmes ERROR: Failed to get version pid metadata from iplayer site If anyone can point me to how I can do this, I'd be grateful. Thanks, Jimmy ___ get_iplayer mailing list get_iplayer@lists.infradead.org http://lists.infradead.org/mailman/listinfo/get_iplayer
Re: BBC Archive - Great Egg race download problems
Jimmy Aitken jimmy.ait...@gmail.com wrote: Hi, I've been trying to work out how to download episodes of the Great Egg Race from the BBC archive site. I'm actually just wanting to watch them, to be honest, but not on a desktop and the episodes seem to be only on Flash, so mobile devices don't play them. Specifically http://www.bbc.co.uk/archive/great_egg_race/10801.shtml and using get_player (2.91) on OS X Yosemite gives: $ get_iplayer --url http://www.bbc.co.uk/archive/great_egg_race/10801.shtml INFO: Trying pid: http://www.bbc.co.uk/archive/great_egg_race/10801.shtml using type: tv INFO: Trying to stream pid using type tv I wonder why tv here turns into radio a few lines further on? INFO: pid not found in tv cache Matches: INFO: 1 Matching Programmes ERROR: Failed to get version pid metadata from iplayer site INFO: Trying pid: http://www.bbc.co.uk/archive/great_egg_race/10801.shtml using type: radio INFO: Trying to stream pid using type radio INFO: pid not found in radio cache (I dunno how to fix it.) -- Jeremy Nicoll - my opinions are my own. ___ get_iplayer mailing list get_iplayer@lists.infradead.org http://lists.infradead.org/mailman/listinfo/get_iplayer
Re: BBC Archive - Great Egg race download problems
On Mon Mar 9 12:02:10 GMT 2015, Jimmy Aitken wrote: I've been trying to work out how to download episodes of the Great Egg Race from the BBC archive site. Specifically http://www.bbc.co.uk/archive/great_egg_race/10801.shtml If anyone can point me to how I can do this, I'd be grateful. Hi :-) This archived program is UK-only; use Mozilla Firefox and its Web Console to perform URL sniffing; upon loading the URL in question, you'll get in the console the playlist URL of the vid: http://www.bbc.co.uk/archive/xml/10/801.xml (further sniffing reveals the mediaselector/4 API URL: http://www.bbc.co.uk/mediaselector/4/gtis/?server=cp47317.edgefcs.netidentifier=archive/white/OAT_BBC_10801kind=akamaiapplication=ondemand - geo-filtered; produces results only from a UK IP - and from then on you can construct yourself the rtmpdump download command: rtmpdump -r rtmp://cp47317.edgefcs.net:1935/ondemand -a ondemand?auth=daEaxcmbhakdCaMbzb1bXd1bMb3bBcnb.aG-bu_Cu8-bWG-EpnEHnwqNBvFsxFaifp=v001slist=archive/white/OAT_BBC_10801 -f WIN 16,0,0,305 -W http://www.bbc.co.uk/emp/10player.swf; -p http://www.bbc.co.uk/archive/great_egg_race/10801.shtml; -C O:1 -C O:0 -y archive/white/OAT_BBC_10801?auth=daEaxcmbhakdCaMbzb1bXd1bMb3bBcnb.aG-bu_Cu8-bWG-EpnEHnwqNBvFsxFaifp=v001slist=archive/white/OAT_BBC_10801 -o OAT_BBC_10801.flv RTMPDump v2.4 GIT-2014-03-02 (Compiled by KSV) (c) 2010 Andrej Stepanchuk, Howard Chu, The Flvstreamer Team; license: GPL Connecting ... INFO: Connected... Starting download at: 0.000 kB INFO: Metadata: INFO: duration2097.04 INFO: width 384.00 INFO: height 288.00 INFO: videodatarate 375.00 INFO: canSeekToEndFALSE INFO: videocodecid2.00 INFO: audiodatarate 128.00 INFO: audiocodecid2.00 INFO: framerate 25.00 INFO: creationdateTue Aug 17 13:58:02 2010 133556.830 kB / 2097.03 sec (99.9%) Download complete The FLV file downloaded uses older video/audio codecs (Video Format : Sorenson Spark Audio Format : MPEG Audio Format version : Version 1 Format profile : Layer 3) so I am uncertain as to if it could be played back in recent mobile devices without prior transcoding of the video stream; a simple remux to the MP4/AVI container just won't work... :-( At dinkypumpkin (I know you no longer post to the list, but you are still reading it) : I have tried with 2.91 to use the CLI command: get_iplayer --type=tv --url=http://www.bbc.co.uk/archive/xml/10/801.xml; --modes=best --swfurl=http://www.bbc.co.uk/emp/10player.swf?revision=18269_21576; --raw but it fails: C:\Program Files\get_iplayerperl get_iplayer-291.pl --url=http://www.bbc.co.uk /archive/xml/10/801.xml --modes=best --swfurl=http://www.bbc.co.uk/emp/10playe r.swf?revision=18269_21576 --raw get_iplayer v2.91, Copyright (C) 2008-2010 Phil Lewis This program comes with ABSOLUTELY NO WARRANTY; for details use --warranty. This is free software, and you are welcome to redistribute it under certain conditions; use --conditions for details. INFO: Trying pid: http://www.bbc.co.uk/archive/xml/10/801.xml using type: tv INFO: Trying to stream pid using type tv INFO: pid not found in tv cache Matches: INFO: 1 Matching Programmes INFO: Checking existence of default version INFO: flashnormal1 modes will be tried for version default INFO: Trying flashnormal1 mode to record tv: - - INFO: File name prefix = The_Great_Egg_Race_-__http_www.bbc.co.uk_archive_xml_10 _801.xml_default RTMPDump v2.4 GIT-2015-01-15 (Compiled by KSV) (c) 2010 Andrej Stepanchuk, Howard Chu, The Flvstreamer Team; license: GPL Connecting ... INFO: Connected... ERROR: rtmp server sent error ERROR: rtmp server requested close INFO: Command exit code 1 (raw code = 256) WARNING: Failed to stream file D:\Vangelis\iPlayer Recordings\The_Great_Egg_Race _-__http_www.bbc.co.uk_archive_xml_10_801.xml_default.partial.flv via RTMP INFO: skipping flashnormal1 mode ERROR: Failed to record 'The Great Egg Race - - (http://www.bbc.co.uk/archive/x ml/10/801.xml)' C:\Program Files\get_iplayer The Akamai server rejects the connection and I initially thought this was related to VPN blacklisting, but I can stream the vid on my browser using the same VPN IP; further debugging this using --debug dbglog.txt 21 in my previous GiP command reveals that GiP is formulating a wrong rtmpdump command: RTMPDump v2.4 GIT-2015-01-15 (Compiled by KSV) (c) 2010 Andrej Stepanchuk, Howard Chu, The Flvstreamer Team; license: GPL DEBUG: Protocol : RTMP DEBUG: Hostname : cp47317.edgefcs.net DEBUG: Port : 1935 DEBUG: Playpath : archive/white/OAT_BBC_10801 DEBUG: tcUrl: rtmp://cp47317.edgefcs.net:80/ondemand?_fcs_vhost=cp47317.edgefcs.netundefinedundefined DEBUG: swfUrl : http://www.bbc.co.uk/emp/10player.swf?revision=18269_21576 DEBUG: pageUrl : DEBUG: app
Re: Episode numbers missing
It's not on all of the programmes. It only seems to be the case where the episode has a number and a title. An example of where there is a problem is Great British Railway Journeys. The title field used to be in the format: 19: Place A to place B Now it's just: Place A to place B So where you have a multi-part series it becomes a job putting the episodes into order. There are quite a few programmes like this. I notice that when gip seeks the programme it has the full details but that seems to get lost when the file is downloaded! But there are other programmes where the episode doesn't have name that the title field merely shows: Episode 3. I'm nearing the end of a two month stay in the Philippines - I've been accessing my PC back home using TeamViewer to set up recordings on my home PC for programmes I want to download. It's too onerous trying to amend the file names manually when I'm working on a painfully slow internet connection here in the Philippines. So it will mean going back over the archives to try to put episodes into order when I get home! I'll try your suggestions when I get home, many thanks. Alan On 08/03/2015 17:29, Dave Liquorice wrote: On Sun, 08 Mar 2015 16:13:20 +0800, Alan Milewczyk wrote: Running v2.91 on Win 7 x64. Not sure if it's something I've done but I've noticed that in the last few weeks where a TV episode used to have an episode number and name in the title field, now just the name appears. All TV series or just some? Filename on disc or that presented by a front end? I use fileprefix senum.episodeshort.pid in my options file and most of the time it works but the BBC is inconsistent in where it places series/episode numbers. Of the series I routinely collect Horizon is the worst. What series/season info there is is in GIP's name field, episode info might be totally abscent. And what info is provided doesn't match that used by thetvdb.com, the latter is fairly consistent in it's specials/series/episode numbering. ___ get_iplayer mailing list get_iplayer@lists.infradead.org http://lists.infradead.org/mailman/listinfo/get_iplayer
Re: BBC Archive - Great Egg race download problems
Your valuable insight on this may be needed - either I am not using the correct GiP command or GiP needs to be patched (for the exotic user case scenario as the OP's). If you tell GiP to use --mediaselector=4 it seems to download successfully. The command I used in the end was get_iplayer --modes=best --url=http://www.bbc.co.uk/archive/xml/10/801.xml; --force --mediaselector=4 Normally you would use the page url http://www.bbc.co.uk/archive/great_egg_race/10801.shtml; in the command and GiP would find the .xml from that, but it seems here you need to use the .xml Vangelis found as the url for it to work. ___ get_iplayer mailing list get_iplayer@lists.infradead.org http://lists.infradead.org/mailman/listinfo/get_iplayer
Re: BBC Archive - Great Egg race download problems
On Mon Mar 9 20:13:58 GMT 2015, tellyaddict wrote: If you tell GiP to use --mediaselector=4 it seems to download successfully. Normally you would use the page url http://www.bbc.co.uk/archive/great_egg_race/10801.shtml; in the command and GiP would find the .xml from that DP fixed it tonight in the develop branch - with the first post of this thread issue #138 was created in the GitHub tracker: https://github.com/get-iplayer/get_iplayer/issues/138 Commit develop-git-067d7f3 https://github.com/get-iplayer/get_iplayer/commit/067d7f3fd078a06923a26526a07988d1458a63bc fixed the extraction of the playlist URL from the page URL, then commits develop-git-229b60f https://github.com/get-iplayer/get_iplayer/commit/229b60fb96224b664b2d7cbb926a90c93398404e and develop-git-9f5ff59 https://github.com/get-iplayer/get_iplayer/commit/9f5ff598714f704c9fe2030dc579e3d281504dc3 reinstated ms4/API and automatically use it for archive pages. I verified that perl get_iplayer-develop-2.92-g9f5ff59.pl --url=http://www.bbc.co.uk/archive/great_egg_race/10801.shtml; --modes=best --swfurl=http://www.bbc.co.uk/emp/10player.swf?revision=18269_21576; --raw --force succeeds when issued from a UK IP. Link to the latest version of the script from the develop branch: https://raw.githubusercontent.com/get-iplayer/get_iplayer/9f5ff598714f704c9fe2030dc579e3d281504dc3/get_iplayer Users of OS X Yosemite could advise the OP on how to use that to rectify his issue... Regards, Vangelis. ___ get_iplayer mailing list get_iplayer@lists.infradead.org http://lists.infradead.org/mailman/listinfo/get_iplayer
