Re: Unable to refresh
Just in case there is an extended period until get-iplayer can refresh its cache again, daily radio and tv cache files are still available from https://schedules.github.io/ess/ Mike ___ get_iplayer mailing list get_iplayer@lists.infradead.org http://lists.infradead.org/mailman/listinfo/get_iplayer
BBC Clifton API JSON data (attn: Martin Powell)
As we got shown the door at the forum, I hope it's not too off-topic to post this here. To clarify, this data is not mine or generated by me, it comes straight from the BBC's replacement for the data sources they shut down back in April/May. It *could* be used by get_iplayer to reinstate the lost category information, should the maintainer so wish. Using the BBC's normal category names, it's possible to get a list of all currently available PIDs for that category by fetching the data from a URL such as: http://clifton.api.bbci.co.uk/aps/programmes/genres/drama/scifiandfantasy/player/episodes.json I'd suggest using cURL or wget to fetch the data, but you should be able to save it from a browser. If you need a list of categories, they're available here: http://www.bbc.co.uk/programmes/genres.json As the JSON output is somewhat difficult to read (especially if it's all on one line), I'd suggest using the jq programme (https://stedolan.github.io/jq/) to query / reformat it. An example of the syntax is: jq '. | .episodes[].programme | .pid+","+.display_titles.title+","+.title' scifi.json cURL, wget and jq are all available for Windows, Mac and Linux. Cheers, Mike ___ get_iplayer mailing list get_iplayer@lists.infradead.org http://lists.infradead.org/mailman/listinfo/get_iplayer
Re: BBC Programmes API JSON feeds
Hi Anthony,
Most of the information is freely available on GitHub, specifically
https://github.com/bbc/programmes-clifton and in this case
https://github.com/bbc/programmes-clifton/blob/master/app/config/routing.yml
The API hostname just took a bit of trial and error. :)
As to longevity, your guess is as good as mine, but probably as long as it
takes the BBC to rewrite their programmes-frontend project. The only date we
have been given is: "The remaining JSON feeds will remain in operation until
May 1, 2018."
I think iterating through the A-Z lists is the best way to generate a complete
list of PIDs, unless you just want the aggregated schedule data for the last
month, in which case I would suggest looking at https://schedules.github.io/ess
Mike
Sent: Monday, July 10, 2017 at 5:21 PM
From: "Anthony Fletcher" <anth...@bifb.org>
To: "gip list" <get_iplayer@lists.infradead.org>
Subject: Re: BBC Programmes API JSON feeds
Thanks Mike - how did you discover them? Any idea of their longevity?
and is there a way of getting a complete list of PIDs other than looking
at
/aps/programmes/a-z/by/{search}.json
for every letter in the alphabet?
Anthony.
On 08 Jul 2017 at 16:36:46, Mike Ralphson wrote:
> Hi,
>
> I know a number of subscribers maintain their own scripts which use (or used)
> a number of the BBC feeds which were recently retired.
>
> It may be of interest that a number of the feeds are now available at:
>
> http://clifton.api.bbci.co.uk/
>
> with URLs matching the following routes
>
> /aps/programmes/{pid}/episodes/{year}/{month}.json
> /aps/programmes/{pid}/episodes/last.json
> /aps/programmes/{pid}/episodes/upcoming.json
> /aps/programmes/{pid}/episodes.json
> /aps/programmes/{pid}/children.json
> /aps/programmes/{pid}/segments.json
> /aps/programmes/{pid}/series.json
> /aps/programmes/{pid}.json
> /aps/programmes/{categoryType}.json
> /aps/programmes/{categoryType}/{urlKeyHierarchy}/schedules/upcoming.json
> /aps/programmes/{categoryType}/{urlKeyHierarchy}/player/episodes.json
> /aps/programmes/{categoryType}/{urlKeyHierarchy}/{slice}.json
> /aps/programmes/{categoryType}/{urlKeyHierarchy}/schedules/{year}/{month}/calendar.json
> /aps/programmes/{categoryType}/{urlKeyHierarchy}/schedules/{year}/{month}/{day}/subcategories.json
> /aps/programmes/{categoryType}/{urlKeyHierarchy}/schedules/{year}/{month}/{day}.json
> /aps/programmes/{categoryType}/{urlKeyHierarchy}.json
> /aps/{networkKey}/programmes/music/artists/charts.json
> /aps/programmes/music/artists/charts.json
> /aps/programmes/music/artists/{musicBrainzId}.json
> /aps/programmes/a-z.json
> /aps/programmes/a-z/{slice}.json
> /aps/programmes/a-z/by/{search}.json
> /aps/programmes/a-z/by/{search}/{slice}.json
> /availability/{pid}.json
> /
> /debug/{serviceName}/{serviceMethod}
>
> Where {categoryType} is either genres or formats, and {urlKeyHierarchy} is
> either a category/format such as drama, or a wider/narrower pair such as
> comedy/sitcoms.
>
> {slice} is either player or all.
>
> Most URLs take a 'page=' parameter.
>
> Best,
>
> Mike
>
___
get_iplayer mailing list
get_iplayer@lists.infradead.org
http://lists.infradead.org/mailman/listinfo/get_iplayer
BBC Programmes API JSON feeds
Hi,
I know a number of subscribers maintain their own scripts which use (or used) a
number of the BBC feeds which were recently retired.
It may be of interest that a number of the feeds are now available at:
http://clifton.api.bbci.co.uk/
with URLs matching the following routes
/aps/programmes/{pid}/episodes/{year}/{month}.json
/aps/programmes/{pid}/episodes/last.json
/aps/programmes/{pid}/episodes/upcoming.json
/aps/programmes/{pid}/episodes.json
/aps/programmes/{pid}/children.json
/aps/programmes/{pid}/segments.json
/aps/programmes/{pid}/series.json
/aps/programmes/{pid}.json
/aps/programmes/{categoryType}.json
/aps/programmes/{categoryType}/{urlKeyHierarchy}/schedules/upcoming.json
/aps/programmes/{categoryType}/{urlKeyHierarchy}/player/episodes.json
/aps/programmes/{categoryType}/{urlKeyHierarchy}/{slice}.json
/aps/programmes/{categoryType}/{urlKeyHierarchy}/schedules/{year}/{month}/calendar.json
/aps/programmes/{categoryType}/{urlKeyHierarchy}/schedules/{year}/{month}/{day}/subcategories.json
/aps/programmes/{categoryType}/{urlKeyHierarchy}/schedules/{year}/{month}/{day}.json
/aps/programmes/{categoryType}/{urlKeyHierarchy}.json
/aps/{networkKey}/programmes/music/artists/charts.json
/aps/programmes/music/artists/charts.json
/aps/programmes/music/artists/{musicBrainzId}.json
/aps/programmes/a-z.json
/aps/programmes/a-z/{slice}.json
/aps/programmes/a-z/by/{search}.json
/aps/programmes/a-z/by/{search}/{slice}.json
/availability/{pid}.json
/
/debug/{serviceName}/{serviceMethod}
Where {categoryType} is either genres or formats, and {urlKeyHierarchy} is
either a category/format such as drama, or a wider/narrower pair such as
comedy/sitcoms.
{slice} is either player or all.
Most URLs take a 'page=' parameter.
Best,
Mike
___
get_iplayer mailing list
get_iplayer@lists.infradead.org
http://lists.infradead.org/mailman/listinfo/get_iplayer
Centralised 30-day tv / radio cache data
If you have a break from refreshing get_iplayer's cache (e.g. if you are away) and this creates holes in your cache history, or if you have a very slow internet connection and web-scraping is not performant enough, or if you are for some reason stuck on an older version of get_iplayer, you may be interested in a source of centralised downloadable tv / radio cache data. Obviously you should back up your tv and radio caches before trying this. https://schedules.github.io/ess/ You can dowload the compiled cache files (built once per day) or the raw schedule data. If any channels are missing, please let me know and I will add them, similarly if any problems are found with the format of the data. You may find the channel ids used are not the same as in get_iplayer, so this may affect searches or filtering by channel id/name. Cheers, Mike ___ get_iplayer mailing list get_iplayer@lists.infradead.org http://lists.infradead.org/mailman/listinfo/get_iplayer
Re: BBC RSS adaptor changes
DC> How did you manage to get a Nitro API key? DC> https://developer.bbc.co.uk/nitro[https://developer.bbc.co.uk/nitro] still says that it's only open for registration to BBC employees. In the early days of Nitro, the BBC did issue some keys to non-employees. They seem not to have expired all of them. :) Mike ___ get_iplayer mailing list get_iplayer@lists.infradead.org http://lists.infradead.org/mailman/listinfo/get_iplayer
BBC RSS adaptor changes
Following the BBC's (temporary?) disabling of the /programmes API JSON feed, I've moved the BBC-RSS adaptor here (https://bbc-rss.herokuapp.com) to a new, but slower, feed (thankfully not having to resort to scraping). All the links in the available radio and TV columns have changed, but I have set up redirects from the old locations. The links in the upcoming column were already using the new feed. I suggest you leave existing links pointing to the redirects for now in case we switch back. As I say, the new feed is somewhat slower, so if you are able to control it, I would suggest setting the timeout in your RSS reader / fetcher to something in the order of 60 seconds. If this poses significant problems going forward I will look at adding some cacheing. Individual PID feeds for brands/series (if anyone was using them) are still broken for the moment. Please let me know of any problems, either here or as an issue on GitHub - https://github.com/mermade/bbc-rss Best, Mike ___ get_iplayer mailing list get_iplayer@lists.infradead.org http://lists.infradead.org/mailman/listinfo/get_iplayer
BBC iPlayer unofficial RSS Feeds
Hi, just a note that the service at https://bbc-rss.herokuapp.com has been extended to add feeds for individual brands and series. This means an extra 40,000+ dynamic feeds are now available. For example:- Doctor Who - https://bbc-rss.herokuapp.com/rss/tv/pid/b006q2x0.rss Cabin Pressure - https://bbc-rss.herokuapp.com/rss/radio/pid/b00lmcxj.rss Just replace the PID in the url with the brand or series PID you're interested in. Individual programme PIDs will not work. You can alternatively go to https://bbc-rss.herokuapp.com/pid.html, enter the PID and select 'PID Feed'. Channel4/All4 and ITVHub programme/series IDs aren't implemented yet, but please shout if there's any demand. I have also set up a Twitter feed at @SciFiPlayer for BBC Science-Fiction, Fantasy and Horror programmes, using dlvr.it to link the RSS feeds to social media as an example of what can be done with them. Cheers, Mike ___ get_iplayer mailing list get_iplayer@lists.infradead.org http://lists.infradead.org/mailman/listinfo/get_iplayer
Re: BBC iPlayer RSS feeds including signed/audio-described
Vangelis wrote: >> Please report any issues at https://github.com/mermade/bbc-rss It's fine to report them here too as long as no-one else minds? > http://bbc-rss.herokuapp.com/rss/tv/music/all.rss > but found it also includes radio programmes; e.g. >Beeb's fault? As you have rightly guessed, this is down to how the BBC organise themselves into a Radio Player and an iPlayer which has both radio and TV programmes available. When the current feeds are switched off, and I move the RSS adaptor to Nitro, this problem will go away. I'm loath to do it yet as Nitro is still rather slow in comparison. Apologies, I forgot to mention this issue, as I'm normally only concerned with radio programmes. > Currently GiP relies on the schedule feeds, > hopefully your rss feeds will be of use if/when > something "designed to better user experience" > happens again and kills the schedule feeds, too ;-( As above, the current version is at the mercy of the /programmes feeds which are likely to disappear at the same time as the schedule feeds used by GiP. But the migration path to Nitro is there and tested. Cheers, Mike ___ get_iplayer mailing list get_iplayer@lists.infradead.org http://lists.infradead.org/mailman/listinfo/get_iplayer
Re: BBC iPlayer RSS feeds including signed/audio-described
David Cantrell wrote: >> ... unofficial BBC iPlayer RSS adaptor ... >Oh wow, how did I miss these? Thanks! Sorry, they were plugged on the get_iplayer forum, but this is the first announcement here. >> Please report any issues at https://github.com/mermade/bbc-rss >And thanks for publishing the source too - I expect I'll be able to use >that to resurrect my keyword search RSS feeds. You can generate any keyword-search based RSS feed dynamically at https://bbc-rss.herokuapp.com/rss/custom/search%20term.rss Just remember to URL encode the search term as above (i.e. replacing spaces with %20). See the 'custom search' box and Generate button to do it manually. I hope the source is useful. You may need a BBC searchSuggest API key to use the same search as this does (they are available if you know where to look), but there are alternative search endpoints (for now). Examples: http://www.bbc.co.uk/radio/programmes/a-z/by/doctor%20who/player.json http://www.bbc.co.uk/programmes/a-z/by/aberfan/player.json Cheers, Mike ___ get_iplayer mailing list get_iplayer@lists.infradead.org http://lists.infradead.org/mailman/listinfo/get_iplayer
BBC iPlayer RSS feeds including signed/audio-described
Following a request from a user, the unofficial BBC iPlayer RSS adaptor now has two new feeds for accessible TV programmes. These are: https://bbc-rss.herokuapp.com/rss/tv/accessibility/audio-described.rss https://bbc-rss.herokuapp.com/rss/tv/accessibility/signed.rss This is in addition to the over 200 existing category feeds for both TV and radio. The full list can be browsed at https://bbc-rss.herokuapp.com Please report any issues at https://github.com/mermade/bbc-rss Mike ___ get_iplayer mailing list get_iplayer@lists.infradead.org http://lists.infradead.org/mailman/listinfo/get_iplayer
BBC feed outages
Re the message: "This service is currently undergoing a period of downtime for essential maintenance. Please be advised that the programme information service which is currently available at this URL will soon be replaced by a new service from the BBC, at a new set of URLs. Please contact the following email address for further information: 'programmes-de...@lists.forge.bbc.co.uk'" Has anyone contacted the address programmes-de...@lists.forge.bbc.co.uk and had any kind of reply? Cheers, Mike ___ get_iplayer mailing list get_iplayer@lists.infradead.org http://lists.infradead.org/mailman/listinfo/get_iplayer
Re: 320kbps radio audio available via MPEG-DASH
James Scholes wrote: >If you happen to have an API key for Nitro, you can check which >mediasets are available for the program: >http://nitro.api.bbci.co.uk/nitro/api/programmes?api_key==versions_availability=b06tvhnj The BBC have just deprecated that Nitro host as well as that mixin, so that command won't work indefinitely. The replacement would be: http://programmes.api.bbc.com/nitro/api/programmes?api_key==available_versions=b06tvhnj There is a full Swagger specification (for use with clients such as Postman) here: https://raw.githubusercontent.com/Mermade/bbcparse/master/nitroApi/swagger.json and full interactive documentation here: http://mermade.github.io/swagger/index.html Cheers, Mike ___ get_iplayer mailing list get_iplayer@lists.infradead.org http://lists.infradead.org/mailman/listinfo/get_iplayer
