Re: [OSM-dev] OSM API lookups to complement minutely diffs?

2016-09-18 Thread mmd
Hi, Am 18.09.2016 um 14:41 schrieb Michael Larsen: > Hi, > > Last time I tried consuming augmented diffs on a minutely basis, I hit the > load-limitations which meant that I could not consume augmented diffs for > some > time afterwards, i.e. this will lead to black holes in your history. the

Re: [OSM-dev] OSM API lookups to complement minutely diffs?

2016-09-18 Thread Michael Larsen
Hi, Last time I tried consuming augmented diffs on a minutely basis, I hit the load-limitations which meant that I could not consume augmented diffs for some time afterwards, i.e. this will lead to black holes in your history. Also, using timestamp start/end to fetch diffs for a given timestamp

Re: [OSM-dev] OSM API lookups to complement minutely diffs?

2016-09-17 Thread Stefan Keller
Thanks mmd, As said, I'd like to fetch the latest available augmented diff and keep uptodate. So, to understand it correctly: Every minute I first call the http://overpass-api.de/api/augmented_diff_status which returns an id, e.g. 2111988, then I fetch the augmented diff file http://overpass-api.d

Re: [OSM-dev] OSM API lookups to complement minutely diffs?

2016-09-17 Thread Pierre Béland
, you wont obtain all content included in the minutely diffs.   Pierre De : mmd À : dev@openstreetmap.org Envoyé le : samedi 17 Septembre 2016 10h48 Objet : Re: [OSM-dev] OSM API lookups to complement minutely diffs? Am 15.09.2016 um 22:53 schrieb Stefan Keller: > I'm sett

Re: [OSM-dev] OSM API lookups to complement minutely diffs?

2016-09-17 Thread mmd
Am 15.09.2016 um 22:53 schrieb Stefan Keller: > I'm setting up a Kafka publish-subscribe messaging system delivering > minutely diffs. > > AFAIK augmented diffs are rather an experimental feature and I'd like > to avoid the latency time and blackouts of overpass which runs in same > server. So I'm

Re: [OSM-dev] OSM API lookups to complement minutely diffs?

2016-09-16 Thread Stefan Keller
2016-09-16 5:59 GMT+02:00 Paul Norman : > No, particularly if your code takes off and multiple people start running > it. I would guess that it would hit rate limits and be automatically > blocked. Got that - though the pub-sub messaging system in fact could cache the data thus taking over the loa

Re: [OSM-dev] OSM API lookups to complement minutely diffs?

2016-09-16 Thread Stefan Keller
2016-09-16 1:30 GMT+02:00 Frederik Ramm : > This reads to me like: > > "There is a third-party service that solves the problem I have, but > because it is experimental, I would like to build my own experimental > third-party service instead" ;) You convinced me to use augmented diffs with your irr

Re: [OSM-dev] OSM API lookups to complement minutely diffs?

2016-09-15 Thread Paul Norman
On 9/15/2016 1:53 PM, Stefan Keller wrote: Is it OK to do API lookups like this https://www.osm.org/api/0.6/nodes?nodes=59906080,4400821613 even for minutely diffs? Any alternatives? No, particularly if your code takes off and multiple people start running it. I would guess that it would hit

Re: [OSM-dev] OSM API lookups to complement minutely diffs?

2016-09-15 Thread Frederik Ramm
Hi, On 09/15/2016 10:53 PM, Stefan Keller wrote: > AFAIK augmented diffs are rather an experimental feature and I'd like > to avoid the latency time and blackouts of overpass which runs in same > server. So I'm concentrating on the main OSM API. This reads to me like: "There is a third-party ser

Re: [OSM-dev] OSM API lookups to complement minutely diffs?

2016-09-15 Thread Ian Dees
On Thu, Sep 15, 2016 at 4:53 PM, Stefan Keller wrote: > I'm setting up a Kafka publish-subscribe messaging system delivering > minutely diffs. > > AFAIK augmented diffs are rather an experimental feature and I'd like > to avoid the latency time and blackouts of overpass which runs in same > serve