Re: [OSM-dev] XAPI

[Paul Hartmann]

On 07.08.2017 18:08, Simon Poole wrote:

There are multiple reasons why this is not going to work, not the least
that there have been no public native XAPI servers available for a very
long time.

See http://wiki.openstreetmap.org/wiki/Xapi


The new query system is Overpass API, which has basically superseded 
XAPI. It is a fairly simple task to extract the data for a limited 
region. However, overall there are about 800,000 objects tagged 
amanity=school in the database, so this is too much to handle for 
Overpass API in a single request.


If you are determined, you can split the world into several regions and 
download the list of schools for each separately. (Make sure to increase 
the timeout parameter, the default is somewhat low.)


Paul

___
dev mailing list
dev@openstreetmap.org
https://lists.openstreetmap.org/listinfo/dev

Re: [OSM-dev] XAPI

[Fredy Yanez]

I tried both. 


It seems like I pasted the wrong line of code here. 


Sorry about that,


Fredy


 From:   Dave F  
 To:
 Sent:   8/7/2017 4:53 PM 
 Subject:   Re: [OSM-dev] XAPI 


 
 
On 07/08/2017 17:08, Simon Poole wrote:

There are multiple reasons why this is not going to work,
 
 One of them is it's amenity=school not schools
   
   
   DaveF
 


___
dev mailing list
dev@openstreetmap.org
https://lists.openstreetmap.org/listinfo/dev
___
dev mailing list
dev@openstreetmap.org
https://lists.openstreetmap.org/listinfo/dev

Re: [OSM-dev] XAPI

[Dave F]

On 07/08/2017 17:08, Simon Poole wrote:


There are multiple reasons why this is not going to work,



One of them is it's amenity=school not schools


DaveF

___
dev mailing list
dev@openstreetmap.org
https://lists.openstreetmap.org/listinfo/dev

Re: [OSM-dev] XAPI

[Fredy Yanez]

JSON would be great!


It would be nice to get all schools (k-12) and all the information that is 
available in regards to the school ( i.e name of school, lat & long, if 
possible country, state/providence etc).


Let me know if you need anymore information.


Thanks so much!!!


Fredy 









 From:   Simon Poole  
 To:   Fredy Yanez  
 Cc:
 Sent:   8/7/2017 2:37 PM 
 Subject:   Re: [OSM-dev] XAPI 


 
I can probably do it for you, I need to know the file/data format   you 
would like and projection (I assume you want points and that   the output 
should be de-duplicated in some form). All tags? Or   just some specific 
one? 
Simon 
 
Am 07.08.2017 um 19:52 schrieb Fredy   Yanez:
  Thanks!    

  
I understand that i might not get 100% coverage. That is okay. Any data 
that I can get is useful.   

  
How would one go about contacting a friendly operator of a osm2pgsql 
server?    

  

  
Fredy
 

   
   
   From:  Simon Poole  
To:  
 
Sent:  8/7/2017 12:08 PM 
Subject:      Re: [OSM-dev] XAPI
 
 

 
There are multiple reasons why this is not going to   work, not 
the least that there have been no public   native XAPI servers 
available for a very long time. 
See http://wiki.openstreetmap.org/wiki/Xapi 
But in any case extracting anything for the whole   world from 
any API is not a good idea, I would suggest   downloading a 
planet dump and filtering the objects   out of it, or asking a 
friendly operator of a   osm2pgsql server with the whole planet 
imported to   generate a list of schools for you.   
  
The other thing to take in to account, that while we   
undoubtedly have a lot of schools in OSM and in some   areas 
will have 100% coverage this is definitely not   universal. 
  
Simon
  
 
Am 07.08.2017 um 17:43   schrieb Fredy Yanez:
  Good afternoon,    

  

  
I'm working for a no profit and our goal is to measure 
internet connectivity for every school in the world. It 
would be very beneficial is we had access to every school 
within the database. To do this I've been trying to use 
XAPI and I'm having a few errors.   

  

  
For example when I try to use XAPI URLs:   
 wget --timeout=0 
http://www.informationfreeway.org/api/0.6/node[amenity=schools] -O data.osm 
  
   
I get this link as a response:    

  
 
http://www.informationfreeway.org/noapi.html 


and in data.osm I get : 
/ 
 
  
No API 


 


I was wondering what I'm doing wrong?   
  
My guess is that I'm not authenticating or something 
along those lines. 


What is the best way to solve this problem ?
 


Thanks ! 
Fredy  
  
   ___
dev mailing list
dev@openstreetmap.org
https://lists.openstreetmap.org/listinfo/dev
  
  
   
   ___
   dev mailing list
   dev@openstreetmap.org
   https://lists.openstreetmap.org/listinfo/dev
  
___
dev mailing list
dev@openstreetmap.org
https://lists.openstreetmap.org/listinfo/dev

Re: [OSM-dev] XAPI

[Simon Poole]

I can probably do it for you, I need to know the file/data format you
would like and projection (I assume you want points and that the output
should be de-duplicated in some form). All tags? Or just some specific one?

Simon


Am 07.08.2017 um 19:52 schrieb Fredy Yanez:
> Thanks! 
>
> I understand that i might not get 100% coverage. That is okay. Any
> data that I can get is useful.
>
> How would one go about contacting a friendly operator of a osm2pgsql
> server? 
>
>
> Fredy
>
>
> *From: * Simon Poole 
> *To: * 
> *Sent: * 8/7/2017 12:08 PM
> *Subject: * Re: [OSM-dev] XAPI
>
> There are multiple reasons why this is not going to work, not the
> least that there have been no public native XAPI servers available
> for a very long time.
>
> See http://wiki.openstreetmap.org/wiki/Xapi
>
> But in any case extracting anything for the whole world from any
> API is not a good idea, I would suggest downloading a planet dump
> and filtering the objects out of it, or asking a friendly operator
> of a osm2pgsql server with the whole planet imported to generate a
> list of schools for you.
>
> The other thing to take in to account, that while we undoubtedly
> have a lot of schools in OSM and in some areas will have 100%
> coverage this is definitely not universal.
>
> Simon
>
>
> Am 07.08.2017 um 17:43 schrieb Fredy Yanez:
>> Good afternoon, 
>>
>>
>> I'm working for a no profit and our goal is to measure internet
>> connectivity for every school in the world. It would be very
>> beneficial is we had access to every school within the database.
>> To do this I've been trying to use XAPI and I'm having a few errors.
>>
>>
>> For example when I try to use XAPI URLs:
>>  wget
>> 
>> --timeout=0http://www.informationfreeway.org/api/0.6/node[amenity=schools]-O
>> data.osm
>> I get this link as a response: 
>>
>> http://www.informationfreeway.org/noapi.html
>>
>>
>> and in data.osm I get :
>>
>> /
>>
>> 
>>
>> No API
>>
>>
>> 
>>
>>
>> I was wondering what I'm doing wrong?
>>
>> My guess is that I'm not authenticating or something along those
>> lines.
>>
>>
>> What is the best way to solve this problem ?
>>
>>
>> Thanks !
>>
>> Fredy
>>
>>
>>
>> ___
>> dev mailing list
>> dev@openstreetmap.org <mailto:dev@openstreetmap.org>
>> https://lists.openstreetmap.org/listinfo/dev
>
>
>
> ___
> dev mailing list
> dev@openstreetmap.org
> https://lists.openstreetmap.org/listinfo/dev
>



signature.asc
Description: OpenPGP digital signature
___
dev mailing list
dev@openstreetmap.org
https://lists.openstreetmap.org/listinfo/dev

Re: [OSM-dev] XAPI

[Fredy Yanez]

Thanks! 


I understand that i might not get 100% coverage. That is okay. Any data that I 
can get is useful.


How would one go about contacting a friendly operator of a osm2pgsql server? 




Fredy




 From:   Simon Poole  
 To:
 Sent:   8/7/2017 12:08 PM 
 Subject:   Re: [OSM-dev] XAPI 


 
There are multiple reasons why this is not going to work, not the   least 
that there have been no public native XAPI servers available   for a very 
long time. 
See http://wiki.openstreetmap.org/wiki/Xapi 
But in any case extracting anything for the whole world from any   API is 
not a good idea, I would suggest downloading a planet dump   and filtering 
the objects out of it, or asking a friendly operator   of a osm2pgsql 
server with the whole planet imported to generate a   list of schools for 
you. 
The other thing to take in to account, that while we undoubtedly   have a 
lot of schools in OSM and in some areas will have 100%   coverage this is 
definitely not universal. 
  
Simon
  
 
Am 07.08.2017 um 17:43 schrieb Fredy   Yanez:
  Good afternoon,    

  

  
I'm working for a no profit and our goal is to measure internet 
connectivity for every school in the world. It would be very beneficial 
is we had access to every school within the database. To do this I've 
been trying to use XAPI and I'm having a few errors.   

  

  
For example when I try to use XAPI URLs:   
 wget --timeout=0 
http://www.informationfreeway.org/api/0.6/node[amenity=schools] -O data.osm 
  
   
I get this link as a response:    

  
 
http://www.informationfreeway.org/noapi.html 


and in data.osm I get : 
/ 
   
  

No API 


 


I was wondering what I'm doing wrong? 
My guess is that I'm not authenticating or something along those 
lines. 


What is the best way to solve this problem ? 


Thanks ! 
Fredy  
  
   ___
dev mailing list
dev@openstreetmap.org
https://lists.openstreetmap.org/listinfo/dev
  


___
dev mailing list
dev@openstreetmap.org
https://lists.openstreetmap.org/listinfo/dev
___
dev mailing list
dev@openstreetmap.org
https://lists.openstreetmap.org/listinfo/dev

Re: [OSM-dev] XAPI

[Simon Poole]

There are multiple reasons why this is not going to work, not the least
that there have been no public native XAPI servers available for a very
long time.

See http://wiki.openstreetmap.org/wiki/Xapi

But in any case extracting anything for the whole world from any API is
not a good idea, I would suggest downloading a planet dump and filtering
the objects out of it, or asking a friendly operator of a osm2pgsql
server with the whole planet imported to generate a list of schools for you.

The other thing to take in to account, that while we undoubtedly have a
lot of schools in OSM and in some areas will have 100% coverage this is
definitely not universal.

Simon


Am 07.08.2017 um 17:43 schrieb Fredy Yanez:
> Good afternoon, 
>
>
> I'm working for a no profit and our goal is to measure internet
> connectivity for every school in the world. It would be very
> beneficial is we had access to every school within the database. To do
> this I've been trying to use XAPI and I'm having a few errors.
>
>
> For example when I try to use XAPI URLs:
>  wget
> --timeout=0http://www.informationfreeway.org/api/0.6/node[amenity=schools]-O
> data.osm
> I get this link as a response: 
>
> http://www.informationfreeway.org/noapi.html
>
>
> and in data.osm I get :
>
> /
>
> 
>
> No API
>
>
> 
>
>
> I was wondering what I'm doing wrong?
>
> My guess is that I'm not authenticating or something along those lines.
>
>
> What is the best way to solve this problem ?
>
>
> Thanks !
>
> Fredy
>
>
>
> ___
> dev mailing list
> dev@openstreetmap.org
> https://lists.openstreetmap.org/listinfo/dev



signature.asc
Description: OpenPGP digital signature
___
dev mailing list
dev@openstreetmap.org
https://lists.openstreetmap.org/listinfo/dev

Re: [OSM-dev] xapi site?

[sly (sylvain letuffe)]

Le jeudi 30 mai 2013 23:33:29, Tac Tacelosky a écrit :

> I've read and re-read the api docs at
> http://wiki.openstreetmap.org/wiki/API_v0.6, and XAPI and wherever
> else I could find, and hadn't seen any references to this site.  

I guess I'll have to improve my advertising skills ;-) 
The server it runs on still has power left and is meant to be used by whoever 
needs it.

I might not have pushed too much on advertising at first since I wanted to 
give it time to correct bugs, but after 1.5 years, I consider it quite 
reliable (Well, apart from software updates requiring database re-import, but 
my todo list contains an automatic fail-over function I've been delaying a bit 
too much...)

> originally I was getting all the data within the
> bounding box of the segment, using the Overpass API.  But that meant
> the data was always cached

I'm unsure about what cache you are talking about, but the 3 public Overpass 
API instances I know about 
(http://wiki.openstreetmap.org/wiki/Overpass_API#Introduction) are behaving 
just about the same about cache and are constantly minutely updated, so if you 
keep receiving the same data even after an update in the bbox I feel that even 
using the fr instance won't change your problem...


-- 
sly (sylvain letuffe)

___
dev mailing list
dev@openstreetmap.org
http://lists.openstreetmap.org/listinfo/dev

Re: [OSM-dev] xapi site?

[Tac Tacelosky]

This is great!  I've read and re-read the api docs at
http://wiki.openstreetmap.org/wiki/API_v0.6, and XAPI and wherever
else I could find, and hadn't seen any references to this site.  I'll
start using it, and I'll add my contact email to the queries should
there be an issue.

I've been experimenting with how to get the OSM elements near a
panoramic images, mostly so that I can tell what elements AREN'T
there, so they can be identified and added.  I have the images broken
up into segments, and originally I was getting all the data within the
bounding box of the segment, using the Overpass API.  But that meant
the data was always cached, so I've started getting just the elements
within about 100 meters of the image, doing that when the user
requests it.  With the .fr site, I can combine some caching with near
real-time data, which should work great.

Thanks for making me aware of this!

Tac


On Thu, May 30, 2013 at 4:18 PM, sly (sylvain letuffe)
 wrote:
> Le jeudi 30 mai 2013 20:27:43, Tac Tacelosky a écrit :
>> As our
>> streetview software moves closer to being demonstrable, I'd like to
>> not use the live API as much.
>
> You are currently quering the 0.6 API at api.openstreetmap.org ? If yes, you
> can easily alleviate the load until you have a working alternative with xapi
> or overpass API by replacing api.openstreetmap.org by api.openstreetmap.fr
>
> http://wiki.openstreetmap.org/wiki/Servers/api.openstreetmap.fr
>
>
> --
> sly (sylvain letuffe)
>
> ___
> dev mailing list
> dev@openstreetmap.org
> http://lists.openstreetmap.org/listinfo/dev

___
dev mailing list
dev@openstreetmap.org
http://lists.openstreetmap.org/listinfo/dev

Re: [OSM-dev] xapi site?

[sly (sylvain letuffe)]

Le jeudi 30 mai 2013 20:27:43, Tac Tacelosky a écrit :
> As our
> streetview software moves closer to being demonstrable, I'd like to
> not use the live API as much.

You are currently quering the 0.6 API at api.openstreetmap.org ? If yes, you 
can easily alleviate the load until you have a working alternative with xapi 
or overpass API by replacing api.openstreetmap.org by api.openstreetmap.fr

http://wiki.openstreetmap.org/wiki/Servers/api.openstreetmap.fr


-- 
sly (sylvain letuffe)

___
dev mailing list
dev@openstreetmap.org
http://lists.openstreetmap.org/listinfo/dev

Re: [OSM-dev] xapi site?

[Martin Raifer]

Can someone point me to an XAPI server with fairly fresh data?


Just use the "XAPI compability layer"[1] provided by Overpass API:
http://www.overpass-api.de/api/xapi?...

[1]  
http://wiki.openstreetmap.org/wiki/Overpass_API/XAPI_Compatibility_Layer


Martin

___
dev mailing list
dev@openstreetmap.org
http://lists.openstreetmap.org/listinfo/dev

Re: [OSM-dev] xapi site?

[Ian Dees]

On Thu, May 30, 2013 at 1:27 PM, Tac Tacelosky  wrote:

> Not sure if the wiki is dynamically updated, but according to the XAPI
> page:
>
> http://wiki.openstreetmap.org/wiki/XAPI
>
> The first server listed is "Running Normally" (green).  But clicking
> on it, or the status page, brings a 503 error.
>
> Service Temporarily Unavailable
>
> The server is temporarily unable to service your request due to
> maintenance downtime or capacity problems. Please try again later.
>
> 
> Apache/2.2.22 (Ubuntu) Server at jxapi.openstreetmap.org Port 80
>
> However, I don't think it's temporary, as it's been down for a while.
>

jxapi.osm.org has been down for quite some time as it was getting abused
and I haven't had time to add protections to it.


> Can someone point me to an XAPI server with fairly fresh data?  As our
> streetview software moves closer to being demonstrable, I'd like to
> not use the live API as much.


You could probably set up your own XAPI pretty easily using the github docs
[0] or you could use Overpass's XAPI interface.

[0] https://github.com/iandees/xapi-servlet
___
dev mailing list
dev@openstreetmap.org
http://lists.openstreetmap.org/listinfo/dev

Re: [OSM-dev] XAPI: Any difference between 'map' and '*' and between '[bbox=...]' and '?bbox=...'?

[Ian Dees]

On Wed, Jun 15, 2011 at 5:21 AM, Stefan Keller  wrote:

> This seems redundant and reading the XAPI [1] wiki page I don't really
> see any clear distinction.
> If yes, I would suggest to deprecate the 'map' and the '?bbox=...'
> parameters.
>
>
The JXAPI implements all of the read-only API endpoints so that (if someone
wrote it) a client could support spreading load across multiple (X)API
servers. The *[bbox...] query is just one of the many queries you can make
with the XAPI syntax. They should return the same data.
___
dev mailing list
dev@openstreetmap.org
http://lists.openstreetmap.org/listinfo/dev

Re: [OSM-dev] XAPI: Any difference between 'map' and '*' and between '[bbox=...]' and '?bbox=...'?

[Philipp Borgers]

The map query is functionally identical to the tag
query /api/0.6/*[bbox=left,bottom,right,top]

Quote from the wiki page ;)

XAPI is an extended api which implements a bit more than the normal api.
Perhaps there is some redundancy but I think this is not a problem.
Keeping the application compatible with older clients is a good move.

Perhaps you can add a comment to the wiki to make everything a bit more
understandable?

Regards

Philipp

On Wed, 2011-06-15 at 12:21 +0200, Stefan Keller wrote:
> Hi
> 
> In XAPI [1] what is the difference
> * between a [bbox=...] and ?bbox=...
> * and between a 'map' and a '*' request ?
> and if the represent equal requests, which one is preferred?
> 
> These examples return identical results:
> * 'map' request with bbox as URL parameter:
> http://jxapi.openstreetmap.org/xapi/api/0.6/map?bbox=34.679,32.039,34.721,32.08
> * 'all' ('*') request with bbox as 'predicate':
> http://jxapi.openstreetmap.org/xapi/api/0.6/*[bbox=34.679,32.039,34.721,32.081]
> 
> This seems redundant and reading the XAPI [1] wiki page I don't really
> see any clear distinction.
> If yes, I would suggest to deprecate the 'map' and the '?bbox=...' parameters.
> 
> Yours, S.
> 
> [1] http://wiki.openstreetmap.org/wiki/Xapi
> 
> ___
> dev mailing list
> dev@openstreetmap.org
> http://lists.openstreetmap.org/listinfo/dev



___
dev mailing list
dev@openstreetmap.org
http://lists.openstreetmap.org/listinfo/dev

Re: [OSM-dev] XAPI log (or use cases)?

[Philipp Borgers]

Here is one log http://fsi.spline.de/osm/xapi-access-23-01-2011.log.bz2

I'm not totally sure but I think it's from one of the official servers.

Regards

Philipp

On Thu, 2011-06-09 at 02:01 +0200, Stefan Keller wrote:
> I'd like find out the use cases of XAPI.
> 
> Does anyone know if there exists a log for XAPI usage from any
> existing web service?
> 
> That's what I found so far:
> https://github.com/osm-spline/xapi/tree/new-main which suggests:
> * .../api/0.6/node[amenity=*]
> * .../api/0.6/node[highway=busstop]
> * .../api/0.6/node[bbox=-6,50,2,61]
> * .../api/0.6/node[amenity=hospital][bbox=-6,50,2,61]
> * .../api/0.6/*[toorism=zoo][bbox=-6,50,2,61]
> 
> Yours, Stefan
> 
> ___
> dev mailing list
> dev@openstreetmap.org
> http://lists.openstreetmap.org/listinfo/dev



___
dev mailing list
dev@openstreetmap.org
http://lists.openstreetmap.org/listinfo/dev

Re: [OSM-dev] XAPI log (or use cases)?

[Stefan Keller]

Hi André

2011/6/9 André Riedel  wrote:
> Ian was pointing you to this sentence:
>
>> Running queries are listed on an admin stats page
>> http://jxapi.openstreetmap.org/xapi/admin/stats

Thanks. That's a useful starting point.
These stats obviously show running queries supported by jXAPI.
But my question is/was explicitely about logs (of course anonymized)
and use cases.
To me, logs include also unsuccessful requests and uses cases include
non-implemented syntax.

Yours, Stefan

___
dev mailing list
dev@openstreetmap.org
http://lists.openstreetmap.org/listinfo/dev

Re: [OSM-dev] XAPI log (or use cases)?

[André Riedel]

Ian was pointing you to this sentence:

> Running queries are listed on an admin stats page
> http://jxapi.openstreetmap.org/xapi/admin/stats

2011/6/9 Stefan Keller :
> Ian,
>
> There is no hint about log files of existing services there - in fact
> there is no word 'log' on the page.
> Ant there are Child Element Predicates which I'm unsure anybody uses these.
> So pls. read my question :->
>
> Yours, Stefan
>
> 2011/6/9 Ian Dees :
>> Read the wiki page for the XAPI: http://wiki.openstreetmap.org/wiki/Xapi
>> On Wed, Jun 8, 2011 at 7:01 PM, Stefan Keller  wrote:
>>>
>>> I'd like find out the use cases of XAPI.
>>>
>>> Does anyone know if there exists a log for XAPI usage from any
>>> existing web service?
>>>
>>> That's what I found so far:
>>> https://github.com/osm-spline/xapi/tree/new-main which suggests:
>>> * .../api/0.6/node[amenity=*]
>>> * .../api/0.6/node[highway=busstop]
>>> * .../api/0.6/node[bbox=-6,50,2,61]
>>> * .../api/0.6/node[amenity=hospital][bbox=-6,50,2,61]
>>> * .../api/0.6/*[toorism=zoo][bbox=-6,50,2,61]
>
> ___
> dev mailing list
> dev@openstreetmap.org
> http://lists.openstreetmap.org/listinfo/dev
>

___
dev mailing list
dev@openstreetmap.org
http://lists.openstreetmap.org/listinfo/dev

Re: [OSM-dev] XAPI log (or use cases)?

[Stefan Keller]

Ian,

There is no hint about log files of existing services there - in fact
there is no word 'log' on the page.
Ant there are Child Element Predicates which I'm unsure anybody uses these.
So pls. read my question :->

Yours, Stefan

2011/6/9 Ian Dees :
> Read the wiki page for the XAPI: http://wiki.openstreetmap.org/wiki/Xapi
> On Wed, Jun 8, 2011 at 7:01 PM, Stefan Keller  wrote:
>>
>> I'd like find out the use cases of XAPI.
>>
>> Does anyone know if there exists a log for XAPI usage from any
>> existing web service?
>>
>> That's what I found so far:
>> https://github.com/osm-spline/xapi/tree/new-main which suggests:
>> * .../api/0.6/node[amenity=*]
>> * .../api/0.6/node[highway=busstop]
>> * .../api/0.6/node[bbox=-6,50,2,61]
>> * .../api/0.6/node[amenity=hospital][bbox=-6,50,2,61]
>> * .../api/0.6/*[toorism=zoo][bbox=-6,50,2,61]

___
dev mailing list
dev@openstreetmap.org
http://lists.openstreetmap.org/listinfo/dev

Re: [OSM-dev] XAPI log (or use cases)?

[Ian Dees]

Read the wiki page for the XAPI: http://wiki.openstreetmap.org/wiki/Xapi

On Wed, Jun 8, 2011 at 7:01 PM, Stefan Keller  wrote:

> I'd like find out the use cases of XAPI.
>
> Does anyone know if there exists a log for XAPI usage from any
> existing web service?
>
> That's what I found so far:
> https://github.com/osm-spline/xapi/tree/new-main which suggests:
> * .../api/0.6/node[amenity=*]
> * .../api/0.6/node[highway=busstop]
> * .../api/0.6/node[bbox=-6,50,2,61]
> * .../api/0.6/node[amenity=hospital][bbox=-6,50,2,61]
> * .../api/0.6/*[toorism=zoo][bbox=-6,50,2,61]
___
dev mailing list
dev@openstreetmap.org
http://lists.openstreetmap.org/listinfo/dev

Re: [OSM-dev] XAPI and other solutions

[Jochen Topf]

On Thu, Apr 28, 2011 at 06:03:29PM +0200, Peter Körner wrote:
> Am 28.04.2011 16:11, schrieb Oliver Tonnhofer:
> >On 28.04.2011, at 16:00, Martijn van Exel wrote:
> >>Interesting, this totally uproots my firm conviction that SAX parsing is 
> >>always more time- and memory-efficient than tree/DOM-based parsing.
> 
> From my experience the expat-sax immplementation is faster then the
> libxml sax-parser.

I benchmarked it when developing Osmium and for OSM files expat was about 10%
faster than libxml2.

Jochen
-- 
Jochen Topf  joc...@remote.org  http://www.remote.org/jochen/  +49-721-388298


___
dev mailing list
dev@openstreetmap.org
http://lists.openstreetmap.org/listinfo/dev

Re: [OSM-dev] XAPI and other solutions

[Peter Körner]

Am 28.04.2011 16:11, schrieb Oliver Tonnhofer:

On 28.04.2011, at 16:00, Martijn van Exel wrote:

Interesting, this totally uproots my firm conviction that SAX parsing is always 
more time- and memory-efficient than tree/DOM-based parsing.


From my experience the expat-sax immplementation is faster then the 
libxml sax-parser.


Peter

___
dev mailing list
dev@openstreetmap.org
http://lists.openstreetmap.org/listinfo/dev

Re: [OSM-dev] XAPI and other solutions

[Oliver Tonnhofer]

On 28.04.2011, at 16:00, Martijn van Exel wrote:
> Interesting, this totally uproots my firm conviction that SAX parsing is 
> always more time- and memory-efficient than tree/DOM-based parsing.

Sure. DOM based parser need to keep the whole tree in memory which doesn't work 
well with large XML files. SAX and other stream based parser (like iterparse 
for Python) do not keep any information in memory. Stream based parser require 
more work from the developer, you can't use XPath expressions for example. So 
DOM based parsing still makes sense for documents with a known size, but for 
OSM data SAX/iterparse is the way to go.

> The article is 6 years old, do the benchmarks still hold in your experience?


Yes, for iterparse is still faster than xml.sax for Python.


Regards,
Oliver

-- 
Oliver Tonnhofer| Omniscale GmbH & Co KG| http://omniscale.de
http://mapproxy.org | https://bitbucket.org/olt | @oltonn





___
dev mailing list
dev@openstreetmap.org
http://lists.openstreetmap.org/listinfo/dev

Re: [OSM-dev] XAPI and other solutions

[Martijn van Exel]

On 4/28/11 2:58 PM, Oliver Tonnhofer wrote:


On 28.04.2011, at 14:46, Serge Wroclawski wrote:


On Thu, Apr 28, 2011 at 8:30 AM, Oliver Tonnhofer  wrote:


If you are using Python, you should use iterparse from the ElementTree API, it 
is much nicer and faster.


Faster than SAX? I'm not so sure. SAX calls the C directly.



Here is a benchmark: http://effbot.org/zone/celementtree.htm

Regards,
Oliver

Interesting, this totally uproots my firm conviction that SAX parsing is 
always more time- and memory-efficient than tree/DOM-based parsing.


The article is 6 years old, do the benchmarks still hold in your experience?

--
Martijn van Exel
Senior Researcher
-
Geodan S&R
President Kennedylaan 1
1079 MB Amsterdam (NL)
-
Tel: +31 (0)20 - 5711 318
Fax: +31 (0)20 - 5711 333
-
E-mail: mart...@geodan.nl
Website: www.geodan.nl
KvK-nummer: 33 247475
Disclaimer: www.geodan.nl/disclaimer
-


___
dev mailing list
dev@openstreetmap.org
http://lists.openstreetmap.org/listinfo/dev

Re: [OSM-dev] XAPI and other solutions

[Oliver Tonnhofer]

On 28.04.2011, at 14:46, Serge Wroclawski wrote:

> On Thu, Apr 28, 2011 at 8:30 AM, Oliver Tonnhofer  wrote:
> 
>> If you are using Python, you should use iterparse from the ElementTree API, 
>> it is much nicer and faster.
> 
> Faster than SAX? I'm not so sure. SAX calls the C directly.


Here is a benchmark: http://effbot.org/zone/celementtree.htm

Regards,
Oliver

-- 
Oliver Tonnhofer| Omniscale GmbH & Co KG| http://omniscale.de
http://mapproxy.org | https://bitbucket.org/olt | @oltonn





___
dev mailing list
dev@openstreetmap.org
http://lists.openstreetmap.org/listinfo/dev

Re: [OSM-dev] XAPI and other solutions

[Serge Wroclawski]

On Thu, Apr 28, 2011 at 8:30 AM, Oliver Tonnhofer  wrote:

> If you are using Python, you should use iterparse from the ElementTree API, 
> it is much nicer and faster.

Faster than SAX? I'm not so sure. SAX calls the C directly.

The technique used in iterparse is the same as in SAX parsing, and the
code is the ~the same size.

Use whatever works for you of course.

- Serge

___
dev mailing list
dev@openstreetmap.org
http://lists.openstreetmap.org/listinfo/dev

Re: [OSM-dev] XAPI and other solutions

[Oliver Tonnhofer]

On 28.04.2011, at 13:57, Pierre-Alain Dorange wrote:
>> What kind of processing were you doing? I'm assuming some kind of XML
>> (unless you were using the protobuffs). If thats the case, you can use
>> a simple SAX parser. If you need an example, I'll send you one.
> 
> Yes i preprocess XML to extract city data (place=town, place=village,
> etc...) to match them with an official source with population data.
> For that i uses elementTree lib (python) that's fine.
> I don't know about SAX, but i just see that contrary to DOM technique it
> do not need to load the whole XML into memory, so it can be helpful if i
> swtich to huge XML data file.
> I'll check.

If you are using Python, you should use iterparse from the ElementTree API, it 
is much nicer and faster. 

Here is a complete OSM parser from an earlier version of Imposm:
http://pastie.org/1843106
It just <40 lines of code and can parse arbitrary large OSM files.


Regards,
Oliver

-- 
Oliver Tonnhofer| Omniscale GmbH & Co KG| http://omniscale.de
http://mapproxy.org | https://bitbucket.org/olt | @oltonn





___
dev mailing list
dev@openstreetmap.org
http://lists.openstreetmap.org/listinfo/dev

Re: [OSM-dev] XAPI and other solutions

[Pierre-Alain Dorange]

Serge Wroclawski  wrote:

> > Yes, but they are huge...
> > My original place=* for france is 50 MB (not compressed).
> 
> 50 meg doesn't seem so big.

Yes 50MB is fine. 2 GB (compressed) is huge.

> > France extract if 2 GB compressed, i don't think my python script was
> > able to handle such a huge data.
> 
> What kind of processing were you doing? I'm assuming some kind of XML
> (unless you were using the protobuffs). If thats the case, you can use
> a simple SAX parser. If you need an example, I'll send you one.

Yes i preprocess XML to extract city data (place=town, place=village,
etc...) to match them with an official source with population data.
For that i uses elementTree lib (python) that's fine.
I don't know about SAX, but i just see that contrary to DOM technique it
do not need to load the whole XML into memory, so it can be helpful if i
swtich to huge XML data file.
I'll check.

-- 
Pierre-Alain Dorange
OSM experiences : 


___
dev mailing list
dev@openstreetmap.org
http://lists.openstreetmap.org/listinfo/dev

Re: [OSM-dev] XAPI and other solutions

[Igor Podolskiy]

Hi,


Igor Podolskiy wrote:

osmosis --rb /dev/stdin --tee 3 --b --b --b --tf --tf -tf --wx --tf
--tf --un --wx --tf --un --uw --merge -merge --wx

(Though if I'd be doing this for real, I'd spell out the at least the
out/in-pipe names,


You would have to. The intermediate "--wx" in your command line must be
removed,

Shame on me, I wanted to move the --wx and I copied it. Sorry.


and then without explicitly specifying the in/out pipes, the
second and third block of "--tf" rules would be applied in sequence
rather than in parallel!
Of course you're right. That's why I gave up on working with Osmosis 
without spelling out the pipe names if it gets more complex than "--rx 
--bb --wx". I should never have tried to change that pipeline in the 
first place, I was doomed right from the start ;)


Best regards
Igor

___
dev mailing list
dev@openstreetmap.org
http://lists.openstreetmap.org/listinfo/dev

Re: [OSM-dev] XAPI and other solutions

[Frederik Ramm]

Hi,

Igor Podolskiy wrote:
osmosis --rb /dev/stdin --tee 3 --b --b --b --tf --tf -tf --wx --tf --tf 
--un --wx --tf --un --uw --merge -merge --wx


(Though if I'd be doing this for real, I'd spell out the at least the 
out/in-pipe names, 


You would have to. The intermediate "--wx" in your command line must be 
removed, and then without explicitly specifying the in/out pipes, the 
second and third block of "--tf" rules would be applied in sequence 
rather than in parallel!


Bye
Frederik

--
Frederik Ramm  ##  eMail frede...@remote.org  ##  N49°00'09" E008°23'33"

___
dev mailing list
dev@openstreetmap.org
http://lists.openstreetmap.org/listinfo/dev

Re: [OSM-dev] XAPI and other solutions

[Igor Podolskiy]

Hi,

On 26.04.2011 22:29, Frederik Ramm wrote:

You could probably save some time by doing something like this
(shortened by dropping arguments):

curl ... -o - | osmosis --rb /dev/stdin --tee 3 --tf --tf -tf --wx --tf
--tf --un --wx --tf --un --uw --wx

that way you would start processing while the download was still
ongoing, and process all three filters at the same time. Logically it
would even be possible to add the merge step to the back of the chain
but I remember some past discussion on the Osmosis list about potential
deadlocks if you combine what you have split in the same task.
exactly, to do tee+merge in a single process you'll need --buffer/--b 
tasks after the tee or you will deadlock for sure. So the pipeline would be:


osmosis --rb /dev/stdin --tee 3 --b --b --b --tf --tf -tf --wx --tf --tf 
--un --wx --tf --un --uw --merge -merge --wx


(Though if I'd be doing this for real, I'd spell out the at least the 
out/in-pipe names, in my experience the pipe stack is quite easy to 
break and quite hard to debug in big pipelines like this operating on 
data sets >1G).


Best regards
Igor

___
dev mailing list
dev@openstreetmap.org
http://lists.openstreetmap.org/listinfo/dev

Re: [OSM-dev] XAPI and other solutions

[yvecai]

On 26. 04. 11 22:02, Pierre-Alain Dorange wrote:

Pierre-Alain Dorange  wrote:


./osmosis --rb "france.osm.pbf" -tf accept-nodes "place=*" --wx
fr_places.osm

You're missing the second "-" before "tf", making Osmosis think that
"-tf" was a second argument to "--rb".

Oh my god, shame on me.
Thanks.


I finally build my proto and it works fine, but i'm disappointed : it's
slow...

curl "http://download.geofabrik.de/osm/europe/france.osm.pbf"; \
 -o "./temp/france.osm.pbf"
osmosis --rb "./temp/france.osm.pbf" \
 --tf accept-nodes "man_made=surveillance" --tf reject-ways \
 --tf reject-relations --wx "./temp/frn.xml"
osmosis --rb "./temp/france.osm.pbf" \
 --tf accept-ways "man_made=surveillance" --tf reject-relations\
 --used-node --wx "./temp/frw.xml"
osmosis --rb "./temp/france.osm.pbf" \
 --tf accept-relations "man_made=surveillance"  --used-way\
 --used-node --wx "./temp/frr.xml"
osmosis --rx "./temp/frn.xml" --rx "./temp/frw.xml" \
 --rx "./temp/frr.xml" --merge --merge \
 --wx "./data/fr_surveillance.xml"

75 minutes to download 1.2 GB of data (France)
60 minutes to filter and merge "man_made=surveillance" for nodes, ways
and relations...

Previously it requires only 10 minutes via XAPI (when server were up).
But XAPI is no more a solution (see above

Nice explanation Igor, thanks, I'm testing it too!
Pierre Alain,
Yes, it is slow compared to Xapi, because Xapi is querying an database 
while with this method you need to parse a file 3 times to get your result.
You could try to download france.osm.gz (or convert your pbf) and filter 
it with Osmfilter. I'm pretty sure it is faster.

Yves

___
dev mailing list
dev@openstreetmap.org
http://lists.openstreetmap.org/listinfo/dev

Re: [OSM-dev] XAPI and other solutions

[Frederik Ramm]

Hi,

Pierre-Alain Dorange wrote:

I finally build my proto and it works fine, but i'm disappointed : it's
slow...

curl "http://download.geofabrik.de/osm/europe/france.osm.pbf"; \
-o "./temp/france.osm.pbf"
osmosis --rb "./temp/france.osm.pbf" \
--tf accept-nodes "man_made=surveillance" --tf reject-ways \
--tf reject-relations --wx "./temp/frn.xml"
osmosis --rb "./temp/france.osm.pbf" \
--tf accept-ways "man_made=surveillance" --tf reject-relations\
--used-node --wx "./temp/frw.xml"
osmosis --rb "./temp/france.osm.pbf" \
--tf accept-relations "man_made=surveillance"  --used-way\
--used-node --wx "./temp/frr.xml"
osmosis --rx "./temp/frn.xml" --rx "./temp/frw.xml" \
--rx "./temp/frr.xml" --merge --merge \
--wx "./data/fr_surveillance.xml"


You could probably save some time by doing something like this 
(shortened by dropping arguments):


curl ... -o - | osmosis --rb /dev/stdin --tee 3 --tf --tf -tf --wx --tf 
--tf --un --wx --tf --un --uw --wx


that way you would start processing while the download was still 
ongoing, and process all three filters at the same time. Logically it 
would even be possible to add the merge step to the back of the chain 
but I remember some past discussion on the Osmosis list about potential 
deadlocks if you combine what you have split in the same task.


Bye
Frederik
--
Frederik Ramm  ##  eMail frede...@remote.org  ##  N49°00'09" E008°23'33"

___
dev mailing list
dev@openstreetmap.org
http://lists.openstreetmap.org/listinfo/dev

Re: [OSM-dev] XAPI and other solutions

[Pierre-Alain Dorange]

Pierre-Alain Dorange  wrote:

> > > ./osmosis --rb "france.osm.pbf" -tf accept-nodes "place=*" --wx
> > > fr_places.osm
> > 
> > You're missing the second "-" before "tf", making Osmosis think that
> > "-tf" was a second argument to "--rb".
> 
> Oh my god, shame on me.
> Thanks.


I finally build my proto and it works fine, but i'm disappointed : it's
slow...

curl "http://download.geofabrik.de/osm/europe/france.osm.pbf"; \
-o "./temp/france.osm.pbf"
osmosis --rb "./temp/france.osm.pbf" \
--tf accept-nodes "man_made=surveillance" --tf reject-ways \
--tf reject-relations --wx "./temp/frn.xml"
osmosis --rb "./temp/france.osm.pbf" \
--tf accept-ways "man_made=surveillance" --tf reject-relations\
--used-node --wx "./temp/frw.xml"
osmosis --rb "./temp/france.osm.pbf" \
--tf accept-relations "man_made=surveillance"  --used-way\
--used-node --wx "./temp/frr.xml"
osmosis --rx "./temp/frn.xml" --rx "./temp/frw.xml" \
--rx "./temp/frr.xml" --merge --merge \
--wx "./data/fr_surveillance.xml"

75 minutes to download 1.2 GB of data (France)
60 minutes to filter and merge "man_made=surveillance" for nodes, ways
and relations...

Previously it requires only 10 minutes via XAPI (when server were up).
But XAPI is no more a solution (see above)

-- 
Pierre-Alain Dorange
OSM experiences : 


___
dev mailing list
dev@openstreetmap.org
http://lists.openstreetmap.org/listinfo/dev

Re: [OSM-dev] XAPI and other solutions

[Pierre-Alain Dorange]

Frederik Ramm  wrote:

> > ./osmosis --rb "france.osm.pbf" -tf accept-nodes "place=*" --wx
> > fr_places.osm
> 
> You're missing the second "-" before "tf", making Osmosis think that 
> "-tf" was a second argument to "--rb".

Oh my god, shame on me.
Thanks.

-- 
Pierre-Alain Dorange
OSM experiences : 


___
dev mailing list
dev@openstreetmap.org
http://lists.openstreetmap.org/listinfo/dev

Re: [OSM-dev] XAPI and other solutions

[Frederik Ramm]

Hi,

Pierre-Alain Dorange wrote:

./osmosis --rb "france.osm.pbf" -tf accept-nodes "place=*" --wx
fr_places.osm


You're missing the second "-" before "tf", making Osmosis think that 
"-tf" was a second argument to "--rb".


Bye
Frederik

--
Frederik Ramm  ##  eMail frede...@remote.org  ##  N49°00'09" E008°23'33"

___
dev mailing list
dev@openstreetmap.org
http://lists.openstreetmap.org/listinfo/dev

Re: [OSM-dev] XAPI and other solutions

[Pierre-Alain Dorange]

Toby Murray  wrote:

> osmosis --read-pbf france.osm.pbf \
>  --tf accept-ways "place=*" \
>  --tf accept-nodes "place=*"
>  --tf accept-relations "place=*"
>  --write-xml france_place.osm

After some tests i cant run osmosis...

My config MacOS X 10.6 (i update to used Java 6 on 64 bits) but osmosis
still crash :

./osmosis --rb "france.osm.pbf" -tf accept-nodes "place=*" --wx
fr_places.osm

return :
GRAVE: Execution aborted.
org.openstreetmap.osmosis.core.OsmosisRuntimeException: Only one default
(un-named) argument can exist per task.  Arguments 3 and 2 have no name.
at
org.openstreetmap.osmosis.core.cli.CommandLineParser.parseTask(CommandLi
neParser.java:317)
at
org.openstreetmap.osmosis.core.cli.CommandLineParser.parse(CommandLinePa
rser.java:90)
at org.openstreetmap.osmosis.core.Osmosis.run(Osmosis.java:74)
at org.openstreetmap.osmosis.core.Osmosis.main(Osmosis.java:37)
at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method)
at
sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.jav
a:39)
at
sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessor
Impl.java:25)
at java.lang.reflect.Method.invoke(Method.java:597)
at
org.codehaus.plexus.classworlds.launcher.Launcher.launchStandard(Launche
r.java:329)
at
org.codehaus.plexus.classworlds.launcher.Launcher.launch(Launcher.java:2
39)
at
org.codehaus.plexus.classworlds.launcher.Launcher.mainWithExitCode(Launc
her.java:409)
at
org.codehaus.plexus.classworlds.launcher.Launcher.main(Launcher.java:352
)
at org.codehaus.classworlds.Launcher.main(Launcher.java:31)

-- 
Pierre-Alain Dorange
OSM experiences : 


___
dev mailing list
dev@openstreetmap.org
http://lists.openstreetmap.org/listinfo/dev

Re: [OSM-dev] XAPI and other solutions

[yvecai]

Hi all,
I already replied Pierre-Alain on the french list, but it maybe useful 
for others too.
For an extract of cross-country trails at [1], I use a world planet file 
updated by osmosis as a file with daily diffs whenever I feel like too. 
Find the script attached.
Then Osmfilter [2] do the filtering, as in my case Osmosis is not able 
to filter relations recursively enough.

Planet update is ~4 hours, filtering ~2hours on a 4Go ram machine.
By the way, same result on a 7200rpm disk or SSD disk. I guess ram and 
compression are the bottlenecks.


Yves
[1] www.pistes-nordiques.org
[2] http://wiki.openstreetmap.org/wiki/Osmfilter

On 24. 04. 11 20:59, Martijn van Exel wrote:

Hi Pierre,

As far as XAPI servers go I have given up for now, although MapQuest 
is running a more reliable instance[1] that may be useful, although 
they employ Ian's Java implementation as well so the same bbox 
limitations likely apply.


I am, in fact, working on a similar project in the Netherlands and for 
an up-to-date data feed for CCTV cameras I use the process described 
here[2]. I'd love to compare that to your approach, we can probably 
benefit from each other's work.


Best
Martijn

[1] http://developer.mapquest.com/web/products/open/xapi
[2] 
https://docs.google.com/document/pub?id=1paaYsOakgJEYP380R70s4SGYq8ME3ASl-mweVi1DlQ4


On Sat, Apr 23, 2011 at 9:57 PM, Pierre-Alain Dorange 
mailto:pdora...@mac.com>> wrote:


Hi, i'm a french contributor and i look for advice for a project.

I'm processing free french city official data (from insee,
official stat
agency) and i have to match those city with osm city (place=*) to
geolocalize it on a map.
The project is to present cctv surveillance in the country (see
demo at
[1]).

To get those data and preprocess them i used XAPI to retrive all nodes
with tag place=* :

The result is fine but XAPI servers are randomly running and data
seems
old. New Java XAPI servers do not accept the bounding box : too large.

What are the best way to retrieve OSM raw data (xml format would be
preferable) to update regulary the project's data ?

Thanks.

[1] project demo
http://www.leretourdelautruche.com/map/cctv/cctv_map.php

These map show city global data (user contributions) and
individual cctv
camera localisation (from OSM man_made=surveillance) when you zoom
to a
city with cctv mapped (ie. Strasbourg) :
>

--
Pierre-Alain Dorange
OSM experiences : 


___
dev mailing list
dev@openstreetmap.org 
http://lists.openstreetmap.org/listinfo/dev




--
Martijn van Exel
http://about.me/mvexel


___
dev mailing list
dev@openstreetmap.org
http://lists.openstreetmap.org/listinfo/dev




planet_update.sh
Description: Bourne shell script


filter.sh
Description: Bourne shell script
___
dev mailing list
dev@openstreetmap.org
http://lists.openstreetmap.org/listinfo/dev

Re: [OSM-dev] XAPI and other solutions

[Martijn van Exel]

Hi Pierre,

As far as XAPI servers go I have given up for now, although MapQuest is
running a more reliable instance[1] that may be useful, although they employ
Ian's Java implementation as well so the same bbox limitations likely apply.

I am, in fact, working on a similar project in the Netherlands and for an
up-to-date data feed for CCTV cameras I use the process described here[2].
I'd love to compare that to your approach, we can probably benefit from each
other's work.

Best
Martijn

[1] http://developer.mapquest.com/web/products/open/xapi
[2]
https://docs.google.com/document/pub?id=1paaYsOakgJEYP380R70s4SGYq8ME3ASl-mweVi1DlQ4

On Sat, Apr 23, 2011 at 9:57 PM, Pierre-Alain Dorange wrote:

> Hi, i'm a french contributor and i look for advice for a project.
>
> I'm processing free french city official data (from insee, official stat
> agency) and i have to match those city with osm city (place=*) to
> geolocalize it on a map.
> The project is to present cctv surveillance in the country (see demo at
> [1]).
>
> To get those data and preprocess them i used XAPI to retrive all nodes
> with tag place=* :
>
> The result is fine but XAPI servers are randomly running and data seems
> old. New Java XAPI servers do not accept the bounding box : too large.
>
> What are the best way to retrieve OSM raw data (xml format would be
> preferable) to update regulary the project's data ?
>
> Thanks.
>
> [1] project demo
> http://www.leretourdelautruche.com/map/cctv/cctv_map.php
>
> These map show city global data (user contributions) and individual cctv
> camera localisation (from OSM man_made=surveillance) when you zoom to a
> city with cctv mapped (ie. Strasbourg) :
>  .5831&lon=7.75238&layers=B0T
> >
>
> --
> Pierre-Alain Dorange
> OSM experiences : 
>
>
> ___
> dev mailing list
> dev@openstreetmap.org
> http://lists.openstreetmap.org/listinfo/dev
>



-- 
Martijn van Exel
http://about.me/mvexel
___
dev mailing list
dev@openstreetmap.org
http://lists.openstreetmap.org/listinfo/dev

Re: [OSM-dev] XAPI and other solutions

[Pierre-Alain Dorange]

Toby Murray  wrote:

> > France extract if 2 GB compressed, i don't think my python script was
> > able to handle such a huge data.
> 
> That's why you use osmosis to trim it down to what you want.
> 
> The following osmosis command gives me a 34 MB XML file when run on
> the France PBF file from geofabrik.
> 
> osmosis --read-pbf france.osm.pbf \
>  --tf accept-ways "place=*" \
>  --tf accept-nodes "place=*"
>  --tf accept-relations "place=*"
>  --write-xml france_place.osm

That sound nice, i'll try osmosis (never try before)...
First attempt just point some (small) troubles, osmosis cause a strange
error, probably an installation trouble or a lib missing.

Its seems that osmosis require Java 6 and i got Java 5 on mac MacOS X
10.5.x, Java SE6 is there but only for 64 bits... 

-- 
Pierre-Alain Dorange
OSM experiences : 


___
dev mailing list
dev@openstreetmap.org
http://lists.openstreetmap.org/listinfo/dev

Re: [OSM-dev] XAPI and other solutions

[Toby Murray]

On Sun, Apr 24, 2011 at 5:43 AM, Pierre-Alain Dorange  wrote:
> Yes, but they are huge...
> My original place=* for france is 50 MB (not compressed).
>
> France extract if 2 GB compressed, i don't think my python script was
> able to handle such a huge data.

That's why you use osmosis to trim it down to what you want.

The following osmosis command gives me a 34 MB XML file when run on
the France PBF file from geofabrik.

osmosis --read-pbf france.osm.pbf \
 --tf accept-ways "place=*" \
 --tf accept-nodes "place=*"
 --tf accept-relations "place=*"
 --write-xml france_place.osm

Toby

___
dev mailing list
dev@openstreetmap.org
http://lists.openstreetmap.org/listinfo/dev

Re: [OSM-dev] XAPI and other solutions

[Oliver Tonnhofer]

On 24.04.2011, at 12:43, Pierre-Alain Dorange wrote:
> Yes, but they are huge...
> My original place=* for france is 50 MB (not compressed).
> 
> France extract if 2 GB compressed, i don't think my python script was
> able to handle such a huge data.


You should have a look at imposm.parser, it's a Python library for OSM XML and 
PBF files and there is no limitation in the file 
size:http://imposm.org/docs/imposm.parser/latest/

Regards,
Oliver

-- 
Oliver Tonnhofer| Omniscale GmbH & Co KG| http://omniscale.de
http://mapproxy.org | https://bitbucket.org/olt


___
dev mailing list
dev@openstreetmap.org
http://lists.openstreetmap.org/listinfo/dev

Re: [OSM-dev] XAPI and other solutions

[Serge Wroclawski]

On Sun, Apr 24, 2011 at 6:43 AM, Pierre-Alain Dorange  wrote:

>> He is talking about France only. So if he used a country extract [1] in stead
>> of the whole planet, then his processing times would be much shorter for both
>> the methods mentioned bij Toby and Nakor.
>>
>> [1] 
>
> Yes, but they are huge...
> My original place=* for france is 50 MB (not compressed).

50 meg doesn't seem so big.

> France extract if 2 GB compressed, i don't think my python script was
> able to handle such a huge data.

What kind of processing were you doing? I'm assuming some kind of XML
(unless you were using the protobuffs). If thats the case, you can use
a simple SAX parser. If you need an example, I'll send you one.

- Serge

___
dev mailing list
dev@openstreetmap.org
http://lists.openstreetmap.org/listinfo/dev

Re: [OSM-dev] XAPI and other solutions

[Pierre-Alain Dorange]

Cartinus  wrote:

> > If you need updates more often than the weekly PBF, it takes about 2 hours
> > on the same machine as above to apply the daily diffs with Osmosis and if
> > you do not need a daily update just merge several daily diffs together
> > before updating your planet file it will be way quicker than updating the
> > planet for each day.
> 
> He is talking about France only. So if he used a country extract [1] in stead
> of the whole planet, then his processing times would be much shorter for both
> the methods mentioned bij Toby and Nakor.
> 
> [1] 

Yes, but they are huge...
My original place=* for france is 50 MB (not compressed).

France extract if 2 GB compressed, i don't think my python script was
able to handle such a huge data.

I was looking for a lighter solution, XAPI was good when servers were
running and updated. 

-- 
Pierre-Alain Dorange
OSM experiences : 


___
dev mailing list
dev@openstreetmap.org
http://lists.openstreetmap.org/listinfo/dev

Re: [OSM-dev] XAPI and other solutions

[Cartinus]

On Sunday 24 April 2011 02:40:52 Nakor Osm wrote:
> Download the planet.pbf and extract from it.
>
> From a pbf planet file on a quad-core/8Gb RAM machine it takes me roughly
> 1.5 h to extract all ways marked natural=coastline.
>
> If you need updates more often than the weekly PBF, it takes about 2 hours
> on the same machine as above to apply the daily diffs with Osmosis and if
> you do not need a daily update just merge several daily diffs together
> before updating your planet file it will be way quicker than updating the
> planet for each day.

He is talking about France only. So if he used a country extract [1] in stead 
of the whole planet, then his processing times would be much shorter for both 
the methods mentioned bij Toby and Nakor.

[1] 

-- 
m.v.g.,
Cartinus

___
dev mailing list
dev@openstreetmap.org
http://lists.openstreetmap.org/listinfo/dev

Re: [OSM-dev] XAPI and other solutions

[Nakor Osm]

Download the planet.pbf and extract from it.

>From a pbf planet file on a quad-core/8Gb RAM machine it takes me roughly
1.5 h to extract all ways marked natural=coastline.

If you need updates more often than the weekly PBF, it takes about 2 hours
on the same machine as above to apply the daily diffs with Osmosis and if
you do not need a daily update just merge several daily diffs together
before updating your planet file it will be way quicker than updating the
planet for each day.
___
dev mailing list
dev@openstreetmap.org
http://lists.openstreetmap.org/listinfo/dev

Re: [OSM-dev] XAPI and other solutions

[Toby Murray]

You can set up your own jXAPI server and disable the bounding box
limit. But this takes about 500 GB of drive space and several days of
processing.

Another option is to use osmosis to filter objects out the planet file:

http://wiki.openstreetmap.org/wiki/Osmosis/Detailed_Usage_0.39#--tag-filter_.28--tf.29

Toby


On Sat, Apr 23, 2011 at 2:57 PM, Pierre-Alain Dorange  wrote:
> Hi, i'm a french contributor and i look for advice for a project.
>
> I'm processing free french city official data (from insee, official stat
> agency) and i have to match those city with osm city (place=*) to
> geolocalize it on a map.
> The project is to present cctv surveillance in the country (see demo at
> [1]).
>
> To get those data and preprocess them i used XAPI to retrive all nodes
> with tag place=* :
>
> The result is fine but XAPI servers are randomly running and data seems
> old. New Java XAPI servers do not accept the bounding box : too large.
>
> What are the best way to retrieve OSM raw data (xml format would be
> preferable) to update regulary the project's data ?
>
> Thanks.
>
> [1] project demo
> http://www.leretourdelautruche.com/map/cctv/cctv_map.php
>
> These map show city global data (user contributions) and individual cctv
> camera localisation (from OSM man_made=surveillance) when you zoom to a
> city with cctv mapped (ie. Strasbourg) :
>  .5831&lon=7.75238&layers=B0T>
>
> --
> Pierre-Alain Dorange
> OSM experiences : 
>
>
> ___
> dev mailing list
> dev@openstreetmap.org
> http://lists.openstreetmap.org/listinfo/dev
>

___
dev mailing list
dev@openstreetmap.org
http://lists.openstreetmap.org/listinfo/dev

Re: [OSM-dev] XAPI and using a home server

[Graham Jones]

Thanks Roland,
That seems to have fixed it.  I will add this workaround to the instructions
on the Wiki.
I'd better try using it for something now!

Regards

Graham.

On 6 March 2011 15:25, Roland Olbricht  wrote:

> > The only thing is that it ends with:
> > "runtime error: open64: 2 ./db/area_tags_local.bin File_Blocks:1"
> > and does not provide the closing  tag.
> >
> > Do you have any suggestions on what might cause that?
>
> Yes, it's a bug in the software. Thank you for reporting it. First, for a
> feasible workaround please place empty files with names
> area_tags_local.bin
> area_tags_local.idx
> in the database directory. The probably fastest way is
> pushd YOUR_DATABASE_DIR
> touch area_tags_local.bin
> touch area_tags_local.idx
> popd
>
> The cause is a little bit intricate. OSM3S should allow for the usage of
> derived data structures, and as a showcase the handling of areas is
> included.
> This feature is not mature enough to offer it as part of the regular
> interface, but areas if present, can be printed with the print statement.
> Unfortunately, the print statement throws an error if a corresponding file
> of
> the database doesn't exist. While useful in general to find errors, its
> unhelpful for this optional data structure, which may be absent for good
> reason.
>
> However, the workaround above should do it for the moment. I'll fix the
> behaviour, by making areas truly optional also in the print statement, with
> the next bugfix version.
>
> Cheers,
>
> Roland
>



-- 
Graham Jones
Hartlepool, UK.
___
dev mailing list
dev@openstreetmap.org
http://lists.openstreetmap.org/listinfo/dev

Re: [OSM-dev] XAPI and using a home server

[Roland Olbricht]

> The only thing is that it ends with:
> "runtime error: open64: 2 ./db/area_tags_local.bin File_Blocks:1"
> and does not provide the closing  tag.
>
> Do you have any suggestions on what might cause that?

Yes, it's a bug in the software. Thank you for reporting it. First, for a 
feasible workaround please place empty files with names
area_tags_local.bin
area_tags_local.idx
in the database directory. The probably fastest way is
pushd YOUR_DATABASE_DIR
touch area_tags_local.bin
touch area_tags_local.idx
popd

The cause is a little bit intricate. OSM3S should allow for the usage of 
derived data structures, and as a showcase the handling of areas is included. 
This feature is not mature enough to offer it as part of the regular 
interface, but areas if present, can be printed with the print statement. 
Unfortunately, the print statement throws an error if a corresponding file of 
the database doesn't exist. While useful in general to find errors, its 
unhelpful for this optional data structure, which may be absent for good 
reason.

However, the workaround above should do it for the moment. I'll fix the 
behaviour, by making areas truly optional also in the print statement, with 
the next bugfix version.

Cheers,

Roland

___
dev mailing list
dev@openstreetmap.org
http://lists.openstreetmap.org/listinfo/dev

Re: [OSM-dev] XAPI and using a home server

[Graham Jones]

Roland,
Thanks for this - Ctrl-D to terminate the standard input made a big
difference - it now gives me some XML that looks right.

The only thing is that it ends with:
"runtime error: open64: 2 ./db/area_tags_local.bin File_Blocks:1"
and does not provide the closing  tag.

Do you have any suggestions on what might cause that?

Thanks

Graham.

On 1 March 2011 01:05, Roland Olbricht  wrote:

> > Roland,
> > I have compiled osm3s and imported the latest planet file.
>
> Thank you for this. I'm sorry that there are still holes in the
> instructions.
>
> > I think this
> >  was successful - no errors anyway and took about 24 hours as you
> suggested
> >  and ended with
> [...]
> > > max_written_role_id 4458
> > > R 1298757941 r 1298757941
> >
> > This looks a bit abrupt, but I tried a small osm file and got a similar
> > result, so I think this is a good sign?
>
> Yes, it is. It looks fine so far. Well, the next version will have a more
> informative final message.
>
> > How do I use it?
>
> > And although it lets me type things at the terminal (like your example
> > queries), it does not respond - is it really listening on standard input?
>
> Yes, it does. It waits until the input stream is finished. So, please
> finish
> the input stream by Ctrl+D when you type at the console (works in general
> on
> all UNIX consoles).
>
> A more convenient way (especially when invoking it in a tool chain) might
> be
> to pass a file with the content to it. For example
>
> echo ' e="7.0"/> kv k="amenity" v="pub"/>' | bin/osm3s_query --no-mime --db-
> dir=YOUR_DB_DIR
>
> > Your instructions on the wiki say "put a query on the standard input",
> but
> > when I start osm3s_query it prints out:
> > > encoding remark: No input found from GET method. Trying to retrieve
> input
> > > by POST method.
>
> You can safely ignore the message if you call osm3s_query on the command
> line.
> It's a leftover from the purpose of using it via the CGI interface of a web
> browser.
>
> > Sorry if this is obvious - I haven't tried to look at your code to see
> what
> > it is doing!
>
> Questions are always welcome. Even if it were obvious (it is not), it is
> still
> a good hint for me how to improve the instructions.
>
> > The other question is whether anyone has written a php script (or
> similar)
> > to make this emulate xapi queries to use as a direct replacement for
> xapi?
>
> AFAIK no yet. I think it would be feasible for
>
> /map?bbox=..
> (gets '')
>
> /node[..] (with or without bbox)
> (like the first query in the instructions, maybe without bbox)
>
> /way[..]
> (gets ''
>  or maybe ''
>
> /relation[..]
> (gets '')
>
> /*  (all three without bbox)
> (gets:
>  
>
>
>
>  
>  
> )
>
> but the other queries may get more difficult.
>
> Cheers,
>
> Roland
>



-- 
Graham Jones
Hartlepool, UK.
___
dev mailing list
dev@openstreetmap.org
http://lists.openstreetmap.org/listinfo/dev

Re: [OSM-dev] XAPI and using a home server

[Roland Olbricht]

> Roland,
> I have compiled osm3s and imported the latest planet file.

Thank you for this. I'm sorry that there are still holes in the instructions.

> I think this
>  was successful - no errors anyway and took about 24 hours as you suggested
>  and ended with
[...]
> > max_written_role_id 4458
> > R 1298757941 r 1298757941
> 
> This looks a bit abrupt, but I tried a small osm file and got a similar
> result, so I think this is a good sign?

Yes, it is. It looks fine so far. Well, the next version will have a more 
informative final message.
 
> How do I use it?

> And although it lets me type things at the terminal (like your example
> queries), it does not respond - is it really listening on standard input?

Yes, it does. It waits until the input stream is finished. So, please finish 
the input stream by Ctrl+D when you type at the console (works in general on 
all UNIX consoles).

A more convenient way (especially when invoking it in a tool chain) might be 
to pass a file with the content to it. For example

echo '' | bin/osm3s_query --no-mime --db-
dir=YOUR_DB_DIR

> Your instructions on the wiki say "put a query on the standard input", but
> when I start osm3s_query it prints out:
> > encoding remark: No input found from GET method. Trying to retrieve input
> > by POST method.

You can safely ignore the message if you call osm3s_query on the command line. 
It's a leftover from the purpose of using it via the CGI interface of a web 
browser.

> Sorry if this is obvious - I haven't tried to look at your code to see what
> it is doing!

Questions are always welcome. Even if it were obvious (it is not), it is still 
a good hint for me how to improve the instructions.
 
> The other question is whether anyone has written a php script (or similar)
> to make this emulate xapi queries to use as a direct replacement for xapi?

AFAIK no yet. I think it would be feasible for

/map?bbox=..
(gets '')

/node[..] (with or without bbox)
(like the first query in the instructions, maybe without bbox)

/way[..]
(gets ''
 or maybe ''

/relation[..]
(gets '')

/*  (all three without bbox)
(gets:
  



  
  
)

but the other queries may get more difficult.

Cheers,

Roland

___
dev mailing list
dev@openstreetmap.org
http://lists.openstreetmap.org/listinfo/dev

Re: [OSM-dev] Xapi-servlet deployement in Tomcat

[yvecai]

I did it, because xapi-servlet.war was easier than 
iandees-xapi-antlr-864104f.war.
I also give a try to Jetty, with the same 
java.lang.ClassNotFoundException: 
com.yellowbkpk.geo.xapi.servlet.XapiServlet


It's maybe not a problem of class but permissions, should a default user 
be declared somewhere in Tomcat?


Yves

On 01. 02. 11 11:05, Brett Henderson wrote:
Tomcat should allow file-based deployment.  It should be as simple as 
copying the war file into the webapps directory.  It will end up with 
a context root that matches the war filename (minus .war).


Different app servers usually provide ways to override the default 
context root via embedding app server specific files into the 
deployment archive (at least full JEE servers such as jboss, 
websphere, and glassfish do), but I can't remember how to do that with 
Tomcat.  In most cases just renaming the war prior to deployment is 
the simplest solution.


On Sun, Jan 30, 2011 at 3:32 AM, yvecai > wrote:


I did that too, but no cigar.
What is the context you used?

Yves


On 29. 01. 11 15:07, Ian Dees wrote:

I'm not very clear on how to deploy servlets. I used tomcat6 and
Ubuntu 10.04, too, but I deployed the war via the tomcat6-admin
servlet that is installed as a separate package. It offers a
"deploy" section where you can specify the path to the war and
the context to deploy the war in. When I use that it seems to
work well.

On Sat, Jan 29, 2011 at 2:44 AM, yvecai mailto:yve...@gmail.com>> wrote:

I have trouble to deploy xapi-servlet in Tomcat 6, on ubuntu
10.04.

I compiled a xapi-servlet.war from instruction in
https://github.com/iandees/xapi-servlet/blob/master/readme.md, copy
it to a freshly installed Tomcat directory
/var/lib/tomcat6/webapps/ and restarted Tomcat.

The servlet is deployed with no error in the logfiles,
however, when I access
http://localhost:8080/xapi-servlet/api/0.6/way[highway=unclassified]

,
I have a 'class not found exception' :

java.lang.ClassNotFoundException:
com.yellowbkpk.geo.xapi.servlet.XapiServlet

Also, I can access http://localhost:8080/xapi-servlet/ but
not http://localhost:8080/xapi-servlet/WEB-INF/index.html

Is there a manual config to do that I missed?

Yves

___
dev mailing list
dev@openstreetmap.org 
http://lists.openstreetmap.org/listinfo/dev





___
dev mailing list
dev@openstreetmap.org 
http://lists.openstreetmap.org/listinfo/dev




___
dev mailing list
dev@openstreetmap.org
http://lists.openstreetmap.org/listinfo/dev

Re: [OSM-dev] Xapi-servlet deployement in Tomcat

[Brett Henderson]

Tomcat should allow file-based deployment.  It should be as simple as
copying the war file into the webapps directory.  It will end up with a
context root that matches the war filename (minus .war).

Different app servers usually provide ways to override the default context
root via embedding app server specific files into the deployment archive (at
least full JEE servers such as jboss, websphere, and glassfish do), but I
can't remember how to do that with Tomcat.  In most cases just renaming the
war prior to deployment is the simplest solution.

On Sun, Jan 30, 2011 at 3:32 AM, yvecai  wrote:

>  I did that too, but no cigar.
> What is the context you used?
>
> Yves
>
>
> On 29. 01. 11 15:07, Ian Dees wrote:
>
> I'm not very clear on how to deploy servlets. I used tomcat6 and Ubuntu
> 10.04, too, but I deployed the war via the tomcat6-admin servlet that is
> installed as a separate package. It offers a "deploy" section where you can
> specify the path to the war and the context to deploy the war in. When I use
> that it seems to work well.
>
> On Sat, Jan 29, 2011 at 2:44 AM, yvecai  wrote:
>
>> I have trouble to deploy xapi-servlet in Tomcat 6, on ubuntu 10.04.
>>
>> I compiled a xapi-servlet.war from instruction in
>> https://github.com/iandees/xapi-servlet/blob/master/readme.md, copy it to
>> a freshly installed Tomcat directory /var/lib/tomcat6/webapps/ and restarted
>> Tomcat.
>>
>> The servlet is deployed with no error in the logfiles, however, when I
>> access
>> http://localhost:8080/xapi-servlet/api/0.6/way[highway=unclassified],
>> I have a 'class not found exception' :
>>
>> java.lang.ClassNotFoundException:
>> com.yellowbkpk.geo.xapi.servlet.XapiServlet
>>
>> Also, I can access http://localhost:8080/xapi-servlet/ but not
>> http://localhost:8080/xapi-servlet/WEB-INF/index.html
>>
>> Is there a manual config to do that I missed?
>>
>> Yves
>>
>> ___
>> dev mailing list
>> dev@openstreetmap.org
>> http://lists.openstreetmap.org/listinfo/dev
>>
>
>
>
> ___
> dev mailing list
> dev@openstreetmap.org
> http://lists.openstreetmap.org/listinfo/dev
>
>
___
dev mailing list
dev@openstreetmap.org
http://lists.openstreetmap.org/listinfo/dev

Re: [OSM-dev] Xapi alternative

[Mitja Kleider]

>> On Sat, 29 Jan 2011 10:46:12 +0100, Maarten Deen 
>> wrote:
>>> Can you elaborate on how to do bbox queries with this?
>>
>> Like this:
>>
>> http://78.47.225.27/tag/amenity/bank/all/ids.json?bbox=9.7190434375091,51.496178170005,10.15849656249,51.565057661413
>>
>> Please note that the data on that server is only covering a small area.
> 
> Then I've found a small bug for you
[...]
> Apparently the parser can not cope with lat/lon figures without a decimal.

Thanks, this is now fixed on the demonstration server.


> Is there also a possibility to get output as an osm file?

OSM output is not yet implemented. You could add it by modifying [1]
from line 100 to 159.

[1]
http://gitorious.org/osm-poi-tools/server/blobs/master/list/views.py#line100



Mitja

___
dev mailing list
dev@openstreetmap.org
http://lists.openstreetmap.org/listinfo/dev

Re: [OSM-dev] Xapi-servlet deployement in Tomcat

[yvecai]

I did that too, but no cigar.
What is the context you used?

Yves

On 29. 01. 11 15:07, Ian Dees wrote:
I'm not very clear on how to deploy servlets. I used tomcat6 and 
Ubuntu 10.04, too, but I deployed the war via the tomcat6-admin 
servlet that is installed as a separate package. It offers a "deploy" 
section where you can specify the path to the war and the context to 
deploy the war in. When I use that it seems to work well.


On Sat, Jan 29, 2011 at 2:44 AM, yvecai > wrote:


I have trouble to deploy xapi-servlet in Tomcat 6, on ubuntu 10.04.

I compiled a xapi-servlet.war from instruction in
https://github.com/iandees/xapi-servlet/blob/master/readme.md,
copy it to a freshly installed Tomcat directory
/var/lib/tomcat6/webapps/ and restarted Tomcat.

The servlet is deployed with no error in the logfiles, however,
when I access
http://localhost:8080/xapi-servlet/api/0.6/way[highway=unclassified]
,
I have a 'class not found exception' :

java.lang.ClassNotFoundException:
com.yellowbkpk.geo.xapi.servlet.XapiServlet

Also, I can access http://localhost:8080/xapi-servlet/ but not
http://localhost:8080/xapi-servlet/WEB-INF/index.html

Is there a manual config to do that I missed?

Yves

___
dev mailing list
dev@openstreetmap.org 
http://lists.openstreetmap.org/listinfo/dev




___
dev mailing list
dev@openstreetmap.org
http://lists.openstreetmap.org/listinfo/dev

Re: [OSM-dev] Xapi-servlet deployement in Tomcat

[Ian Dees]

I'm not very clear on how to deploy servlets. I used tomcat6 and Ubuntu
10.04, too, but I deployed the war via the tomcat6-admin servlet that is
installed as a separate package. It offers a "deploy" section where you can
specify the path to the war and the context to deploy the war in. When I use
that it seems to work well.

On Sat, Jan 29, 2011 at 2:44 AM, yvecai  wrote:

> I have trouble to deploy xapi-servlet in Tomcat 6, on ubuntu 10.04.
>
> I compiled a xapi-servlet.war from instruction in
> https://github.com/iandees/xapi-servlet/blob/master/readme.md, copy it to
> a freshly installed Tomcat directory /var/lib/tomcat6/webapps/ and restarted
> Tomcat.
>
> The servlet is deployed with no error in the logfiles, however, when I
> access
> http://localhost:8080/xapi-servlet/api/0.6/way[highway=unclassified],
> I have a 'class not found exception' :
>
> java.lang.ClassNotFoundException:
> com.yellowbkpk.geo.xapi.servlet.XapiServlet
>
> Also, I can access http://localhost:8080/xapi-servlet/ but not
> http://localhost:8080/xapi-servlet/WEB-INF/index.html
>
> Is there a manual config to do that I missed?
>
> Yves
>
> ___
> dev mailing list
> dev@openstreetmap.org
> http://lists.openstreetmap.org/listinfo/dev
>
___
dev mailing list
dev@openstreetmap.org
http://lists.openstreetmap.org/listinfo/dev

Re: [OSM-dev] Xapi alternative

[Maarten Deen]

Mitja, your From:  is malformed.


> On Sat, 29 Jan 2011 10:46:12 +0100, Maarten Deen 
> wrote:
>> Can you elaborate on how to do bbox queries with this?
>
>
> Like this:
>
> 
http://78.47.225.27/tag/amenity/bank/all/ids.json?bbox=9.7190434375091,51.496178170005,10.15849656249,51.565057661413

>
> Please note that the data on that server is only covering a small area.

Then I've found a small bug for you
This works fine: 



But this does not: 



Apparently the parser can not cope with lat/lon figures without a decimal.

Is there also a possibility to get output as an osm file?

Regards,
Maarten

___
dev mailing list
dev@openstreetmap.org
http://lists.openstreetmap.org/listinfo/dev

Re: [OSM-dev] Xapi alternative

[Maarten Deen]

Mitja Kleider wrote:
> Hi Antoine,
>
> On Fri, 28 Jan 2011 16:11:11 +0100, Antoine Pichon
>  wrote:
>> I am building an application that needs to access osm poi database. Ex
>> : Extract all the banks (or any orther amenity)  of a given area. I
>> didn't find this possibility (amenity filtering) in basic API but only
>> in xapi
>>
>> 1/ is there any other possibility instead of xapi to do that ?
>
> Andy already mentioned the new XAPI implementation.
>
> Last summer I wrote a POI API [1]. The wiki pages should contain setup
> information and query examples. If you have questions, feel free to
> ask.
>
> There is a (weak) demonstration server with data covering a tiny area
> at [2]. You probably want to do something like [3] or [4].
>
>
> [1] http://wiki.openstreetmap.org/wiki/POI_tools
> [2] http://78.47.225.27/
> [3]
> 
http://78.47.225.27/static/examples/map.html?key=amenity&value=bank&zoom=15&lat=51.53318&lon=9.93624&lang=en

> [4]
> 
http://78.47.225.27/static/examples/list.html?type=relation&osm_id=191361&key=amenity&value=bank&lang=en


Can you elaborate on how to do bbox queries with this?

Regards,
Maarten

___
dev mailing list
dev@openstreetmap.org
http://lists.openstreetmap.org/listinfo/dev

Re: [OSM-dev] Xapi alternative

[Mitja Kleider]

Hi Antoine,

On Fri, 28 Jan 2011 16:11:11 +0100, Antoine Pichon
 wrote:
> I am building an application that needs to access osm poi database. Ex
> : Extract all the banks (or any orther amenity)  of a given area. I
> didn't find this possibility (amenity filtering) in basic API but only
> in xapi
> 
> 1/ is there any other possibility instead of xapi to do that ?

Andy already mentioned the new XAPI implementation.

Last summer I wrote a POI API [1]. The wiki pages should contain setup
information and query examples. If you have questions, feel free to
ask.

There is a (weak) demonstration server with data covering a tiny area
at [2]. You probably want to do something like [3] or [4].


[1] http://wiki.openstreetmap.org/wiki/POI_tools
[2] http://78.47.225.27/
[3]
http://78.47.225.27/static/examples/map.html?key=amenity&value=bank&zoom=15&lat=51.53318&lon=9.93624&lang=en
[4]
http://78.47.225.27/static/examples/list.html?type=relation&osm_id=191361&key=amenity&value=bank&lang=en


Mitja


___
dev mailing list
dev@openstreetmap.org
http://lists.openstreetmap.org/listinfo/dev

Re: [OSM-dev] Xapi alternative

[Serge Wroclawski]

Antoine,

There's work being done on Ian's server side, and I'm working on
making a simple web frontend to XAPI so people can have a little
easier time working with it.

My code (just some HTML, CSS and JS) is at:

https://github.com/emacsen/xapi-ui

I could use some help. I'd like to get a search bar working with
nominatim (vs just using the map)- that'd take some work with
nominatium and jquery-ui, I'd like to get "select by drawn bbox" (ie
some openlayers magic), results preview (openlayers) and in general,
make the thing look pretty (mostly css and web page design).

So there's plenty of opportunity to help make XAPI good.

- Serge

___
dev mailing list
dev@openstreetmap.org
http://lists.openstreetmap.org/listinfo/dev

Re: [OSM-dev] Xapi alternative

[Andy Allan]

On Fri, Jan 28, 2011 at 3:11 PM, Antoine Pichon  wrote:
> Hi everybody
>
> First post here  and a few questions to ask :-)

Welcome.

> 1/ is there any other possibility instead of xapi to do that ?

You can download the planet file, filter it and get your own results.
You probably don't want to go through all that hassle, but it is
possible.

> 2/ the problem with xapi is that servers are quite always down or
> overloaded or i don't know what ! at least not reliable. Does anybody
> know if it is a temporary problem and should be fixed some day ? And
> what is the problem exactly ?

The root cause is that very few (~1) people know how to write code in
the language that the current XAPI is written in. That makes it harder
for people to help with development, and harder set up and manage the
servers too, and the volunteer who set up the main xapi server is
working on other projects right now so things have hit a bit of a
bottleneck.

> 3/ i read in newsletter recent archive that some people were
> considering hosting their own xapi server and even rewriting xapi
> itself.
> Wouldn't it be much easier to add xapi features to basic api ?
> And actually, I am just wondering why it has not been done already. Is
> it on purpose ? or a technical reason ? or just nobody had the time to
> do it ?

It's on purpose. The editing API (you call it the basic api) is for
the core features needed for editing the map only. It's a policy
decision that cool alternatives like xapi should run independently of
the main servers, rather than continually adding more and more
features to the main editing API. This allows people to run their own
copies of the read-only servers for their own projects, and other
groups to run and maintain xapi-style services independently, and lets
the sysadmins concentrate on the core services.

> 4/ rewriting xapi ? Why not, if i can help... (i know c, sql ...).

Great. There's some people working on the xapi-servlet program at
https://github.com/iandees/xapi-servlet . You could help them out with
development, testing, documentation and all that kind of thing.

> But hosting my own server would be really much more complicate (money,
> bandwidth )

Don't worry about that too much, we have hardware earmarked for these
purposes when the code is ready and working.

Cheers,
Andy

___
dev mailing list
dev@openstreetmap.org
http://lists.openstreetmap.org/listinfo/dev

Re: [OSM-dev] XAPI - Source code

[arminus]

Same error. However, I got it working now with --write-pgsql-dump and a
subsequent pgsnapshot_load_0.6.sql. Your new xapi code now also returns a
valid result. Great :-)

cheers,
Armin

-- 
View this message in context: 
http://gis.638310.n2.nabble.com/API-XAPI-caching-proxy-server-tp5825779p5886831.html
Sent from the Developer Discussion mailing list archive at Nabble.com.

___
dev mailing list
dev@openstreetmap.org
http://lists.openstreetmap.org/listinfo/dev

Re: [OSM-dev] XAPI - Source code

[Ian Dees]

On Mon, Jan 3, 2011 at 3:10 PM, arminus  wrote:

>
> > This sounds as if your database isn't even a PostGIS database?
>
> No it wasn't :-/ I didn't realize that apparently (?) the osmosis
> import I did after postgis enabling the db somehow wiped out the
> postgis code in it ... At any rate, I don't get the errors on an empty
> db anymore, but I also fail to populate the new db now. Here's what I
> did:
>
> createdb -U postgres openstreetmap
> createlang -U postgres plpgsql openstreetmap
> psql -U postgres -d openstreetmap -f
> /usr/share/postgresql/contrib/postgis-1.5/postgis.sql
> psql -U postgres -d openstreetmap -f
> /usr/share/postgresql/contrib/postgis-1.5/spatial_ref_sys.sql
> psql -U postgres -d openstreetmap -f
> /usr/share/postgresql/contrib/hstore.sql
> psql -U postgres -d openstreetmap -f
> osm_routing/osmosis-0.38/script/pgsnapshot_schema_0.6
> psql -U postgres -d openstreetmap -f
> osm_routing/osmosis-0.38/script/pgsnapshot_schema_0.6_linestring.sql
> osmosis --read-xml-0.6 file="data2.osm" --write-pgsql host="localhost"
> database="openstreetmap" user="postgres" validateSchemaVersion=no
>
> and this is what I get:
>
> org.openstreetmap.osmosis.core.OsmosisRuntimeException: Cannot begin
> reading in Add stage, must call complete first.
>
>
I've not seen that error before.

I would start from scratch (drop the DB and perform those steps again),
leaving the validateSchemaVersion argument off this time.
___
dev mailing list
dev@openstreetmap.org
http://lists.openstreetmap.org/listinfo/dev

Re: [OSM-dev] XAPI - Source code

[arminus]

> This sounds as if your database isn't even a PostGIS database?

No it wasn't :-/ I didn't realize that apparently (?) the osmosis
import I did after postgis enabling the db somehow wiped out the
postgis code in it ... At any rate, I don't get the errors on an empty
db anymore, but I also fail to populate the new db now. Here's what I
did:

createdb -U postgres openstreetmap
createlang -U postgres plpgsql openstreetmap
psql -U postgres -d openstreetmap -f
/usr/share/postgresql/contrib/postgis-1.5/postgis.sql
psql -U postgres -d openstreetmap -f
/usr/share/postgresql/contrib/postgis-1.5/spatial_ref_sys.sql
psql -U postgres -d openstreetmap -f
/usr/share/postgresql/contrib/hstore.sql
psql -U postgres -d openstreetmap -f
osm_routing/osmosis-0.38/script/pgsnapshot_schema_0.6
psql -U postgres -d openstreetmap -f
osm_routing/osmosis-0.38/script/pgsnapshot_schema_0.6_linestring.sql
osmosis --read-xml-0.6 file="data2.osm" --write-pgsql host="localhost"
database="openstreetmap" user="postgres" validateSchemaVersion=no

and this is what I get:

org.openstreetmap.osmosis.core.OsmosisRuntimeException: Cannot begin
reading in Add stage, must call complete first.
   at
org.openstreetmap.osmosis.core.store.RandomAccessObjectStore.initializeReadingStage(RandomAccessObjectStore.java:156)
   at
org.openstreetmap.osmosis.core.store.RandomAccessObjectStore.createReader(RandomAccessObjectStore.java:181)
   at
org.openstreetmap.osmosis.core.store.IndexStore.createReader(IndexStore.java:151)
   at
org.openstreetmap.osmosis.core.store.IndexedObjectStore.createReader(IndexedObjectStore.java:96)
   at
org.openstreetmap.osmosis.pgsnapshot.common.CompactPersistentNodeLocationStore.getNodeLocation(CompactPersistentNodeLocationStore.java:50)
   at
org.openstreetmap.osmosis.pgsnapshot.v0_6.impl.WayGeometryBuilder.createWayLinestring(WayGeometryBuilder.java:204)

(I also tried loading CreateGeometryForWays.sql before running the
osmosis import - same errors)

cheers,
Armin
-- 
View this message in context: 
http://gis.638310.n2.nabble.com/API-XAPI-caching-proxy-server-tp5825779p5886687.html
Sent from the Developer Discussion mailing list archive at Nabble.com.

___
dev mailing list
dev@openstreetmap.org
http://lists.openstreetmap.org/listinfo/dev

Re: [OSM-dev] XAPI - Source code

[Frederik Ramm]

Hi,

arminus wrote:

Exception in thread "main" org.springframework.jdbc.BadSqlGrammarException:
PreparedStatementCallback; bad SQL grammar [CREATE TEMPORARY TABLE
bbox_nodes ON COMMIT DROP AS SELECT * FROM nodes WHERE (geom && ?)]; nested
exception is org.postgresql.util.PSQLException: Unknown type geometry.


This sounds as if your database isn't even a PostGIS database?

Bye
Frederik

--
Frederik Ramm  ##  eMail frede...@remote.org  ##  N49°00'09" E008°23'33"

___
dev mailing list
dev@openstreetmap.org
http://lists.openstreetmap.org/listinfo/dev

Re: [OSM-dev] XAPI - Source code

[Ian Dees]

On Mon, Jan 3, 2011 at 10:21 AM, arminus  wrote:

>
> @Ian:
>
> > The grammar that I published parses the examples on the xapi wiki page
> > just
> > fine. The hard part now is converting those in to SQL statements while
> > maintaining speed.
>
> In which stage is this code presently ? I managed to build it, but when I
> try to actually run a query, I get
>
> Exception in thread "main" org.springframework.jdbc.BadSqlGrammarException:
> PreparedStatementCallback; bad SQL grammar [CREATE TEMPORARY TABLE
> bbox_nodes ON COMMIT DROP AS SELECT * FROM nodes WHERE (geom && ?)]; nested
> exception is org.postgresql.util.PSQLException: Unknown type geometry.
>at
>
> org.springframework.jdbc.support.SQLStateSQLExceptionTranslator.doTranslate(SQLStateSQLExceptionTranslator.java:98)
>
> (postgis-2.0.0SVN.jar is in my build path)
>

The code is working relatively well for some use cases last I checked. That
particular error looks like your schema isn't set up correctly.

Some things to check:
1) Are you using the Osmosis pgsnapshot schema?
2) Did you apply the *_linestring.sql file to the database?

-Ian
___
dev mailing list
dev@openstreetmap.org
http://lists.openstreetmap.org/listinfo/dev

Re: [OSM-dev] XAPI - Source code

[arminus]

@Ian:

> The grammar that I published parses the examples on the xapi wiki page
> just
> fine. The hard part now is converting those in to SQL statements while
> maintaining speed.

In which stage is this code presently ? I managed to build it, but when I
try to actually run a query, I get

Exception in thread "main" org.springframework.jdbc.BadSqlGrammarException:
PreparedStatementCallback; bad SQL grammar [CREATE TEMPORARY TABLE
bbox_nodes ON COMMIT DROP AS SELECT * FROM nodes WHERE (geom && ?)]; nested
exception is org.postgresql.util.PSQLException: Unknown type geometry.
at
org.springframework.jdbc.support.SQLStateSQLExceptionTranslator.doTranslate(SQLStateSQLExceptionTranslator.java:98)

(postgis-2.0.0SVN.jar is in my build path)

thx,
Armin
-- 
View this message in context: 
http://gis.638310.n2.nabble.com/API-XAPI-caching-proxy-server-tp5825779p5880974.html
Sent from the Developer Discussion mailing list archive at Nabble.com.

___
dev mailing list
dev@openstreetmap.org
http://lists.openstreetmap.org/listinfo/dev

Re: [OSM-dev] XAPI - Source code

[Ian Dees]

On Dec 20, 2010 1:47 AM, "Stefan Keller"  wrote:
>
> Philipp, Ian
>
> @Philipp:
> Ian seems to begin a complete rewrite of XAPI. There seems to be only
> on implementation out there and at for some time least three well
> known installations. See also Frederiks answer recently.
>
> @Ian:
> Since you start programming: Did you verify/discuss with others the
> syntax you re-engineered and published on
> https://github.com/iandees/xapi-servlet ?

The grammar that I published parses the examples on the xapi wiki page just
fine. The hard part now is converting those in to SQL statements while
maintaining speed.

>
> Yours, S.
>
> 2010/12/20 Philipp Borgers :
> >
> >> 1. I think all XAPI server mentioned in
> >> http://wiki.openstreetmap.org/wiki/XAPI#Servers use the same code,
> >> don't they?
> >>
> >
> > Can someone provide source code for all the xapi implementations out
> > there? http://xapi.openstreetmap.org/scripts is broken for several days
> > now. I will make a list in the wiki if I get several.
> >
> >> 2. The http://wiki.openstreetmap.org/wiki/Platform_Status should be
> >> more up-to-date: Who maintains it? Can anyone help there?
> >
> > Why is xapi down?
> >
> > best regards
> >
> > philipp
> >
> >
> >
> >
> > ___
> > dev mailing list
> > dev@openstreetmap.org
> > http://lists.openstreetmap.org/listinfo/dev
> >
___
dev mailing list
dev@openstreetmap.org
http://lists.openstreetmap.org/listinfo/dev

Re: [OSM-dev] XAPI - Source code

[Stefan Keller]

Philipp, Ian

@Philipp:
Ian seems to begin a complete rewrite of XAPI. There seems to be only
on implementation out there and at for some time least three well
known installations. See also Frederiks answer recently.

@Ian:
Since you start programming: Did you verify/discuss with others the
syntax you re-engineered and published on
https://github.com/iandees/xapi-servlet ?

Yours, S.

2010/12/20 Philipp Borgers :
>
>> 1. I think all XAPI server mentioned in
>> http://wiki.openstreetmap.org/wiki/XAPI#Servers use the same code,
>> don't they?
>>
>
> Can someone provide source code for all the xapi implementations out
> there? http://xapi.openstreetmap.org/scripts is broken for several days
> now. I will make a list in the wiki if I get several.
>
>> 2. The http://wiki.openstreetmap.org/wiki/Platform_Status should be
>> more up-to-date: Who maintains it? Can anyone help there?
>
> Why is xapi down?
>
> best regards
>
> philipp
>
>
>
>
> ___
> dev mailing list
> dev@openstreetmap.org
> http://lists.openstreetmap.org/listinfo/dev
>

___
dev mailing list
dev@openstreetmap.org
http://lists.openstreetmap.org/listinfo/dev

Re: [OSM-dev] XAPI - Source code

[Philipp Borgers]

> 1. I think all XAPI server mentioned in
> http://wiki.openstreetmap.org/wiki/XAPI#Servers use the same code,
> don't they?
> 

Can someone provide source code for all the xapi implementations out
there? http://xapi.openstreetmap.org/scripts is broken for several days
now. I will make a list in the wiki if I get several.

> 2. The http://wiki.openstreetmap.org/wiki/Platform_Status should be
> more up-to-date: Who maintains it? Can anyone help there?

Why is xapi down? 

best regards

philipp




___
dev mailing list
dev@openstreetmap.org
http://lists.openstreetmap.org/listinfo/dev

Re: [OSM-dev] XAPI server unusable

[Wyo]

Ian Dees wrote:

As you can imagine the few XAPI servers out there are already quite
burdened. If your use of the XAPI requires uptime guarantees then you
should run your own instance somewhere.

My tests showed XAPI is more or less not working at all (less than 10%). If 
other users gets equally bad results, I can't imagine at all anybody using XAPI. 
Luckally I don't require any uptime guarantees I can easily drop any XAPI tests.


Wyo


___
dev mailing list
dev@openstreetmap.org
http://lists.openstreetmap.org/listinfo/dev

Re: [OSM-dev] XAPI server unusable

[Ian Dees]

On Thu, Dec 2, 2010 at 10:25 AM, Wyo  wrote:

> I've rebuild the "osm_xapi" example and if the XAPI servers work, it would
> be terrific.
>
>
> http://dev.openlayers.org/sandbox/fvanderbiest/openlayers/examples/osm_xapi.html
>
> http://www.orpatec.ch/osm/tools/test.php?lat=48.9116&lon=5.5247&zoom=14&layers=M
>
> Unfortunately the server mostly don't work, better said only
> xapi.openstreetmap.org works sometimes. At the moment it doesn't.
>
> http://wiki.openstreetmap.org/wiki/Platform_Status
>
> Are there any plans to fix this situation?
>
>
As you can imagine the few XAPI servers out there are already quite
burdened. If your use of the XAPI requires uptime guarantees then you should
run your own instance somewhere.
___
dev mailing list
dev@openstreetmap.org
http://lists.openstreetmap.org/listinfo/dev

Re: [OSM-dev] xapi - find node by id

[Peter Körner]

Am 02.09.2010 16:36, schrieb bernhard zwischenbrugger:

Hi all

Is there a way to get a node from xapi if I know the id?

I tryed this:
http://xapi.openstreetmap.org/api/0.6/way[id=8136261]
and this.
http://xapi.openstreetmap.org/api/0.6/way/8136261

You're requesting a way.

http://www.openstreetmap.org/api/0.6/node/8136261/1
will work as well as
http://www.openstreetmap.org/api/0.6/node/8136261/history

http://www.openstreetmap.org/api/0.6/node/8136261
won't because the node is deleted.

Peter

___
dev mailing list
dev@openstreetmap.org
http://lists.openstreetmap.org/listinfo/dev

Re: [OSM-dev] xapi - find node by id

[Emilie Laffray]

On 2 September 2010 15:36, bernhard zwischenbrugger wrote:

>  Hi all
>
> Is there a way to get a node from xapi if I know the id?
>
> I tryed this:
> http://xapi.openstreetmap.org/api/0.6/way[id=8136261]
> and this.
> http://xapi.openstreetmap.org/api/0.6/way/8136261
>
> Both don't give a result.
>

Hello,

if you know the id, you can get the information directly on osm website
without xapi. Xapi is mostly use to search specific tags. When you have the
id, you can make use of the main api.
http://www.openstreetmap.org/api/0.6/way/8136261

You gave the example of a way. A node syntax would be
http://www.openstreetmap.org/api/0.6/node/x

Emilie Laffray
___
dev mailing list
dev@openstreetmap.org
http://lists.openstreetmap.org/listinfo/dev

Re: [OSM-dev] XAPI problems and available queries

[Erik Johansson]

I'll try to answer the questions and maybe someone else can fill in
where I get things wrong.

On Wed, Aug 25, 2010 at 9:17 PM, Khoa Tran  wrote:
> 1) Sometimes, XAPI server responds pretty quick for my query. However, for
> some other time, it's very slow like 5 or 10 minutes to get all the nodes
> (http://www.informationfreeway.org/api/0.6/node[highway=bus_stop][bbox=-82.738031,27.70168,-82.153672,28.252141]
> retrieves approximately 3900 nodes. I know this is a large dataset but the
> xml download file is not that big, under 2MB).

Don't know, sometimes things are slow?

> 2) Since data needs to be updated by osmosis to planetdump before XAPI can
> have the new data, I understand that there's a mismatch between real
> openstreetmap database and xapi data. However, I've read on the wiki page
> that planetdump is updated minutely (??). It seems to me it takes more time
> to update the new data. I had to wait 3,4 hours before my new data/change
> took place in XAPI server.

There have been problems with generating the minutely diffs, since the
db updated to pg8.4. Not sure if this will solve it self in the near
time.


> * Is there anything I can do in my application to stay away from the above
> problems? I don't intend to have my own database to handle the same job of
> XAPI server.
> * Is there a way to access OpenStreetMap Postgresql database to GET data
> only besides using the API? I'd love to use something like XAPI but more
> stable.

Only running your own local server, or maybe  take a look at the
different Openstreetmap tool servers out there. I know Openstreetmap,
Wikimedia, French-OSM and German-OSM have tool servers for
openstreetmap, don't think they are ment for this kind of stuff but
you can ask.


> * The last question seems irrelevant to this thread but I can't find an
> answer myself. If a node is deleted, how to get that node WITHOUT the node
> id (e.g. I'd like to use something like
> this http://www.informationfreeway.org/api/0.6/node[highway=bus_stop][bbox=-82.738031,27.70168,-82.153672,28.252141]
> but with all the deleted nodes]

As far as I know there is no such webservice available, except if
Potlatch have a undelete node function. I can give you a copy of the
full history of that area but it takes about 8hours to generate. :-)

/Erik Johansson emj

___
dev mailing list
dev@openstreetmap.org
http://lists.openstreetmap.org/listinfo/dev

Re: [OSM-dev] XAPI Server Problems?

[80n]

Graham
The server has been heavily loaded for the last day or so.  Requests are
getting queue up. Increasing your client timeout might help, if you are able
to do that.

I'll turn on some load balancing so that some requests are shed to
hypercube.

Etienne

On Wed, Apr 28, 2010 at 10:13 PM, Graham Jones <
grahamjones...@googlemail.com> wrote:

> Hi Folks,
> Does anyone know if there is a problem with the
> http://xapi.openstreetmap.org server?
>
> http://osmxapi.hypercube.telascience.org works ok, but the other just
> seems to hang once a connection is made.
>
> Unfortunately informationfreeway.org keeps redirecting to the
> openstreetmap one.  Is it possible to change the informationfreeway service
> to redirect to a different server if this one has a problem please?
>
> Thanks
>
> Graham.
> --
> Dr. Graham Jones
> Hartlepool, UK
> email: grahamjones...@gmail.com
>
> ___
> dev mailing list
> dev@openstreetmap.org
> http://lists.openstreetmap.org/listinfo/dev
>
>
___
dev mailing list
dev@openstreetmap.org
http://lists.openstreetmap.org/listinfo/dev

Re: [OSM-dev] XAPI compressed

[Stefan de Konink]

-BEGIN PGP SIGNED MESSAGE-
Hash: SHA512

Op 08-04-10 01:40, Jonathan Bennett schreef:
> On 07/04/2010 21:36, Christian H. Bruhn wrote:
>> Is there a way to get compressed data (e.g. bz2) when I start a
>> XAPI-query? My internet connection is not that fast, but the OSM-data
>> can be easily compressed to 10% of the original size.
> 
> As far as I'm aware, the data is output as soon as it's retrieved from
> the database, which makes compression somewhat difficult. You wouldn't
> get the data any *faster* anyway -- net bandwidth isn't the bottleneck.

Ever heard of deflate/gzip... these are basic webserver things. Just a
'proper' misconfiguration.


Stefan
-BEGIN PGP SIGNATURE-
Version: GnuPG v2.0.14 (GNU/Linux)
Comment: Using GnuPG with Mozilla - http://enigmail.mozdev.org/

iEYEAREKAAYFAku9GhMACgkQYH1+F2Rqwn2j6QCfesYeqgiGYa2rOppJ3730LH8E
uGEAoIr5Sx7l2ABSYRdPhzv8wlYYifMq
=dN2H
-END PGP SIGNATURE-

___
dev mailing list
dev@openstreetmap.org
http://lists.openstreetmap.org/listinfo/dev

Re: [OSM-dev] XAPI compressed

[Jonathan Bennett]

On 07/04/2010 21:36, Christian H. Bruhn wrote:
> Is there a way to get compressed data (e.g. bz2) when I start a
> XAPI-query? My internet connection is not that fast, but the OSM-data
> can be easily compressed to 10% of the original size.

As far as I'm aware, the data is output as soon as it's retrieved from
the database, which makes compression somewhat difficult. You wouldn't
get the data any *faster* anyway -- net bandwidth isn't the bottleneck.


-- 
Jonathan (Jonobennett)

___
dev mailing list
dev@openstreetmap.org
http://lists.openstreetmap.org/listinfo/dev

Re: [OSM-dev] XAPI queries for tags that include a pipe, vbar or vertical bar

[David Calder]

That's excellent! Works a treat!

Many thanks,
David

2009/12/6 80n <80n...@gmail.com>

> On Sun, Dec 6, 2009 at 6:21 PM, David Calder wrote:
>
>> Hi,
>> I was wondering if you could help me. I'm using Tagwatch to find and tidy
>> up the route_ref=* values where a pipe symbol or vbar (i.e. Unicode
>> character U+007C) has been used as a delimeter. See this page for example:
>> http://tagwatch.stoecker.eu/Great_britain/En/ignored_route_ref.html
>>
>> The query for a semicolon delimited value is (for example):
>> http://tagwatch.stoecker.eu/osmxapi/*[route_ref=171;172;178]
>> which works fine.
>>
>> However, the query for a pipe delimited value is (for example):
>> http://tagwatch.stoecker.eu/osmxapi/*[route_ref=46|46A]
>> which returns the data for values that match 46 OR 46A but not "46|46A". I
>> know that this is the correct functionality as defined in the API spec but
>> how do I write the query so that it finds "46|46A". Do I need to escape the
>> character (and if so, how?) or do I need to encode it somehow (and if so,
>> how?)
>>
>
> I've just added escaping for this this and other characters.  To treat | as
> a literal value escape it as \| so your query would be:
>
>
> http://tagwatch.stoecker.eu/osmxapi/*[route_ref=46
> \|46A]
>
> You can escape other characters [ ] = / etc in the same way.
>
> Spaces normally don't need to be escaped but this depends to some extent on
> the client you are using.  If you do need to escape space then it's URL
> encoding that you need, so use %20 in place of a space.
>
> 80n
>
>
>
>
>
>>
>> Many thanks,
>> David
>>
>>
>>
>> ___
>> dev mailing list
>> dev@openstreetmap.org
>> http://lists.openstreetmap.org/listinfo/dev
>>
>>
>
___
dev mailing list
dev@openstreetmap.org
http://lists.openstreetmap.org/listinfo/dev

Re: [OSM-dev] XAPI queries for tags that include a pipe, vbar or vertical bar

[80n]

On Sun, Dec 6, 2009 at 8:14 PM, Marcus Wolschon <
marcus.wolsc...@googlemail.com> wrote:

> It´s the same as me asking about including a space in a tag-value a
> few weeks ago.
> No escaping.
> Who has time to grab the source and add it?
>
> Marcus
It turns out that spaces are already handled correctly by XAPI, but some
clients may require you to url encode the query.  To do this replace each
space with %20.

80n





> Marcus
>
> ___
> dev mailing list
> dev@openstreetmap.org
> http://lists.openstreetmap.org/listinfo/dev
>
___
dev mailing list
dev@openstreetmap.org
http://lists.openstreetmap.org/listinfo/dev

Re: [OSM-dev] XAPI queries for tags that include a pipe, vbar or vertical bar

[80n]

On Sun, Dec 6, 2009 at 6:21 PM, David Calder  wrote:

> Hi,
> I was wondering if you could help me. I'm using Tagwatch to find and tidy
> up the route_ref=* values where a pipe symbol or vbar (i.e. Unicode
> character U+007C) has been used as a delimeter. See this page for example:
> http://tagwatch.stoecker.eu/Great_britain/En/ignored_route_ref.html
>
> The query for a semicolon delimited value is (for example):
> http://tagwatch.stoecker.eu/osmxapi/*[route_ref=171;172;178]
> which works fine.
>
> However, the query for a pipe delimited value is (for example):
> http://tagwatch.stoecker.eu/osmxapi/*[route_ref=46|46A]
> which returns the data for values that match 46 OR 46A but not "46|46A". I
> know that this is the correct functionality as defined in the API spec but
> how do I write the query so that it finds "46|46A". Do I need to escape the
> character (and if so, how?) or do I need to encode it somehow (and if so,
> how?)
>

I've just added escaping for this this and other characters.  To treat | as
a literal value escape it as \| so your query would be:

http://tagwatch.stoecker.eu/osmxapi/*[route_ref=46\|46A]

You can escape other characters [ ] = / etc in the same way.

Spaces normally don't need to be escaped but this depends to some extent on
the client you are using.  If you do need to escape space then it's URL
encoding that you need, so use %20 in place of a space.

80n





>
> Many thanks,
> David
>
>
>
> ___
> dev mailing list
> dev@openstreetmap.org
> http://lists.openstreetmap.org/listinfo/dev
>
>
___
dev mailing list
dev@openstreetmap.org
http://lists.openstreetmap.org/listinfo/dev

Re: [OSM-dev] XAPI queries for tags that include a pipe, vbar or vertical bar

[Marcus Wolschon]

It´s the same as me asking about including a space in a tag-value a
few weeks ago.
No escaping.
Who has time to grab the source and add it?

Marcus

___
dev mailing list
dev@openstreetmap.org
http://lists.openstreetmap.org/listinfo/dev

Re: [OSM-dev] XAPI gone?

[80n]

On Wed, Nov 25, 2009 at 8:26 AM, Alan Mintz

> wrote:

> At 2009-11-25 00:10, 80n wrote:
> >...
> >The third XAPI instance at Bearstech no longer has sufficient disk
> >space.  I'm considering a partial implementation there that will be able
> >to process a sub-set of XAPI queries, but that's somewhere in the future.
>
> Out of curiosity, how much and what kind of disk used/needed are we talking
> about?
>
> Currently about 350Gb.

Since it's pretty I/O intensive, the faster the disks the better.





> --
> Alan Mintz 
>
>
> ___
> dev mailing list
> dev@openstreetmap.org
> http://lists.openstreetmap.org/listinfo/dev
>
___
dev mailing list
dev@openstreetmap.org
http://lists.openstreetmap.org/listinfo/dev

Re: [OSM-dev] XAPI gone?

[Alan Mintz]

At 2009-11-25 00:10, 80n wrote:
>...
>The third XAPI instance at Bearstech no longer has sufficient disk 
>space.  I'm considering a partial implementation there that will be able 
>to process a sub-set of XAPI queries, but that's somewhere in the future.

Out of curiosity, how much and what kind of disk used/needed are we talking 
about?

--
Alan Mintz 


___
dev mailing list
dev@openstreetmap.org
http://lists.openstreetmap.org/listinfo/dev

Re: [OSM-dev] XAPI - issue with spaces in tag-value

[80n]

I do.

On Thu, Nov 5, 2009 at 8:57 PM, Marcus Wolschon <
marcus.wolsc...@googlemail.com> wrote:

> So, who a maintains the XAPI?
>
> On Thu, Nov 5, 2009 at 5:55 PM, 80n <80n...@gmail.com> wrote:
> > I think it's a bug.
> >
> > On Thu, Nov 5, 2009 at 9:31 AM,  wrote:
> >>
> >>
> >> Hello,
> >>
> >> I am using XAPI to search for relations like
> >> [ref=L 1100]
> >> but I get lots of results with ref=L instead of
> >> what I'm searching for.
> >>
> >> Is there some kind of escaping for spaces that just has not been
> >> documented on
> >> http://wiki.openstreetmap.org/wiki/Talk:Xapi#wildcards_in_the_value.3F
> >> or is this a bug?
> >>
> >> Marcus
> >>
> >> ___
> >> dev mailing list
> >> dev@openstreetmap.org
> >> http://lists.openstreetmap.org/listinfo/dev
> >
> >
>
___
dev mailing list
dev@openstreetmap.org
http://lists.openstreetmap.org/listinfo/dev

Re: [OSM-dev] XAPI - issue with spaces in tag-value

[Marcus Wolschon]

So, who a maintains the XAPI?

On Thu, Nov 5, 2009 at 5:55 PM, 80n <80n...@gmail.com> wrote:
> I think it's a bug.
>
> On Thu, Nov 5, 2009 at 9:31 AM,  wrote:
>>
>>
>> Hello,
>>
>> I am using XAPI to search for relations like
>> [ref=L 1100]
>> but I get lots of results with ref=L instead of
>> what I'm searching for.
>>
>> Is there some kind of escaping for spaces that just has not been
>> documented on
>> http://wiki.openstreetmap.org/wiki/Talk:Xapi#wildcards_in_the_value.3F
>> or is this a bug?
>>
>> Marcus
>>
>> ___
>> dev mailing list
>> dev@openstreetmap.org
>> http://lists.openstreetmap.org/listinfo/dev
>
>

___
dev mailing list
dev@openstreetmap.org
http://lists.openstreetmap.org/listinfo/dev

Re: [OSM-dev] [xapi?]

[Cartinus]

On Sunday 19 July 2009 21:07:12 Sergiusz Pawlowicz wrote:
> hello chaps,
> two fast questions:
>
> 1. why xapi servers are not available?
> 2. how to compile and deploy xapi server from sources?
>
> serge
>
> ___
> dev mailing list
> dev@openstreetmap.org
> http://lists.openstreetmap.org/listinfo/dev

http://www.google.com/search?&q=xapi+site%3Alists.openstreetmap.org

-- 
m.v.g.,
Cartinus

___
dev mailing list
dev@openstreetmap.org
http://lists.openstreetmap.org/listinfo/dev

Re: [OSM-dev] XAPI Server

[Jeffrey Ollie]

Any word on getting a 0.6 XAPI server up and running?

On Fri, Jun 12, 2009 at 6:10 AM, 80n<80n...@gmail.com> wrote:
> Folks
> The main XAPI server at hypercube.telascience.org has been down for a few
> days.

-- 
Jeff Ollie

___
dev mailing list
dev@openstreetmap.org
http://lists.openstreetmap.org/listinfo/dev

Re: [OSM-dev] xapi server

[80n]

zappy1 and zappy2 are a hangover from a time when we were running two zappy
instances on a single server (long story...), just use zappy1 for
everything.

Yes there are hard coded paths, the whole thing needs packaging properly.
You may find it easier to work with these paths rather than trying to edit
everything.

80n

On Fri, Jun 19, 2009 at 1:41 PM, Christian Lange  wrote:

> Hi,
>
> what is the different between zappy1 zappy2 zappy4?
>
> there are many hardcoded path's in the source like "/home/etienne/...".
>
>
> regards christian
>
> 80n schrieb:
> > Christian
> > These are compilation errors, but actually for modules that only apply to
> > other platforms so they can be safely ignored.
> >
> > If you re-run the process (zappy1_up I assume) you shouldn't see these
> > errors again.
> >
> > 80n
> >
> > On Fri, Jun 19, 2009 at 9:47 AM, Christian Lange  wrote:
> >
> >
> >> Next problem is:
> >>  o socket:(:port:"PSTA"):10 e  d logMessage("Cannot open
> >> socket",0,port) s stop=1 q
> >>  ^-
> >>At column 12, line 53, source module serverLink.m
> >> %GTM-E-DEVPARUNK, Deviceparameter unknown
> >>. u socket:"PSTA"
> >>   ^-
> >>At column 13, line 57, source module serverLink.m
> >> %GTM-E-DEVPARUNK, Deviceparameter unknown
> >>. j
> >> sub01^serverLink(port,logLevel):(:4:socket:socket):10 e  d
> >> logMessage("Cannot spawn sub-process",1,port) q
> >> ^-
> >>At column 39, line 60, source module serverLink.m
> >> %GTM-E-JOBPARUNK, Job parameter unknown
> >>o device:("TCP":"":port):10 e  d logMessage("Cannot open
> >> socket",0,port) s stop=1 q
> >>  ^-
> >>At column 12, line 73, source module serverLink.m
> >> %GTM-E-DEVPARUNK, Deviceparameter unknown
> >>. s socket=$zsocket(device)
> >>^-
> >>At column 14, line 80, source module serverLink.m
> >> %GTM-E-INVFCN, Invalid function name
> >>. u device:(::socket) ; Detach socket
> >>^-
> >>At column 14, line 82, source module serverLink.m
> >> %GTM-E-DEVPARUNK, Deviceparameter unknown
> >>. c device:socket
> >> ^-
> >>At column 19, line 84, source module serverLink.m
> >> %GTM-E-DEVPARVALREQ, A value is required for this device parameter
> >>s $et="i $estack=0 znspace """_$znspace_""" g
> >> error^serverLink"
> >>^-
> >>At column 34, line 182, source module serverLink.m
> >> %GTM-E-INVSVN, Invalid special variable name
> >>u socket:(::"STP")
> >>  ^-
> >>At column 12, line 188, source module serverLink.m
> >> %GTM-E-DEVPARUNK, Deviceparameter unknown
> >>. u socket:(::"STP")
> >>^-
> >>At column 14, line 198, source module serverLink.m
> >> %GTM-E-DEVPARUNK, Deviceparameter unknown
> >>s ucivol=$zu(0)
> >>  ^-
> >>At column 12, line 228, source module serverLink.m
> >> %GTM-E-INVFCN, Invalid function name
> >>s ucivolno=$zu(uci,vol)
> >>^-
> >>At column 14, line 231, source module serverLink.m
> >> %GTM-E-INVFCN, Invalid function name
> >>o device:("TCP":""socket) ; Attach socket
> >>  ^-
> >>At column 12, line 239, source module serverLink.m
> >> %GTM-E-DEVPARUNK, Deviceparameter unknown
> >>u device:(:::$c(10))
> >>  ^-
> >>At column 12, line 285, source module serverLink.m
> >> %GTM-E-DEVPARUNK, Deviceparameter unknown
> >>
> >>
> >> regards christian
> >>
> >> 80n schrieb:
> >>
> >>> Christian
> >>> This can occur if you are running SELinux.  In that case try it with
> >>>
> >> SELinux
> >>
> >>> disabled, or follow the suggestions from this post:
> >>>
> >>>
> >>
> http://www.mail-archive.com/hardhats-memb...@lists.sourceforge.net/msg16471.html
> >>
> >>> A second possibility is if you are using an AMD processor then you need
> >>>
> >> to
> >>
> >>> add noexec32=off to your kernel boot command line.
> >>>
> >>> 80n
> >>>
> >>> On Thu, Jun 18, 2009 at 11:12 AM, Christian Lange 
> wrote:
> >>>
> >>>
> >>>
>  Hi,
>  i will be setup a xapi server.
> 
>  i have looked in http://xapi.openstreetmap.org/ and
>  http://xapi.openstreetmap.org/scripts  .
> 
>  but i do nothing know about GT.M
> 
>  i have try to start zappy:
> 
>  %GTM-F-KILLBYSIGSINFO1, GT.M process 20929 has been killed by a signal
>  11 at address 

Re: [OSM-dev] xapi server

[Christian Lange]

Hi,

what is the different between zappy1 zappy2 zappy4?

there are many hardcoded path's in the source like "/home/etienne/...".


regards christian

80n schrieb:
> Christian
> These are compilation errors, but actually for modules that only apply to
> other platforms so they can be safely ignored.
>
> If you re-run the process (zappy1_up I assume) you shouldn't see these
> errors again.
>
> 80n
>
> On Fri, Jun 19, 2009 at 9:47 AM, Christian Lange  wrote:
>
>   
>> Next problem is:
>>  o socket:(:port:"PSTA"):10 e  d logMessage("Cannot open
>> socket",0,port) s stop=1 q
>>  ^-
>>At column 12, line 53, source module serverLink.m
>> %GTM-E-DEVPARUNK, Deviceparameter unknown
>>. u socket:"PSTA"
>>   ^-
>>At column 13, line 57, source module serverLink.m
>> %GTM-E-DEVPARUNK, Deviceparameter unknown
>>. j
>> sub01^serverLink(port,logLevel):(:4:socket:socket):10 e  d
>> logMessage("Cannot spawn sub-process",1,port) q
>> ^-
>>At column 39, line 60, source module serverLink.m
>> %GTM-E-JOBPARUNK, Job parameter unknown
>>o device:("TCP":"":port):10 e  d logMessage("Cannot open
>> socket",0,port) s stop=1 q
>>  ^-
>>At column 12, line 73, source module serverLink.m
>> %GTM-E-DEVPARUNK, Deviceparameter unknown
>>. s socket=$zsocket(device)
>>^-
>>At column 14, line 80, source module serverLink.m
>> %GTM-E-INVFCN, Invalid function name
>>. u device:(::socket) ; Detach socket
>>^-
>>At column 14, line 82, source module serverLink.m
>> %GTM-E-DEVPARUNK, Deviceparameter unknown
>>. c device:socket
>> ^-
>>At column 19, line 84, source module serverLink.m
>> %GTM-E-DEVPARVALREQ, A value is required for this device parameter
>>s $et="i $estack=0 znspace """_$znspace_""" g
>> error^serverLink"
>>^-
>>At column 34, line 182, source module serverLink.m
>> %GTM-E-INVSVN, Invalid special variable name
>>u socket:(::"STP")
>>  ^-
>>At column 12, line 188, source module serverLink.m
>> %GTM-E-DEVPARUNK, Deviceparameter unknown
>>. u socket:(::"STP")
>>^-
>>At column 14, line 198, source module serverLink.m
>> %GTM-E-DEVPARUNK, Deviceparameter unknown
>>s ucivol=$zu(0)
>>  ^-
>>At column 12, line 228, source module serverLink.m
>> %GTM-E-INVFCN, Invalid function name
>>s ucivolno=$zu(uci,vol)
>>^-
>>At column 14, line 231, source module serverLink.m
>> %GTM-E-INVFCN, Invalid function name
>>o device:("TCP":""socket) ; Attach socket
>>  ^-
>>At column 12, line 239, source module serverLink.m
>> %GTM-E-DEVPARUNK, Deviceparameter unknown
>>u device:(:::$c(10))
>>  ^-
>>At column 12, line 285, source module serverLink.m
>> %GTM-E-DEVPARUNK, Deviceparameter unknown
>>
>>
>> regards christian
>>
>> 80n schrieb:
>> 
>>> Christian
>>> This can occur if you are running SELinux.  In that case try it with
>>>   
>> SELinux
>> 
>>> disabled, or follow the suggestions from this post:
>>>
>>>   
>> http://www.mail-archive.com/hardhats-memb...@lists.sourceforge.net/msg16471.html
>> 
>>> A second possibility is if you are using an AMD processor then you need
>>>   
>> to
>> 
>>> add noexec32=off to your kernel boot command line.
>>>
>>> 80n
>>>
>>> On Thu, Jun 18, 2009 at 11:12 AM, Christian Lange  wrote:
>>>
>>>
>>>   
 Hi,
 i will be setup a xapi server.

 i have looked in http://xapi.openstreetmap.org/ and
 http://xapi.openstreetmap.org/scripts  .

 but i do nothing know about GT.M

 i have try to start zappy:

 %GTM-F-KILLBYSIGSINFO1, GT.M process 20929 has been killed by a signal
 11 at address 0xF7CFBF83 (vaddr 0x)
 %GTM-F-SIGMAPERR, Signal was caused by an address not mapped to an
 
>> object
>> 
 can anybody help me plz?



 sorry for my english ;)


 regards Christian

 ___
 dev mailing list
 dev@openstreetmap.org
 http://lists.openstreetmap.org/listinfo/dev


 
>>>   
>> ___
>> dev mailing list
>> dev@openstreetmap.org
>> http://lists.openstreetmap.org/listinfo/dev
>

Re: [OSM-dev] xapi server

[80n]

Christian
These are compilation errors, but actually for modules that only apply to
other platforms so they can be safely ignored.

If you re-run the process (zappy1_up I assume) you shouldn't see these
errors again.

80n

On Fri, Jun 19, 2009 at 9:47 AM, Christian Lange  wrote:

> Next problem is:
>  o socket:(:port:"PSTA"):10 e  d logMessage("Cannot open
> socket",0,port) s stop=1 q
>  ^-
>At column 12, line 53, source module serverLink.m
> %GTM-E-DEVPARUNK, Deviceparameter unknown
>. u socket:"PSTA"
>   ^-
>At column 13, line 57, source module serverLink.m
> %GTM-E-DEVPARUNK, Deviceparameter unknown
>. j
> sub01^serverLink(port,logLevel):(:4:socket:socket):10 e  d
> logMessage("Cannot spawn sub-process",1,port) q
> ^-
>At column 39, line 60, source module serverLink.m
> %GTM-E-JOBPARUNK, Job parameter unknown
>o device:("TCP":"":port):10 e  d logMessage("Cannot open
> socket",0,port) s stop=1 q
>  ^-
>At column 12, line 73, source module serverLink.m
> %GTM-E-DEVPARUNK, Deviceparameter unknown
>. s socket=$zsocket(device)
>^-
>At column 14, line 80, source module serverLink.m
> %GTM-E-INVFCN, Invalid function name
>. u device:(::socket) ; Detach socket
>^-
>At column 14, line 82, source module serverLink.m
> %GTM-E-DEVPARUNK, Deviceparameter unknown
>. c device:socket
> ^-
>At column 19, line 84, source module serverLink.m
> %GTM-E-DEVPARVALREQ, A value is required for this device parameter
>s $et="i $estack=0 znspace """_$znspace_""" g
> error^serverLink"
>^-
>At column 34, line 182, source module serverLink.m
> %GTM-E-INVSVN, Invalid special variable name
>u socket:(::"STP")
>  ^-
>At column 12, line 188, source module serverLink.m
> %GTM-E-DEVPARUNK, Deviceparameter unknown
>. u socket:(::"STP")
>^-
>At column 14, line 198, source module serverLink.m
> %GTM-E-DEVPARUNK, Deviceparameter unknown
>s ucivol=$zu(0)
>  ^-
>At column 12, line 228, source module serverLink.m
> %GTM-E-INVFCN, Invalid function name
>s ucivolno=$zu(uci,vol)
>^-
>At column 14, line 231, source module serverLink.m
> %GTM-E-INVFCN, Invalid function name
>o device:("TCP":""socket) ; Attach socket
>  ^-
>At column 12, line 239, source module serverLink.m
> %GTM-E-DEVPARUNK, Deviceparameter unknown
>u device:(:::$c(10))
>  ^-
>At column 12, line 285, source module serverLink.m
> %GTM-E-DEVPARUNK, Deviceparameter unknown
>
>
> regards christian
>
> 80n schrieb:
> > Christian
> > This can occur if you are running SELinux.  In that case try it with
> SELinux
> > disabled, or follow the suggestions from this post:
> >
> http://www.mail-archive.com/hardhats-memb...@lists.sourceforge.net/msg16471.html
> >
> > A second possibility is if you are using an AMD processor then you need
> to
> > add noexec32=off to your kernel boot command line.
> >
> > 80n
> >
> > On Thu, Jun 18, 2009 at 11:12 AM, Christian Lange  wrote:
> >
> >
> >> Hi,
> >> i will be setup a xapi server.
> >>
> >> i have looked in http://xapi.openstreetmap.org/ and
> >> http://xapi.openstreetmap.org/scripts  .
> >>
> >> but i do nothing know about GT.M
> >>
> >> i have try to start zappy:
> >>
> >> %GTM-F-KILLBYSIGSINFO1, GT.M process 20929 has been killed by a signal
> >> 11 at address 0xF7CFBF83 (vaddr 0x)
> >> %GTM-F-SIGMAPERR, Signal was caused by an address not mapped to an
> object
> >>
> >>
> >> can anybody help me plz?
> >>
> >>
> >>
> >> sorry for my english ;)
> >>
> >>
> >> regards Christian
> >>
> >> ___
> >> dev mailing list
> >> dev@openstreetmap.org
> >> http://lists.openstreetmap.org/listinfo/dev
> >>
> >>
> >
> >
>
>
> ___
> dev mailing list
> dev@openstreetmap.org
> http://lists.openstreetmap.org/listinfo/dev
>
___
dev mailing list
dev@openstreetmap.org
http://lists.openstreetmap.org/listinfo/dev

Re: [OSM-dev] xapi server

[Christian Lange]

Next problem is:
  o socket:(:port:"PSTA"):10 e  d logMessage("Cannot open
socket",0,port) s stop=1 q
  ^-
At column 12, line 53, source module serverLink.m
%GTM-E-DEVPARUNK, Deviceparameter unknown
. u socket:"PSTA"
   ^-
At column 13, line 57, source module serverLink.m
%GTM-E-DEVPARUNK, Deviceparameter unknown
. j
sub01^serverLink(port,logLevel):(:4:socket:socket):10 e  d
logMessage("Cannot spawn sub-process",1,port) q
 ^-
At column 39, line 60, source module serverLink.m
%GTM-E-JOBPARUNK, Job parameter unknown
o device:("TCP":"":port):10 e  d logMessage("Cannot open
socket",0,port) s stop=1 q
  ^-
At column 12, line 73, source module serverLink.m
%GTM-E-DEVPARUNK, Deviceparameter unknown
. s socket=$zsocket(device)
^-
At column 14, line 80, source module serverLink.m
%GTM-E-INVFCN, Invalid function name
. u device:(::socket) ; Detach socket
^-
At column 14, line 82, source module serverLink.m
%GTM-E-DEVPARUNK, Deviceparameter unknown
. c device:socket
 ^-
At column 19, line 84, source module serverLink.m
%GTM-E-DEVPARVALREQ, A value is required for this device parameter
s $et="i $estack=0 znspace """_$znspace_""" g
error^serverLink"
^-
At column 34, line 182, source module serverLink.m
%GTM-E-INVSVN, Invalid special variable name
u socket:(::"STP")
  ^-
At column 12, line 188, source module serverLink.m
%GTM-E-DEVPARUNK, Deviceparameter unknown
. u socket:(::"STP")
^-
At column 14, line 198, source module serverLink.m
%GTM-E-DEVPARUNK, Deviceparameter unknown
s ucivol=$zu(0)
  ^-
At column 12, line 228, source module serverLink.m
%GTM-E-INVFCN, Invalid function name
s ucivolno=$zu(uci,vol)
^-
At column 14, line 231, source module serverLink.m
%GTM-E-INVFCN, Invalid function name
o device:("TCP":""socket) ; Attach socket
  ^-
At column 12, line 239, source module serverLink.m
%GTM-E-DEVPARUNK, Deviceparameter unknown
u device:(:::$c(10))
  ^-
At column 12, line 285, source module serverLink.m
%GTM-E-DEVPARUNK, Deviceparameter unknown


regards christian

80n schrieb:
> Christian
> This can occur if you are running SELinux.  In that case try it with SELinux
> disabled, or follow the suggestions from this post:
> http://www.mail-archive.com/hardhats-memb...@lists.sourceforge.net/msg16471.html
>
> A second possibility is if you are using an AMD processor then you need to
> add noexec32=off to your kernel boot command line.
>
> 80n
>
> On Thu, Jun 18, 2009 at 11:12 AM, Christian Lange  wrote:
>
>   
>> Hi,
>> i will be setup a xapi server.
>>
>> i have looked in http://xapi.openstreetmap.org/ and
>> http://xapi.openstreetmap.org/scripts  .
>>
>> but i do nothing know about GT.M
>>
>> i have try to start zappy:
>>
>> %GTM-F-KILLBYSIGSINFO1, GT.M process 20929 has been killed by a signal
>> 11 at address 0xF7CFBF83 (vaddr 0x)
>> %GTM-F-SIGMAPERR, Signal was caused by an address not mapped to an object
>>
>>
>> can anybody help me plz?
>>
>>
>>
>> sorry for my english ;)
>>
>>
>> regards Christian
>>
>> ___
>> dev mailing list
>> dev@openstreetmap.org
>> http://lists.openstreetmap.org/listinfo/dev
>>
>> 
>
>   


___
dev mailing list
dev@openstreetmap.org
http://lists.openstreetmap.org/listinfo/dev

Re: [OSM-dev] xapi server

[80n]

Christian
This can occur if you are running SELinux.  In that case try it with SELinux
disabled, or follow the suggestions from this post:
http://www.mail-archive.com/hardhats-memb...@lists.sourceforge.net/msg16471.html

A second possibility is if you are using an AMD processor then you need to
add noexec32=off to your kernel boot command line.

80n

On Thu, Jun 18, 2009 at 11:12 AM, Christian Lange  wrote:

> Hi,
> i will be setup a xapi server.
>
> i have looked in http://xapi.openstreetmap.org/ and
> http://xapi.openstreetmap.org/scripts  .
>
> but i do nothing know about GT.M
>
> i have try to start zappy:
>
> %GTM-F-KILLBYSIGSINFO1, GT.M process 20929 has been killed by a signal
> 11 at address 0xF7CFBF83 (vaddr 0x)
> %GTM-F-SIGMAPERR, Signal was caused by an address not mapped to an object
>
>
> can anybody help me plz?
>
>
>
> sorry for my english ;)
>
>
> regards Christian
>
> ___
> dev mailing list
> dev@openstreetmap.org
> http://lists.openstreetmap.org/listinfo/dev
>
___
dev mailing list
dev@openstreetmap.org
http://lists.openstreetmap.org/listinfo/dev

Re: [OSM-dev] xapi status?

[Jeffrey Warren]

Hmm, i can load yours, but I'm getting a lot of stalling in general, also
after about 5.8 Kb. I'll try later in the day, maybe it's as you say, just
transient dropouts.

On Sat, May 2, 2009 at 12:19 PM, 80n <80n...@gmail.com> wrote:

> Actually your request seems to be working fine now.  The stall was probably
> a transient network dropout.
>
>
> On Sat, May 2, 2009 at 5:14 PM, 80n <80n...@gmail.com> wrote:
>
>> Jeff
>> This url works for me:
>> http://www.informationfreeway.org/api/0.6/*[elephant=*]
>>
>> I just tried yours and it appears to have stalled after downloading
>> 5.2Kb.  Not sure why yet, I'll investigate futher.
>>
>> 80n
>>
>>
>> On Sat, May 2, 2009 at 3:50 PM, Jeffrey Warren  wrote:
>>
>>> Hmm, I'm now getting a blank response after consistently 26.4 seconds. Is
>>> that a timeout? I'm only asking for buildings=yes in an area where I know
>>> there are very few... i request all ways for this bbox from the regular 0.6
>>> api all the time.
>>>
>>> I tried:
>>>
>>>
>>> http://osmxapi.hypercube.telascience.org/api/0.6/*[building=yes][bbox=-71.089,42.359,-71.087,42.361]
>>>
>>>
>>> http://www.informationfreeway.org/api/0.6/*[building=yes][bbox=-71.089,42.359,-71.087,42.361]
>>>
>>> Is there a request you can confirm working, that you can give me a URI
>>> for so I can troubleshoot using that as an example?
>>>
>>> Thanks a lot -
>>> Jeff
>>>
>>>
>>> On Fri, May 1, 2009 at 2:41 AM, 80n <80n...@gmail.com> wrote:
>>>
 This characteristically happens if all the daemons are busy servicing
 other people's requests.  The server you are accessing is not particularly
 fast.  The other xapi servers are faster and can handle more capacity.

 Most people use the xapi instance on the telascience server:
 http://osmxapi.hypercube.telascience.org/api/0.5/

 There's also a 0.6 instance running on that server at:
 http://osmxapi.hypercube.telascience.org/api/0.6/

 I'll update the platform status page as it's not quite accurate at the
 moment.

 80n





 The 0.5 service is serving data as at 17th April.

 On Fri, May 1, 2009 at 6:27 AM, Jeffrey Warren  wrote:

> Hello all -
> I'm trying to ping the xapi.openstreetmap.org service for:
>
>
> http://xapi.openstreetmap.org/api/0.5/*[amenity=hotel][bbox=-71.089,42.359,-71.087,42.361]
>
> or perhaps less ambitious:
>
>
> http://xapi.openstreetmap.org/api/0.5/*[building=yes][bbox=-71.089,42.359,-71.087,42.361]
>
> I'm not getting a response - rather, i'm getting a blank page. Am I
> making a grievous error or is the xapi server not running pending the 0.6
> upgrade?
>
> Platform status says "Currently serving data as at 0.5 cut-off. 0.6
> service will start shortly."
>
> Thanks in advance -
>
> Jeff
>
> ___
> dev mailing list
> dev@openstreetmap.org
> http://lists.openstreetmap.org/listinfo/dev
>
>

>>>
>>
>
___
dev mailing list
dev@openstreetmap.org
http://lists.openstreetmap.org/listinfo/dev

Re: [OSM-dev] xapi status?

[80n]

Actually your request seems to be working fine now.  The stall was probably
a transient network dropout.

On Sat, May 2, 2009 at 5:14 PM, 80n <80n...@gmail.com> wrote:

> Jeff
> This url works for me:
> http://www.informationfreeway.org/api/0.6/*[elephant=*]
>
> I just tried yours and it appears to have stalled after downloading 5.2Kb.
> Not sure why yet, I'll investigate futher.
>
> 80n
>
>
> On Sat, May 2, 2009 at 3:50 PM, Jeffrey Warren  wrote:
>
>> Hmm, I'm now getting a blank response after consistently 26.4 seconds. Is
>> that a timeout? I'm only asking for buildings=yes in an area where I know
>> there are very few... i request all ways for this bbox from the regular 0.6
>> api all the time.
>>
>> I tried:
>>
>>
>> http://osmxapi.hypercube.telascience.org/api/0.6/*[building=yes][bbox=-71.089,42.359,-71.087,42.361]
>>
>>
>> http://www.informationfreeway.org/api/0.6/*[building=yes][bbox=-71.089,42.359,-71.087,42.361]
>>
>> Is there a request you can confirm working, that you can give me a URI for
>> so I can troubleshoot using that as an example?
>>
>> Thanks a lot -
>> Jeff
>>
>>
>> On Fri, May 1, 2009 at 2:41 AM, 80n <80n...@gmail.com> wrote:
>>
>>> This characteristically happens if all the daemons are busy servicing
>>> other people's requests.  The server you are accessing is not particularly
>>> fast.  The other xapi servers are faster and can handle more capacity.
>>>
>>> Most people use the xapi instance on the telascience server:
>>> http://osmxapi.hypercube.telascience.org/api/0.5/
>>>
>>> There's also a 0.6 instance running on that server at:
>>> http://osmxapi.hypercube.telascience.org/api/0.6/
>>>
>>> I'll update the platform status page as it's not quite accurate at the
>>> moment.
>>>
>>> 80n
>>>
>>>
>>>
>>>
>>>
>>> The 0.5 service is serving data as at 17th April.
>>>
>>> On Fri, May 1, 2009 at 6:27 AM, Jeffrey Warren  wrote:
>>>
 Hello all -
 I'm trying to ping the xapi.openstreetmap.org service for:


 http://xapi.openstreetmap.org/api/0.5/*[amenity=hotel][bbox=-71.089,42.359,-71.087,42.361]

 or perhaps less ambitious:


 http://xapi.openstreetmap.org/api/0.5/*[building=yes][bbox=-71.089,42.359,-71.087,42.361]

 I'm not getting a response - rather, i'm getting a blank page. Am I
 making a grievous error or is the xapi server not running pending the 0.6
 upgrade?

 Platform status says "Currently serving data as at 0.5 cut-off. 0.6
 service will start shortly."

 Thanks in advance -

 Jeff

 ___
 dev mailing list
 dev@openstreetmap.org
 http://lists.openstreetmap.org/listinfo/dev


>>>
>>
>
___
dev mailing list
dev@openstreetmap.org
http://lists.openstreetmap.org/listinfo/dev

Re: [OSM-dev] xapi status?

[80n]

Jeff
This url works for me:
http://www.informationfreeway.org/api/0.6/*[elephant=*]

I just tried yours and it appears to have stalled after downloading 5.2Kb.
Not sure why yet, I'll investigate futher.

80n

On Sat, May 2, 2009 at 3:50 PM, Jeffrey Warren  wrote:

> Hmm, I'm now getting a blank response after consistently 26.4 seconds. Is
> that a timeout? I'm only asking for buildings=yes in an area where I know
> there are very few... i request all ways for this bbox from the regular 0.6
> api all the time.
>
> I tried:
>
>
> http://osmxapi.hypercube.telascience.org/api/0.6/*[building=yes][bbox=-71.089,42.359,-71.087,42.361]
>
>
> http://www.informationfreeway.org/api/0.6/*[building=yes][bbox=-71.089,42.359,-71.087,42.361]
>
> Is there a request you can confirm working, that you can give me a URI for
> so I can troubleshoot using that as an example?
>
> Thanks a lot -
> Jeff
>
>
> On Fri, May 1, 2009 at 2:41 AM, 80n <80n...@gmail.com> wrote:
>
>> This characteristically happens if all the daemons are busy servicing
>> other people's requests.  The server you are accessing is not particularly
>> fast.  The other xapi servers are faster and can handle more capacity.
>>
>> Most people use the xapi instance on the telascience server:
>> http://osmxapi.hypercube.telascience.org/api/0.5/
>>
>> There's also a 0.6 instance running on that server at:
>> http://osmxapi.hypercube.telascience.org/api/0.6/
>>
>> I'll update the platform status page as it's not quite accurate at the
>> moment.
>>
>> 80n
>>
>>
>>
>>
>>
>> The 0.5 service is serving data as at 17th April.
>>
>> On Fri, May 1, 2009 at 6:27 AM, Jeffrey Warren  wrote:
>>
>>> Hello all -
>>> I'm trying to ping the xapi.openstreetmap.org service for:
>>>
>>>
>>> http://xapi.openstreetmap.org/api/0.5/*[amenity=hotel][bbox=-71.089,42.359,-71.087,42.361]
>>>
>>> or perhaps less ambitious:
>>>
>>>
>>> http://xapi.openstreetmap.org/api/0.5/*[building=yes][bbox=-71.089,42.359,-71.087,42.361]
>>>
>>> I'm not getting a response - rather, i'm getting a blank page. Am I
>>> making a grievous error or is the xapi server not running pending the 0.6
>>> upgrade?
>>>
>>> Platform status says "Currently serving data as at 0.5 cut-off. 0.6
>>> service will start shortly."
>>>
>>> Thanks in advance -
>>>
>>> Jeff
>>>
>>> ___
>>> dev mailing list
>>> dev@openstreetmap.org
>>> http://lists.openstreetmap.org/listinfo/dev
>>>
>>>
>>
>
___
dev mailing list
dev@openstreetmap.org
http://lists.openstreetmap.org/listinfo/dev

Re: [OSM-dev] xapi status?

[Jeffrey Warren]

Hmm, I'm now getting a blank response after consistently 26.4 seconds. Is
that a timeout? I'm only asking for buildings=yes in an area where I know
there are very few... i request all ways for this bbox from the regular 0.6
api all the time.

I tried:

http://osmxapi.hypercube.telascience.org/api/0.6/*[building=yes][bbox=-71.089,42.359,-71.087,42.361]

http://www.informationfreeway.org/api/0.6/*[building=yes][bbox=-71.089,42.359,-71.087,42.361]

Is there a request you can confirm working, that you can give me a URI for
so I can troubleshoot using that as an example?

Thanks a lot -
Jeff


On Fri, May 1, 2009 at 2:41 AM, 80n <80n...@gmail.com> wrote:

> This characteristically happens if all the daemons are busy servicing other
> people's requests.  The server you are accessing is not particularly fast.
> The other xapi servers are faster and can handle more capacity.
>
> Most people use the xapi instance on the telascience server:
> http://osmxapi.hypercube.telascience.org/api/0.5/
>
> There's also a 0.6 instance running on that server at:
> http://osmxapi.hypercube.telascience.org/api/0.6/
>
> I'll update the platform status page as it's not quite accurate at the
> moment.
>
> 80n
>
>
>
>
>
> The 0.5 service is serving data as at 17th April.
>
> On Fri, May 1, 2009 at 6:27 AM, Jeffrey Warren  wrote:
>
>> Hello all -
>> I'm trying to ping the xapi.openstreetmap.org service for:
>>
>>
>> http://xapi.openstreetmap.org/api/0.5/*[amenity=hotel][bbox=-71.089,42.359,-71.087,42.361]
>>
>> or perhaps less ambitious:
>>
>>
>> http://xapi.openstreetmap.org/api/0.5/*[building=yes][bbox=-71.089,42.359,-71.087,42.361]
>>
>> I'm not getting a response - rather, i'm getting a blank page. Am I making
>> a grievous error or is the xapi server not running pending the 0.6 upgrade?
>>
>> Platform status says "Currently serving data as at 0.5 cut-off. 0.6
>> service will start shortly."
>>
>> Thanks in advance -
>>
>> Jeff
>>
>> ___
>> dev mailing list
>> dev@openstreetmap.org
>> http://lists.openstreetmap.org/listinfo/dev
>>
>>
>
___
dev mailing list
dev@openstreetmap.org
http://lists.openstreetmap.org/listinfo/dev

Re: [OSM-dev] xapi status?

[80n]

This characteristically happens if all the daemons are busy servicing other
people's requests.  The server you are accessing is not particularly fast.
The other xapi servers are faster and can handle more capacity.

Most people use the xapi instance on the telascience server:
http://osmxapi.hypercube.telascience.org/api/0.5/

There's also a 0.6 instance running on that server at:
http://osmxapi.hypercube.telascience.org/api/0.6/

I'll update the platform status page as it's not quite accurate at the
moment.

80n





The 0.5 service is serving data as at 17th April.

On Fri, May 1, 2009 at 6:27 AM, Jeffrey Warren  wrote:

> Hello all -
> I'm trying to ping the xapi.openstreetmap.org service for:
>
>
> http://xapi.openstreetmap.org/api/0.5/*[amenity=hotel][bbox=-71.089,42.359,-71.087,42.361]
>
> or perhaps less ambitious:
>
>
> http://xapi.openstreetmap.org/api/0.5/*[building=yes][bbox=-71.089,42.359,-71.087,42.361]
>
> I'm not getting a response - rather, i'm getting a blank page. Am I making
> a grievous error or is the xapi server not running pending the 0.6 upgrade?
>
> Platform status says "Currently serving data as at 0.5 cut-off. 0.6 service
> will start shortly."
>
> Thanks in advance -
>
> Jeff
>
> ___
> dev mailing list
> dev@openstreetmap.org
> http://lists.openstreetmap.org/listinfo/dev
>
>
___
dev mailing list
dev@openstreetmap.org
http://lists.openstreetmap.org/listinfo/dev

Re: [OSM-dev] XAPI servers now all down?

[80n]

There are three xapi servers.

The file system on Hypercube has been increasingly slow in the last few
days, I'm not sure why but it has made this server pretty unusable.

The instance at bearstech.com had a hard disk failure.  The disk has been
replaced, but the server has not yet been rebuilt.

This leave xapi.openstreetmap to take the full load.  Its not a very large
machine and easily gets saturated with requests.  I've started up a few more
daemons which may ease the problem a bit.

Anyone know why the NFS file systems on hypercube have recently started to
go more slowly than normal?

80n

On Fri, Nov 7, 2008 at 4:01 PM, Maarten Deen <[EMAIL PROTECTED]> wrote:

> I can get no data from the XAPI servers at all. Both
> xapi.openstreetmap.org and
> osmxapi.hypercube.telascience.org come back with ERROR 501: Internal
> Server Error.
>
> What's going on?
>
> Maarten
>
> ___
> dev mailing list
> dev@openstreetmap.org
> http://lists.openstreetmap.org/listinfo/dev
>
___
dev mailing list
dev@openstreetmap.org
http://lists.openstreetmap.org/listinfo/dev