Re: [OSM-talk] OSMXAPI stable?
bernhard schrieb: Hi all I would like to show the XAPI to my students. But it seams that all XAPI Servers are very slow or out of function. Or overloaded :) Maybe you could allocate a server at your university as another xapi server ;) The students should learn something about Location Based Services and my idea was to show how to retrieve Points of Interest from OSM. With XAPI it would be easy: wget http://www.informationfreeway.org/api/0.6/node[amenity=restaurant][bbox=15.5337,48.1732,15.7161,48.2362] -o osm.xml But if the XAPI is not working I have to cancel that. The Query works for me. If you want to be sure, save a offline-version of the output for the worst-case. Or is there a similar service I can use for that? You can use the default api's map-call to get *all* elements in a bbox and let your students filter it manually :) Peter ___ talk mailing list talk@openstreetmap.org http://lists.openstreetmap.org/listinfo/talk
Re: [OSM-talk] OSMXAPI stable?
But if the XAPI is not working I have to cancel that. Or is there a similar service I can use for that? You can use OSM3S. Just send a post request with content http://78.46.81.38/api/poi?bbox=15.5337,48.1732,15.7161,48.2362amenity=restaurant You should receive a gzip-compressed osm file. This request is a short cut for the request to http://78.46.81.38/api/interpreter with POST data: osm-script timeout=180 query type=node bbox-query w=15.5337 s=48.1732 e=15.7161 n=48.2362/ has-kv k=amenity v=restaurant/ /query print mode=body/ /osm-script A comprehensive (but not yet complete) documentation of OSM3S can be found at http://78.46.81.38 Feel free to experiment with other queries or ask for other short cuts. Cheers, Roland ___ talk mailing list talk@openstreetmap.org http://lists.openstreetmap.org/listinfo/talk
Re: [OSM-talk] OSMXAPI stable?
bernhard wrote: But it seams that all XAPI Servers are very slow or out of function. All ROMA and TRAPI servers seem to be (near) down. So the TaH clients all connect to XAPI or API. This makes a) XAPI and (less) API slow and b) brings the renderspeed down to about 200 Z12-tiles per hour. Norbert PS: Mumin doesn't show data for tah.openstreetmap since some days ___ talk mailing list talk@openstreetmap.org http://lists.openstreetmap.org/listinfo/talk
Re: [OSM-talk] OSMXAPI stable?
bernhard wrote: But it seams that all XAPI Servers are very slow or out of function. All ROMA and TRAPI servers seem to be (near) down. So the TaH clients all connect to XAPI or API. This makes a) XAPI and (less) API slow and b) brings the renderspeed down to about 200 Z12-tiles per hour. Norbert PS: Mumin doesn't show data for tah.openstreetmap since some days This is correct. Mat's server went down last week for a database rebuild. It should have been back online by now, so maybe he's having trouble. My server is several hours behind atm. I believe it's caused by the NHD data that's being imported. This is slowing down the update process so much that it sometimes takes 2 - 3 minutes or more to apply one of the minute updates. I've contacted Blars to see if we can figure something out to speed the process up, but for now we'll have to wait it out. -Jeremy ___ talk mailing list talk@openstreetmap.org http://lists.openstreetmap.org/listinfo/talk
Re: [OSM-talk] osmxapi - stability
Bernhard It is currently down on all servers. I can enable it on hypercube but that server is very slow at the moment, and synchronisation is several days behind. xapi had an unexpected shutdown yesterday and needs a database check before it'll be available. bearstech is being built at the moment and should be available in a few days time. 80n 2008/11/9 Bernhard Zwischenbrugger [EMAIL PROTECTED] Hi all It looks like osmxapi is down on all servers. Will it be available today or tomorrow again? I want to show it tomorrow to my students. They will make a project using the osmxapi. thanks Bernhard ___ talk mailing list talk@openstreetmap.org http://lists.openstreetmap.org/listinfo/talk ___ talk mailing list talk@openstreetmap.org http://lists.openstreetmap.org/listinfo/talk
Re: [OSM-talk] OsmXapi and semicolons
On Sun, Oct 19, 2008 at 10:43 AM, Kai Krueger [EMAIL PROTECTED] wrote: Hi I was using OsmXapi today to try and get a set of bus_stops however there seem to be inconsistencies with the encoding of some of the semicolons. for example calling wget http://xapi.openstreetmap.org/api/0.5/node[highway=bus_stop][bbox=-1,51.51,0,51.52]http://xapi.openstreetmap.org/api/0.5/node%5Bhighway=bus_stop%5D%5Bbbox=-1,51.51,0,51.52%5D I get the following xml from xapi for node 281455008: node id='281455008' lat='51.5167833' lon='-0.1279817' user='amm' osmxapi:users='smsm1,amm' timestamp='2008-10-07T23:07:46Z' tag k='bus_number' v='1\s8\s25\s98\s242\sN1\sN8\sN68\sN98\sN171\sN207'/ tag k='highway' v='bus_stop'/ tag k='name' v='New Oxford Street'/ /node whereas the main api gives back the correct data osm version=0.5 generator=OpenStreetMap server node id=281455008 lat=51.5167833 lon=-0.1279817 user=amm visible=true timestamp=2008-10-08T00:07:46+01:00 tag k=bus_number v=1;8;25;98;242;N1;N8;N68;N98;N171;N207/ tag k=highway v=bus_stop/ tag k=name v=New Oxford Street/ /node /osm However not all of the semicolons are replaced by \s for example node id='265255763' lat='51.5105981' lon='-0.2886720' user='Harry Wood' osmxapi:users='Harry Wood' timestamp='2008-05-17T17:04:34Z' tag k='highway' v='bus_stop'/ tag k='ref' v='ET'/ tag k='routes' v='207;427;607;N7;N207'/ /node looks correct. I am not sure, but potentially the behaviour changed mid September? There was a change in, perhaps in mid September, to fix an escaping problem with ampersand (). That may have broken something. I'll take a look. Is this a known issue? thanks, Kai ___ talk mailing list talk@openstreetmap.org http://lists.openstreetmap.org/listinfo/talk ___ talk mailing list talk@openstreetmap.org http://lists.openstreetmap.org/listinfo/talk
Re: [OSM-talk] OsmXapi and semicolons
On 09:43, 19 October 2008, Kai Krueger did write: I was using OsmXapi today to try and get a set of bus_stops however there seem to be inconsistencies with the encoding of some of the semicolons. Would this be a good time to revive the debate about applying duplicate tags for objects where multiple values apply? ;~) ___ talk mailing list talk@openstreetmap.org http://lists.openstreetmap.org/listinfo/talk
Re: [OSM-talk] OSMXAPI question: is it me, or...
Steven Excellent. I think we can blame the dodgy NFS on hypercube for the missing data. I re-synchronized it last night, so I'm pleased to hear that all is ok. I'll take a look at the relations issue some time - maybe the bbox calculation is off or something. Thanks for reporting back. 80n On Fri, Sep 12, 2008 at 8:30 AM, Steven te Brinke [EMAIL PROTECTED] wrote: The problem that some nodes were missing and that there were ways without nodes is gone now. Thus all real problems are gone. I only receive slightly more relations than expected, but that's not really a problem for me. Thanks, Steven 80n schreef: On Thu, Sep 11, 2008 at 9:25 AM, Steven te Brinke[EMAIL PROTECTED] [EMAIL PROTECTED] wrote: Taking a closer look at the data, there are some strange things indeed. However, these are not new, they are already in there several weeks. I retrieve all routes in the netherlands: relation[network=rcn][bbox=2.7984557419334006,50.62642256377723,7.388298070963748,53.954129036190224] Problems: - some relations are outside the bbox, for example relation 5881 (at least, as far as I can see, I didn't compute the bbox of the relation) I think I know why that is. - quite some nodes are missing (they are referenced by ways that are returned) - a few ways do not contain any nodes, for example way 24828122, whereas the main api returns two nodes This way is missing from one of the zappy instances, but present in the others. Looks like it may have lost synchronisation during the recent NFS hiccups. I'll pull it offline and re-sync it. For now I just ignore these, so it's no problem to me. But if you want more information on these problems, I can easily give a list of all nodes/ways with the last two problems. Steven ___ talk mailing list talk@openstreetmap.org http://lists.openstreetmap.org/listinfo/talk ___ talk mailing list talk@openstreetmap.org http://lists.openstreetmap.org/listinfo/talk
Re: [OSM-talk] OSMXAPI question: is it me, or...
On Thu, Sep 11, 2008 at 9:25 AM, Steven te Brinke [EMAIL PROTECTED] wrote: Taking a closer look at the data, there are some strange things indeed. However, these are not new, they are already in there several weeks. I retrieve all routes in the netherlands: relation[network=rcn][bbox=2.7984557419334006,50.62642256377723,7.388298070963748,53.954129036190224] Problems: - some relations are outside the bbox, for example relation 5881 (at least, as far as I can see, I didn't compute the bbox of the relation) I think I know why that is. - quite some nodes are missing (they are referenced by ways that are returned) - a few ways do not contain any nodes, for example way 24828122, whereas the main api returns two nodes This way is missing from one of the zappy instances, but present in the others. Looks like it may have lost synchronisation during the recent NFS hiccups. I'll pull it offline and re-sync it. For now I just ignore these, so it's no problem to me. But if you want more information on these problems, I can easily give a list of all nodes/ways with the last two problems. Steven Lambertus schreef: Thanks for the quick action. The amount of data downloaded by the query was significantly more then before so that was already promising. Looking at the data in JOSM showed no sign of crippled roads so that bug appears to be squashed. However the bbox parameter still does not seem to do what I expect from it (data returning from UK, NL, DE and BE instead of roughly a province in NL). Reversing the parameters gives almost but not exactly the same result: -rw-rw-r-- 1 lambertus lambertus 16519465 Sep 11 08:45 data.osm.4 (wget http://www.informationfreeway.org/api/0.5/relation[network=rcn][bbox=5.5,52.0,6.3,52.3]) -rw-rw-r-- 1 lambertus lambertus 16397318 Sep 11 09:14 data.osm.5 (wget http://www.informationfreeway.org/api/0.5/relation[bbox=5.5,52.0,6.3,52.3][network=rcn]) The one that was downloaded half an hour later is a bit smaller to my surprise. I tried to find out what was the difference but visually there are no changes to spot, but diff outputs so much that I don't know what to do with it. 80n wrote: I've found a bug and fixed it. Can you try again and let me know how it goes? 80n ___ talk mailing list talk@openstreetmap.org http://lists.openstreetmap.org/listinfo/talk
Re: [OSM-talk] OSMXAPI question: is it me, or...
I've found a bug and fixed it. Can you try again and let me know how it goes? 80n On Wed, Sep 10, 2008 at 4:23 PM, 80n [EMAIL PROTECTED] wrote: I changed something at the weekend, so that's where I'll start looking... On Wed, Sep 10, 2008 at 4:03 PM, Steven te Brinke [EMAIL PROTECTED] wrote: It looks like it became broken a few days ago. Because last week I got the results I expected when querying for the rcn of the Netherlands, but this week I am missing quite some information. (I use nearly the same query as Lambertus.) So I think around the weekend something went wrong with a database update. Thanks for looking at it. Steven 80n schreef: Lambertus Yes, its likely to be a bug. I'll take a look at it. 80n On Tue, Sep 9, 2008 at 10:12 PM, Lambertus [EMAIL PROTECTED] wrote: Thanks for looking at it and you are right, only one predicate and one bbox predicate is allowed, I missed that. Unfortunately when I request again with only one predicate, the result is almost the same (data from far outside the bbox and missing ways and nodes without ways): /api/0.5/relation[network=rcn][bbox=5.5,52.0,6.3,52.3] Chris Hill wrote: Lambertus wrote: Either I don't understand how querying OSMXAPI works or I stumbled upon a bug. Perhaps someone can have a look at this: /api/0.5/relation[route=bicycle][network=rcn][bbox=5.5,52.0,6.3,52.3] I don't think you can use multiple predicates. The wiki says: A request can be suffixed with multiple predicates, each of which further constrains the results (currently limited to one tag predicate and one bbox predicate) Cheers, Chris ___ talk mailing list talk@openstreetmap.org http://lists.openstreetmap.org/listinfo/talk ___ talk mailing list talk@openstreetmap.org http://lists.openstreetmap.org/listinfo/talk ___ talk mailing list talk@openstreetmap.org http://lists.openstreetmap.org/listinfo/talk ___ talk mailing list talk@openstreetmap.org http://lists.openstreetmap.org/listinfo/talk
Re: [OSM-talk] OSMXAPI question: is it me, or...
Thanks for looking at it and you are right, only one predicate and one bbox predicate is allowed, I missed that. Unfortunately when I request again with only one predicate, the result is almost the same (data from far outside the bbox and missing ways and nodes without ways): /api/0.5/relation[network=rcn][bbox=5.5,52.0,6.3,52.3] Chris Hill wrote: Lambertus wrote: Either I don't understand how querying OSMXAPI works or I stumbled upon a bug. Perhaps someone can have a look at this: /api/0.5/relation[route=bicycle][network=rcn][bbox=5.5,52.0,6.3,52.3] I don't think you can use multiple predicates. The wiki says: A request can be suffixed with multiple predicates, each of which further constrains the results (currently limited to one tag predicate and one bbox predicate) Cheers, Chris ___ talk mailing list talk@openstreetmap.org http://lists.openstreetmap.org/listinfo/talk
Re: [OSM-talk] OSMXAPI question: is it me, or...
Lambertus Yes, its likely to be a bug. I'll take a look at it. 80n On Tue, Sep 9, 2008 at 10:12 PM, Lambertus [EMAIL PROTECTED] wrote: Thanks for looking at it and you are right, only one predicate and one bbox predicate is allowed, I missed that. Unfortunately when I request again with only one predicate, the result is almost the same (data from far outside the bbox and missing ways and nodes without ways): /api/0.5/relation[network=rcn][bbox=5.5,52.0,6.3,52.3] Chris Hill wrote: Lambertus wrote: Either I don't understand how querying OSMXAPI works or I stumbled upon a bug. Perhaps someone can have a look at this: /api/0.5/relation[route=bicycle][network=rcn][bbox=5.5,52.0,6.3,52.3] I don't think you can use multiple predicates. The wiki says: A request can be suffixed with multiple predicates, each of which further constrains the results (currently limited to one tag predicate and one bbox predicate) Cheers, Chris ___ talk mailing list talk@openstreetmap.org http://lists.openstreetmap.org/listinfo/talk ___ talk mailing list talk@openstreetmap.org http://lists.openstreetmap.org/listinfo/talk
Re: [OSM-talk] Osmxapi down
Thanks! It worked now. On Sat, 2008-08-09 at 07:02 +0100, 80n wrote: Maning It works for me. When did you last try it? The server was down for a while yesterday. 80n On Sat, Aug 9, 2008 at 3:16 AM, Maning Sambale [EMAIL PROTECTED] wrote: Hi, This used to work before: wget http://www.informationfreeway.org/api/0.5/*[bbox=120.15542470079176,13.961847461106647,121.99413304208379,15.20729300056744] -O filename.osm But now I can't download any data anymore. maning ___ talk mailing list talk@openstreetmap.org http://lists.openstreetmap.org/listinfo/talk ___ talk mailing list talk@openstreetmap.org http://lists.openstreetmap.org/listinfo/talk
Re: [OSM-talk] Osmxapi down
Maning It works for me. When did you last try it? The server was down for a while yesterday. 80n On Sat, Aug 9, 2008 at 3:16 AM, Maning Sambale [EMAIL PROTECTED]wrote: Hi, This used to work before: wget http://www.informationfreeway.org/api/0.5/*[bbox=120.15542470079176,13.961847461106647,121.99413304208379,15.20729300056744]http://www.informationfreeway.org/api/0.5/*%5Bbbox=120.15542470079176,13.961847461106647,121.99413304208379,15.20729300056744%5D-O filename.osm But now I can't download any data anymore. maning ___ talk mailing list talk@openstreetmap.org http://lists.openstreetmap.org/listinfo/talk ___ talk mailing list talk@openstreetmap.org http://lists.openstreetmap.org/listinfo/talk
Re: [OSM-talk] Osmxapi down
Hi, This used to work before: wget http://www.informationfreeway.org/api/0.5/*[bbox=120.15542470079176,13.961847461106647,121.99413304208379,15.20729300056744] -O filename.osm But now I can't download any data anymore. maning ___ talk mailing list talk@openstreetmap.org http://lists.openstreetmap.org/listinfo/talk
Re: [OSM-talk] Osmxapi down
On Tue, Jul 29, 2008 at 07:20:29PM +0200, Aurelien Jacobs wrote: Hi, It seems osmxapi is down: Running again, as documented in the wiki ___ talk mailing list talk@openstreetmap.org http://lists.openstreetmap.org/cgi-bin/mailman/listinfo/talk
Re: [OSM-talk] OSMXAPI
This used to run before: wget http://www.informationfreeway.org/api/0.5/*[bbox=120.15542470079176,13.961847461106647,121.99413304208379,15.20729300056744] -O 20080730.osm The output file says: ?xml version='1.0' standalone='no'? error BETA: we are testing a request validation mechanism to filter out silly requests. If you have made a sensible request that is being rejected please let me know ([EMAIL PROTECTED]). Your request (*/*/*) is too large. Please check your request. If you really do need this data then it may be better to get it directly from a planet file. Log ID=732854 /error The osm file should be around 30 mb. Is it too big now for osmxapi? cheers, maning ___ talk mailing list talk@openstreetmap.org http://lists.openstreetmap.org/cgi-bin/mailman/listinfo/talk
Re: [OSM-talk] Osmxapi down
Aurelien Jacobs wrote: Hi, It seems osmxapi is down: $ wget http://osmxapi.hypercube.telascience.org/api/0.5/node[place=*][code_departement=54] Warning: wildcards not supported in HTTP. --2008-07-29 19:17:34-- http://osmxapi.hypercube.telascience.org/api/0.5/node[place=*][code_departement=54] Resolving osmxapi.hypercube.telascience.org... 137.110.119.130 Connecting to osmxapi.hypercube.telascience.org|137.110.119.130|:80... connected. HTTP request sent, awaiting response... 501 Internal Server Error 2008-07-29 19:18:01 ERROR 501: Internal Server Error. If someone could have a look at it, that would be nice. Hi, came across the same thing here as well. It's down by intention and that's documented on the platform status-page in the wiki. Regards, Stefan ___ talk mailing list talk@openstreetmap.org http://lists.openstreetmap.org/cgi-bin/mailman/listinfo/talk
Re: [OSM-talk] OSMXAPI
Would it additionally be feasible to add some sort of limit parameter (a la the MySQL LIMIT parameter) to OSMXAPI calls? That would be useful for writing programs where you don't know exactly what the user might ask for. As a real example, I'd like to limit the return from a web-based POI node search to just 100 nodes. Mike At 06:54 PM 23/07/2008, 80n wrote: I've just implemented a change to OSMXAPI which will filter out and reject silly requests (like highway=*). The filter uses a combination of bbox size and count of matching elements to determine whether or not to process the request. At this stage it is a bit experimental and there is scope for fine tuning what it accepts and rejects. If you find that it is rejecting a request that you think is reasonable then please let me know. I want to find the point where all reasonable requests are still accepted but silly or badly formed ones are rejected. This should make a big difference to the throughput as previously osmxapi would easily get bogged down by someone requesting the whole planet and then retrying two or three times when they don't get a response within 10 seconds. 80n ___ talk mailing list talk@openstreetmap.org http://lists.openstreetmap.org/cgi-bin/mailman/listinfo/talk
Re: [OSM-talk] OSMXAPI
On Wed, Jul 23, 2008 at 5:54 PM, 80n [EMAIL PROTECTED] wrote: If you find that it is rejecting a request that you think is reasonable then please let me know. I want to find the point where all reasonable requests are still accepted but silly or badly formed ones are rejected. Every few days I download the list of UK stations: http://www.informationfreeway.org/api/0.5/node[railway=station][bbox=-6,50,2,61] I compare that with my previous download to see if any stations have been deleted. Should I be using the planet file for this? -- Edward. ___ talk mailing list talk@openstreetmap.org http://lists.openstreetmap.org/cgi-bin/mailman/listinfo/talk
Re: [OSM-talk] OSMXAPI
Edward No, that's a reasonable request. Currently this is being filtered out, but should be permitted. The filter is a bit over-zealous at the moment. I will adjust the settings to permit this. 80n On Thu, Jul 24, 2008 at 11:37 AM, Edward Betts [EMAIL PROTECTED] wrote: On Wed, Jul 23, 2008 at 5:54 PM, 80n [EMAIL PROTECTED] wrote: If you find that it is rejecting a request that you think is reasonable then please let me know. I want to find the point where all reasonable requests are still accepted but silly or badly formed ones are rejected. Every few days I download the list of UK stations: http://www.informationfreeway.org/api/0.5/node[railway=station][bbox=-6,50,2,61]http://www.informationfreeway.org/api/0.5/node%5Brailway=station%5D%5Bbbox=-6,50,2,61%5D I compare that with my previous download to see if any stations have been deleted. Should I be using the planet file for this? -- Edward. ___ talk mailing list talk@openstreetmap.org http://lists.openstreetmap.org/cgi-bin/mailman/listinfo/talk ___ talk mailing list talk@openstreetmap.org http://lists.openstreetmap.org/cgi-bin/mailman/listinfo/talk
Re: [OSM-talk] OSMXAPI
OK I tried it with Kosmos, looks like you set the maximum size limit on downloadable areas (or is it just the max. count of elements)? This is my request URL (roughly the area around Bodensee): http://osmxapi.hypercube.telascience.org/api/0.5/*%5bbbox=8.57056470092773,47.3201045967113,10.3134986679315,47.8968827018757 Response: ?xml version='1.0' standalone='no'?\nerror\nBETA: we are testing a request validation mechanism to filter out silly requests. If you have made\n a sensible request that is being rejected please let me know ([EMAIL PROTECTED]). \n\nYour request (*/*/*) is too large. Please check your request. \nIf you really do need this data then it may be better to get it directly from a planet file.\nLog ID=475746 \n/error\n I think it is good that you've set some sort of filtering of requests. It would however be nice to know what kind of criteria you set for rejecting requests, so that OSMXAPI clients could implements similar logic even before sending requests. An idea to consider: why not allow some sort of capabilities query which would return current values of these criteria? Regards, Igor 80n wrote: I've just implemented a change to OSMXAPI which will filter out and reject silly requests (like highway=*). The filter uses a combination of bbox size and count of matching elements to determine whether or not to process the request. At this stage it is a bit experimental and there is scope for fine tuning what it accepts and rejects. If you find that it is rejecting a request that you think is reasonable then please let me know. I want to find the point where all reasonable requests are still accepted but silly or badly formed ones are rejected. This should make a big difference to the throughput as previously osmxapi would easily get bogged down by someone requesting the whole planet and then retrying two or three times when they don't get a response within 10 seconds. 80n ___ talk mailing list talk@openstreetmap.org http://lists.openstreetmap.org/cgi-bin/mailman/listinfo/talk -- http://igorbrejc.net ___ talk mailing list talk@openstreetmap.org http://lists.openstreetmap.org/cgi-bin/mailman/listinfo/talk
Re: [OSM-talk] Osmxapi down?
Should be working again now. On Sun, Jul 13, 2008 at 10:27 AM, Tom Taylor [EMAIL PROTECTED] wrote: On 13 Jul 2008, at 10:13, Shaun McDonald wrote: Which URL were you doing? What were you expecting, and what did you get instead? I've been getting this on and off for a while. --2008-07-13 10:26:38-- http://www.informationfreeway.org/api/0.5/ node[amenity=pub][bbox=-6,50,2,61] Resolving www.informationfreeway.org... 80.68.90.42 Connecting to www.informationfreeway.org|80.68.90.42|:80... connected. HTTP request sent, awaiting response... 302 Found Location: http://osmxapi.hypercube.telascience.org/api/0.5/node%5bamenity=pub%5d%5bbbox=-6,50,2,61%5d [following] --2008-07-13 10:26:40-- http://osmxapi.hypercube.telascience.org/api/0.5/node%5bamenity=pub%5d%5bbbox=-6,50,2,61%5d Resolving osmxapi.hypercube.telascience.org... 137.110.119.130 Connecting to osmxapi.hypercube.telascience.org|137.110.119.130|:80... connected. HTTP request sent, awaiting response... 501 Internal Server Error 2008-07-13 10:27:08 ERROR 501: Internal Server Error. ___ talk mailing list talk@openstreetmap.org http://lists.openstreetmap.org/cgi-bin/mailman/listinfo/talk ___ talk mailing list talk@openstreetmap.org http://lists.openstreetmap.org/cgi-bin/mailman/listinfo/talk
Re: [OSM-talk] Osmxapi down?
Am Montag, 14. Juli 2008 11:32 schrieb 80n: Should be working again now. YES! Thank you Sven ___ talk mailing list talk@openstreetmap.org http://lists.openstreetmap.org/cgi-bin/mailman/listinfo/talk
Re: [OSM-talk] Osmxapi down?
On 13 Jul 2008, at 10:13, Shaun McDonald wrote: Which URL were you doing? What were you expecting, and what did you get instead? I've been getting this on and off for a while. --2008-07-13 10:26:38-- http://www.informationfreeway.org/api/0.5/ node[amenity=pub][bbox=-6,50,2,61] Resolving www.informationfreeway.org... 80.68.90.42 Connecting to www.informationfreeway.org|80.68.90.42|:80... connected. HTTP request sent, awaiting response... 302 Found Location: http://osmxapi.hypercube.telascience.org/api/0.5/node%5bamenity=pub%5d%5bbbox=-6,50,2,61%5d [following] --2008-07-13 10:26:40-- http://osmxapi.hypercube.telascience.org/api/0.5/node%5bamenity=pub%5d%5bbbox=-6,50,2,61%5d Resolving osmxapi.hypercube.telascience.org... 137.110.119.130 Connecting to osmxapi.hypercube.telascience.org|137.110.119.130|:80... connected. HTTP request sent, awaiting response... 501 Internal Server Error 2008-07-13 10:27:08 ERROR 501: Internal Server Error. ___ talk mailing list talk@openstreetmap.org http://lists.openstreetmap.org/cgi-bin/mailman/listinfo/talk
Re: [OSM-talk] osmxapi problems?
On Wed, Jun 11, 2008 at 04:49:00PM -0700, Alan Millar wrote: Anyone else having osmxapi problems? I can't generate lowzoom captions because it is returning empty data. For example: wget 'http://www.informationfreeway.org/api/0.5/node[place=town|city|country][bbox=-123.046875,46.878726,-110.234375,50.151377]' comes back with one xml header line then it closes the connection and file. Any ideas? Thanks. A disk filled up, and is being problematic to clean up (since the disk is 100% full, it can't get an NFS lock written, I think, so it's not letting me remove files). I'm working on getting it back up. Regards, -- Christopher Schmidt MetaCarta ___ talk mailing list talk@openstreetmap.org http://lists.openstreetmap.org/cgi-bin/mailman/listinfo/talk
Re: [OSM-talk] osmxapi/bbox question
Hi, Currently i'm working with the bbox of Belgium, but this bbox includes parts of the Netherlands, France,.. And this gives me some problems... it appears that some places in Belgium also exists in the Netherlands or France. Apparently it is only possible to use bbox-es to limit the size. Are there any ideas or plans to implement some way you can limit the size for eg. a country? Johan 80n wrote: You can have any shaped bbox you like as long as it is a rectangle ;) Can anyone point me to a good algorithm for selecting points within an arbitrary polygon? 80n On Fri, Apr 11, 2008 at 1:01 PM, Johan Huysmans [EMAIL PROTECTED] mailto:[EMAIL PROTECTED] wrote: Hi All, I' experimenting with osmxapi to get a list of all places in Belgium. Getting a list of all places is no problem, but the list is a bit too large ;) Can I specify that I only want the places in Belgium? Can this be done with bbox? Is there a known mapping that give you the exact bbox for each country? Thx, Johan Huysmans ___ talk mailing list talk@openstreetmap.org mailto:talk@openstreetmap.org http://lists.openstreetmap.org/cgi-bin/mailman/listinfo/talk ___ talk mailing list talk@openstreetmap.org http://lists.openstreetmap.org/cgi-bin/mailman/listinfo/talk
Re: [OSM-talk] osmxapi/bbox question
Download from here, it uses a polygon instead of a bbox. http://download.geofabrik.de/osm/europe/ On Fri, Apr 18, 2008 at 10:04 AM, Johan Huysmans [EMAIL PROTECTED] wrote: Hi, Currently i'm working with the bbox of Belgium, but this bbox includes parts of the Netherlands, France,.. And this gives me some problems... it appears that some places in Belgium also exists in the Netherlands or France. Apparently it is only possible to use bbox-es to limit the size. Are there any ideas or plans to implement some way you can limit the size for eg. a country? Johan 80n wrote: You can have any shaped bbox you like as long as it is a rectangle ;) Can anyone point me to a good algorithm for selecting points within an arbitrary polygon? 80n On Fri, Apr 11, 2008 at 1:01 PM, Johan Huysmans [EMAIL PROTECTED] mailto:[EMAIL PROTECTED] wrote: Hi All, I' experimenting with osmxapi to get a list of all places in Belgium. Getting a list of all places is no problem, but the list is a bit too large ;) Can I specify that I only want the places in Belgium? Can this be done with bbox? Is there a known mapping that give you the exact bbox for each country? Thx, Johan Huysmans ___ talk mailing list talk@openstreetmap.org mailto:talk@openstreetmap.org http://lists.openstreetmap.org/cgi-bin/mailman/listinfo/talk ___ talk mailing list talk@openstreetmap.org http://lists.openstreetmap.org/cgi-bin/mailman/listinfo/talk ___ talk mailing list talk@openstreetmap.org http://lists.openstreetmap.org/cgi-bin/mailman/listinfo/talk
Re: [OSM-talk] osmxapi/bbox question
i would be cool if the osmxapi could accept a href to a polygon xml file reference instead of a bbox. We can put a list of country/province/city/... polygons somewhere on a site 2008/4/18, Johan Huysmans [EMAIL PROTECTED]: And a combination of both? Does that exists. Now my php script just eats all memory when parsing the osm file :( Johan Skywave wrote: Download from here, it uses a polygon instead of a bbox. http://download.geofabrik.de/osm/europe/ On Fri, Apr 18, 2008 at 10:04 AM, Johan Huysmans [EMAIL PROTECTED] wrote: Hi, Currently i'm working with the bbox of Belgium, but this bbox includes parts of the Netherlands, France,.. And this gives me some problems... it appears that some places in Belgium also exists in the Netherlands or France. Apparently it is only possible to use bbox-es to limit the size. Are there any ideas or plans to implement some way you can limit the size for eg. a country? Johan 80n wrote: You can have any shaped bbox you like as long as it is a rectangle ;) Can anyone point me to a good algorithm for selecting points within an arbitrary polygon? 80n On Fri, Apr 11, 2008 at 1:01 PM, Johan Huysmans [EMAIL PROTECTED] mailto:[EMAIL PROTECTED] wrote: Hi All, I' experimenting with osmxapi to get a list of all places in Belgium. Getting a list of all places is no problem, but the list is a bit too large ;) Can I specify that I only want the places in Belgium? Can this be done with bbox? Is there a known mapping that give you the exact bbox for each country? Thx, Johan Huysmans ___ talk mailing list talk@openstreetmap.org mailto:talk@openstreetmap.org http://lists.openstreetmap.org/cgi-bin/mailman/listinfo/talk ___ talk mailing list talk@openstreetmap.org http://lists.openstreetmap.org/cgi-bin/mailman/listinfo/talk ___ talk mailing list talk@openstreetmap.org http://lists.openstreetmap.org/cgi-bin/mailman/listinfo/talk ___ talk mailing list talk@openstreetmap.org http://lists.openstreetmap.org/cgi-bin/mailman/listinfo/talk ___ talk mailing list talk@openstreetmap.org http://lists.openstreetmap.org/cgi-bin/mailman/listinfo/talk
Re: [OSM-talk] osmxapi/bbox question
That's exactly what i mean/want :D That way you can call the osmxapi url with [polygon=belgium] or [polygon:country=belgium] What do the osmxapi developers think about it? Greetings Johan Rob wrote: i would be cool if the osmxapi could accept a href to a polygon xml file reference instead of a bbox. We can put a list of country/province/city/... polygons somewhere on a site 2008/4/18, Johan Huysmans [EMAIL PROTECTED]: And a combination of both? Does that exists. Now my php script just eats all memory when parsing the osm file :( Johan Skywave wrote: Download from here, it uses a polygon instead of a bbox. http://download.geofabrik.de/osm/europe/ On Fri, Apr 18, 2008 at 10:04 AM, Johan Huysmans [EMAIL PROTECTED] wrote: Hi, Currently i'm working with the bbox of Belgium, but this bbox includes parts of the Netherlands, France,.. And this gives me some problems... it appears that some places in Belgium also exists in the Netherlands or France. Apparently it is only possible to use bbox-es to limit the size. Are there any ideas or plans to implement some way you can limit the size for eg. a country? Johan 80n wrote: You can have any shaped bbox you like as long as it is a rectangle ;) Can anyone point me to a good algorithm for selecting points within an arbitrary polygon? 80n On Fri, Apr 11, 2008 at 1:01 PM, Johan Huysmans [EMAIL PROTECTED] mailto:[EMAIL PROTECTED] wrote: Hi All, I' experimenting with osmxapi to get a list of all places in Belgium. Getting a list of all places is no problem, but the list is a bit too large ;) Can I specify that I only want the places in Belgium? Can this be done with bbox? Is there a known mapping that give you the exact bbox for each country? Thx, Johan Huysmans ___ talk mailing list talk@openstreetmap.org mailto:talk@openstreetmap.org http://lists.openstreetmap.org/cgi-bin/mailman/listinfo/talk ___ talk mailing list talk@openstreetmap.org http://lists.openstreetmap.org/cgi-bin/mailman/listinfo/talk ___ talk mailing list talk@openstreetmap.org http://lists.openstreetmap.org/cgi-bin/mailman/listinfo/talk ___ talk mailing list talk@openstreetmap.org http://lists.openstreetmap.org/cgi-bin/mailman/listinfo/talk ___ talk mailing list talk@openstreetmap.org http://lists.openstreetmap.org/cgi-bin/mailman/listinfo/talk ___ talk mailing list talk@openstreetmap.org http://lists.openstreetmap.org/cgi-bin/mailman/listinfo/talk
Re: [OSM-talk] osmxapi/bbox question
On Fri, Apr 18, 2008 at 3:14 PM, Johan Huysmans [EMAIL PROTECTED] wrote: That's exactly what i mean/want :D That way you can call the osmxapi url with [polygon=belgium] or [polygon:country=belgium] What do the osmxapi developers think about it? It's a nice idea. I just need to implement the algorithm described earlier in this thread :) 80n Greetings Johan Rob wrote: i would be cool if the osmxapi could accept a href to a polygon xml file reference instead of a bbox. We can put a list of country/province/city/... polygons somewhere on a site 2008/4/18, Johan Huysmans [EMAIL PROTECTED]: And a combination of both? Does that exists. Now my php script just eats all memory when parsing the osm file :( Johan Skywave wrote: Download from here, it uses a polygon instead of a bbox. http://download.geofabrik.de/osm/europe/ On Fri, Apr 18, 2008 at 10:04 AM, Johan Huysmans [EMAIL PROTECTED] wrote: Hi, Currently i'm working with the bbox of Belgium, but this bbox includes parts of the Netherlands, France,.. And this gives me some problems... it appears that some places in Belgium also exists in the Netherlands or France. Apparently it is only possible to use bbox-es to limit the size. Are there any ideas or plans to implement some way you can limit the size for eg. a country? Johan 80n wrote: You can have any shaped bbox you like as long as it is a rectangle ;) Can anyone point me to a good algorithm for selecting points within an arbitrary polygon? 80n On Fri, Apr 11, 2008 at 1:01 PM, Johan Huysmans [EMAIL PROTECTED] mailto:[EMAIL PROTECTED] wrote: Hi All, I' experimenting with osmxapi to get a list of all places in Belgium. Getting a list of all places is no problem, but the list is a bit too large ;) Can I specify that I only want the places in Belgium? Can this be done with bbox? Is there a known mapping that give you the exact bbox for each country? Thx, Johan Huysmans ___ talk mailing list talk@openstreetmap.org mailto:talk@openstreetmap.org http://lists.openstreetmap.org/cgi-bin/mailman/listinfo/talk ___ talk mailing list talk@openstreetmap.org http://lists.openstreetmap.org/cgi-bin/mailman/listinfo/talk ___ talk mailing list talk@openstreetmap.org http://lists.openstreetmap.org/cgi-bin/mailman/listinfo/talk ___ talk mailing list talk@openstreetmap.org http://lists.openstreetmap.org/cgi-bin/mailman/listinfo/talk ___ talk mailing list talk@openstreetmap.org http://lists.openstreetmap.org/cgi-bin/mailman/listinfo/talk ___ talk mailing list talk@openstreetmap.org http://lists.openstreetmap.org/cgi-bin/mailman/listinfo/talk ___ talk mailing list talk@openstreetmap.org http://lists.openstreetmap.org/cgi-bin/mailman/listinfo/talk
Re: [OSM-talk] osmxapi/bbox question
Hi, That way you can call the osmxapi url with [polygon=belgium] or [polygon:country=belgium] What do the osmxapi developers think about it? It's a nice idea. I just need to implement the algorithm described earlier in this thread :) Not only do you need to implement the algorithm, you also need a computing environment that will be able to execute the algorithm in an acceptable timeframe. A halfway correct border polygon of a landlocked state easily runs into five-digit numbers of polygon nodes, and then for each of the 250 million nodes in the database, you have to find out whether it lies in that polygon. (An obvious optimization is to compute the largest rectangle contained in, and the largest rectangle containing, the polygon. First check if point is outside the outer bbox - if yes, you're done. Then check if point is inside the inner bbox - if yes, you're done. Only after that do the actual polygon test.) Bye Frederik ___ talk mailing list talk@openstreetmap.org http://lists.openstreetmap.org/cgi-bin/mailman/listinfo/talk
Re: [OSM-talk] osmxapi/bbox question
On Fri, Apr 18, 2008 at 4:56 PM, Frederik Ramm [EMAIL PROTECTED] wrote: (An obvious optimization is to compute the largest rectangle contained in, and the largest rectangle containing, the polygon. First check if point is outside the outer bbox - if yes, you're done. Then check if point is inside the inner bbox - if yes, you're done. Only after that do the actual polygon test.) PostGIS is thataway -- :-) Cheers, Andy ___ talk mailing list talk@openstreetmap.org http://lists.openstreetmap.org/cgi-bin/mailman/listinfo/talk
Re: [OSM-talk] osmxapi/bbox question
On Fri, Apr 18, 2008 at 4:56 PM, Frederik Ramm [EMAIL PROTECTED] wrote: Hi, That way you can call the osmxapi url with [polygon=belgium] or [polygon:country=belgium] What do the osmxapi developers think about it? It's a nice idea. I just need to implement the algorithm described earlier in this thread :) Not only do you need to implement the algorithm, you also need a computing environment that will be able to execute the algorithm in an acceptable timeframe. A halfway correct border polygon of a landlocked state easily runs into five-digit numbers of polygon nodes, and then for each of the 250 million nodes in the database, you have to find out whether it lies in that polygon. (An obvious optimization is to compute the largest rectangle contained in, and the largest rectangle containing, the polygon. First check if point is outside the outer bbox - if yes, you're done. Then check if point is inside the inner bbox - if yes, you're done. Only after that do the actual polygon test.) Yes, the algorithm is simple, it's implementation is a little more challenging. Bye Frederik ___ talk mailing list talk@openstreetmap.org http://lists.openstreetmap.org/cgi-bin/mailman/listinfo/talk
Re: [OSM-talk] osmxapi/bbox question
Karl Newman wrote: On Fri, Apr 11, 2008 at 5:47 AM, 80n [EMAIL PROTECTED] mailto:[EMAIL PROTECTED] wrote: You can have any shaped bbox you like as long as it is a rectangle ;) Can anyone point me to a good algorithm for selecting points within an arbitrary polygon? 80n I don't have it in pseudocode, but one I've heard of casts a ray (horizontal is common) out from the point being tested and then checks the intersection of that ray against each segment of the polygon. If the total number of intersections is odd, then the point lies inside the polygon. If the number is even, then it's outside. This works for holes in a polygon, too. Karl http://en.wikipedia.org/wiki/Point_in_polygon Igor -- http://igorbrejc.net ___ talk mailing list talk@openstreetmap.org http://lists.openstreetmap.org/cgi-bin/mailman/listinfo/talk
Re: [OSM-talk] osmxapi/bbox question
On Fri, Apr 11, 2008 at 5:47 AM, 80n [EMAIL PROTECTED] wrote: You can have any shaped bbox you like as long as it is a rectangle ;) Can anyone point me to a good algorithm for selecting points within an arbitrary polygon? 80n I don't have it in pseudocode, but one I've heard of casts a ray (horizontal is common) out from the point being tested and then checks the intersection of that ray against each segment of the polygon. If the total number of intersections is odd, then the point lies inside the polygon. If the number is even, then it's outside. This works for holes in a polygon, too. Karl ___ talk mailing list talk@openstreetmap.org http://lists.openstreetmap.org/cgi-bin/mailman/listinfo/talk
Re: [OSM-talk] OSMXAPI and wget failing miserably
On Sat, Apr 05, 2008 at 03:52:37PM +1100, Matt White wrote: Is anyone else having issues getting data from informationfreeway.org using OSMXAPI? A scheduled dump I run has started failing all the time, and a couple of manual extracts are returning nothing. I think my query is right (certainly my scheduled dump ran nicely for many days). But I know the daily diffs choked a couple of weeks ago. Have there been changes made to extracting since then? Has this been happening since last weekend only? If so, then this is matching other reports I've been receiving. I only know how to keep the apache server up and running. When that is running fine, osmxapi fixes are beyond my skill level. I can't see anything obvious from the server logs that indicates what's wrong. The zappyds appear to be up, but I'm definitely not getting any data out. (There's also 16000 email messages from cron in etiennes mail folder from what looks like failed loading of minutely diffs.) All I can say is Ask Etienne, and it seems as if he's unavailable to investigate at the moment. Currently trying to extract the Washington DC area using: wget --timeout=0 http://www.informationfreeway.org/api/0.5/*[bbox=-77.4,39,-76.7,38.7]; -O WashingtonDC.osm which I think is correct. So, does anybody know what's going on? Matt ___ talk mailing list talk@openstreetmap.org http://lists.openstreetmap.org/cgi-bin/mailman/listinfo/talk -- Christopher Schmidt MetaCarta ___ talk mailing list talk@openstreetmap.org http://lists.openstreetmap.org/cgi-bin/mailman/listinfo/talk
Re: [OSM-talk] OSMXAPI and wget failing miserably
One of the zappy2 databases wanted a database check. Everything should be ok now. Chris, I'll put some instructions on the wiki about how to troubleshoot this kind of problem. 80n On Sat, Apr 5, 2008 at 10:03 AM, Christopher Schmidt [EMAIL PROTECTED] wrote: On Sat, Apr 05, 2008 at 03:52:37PM +1100, Matt White wrote: Is anyone else having issues getting data from informationfreeway.org using OSMXAPI? A scheduled dump I run has started failing all the time, and a couple of manual extracts are returning nothing. I think my query is right (certainly my scheduled dump ran nicely for many days). But I know the daily diffs choked a couple of weeks ago. Have there been changes made to extracting since then? Has this been happening since last weekend only? If so, then this is matching other reports I've been receiving. I only know how to keep the apache server up and running. When that is running fine, osmxapi fixes are beyond my skill level. I can't see anything obvious from the server logs that indicates what's wrong. The zappyds appear to be up, but I'm definitely not getting any data out. (There's also 16000 email messages from cron in etiennes mail folder from what looks like failed loading of minutely diffs.) All I can say is Ask Etienne, and it seems as if he's unavailable to investigate at the moment. Currently trying to extract the Washington DC area using: wget --timeout=0 http://www.informationfreeway.org/api/0.5/*[bbox=-77.4,39,-76.7,38.7]http://www.informationfreeway.org/api/0.5/*%5Bbbox=-77.4,39,-76.7,38.7%5D -O WashingtonDC.osm which I think is correct. So, does anybody know what's going on? Matt ___ talk mailing list talk@openstreetmap.org http://lists.openstreetmap.org/cgi-bin/mailman/listinfo/talk -- Christopher Schmidt MetaCarta ___ talk mailing list talk@openstreetmap.org http://lists.openstreetmap.org/cgi-bin/mailman/listinfo/talk ___ talk mailing list talk@openstreetmap.org http://lists.openstreetmap.org/cgi-bin/mailman/listinfo/talk
Re: [OSM-talk] OSMXapi error 501
On Thu, Apr 03, 2008 at 11:17:31AM +0800, maning sambale wrote: Is the osmxapi working on the hourly diffs now? Minutely, so far as I can tell based on the way that the server behaves. Regards, -- Christopher Schmidt MetaCarta ___ talk mailing list talk@openstreetmap.org http://lists.openstreetmap.org/cgi-bin/mailman/listinfo/talk
Re: [OSM-talk] OSMXapi error 501
Christopher Schmidt wrote: Minutely, so far as I can tell based on the way that the server behaves. Regards, It's every minute unless recent issues have changed something. The minute diffs have been somewhat unadvertised but are now available at the top level of the planet server: http://planet.openstreetmap.org/minute/ ___ talk mailing list talk@openstreetmap.org http://lists.openstreetmap.org/cgi-bin/mailman/listinfo/talk
Re: [OSM-talk] OSMXapi error 501
Cool! Thanks! On Thu, Apr 3, 2008 at 7:16 PM, Brett Henderson [EMAIL PROTECTED] wrote: Christopher Schmidt wrote: Minutely, so far as I can tell based on the way that the server behaves. Regards, It's every minute unless recent issues have changed something. The minute diffs have been somewhat unadvertised but are now available at the top level of the planet server: http://planet.openstreetmap.org/minute/ ___ talk mailing list talk@openstreetmap.org http://lists.openstreetmap.org/cgi-bin/mailman/listinfo/talk -- |-|--| | __.-._ |Ohhh. Great warrior. Wars not make one great. -Yoda | | '-._7' |Freedom is still the most radical idea of all -N.Branden| | /'.-c |Linux registered user #402901, http://counter.li.org/ | | | /T |http://esambale.wikispaces.com| | _)_/LI |-|--| ___ talk mailing list talk@openstreetmap.org http://lists.openstreetmap.org/cgi-bin/mailman/listinfo/talk
Re: [OSM-talk] OSMXapi error 501
Is the osmxapi working on the hourly diffs now? cheers, maning On Sun, Mar 30, 2008 at 10:07 PM, Christopher Schmidt [EMAIL PROTECTED] wrote: On Sun, Mar 30, 2008 at 01:16:52PM +0100, 80n wrote: One instance of osmxapi (zappy2) is affected by this, but the other instance (zappy1) is running normally. However, apache is having problems and so requests are not getting through to zappy1. This is now totally broken: I've emailed someone to go physically poke the machine. I will update again when this is done. I apologize for the inconvenience. Regards, -- Christopher Schmidt MetaCarta ___ talk mailing list talk@openstreetmap.org http://lists.openstreetmap.org/cgi-bin/mailman/listinfo/talk -- |-|--| | __.-._ |Ohhh. Great warrior. Wars not make one great. -Yoda | | '-._7' |Freedom is still the most radical idea of all -N.Branden| | /'.-c |Linux registered user #402901, http://counter.li.org/ | | | /T |http://esambale.wikispaces.com| | _)_/LI |-|--| ___ talk mailing list talk@openstreetmap.org http://lists.openstreetmap.org/cgi-bin/mailman/listinfo/talk
Re: [OSM-talk] OSMXapi error 501
I'm still having trouble getting returned data from OSMXapi. The server osmxapi.hypercube.telascience.org times out getting a connection most times. If I do get a connection the HTTP request times out. I've tried a deliberately small request to minimise the load, but still no joy. If the server is busy then I'll wait, but it might need a prod at the big red button. :) cheers, Chris - Original Message From: 80n [EMAIL PROTECTED] To: Chris Hill [EMAIL PROTECTED] Cc: Talk OSM talk@openstreetmap.org Sent: Sunday, 30 March, 2008 3:49:03 AM Subject: Re: [OSM-talk] OSMXapi error 501 Osmxapi is back up. It just wanted a database check before it was willing to restart. 80n On Sat, Mar 29, 2008 at 10:17 PM, Chris Hill [EMAIL PROTECTED] wrote: The request still gives error 501 so something is wrong. cheers, Chris - Original Message From: Christopher Schmidt [EMAIL PROTECTED] To: J.D. Schmidt [EMAIL PROTECTED] Cc: Chris Hill [EMAIL PROTECTED]; Talk OSM talk@openstreetmap.org Sent: Saturday, 29 March, 2008 7:31:56 PM Subject: Re: [OSM-talk] OSMXapi error 501 On Sat, Mar 29, 2008 at 05:03:54PM +0100, J.D. Schmidt wrote: Chris Hill skrev: I've been trying to extract data from OSMXapi. It seems to respond with ERROR 501 - Internal Server Error to each request. Is it broken? cheers, Chris Same server that runs [EMAIL PROTECTED] afair - and that server is down at the moment. Crschmidt posted the following on the [EMAIL PROTECTED] list : This shouldn't have affected osmxapi other than temporarily, but in any case, Hypercube is back in the saddle now, so if there is a continuing problem, it likely needs to be fixed by etienne: unfortunately, I don't know much about how to bring this back online. Regards, -- Christopher Schmidt MetaCarta __ Sent from Yahoo! Mail. A Smarter Inbox http://uk.docs.yahoo..com/nowyoucan.html ___ talk mailing list talk@openstreetmap.org http://lists.openstreetmap.org/cgi-bin/mailman/listinfo/talk __ Sent from Yahoo! Mail. A Smarter Inbox http://uk.docs.yahoo.com/nowyoucan.html___ talk mailing list talk@openstreetmap.org http://lists.openstreetmap.org/cgi-bin/mailman/listinfo/talk
Re: [OSM-talk] OSMXapi error 501
On Sun, Mar 30, 2008 at 12:46 PM, Martijn van Oosterhout [EMAIL PROTECTED] wrote: On Sun, Mar 30, 2008 at 1:34 PM, Chris Hill [EMAIL PROTECTED] wrote: I'm still having trouble getting returned data from OSMXapi.. The server osmxapi.hypercube.telascience.org times out getting a connection most times. If I do get a connection the HTTP request times out. I've tried a deliberately small request to minimise the load, but still no joy. If the server is busy then I'll wait, but it might need a prod at the big red button. :) There is something funny going on on hypercube. It looked like one of the NFS mounts is wedged on a certain directory and it just happens to be the one where osmxapi is processing the diffs. There's lots of processes stuck in D state right now, I think crschmidt needs to diagnose the NFS thing before things start working again... One instance of osmxapi (zappy2) is affected by this, but the other instance (zappy1) is running normally. However, apache is having problems and so requests are not getting through to zappy1. 80n Have a nice day, -- Martijn van Oosterhout [EMAIL PROTECTED] http://svana.org/kleptog/ ___ talk mailing list talk@openstreetmap.org http://lists.openstreetmap.org/cgi-bin/mailman/listinfo/talk
Re: [OSM-talk] OSMXAPI returning points outside bounding box
On 18/03/2008, David Dean [EMAIL PROTECTED] wrote: But, there are a bunch of nodes in the XML file outside that bounding box: After a bit of that, the reset of the xml file seems ok, but something weird is clearly happening here. Any ideas? seeing as no-one more knowledgeable has answeeed, i'll have a go: are they components of ways which are partly within the bbox, partly outside it? i think if you request a bbox which has roads (or any ways), which are partly outside, it downloads the entirety of the way, including the nodes not constrained by the box? but i'm not 100% ___ talk mailing list talk@openstreetmap.org http://lists.openstreetmap.org/cgi-bin/mailman/listinfo/talk
Re: [OSM-talk] OSMXapi error 501
Chris Hill skrev: I've been trying to extract data from OSMXapi. It seems to respond with ERROR 501 - Internal Server Error to each request. Is it broken? cheers, Chris Same server that runs [EMAIL PROTECTED] afair - and that server is down at the moment. Crschmidt posted the following on the [EMAIL PROTECTED] list : The [EMAIL PROTECTED] server is currently down for processing new tilesets. The disk which hosts the MySQL database is currently unavailable. I've contacted the owner of the machine and let him know. I will update the list when the service is available again. I apologize for any inconvenience. Regards, Christopher Schmidt MetaCarta That might be the same reason osmxapi is u/s at the moment. Dutch ___ talk mailing list talk@openstreetmap.org http://lists.openstreetmap.org/cgi-bin/mailman/listinfo/talk
Re: [OSM-talk] OSMXapi error 501
On Sat, Mar 29, 2008 at 05:03:54PM +0100, J.D. Schmidt wrote: Chris Hill skrev: I've been trying to extract data from OSMXapi. It seems to respond with ERROR 501 - Internal Server Error to each request. Is it broken? cheers, Chris Same server that runs [EMAIL PROTECTED] afair - and that server is down at the moment. Crschmidt posted the following on the [EMAIL PROTECTED] list : This shouldn't have affected osmxapi other than temporarily, but in any case, Hypercube is back in the saddle now, so if there is a continuing problem, it likely needs to be fixed by etienne: unfortunately, I don't know much about how to bring this back online. Regards, -- Christopher Schmidt MetaCarta ___ talk mailing list talk@openstreetmap.org http://lists.openstreetmap.org/cgi-bin/mailman/listinfo/talk
Re: [OSM-talk] OSMXapi error 501
The request still gives error 501 so something is wrong. cheers, Chris - Original Message From: Christopher Schmidt [EMAIL PROTECTED] To: J.D. Schmidt [EMAIL PROTECTED] Cc: Chris Hill [EMAIL PROTECTED]; Talk OSM talk@openstreetmap.org Sent: Saturday, 29 March, 2008 7:31:56 PM Subject: Re: [OSM-talk] OSMXapi error 501 On Sat, Mar 29, 2008 at 05:03:54PM +0100, J.D. Schmidt wrote: Chris Hill skrev: I've been trying to extract data from OSMXapi. It seems to respond with ERROR 501 - Internal Server Error to each request. Is it broken? cheers, Chris Same server that runs [EMAIL PROTECTED] afair - and that server is down at the moment. Crschmidt posted the following on the [EMAIL PROTECTED] list : This shouldn't have affected osmxapi other than temporarily, but in any case, Hypercube is back in the saddle now, so if there is a continuing problem, it likely needs to be fixed by etienne: unfortunately, I don't know much about how to bring this back online. Regards, -- Christopher Schmidt MetaCarta __ Sent from Yahoo! Mail. A Smarter Inbox http://uk.docs.yahoo.com/nowyoucan.html ___ talk mailing list talk@openstreetmap.org http://lists.openstreetmap.org/cgi-bin/mailman/listinfo/talk
Re: [OSM-talk] OSMXapi
-BEGIN PGP SIGNED MESSAGE- Hash: SHA1 80n wrote: | | On Thu, Mar 20, 2008 at 9:54 PM, Chris Hill [EMAIL PROTECTED] | mailto:[EMAIL PROTECTED] wrote: | | I have extracted some data yesterday from OsmXapi for a range | [bbox=-1.1,53.63,0.16,54.17], roughly the area of East Yorkshire, UK. | | In the resulting data there are nodes and ways from well outside | this area, for example: | | node id='46201367' lat='52.3305' lon='5.06701' user='Ed Kapitein' | osmxapi:users='Ed Kapitein' timestamp='2008-02-22T16:55:00Z' |tag k='AND_nodes' v='236712'/ |tag k='AND_nosr_p' v='10012917'/ |tag k='is_in' v='NL'/ |tag k='name' v='Muiden'/ |tag k='place' v='village'/ |tag k='population' v='1000'/ |tag k='postal_code' v='1398'/ |tag k='source' v='AND'/ | /node | | Is this normal? | | | This should be fixed now. Osmxapi was being a bit over-zealous by | selecting all the nodes from all the ways from all the relations under | some circumstances. This sounds unsustainable. It is very likely that once a few large relations are added (a complete set of is_ins, for example), the whole world will be interrelated. Please make this a non-default option. Robert (Jamie) Munro -BEGIN PGP SIGNATURE- Version: GnuPG v1.4.6 (Darwin) Comment: Using GnuPG with Mozilla - http://enigmail.mozdev.org iD8DBQFH5PVxz+aYVHdncI0RArH9AJ4w5n48/0/h5SVA0XbUV4eQcEKOOQCffODj OZxyn9rdG78vWPr1xRF11/s= =FSj7 -END PGP SIGNATURE- ___ talk mailing list talk@openstreetmap.org http://lists.openstreetmap.org/cgi-bin/mailman/listinfo/talk
Re: [OSM-talk] OSMXapi
On Thu, Mar 20, 2008 at 9:54 PM, Chris Hill [EMAIL PROTECTED] wrote: I have extracted some data yesterday from OsmXapi for a range [bbox=-1.1, 53.63,0.16,54.17], roughly the area of East Yorkshire, UK. In the resulting data there are nodes and ways from well outside this area, for example: node id='46201367' lat='52.3305' lon='5.06701' user='Ed Kapitein' osmxapi:users='Ed Kapitein' timestamp='2008-02-22T16:55:00Z' tag k='AND_nodes' v='236712'/ tag k='AND_nosr_p' v='10012917'/ tag k='is_in' v='NL'/ tag k='name' v='Muiden'/ tag k='place' v='village'/ tag k='population' v='1000'/ tag k='postal_code' v='1398'/ tag k='source' v='AND'/ /node Is this normal? There have been a couple of reports of problems like this recently. Some changes were made to Osmxapi on March 15 to support relations. It may be that a bug crept in. I'll take a look. 80n cheers, Chris ___ Rise to the challenge for Sport Relief with Yahoo! For Good http://uk.promotions.yahoo.com/forgood/ ___ talk mailing list talk@openstreetmap.org http://lists.openstreetmap.org/cgi-bin/mailman/listinfo/talk ___ talk mailing list talk@openstreetmap.org http://lists.openstreetmap.org/cgi-bin/mailman/listinfo/talk
Re: [OSM-talk] OSMXapi
Hi, Now i've got the most bizarre results ever, it does actually seem to be the right area its rending now, with all the right labels and icons just none of the ways (and no closed ways) all the individual nodes are there (it seems, POI are showing up). Actually I lie there are about 5-6 ways showing, amounts to about 3-4 roads randomly placed over the map. I had the very same thing recently, with an .osm file containing some objects with negative IDs (due to JOSM editing). Using IdTrackerType of IdList produced results like you describe (all nodes there but practically no ways), while BitSet worked fine. Sent the whole thing to Karl Newman who couldn't reproduce the problem. Does switching to BitSet do anything for you? Bye Frederik -- Frederik Ramm ## eMail [EMAIL PROTECTED] ## N49°00'09 E008°23'33 ___ talk mailing list talk@openstreetmap.org http://lists.openstreetmap.org/cgi-bin/mailman/listinfo/talk
Re: [OSM-talk] OSMXapi
Frederik Ramm wrote: Hi, Now i've got the most bizarre results ever, it does actually seem to be the right area its rending now, with all the right labels and icons just none of the ways (and no closed ways) all the individual nodes are there (it seems, POI are showing up). Actually I lie there are about 5-6 ways showing, amounts to about 3-4 roads randomly placed over the map. I had the very same thing recently, with an .osm file containing some objects with negative IDs (due to JOSM editing). Using IdTrackerType of IdList produced results like you describe (all nodes there but practically no ways), while BitSet worked fine. Sent the whole thing to Karl Newman who couldn't reproduce the problem. Does switching to BitSet do anything for you? Bye Frederik Oh it didn't like that: [EMAIL PROTECTED]:~/Desktop/osm$ java -jar osmosis-0.24/osmosis.jar --read-xml file=data.osm --bb left=-2.6951453125 bottom=53.53062734375 right=2.6072546875 top=53.57457265625 completeRelations=no completeWays=no idTrackerType=BitSet --write-xml file=data.osm 21-Mar-2008 21:26:41 com.bretth.osmosis.core.Osmosis main INFO: Osmosis Version 0.24 21-Mar-2008 21:26:41 com.bretth.osmosis.core.Osmosis main INFO: Preparing pipeline. 21-Mar-2008 21:26:41 com.bretth.osmosis.core.Osmosis main INFO: Launching pipeline execution. 21-Mar-2008 21:26:41 com.bretth.osmosis.core.Osmosis main INFO: Pipeline executing, waiting for completion. Exception in thread Thread-1-read-xml java.lang.OutOfMemoryError: Java heap space at java.util.Arrays.copyOf(Arrays.java:2858) at java.util.BitSet.ensureCapacity(BitSet.java:155) at java.util.BitSet.expandTo(BitSet.java:170) at java.util.BitSet.set(BitSet.java:265) at com.bretth.osmosis.core.filter.common.BitSetIdTracker.set(BitSetIdTracker.java:64) at com.bretth.osmosis.core.filter.v0_5.AreaFilter.process(AreaFilter.java:110) at com.bretth.osmosis.core.container.v0_5.NodeContainer.process(NodeContainer.java:57) at com.bretth.osmosis.core.filter.v0_5.AreaFilter.process(AreaFilter.java:80) at com.bretth.osmosis.core.xml.v0_5.impl.NodeElementProcessor.end(NodeElementProcessor.java:99) at com.bretth.osmosis.core.xml.v0_5.impl.OsmHandler.endElement(OsmHandler.java:108) at com.sun.org.apache.xerces.internal.parsers.AbstractSAXParser.endElement(AbstractSAXParser.java:601) at com.sun.org.apache.xerces.internal.parsers.AbstractXMLDocumentParser.emptyElement(AbstractXMLDocumentParser.java:180) at com.sun.org.apache.xerces.internal.impl.XMLDocumentFragmentScannerImpl.scanStartElement(XMLDocumentFragmentScannerImpl.java:1337) at com.sun.org.apache.xerces.internal.impl.XMLDocumentFragmentScannerImpl$FragmentContentDriver.next(XMLDocumentFragmentScannerImpl.java:2740) at com.sun.org.apache.xerces.internal.impl.XMLDocumentScannerImpl.next(XMLDocumentScannerImpl.java:645) at com.sun.org.apache.xerces.internal.impl.XMLDocumentFragmentScannerImpl.scanDocument(XMLDocumentFragmentScannerImpl.java:508) at com.sun.org.apache.xerces.internal.parsers.XML11Configuration.parse(XML11Configuration.java:807) at com.sun.org.apache.xerces.internal.parsers.XML11Configuration.parse(XML11Configuration.java:737) at com.sun.org.apache.xerces.internal.parsers.XMLParser.parse(XMLParser.java:107) at com.sun.org.apache.xerces.internal.parsers.AbstractSAXParser.parse(AbstractSAXParser.java:1205) at com.sun.org.apache.xerces.internal.jaxp.SAXParserImpl$JAXPSAXParser.parse(SAXParserImpl.java:522) at javax.xml.parsers.SAXParser.parse(SAXParser.java:395) at javax.xml.parsers.SAXParser.parse(SAXParser.java:198) at com.bretth.osmosis.core.xml.v0_5.XmlReader.run(XmlReader.java:101) at java.lang.Thread.run(Thread.java:619) 21-Mar-2008 21:26:42 com.bretth.osmosis.core.Osmosis main One step closer, two steps back! - Daniel ___ talk mailing list talk@openstreetmap.org http://lists.openstreetmap.org/cgi-bin/mailman/listinfo/talk
Re: [OSM-talk] OSMXapi
On Thu, Mar 20, 2008 at 9:54 PM, Chris Hill [EMAIL PROTECTED] wrote: I have extracted some data yesterday from OsmXapi for a range [bbox=-1.1, 53.63,0.16,54.17], roughly the area of East Yorkshire, UK. In the resulting data there are nodes and ways from well outside this area, for example: node id='46201367' lat='52.3305' lon='5.06701' user='Ed Kapitein' osmxapi:users='Ed Kapitein' timestamp='2008-02-22T16:55:00Z' tag k='AND_nodes' v='236712'/ tag k='AND_nosr_p' v='10012917'/ tag k='is_in' v='NL'/ tag k='name' v='Muiden'/ tag k='place' v='village'/ tag k='population' v='1000'/ tag k='postal_code' v='1398'/ tag k='source' v='AND'/ /node Is this normal? This should be fixed now. Osmxapi was being a bit over-zealous by selecting all the nodes from all the ways from all the relations under some circumstances. 80n cheers, Chris ___ Rise to the challenge for Sport Relief with Yahoo! For Good http://uk.promotions.yahoo.com/forgood/ ___ talk mailing list talk@openstreetmap.org http://lists.openstreetmap.org/cgi-bin/mailman/listinfo/talk ___ talk mailing list talk@openstreetmap.org http://lists.openstreetmap.org/cgi-bin/mailman/listinfo/talk
Re: [OSM-talk] OSMXapi
Frederik Ramm wrote: Hi, [EMAIL PROTECTED]:~/Desktop/osm$ java -jar osmosis-0.24/osmosis.jar --read-xml file=data.osm --bb left=-2.6951453125 bottom=53.53062734375 right=2.6072546875 top=53.57457265625 completeRelations=no [...] Exception in thread Thread-1-read-xml java.lang.OutOfMemoryError: Java heap space Try adding the Java command line parameter -Xmx1024m. Bye Frederik Now its working! Thank you very much! The working command is: java -Xmx1024m -jar osmosis-0.24/osmosis.jar --read-xml file=data.osm --bb left=-2.6951453125 bottom=53.53062734375 right=2.6072546875 top=53.57457265625 completeRelations=no completeWays=no idTrackerType=BitSet --write-xml file=data.osm Finally a nice small map! Perfect. Thank you for your help everyone, - Daniel ___ talk mailing list talk@openstreetmap.org http://lists.openstreetmap.org/cgi-bin/mailman/listinfo/talk
Re: [OSM-talk] OSMXapi
Hi, [EMAIL PROTECTED]:~/Desktop/osm$ java -jar osmosis-0.24/osmosis.jar --read-xml file=data.osm --bb left=-2.6951453125 bottom=53.53062734375 right=2.6072546875 top=53.57457265625 completeRelations=no [...] Exception in thread Thread-1-read-xml java.lang.OutOfMemoryError: Java heap space Try adding the Java command line parameter -Xmx1024m. Bye Frederik -- Frederik Ramm ## eMail [EMAIL PROTECTED] ## N49°00'09 E008°23'33 ___ talk mailing list talk@openstreetmap.org http://lists.openstreetmap.org/cgi-bin/mailman/listinfo/talk
Re: [OSM-talk] OSMXapi
I have downloaded the selection again and it now looks much better at a first glance. It is also a little over half the size of the old one. Thanks for your work. cheers, Chris - Original Message From: 80n [EMAIL PROTECTED] To: Chris Hill [EMAIL PROTECTED] Cc: Talk OSM talk@openstreetmap.org Sent: Friday, 21 March, 2008 9:37:55 PM Subject: Re: [OSM-talk] OSMXapi On Thu, Mar 20, 2008 at 9:54 PM, Chris Hill [EMAIL PROTECTED] wrote: I have extracted some data yesterday from OsmXapi for a range [bbox=-1.1,53.63,0.16,54.17], roughly the area of East Yorkshire, UK. In the resulting data there are nodes and ways from well outside this area, for example: node id='46201367' lat='52.3305' lon='5.06701' user='Ed Kapitein' osmxapi:users='Ed Kapitein' timestamp='2008-02-22T16:55:00Z' tag k='AND_nodes' v='236712'/ tag k='AND_nosr_p' v='10012917'/ tag k='is_in' v='NL'/ tag k='name' v='Muiden'/ tag k='place' v='village'/ tag k='population' v='1000'/ tag k='postal_code' v='1398'/ tag k='source' v='AND'/ /node Is this normal? This should be fixed now. Osmxapi was being a bit over-zealous by selecting all the nodes from all the ways from all the relations under some circumstances. 80n cheers, Chris ___ Rise to the challenge for Sport Relief with Yahoo! For Good http://uk.promotions.yahoo.com/forgood/ ___ talk mailing list talk@openstreetmap.org http://lists..openstreetmap.org/cgi-bin/mailman/listinfo/talk __ Sent from Yahoo! Mail. More Ways to Keep in Touch. http://uk.docs.yahoo.com/nowyoucan.html___ talk mailing list talk@openstreetmap.org http://lists.openstreetmap.org/cgi-bin/mailman/listinfo/talk
Re: [OSM-talk] OSMXapi
Chris Hill wrote: I have extracted some data yesterday from OsmXapi for a range [bbox=-1.1,53.63,0.16,54.17], roughly the area of East Yorkshire, UK. In the resulting data there are nodes and ways from well outside this area, for example: node id='46201367' lat='52.3305' lon='5.06701' user='Ed Kapitein' osmxapi:users='Ed Kapitein' timestamp='2008-02-22T16:55:00Z' tag k='AND_nodes' v='236712'/ tag k='AND_nosr_p' v='10012917'/ tag k='is_in' v='NL'/ tag k='name' v='Muiden'/ tag k='place' v='village'/ tag k='population' v='1000'/ tag k='postal_code' v='1398'/ tag k='source' v='AND'/ /node Is this normal? cheers, Chris ___ Rise to the challenge for Sport Relief with Yahoo! For Good http://uk.promotions.yahoo.com/forgood/ ___ talk mailing list talk@openstreetmap.org http://lists.openstreetmap.org/cgi-bin/mailman/listinfo/talk Hi, I had this problem the other day extracting data from the Wigan area, when I looked at what was being downloaded it was data that was connected/related to data that was inside the bbox I had selected. For example a large primary road (one _long_ way) was included even though the majority of it clearly outside of the bbox I had selected, from what I have read this happens by design. http://wiki.openstreetmap.org/index.php/OSM_Protocol_Version_0.5#About_bounding_boxes The following command returns: * All nodes that are inside a given bounding box and any relations that reference them. * All ways that reference at least one node that is inside a given bounding box, any relations that reference them [the ways], and any nodes outside the bounding box that the ways may reference. That might be the cause of your issues, and if so there doesn't seem to be a way around it. If you find one let me know! - Daniel ___ talk mailing list talk@openstreetmap.org http://lists.openstreetmap.org/cgi-bin/mailman/listinfo/talk
Re: [OSM-talk] OSMXapi
There might be ways from Hull to Rotterdam and Zeebrugge as ferry routes - I'll check the relations but when I retrieve sub-sets in JOSM of api data I don't get chunks of Netherlands or Germany which seem to be in the download. cheers, Chris Hi, I had this problem the other day extracting data from the Wigan area, when I looked at what was being downloaded it was data that was connected/related to data that was inside the bbox I had selected. For example a large primary road (one _long_ way) was included even though the majority of it clearly outside of the bbox I had selected, from what I have read this happens by design. http://wiki.openstreetmap.org/index.php/OSM_Protocol_Version_0.5#About_bounding_boxes The following command returns: * All nodes that are inside a given bounding box and any relations that reference them. * All ways that reference at least one node that is inside a given bounding box, any relations that reference them [the ways], and any nodes outside the bounding box that the ways may reference. That might be the cause of your issues, and if so there doesn't seem to be a way around it. If you find one let me know! - Daniel ___ Rise to the challenge for Sport Relief with Yahoo! For Good http://uk.promotions.yahoo.com/forgood/ ___ talk mailing list talk@openstreetmap.org http://lists.openstreetmap.org/cgi-bin/mailman/listinfo/talk
Re: [OSM-talk] OSMXapi
Hi, That might be the cause of your issues, and if so there doesn't seem to be a way around it. If you need a properly cut bounding box then you can run your .osm file from OsmXAPI through an Osmosis -bb task afterwards. This will drop all nodes outside the box, and cut ways extending past the box. Bye Frederik -- Frederik Ramm ## eMail [EMAIL PROTECTED] ## N49°00'09 E008°23'33 ___ talk mailing list talk@openstreetmap.org http://lists.openstreetmap.org/cgi-bin/mailman/listinfo/talk
Re: [OSM-talk] OSMXapi
Frederik Ramm wrote:
Hi,
That might be the cause of your issues, and if so there doesn't seem to
be a way around it.
If you need a properly cut bounding box then you can run your .osm
file from OsmXAPI through an Osmosis -bb task afterwards. This will
drop all nodes outside the box, and cut ways extending past the box.
Bye
Frederik
Frederik,
Well that was another thing that puzzled me, because I tried that and it
didn't (seem to) work. (Although it's entirely possible that it's my fault).
http://wiki.openstreetmap.org/index.php/Osmosis#--bounding-box_.28--bb.29
Says that the completeWays and completeRelations are off ('no') by
default (I tried enabling them just to see if the logic was reversed
(ie. a bug) and explicitly turning them off, but on luck).
Here's what I was using:
java -jar osmosis-0.24/osmosis.jar --read-xml file=data.osm -bb
left=-2.6951453125 right=53.53062734375 top=2.6072546875
bottom=53.57457265625 completeRelations=no completeWays=no --write-xml
file=data.osm
I could be doing that wrong, I even tried cutting it into a tiny bbox
using coordinates that where only a few seconds apart, but still
couldn't make it work.
It does make some difference however (new file here shown against a backup):
-rw-r--r-- 1 daniel daniel1046290 2008-03-20 23:03 data.osm
-rw-r--r-- 1 daniel daniel1190058 2008-03-20 13:49 data.osm.1
No visible changes though, hmm weird, that one must be my fault, I'll
keep playing.
Thanks for your help,
- Daniel
___
talk mailing list
talk@openstreetmap.org
http://lists.openstreetmap.org/cgi-bin/mailman/listinfo/talk
Re: [OSM-talk] Osmxapi returns old data
Lars I think this is all sorted out now. Let me know if you suspect any other discrepancies. 80n On Fri, Mar 14, 2008 at 8:39 PM, Lars Aronsson [EMAIL PROTECTED] wrote: 80n wrote: Lars Can you point to a couple of specific instances please so that I can investigate further? If you try this very narrow region, wget ' http://www.informationfreeway.org/api/0.5/way[bbox=14.4,58.05,14.6,58.1][note=FIXMEhttp://www.informationfreeway.org/api/0.5/way%5Bbbox=14.4,58.05,14.6,58.1%5D%5Bnote=FIXMEpreviously unwayed segment]' -O mymap.osm You will get a 3280 bytes in mymap.osm, containing a few small untagged ways: way id='8173415' timestamp='2005-06-23T02:14:27Z' way id='8173417' timestamp='2005-06-23T02:14:30Z' way id='8173419' timestamp='2005-06-23T02:15:30Z' way id='8212509' timestamp='2006-02-24T18:11:40Z' way id='8212516' timestamp='2006-02-24T18:12:58Z' way id='8212518' timestamp='2006-02-24T18:14:36Z' way id='8212522' timestamp='2006-02-24T18:14:41Z' way id='8212526' timestamp='2006-02-24T18:15:07Z' Swedes will know this area as the ruins of Brahehus, near lake Vättern and motorway E4. I mapped this place with line segments in my first year of OSM, as shown by the timestamps above. Then Osmarender was introduced and the need to tag ways, and then someone added FIXME tags to old line segments. So just two weeks ago I edited these ways, combining them into larger units, adding the appropriate tags and removing the note=FIXME tags. When you open mymap.osm with JOSM, you will notice that all ways are 2 nodes (a single line segment) and they are not connected, but sprinkled out. If you download fresh data from OSM (without changing the zoom), you will notice that all FIXME tags are gone, and the ways are larger connected units. The last way in the list above, having id=8212526, still exists, but now is now a 4 node way (highway=motorway_link). It was tagged fixme in the planet.osm dump of 080227, but not in 080305 or 080312. At first I thought that 2-node ways that I had removed were lingering in osmxapi, but that doesn't seem to be the case. I guess the neighboring ways 8212523-8212525 were correctly removed. But the way that remained after my combination and tagging, 8212526, apparently wasn't modified in osmxapi. -- Lars Aronsson ([EMAIL PROTECTED]) Aronsson Datateknik - http://aronsson.se ___ talk mailing list talk@openstreetmap.org http://lists.openstreetmap.org/cgi-bin/mailman/listinfo/talk ___ talk mailing list talk@openstreetmap.org http://lists.openstreetmap.org/cgi-bin/mailman/listinfo/talk
Re: [OSM-talk] Osmxapi returns old data
On Sat, Mar 15, 2008 at 1:43 AM, 80n [EMAIL PROTECTED] wrote: On Sat, Mar 15, 2008 at 12:46 AM, Jon Burgess [EMAIL PROTECTED] wrote: On Sat, 2008-03-15 at 00:30 +, 80n wrote: Lars Thanks for this info, its been very useful. Some edits, that were made during the period when the incremental feeds were down, have not been resynchronized correctly. The problem is due to a difference in the timestamp format between the planet dump and the incremental feeds. I'll fix the resync script and re-run it. 80n I thought they both used the same format:- $ gzip -dc /home/www/tile/direct/planet/planet-080312.osm.gz | grep timestamp | head -n 3 node id=2 lat=50.1360074 lon=8.3023717 timestamp=2007-10-04T18:28:37Z node id=4 lat=51.5220733 lon=-0.1458135 timestamp=2007-01-29T08:48:14Z/ node id=11 lat=4.0840331 lon=73.5129514 timestamp=2006-11-04T18:15:03Z $ bzip2 -dc daily-20080307-20080308.osc.bz2 | grep timestamp | head -n 3 node id=122329 timestamp=2008-03-07T07:33:53Z user=mbuege lat=53.5374636 lon=10.0309499/ node id=122330 timestamp=2008-03-07T07:43:48Z user=mbuege lat=53.5369426 lon=10.0339214/ node id=122331 timestamp=2008-03-07T07:27:15Z user=mbuege lat=53.5389492 lon=10.0325114/ I can see the order of the attributes is different and the diffs contain the user, but the timestamp looks the same format to me. Or do you mean the timestamp in the filename? Yeah, the problem is that there _used_ to be a difference, but now there isn't. My script was expecting them to be different. On further inspection, what I said above is complete rubbish. The timestamp format difference is between the the planet dump and the API not Osmosis: Planet dump: node id=2 lat=50.1360074 lon=8.3023717 timestamp=2007-10-04T18:28:37Z API: node id=2 lat=50.1360074 lon=8.3023717 timestamp=2007-10-04T19:28:37+01:00 My code, which is pants, wrongly assumes that Osmosis was using a timestamp like the API produces, when in fact its the same as the planet dump. Maybe I'll be able to fix it properly now I know what I'm talking about. 80n Jon ___ talk mailing list talk@openstreetmap.org http://lists.openstreetmap.org/cgi-bin/mailman/listinfo/talk
Re: [OSM-talk] Osmxapi returns old data
On Sat, 2008-03-15 at 07:31 +, 80n wrote: On further inspection, what I said above is complete rubbish. The timestamp format difference is between the the planet dump and the API not Osmosis: Planet dump: node id=2 lat=50.1360074 lon=8.3023717 timestamp=2007-10-04T18:28:37Z API: node id=2 lat=50.1360074 lon=8.3023717 timestamp=2007-10-04T19:28:37+01:00 My code, which is pants, wrongly assumes that Osmosis was using a timestamp like the API produces, when in fact its the same as the planet dump. Maybe I'll be able to fix it properly now I know what I'm talking about. The timestamps in the planet dumps did match the API until a few months ago. Brett and I agreed to converge on a common timestamp format since the generic Java date parsing was horribly slow. I suppose we could change the API to use this same format if it would help other tools. Jon ___ talk mailing list talk@openstreetmap.org http://lists.openstreetmap.org/cgi-bin/mailman/listinfo/talk
Re: [OSM-talk] Osmxapi returns old data
Karl Newman wrote: This is probably due to the recently broken (and now fixed) daily/hourly diffs. After this week's planet dump is imported (probably today), the hourly diffs should be able to properly keep it up to date as the wiki page states. Yes, it's much better now. But it's not perfect. I still get many (albeit not *so* many) small (two node) ways from Osmxapi that I know have been removed (long ago) in the OSM database. When I grab an area of FIXME with Osmxapi, open this .osm file in JOSM, and download fresh data from OSM, the FIXME disappear. -- Lars Aronsson ([EMAIL PROTECTED]) Aronsson Datateknik - http://aronsson.se ___ talk mailing list talk@openstreetmap.org http://lists.openstreetmap.org/cgi-bin/mailman/listinfo/talk
Re: [OSM-talk] Osmxapi returns old data
Lars Can you point to a couple of specific instances please so that I can investigate further? Osmxapi was resynchronized against this week's planet file ( planet-080312.osm) plus the diff files from then onwards. So if there are still discrepancies all the evidence is still be available at the moment to track down how this is happening. 80n On Fri, Mar 14, 2008 at 5:22 PM, Lars Aronsson [EMAIL PROTECTED] wrote: Karl Newman wrote: This is probably due to the recently broken (and now fixed) daily/hourly diffs. After this week's planet dump is imported (probably today), the hourly diffs should be able to properly keep it up to date as the wiki page states. Yes, it's much better now. But it's not perfect. I still get many (albeit not *so* many) small (two node) ways from Osmxapi that I know have been removed (long ago) in the OSM database. When I grab an area of FIXME with Osmxapi, open this .osm file in JOSM, and download fresh data from OSM, the FIXME disappear. -- Lars Aronsson ([EMAIL PROTECTED]) Aronsson Datateknik - http://aronsson.se ___ talk mailing list talk@openstreetmap.org http://lists.openstreetmap.org/cgi-bin/mailman/listinfo/talk ___ talk mailing list talk@openstreetmap.org http://lists.openstreetmap.org/cgi-bin/mailman/listinfo/talk
Re: [OSM-talk] Osmxapi returns old data
80n wrote: Lars Can you point to a couple of specific instances please so that I can investigate further? If you try this very narrow region, wget 'http://www.informationfreeway.org/api/0.5/way[bbox=14.4,58.05,14.6,58.1][note=FIXME previously unwayed segment]' -O mymap.osm You will get a 3280 bytes in mymap.osm, containing a few small untagged ways: way id='8173415' timestamp='2005-06-23T02:14:27Z' way id='8173417' timestamp='2005-06-23T02:14:30Z' way id='8173419' timestamp='2005-06-23T02:15:30Z' way id='8212509' timestamp='2006-02-24T18:11:40Z' way id='8212516' timestamp='2006-02-24T18:12:58Z' way id='8212518' timestamp='2006-02-24T18:14:36Z' way id='8212522' timestamp='2006-02-24T18:14:41Z' way id='8212526' timestamp='2006-02-24T18:15:07Z' Swedes will know this area as the ruins of Brahehus, near lake Vättern and motorway E4. I mapped this place with line segments in my first year of OSM, as shown by the timestamps above. Then Osmarender was introduced and the need to tag ways, and then someone added FIXME tags to old line segments. So just two weeks ago I edited these ways, combining them into larger units, adding the appropriate tags and removing the note=FIXME tags. When you open mymap.osm with JOSM, you will notice that all ways are 2 nodes (a single line segment) and they are not connected, but sprinkled out. If you download fresh data from OSM (without changing the zoom), you will notice that all FIXME tags are gone, and the ways are larger connected units. The last way in the list above, having id=8212526, still exists, but now is now a 4 node way (highway=motorway_link). It was tagged fixme in the planet.osm dump of 080227, but not in 080305 or 080312. At first I thought that 2-node ways that I had removed were lingering in osmxapi, but that doesn't seem to be the case. I guess the neighboring ways 8212523-8212525 were correctly removed. But the way that remained after my combination and tagging, 8212526, apparently wasn't modified in osmxapi. -- Lars Aronsson ([EMAIL PROTECTED]) Aronsson Datateknik - http://aronsson.se ___ talk mailing list talk@openstreetmap.org http://lists.openstreetmap.org/cgi-bin/mailman/listinfo/talk
Re: [OSM-talk] Osmxapi returns old data
Lars Thanks for this info, its been very useful. Some edits, that were made during the period when the incremental feeds were down, have not been resynchronized correctly. The problem is due to a difference in the timestamp format between the planet dump and the incremental feeds. I'll fix the resync script and re-run it. 80n On Fri, Mar 14, 2008 at 8:39 PM, Lars Aronsson [EMAIL PROTECTED] wrote: 80n wrote: Lars Can you point to a couple of specific instances please so that I can investigate further? If you try this very narrow region, wget ' http://www.informationfreeway.org/api/0.5/way[bbox=14.4,58.05,14.6,58.1][note=FIXMEhttp://www.informationfreeway.org/api/0.5/way%5Bbbox=14.4,58.05,14.6,58.1%5D%5Bnote=FIXMEpreviously unwayed segment]' -O mymap.osm You will get a 3280 bytes in mymap.osm, containing a few small untagged ways: way id='8173415' timestamp='2005-06-23T02:14:27Z' way id='8173417' timestamp='2005-06-23T02:14:30Z' way id='8173419' timestamp='2005-06-23T02:15:30Z' way id='8212509' timestamp='2006-02-24T18:11:40Z' way id='8212516' timestamp='2006-02-24T18:12:58Z' way id='8212518' timestamp='2006-02-24T18:14:36Z' way id='8212522' timestamp='2006-02-24T18:14:41Z' way id='8212526' timestamp='2006-02-24T18:15:07Z' Swedes will know this area as the ruins of Brahehus, near lake Vättern and motorway E4. I mapped this place with line segments in my first year of OSM, as shown by the timestamps above. Then Osmarender was introduced and the need to tag ways, and then someone added FIXME tags to old line segments. So just two weeks ago I edited these ways, combining them into larger units, adding the appropriate tags and removing the note=FIXME tags. When you open mymap.osm with JOSM, you will notice that all ways are 2 nodes (a single line segment) and they are not connected, but sprinkled out. If you download fresh data from OSM (without changing the zoom), you will notice that all FIXME tags are gone, and the ways are larger connected units. The last way in the list above, having id=8212526, still exists, but now is now a 4 node way (highway=motorway_link). It was tagged fixme in the planet.osm dump of 080227, but not in 080305 or 080312. At first I thought that 2-node ways that I had removed were lingering in osmxapi, but that doesn't seem to be the case. I guess the neighboring ways 8212523-8212525 were correctly removed. But the way that remained after my combination and tagging, 8212526, apparently wasn't modified in osmxapi. -- Lars Aronsson ([EMAIL PROTECTED]) Aronsson Datateknik - http://aronsson.se ___ talk mailing list talk@openstreetmap.org http://lists.openstreetmap.org/cgi-bin/mailman/listinfo/talk ___ talk mailing list talk@openstreetmap.org http://lists.openstreetmap.org/cgi-bin/mailman/listinfo/talk
Re: [OSM-talk] Osmxapi returns old data
On Sat, 2008-03-15 at 00:30 +, 80n wrote: Lars Thanks for this info, its been very useful. Some edits, that were made during the period when the incremental feeds were down, have not been resynchronized correctly. The problem is due to a difference in the timestamp format between the planet dump and the incremental feeds. I'll fix the resync script and re-run it. 80n I thought they both used the same format:- $ gzip -dc /home/www/tile/direct/planet/planet-080312.osm.gz | grep timestamp | head -n 3 node id=2 lat=50.1360074 lon=8.3023717 timestamp=2007-10-04T18:28:37Z node id=4 lat=51.5220733 lon=-0.1458135 timestamp=2007-01-29T08:48:14Z/ node id=11 lat=4.0840331 lon=73.5129514 timestamp=2006-11-04T18:15:03Z $ bzip2 -dc daily-20080307-20080308.osc.bz2 | grep timestamp | head -n 3 node id=122329 timestamp=2008-03-07T07:33:53Z user=mbuege lat=53.5374636 lon=10.0309499/ node id=122330 timestamp=2008-03-07T07:43:48Z user=mbuege lat=53.5369426 lon=10.0339214/ node id=122331 timestamp=2008-03-07T07:27:15Z user=mbuege lat=53.5389492 lon=10.0325114/ I can see the order of the attributes is different and the diffs contain the user, but the timestamp looks the same format to me. Or do you mean the timestamp in the filename? Jon ___ talk mailing list talk@openstreetmap.org http://lists.openstreetmap.org/cgi-bin/mailman/listinfo/talk
Re: [OSM-talk] Osmxapi returns old data
On Thu, Mar 13, 2008 at 5:26 AM, Karl Newman [EMAIL PROTECTED] wrote: On Wed, Mar 12, 2008 at 9:30 PM, Lars Aronsson [EMAIL PROTECTED] wrote: Today I learned about [[Osmxapi]] and found it really useful for digging out ways tagged with FIXME. However, on the wiki page it says the data is never more than about 2 hours old and this clearly doesn't hold, as I got data from InformationFreeway that was changed in OSM many days ago. What's up? In particular, this command: wget ' http://www.informationfreeway.org/api/0.5/way[bbox=15,58,15.5,59][note=FIXMEhttp://www.informationfreeway.org/api/0.5/way%5Bbbox=15,58,15.5,59%5D%5Bnote=FIXMEpreviously unwayed segment]' -O mymap.osm returns 1.5 megabytes of data with a mesh of single line segment ways tagged with FIXME, that I last week have combined into longer ways tagged with highway=secondary. This is probably due to the recently broken (and now fixed) daily/hourly diffs. After this week's planet dump is imported (probably today), the hourly diffs should be able to properly keep it up to date as the wiki page states. This *is* due to the recently broken (and now fixed) daily/hourly diffs. There's a resync that was started about 9 hours ago. 80n Karl ___ talk mailing list talk@openstreetmap.org http://lists.openstreetmap.org/cgi-bin/mailman/listinfo/talk ___ talk mailing list talk@openstreetmap.org http://lists.openstreetmap.org/cgi-bin/mailman/listinfo/talk
Re: [OSM-talk] Osmxapi returns old data
On Wed, Mar 12, 2008 at 9:30 PM, Lars Aronsson [EMAIL PROTECTED] wrote: Today I learned about [[Osmxapi]] and found it really useful for digging out ways tagged with FIXME. However, on the wiki page it says the data is never more than about 2 hours old and this clearly doesn't hold, as I got data from InformationFreeway that was changed in OSM many days ago. What's up? In particular, this command: wget ' http://www.informationfreeway.org/api/0.5/way[bbox=15,58,15.5,59][note=FIXMEhttp://www.informationfreeway.org/api/0.5/way%5Bbbox=15,58,15.5,59%5D%5Bnote=FIXMEpreviously unwayed segment]' -O mymap.osm returns 1.5 megabytes of data with a mesh of single line segment ways tagged with FIXME, that I last week have combined into longer ways tagged with highway=secondary. This is probably due to the recently broken (and now fixed) daily/hourly diffs. After this week's planet dump is imported (probably today), the hourly diffs should be able to properly keep it up to date as the wiki page states. Karl ___ talk mailing list talk@openstreetmap.org http://lists.openstreetmap.org/cgi-bin/mailman/listinfo/talk
Re: [OSM-talk] osmxapi not updating
On Jan 7, 2008 7:55 AM, Brent Easton [EMAIL PROTECTED] wrote: Hi 80n, Are we still applying hourly diffs to osmxapi? Stuff added 8 hour ago does not seem to moved accross yet. BTW you can tell how old the Osmxapi data is by looking at the first line of the response: osm version=0.5 generator=osmxapi: OSM Extended API osmxapi:uri=/api/0.5/node%5bamenity=hotel osmxapi:planetDate=2008010715 osmxapi:copyright=2007 OpenStreetMap contributors When everything is working fine it should be less than two hours old, as it is now. If it's more than that then there's probably something wrong. 80n Regards, Brent. Brent Easton Analyst/Programmer University of Western Sydney Email: [EMAIL PROTECTED] ___ talk mailing list talk@openstreetmap.org http://lists.openstreetmap.org/cgi-bin/mailman/listinfo/talk ___ talk mailing list talk@openstreetmap.org http://lists.openstreetmap.org/cgi-bin/mailman/listinfo/talk
Re: [OSM-talk] Osmxapi is up
Great - thanks for all the work involved in getting it working again. Hope you had a relaxing vacation. -Jeremy - Original Message - From: 80n To: Talk Openstreetmap Sent: Friday, January 04, 2008 1:33 AM Subject: [OSM-talk] Osmxapi is up After a long seasonal break Osmxapi is now up and running again. The server it was running on (hypercube.telascience.org) lost its disk on 19 December. Which also happened to be the day I went on vacation. When the disk was restored Osmxapi wouldn't restart because it needed a database check. So it stayed down until I returned from vacation. By the time I returned the hourly diff files had been purged up to December 25 meaning Osmxapi would not have changes for the period 19-25 December. So I started a rebuild from planet.osm. Planet is now large enough that it takes several days to do a complete rebuild. However, since Brett had also fixed the UTF-8 bug in the Osmosis hourly diffs it was also worth doing the rebuild to get rid of all those UTF-8 problems that had been introduced. So now we have a fresh clean Osmxapi database with no UTF-8 problems (I hope). Enjoy 80n -- ___ talk mailing list talk@openstreetmap.org http://lists.openstreetmap.org/cgi-bin/mailman/listinfo/talk ___ talk mailing list talk@openstreetmap.org http://lists.openstreetmap.org/cgi-bin/mailman/listinfo/talk
Re: [OSM-talk] OSMXAPI Status?
David There was a disk outage on the Osmxapi server on December 19. Osmxapi did not restart after the disk came back, and I was on vacation so it stayed down until I got back. I got it restarted but then discovered that the hourly diffs for 19-23rd December had already been purged so it couldn't catch up from that source. As there has also been a fix to the UTF-8 problem with hourly diffs I've decided to rebuild from a fresh planet.osm. The rebuild is currently in progress but will probably take another 24-48 hours to complete. 80n On Jan 1, 2008 5:21 AM, David Dean [EMAIL PROTECTED] wrote: Hello everybody, I'm just wondering what is happening with OSMXAPI? The wiki no longer says OSMXAPI is down on the status page, but I am still getting 501 errors when I try and use it. $ wget -O greater-brisbane.osm http://www.informationfreeway.org/api/0.5/*[bbox=152,-28,154,-26]http://www.informationfreeway.org/api/0.5/*%5Bbbox=152,-28,154,-26%5D Warning: wildcards not supported in HTTP. --15:17:59-- http://www.informationfreeway.org/api/0.5/*[bbox=152,-28,154,-26]http://www.informationfreeway.org/api/0.5/*%5Bbbox=152,-28,154,-26%5D = `greater-brisbane.osm' Resolving www.informationfreeway.org... 80.68.90.42 Connecting to www.informationfreeway.org|80.68.90.42|:80... connected. HTTP request sent, awaiting response... 302 Moved Temporarily Location: http://osmxapi.hypercube.telascience.org/api/0.5/*%5bbbox=152,-28,154,-26%5d [following] Warning: wildcards not supported in HTTP. --15:18:03-- http://osmxapi.hypercube.telascience.org/api/0.5/*%5bbbox=152,-28,154,-26%5d = `greater-brisbane.osm' Resolving osmxapi.hypercube.telascience.org... 137.110.119.130 Connecting to osmxapi.hypercube.telascience.org|137.110.119.130|:80... connected. HTTP request sent, awaiting response... 501 Not Implemented 15:18:35 ERROR 501: Not Implemented. - David -- David Dean PhD Research Student, RP-SAIVT, QUT (me) http://www.davidbdean.com (saivt) http://www.bee.qut.edu.au/projects/saivt/ (post) Room S1102, GPO Box 2434, Brisbane, Australia 4001 (p) +61 7 3138 1414 (m) 0407 151 912 (f) +61 7 3138 1516 (CRICOS) 00213J ___ talk mailing list talk@openstreetmap.org http://lists.openstreetmap.org/cgi-bin/mailman/listinfo/talk ___ talk mailing list talk@openstreetmap.org http://lists.openstreetmap.org/cgi-bin/mailman/listinfo/talk
