Re: [OSM-dev] Can SQLite3 handle OSM 150G data file?
Hi, I will post something, but now I'm not at home. So maybe today night. But Dane wrote me about sqlite support in mapnik, so you can try that: Are you aware we have a postgres - sqlite converter in mapnik? https://trac.mapnik.org/browser/trunk/utils/pgsql2sqlite It requires the postgis and sqlite plugins: https://trac.mapnik.org/browser/trunk/plugins/input Just build mapnik with: $ python scons/scons.py INPUT_PLUGINS=all PGSQL2SQLITE=True I have been hand converting the XML, a scripted approach would be cool. Dane - https://trac.mapnik.org/browser/trunk/utils/pgsql2sqliteI don't thing that it is usable for me, because I do not like to convert something many times to get the result. But I do not know about it (I played with it half year ago, so maybe it did not exists yet). Tomas Christoph Eckert napsal(a): Hi, There is no reason to be sqlite slow. How much are you are using transactions on your local db? What are you using for import? I'm importing Czech republic (50Mb bziped) in one or two minutes. So for 5.4GB it takes 108 minutes (two hours). But I'm importig to modified osm schema (something like mapnik schema in postgress). It is because of query speed. sounds cool. Is the Script that does the conversion from osm.xml into sqlite available somewhere? Thanks best regards, ce ___ dev mailing list dev@openstreetmap.org http://lists.openstreetmap.org/listinfo/dev ___ dev mailing list dev@openstreetmap.org http://lists.openstreetmap.org/listinfo/dev
Re: [OSM-dev] Cloudmade routing for OSM rails_port site.
On Mon, Apr 27, 2009 at 12:58 PM, Tom Hughes t...@compton.nu wrote: Chris-Hein Lunkhusen wrote: Марат Хасанов schrieb: http://mkhasanov.sandbox.cloudmade.com/directions (only view and routing tabs works) Hi, is it planned to integrate this on the openstreetmap.org site ? I think it's highly unlikely. Why's that? Tom -- Tom Hughes (t...@compton.nu) http://www.compton.nu/ ___ dev mailing list dev@openstreetmap.org http://lists.openstreetmap.org/listinfo/dev -- -- Nick Black twitter.com/nick_b ___ dev mailing list dev@openstreetmap.org http://lists.openstreetmap.org/listinfo/dev
Re: [OSM-dev] Cloudmade routing for OSM rails_port site.
Nick Black wrote: On Mon, Apr 27, 2009 at 12:58 PM, Tom Hughes t...@compton.nu mailto:t...@compton.nu wrote: Chris-Hein Lunkhusen wrote: Марат Хасанов schrieb: http://mkhasanov.sandbox.cloudmade.com/directions (only view and routing tabs works) Hi, is it planned to integrate this on the openstreetmap.org http://openstreetmap.org site ? I think it's highly unlikely. Why's that? Well there are several reasons which would make me disinclined to integrate it, so I at least would need some persuasion. First up is the general question of whether we want a routing function on the site - it has been said repeatedly in the past that our aim is to provide the data and let other people innovate with it. This sort of things is just another step to making the site a full featured Google Maps clone where doing all the data presentation as well as the production. This is a position which I believe Steve has advocated on a number of occasions in the past. On top of that is the policy question of whether, if we decided we wanted a routing function, we would want that to be based on a closed source service from a commercial organisation. Obviously that is a policy decision for the Foundation but on the face of it I would tend to be opposed. Finally, even if we decided such a closed source commercial service was acceptable there are obviously specific questions when the source of that service is Cloudmade - the risk of such a decision being viewed in an unfavourable light by others when Cloudmade in general, and you and Steve in particular, are so closely linked to the project in general and the Foundation in particular is obviously quite large. Look at it this way - if we integrate this, what do we do when Frederik and Jochen come calling asking us to give their (hypothetical as far as I know) routing service equal space/prominence? At the end of the day, these are policy matters for the Foundation, but as things stand my advice to them would be along the lines described above. Tom -- Tom Hughes (t...@compton.nu) http://www.compton.nu/ ___ dev mailing list dev@openstreetmap.org http://lists.openstreetmap.org/listinfo/dev
Re: [OSM-dev] Can SQLite3 handle OSM 150G data file?
On Tue, 28 Apr 2009 14:30:33 +, Ævar Arnfjörð Bjarmason ava...@gmail.com wrote: From what I can see at http://monetdb.cwi.nl/projects/monetdb/SQL/Documentation/Embedded-Server.html#Embedded-Server the embedded-mode is still a server, just for embedded systems. I was talking about having the database as a library be a part of the program. Nothing to install or to start separately. You could always make your program embed/start the database server regardless of whether it's a library or a server. It would just mean e.g. shipping the postgresql binaries with your program and doing some magic in your program that ensures that the server is started when the program is. And determining what platform's binary to run in the first place (Windows? Linux? Solaris?, Windows Mobile?, ...) including the version of the libc. I thought about what is possible here for a while now and I guess the effort and download-size are not worth it. Marcus ___ dev mailing list dev@openstreetmap.org http://lists.openstreetmap.org/listinfo/dev
Re: [OSM-dev] Cloudmade routing for OSM rails_port site.
Tom Hughes wrote: Sent: 29 April 2009 8:41 AM To: Nick Black Cc: dev@openstreetmap.org; Chris-Hein Lunkhusen Subject: Re: [OSM-dev] Cloudmade routing for OSM rails_port site. Nick Black wrote: On Mon, Apr 27, 2009 at 12:58 PM, Tom Hughes t...@compton.nu mailto:t...@compton.nu wrote: Chris-Hein Lunkhusen wrote: Марат Хасанов schrieb: http://mkhasanov.sandbox.cloudmade.com/directions (only view and routing tabs works) Hi, is it planned to integrate this on the openstreetmap.org http://openstreetmap.org site ? I think it's highly unlikely. Why's that? My personal views inline below Well there are several reasons which would make me disinclined to integrate it, so I at least would need some persuasion. First up is the general question of whether we want a routing function on the site - it has been said repeatedly in the past that our aim is to provide the data and let other people innovate with it. This sort of things is just another step to making the site a full featured Google Maps clone where doing all the data presentation as well as the production. This is a position which I believe Steve has advocated on a number of occasions in the past. Agree with Tom here. OSM is about data collection and storage. Our tools on the main website should be focused on that. I can argue that all the current tools are useful for contribution in some way. Routing is also useful if its configured to help find errors, ie to test if the data is accurate in terms of routing, However this capability would be better integrated into editing software. On top of that is the policy question of whether, if we decided we wanted a routing function, we would want that to be based on a closed source service from a commercial organisation. Obviously that is a policy decision for the Foundation but on the face of it I would tend to be opposed. Again I agree with Tom, I don't see the benefit to OSM of adding close source services. Finally, even if we decided such a closed source commercial service was acceptable there are obviously specific questions when the source of that service is Cloudmade - the risk of such a decision being viewed in an unfavourable light by others when Cloudmade in general, and you and Steve in particular, are so closely linked to the project in general and the Foundation in particular is obviously quite large. Look at it this way - if we integrate this, what do we do when Frederik and Jochen come calling asking us to give their (hypothetical as far as I know) routing service equal space/prominence? Again I agree that as other have suggested if we did want a routing service on the OSM site it should not be restrictive to any one service provider. At the end of the day, these are policy matters for the Foundation, but as things stand my advice to them would be along the lines described above. The Foundation and the OSM contributor base need to debate what meets the current aims of the project and where there are gaps in meeting those aims. We might also debate whether the current aims are appropriate or if the community wants to change them. I'll bring this up at our next OSMF Board meeting. Cheers Andy ___ dev mailing list dev@openstreetmap.org http://lists.openstreetmap.org/listinfo/dev
Re: [OSM-dev] building A openstreetmap server
Sam Mor wrote: I would to comment about I read: is it correct that everyone can build his openstreet map server? if yes , what are the needs of hardwares and softwares? Yes, you can set up your own OSM server -- the software is all open source. See http://wiki.openstreetmap.org/wiki/The_Rails_Port for more information. -- Jonathan (Jonobennett) ___ dev mailing list dev@openstreetmap.org http://lists.openstreetmap.org/listinfo/dev
Re: [OSM-dev] Cloudmade routing for OSM rails_port site.
2009/4/29 Andy Robinson (blackadder-lists) ajrli...@googlemail.com Tom Hughes wrote: Sent: 29 April 2009 8:41 AM To: Nick Black Cc: dev@openstreetmap.org; Chris-Hein Lunkhusen Subject: Re: [OSM-dev] Cloudmade routing for OSM rails_port site. Nick Black wrote: On Mon, Apr 27, 2009 at 12:58 PM, Tom Hughes t...@compton.nu mailto:t...@compton.nu wrote: Chris-Hein Lunkhusen wrote: Марат Хасанов schrieb: http://mkhasanov.sandbox.cloudmade.com/directions (only view and routing tabs works) Hi, is it planned to integrate this on the openstreetmap.org http://openstreetmap.org site ? I think it's highly unlikely. Why's that? My personal views inline below Well there are several reasons which would make me disinclined to integrate it, so I at least would need some persuasion. First up is the general question of whether we want a routing function on the site - it has been said repeatedly in the past that our aim is to provide the data and let other people innovate with it. This sort of things is just another step to making the site a full featured Google Maps clone where doing all the data presentation as well as the production. This is a position which I believe Steve has advocated on a number of occasions in the past. Agree with Tom here. OSM is about data collection and storage.Our tools on the main website should be focused on that. I can argue that all the current tools are useful for contribution in some way. Routing is also useful if its configured to help find errors, ie to test if the data is accurate in terms of routing, However this capability would be better integrated into editing software. Completely agree that this functionality would be best integrated into editing software, but OSM has always taken a one step at a time approach. I see this as the first step toward the editing tools supporting better validation of roads for routing. On top of that is the policy question of whether, if we decided we wanted a routing function, we would want that to be based on a closed source service from a commercial organisation. Obviously that is a policy decision for the Foundation but on the face of it I would tend to be opposed. Again I agree with Tom, I don't see the benefit to OSM of adding close source services. Even if they make the map better and make life better for mappers? What is the real difference between using a GPS unit with closed source software and using third party web services that are closed source to enhance core OSM software? Finally, even if we decided such a closed source commercial service was acceptable there are obviously specific questions when the source of that service is Cloudmade - the risk of such a decision being viewed in an unfavourable light by others when Cloudmade in general, and you and Steve in particular, are so closely linked to the project in general and the Foundation in particular is obviously quite large. Look at it this way - if we integrate this, what do we do when Frederik and Jochen come calling asking us to give their (hypothetical as far as I know) routing service equal space/prominence? Again I agree that as other have suggested if we did want a routing service on the OSM site it should not be restrictive to any one service provider. Again - definitely agree with this on the grounds that creating competition within third party developers will lead to better apps for OSM. At the end of the day, these are policy matters for the Foundation, but as things stand my advice to them would be along the lines described above. The Foundation and the OSM contributor base need to debate what meets the current aims of the project and where there are gaps in meeting those aims. We might also debate whether the current aims are appropriate or if the community wants to change them. I'll bring this up at our next OSMF Board meeting. It could be a good idea to get input from the community on their appreciation of the aims of OSM to help with this. We should also go far wider than the small section of the community who are on the mailing list to make sure we're getting a true feel for people's opinions. Cheers Andy -- -- Nick Black twitter.com/nick_b ___ dev mailing list dev@openstreetmap.org http://lists.openstreetmap.org/listinfo/dev
Re: [OSM-dev] Can SQLite3 handle OSM 150G data file?
On Wed, Apr 29, 2009 at 8:41 AM, marcus.wolsc...@googlemail.com wrote: On Tue, 28 Apr 2009 14:30:33 +, Ævar Arnfjörð Bjarmason ava...@gmail.com wrote: From what I can see at http://monetdb.cwi.nl/projects/monetdb/SQL/Documentation/Embedded-Server.html#Embedded-Server the embedded-mode is still a server, just for embedded systems. I was talking about having the database as a library be a part of the program. Nothing to install or to start separately. You could always make your program embed/start the database server regardless of whether it's a library or a server. It would just mean e.g. shipping the postgresql binaries with your program and doing some magic in your program that ensures that the server is started when the program is. And determining what platform's binary to run in the first place (Windows? Linux? Solaris?, Windows Mobile?, ...) including the version of the libc. I thought about what is possible here for a while now and I guess the effort and download-size are not worth it. You'd build postrgresql with the compilation flags you'd use for your program: Problem solved. Any embedded database like sqlite would have to talk to libc too, and so (presumably) would your main program. ___ dev mailing list dev@openstreetmap.org http://lists.openstreetmap.org/listinfo/dev
Re: [OSM-dev] Cloudmade routing for OSM rails_port site.
I've had quite a few off-list emails from different people asking for more details about this service, so I want to clarify a few things. In December 2008 the OSM-F Board discussed an offer from CloudMade to use their routing and geocoding services on the OSM site, free of charge. We discussed this as a Board and unanimously agreed that any third party services to be used on OSM.org should be offered to the community to make a decision about. The current sandbox implementation and patch is just that - a working demonstration of a service that the community is able to accept and have integrated onto the OSM site, reject or make changes to. There is nothing stopping anyone taking the UI that has been offered and tying that into any other routing service. Cheers, 2009/4/29 Nick Black nickbla...@gmail.com 2009/4/29 Andy Robinson (blackadder-lists) ajrli...@googlemail.com Tom Hughes wrote: Sent: 29 April 2009 8:41 AM To: Nick Black Cc: dev@openstreetmap.org; Chris-Hein Lunkhusen Subject: Re: [OSM-dev] Cloudmade routing for OSM rails_port site. Nick Black wrote: On Mon, Apr 27, 2009 at 12:58 PM, Tom Hughes t...@compton.nu mailto:t...@compton.nu wrote: Chris-Hein Lunkhusen wrote: Марат Хасанов schrieb: http://mkhasanov.sandbox.cloudmade.com/directions (only view and routing tabs works) Hi, is it planned to integrate this on the openstreetmap.org http://openstreetmap.org site ? I think it's highly unlikely. Why's that? My personal views inline below Well there are several reasons which would make me disinclined to integrate it, so I at least would need some persuasion. First up is the general question of whether we want a routing function on the site - it has been said repeatedly in the past that our aim is to provide the data and let other people innovate with it. This sort of things is just another step to making the site a full featured Google Maps clone where doing all the data presentation as well as the production. This is a position which I believe Steve has advocated on a number of occasions in the past. Agree with Tom here. OSM is about data collection and storage.Our tools on the main website should be focused on that. I can argue that all the current tools are useful for contribution in some way. Routing is also useful if its configured to help find errors, ie to test if the data is accurate in terms of routing, However this capability would be better integrated into editing software. Completely agree that this functionality would be best integrated into editing software, but OSM has always taken a one step at a time approach. I see this as the first step toward the editing tools supporting better validation of roads for routing. On top of that is the policy question of whether, if we decided we wanted a routing function, we would want that to be based on a closed source service from a commercial organisation. Obviously that is a policy decision for the Foundation but on the face of it I would tend to be opposed. Again I agree with Tom, I don't see the benefit to OSM of adding close source services. Even if they make the map better and make life better for mappers? What is the real difference between using a GPS unit with closed source software and using third party web services that are closed source to enhance core OSM software? Finally, even if we decided such a closed source commercial service was acceptable there are obviously specific questions when the source of that service is Cloudmade - the risk of such a decision being viewed in an unfavourable light by others when Cloudmade in general, and you and Steve in particular, are so closely linked to the project in general and the Foundation in particular is obviously quite large. Look at it this way - if we integrate this, what do we do when Frederik and Jochen come calling asking us to give their (hypothetical as far as I know) routing service equal space/prominence? Again I agree that as other have suggested if we did want a routing service on the OSM site it should not be restrictive to any one service provider. Again - definitely agree with this on the grounds that creating competition within third party developers will lead to better apps for OSM. At the end of the day, these are policy matters for the Foundation, but as things stand my advice to them would be along the lines described above. The Foundation and the OSM contributor base need to debate what meets the current aims of the project and where there are gaps in meeting those aims. We might also debate whether the current aims are appropriate or if the community wants to change them. I'll bring this up at our next OSMF Board meeting. It could be a good idea to get input from the community on their appreciation of the aims of OSM to help with this. We should also go
Re: [OSM-dev] Cloudmade routing for OSM rails_port site.
Nick Black wrote: To your point about integrating other people's services, I think its clear. Whatever the best service available is should be used. Best is in the eye of the beholder. Subject to minimum quality standards (no long outages, results not completely bogus) and a common API, we should let the user choose between available services. I could in theory code a routing service that was better than CM's for validating the type of mapping I tend to do (i.e. long cycle routes) but less useful for housing estates. It's exactly the same as with the map layers. I think (awaits flames) that Steve Chilton's Mapnik layer is the best OSM cartography there is at present, and if you apply commonly-accepted cartographic standards than that's probably not just opinion, it's objective truth. But we don't refuse to offer other layers (e.g. Osmarender) because this is the single best; we have the OL layer chooser. In fact, offering a routing chooser might even encourage the development of more routing applications, and that has to be good. cheers Richard -- View this message in context: http://www.nabble.com/Cloudmade-routing-for-OSM-rails_port-site.-tp23251791p23294656.html Sent from the OpenStreetMap - Dev mailing list archive at Nabble.com. ___ dev mailing list dev@openstreetmap.org http://lists.openstreetmap.org/listinfo/dev
Re: [OSM-dev] Cloudmade routing for OSM rails_port site.
2009/4/29 Richard Fairhurst rich...@systemed.net: Nick Black wrote: To your point about integrating other people's services, I think its clear. Whatever the best service available is should be used. Best is in the eye of the beholder. Subject to minimum quality standards (no long outages, results not completely bogus) and a common API, we should let the user choose between available services. I could in theory code a routing service that was better than CM's for validating the type of mapping I tend to do (i.e. long cycle routes) but less useful for housing estates. It's exactly the same as with the map layers. I think (awaits flames) that Steve Chilton's Mapnik layer is the best OSM cartography there is at present, and if you apply commonly-accepted cartographic standards than that's probably not just opinion, it's objective truth. Doesn't have contour lines though does it? I know what the best layer _really_ is :-) Dave ___ dev mailing list dev@openstreetmap.org http://lists.openstreetmap.org/listinfo/dev
Re: [OSM-dev] Cloudmade routing for OSM rails_port site.
Hi, Nick Black wrote: The pragmatic argument would be to use routing generated from non-open source server software along side other open source alternatives and let the user base choose which best meets their needs. *If* our user base thinks that routing is a need they want met by the OpenStreetMap site, which is something that should be discussed. Personally I think that routing has good value for OSM debugging, but we would not put routing on our front page for that; instead we would have a special routing application for mappers that can use several routing services and allows users to record problems they found. Definitely a worthy tool to develop but nothing for the main page. The main page is not a tool for mappers, it is more of a showcase, and the question remains whether we want to showcase third-party services through it. I don't totally follow the argument about this specific example being more risky because its provided by CloudMade because a lot of people who work for CloudMade are deeply involved with OSM. Again, we need to take a pragmatic standpoint and figure out what's more important for OSM. I think there is no problem as long as the CloudMade services we use are balanced by other free and non-free solutions offered at the same time, with no special selection or preference expressed for the CloudMade services (as in select one from the following 5 routing services). Bye Frederik ___ dev mailing list dev@openstreetmap.org http://lists.openstreetmap.org/listinfo/dev
Re: [OSM-dev] Cloudmade routing for OSM rails_port site.
Dave Stubbs wrote: Doesn't have contour lines though does it? I know what the best layer _really_ is :-) Heh. But you're absolutely right and that's the point; one man's best is not necessarily any use at all for someone else. cheers Richard -- View this message in context: http://www.nabble.com/Cloudmade-routing-for-OSM-rails_port-site.-tp23251791p23294890.html Sent from the OpenStreetMap - Dev mailing list archive at Nabble.com. ___ dev mailing list dev@openstreetmap.org http://lists.openstreetmap.org/listinfo/dev
Re: [OSM-dev] Can SQLite3 handle OSM 150G data file?
On Wed, 29 Apr 2009 10:18:55 +, Ævar Arnfjörð Bjarmason ava...@gmail.com wrote: You'd build postrgresql with the compilation flags you'd use for your program: Problem solved. My program is not compiled. It's java. Any embedded database like sqlite would have to talk to libc too, and so (presumably) would your main program. Marcus ___ dev mailing list dev@openstreetmap.org http://lists.openstreetmap.org/listinfo/dev
[OSM-dev] java.lang.NumberFormatException: null error with osmosis 0.30.3
I'm trying to import v0.6 osm files with osmosis 0.30.3, and I get this error: SEVERE: Thread for task 1-read-xml failed java.lang.NumberFormatException: null at java.lang.Integer.parseInt(Integer.java:415) at java.lang.Integer.parseInt(Integer.java:497) at org.openstreetmap.osmosis.core.xml.v0_6.impl.NodeElementProcessor.begin(NodeElementProcessor.java:67) at org.openstreetmap.osmosis.core.xml.v0_6.impl.OsmHandler.startElement(OsmHandler.java:91) at com.sun.org.apache.xerces.internal.parsers.AbstractSAXParser.startElement(AbstractSAXParser.java:501) at com.sun.org.apache.xerces.internal.impl.XMLDocumentFragmentScannerImpl.scanStartElement(XMLDocumentFragmentScannerImpl.java:1359) at com.sun.org.apache.xerces.internal.impl.XMLDocumentFragmentScannerImpl$FragmentContentDriver.next(XMLDocumentFragmentScannerImpl.java:2747) at com.sun.org.apache.xerces.internal.impl.XMLDocumentScannerImpl.next(XMLDocumentScannerImpl.java:648) at com.sun.org.apache.xerces.internal.impl.XMLDocumentFragmentScannerImpl.scanDocument(XMLDocumentFragmentScannerImpl.java:510) at com.sun.org.apache.xerces.internal.parsers.XML11Configuration.parse(XML11Configuration.java:807) at com.sun.org.apache.xerces.internal.parsers.XML11Configuration.parse(XML11Configuration.java:737) at com.sun.org.apache.xerces.internal.parsers.XMLParser.parse(XMLParser.java:107) at com.sun.org.apache.xerces.internal.parsers.AbstractSAXParser.parse(AbstractSAXParser.java:1205) at com.sun.org.apache.xerces.internal.jaxp.SAXParserImpl$JAXPSAXParser.parse(SAXParserImpl.java:522) at javax.xml.parsers.SAXParser.parse(SAXParser.java:395) at javax.xml.parsers.SAXParser.parse(SAXParser.java:198) at org.openstreetmap.osmosis.core.xml.v0_6.XmlReader.run(XmlReader.java:108) at java.lang.Thread.run(Thread.java:619) Apr 29, 2009 3:28:18 PM org.openstreetmap.osmosis.core.Osmosis main SEVERE: Execution aborted. org.openstreetmap.osmosis.core.OsmosisRuntimeException: One or more tasks failed. at org.openstreetmap.osmosis.core.pipeline.common.Pipeline.waitForCompletion(Pipeline.java:146) at org.openstreetmap.osmosis.core.Osmosis.run(Osmosis.java:85) at org.openstreetmap.osmosis.core.Osmosis.main(Osmosis.java:30) Sample file that I try to import is this: ?xml version='1.0' standalone='no'? osm version='0.6' generator='xapi: OSM Extended API 2.0' mlns:xapi='http://www.informationfreeway.org/xapi/0.6' xapi:uri='/api/0.6/node[amenity=atm][bbox=3.4,50.7,7.2,53.6]' api:planetDate='200904241825' xapi:copyright='2009 OpenStreetMap contributors' xapi:instance='zappyHyper' node id='30839681' lat='52.6035219' lon='4.687596' user='Maarten Deen'xapi:users='florisje,Maarten Deen' timestamp='2009-03-01T11:48:12Z' tag k='addr:city' v='Heiloo'/ tag k='addr:country' v='NL'/ tag k='addr:housenumber' v='10-12'/ tag k='addr:postcode' v='1852KX'/ tag k='addr:street' v='Het Hoekstuk'/ tag k='amenity' v='atm'/ tag k='name' v='ABN AMRO'/ /node /osm Any idea what is going wrong here? The same error pops up with 0.30. Regards, Maarten ___ dev mailing list dev@openstreetmap.org http://lists.openstreetmap.org/listinfo/dev
Re: [OSM-dev] java.lang.NumberFormatException: null error with osmosis 0.30.3
On Wed, Apr 29, 2009 at 6:32 AM, Maarten Deen md...@xs4all.nl wrote: I'm trying to import v0.6 osm files with osmosis 0.30.3, and I get this error: SEVERE: Thread for task 1-read-xml failed java.lang.NumberFormatException: null at java.lang.Integer.parseInt(Integer.java:415) at java.lang.Integer.parseInt(Integer.java:497) at org.openstreetmap.osmosis.core.xml.v0_6.impl.NodeElementProcessor.begin(NodeElementProcessor.java:67) at org.openstreetmap.osmosis.core.xml.v0_6.impl.OsmHandler.startElement(OsmHandler.java:91) at com.sun.org.apache.xerces.internal.parsers.AbstractSAXParser.startElement(AbstractSAXParser.java:501) at com.sun.org.apache.xerces.internal.impl.XMLDocumentFragmentScannerImpl.scanStartElement(XMLDocumentFragmentScannerImpl.java:1359) at com.sun.org.apache.xerces.internal.impl.XMLDocumentFragmentScannerImpl$FragmentContentDriver.next(XMLDocumentFragmentScannerImpl.java:2747) at com.sun.org.apache.xerces.internal.impl.XMLDocumentScannerImpl.next(XMLDocumentScannerImpl.java:648) at com.sun.org.apache.xerces.internal.impl.XMLDocumentFragmentScannerImpl.scanDocument(XMLDocumentFragmentScannerImpl.java:510) at com.sun.org.apache.xerces.internal.parsers.XML11Configuration.parse(XML11Configuration.java:807) at com.sun.org.apache.xerces.internal.parsers.XML11Configuration.parse(XML11Configuration.java:737) at com.sun.org.apache.xerces.internal.parsers.XMLParser.parse(XMLParser.java:107) at com.sun.org.apache.xerces.internal.parsers.AbstractSAXParser.parse(AbstractSAXParser.java:1205) at com.sun.org.apache.xerces.internal.jaxp.SAXParserImpl$JAXPSAXParser.parse(SAXParserImpl.java:522) at javax.xml.parsers.SAXParser.parse(SAXParser.java:395) at javax.xml.parsers.SAXParser.parse(SAXParser.java:198) at org.openstreetmap.osmosis.core.xml.v0_6.XmlReader.run(XmlReader.java:108) at java.lang.Thread.run(Thread.java:619) Apr 29, 2009 3:28:18 PM org.openstreetmap.osmosis.core.Osmosis main SEVERE: Execution aborted. org.openstreetmap.osmosis.core.OsmosisRuntimeException: One or more tasks failed. at org.openstreetmap.osmosis.core.pipeline.common.Pipeline.waitForCompletion(Pipeline.java:146) at org.openstreetmap.osmosis.core.Osmosis.run(Osmosis.java:85) at org.openstreetmap.osmosis.core.Osmosis.main(Osmosis.java:30) Sample file that I try to import is this: ?xml version='1.0' standalone='no'? osm version='0.6' generator='xapi: OSM Extended API 2.0' mlns:xapi='http://www.informationfreeway.org/xapi/0.6' xapi:uri='/api/0.6/node[amenity=atm][bbox=3.4,50.7,7.2,53.6]' api:planetDate='200904241825' xapi:copyright='2009 OpenStreetMap contributors' xapi:instance='zappyHyper' node id='30839681' lat='52.6035219' lon='4.687596' user='Maarten Deen'xapi:users='florisje,Maarten Deen' timestamp='2009-03-01T11:48:12Z' tag k='addr:city' v='Heiloo'/ tag k='addr:country' v='NL'/ tag k='addr:housenumber' v='10-12'/ tag k='addr:postcode' v='1852KX'/ tag k='addr:street' v='Het Hoekstuk'/ tag k='amenity' v='atm'/ tag k='name' v='ABN AMRO'/ /node /osm Any idea what is going wrong here? The same error pops up with 0.30. Regards, Maarten Looks like your node element is missing the required (for 0.6 files) version attribute. Karl ___ dev mailing list dev@openstreetmap.org http://lists.openstreetmap.org/listinfo/dev
Re: [OSM-dev] building A openstreetmap server
El Miércoles, 29 de Abril de 2009, Sam Mor escribió: I would to comment about I read: is it correct that everyone can build his openstreet map server? if yes , what are the needs of hardwares and softwares? On the hardware side, a 2-year-old single-core computer with 300 Gb of free disk space will be able to process a planet in maybe 12 hours. You'll have to pump up the hardware if you plan to support lots of concurrent users. On the software side, everything is in the SVN repository (besides PostgreSQL and Ruby, which are widely available). -- -- Iván Sánchez Ortega i...@sanchezortega.es You will probably marry after a very brief courtship. signature.asc Description: This is a digitally signed message part. ___ dev mailing list dev@openstreetmap.org http://lists.openstreetmap.org/listinfo/dev
Re: [OSM-dev] java.lang.NumberFormatException: null error with osmosis 0.30.3
Karl Newman wrote: On Wed, Apr 29, 2009 at 6:32 AM, Maarten Deen md...@xs4all.nl mailto:md...@xs4all.nl wrote: Sample file that I try to import is this: ?xml version='1.0' standalone='no'? osm version='0.6' generator='xapi: OSM Extended API 2.0' mlns:xapi='http://www.informationfreeway.org/xapi/0.6' xapi:uri='/api/0.6/node[amenity=atm][bbox=3.4,50.7,7.2,53.6]' api:planetDate='200904241825' xapi:copyright='2009 OpenStreetMap contributors' xapi:instance='zappyHyper' node id='30839681' lat='52.6035219' lon='4.687596' user='Maarten Deen'xapi:users='florisje,Maarten Deen' timestamp='2009-03-01T11:48:12Z' tag k='addr:city' v='Heiloo'/ tag k='addr:country' v='NL'/ tag k='addr:housenumber' v='10-12'/ tag k='addr:postcode' v='1852KX'/ tag k='addr:street' v='Het Hoekstuk'/ tag k='amenity' v='atm'/ tag k='name' v='ABN AMRO'/ /node /osm Any idea what is going wrong here? The same error pops up with 0.30. Looks like your node element is missing the required (for 0.6 files) version attribute. Ok. I downloaded the node from the api and I see the difference. I got this from one of the xapi servers. Guess they're not yet fully 0.6 compliant then. Or is there a way of getting osmosis to disregard the fact that there is no version attribute? Regards, Maarten ___ dev mailing list dev@openstreetmap.org http://lists.openstreetmap.org/listinfo/dev
Re: [OSM-dev] java.lang.NumberFormatException: null error with osmosis 0.30.3
On Wed, Apr 29, 2009 at 9:54 AM, Maarten Deen md...@xs4all.nl wrote: Karl Newman wrote: On Wed, Apr 29, 2009 at 6:32 AM, Maarten Deen md...@xs4all.nl mailto:md...@xs4all.nl wrote: Sample file that I try to import is this: ?xml version='1.0' standalone='no'? osm version='0.6' generator='xapi: OSM Extended API 2.0' mlns:xapi='http://www.informationfreeway.org/xapi/0.6' xapi:uri='/api/0.6/node[amenity=atm][bbox=3.4,50.7,7.2,53.6]' api:planetDate='200904241825' xapi:copyright='2009 OpenStreetMap contributors' xapi:instance='zappyHyper' node id='30839681' lat='52.6035219' lon='4.687596' user='Maarten Deen'xapi:users='florisje,Maarten Deen' timestamp='2009-03-01T11:48:12Z' tag k='addr:city' v='Heiloo'/ tag k='addr:country' v='NL'/ tag k='addr:housenumber' v='10-12'/ tag k='addr:postcode' v='1852KX'/ tag k='addr:street' v='Het Hoekstuk'/ tag k='amenity' v='atm'/ tag k='name' v='ABN AMRO'/ /node /osm Any idea what is going wrong here? The same error pops up with 0.30. Looks like your node element is missing the required (for 0.6 files) version attribute. Ok. I downloaded the node from the api and I see the difference. I got this from one of the xapi servers. Guess they're not yet fully 0.6 compliant then. Or is there a way of getting osmosis to disregard the fact that there is no version attribute? Regards, Maarten Well, I know there's currently no way to make Osmosis ignore a missing version attribute, but it's certainly possible to program that functionality as an option. It could just create a synthetic version number (0?) for use in the rest of the pipeline. This would likely prevent it from being uploaded (without further manipulation, anyway). I'll leave it to others to debate the wisdom of providing such an option for non-compliant files, though. Karl ___ dev mailing list dev@openstreetmap.org http://lists.openstreetmap.org/listinfo/dev
Re: [OSM-dev] java.lang.NumberFormatException: null error with osmosis 0.30.3
Karl Newman wrote: On Wed, Apr 29, 2009 at 9:54 AM, Maarten Deen md...@xs4all.nl mailto:md...@xs4all.nl wrote: Ok. I downloaded the node from the api and I see the difference. I got this from one of the xapi servers. Guess they're not yet fully 0.6 compliant then. Or is there a way of getting osmosis to disregard the fact that there is no version attribute? Regards, Maarten Well, I know there's currently no way to make Osmosis ignore a missing version attribute, but it's certainly possible to program that functionality as an option. It could just create a synthetic version number (0?) for use in the rest of the pipeline. This would likely prevent it from being uploaded (without further manipulation, anyway). I'll leave it to others to debate the wisdom of providing such an option for non-compliant files, though. I've found that osmosis will still read a (xapi) 0.6 file in 0.5 mode. It does complain that the version number does not match, but it reads it fine. So no workaround necessary. Regards, Maarten ___ dev mailing list dev@openstreetmap.org http://lists.openstreetmap.org/listinfo/dev
Re: [OSM-dev] Slippy Map Elevation Overlay
Ah yes - I was lazy and didn't render all zoom levels - I only did a couple to see what it looked like. The blockiness goes away if you render the rest. The problem I had though was that some of the tiles appear half transparent like I intended, and sometimes they look like pretty solid colour that obscures other map features. It's almost as though OpenLayers is displaying the lower zoom level tiles as well as the top one. I've never looked at WorldWind - I might have a quick look this evening. Graham. 2009/4/29 MilesTogoe miles.to...@gmail.com Graham Jones (Physics) wrote: I sometimes think that the main slippy map has a bit too much plain white, especially in undeveloped places where there are not many roads such as the Pennines or North Yorkshire Moors in Northern England - I keep wondering if this is an un-mapped area, or if there is nothing there The cycle map is very good with shaded elevation contours, but the main osmarender and mapnik maps do not include this. I would like this sort of shading to be available for the main map too, but I am not convinced that rendering it into the tiles is good, because sometimes those extra colours or contour lines are a distraction, so it would be nice for the user to be able to switch them off. I wondered if there is any reason why we could not create an overlay of elevation information (contours and or shading) that could sit on top of the main map as a user selectable leayer? I have had a quick go at http://maps.webhop.net/srtm.html. It sort of works - the high ground stands out, and you can see the shape of the ground, and you can switch the overlay off and on. It does not work that well as an overlay though because it is not really transparent enough. I find that sometimes the transparency works quite well and you can see the map underneath, and others it is practically opaque. pretty nice, though when zoomed in, it gets blocky - maybe this is actually how the parcel boundaries are, maybe you where just trying to get stuff prototyped.I keep thinking it would be nice to integrate OSM data with free satellite data like java based WorldWind NASA data as the background - haven't really researched this yet. -- Dr. Graham Jones Hartlepool, UK email: grahamjones...@gmail.com ___ dev mailing list dev@openstreetmap.org http://lists.openstreetmap.org/listinfo/dev
Re: [OSM-dev] Cloudmade routing for OSM rails_port site.
2009/4/29 Frederik Ramm frede...@remote.org: *If* our user base thinks that routing is a need they want met by the OpenStreetMap site, which is something that should be discussed. There's another angle to consider here - we don't just need to cater for our existing user-base (who are probably quite a resourceful bunch). One of the reasons we have a site with a slippy map on it is that it demonstrates to those unfamiliar to the project what OpenStreetMap is capable of. That our slippy map closely resembles those of Google, Yahoo and others helps to get around any scepticism that might arise. This is why it is, IMHO, important that the map be draggable rather than click-the-edge-to-pan-and-reload. AJAX-powered maps are considered a baseline user requirement. Clearly every potential user of OSM is different, but for me, a key benefit when I discovered the project what hey, vector data, that can be used for routing!. If we think that others discovering the project would thing likewise then a prominent path from project home page to a routing engine (and I really couldn't care less whose) would be a Good Thing. As long as it works acceptably well, of course... Dermot -- -- Iren sind menschlich ___ dev mailing list dev@openstreetmap.org http://lists.openstreetmap.org/listinfo/dev
Re: [OSM-dev] Cloudmade routing for OSM rails_port site.
Hi, Dermot McNally wrote: Clearly every potential user of OSM is different, but for me, a key benefit when I discovered the project what hey, vector data, that can be used for routing!. If we think that others discovering the project would thing likewise then a prominent path from project home page to a routing engine (and I really couldn't care less whose) would be a Good Thing. As long as it works acceptably well, of course... But isn't this angle one where the open/closed distinction gains weight again? Currently, you can (and I've done this a number of times) tell potential OSM users: Everything on openstreetmap.org is free software and free data - you can build the exact same site for yourself with all its functionality from our database and our svn *). With non-free routing or geocoding services that would stop. Bye Frederik *) And add in fine print if you're willing to devote a few man-months to get to grips with the finer details of Ruby, PHP, Python, PostGIS, Mapnik and others -- Frederik Ramm ## eMail frede...@remote.org ## N49°00'09 E008°23'33 ___ dev mailing list dev@openstreetmap.org http://lists.openstreetmap.org/listinfo/dev
Re: [OSM-dev] Cloudmade routing for OSM rails_port site.
2009/4/29 Frederik Ramm frede...@remote.org: But isn't this angle one where the open/closed distinction gains weight again? Currently, you can (and I've done this a number of times) tell potential OSM users: Everything on openstreetmap.org is free software and free data - you can build the exact same site for yourself with all its functionality from our database and our svn *). With non-free routing or geocoding services that would stop. Actually yes, I think I overstated my lack of caring where the routing comes from - let me restate my priorities thus: 1. That we should have at least one routing engine to show that our data will support that. 2. That we should have a selection of routing tools to demonstrate that the data are engine-agnostic. 3. That a good proportion of the engines we show off be sufficiently open to allow users to play with them or deploy them for their own needs. 4. That our headline routing engine be open. That is, whereas I have a preference for an open solution, so that people get used to the idea that such problems can be solved using open software, I personally wouldn't insist on it if (as I believe) we are selling ourselves short without any on-site visibility of routing tools. However, I can understand that others would put my priority 4 right up the top of the list. Dermot -- -- Iren sind menschlich ___ dev mailing list dev@openstreetmap.org http://lists.openstreetmap.org/listinfo/dev
Re: [OSM-dev] Cloudmade routing for OSM rails_port site.
On Wed, Apr 29, 2009 at 11:53 PM, Dermot McNally derm...@gmail.com wrote: 2009/4/29 Frederik Ramm frede...@remote.org: But isn't this angle one where the open/closed distinction gains weight again? Currently, you can (and I've done this a number of times) tell potential OSM users: Everything on openstreetmap.org is free software and free data - you can build the exact same site for yourself with all its functionality from our database and our svn *). With non-free routing or geocoding services that would stop. Actually yes, I think I overstated my lack of caring where the routing comes from - let me restate my priorities thus: 1. That we should have at least one routing engine to show that our data will support that. 2. That we should have a selection of routing tools to demonstrate that the data are engine-agnostic. 3. That a good proportion of the engines we show off be sufficiently open to allow users to play with them or deploy them for their own needs. 4. That our headline routing engine be open. That is, whereas I have a preference for an open solution, so that people get used to the idea that such problems can be solved using open software, I personally wouldn't insist on it if (as I believe) we are selling ourselves short without any on-site visibility of routing tools. I totally agree. +1 From me. ___ dev mailing list dev@openstreetmap.org http://lists.openstreetmap.org/listinfo/dev
[OSM-dev] mapnik rendering last step
Hi Guys, In the final step of tutorial u...@pc1:~$ cd mapnik u...@pc!:~/mapnik$ source set-mapnik-env nothing happen on the screen Then ./customize-mapnik-map $MAPNIK_MAP_FILE again nothing happen on the screen sudo ./customize-mapnik-map $MAPNIK_MAP_FILE then the screen displays: Use of uninitialized value $ENV{MAPNIK_DBPORT} in string eq at ./customize-mapnik-map line 34, IN line 7008. Use of uninitialized value $ENV{MAPNIK_DBUSER} in string eq at ./customize-mapnik-map line 17, IN line 7009. Use of uninitialized value $ENV{MAPNIK_DBPASS} in string eq at ./customize-mapnik-map line 23, IN line 7009. Use of uninitialized value $ENV{MAPNIK_DBHOST} in string eq at ./customize-mapnik-map line 29, IN line 7009. Use of uninitialized value $ENV{MAPNIK_DBPORT} in string eq at ./customize-mapnik-map line 34, IN line 7009. Use of uninitialized value $ENV{MAPNIK_DBUSER} in string eq at ./customize-mapnik-map line 17, IN line 7010. Use of uninitialized value $ENV{MAPNIK_DBPASS} in string eq at ./customize-mapnik-map line 23, IN line 7010. Use of uninitialized value $ENV{MAPNIK_DBHOST} in string eq at ./customize-mapnik-map line 29, IN line 7010. Use of uninitialized value $ENV{MAPNIK_DBPORT} in string eq at ./customize-mapnik-map line 34, IN line 7010. Use of uninitialized value $ENV{MAPNIK_DBUSER} in string eq at ./customize-mapnik-map line 17, IN line 7011. Use of uninitialized value $ENV{MAPNIK_DBPASS} in string eq at ./customize-mapnik-map line 23, IN line 7011. Use of uninitialized value $ENV{MAPNIK_DBHOST} in string eq at ./customize-mapnik-map line 29, IN line 7011. Use of uninitialized value $ENV{MAPNIK_DBPORT} in string eq at ./customize-mapnik-map line 34, IN line 7011. Use of uninitialized value $ENV{MAPNIK_DBUSER} in string eq at ./customize-mapnik-map line 17, IN line 7012. Use of uninitialized value $ENV{MAPNIK_DBPASS} in string eq at ./customize-mapnik-map line 23, IN line 7012. Use of uninitialized value $ENV{MAPNIK_DBHOST} in string eq at ./customize-mapnik-map line 29, IN line 7012. Use of uninitialized value $ENV{MAPNIK_DBPORT} in string eq at ./customize-mapnik-map line 34, IN line 7012. Use of uninitialized value $ENV{MAPNIK_DBUSER} in string eq at ./customize-mapnik-map line 17, IN line 7013. Use of uninitialized value $ENV{MAPNIK_DBPASS} in string eq at ./customize-mapnik-map line 23, IN line 7013. Use of uninitialized value $ENV{MAPNIK_DBHOST} in string eq at ./customize-mapnik-map line 29, IN line 7013. Use of uninitialized value $ENV{MAPNIK_DBPORT} in string eq at ./customize-mapnik-map line 34, IN line 7013. …. … Finally I tried ( maybe doesn’t have any sense ): u...@pc1:~/mapnik$ ./z0_generate_tile1s.py ./z0_generate_tile1s.py: line 1: /user/bin/python: No such file or directory from: can't read /var/mail/math from: can't read /var/mail/subprocess ./z0_generate_tile1s.py: line 6: DEG_TO_RAD: command not found ./z0_generate_tile1s.py: line 7: RAD_TO_DEG: command not found ./z0_generate_tile1s.py: line 9: syntax error near unexpected token `(' ./z0_generate_tile1s.py: line 9: `def minmax (a,b,c):' Any suggestions ___ dev mailing list dev@openstreetmap.org http://lists.openstreetmap.org/listinfo/dev
Re: [josm-dev] Deletion conflicts
On Mon, Apr 27, 2009 at 9:51 PM, Frederik Ramm frede...@remote.org wrote: (Incidentally - how can a node have only one version and this is deleted? Would one not have to first create the node, making v1, then delete it, making v2?) ah, yes, but previous versions of the API were non-transactional, so (in theory) what happened is that the node was originally uploaded, but failed to enter the history table and existed only in current. it was then deleted, which made an entry in the history table and overwrote the current table. when the 0.6 migration ran it saw only one revision in the history table, so assigned it version 1, since previously nodes only had timestamps, not version numbers. On Tue, Apr 28, 2009 at 10:43 AM, Marko Mäkelä marko.mak...@iki.fi wrote: I think that the revision-per-tree approach of Subversion makes much more sense than the revision-per-file approach of CVS and RCS. The Subversion model could be impractical for OSM, though. There are so many objects being edited concurrently, all over the world. While someone is working on a small local change, the global revision count could easily grow by hundreds or thousands. there was discussion about having unique (per-upload / other transaction) version numbers global across all element types at the 0.6 hack weekend, but i can't remember why it wasn't popular. How do distributed revision control systems solve this problem? each element would have a unique version (allocated randomly, or based on user/timestamp/id, etc...) and a set of parent-versions. upon download the client would get all the versions of a particular id which aren't referenced by a parent-version. this doesn't solve conflicts in the same way as DVCS doesn't - it just makes it someone else's problem to do the merge later. (or, in the parlance of DVCS: branches are cheap!) cheers, matt ___ josm-dev mailing list josm-dev@openstreetmap.org http://lists.openstreetmap.org/listinfo/josm-dev