[OSM-dev] imposm.parser - New Python library for OSM XML and PBF files
Hi everyone, I'm pleased to announce the first open source release of our OpenStreetMap parser. It is a simple to use Python library that parses XML and PBF files. It uses C extensions for performance critical parts and automatically distributes the parsing across multiple CPUs/cores (for PBF and XML!). It is released under the Apache Software License 2.0. Package: http://pypi.python.org/pypi/imposm.parser Documentation: http://dev.omniscale.net/imposm.parser/ Source code: https://bitbucket.org/olt/imposm.parser/src As the name already suggests, imposm.parser is only a sub-package of a larger project: Imposm. It is an importer for OSM data that we are going to release in a couple of weeks. Regards, Oliver -- Oliver Tonnhofer| Omniscale GmbH Co KG| http://omniscale.de http://mapproxy.org | https://bitbucket.org/olt ___ dev mailing list dev@openstreetmap.org http://lists.openstreetmap.org/listinfo/dev
[OSM-dev] Saparate layer for imports?
What do you think about setting up separate layer for data imports? The Imports Layer would hold 3rd party data so it could be manually carefully reviewed and copied (using copy-paste or tracing) to the main database. The principle similar to GPS traces, but with structured, fully prepared (tagged, topologically cleaned, relationificated etc) vector data. Advantages: - reduces surprises from bad imports - better sharing and using good reference data without actual import - it would be possible to do some services (e.g. geocoding, search) using this data also, license-wise it must be clean anyway. - easier updates of already done imports. Example: I have prepared updated municipality borders, but cannot upload it directly, cannot update all the data myself (too big). - can pre-view impact of import - Mapink import+osm tileset could be applied. Once I have used dev.openstreetmap.org for this, but that has really old base data now. Then the preferred way of any import would be through this import layer. Direct bulk import would be possible with exceptional cases only, if no similar data exists for the area or cannot be surveyd (e.g. admin borders where they did not exist). It should not be too hard to implement, as minimum: * Set up separate database, instance of OSM API 0.6 using it. Some data like users should be shared. * Plugins for JOSM (and others) to be able to read from multiple OSM API servers. -- Jaak Laineste ___ dev mailing list dev@openstreetmap.org http://lists.openstreetmap.org/listinfo/dev
Re: [OSM-dev] imposm.parser - New Python library for OSM XML and PBF files
Sounds interesting, I added you at http://wiki.openstreetmap.org/wiki/Develop/Frameworks Would be nice if you provide some more informations about the internals at the dedicated wikipage cheers Matthias ___ dev mailing list dev@openstreetmap.org http://lists.openstreetmap.org/listinfo/dev
Re: [osmosis-dev] OSMembrane - GUI front-end for Osmosis
Am 16.02.2011 13:05, schrieb Tobias Kuhn: We're primarily interested in feedback for OSMembrane: Do you like it? Do you need it? Will you use it in the future? What's good and what's bad? So please don't hesitate to post your thoughts, a lousy answer is better than none. :) I like it much. It still needs some love to the arrow-drawing and such but it makes my life much, much easier. I found a bug but I won't register on yet another page to file it. Please, make bug filing open. It seems that the write-osmbin task doesn't take any input (is has no connector). I looked for the named XML-File that, according to your mail, should contain the tasks but i was unable to locate it in OSMembrane_build845.zip. Peter ___ osmosis-dev mailing list osmosis-...@openstreetmap.org http://lists.openstreetmap.org/listinfo/osmosis-dev
Re: [OSM-dev] imposm.parser - New Python library for OSM XML and PBF files
On 22.02.2011, at 12:12, Jochen Topf wrote: It uses C extensions for performance critical parts and automatically distributes the parsing across multiple CPUs/cores (for PBF and XML!). Interesting! How do you do the parallel parsing? For XML? It reads the (uncompressed) XML line by line and writes these lines into mmap'ed files. It splits the files after closing node/way/relation tags. It's not a generic parallel XML parser but it works great for the OSM data. https://bitbucket.org/olt/imposm.parser/src/c7e1cd122f00/imposm/parser/xml/multiproc.py#cl-167 As the name already suggests, imposm.parser is only a sub-package of a larger project: Imposm. It is an importer for OSM data that we are going to release in a couple of weeks. Importer into what? PostGIS for now, but it could be extended to support SQLite, etc. It is similar to osm2pgsql but it supports more customizable database schemas. For example, separate tables for buildings and landusage, or motorways and minorways. It can also create generalized tables (with lower spatial resolution) and union views. It uses TokyoCabinet to cache the nodes for ways and relations building (you might remember that from Barcelona?). Regards, Oliver -- Oliver Tonnhofer| Omniscale GmbH Co KG| http://omniscale.de http://mapproxy.org | https://bitbucket.org/olt ___ dev mailing list dev@openstreetmap.org http://lists.openstreetmap.org/listinfo/dev
Re: [Potlatch-dev] i18n using babelFx
On Mon, Feb 21, 2011 at 1:21 PM, NopMap ekkeh...@gmx.de wrote: Is there a way to attach custom resource files to this process which match the custom map_features? Well, you could replace the locale .swfs with custom ones, but you'd probably also need a custom LocalizationMap.mxml at which point you're running a custom version of potlatch2 and then theoretically anything is possible! We'll need to wait and see how the map_features translation works in practise before I can comment any further though - this is all a bit speculative for now. Cheers, Andy ___ Potlatch-dev mailing list potlatch-...@openstreetmap.org http://lists.openstreetmap.org/listinfo/potlatch-dev
Re: [osmosis-dev] OSMembrane - GUI front-end for Osmosis
Hey Peter, yes there was a little bug in the XML, in the next build that should be fixed, i hope you can wait until it is released. If you can't, just place the XML from [1] to /resources/xml/* next to your jar. Jakob [1] http://osmembrane.de/svn/sources/src/de/osmembrane/resources/xml/osmosis-structure.xml 2011/2/22 Peter Körner osm-li...@mazdermind.de: Am 16.02.2011 13:05, schrieb Tobias Kuhn: We're primarily interested in feedback for OSMembrane: Do you like it? Do you need it? Will you use it in the future? What's good and what's bad? So please don't hesitate to post your thoughts, a lousy answer is better than none. :) I like it much. It still needs some love to the arrow-drawing and such but it makes my life much, much easier. I found a bug but I won't register on yet another page to file it. Please, make bug filing open. It seems that the write-osmbin task doesn't take any input (is has no connector). I looked for the named XML-File that, according to your mail, should contain the tasks but i was unable to locate it in OSMembrane_build845.zip. Peter ___ osmosis-dev mailing list osmosis-...@openstreetmap.org http://lists.openstreetmap.org/listinfo/osmosis-dev ___ osmosis-dev mailing list osmosis-...@openstreetmap.org http://lists.openstreetmap.org/listinfo/osmosis-dev
Re: [Potlatch-dev] i18n using babelFx
Hi! Just to explain the situation: I am running an (unmodified) P2, but I have built a custom map_feature file from scratch. Of course it would be good to translate both. So it would be desirable to have seperate language resources for strings hardcoded in P2 and for strings from customizable resources like map_features or imagery files. Just to keep in the back of the head, of course it needs to work for the main application first. :-) bye Nop -- View this message in context: http://gis.638310.n2.nabble.com/Potlatch-dev-i18n-using-babelFx-tp6040153p6052672.html Sent from the Potlatch mailing list archive at Nabble.com. ___ Potlatch-dev mailing list potlatch-...@openstreetmap.org http://lists.openstreetmap.org/listinfo/potlatch-dev
[josm-dev] Optimized data structures
Hi, for my pluin I'm looking for optimized structures for geodatas. I saw this quadbucket thing at some places but neighter a doc nor a plugin that takes use of this. Is there another way to optimize the search e.g. to pick the things that need to bee drawn within the clipping area? regards Matthias ___ josm-dev mailing list josm-...@openstreetmap.org http://lists.openstreetmap.org/listinfo/josm-dev
Re: [osmosis-dev] OSMembrane - GUI front-end for Osmosis
Am 22.02.2011 16:00, schrieb Jakob Jarosch: Hey Peter, yes there was a little bug in the XML, in the next build that should be fixed, i hope you can wait until it is released. If you can't, just place the XML from [1] to /resources/xml/* next to your jar. I'm just testing around :) It would be nice if I could just place a xml next to the jar to add custom plugin tasks. Optionaly this file could be used to override errornous definitions like this one. The packaged zip should then contain a dummy xml file with explanations on how to add custom tasks. Peter ___ osmosis-dev mailing list osmosis-...@openstreetmap.org http://lists.openstreetmap.org/listinfo/osmosis-dev
Re: [OSM-dev] Is There Any Other Java Toolkit for OSM File Processing except Osmosis?
Hi Matthias Meißer, yes, we are doing research on geo-referenced video search, which will partly be based on openstreetmap's data. However, I'm not sure it will be a suitable entry on that wiki page. BTW, I found the core and xml jars of Osmosis can meet my demands. Thank the developers for your help! Regards, Zhijie On Feb 22, 2011 3:02 PM, Matthias Meißer dig...@arcor.de wrote: By the way, if your work is in context of science, please add it at http://wiki.openstreetmap.org/wiki/Research regards Matthias ___ dev mailing list dev@openstreetmap.org http://lists.openstreetmap.org/listinfo/dev ___ dev mailing list dev@openstreetmap.org http://lists.openstreetmap.org/listinfo/dev
[OSM-dev] Google Summer of Code 2011
Hi all, I'm planning on submitting an application for the 2011 edition of Google's Summer of Code. The deadline for the organization application is March 11. In the meantime I'd love to invite anyone with ideas for projects university-aged students may enjoy working on to submit them on the project ideas wiki page here: http://wiki.openstreetmap.org/wiki/GSoC_Project_Ideas_2011 Please spread this to any and all OSM mailing lists you know about. Thanks, Ian ___ dev mailing list dev@openstreetmap.org http://lists.openstreetmap.org/listinfo/dev
Re: [OSM-dev] Is There Any Other Java Toolkit for OSM File Processing except Osmosis?
Hi Matthias, The name of our research project is called geo-referenced video search. Nowadays, increasingly more videos are captured with with some camera-equipped mobile phones. These smart phones always have a number of sensors like GPS, compass, accelerometer and etc. In order to facilitate video search, we embed the geo-information collected with these sensors into videos, so that it is easier and more accurate to answer some queries like where the video is collected and what it shows, especially for the tourism videos. This is a on-going project. Previously, our experimental prototype was build based on Google Map. But recently, I come up an idea to improve the way to probe video content with geo-information, which requires more sophisticated geo-data manipulation than what Google Map can provides. Therefore, I resort to OpenStreeMap, where I have more freedom to access and process geo-data. I'm sorry that I cannot provide more detail about the newest development, because it is paper-oriented work, and we need to keep it confidential before publication. For more information about this project, you can visit our website: http://www.geovid.org/. BTW, it's a pity that I'm still not on the people list because I've just moved from another research project here:-S Regards, Zhijie 2011/2/23 Matthias Meißer dig...@arcor.de Sounds quite interesting, I'm currently working on http://wiki.openstreetmap.org/wiki/JOSM/Plugins/VideoMapping Can you give me some more details, please? regards Matthias -- Zhijie Shen School of Computing National University of Singapore http://www.comp.nus.edu.sg/%7Ez-shen/ ___ dev mailing list dev@openstreetmap.org http://lists.openstreetmap.org/listinfo/dev
