Re: [OSM-dev] Binary tiling scheme
Hi, my only spontaneous thought is this : what if we can add in a zoom level to the tiling, so that map elements visible at zoom level 1 are in one tile, and less visible elements are stored in a sub tile? basically any tile will contain only elements at a certain level of zoom. additional constraint, the tiles will all fit into the existing tiling scheme, with those two constraints, you will be able to render each tile at each zoom level with an efficient memory and cache profile. mike On Sun, Aug 29, 2010 at 5:14 PM, Frank Steggink stegg...@steggink.org wrote: Hi, I have created a tiling scheme which is based on division in two parts of a parent cell, alternating in the x and y directions. It can be used to chop up a rectangular area, so that each resulting tile contains less data than a certain threshold. I've devised it as a possible answer to the problem that some of Computerteddy's IMG files, particular in the Netherlands, can't be generated due to their size. This binary scheme is in contrast to the quad tiling scheme which is often used (like in Google Maps, or the CanVec import tiles), where each division ends up in four cells. However, when a quad scheme is used, you'll end up with more redundant tiles, of which the combination does not exceed the threshold either. Another benefit of this binary division is that each subtile can be identified by a unique integer value. This can be very convenient. It also means that the location of the subtile within the base tile, as well as its size, are implicitly stored. This scheme is also not limited by scale. When a parent tile has number n, its children will have the numbers 2*n and 2*n+1. If you're familiar with genealogy, this is the same as the Ahnentafel numbering (Sosa-Stradonitz). However, where as in genealogy a child has two parents, this is completely the opposite here. (A parent tile can be divided into two child tiles.) More information can be found on the OSM wiki: [1]. If you think it is useful, please let me know. Regards, Frank [1] http://wiki.openstreetmap.org/wiki/Binary_tiling_scheme ___ dev mailing list dev@openstreetmap.org http://lists.openstreetmap.org/listinfo/dev -- James Michael DuPont Member of Free Libre Open Source Software Kosova and Albania flossk.org flossal.org ___ dev mailing list dev@openstreetmap.org http://lists.openstreetmap.org/listinfo/dev
Re: [OSM-dev] Beautiful maps for a travel blog reviews site
On Mon, Aug 30, 2010 at 4:12 AM, Joe Richards geojoeli...@gmail.com wrote: Unique colours/look and feel - we already have that, but perhaps it's time to give up our own map rendering engine and look at Mapnik etc. We can create a tile server, although obviously avoiding so would be desirable if it can be done without causing too much impact on any one source server (perhaps we can retrieve and cache tiles) mapnik is going to needs its own server for rendering. no way to put that on the main server if you have any load. mapnik is very very hungry. mike ___ dev mailing list dev@openstreetmap.org http://lists.openstreetmap.org/listinfo/dev
Re: [OSM-dev] Installation and Configuration of OSM and Nominatim
On Sat, Aug 28, 2010 at 9:49 PM, Jose Cid don...@gmail.com wrote: I have just downloaded the Rails Port of the OSM server. After several configuration and build issues I was able to get it done and running on my local machine. Next, I tried populating the database using Osmosis version 0.36. I downloaded the following osm file, florida.osm.bz2, attempted the load and received the following exception: current_way_nodes violates foreign key constraint current_way_nodes_node_id_fkey -- not sure what steps to take next any help is appreciated. Another question I have is the following: I would like to use the Rails port (OSM) server in a closed network (ie. no access to internet etc). The only maps/data I would like to have in the database is of the USA -- later adding other countries. Upon installing the OSM server and configuring the database, I noticed that attempting a search will cause a request to go out to an external server (Nominatim and GeoNames -- among others). These URLs are hard-coded in the code. What would I need to do to run the server in a self contained closed network? you will need a renderer to produce the tiles and nomatim is not that hard to setup http://osmopenlayers.blogspot.com/2010/03/nomatim-kosovo-and-albania-running.html you dont need the patch. http://osmopenlayers.blogspot.com/2010/03/postgis-84-on-karmic-ubuntu-debian-gnu.html ___ dev mailing list dev@openstreetmap.org http://lists.openstreetmap.org/listinfo/dev -- James Michael DuPont Member of Free Libre Open Source Software Kosova and Albania flossk.org flossal.org ___ dev mailing list dev@openstreetmap.org http://lists.openstreetmap.org/listinfo/dev
Re: [OSM-dev] Support for Blender3D import script
i have done some experiments with this http://www.mail-archive.com/dev@openstreetmap.org/msg11191.html 2010/8/16 Matthias Meißer dig...@arcor.de: Excause me I already asked in the Forums but didn't get any answer. I contacted Jerome, author of the 'blended city' script for Blender3D. Currently it generates cities using an procedural algorithm but he plays a little bit with OSM and would be glad to get some assistance by someone from the community. http://jerome.le.chat.free.fr/index.php/en/ Even if I have experiences with Blender3D(well once upon a time...;)) I lack of Python knowledge, is anybody else interested to buildup a possibility to animate OSM in 3D using this script? regards Matthias ___ dev mailing list dev@openstreetmap.org http://lists.openstreetmap.org/listinfo/dev -- James Michael DuPont Member of Free Libre Open Source Software Kosova and Albania flossk.org flossal.org ___ dev mailing list dev@openstreetmap.org http://lists.openstreetmap.org/listinfo/dev
Re: [OSM-dev] Proposed schema for the OSM binary format.
hi scott,
what has changed since the beginnning?
the only thing that I would like to see is some form of tree structure
being possible, we should consider that the quadtree can be
implemented using the protobuf for an optimal random access.
all the best,
mike
On Mon, Aug 9, 2010 at 8:06 PM, Scott Crosby scro...@cs.rice.edu wrote:
As I'm in the process of packaging the osm binary format for packaging
as part of osmosis, I expect that it may start get used fairly soon.
Like any fileformat, the binary format requires a schema which will be
hard to change. Before finalizing it, I would like to run my schema
design past stakeholders for feedback and suggestions before people
start using it.
Once the schema is set and data is in that format, changing the schema
becomes MUCH more difficult.
My design includes several features that we may want to strip out,
such as flags indicating if the dataset is already pre-sorted, etc.
The schema isn't the implementation; not every feature needs to be
fully supported or used by the current toolset, but I would like to be
forward thinking and consider future use cases.
For instance, one feature that I thought was worth including was an
offset field so that the binary format can represent isohypsis data
efficiently, setting its grid spacing to be the same as that of the
isohypsis data, and then adjust the offset to make the grids align.
For forward compatibility with future files that include an offset, it
must be, and is, implemented by the parser, even if it is not
supported by the serializer. Another feature was dataset version
numbers (suggested by Fredrick Ramm) for auto-applying delta's. What
other features should be considered and added?
I am placing my current protobuf source file here, please reply with
any questions/comments or suggestions.
Thank you,
Scott
/* OSM Binary file format
This is the master schema file of the OSM binary file format. This
file is designed to support limited random-access and future
extendability.
A binary OSM file consists of a sequence of FileBlocks (please see
fileformat.proto). The first fileblock contains a serialized instance
of HeaderBlock, followed by a sequence of PrimitiveBlock blocks that
contain the primitives.
Each primitiveblock is designed to be independently parsable. It
contains a string table storing all strings in that block (keys and
values in tags, roles in relations, usernames, etc.) as well as
metadata containing the precision of coordinates or timestamps in that
block.
A primitiveblock contains a sequence of primitive groups, each
containing primitives of the same type (nodes, densenodes, ways,
relations). Coordinates are stored in signed 64-bit integers. Latlon
are measured in units granularity nanodegrees. The default of
granularity of 100 nanodegrees corresponds to about 1cm on the ground,
and a full lat or lon fits into 32 bits.
Converting an integer to a lattitude or longitude uses the formula:
$OUT = IN * granularity / 10**9$. Many encoding schemes use delta
coding when representing nodes and relations.
*/
//
//
/* Contains the file header. */
message HeaderBlock {
required HeaderBBox bbox = 1;
// Author, name, and version number of the dataset in this file. (to permit
// patches/updates to be incrementally applied)
optional string datasetauthor = 16; // TODO: WANT THIS?
optional string datasetname = 17; // TODO: WANT THIS?
optional int64 version = 18; // TODO: WANT THIS?
// Program generating this data
optional string writingprogram = 19; // TODO: WANT THIS?
/* Additional tags to aid in parsing this dataset */
repeated string required_features = 4; // TODO: WANT THIS?
repeated string optional_features = 5; // TODO: WANT THIS?
}
/*
Required features are features that an implementation must
understand in order to be able to parse the OSM entities in the
file. If a program sees a required feature that it does not
understand, it must error out. Currently the following features are
defined:
DenseNodes -- File uses dense nodes.
Optional features are features that a file has that a program may
exploit if it chooses to.
Has_Metadata -- Does the file contain author and timestamp metadata?
Sort.Type_then_ID -- Entites are sorted by type then ID.
Sort.Geographic -- Entities are in some form of geometric sort.
*/
/** The bounding box field in the OSM header. BBOX, as used in the OSM
header. Units are in nanodegrees. */
message HeaderBBox {
required sint64 left = 1;
required sint64 right = 2;
required sint64 top = 3;
required sint64 bottom = 4;
}
///
Re: [OSM-dev] New OSM binary fileformat implementation.
Hi, ist there any documentation of the binary format changes? I have implemented a c++ reader using protobuf, would update that if there is a new format spec. mike ___ dev mailing list dev@openstreetmap.org http://lists.openstreetmap.org/listinfo/dev
Re: [OSM-dev] please help peer a test torrent
Sorry, it seemed to have gone offline, I have restarted the tracker, thanks, mike On Sun, Jun 20, 2010 at 2:25 AM, Jeremy Adams mile...@king-nerd.com wrote: my latest experiment, splitting the osm files and sharing via torrent: http://osmopenlayers.blogspot.com/2010/06/first-running-of-osm-gittorrent.html can you please try the torrent? For Kosovo : http://xhema.flossk.org/~mdupont/osm/osmgit-test/kosovo.torrenthttp://xhema.flossk.org/%7Emdupont/osm/osmgit-test/kosovo.torrent For Albania : http://xhema.flossk.org/~mdupont/osm/osmgit-test/albania.torrenthttp://xhema.flossk.org/%7Emdupont/osm/osmgit-test/albania.torrent thanks, mike -- According to my client, your tracker (xhema.flossk.org on port 6969) is refusing connections. -Jeremy -- James Michael DuPont Member of Free Libre Open Source Software Kosova and Albania flossk.org flossal.org ___ dev mailing list dev@openstreetmap.org http://lists.openstreetmap.org/listinfo/dev
[OSM-dev] please help peer a test torrent
my latest experiment, splitting the osm files and sharing via torrent: http://osmopenlayers.blogspot.com/2010/06/first-running-of-osm-gittorrent.html can you please try the torrent? For Kosovo : http://xhema.flossk.org/~mdupont/osm/osmgit-test/kosovo.torrenthttp://xhema.flossk.org/%7Emdupont/osm/osmgit-test/kosovo.torrent For Albania : http://xhema.flossk.org/~mdupont/osm/osmgit-test/albania.torrenthttp://xhema.flossk.org/%7Emdupont/osm/osmgit-test/albania.torrent thanks, mike -- James Michael DuPont Member of Free Libre Open Source Software Kosova and Albania flossk.org flossal.org ___ dev mailing list dev@openstreetmap.org http://lists.openstreetmap.org/listinfo/dev
Re: [OSM-dev] start of gwtosm the google webtoolkit port of josm
Ok I installed it : http://xhema.flossk.org:8180/GWTOSM/ You put the url to load in the name field, and you can pan with the bbox fields , the last one is the zoom factor (so a bigger number is farther away). right now the bbox and the uri are not connected. code here, http://github.com/h4ck3rm1k3/GWTOsm patches welcome. mike On Tue, Jun 1, 2010 at 12:13 PM, jamesmikedup...@googlemail.com jamesmikedup...@googlemail.com wrote: it is not running yet on a public server. could deploy it on appspot. need to look into the details, right now running it in eclipse. will look into that some time. mike On Tue, Jun 1, 2010 at 12:06 PM, Peter Körner osm-li...@mazdermind.de wrote: jamesmikedup...@googlemail.com schrieb: OK, I have not been able to get the client side connection running, so I moved the http request to the java server side and not the client requests the uri via rpc and gets the data. now the program works, it can fetch an osm url and render it, the bbox is not calculated right yet, but that will be next. Can we see it running somewhere? Peter ___ dev mailing list dev@openstreetmap.org http://lists.openstreetmap.org/listinfo/dev
Re: [OSM-dev] start of gwtosm the google webtoolkit port of josm
http://wiki.github.com/h4ck3rm1k3/GWTOsm/ here are the build instructions. mkdir ~/GWTOSM cd ~/GWTOSM install google web kit sdk, very simple. wget http://google-web-toolkit.googlecode.com/files/gwt-2.0.3.zip unzip gwt-2.0.3.zip export GWTPATH=~/GWTOSM/gwt-2.0.3 git clone git://github.com/h4ck3rm1k3/GWTOsm.git get the code ant build ant war create a war file for tomcat ant devmode test locally, you can connect in eclipse via the port : -Xrunjdwp:transport=dt_socket,address=localhost:20345,server=y,suspend=n mike On Wed, May 26, 2010 at 8:19 PM, jamesmikedup...@googlemail.com jamesmikedup...@googlemail.com wrote: Hi, I have refactored some core classes in josm to run in gwt. this includes most of data classes. I am porting the graphic output to use gwt graphics and svg output. Goal is to get the josm core code running in gwt, first the display code and then to build the the edit functions. there are ways to move also rendering to the server side, and the code is all java, compiled by gwt into javascript using a canvas object and svg data. here is a screen-shot : http://www.scribd.com/doc/32005145/Example-Out-of-gwt-osm-port code here: http://github.com/h4ck3rm1k3/GWTOsm git clone g...@github.com:h4ck3rm1k3/GWTOsm.git I am using eclipse gwt plugins : http://dl.google.com/eclipse/plugin/3.5 - http://dl.google.com/eclipse/plugin/3.5 and also the gwt-2.0.3 http://code.google.com/webtoolkit/gettingstarted.html and the two graphics libs the canvas and the vaadin gwtgraphcsi inherits name='com.google.gwt.widgetideas.WidgetIdeas' / inherits name='org.vaadin.gwtgraphics.GWTGraphics'/ Currently having problems with http requests, is using a static xml loaded into as a resource. need to rework the xml parsing, sax does not seem to be directly supported. but you can at least see node positions being displayed. more to come, all help is welcome. please help test and write test cases for josm core code. the more tests we have, the easier it is to port the code. mike ___ dev mailing list dev@openstreetmap.org http://lists.openstreetmap.org/listinfo/dev
Re: [OSM-dev] start of gwtosm the google webtoolkit port of josm
it is not running yet on a public server. could deploy it on appspot. need to look into the details, right now running it in eclipse. will look into that some time. mike On Tue, Jun 1, 2010 at 12:06 PM, Peter Körner osm-li...@mazdermind.dewrote: jamesmikedup...@googlemail.com schrieb: OK, I have not been able to get the client side connection running, so I moved the http request to the java server side and not the client requests the uri via rpc and gets the data. now the program works, it can fetch an osm url and render it, the bbox is not calculated right yet, but that will be next. Can we see it running somewhere? Peter ___ dev mailing list dev@openstreetmap.org http://lists.openstreetmap.org/listinfo/dev
Re: [OSM-dev] start of gwtosm the google webtoolkit port of josm
On Mon, May 31, 2010 at 1:58 PM, Sebastian Klein basti...@googlemail.com wrote: Andrew Gregory wrote: On Mon, 31 May 2010 00:40:57 +0800, Peter Körner osm-li...@mazdermind.de wrote: Am 30.05.2010 17:22, schrieb jamesmikedup...@googlemail.com: I am happy to say, have made some progress. gwtosm now can display simple roads. I'm sorry but I'm really not sure what this is all about. Josm is designed as an offline editing tools. Why bend'n'break it to run in your browser? We already have an online editor called Potlatch. I think a web-based online editor that doesn't rely on a plugin would be a good thing. +1 @jamesmikedupont: What is your vision for this project? My vision is to implement as much of the jsom as possible on the gwt. Basically first to implement the rendering, then the editing. I am starting to get an idea of a svg renderer and using svg stylesheets to select how to style to maps. also click handling can be done via svg. But my vision is basically to create a set of patches for jsom that will separate the core map storage, rendering and navigation in a reusable java component and to move the platform specific code to a gwt or swing/awt lib. mike Do you try to create a cut down version of JOSM that runs in a browser or will it be a completely new editor that happens to reuse some source code from another project? What are the limitations of a gwt/js port? Is it still possible to open a local gpx file or do I have to upload it to some server, first? Same question for image files. I think it should be possible to read local files if they are for example selected in an upload bot or accessible via an http request http://google-web-toolkit.googlecode.com/svn/javadoc/1.5/com/google/gwt/user/client/HTTPRequest.html Anyway, great idea, let's see how it performs compared to the java version! Sebastian PS: Maybe you can find a better name for this... What about JOSM-- :) ___ dev mailing list dev@openstreetmap.org http://lists.openstreetmap.org/listinfo/dev ___ dev mailing list dev@openstreetmap.org http://lists.openstreetmap.org/listinfo/dev
Re: [OSM-dev] start of gwtosm the google webtoolkit port of josm
Today, I was able to get the zoom, and bounding boxes to be dynamically be changed. next to add in the ability to load data from the api server. mike On Wed, May 26, 2010 at 8:19 PM, jamesmikedup...@googlemail.com jamesmikedup...@googlemail.com wrote: Hi, I have refactored some core classes in josm to run in gwt. this includes most of data classes. I am porting the graphic output to use gwt graphics and svg output. Goal is to get the josm core code running in gwt, first the display code and then to build the the edit functions. there are ways to move also rendering to the server side, and the code is all java, compiled by gwt into javascript using a canvas object and svg data. here is a screen-shot : http://www.scribd.com/doc/32005145/Example-Out-of-gwt-osm-port code here: http://github.com/h4ck3rm1k3/GWTOsm git clone g...@github.com:h4ck3rm1k3/GWTOsm.git I am using eclipse gwt plugins : http://dl.google.com/eclipse/plugin/3.5 - http://dl.google.com/eclipse/plugin/3.5 and also the gwt-2.0.3 http://code.google.com/webtoolkit/gettingstarted.html and the two graphics libs the canvas and the vaadin gwtgraphcsi inherits name='com.google.gwt.widgetideas.WidgetIdeas' / inherits name='org.vaadin.gwtgraphics.GWTGraphics'/ Currently having problems with http requests, is using a static xml loaded into as a resource. need to rework the xml parsing, sax does not seem to be directly supported. but you can at least see node positions being displayed. more to come, all help is welcome. please help test and write test cases for josm core code. the more tests we have, the easier it is to port the code. mike ___ dev mailing list dev@openstreetmap.org http://lists.openstreetmap.org/listinfo/dev
Re: [OSM-dev] start of gwtosm the google webtoolkit port of josm
OK, I have not been able to get the client side connection running, so I moved the http request to the java server side and not the client requests the uri via rpc and gets the data. now the program works, it can fetch an osm url and render it, the bbox is not calculated right yet, but that will be next. mike On Mon, May 31, 2010 at 7:38 PM, jamesmikedup...@googlemail.com jamesmikedup...@googlemail.com wrote: Today, I was able to get the zoom, and bounding boxes to be dynamically be changed. next to add in the ability to load data from the api server. mike On Wed, May 26, 2010 at 8:19 PM, jamesmikedup...@googlemail.com jamesmikedup...@googlemail.com wrote: Hi, I have refactored some core classes in josm to run in gwt. this includes most of data classes. I am porting the graphic output to use gwt graphics and svg output. Goal is to get the josm core code running in gwt, first the display code and then to build the the edit functions. there are ways to move also rendering to the server side, and the code is all java, compiled by gwt into javascript using a canvas object and svg data. here is a screen-shot : http://www.scribd.com/doc/32005145/Example-Out-of-gwt-osm-port code here: http://github.com/h4ck3rm1k3/GWTOsm git clone g...@github.com:h4ck3rm1k3/GWTOsm.git I am using eclipse gwt plugins : http://dl.google.com/eclipse/plugin/3.5 - http://dl.google.com/eclipse/plugin/3.5 and also the gwt-2.0.3 http://code.google.com/webtoolkit/gettingstarted.html and the two graphics libs the canvas and the vaadin gwtgraphcsi inherits name='com.google.gwt.widgetideas.WidgetIdeas' / inherits name='org.vaadin.gwtgraphics.GWTGraphics'/ Currently having problems with http requests, is using a static xml loaded into as a resource. need to rework the xml parsing, sax does not seem to be directly supported. but you can at least see node positions being displayed. more to come, all help is welcome. please help test and write test cases for josm core code. the more tests we have, the easier it is to port the code. mike ___ dev mailing list dev@openstreetmap.org http://lists.openstreetmap.org/listinfo/dev
Re: [OSM-dev] start of gwtosm the google webtoolkit port of josm
this is a fun project that you can learn from. I hope people will help out. peace, mike On Sun, May 30, 2010 at 6:40 PM, Peter Körner osm-li...@mazdermind.de wrote: Am 30.05.2010 17:22, schrieb jamesmikedup...@googlemail.com: I am happy to say, have made some progress. gwtosm now can display simple roads. I'm sorry but I'm really not sure what this is all about. Josm is designed as an offline editing tools. Why bend'n'break it to run in your browser? We already have an online editor called Potlatch. Peter ___ dev mailing list dev@openstreetmap.org http://lists.openstreetmap.org/listinfo/dev
Re: [josm-dev] start of gwtosm the google webtoolkit port of josm
On Thu, May 27, 2010 at 11:03 AM, Frederik Ramm frede...@remote.org wrote: Dirk, Dirk Stöcker wrote: I'm not so sure this is true anymore. JOSM's internal structure has been reworked largely and it has a big advantage - it has been tested for a long time and works reliable. Nothing against JOSM's internal structure but it seemed to me that Avar was looking for a rather general OSM library, whereas even today, and even if you look at the base layer of objects in JOSM, everything is geared towards being an editor - you'll find projected coordinates in the node objects, your primitives will have flags saying whether they are editable or not, and so on. All this is perfectly OK in the JOSM context but I wouldn't want that overhead for general OSM data processing. The lib is also geared to be and editor. the goal is to make a webbased thin client for josm. mike ___ josm-dev mailing list josm-dev@openstreetmap.org http://lists.openstreetmap.org/listinfo/josm-dev
Re: [OSM-dev] start of gwtosm the google webtoolkit port of josm
thanks for the props Ævar, yes, I have started to create a cut down navigable object that is used to control the view, also, removed most of the preferenced and turned them into fields loaded from constants. What we need are test cases, test suites to verify that the code is running well. mike On Wed, May 26, 2010 at 9:35 PM, Ævar Arnfjörð Bjarmason ava...@gmail.com wrote: On Wed, May 26, 2010 at 19:17, Frederik Ramm frede...@remote.org wrote: jamesmikedup...@googlemail.com wrote: I have refactored some core classes in josm to run in gwt. this includes most of data classes. I am porting the graphic output to use gwt graphics and svg output. Might be worth taking this to the josm-dev list. Also, to those unfamiliar with gwt, explain the advantages. These examples might be useful: http://code.google.com/webtoolkit/examples/ Basically it's a Java to JavaScript compiler and UI toolkit. You can write Java which is then magically compiled to a web application. This is a great development. It might also help to generalize the JOSM core more, right now it's very tightly bound to its current UI. It would be neat if there was a Java libosm that could be used for stuff like this, and things like Android apps. ___ dev mailing list dev@openstreetmap.org http://lists.openstreetmap.org/listinfo/dev
Re: [OSM-dev] I have created software for processing OSM data into networked graph structure
lets see the c0d3! On Sat, May 22, 2010 at 1:15 AM, Daniel Lissner dliss...@gmail.com wrote: Hello OSM developers, I am a computer scientist researcher at the University of Memphis Computer Science Dept. In a recent project, we needed a representation of the road network which would provide us with information about connectivity and distance between sections of road. We found that the OSM data provided a suitable platform to build such a graph-like structure. I have written a java program to process the XML format OSM data and achieve this. Currently, each sequential pair of nodes referenced in the WAY elements of roads are considered as a section of road. their lat/long coords are passed to a method to calculate their distance via law of spherical cosines and haversine formula. After every Way in the dataset is processed, another method populates adjacency and incidence information. Each road section (essentially a graph edge) knows which road sections it is adjacent to, the two node points that make its end points, its distance, it's heading (in respect to North) and its street name. Thus far we are not very concerned with other metadata but it's certainly feasible n possible to include. Further, each node (essentially a graph vertex) knows its reference number, its lat/lng coords, and all of the road sections which are incident to it. The purpose of this structure for us was to serve as a state model for simulations for our research work. While I'm not at liberty to share all of our research purposes at this time, I am however able to share the code I wrote which processes the osm data and creates a graph structure of the road network. The first version simply instantiates and populates several java objects, which we tried to design and code as clean and efficiently as possible. We are now migrating the processor to instead store the data in a MySQL database. So, I am writing the mailing list to ask if the osm developer community would find any use for this little utility which creates a connected graph structure of Ways, either as a straightforward set of java objects or as a MySQL database. OSM has benefited our research and I would certainly like to give back. Thanks, Daniel ___ dev mailing list dev@openstreetmap.org http://lists.openstreetmap.org/listinfo/dev ___ dev mailing list dev@openstreetmap.org http://lists.openstreetmap.org/listinfo/dev
[OSM-dev] first pass of albanian translation for openstreetmap ready
Hi, The first pass at translating opensteretmap, potlatch and slippy maps into albanian is finished, now we will have to review them and do some corrections. I think in 2-3 weeks we will have a complete and checked translation. OSM webpage : http://translatewiki.net/w/i.php?title=Special%3ATranslatetask=reviewallgroup=out-osm-sitelanguage=alnlimit=100 potlach : http://translatewiki.net/w/i.php?title=Special%3ATranslatetask=reviewallgroup=out-osm-potlatchlanguage=alnlimit=100 open layers: http://translatewiki.net/w/i.php?title=Special%3ATranslatetask=reviewallgroup=out-openlayerslanguage=alnlimit=100 potlach help : http://translatewiki.net/w/i.php?title=Special%3ATranslatetask=reviewallgroup=page|Osm%3APotlatch-help-htmllanguage=alnlimit=100http://translatewiki.net/w/i.php?title=Special%3ATranslatetask=reviewallgroup=page%7COsm%3APotlatch-help-htmllanguage=alnlimit=100 thanks, mike ___ dev mailing list dev@openstreetmap.org http://lists.openstreetmap.org/listinfo/dev
[OSM-dev] first steps in a osmgit
HI, I have gotten a first little step running in the splitting of osm into osm files contains tiles of data, and checking them into git. using zoom 10 and then 15 recursivly gives small files, at least for albania that can be seen easily. http://fmtyewtk.blogspot.com/2010/05/first-steps-in-osmgit.html idea is to be able to also render those tiles on many clients and share the results, maybe also via another git repo. mike ___ dev mailing list dev@openstreetmap.org http://lists.openstreetmap.org/listinfo/dev
Re: [josm-dev] Java Applet
what a great idea, i have considered this as well. it would be a welcome replacement for potlatch On Wed, May 12, 2010 at 11:00 PM, Ævar Arnfjörð Bjarmason ava...@gmail.comwrote: It would be very interesting if were un-buggy enough to run via the Edit button on openstreetmap.org. I've wanted to make the editor the user runs via the Edit button optional for some time. ___ josm-dev mailing list josm-dev@openstreetmap.org http://lists.openstreetmap.org/listinfo/josm-dev ___ josm-dev mailing list josm-dev@openstreetmap.org http://lists.openstreetmap.org/listinfo/josm-dev
Re: [OSM-dev] New OSM binary fileformat implementation.
I have now reworked the reader code to use only the internal google protobuffer features for reading. It now can read the entire file to the end. Code is commited. Also, I have checked in an example small protobuffer file for testing. http://github.com/h4ck3rm1k3/OSM-Osmosis any testers would be appreciated. in the dir OSM-Osmosis/src/crosby/binary/cpp, build and then run : ./osmprotoread albania.osm.protobuf3 out.txt mike On Sun, May 2, 2010 at 11:25 AM, jamesmikedup...@googlemail.com jamesmikedup...@googlemail.com wrote: Ok, my reader is now working, it can read to the end of the file, now am fleshing out the template dump functions to emit the data. g...@github.com:h4ck3rm1k3/OSM-Osmosis.git My new idea is that we could use a binary version of the rtree, I have already ported the rtree to my older template classes. We could use the rtree to sort the data and emit the blocks based on that. the rtree data structures themselves could be stored in the protobuffer so that it is persistent and also readable by all. https://code.launchpad.net/~jamesmikedupont/+junk/EPANatReghttps://code.launchpad.net/%7Ejamesmikedupont/+junk/EPANatReg notes: http://www.openstreetmap.org/user/h4ck3rm1k3/diary/9042 doxygen here : http://xhema.flossk.org:8080/mapdata/03/EPANatReg/html/classRTreeWorld.html On Sun, May 2, 2010 at 7:35 AM, Scott Crosby scrosb...@gmail.com wrote: -- Forwarded message -- (Accidently did not reply to list) Some of these questions may be a bit premature, but I don't know how far along your design is, and perhaps asking them now may influence that design in ways that work for me. I'm willing to call what I've designed so far in the file format mostly complete, except for some of the header design issues I've brought up already. The question is what extensions make sense to define now, such as bounding boxes, and choosing the right definition for them. Unfortunately, this method introduces a variety of complications. First, the database for TX alone is 10 gigs. Ballpark estimations are that I might need half a TB or more to store the entire planet. I'll also need substantial RAM to store the working set for the DB index. All this means that, to launch this project on a global scale, I'd need a lot more funding than I as an individual am likely to find. With pruning out metadata, some judicious filtering of uninteresting tags, and increasing the granularity to 10 microdegrees (about 1m resolution), I've fit the whole planet in 3.7gb. Is there a performance or size penalty to ordering the data geographically rather than by ID? I expect no performance penalty. As for a size penalty, it will be a mixed bag. Ordering geographically should reduce the similarity for node ID numbers, increasing the space required to store them. It should increase the similarity for latitude and longitude numbers, which would reduce the size. It might change the re-use frequency of strings. On the whole, I suspect the filesize would remain within 10% of what it is now and believe it will decrease, but I have no way to know. I understand that this won't be the default case, but I'm wondering if there would likely be any major performance issues for using it in situations where you're likely to want bounding-box access rather than simply pulling out entities by ID. I have no code for pulling entities out by ID, but that would be straightforward to add, if there was a demand for it. There should be no problems at all for doing geographic queries. My vision for a bounding box access is that the file lets you skip 'most' blocks that are irrelevant to a query. 'most' depends a lot on the data and how exactly the dataset is sorted for geographic locality. But there may be problems in geographic queries. Things like cross-continental airways if they are in the OSM planet file would cause huge problems; their bounding box would cover the whole continent, intersecting virtually any geographic lookup. Those geographic lookups would then need to find the nodes in those long ways which would require loading virtually every block containing nodes. I have considered solutions for this issue, but I do not know if problematic ways like this exist. Does OSM have ways like this. Also, is there any reason that this format wouldn't be suitable for a site with many active users performing geographic, read-only queries of the data? A lot of that depends on the query locality. Each block has to be indpendently decompressed and parsed before the contents can be examined, that takes around 1ms. At a small penalty in filesize, you can use 4k entities in a block which decompress and parse faster. If the client is interested in many ways in a particular geographic locality, as yours seems to, then this is perfect. Grab the blocks and cache
Re: [josm-dev] Can't get Yahoo imagery to show up in JOSM
On Wed, May 5, 2010 at 12:58 PM, Jonas Stein n...@jonasstein.de wrote: Although the best solution would be to include a downloader into the plugin or include a self-test function. We can't include a downloader in the plugin except someone writes a Java software to do so. I am not very familiar with java, but isn't there a standard lib for things like download? I tried to write a shell script, that downloads the URL given on command line like wget, but that did not work. Does webkit more? Btw: there is a link to a webkit.c file in the wiki. That did not compile on debian testing. Plenty of missing libs and errors. I tried to fix them manually, but gave up after a while. please check my deb packages, if there are any errors, let me know here is the debian package http://osm.komzpa.net/~mdupont/osm/pool/main/w/webkitimageqt/ http://osm.komzpa.net/%7Emdupont/osm/pool/main/w/webkitimageqt/ the line deb http://osm.komzpa.net/~mdupont/osm/ http://osm.komzpa.net/%7Emdupont/osm/ gjergi-osm main you add to your /etc/apt/source.list apt-get install webkitimageqt should work. mike ___ josm-dev mailing list josm-dev@openstreetmap.org http://lists.openstreetmap.org/listinfo/josm-dev
Re: [OSM-dev] New OSM binary fileformat implementation.
Ok, my reader is now working, it can read to the end of the file, now am fleshing out the template dump functions to emit the data. g...@github.com:h4ck3rm1k3/OSM-Osmosis.git My new idea is that we could use a binary version of the rtree, I have already ported the rtree to my older template classes. We could use the rtree to sort the data and emit the blocks based on that. the rtree data structures themselves could be stored in the protobuffer so that it is persistent and also readable by all. https://code.launchpad.net/~jamesmikedupont/+junk/EPANatReg notes: http://www.openstreetmap.org/user/h4ck3rm1k3/diary/9042 doxygen here : http://xhema.flossk.org:8080/mapdata/03/EPANatReg/html/classRTreeWorld.html On Sun, May 2, 2010 at 7:35 AM, Scott Crosby scrosb...@gmail.com wrote: -- Forwarded message -- (Accidently did not reply to list) Some of these questions may be a bit premature, but I don't know how far along your design is, and perhaps asking them now may influence that design in ways that work for me. I'm willing to call what I've designed so far in the file format mostly complete, except for some of the header design issues I've brought up already. The question is what extensions make sense to define now, such as bounding boxes, and choosing the right definition for them. Unfortunately, this method introduces a variety of complications. First, the database for TX alone is 10 gigs. Ballpark estimations are that I might need half a TB or more to store the entire planet. I'll also need substantial RAM to store the working set for the DB index. All this means that, to launch this project on a global scale, I'd need a lot more funding than I as an individual am likely to find. With pruning out metadata, some judicious filtering of uninteresting tags, and increasing the granularity to 10 microdegrees (about 1m resolution), I've fit the whole planet in 3.7gb. Is there a performance or size penalty to ordering the data geographically rather than by ID? I expect no performance penalty. As for a size penalty, it will be a mixed bag. Ordering geographically should reduce the similarity for node ID numbers, increasing the space required to store them. It should increase the similarity for latitude and longitude numbers, which would reduce the size. It might change the re-use frequency of strings. On the whole, I suspect the filesize would remain within 10% of what it is now and believe it will decrease, but I have no way to know. I understand that this won't be the default case, but I'm wondering if there would likely be any major performance issues for using it in situations where you're likely to want bounding-box access rather than simply pulling out entities by ID. I have no code for pulling entities out by ID, but that would be straightforward to add, if there was a demand for it. There should be no problems at all for doing geographic queries. My vision for a bounding box access is that the file lets you skip 'most' blocks that are irrelevant to a query. 'most' depends a lot on the data and how exactly the dataset is sorted for geographic locality. But there may be problems in geographic queries. Things like cross-continental airways if they are in the OSM planet file would cause huge problems; their bounding box would cover the whole continent, intersecting virtually any geographic lookup. Those geographic lookups would then need to find the nodes in those long ways which would require loading virtually every block containing nodes. I have considered solutions for this issue, but I do not know if problematic ways like this exist. Does OSM have ways like this. Also, is there any reason that this format wouldn't be suitable for a site with many active users performing geographic, read-only queries of the data? A lot of that depends on the query locality. Each block has to be indpendently decompressed and parsed before the contents can be examined, that takes around 1ms. At a small penalty in filesize, you can use 4k entities in a block which decompress and parse faster. If the client is interested in many ways in a particular geographic locality, as yours seems to, then this is perfect. Grab the blocks and cache the decompressed data in RAM where it can be re-used for subsequent geographic queries in the same locality. Again, I'd guess not, since the data isn't compressed as such, but maybe seeking several gigs into a file to locate nearby entities would be a factor, or it may work just fine for single-user access but not so well with multiple distinct seeks for different users in widely separate locations. Ultimately, it depends on your application, which has a particular locality in its lookups. Application locality, combined with a fileformat, defines the working set size. If RAM is insufficient to hold the working set, you'll have to pay a disk seek whether it is in my format or not. My
Re: [josm-dev] Can't get Yahoo imagery to show up in JOSM (works now)
I have prepared debian/ubuntu packages and source to build yourself if you need it. The ITP bug report is here: http://bugs.debian.org/cgi-bin/bugreport.cgi?bug=569040 The git repo is here : http://github.com/h4ck3rm1k3/webkitimageqt here is the debian package http://osm.komzpa.net/~mdupont/osm/pool/main/w/webkitimageqt/ the line deb http://osm.komzpa.net/~mdupont/osm/ gjergi-osm main you add to your /etc/apt/source.list apt-get install webkitimageqt should work. On Sun, May 2, 2010 at 9:41 PM, Ramey zep...@cryptotrope.com wrote: Sorry about that, I've got it working now. It was poor trouble- shooting on my part to try a couple (half-assed) things, throw up my hands, and holler for help. The problem was the OS couldn't find webkit-image (the prebuilt binary). (I had assumed that it wasn't working because of architecture issues, as it was built with the previous OS). I had wanted to put it in /Users/me/bin, and changed my path accordingly, but it appears that the system has a different context, so my choices are to put it in the system path or edit the system path, neither of which thrills me, but I did the lazier and put it in the system path and it now works. ___ josm-dev mailing list josm-dev@openstreetmap.org http://lists.openstreetmap.org/listinfo/josm-dev ___ josm-dev mailing list josm-dev@openstreetmap.org http://lists.openstreetmap.org/listinfo/josm-dev
Re: [OSM-dev] New OSM binary fileformat implementation.
On Wed, Apr 28, 2010 at 7:02 PM, Scott Crosby scrosb...@gmail.com wrote: Hello! I would like to announce code implementing a binary OSM format that supports the full semantics of the OSM XML. It is 5x-10x faster at reading and writing and 30-50% smaller; an entire planet, including all metadata, can be read in about 12 minutes and written in about 50 minutes on a 3 year old dual-core machine. I have implemented an osmosis reader and writer and have enhancements to the map splitter to read the format. Code is pure Java and uses Google protocol buffers for the low-level serialization. Thats very interesting. Would like to see this working with c++ as well. Will have to look at the code. thanks for sharing, mike ___ dev mailing list dev@openstreetmap.org http://lists.openstreetmap.org/listinfo/dev
Re: [OSM-dev] New OSM binary fileformat implementation.
I got it built,
Build instructions :
first get the protobuf, and build manually,
526 svn checkout http://protobuf.googlecode.com/svn/trunk/ protobuf-read-only
527 ls
528 cd protobuf-read-only/
529 ls
530 bash ./autogen.sh
531 ls
532 make
533 ./configure
534 make
535 sudo make install
go into the java dir and use ant to build the jar files.
got to the sources of the OSM tool :
install the protobuf into the lib/compile, normally this will be
handled by ivy, but there are issues.
cp
/home/mdupont/experiments/osm/protobuf-read-only/java/target/protobuf-java-2.3.1-pre.jar
lib/compile/
607 cd src/
611 cd crosby/
613 cd binary/
614 ls
615 protoc --java_out=../.. fileformat.proto
616 protoc --java_out=../.. osmformat.proto
this generates the needed code.
now you can build.
On Wed, Apr 28, 2010 at 7:02 PM, Scott Crosby scrosb...@gmail.com wrote:
Hello!
I would like to announce code implementing a binary OSM format that
supports the full semantics of the OSM XML. It is 5x-10x faster at
reading and writing and 30-50% smaller; an entire planet, including
all metadata, can be read in about 12 minutes and written in about 50
minutes on a 3 year old dual-core machine. I have implemented an
osmosis reader and writer and have enhancements to the map splitter to
read the format. Code is pure Java and uses Google protocol buffers
for the low-level serialization.
Comparing the file sizes:
8.2gb planet-100303.osm.bz2
12 gb planet-100303.osm.gz
5.2gb planet-omitmeta.bin
6.2gb planet.bin
The omitmeta version omits the uid/user/version/timestamp metadata
fields on each entity and are faster to generate and read.
The design is very extensible. The low-level file format is designed
to support random access at the 'fileblock' granularity, where a
fileblock can contain ~8k OSM entities. There is *no* tag hardcoding
used; all keys and values are stored in full as opaque strings. For
future scalability, 64 bit node/way/relation ID's are assumed. The
current serializer preserves the order of OSM entities and tags on OSM
entities. To flexibly handle multiple resolutions, the granularity, or
resolution used for representing locations and timestamps is
adjustable in multiples of 1 millisecond and 1 nanodegree and can be
set independently for each fileblock. The default scaling factor is
1000 milliseconds and 100 nanodegrees, corresponding to about ~1cm at
the equator. These are the current resolution of the OSM database.
Smaller files can be generated. At 10 microdegrees granularity,
corresponding to about 1m of resolution, the filesize decreases by
about 1gb. Space may also be saved by removing uninteresting UUID
tags or perhaps by having stronger geographic locality when building
the file.
I have also tested the binary format on some SRTM contour lines in OSM
0.5 XML format, obtaining about a 50:1 compression ratio. This might
be further improved by choosing a granularity equal to the isohypsis
grid size.
// Testing
I have tested this code on the Cloudmade extract of Rhode
Island. After converting the entire file to and from binary format,
the XML output is bytewise identical to original file except for the
one line indicating the osmosis version number.
When run through the splitter, the output is not bytewise identical to
before because of round-off errors 16 digits after the decimal point;
this could be fixed by having the splitter behave like osmosis and
only output 7 significant digits.
// To use:
Demonstration code is available on github at
http://github.com/scrosby/OSM-Osmosis and
http://github.com/scrosby/OSM-splitter
See the 'master' branches.
Please note that this is at present unpackaged demonstration code and
the fileformat may change to incorporate suggestions. Also note that
the shared code between the splitter and osmosis currently lives in
the osmosis git repository. You'll also need to go into the
crosby.binary directory and run the protocol compiler ('protoc') on
the .proto files (See comments in those files for the command line.).
/// The design ///
I use Google protocol buffers for the low-level store. Given a
specification file of one or more messages, the protocol buffer
compiler writes low-level serialization code. Messages may contain
other messages, forming hierarchical structures. Protocol buffers also
support extensibility; new fields can be added to a message and old
clients can read those messages without recompiling. For more details,
please see http://code.google.com/p/protobuf/. Google officially
supports C++, Java, and Python, but compilers exist for other
languages. An example message specification is:
message Node {
required sint64 id = 1;
required sint64 lat = 7;
required sint64 lon = 8;
repeated uint32 keys = 9 [packed = true]; // Denote strings
repeated uint32 vals = 10 [packed = true];// Denote strings
Re: [OSM-dev] New OSM binary fileformat implementation.
I have created a branch with the cpp generated code, g...@github.com:h4ck3rm1k3/OSM-Osmosis.git the new c++ lib is called libosmprotobuf, what a great name. OSM-Osmosis/src/crosby/binary/ run make to generate the code, but i checked in the results. in the subdir : OSM-Osmosis/src/crosby/binary/cpp bash ./autogen.sh ./configure make it uses /usr/local/lib/libprotobuf.la which is a bit of a hack. my next step will be to hook this up to my existing c++ code https://code.launchpad.net/~jamesmikedupont/+junk/EPANatReg I hope that I will be able to make nice small C++ tools that can then process and or produce these buffer files. very interesting stuff that google has produced, thanks scott for making this public, mike ___ dev mailing list dev@openstreetmap.org http://lists.openstreetmap.org/listinfo/dev
Re: [josm-dev] josm and gcj (was: Git mirror of JOSM on GitHub)
I have found and fixed my first bug in josm : http://fmtyewtk.blogspot.com/2010/04/first-bug-fixed-in-josm-because-of-gcj.html https://josm.openstreetmap.de/ticket/4950 this is a good reason why we should be using gcj because it is stricter. mike On Sat, Apr 24, 2010 at 8:32 PM, Sebastian Klein basti...@googlemail.com wrote: jamesmikedup...@googlemail.com wrote: I will next encapsulate/isolate the changes, yes. I am also more interested in optimizing the generated code, will work on some optimizations first. mike Interesting, I did not expect it would run so well with gcj. However I have problems opening a file, does it work for you? (gcj 4.4 jre) Sebastian -- console log: Exception during event dispatch: java.lang.NegativeArraySizeException at java.util.concurrent.CopyOnWriteArrayList.remove(libgcj.so.10) at org.openstreetmap.josm.data.osm.ChangesetCache.removeChangesetCacheListener(ChangesetCache.java:67) at org.openstreetmap.josm.gui.dialogs.ChangesetDialog.unregisterAsListener(ChangesetDialog.java:133) at org.openstreetmap.josm.gui.dialogs.ChangesetDialog.hideNotify(ChangesetDialog.java:154) at org.openstreetmap.josm.gui.dialogs.ToggleDialog.hideDialog(ToggleDialog.java:213) at org.openstreetmap.josm.gui.dialogs.DialogsPanel.add(DialogsPanel.java:85) at org.openstreetmap.josm.gui.dialogs.DialogsPanel.initialize(DialogsPanel.java:43) at org.openstreetmap.josm.gui.MapFrame.initializeDialogsPane(MapFrame.java:219) at org.openstreetmap.josm.Main.addLayer(Main.java:232) ___ josm-dev mailing list josm-dev@openstreetmap.org http://lists.openstreetmap.org/listinfo/josm-dev ___ josm-dev mailing list josm-dev@openstreetmap.org http://lists.openstreetmap.org/listinfo/josm-dev
Re: [OSM-dev] [josm-dev] Git mirror of JOSM on GitHub
On Sat, Apr 24, 2010 at 7:16 AM, jamesmikedup...@googlemail.com jamesmikedup...@googlemail.com wrote: Thats great, I will test build it. I have been dreaming last night about compiling josm with the GNU Java Compiler: http://gcc.gnu.org/java/ dream come true http://github.com/h4ck3rm1k3/josm/commit/2432202f867953559d973387bc28ef66acf039f7 It works, I now have a gnu java compiler version of josm running, I removed the proxy support because that does not work with classpath. we might be able to implement that some other time. also the rounding of the division is left to do, we will see if it causes big problems. i made my first commit with it http://www.openstreetmap.org/browse/changeset/4511174 http://github.com/downloads/h4ck3rm1k3/josm/josm-custom.jar ___ dev mailing list dev@openstreetmap.org http://lists.openstreetmap.org/listinfo/dev
Re: [josm-dev] Git mirror of JOSM on GitHub
On Sat, Apr 24, 2010 at 7:16 AM, jamesmikedup...@googlemail.com jamesmikedup...@googlemail.com wrote: Thats great, I will test build it. I have been dreaming last night about compiling josm with the GNU Java Compiler: http://gcc.gnu.org/java/ dream come true http://github.com/h4ck3rm1k3/josm/commit/2432202f867953559d973387bc28ef66acf039f7 It works, I now have a gnu java compiler version of josm running, I removed the proxy support because that does not work with classpath. we might be able to implement that some other time. also the rounding of the division is left to do, we will see if it causes big problems. i made my first commit with it http://www.openstreetmap.org/browse/changeset/4511174 http://github.com/downloads/h4ck3rm1k3/josm/josm-custom.jar ___ josm-dev mailing list josm-dev@openstreetmap.org http://lists.openstreetmap.org/listinfo/josm-dev
Re: [josm-dev] Git mirror of JOSM on GitHub
I will next encapsulate/isolate the changes, yes. I am also more interested in optimizing the generated code, will work on some optimizations first. mike On Sat, Apr 24, 2010 at 3:56 PM, Ævar Arnfjörð Bjarmason ava...@gmail.com wrote: On Sat, Apr 24, 2010 at 11:51, jamesmikedup...@googlemail.com jamesmikedup...@googlemail.com wrote: On Sat, Apr 24, 2010 at 7:16 AM, jamesmikedup...@googlemail.com jamesmikedup...@googlemail.com wrote: Thats great, I will test build it. I have been dreaming last night about compiling josm with the GNU Java Compiler: http://gcc.gnu.org/java/ dream come true http://github.com/h4ck3rm1k3/josm/commit/2432202f867953559d973387bc28ef66acf039f7 It works, I now have a gnu java compiler version of josm running, I removed the proxy support because that does not work with classpath. we might be able to implement that some other time. also the rounding of the division is left to do, we will see if it causes big problems. i made my first commit with it http://www.openstreetmap.org/browse/changeset/4511174 http://github.com/downloads/h4ck3rm1k3/josm/josm-custom.jar That's awesome. Nice to see some development happening with the mirror. Doesn't Java have some macro-like system or a way to hack it with Ant so that gcj support can be merged back in? Maybe by subclassing those files you modified and tell ant to compile FooGCJ.java under gcj and just Foo.java otherwise. Also doesn't GCJ support compiling to object code instead of a .jar via GCC? Did you try that? If so how does it compare speed/memory wise? Does running with GCJ also suffer from the odd little bugs everywhere you get with OpenJDK? ___ josm-dev mailing list josm-dev@openstreetmap.org http://lists.openstreetmap.org/listinfo/josm-dev
Re: [josm-dev] josm and gcj (was: Git mirror of JOSM on GitHub)
opening a file works for me, send me your file. I have a feeling that the open file dialog is noticibley faster, what about you? thanks mike On Sat, Apr 24, 2010 at 8:32 PM, Sebastian Klein basti...@googlemail.com wrote: jamesmikedup...@googlemail.com wrote: I will next encapsulate/isolate the changes, yes. I am also more interested in optimizing the generated code, will work on some optimizations first. mike Interesting, I did not expect it would run so well with gcj. However I have problems opening a file, does it work for you? (gcj 4.4 jre) Sebastian -- console log: Exception during event dispatch: java.lang.NegativeArraySizeException at java.util.concurrent.CopyOnWriteArrayList.remove(libgcj.so.10) at org.openstreetmap.josm.data.osm.ChangesetCache.removeChangesetCacheListener(ChangesetCache.java:67) at org.openstreetmap.josm.gui.dialogs.ChangesetDialog.unregisterAsListener(ChangesetDialog.java:133) at org.openstreetmap.josm.gui.dialogs.ChangesetDialog.hideNotify(ChangesetDialog.java:154) at org.openstreetmap.josm.gui.dialogs.ToggleDialog.hideDialog(ToggleDialog.java:213) at org.openstreetmap.josm.gui.dialogs.DialogsPanel.add(DialogsPanel.java:85) at org.openstreetmap.josm.gui.dialogs.DialogsPanel.initialize(DialogsPanel.java:43) at org.openstreetmap.josm.gui.MapFrame.initializeDialogsPane(MapFrame.java:219) at org.openstreetmap.josm.Main.addLayer(Main.java:232) ___ josm-dev mailing list josm-dev@openstreetmap.org http://lists.openstreetmap.org/listinfo/josm-dev ___ josm-dev mailing list josm-dev@openstreetmap.org http://lists.openstreetmap.org/listinfo/josm-dev
Re: [OSM-dev] [josm-dev] Git mirror of JOSM on GitHub
Thats great, I will test build it. I have been dreaming last night about compiling josm with the GNU Java Compiler: http://gcc.gnu.org/java/ will see how that works out mike On Sat, Apr 24, 2010 at 4:05 AM, Ævar Arnfjörð Bjarmason ava...@gmail.com wrote: I got tired of waiting for `svn up' when rebuilding JOSM and wanted to commit some local patches. So I made a Git mirror of JOSM that I and others can use. It's very handy for getting faster updates, a local history and the ability to patch JOSM without SVN write access: http://github.com/avar/josm It's made with `git-svn`. It has two branches, the master branch is unaltered from git-svn and can be used to bootstrap from git-svn[1]: http://github.com/avar/josm/tree/master The second one is the mirror branch. This one is checked out by default and includes all the svn externals plus this hack to get it to build under Git: http://github.com/avar/josm http://github.com/avar/josm/commit/f5f16565e It would be nice if the core build.xml supported getting the revision from the git history if applicable, but my ant fu didn't suffice to make this happen. Finally this is the script that does the mirroring: http://github.com/avar/josm-mirror It runs through cron every 30 minutes and hits the josm.openstreetmap.org server with `git svn fetch`. I can adjust the frequency if the server admins think this is too much. 1. Example of git-svn bootstrapping: http://trac.parrot.org/parrot/wiki/git-svn-tutorial ___ josm-dev mailing list josm-...@openstreetmap.org http://lists.openstreetmap.org/listinfo/josm-dev ___ dev mailing list dev@openstreetmap.org http://lists.openstreetmap.org/listinfo/dev
Re: [josm-dev] Git mirror of JOSM on GitHub
Thats great, I will test build it. I have been dreaming last night about compiling josm with the GNU Java Compiler: http://gcc.gnu.org/java/ will see how that works out mike On Sat, Apr 24, 2010 at 4:05 AM, Ævar Arnfjörð Bjarmason ava...@gmail.com wrote: I got tired of waiting for `svn up' when rebuilding JOSM and wanted to commit some local patches. So I made a Git mirror of JOSM that I and others can use. It's very handy for getting faster updates, a local history and the ability to patch JOSM without SVN write access: http://github.com/avar/josm It's made with `git-svn`. It has two branches, the master branch is unaltered from git-svn and can be used to bootstrap from git-svn[1]: http://github.com/avar/josm/tree/master The second one is the mirror branch. This one is checked out by default and includes all the svn externals plus this hack to get it to build under Git: http://github.com/avar/josm http://github.com/avar/josm/commit/f5f16565e It would be nice if the core build.xml supported getting the revision from the git history if applicable, but my ant fu didn't suffice to make this happen. Finally this is the script that does the mirroring: http://github.com/avar/josm-mirror It runs through cron every 30 minutes and hits the josm.openstreetmap.org server with `git svn fetch`. I can adjust the frequency if the server admins think this is too much. 1. Example of git-svn bootstrapping: http://trac.parrot.org/parrot/wiki/git-svn-tutorial ___ josm-dev mailing list josm-dev@openstreetmap.org http://lists.openstreetmap.org/listinfo/josm-dev ___ josm-dev mailing list josm-dev@openstreetmap.org http://lists.openstreetmap.org/listinfo/josm-dev
[OSM-dev] got traindirector to compile
hi, I finaly got around to trying traindirector, it now compiles and my autotoolz patch is commited. feel free to try: http://gitorious.org/osm-traindirector http://groups.google.com/group/traindir3?hl=en mike ___ dev mailing list dev@openstreetmap.org http://lists.openstreetmap.org/listinfo/dev
Re: [josm-dev] Copy IDs from JOSM
I am missing that function as well, but CTRL-I (i) will open the object in the browser, that works as well. mike On Wed, Mar 31, 2010 at 8:58 AM, NopMap ekkeh...@gmx.de wrote: Hi! Is there a way to get the ID of a currently selected item in JOSM into the clipboard? bye Nop -- View this message in context: http://n2.nabble.com/Copy-IDs-from-JOSM-tp4829345p4829345.html Sent from the JOSM Development mailing list archive at Nabble.com. ___ josm-dev mailing list josm-dev@openstreetmap.org http://lists.openstreetmap.org/listinfo/josm-dev ___ josm-dev mailing list josm-dev@openstreetmap.org http://lists.openstreetmap.org/listinfo/josm-dev
Re: [josm-dev] Copy IDs from JOSM
NICE! On Wed, Mar 31, 2010 at 10:59 AM, André Riedel riedel.an...@gmail.com wrote: CTRL-C works fine. ;-) 2010/3/31 jamesmikedup...@googlemail.com jamesmikedup...@googlemail.com: I am missing that function as well, but CTRL-I (i) will open the object in the browser, that works as well. mike On Wed, Mar 31, 2010 at 8:58 AM, NopMap ekkeh...@gmx.de wrote: Hi! Is there a way to get the ID of a currently selected item in JOSM into the clipboard? bye Nop -- View this message in context: http://n2.nabble.com/Copy-IDs-from-JOSM-tp4829345p4829345.html Sent from the JOSM Development mailing list archive at Nabble.com. ___ josm-dev mailing list josm-dev@openstreetmap.org http://lists.openstreetmap.org/listinfo/josm-dev ___ josm-dev mailing list josm-dev@openstreetmap.org http://lists.openstreetmap.org/listinfo/josm-dev ___ josm-dev mailing list josm-dev@openstreetmap.org http://lists.openstreetmap.org/listinfo/josm-dev ___ josm-dev mailing list josm-dev@openstreetmap.org http://lists.openstreetmap.org/listinfo/josm-dev
Re: [OSM-dev] [HOT] Open Street Map
Hi, there are many answers and your question is vague. I think the best start would be the export function : http://www.openstreetmap.org/export?lat=41.82lon=20.07zoom=8layers=B000FTFT you can create an iframe and embed that on your webpage. you can extend open layers to include more data on top of that. Otherwise, you can setup a mapnik renderer to render you own maps. setting up your own server is involved, so be prepared to do alot of work. I dont know if hot is the right list for this, I think dev or talk is better. mike On Wed, Mar 24, 2010 at 7:35 AM, John Yumbya jyum...@yahoo.com wrote: Hi all, can I download Open Street Map for my own purposes. Like running the map on my servers. If yes how do i do it. John ___ HOT mailing list h...@openstreetmap.org http://lists.openstreetmap.org/listinfo/hot ___ dev mailing list dev@openstreetmap.org http://lists.openstreetmap.org/listinfo/dev
[OSM-dev] Fwd: LinkedGeoData Google Code Project Started
FYI: The linked geodata for OSM (rdf) has released code today http://code.google.com/p/linkedgeodata/ -- Forwarded message -- From: Jens Lehmann lehm...@informatik.uni-leipzig.de Date: Wed, Mar 24, 2010 at 9:31 AM Subject: LinkedGeoData Google Code Project Started To: linked-geo-d...@googlegroups.com Hello, as we indicated in previous messages, we are now starting to open source the LinkedGeoData code: http://blog.aksw.org/2010/linkedgeodata-google-code-project-started/ It will take a while for the code to be usable externally, but you can already use the issue tracker to add (or vote for) bugs and feature requests. Kind regards, Jens -- Dipl. Inf. Jens Lehmann Department of Computer Science, University of Leipzig Homepage: http://www.jens-lehmann.org GPG Key: http://jens-lehmann.org/jens_lehmann.asc -- You received this message because you are subscribed to the Google Groups Linked Geo Data group. To post to this group, send email to linked-geo-d...@googlegroups.com. To unsubscribe from this group, send email to linked-geo-data+unsubscr...@googlegroups.comlinked-geo-data%2bunsubscr...@googlegroups.com . For more options, visit this group at http://groups.google.com/group/linked-geo-data?hl=en. ___ dev mailing list dev@openstreetmap.org http://lists.openstreetmap.org/listinfo/dev
Re: [OSM-dev] [Imports] Inserting OSM data
On Tue, Mar 23, 2010 at 12:50 PM, Frederik Ramm frede...@remote.org wrote: Jaak Laineste wrote: 1) my inserted data (tag, node, relation, way - any of them) can be defined as private, nobody else can not even see it. 2) my data is protected - you can see, but not modify 3) my data has group privacy/protection under my control: I can give view/ modify / delete permissions to specific users/groups These three are, in my opinion, not compatible with the spirit of OSM. If you want your own data, store it somewhere else ;-) Yes, as soon as you license your data under CC-SA you are explicitly allowing people to modify it. I think the whole idea of putting the data in osm is not just for making a pretty picture, but for contributing data for others to build upon. mike ___ dev mailing list dev@openstreetmap.org http://lists.openstreetmap.org/listinfo/dev
Re: [OSM-dev] patch for nomatim
Hi Brian, Thanks for you help. Hey that is great, It works now. I did not want to bad mouth anyones code. I was just happy it works. Mike On Mon, Mar 22, 2010 at 3:05 AM, Brian Quinion openstreet...@brian.quinion.co.uk wrote: On Sun, Mar 21, 2010 at 2:51 PM, jamesmikedup...@googlemail.com jamesmikedup...@googlemail.com wrote: I have problems with the current nomatim code to connect to the database. http://trac.openstreetmap.org/ticket/2813 You made an IRC request, a mailing list post, a trac bug report [1], a comment on your blog [2] and one on your diary [3]. All of these state that the database code didn't work and that you had to 'hack' it when in fact it works fine. You added an extra / to your DSN, that is the whole problem. Better yet the comment in your own test script[1] gives the reason for your problem if you look closely. Please stop bad mouthing other peoples code - or at least make sure it is true first. -- Brian [1] http://trac.openstreetmap.org/attachment/ticket/2813/test.php [2] http://osmopenlayers.blogspot.com/2010/03/nomatim-kosovo-and-albania-running.html [3] http://www.openstreetmap.org/user/h4ck3rm1k3/diary/10067 [4] http://trac.openstreetmap.org/attachment/ticket/2813/test.php ___ dev mailing list dev@openstreetmap.org http://lists.openstreetmap.org/listinfo/dev
Re: [OSM-dev] Inserting OSM data
What we did for a similar project in kosovo[1] is to create a set of files on archive.org split by 10k gps points, they are being traced over by volunteers. we processed the csv data into osm files wih perl. If you need help setting that up, please let me know. retrospectivly it is better to create gpx files instead of osm files. mfg, mike [1] http://wiki.openstreetmap.org/wiki/Kosovo_LogisticsPlus_Tracing 2010/3/22 Andreas Höschler ahoe...@smartsoft.de Hi all, we are collecting huge amounts of GPS-tracks with a fleet of vehicles with on-board computers. These tracks are used internally for a bunch of purposes (vehicle monitoring, etc ). We have to maintain our own database of tracks, add properties like a so a called pickupCondition, which determines how good a track is (e.g. paved, muddy, never use it when it's raining,...). We would like to insert this collected data into the OSM database and am looking for the best way to do that. We have the data in our ERP system. Users are supposed to review the collected tracks, add properties (pickupCondition). What we plan to do is to use the public OSM data, add the self-collected tracks and use the resulting dataset to generate map, calculate routes, etc. We need to do it that way, because • our users cannot use the official OSM editor for several reasons (to complicated, no direct access to our tracks,...) • the grab OSM data from public server and compile the data for our mapserver, routeserver,...-cycle is too long. It would take 1-2 weeks until entered data would show up in our ERP. However, we want to pass our track data to the OSM project and are looking for a neat way to do that. We can convert our data to any format (some kind of CSV or XML preferred). We just need a TCP interface to post them to or a destination email address where to send the files to. Simply uploading the tracks to some server is no good solution. When a user creates a track in our database it gets a primary key but of course can't be assigned an official OSM ID yet. So the upload process would need to be as follows: Iterate through al newly created tracks - send a track with nodes to the OSM server and receive IDs for the way and the nodes - assign these IDs to our private database objects and thus marking them sent and no longer new For that we need some kind of TCP-based XML interface so that we could send a track in some XML format to a TCP socket and get back the IDs assigned to objects by the public OSM database server. Only that would allow us the assign the returned IDs to our private database objects and thus avoid data duplication. Is there such an API (TCP-socket based)? What's our best option? Thanks a lot, Andreas ___ dev mailing list dev@openstreetmap.org http://lists.openstreetmap.org/listinfo/dev ___ dev mailing list dev@openstreetmap.org http://lists.openstreetmap.org/listinfo/dev
Re: [OSM-dev] Inserting OSM data
On Mon, Mar 22, 2010 at 3:54 PM, Maarten Deen md...@xs4all.nl wrote: On Mon, 22 Mar 2010 15:19:43 +0100, Andreas Höschler ahoe...@smartsoft.de wrote: Hi John, For that we need some kind of TCP-based XML interface so that we could send a track in some XML format to a TCP socket and get back the IDs assigned to objects by the public OSM database server. Only that would allow us the assign the returned IDs to our private database objects and thus avoid data duplication. Is there such an API (TCP-socket based)? It's not that simple, because you may need to deal with merging, alternatively you could produce .osm files similar to what JOSM produces and then people can load those files into JOSM and merge or add data to OSM. Creating OSM files would be easy for us. But where would we sent them? Simply put them on our webserver and make an announcement on the osm list hey, we have some osm data to be merged/imported! Have fun!!? That's the basic thought. Have a look at the projectpages for the various Kosovo imports on http://wiki.openstreetmap.org/wiki/Category:Kosovo. If this gets coordinated with a group of local mappers (in case there already is data present) then I don't see a big problem. The other problem is how do we get to know that one of our ways got imported into the public OSM database and thus assigned an ID so that we can get rid of that way in our private database? Only by investigating the new data and comparing it to your own data. As you can see on some of the Kosovo pages, there is a link to a changeset. This is a collection of all the items that got added/changed. This could be used to check against your local data. Yes, we have had good results with the spoonful imports done by people. I would say that if you have all this data to share, share it. upload the data to archive.org, put it unter creative commons sharealike commercial, and let us look at it. We can help you prepare it for importing into osm. If you have internal ids, we can also import them if needed, better would be to download the data back out of osm, pull that into a database, the postgis database is easy to use. you should be able to do that matching of the osm data in postgis against your data pretty easily. so, lets see some data samples and then we can talk about details. mike ___ dev mailing list dev@openstreetmap.org http://lists.openstreetmap.org/listinfo/dev
Re: [OSM-dev] Inserting OSM data
On Mon, Mar 22, 2010 at 5:18 PM, Tom Hughes t...@compton.nu wrote: I'm not sure we really want to encourage the use of our database as a storage space for third party identifiers like that. It could get rather out of hand if everybody else wants to attach their own IDs to our data. If someone donates a good chunk of good data to osm then they are also part of the solution. I think that it makes sense to allow people who are maintaining some data to add in IDs for better maintenance. I doubt that the situation where everyone needs to add IDs to everyone else's data will ever occur. mike ___ dev mailing list dev@openstreetmap.org http://lists.openstreetmap.org/listinfo/dev
[OSM-dev] patch for nomatim
I have problems with the current nomatim code to connect to the database. http://trac.openstreetmap.org/ticket/2813 I am trying to see if this works, does the output look alright? php ./util.update.php --index Rank: 0, total to do: 0 Rank: 1, total to do: 0 Rank: 2, total to do: 0 Rank: 3, total to do: 0 Rank: 4, total to do: 0 Rank: 5, total to do: 0 Rank: 6, total to do: 0 Rank: 7, total to do: 0 Rank: 8, total to do: 0 Rank: 9, total to do: 0 Rank: 10, total to do: 0 Rank: 11, total to do: 0 Rank: 12, total to do: 0 Rank: 13, total to do: 0 Rank: 14, total to do: 0 Rank: 15, total to do: 0 Rank: 16, total to do: 0 Rank: 17, total to do: 0 Rank: 18, total to do: 0 Rank: 19, total to do: 0 Rank: 20, total to do: 0 Rank: 21, total to do: 0 Rank: 22, total to do: 0 Rank: 23, total to do: 0 Rank: 24, total to do: 0 Rank: 25, total to do: 0 Rank: 26, total to do: 0 Rank: 27, total to do: 0 Rank: 28, total to do: 0 Rank: 29, total to do: 0 Rank: 30, total to do: 0 php ./util.index.php 100 Session ID: 100 ___ dev mailing list dev@openstreetmap.org http://lists.openstreetmap.org/listinfo/dev
Re: [OSM-dev] need some javascript help
I have done the basic javascript work now. http://github.com/h4ck3rm1k3/OAD-Open-Address-Database/blob/master/OAD/root/static/javascript/oad.js Now I need to setup an nomatim server interface, I am considering setting up my own, using the alternative names we have loaded into the kosovo osm map. Mike On Fri, Feb 26, 2010 at 10:40 PM, jamesmikedup...@googlemail.com jamesmikedup...@googlemail.com wrote: yes the performance is horrid. thanks! I will look into compressing this all and making it tight. it will all be hosted on the server, no need for cross site stuff. thanks, mike On Fri, Feb 26, 2010 at 10:35 PM, Emilie Laffray emilie.laff...@gmail.com wrote: On 26/02/2010 20:59, jamesmikedup...@googlemail.com wrote: OK I have updated the server here : http://119.161.80.223:3000/Controller It is running the lastest code. You can see my demo controller, now I want to change the url of the top frame based on the selection in the bottom one. I guess it might be very easy. there is a great plugin that just allows you to right click on something and show it in a map. the minimap plugin for firefox. Something like that is what I want. but it would be great to be able to also select the location in the map and update the lat /lon. Even to select a street and attach it (data mode osm) this will be a great tool for osm, please help with it. we can use it to create databases of addresses and pull them up in the map, like select a street and find all data rows with the street name in it in that current town. You might want to check the parent functionality in Javascript. In the iframe, you may want to use code like this: var firstiframe = parent.getElementById(addresses); firstiframe.src = http://www.mynewurl;; Please note that this code won't work on your current page as you have a name field instead of an id field, which is what getElementById is getting. Of course, you could use getElementsByName() but the compatibility is not as good. Please check the following page for more information: http://www.quirksmode.org/dom/w3c_core.html However, cross scripting prevention tools might balk at it. Also, for some reason, all files from openlayer are being loaded. YSlow is reporting the following: This page has 205 external Javascript scripts. Try combining them into one. The main openstreetmap site is using only 5 external javascript scripts, so you might want to investigate this for performance reason. Emilie Laffray ___ dev mailing list dev@openstreetmap.org http://lists.openstreetmap.org/listinfo/dev
Re: [OSM-dev] request for hosting of WMS layers
HI, I have offers from hypercube and wms.openstreetmap.de thanks to them for assisting. we can use any services available, meaning if you have hdd bandwidth and cpu to share we can find more data to host. sorry that I have not responded earlier, I need to put some more time into this. what about a way to distribute these layers? I am thinking about putting the map files on a git repo, (well I have them) http://gitorious.org/albanianfloodingcrisiscamp and putting the map data on archive.org. We can host the layers there and then have the map servers download the data when needed by ftp. that would allow for someone to setup a mapserver immediatly and on the fly. I think that would be a worthly project for a bit of scripting. mike On Fri, Mar 19, 2010 at 7:08 PM, Martin Spott martin.sp...@mgras.netwrote: Folks, did you already get to a satisfactory solution ? Martin. -- Unix _IS_ user friendly - it's just selective about who its friends are ! -- ___ dev mailing list dev@openstreetmap.org http://lists.openstreetmap.org/listinfo/dev ___ dev mailing list dev@openstreetmap.org http://lists.openstreetmap.org/listinfo/dev
Re: [OSM-dev] MapServer, OpenStreetMap, OpenLayers + Reprojection from Latlong to Mercator: a real nightmare
please check you mapfile into some git like this http://gitorious.org/albanianfloodingcrisiscamp then i will review it. thanks mike On Wed, Mar 17, 2010 at 10:52 PM, Mulone mul...@rome.com wrote: (apologies for cross-posting) Hi everybody, I'm trying to render openstreetmap data on a WMS on MapServer and I posted something already about this. Now it's time to summarise everything and make some sense of this. The system used to work with epsg:4326 (LATLONG from now on) but in our project we need a GoogleMaps like projection and we chose epsg:900913/epsg:3785 (MERC from now on). This is our problem. We need the image on the right but we're getting the one on the left, a flattened map: http://img7.imageshack.us/img7/8279/imagelw.png After a lot of work and unsucceful tests I post here the outcome, hoping that it will be helpful to the community - and to us :-) These are the steps I followed from the very start: 1) download osm xml file from Cloudmade (e.g. Italy.osm.bz2) 2) Run 900913.sql on my PostGIS (optional, it shouldn't matter). 3) import that file into PostGIS with command (latlong option selected): ./osm2pgsql -U userid -W -H host -d maps -p myprefix -S default.style -c -l italy.osm.bz2 4) At this point everything seems ok. The geometry columns have latlong as SRID and the tables contain geometries. It's possible to visualise this dataset with uDig or other tools and reproject it. 5) Now we want to render this stuff on MapServer. So we add the espg configs from http://spatialreference.org/ref/epsg/3785/ to our mapserver espg file: 900913 +proj=merc +lon_0=0 +k=1 +x_0=0 +y_0=0 +a=6378137 +b=6378137 +towgs84=0,0,0,0,0,0,0 +units=m +no_defs 3785 +proj=merc +lon_0=0 +k=1 +x_0=0 +y_0=0 +a=6378137 +b=6378137 +towgs84=0,0,0,0,0,0,0 +units=m +no_defs 6) define a minimal mapfile with one layer (containing the buildings). 7) run several tests with different projections and annotate the outcome. Have a look at the report: http://docs.google.com/View?id=dftx6j46_166d6r38pcs Does anybody have any idea about how we could tackle this issue? I don't know if the problem is arising from MapServer or OpenLayers, so maybe you can help me design a better test to narrow the problem down. I presume a lot of people are doing something similar to us, so others might come across this issue. Cheers, Mulone - Mulone PhD student -- View this message in context: http://n2.nabble.com/MapServer-OpenStreetMap-OpenLayers-Reprojection-from-Latlong-to-Mercator-a-real-nightmare-tp4753261p4753261.html Sent from the Developer Discussion mailing list archive at Nabble.com. ___ dev mailing list dev@openstreetmap.org http://lists.openstreetmap.org/listinfo/dev ___ dev mailing list dev@openstreetmap.org http://lists.openstreetmap.org/listinfo/dev
Re: [OSM-dev] request for hosting of WMS layers
On Tue, Mar 16, 2010 at 9:06 AM, Frederik Ramm frede...@remote.org wrote: Hi, jamesmikedup...@googlemail.com wrote: I would like to request that my WMS layers for the albanian flooding crisis get hosted on dev.openstreetmap.org http://dev.openstreetmap.org . we have setup a server for them, and I am happy to host them, but it would be better to have them on the osm server. Where were the Haiti images hosted, and is that same option not available or not workable for other imagery? http://hypercube.telascience.org/haiti/layers.html Or were they on dev also? I found this sever : *wms*.*openstreetmap*.de I can setup the server myself if needed. I have been running an mapserver now for the flooding project, all I need is an account with permissions. thanks, mike ___ dev mailing list dev@openstreetmap.org http://lists.openstreetmap.org/listinfo/dev
Re: [OSM-dev] request for hosting of WMS layers
Lets see: The russian toplogical maps 24Gbekim/spatial_data/raster_data/topo_maps/ussr/ But they are converted to tiffs so much bigger. I guess we could go back the ECW proprietary compressed jpeg.. but that needs special drivers. http://xhema.flossk.org:8080/mapdata/02/bekim/spatial_data/raster_data/topo_maps/ussr/050k_utm/ The dlr sat photos : Madeira flooding : 1.8Ghttp://xhema.flossk.org:8080/mapdata/02/mdupont/dlr/portugal I guess we are using about 30-50gb of data right now. The conversion to tiffs expands that alot. The DLR photos in general about 200mb for each compressed jpg file. mike On Tue, Mar 16, 2010 at 10:06 AM, Jochen Topf joc...@remote.org wrote: On Tue, Mar 16, 2010 at 08:13:04AM +0100, jamesmikedup...@googlemail.comwrote: My server is getting slower and slower... and running out of memory. How much disk space do you need? Jochen -- Jochen Topf joc...@remote.org http://www.remote.org/jochen/ +49-721-388298 ___ dev mailing list dev@openstreetmap.org http://lists.openstreetmap.org/listinfo/dev
Re: [OSM-dev] request for hosting of WMS layers
I would like to humbly suggest that we start with the DLR images that are coming out: I have prepare Madeira already: http://xhema.flossk.org:8080/mapserver/madeira_ll.map I hope that the new ones are available because they are made due to the charter call, see the permission mail from the albanian flooding : http://lists.openstreetmap.org/pipermail/legal-talk/2010-January/003191.html The images are about 100mb each, georeferenced jpeg. There are new ones coming out for Turkey and Hungary. mike On Tue, Mar 16, 2010 at 12:07 PM, Sven Geggus li...@fuchsschwanzdomain.dewrote: Jochen Topf joc...@remote.org wrote: I contacted the guy running wms.openstreetmap.de /me to see whether we have some space on that server. I think we are running out of disk space, but we'll see. There are still about 700 Gigabytes available so we will probably be able to host at least some of the data. wms.openstreetmap.de already has a wms and a tile server so that images would be available for JOSM and Potlatch. Yes! Infrastructure is already up and running. Sven -- The source code is not comprehensible (found in bug section of man 8 telnetd on Redhat Linux) /me is gig...@ircnet, http://sven.gegg.us/ on the Web ___ dev mailing list dev@openstreetmap.org http://lists.openstreetmap.org/listinfo/dev ___ dev mailing list dev@openstreetmap.org http://lists.openstreetmap.org/listinfo/dev
Re: [OSM-dev] Spam in Users' Diaries and Users' Pages
What about a default filter for the main page that only shows people who have x number of edits. Or allow people who are established user to approve or vote on new entries from new people. I think there should be a way to report spam effectively, that would be the best solution. mike On Mon, Mar 15, 2010 at 2:21 PM, Eugene Alvin Villar sea...@gmail.comwrote: Hi guys, The spam on users' diaries and users' pages is getting quite annoying. Some user just now flooded the main diary page with drug ads. Using rel=nofollow is apparently not much of a deterrent. I think one really effective way of dealing with this is to reject addition of a user description or a diary entry if the user is quite new and has no OSM edits yet. This would correspond to the Wikipedia user without the autoconfirmed bit set yet. What do you guys think? (Then again, it may be that the sysads can currently handle the volume now so this change in the site software is not needed.) Eugene (osm:seav) ___ dev mailing list dev@openstreetmap.org http://lists.openstreetmap.org/listinfo/dev ___ dev mailing list dev@openstreetmap.org http://lists.openstreetmap.org/listinfo/dev
Re: [OSM-dev] [OSM-talk] GSoC'10
That is a great idea. What about making video as well, on how to use OSM/JOSM/Potlatch how to get started. Video Screencasts? mike On Thu, Mar 11, 2010 at 11:01 AM, Peteris Krisjanis pec...@gmail.comwrote: For one of OSM GSoC'10 projects I would like to suggest unofficial guide for mapping. We all know that there is a little haos in tagging (some says it's good, some says it bad), but so far biggest confusion comes from not how to tag things, but how to tag complex situations or how to even map complex situations (and that's without even taking micro mapping into account). What we need is nice guide where is said - basic roads are maped like this, crossroads created this way, this must be connected with that, etc. It would also create a nice little base for futher experiments and ideas. There's nothing wrong with seeking out alternative tags or ways of mapping, but this at least should be documented somewhere. More or less everyone who would take this task would have to go trough all archives, look for discusions and conlusions (and even if there is no conlusion, writing down all sane opinions would help greatly) and write it down in casual user manual style. Just a idea, but I think worth to explore, cheers, Peter. 2010/3/11 Graham Jones grahamjones...@googlemail.com: Mike. Thank you for your suggestion. I do not know where the apache licence ref comes from. This year's application says GPL with a note saying some is PD. Graham On Mar 11, 2010 7:36 AM, jamesmikedup...@googlemail.com jamesmikedup...@googlemail.com wrote: My GSOC suggestion : Get the potlatch running without any Adobe software, use gnash. http://wiki.openstreetmap.org/wiki/GSoC_Project_Ideas_2010#Porting_of_Potlatch_to_use_FLOSS_tools_and_viewer Also why does google list OSM as being apache licensed? http://code.google.com/soc/2008/streetmap/about.html Preferred license: Apache License, 2.0 Since when? I am putting all my new code under the affero GPL 3.0. mike On Fri, Feb 12, 2010 at 4:44 PM, Rajan Vaish vaish.ra...@gmail.com wrote: Thanks Graham, ... ___ talk mailing list t...@openstreetmap.org http://lists.openstreetmap.org/listinfo/talk -- mortigi tempo Pēteris Krišjānis ___ dev mailing list dev@openstreetmap.org http://lists.openstreetmap.org/listinfo/dev
Re: [josm-dev] Endless bugfixing
Hello, May I make a suggestion? create a java 6.0 branch and run that in parallel until it works. mike ___ josm-dev mailing list josm-dev@openstreetmap.org http://lists.openstreetmap.org/listinfo/josm-dev
Re: [OSM-dev] Openstreetmap and the AMD 48 core contest
here is my submission : http://xhema.flossk.org:8081/blog/members/h4ck3rm1k3/activity/204/ My submission to AMD, what would I do with 48 cores. 1. remove windows and install debian GNU Linux 2. setup a mapserver for the giscorp/openstreetmap project. 3. setup gdal tools to process the gigabytes of image files we have. 4. setup an mapnik rendering engine 5. use the 48 core for compiling mapnik, it is a beast. 6. install some of my high speed c++ code https://code.launchpad.net/~jamesmikedupont/+junk/EPANatReghttps://code.launchpad.net/%7Ejamesmikedupont/+junk/EPANatRegand tune that for processing the osm data on many cores. t 7. setup a feed from the openstreetmap changes server to download and process all new data from osm. 8. setup a splitting tool to split all the osm data into smaller files and then host them on a git server for easy access. I don’t even need physical access to the machine, just put it on the net and give me the root password! mike On Wed, Mar 10, 2010 at 4:16 AM, SteveC st...@asklater.com wrote: thanks kevin anyone want to apply for this? On Mar 8, 2010, at 11:52 PM, Kevin's Hobbies - www.scale18.com wrote: Hi Steve, I saw this in a recent slashdot submission page and I thought that you guys might be interested. What Would You Do With 48 Cores? The AMD Server team is kicking March off with a new contest. We are seeking your best essays, videos, or blog posts documenting how you might use 48 cores. One winner will be selected and awarded with: * Four new AMD Opteron™ processors Model 6174, 12-core (2.2 GHz) * TYAN S8812 motherboard: the motherboard is a Tyan S8812 that features 4 processor sockets with the capacity for you to install up to 8 DIMMs per socket * one copy of Windows Server® 2008 Approximate retail value of all prizes is $8,189 USD. http://blogs.amd.com/work/2010/03/03/48-cores-contest/ Cheers, Kevin Pickell http://code.google.com/p/gpsturbo/ Yours c. Steve ___ dev mailing list dev@openstreetmap.org http://lists.openstreetmap.org/listinfo/dev ___ dev mailing list dev@openstreetmap.org http://lists.openstreetmap.org/listinfo/dev
[OSM-dev] First version of long way splitter for gdalcontour output
Hi all, As you my know there is a great tool call gdalcontour that will help trace sat images. The problem with it, it produces a huge amount of data. I have been working on how to process this data. First I used shp2osm.pl to produce osm files from the output, but they are still huge. Then I used my modified version that splits into 100 way packages. http://xhema.flossk.org:8080/mapdata/02/mdupont/dlr/contours/shp2osm_split.pl Now today, I have rewarmed my c++ processing tool for high speed, single-pass osm processing, I have a program FindClosedWays (compiled version) http://xhema.flossk.org:8080/mapdata/03/EPANatReg/FindClosedWaysthat will emit only closed ways and only the ones above a certain length. That way you can remove alot of the junk. This can be used for lakefinding and also forest finding. The image data can be preprocessed with different tools to extract colors, or apply filtering. here is my blog post for it, http://osmopenlayers.blogspot.com/2010/03/first-version-of-way-cutter.html Code and compiled version is here : http://xhema.flossk.org:8080/mapdata/03/EPANatReg/?C=M;O=A The code is also checked into the bzr repo on launchpad. I hope to make more filter features, for example to split data on a keyfield into new files, or to be able to process I will also look into how my tools can fit into the ogr/gdal toolkit, I wonder why they dont deal with OSM data, or do they? there is the ogr2osm tool as well. Also we have this http://www.gnu.org/software/libredwg/ as a possible future datasource as well as my work on the dime/twonickets dxf2osm. And I have been working on the mapnik c++ code that is stalling atm. All of those programs work on structured geometry files. We should have a simple template callback system that can be adapted to all these tools to be able to process and emit structured data from them. Of course we can just use OSM as our file format, and that is what I am doing here. I am also working with skippern on brasilian cad files. We are in the negotiations on getting a huge load of cad files from albania at the moment. When that happens, we will need tools to splitup and extract features from them. Now my code works in a single pass, at least over the entire data. It builds up node indexes to remove duplicate, and processes the waypoints of each roads 3 times, one to read them and look for duplicates and one to emit the nodes. This can be optimized further. I have exploited the following optimisations : 1. the nodes are all declared before they are referenced. 2. the xml is not nested, its basically flat. I admit the code is not as clean as I would like it, but the speed and flexibility is promising, one area of the code that is a problem is the end node handling, there I introduced an enum to track in what node type I am in. this code needs to be refactored into the base class. The program is invoked like this : ./FindClosedWays INPUT LENGTH OUTPUT ./FindClosedWays inputways_2054100.osm 50 test_out_contour_ways_2054100.osm As I have talked about previously, there is a great need for some high speed c++ processing in osm. I hope to make these tools to be usable in a plug in processing schema. So you can activate certain features via including the templates for the algorithms and have the data shared. Anyway, I hope some of my ideas will be adopted in OSM some day. mike ___ dev mailing list dev@openstreetmap.org http://lists.openstreetmap.org/listinfo/dev
Re: [OSM-dev] First version of long way splitter for gdalcontour output
I have not done any monster forests, It is just in the beginning. Feel free to try the program on a big file, I would be interested to know how it works. any bug reports will be processed asap. I have updated the blog post, at the bottom you will see two features i extracted and the source. I hope to have some more results soon, mike On Wed, Mar 10, 2010 at 9:21 PM, Nic Roets nro...@gmail.com wrote: On Wed, Mar 10, 2010 at 8:54 PM, jamesmikedup...@googlemail.com jamesmikedup...@googlemail.com wrote: ... Now my code works in a single pass, at least over the entire data. It builds ... This can be optimized further. I have exploited the following optimisations ... I process the entire planet every week (+- 5 passes, +-12 counting compression and decompression). I guess I'll be able to cope if the planet grows by 40% p.a, but you make it sound if that is too slow for you. On a less predicting the future topic: Can you please point me to some of these monster forests or lakes you've uploaded, so that I can check that my software can handle them ? What about Potlatch ? ___ dev mailing list dev@openstreetmap.org http://lists.openstreetmap.org/listinfo/dev
Re: [OSM-dev] First version of long way splitter for gdalcontour output
yes, you can also process the images beforehand to increase the contrast. I have been experimenting with that, using gimp , imagemagick and some of the gdal tools. Will be posting updates when I have more info. Yes I think this could be put into an editor. It could even be made an online service. This method extracts areas of the same color, so you can see from the radarsat that it can extract the purple areas. the only problem is the CPU, it uses alot, gdalcontour and also produces huge files... but we will get there some day. mike On Wed, Mar 10, 2010 at 10:19 PM, Graham Jones grahamjones...@googlemail.com wrote: James, This sounds interesting - to make sure I understand are you saying that you can use gdalcontour to process image files and extract boundaries from itlike forests from satellite images? I had never thought of doing that - what a good idea! I thought it would only have worked with monochrome images. I would really like this because I am keen to add forests to the map to help with outdoor navigation, but my eyes are not up to tracing them from satellite images. Is this something that could be automated into an editor to highlight areas you might want to trace around? Regards Graham. On 10 March 2010 20:25, jamesmikedup...@googlemail.com jamesmikedup...@googlemail.com wrote: I have not done any monster forests, It is just in the beginning. Feel free to try the program on a big file, I would be interested to know how it works. any bug reports will be processed asap. I have updated the blog post, at the bottom you will see two features i extracted and the source. I hope to have some more results soon, mike On Wed, Mar 10, 2010 at 9:21 PM, Nic Roets nro...@gmail.com wrote: On Wed, Mar 10, 2010 at 8:54 PM, jamesmikedup...@googlemail.com jamesmikedup...@googlemail.com wrote: ... Now my code works in a single pass, at least over the entire data. It builds ... This can be optimized further. I have exploited the following optimisations ... I process the entire planet every week (+- 5 passes, +-12 counting compression and decompression). I guess I'll be able to cope if the planet grows by 40% p.a, but you make it sound if that is too slow for you. On a less predicting the future topic: Can you please point me to some of these monster forests or lakes you've uploaded, so that I can check that my software can handle them ? What about Potlatch ? ___ dev mailing list dev@openstreetmap.org http://lists.openstreetmap.org/listinfo/dev -- Dr. Graham Jones Hartlepool, UK email: grahamjones...@gmail.com ___ dev mailing list dev@openstreetmap.org http://lists.openstreetmap.org/listinfo/dev
Re: [OSM-dev] First version of long way splitter for gdalcontour output
yes, we are just in the process of creating tagging guidelines. setting up the server. There is alot of tagcleanup to be done. We are setting up a mapfish server , and later will have a mapnik and a railsport. I think we can pull all the floodzone data into a shapefile when we are finished, it wont be needed. But a lot of the flooded houses were built illegally, and in fact the fact that the water floods that area easily could be a feature of the map. For the urban planning project I am trying to support in dragash, the southern tip of kosovo, next to albania, they are also interested in doing civil planning using some osm data and other tools. I dont know enough about it, but maybe it would be interesting to model the ground contours enough to model where the water can raise to. We also have the DEM and STRM data for that area from bekim from immap, and still need to process that. We have also more shapefiles with the rivers and streams. http://wiki.openstreetmap.org/wiki/AlbanianFloodingCrisisCamp/Layers see the rivers section. We need to create tagging guidelines for all those areas in kosovo and albania we have been working on. I am painfully aware of the shortcomings, and hope that you will have patience. mike On Wed, Mar 10, 2010 at 10:35 PM, Nic Roets nro...@gmail.com wrote: Ok Mike, I've look at it. It's in an urban area so chances are that it will be useful to someone. But I'm still a bit worried that there is too much detail there, considering what is being imported. One of those segments is shorter than 4m. It's not like a building, where you know someone will be happy if they see their house, or a road where it can influence routing. And you haven't documented your tag (at least not in the obvious place): http://wiki.openstreetmap.org/wiki/Tag:natural%3Dpurple_floodzone http://wiki.openstreetmap.org/wiki/Tag:natural=floodzone http://wiki.openstreetmap.org/wiki/Key:natural Regards, Nic On Wed, Mar 10, 2010 at 10:25 PM, jamesmikedup...@googlemail.com jamesmikedup...@googlemail.com wrote: I have not done any monster forests, It is just in the beginning. Feel free to try the program on a big file, I would be interested to know how it works. any bug reports will be processed asap. I have updated the blog post, at the bottom you will see two features i extracted and the source. I hope to have some more results soon, mike On Wed, Mar 10, 2010 at 9:21 PM, Nic Roets nro...@gmail.com wrote: On Wed, Mar 10, 2010 at 8:54 PM, jamesmikedup...@googlemail.com jamesmikedup...@googlemail.com wrote: ... Now my code works in a single pass, at least over the entire data. It builds ... This can be optimized further. I have exploited the following optimisations ... I process the entire planet every week (+- 5 passes, +-12 counting compression and decompression). I guess I'll be able to cope if the planet grows by 40% p.a, but you make it sound if that is too slow for you. On a less predicting the future topic: Can you please point me to some of these monster forests or lakes you've uploaded, so that I can check that my software can handle them ? What about Potlatch ? ___ dev mailing list dev@openstreetmap.org http://lists.openstreetmap.org/listinfo/dev
Re: [OSM-dev] Hello
Welcome! It is great to see young people interested. The webpage is currently in design, but you can alway make a patch and submit a bug to have it changed: The trac system is here: http://trac.openstreetmap.org/ The source is here: http://svn.openstreetmap.org/sites/rails_port/public/stylesheets/ mike On Thu, Mar 11, 2010 at 5:59 AM, Adrian Cochrane alci...@gmail.com wrote: Hello, First, I am a new developer here. My name is Adrian. I'm only 15, but I'm really keen on contributing to some Open Source, and OSM looks like a very good project that can do with a hand in developing the GUI so normal users can use it. I know the client side web languages, Python, and some C (namely Obj-C for iPhone). I'd like to work on the UI. I have some ideas to make the disabled tabs look better. I have a screenshot attached if it will come across, and the CSS I'd apply to the tabs will be (I tried this out through Web Inspector/Fire Bug debugging interface): text-decoration: line-through; background-color: #bb; color: white Any pointers or suggestions? ___ dev mailing list dev@openstreetmap.org http://lists.openstreetmap.org/listinfo/dev ___ dev mailing list dev@openstreetmap.org http://lists.openstreetmap.org/listinfo/dev
Re: [OSM-dev] GSoC'10
My GSOC suggestion : Get the potlatch running without any Adobe software, use gnash. http://wiki.openstreetmap.org/wiki/GSoC_Project_Ideas_2010#Porting_of_Potlatch_to_use_FLOSS_tools_and_viewer Also why does google list OSM as being apache licensed? http://code.google.com/soc/2008/streetmap/about.html *Preferred license: Apache License, 2.0 Since when? I am putting all my new code under the affero GPL 3.0. * mike On Fri, Feb 12, 2010 at 4:44 PM, Rajan Vaish vaish.ra...@gmail.com wrote: Thanks Graham, The page looks nice. Though, I have also created this page - http://wiki.openstreetmap.org/wiki/GSoC_Project_Ideas_2010, where students can start posting their ideas. I think Things to do http://wiki.openstreetmap.org/wiki/Things_To_Doand Student projectshttp://wiki.openstreetmap.org/wiki/Student_projectspages should be updated, to see what and where OSM's priority lies as of now. This will help students, develop ideas on similar lines. I plan to edit/add pages, as things progress. Regards, Rajan On Fri, Feb 12, 2010 at 4:14 AM, Graham Jones grahamjones...@googlemail.com wrote: Hi All, Following Rajan's prompt I have made a start on a wiki page to detail OSM's participation in the 2010 Google Summer of Code ( http://wiki.openstreetmap.org/wiki/Google_Summer_of_Code/2010). The page includes a draft proposal for OSM to apply to GSoC when the programme starts, but I think it would be worth us starting on a list of potential projects. I have had a look through previous GSoC pages and the 'Student Projects' wiki page, but I am not sure which are still appropriate, and which have been superseded by other work. Please can you give some thought to potential projects for students and add them to the wiki page? The thing to remember is that the projects need to be pretty well defined and be achievable in a relatively short time period. Feel free to add comments to the proposals so that we get the most useful set of potential projects. This is an opportunity for OSM to get some help with coding, and is a useful learning experience for students, so please give some thought to what you would like to see worked on! Thanks Graham. -- Dr. Graham Jones Hartlepool, UK email: grahamjones...@gmail.com On 6 February 2010 11:58, Rajan Vaish vaish.ra...@gmail.com wrote: Hi all, With GSoC'10 not very far, quite a number of students are emailing me to know about OSM's participation in GSoC'10 and what they can expect. I haven't noticed any discussion or page regarding the same (sorry if I missed one?) . Looking forward to know/hear more about it, and ways I can contribute. Thanks, Rajan GSoC'09 - OSM developer. -- Rajan Vaish ASE at Accenture Technology Labs (RD) http://LinkedIn.com/in/RajanVaish ___ dev mailing list dev@openstreetmap.org http://lists.openstreetmap.org/listinfo/dev -- Rajan Vaish ASE at Accenture Technology Labs (RD) http://LinkedIn.com/in/RajanVaish ___ dev mailing list dev@openstreetmap.org http://lists.openstreetmap.org/listinfo/dev ___ dev mailing list dev@openstreetmap.org http://lists.openstreetmap.org/listinfo/dev
Re: [OSM-dev] need some javascript help
OK I have updated the server here : http://119.161.80.223:3000/Controller It is running the lastest code. You can see my demo controller, now I want to change the url of the top frame based on the selection in the bottom one. I guess it might be very easy. there is a great plugin that just allows you to right click on something and show it in a map. the minimap plugin for firefox. Something like that is what I want. but it would be great to be able to also select the location in the map and update the lat /lon. Even to select a street and attach it (data mode osm) this will be a great tool for osm, please help with it. we can use it to create databases of addresses and pull them up in the map, like select a street and find all data rows with the street name in it in that current town. thanks, mike On Wed, Feb 24, 2010 at 8:23 PM, jamesmikedup...@googlemail.com jamesmikedup...@googlemail.com wrote: This is what I have so far, two iframes. The javascript was not working, I dont know why. here is my commit. http://github.com/h4ck3rm1k3/OAD-Open-Address-Database/commit/88b8624a45aee548e087f168409751f9951f4994 Firebug for debugging. Yes I will put all the java script into the controller page, and install callbacks into the children pages. basically what I want is like this maps sidebar for firefox, but with the ability to look at tables of data for the find source. mike On Wed, Feb 24, 2010 at 7:06 PM, Emilie Laffray emilie.laff...@gmail.comwrote: On 24/02/2010 16:03, jamesmikedup...@googlemail.com wrote: thank you! i will start with some greasemonkey to get going. thanks, mike Grease Monkey might not be the best tool to perform javascript debugging and general web debugging. I would suggest firebug as a very good starting point. It will be more efficient. Emilie Laffray ___ dev mailing list dev@openstreetmap.org http://lists.openstreetmap.org/listinfo/dev
Re: [OSM-dev] need some javascript help
yes the performance is horrid. thanks! I will look into compressing this all and making it tight. it will all be hosted on the server, no need for cross site stuff. thanks, mike On Fri, Feb 26, 2010 at 10:35 PM, Emilie Laffray emilie.laff...@gmail.comwrote: On 26/02/2010 20:59, jamesmikedup...@googlemail.com wrote: OK I have updated the server here : http://119.161.80.223:3000/Controller It is running the lastest code. You can see my demo controller, now I want to change the url of the top frame based on the selection in the bottom one. I guess it might be very easy. there is a great plugin that just allows you to right click on something and show it in a map. the minimap plugin for firefox. Something like that is what I want. but it would be great to be able to also select the location in the map and update the lat /lon. Even to select a street and attach it (data mode osm) this will be a great tool for osm, please help with it. we can use it to create databases of addresses and pull them up in the map, like select a street and find all data rows with the street name in it in that current town. You might want to check the parent functionality in Javascript. In the iframe, you may want to use code like this: var firstiframe = parent.getElementById(addresses); firstiframe.src = http://www.mynewurl;; Please note that this code won't work on your current page as you have a name field instead of an id field, which is what getElementById is getting. Of course, you could use getElementsByName() but the compatibility is not as good. Please check the following page for more information: http://www.quirksmode.org/dom/w3c_core.html However, cross scripting prevention tools might balk at it. Also, for some reason, all files from openlayer are being loaded. YSlow is reporting the following: This page has 205 external Javascript scripts. Try combining them into one. The main openstreetmap site is using only 5 external javascript scripts, so you might want to investigate this for performance reason. Emilie Laffray ___ dev mailing list dev@openstreetmap.org http://lists.openstreetmap.org/listinfo/dev
[OSM-dev] need some javascript help
Hi all, I am not a real javascript developer, can you give me some advice on this ; 1. I have a url that will return the map for a location string 2. I have a browser for a database browser. How can I connect two windows to each other, I would like to call a different url in what would its own sub window. so when you click on a text field, and right click on it, select find, it will then refresh the lower map window. does anyone have some java script for this or whant to help? the project is the openaddressdatabase, which uses a generic automatic database table format using the autocrud lib, that generates a nice table with browse and filter for any database. I want to extend this autocrud with a set of menus to search geonames and display it on the map below. what do you think? how to do this best. mike ___ dev mailing list dev@openstreetmap.org http://lists.openstreetmap.org/listinfo/dev
Re: [OSM-dev] need some javascript help
thank you!
i will start with some greasemonkey to get going.
thanks,
mike
2010/2/24 Iván Sánchez Ortega i...@sanchezortega.es
El 24/02/2010 15:25, jamesmikedup...@googlemail.com escribió:
Hi all, I am not a real javascript developer, can you give me some
advice on this ;
[...]
How can I connect two windows to each other, I would like to call a
different url in what would its own sub window. so when you click on
a text field, and right click on it, select find, it will then
refresh the lower map window.
Sounds like you want to use iframes*. Simply put a iframe
id='foo'/iframe somewhere, and that'll be your sub-window. In order for
it to load a URL, you just do
document.getElementById('foo').src='url_goes_here'; in javascript.
* IFrames are evil. Yes, even more evil than FakeSteveC.
Another cleaner option is to use all that AJAX magic stuff to load the
content in a div rather than in an iframe.
May I suggest you the ajax for dummies book? It's a nice hands-on
introduction to this javascript stuff.
Cheers,
--
Iván Sánchez Ortega i...@sanchezortega.es
___
dev mailing list
dev@openstreetmap.org
http://lists.openstreetmap.org/listinfo/dev
Re: [OSM-dev] need some javascript help
thank you! On Wed, Feb 24, 2010 at 5:10 PM, Nick Whitelegg nick.whitel...@solent.ac.uk wrote: Another cleaner option is to use all that AJAX magic stuff to load the content in a div rather than in an iframe. May I suggest you the ajax for dummies book? It's a nice hands-on introduction to this javascript stuff. AJAX is easy. ;-) Particularly if you use prototype (www.prototypejs.org). I don't think I've needed to use an iframe in my life. :-) See, for example (absolute bare-bones example, you have to enter one of the three specified destinations and 010708 for the date): http://www.free-map.org.uk/course/ajaxexample.html The javascript queries the server with what the user entered in the 2 text fields, the server sends a load of text back and loads it into a specified div. Nick ___ dev mailing list dev@openstreetmap.org http://lists.openstreetmap.org/listinfo/dev ___ dev mailing list dev@openstreetmap.org http://lists.openstreetmap.org/listinfo/dev
Re: [OSM-dev] need some javascript help
This is what I have so far, two iframes. The javascript was not working, I dont know why. here is my commit. http://github.com/h4ck3rm1k3/OAD-Open-Address-Database/commit/88b8624a45aee548e087f168409751f9951f4994 Firebug for debugging. Yes I will put all the java script into the controller page, and install callbacks into the children pages. basically what I want is like this maps sidebar for firefox, but with the ability to look at tables of data for the find source. mike On Wed, Feb 24, 2010 at 7:06 PM, Emilie Laffray emilie.laff...@gmail.comwrote: On 24/02/2010 16:03, jamesmikedup...@googlemail.com wrote: thank you! i will start with some greasemonkey to get going. thanks, mike Grease Monkey might not be the best tool to perform javascript debugging and general web debugging. I would suggest firebug as a very good starting point. It will be more efficient. Emilie Laffray ___ dev mailing list dev@openstreetmap.org http://lists.openstreetmap.org/listinfo/dev
Re: [OSM-dev] I converted the rails port to Git
Nice! we should have a git server on the osm site as well! mike On Sun, Feb 21, 2010 at 11:30 PM, Ævar Arnfjörð Bjarmason ava...@gmail.comwrote: We were discussing maybe moving over to Git in #osm and I thought I'd do a quick conversion just to show how easy it is: http://github.com/avar/openstreetmap-website ___ dev mailing list dev@openstreetmap.org http://lists.openstreetmap.org/listinfo/dev
Re: [OSM-dev] Ways and tags to separate tables?
you could run a tagscanner tool like I have posted elsewhere and then just generate a stylesheet. It would be possible to modify the osm2pgsql tool, I have patches for it as well. Right now I am a bit busy, but when I have nothing to do; could look into it. mike On Thu, Feb 4, 2010 at 11:34 AM, Jukka Rahkonen jukka.rahko...@mmmtike.fi wrote: Hi, Osm2pgsql is fine and fast utility for importing OSM data into PostGIS, but it is mainly made for Mapnik rendering. For that it is OK to import just a subset of tags and make a wide schema with an own column for each tag. However, sometimes it would nice to get all the tags available in some database. Has anybody made yet a tool which separates ways and tags to different tables? The way tables could contain just the geometries and OSM_IDs, perhaps separated to points, lines and polygons, and tag tables would hold the tags by using OSM_ID as a foreign key. Perhaps relations should be pushed to a fourth table which accepts all kind of things, including geometry collections. Spatialite would be an ideal output for me but I an not sure if is could take in very big datasets. I have had troubles in creating bigger that 5 gigabyte spatialite databases so perhaps PostGIS would be more safe alternative. -Jukka Rahkonen- ___ dev mailing list dev@openstreetmap.org http://lists.openstreetmap.org/listinfo/dev ___ dev mailing list dev@openstreetmap.org http://lists.openstreetmap.org/listinfo/dev
[OSM-dev] Broken formatting on diary
Hi all, can you please help me remove the broken formatting from my comment here : http://www.openstreetmap.org/user/h4ck3rm1k3/diary/9347 It must be the picture that messes it up. thanks, mike ___ dev mailing list dev@openstreetmap.org http://lists.openstreetmap.org/listinfo/dev
Re: [OSM-dev] Broken formatting on diary
It has been fixed, thanks to TomH on #osm on irc.OFTC.net! mike On Wed, Jan 27, 2010 at 9:30 AM, jamesmikedup...@googlemail.com jamesmikedup...@googlemail.com wrote: Hi all, can you please help me remove the broken formatting from my comment here : http://www.openstreetmap.org/user/h4ck3rm1k3/diary/9347 It must be the picture that messes it up. thanks, mike ___ dev mailing list dev@openstreetmap.org http://lists.openstreetmap.org/listinfo/dev
[OSM-dev] please help transform of coords for Prishtina DXF
I have here a dxf file of Prishtina in high quality. http://www.archive.org/details/PrishtinaStreets I have been able to convert it to lat/lon like this cs2cs +proj=utm +zone=34T +ellps=WGS84 +datum=WGS84 +units=m -f \%.7f\ Problem is that most of the points are in relative position, there is a grid. I have pushed a version of two nickels that can process alot of this : To g...@github.com:h4ck3rm1k3/TwoNickels.git c8e4009..41f23f1 master - master It produces osm files with data in three groups : 1. points that are exact on the mark, (few) 2. points on the equator (0,0) relative to something 3. points that seem to be shifted over from utm34T 720496.25, 506444.9375 - 22.987450699423831679, 4.5791053696411907481 I have created averages of good points versus the shifted ones and came up with these constant shifts: $n -= 187380; $e += 4228672; They are still 15km off of prishtina.. So I would like one of you to please help with the autocad and transform all coordinates into some single form so I can convert them. Or please advice on these points. thanks, mike ___ dev mailing list dev@openstreetmap.org http://lists.openstreetmap.org/listinfo/dev
Re: [OSM-dev] first version of the autocad dxf2osm running with polygons
I can check it in no problem. push: To g...@github.com:h4ck3rm1k3/TwoNickels.git e5c9653..c8e4009 master - master updating local tracking ref 'refs/remotes/origin/master' On Thu, Jan 14, 2010 at 12:28 PM, Jonathan-David SCHRODER jonathan.schro...@gmail.com wrote: I have autoconf (GNU Autoconf) 2.63 and automake (GNU automake) 1.10.2 those macro errors seem to be common between new and old autoconf versions when searching google. I'll dig into that though most projects sheep with a configure.sh why doesn't your repo give that ? thanks for your replies and care ! Take care ! Jonathan On 1/14/10, jamesmikedup...@googlemail.com jamesmikedup...@googlemail.com wrote: I am using : Autoconf version 2.13 automake (GNU automake) 1.11 Strange, but the versions from karmic are different: http://packages.ubuntu.com/de/karmic/automake http://packages.ubuntu.com/de/karmic/autoconf dlocate /usr/bin/autoconf autoconf: /usr/bin/autoconf autoconf2.13: /usr/bin/autoconf autoconf2.13: /usr/bin/autoconf2.13 diversion by autoconf2.13 from: /usr/bin/autoconf diversion by autoconf2.13 to: /usr/bin/autoconf2.50 dlocate /usr/bin/automake automake: /usr/bin/automake-1.11 automake1.4: /usr/bin/automake-1.4 It seems that you can use the newer versions or not. ___ dev mailing list dev@openstreetmap.org http://lists.openstreetmap.org/listinfo/dev
Re: [OSM-dev] first version of the autocad dxf2osm running with polygons
I am using : Autoconf version 2.13 automake (GNU automake) 1.11 Strange, but the versions from karmic are different: http://packages.ubuntu.com/de/karmic/automake http://packages.ubuntu.com/de/karmic/autoconf dlocate /usr/bin/autoconf autoconf: /usr/bin/autoconf autoconf2.13: /usr/bin/autoconf autoconf2.13: /usr/bin/autoconf2.13 diversion by autoconf2.13 from: /usr/bin/autoconf diversion by autoconf2.13 to: /usr/bin/autoconf2.50 dlocate /usr/bin/automake automake: /usr/bin/automake-1.11 automake1.4: /usr/bin/automake-1.4 It seems that you can use the newer versions or not. ___ dev mailing list dev@openstreetmap.org http://lists.openstreetmap.org/listinfo/dev
Re: [OSM-dev] first version of the autocad dxf2osm running with polygons
Just use aclocal automake autoconf that will generate the configure. also you will need the proj stuff i checked in, otherwise if you want to use the standard proje we can patch it. It is hard coded to use the brazil transform. I will help you get this running, are you on irc.freenode.net #osm ? look for Phurl. gotta go out for 1-2 hours will be back mike On Mon, Jan 11, 2010 at 11:17 AM, Jonathan-David SCHRODER jonathan.schro...@gmail.com wrote: Hello James !! Thank you for this project. We have cloned your github http://github.com/h4ck3rm1k3/TwoNickels and we do not manage to just ./configure the project because this file doesn't exist. We plan to use your converter for buildings dxf maps = osm conversion for indoor mapping. Can you help us on compiling your project from the configure file generation step ? Thanks so much !! Jonathan On Mon, Jan 4, 2010 at 9:45 PM, jamesmikedup...@googlemail.com jamesmikedup...@googlemail.com wrote: I have made a version of dime that compiles with gcc on linux and has openstreetmap output. It uses a hacked version of proj, which i want to integrate closely using c++ templates to reduce overhead. It is my opinion that we can add in all these templates to produce a inline template function that does the conversion, this will be able to be optimized very well. here is my diary entry about it: http://www.openstreetmap.org/user/h4ck3rm1k3/diary/9137 example data (OUT_1.osm.bz2) files from brasil : http://ia341329.us.archive.org/1/items/VitoriaOpenstreetmapData/ Code is on github: dime : http://github.com/h4ck3rm1k3/TwoNickels proj.4 : http://github.com/h4ck3rm1k3/ProjC--/ I want to use my new template classes with all these tools to better integrate them. I can imagine that there is one point template that maps all points in all the tools to one register of memory. Meaning that we can replace the types in the older system to synthetic template types that present a facade to the existing interface. Also you can read my diary entries on the EPANatReg, the epa which is a high speed sax2 xerces-c template processor. I have written lots of little command line processors that are very fast. You can make template callbacks access world data in a high speed custom way. a little bit slower that wc, the wordcount. https://code.launchpad.net/~jamesmikedupont/+junk/EPANatReghttps://code.launchpad.net/%7Ejamesmikedupont/+junk/EPANatReg Happy new year. mike ___ dev mailing list dev@openstreetmap.org http://lists.openstreetmap.org/listinfo/dev ___ dev mailing list dev@openstreetmap.org http://lists.openstreetmap.org/listinfo/dev
Re: [OSM-dev] first version of the autocad dxf2osm running with polygons
ok, I am not leaving right now, have another hour. The code for the proj is here : proj/proj.cpp: int ret=pj_transform1(fromProj, toProj, ax, ay, az); the function is : void convertPoint(double x, double y, double rx, double ry) it should be refactored and put into a new file. That function is called to transform the points. You will need to patch it to your needs. You will need to adjust the projection code here : if (!(fromProj = pj_init_plus(+proj=utm +south +ellps=intl +zone=24K +units=m -f \%.7f\ )) ) I have doubled checked the code. There was a problem in the build and some missing files. It now uses the standard Proj, located in /usr/lib/libproj.la Will have to make some autoconf macros to locate that automatically. I have created a bootstrap.sh for you to run, it produces the configure. Instructions : 1. git clone git://github.com/h4ck3rm1k3/TwoNickels.git 2. cd TwoNickels/ 3. bash ./bootstrap 4. ./configure 5. make the resulting binary : dxf2osm is here : ./dxf2osm/dxf2osm sample.dxf sample.osm Please let me know if it works. sorry for any inconveniences. mike On Mon, Jan 11, 2010 at 11:25 AM, jamesmikedup...@googlemail.com jamesmikedup...@googlemail.com wrote: Just use aclocal automake autoconf that will generate the configure. also you will need the proj stuff i checked in, otherwise if you want to use the standard proje we can patch it. It is hard coded to use the brazil transform. I will help you get this running, are you on irc.freenode.net #osm ? look for Phurl. gotta go out for 1-2 hours will be back mike On Mon, Jan 11, 2010 at 11:17 AM, Jonathan-David SCHRODER jonathan.schro...@gmail.com wrote: Hello James !! Thank you for this project. We have cloned your github http://github.com/h4ck3rm1k3/TwoNickels and we do not manage to just ./configure the project because this file doesn't exist. We plan to use your converter for buildings dxf maps = osm conversion for indoor mapping. Can you help us on compiling your project from the configure file generation step ? Thanks so much !! Jonathan On Mon, Jan 4, 2010 at 9:45 PM, jamesmikedup...@googlemail.com jamesmikedup...@googlemail.com wrote: I have made a version of dime that compiles with gcc on linux and has openstreetmap output. It uses a hacked version of proj, which i want to integrate closely using c++ templates to reduce overhead. It is my opinion that we can add in all these templates to produce a inline template function that does the conversion, this will be able to be optimized very well. here is my diary entry about it: http://www.openstreetmap.org/user/h4ck3rm1k3/diary/9137 example data (OUT_1.osm.bz2) files from brasil : http://ia341329.us.archive.org/1/items/VitoriaOpenstreetmapData/ Code is on github: dime : http://github.com/h4ck3rm1k3/TwoNickels proj.4 : http://github.com/h4ck3rm1k3/ProjC--/ I want to use my new template classes with all these tools to better integrate them. I can imagine that there is one point template that maps all points in all the tools to one register of memory. Meaning that we can replace the types in the older system to synthetic template types that present a facade to the existing interface. Also you can read my diary entries on the EPANatReg, the epa which is a high speed sax2 xerces-c template processor. I have written lots of little command line processors that are very fast. You can make template callbacks access world data in a high speed custom way. a little bit slower that wc, the wordcount. https://code.launchpad.net/~jamesmikedupont/+junk/EPANatReghttps://code.launchpad.net/%7Ejamesmikedupont/+junk/EPANatReg Happy new year. mike ___ dev mailing list dev@openstreetmap.org http://lists.openstreetmap.org/listinfo/dev ___ dev mailing list dev@openstreetmap.org http://lists.openstreetmap.org/listinfo/dev
Re: [OSM-dev] amazon AMIs for a full blown openstreetmap.org-like server
I would like to have an account. We could try out some ideas for replacing the database with a lot of small files. mike On Fri, Jan 8, 2010 at 1:42 PM, Emilie Laffray emilie.laff...@gmail.com wrote: 2010/1/8 Jonathan-David SCHRODER jonathan.schro...@gmail.com Hello, Please tell me if I'm replicating any initiative or doing something the wrong or a not-so-good way. I've started this week from an EBS backed (or boot) Ubuntu 8.04 image ami-f6ad409f. I agree to give the .pem file for ssh connection to an instance to anyone willing to collaborate. My idea is to provide an EC2 EBS image with rails port(done) + tile rendering setup(started) + rails port-tile rendering sync scripts(todo) + easy config scripts (why not triggerable on startup with JSON config ala tilecache.org) (todo, not sure I'll have time to it). The list of commands to install is very long. I note down all the commands I type so as to be able to one or more bash scripts to be able to reinstall a similar solution on an Ubuntu N.NN later (by assuming that commands/package names for 8.04 are similar to those for 9.04 etc..). Maybe I'll have 3 bash scripts such as : install_railsport_u804.sh, install_mapnik_u804.sh, install_railsport_mapnik_sync.sh. And I'd need other scripts to go along : setup_rails_port_u804.sh, setup_mapnik_u804.sh and setup_rails_mapnik_sync_u804.sh... What do you think of this ? A recall on the requirements (reply to change them if you'd like to collaborate or request something): - postgres+osmosis+rails port (with 3 dbs : development, testing and production) : filled with nothing for now. setup_rails_port_u804.sh would have a simple calling syntax like : sudo setup_rails_port_u804.sh [--bz2url=http://domain/someRegion.osm.bz2|--bz2file=/path/to/file.osm.bz2] [--forceResetDB (false if omitted)] [--dbName=development(default),other,dbs,to,make,identical,too] [--guessDBLoginPassFromRailsConfig (default is true)] - mapnik tile rendering setup. I want to have a simple script to insert a bz2 + tell to use some style sheets + to tell to render at z=N (max zoom) - cron'able synced file making the Mapnik setup be filled with the Rails ports's data. I plan to get inspiration from the myanmar scripts for this. I'm sorry to repeat this, though, please reply if you know of some linux image (on EC2 or not) hanging somewhere which almost does what I'm trying to achieve and that image is easy to redeploy (ex : .iso or vmware/virtual bos EC2 ami). Well, one quick point: database performance are going to be bad. Someone is currently trying to do something similar in one of the mailing list. Cloud vendor are very good for serving content like a web page. They are extremely poor for database performance. The IO is usually catastrophic. I wouldn't expect any real good performance out of such a system especially for rendering. I think that using cloud technology is for the moment at least a bit pointless. Emilie Laffray ___ dev mailing list dev@openstreetmap.org http://lists.openstreetmap.org/listinfo/dev ___ dev mailing list dev@openstreetmap.org http://lists.openstreetmap.org/listinfo/dev
Re: [OSM-dev] amazon AMIs for a full blown openstreetmap.org-like server
I have been working on c++ code with rtrees and other nice things. depending on what you want to do with it, I think it is fair to make updates very slow if the rendering is very fast... mike On Fri, Jan 8, 2010 at 2:39 PM, Stefan de Konink ste...@konink.de wrote: Op 08-01-10 13:49, jamesmikedup...@googlemail.com schreef: I would like to have an account. We could try out some ideas for replacing the database with a lot of small files. We could just switch to MonetDB get deduplication, and don't require a lot of space ;) ...in other news did anyone try SphinxSearch on OSM data? Since I dislike PostgreSQL's geo-non-indiced functionality. Hence: an index on IsValid(...) is not materialised, I wonder if anyone succesfully applied stuff like: select planet_osm_point.osm_id, planet_osm_polygon.name, planet_osm_point.name from planet_osm_point, planet_osm_polygon where ST_Intersects(planet_osm_point.way, planet_osm_polygon.way) and planet_osm_polygon.name '' and planet_osm_point.name '' and planet_osm_polygon.name planet_osm_point.name; sql_query = select planet_osm_roads.osm_id, planet_osm_polygon.name, planet_osm_roads.name from planet_osm_roads, planet_osm_polygon where st_isvalid(planet_osm_roads.way) AND st_isvalid(planet_osm_polygon.way) AND ST_Intersects(planet_osm_roads.way, planet_osm_polygon.way) and planet_osm_polygon.name '' and planet_osm_roads.name '' and planet_osm_polygon.name planet_osm_roads.name; sql_query = select p2.osm_id, p1.name, p2.name from planet_osm_polygon as p2, planet_osm_polygon as p1 where ST_Intersects(p1.way, p2.way) and p1.name '' and p2.name '' and p1.name p2.name; Stefan ps. TomH thanks for the comment on IRC :D ___ dev mailing list dev@openstreetmap.org http://lists.openstreetmap.org/listinfo/dev ___ dev mailing list dev@openstreetmap.org http://lists.openstreetmap.org/listinfo/dev
Re: [OSM-dev] amazon AMIs for a full blown openstreetmap.org-like server
On Fri, Jan 8, 2010 at 3:23 PM, Stefan de Konink ste...@konink.de wrote: Op 08-01-10 15:09, jamesmikedup...@googlemail.com schreef: I dont know all the details of mapnik, but from what I have seen, using the postgres database is not needed in all cases. I am thinking about It is not required to use the database, but the overhead is in the rendering. I do agree that PostgreSQL will not always give you the fastest results ;) Well you mean a 4k page in memory. But you dont need to have all that data memory mapped. It could be just 4k of data on disk in an array. It could also just be a tiny osm file that is parsed when needed. Tiny would have to be an osmtile in binary format, agreed? Yes, well if you sort the data properly then mapnik would just render the data in a sax callback, right? It would be a single pass over the data to render it, maybe with a second pass to do some touch ups. But given a street you could just draw the street. It has a vector of nodes. imagine the following sequence of events in a sax xml callback : begin tile : process nodes for next street (marking intersections) Process all the intersecting streets (there we need to preprocess the data) process street (process intersections as they go) next street. So you need to look for street crossings, and need to mark the points where they cross as such. I can imagine that might need some work. I am just working this out right now, but I can imagine that if you sorted the streets and knew all the intersections and marked each intersection, storing a ref to it like in nd ref and also had those segments available, then you could just draw the street. Well again, I have not really gotten into mapnik. But I can. Please do so :) Ok, well I will have to.! But lets try and define the problem as rendering an osm file to a tile. That osm file is updated , and rerendered. All the data needed to render is just stored in osmxml in a nice sorted way. You never need all the data at once because you only render a tile at a time. You don't want to store it in XML, it will get huge... and requires again the parsing overhead. And as I pointed out before, we prefer to render 64 tiles at a time. So, you would have 64 tiles of data in one page How big is that? the size of a city. Well I have gotten the parsing down to very small using sax2, it is just a bit slower than reading the file. If you sort the xml data topologically and pack it all in, it could be very easy to process. but you dont need a full postgres database functionality, you just have very basic update of pages of data. In your idea, how would you *update* the storage? My vision of a distributed GIT repository would have the user update the storage when they save it... Now if you have a web user that commits the data or uploads it, then the page of data would be updated by that process the rendering would be triggered and the whole thing checked in. Each tile would be checked in and older versions discarded as needed. Now, if you just have a nice xml file that is compact or an ASN.1 file for higher speed binary or something else, you need to update that. but how often are we talking about update here? Most people are using daily diff files from the main database. those would be split up into the tiles, and the xml would be replaced by a new page, sorting would have to take place. I need to work this all out, but it is possible. I will have to work through the entire pipeline of processing to see if it fits my model, I risk having to put my foot in my mouth here mike ___ dev mailing list dev@openstreetmap.org http://lists.openstreetmap.org/listinfo/dev
Re: [OSM-dev] amazon AMIs for a full blown openstreetmap.org-like server
Ok, well I am going to first work on making the mapnik be able to render an osm file standalone without postgis, will report back when that works. mike On Fri, Jan 8, 2010 at 3:50 PM, Stefan de Konink ste...@konink.de wrote: Op 08-01-10 15:39, jamesmikedup...@googlemail.com schreef: Tiny would have to be an osmtile in binary format, agreed? Yes, well if you sort the data properly then mapnik would just render the data in a sax callback, right? Jup, but you will never get better results of that storing in parts than having it stored in one file and having an index to it. So in that respect you have to mmap the file, for example a post/plane parser, extract the childs, send the childs to Mapnik. I have tested this using MonetDB/XML, that wasn't really a succes ;) Either way you need something that stores that creates an index by a bounding box. You can use rtree's for that sure. But we already have shown that sideway cracking gives far better results. [google: sideway cracking databases] You don't want to store it in XML, it will get huge... and requires again the parsing overhead. And as I pointed out before, we prefer to render 64 tiles at a time. So, you would have 64 tiles of data in one page How big is that? the size of a city. All depending on the zoom level :) Well I have gotten the parsing down to very small using sax2, it is just a bit slower than reading the file. If you sort the xml data topologically and pack it all in, it could be very easy to process. But how are you going to store this, for example if we take a *perfect* filesystem. Will you store everything by nodeid, wayid, relationid? OR will you store everything that is in a tile, in a file marking the tile, having the same structure as the tile server uses? I will have to work through the entire pipeline of processing to see if it fits my model, I risk having to put my foot in my mouth here Sure :) Just start with some smaller country and try to prevent bottlenecks. The worse thing that can happen is TomH saying you are a 'Bonker' (whatever that may mean). Stefan ___ dev mailing list dev@openstreetmap.org http://lists.openstreetmap.org/listinfo/dev
Re: [OSM-dev] amazon AMIs for a full blown openstreetmap.org-like server
So this renderes directly from an osm file? On Fri, Jan 8, 2010 at 4:02 PM, Lennard l...@xs4all.nl wrote: jamesmikedup...@googlemail.com wrote: Ok, well I am going to first work on making the mapnik be able to render an osm file standalone without postgis, will report back when that works. *cough* http://trac.mapnik.org/browser/trunk/plugins/input/osm Will not work with the postgis-based stylesheet. I have not looked into all of this, as I said. From what I know about mapnick, it renders from the database. Compiling now. mike ___ dev mailing list dev@openstreetmap.org http://lists.openstreetmap.org/listinfo/dev
Re: [OSM-dev] amazon AMIs for a full blown openstreetmap.org-like server
http://wiki.openstreetmap.org/wiki/Mapnik#Data_Sources This webpage only talkes about posgis, is there any documentation that covers the osm direct rendering? mike On Fri, Jan 8, 2010 at 4:08 PM, jamesmikedup...@googlemail.com jamesmikedup...@googlemail.com wrote: So this renderes directly from an osm file? On Fri, Jan 8, 2010 at 4:02 PM, Lennard l...@xs4all.nl wrote: jamesmikedup...@googlemail.com wrote: Ok, well I am going to first work on making the mapnik be able to render an osm file standalone without postgis, will report back when that works. *cough* http://trac.mapnik.org/browser/trunk/plugins/input/osm Will not work with the postgis-based stylesheet. I have not looked into all of this, as I said. From what I know about mapnick, it renders from the database. Compiling now. mike ___ dev mailing list dev@openstreetmap.org http://lists.openstreetmap.org/listinfo/dev
Re: [OSM-dev] amazon AMIs for a full blown openstreetmap.org-like server
Ok, this looks great. So, now, that would be my suggestion to use on this amazon webservice. A lot of small osm files, the size of the smallest tile. Now, on thing did occur to me while walking the dog, we could render multiple zoom levels at once. Every time you render the smallest unit (tile) you would render the sections of all the zoom levels and that should prevent you from touching the data at the same time. mike On Fri, Jan 8, 2010 at 6:08 PM, Dane Springmeyer bl...@hailmail.net wrote: On Jan 8, 2010, at 7:19 AM, jamesmikedup...@googlemail.com wrote: http://wiki.openstreetmap.org/wiki/Mapnik#Data_Sources This webpage only talkes about posgis, is there any documentation that covers the osm direct rendering? http://trac.mapnik.org/wiki/OsmPlugin ___ dev mailing list dev@openstreetmap.org http://lists.openstreetmap.org/listinfo/dev
[OSM-dev] first version of the autocad dxf2osm running with polygons
I have made a version of dime that compiles with gcc on linux and has openstreetmap output. It uses a hacked version of proj, which i want to integrate closely using c++ templates to reduce overhead. It is my opinion that we can add in all these templates to produce a inline template function that does the conversion, this will be able to be optimized very well. here is my diary entry about it: http://www.openstreetmap.org/user/h4ck3rm1k3/diary/9137 example data (OUT_1.osm.bz2) files from brasil : http://ia341329.us.archive.org/1/items/VitoriaOpenstreetmapData/ Code is on github: dime : http://github.com/h4ck3rm1k3/TwoNickels proj.4 : http://github.com/h4ck3rm1k3/ProjC--/ I want to use my new template classes with all these tools to better integrate them. I can imagine that there is one point template that maps all points in all the tools to one register of memory. Meaning that we can replace the types in the older system to synthetic template types that present a facade to the existing interface. Also you can read my diary entries on the EPANatReg, the epa which is a high speed sax2 xerces-c template processor. I have written lots of little command line processors that are very fast. You can make template callbacks access world data in a high speed custom way. a little bit slower that wc, the wordcount. https://code.launchpad.net/~jamesmikedupont/+junk/EPANatReg Happy new year. mike ___ dev mailing list dev@openstreetmap.org http://lists.openstreetmap.org/listinfo/dev
Re: [OSM-dev] [ANN] Parsing Library for OSM
Nice! any figures on performance? On Thu, Dec 24, 2009 at 12:49 AM, Tony Morris tonymor...@gmail.com wrote: A library for parsing OpenStreetMap files using HXT into data structures. http://code.google.com/p/geo-osm/ http://hackage.haskell.org/package/OSM -- Tony Morris http://tmorris.net/ ___ dev mailing list dev@openstreetmap.org http://lists.openstreetmap.org/listinfo/dev ___ dev mailing list dev@openstreetmap.org http://lists.openstreetmap.org/listinfo/dev
Re: [OSM-dev] Delete a node
yes. I think, at least the node data like id and version. node id=123 version=3 / mike On Sun, Dec 13, 2009 at 6:54 PM, hy-soft hy-s...@sha-mash.de wrote: the wiki says: http://wiki.openstreetmap.org/wiki/API_v0.6 Delete: DELETE /api/0.6/[node|way|relation]/#id Expects a valid XML representation of the element to be deleted. --- What exactly does the term 'valid XML representation of the element' mean? Is it the same what I would get when downloading the item? ___ dev mailing list dev@openstreetmap.org http://lists.openstreetmap.org/listinfo/dev ___ dev mailing list dev@openstreetmap.org http://lists.openstreetmap.org/listinfo/dev
Re: [OSM-dev] Delete a node
It is not like people want to program an API most of the time. they want to use a simple lib that wraps that api. That is what we need, a libOSM that is up to date and usable in many languages. mike On Sun, Dec 13, 2009 at 9:14 PM, Ian Dees ian.d...@gmail.com wrote: On Sun, Dec 13, 2009 at 2:06 PM, Ævar Arnfjörð Bjarmason ava...@gmail.com wrote: On Sun, Dec 13, 2009 at 19:38, Ian Dees ian.d...@gmail.com wrote: Perhaps you (or others) that spend the time to do the network sniffing could update the wiki API docs so that in the future these questions are answered without a trip to the mailing list? I already know how it works so there's no personal gain for me in spending time in updating the documentation. Is there personal gain for you in spending time on an Open Street Map? :-) It's not just about helping yourself, we are a community after all. ___ dev mailing list dev@openstreetmap.org http://lists.openstreetmap.org/listinfo/dev ___ dev mailing list dev@openstreetmap.org http://lists.openstreetmap.org/listinfo/dev
Re: [josm-dev] Save OSM file without information about changed data
On Sun, Dec 13, 2009 at 1:57 PM, Jonas Krückel o...@jonas-krueckel.de wrote: Hi, I've loaded a local .osm file into JOSM and deleted some relations. Now I want to save this file, but without the information about what I have edited. I don't want to have the action= tags in the .osm file and I also don't want to have any id's changed etc. How can I save it this way? I'm going to process the file locally with other tools and therefore don't need and want this extra information. If you made the edits in josm then you will get the modified flags. you can just strip them out with a little command line magic. sed -e 's;action='delete';;g' -e 's;action='modify';;g' test.osm that will strip out the delete and modify action.s from an osm file. mike ___ josm-dev mailing list josm-dev@openstreetmap.org http://lists.openstreetmap.org/listinfo/josm-dev
Re: [josm-dev] Save OSM file without information about changed data
This attached perl filter purge.pl will remove nodes marked a deleted. you can extend it for ways as well. usage : perl purge.pl version2.osm version21.osm test : mdup...@introspector-desktop:~/Desktop$ diff version2.osm version21.osm 2c2 osm version='0.6' generator='JOSM' --- osm version='0.6' generator='h4ck3rm1k3' 1070d1069 node id='587702957' action='delete' timestamp='2009-12-12T14:09:26Z' uid='131059' user='h4ck3rm1k3' visible='true' version='1' lat='36.5967337' lon='-93.5215472' / mike On Sun, Dec 13, 2009 at 2:34 PM, jamesmikedup...@googlemail.com jamesmikedup...@googlemail.com wrote: On Sun, Dec 13, 2009 at 1:57 PM, Jonas Krückel o...@jonas-krueckel.de wrote: Hi, I've loaded a local .osm file into JOSM and deleted some relations. Now I want to save this file, but without the information about what I have edited. I don't want to have the action= tags in the .osm file and I also don't want to have any id's changed etc. How can I save it this way? I'm going to process the file locally with other tools and therefore don't need and want this extra information. If you made the edits in josm then you will get the modified flags. you can just strip them out with a little command line magic. sed -e 's;action='delete';;g' -e 's;action='modify';;g' test.osm that will strip out the delete and modify action.s from an osm file. mike purge.pl Description: Perl program ___ josm-dev mailing list josm-dev@openstreetmap.org http://lists.openstreetmap.org/listinfo/josm-dev
Re: [OSM-dev] Import of KML Radar sites failing
Hi, I fixed the mines already. I am importing the EPA sites. of course I unzipped it. The gpsbabel produced nothing. mike On Fri, Dec 11, 2009 at 5:22 PM, Thomas Wood grand.edgemas...@gmail.com wrote: jamesmikedup...@googlemail.com wrote: HI there, I have been using gpsbabel to convert data.gov kml files to osm. Here is a problem file that does not work http://www.ncdc.noaa.gov/oa/radar/nexrad.kmz Anyone have some advice? thanks, mike ___ dev mailing list dev@openstreetmap.org http://lists.openstreetmap.org/listinfo/dev Simple, it's not a kml file. (Hint: try unzipping it) Please be careful with bulk imports, I read on one of your diary posts that you messed up the Mines import when following a similar process... ___ dev mailing list dev@openstreetmap.org http://lists.openstreetmap.org/listinfo/dev
Re: [OSM-dev] Import of KML Radar sites failing
Here is what the KML file looks like : wsr nameKBGM/name description![CDATA[SITE: KBGMBRLOCATION: BINGHAMTONBRLATITUDE: 42.2BRLONGITUDE: -75.985BRELEVATION: 1606BRBRORDER DATA: BRA HREF=http://www.ncdc.noaa.gov/nexradinv/chooseday.jsp?id=KBGM;http://www.ncdc.noaa.gov/nexradinv/chooseday.jsp?id=KBGM/A]]/description Point coordinates-75.985,42.21,0/coordinates /Point /wsr wsr On Fri, Dec 11, 2009 at 5:29 PM, jamesmikedup...@googlemail.com jamesmikedup...@googlemail.com wrote: Hi, I fixed the mines already. I am importing the EPA sites. of course I unzipped it. The gpsbabel produced nothing. mike On Fri, Dec 11, 2009 at 5:22 PM, Thomas Wood grand.edgemas...@gmail.com wrote: jamesmikedup...@googlemail.com wrote: HI there, I have been using gpsbabel to convert data.gov kml files to osm. Here is a problem file that does not work http://www.ncdc.noaa.gov/oa/radar/nexrad.kmz Anyone have some advice? thanks, mike ___ dev mailing list dev@openstreetmap.org http://lists.openstreetmap.org/listinfo/dev Simple, it's not a kml file. (Hint: try unzipping it) Please be careful with bulk imports, I read on one of your diary posts that you messed up the Mines import when following a similar process... ___ dev mailing list dev@openstreetmap.org http://lists.openstreetmap.org/listinfo/dev
Re: [OSM-dev] Import of KML Radar sites failing
perfect : http://www.openstreetmap.org/browse/changeset/3350339 now we have 163 radio transponders! On Fri, Dec 11, 2009 at 5:34 PM, Thomas Wood grand.edgemas...@gmail.com wrote: jamesmikedup...@googlemail.com wrote: Hi, I fixed the mines already. I am importing the EPA sites. of course I unzipped it. The gpsbabel produced nothing. mike On Fri, Dec 11, 2009 at 5:22 PM, Thomas Wood grand.edgemas...@gmail.com wrote: jamesmikedup...@googlemail.com wrote: HI there, I have been using gpsbabel to convert data.gov kml files to osm. Here is a problem file that does not work http://www.ncdc.noaa.gov/oa/radar/nexrad.kmz Anyone have some advice? thanks, mike ___ dev mailing list dev@openstreetmap.org http://lists.openstreetmap.org/listinfo/dev Simple, it's not a kml file. (Hint: try unzipping it) Please be careful with bulk imports, I read on one of your diary posts that you messed up the Mines import when following a similar process... It looks like gpsbabel doesn't support the full range of kml options (or the NOAA have seriously messed up their file!) I think mass replacing wsr with Placemark should work... (No guarantees) ___ dev mailing list dev@openstreetmap.org http://lists.openstreetmap.org/listinfo/dev
Re: [OSM-dev] 3d Import into OpenArena working
Hi, Yes I have thought about it. I would use it if I took the time to learn. I agree that a raytraced map could look very pretty. mike On Sat, Oct 17, 2009 at 4:39 PM, Peter Körner osm-li...@mazdermind.de wrote: Hi have you tried using PovRAY [1]? It reads an ASCII-Script and produces wonderful Images from it. PovRAY relates to Blender co. like LaTeX relates to Word. It is very well suited for automated generation of 3D models, as you can see with eagle3D [2] Peter [1] http://www.povray.org/ [2] http://www.matwei.de/doku.php?id=en:eagle3d:eagle3d jamesmikedup...@googlemail.com schrieb: Video, it works http://www.youtube.com/watch?v=hFcUjA6A8pQ Hi all, I am working on importing openstreetmap maps into openarena. Here are my patchs and code and posts : Project Plan and Kick off http://rdfintrospector2.blogspot.com/2009/09/3d-openstreetmap.html Importing into blender http://fmtyewtk.blogspot.com/2009/10/import-into-blender.html How to load an example map into OA http://fmtyewtk.blogspot.com/2009/10/blender-gtkradient-openarena.html lots of pain to get gtkradient running http://fmtyewtk.blogspot.com/2009/10/gtkradiant-running.html Video of export tools http://fmtyewtk.blogspot.com/2009/09/blender-faces-added-to-meshes.html Post on openstreetmap journal http://www.openstreetmap.org/user/h4ck3rm1k3/diary/8068 Mike http://fmtyewtk.blogspot.com/2009/10/mail-to-openarena-forum.html ___ dev mailing list dev@openstreetmap.org http://lists.openstreetmap.org/listinfo/dev ___ dev mailing list dev@openstreetmap.org http://lists.openstreetmap.org/listinfo/dev ___ dev mailing list dev@openstreetmap.org http://lists.openstreetmap.org/listinfo/dev
Re: [OSM-dev] 3d Import into OpenArena working
On Tue, Oct 13, 2009 at 2:33 PM, Nick Whitelegg nick.whitel...@solent.ac.uk wrote: WebGL looks interesting, and am thinking of having a play with it. The main issue I see is it introduces a web dependency; if you're in the field and you don't have web access (or don't want to pay for data download) a standalone mobile application would be useful too. But I agree, it does look very interesting. Yes, I did not even get to run that, it needed some plugin. My entire focus is on FLOSS software. I would like to be able to use an entirely free software stack and tools and avoid API for apis sake. Why need an API when we have the software? mike ___ dev mailing list dev@openstreetmap.org http://lists.openstreetmap.org/listinfo/dev
Re: [OSM-dev] 3d Import into OpenArena working
What about vrml? And blender is an editor. What editor will you use to produce webgl? Blender On Sun, Oct 11, 2009 at 12:46 AM, Stefan Ziegler stefan.ziegler_...@gmx.de wrote: Hello, I think, the future will not be Blender or any gaming engine like openarena. I think, the most used platform will be WebGL, a 3D-rendering API integrated in the browsers, usable with JavaScript. It is already integrated in developer versions of WebKit (Safari, Konqueror) and Firefox. Original-Nachricht Von: jamesmikedup...@googlemail.com jamesmikedup...@googlemail.com Well, I have started on this already Lets just focus on blender as a modeling tool to begin with. There are many other usages for blender models. and the model is basically blender. I hope to in the next step find some good python based rendering code and just get that to work in blender to create 2d models in blender of the objects and then make them 3d by adding in simple infomation. I dont know about scaling, but I can say that for the purposes of gaming, you dont want the maps to be too big. When we get the ability to export to blender in higher quality then belive me, the gaming kiddies will do the porting for you. mike -- Diplom-Informatiker, Homepage: http://www.stefanziegler-online.de/ Wir alle wissen mehr als das, wovon wir wissen, dass wir es wissen. (Thornton Wilder) GRATIS für alle GMX-Mitglieder: Die maxdome Movie-FLAT! Jetzt freischalten unter http://portal.gmx.net/de/go/maxdome01 ___ dev mailing list dev@openstreetmap.org http://lists.openstreetmap.org/listinfo/dev
Re: [OSM-dev] 3d Import into OpenArena working
On Wed, Oct 7, 2009 at 11:27 PM, Stefan Ziegler stefan.ziegler_...@gmx.de wrote: Hello, Original-Nachricht Von: jamesmikedup...@googlemail.com jamesmikedup...@googlemail.com I am open to all ideas. the code is checked in. my next step would be to look into the rendering engines from osm. I would like to be able to walk around a town and be able to markup and interact with the map not fly. My theory is that people will remember map features from a 3d perspective, and that if they walk around thier streets, they will say : the baker should be on that corner. the well known renderers all works in 2d - just drawing pictures/tiles. e.g. mapnik, osmarender. The editors like josm or potlach also works 2d. Interesting may be footnav: http://sourceforge.net/projects/footnav/ Some mails from the mailing list archiv: http://www.mail-archive.com/dev@openstreetmap.org/msg08632.html http://www.mail-archive.com/t...@openstreetmap.org/msg21380.html There are also some renderers for mobile devices (android ...) - but I don't think they are really 3d. Some navigation systems has a 3d perspective but aren't really 3d. Also, i think that it is very important to reach people, and that the gamer community is huge, they have unlimited energy and they will help make openstreetmap better. The problem with blender/openarena is, you can't reload openstreetmap data when you pan to the border of a map file. You have to change the whole program - or write your own, based on a gaming engine. Before starting this, it is better to test, how many nodes/ways can be used at once with a reasonable frame rate. Well, I have started on this already Lets just focus on blender as a modeling tool to begin with. There are many other usages for blender models. and the model is basically blender. I hope to in the next step find some good python based rendering code and just get that to work in blender to create 2d models in blender of the objects and then make them 3d by adding in simple infomation. I dont know about scaling, but I can say that for the purposes of gaming, you dont want the maps to be too big. When we get the ability to export to blender in higher quality then belive me, the gaming kiddies will do the porting for you. mike ___ dev mailing list dev@openstreetmap.org http://lists.openstreetmap.org/listinfo/dev
Re: [OSM-dev] 3d Import into OpenArena working
I am open to all ideas. the code is checked in. my next step would be to look into the rendering engines from osm. I would like to be able to walk around a town and be able to markup and interact with the map not fly. My theory is that people will remember map features from a 3d perspective, and that if they walk around thier streets, they will say : the baker should be on that corner. we can include geotaged pictures on the walls, etc. it is not about weapons and we dont need weapons it is about a mature and easy to use environment. Also, these games dont have to be 17+. you can change them, they are open source. you can shoot paintballs instead. Also, i think that it is very important to reach people, and that the gamer community is huge, they have unlimited energy and they will help make openstreetmap better. mike On Tue, Oct 6, 2009 at 11:44 PM, Stefan Ziegler stefan.ziegler_...@gmx.de wrote: Hello, From: jamesmikedup...@googlemail.com jamesmikedup...@googlemail.com Look at osm3d.org (my sleeping project) or at these flight simulator pages using osm: http://gallery.flightgear.org.uk/c1483094.html http://www.marginal.org.uk/x-planescenery/tools.html A flight simulator might be better than a shooter game (copied from openarena.ws: may not be suitable for children under 17). Do you know how much memory (RAM) a bigger scene (e.g. a town) would need? Even in smaller areas, you have millions of nodes and thousands of ways. Stefan. -- Diplom-Informatiker, Homepage: http://www.stefanziegler-online.de/ Wir alle wissen mehr als das, wovon wir wissen, dass wir es wissen. (Thornton Wilder) Jetzt kostenlos herunterladen: Internet Explorer 8 und Mozilla Firefox 3.5 - sicherer, schneller und einfacher! http://portal.gmx.net/de/go/atbrowser ___ dev mailing list dev@openstreetmap.org http://lists.openstreetmap.org/listinfo/dev ___ dev mailing list dev@openstreetmap.org http://lists.openstreetmap.org/listinfo/dev
[OSM-dev] 3d Import into OpenArena working
Video, it works http://www.youtube.com/watch?v=hFcUjA6A8pQ Hi all, I am working on importing openstreetmap maps into openarena. Here are my patchs and code and posts : Project Plan and Kick off http://rdfintrospector2.blogspot.com/2009/09/3d-openstreetmap.html Importing into blender http://fmtyewtk.blogspot.com/2009/10/import-into-blender.html How to load an example map into OA http://fmtyewtk.blogspot.com/2009/10/blender-gtkradient-openarena.html lots of pain to get gtkradient running http://fmtyewtk.blogspot.com/2009/10/gtkradiant-running.html Video of export tools http://fmtyewtk.blogspot.com/2009/09/blender-faces-added-to-meshes.html Post on openstreetmap journal http://www.openstreetmap.org/user/h4ck3rm1k3/diary/8068 Mike http://fmtyewtk.blogspot.com/2009/10/mail-to-openarena-forum.html ___ dev mailing list dev@openstreetmap.org http://lists.openstreetmap.org/listinfo/dev
Re: [OSM-dev] Open sou...@dtu
Hi there, Well do you mean as coders or as editors? First you should start by reviewing the maps of the places you know. Look up your home town and check if it is ok. If you see something missing, use the editor or josm.openstreetmap.de for fixing it. mike ___ dev mailing list dev@openstreetmap.org http://lists.openstreetmap.org/listinfo/dev
