Re: [OSM-dev] Release candidate for OSM binary format is in osmosis trunk.

2010-09-22 Thread Shaun McDonald

On 22 Sep 2010, at 06:49, Anthony wrote:

 On Tue, Sep 21, 2010 at 6:20 PM, Frederik Ramm frede...@remote.org wrote:
 Easy to do - just download the .osm.pbf and run
 
 osmosis --read-bin country.osm.pbf --write-xml country.osm
 
 Do you have to have java installed to do that?

yes

Shaun


___
dev mailing list
dev@openstreetmap.org
http://lists.openstreetmap.org/listinfo/dev


Re: [OSM-dev] Release candidate for OSM binary format is in osmosis trunk.

2010-09-22 Thread John Smith
On 22 September 2010 17:17, Frederik Ramm frede...@remote.org wrote:
 mkgmap support the new format, and that anyone with Osmosis+Java installed

It might be useful to make a simple C based application that just
converts from the new format to OSM XML, that way you could pipe the
input to the other apps without them needing to support the new format
natively, and without needing osmosis/java...

___
dev mailing list
dev@openstreetmap.org
http://lists.openstreetmap.org/listinfo/dev


Re: [OSM-dev] How to get non-technical users easily editing (offline)?

2010-09-22 Thread Jonathan Bennett

 On 22/09/2010 06:52, Sam Wilson wrote:
 I'm currently thinking of changing this mud-map to use the relevant 
OSM tile as a starting point, and getting the users to sketch in their 
notes and modifications over the top, and then uploading these 
modified tiles to our server from where I can use them as backgrounds 
in JOSM.  I'm just wondering whether anyone's done anything like this 
before.

Take a look at Walking Papers:

http://walking-papers.org/

This does a similar thing, but with printouts that can be given to 
non-technical mappers to make notes on. You then scan the annotated map 
back into Walking Papers, which makes it available as a background in 
Potlatch (or JOSM, if you like).


The printouts are just PDFs, so you may already be able to hack 
something together using Walking Papers, but certain take a look and 
talk to Michal.


Jonathan

___
dev mailing list
dev@openstreetmap.org
http://lists.openstreetmap.org/listinfo/dev


Re: [OSM-dev] How to get non-technical users easily editing (offline)?

2010-09-22 Thread Sam Wilson

 On 2010-09-22 3:47 PM, Jonathan Bennett wrote:

Take a look at Walking Papers:

http://walking-papers.org/

This does a similar thing, but with printouts that can be given to 
non-technical mappers to make notes on. You then scan the annotated 
map back into Walking Papers, which makes it available as a background 
in Potlatch (or JOSM, if you like).


The printouts are just PDFs, so you may already be able to hack 
something together using Walking Papers, but certain take a look and 
talk to Michal.


Yes, of course!  I was working from the idea of Walking Papers, but 
trying to apply it to screen-based editing.  But I could just *use* 
images straight from WP!


The biggest problem I have is that not all of the notes made on the maps 
will be of interest to OSM, and in some cases will contain private 
data.  So I was figuring on doing a fair bit of processing myself 
(there's usually only three or four field assessors doing the data 
collection).  I shall look into getting the JOSM Walking Papers plugin 
to use images from a local source.


(This project, by the way, if anyone's interested, is to assist power 
pole assessors in Western Australia; people who travel thousands of kms 
a month all over the state, driving all the back ways and small roads, 
and taking note of fences, gates, power lines.  We've started using OSM 
data for locating poles, and I thought it'd be nice to feed some of our 
data back in to the map.)


- Sam.

___
dev mailing list
dev@openstreetmap.org
http://lists.openstreetmap.org/listinfo/dev


Re: [OSM-dev] How to get non-technical users easily editing (offline)?

2010-09-22 Thread John Smith
On 22 September 2010 18:10, Sam Wilson s...@archives.org.au wrote:
 (This project, by the way, if anyone's interested, is to assist power pole
 assessors in Western Australia; people who travel thousands of kms a month

Are you planning to upload pole locations to OSM? The poles are of
interest to some, but I'm thinking the pole reference numbers to
lat/lon would be useful. Someone else expressed interest in emergency
phone reference numbers, so they could be used to more quickly locate
people, apparently private road ways don't need to supply this
information to government.

 all over the state, driving all the back ways and small roads, and taking
 note of fences, gates, power lines.

Do these people keep GPS tracks by any chance?

___
dev mailing list
dev@openstreetmap.org
http://lists.openstreetmap.org/listinfo/dev


Re: [OSM-dev] How to get non-technical users easily editing (offline)?

2010-09-22 Thread Sam Wilson

 On 2010-09-22 4:17 PM, John Smith wrote:

On 22 September 2010 18:10, Sam Wilsons...@archives.org.au  wrote:

(This project, by the way, if anyone's interested, is to assist power pole
assessors in Western Australia; people who travel thousands of kms a month

Are you planning to upload pole locations to OSM? The poles are of
interest to some, but I'm thinking the pole reference numbers to
lat/lon would be useful. Someone else expressed interest in emergency
phone reference numbers, so they could be used to more quickly locate
people, apparently private road ways don't need to supply this
information to government.
Ultimately, yes, but although I've got this data now (for all 3,340,068 
of them), it's not allowed to be used.  It's awfully wrong, too, in lots 
of cases!  So, it's forming the basis for pole locating, and then the 
confirmed positions will come back, and hopefully be allowed to be used 
in OSM.  Even if the locations and reference numbers of the poles are 
held back, the other stuff -- roads, tracks, fences, gates, etc. -- will 
be fine to upload.



all over the state, driving all the back ways and small roads, and taking
note of fences, gates, power lines.

Do these people keep GPS tracks by any chance?
Yes!  And they *used* to be accessible to me.  Recently, however, we 
moved to a different system, and I am still negotiating how they can be 
used.  I'm hoping to impress management with the pole locating stuff, 
and then they'll see the value of helping make the map better and better.


- Sam.

___
dev mailing list
dev@openstreetmap.org
http://lists.openstreetmap.org/listinfo/dev


Re: [OSM-dev] How to get non-technical users easily editing (offline)?

2010-09-22 Thread Shaun McDonald
On Wed, September 22, 2010 9:10 am, Sam Wilson wrote:
   On 2010-09-22 3:47 PM, Jonathan Bennett wrote:
 Take a look at Walking Papers:

 http://walking-papers.org/

 This does a similar thing, but with printouts that can be given to
 non-technical mappers to make notes on. You then scan the annotated
 map back into Walking Papers, which makes it available as a background
 in Potlatch (or JOSM, if you like).

 The printouts are just PDFs, so you may already be able to hack
 something together using Walking Papers, but certain take a look and
 talk to Michal.

 Yes, of course!  I was working from the idea of Walking Papers, but
 trying to apply it to screen-based editing.  But I could just *use*
 images straight from WP!

 The biggest problem I have is that not all of the notes made on the maps
 will be of interest to OSM, and in some cases will contain private
 data.  So I was figuring on doing a fair bit of processing myself
 (there's usually only three or four field assessors doing the data
 collection).  I shall look into getting the JOSM Walking Papers plugin
 to use images from a local source.

Have you taken a look at Potlatch2? It allows you to customise the
interface easily, so that only the appropriate things that are needed for
that group of editors is shown, thus making it easier for them.
http://wiki.openstreetmap.org/wiki/Potlatch_2/Deploying_Potlatch_2

Shaun


 (This project, by the way, if anyone's interested, is to assist power
 pole assessors in Western Australia; people who travel thousands of kms
 a month all over the state, driving all the back ways and small roads,
 and taking note of fences, gates, power lines.  We've started using OSM
 data for locating poles, and I thought it'd be nice to feed some of our
 data back in to the map.)

 - Sam.

 ___
 dev mailing list
 dev@openstreetmap.org
 http://lists.openstreetmap.org/listinfo/dev




___
dev mailing list
dev@openstreetmap.org
http://lists.openstreetmap.org/listinfo/dev


Re: [OSM-dev] How to get non-technical users easily editing (offline)?

2010-09-22 Thread Sam Wilson

On 22/09/10 5:55 PM, Shaun McDonald wrote:

Have you taken a look at Potlatch2? It allows you to customise the
interface easily, so that only the appropriate things that are needed for
that group of editors is shown, thus making it easier for them.
http://wiki.openstreetmap.org/wiki/Potlatch_2/Deploying_Potlatch_2


Unfortunately, this all has to work offline, so Potlatch can't help me. 
 But really, that idea of limiting an editor to a specific set of tags 
(etc.) seems great; anyone know if one of the offline editors would lend 
itself to that sort of thing?


- Sam.

___
dev mailing list
dev@openstreetmap.org
http://lists.openstreetmap.org/listinfo/dev


Re: [OSM-dev] How to get non-technical users easily editing (offline)?

2010-09-22 Thread M∡rtin Koppenhoefer
2010/9/22 Peter Körner osm-li...@mazdermind.de:

 You can completely configure the presets available in josm but you can't
 remove the possibility of changing existing data or adding arbitrary tags
 via the tag editor.


You could simply not show the tag editor (I would actually do this for
a declared simple editor directed to newbies).

cheers,
Martin

___
dev mailing list
dev@openstreetmap.org
http://lists.openstreetmap.org/listinfo/dev


Re: [OSM-dev] Release candidate for OSM binary format is in osmosis trunk.

2010-09-22 Thread Scott Crosby
On Wed, Sep 22, 2010 at 2:17 AM, Frederik Ramm frede...@remote.org wrote:

 Hi,


 Kai Krueger wrote:

 Easy to do - just download the .osm.pbf and run
 osmosis --read-bin country.osm.pbf --write-xml country.osm


  May I suggest it be run on planet.openstreetmap.org then as part of the
 core
 services alongside the regular full planet dump?


 Making the excerpts basically occupies a whole big machine for half a day.
 It might be possible to do it on a weekly basis on
 planet.openstreetmap.org (not my call though) but very unlikely to be run
 daily.


Or a 4gb laptop in about 3-4 hours. I've been putting some work into the
mkgmap splitter. It can now split the planet into 1,200 pieces in two
passes.

I did a somewhat more brutal test on an 8gb i7 iMac and it took 4 hours to
split the planet into 20,000 pieces, but required 6700 concurrent open
files.

It doesn't do all of what you might want right now, but it could be adapted.

Three catches:

First, the format the program uses for representing areas to extract is
bounding boxes, but this could be easily fixed; define a new file format,
import some is-point-in-polygon code, and done.

Second, the program doesn't guarantee it will output all member nodes of a
way/relation that cross the border of an area. (In osmosis terms, it returns
--boundingbox completeWays=false completeRelations=false.). However, it
ameliorates this by automatically expanding each bbox in question by adding
an overlap border.

Third, the input format is *.osm.gz or *.osm.pbf. The output is *.osm.gz and
without metadata (version/timestamp/user/...).

Scott

http://www.mkgmap.org.uk/pipermail/mkgmap-dev/2010q3/009033.html
http://www.mkgmap.org.uk/pipermail/mkgmap-dev/2010q3/009038.html
___
dev mailing list
dev@openstreetmap.org
http://lists.openstreetmap.org/listinfo/dev


Re: [OSM-dev] Release candidate for OSM binary format is in osmosis trunk.

2010-09-22 Thread Frederik Ramm

Hi,

Anthony wrote:

Mine would be that I don't feel like installing osmosis+java.


I'm sure we'll get a pure C/C++ implementation sooner or later; even so, 
there certainly will be people who don't feel like installing it.



Another problem would be if osmosis doesn't support piping the output
xml to stdout.


It does support piping the output XML to stdout.


I'd hope there would at least be a reference implementation in C
before the existing standard was removed.
I'm not sure exactly what files it is we're talking about changing, though.


Yes, maybe that was my fault for not making this clear; I am only 
talking about the files that are now being made available on the 
geofabrik.de site. I'm pretty sure that the original planet file will 
remain .osm.bz2 for quite some time.


Bye
Frederik

___
dev mailing list
dev@openstreetmap.org
http://lists.openstreetmap.org/listinfo/dev


Re: [OSM-dev] How to get non-technical users easily editing (offline)?

2010-09-22 Thread Jonathan Bennett

 On 22/09/2010 11:10, Sam Wilson wrote:
Unfortunately, this all has to work offline, so Potlatch can't help 
me.  But really, that idea of limiting an editor to a specific set of 
tags (etc.) seems great; anyone know if one of the offline editors 
would lend itself to that sort of thing?


As with JOSM, Merkaartor can take custom tag templates, which make 
entering data for specific tags easier, and they appear above the 
free-form tag entry fields. Merkaartor also allows you to customise the 
map rendering from within the application (no file editing). However, it 
does need installing, as opposed to JOSM's drop-in operation.


If you're interested in trying Merkaartor, I can come up with a couple 
of simple examples, or pop into the Merkaartor mailing list.


Jonathan

___
dev mailing list
dev@openstreetmap.org
http://lists.openstreetmap.org/listinfo/dev


Re: [OSM-dev] Release candidate for OSM binary format is in osmosis trunk.

2010-09-22 Thread Anthony
On Wed, Sep 22, 2010 at 8:25 AM, Scott Crosby scro...@cs.rice.edu wrote:
 On Wed, Sep 22, 2010 at 2:17 AM, Frederik Ramm frede...@remote.org wrote:
 Making the excerpts basically occupies a whole big machine for half a day.
 It might be possible to do it on a weekly basis on planet.openstreetmap.org
 (not my call though) but very unlikely to be run daily.


 Or a 4gb laptop in about 3-4 hours.

How long does it take to just make a compressed psql binary dump?
Seems that would be just as fast, just as small, and require just as
much installation on the other end to convert into a legacy xml file.

___
dev mailing list
dev@openstreetmap.org
http://lists.openstreetmap.org/listinfo/dev


Re: [OSM-dev] Release candidate for OSM binary format is in osmosis trunk.

2010-09-22 Thread Anthony
On Wed, Sep 22, 2010 at 8:34 AM, Frederik Ramm frede...@remote.org wrote:
 It does support piping the output XML to stdout.

That's good to hear.

 Yes, maybe that was my fault for not making this clear; I am only talking
 about the files that are now being made available on the geofabrik.de site.

And that's great to hear.

How are you going to be making the .pbf files?

___
dev mailing list
dev@openstreetmap.org
http://lists.openstreetmap.org/listinfo/dev


Re: [OSM-dev] Release candidate for OSM binary format is in osmosis trunk.

2010-09-22 Thread Stefan de Konink
-BEGIN PGP SIGNED MESSAGE-
Hash: SHA512

Op 22-09-10 14:34, Frederik Ramm schreef:
 I'm sure we'll get a pure C/C++ implementation sooner or later; even so,
 there certainly will be people who don't feel like installing it.

If noone steps up for the reference implementation before Friday I'll
write one.


Stefan
-BEGIN PGP SIGNATURE-
Version: GnuPG v2.0.16 (GNU/Linux)
Comment: Using GnuPG with Mozilla - http://enigmail.mozdev.org/

iEYEAREKAAYFAkyZ+skACgkQYH1+F2Rqwn0C5gCeJct2LDyH9JgAj/p3zwyBgaQS
+ncAoIM44Bh/rFKFGfWwGWihp7KUZPIG
=vN++
-END PGP SIGNATURE-

___
dev mailing list
dev@openstreetmap.org
http://lists.openstreetmap.org/listinfo/dev


Re: [OSM-dev] Release candidate for OSM binary format is in osmosis trunk.

2010-09-22 Thread Grant Slater
On 21 September 2010 20:38, Kai Krueger kakrue...@gmail.com wrote:
 Frederik Ramm wrote:
 (and kick out the .bz2 stuff soon after)

 Not sure if I am interpreting this right, but are you suggesting to stop
 offering the daily xml extracts? If yes, then I think someone else needs to
 step up and replace them, as they are quite an important part of using
 OpenStreetMap and definately not ready to be retired for some new binary
 format (even though the new format sounds quite appealing)


I quite like the .osm.bz2 format. I don't see it being kicked off
http://planet.osm.org anytime soon. Parallel distribution is an
option.

/ Grant

___
dev mailing list
dev@openstreetmap.org
http://lists.openstreetmap.org/listinfo/dev


Re: [OSM-dev] How to get non-technical users easily editing (offline)?

2010-09-22 Thread Chris Browet

 the map rendering from within the application (no file editing). However,
 it does need installing, as opposed to JOSM's drop-in operation.

 Note however that since 0.16, there is a portable version of Merkaartor
for Windows, i.e. a plain zip file you extract anywhere and just
double-click the exe. See Merkaartor portable zip at
http://merkaartor.be/projects/merkaartor/files

BTW, even the installed version can be started with -p for the same
functionality.

- Chris -
___
dev mailing list
dev@openstreetmap.org
http://lists.openstreetmap.org/listinfo/dev


Re: [OSM-dev] Release candidate for OSM binary format is in osmosis trunk.

2010-09-22 Thread Peter Körner

Am 22.09.2010 15:23, schrieb Grant Slater:

I quite like the .osm.bz2 format. I don't see it being kicked off
http://planet.osm.org anytime soon. Parallel distribution is an
option.


Yes it hast definitive advantages as a primary data source. The biggest 
one that I can see is, that it is easily readable without any special 
sourcecode.


The bzip2 source is well known and very well distributed. There are 
million of sources on the web and in books where one can get information 
on how to decompress the format.


The XML underneath can be read as plain text and is very readable. Even 
without a full blown xml parser it is possible to parse the information 
out of it.


In contrast the osm protobuf format needs special knowledge about the 
format and special Sourcecode to read it. If the Nuclear Winter comes 
and the internet breaks down, I still can parse the planet.osm.bz2 with 
a book of bip2 source and some hacking but I will have a lot more work 
to do in order to read a planet.osm.pbf.


Also it would be somehow odd to have the planet in pbf and the changes 
in xml..


Peter

___
dev mailing list
dev@openstreetmap.org
http://lists.openstreetmap.org/listinfo/dev


Re: [OSM-dev] Release candidate for OSM binary format is in osmosis trunk.

2010-09-22 Thread John Smith
On 22 September 2010 22:37, Anthony o...@inbox.org wrote:
 How long does it take to just make a compressed psql binary dump?

This is why XML is used, it's database independent, there is apps like
navit and mkgmap that use their own format, further more the psql
binary dump may not include all the information if it's only being
used for tile rendering, although some people want the full file, and
those that don't would be forced to filter it some how for just the
information they require.

In this case binary dumps occur anyway (osm.bz2) but it makes more
sense to have an OSM specific format to reduce overhead and speed up
processing.

___
dev mailing list
dev@openstreetmap.org
http://lists.openstreetmap.org/listinfo/dev


Re: [OSM-dev] Release candidate for OSM binary format is in osmosis trunk.

2010-09-22 Thread John Smith
On 22 September 2010 23:23, Grant Slater openstreet...@firefishy.com wrote:
 I quite like the .osm.bz2 format. I don't see it being kicked off
 http://planet.osm.org anytime soon. Parallel distribution is an
 option.

Considering Scott was able to get the full planet dump under 5G it
seems a better idea to go with his binary format...

___
dev mailing list
dev@openstreetmap.org
http://lists.openstreetmap.org/listinfo/dev


Re: [OSM-dev] Spatialite in OSM context

2010-09-22 Thread Serge Wroclawski
On Wed, Sep 22, 2010 at 10:38 AM, Chris Browet c...@semperpax.com wrote:
 Hi,
 I wanted to know if someone already used Spatialite in an OSM context?

Spatiaite comes with an OSM XML to Spatialite converter, so I'd expect
someone uses it for that.

- Serge

___
dev mailing list
dev@openstreetmap.org
http://lists.openstreetmap.org/listinfo/dev


Re: [OSM-dev] Spatialite in OSM context

2010-09-22 Thread Chris Browet
On Wed, Sep 22, 2010 at 17:35, Serge Wroclawski emac...@gmail.com wrote:

 On Wed, Sep 22, 2010 at 10:38 AM, Chris Browet c...@semperpax.com wrote:
  Hi,
  I wanted to know if someone already used Spatialite in an OSM context?

 Spatiaite comes with an OSM XML to Spatialite converter, so I'd expect
 someone uses it for that.

 Is it so. Great.
___
dev mailing list
dev@openstreetmap.org
http://lists.openstreetmap.org/listinfo/dev


[OSM-dev] locate places near a cross street / intersection

2010-09-22 Thread Jose Cid

 Hello All,

Do any of the services (such as: Nominatim, Name Finder, Gazetteer, the 
standard Rails Port of OSM, etc. ) provide functionality to locate a 
place(s) given a cross street / intersection of roads?
___
dev mailing list
dev@openstreetmap.org
http://lists.openstreetmap.org/listinfo/dev


Re: [OSM-dev] Release candidate for OSM binary format is in osmosis trunk.

2010-09-22 Thread Kai Krueger


Grant Slater wrote:
 I quite like the .osm.bz2 format. I don't see it being kicked off
 http://planet.osm.org anytime soon. Parallel distribution is anoption.
Well they would first have to be added as the extracts don't currently live
on planet.osm.org ;-)

Parallel distribution would be ideal if the new format holds what it
promises and should hopefully be within the resources that OSMF have
available.
-- 
View this message in context: 
http://gis.638310.n2.nabble.com/Release-candidate-for-OSM-binary-format-is-in-osmosis-trunk-tp5499747p5561089.html
Sent from the Developer Discussion mailing list archive at Nabble.com.

___
dev mailing list
dev@openstreetmap.org
http://lists.openstreetmap.org/listinfo/dev