Re: [Talk-us] How to apply changesets

[David Niklas]

On 03/12/2017(Sun) 05:14
Frederik Ramm <frede...@remote.org> wrote:
> Hi,
> 
> On 11.03.2017 15:48, David Niklas wrote:
> > 1: Do I need every changes set or just the latest of the year?  
> 
> You don't say exactly what you want to achieve so I can't tell you
> exactly what you need. In your subject you talk about changesets, but it
> seems that you are concerned about diff updates published on
> openstreetmap.org. If that'S the case: They are not cumulative; you have
> to find out what the timestamp of your data set is and download those
> between then and now.
I apologize for being unclear, I'm referring to the
changeset-XX.osm.bz2 files.

 
> Osmosis' "read-replication-interval" action can help you keep track of
> how current your data is, and download all changesets between then and
> now, and combine them into one automatically.
Thanks, but that is not an option for me, as my laptop's disk is too small
and my desktop can't be connected to the internet (I live in a rural
area).

> > 2: If I need multiple changesets, can I apply them all at once using
> > multiple --read-xml-change directives?  
> 
> Yes, *and* multiple --apply-change of course. But if you use
> "read-replication-interval" then you will only deal with one diff file
> that has all the changes.

Unfortunately, I'm getting an error:
SEVER: Thread for task 1-read-xml-change failed
org.openstreetmap.osmosis.core.OsmosisRuntimeException: This does not
appear to be an OSM Change XML file.


Here is my (minimal) command line (I checked the hashes and decompressed
the changesets before hand), (I also checked the hash of the planet
file):
lbzip2 -dkc planet-160718.osm.bz2 | pv -WcarbB 100m | osmosis
--read-xml-change file=changesets-160725.osm compressionMethod=none
--read-xml file=/dev/stdin compressionMethod=none --apply-change
--write-xml file=- compressionMethod=none | pv -WcarbB 100m | lbzip2
-z4c5 > planet-160725.osm.bz2

In the unlikely event that decompression resulted in a corrupted file, I
did try using the compressed and md5sum verified originals, but still got
the same error.

Thanks,
David

___
Talk-us mailing list
Talk-us@openstreetmap.org
https://lists.openstreetmap.org/listinfo/talk-us

[Talk-us] How to apply changesets

[David Niklas]

Hello,
I do know what the command line using omosis looks like (and I have
osmosis).
What I don't know is this.

1: Do I need every changes set or just the latest of the year?
2: If I need multiple changesets, can I apply them all at once using
multiple --read-xml-change directives?

Thanks,
David

___
Talk-us mailing list
Talk-us@openstreetmap.org
https://lists.openstreetmap.org/listinfo/talk-us

Re: [Talk-us] How to get open street maps

[David Niklas]

Just to clarify (I'm going to ask on https://help.openstreetmap.org/).
This also applies to some extent to Andy's reply too.

On Sun, 5 Jun 2016 09:16:31 <wolfg...@lyxys.ka.sub.org> wrote:
> * David Niklas <do...@mail.com> [160605 05:28]:
> > On Fri, 3 Jun 2016 22:58:01 +0200
> > Wolfgang Zenker <wolfg...@lyxys.ka.sub.org> wrote:  
> >> * David Niklas <do...@mail.com> [160603 22:47]:  
> > [..]  
> >>> I'm guessing you guys don't know, can you recommend a better ML to
> >>> ask at, OSM has many.
> 
> >> it would help if you specify more clearly what you are looking for.
> >> The problem is that in OSM there is nothing like "the" maps. There
> >> are literally hundreds of very different maps generated from OSM
> >> data and dozends of apps navigating on that data, so you need to
> >> tell us what specific maps or apps you are talking about.
> >> [..]  
> 
> > I got my idea of what "the" maps are from
> > https://wiki.openstreetmap.org/wiki/Planet.osm
> > among which, is the said server.
> > I am trying to get the planet-.osm.bz2 and planet-.osm.pbf
> > files. I wanted to print out maps on my local printer. Being one of
> > those poor hackers out in the middle of no-where, I can't rely on an
> > internet based js or similar map utils.  
> 
> I see; you might have misunderstood that page. First,
> planet-.osm.bz2 and planet-.osm.pbf contain the same data, just
> in different formats, so you would download only one of them.
I knew that, I read that not all programs accept the same data format,
so I am trying to get both and then am going to test the tools to see
what works.

> Second,
> these files don't contain any maps at all, but a dump of the database
> with the raw geodata that is used to create maps from it. Importing
> this dump in a database alone will take several days or weeks dpending
> on how powerful your machine is, and then you would use a program like
> Maknik to generate printable maps from that data (which will take a
> long time as well if you want to generate these maps for the whole
> planet).
I had hoped to cut the US country out of that prior to processing.
Failing that, I could use my machine to import the whole data. My desktop
machine is the 1090T AMD processsor (6 core), it's bottlenecked by IO to
my HDs which are 5400 RPM 2TiB (Hard, not SSD), each in a RAID 5 array.

> I suggest you start with an extract covering a small area (like
> the country of Luxemburg, which is about the size of a rural county
> in the US) to try out the toolchain used to create map images (= render
> map tiles) from the database, and after you got that running use the
> extracts for your area of interest.
> 
> Wolfgang
That's a good idea with one drawback, if the roads change in the US I
will have to download my region again, instead of using rsync. Beings
that I live in a rural area without internet, if I can save bandwidth
that's a good thing.

I have the said data (by some miracle), it's just that it's not correct,
perhaps my disk has hiccuped I timed the download working with the
understanding that the other computers were syncing in UTC time, which
obviously was an incorrect assumption.

On Sat, 4 Jun 2016 16:14:50 <ajt1...@gmail.com> wrote:
> However if you really do want "maps" rather than "data", then where to
> go depends on what you want maps for.  For example, various maps that
> are suitable for a Garmin handheld or satnav are available (such as
> http://garmin.openstreetmap.nl/ , see
> http://wiki.openstreetmap.org/wiki/OSM_Map_On_Garmin/Download ), but
> they won't work with (say) MAPS.ME or OsmAnd on a phone.
I wanted to print them. I have no GPS tool and don't want one (unless I
can find an open source one), they tend to have some "interesting"
directions for travel.

Thanks, David

___
Talk-us mailing list
Talk-us@openstreetmap.org
https://lists.openstreetmap.org/listinfo/talk-us

Re: [Talk-us] How to get open street maps

[David Niklas]

On Sat, 28 May 2016 06:51:52  wrote:
> Hello,
> I downloaded the maps, but they changed over night, so the md5 sums
> don't match up. I tried using rsync -cav to ftp.spline.de, but the
> connection times out "[Receiver] io timeout after 181 seconds --
> exiting" (return code 30) I know that the port is accessible because I
> used nmap on it. I tried passing the --timeout flags but that made no
> difference. What could I do? I can't download that much data from
> scratch and a subset of the world cannot be resynced with the master?

I'm guessing you guys don't know, can you recommend a better ML to ask
at, OSM has many.

Thanks, David

___
Talk-us mailing list
Talk-us@openstreetmap.org
https://lists.openstreetmap.org/listinfo/talk-us

[Talk-us] How to get open street maps

[David Niklas]

Hello,
I downloaded the maps, but they changed over night, so the md5 sums don't
match up. I tried using rsync -cav to ftp.spline.de, but the connection
times out "[Receiver] io timeout after 181 seconds -- exiting" (return
code 30) I know that the port is accessible because I used nmap on it. I
tried passing the --timeout flags but that made no difference. What could
I do? I can't download that much data from scratch and a subset of the
world cannot be resynced with the master?



___
Talk-us mailing list
Talk-us@openstreetmap.org
https://lists.openstreetmap.org/listinfo/talk-us