Re: [OSM-dev] Updating Planet and Reliability

On 7/21/2011 9:19 AM, Andy Allan wrote: > On Thu, Jul 21, 2011 at 9:07 AM, Andrew Ayre wrote: >> Keeping my copy of the planet up to date is a two-step process with >> Osmosis. Get the latest changes and applying them. This takes about an >> hour on my server which is enoug

Re: [OSM-dev] Updating Planet and Reliability

On 7/21/2011 12:48 PM, John Smith wrote: > On 21 July 2011 21:41, Andrew Ayre wrote: >> Yes, changes are applied sequentially, i.e. one set every 24 hours in my >> case as that is how frequently I run Osmosis to perform the change merge. > > So what is it you want to do ex

Re: [OSM-dev] Updating Planet and Reliability

On 7/21/2011 12:36 PM, John Smith wrote: > On 21 July 2011 21:33, Andrew Ayre wrote: >> From the date/time of the last successfully applied changes. > > It already does that, but that's not what you're expecting, you're > expecting that changes are applied s

Re: [OSM-dev] Updating Planet and Reliability

On 7/21/2011 12:29 PM, John Smith wrote: > On 21 July 2011 21:26, Andrew Ayre wrote: >> I don't care about resuming partially completed change merges if that is >> what you mean. What I do care about is detecting an interrupted merge >> and starting it again from the

Re: [OSM-dev] Updating Planet and Reliability

On 7/21/2011 12:17 PM, John Smith wrote: > You misunderstood me, I didn't say anything took 5 minutes, nor that > the memory state file would be any where near 85 bytes, Osmosis does a > lot of the merging in memory to be able to come back to a point close > in time you would need to dump the memor

Re: [OSM-dev] Updating Planet and Reliability

On 7/21/2011 12:02 PM, John Smith wrote: > On 21 July 2011 20:45, Andrew Ayre wrote: >> Is there any possibility of changing Osmosis so arbitrary post merge >> commands could be executed before finalizing the state file? E.g.: > > The problem is if osmosis posted a memory s

Re: [OSM-dev] Updating Planet and Reliability

On 7/21/2011 11:28 AM, Brett Henderson wrote: > You will however need a wrapper shell script to rename the new planet > file to the original file name and this leaves a very small window for > something to go wrong between the state.txt being updated and the file > being renamed. > > Brett Thanks

[OSM-dev] Updating Planet and Reliability

Keeping my copy of the planet up to date is a two-step process with Osmosis. Get the latest changes and applying them. This takes about an hour on my server which is enough time for some other user to reboot the server without realizing/knowing. What protection is there in Osmosis to recover from

Re: [OSM-dev] Osmosis Tee Limit

On 7/18/2011 11:55 AM, Frederik Ramm wrote: > Hi, > > On 07/18/11 12:38, Andrew Ayre wrote: >> Hi, I know there is a command line limit in Linux, but what is the limit >> on the number of tees in Osmosis? I am thinking of taking a single osm >> file and applying a lar

[OSM-dev] Osmosis Tee Limit

Hi, I know there is a command line limit in Linux, but what is the limit on the number of tees in Osmosis? I am thinking of taking a single osm file and applying a large number of bounding boxes to it in one go, rather than continually subdividing and subdividing. thanks, Andy -- Andy PGP Key ID

Re: [OSM-dev] Merging Changes with Bounding Boxes

On 7/15/2011 7:55 PM, mar...@gmx.eu wrote: >> Are there any options to getting the old location of a moved node >> without writing my own Osmosis patch (if that's even possible)? > > I think this cannot be solved easily. But I like your Idea of creating a > change file "extract". One could implem

Re: [OSM-dev] Merging Changes with Bounding Boxes

Thanks Toby, this is a bit more involved than I realized! Andy On 7/15/2011 7:53 PM, Toby Murray wrote: > Not 100% sure. The API documentation in the wiki does state that > lat/lon are required parameters for a delete operation. It doesn't say > that they must be the same as they were for the pre

Re: [OSM-dev] Merging Changes with Bounding Boxes

Thanks. You mentioned that the change file only contains the new version of objects. If a node is being deleted is the lat/lon in the change file guaranteed to be identical to the lat/lon for that node an up-to-date planet file? Are there any options to getting the old location of a moved node wi

[OSM-dev] Merging Changes with Bounding Boxes

Hi, currently I extract a piece of map data and store it. Later on I want to apply a set of changes to it. Here are my commands: osmosis --read-pbf britishisles.osm.pbf --buffer bufferCapacity=12000 --bb bottom=51 top=52 left=-1 right=1 --write-pbf london.osm.pbf osmosis --read-xml-change changes

Re: [OSM-dev] Merging Changes into Planet

Hi Markus, Thanks for the suggestion - I will take a look at it! Andy On 7/14/2011 3:41 PM, mar...@gmx.eu wrote: > Hi Andy, > > there is another program which I would expect to be significantly faster. > However, it has two disadvantages: > 1. It's new, it still may have bugs. > 2. It lacks in

Re: [OSM-dev] Merging Changes into Planet

On 7/14/2011 9:26 AM, Jochen Topf wrote: > Its almost certainly CPU. Try > dd if=planet-latest.osm.pbf of=copy.osm.pbf bs=1M > and you'll see how fast the files can be copied. Thats the time needed for the > disk. Everything else is CPU. > >> Does this merge time seem right/reasonable? Are there a

[OSM-dev] Merging Changes into Planet

Hi, If I download the latest set of hourly changes and merge them into planet.osm.pbf using osmosis, this always takes about two hours to complete: osmosis --read-xml-change changes.osc --read-bin planet-latest.osm.pbf --apply-change --write-bin planet-new.osm.pbf This is on an Ubuntu-based quad

Re: [OSM-dev] Planet File Sequence Number

On 7/7/2011 2:58 PM, Ian Dees wrote: > On Thu, Jul 7, 2011 at 8:51 AM, Andrew Ayre <mailto:a...@britishideas.com>> wrote: > Is it possible to get the timestamp of the planet file in any compressed > format without decompressing? > > > Look at the file name.

Re: [OSM-dev] Planet File Sequence Number

On 7/7/2011 12:32 PM, Peter Körner wrote: > Am 07.07.2011 12:45, schrieb Andrew Ayre: >> Hi, sorry for being dense but is there a tool that can extract the >> timestamp for planet-latest.osm.pbf without having to decompress the >> file? >> >> Or alternatively

[OSM-dev] Planet File Sequence Number

Hi, sorry for being dense but is there a tool that can extract the timestamp for planet-latest.osm.pbf without having to decompress the file? Or alternatively is there a way of finding out the timestamp or sequence number for planet.latest.osm.pbf? I want to know at what point to start grabbing c

Re: [OSM-dev] Osmium

Jochen Topf wrote: Osmium is a C++ framework for handling OSM data read from XML or PBF files. The framework itself doesn't do much by itself, it just parses the data and gives you callbacks for each object. Handlers can implement those callbacks and Sounds nice! It would be interesting for me

Re: [OSM-dev] Mapnik rendering: Zoom-Level to Width/Height

Hi Peter, This document: http://svn.openstreetmap.org/applications/rendering/mapnik/zoom-to-scale.txt shows the relationship of zoom level to scale denominator. This blog post: http://www.britishideas.com/2009/09/22/map-scales-and-printing-with-mapnik/ shows how to get from bounding box to sc

Re: [OSM-dev] osm2pgsql Error way_changed_mark

Martijn van Oosterhout wrote: > On Sat, Sep 19, 2009 at 1:22 AM, Andrew Ayre wrote: >>> I think you can fix it by creating a DB with empty tables and then >>> loading your data using --append: >>> >>> $ echo "" > empty.osm >>> $

Re: [OSM-dev] osm2pgsql Error way_changed_mark

Jon Burgess wrote: > On Thu, 2009-09-17 at 23:01 -0700, Andrew Ayre wrote: >> Previously I was using 0.52 and it was working fine. However it wasn't >> include the service tag, so now I am using 0.67-17674M. When I run it with: >> >> osm2pgsql -d mapnik -p opt

Re: [OSM-dev] osm2pgsql Error way_changed_mark

Jon Burgess wrote: > On Thu, 2009-09-17 at 23:01 -0700, Andrew Ayre wrote: >> Previously I was using 0.52 and it was working fine. However it wasn't >> include the service tag, so now I am using 0.67-17674M. When I run it with: >> >> osm2pgsql -d mapnik -p opt

[OSM-dev] osm2pgsql Error way_changed_mark

Previously I was using 0.52 and it was working fine. However it wasn't include the service tag, so now I am using 0.67-17674M. When I run it with: osm2pgsql -d mapnik -p opt -U username -W -c -m -s opt.osm I get: Processing: Node(10k) Way(0k) Relation(0k)way_changed_mark failed: ERROR: prepar

Re: [OSM-dev] "Deep History" App

Ian Dees wrote: > On Tue, Sep 15, 2009 at 3:34 PM, Richard Weait > wrote: > > On Tue, Sep 15, 2009 at 1:49 PM, Ian Dees > wrote: > > I'm working on a webapp that pulls way/node/relation history data > from the > > API and

Re: [OSM-dev] "Deep History" App

Ian Dees wrote: > On Tue, Sep 15, 2009 at 3:34 PM, Richard Weait > wrote: > > On Tue, Sep 15, 2009 at 1:49 PM, Ian Dees > wrote: > > I'm working on a webapp that pulls way/node/relation history data > from the > > API and

Re: [OSM-dev] Mapnik rendering?

John Smith wrote: > --- On Tue, 28/7/09, Apollinaris Schoell wrote: > >> is there a way to report the status of a tile and a >> procedure to >> trigger a rerender? like TAH > > If you right click on the tile not rendering properly and view image, stick > /dirty to the end of the url. Thank y

[OSM-dev] Osmarender and Unknown Type

Hi, I'm using OSM in a project and I *much* prefer the look of the Osmarender tiles over the Mapnik tiles, especially the extra detail when zoomed out. However, if I go to www.openstreetmap.org and zoom in to Arizona blue tiles with "Unknown Type" appear. In fact I see this a lot. I've noticed

Re: [OSM-dev] WMS Overlay Disappears

ways > successfully. > > Setting up the Map object as shown here should be the first step to > getting the overlay to display. > http://wiki.openstreetmap.org/wiki/OpenLayers_Simple_Example#Instructions > > 2009/3/30 Andrew Ayre : >> Hi! I am generating a map usin

[OSM-dev] WMS Overlay Disappears

Hi! I am generating a map using OpenLayers with an OSM base map and a WMS overlay. At the backend I am running GeoServer 1.7.3 with PostGIS. I can view my WMS data fine in the client in GeoServer and in uDig. However when I overlay it on my OpenLayers map it disappears at nearly all the zoom level

Re: [OSM-dev] Osmosis Output Error

Brett Henderson wrote: > Andrew Ayre wrote: >> Brett Henderson wrote: >>> Andrew Ayre wrote: >>>> Brett Henderson wrote: >>>>> I had a quick play and think I've found the problem. >>>>> >>>>> Firstly, when you receive

Re: [OSM-dev] Osmosis Output Error

Brett Henderson wrote: > Andrew Ayre wrote: >> Brett Henderson wrote: >>> I had a quick play and think I've found the problem. >>> >>> Firstly, when you receive an error in osmosis, look further down the >>> stack trace. The real reason is almost

Re: [OSM-dev] Osmosis Output Error

Brett Henderson wrote: > I had a quick play and think I've found the problem. > > Firstly, when you receive an error in osmosis, look further down the > stack trace. The real reason is almost always in there somewhere. > Osmosis is multi-threaded so it is difficult to have the real reason > s

Re: [OSM-dev] Osmosis Output Error

Brett Henderson wrote: > Andrew Ayre wrote: >> Thanks for looking into this. I added --sort after each input file >> name and it still gives the same error. The OSM map file was generated >> by osmosis, which I used to split planet.osm. >> >> java -Xmx1560m -

Re: [OSM-dev] Osmosis Output Error

Karl Newman wrote: > On Tue, Dec 9, 2008 at 2:40 PM, Andrew Ayre <[EMAIL PROTECTED] > <mailto:[EMAIL PROTECTED]>> wrote: > > Brett Henderson wrote: > > Karl Newman wrote: > > So, sounds like the most recent changes are not the

Re: [OSM-dev] Osmosis Output Error

Brett Henderson wrote: > Karl Newman wrote: >> So, sounds like the most recent changes are not the issue. Do you know >> if SRTM2OSM creates entities with negative ids? If not, you may run >> into collisions with the other data file that you're trying to merge. >> >> Karl > Andrew, it would be gr

Re: [OSM-dev] Osmosis Output Error

Brett Henderson wrote: > Karl Newman wrote: >> I just noticed that Brett checked in some changes to the DataPostbox >> today. Can you try with an earlier version (say r12258, just before >> the change) to see if it works? I'm sure Brett would like to know if >> something is broken. > Ouch. Sorr

[OSM-dev] Osmosis Output Error

Hi, I'm trying to merge two osm files. One contains a 1.5 deg x 1.5 deg tile of data from the planet file. The other contains a 1.5 deg x 1.5 deg tile of contours from Srtm2Osm. I'm using the current Osmosis svn HEAD (r12273). Here is my command line: java -Xmx1560m -jar /home/nav/scripts/osmos