Re: [OSM-dev] Updating Planet and Reliability

2011-10-19 Thread Andrew Ayre
On 7/21/2011 9:19 AM, Andy Allan wrote: On Thu, Jul 21, 2011 at 9:07 AM, Andrew Ayre a...@britishideas.com wrote: Keeping my copy of the planet up to date is a two-step process with Osmosis. Get the latest changes and applying them. This takes about an hour on my server which is enough time

[OSM-dev] Updating Planet and Reliability

2011-07-21 Thread Andrew Ayre
Keeping my copy of the planet up to date is a two-step process with Osmosis. Get the latest changes and applying them. This takes about an hour on my server which is enough time for some other user to reboot the server without realizing/knowing. What protection is there in Osmosis to recover from

Re: [OSM-dev] Updating Planet and Reliability

2011-07-21 Thread Andrew Ayre
On 7/21/2011 11:28 AM, Brett Henderson wrote: You will however need a wrapper shell script to rename the new planet file to the original file name and this leaves a very small window for something to go wrong between the state.txt being updated and the file being renamed. Brett Thanks to

Re: [OSM-dev] Updating Planet and Reliability

2011-07-21 Thread Andrew Ayre
On 7/21/2011 12:02 PM, John Smith wrote: On 21 July 2011 20:45, Andrew Ayre a...@britishideas.com wrote: Is there any possibility of changing Osmosis so arbitrary post merge commands could be executed before finalizing the state file? E.g.: The problem is if osmosis posted a memory state

Re: [OSM-dev] Updating Planet and Reliability

2011-07-21 Thread Andrew Ayre
On 7/21/2011 12:17 PM, John Smith wrote: You misunderstood me, I didn't say anything took 5 minutes, nor that the memory state file would be any where near 85 bytes, Osmosis does a lot of the merging in memory to be able to come back to a point close in time you would need to dump the memory

Re: [OSM-dev] Updating Planet and Reliability

2011-07-21 Thread Andrew Ayre
On 7/21/2011 12:29 PM, John Smith wrote: On 21 July 2011 21:26, Andrew Ayre a...@britishideas.com wrote: I don't care about resuming partially completed change merges if that is what you mean. What I do care about is detecting an interrupted merge and starting it again from the beginning. I

Re: [OSM-dev] Updating Planet and Reliability

2011-07-21 Thread Andrew Ayre
On 7/21/2011 12:36 PM, John Smith wrote: On 21 July 2011 21:33, Andrew Ayre a...@britishideas.com wrote: From the date/time of the last successfully applied changes. It already does that, but that's not what you're expecting, you're expecting that changes are applied sequentially

Re: [OSM-dev] Updating Planet and Reliability

2011-07-21 Thread Andrew Ayre
On 7/21/2011 12:48 PM, John Smith wrote: On 21 July 2011 21:41, Andrew Ayre a...@britishideas.com wrote: Yes, changes are applied sequentially, i.e. one set every 24 hours in my case as that is how frequently I run Osmosis to perform the change merge. So what is it you want to do exactly

[OSM-dev] Osmosis Tee Limit

2011-07-18 Thread Andrew Ayre
Hi, I know there is a command line limit in Linux, but what is the limit on the number of tees in Osmosis? I am thinking of taking a single osm file and applying a large number of bounding boxes to it in one go, rather than continually subdividing and subdividing. thanks, Andy -- Andy PGP Key

Re: [OSM-dev] Osmosis Tee Limit

2011-07-18 Thread Andrew Ayre
On 7/18/2011 11:55 AM, Frederik Ramm wrote: Hi, On 07/18/11 12:38, Andrew Ayre wrote: Hi, I know there is a command line limit in Linux, but what is the limit on the number of tees in Osmosis? I am thinking of taking a single osm file and applying a large number of bounding boxes

[OSM-dev] Merging Changes with Bounding Boxes

2011-07-15 Thread Andrew Ayre
Hi, currently I extract a piece of map data and store it. Later on I want to apply a set of changes to it. Here are my commands: osmosis --read-pbf britishisles.osm.pbf --buffer bufferCapacity=12000 --bb bottom=51 top=52 left=-1 right=1 --write-pbf london.osm.pbf osmosis --read-xml-change

Re: [OSM-dev] Merging Changes with Bounding Boxes

2011-07-15 Thread Andrew Ayre
Thanks. You mentioned that the change file only contains the new version of objects. If a node is being deleted is the lat/lon in the change file guaranteed to be identical to the lat/lon for that node an up-to-date planet file? Are there any options to getting the old location of a moved node

Re: [OSM-dev] Merging Changes with Bounding Boxes

2011-07-15 Thread Andrew Ayre
On 7/15/2011 7:55 PM, mar...@gmx.eu wrote: Are there any options to getting the old location of a moved node without writing my own Osmosis patch (if that's even possible)? I think this cannot be solved easily. But I like your Idea of creating a change file extract. One could implement it

[OSM-dev] Merging Changes into Planet

2011-07-14 Thread Andrew Ayre
Hi, If I download the latest set of hourly changes and merge them into planet.osm.pbf using osmosis, this always takes about two hours to complete: osmosis --read-xml-change changes.osc --read-bin planet-latest.osm.pbf --apply-change --write-bin planet-new.osm.pbf This is on an Ubuntu-based

Re: [OSM-dev] Merging Changes into Planet

2011-07-14 Thread Andrew Ayre
On 7/14/2011 9:26 AM, Jochen Topf wrote: Its almost certainly CPU. Try dd if=planet-latest.osm.pbf of=copy.osm.pbf bs=1M and you'll see how fast the files can be copied. Thats the time needed for the disk. Everything else is CPU. Does this merge time seem right/reasonable? Are there any

Re: [OSM-dev] Merging Changes into Planet

2011-07-14 Thread Andrew Ayre
Hi Markus, Thanks for the suggestion - I will take a look at it! Andy On 7/14/2011 3:41 PM, mar...@gmx.eu wrote: Hi Andy, there is another program which I would expect to be significantly faster. However, it has two disadvantages: 1. It's new, it still may have bugs. 2. It lacks in the

[OSM-dev] Planet File Sequence Number

2011-07-07 Thread Andrew Ayre
Hi, sorry for being dense but is there a tool that can extract the timestamp for planet-latest.osm.pbf without having to decompress the file? Or alternatively is there a way of finding out the timestamp or sequence number for planet.latest.osm.pbf? I want to know at what point to start grabbing

Re: [OSM-dev] Planet File Sequence Number

2011-07-07 Thread Andrew Ayre
On 7/7/2011 12:32 PM, Peter Körner wrote: Am 07.07.2011 12:45, schrieb Andrew Ayre: Hi, sorry for being dense but is there a tool that can extract the timestamp for planet-latest.osm.pbf without having to decompress the file? Or alternatively is there a way of finding out the timestamp

Re: [OSM-dev] Planet File Sequence Number

2011-07-07 Thread Andrew Ayre
On 7/7/2011 2:58 PM, Ian Dees wrote: On Thu, Jul 7, 2011 at 8:51 AM, Andrew Ayre a...@britishideas.com mailto:a...@britishideas.com wrote: Is it possible to get the timestamp of the planet file in any compressed format without decompressing? Look at the file name. Thanks

Re: [OSM-dev] Osmium

2011-01-07 Thread Andrew Ayre
Jochen Topf wrote: Osmium is a C++ framework for handling OSM data read from XML or PBF files. The framework itself doesn't do much by itself, it just parses the data and gives you callbacks for each object. Handlers can implement those callbacks and Sounds nice! It would be interesting for me

Re: [OSM-dev] Mapnik rendering: Zoom-Level to Width/Height

2009-10-14 Thread Andrew Ayre
Hi Peter, This document: http://svn.openstreetmap.org/applications/rendering/mapnik/zoom-to-scale.txt shows the relationship of zoom level to scale denominator. This blog post: http://www.britishideas.com/2009/09/22/map-scales-and-printing-with-mapnik/ shows how to get from bounding box to

Re: [OSM-dev] osm2pgsql Error way_changed_mark

2009-09-19 Thread Andrew Ayre
Martijn van Oosterhout wrote: On Sat, Sep 19, 2009 at 1:22 AM, Andrew Ayre a...@britishideas.com wrote: I think you can fix it by creating a DB with empty tables and then loading your data using --append: $ echo osm/osm empty.osm $ osm2pgsql -d mapnik -p opt -U username -W -c -m -s

[OSM-dev] osm2pgsql Error way_changed_mark

2009-09-18 Thread Andrew Ayre
Previously I was using 0.52 and it was working fine. However it wasn't include the service tag, so now I am using 0.67-17674M. When I run it with: osm2pgsql -d mapnik -p opt -U username -W -c -m -s opt.osm I get: Processing: Node(10k) Way(0k) Relation(0k)way_changed_mark failed: ERROR:

Re: [OSM-dev] osm2pgsql Error way_changed_mark

2009-09-18 Thread Andrew Ayre
Jon Burgess wrote: On Thu, 2009-09-17 at 23:01 -0700, Andrew Ayre wrote: Previously I was using 0.52 and it was working fine. However it wasn't include the service tag, so now I am using 0.67-17674M. When I run it with: osm2pgsql -d mapnik -p opt -U username -W -c -m -s opt.osm I get

Re: [OSM-dev] osm2pgsql Error way_changed_mark

2009-09-18 Thread Andrew Ayre
Jon Burgess wrote: On Thu, 2009-09-17 at 23:01 -0700, Andrew Ayre wrote: Previously I was using 0.52 and it was working fine. However it wasn't include the service tag, so now I am using 0.67-17674M. When I run it with: osm2pgsql -d mapnik -p opt -U username -W -c -m -s opt.osm I get

Re: [OSM-dev] Deep History App

2009-09-15 Thread Andrew Ayre
Ian Dees wrote: On Tue, Sep 15, 2009 at 3:34 PM, Richard Weait rich...@weait.com mailto:rich...@weait.com wrote: On Tue, Sep 15, 2009 at 1:49 PM, Ian Dees ian.d...@gmail.com mailto:ian.d...@gmail.com wrote: I'm working on a webapp that pulls way/node/relation history data

Re: [OSM-dev] Deep History App

2009-09-15 Thread Andrew Ayre
Ian Dees wrote: On Tue, Sep 15, 2009 at 3:34 PM, Richard Weait rich...@weait.com mailto:rich...@weait.com wrote: On Tue, Sep 15, 2009 at 1:49 PM, Ian Dees ian.d...@gmail.com mailto:ian.d...@gmail.com wrote: I'm working on a webapp that pulls way/node/relation history data

Re: [OSM-dev] Mapnik rendering?

2009-07-28 Thread Andrew Ayre
John Smith wrote: --- On Tue, 28/7/09, Apollinaris Schoell ascho...@gmail.com wrote: is there a way to report the status of a tile and a procedure to trigger a rerender? like TAH If you right click on the tile not rendering properly and view image, stick /dirty to the end of the url.

[OSM-dev] Osmarender and Unknown Type

2009-06-04 Thread Andrew Ayre
Hi, I'm using OSM in a project and I *much* prefer the look of the Osmarender tiles over the Mapnik tiles, especially the extra detail when zoomed out. However, if I go to www.openstreetmap.org and zoom in to Arizona blue tiles with Unknown Type appear. In fact I see this a lot. I've noticed

[OSM-dev] WMS Overlay Disappears

2009-03-30 Thread Andrew Ayre
Hi! I am generating a map using OpenLayers with an OSM base map and a WMS overlay. At the backend I am running GeoServer 1.7.3 with PostGIS. I can view my WMS data fine in the client in GeoServer and in uDig. However when I overlay it on my OpenLayers map it disappears at nearly all the zoom

Re: [OSM-dev] WMS Overlay Disappears

2009-03-30 Thread Andrew Ayre
. Setting up the Map object as shown here should be the first step to getting the overlay to display. http://wiki.openstreetmap.org/wiki/OpenLayers_Simple_Example#Instructions 2009/3/30 Andrew Ayre a...@britishideas.com: Hi! I am generating a map using OpenLayers with an OSM base map and a WMS

[OSM-dev] Osmosis Output Error

2008-12-09 Thread Andrew Ayre
Hi, I'm trying to merge two osm files. One contains a 1.5 deg x 1.5 deg tile of data from the planet file. The other contains a 1.5 deg x 1.5 deg tile of contours from Srtm2Osm. I'm using the current Osmosis svn HEAD (r12273). Here is my command line: java -Xmx1560m -jar

Re: [OSM-dev] Osmosis Output Error

2008-12-09 Thread Andrew Ayre
Brett Henderson wrote: Karl Newman wrote: I just noticed that Brett checked in some changes to the DataPostbox today. Can you try with an earlier version (say r12258, just before the change) to see if it works? I'm sure Brett would like to know if something is broken. Ouch. Sorry about

Re: [OSM-dev] Osmosis Output Error

2008-12-09 Thread Andrew Ayre
Brett Henderson wrote: Karl Newman wrote: So, sounds like the most recent changes are not the issue. Do you know if SRTM2OSM creates entities with negative ids? If not, you may run into collisions with the other data file that you're trying to merge. Karl Andrew, it would be great if you

Re: [OSM-dev] Osmosis Output Error

2008-12-09 Thread Andrew Ayre
Karl Newman wrote: On Tue, Dec 9, 2008 at 2:40 PM, Andrew Ayre [EMAIL PROTECTED] mailto:[EMAIL PROTECTED] wrote: Brett Henderson wrote: Karl Newman wrote: So, sounds like the most recent changes are not the issue. Do you know if SRTM2OSM creates

Re: [OSM-dev] Osmosis Output Error

2008-12-09 Thread Andrew Ayre
Brett Henderson wrote: I had a quick play and think I've found the problem. Firstly, when you receive an error in osmosis, look further down the stack trace. The real reason is almost always in there somewhere. Osmosis is multi-threaded so it is difficult to have the real reason show

Re: [OSM-dev] Osmosis Output Error

2008-12-09 Thread Andrew Ayre
Brett Henderson wrote: Andrew Ayre wrote: Brett Henderson wrote: I had a quick play and think I've found the problem. Firstly, when you receive an error in osmosis, look further down the stack trace. The real reason is almost always in there somewhere. Osmosis is multi-threaded so

Re: [OSM-dev] Osmosis Output Error

2008-12-09 Thread Andrew Ayre
Brett Henderson wrote: Andrew Ayre wrote: Brett Henderson wrote: Andrew Ayre wrote: Brett Henderson wrote: I had a quick play and think I've found the problem. Firstly, when you receive an error in osmosis, look further down the stack trace. The real reason is almost always