Re: [OSM-dev] Snapshot Server
On 20 January 2013 00:45, Rob Nickerson rob.j.nicker...@gmail.com wrote: I reinstalled snapshot-server following your updated instructions, which was a lot simpler than last time :-) and gave the web load a test. It worked a charm :-) That's great news. If you, or anyone else on the list, have problems or suggestions for making it easier to install a copy of snapshot-server, please let me know! Cheers, Andy ___ dev mailing list dev@openstreetmap.org http://lists.openstreetmap.org/listinfo/dev
Re: [OSM-dev] Snapshot Server
Andy, Apologies for the late reply to this one. I've only just had the chance this weekend to test the new snapshot server (and updated manual), however I should really have dropped you a quick thank you email much earlier. I reinstalled snapshot-server following your updated instructions, which was a lot simpler than last time :-) and gave the web load a test. It worked a charm :-) Next step is to see if I can get Potlatch2 up and running. Once I've tested the process on my home computer and am satisfied with it, the next step would be to see if I can get this online. Paul, If I can't scrounge some server space from somewhere, would you still be happy to host these OSM files on your snapshot server instance (we discussed this idea on IRC a couple of weeks back)? Regards, RobJN On 11 January 2013 17:33, Andy Allan gravityst...@gmail.com wrote: On 8 January 2013 17:59, Rob Nickerson rob.j.nicker...@gmail.com wrote: A web based loading screen would be a big plus for me. I had a quick look and found a 5mb shapefile. I would imagine 10mb is probably the largest I have. Not sure how that converts to .osm filesize. On Tuesday I coded up an upload form, and it's in the most recent version. It works at about 30s for a 1Mb file on my laptop, which is fine for the data that I've been handling but not great for others who need larger uploads. I've stuck in a few tickets on github for things that would be good to do in future - if anyone fancies having a stab at them, be my guest! There's nothing complex in the snapshot-server code. https://github.com/gravitystorm/snapshot-server Cheers, Andy ___ dev mailing list dev@openstreetmap.org http://lists.openstreetmap.org/listinfo/dev
Re: [OSM-dev] Snapshot Server
On 8 January 2013 17:59, Rob Nickerson rob.j.nicker...@gmail.com wrote: A web based loading screen would be a big plus for me. I had a quick look and found a 5mb shapefile. I would imagine 10mb is probably the largest I have. Not sure how that converts to .osm filesize. On Tuesday I coded up an upload form, and it's in the most recent version. It works at about 30s for a 1Mb file on my laptop, which is fine for the data that I've been handling but not great for others who need larger uploads. I've stuck in a few tickets on github for things that would be good to do in future - if anyone fancies having a stab at them, be my guest! There's nothing complex in the snapshot-server code. https://github.com/gravitystorm/snapshot-server Cheers, Andy ___ dev mailing list dev@openstreetmap.org http://lists.openstreetmap.org/listinfo/dev
Re: [OSM-dev] Snapshot Server
On 28 December 2012 05:52, Paul Norman penor...@mac.com wrote: Readme.md for snapshot-server is not quite accurate. I’ve got an updated readme at https://github.com/pnorman/snapshot-server/blob/patch-3/README.md that covers enabling PostGIS and hstore but Andy hasn’t had time to update upstream. I've updated the readme, and there's actually a chance now that you could get it installed. I've tested the instructions on a VM, but of course feedback is welcome. I've gone for the route that involves the least typing, so rake db:create will sort out all the postgis-related things for you. Rob, did you manage to get your snapshot-server instance up and running in the end? Cheers, Andy ___ dev mailing list dev@openstreetmap.org http://lists.openstreetmap.org/listinfo/dev
Re: [OSM-dev] Snapshot Server
Thanks. I got it up and running but was struggling to load some data. Can't quite remember the error message but I'm hoping to get to look at it again this weekend (tho time is an issue). RobJN On 8 Jan 2013, at 16:32, Andy Allan gravityst...@gmail.com wrote: On 28 December 2012 05:52, Paul Norman penor...@mac.com wrote: Readme.md for snapshot-server is not quite accurate. I’ve got an u pdated readme at https://github.com/pnorman/snapshot-server/blob/patch-3/README.md that covers enabling PostGIS and hstore but Andy hasn’t had time t o update upstream. I've updated the readme, and there's actually a chance now that you could get it installed. I've tested the instructions on a VM, but of course feedback is welcome. I've gone for the route that involves the least typing, so rake db:create will sort out all the postgis-related things for you. Rob, did you manage to get your snapshot-server instance up and running in the end? Cheers, Andy ___ dev mailing list dev@openstreetmap.org http://lists.openstreetmap.org/listinfo/dev
Re: [OSM-dev] Snapshot Server
A web based loading screen would be a big plus for me. I had a quick look and found a 5mb shapefile. I would imagine 10mb is probably the largest I have. Not sure how that converts to .osm filesize. Rob On 8 January 2013 17:35, Andy Allan gravityst...@gmail.com wrote: On 8 January 2013 17:28, Rob Nickerson rob.j.nicker...@gmail.com wrote: Thanks. I got it up and running but was struggling to load some data. Can't quite remember the error message but I'm hoping to get to look at it again this weekend (tho time is an issue). Do you know offhand how big your .osm files are? I know that for giant projects, nothing will beat the osmosis loading method that we have now. But I'm wondering if it's worthwhile building a mechanism into the web frontend that can handle smaller files a bit more easily, by just uploading the file to the site. The files I had for the original cycling data project were about 0.25 - 4.0 Mb in size but I know the stuff Paul has been wrangling are closer to gigabytes. Cheers, Andy ___ dev mailing list dev@openstreetmap.org http://lists.openstreetmap.org/listinfo/dev
Re: [OSM-dev] Snapshot Server
On 2013-01-08, at 12:59 PM, Rob Nickerson rob.j.nicker...@gmail.com wrote: A web based loading screen would be a big plus for me. I had a quick look and found a 5mb shapefile. I would imagine 10mb is probably the largest I have. Not sure how that converts to .osm filesize. Rob It can vary greatly by the type of shapefile and what data you drop but for a 31M building file I got a 155M output .osm. As a snapshot DB it'll be 2x-3x larger. This would make your shapefile 25M as .osm and about 60M of database space. Just for reference, the largest single .osm I've had ogr2osm generate was 25G and I'm looking at applications that involve planet-sized amounts of data across multiple files. ___ dev mailing list dev@openstreetmap.org http://lists.openstreetmap.org/listinfo/dev
Re: [OSM-dev] Snapshot Server
Hi Rob, Am 27.12.2012 15:41, schrieb Rob Nickerson: However, when I run rake db:migrate I get the following error: PG::Error: ERROR relation “geometry_columns” does not exist LINE 1: SELECT * FROM geometry_columns WHERE f_table_name='schema_migrations' Sounds like your database is missing postgis. Take a look at the database section on my history-rendering tutorial: https://github.com/MaZderMind/osm-history-renderer/blob/master/TUTORIAL.md#creating-the-database the other parts of the document are not relevant for the snapshot server. Peter ___ dev mailing list dev@openstreetmap.org http://lists.openstreetmap.org/listinfo/dev
Re: [OSM-dev] Snapshot Server
Readme.md for snapshot-server is not quite accurate. I've got an updated readme at https://github.com/pnorman/snapshot-server/blob/patch-3/README.md that covers enabling PostGIS and hstore but Andy hasn't had time to update upstream. From: Rob Nickerson [mailto:rob.j.nicker...@gmail.com] Sent: Thursday, December 27, 2012 6:41 AM To: Andy Allan; dev@openstreetmap.org Subject: [OSM-dev] Snapshot Server Hi All, I am a complete newbie when it comes to databases and the like so please bear with me... I am attempting to set up a snapshot server in order to feed UK Public Rights of Way data into Potlatch 2's merging tool. I am following Andy's guide at [1]. I am doing this in debian (raspberry pi version) as an initial proof of concept work. So far I have managed to get postgreSQL 9.1.7 set up and I have created a user role: sudo -u postrgres psql # create role username login createdb; # \q (where lines 2 and 3 are run within postgresql). I have also put this username in config/database.yml and executed rake db:create. However, when I run rake db:migrate I get the following error: PG::Error: ERROR relation geometry_columns does not exist LINE 1: SELECT * FROM geometry_columns WHERE f_table_name='schema_migrations' Any ideas? Regards, Rob [1] https://github.com/gravitystorm/snapshot-server ___ dev mailing list dev@openstreetmap.org http://lists.openstreetmap.org/listinfo/dev
