Re: [OSM-dev] Switch osm2pgsql to 64 bit mode
Hello Kai, I have updated the package for 10.04 as well now. It will take another couple of hours though to propagate through the system. Thank you! Did you update just your repository (ppa:kakrueger/openstreetmap) or is the new version now available via Ubuntu standard packet sources? I'm a bit confused now because of this edit in OSM Wiki: https://wiki.openstreetmap.org/w/index.php?title=Osm2pgsqlaction=historysubmitdiff=809338oldid=808884 Today I've downloaded Version 0.81 via ppa:kakrueger/openstreetmap and hope this is still the right way - despite of the Wiki edit. However, as Sven said, it is pretty simple to build osm2pgsql from source in case you need. Yes, that's what I did last time - about 3 years ago. Obviously got more and more lazy over the years. :-) Anyway - Thank you for this fine piece of software! Markus ___ dev mailing list dev@openstreetmap.org http://lists.openstreetmap.org/listinfo/dev
Re: [OSM-dev] Switch osm2pgsql to 64 bit mode
On Sun, Sep 16, 2012 at 2:17 PM, mar...@gmx.eu wrote: Hello Kai, I have updated the package for 10.04 as well now. It will take another couple of hours though to propagate through the system. Thank you! Did you update just your repository (ppa:kakrueger/openstreetmap) or is the new version now available via Ubuntu standard packet sources? I'm a bit confused now because of this edit in OSM Wiki: I only updated my PPA repository and am not involved with the official packages of either debian or ubuntu. As far as I am aware, they remain outdated. The packages of Ubuntu 12.04 remain completely outdated at version 0.70.5+r25090. r25090 of the svn was from January 2011. Ubuntu 12.10 beta and Debian sid are at version 0.80.0-r27899 which corresponds to about February 2012. I did contact the debian maintainer a while ago, to try and get more of the rendering stack into the official repositories, including mod_tile and renderd. But the current set of packages got rejected as they contain too much magic (in the form of setup scripts) which they do. Somehow we never followed up on things to get them compliant with the debian packaging rules. It would be good though to get more OSM related packages into Ubuntu, so that people don't always have to compile things and need lengthy (and usually outdated) tutorials to get things working. It might already help to move the packages out of my personal PPA into an official osm repository. https://wiki.openstreetmap.org/w/index.php?title=Osm2pgsqlaction=historysubmitdiff=809338oldid=808884 Today I've downloaded Version 0.81 via ppa:kakrueger/openstreetmap and hope this is still the right way - despite of the Wiki edit. However, as Sven said, it is pretty simple to build osm2pgsql from source in case you need. Yes, that's what I did last time - about 3 years ago. Obviously got more and more lazy over the years. :-) Anyway - Thank you for this fine piece of software! Markus ___ dev mailing list dev@openstreetmap.org http://lists.openstreetmap.org/listinfo/dev
Re: [OSM-dev] Switch osm2pgsql to 64 bit mode
Thank you for you work! When will this new version be available via your repository? I just tried and got the old one (0.80.0). Do I need to delete and remove the old database first, or will it be modified and reused by the 64-bit osm2pgsql? Grüße Markus Original-Nachricht Datum: Thu, 13 Sep 2012 16:58:45 -0600 Von: Kai Krueger kakrue...@gmail.com An: dev@openstreetmap.org Betreff: [OSM-dev] Switch osm2pgsql to 64 bit mode Hello everyone, I have just changed the default compile of osm2pgsql to use 64bit IDs instead of 32bit IDs. The current highest node ID is 1.9 billion. As signed 32 bit ints can only hold ~2.1 billion IDs, it is likely that the (signed) 32bit ID space will run out in a couple of months. As the switching from 32bit to 64bit IDs with osm2pgsql requires a fresh import as the database schemas are not compatible with each other, the current time seems like the most reasonable time to do this, as due to the license change it is recommended to perform a re-import anyway. It is still possible to compile osm2pgsql with 32bit IDs by passing the argument --disable-64bit-ids to ./configure. According to Frederik's benchmarks[1], 64bit mode is slightly slower and uses up more disk space, but hopefully that doesn't cause to much trouble and it will soon be necessary anyway. I also bumped the version number to 0.81.0 Kai [1] http://www.remote.org/frederik/tmp/ramm-osm2pgsql-sotm-2012.pdf ___ dev mailing list dev@openstreetmap.org http://lists.openstreetmap.org/listinfo/dev ___ dev mailing list dev@openstreetmap.org http://lists.openstreetmap.org/listinfo/dev
Re: [OSM-dev] Switch osm2pgsql to 64 bit mode
On Sat, Sep 15, 2012 at 7:59 AM, mar...@gmx.eu wrote: Thank you for you work! When will this new version be available via your repository? I just tried and got the old one (0.80.0). What version of Ubuntu do you use? I have updated the packages for 12.04LTS (precise), but I haven't updated them for the other versions of Ubuntu yet. Do I need to delete and remove the old database first, or will it be modified and reused by the 64-bit osm2pgsql? It is an incompatible change, so you will need to delete and re-import the full database. (But you need to do that anyway for the switch to ODbL). But if you run osm2pgsql in --create mode, it will automatically delete the old database for you and change the schema. So you don't have to worry about that. Kai Grüße Markus Original-Nachricht Datum: Thu, 13 Sep 2012 16:58:45 -0600 Von: Kai Krueger kakrue...@gmail.com An: dev@openstreetmap.org Betreff: [OSM-dev] Switch osm2pgsql to 64 bit mode Hello everyone, I have just changed the default compile of osm2pgsql to use 64bit IDs instead of 32bit IDs. The current highest node ID is 1.9 billion. As signed 32 bit ints can only hold ~2.1 billion IDs, it is likely that the (signed) 32bit ID space will run out in a couple of months. As the switching from 32bit to 64bit IDs with osm2pgsql requires a fresh import as the database schemas are not compatible with each other, the current time seems like the most reasonable time to do this, as due to the license change it is recommended to perform a re-import anyway. It is still possible to compile osm2pgsql with 32bit IDs by passing the argument --disable-64bit-ids to ./configure. According to Frederik's benchmarks[1], 64bit mode is slightly slower and uses up more disk space, but hopefully that doesn't cause to much trouble and it will soon be necessary anyway. I also bumped the version number to 0.81.0 Kai [1] http://www.remote.org/frederik/tmp/ramm-osm2pgsql-sotm-2012.pdf ___ dev mailing list dev@openstreetmap.org http://lists.openstreetmap.org/listinfo/dev ___ dev mailing list dev@openstreetmap.org http://lists.openstreetmap.org/listinfo/dev
Re: [OSM-dev] Switch osm2pgsql to 64 bit mode
Hello Kai, thanks for this quick reply. What version of Ubuntu do you use? I have updated the packages for 12.04LTS (precise), but I haven't updated them for the other versions of Ubuntu yet. Oh, I see. Is there any chance you might update it for the previous (and still supported) LTS 10.04? Unfortunately I cannot update to 12.04. at present. :-( But if you run osm2pgsql in --create mode, it will automatically delete the old database for you and change the schema. So you don't have to worry about that. Fantastic! Grüße Markus ___ dev mailing list dev@openstreetmap.org http://lists.openstreetmap.org/listinfo/dev
Re: [OSM-dev] Switch osm2pgsql to 64 bit mode
mar...@gmx.eu wrote: Oh, I see. Is there any chance you might update it for the previous (and still supported) LTS 10.04? Unfortunately I cannot update to 12.04. at present. :-( Just compile osm2pqsql yourself from svn version. That's what I always do and it is is not that complicated (at least on linux) after all. Sven -- Those who would give up Essential Liberty to purchase a little Temporary Safety, deserve neither Liberty nor Safety (Benjamin Franklin) /me is giggls@ircnet, http://sven.gegg.us/ on the Web ___ dev mailing list dev@openstreetmap.org http://lists.openstreetmap.org/listinfo/dev
Re: [OSM-dev] Switch osm2pgsql to 64 bit mode
Kai Krueger schrieb: The current highest node ID is 1.9 billion. As signed 32 bit ints can only hold ~2.1 billion IDs, it is likely that the (signed) 32bit ID space will run out in a couple of months. I did some calculations on this topic: Based on the highest node ID of the last 30 days and a prediction using a linear regression model, the node with the magic ID 2^31 will be created on February 6, 2013. Last 90 days as data set: March 5, 2013. Beginning of redaction period (April 2012) as data set: March 24, 2013. But don't worry, we'll have plenty of time until the relation ID will require 64 bit signed integers. R calculated this to be in the year 5233. ;-) Regards, Michael signature.asc Description: OpenPGP digital signature ___ dev mailing list dev@openstreetmap.org http://lists.openstreetmap.org/listinfo/dev
Re: [OSM-dev] Switch osm2pgsql to 64 bit mode
On Sat, Sep 15, 2012 at 11:15 AM, mar...@gmx.eu wrote: Hello Kai, thanks for this quick reply. What version of Ubuntu do you use? I have updated the packages for 12.04LTS (precise), but I haven't updated them for the other versions of Ubuntu yet. Oh, I see. Is there any chance you might update it for the previous (and still supported) LTS 10.04? Unfortunately I cannot update to 12.04. at present. :-( I have updated the package for 10.04 as well now. It will take another couple of hours though to propagate through the system. However, as Sven said, it is pretty simple to build osm2pgsql from source in case you need. It is even pretty simple to build your own ubuntu package. All you need to do is download the source and then run the command debuild in the directory and you should have a working debian / ubuntu package to install. Kai But if you run osm2pgsql in --create mode, it will automatically delete the old database for you and change the schema. So you don't have to worry about that. Fantastic! Grüße Markus ___ dev mailing list dev@openstreetmap.org http://lists.openstreetmap.org/listinfo/dev
[OSM-dev] Switch osm2pgsql to 64 bit mode
Hello everyone, I have just changed the default compile of osm2pgsql to use 64bit IDs instead of 32bit IDs. The current highest node ID is 1.9 billion. As signed 32 bit ints can only hold ~2.1 billion IDs, it is likely that the (signed) 32bit ID space will run out in a couple of months. As the switching from 32bit to 64bit IDs with osm2pgsql requires a fresh import as the database schemas are not compatible with each other, the current time seems like the most reasonable time to do this, as due to the license change it is recommended to perform a re-import anyway. It is still possible to compile osm2pgsql with 32bit IDs by passing the argument --disable-64bit-ids to ./configure. According to Frederik's benchmarks[1], 64bit mode is slightly slower and uses up more disk space, but hopefully that doesn't cause to much trouble and it will soon be necessary anyway. I also bumped the version number to 0.81.0 Kai [1] http://www.remote.org/frederik/tmp/ramm-osm2pgsql-sotm-2012.pdf ___ dev mailing list dev@openstreetmap.org http://lists.openstreetmap.org/listinfo/dev
Re: [OSM-dev] Switch osm2pgsql to 64 bit mode
Are there any other changes that will be made to the default config? (e.g. new .style, switching to hstore) -Original Message- From: Kai Krueger [mailto:kakrue...@gmail.com] Sent: Thursday, September 13, 2012 3:59 PM To: dev@openstreetmap.org Subject: [OSM-dev] Switch osm2pgsql to 64 bit mode Hello everyone, I have just changed the default compile of osm2pgsql to use 64bit IDs instead of 32bit IDs. The current highest node ID is 1.9 billion. As signed 32 bit ints can only hold ~2.1 billion IDs, it is likely that the (signed) 32bit ID space will run out in a couple of months. As the switching from 32bit to 64bit IDs with osm2pgsql requires a fresh import as the database schemas are not compatible with each other, the current time seems like the most reasonable time to do this, as due to the license change it is recommended to perform a re-import anyway. It is still possible to compile osm2pgsql with 32bit IDs by passing the argument --disable-64bit-ids to ./configure. According to Frederik's benchmarks[1], 64bit mode is slightly slower and uses up more disk space, but hopefully that doesn't cause to much trouble and it will soon be necessary anyway. I also bumped the version number to 0.81.0 Kai [1] http://www.remote.org/frederik/tmp/ramm-osm2pgsql-sotm-2012.pdf ___ dev mailing list dev@openstreetmap.org http://lists.openstreetmap.org/listinfo/dev ___ dev mailing list dev@openstreetmap.org http://lists.openstreetmap.org/listinfo/dev
