Re: [OSM-dev] The same OSM server but locally available
Hi, John Smith writes: > What about the hstore patches that effectively store all tag > information, not just a limited subset? I don't know but if the database schema does not match http://wiki.openstreetmap.org/wiki/Database_schema then I don't see how cgimap could every work. -Timo ___ dev mailing list dev@openstreetmap.org http://lists.openstreetmap.org/listinfo/dev
Re: [OSM-dev] The same OSM server but locally available
Hi, "Jukka Rahkonen" writes: > There is this wiki page that handles partial diff updates: > http://wiki.openstreetmap.org/wiki/DE:HowtoMinutelyHstore > > I don't know if the recipe works. This is unfortunately for osm2pgsql which does not use http://wiki.openstreetmap.org/wiki/Database_schema that is needed by cgimap that in turn is needed by JOSM. Afaik osm2pgsql is only good for mapnik and nothing else. I'd be happy to be proven wrong though ;-) -Timo ___ dev mailing list dev@openstreetmap.org http://lists.openstreetmap.org/listinfo/dev
Re: [OSM-dev] The same OSM server but locally available
Emilie Laffray writes: > Plus you can even filtered it at Osmosis level if you want to. I tried that in http://lists.openstreetmap.org/pipermail/dev/2010-June/019570.html but failed with things like Caused by: org.postgresql.util.PSQLException: ERROR: insert or update on table "current_way_nodes" violates foreign key constraint "current_way_nodes_node_id_fkey" since the replication data (*.osc) refers to nodes that are not in my partial database. Afaik the only solutions are: 1) Include everything in your OSM database and forget about partial database or 2) re-import an extract periodically and forget about using *.osc files. -Timo ___ dev mailing list dev@openstreetmap.org http://lists.openstreetmap.org/listinfo/dev
Re: [OSM-dev] The same OSM server but locally available
John Smith writes: > 2010/7/29 Timo Juhani Lindfors : >> You can import an export of your country to postgresql >> database. However, there is no way to apply diffs to a partial >> database so you need to re-import the database every time you want to update >> it. > > osm2pgsql has a bbox option... osm2pgsql does not use apidb schema though? it is only useful for mapnik and does not work with cgimap, right? I need cgimap to use the DB with josm. -Timo ___ dev mailing list dev@openstreetmap.org http://lists.openstreetmap.org/listinfo/dev
Re: [OSM-dev] The same OSM server but locally available
Hi, Imóveis Nacionais writes: > Please, which are the FREE availale options to "replicate" the OSM server in > my computer, of course, with GIS data only for my country (it is enough). You can import an export of your country to postgresql database. However, there is no way to apply diffs to a partial database so you need to re-import the database every time you want to update it. -Timo ___ dev mailing list dev@openstreetmap.org http://lists.openstreetmap.org/listinfo/dev
Re: [OSM-dev] Errors with populateCurrentTables=yes on refresh based on partial dataset
Hi, Andreas Kalsch writes: > Using populateCurrentTables=yes on refresh will make Osmosis stop. When > I use populateCurrentTables=no, then all is OK, but then I don't have > updated data in the current tables. What can I do about that? > Caused by: org.postgresql.util.PSQLException: ERROR: insert or update on > table "current_way_nodes" violates foreign key constraint > "current_way_nodes_node_id_fkey" >Detail: Key (node_id)=(204308) is not present in table "current_nodes". > at I think I hit the same problem. Have you found any solution? Could I somehow remove references to nodes that are not inside the bounding box I am trying to mirror? sudo aptitude install postgresql-8.4 postgresql-client-8.4 postgresql-contrib-8.4 osmosis bzip2 wget http://download.geofabrik.de/osm/europe/finland.osm.bz2 sudo -u postgres psql -c "CREATE DATABASE osm ENCODING = 'UNICODE';" sudo -u postgres psql -c "CREATE USER osm PASSWORD 'osm';" sudo -u postgres psql osm -c "GRANT ALL ON SCHEMA PUBLIC TO osm;" zcat /usr/share/doc/osmosis/examples/contrib/apidb_0.6.sql.gz | sudo -u postgres psql osm -f - bzcat finland.osm.bz2 | osmosis --read-xml file=- --write-apidb password=osm user=osm dbType=postgresql osmosis --read-replication-interval-init wget -O state.txt http://toolserver.org/~mazder/replicate-sequences/?2010-05-30T00:00:00Z osmosis --read-replication-interval --simplify-change --write-xml-change changes.osc.gz osmosis --read-xml-change file=changes.osc.gz --write-apidb-change password=osm user=osm dbType=postgresql fails with 1.6.2010 22:30:58 org.openstreetmap.osmosis.core.Osmosis run INFO: Osmosis Version 0.34 log4j:WARN No appenders could be found for logger (org.java.plugin.ObjectFactory). log4j:WARN Please initialize the log4j system properly. 1.6.2010 22:30:59 org.openstreetmap.osmosis.core.Osmosis run INFO: Preparing pipeline. 1.6.2010 22:30:59 org.openstreetmap.osmosis.core.Osmosis run INFO: Launching pipeline execution. 1.6.2010 22:30:59 org.openstreetmap.osmosis.core.Osmosis run INFO: Pipeline executing, waiting for completion. 1.6.2010 22:31:31 org.openstreetmap.osmosis.core.pipeline.common.ActiveTaskManager waitForCompletion SEVERE: Thread for task 1-read-xml-change failed org.openstreetmap.osmosis.core.OsmosisRuntimeException: Unable to insert current way node with way id=4332984 and node id=26369792. at org.openstreetmap.osmosis.core.apidb.v0_6.impl.ChangeWriter.write(ChangeWriter.java:755) at org.openstreetmap.osmosis.core.apidb.v0_6.impl.ActionChangeWriter.process(ActionChangeWriter.java:56) at org.openstreetmap.osmosis.core.container.v0_6.WayContainer.process(WayContainer.java:60) at org.openstreetmap.osmosis.core.apidb.v0_6.ApidbChangeWriter.process(ApidbChangeWriter.java:67) at org.openstreetmap.osmosis.core.xml.v0_6.impl.ChangeSourceElementProcessor$ChangeSinkAdapter.process(ChangeSourceElementProcessor.java:134) at org.openstreetmap.osmosis.core.xml.v0_6.impl.WayElementProcessor.end(WayElementProcessor.java:116) at org.openstreetmap.osmosis.core.xml.v0_6.impl.OsmChangeHandler.endElement(OsmChangeHandler.java:94) at com.sun.org.apache.xerces.internal.parsers.AbstractSAXParser.endElement(AbstractSAXParser.java:604) at com.sun.org.apache.xerces.internal.impl.XMLDocumentFragmentScannerImpl.scanEndElement(XMLDocumentFragmentScannerImpl.java:1759) at com.sun.org.apache.xerces.internal.impl.XMLDocumentFragmentScannerImpl$FragmentContentDriver.next(XMLDocumentFragmentScannerImpl.java:2915) at com.sun.org.apache.xerces.internal.impl.XMLDocumentScannerImpl.next(XMLDocumentScannerImpl.java:625) at com.sun.org.apache.xerces.internal.impl.XMLDocumentFragmentScannerImpl.scanDocument(XMLDocumentFragmentScannerImpl.java:488) at com.sun.org.apache.xerces.internal.parsers.XML11Configuration.parse(XML11Configuration.java:812) at com.sun.org.apache.xerces.internal.parsers.XML11Configuration.parse(XML11Configuration.java:741) at com.sun.org.apache.xerces.internal.parsers.XMLParser.parse(XMLParser.java:123) at com.sun.org.apache.xerces.internal.parsers.AbstractSAXParser.parse(AbstractSAXParser.java:1208) at com.sun.org.apache.xerces.internal.jaxp.SAXParserImpl$JAXPSAXParser.parse(SAXParserImpl.java:525) at javax.xml.parsers.SAXParser.parse(SAXParser.java:392) at javax.xml.parsers.SAXParser.parse(SAXParser.java:195) at org.openstreetmap.osmosis.core.xml.v0_6.XmlChangeReader.run(XmlChangeReader.java:107) at java.lang.Thread.run(Thread.java:636) Caused by: org.postgresql.util.PSQLException: ERROR: insert or update on table "current_way_nodes" violates foreign key constraint "current_way_nodes_node_id_fkey" Detail: Key (node_id)=(26369792) is not present in table "current_nodes". at org.postgresql.core.v3.QueryExecutorImpl.receiveErrorResponse(QueryExecutorImpl.java:2062) at org.postgresql.co
Re: [OSM-dev] Osmosis problem or problem with planet.osm.bz2?
John Smith writes: > Neither is java, but people still install and use osmosis anyway. Ah, I first thought that we'd need some runtime detection for the existence of bzcat. If we make it mandatory then it could be easier indeed. ___ dev mailing list dev@openstreetmap.org http://lists.openstreetmap.org/listinfo/dev
Re: [OSM-dev] Osmosis problem or problem with planet.osm.bz2?
John Smith writes: > If that's the case shouldn't osmosis code should be updated to call > bzcat if it's given a bz2 file? bzcat might not always be present. ___ dev mailing list dev@openstreetmap.org http://lists.openstreetmap.org/listinfo/dev
Re: [OSM-dev] 'Up-to-Date', serving ondemand live Mapnik data
Christopher Schmidt writes: > Using the osm2pgsql diff loading code, and osmosis's --rci, I've got an > up to date copy of the Mapnik database being maintained on a server I > have access to. I put together a little bookmarklet that lets you do a > 'live view' of any area by pressing a button. > > http://labs.metacarta.com/osm/up-to-date/ Sounds great :-) Here's a video of how it also really works here: http://iki.fi/lindi/osm/up-to-date1.ogv ___ dev mailing list dev@openstreetmap.org http://lists.openstreetmap.org/listinfo/dev
[OSM-dev] internal server error: informationfreeway.org/api/0.5/way[name=Vilhonvuorenkatu]
Hi, any idea why $ wget -O a 'http://www.informationfreeway.org/api/0.5/way[name=Vilhonvuorenkatu]' Warning: wildcards not supported in HTTP. --18:02:46-- http://www.informationfreeway.org/api/0.5/way[name=Vilhonvuorenkatu] => `a' Resolving www.informationfreeway.org... 80.68.90.42 Connecting to www.informationfreeway.org|80.68.90.42|:80... connected. HTTP request sent, awaiting response... 302 Found Location: http://osmxapi.hypercube.telascience.org/api/0.5/way%5bname=Vilhonvuorenkatu%5d [following] --18:02:46-- http://osmxapi.hypercube.telascience.org/api/0.5/way%5bname=Vilhonvuorenkatu%5d => `a' Resolving osmxapi.hypercube.telascience.org... 137.110.119.130 Connecting to osmxapi.hypercube.telascience.org|137.110.119.130|:80... connected. HTTP request sent, awaiting response... 501 Internal Server Error 18:03:13 ERROR 501: Internal Server Error. fails with internal server error? best regards, Timo Lindfors ___ dev mailing list dev@openstreetmap.org http://lists.openstreetmap.org/listinfo/dev
Re: [OSM-dev] source code for josm ewmsplugin?
Frederik Ramm <[EMAIL PROTECTED]> writes: >> Thanks for confirming this. So the binary ewmsplugin.jar in SVN has >> been compiled from current head of plugins/wmsplugin/ and the binary >> wmsplugin.jar in SVN has been compiled from some older revision of >> that directory? I have svn account so I could add a note that explains >> this to the directory so that other people can find it when they grep >> -r ewmsplugin. > > Yes, you can do that (but make a note to remove it later ;-) Ok, revision 11952 now has dist/ewmsplugin.NOTE that explains the situation. ___ dev mailing list dev@openstreetmap.org http://lists.openstreetmap.org/listinfo/dev
Re: [OSM-dev] source code for josm ewmsplugin?
Frederik Ramm <[EMAIL PROTECTED]> writes: > Yes, and currently whoever checks in the ewmsplugin.jar does a rename > beforehand. Thanks for confirming this. So the binary ewmsplugin.jar in SVN has been compiled from current head of plugins/wmsplugin/ and the binary wmsplugin.jar in SVN has been compiled from some older revision of that directory? I have svn account so I could add a note that explains this to the directory so that other people can find it when they grep -r ewmsplugin. http://wiki.openstreetmap.org/index.php/Accounts#SVN_access_.28OSM_software.29 says that JOSM is maintained in a separate SVN repository -- is this also out-of-date information? ___ dev mailing list dev@openstreetmap.org http://lists.openstreetmap.org/listinfo/dev
Re: [OSM-dev] source code for josm ewmsplugin?
Frederik Ramm <[EMAIL PROTECTED]> writes: > Yes that's misleading; the wmsplugin source is actually what makes the > ewmsplugin! We just didn't remove the old wmsplugin binary yet so that Oh! Where are the scripts I need to create ewmsplugin.jar from those sources? I think if I run ant I will get wmsplugin.jar. ___ dev mailing list dev@openstreetmap.org http://lists.openstreetmap.org/listinfo/dev
[OSM-dev] source code for josm ewmsplugin?
Hi, where's the source code of ewmsplugin.jar? I see svn.openstreetmap.org/applications/editors/josm/plugins/wmsplugin but grep -r ewms ../ finds nothing. best regards, Timo Lindfors ___ dev mailing list dev@openstreetmap.org http://lists.openstreetmap.org/listinfo/dev
Re: [OSM-dev] introductory videos with free software?
Hi, Frederik Ramm <[EMAIL PROTECTED]> writes: > I guess it is a matter of priorities; some would rather advance the > cause of OSM even if they have to use non-free software to achieve it, > and others would rather avoid using non-free software even if this > means that they cannot help OSM... Yeah, free software > free maps at least for now :-) -Timo ___ dev mailing list dev@openstreetmap.org http://lists.openstreetmap.org/cgi-bin/mailman/listinfo/dev
Re: [OSM-dev] introductory videos with free software?
Hi, SteveC <[EMAIL PROTECTED]> writes: > Better yet, you could re-record them, several are starting to get > dated now that potlatch has slightly different UI and so on. it's bit tricky since potlatch does not run with gnash yet. best regards, Timo Lindfors ___ dev mailing list dev@openstreetmap.org http://lists.openstreetmap.org/cgi-bin/mailman/listinfo/dev
[OSM-dev] introductory videos with free software?
Hi, I tried to watch the videos linked at http://wiki.openstreetmap.org/index.php/Beginners%27_Guide with gnash from debian unstable but it kept updating only a small rectangular area: http://iki.fi/lindi/osm/video-with-gnash1.png Are these videos available somewhere in some other format? If not, who should I ask for a permission to screenscrape them to ogg theora or something (if that's the only way to convert them)? best regards, Timo Lindfors ___ dev mailing list dev@openstreetmap.org http://lists.openstreetmap.org/cgi-bin/mailman/listinfo/dev
[OSM-dev] svn commit access to applications/utils/export/tiledata/import?
Hi, can I get svn commit access to http://svn.openstreetmap.org/applications/utils/export/tiledata/import so that I can more efficiently work on adding minutely diff support to import? best regards, Timo Lindfors ___ dev mailing list dev@openstreetmap.org http://lists.openstreetmap.org/cgi-bin/mailman/listinfo/dev
Re: [OSM-dev] simple tool for finding minimal set of osmosis diff files
Hi, Brett Henderson <[EMAIL PROTECTED]> writes: > Osmosis has a task named --read-change-interval which will download all > changes from the last time it ran (it maintains a timestamp file), and > merge them into a single changeset. That changeset can then be used to > patch a file, or imported into a database, etc. Aha, due to java issues I was using the java5 compatible version which does not have that option: $ grep -ri read-change-interval osmosis-0.24.1-java5 $ > For example, I use it to maintain a local copy of all data in Myanmar. > http://www.bretth.com/myanmar/ > The main file of interest in that directory is replicate_osm_file.sh > which is launched from cron hourly. configuration.txt defines which set > of diffs to download, I'm using hourly diffs but minute and day diffs > will also work. Interesting, I didn't know you could apply diffs if you only have some small bounding box of data. > There is one big problem with your script which should be easy to fix. > DON'T use the bz2 daily files, they use a different timezone offset > (BST) to the gz daily files (UTC) so will contain slightly different > data. I'm going to disable them very soon in favour of the new gz > files. The gz files are a bit larger but fix timezone issues and > drastically improve the reliability of daily files. Thanks for the warning :-) I fixed the script. > One nice thing about your script is that it uses daily files and hourly > diffs, osmosis won't do that for you. It's probably faster to use your > approach because less files are downloaded, although the total bandwidth > consumption will be almost identical. Yep, I am experimenting with http://svn.openstreetmap.org/applications/utils/export/tiledata/import and trying to make it support minutely diffs so I really need more than just hourly diffs. I need to add support for the case where starttime is not at midnight. best regards, Timo Lindfors ___ dev mailing list dev@openstreetmap.org http://lists.openstreetmap.org/cgi-bin/mailman/listinfo/dev
[OSM-dev] simple tool for finding minimal set of osmosis diff files
Hi, in order to sync my local planet.osm I need to fetch a number of osmosis diff files. I could not find a tool for figuring out which files are needed so I wrote my own. Please let me know if I just reinvented some wheels :-) http://iki.fi/lindi/planet-sync.pl # usage example: # # ./planet-sync.pl 2008062500 20080629180400 # http://planet.openstreetmap.org/daily/daily-20080625-20080626.osc.bz2 # http://planet.openstreetmap.org/daily/daily-20080626-20080627.osc.bz2 # http://planet.openstreetmap.org/daily/daily-20080627-20080628.osc.bz2 # http://planet.openstreetmap.org/daily/daily-20080628-20080629.osc.bz2 # http://planet.openstreetmap.org/hourly/2008062900-2008062901.osc.gz # http://planet.openstreetmap.org/hourly/2008062901-2008062902.osc.gz # http://planet.openstreetmap.org/hourly/2008062902-2008062903.osc.gz # http://planet.openstreetmap.org/hourly/2008062903-2008062904.osc.gz # http://planet.openstreetmap.org/hourly/2008062904-2008062905.osc.gz # http://planet.openstreetmap.org/hourly/2008062905-2008062906.osc.gz # http://planet.openstreetmap.org/hourly/2008062906-2008062907.osc.gz # http://planet.openstreetmap.org/hourly/2008062907-2008062908.osc.gz # http://planet.openstreetmap.org/hourly/2008062908-2008062909.osc.gz # http://planet.openstreetmap.org/hourly/2008062909-2008062910.osc.gz # http://planet.openstreetmap.org/hourly/2008062910-2008062911.osc.gz # http://planet.openstreetmap.org/hourly/2008062911-2008062912.osc.gz # http://planet.openstreetmap.org/hourly/2008062912-2008062913.osc.gz # http://planet.openstreetmap.org/hourly/2008062913-2008062914.osc.gz # http://planet.openstreetmap.org/hourly/2008062914-2008062915.osc.gz # http://planet.openstreetmap.org/hourly/2008062915-2008062916.osc.gz # http://planet.openstreetmap.org/hourly/2008062916-2008062917.osc.gz # http://planet.openstreetmap.org/hourly/2008062917-2008062918.osc.gz # http://planet.openstreetmap.org/minute/200806291800-200806291801.osc.gz # http://planet.openstreetmap.org/minute/200806291801-200806291802.osc.gz # http://planet.openstreetmap.org/minute/200806291802-200806291803.osc.gz # http://planet.openstreetmap.org/minute/200806291803-200806291804.osc.gz best regards, Timo Lindfors ___ dev mailing list dev@openstreetmap.org http://lists.openstreetmap.org/cgi-bin/mailman/listinfo/dev
