[OSM-dev] Web Server Directory Listings on Errol

2020-03-11 Thread Brett Henderson
Hi Folks, I'm wondering if it's possible to customise web server directory listings under my user home on Errol. Michal Migurski has graciously offered to help with some basic Osmosis maintenance to help keep the lights on with essential PRs and as part of this we've decided to host downloads dir

Re: [OSM-dev] Multithreading in new version of osmosis

2018-10-15 Thread Brett Henderson
Hi Sanjay, I'm glad you figured it out. I must admit I'd forgotten to respond to your initial message ... On Mon, 8 Oct 2018 at 20:19 Sanjay B wrote: > On Thursday 04 October 2018 04:29 PM, Sanjay B wrote: > > > > > This works fine and data is imported, except that it seems to be > > running on

Re: [OSM-dev] Builds available for Osmosis 0.47 ?

2018-10-03 Thread Brett Henderson
Hi Sanjay, I made it half way through the release and ran out of time to finish it. The distribution zip and tgz files should end up under the "package/build/distribution" directory. Cheers, Brett On Thu, 4 Oct 2018 at 05:25 Sanjay B wrote: > Hi, > > (Apologies in advance if this is not the be

Re: [OSM-dev] Fetch child relations by naming parent with Osmosis

2016-07-05 Thread Brett Henderson
On Wed, 6 Jul 2016 at 12:34 Jochen Topf wrote: > On Di, Jul 05, 2016 at 11:26:50 +, Humphries, Grant wrote: > > I have an OSM extract from which I am trying to use Osmosis to import > into PostGIS only railways that are a part of a transit network that is > defined by relations. There is a s

Re: [OSM-dev] osmosis not handling empty command line values

2016-06-07 Thread Brett Henderson
On Mon, 6 Jun 2016 at 09:33 Stadin, Benjamin < benjamin.sta...@heidelberg-mobil.com> wrote: > Hi, > > I¹m following the import example from [1] with a small extract: > > osmosis --read-pbf ka.pbf \ > --write-apidb host="localhost" database="openstreetmap" \ > user="openstreetmap" password="" v

Re: [OSM-dev] Osmosis RuntimeException: Pipeline entities are not sorted

2016-05-12 Thread Brett Henderson
e too strict. It may be necessary to fix the file manually ... On Thu, 12 May 2016 at 20:30 Brett Henderson wrote: > Okay, so the --simplify-change task is failing because it requires sorted > input. > > Can you try this? It will sort the changes before attempting to simplify > t

Re: [OSM-dev] Osmosis RuntimeException: Pipeline entities are not sorted

2016-05-12 Thread Brett Henderson
.java:238) > at > org.codehaus.plexus.classworlds.launcher.Launcher.mainWithExitCode(Launcher.java:415) > at > org.codehaus.plexus.classworlds.launcher.Launcher.main(Launcher.java:356) > at org.codehaus.classworlds.Launcher.main(Launcher.java:47) > > > > On 12.05.2016, at 05:1

Re: [OSM-dev] Osmosis RuntimeException: Pipeline entities are not sorted

2016-05-11 Thread Brett Henderson
Can you provide more of the stack trace? It would be helpful to see exactly which task in the pipeline is failing. It *may* be possible to workaround it it with an intermediate sort task. On Wed, 11 May 2016 at 21:43 Michael Kussmaul wrote: > Yes, I see the same problem, I’m using osmosis to k

Re: [OSM-dev] Osmosis data corruption on Debian Jessie/Testing

2015-11-02 Thread Brett Henderson
I've added the check. Processing will abort if unicode support is broken, and the error message suggests including a newer version of Xerces. On Mon, 2 Nov 2015 at 17:30 Brett Henderson wrote: > Ah, great I'll take a look this evening and see if I can add a runtime > check. &

Re: [OSM-dev] Osmosis data corruption on Debian Jessie/Testing

2015-11-01 Thread Brett Henderson
s node: http://www.openstreetmap.org/node/3382756758. Then > run > > > > > it through osmosis: > > > > > > > > > > osmosis --rx 3382756758.osm --wx out.osm > > > > > Compare the two files, you'll see the musical notation characte

Re: [OSM-dev] Osmosis data corruption on Debian Jessie/Testing

2015-11-01 Thread Brett Henderson
face again. Either by detecting the runtime or by the check > you describe. At least we should put the check into a unit test, so that > people who run the tests on their platform after building can be safe. > > Jochen > > On Thu, Mar 05, 2015 at 05:25:12PM +1100, Brett Henderson wr

Re: [OSM-dev] unable to create jar file from the OSM-binary

2015-06-04 Thread Brett Henderson
I've battled with that library in the past because it's used by Osmosis. I forked the project and made some changes to make it easier to integrate with Osmosis. The biggest change was moving the build to Gradle instead of Maven, but it also changes package names to avoid namespace collisions. Eve

Re: [OSM-dev] [osmosis-dev] Proposal for a multithreaded PBF reader

2015-06-03 Thread Brett Henderson
On 30 April 2015 at 03:27, Paul Norman wrote: > On 4/29/2015 9:55 AM, Martijn van Exel wrote: > >> If osmosis is the reference implementation, is there a reason why it >> doesn't seem to leverage this block structure to speed up reading? Or >> does it? >> > Osmosis has the --read-pbf-fast task wh

Re: [OSM-dev] Osmosis data corruption on Debian Jessie/Testing

2015-03-04 Thread Brett Henderson
I suspect that attempting to detect the underlying XML runtime would be brittle. Another option might be to embed that bit of data in Osmosis itself and do a self test before attempting to execute any XML tasks. I'm surprised that this is still an issue in standard Java. I tried raising tickets

Re: [OSM-dev] Problems with mapsforge osmosis plugin

2013-04-21 Thread Brett Henderson
Hi Mike, On 20 April 2013 11:39, Michal Migurski wrote: > On Apr 19, 2013, at 6:38 PM, Michal Migurski wrote: > > > Osmosis is installed under /usr/local for me. I have the latest version, > 4.3 from earlier this month. > > > > With the plugin under lib/default I now see this error: > > > >o

Re: [OSM-dev] Osmosis API

2013-04-06 Thread Brett Henderson
Hi Sadeer, On 4 April 2013 18:53, Sadeer Nasser wrote: > Hi guys, > > I'm trying to use the Osmosis API (the Jar file not the command-line tool) > in my Java application but not sure how to get started as there doesn't > seem to be enough stuff on the web to help people with this. Specifically,

Re: [OSM-dev] osmosis 32/64 ID failure

2013-02-13 Thread Brett Henderson
On 13 February 2013 17:41, NopMap wrote: > > Hi! > > So which of the two statements is true? > > 1. 64bit IDs are only supported in 64bit tracker, so 0.42 will change > nothing and it's just a matter of documentation. The 64bit wiki page is > wrong. > 0.42 will make the Dynamic id tracker type t

Re: [OSM-dev] osmosis 32/64 ID failure

2013-02-12 Thread Brett Henderson
On 13 February 2013 06:21, NopMap wrote: > > Hi! > > > Brett Henderson wrote > > I believe it was fixed in Osmosis 0.38. But I'd recommend using 0.41 > (ie. > > the latest) if possible. > > Unfortunately, it is only partially fixed. I tried Osmosis 0.

Re: [OSM-dev] osmosis 32/64 ID failure

2013-02-10 Thread Brett Henderson
On 11 February 2013 07:33, Jochen Topf wrote: > On Sun, Feb 10, 2013 at 09:31:16AM -0700, Kai Krueger wrote: > > On 02/09/2013 04:13 PM, Lynn W. Deffenbaugh (Mr) wrote: > > >I'm running Osmosis Version 0.34 to pull and apply minutely > > >updates to my database for use by mod_tile/renderd. These

Re: [OSM-dev] Osmosis crash (what am I doing wrong)

2012-12-13 Thread Brett Henderson
Hi Serge, On 14 December 2012 15:11, Serge Wroclawski wrote: > > What have I done wrong? > The following line in the stack trace indicates that you've run out of disk space during processing. Caused by: java.io.IOException: No space left on device The --used-node task stores all data to tempor

Re: [OSM-dev] Timestamp in PBF files

2012-12-11 Thread Brett Henderson
On 12 December 2012 01:53, Frederik Ramm wrote: > Hi, > > It would be great if someone were to add support to Osmosis which is > likely to be a bit tricky as you have to shove replication information > through the pipeline, but if all else fails I might have a go at it during > the holidays.

Re: [OSM-dev] Timestamp in PBF files

2012-11-24 Thread Brett Henderson
Hi Markus, On 24 November 2012 00:04, wrote: > Hi Brett, > > > *If* this information is intended to be used as an input into replication > > processes then the sequence number is essential. Osmosis writes a > > timestamp in the state.txt file, but it only for identifying the right > > sequence

Re: [OSM-dev] Timestamp in PBF files

2012-11-23 Thread Brett Henderson
On 21 November 2012 19:43, Frederik Ramm wrote: > Hi, > > To be self-contained, it should be sufficient to include the "baseURL" > from configuration.txt, no? > > So maybe: > > > optional string writingprogram = 16; > optional string source = 17; > optional sint64 timestamp = 18; > opt

Re: [OSM-dev] Osmosis bug with --write-pgsql task

2012-10-19 Thread Brett Henderson
Hi Mike, On 16 October 2012 05:57, Michal Migurski wrote: > Hello, > > I've encountered an error with Osmosis and writing to the snapshot schema > that might be a bug. I am attempting to add a new extract to an existing > database, and seeing an error where a new index is trying to be created. A

Re: [OSM-dev] Fwd: Streaming Replication

2012-10-19 Thread Brett Henderson
On 15 October 2012 23:08, Matt Amos wrote: > On Sun, 2012-10-14 at 22:39 +1100, Brett Henderson wrote: > > The timestamp columns in the database are set to "timestamp without > > time zone" which presumably means the timezones of dates aren't > > automatical

Re: [OSM-dev] Fwd: Streaming Replication

2012-10-14 Thread Brett Henderson
On 14 October 2012 13:59, Brett Henderson wrote: > On 14 October 2012 09:46, sly (sylvain letuffe) wrote:note > : I have a strange issue with all objects's timestamp, they seam > to be > >> shifted by -1 hour >> > > Really? I might have to look into this this

Re: [OSM-dev] Streaming Replication

2012-10-13 Thread Brett Henderson
One extra bit of info that might be of interest. There are a number of different URLs supported by the server. They are described here: http://wiki.openstreetmap.org/wiki/Osmosis/Detailed_Usage#--send-replication-data_.28--srd.29 To summarise: - You can download just state information, or st

Re: [OSM-dev] Fwd: Streaming Replication

2012-10-13 Thread Brett Henderson
On 14 October 2012 09:46, sly (sylvain letuffe) wrote: > > Hi All, > > Hi Brett, > > > To solve this, a new streaming replication mechanism has been developed. > > Under the covers the same database queries are utilised, but the process > > performing the queries runs continously and polls the da

[OSM-dev] Fwd: Streaming Replication

2012-10-12 Thread Brett Henderson
Oops, I sent my previous email to the wrong list ... -- Forwarded message -- From: Brett Henderson Date: 13 October 2012 15:43 Subject: Streaming Replication To: osmosis-dev Hi All, For those of you who currently use the minute diffs to keep a local database up to date, you

Re: [OSM-dev] XML planets (was Re: New proposed directory layout for planet.openstreetmap.org)

2012-09-07 Thread Brett Henderson
On 7 September 2012 17:28, Roland Olbricht wrote: > The planet file is necessary for the first startup. Afterwards, it can > work forever solely on minute diffs. And new instances can be cloned from > the exisiting instance over a public interface, without a planet file. > > This initial startup

Re: [OSM-dev] Broken Daily Replication Diffs

2012-09-04 Thread Brett Henderson
On 4 September 2012 15:48, Stéphane Henriod wrote: > Hi Brett > > Is this problem only for the daily diffs, or also for the minutes and > hours? I am trying to get the minutely diffs working and get some strange > error messages "*Unable to read the changeset file on the server*" > It was only d

Re: [OSM-dev] Osmosis exception

2012-09-01 Thread Brett Henderson
On 2 September 2012 04:26, Stéphane Henriod wrote: > Hi Brett > > Thanks for your answer! > > Yes I have compiled the source with the command ant build. > What command did you run to build the software, and which directory did you run the command from? Did the ant command complete without error

Re: [OSM-dev] Osmosis exception

2012-09-01 Thread Brett Henderson
Hi Stéphane, On 31 August 2012 23:11, Stéphane Henriod wrote: > Hello > > it's the first time I post on this list, so I hope it's the right place to > ask this question! > > I want to use Osmosis to keep a PostGIS database up-to-date (for use with > Mapnik), as explained here > http://wiki.opens

[OSM-dev] Broken Daily Replication Diffs

2012-09-01 Thread Brett Henderson
Hi All, Please note that there have been some problems with the daily replication diffs in the last couple of days. http://planet.openstreetmap.org/redaction-period/day-replicate/ BACKGROUND All files after 148 were incorrectly created. The data in them was more or less valid data, but they were

[osmosis-dev] Osmosis 0.41 Released

2012-08-29 Thread Brett Henderson
Hi All, I've just released Osmosis 0.41. http://bretth.dev.openstreetmap.org/osmosis-build/osmosis-0.41.tgz http://bretth.dev.openstreetmap.org/osmosis-build/osmosis-0.41.zip http://dev.openstreetmap.de:23457/hudson/job/osmosis-release/6/ >From changes.txt: - All entities can now pass metadat

Re: [OSM-dev] Using changesets-latest.osm

2012-01-25 Thread Brett Henderson
On 22 January 2012 11:08, Toby Murray wrote: > > Yes, I am aware of this. I want to query the metadata. Comment tags, > bboxes, users and such. I don't really care if it is in the apidb > schema or not. My first thought was that this would "just work" with > osmosis but that obviously isn't the c

Re: [OSM-dev] problem with osmosis to apply changeset to postgresql db

2011-12-27 Thread Brett Henderson
On 27 December 2011 08:10, Oon Arfiandwi wrote: > Hi brett, > > On Wed, Dec 21, 2011 at 5:04 AM, Brett Henderson wrote: > > On 20 December 2011 03:14, Oon Arfiandwi wrote: > >> > >> I just try to apply osmosis command below, > >> the problem is: &qu

Re: [osmosis-dev] nodes column in way table and way_nodes table

2011-12-27 Thread Brett Henderson
and -Xmx 16000. It uses all the > physically available memory (nearly 16GB) and throws the exception when > that limit is reached. > > > 2011/12/26 Brett Henderson > >> On 26 December 2011 01:43, Michel Seuthe wrote: >> >>> Ya, I used a similar statement

Re: [OSM-dev] Full history extracts

2011-12-24 Thread Brett Henderson
On 24/12/2011, at 8:19 PM, Frederik Ramm wrote: > Hi, > > On Sat, 24 Dec 2011 13:47:48 +1100 > Brett Henderson wrote: >> Osmosis doesn't currently support the full history data format. It >> only supports the alternative osmChange format. > > Suppose I were

Re: [OSM-dev] Full history extracts

2011-12-23 Thread Brett Henderson
On 24 December 2011 00:01, kimaidou wrote: > Hi SImon > > This seems very interesting ! > Are these full history extracts compatible with the osmosis apidb database > structure ? I mean, how can I import them in osmosi apidb, then use the > minutely diff to stay up to date ? > Osmosis doesn't cu

Re: [OSM-dev] problem with osmosis to apply changeset to postgresql db

2011-12-20 Thread Brett Henderson
Hi Oon, On 20 December 2011 03:14, Oon Arfiandwi wrote: > Hi Frederik, > > I just try to apply osmosis command below, > the problem is: "Caused by: org.postgresql.util.PSQLException: ERROR: > relation "schema_migrations" does not exist" > > I read a solution about schema_migrations relation here

Re: [OSM-dev] osm2pgsql not appending changeset?

2011-12-08 Thread Brett Henderson
On 8 December 2011 18:41, Ákos Maróy wrote: > On 08/12/11 08:23, Andre Joost wrote: > > Am 08.12.2011 02:00, schrieb Ákos Maróy: > >> On 07/12/11 01:28, Erik Johansson wrote: > >>> > http://wiki.openstreetmap.org/wiki/Osmosis/Detailed_Usage_0.39#Replication_Tasks > >>> > >>> > >>> Or the well wri

Re: [OSM-dev] Osmosis 0.4 windows batch file: wrong classpath

2011-12-06 Thread Brett Henderson
On 7 December 2011 16:18, Brett Henderson wrote: > Thanks for the report Curt, I'll make the change and issue a 0.40.1 > release as soon as I can. > Done. Let me know if you still encounter any issues. Brett ___ dev ma

Re: [OSM-dev] Osmosis 0.4 windows batch file: wrong classpath

2011-12-06 Thread Brett Henderson
On 7 December 2011 00:59, Curt Nowak wrote: > Hi all, > > (I know, there must be an osmosis mailing list somewhere, but I guess some > of this list's readers are interested as well.) > > That said, version 0.40 of osmosis (as can be downloaded from [1]) > contains a wrong line in its bin/osmosis.

Re: [OSM-dev] Incomplete diffs?

2011-11-30 Thread Brett Henderson
On 21 November 2011 06:06, Peter Körner wrote: > Am 05.11.2011 22:33, schrieb mar...@gmx.eu: > > > Hi Erik, > > > > thanks for your help. The missing node seems to be available via > minutely and hourly diff files but NOT via the daily file. > > > > Meanwhile I found an explanation in the Wiki: >

Re: [OSM-dev] Updating Planet and Reliability

2011-10-21 Thread Brett Henderson
Hi Andrew, On Wed, Oct 19, 2011 at 11:54 PM, Andrew Ayre wrote: > On 7/21/2011 9:19 AM, Andy Allan wrote: > > On Thu, Jul 21, 2011 at 9:07 AM, Andrew Ayre > wrote: > >> Keeping my copy of the planet up to date is a two-step process with > >> Osmosis. Get the latest changes and applying them. Th

Re: [OSM-dev] osmosis + postgis 2.0 - usage of legacy function namens

2011-07-22 Thread Brett Henderson
On Sat, Jul 9, 2011 at 4:48 AM, Florian Lohoff wrote: > On Fri, Jul 08, 2011 at 09:34:35AM -0500, Ian Dees wrote: > > On Fri, Jul 8, 2011 at 9:12 AM, Florian Lohoff wrote: > > > > > > > > Hi, > > > i just found a future bug when postgis 2.0 will be used more - osmosis > 0.39 > > > uses legacy fu

Re: [OSM-dev] osmosis with completeWays option behaves strangely

2011-07-22 Thread Brett Henderson
On Mon, Jul 4, 2011 at 3:45 AM, ant wrote: > Hi all, > > I'm experimenting with osmosis boundig box operations in order to find out > how completeWays, completeRelations and cascadingRelations behave. Comparing > the outputs of bbox operations done with completeWays=yes and no, > respectively, I

Re: [OSM-dev] Updating Planet and Reliability

2011-07-21 Thread Brett Henderson
On Thu, Jul 21, 2011 at 6:18 PM, Frederik Ramm wrote: > Hi, > > > On 07/21/2011 10:07 AM, Andrew Ayre wrote: > >> What protection is there in Osmosis to recover from this without missing >> any changes? If none, how are people solving this in their scripts? >> > > I usually do this: > > * get lat

Re: [OSM-dev] How to use osmosis as a lib with direct access to the classes?

2011-07-04 Thread Brett Henderson
Hi Robert, On Thu, Jun 30, 2011 at 12:51 AM, Robert Greil wrote: > Hi! > > I am currently trying to use OSMOSIS as a lib for our java project. I have > already checked out the svn repository and downloaded the latest osmosis zip > from the website. I included all *.jar found in the Osmosis/lib d

Re: [OSM-dev] History File Formats

2011-05-11 Thread Brett Henderson
Hi Frederik, On Thu, May 12, 2011 at 2:14 AM, Frederik Ramm wrote: > Hi, > > > On 05/11/11 15:31, Brett Henderson wrote: > >> I then used the osc file format to create not only the commonly used >> daily/hourly/minutely replication files, but also a complete dump of

Re: [osmosis-dev] [PATCH] --upload-xml-change does not send correct credentials

2011-05-11 Thread Brett Henderson
. I still > can't believe the code that was in there never could have worked in the > first place. > > Cheers, > > Guillaume > > On 9 May 2011, at 12:22, Brett Henderson wrote: > > Hi Guillaume, > > Thanks for the patch! > > I haven't used this t

[OSM-dev] History File Formats

2011-05-11 Thread Brett Henderson
Hi All, With the recent discussions around deciding on file extensions (eg. osm, osc, osh, pbf, etc) it seemed a good time to raise a question I've had for a while now. What is the relationship between osmChange (osc) files, and full history files (osh?) with visible attributes? When I first cre

Re: [OSM-dev] visible-Flag in PBF

2011-05-09 Thread Brett Henderson
On Sun, May 8, 2011 at 6:15 AM, Scott Crosby wrote: > The problem is that osmosis doesn't have functionality to 'push' > metadata through the pipeline. The pbf reader, as a consumer, has > barely any metadata available to put in the file header. It has no > idea if the data is sorted or not so ca

Re: [OSM-dev] [osmosis-dev] [patch] Merge command an resulting bounding box?

2011-05-09 Thread Brett Henderson
Hi Igor, Thanks for the patch! I just applied your patch to Osmosis trunk before receiving this latest email. I've applied it without making any changes, it all looks good to me. I'm not too fussed about the default of warning. As you say, it preserves backwards compatibility which is generall

Re: [OSM-dev] Xapi-servlet deployement in Tomcat

2011-02-01 Thread Brett Henderson
Tomcat should allow file-based deployment. It should be as simple as copying the war file into the webapps directory. It will end up with a context root that matches the war filename (minus .war). Different app servers usually provide ways to override the default context root via embedding app s

Re: [OSM-dev] Using osmosis as a lib?

2011-02-01 Thread Brett Henderson
Hi Franz, On Tue, Jan 25, 2011 at 1:40 AM, Franz wrote: > Hi, > > is it possible to use osmosis as a library in order to use it in an own, > separate java program? I wanted to transform pbf to xml and extract > subregions from larger osm/pbf files. > Yes, definitely. It has been done a number

Re: [OSM-dev] scaling

2011-01-10 Thread Brett Henderson
On 11/01/2011, at 7:30, Matt Amos wrote: > > it seems postgres 9 isn't able to do temporary table creation on > hot-standby servers [1]. maybe this is something that'll be fixed in > future versions (but it doesn't seem to be on the TODO [2]) or maybe > it's an opportunity to put a bounty to good

Re: [OSM-dev] API/XAPI caching proxy server

2010-12-17 Thread Brett Henderson
Hi Stefan, On Fri, Dec 17, 2010 at 11:45 AM, Stefan Keller wrote: > Hi Brett > > Thanks very much for your detailed instructions. > > > In my experience the biggest limitation in performance is disk seeking, > > rather than the amount of data returned. > > If that's the bottleneck (or the amount

Re: [OSM-dev] API/XAPI caching proxy server

2010-12-16 Thread Brett Henderson
I'll add some background info to the discussion which may be useful. If you do use a relational database, the latest pgsnapshot schema (ie. pgsimple with hstore tags) for Osmosis is at least worth a look. Note that I still called it the simple schema in Osmosis 0.38, but I am now differentiating

Re: [OSM-dev] Applying a changeset

2010-12-14 Thread Brett Henderson
Hi Andreas, What are the contents of your state.txt file in the /backup/downloads/zltl/replicate/rlp/ directory before and after you run the command? That file is used to track where replication is currently up to. If the doesn't exists when you run the command, a new one will be created based o

Re: [OSM-dev] Osmosis questions about applying changesets

2010-12-08 Thread Brett Henderson
On Wed, Dec 8, 2010 at 7:54 PM, Peter Körner wrote: > Am 07.12.2010 14:11, schrieb Andreas Kalsch: > > 3) This command does not seem to retrieve all changesets. After call, >> the latest timestamp was 20.11.2010. >> > > Did you check the maxInterval setting in configuration.txt? > Oops, I said t

Re: [OSM-dev] Osmosis questions about applying changesets

2010-12-08 Thread Brett Henderson
On Wed, Dec 8, 2010 at 4:39 AM, Andreas Kalsch wrote: > Am 07.12.10 14:11, schrieb Andreas Kalsch: > > 1) What does the data_type "U" in the actions table mean? >> > Of course: users, but 2 and 3 are still not clear to me. > > 2) It seems that Osmosis violates pk_aktions (primary key), so it wo

Re: [osmosis-dev] Get underlying timestamp string

2010-11-24 Thread Brett Henderson
Hi Rafael, On Tue, Nov 23, 2010 at 8:37 PM, Rafael Troilo wrote: > Hello, > > At the moment I use: > > XmlTimestampFormat xmlTimestampFormat = new XmlTimestampFormat(); > TimestampContainer tc = entity.getTimestampContainer(); > String timestamp = tc.getFormattedTimestamp(xmlTimestampFormat); >

Re: [osmosis-dev] Osmosis and retrieving relations+ways+nodes

2010-11-24 Thread Brett Henderson
Hi Rudi, On Tue, Nov 23, 2010 at 8:16 PM, Rudi Alberda wrote: > Hello everyone, > > I'm wondering if it is possible to retrieve relations with osmosis in the > same way as it can be done through the XAPI. When I query data through the > XAPI, based on relations (for example: > http://xapi.openstr

Re: [OSM-dev] Is there a way to use simple schema without hstore

2010-11-24 Thread Brett Henderson
Hi Sarah, On Fri, Nov 19, 2010 at 10:50 PM, Sarah Hoffmann wrote: > On Fri, Nov 19, 2010 at 09:37:33AM +0100, Andreas Kalsch wrote: > >> If you're applying diffs to the database you can enhance the > >> osmosisUpdate() function (initially empty, but can be customised) to > >> keep your separate

Re: [OSM-dev] Is there a way to use simple schema without hstore

2010-11-24 Thread Brett Henderson
Hi Andreas, On Sun, Nov 21, 2010 at 12:54 AM, Andreas Kalsch wrote: > Hi, > > thank you, Brett, for me this is the perfect setup. I hope that others will > find it useful as well. The names are OK. Two problems: > > 1) I read XML or PBF, dump it to CSV and then read the dump, but now my > featur

Re: [OSM-dev] Is there a way to use simple schema without hstore

2010-11-19 Thread Brett Henderson
On Sat, Nov 20, 2010 at 12:09 PM, Brett Henderson wrote: > Hmm, I've given all of this a bit more thought. Perhaps there is a need > for a "simple" schema that is easy for people to populate and utilise. I'm > quite happy with hstore, but it's not as simple f

Re: [OSM-dev] Is there a way to use simple schema without hstore

2010-11-19 Thread Brett Henderson
or something ... But I don't know when I'll get to do this. I'm very time poor at the moment. On Sat, Nov 20, 2010 at 11:47 AM, Brett Henderson wrote: > > > Please keep in mind that the one and only reason I've switched to hstore is > performance. It has not

Re: [OSM-dev] Is there a way to use simple schema without hstore

2010-11-19 Thread Brett Henderson
On Fri, Nov 19, 2010 at 10:50 PM, Sarah Hoffmann wrote: > On Fri, Nov 19, 2010 at 09:37:33AM +0100, Andreas Kalsch wrote: > >> If you're applying diffs to the database you can enhance the > >> osmosisUpdate() function (initially empty, but can be customised) to > >> keep your separate tags tables

Re: [OSM-dev] Is there a way to use simple schema without hstore

2010-11-19 Thread Brett Henderson
On Fri, Nov 19, 2010 at 8:25 PM, Andreas Kalsch wrote: > Am 19.11.10 10:06, schrieb Frederik Ramm: > > Hi, >> >> Andreas Kalsch wrote: >> >>> One simple answer: The drivers do not work appropriately with complex SQL >>> data types. In PHP or node.js I will get a string that I have to parse, in >>

Re: [OSM-dev] Is there a way to use simple schema without hstore

2010-11-19 Thread Brett Henderson
On Fri, Nov 19, 2010 at 7:37 PM, Andreas Kalsch wrote: > Hi Brett, > > thanks for your elaborate answer! Now I am up to date. Some ideas regarding > my use case ... > > Am 18.11.10 23:50, schrieb Brett Henderson: > > Hi Andreas, > > The change was made mostly fo

Re: [OSM-dev] Is there a way to use simple schema without hstore

2010-11-18 Thread Brett Henderson
On Fri, Nov 19, 2010 at 12:21 AM, Andreas Kalsch wrote: > It's always great to try something new, but we use Postgres as the database > and it is SQL, where I use tables. Somehow I feel forced to learn something > I and others will not use very often. It is better to be conservative about > schema

Re: [OSM-dev] Is there a way to use simple schema without hstore

2010-11-18 Thread Brett Henderson
Hi Andreas, The change was made mostly for performance reasons. With a full planet imported into the database, bounding box style queries are now approximately 10 times faster. This is due to a couple of reasons: - All data (with the exception of relations) is now clustered by geographica

Re: [OSM-dev] OSM binary format (pbf) 1.0 is in osmosis trunk.

2010-10-15 Thread Brett Henderson
I've released version 0.37 of Osmosis with this included. I haven't had a chance to update the wiki either. I'll try to do so over the next few days if nobody beats me to it. If anybody sees any issues with the binary support, please let Scott and I know. I'm now building Osmosis via an automat

Re: [OSM-dev] osmosis

2010-10-15 Thread Brett Henderson
It looks like your input file contains duplicate nodes. It is possible that multiple versions of the same node exist. This has come up a number of times on the mailing list. Does anybody have the list of steps for fixing this handy? Brett On Fri, Oct 15, 2010 at 3:21 AM, Jose Cid wrote: > H

Re: [OSM-dev] Bin-test failed (different test)

2010-10-04 Thread Brett Henderson
On Mon, Oct 4, 2010 at 1:56 AM, Scott Crosby wrote: > On Thu, Sep 30, 2010 at 7:41 PM, Brett Henderson wrote: > >> On Fri, Oct 1, 2010 at 12:23 AM, Curt Nowak >> wrote: >> >>> Hello dev, >>> >>> I also tested osmosis 0.37-SNAPSHOT with the

Re: [OSM-dev] Bin-test failed (different test)

2010-09-30 Thread Brett Henderson
On Fri, Oct 1, 2010 at 12:23 AM, Curt Nowak wrote: > Hello dev, > > I also tested osmosis 0.37-SNAPSHOT with the bin-support for various > countries downloaded at Geofabrik. > In contrast to the -xml tasks I *sometimes* ran into an exception using the > -bin tasks in combination with the --used-no

Re: [OSM-dev] osmosis foreign key constraint

2010-09-14 Thread Brett Henderson
I'd try dropping the constraint. I'm not sure how well rails will cope with invalid data but it might be your only option. Ideally the OSM file shouldn't have any referential integrity problems but it often seems to happen. For extra points you could then figure out what the dodgy data is, clean

Re: [OSM-dev] Osmosis hourly replication broken?

2010-09-14 Thread Brett Henderson
appen in future. The new state files contain only the information that is essential rather than the old ones that had a bunch of unused fields. On Wed, Sep 15, 2010 at 2:31 AM, Florian Lohoff wrote: > On Mon, Sep 13, 2010 at 01:52:14AM +0200, Frederik Ramm wrote: > > Hi, > > >

Re: [OSM-dev] minute diff - max delay

2010-09-12 Thread Brett Henderson
On Sun, Sep 12, 2010 at 9:28 PM, Brett Henderson wrote: > I've just upgraded Osmosis from the 0.35 release to the current 0.37 > snapshot. I've introduced a relatively minor change that on initial testing > appears to have fixed the problem. I create a number of

Re: [OSM-dev] Osmosis hourly replication broken?

2010-09-12 Thread Brett Henderson
On Mon, Sep 13, 2010 at 9:43 AM, Brett Henderson wrote: > Hi Frederik, > > Hmm, I can't remember details, but I probably did it during the large > re-factor for 0.36. I tried not to make too many code changes, but had to > change a few things in order to minimise dependenc

Re: [OSM-dev] Osmosis hourly replication broken?

2010-09-12 Thread Brett Henderson
Hi Frederik, Hmm, I can't remember details, but I probably did it during the large re-factor for 0.36. I tried not to make too many code changes, but had to change a few things in order to minimise dependencies once I separated code into distinct projects. The sequenceNumber and timestamp fields

Re: [OSM-dev] minute diff - max delay

2010-09-12 Thread Brett Henderson
On Sat, Aug 14, 2010 at 11:38 AM, Brett Henderson wrote: > On Sat, Aug 14, 2010 at 9:30 AM, Tom Hughes wrote: > >> On 14/08/10 00:19, Grant Slater wrote: >> >>> On 14 August 2010 00:10, Brett Henderson wrote: >>> >>>> >>>> Is anybody

Re: [OSM-dev] Release candidate for OSM binary format is in osmosis trunk.

2010-09-06 Thread Brett Henderson
On Mon, Sep 6, 2010 at 6:58 AM, Scott Crosby wrote: > On Sun, Sep 5, 2010 at 11:42 AM, Frederik Ramm > wrote: > > Scott, > > > > Scott Crosby wrote: > >> > >> message HeaderBlock { > >> required HeaderBBox bbox = 1; > >> > >> // Author, name, and version number of the dataset in this file. (to

Re: [OSM-dev] minute diff - max delay

2010-08-14 Thread Brett Henderson
29-Jun-2010 20:02 46K > > Bernhard > > > Am 14.08.10 03:38, schrieb Brett Henderson: > > On Sat, Aug 14, 2010 at 9:30 AM, Tom Hughes wrote: > >> On 14/08/10 00:19, Grant Slater wrote: >> >>> On 14 August 2010 00:10, Brett Henderson wrote: >&

Re: [OSM-dev] minute diff - max delay

2010-08-13 Thread Brett Henderson
On Sat, Aug 14, 2010 at 9:30 AM, Tom Hughes wrote: > On 14/08/10 00:19, Grant Slater wrote: > >> On 14 August 2010 00:10, Brett Henderson wrote: >> >>> >>> Is anybody aware of anything that happened on that day *other* than the >>> database u

Re: [OSM-dev] minute diff - max delay

2010-08-13 Thread Brett Henderson
Thanks Patrick, that's much appreciated. Is anybody aware of anything that happened on that day *other* than the database upgrade? Any new imports, etc. On Fri, Aug 13, 2010 at 4:33 PM, Patrick Petschge wrote: > Hi, > > > If anybody has time it would be interesting to look at the minute diffs

Re: [OSM-dev] minute diff - max delay

2010-08-12 Thread Brett Henderson
There is a known issue with the minute diffs where some are taking much longer than a minute to produce. This causes subsequent executions to skip until the previous one completes. I noticed it occurring approximately around the time of the recent database server upgrade but this may be pure coin

Re: [OSM-dev] New OSM binary fileformat implementation.

2010-08-09 Thread Brett Henderson
Hi Scott, I won't have time to do much today, but I've added a couple of comments below. On Tue, Aug 10, 2010 at 3:43 AM, Scott Crosby wrote: > On Wed, Aug 4, 2010 at 7:17 PM, Brett Henderson wrote: > > On Tue, Aug 3, 2010 at 11:37 PM, Scott Crosby > wrote: > >>

Re: [OSM-dev] New OSM binary fileformat implementation.

2010-08-04 Thread Brett Henderson
On Tue, Aug 3, 2010 at 11:37 PM, Scott Crosby wrote: > On Sun, Aug 1, 2010 at 6:39 AM, Brett Henderson wrote: > > > I'll help incorporate this into the rest of Osmosis. There's a few > things > > to work through though. > > I don't have a lot of tim

Re: [OSM-dev] How to clean up Negative IDs

2010-08-03 Thread Brett Henderson
On that note, I think there's a lot of scope for improving import speed in Osmosis. Currently it does it all with multi-line SQL inserts. PostgreSQL JDBC drivers now have COPY support and I have tried it out in the --fast-write-pgsql task. It works well and is much faster. There's a bit of work

Re: [OSM-dev] New OSM binary fileformat implementation.

2010-08-01 Thread Brett Henderson
On Sun, Aug 1, 2010 at 7:34 PM, Erik Johansson wrote: > On Sun, Aug 1, 2010 at 2:35 AM, Brett Henderson wrote: > > On Sun, Aug 1, 2010 at 2:26 AM, Frederik Ramm > wrote: > >> > >> Scott, others, > >> > >> Scott Crosby wrote: > >>> &

Re: [OSM-dev] New OSM binary fileformat implementation.

2010-07-31 Thread Brett Henderson
On Sun, Aug 1, 2010 at 2:26 AM, Frederik Ramm wrote: > Scott, others, > > > Scott Crosby wrote: > >> I would like to announce code implementing a binary OSM format that >> supports the full semantics of the OSM XML. >> > > [...] > > > The changes to osmosis are just some new tasks to handle read

Re: [OSM-dev] OSM History Retriever

2010-07-29 Thread Brett Henderson
Hi Martijn, On Thu, Jul 29, 2010 at 7:02 PM, Martijn van Exel wrote: > Hi Brett, > > What kind of trouble do you envisage when doing a bbox operation on a full > history dump? I guess the movement of features over time makes an accurate > determination of what is and what isn't in the bounding b

[OSM-dev] Missing Java Compiler On Dev

2010-07-23 Thread Brett Henderson
Hi All, Does anybody know why the java compiler is now missing from errol.openstreetmap.org? It used to work, but appears to have been removed or broken around July 3. If I attempt to run "javac", it suggests that the openjdk-6-jdk package be installed. Is it possible to get that package instal

Re: [OSM-dev] OSM History Retriever

2010-07-23 Thread Brett Henderson
On Thu, Jul 22, 2010 at 6:14 PM, Martijn van Exel wrote: > > On 22 jul 2010, at 06:57, Brett Henderson wrote: > > On Wed, Jul 21, 2010 at 11:52 PM, Lars Francke wrote: > [...] > > That format is fine and exactly what I would have expected. I suspect > Osmosis would pa

Re: [OSM-dev] OSM History Retriever

2010-07-21 Thread Brett Henderson
On Wed, Jul 21, 2010 at 11:52 PM, Lars Francke wrote: > On Wed, Jul 21, 2010 at 15:42, Brett Henderson wrote: > > I haven't looked at the full history dump to be honest so I'm not in a > great > > position to comment, but I'll comment anyway ;-) > > >

Re: [OSM-dev] OSM History Retriever

2010-07-21 Thread Brett Henderson
I haven't looked at the full history dump to be honest so I'm not in a great position to comment, but I'll comment anyway ;-) I'm curious what the format of the full history dump is. I'd like to understand how nodes, ways and relations are represented in the file but I can't do so without downloa

Re: [OSM-dev] Multiple XAPI parameters...

2010-07-08 Thread Brett Henderson
I've been wondering if hstore would be a good addition to the Osmosis "simple" schema which does store junction information. I wonder if a combination of tags stored in a hstore column, and table data clustered by GIST indexes on node.geom and way.linestring columns (ie. to organise the data geogr

  1   2   3   4   5   6   >