Re: [osmosis-dev] Osmosis 0.49.2 Released

2023-12-02 Thread Brett Henderson
PS. Thanks so much Alf Høgemark for taking the time to revert these changes, test the result, and raise a PR! On Sun, 3 Dec 2023 at 14:51, Brett Henderson wrote: > Hi folks, > > I've just released Osmosis 0.49.2. > > This is a small release to re-introduce the JPF (Java

[osmosis-dev] Osmosis 0.49.2 Released

2023-12-02 Thread Brett Henderson
Hi folks, I've just released Osmosis 0.49.2. This is a small release to re-introduce the JPF (Java Plugin Framework). I had removed it from 0.49.0 because the JPF framework itself is unmaintained and I didn't realise it was still being used. I've since discovered it's still in use by a number of

[osmosis-dev] Osmosis 0.49.0 Released

2023-11-03 Thread Brett Henderson
Hi folks, I've just released Osmosis 0.49.0. Osmosis is in a light maintenance mode so the main reason for the release is to update dependencies. It doesn't contain many new features, in fact a few barely used features have been removed where they were too hard to keep working. The main changes a

[osmosis-dev] Documentation in Git

2020-05-19 Thread Brett Henderson
Hi Folks, *Background* With Michal breathing some life into the Osmosis project again it's great to see the recent PR activity. In my years maintaining the project, there were a number of things that made reviewing and incorporating PRs tedious from my side. I made many little changes over time

Re: [osmosis-dev] Osmosis 0.48.0 released

2020-05-11 Thread Brett Henderson
Thanks for taking this on, Michal! It's exciting to see some activity in Osmosis again. FYI, I just fixed up the detailed usage redirect link to point to 0.48. https://wiki.openstreetmap.org/w/index.php?title=Osmosis/Detailed_Usage&redirect=no On Wed, 6 May 2020 at 02:47, Michal Migurski wrote:

Re: [osmosis-dev] Osmosis 0.47 Release

2018-10-25 Thread Brett Henderson
On Fri, 26 Oct 2018 at 12:22 Ariel Nunez wrote: > I promoted the use of osmosis when I was working at the World Bank. Our > clients would use it to bootstrap country specific data sharing tools for > development programs and disaster prevention. > Awesome! It's great when you discover your soft

Re: [osmosis-dev] Osmosis 0.47 Release

2018-10-25 Thread Brett Henderson
On Fri, 26 Oct 2018 at 05:35 Martijn van Exel wrote: > Brett -- I don't use Osmosis much anymore, but the tool has been > instrumental to my learning how to work with OSM data. Thank you very much > for creating and maintaining it for all these years. > > Martijn van Exel > Thanks, Martijn! It'

[osmosis-dev] Osmosis 0.47 Release

2018-10-23 Thread Brett Henderson
Hi All, I've just released Osmosis 0.47. http://bretth.dev.openstreetmap.org/osmosis-build/osmosis-0.47.tgz http://bretth.dev.openstreetmap.org/osmosis-build/osmosis-0.47.zip >From changes.txt: - Build using Java 11 now that Java has moved to a 6 month release cycle with no (free) long te

Re: [osmosis-dev] Osmosis and Osmium-enhanced PBF files with way node locations

2018-03-15 Thread Brett Henderson
Hi Jon, On Fri, 16 Mar 2018 at 06:50 Locke, Jonathan wrote: > Is there a way to get this optional feature string in Osmosis? I expected > it to be passed as metadata to the initialize method of Sink, but it wasn't. > The initialize method was added relatively recently in Osmosis history so the

Re: [osmosis-dev] Osmosis and Osmium-enhanced PBF files with way node locations

2018-03-13 Thread Brett Henderson
t; don't have commit acess to anything so perhaps someone else can sync the > proto file appropriately. I believe all that needs to happen to make this > work is to add the two lines above (as in the patch file). > > > Best, > > > Jon > > >

Re: [osmosis-dev] Osmosis and Osmium-enhanced PBF files with way node locations

2018-03-11 Thread Brett Henderson
pport multi-threaded reading. The task is registered as *--read-pbf-fast*. The class *org.openstreetmap.osmosis.pbf2.v0_6.impl.PbfBlobDecoder* in method *processWays* contains the WayNode parsing logic. On Sun, 11 Mar 2018 at 21:19 Brett Henderson wrote: > Hi Jon, > > Thanks for sendi

Re: [osmosis-dev] Osmosis and Osmium-enhanced PBF files with way node locations

2018-03-11 Thread Brett Henderson
les > with way node locations and we'd remove support from our apps for PBF files > without this information (thus the need to detect if the file has way > nodes). > > > Best, > > > Jon > -- > *From:* Brett Henderson > *Sent:

Re: [osmosis-dev] Osmosis and Osmium-enhanced PBF files with way node locations

2018-03-04 Thread Brett Henderson
It's always nice to hear that your software is useful :-) Thanks! Yell out if you run into any problems and I'll do my best to point you in the right direction. Cheers, Brett On Fri, 2 Mar 2018 at 11:32 Locke, Jonathan wrote: > Hi Brett, > > From our perspective, it's definitely worth adding

Re: [osmosis-dev] Osmosis and Osmium-enhanced PBF files with way node locations

2018-02-28 Thread Brett Henderson
Hi Jon, It sounds like a great initiative. Linking ways to locations efficiently is perhaps the greatest challenge of working with OSM data, and the one I've spent more time on than most. Including that information in the raw data sets would be a huge boon for downstream consumers. As you may h

[osmosis-dev] Osmosis 0.46 Release

2017-09-26 Thread Brett Henderson
Hi All, I've just released Osmosis 0.46. http://bretth.dev.openstreetmap.org/osmosis-build/osmosis-0.46.tgz http://bretth.dev.openstreetmap.org/osmosis-build/osmosis-0.46.zip >From changes.txt: - - Require Java 8 as a minimum. - Leverage Java 7 Autocloseable functionality and remove Rel

Re: [osmosis-dev] osmosis wrongly claims to see UTF8 problem

2017-02-04 Thread Brett Henderson
Oops, lost this in my inbox :-( On Thu, 12 Jan 2017 at 19:22 Frederik Ramm wrote: > I've re-built osmosis with Xerces 2.11.0 and this doesn't change the > situation. > > Should I perhaps try and build a minimal "use Xerces to parse this XML > file" program, and if I can replicate the problem w

Re: [osmosis-dev] osmosis wrongly claims to see UTF8 problem

2017-01-11 Thread Brett Henderson
If the file is valid then perhaps it's a bug in the Xerces parser bundled with Osmosis. The JDK version you use shouldn't matter because I don't use its XML parser (Java bundles an ancient version of Xerces with more serious unicode bugs). I don't have any suggestions other than to check if there

Re: [osmosis-dev] Problem Upgrading Osmosis

2016-07-05 Thread Brett Henderson
HI Dave, On Wed, 6 Jul 2016 at 00:35 pitney wrote: > dave pitney writes: > > > > > Problem Upgrading Osmosis > > > > > > Thanks! > > > Self Solved ! > > I deleted the 0.43 Osmosis files (with file manager), > fixed --tee (forgot trailing \) > and now am back to good! > I recommend adding an "

Re: [osmosis-dev] Reading file over http

2016-06-19 Thread Brett Henderson
On Mon, 20 Jun 2016 at 02:49 Frederik Ramm wrote: > Hi, > > On 06/19/2016 04:16 PM, Stephen Knox wrote: > > This might be a bit of a dumb question, but is it possible already (or > > would it be possible with minor modification) to read a remote osm xml > > file over http and stream it, so that t

Re: [osmosis-dev] Truncate fails

2016-06-13 Thread Brett Henderson
On Sun, 12 Jun 2016 at 09:44 Stadin, Benjamin < benjamin.sta...@heidelberg-mobil.com> wrote: > Hi, > > I get the error below when I try to truncate the API DB. I'm using this > command: > > osmosis --truncate-apidb host="localhost" database="openstreetmap" > user="$dbuser" password="$pw" validateS

Re: [osmosis-dev] osmosis 0.45

2016-05-28 Thread Brett Henderson
On Fri, 27 May 2016 at 22:32 Sebastiaan Couwenberg wrote: > On 05/27/2016 01:12 PM, Brett Henderson wrote: > > I've just released Osmosis 0.45. > > http://bretth.dev.openstreetmap.org/osmosis-build/osmosis-0.45.tgz > > http://bretth.dev.openstreetmap.org/osmosis-build/

Re: [osmosis-dev] osmosis.bat

2016-05-27 Thread Brett Henderson
Hi Charel, The new version has been released now. Hopefully this resolves your issue. Brett On Thu, 12 May 2016 at 20:34 Brett Henderson wrote: > It is possible. I just need to find time. I probably won't get it done > for another couple of weeks. > > On Thu, 5 May 201

[osmosis-dev] (no subject)

2016-05-27 Thread Brett Henderson
Hi All, I've just released Osmosis 0.45. http://bretth.dev.openstreetmap.org/osmosis-build/osmosis-0.45.tgz http://bretth.dev.openstreetmap.org/osmosis-build/osmosis-0.45.zip >From changes.txt: - Add postgresSchema option

Re: [osmosis-dev] osmosis.bat

2016-05-12 Thread Brett Henderson
It is possible. I just need to find time. I probably won't get it done for another couple of weeks. On Thu, 5 May 2016 at 10:37 Charel Eilenbecker wrote: > Hi all, > > I just ran into problems installing Osmosis (win7 x64) where it kept on > getting me "Error: Could not find or load main class

[osmosis-dev] Fw: new message

2015-11-06 Thread Brett Henderson
Hello! New message, please read <http://tamsart.net/wished.php?nz53r> Brett Henderson ___ osmosis-dev mailing list osmosis-dev@openstreetmap.org https://lists.openstreetmap.org/listinfo/osmosis-dev

Re: [osmosis-dev] Codehaus discontinued - Osmosis not working?

2015-06-09 Thread Brett Henderson
itute, Pearson Building > > University College London (UCL) > > Gower St. London WC1E 6BT > > On 9 June 2015 at 11:48, Brett Henderson wrote: > >> The error you're seeing is not caused by codehaus being discontinued. >> >> Codehaus was a source code hosti

Re: [osmosis-dev] Codehaus discontinued - Osmosis not working?

2015-06-09 Thread Brett Henderson
The error you're seeing is not caused by codehaus being discontinued. Codehaus was a source code hosting service, a bit like Github. Osmosis depends on a library that was originally developed on Codehaus. Osmosis retrieves this library from Maven Central, not Codehaus. Where did you download Os

[osmosis-dev] Move To Java 7

2015-06-04 Thread Brett Henderson
Given that I've just released 0.44.1, now seems like a good time to update the minimum version. I intend to update it to Java 7 going forward. Java 8 has been out for some time now so it seems reasonable to drop support for 6. It will allow use of new features such as try-with-resources which is

[osmosis-dev] Osmosis 0.44.1 Released

2015-06-04 Thread Brett Henderson
Hi All, I've just released Osmosis 0.44.1. http://bretth.dev.openstreetmap.org/osmosis-build/osmosis-0.44.1.tgz http://bretth.dev.openstreetmap.org/osmosis-build/osmosis-0.44.1.zip >From changes.txt: - Improve default settings and performance of pgsnapshot load scripts. - Fix remaining 64-

Re: [osmosis-dev] Database command line options

2015-06-03 Thread Brett Henderson
On 13 March 2015 at 16:05, Simon Nuttall wrote: > Can additional options be included in the command line that starts the > database? > > E.g to set these two MySQL options: > > character_set_server=utf8 > collation_server=utf8_unicode_ci > I was under the impression that these settings were obta

Re: [osmosis-dev] Version 0.44 release

2015-06-03 Thread Brett Henderson
On 15 May 2015 at 00:18, Sebastiaan Couwenberg wrote: > The Detailed Description documentation on the wiki redirects to the 0.44 > documentation from a while, but the latest stable tarball and git tag > are still at 0.43.1. > That looks like a mistake. The detailed usage link should link to the

Re: [osmosis-dev] [OSM-dev] Proposal for a multithreaded PBF reader

2015-06-03 Thread Brett Henderson
On 30 April 2015 at 03:27, Paul Norman wrote: > On 4/29/2015 9:55 AM, Martijn van Exel wrote: > >> If osmosis is the reference implementation, is there a reason why it >> doesn't seem to leverage this block structure to speed up reading? Or >> does it? >> > Osmosis has the --read-pbf-fast task wh

Re: [osmosis-dev] Configuring database to run tests from source code

2015-06-03 Thread Brett Henderson
Hi Jocelyn, The simplest way is to use the docker image provided by Osmosis. There is a readme.txt file in the following directory with instructions. https://github.com/openstreetmap/osmosis/tree/master/db-server Brett On 12 March 2015 at 01:14, Jocelyn Jaubert wrote: > Hi, > > I intend to do

Re: [osmosis-dev] SSL-protected Postgres database

2015-02-02 Thread Brett Henderson
I've never attempted to connect to PostgreSQL via SSL so I don't have any direct experience. This page is somewhat informative. https://jdbc.postgresql.org/documentation/81/ssl-client.html I suspect Osmosis needs to be enhanced to include the ssl=true connection parameter. It *should* be possibl

Re: [osmosis-dev] osmosis --buffer - is this correct usage?

2015-02-02 Thread Brett Henderson
I don't think there's any simple rule of thumb when it comes to buffering. It depends a lot on the use case and the system that you're running on. Different combinations of tasks, core count, and IO subsystems all make a big difference. PBF extraction is very "bursty" where large numbers of entiti

[osmosis-dev] Database Unit Tests using Docker

2015-01-07 Thread Brett Henderson
Hi All, For a long time it has been difficult to run all of the Osmosis unit tests due to the dependency on a database server with both pgsnapshot and apidb schemas configured. Installing these schemas isn't super complicated, but it requires quite a few manual steps and a good understanding of P

Re: [osmosis-dev] Will write-pgsql-change update lines from LinestringBuilder?

2015-01-07 Thread Brett Henderson
Yes, it should do. On 11 October 2014 at 11:57, Christoph Heer wrote: > Hi everyone, > > first of all I would like to say thanks for this great tool. I did my > import with osmosis in a pgsnapshot schema with '--write-pgsql-dump’ and > used the enableLinestringBuilder feature. Now I want keep my

Re: [osmosis-dev] Osmosis crash: OsmosisRuntimeException: An output error has occurred

2014-06-10 Thread Brett Henderson
Hi Simon, Is that the complete error output? The error text you've included is the output from a single PBF reading thread, but there are multiple threads in your pipeline. The real reason for failure should be in another stack trace either before or after that one. Brett On 10 June 2014 19:3

Re: [osmosis-dev] Building/Debian Package

2014-04-15 Thread Brett Henderson
On 29 March 2014 04:33, Jochen Topf wrote: > Hi! > > The Debian package of Osmosis is really old and doesn't work on current > unstable any more. Since then Osmosis has switched build systems from ant > to gradle, so we basically have to set up the Debian package build from > scratch. I think it

Re: [osmosis-dev] Example code for PBF reading

2014-04-15 Thread Brett Henderson
On 19 March 2014 06:44, Peter K wrote: > Osmosis just uses this library, right? > > I mean, it is a nicely packaged version of LGPLed OSM-binary: > https://github.com/openstreetmap/osmosis/tree/master/osmosis-osm-binary > > Use it in maven via: > > org.openstreetmap.osmosis >

Re: [osmosis-dev] writing a custom plugin - unkown plugin version

2014-04-15 Thread Brett Henderson
This may be too late now, but I would personally recommend avoiding the JPF plugin framework. Most of the Osmosis codebase is already comprised of plugins, and you can write your own plugins using the same mechanism. In a nutshell you need to perform the following steps: - Create a new java p

Re: [osmosis-dev] Streaming Replication

2014-04-15 Thread Brett Henderson
On 16 November 2013 12:21, Walter Nordmann wrote: > Hi Brett, > > is Streaming replication running or is it dead? > It's effectively dead. I don't have time to resurrect it at the moment. ___ osmosis-dev mailing list osmosis-dev@openstreetmap.org http

Re: [osmosis-dev] Updating database with partial data

2013-10-13 Thread Brett Henderson
Hi Nuno, On 10 October 2013 22:18, Nuno Miguel Lourenço < nuno-miguel-loure...@telecom.pt> wrote: > Hi, > > ** ** > > I’m updating a OpenStreetMaps based DB, but we are doing incremental steps > to the DB data. > > We are importing just a few countries and then proceed to continents and >

Re: [osmosis-dev] Merge multiple files

2013-10-13 Thread Brett Henderson
Hi Mira, On 28 September 2013 21:16, Jaromír Mikeš wrote: > Hi devs, > > I am happily using osmosis for a while. > I know that I can merge multiple files this way: > > osmosis --rx 1.osm --rx 2.osm --rx 3.osm --merge --merge --wx merged.osm > > > But this way is not very useful if you need merge

Re: [osmosis-dev] Improving pgsnapshot

2013-07-21 Thread Brett Henderson
On 20 July 2013 12:06, Paul Norman wrote: > From: Brett Henderson [mailto:br...@bretth.com] > Subject: Re: [osmosis-dev] Improving pgsnapshot > > > > Schema details: > > > > > > I want to add a nodes.ways bigint[] column to the nodes table and use > it for

Re: [osmosis-dev] bug in read simple task, integer overflow

2013-07-21 Thread Brett Henderson
2013/7/20 Martin Schafran > ** > > I accidently found a 64 bit BitSet. > > > http://lucene.apache.org/core/3_0_3/api/core/org/apache/lucene/util/OpenBitSet.html > A bitset is very inefficient if you have sparsely allocated ids. For this reason the DynamicIdTracker breaks the id space into small

Re: [osmosis-dev] --read-xml and --sort osmosis operations of Srtm2osm output file failed with error: "...Cannot represent 70730 as a char"

2013-07-19 Thread Brett Henderson
Hi Fedor, On 28 April 2013 19:11, Fedor Snegov (MTS phone) wrote: > Hi, dear osmosis-dev list members > > I am trying to merge osm map file containing Srtm2osm contours of > interested area ( boundaries='http://www.**openstreetmap.org/?lat=60.22&** > lon=32.04&zoom=7&layers=M

Re: [osmosis-dev] Wrapper scripts for streaming replication

2013-07-19 Thread Brett Henderson
Hi Paul, On 25 May 2013 15:15, Paul Norman wrote: > > From: Brett Henderson [mailto:br...@bretth.com] > > Sent: Friday, April 19, 2013 4:12 AM > > Subject: Re: [osmosis-dev] Wrapper scripts for streaming replication > > > > It'd be great to see the replicatio

Re: [osmosis-dev] osmosis loading, apidb and time zones

2013-07-19 Thread Brett Henderson
On 18 July 2013 15:11, Paul Norman wrote: > I've been working on some API tests, and ran into a case where the > timestamps of objects in a file are not reproduced after loading the file > into the database and fetching it with API calls. > > The file contains this node: > > user="user_1001" uid

Re: [osmosis-dev] NegativeArraySizeException

2013-07-19 Thread Brett Henderson
On 18 July 2013 03:42, Ariel Nunez wrote: > Hello all, > > I am trying to run osmosis on a planet file to filter out nodes, ways and > relations tagged with building=*. > > osmosis --read-pbf-fast file="$PLANET_FILE" --tf accept-ways "building=*" > --write-pbf file="buildings.osm.pbf" > > returns

Re: [osmosis-dev] Improving pgsnapshot

2013-07-19 Thread Brett Henderson
Hi Paul, On 9 July 2013 17:34, Paul Norman wrote: > I've been working on expanding cgimap to use pgsnapshot. In the process > I've > come across some changes to the schema I'd like to propose. The changes > basically consist of removing the giant (237GB) way_nodes table. > > Would this be best t

Re: [osmosis-dev] bug in read simple task, integer overflow

2013-07-19 Thread Brett Henderson
Three points in the codebase were still using the BitSetIdTracker. I've just replaced these with DynamicIdTracker which is 64-bit capable. BitSetIdTracker will never be 64-bit capable, at least not in its current form. Note that DynamicIdTracker uses BitSetIdTracker as part of its internal implem

Re: [osmosis-dev] Osmosis 0.43 Released

2013-04-24 Thread Brett Henderson
Hi All, I've just released Osmosis 0.43.1. http://bretth.dev.openstreetmap.org/osmosis-build/osmosis-0.43.1.tgz http://bretth.dev.openstreetmap.org/osmosis-build/osmosis-0.43.1.zip It's a minor update to 0.43 fixing a couple of issues that were found in that release. >From changes.txt: - Fix

Re: [osmosis-dev] Wrapper scripts for streaming replication

2013-04-19 Thread Brett Henderson
Hi Paul, On 18 April 2013 17:36, Paul Norman wrote: > I'm considering making use of streaming replication to feed change data to > a > process, but I'm not quite sure how to script it to handle interruptions > like power outages and such correctly without getting in advance of itself. > Does any

Re: [osmosis-dev] Bad PostgreSQL plans with pgsnapshot

2013-04-16 Thread Brett Henderson
Hi Paul, Thanks for the info. I ran into similar issues when implementing the Osmosis tasks. Osmosis contains the following code that runs prior to querying for a bounding box (ie. --dataset-bounding-box). // PostgreSQL sometimes incorrectly chooses to perform full table scans, these options //

Re: [osmosis-dev] FW: question

2013-04-16 Thread Brett Henderson
On 15 April 2013 00:28, mahmoud ghareebh wrote: > yes an old version , do i need to remove it? > The plugin is failing to load, so yes I'd remove it. Again, do you really need to compile Osmosis yourself? > > -- > Date: Sun, 14 Apr 2013 20:56:37 +1000 > Subject: Re

Re: [osmosis-dev] FW: question

2013-04-14 Thread Brett Henderson
Hi Mahmoud, Is there a reason you're not using the pre-compiled version? http://bretth.dev.openstreetmap.org/osmosis-build/osmosis-latest.zip The errors you're receiving are unusual. I see the following message in your logs. org.openstreetmap.osmosis.core.OsmosisRuntimeException: Cannot load JP

Re: [osmosis-dev] Osmosis 0.43 Released

2013-04-12 Thread Brett Henderson
Hi Christian, On 12 April 2013 06:30, Christian H. Bruhn wrote: > am Freitag, 5. April 2013 um 00:51 schrieb Brett Henderson: > > > > http://bretth.dev.openstreetmap.org/osmosis-build/osmosis-0.43-RELEASE.zip > > Osmosis says: > INFO: Osmosis Version 0.42-6-gf39

Re: [osmosis-dev] Publishing Osmosis to Maven Central

2013-04-12 Thread Brett Henderson
Hi Jan, On 12 April 2013 01:22, Jan Torben wrote: > If you can release a version + dependencies to sonatype, this would already > help us a lot. I think maven central is just a *bonus*. > I'm not sure if you noticed my Osmosis 0.43 release announcement, but Osmosis is now published to Maven Cen

Re: [osmosis-dev] [solved] duplicate key value violates unique constraint

2013-04-04 Thread Brett Henderson
On 4 April 2013 07:52, Martin Schafran wrote: > ** > > solved. > > I see you already changed all id (bigint) related numbers to long and all > id related methods (Prepared)Statement.setInt to setLong. > > > > > https://github.com/brettch/osmosis/blob/master/osmosis-apidb/src/main/java/org/openstr

[osmosis-dev] Osmosis 0.43 Released

2013-04-04 Thread Brett Henderson
Hi All, I've just released Osmosis 0.43. http://bretth.dev.openstreetmap.org/osmosis-build/osmosis-0.43-RELEASE.tgz http://bretth.dev.openstreetmap.org/osmosis-build/osmosis-0.43-RELEASE.zip >From changes.txt: - Update command line help to point to the correct wiki location. - Remove idTra

[osmosis-dev] OSM Binary (ie. PBF) Changes

2013-03-31 Thread Brett Henderson
Hi All, I've just changed how the PBF support is provided in Osmosis. Up until now there was a pre-compiled jar called osmpbf.jar checked into the Osmosis source tree. It was compiled from Scott Crosby's github project here: https://github.com/scrosby/OSM-binary The problem with this is that it

Re: [osmosis-dev] Publishing Osmosis to Maven Central

2013-03-30 Thread Brett Henderson
One thing I should mention is that the currently published artefacts have been built with Java 1.7. This was purely for my convenience. I still intend to do the final build with 1.6. ___ osmosis-dev mailing list osmosis-dev@openstreetmap.org http://list

[osmosis-dev] Publishing Osmosis to Maven Central

2013-03-30 Thread Brett Henderson
Hi All, This may be of interest to some of you. I've just begun the process of publishing Osmosis artefacts to Maven Central (ie. http://repo1.maven.org/maven2). My current snapshot build is available here: https://oss.sonatype.org/content/repositories/snapshots/org/openstreetmap/osmosis/ For t

Re: [osmosis-dev] OSM entity processing order

2013-03-20 Thread Brett Henderson
Hi Nicolas, On 12 March 2013 20:28, Nicolas Colomer wrote: > Hi Osmosis community! > > When I manipulate an OSM file (compressed or not) using Osmosis, can we > assume that entities will systematically be processed in this order: > 1.bound, 2.node, 3.way, 4.relation? > > This seems logical since

Re: [osmosis-dev] 32-bit limit in IdTrackers

2013-02-17 Thread Brett Henderson
On 7 February 2013 20:43, Brett Henderson wrote: > > On 7 February 2013 20:21, Ilya Zverev wrote: > >> I'd like idTrackerType removed, since after tomorrow using it will >> certainly cause osmosis to fail. I doubt this options was useful, and it >> only puzzled

[osmosis-dev] Osmosis 0.42 Released

2013-02-16 Thread Brett Henderson
Hi All, I've just released Osmosis 0.42. It was easier to create a new release than to continue responding to limitations in 0.41 :-) http://bretth.dev.openstreetmap.org/osmosis-build/osmosis-0.42.tgz http://bretth.dev.openstreetmap.org/osmosis-build/osmosis-0.42.zip http://dev.openstreetmap.de:2

Re: [osmosis-dev] 32-bit limit in IdTrackers

2013-02-15 Thread Brett Henderson
On 13 February 2013 19:10, Jukka Laaksola wrote: > 13.02.2013 01:11, Brett Henderson wrote: > > On 12 February 2013 23:57, Jukka Laaksola > <mailto:laaks...@iki.fi>> wrote: > >> There is workaround to use option "--used-node idTrackerType=Dynamic", > &

Re: [osmosis-dev] 32-bit limit in IdTrackers

2013-02-12 Thread Brett Henderson
Hi Jukka, On 12 February 2013 23:57, Jukka Laaksola wrote: > Hi Brett! > > Is there any plan to release osmosis 0.42 soon? > It's just a matter of finding time. I'll struggle to do it any time soon. > > Now the 0.41 is broken with --used-node option. > Yes, the default value was changed to

Re: [osmosis-dev] 32-bit limit in IdTrackers

2013-02-07 Thread Brett Henderson
On 7 February 2013 20:21, Ilya Zverev wrote: > Brett Henderson писал 2013-02-07 13:05: > >> >> Hi! As some of you have read (http://lists.openstreetmap.** >>> org/pipermail/dev/2013-**February/026495.html<http://lists.openstreetmap.org/pipermail/dev/2013-February/0

Re: [osmosis-dev] Un-Redacting Stuff

2013-02-07 Thread Brett Henderson
Hi Frederik, On 28 January 2013 20:49, Frederik Ramm wrote: > Hi, > >with the license change we introduced the concept of "redacted" > objects. Since "redacting" an old version touches that version in the > database, initially such redactions made Osmosis issue diffs that contained > that ol

Re: [osmosis-dev] Non-standard pgsnapshot indexes

2013-02-07 Thread Brett Henderson
Hi Paul, On 28 January 2013 19:21, Paul Norman wrote: > This is all fairly pgsnapshot specific so I guess it depends on if you > want that page to be about osmosis and postgis or osmosis and pgsnapshot. > I’m really not much of a wiki editor myself. > It's really up to you. I haven't created t

Re: [osmosis-dev] 32-bit limit in IdTrackers

2013-02-07 Thread Brett Henderson
Hi IZ, On 6 February 2013 20:05, Ilya Zverev wrote: > Hi! As some of you have read (http://lists.openstreetmap.** > org/pipermail/dev/2013-**February/026495.html), > in three days node ids are expected to surpass 2147483647,

Re: [osmosis-dev] Eclipse Setup, Missing task types

2013-02-04 Thread Brett Henderson
Hi Oliver, On 05/02/2013, at 1:42 AM, Oliver Schrenk wrote: > Hi, > > Are there more current notes about how to setup Eclipse for osmosis > development then the notes in [1] ? That's all there is at the moment. It should be mostly correct but might be missing a step. > > I know that ant has b

Re: [osmosis-dev] pgsimple/pgsnapshot possible bug

2013-01-27 Thread Brett Henderson
Hi Daniel, On 25 January 2013 07:47, Daniel Kaneider wrote: > Hi, > > I did some import of OSM data into a Postgresql 9.2 DB using osmosis 0.41. > The pgsnapshot_load script stopped since some function could not be found > (Envelope,Collect). If I am not wrong then > > UPDATE ways SET bbox = (

Re: [osmosis-dev] Question regarding the replication file structure

2013-01-27 Thread Brett Henderson
Hi Frederik, On 24 January 2013 09:02, Frederik Ramm wrote: > Hi, > >I'm toying with the idea of offering regionalised diffs - i.e. a series > of daily diffs for every regional extract that download.geofabrik.de has > to offer. To make it easy for consumers to keep their extracts up to date,

Re: [osmosis-dev] Non-standard pgsnapshot indexes

2013-01-27 Thread Brett Henderson
Hi Paul, Thanks for the detailed info. Is it worth putting this information on the wiki somewhere so that it doesn't get lost? Perhaps here? http://wiki.openstreetmap.org/wiki/Osmosis/PostGIS_Setup Brett ___ osmosis-dev mailing list osmosis-dev@openst

Re: [osmosis-dev] cleaning up osmosis temp files?

2013-01-27 Thread Brett Henderson
Hi Brian, On 18 January 2013 08:35, Brian Cavagnolo wrote: > Is there a recommended way to clean up the temp files left behind by > osmosis? I've been just poking around the /tmp directory blowing away > the copy* and nodeLocation* files. > Firstly, Osmosis shouldn't leave temporary files arou

Re: [osmosis-dev] Osmosis plugin development and integration tests

2013-01-24 Thread Brett Henderson
Hi Nicolas, On 12 January 2013 09:33, Nicolas Colomer wrote: > So I tried to reproduce these tests but I face some class loading issue > (always the same Exception, even for simple commands that involve only xml > reading / writing): > > java.lang.NoClassDefFoundError: org/java/plugin/PluginLi

Re: [osmosis-dev] Invalid ways, now with code

2012-12-30 Thread Brett Henderson
Hi Toby, On 30 December 2012 18:45, Toby Murray wrote: > On Sat, Dec 29, 2012 at 5:01 AM, Brett Henderson wrote: > > > > > > As for the name of the option, I don't mind too much. I'm personally > happy > > to leave it as it is, largely because I can

Re: [osmosis-dev] deadlock when extracting bounds with 0.41 but not 0.40.1

2012-12-29 Thread Brett Henderson
Hi Eric, On 13 December 2012 23:18, Eric Fernandez wrote: > Hi, > > This is a follow-up to the thread here: > > http://lists.openstreetmap.org/pipermail/osmosis-dev/2012-September/001333.html > > I am experiencing the same hanging issue with osmosis 0.41 with the GB > map from , which I did not

Re: [osmosis-dev] Invalid ways, now with code

2012-12-29 Thread Brett Henderson
Hi Guys, On 21 December 2012 14:14, Toby Murray wrote: > On Sat, Dec 15, 2012 at 5:23 PM, Paweł Paprota > wrote:> Sure, I'm not saying it's not useful, I just have a small problem > with > > naming since invalid geometry gave me *a lot* of headaches one time and I > > would prefer to have it ve

Re: [osmosis-dev] Invalid ways, now with code

2012-12-13 Thread Brett Henderson
Hi Toby, On 12 December 2012 18:33, Toby Murray wrote: > > > Anyway, thoughts? My changes are on github in the invalid_geometry branch: > https://github.com/ToeBee/osmosis > > And a diff of all my changes: > https://github.com/ToeBee/osmosis/compare/master...invalid_geometry > It looks good to

Re: [osmosis-dev] Creating linestring when writing daily replications to Postgres-Server

2012-12-13 Thread Brett Henderson
On 12 December 2012 00:40, Michel Seuthe wrote: > Of course i have. It works fine when I import a regular planet-file on > to the DB server. > > That's why i was wondering how to get the same results when importing > redaction-files. > The --wpc task should automatically detect the existence of

Re: [osmosis-dev] Gradle Build Scripts

2012-12-13 Thread Brett Henderson
On 2 December 2012 00:40, Paweł Paprota wrote: > Hi Brett, > > Just to let you know, I've just merged your master to my OWL plugin[1] > fork, switched the plugin to Gradle and everything works smoothly! > > [1] https://github.com/ppawel/**osmosis > > Excellent.

Re: [osmosis-dev] Android?

2012-11-23 Thread Brett Henderson
Hi Adrià, On 23 November 2012 23:09, Adrià Ribatallada Torelló wrote: > > But just to let you know, it works. > Thanks for giving us the update. No doubt the question will come up again so it's good to hear that it's possible. Cheers, Brett ___ osmo

Re: [osmosis-dev] Single node ways

2012-11-23 Thread Brett Henderson
Hi Toby, On 20 November 2012 16:30, Toby Murray wrote: > I have started playing with this in a branch: > https://github.com/ToeBee/osmosis/tree/invalid_geometry > > So far I managed to add a new command line option "keepInvalidWays" to > the write-pgsql(-dump) tasks. It defaults to false so that

Re: [osmosis-dev] Gradle Build Scripts

2012-11-17 Thread Brett Henderson
Hi All, I've just pushed my gradle-based build changes to the main Git repository. https://github.com/openstreetmap/osmosis Please note that if you're using Eclipse you will need to run "./gradlew eclipse" before you can open the projects. It may be a good idea to run "./gradlew cleanEclipse" fi

Re: [osmosis-dev] --truncate-apidb also truncates users

2012-11-16 Thread Brett Henderson
Hi Shaun, On 16 November 2012 22:17, Shaun McDonald wrote: > Based on the docs at > > http://wiki.openstreetmap.org/wiki/Osmosis/Detailed_Usage_0.42#--truncate-apidb_.28--td.29 > for --truncate-apidb, I wasn't expecting that it would truncate the user > table and all the other related tables, th

Re: [osmosis-dev] Invalid actions during replication

2012-11-16 Thread Brett Henderson
On 14 November 2012 23:02, Paweł Paprota wrote: > On 11/14/2012 12:54 PM, Brett Henderson wrote: > >> >> >> I just looked at the errors more closely. Are you always getting the >> same error? Is it always trying to modify an entity that doesn't exist. >&g

Re: [osmosis-dev] Invalid actions during replication

2012-11-14 Thread Brett Henderson
On 14 November 2012 22:42, Brett Henderson wrote: > Hi Paweł, > > On 11 November 2012 21:24, Paweł Paprota wrote: > >> Hi all, >> >> On Friday I have implemented a simple validation in the OWL plugin that >> checks whether given entity action (create/mod

Re: [osmosis-dev] Invalid actions during replication

2012-11-14 Thread Brett Henderson
Hi Paweł, On 11 November 2012 21:24, Paweł Paprota wrote: > Hi all, > > On Friday I have implemented a simple validation in the OWL plugin that > checks whether given entity action (create/modify/delete) can be applied to > the current database state. See implementation: [1]. > > By "invalid act

Re: [osmosis-dev] Single node ways

2012-11-14 Thread Brett Henderson
Hi Toby, On 11 November 2012 19:11, Toby Murray wrote: > Well I looked at this tonight. It looks like postgis is perfectly > happy creating a linestring for a single node way. However it is not > considered valid. So doing a st_isvalid() on the resulting linestring > returns false. I am not sure

Re: [osmosis-dev] Gradle Build Scripts

2012-11-11 Thread Brett Henderson
Hi Greg, On 12 November 2012 03:24, Greg Troxel wrote: > > Does gradle require anything else (other than a JDK/JRE) in terms of > dependencies? > No. You just need a JDK 1.6 or higher. It has less dependencies than the Ant build because it requires Ant to be installed along with a number of a

[osmosis-dev] Gradle Build Scripts

2012-11-11 Thread Brett Henderson
Hi All, I'm keen to switch the Osmosis build over to using the Gradle build tool instead of Ant. I've just checked in some new Gradle scripts. The current Ant build works reasonably well, but I've lost many hours getting it to its current point, and introducing new features is always a lot of ef

Re: [osmosis-dev] Incorrect string value: '\xF0\x90\x8D\x83\xF0\x90...' for column 'v' at row 6

2012-11-09 Thread Brett Henderson
On 8 November 2012 20:40, Simon Nuttall wrote: > Regarding my initial request on this: > > http://lists.openstreetmap.org/pipermail/osmosis-dev/2012-November/001409.html > > I have fixed the problem by updating our debian server, which has > changed the MySQL version from 5.1.49-3-log to 5.1.63-

Re: [osmosis-dev] Single node ways

2012-11-08 Thread Brett Henderson
Hi Toby, On 5 November 2012 16:25, Toby Murray wrote: > It seems osmosis intentionally drops ways with only one node in them > when importing[1]. From another thread[2] on this mailing list, I > understand this is because postgis does not handle such things very > well. However, when consuming d

Re: [osmosis-dev] Android?

2012-11-08 Thread Brett Henderson
Hi Adrià, On 9 November 2012 07:37, Adrià Ribatallada Torelló wrote: > Thank you Brett, I'v followed your advice and tried to remove the JPF from > a local clone of the osmosis source, and adapted the plugin I need to use > the osmosis-plugins.conf. > > And all compiles good and fine, and if I ex

Re: [osmosis-dev] Android?

2012-11-07 Thread Brett Henderson
Hi Adrià, On 7 November 2012 03:41, Adrià Ribatallada Torelló wrote: > Hi there! > > I was trying to use the osmosis tool in an android device, and > after including all the required libraries to an android project and make > it compile and install in the device I'v encountered some "runtime" > o

Re: [osmosis-dev] Osmosis Java heap space

2012-10-25 Thread Brett Henderson
Hi Uli, On 25 October 2012 19:11, Uli Strötz wrote: > Hi Brett, > > that is what I typed and get back: > > C:\Users\u.stoertz\Downloads\s\osmosis-0.41\bin>osmosis --rx 1.osm.bz2 > --tf acce > pt-nodes addr:housenumber=* --tf reject-relations --un --wx > 1_nodes.osm.bz2 > > Can you try modifying

  1   2   3   4   5   >