Re: [osmosis-dev] How to use EntityBuffer

2009-04-20 Thread Brett Henderson
marcus.wolsc...@googlemail.com wrote: Hello, I am trying to use the EntityBuffer -class but seem to be doing something wrong here. I did: XMReader task = new ... EntityBuffer buffer = new EntityBuffer(BUFFERCAPACITY); task.setSink(buffer); buffer.setSink(sink); buffer.run();

Re: [osmosis-dev] Dropping 0.5 tasks

2009-05-06 Thread Brett Henderson
Frederik Ramm wrote: Hi, Brett Henderson wrote: I'm in the process of releasing 0.31 so that people have a known stable version to download that supports 0.6. It still includes all of the existing 0.5 tasks. So, would there be any objections to dropping 0.5 support? It's not urgent

Re: [osmosis-dev] Dropping 0.5 tasks

2009-05-09 Thread Brett Henderson
Karl Newman wrote: When you do eventually drop it, it would be a good idea to create an SVN tag for the last Osmosis version with 0.5 support so it can be easily found later (I seem to recall having to sort through commit messages to find the last 0.4-supporting version for someone a few

Re: [osmosis-dev] SQL schemas not available

2009-06-01 Thread Brett Henderson
Paul Balomiri wrote: Hi, the server gweb.bretth.com refuses to answer due to high traffic. Could you please send me the file hosted at http://gweb.bretth.com/apidb06-pgsql-latest.sql alternatively you could check it into svn at openstreetmap, or post it to this list? I'm really stuck on

Re: [osmosis-dev] Problem using Osmosis (PluginLifecycleException)

2009-11-11 Thread Brett Henderson
On Wed, Nov 11, 2009 at 4:03 PM, Marcus Wolschon marcus.wolsc...@googlemail.com wrote: On Tue, Nov 10, 2009 at 11:03 PM, Brett Henderson br...@bretth.com wrote: Changing osmosis.bat is not the problem but how can I do an entry Does anybody know how to build a classpath list based

Re: [osmosis-dev] WayKeyFilter

2009-11-19 Thread Brett Henderson
On Thu, Nov 19, 2009 at 11:27 PM, Andrew Byrd and...@fastmail.net wrote: On 19 Nov 2009, at 07:30, Brett Henderson wrote: Can you please update the wiki detailed usage page to reflect the new task? http://wiki.openstreetmap.org/wiki/Osmosis/DetailedUsage Done. I noted

[osmosis-dev] Replication Changes

2009-11-19 Thread Brett Henderson
Hi All, I thought I should give an update on recent Osmosis replication changes. The existing minute diffs are irreparably broken. The timestamp approach for extracting changes only works if a long delay is used. 1 hour is probably a minimum and unacceptable for supposedly minute diffs. The

Re: [osmosis-dev] duplication of nodes on apply-change

2009-11-23 Thread Brett Henderson
In an attempt to fix this I have done the following: * Rolled back EntityByTypeThenIdComparator to the previous behaviour of only checking type then id. * Created a new EntityByTypeThenIdThenVersion comparator which (obviously :-) includes version as part of the checking. * Updated ChangeMerger

Re: [osmosis-dev] GetPropertyAction in xml/common/ElementWriter

2009-12-08 Thread Brett Henderson
: alex.smudgy On Tue, Dec 8, 2009 at 2:52 AM, Hakan Tandogan ha...@gurkensalat.comwrote: Brett Henderson wrote: On Tue, Dec 8, 2009 at 11:01 AM, Hakan Tandogan ha...@gurkensalat.com mailto:ha...@gurkensalat.com wrote: Hi again, Is there any particular reason why ElementWriter

Re: [osmosis-dev] use classworlds-Loader fort start script?

2009-12-08 Thread Brett Henderson
On Tue, Dec 8, 2009 at 7:39 PM, marcus.wolsc...@googlemail.com wrote: On Tue, 08 Dec 2009 02:04:55 +0100, Hakan Tandogan ha...@gurkensalat.com wrote: Brett Henderson wrote: If it isn't too invasive it should be fine. I guess the best way is to try it out and see if any problems crop up

Re: [osmosis-dev] Postgis is in repo1.maven.org

2009-12-10 Thread Brett Henderson
[ivy:resolve] http://repo1.maven.org/maven2/org/postgis/postgis/1.3.2/postgis-1.3.2.pom [ivy:resolve] -- artifact org.postgis#postgis;1.3.2!postgis.jar: [ivy:resolve] http://repo1.maven.org/maven2/org/postgis/postgis/1.3.2/postgis-1.3.2.jar [ivy:resolve]

Re: [osmosis-dev] Postgis is in repo1.maven.org

2009-12-13 Thread Brett Henderson
On Sat, Dec 12, 2009 at 12:52 AM, Hakan Tandogan ha...@gurkensalat.comwrote: If you want to wait a few moments more, you should have a fixed postgis jar latest tomorrow. I did the revert to get the build running because switching backwards and forwards between jars is straightforward. Let

Re: [osmosis-dev] Bzip2-issues

2009-12-13 Thread Brett Henderson
It looks like the commons-compress library changes how it handles the file prefix. The old libraries didn't use a prefix so I had hacks in a class called CompressionActivator like the following to make it compatible with command line bzip2. // Command line BZip2 adds BZ to the start of the file

Re: [osmosis-dev] Bzip2-issues

2009-12-14 Thread Brett Henderson
: Thanks. I'll test it. Do you want to do a 0.32.2 -release with this? I imagine the latest osmosis-release not being able to read map-dumps is quite a showshopper. Marcus On Mon, 14 Dec 2009 19:22:09 +1100, Brett Henderson br...@bretth.com wrote: Hi Marcus, I've checked a fix

Re: [osmosis-dev] download Osmosis 0.32

2009-12-17 Thread Brett Henderson
is an unstable dev release is not obvious. Brett On Thu, Dec 17, 2009 at 11:58 PM, Jan Tappenbeck o...@tappenbeck.net wrote: is there a possiblity to see the right number outside ??? in changes.txt you can the only the milestones ... 0.31, 0.32 regards Jan :-) Brett Henderson schrieb: On Tue, Dec 15

[osmosis-dev] Fwd: download Osmosis 0.32

2009-12-17 Thread Brett Henderson
Forwarding back to the list ... -- Forwarded message -- From: Brett Henderson br...@bretth.com Date: Fri, Dec 18, 2009 at 9:22 AM Subject: Re: [osmosis-dev] download Osmosis 0.32 To: Jan Tappenbeck o...@tappenbeck.net Cc: osmosis-dev@openstreetmap.org, Marcus Wolschon public

Re: [osmosis-dev] download Osmosis 0.32

2009-12-17 Thread Brett Henderson
On Fri, Dec 18, 2009 at 9:40 AM, Hakan Tandogan ha...@gurkensalat.comwrote: Brett Henderson wrote: Anything's possible. What would you like to see? As I've mentioned before, I'm open to suggestions on how to better number the releases. The fact that 0.32 is a full release and 0.32.1

Re: [osmosis-dev] Problem opening .osm files in JOSM after osmosis-0.32 processing

2010-01-05 Thread Brett Henderson
Hi Holger, I don't have much net connectivity at the moment, and don't have JOSM installed. I'm assuming that osmosis is creating node id 289490930 in such a way that JOSM doesn't like it. Can you provide the xml element for node with id=289490930 from both the original unterfraken.osm.bz2

Re: [osmosis-dev] planet diff to polygon extract?

2010-01-05 Thread Brett Henderson
On Wed, Dec 30, 2009 at 3:56 AM, David Carmean d...@halibut.com wrote: For the moment I'm working with just the Cloudmade California extract (in PostGIS simple schema). Is it possible to perform a polygon clip/extract of the daily planet diffs (changefile)? Failing that, what happens if a

Re: [osmosis-dev] completeRelations flag for --bp/--bb not working

2010-01-10 Thread Brett Henderson
On Sat, Jan 9, 2010 at 9:15 PM, Frederik Ramm frede...@remote.org wrote: Hi, consider this test case (run with 0.31.3): osm version=0.6 node id=1 version=1 timestamp=2007-10-31T23:48:54Z uid=1 user=fred changeset=1 lat=53 lon=10/ node id=2 version=1 timestamp=2008-09-28T17:44:53Z

Re: [osmosis-dev] Crash on processing nodes?

2010-01-11 Thread Brett Henderson
On Mon, Jan 11, 2010 at 8:38 PM, Brett Henderson br...@bretth.com wrote: On Mon, Jan 11, 2010 at 6:40 PM, Frederik Ramm frede...@remote.orgwrote: The problem was that in switching from --rci to --rri I didn't add the --simc filter, which led to duplicate objects in the extracts. It should

Re: [osmosis-dev] Crash on processing nodes?

2010-01-20 Thread Brett Henderson
On Wed, Jan 20, 2010 at 11:24 PM, Simon Nuttall simon.nutt...@gmail.comwrote: On one of the CycleStreets machines it takes 17.3 hours to extract and merge data from the Britain and Ireland GeoFabrik planets using: osmosis -v 100 --read-xml data/osm/downloads/great_britain.osm

Re: [osmosis-dev] [RFE] Add bounding shape to OSM dumps

2010-01-21 Thread Brett Henderson
On Fri, Jan 22, 2010 at 5:17 AM, WanMil wmgc...@web.de wrote: Hi, Apollinaris Schoell wrote: osmosis supports 2 options to keep ways and relations intact. but geofabrik extracts don't use it as far as I know. completeWays completeRelations That is correct: These options exist, and

Re: [osmosis-dev] extracting with --used-node BitSet misses certain objects

2010-01-27 Thread Brett Henderson
On Tue, Jan 19, 2010 at 2:59 PM, Maxim Dubinin s...@gis-lab.info wrote: Hi osmosis-devs, I've encountered rather strange behaviour for this test case: osmosis --rx file=data/planet-091230.osm --bp file=poly/tatar.poly idTrackerType=BitSet --used-node idTrackerType=BitSet --wx file=tatar.osm

[osmosis-dev] Osmosis Release 0.34

2010-02-21 Thread Brett Henderson
Hi, I've created osmosis 0.34 which should fix the recent issues with a missing plexus.conf file, and problems with various other missing files in the tar distribution. Brett ___ osmosis-dev mailing list osmosis-dev@openstreetmap.org

Re: [osmosis-dev] Slow to import into a postgres api schema

2010-02-22 Thread Brett Henderson
On Mon, Feb 22, 2010 at 12:31 AM, Kai Krueger kakrue...@gmail.com wrote: On 02/21/2010 11:43 AM, Brett Henderson wrote: Having a --write-api0.6-dump command might not be a bad idea. Although the --wd task is simpler from a users point of view if it can be made to be equally fast. Sorry

Re: [osmosis-dev] keeping an AOI-API-DB up to date

2010-02-22 Thread Brett Henderson
Hi Marco, I'm not sure if you've received an answer elsewhere, but here goes. There are a number of ways your data can end up with referential integrity problems. The most likely is simply that by cutting an area out using the bounding polygon task you'll end up with missing nodes. Some ways

Re: [osmosis-dev] keeping an AOI-API-DB up to date

2010-02-25 Thread Brett Henderson
Hi Marco, On Tue, Feb 23, 2010 at 12:08 AM, Marco Lechner - FOSSGIS e.V. marco.lech...@fossgis.de wrote: Hi Brett, thanx for your answer. I thought using completeWays=yes and completeRelations=yes takes care of nodes outside my bounding polygon. Those options will fix the problem, but

Re: [osmosis-dev] getting all the relations from source with completeRelations=yes

2010-03-09 Thread Brett Henderson
Frederik Ramm wrote about similar issues on January 9 (not sure if they're the same though). I haven't had a chance to look into them yet. I didn't write the completeRelations, completeWays functionality so I don't understand how they work at the moment. It's on my TODO list, but I'm finding it

Re: [osmosis-dev] problems with xapi, relations and osmosis

2010-03-12 Thread Brett Henderson
You need to check both of your OSM files downloaded from XAPI. The first one contains the full relation details as you expect. The second one contains an empty relation. Both have the same version number. The Osmosis *--merge* task is intentionally simple and doesn't alter relation contents in

Re: [osmosis-dev] problems with xapi, relations and osmosis

2010-03-12 Thread Brett Henderson
On Fri, Mar 12, 2010 at 11:38 PM, Jan Tappenbeck o...@tappenbeck.net wrote: Am 12.03.2010 12:30, schrieb Brett Henderson: You need to check both of your OSM files downloaded from XAPI. The first one contains the full relation details as you expect. The second one contains an empty

Re: [osmosis-dev] problems with xapi, relations and osmosis

2010-03-12 Thread Brett Henderson
On Sat, Mar 13, 2010 at 12:05 AM, Jan Tappenbeck o...@tappenbeck.net wrote: Am 12.03.2010 13:52, schrieb Brett Henderson: On Fri, Mar 12, 2010 at 11:38 PM, Jan Tappenbeck o...@tappenbeck.netwrote: Am 12.03.2010 12:30, schrieb Brett Henderson: You need to check both of your OSM files

Re: [osmosis-dev] Database is empty after five days of importing

2010-03-26 Thread Brett Henderson
It's not currently possible. The --truncate-apidb and --write-apidb tasks have to be run via separate Osmosis invocations (to ensure one completes before the other starts), and cannot be made to run inside a single transaction. Note that the import itself does run in a transaction, but doesn't

Re: [osmosis-dev] Error with osmosis.bat when using paths that include spaces

2010-03-28 Thread Brett Henderson
Hi Franz, Thanks for the error report. I haven't been able to test this out yet but I haven't forgotten. I'll get to it eventually and apply your changes. Brett On Sat, Mar 13, 2010 at 2:39 AM, Franz gr...@cip.ifi.lmu.de wrote: Hello, I just wanted to try osmosis and encountered an little

Re: [osmosis-dev] extracting data in a polygon

2010-03-30 Thread Brett Henderson
On Tue, Mar 30, 2010 at 8:25 PM, Brett Henderson br...@bretth.com wrote: On Tue, Mar 30, 2010 at 10:04 AM, Nakor nakor@gmail.com wrote: On 03/28/2010 09:28 PM, Brett Henderson wrote: osmosis --read-xml enableDateParsing=no file=MI_limits_merged.osm --bounding-polygon file

Re: [osmosis-dev] Problem using Osmosis34, Please Help

2010-04-21 Thread Brett Henderson
On Wed, Apr 21, 2010 at 5:03 PM, M Naveed Akram cmn...@gmail.com wrote: I can connect to my database explicitly, i think there is some problem with jdbc connection Sorry to ask, but did you run: mysql -h 127.0.0.1 -u root -p rose* *Or did you run:* *mysql -h 127.0.0.1 -u root -p rose

Re: [osmosis-dev] Problem using Osmosis34, Please Help

2010-04-21 Thread Brett Henderson
The MySQL support isn't well tested any more because PostgreSQL is now the preferred database. It is possible there's a problem there. Unfortunately I don't have a working MySQL installation to verify this. Do you have to use MySQL, or could you use PostgreSQL instead? Can anybody verify that

Re: [osmosis-dev] Problem using Osmosis34, Please Help

2010-04-21 Thread Brett Henderson
I've just looked at your error message again. It appears to be using the PostgreSQL drivers instead of MySQL. That might explain the problem. Now I just need to figure out why it's not using the MySQL drivers ... On Wed, Apr 21, 2010 at 9:03 PM, Brett Henderson br...@bretth.com wrote

Re: [osmosis-dev] Problem using Osmosis34, Please Help

2010-04-21 Thread Brett Henderson
It should be fixed now. Try a continuous integration build here: http://dev.openstreetmap.de:23457/hudson/job/osmosis-SNAPSHOT-ant/lastSuccessfulBuild/artifact/ It will be included in the 0.35 release when that occurs. On Wed, Apr 21, 2010 at 9:48 PM, Brett Henderson br...@bretth.com wrote

Re: [osmosis-dev] Error with osmosis.bat when using paths that include spaces

2010-04-21 Thread Brett Henderson
/osmosis-SNAPSHOT-ant/59/ Brett On Mon, Mar 29, 2010 at 11:31 AM, Brett Henderson br...@bretth.com wrote: Hi Franz, Thanks for the error report. I haven't been able to test this out yet but I haven't forgotten. I'll get to it eventually and apply your changes. Brett On Sat, Mar 13, 2010

[osmosis-dev] Osmosis Release 0.35

2010-04-22 Thread Brett Henderson
Hi All, I just released Osmosis 0.35. There are no major new features, just an assortment of bugs and improvements that should be useful to users. The key changes are listed below. Cheers, Brett *Changes* - Registered --fast-read-xml as a task instead of requiring --fast-read-xml-0.6

[osmosis-dev] Removed 0.5 Support

2010-04-22 Thread Brett Henderson
Hi All, With the 0.6 API having been released for 12 months now, the time has come to remove 0.5 support from Osmosis. While 0.5 support hasn't caused much pain, I'm keen to simplify things where possible. Some before and after stats. 0.35 Lines of Java Code: 91,602 Number of Java Classes: 843

Re: [osmosis-dev] Osmosis Release 0.35

2010-04-22 Thread Brett Henderson
On Thu, Apr 22, 2010 at 11:17 PM, Frederik Ramm frede...@remote.org wrote: Brett, Brett Henderson wrote: There are no major new features, just an assortment of bugs That's how we love our Osmosis ;-) Hehe, oops. Bug *fixes* :-) Bye Frederik

Re: [osmosis-dev] problems importing .osm files into postgis

2010-05-02 Thread Brett Henderson
On Sun, May 2, 2010 at 10:12 PM, _-_ txp_unimatri...@web.de wrote: Hi there, I've got a problem with importing .osm files into a postgis database. I think i set up the database correcly is, I used the pgsql_simple_schema_0.6.sql schema from osmosis. I also used the 900913.sql file.

Re: [osmosis-dev] Can't load osm file to PostGRESql

2010-05-03 Thread Brett Henderson
On Tue, May 4, 2010 at 12:30 AM, Ibrahim Bouchrika ibrahim_bouchr...@hotmail.com wrote: Hi, I'm trying to load a osm file to my postgresql database. I'm working on a windows xp system with dual core and 3GB of RAM and about 10GB of free space. I downloaded the netherlands.osm file from

Re: [osmosis-dev] Can't load osm file to PostGRESql

2010-05-04 Thread Brett Henderson
On Tue, May 4, 2010 at 10:50 PM, Brett Henderson br...@bretth.com wrote: On Tue, May 4, 2010 at 5:56 PM, Ibrahim Bouchrika ibrahim_bouchr...@hotmail.com wrote: The database i'm using is a fresh made one, so the error must be duplicate entries in the osm. I have the same problem

Re: [osmosis-dev] Can't load osm file to PostGRESql

2010-05-10 Thread Brett Henderson
Can you try downloading this file? http://www.bretth.com/empty.osm And then follow Frederik's instructions as below. osmosis --rx faulty.osm --rx empty.osm --dc --sort-change-0.6 --simc --wxc good.osc osmosis --rxc good.osc --rx empty.osm --ac --wx good.osm On Mon, May 10, 2010 at 8:38 PM,

Re: [osmosis-dev] build problem with 0.35 release

2010-05-16 Thread Brett Henderson
On Sun, May 16, 2010 at 6:05 AM, datendelphin mailingl...@osm.datendelphin.net wrote: Hello I tried to make an ebuild for gentoo for the recent osmosis 0.35. But ant fails building with ant build_binary Buildfile: build.xml BUILD FAILED

Re: [osmosis-dev] Unexpected Database Migration

2010-05-17 Thread Brett Henderson
:07, Brett Henderson wrote: Can somebody tell me what migration 20100513171259 does in the production database? I can't see it in the git repo. I'm getting warnings from the Osmosis replication and before I turn them off for each migration I verify that the db change isn't in an area I care

Re: [osmosis-dev] question about --merge

2010-05-19 Thread Brett Henderson
On Wed, May 19, 2010 at 4:29 AM, Christoph Wagner freemaps@googlemail.com wrote: Am 18.05.2010 15:18, schrieb Brett Henderson: To summarise, if you can draw a graph of the data flows in Osmosis, ensure that you never have data being split then recombined at a later point. In your

Re: [osmosis-dev] rails_port and Mapnik with one database

2010-06-10 Thread Brett Henderson
Hi Klemens, I believe the answer is no. Both schemas are serve different purposes and use a very different implementation. Perhaps not the ideal list for this question though given that neither schema is defined by Osmosis. Brett On Thu, Jun 10, 2010 at 1:34 AM, Klemens toural...@gmail.com

Re: [osmosis-dev] [OSM-dev] Problem in rake db:migrate with postgre

2010-06-12 Thread Brett Henderson
to resolve it On Mon, Jun 7, 2010 at 12:44 PM, M Naveed Akram cmn...@gmail.com wrote: can anyone tell me that to which schema migration version number the new osmosis works fine On Sun, Jun 6, 2010 at 7:35 AM, Brett Henderson br...@bretth.com wrote: On Fri, Jun 4, 2010 at 10:38 PM, Ævar

[osmosis-dev] Project Restructure

2010-06-15 Thread Brett Henderson
Hi All, I just created a breakup branch. I had several hours in an airport without much to do so started experimenting with a new way of packaging osmosis. One problem I have with the current single project approach is that every time a new feature is added, a whole bunch of new libraries need

Re: [osmosis-dev] error caused by Caused by: org.postgresql.util.PSQLException: ERROR: column active of relation users does not exist

2010-06-23 Thread Brett Henderson
Hi Michael, There were some changes made to the schema recently that have broken Osmosis. Fixing Osmosis is on my list of things to do, but I'm not sure when I'll get to do it. Brett On Wed, Jun 23, 2010 at 7:10 PM, Michael musset mickamus...@gmail.comwrote: Hi, I've a france.osm from

Re: [osmosis-dev] How to merge 2 osm files

2010-07-19 Thread Brett Henderson
Hi Sam, On Tue, Jul 20, 2010 at 6:09 AM, Sam Vekemans acrosscanadatra...@gmail.comwrote: Hi there, I was wondering how i can use osmosis to merge 2 osm files. I use Windows XP and want to use the command line for it. My guess is this osmosis --rx file2.osm --rx file1.osm --m --wx

Re: [osmosis-dev] postgresql base for osmosis

2010-07-22 Thread Brett Henderson
Hi Nakor, You're getting an error earlier in the script: psql:/tmp/pgsql_simple_schema_0.6.sql:42: ERROR: AddGeometryColumns() - invalid SRID CONTEXT: SQL statement SELECT AddGeometryColumn('','', $1 , $2 , $3 , $4 , $5 ) PL/pgSQL function addgeometrycolumn line 4 at SQL statement You don't

Re: [osmosis-dev] postgresql base for osmosis

2010-07-24 Thread Brett Henderson
On Sat, Jul 24, 2010 at 2:44 AM, Nakor nakor@gmail.com wrote: On Fedora, the script to run against your database is /usr/share/pgsql/contrib/spatial_ref_sys.sql Brett, Thanks that helps. I was able to import data into the DB. BTW what are the other schema useful for? What other

Re: [osmosis-dev] other schemas delivered with osmosis (was postgresql base for osmosis)

2010-07-26 Thread Brett Henderson
On Sun, Jul 25, 2010 at 1:46 AM, Nakor nakor@gmail.com wrote: On 07/24/2010 04:59 AM, Brett Henderson wrote: On Sat, Jul 24, 2010 at 2:44 AM, Nakor nakor@gmail.com What other schema are you referring to? Brett The ones provided with osmosis like pgsql_simple_schema_0.6_bbox.sql

Re: [osmosis-dev] How to merge 2 osm files

2010-07-26 Thread Brett Henderson
On Sun, Jul 25, 2010 at 3:23 AM, Sam Vekemans acrosscanadatra...@gmail.comwrote: cool, to start, the .bat file was actually in the sub directory called 'bin', i was expecting it to be in the root directory, instead of the .jar file which maybe should be in a sub folder? That is where the

Re: [osmosis-dev] Patch: ReplicationLagReader

2010-07-26 Thread Brett Henderson
Hi Peter, You seem to have left my name as the author in some of the source code. Presumably that should be your name ;-) Can you let me know what the purpose of this is? Okay, I understand that this is for replication lag, but what is it comparing? On first read it appears to be comparing the

Re: [osmosis-dev] Changes to Osmosis Pgsql Schema

2010-08-09 Thread Brett Henderson
Hi David, On Sat, Aug 7, 2010 at 10:10 PM, David Carmean d...@halibut.com wrote: Brett, et al: Please consider leaving the current simple schema intact (with the addition of the index clustering) and instead create a third schema for the HSTORE version. Losing the current schema would

Re: [osmosis-dev] Reading OSM History dumps

2010-08-22 Thread Brett Henderson
Hi Peter, This all sounds very interesting and will no doubt have many uses that I can't anticipate. I can't give you much assistance but will try to answer any specific questions you have. My wife is going to give birth sometime within the next month which means my priorities are about to

Re: [osmosis-dev] Parsing the JOSM file format

2010-08-23 Thread Brett Henderson
Hi Michael, The JOSM format differs from the Osmosis format in a number of ways, not just version information. In order to open a JOSM file properly you really need to handle other information including the extra action attribute. I try to keep Osmosis pure wherever possible to avoid lots of

Re: [osmosis-dev] Reading OSM History dumps

2010-08-24 Thread Brett Henderson
On Tue, Aug 24, 2010 at 1:09 AM, Peter Körner osm-li...@mazdermind.dewrote: Am 23.08.2010 13:35, schrieb Brett Henderson: To create your own store implementation you can build on the Osmosis persistence support. All classes that are persistable implement the Storeable interface and have

Re: [osmosis-dev] Reading OSM History dumps

2010-08-25 Thread Brett Henderson
On Wed, Aug 25, 2010 at 11:14 PM, Peter Körner osm-li...@mazdermind.dewrote: Brett, the pgsql tasks currently write (in COPY mode) all data to temp files first. The process seems to be PlanetFile - NodeStoreTempFile - CopyFormatTempFile - PgsqlCopyImport in osm2pgsql the copy data is pushed

Re: [osmosis-dev] Reading OSM History dumps

2010-08-25 Thread Brett Henderson
On Wed, Aug 25, 2010 at 11:33 PM, Peter Körner osm-li...@mazdermind.dewrote: Am 25.08.2010 15:26, schrieb Brett Henderson: In short it just hasn't been a high priority to change it. I was planning to share on FileInputStream/FileOutputStream level. You can feed a FileInputStream

Re: [osmosis-dev] Reading OSM History dumps

2010-08-25 Thread Brett Henderson
On Thu, Aug 26, 2010 at 8:19 AM, Peter Körner osm-li...@mazdermind.dewrote: Hi Marco The first snapshot is out. Unfortunately the hstore migration progress Brett is still in let the pgsnapshot tests fail, which is why hudson is not providing nightly builds anymore. I hope to have this

Re: [osmosis-dev] keyValueList option, and latest node versions

2010-08-30 Thread Brett Henderson
Hi Andrzej, I finally got around to checking out your patch. I've just checked it in. I changed the name of the task to --flatten or --f for short because I don't believe any other tasks have filter in the name. I notice that it assumes that data is sorted. Ideally it should utilise something

Re: [osmosis-dev] keyValueList option, and latest node versions

2010-09-03 Thread Brett Henderson
I've applied the patch, modified it to use a new SortedDuplicateEntityPipeValidator class, and checked it all in. I haven't tested it though ... On Fri, Sep 3, 2010 at 10:20 PM, Brett Henderson br...@bretth.com wrote: Hi Andrzej, On Thu, Sep 2, 2010 at 12:45 PM, andrzej zaborowski balr

Re: [osmosis-dev] Boxing accuracy

2010-09-03 Thread Brett Henderson
Hi Zenon, On Wed, Sep 1, 2010 at 11:33 AM, Zenon Panoussis ora...@provocation.netwrote: Hi everyone I just subscribed and, as you might expect, I'm coming here with a problem. I think it's an osmosis bug, but I can't say that for sure. I find the planet.osm file completely unworkable

Re: [osmosis-dev] Problem with 0.36

2010-09-13 Thread Brett Henderson
On Mon, Sep 13, 2010 at 4:57 PM, Frederik Ramm frede...@remote.org wrote: Hi, Frederik Ramm wrote: I'll debug this further - currently unsure if there's something wrong with the input data or what. The problem occurs about 1h50m hours into processing the job. so it looks more like it is

Re: [osmosis-dev] Planet import

2010-09-27 Thread Brett Henderson
On Tue, Sep 28, 2010 at 10:25 AM, Nakor nakor@gmail.com wrote: On 09/24/2010 09:52 AM, Nakor wrote: Brett, I should have read the whole documentation first. I am using --write-pgsql . I'll let it continue (as I am now over 200 Gb) and see how it goes. Next time I need to import I

Re: [osmosis-dev] Problem with bounding-polygon and completeWays=yes

2010-10-04 Thread Brett Henderson
On Sat, Oct 2, 2010 at 3:06 PM, Brett Henderson br...@bretth.com wrote: On Sat, Oct 2, 2010 at 1:47 AM, Martin Kaistra ad...@djfun.de wrote: Hi, when I try this command ./osmosis --read-xml file=friedrichshafen_highways.osm --bounding-polygon file=Friedrichshafen.poly completeWays=yes

Re: [osmosis-dev] Osmosis 0.37 Released

2010-10-16 Thread Brett Henderson
On Sat, Oct 16, 2010 at 9:41 PM, Jochen Topf joc...@remote.org wrote: On Sat, Oct 16, 2010 at 05:33:37PM +1100, Brett Henderson wrote: - Updated the pgsql schema (now version 6) to move all tags into hstore columns, add a ways.nodes column and CLUSTER the nodes and ways tables

Re: [osmosis-dev] lost relations while clipping

2010-10-16 Thread Brett Henderson
Hi Maxim, 2010/10/12 Maxim Dubinin s...@gis-lab.info Hi osmosis-devs, On our regional extraction system we've ran into what seems to be a bug. Relations, that are members by themselves are dropped while extracting. Example of such relation:

Re: [osmosis-dev] Problem with --node-key-value

2010-10-16 Thread Brett Henderson
I've just taken a look at the code (I didn't write these tasks) for the --node-key-value task and it works slightly differently to the --way-key-value task. The --way-key-value task passes through node and relation objects unchanged, but the --node-key-value task drops them. That means that when

Re: [osmosis-dev] Osmosis on Windows

2010-11-06 Thread Brett Henderson
Hi Nakor, Thanks for the report. On Fri, Nov 5, 2010 at 2:39 AM, Nakor nakor@gmail.com wrote: Hello, Lately I had to use osmosis on Windows. I found a few issues in osmosis.bat that I want to report. 1) lines 14 and 19 need to have extra quotes: IF EXIST

Re: [osmosis-dev] Improve relation extraction handling

2010-11-07 Thread Brett Henderson
Hi Frederik, On Sun, Nov 7, 2010 at 10:44 PM, Frederik Ramm frede...@remote.org wrote: Hi, I'm a major user of the --bp task in Osmosis, for the nightly Geofabrik country extracts. I cannot use the complete-something flags as that would take far too much time, and on the whole the

[osmosis-dev] Changes to Plugin Loader

2010-11-15 Thread Brett Henderson
Hi Everybody, I've made a simple but significant improvement to the way Osmosis loads tasks and plugins. Previously there was a file called osmosis-plugins.conf in the config directory that listed out all the plugins to be loaded during startup. This was the way that the tasks for each

Re: [osmosis-dev] Osmosis 0.37 and enableLinestringBuilder error

2010-11-17 Thread Brett Henderson
It looks like the wiki needs a fix up :-) Sorry about that. You don't need to specify that option. The code *should* (been a while since I looked at it) figure out what columns you have in the database dynamically. There is no need to specify such an option. Just remove the option and try

[osmosis-dev] Osmosis 0.38 Released

2010-11-19 Thread Brett Henderson
Hi All, I've just released Osmosis 0.38. http://bretth.dev.openstreetmap.org/osmosis-build/osmosis-0.38.tgz http://bretth.dev.openstreetmap.org/osmosis-build/osmosis-0.38.zip http://dev.openstreetmap.de:23457/hudson/job/osmosis-RELEASE-ant/38/ From changes.txt: - Updated internal storage to

Re: [osmosis-dev] Problem with pbf import into a postgres DB

2010-12-15 Thread Brett Henderson
Hi Thomas, My German isn't great, but I'm guessing that the following message is complaining about a missing tags column in the nodes table. FEHLER: Spalte »tags« von Relation »nodes« existiert nicht I notice you're specifying the following option. validateSchemaVersion=no Why are you doing

Re: [osmosis-dev] Problem with pbf import into a postgres DB

2010-12-16 Thread Brett Henderson
osmosis via svn in eclipse to be able to debug the application? Is there a step by step documentation? Thanks Thomas Original-Nachricht Datum: Thu, 16 Dec 2010 18:58:51 +1100 Von: Brett Henderson br...@bretth.com An: Thomas Schreiner schreiner.tho...@gmx.net CC

Re: [osmosis-dev] Source for JAR archives in osmosis source

2010-12-23 Thread Brett Henderson
Hi Giovanni, The source for the osmbin jar is stored in a git repo on github. I don't have the URL handy (I'm on my phone) but I think a search for PBF or similar should find it on the osm wiki ... The source for osmosis-hstore is in the binary jar I think. I didn't bother setting up a proper

Re: [osmosis-dev] Source for JAR archives in osmosis source

2011-01-07 Thread Brett Henderson
forum that will (hopefully) eventually become part of the PostgreSQL JDBC driver. On Fri, Dec 31, 2010 at 9:07 AM, Brett Henderson br...@bretth.com wrote: On 24/12/2010, at 10:26, Brett Henderson br...@bretth.com wrote: On Fri, Dec 24, 2010 at 9:18 AM, Giovanni Mascellani mascell

Re: [osmosis-dev] [patch] Suboptimal handling of the compressionMethod parameter in xml tasks

2011-02-06 Thread Brett Henderson
Hi Igor, Thanks for the patch. It looks good to me. I've applied it to trunk. Can you please update the documentation for the next version on the wiki to describe the new argument value? http://wiki.openstreetmap.org/wiki/Osmosis/Detailed_Usage_0.39 Cheers, Brett On Sun, Feb 6, 2011 at 4:12

Re: [osmosis-dev] Improving completeWays/completeRelations performance

2011-02-18 Thread Brett Henderson
On Fri, Feb 18, 2011 at 10:20 PM, Frederik Ramm frede...@remote.org wrote: Igor, On 02/18/11 11:40, Igor Podolskiy wrote: just a random thought: what's wrong with using --dataset-bounding-box? Importing the planet file into a database and doing a bunch of queries against is equivalent to

Re: [osmosis-dev] Unable to load current way nodes, when extracting and importing data from a osm file to a API BD

2011-03-03 Thread Brett Henderson
This is a known limitation of Osmosis bounding box processing. When you perform a bounding box extract, if nodes lie outside the bounding box, but are referenced by ways inside the bounding box they will not be included in the file. This is due to the way Osmosis processing works because it

Re: [osmosis-dev] [PATCH] Some issues with Osmosis launch scripts

2011-03-03 Thread Brett Henderson
Hi Igor, On Wed, Feb 16, 2011 at 4:25 AM, Igor Podolskiy igor.podols...@vwi-stuttgart.de wrote: Hi, one of my students and I managed to discover different issues with the Osmosis launch scripts in the $OSMOSIS/bin directory, both on Windows and Unix-like systems. The shell script

Re: [osmosis-dev] using osmosis to import full history planet

2011-03-04 Thread Brett Henderson
Hi Martijn, The history tasks you're using are part of some experimental work that Peter Körner was working on and they're not part of the normal Osmosis distribution. Perhaps Peter can provide some assistance ... Brett On Fri, Mar 4, 2011 at 1:09 AM, Martijn van Exel mart...@geodan.nl wrote:

Re: [osmosis-dev] OSMembrane - GUI front-end for Osmosis

2011-03-04 Thread Brett Henderson
Hi Tobias, I just finished having a play with OSMembrane. Colour me impressed :-) It's a great little app, and provides a nicely polished user experience. I hope development on the tool remains active, or that it at least continues to be maintained. It should be a great complement to Osmosis.

Re: [osmosis-dev] Improving completeWays/completeRelations performance

2011-03-04 Thread Brett Henderson
Hi Frederik, On Fri, Feb 18, 2011 at 7:57 PM, Frederik Ramm frede...@remote.org wrote: But I've been thinking: With the the high performance of PBF reading, a two-pass operation should become possible. Simply read the input file twice, determining which objects to copy in pass 1, and actually

Re: [osmosis-dev] Cannot represent -1 as a char.

2011-03-23 Thread Brett Henderson
Hi Scott, I've just modified the serialisation code to serialise the full 32-bit signed int instead of casting to an unsigned chararacter. This means that the internal serialisation format will be slightly less efficient but I suspect the difference will be immeasurable. Note that recently I

[osmosis-dev] Osmosis Maintenance

2011-03-23 Thread Brett Henderson
Hi All, I'm getting worse and worse at responding to any Osmosis issues. The primary reason is a recent addition to the family, but a busy day job isn't helping. This manifests as slow response to emails, slower response to patches, extra slow response to bugs, and total absence of new features

Re: [osmosis-dev] planet import

2011-04-18 Thread Brett Henderson
Hi Brian, Yes, you should definitely use the built-in box builder functionality. I've never tried to use the database to do it on a complete planet. I have no idea how long it will take. Brett On Sun, Apr 17, 2011 at 4:34 AM, Brian DeRocher br...@derocher.org wrote: On Saturday 09 April

[osmosis-dev] Proposal for Allowing Additional Data in Pipeline

2011-05-11 Thread Brett Henderson
Hi All, This email is just musings at this point. I'm not sure if I'll be able to implement anything anytime soon, but I'd be interested in people's thoughts on this. Until now I've intentionally kept the core data classes in Osmosis as simple as possible to simplify maintenance and ensure

Re: [osmosis-dev] --used-node performance and a possible way to improve it

2011-06-03 Thread Brett Henderson
Hi Igor, You're describing a common problem with the Osmosis pipeline. Many scenarios would be improved if you could access the data stream twice rather than having to buffer all data within the task itself. Your solution of requiring two input streams is quite practical. I've often been

Re: [osmosis-dev] --used-node performance and a possible way to improve it

2011-06-12 Thread Brett Henderson
Hi Igor, On Sat, Jun 4, 2011 at 6:04 AM, Igor Podolskiy igor.podols...@vwi-stuttgart.de wrote: Hi Brett, hi @osmosis-dev, You're describing a common problem with the Osmosis pipeline. Many scenarios would be improved if you could access the data stream twice rather than having to buffer

Re: [osmosis-dev] bounding-polygon dismisses points at +180° longitude

2011-07-22 Thread Brett Henderson
On Sun, Jul 17, 2011 at 4:25 AM, WanMil wmgc...@web.de wrote: Hi, what need to be done to get this issue fixed? The following things were provided: * a simple testcase * a scenario in which the problem is a real issue (extracting russian border) * a simple patch based on Brett ideas I

[osmosis-dev] Version Control Full History and GIT Test

2011-09-07 Thread Brett Henderson
Hi All, I've been playing in a couple of areas with regards to Osmosis version control. - I'm pondering a move to GIT. Primarily because it gives people a better opportunity to experiment with the codebase. Secondly because I am experimenting with GIT anyway and wanted a real-world

  1   2   3   >