Re: [OSM-dev] Merging pbf files problem?

2010-12-22 Thread marqqs
Since the USA is such a large proportion of the whole planet file (probably over 50%) I believe most people import the whole planet file instead of trying to extract the US data. As far as I remember (bz2 compressed files): World 13 GB USA 3 GB Europe 6 GB But the suggested way, to download the

Re: [OSM-dev] Rendering Strategy

2010-12-24 Thread marqqs
Hello again, meanwhile I have established a rendering strategy other than mod_tile an a bit easier than tirex - I think. http://wiki.openstreetmap.org/wiki/Openptmap/Installation#Use_a_Rendering_Strategy Until now, it works fine. Thanks again for your suggestions and Ideas! Markus

[OSM-dev] mod_tile - Howto?

2010-12-26 Thread marqqs
Hello, I've got curious about Tirex. Since Tirex seems to need mod_tile I'm looking for an easy installation instruction for mod_tile. The Wiki page says There are a number of HowTo's available to set up a tile server based upon mod_tile.. That's a nice hint, but at this point I would have

Re: [OSM-dev] mod_tile - Howto?

2010-12-26 Thread marqqs
Thanks for this quick reply! Get the source. Change paths in render_conf.h if you have to. Compile with make. Install with make install. Create a apache module with the config provided on the wikipage. Perhaps edit renderd.conf? Startup apache and tirex. Have fun :) Join irc.oftc.net #osm-dev

Re: [OSM-dev] Layered Tiling (Mapnik)

2010-12-27 Thread marqqs
It would break some layering - if you paint roads and railways on different tiles then you can *either* display roads over railways or railways over roads but not - but on the whole it should not be too bad. Has anyone done some experimentation in that direction? Yes, I did exactly this

Re: [OSM-dev] Layered Tiling (Mapnik)

2010-12-28 Thread marqqs
Sounds great, but it's not that easy, I think... Depending of the map layers you compose, you would need different text layer compositions. For example: In my public transport map, there are priorities for the texts; the name of a railway station has always a higher priority than the name of a

Re: [OSM-dev] Layered Tiling (Mapnik)

2010-12-28 Thread marqqs
Yes, would be a very good solution! The client would get the texts and their font information including their position and display them on its own. This could be done in Javascript. Even collision management would be possible (omitting texts which low priorities or moving them a bit). Of

Re: [OSM-dev] mod_tile - Howto?

2011-01-02 Thread marqqs
Sorry having to tell you: I failed. Did not manage to get mod_tile installed. Package dependencies which could not be resolved (different package versions) and a bunch of error messages while doing debuild. The commands in chapter

[OSM-dev] Fwd: Re: mod_tile - Howto?

2011-01-03 Thread marqqs
Thanks! It seems, I still have problems in creating the debian packages: parsechangelog/debian: Warnung: debian/changelog(l1): ungültiger Schlüsselwert nach »;«: urgency=low LINE: mapnik (0.7.1) stable; urgency=low dh_installdocs dh_installexamples -Xdata/new dh_install

Re: [OSM-dev] Planet from api06.dev?

2011-01-04 Thread marqqs
Hi Chris, there is a germany.osm.bz2 in this directory: http://download.geofabrik.de/osm/europe/ It's a snapshot, taken usually between 20:00 and 21:00 and made available one or two days later. Markus Original-Nachricht Datum: Tue, 4 Jan 2011 21:22:05 +0100 Von: Christian

Re: [OSM-dev] mod_tile - Howto?

2011-01-06 Thread marqqs
Hi Peter, the small syntax problems didn't bother me, I already corrected them. Must have been a mistake while copy/paste - the minuses left to some operands were replaced by dashes. And yes, I tried make and make install too, but I think, I do not have the right prerequisites on the machine.

[OSM-dev] osm2pgsql: parse-xml2.c:100: StartElement: Assertion `xlon' failed.

2011-05-30 Thread marqqs
Hello, today this error message was relayed to me: osm2pgsql: parse-xml2.c:100: StartElement: Assertion `xlon' failed. I managed to identify the problem: osm2pgsql persists on getting coordinates (lon/lat) even when it reads an .osc file and the OSM object in question is to delete.

Re: [OSM-dev] osm2pgsql: parse-xml2.c:100: StartElement: Assertion `xlon' failed.

2011-05-30 Thread marqqs
Hi Frederik, That would not break osm2pgsql but make it less resilient against nonsensical input. I have checked in a change (r26083) that hopefully does it right. Thanks!! I'm trying to get smaller .osc files. Some of the data isn't absolutely necessary if you just want to keep your

Re: [OSM-dev] Fastest way to extract a bounding box

2011-06-01 Thread marqqs
What I would like to know is if there's a significantly faster way to do that. That depends... ;-) Which option do you need? Do you need relations? Do you need relations which have relations as members which have ways which have nodes inside the box? Example: There is a bus line which

Re: [OSM-dev] Fastest way to extract a bounding box

2011-06-01 Thread marqqs
Hi, you're of course not bothering me :-) I'm relieved. :-) You can choose very particularly which option you want to apply and which one not if you extract your bbox with Osmosis. I would suggest to apply at least cascadingRelations if you need to have multipolygons included properly (forest

Re: [OSM-dev] planet.openstreetmap.org, pbf, latest-link

2011-06-08 Thread marqqs
Would be very helpful! I made a similar suggestion concerning http://planet.osm.org/daily/ half a year ago. Who could create such a symlink? Original-Nachricht Datum: Wed, 8 Jun 2011 16:38:58 +0200 Von: Sebastian Kürten sebastian.kuer...@fu-berlin.de An:

[OSM-dev] osm2pgsql, .o5m import interface

2011-07-02 Thread marqqs
Hi, yesterday I wrote an import interface for .o5m and .o5c files ( http://wiki.openstreetmap.org/wiki/o5m ). May I add the source file (parse-o5m.c) to the regular osm2pgsql sources? Markus ___ dev mailing list dev@openstreetmap.org

Re: [OSM-dev] osm2pgsql, .o5m import interface

2011-07-02 Thread marqqs
Hi Jon, thanks for your suggestions and ideas! Do you have any speed benchmarks you can add to the o5m wiki page? Perhaps the timing from an osm2pgsql -O null file could be added to the existing table listing the file sizes? OK, I added speed information for the most important formats. This

Re: [OSM-dev] [OSM-legal-talk] license change effect on un-tagged nodes

2011-07-07 Thread marqqs
to retrieve the information you need from the node records, as the node records are referred to by the way records. Marqqs Original-Nachricht Datum: Wed, 6 Jul 2011 19:31:33 -0400 Von: Anthony o...@inbox.org An: Dave F. dave...@madasafish.com, Frederik Ramm frede...@remote.org

Re: [OSM-dev] Merging Changes into Planet

2011-07-14 Thread marqqs
Hi Andy, there is another program which I would expect to be significantly faster. However, it has two disadvantages: 1. It's new, it still may have bugs. 2. It lacks in the ability to write PBF and uses .osm or the efficient but less common .o5m format instead. Nevertheless, it could be worth

Re: [OSM-dev] Merging Changes with Bounding Boxes

2011-07-15 Thread marqqs
Are there any options to getting the old location of a moved node without writing my own Osmosis patch (if that's even possible)? I think this cannot be solved easily. But I like your Idea of creating a change file extract. One could implement it like this: Exclude all create and modify

Re: [OSM-dev] osm2pgsql fails on pbf file

2011-07-23 Thread marqqs
Hi, I just downloaded asia.osm.pbf and started the detour via .o5m (osmconvert, osm2pgsql with o5m-parser). So far no error occurred. That really sounds like a problem inside the pbf. Did you try to read another pbf-file or read asia.osm.pbf with osmosis? Maybe it was just the pbf file from

Re: [OSM-dev] Extracting just national boundaries

2011-08-05 Thread marqqs
Original-Nachricht Datum: Fri, 5 Aug 2011 08:57:53 +0200 Von: Curt Nowak no...@bwl.uni-hildesheim.de An: \'mar...@gmx.eu\' mar...@gmx.eu, \'igor.podols...@vwi-stuttgart.de\' igor.podols...@vwi-stuttgart.de CC: \'dev@openstreetmap.org\' dev@openstreetmap.org Betreff: AW:

Re: [OSM-dev] Extracting just national boundaries

2011-08-05 Thread marqqs
Hi Curt, But as far as I understand, those relations will have other relations as their members. If these other relations do *not* have the above mentioned tags, they will *not* be in the output file (but they should). Unfortunately, because of my lack in experience I cannot speak for

Re: [OSM-dev] Extracting just national boundaries

2011-08-07 Thread marqqs
Hi Curt, 1.Run: Read all relations and store their dependencies (maybe in a very simple database, or even in RAM) Then figure out which relations you *really* need. 2. Run: Filter these relations. This is a good description of osmfilter's algorithm. ;-) The program stores the interrelation

[OSM-dev] osm2pgsql intarray contrib module loaded

2011-08-08 Thread marqqs
Hi! After starting this command: osm2pgsql/osm2pgsql -s -C 3000 -d gis -U gisuser -S default.style gis.osm I get this output from osm2pgsql: osm2pgsql SVN version 0.80.0 (32bit id space) (...) The target database has the intarray contrib module loaded. While required for earlier versions of

Re: [OSM-dev] osm2pgsql intarray contrib module loaded

2011-08-08 Thread marqqs
Hi Frederik and Jon, thanks a lot, this worked! There was no uninstall procedure available but the database could be recreated easily. Markus Original-Nachricht Datum: Mon, 08 Aug 2011 19:30:03 +0200 Von: Frederik Ramm frede...@remote.org An: dev@openstreetmap.org

[OSM-dev] osm2pgsql, zoom range for -e option?

2011-08-09 Thread marqqs
Hi, last night I experimented with the -e option. Although this option had been set to 11-18 the dirty_tiles file contained only three tile paths with zoom level 15, a lot of paths with level 16 to 18 and not a single tile path with zoom level 14 or below. Does someone know the reason for

Re: [OSM-dev] osm2pgsql, zoom range for -e option?

2011-08-09 Thread marqqs
Maybe it's a bug in expire-tiles.c? I'm not sure. When I change -e 11-18 to -e 11-15 many tile paths (number triples) from zoom level 15 and below appear in the list. It seems as if the length of the tiles expired list would be limited to about 4 MB. Very confusing... at least for me. :-)

Re: [OSM-dev] osm2pgsql, zoom range for -e option?

2011-08-09 Thread marqqs
OK, I fixed the bug. - If it really was a bug and not intended behaviour. I'm still not sure... My patch (I added just 2 lines): diff -C 5 -p expire-tiles_old.c expire-tiles.c *** expire-tiles_old.c 2011-05-21 15:13:49.0 +0200 --- expire-tiles.c 2011-08-09 19:41:07.0 +0200

Re: [OSM-dev] osm2pgsql, zoom range for -e option?

2011-08-10 Thread marqqs
Hi Stephan, meanwhile I've asked Steve Hill (author which is mentioned in the source file header) for help. His explanation in brief: The expired-tiles list which is written by osm2pgsql does not contain any redundant information. This is intended that way because he wanted to save memory:

Re: [OSM-dev] Problem with duplicate keys

2011-08-10 Thread marqqs
Another thing is that I will be importing Russia as well... but I think that I could import Central America and then import Russia without any problem because it shouldn't be any duplicate entry in both files. You may have luck with that. It's worth a try. But you might encounter problems

Re: [OSM-dev] osm2pgsql, zoom range for -e option?

2011-08-10 Thread marqqs
Hi Igor, thanks! Do your python functions recalculate all the missing tile paths? Example: The dirty_tiles file contains just one tile: 16/100/100 Would the output of your function produce the following result? 16/100/100 17/200/200 17/200/201 17/201/200 17/201/201 18/400/400 18/400/401

Re: [OSM-dev] osm2pgsql, zoom range for -e option?

2011-08-10 Thread marqqs
My new patch cares about issue 1 and 2: $ diff -C 5 -p expire-tiles_old.c expire-tiles.c *** expire-tiles_old.c 2011-05-21 15:13:49.0 +0200 --- expire-tiles.c 2011-08-10 16:23:05.0 +0200 *** static int _mark_tile(struct tile ** tre *** 105,114 --- 105,146

Re: [OSM-dev] Problem with duplicate keys

2011-08-11 Thread marqqs
Ok, so I could extract my areas from a planet.osm with osmosis but how could I extract from planet osm Dominican Republic and Russia ? and then how could I apply diffs ? Now I am downloading the extracts from the countries and then I am getting differences with osmosis to finally apply with

Re: [OSM-dev] Extracting just national boundaries

2011-08-11 Thread marqqs
PS: Why is there that strict limit of parsing an osm file up to 12 times? In theory, there is no need to limit the number of recursions, but the if there was a closed loop in the data's references - e.g. relation A has relation B as a member, and vice versa - the program would never terminate.

Re: [OSM-dev] osm2pgsql: parse-xml2.c:100: StartElement: Assertion `xlon' failed.

2011-08-12 Thread marqqs
Hi Peter, thanks for answering! This question is very old, and there have been a few discussions concerning this subject since then. My question: Does osm2pgsql really need the coordinates of an object which is to delete anyway? No. Yes, in order to expire the tile the node was

[OSM-dev] NOT-saving empty Mapnik tiles

2011-08-12 Thread marqqs
Hi, I'm trying not to save empty tiles. Until now my approach is very simple but silly too: The tile is rendered by Mapnik, then stored in a file. After this, I look at the file's length and delete this file if the length does not exceed 116 bytes. This is a lot of IO effort. Therefore I

Re: [OSM-dev] NOT-saving empty Mapnik tiles

2011-08-12 Thread marqqs
Hi Igor, thank you, this link is very helpful! um, what is your definition of empty exactly? Is it all pixels are transparent? Or is it all pixels are of the same color? Or is it all pixels are of color X? I don't think there's an Image.is_empty() because empty means different things to

Re: [OSM-dev] NOT-saving empty Mapnik tiles

2011-08-12 Thread marqqs
To Igor: If your current method works for you and it's just about reducing disk IO, you just could use StringIO [1] or the like and save the PNG image to a buffer first, then check its length and conditionally save it to disk: Sounds very good, I will try this, thanks! Meanwhile I realized

Re: [OSM-dev] NOT-saving empty Mapnik tiles

2011-08-13 Thread marqqs
Hello again... unfortunately, this line did not work: im.save(buf, 'png256') I tried im.tostring() too, did not work either. This is the error message: Traceback (most recent call last): File ./mapnik_tile.py, line 143, in module im.save(buf, 'png256') Boost.Python.ArgumentError:

Re: [OSM-dev] NOT-saving empty Mapnik tiles

2011-08-15 Thread marqqs
Hi Igor, thanks a lot! I just got two further ideas: 1. Mapnik internals I would guess that Mapnik stored every tile in an array of 256 x 256 Bytes. If you could check such an array's bytes if they all had the same value, this would indicate either strictly monochromacity or complete

Re: [OSM-dev] NOT-saving empty Mapnik tiles

2011-08-16 Thread marqqs
Hello Igor and Oliver, presently I use this method: The image is written to /dev/shm/tile (RAM), then the file length is retrieved by os.stat(). If this length exceeds 116 bytes, the file is copied to its destination location in the tile tree, otherwise the destination location is deleted

[OSM-dev] How render tile size 1024x1024?

2011-08-17 Thread marqqs
Hello, what should I do to render larger tiles with plain Mapnik? I don't have installed Tirex/Mod-tile because the do not fit to the rendering strategy I'm planning to use. But a larger tile size would be fine... :-) Markus ___ dev mailing list

Re: [OSM-dev] How render tile size 1024x1024?

2011-08-17 Thread marqqs
Hi Peter, thank you! The problem is, that I don't need just one tile as output, I need a whole bunch of tiles in a tile tree which will be used by OpenLayers. I neglected to mention this, sorry. Original-Nachricht Datum: Wed, 17 Aug 2011 13:33:15 +0200 Von: Peter Körner

[OSM-dev] Mapnik, shared object issue

2011-08-22 Thread marqqs
Hi, last time I installed Mapnik everything went fine. This time there is a problem I have not been able to solve. If anybody knows what to do, please help... When I try to render tiles, the script throws an exception in one of the first lines: Traceback (most recent call last): File

Re: [OSM-dev] Mapnik, shared object issue

2011-08-22 Thread marqqs
Oops - my fault, sorry. sudo ldconfig solved the problem. :-) Original-Nachricht Datum: Mon, 22 Aug 2011 14:09:53 +0200 Von: mar...@gmx.eu An: dev@openstreetmap.org Betreff: [OSM-dev] Mapnik, shared object issue Hi, last time I installed Mapnik everything went fine.

[OSM-dev] osm2pgsql, -e option might affect too many tiles

2011-09-01 Thread marqqs
Hello, I'm using osm2pgsql with the excellent -e option which allows me to generate dirty-tiles lists. It's my observation that the output can be somewhat extensive if you just change ONE node. For example: I change the name of a single node. This causes osm2pgsql to put not only the node's

Re: [OSM-dev] osm2pgsql, -e option might affect too many tiles

2011-09-01 Thread marqqs
Hi Andy, thanks for reply! You're right, the whole way needs to be rerendered if one node is moved and the way is displayed as a dashed line. Nevertheless, it would be a nice feature if only the node's tile and maybe the neighboring tiles would be rerendered if someone changed just one of the

[OSM-dev] Mapnik, Japanese characters?

2011-09-07 Thread marqqs
Hi, I'm using Mapnik to render a thematic map. Latin and Cyrillic characters are displayed properly but Japanese are not: http://openptmap.org/?zoom=14lat=35.68025lon=139.76767layers=BTFT Does anybody know how to fix this problem? Regards Markus

Re: [OSM-dev] Mapnik, Japanese characters?

2011-09-07 Thread marqqs
Hi AJ, thanks for your help! I added Unifonts as fallback and now everything is fine. :-) FontSet name=book-fonts Font face_name=DejaVu Sans Book / Font face_name=unifont Medium / /FontSet Markus Original-Nachricht Datum: Wed, 7 Sep 2011 10:47:12 -0400 Von: AJ Ashton

Re: [OSM-dev] keeping thematic planet extract up to date

2011-10-19 Thread marqqs
Hello, An alternative toolchain for keeping up-to-date thematic extracts (here: public transport information) is described here: http://wiki.openstreetmap.org/wiki/Openptmap/Installation the Wiki page is very long and might be confusing because two different approaches are described. Just

[OSM-dev] File Timestamp in PBF Files

2011-10-21 Thread marqqs
Hi, I just wanted to point you to a small discussion about storing a timestamp in the header of PBF files. This is already supported by .osm, .osc, .o5m and .o5c files. If you have any ideas which are more appropriate than my interim solution, please join the discussion. Markus

Re: [OSM-dev] File Timestamp in PBF Files

2011-10-21 Thread marqqs
Original-Nachricht Datum: Fri, 21 Oct 2011 23:48:12 +0200 Von: mar...@gmx.eu An: dev@openstreetmap.org Betreff: [OSM-dev] File Timestamp in PBF Files Hi, I just wanted to point you to a small discussion about storing a timestamp in the header of PBF files. This is

[OSM-dev] osm2pgsql, direction of a virtual way (based on a route)

2011-10-26 Thread marqqs
Hi! I'm wondering how osm2pgsql determines the direction of a route. Has the order of way-refs in the route relation influence on that? Are role tags forward and backward evaluated? Markus ___ dev mailing list dev@openstreetmap.org

Re: [OSM-dev] osm2pgsql, direction of a virtual way (based on a route)

2011-10-26 Thread marqqs
Thanks, this helps a lot! The direction of each resulting LineString should be the direction of the majority of constituting ways. That explains a some issues in openptmap at zoom level 17. Are role tags forward and backward evaluated? Not at all. Could it be done in osm2pgsql somehow?

Re: [OSM-dev] osm2pgsql, direction of a virtual way (based on a route)

2011-10-26 Thread marqqs
Hi Igor, are you sure? I thought one of the major goals of the _new_ PT schema was precisely to eliminate this forward/backward mess with the relation per route variant concept. Just looked it up [1]: No, I'm indeed very unsure in aspects of the new schema. If the ways don't have roles, the

Re: [OSM-dev] Release of osmpbf version 1.2.1

2011-11-01 Thread marqqs
Hi Scott, The decoding loop of osmconvert scares me a bit. Don't worry, it scares me too! :-) The PBF DEcoding procedure is a section in the source code I'm really not proud of. It's the result of a couple of experiments. Meanwhile this procedure works quite reliable, but if I had to write it

[OSM-dev] osm2pgsql and complex buildings

2011-11-02 Thread marqqs
Hi! Is there a way how osm2pgsql would consider complex buildings? Example: There is a hospital (building) which is defined by a multipolygon. That multipolygon has some ways as members, one of them with the role outer the others with the role inner. The hospital's tags are applied to the

Re: [OSM-dev] osm2pgsql and complex buildings

2011-11-02 Thread marqqs
Hi Jon, thanks for reply! That combination should work. Can you provide the ID of the relation? This is the relation after some tags have been removed by a filtering process: $ grep -A 20 1171285 gis_ey.osm relation id=1171285 version=4 member type=way ref=4921003

Re: [OSM-dev] osm2pgsql and complex buildings

2011-11-02 Thread marqqs
Hello Ian, I must apologize, that was my fault. Of course, you are right I must not remove the type tag. Just added the type line to the filter, and osm2pgsql runs smoothly. :-) Thanks to you and to Jon! osmfilter parameter file --keep=all amenity=hospital emergency=yes --keep-tags=all

[OSM-dev] Incomplete diffs?

2011-11-05 Thread marqqs
Hi all, this week, a user of osmupdate and osmfilter asked me for help. The filter program's output contained a certain way but not all of its nodes. This must not happen, of course, and I thought this would be a program error at first. Meanwhile I found out that this node simply did not

Re: [OSM-dev] Incomplete diffs?

2011-11-05 Thread marqqs
Hi Erik, thanks for your help. The missing node seems to be available via minutely and hourly diff files but NOT via the daily file. Meanwhile I found an explanation in the Wiki: http://wiki.openstreetmap.org/wiki/Planet.osm/diffs The data in the file is the change in data between midnight on

Re: [OSM-dev] Incomplete diffs?

2011-11-05 Thread marqqs
Hi Frederik, thanks for the explanation! The _replication_ diffs are the right choice if you want to update a full history file. Most people who update their OSM files on a regular basis do not need replication diffs, they are satisfied with the newest version of each object which has been

Re: [OSM-dev] Incomplete diffs?

2011-11-06 Thread marqqs
Hello, meanwhile osmupdate has been changed to download replication diffs only. But there is still an issue I cannot explain... I thought that the normal daily diffs would lack of some data which were provided around midnight, but there seem data to vanish from the middle of the day too: #

Re: [OSM-dev] Incomplete diffs?

2011-11-07 Thread marqqs
Hello Frederik, ok, it really must have been late. :-) Thank you for the explanation, sounds perfect. I wouldn't call it a bug at all because it may be necessary to keep such delete requests: Let's say you found an out-of-date .osm file and want to update it. You guess, the file is from last

[OSM-dev] New transport layer

2011-12-05 Thread marqqs
Hi Andy, thanks for your work, it's good to have a transport layer in official OSM map now. :-) I'm still not sure what you want to display on the map. Is it the Hardware (e.g. rails, streets) or is it the Software (transport lines, etc.)? An example: For buses you show the bus LINES, for

Re: [OSM-dev] Writing PBF

2011-12-13 Thread marqqs
Hi Jochen, Osmium now checks whether the buffer is 95% full and then writes it out (the 95% should leave more than enough space for the string table). This is great news, thanks! If you limit the number of objects only to maximum block size (32 MiB), you will get smaller PBF files. I noticed

Re: [OSM-dev] Writing PBF

2011-12-13 Thread marqqs
Hi Peter Jochen, I encountered shrinkage of around 1-2% of the overall block size while comparing the intermediate string ids with the sorted ones. sounds plausible. Sorting the strings might not be worth the effort if circumstances allow you to increase block size. I just ran a comparison

Re: [OSM-dev] Full history extracts

2011-12-24 Thread marqqs
Hi, Suppose I were to write a simple Perl script that streams the full history file (which is sorted by type then id then version), and wrap every version 1 entry in create.../create and every other entry in modify.../modify unless it has visible=false in which case I'd choose

Re: [OSM-dev] Getting information from relations.

2012-01-22 Thread marqqs
Hi Morten, first, I would take osm2pgsql for this purpose (openptmap.org does). Nevertheless, there are two cheep alternatives which may be sufficient for your application: 1. Osmosis option --a2p https://wiki.openstreetmap.org/wiki/Osmosis/Detailed_Usage_0.39#--areapoints_.28--a2p.29 Works for

Re: [OSM-dev] Filtering out elements from a planet extract

2012-02-08 Thread marqqs
Hi, I then tried with osmfilter but I don't think I found the right way to do it since the output file is only marginally smaller than the original. how did your command line look like? This should work: osmfilter input_data.osm --keep=landuse= -o=output_data.osm If you do NOT want to

Re: [OSM-dev] Filtering out elements from a planet extract

2012-02-08 Thread marqqs
Hi Ciprian, sorry, I got you wrong. Now it's clear which ways you want to exclude, but I'm still not sure which nodes you want have and which nodes you don't. You want to exclude landuse-ways with all their nodes? BUT you do NOT want to exclude that nodes of landuse-ways which have at least

Re: [OSM-dev] Filtering out elements from a planet extract

2012-02-08 Thread marqqs
Hi Ciprian, to use Osmium is certainly a good idea if you planning similar complex filtering tasks for the future! If you want to try it with osmfilter, there are two ways: 1. Manipulate XML Filter positive: osmfilter input_data.osm --keep=landuse= -o=filter_data.osm Then manipulate the

[OSM-dev] Mapnik: black transparent tiles

2012-03-21 Thread marqqs
Hello, once in a while, Mapnik creates black tiles. For example: http://openfiremap.org/?zoom=14lat=48.11357lon=11.52722layers=B Does anybody know the reason for this behaviour? Markus Original-Nachricht Datum: Wed, 21 Mar 2012 15:31:18 +0300 Von: Valery N.

Re: [OSM-dev] Mapnik: black transparent tiles

2012-03-21 Thread marqqs
It worked! I did as you suggested and changed 'png256' to 'png'. THANK YOU !! Markus Original-Nachricht Datum: Wed, 21 Mar 2012 16:03:44 +0300 Von: Darafei Praliaskouski m...@komzpa.net An: dev@openstreetmap.org Betreff: Re: [OSM-dev] Mapnik: black transparent tiles В

Re: [OSM-dev] Planet Updates

2012-04-28 Thread marqqs
Datum: Wed, 18 Apr 2012 11:29:19 -0500 Von: Toby Murray toby.mur...@gmail.com location a bit prematurely. At the time the database came out of read-only mode, the license bot was going to start any day now so the diffs were moved. But now we have 3 weeks worth of redaction diffs with no

[OSM-dev] Regional Diffs

2012-08-29 Thread marqqs
Hi, I just saw this new section in OSM Wiki: http://wiki.openstreetmap.org/w/index.php?title=Planet.osm%2Fdiffsaction=historysubmitdiff=801359oldid=792156#Regionaly_limited_diffs I think it would be advantageous to have regional diffs for more than a few countries. Probably, daily or hourly

[OSM-dev] Augmented Diffs - Compatibility?

2012-09-07 Thread marqqs
Hello, thanks for the idea of augmented diffs! It's advantageous to have related data in the same file. However I am not sure if it is wise to reinvent the wheel. Two questions / suggestions: 1. Tagging Why did you not use solely the existing XML tags create, modify and delete? That data an

Re: [OSM-dev] Augmented Diffs - Compatibility?

2012-09-07 Thread marqqs
Hi Roland, sorry, I did not want to just criticize the idea of augmented diffs, I merely wanted to understand the reasons why the tags have been defined in the way they are. 1. Tagging Altogether, please note: the augmented diffs aren't an extension of the normal diffs and even less

Re: [OSM-dev] XML planets (was Re: New proposed directory layout for planet.openstreetmap.org)

2012-09-08 Thread marqqs
Hello Roland, thanks for your explanations, however, you might be wrong with the assumption a file based update would take much longer than a database based update. I wanted to get sure, therefore I just did some tests with an average 64-bit Linux computer. Downloading planet-120822.osm.pbf:

[OSM-dev] file timestamp in planet.pbf ?

2012-09-09 Thread marqqs
Hello! Presently, only XML planet files contain a file timestamp. Example: osm version=0.6 generator=OpenStreetMap planet.c timestamp=2012-08-22T11:34:27Z I really would like to use the PBF planet files, but I need a file timestamp for my toolchain. How can this be accomplished? How can I

Re: [OSM-dev] file timestamp in planet.pbf ?

2012-09-10 Thread marqqs
Hi Martijn, What does that timestamp mean? The time the file was created? The time of the newest feature in the file? The latter. The latter can be extracted from a PBD using osmconvert --out-statistics (which is what I do) but there may be easier ways... Yes, this is what I do also. But

Re: [OSM-dev] Switch osm2pgsql to 64 bit mode

2012-09-15 Thread marqqs
Thank you for you work! When will this new version be available via your repository? I just tried and got the old one (0.80.0). Do I need to delete and remove the old database first, or will it be modified and reused by the 64-bit osm2pgsql? Grüße Markus Original-Nachricht

Re: [OSM-dev] Switch osm2pgsql to 64 bit mode

2012-09-15 Thread marqqs
Hello Kai, thanks for this quick reply. What version of Ubuntu do you use? I have updated the packages for 12.04LTS (precise), but I haven't updated them for the other versions of Ubuntu yet. Oh, I see. Is there any chance you might update it for the previous (and still supported) LTS

Re: [OSM-dev] Switch osm2pgsql to 64 bit mode

2012-09-16 Thread marqqs
Hello Kai, I have updated the package for 10.04 as well now. It will take another couple of hours though to propagate through the system. Thank you! Did you update just your repository (ppa:kakrueger/openstreetmap) or is the new version now available via Ubuntu standard packet sources? I'm a

Re: [OSM-dev] missing nodes

2012-10-16 Thread marqqs
Hi David, did you find out exactly where in your toolchain these nodes get lost? Maybe it's the filter process with Osmosis? I wouldn't assume a bug, I think it's more likely a misunderstanding in how the program options should be used. I'm not sure about the official API definition but it

Re: [OSM-dev] Timestamp in PBF files

2012-11-20 Thread marqqs
Hello Jochen, very good question. From my point of view the file timestamp should be the in-file representation of the externally maintained state.txt timestamp, as in http://planet.openstreetmap.org/replication/hour/000/001/668.state.txt for example. This would it make very easy to update

Re: [OSM-dev] Timestamp in PBF files

2012-11-20 Thread marqqs
Hello, did you know that PBF file timestamp has anniversary these days? :-) https://wiki.openstreetmap.org/w/index.php?title=Talk:PBF_Formatdiff=708490oldid=705430 After some thought... would it hurt if there were _two_ file timestamps in a PBF file? One string-formatted according to the

Re: [OSM-dev] Timestamp in PBF files

2012-11-21 Thread marqqs
Hello, How many nodes in the planet lack a latitude or longitude? Using a MAXINT encoding will cost about 8 bytes for each missing latitude or longitude. It's possible to reduce this to 2-3 bytes, but the format gets uglier/hackier. IMHO, probably not worth that cost. As far as I

Re: [OSM-dev] Timestamp in PBF files

2012-11-21 Thread marqqs
Frederik, Jochen, sorry, you both are right, I really was too fast. But now? Please, let's risk one small step and standardize the file timestamp (replication time), whatever the protobuf ID will be. If not 18, then 19 or something else. Protobuf format is flexible enough to be extended again

Re: [OSM-dev] Timestamp in PBF files

2012-11-22 Thread marqqs
Hello Scott, Thanks for your reply! I think what we need is a replacement for the timestamp which has been provided by .osm.bz2 files for years now. For example: $ wget -q planet.openstreetmap.org/planet/planet-latest.osm.bz2 -O - | bunzip2 | head -4 ?xml version=1.0 encoding=UTF-8? osm

Re: [OSM-dev] Timestamp in PBF files

2012-11-23 Thread marqqs
Hi Scott, in brief to the 1-degrees granularity: 1. Do whole processing in 64 bit: This would mean to need much more RAM space when processing ways' coordinates. We should not do this unless this granularity is really required. 2. Your formula: latitude_int = ((lat_offset +

Re: [OSM-dev] Timestamp in PBF files

2012-11-23 Thread marqqs
message HeaderMeta { required string HeaderKey = 1; optional HeaderMetaVarint = 10; optional HeaderMetaString = 12; // see type definitions there: https://wiki.openstreetmap.org/wiki/PBF#Format_example // Only _one_ of the three optional objects should be used; did not know how to

[OSM-dev] osm2pgsql - polygon stored in table planet_osm_line?

2012-12-25 Thread marqqs
Hello! Does anybody know why this way is not written into table planet_osm_polygon but into table planet_osm_line instead? http://www.openstreetmap.org/browse/way/152704753 I have already changed this line in the style file from node,way railway text linear to node,way

Re: [OSM-dev] Osmosis error - node not present in table current_nodes - no bbox

2013-01-03 Thread marqqs
Hi, Frederik is right: It seems that you somehow managed to drop a node that is referenced by something. I would suspect the --drop option of osmfilter to be responsible for this: --drop=natural=wood waterway=drain or waterway=ditch or waterway=stream or leisure=park Maybe replacing --drop

Re: [OSM-dev] Planet file date unclear at planet.osm.org

2013-01-11 Thread marqqs
It really would be nice to have a file timestamp not only in XML planet files but also in PBF planet files. There is a definition in PBF format for this information: https://wiki.openstreetmap.org/wiki/PBF#What_are_the_replication_fields_for.3F The field is called osmosis_replication_timestamp.