Re: [OSM-dev] PBF parsing frontend for osm2pgsql, tester wanted

2010-11-02 Thread Hartmut Holzgraefe

On 11/02/2010 12:07 AM, Jon Burgess wrote:

This looks like it fixes the problem:
$ diff -uw parse-pbf.c~ parse-pbf.c
--- parse-pbf.c~2010-10-31 20:47:32.0 +
+++ parse-pbf.c 2010-11-01 23:05:23.0 +
@@ -306,6 +306,7 @@
  DenseNodes *dense = group-dense;

  for (unsigned node_id = 0; node_id  dense-n_id; node_id++) {
+  deltaid += dense-id[node_id];
deltalat += dense-lat[node_id];
deltalon += dense-lon[node_id];

thanks for spotting, looks as if i deleted two lines instead of one
when removing some unused variable declarations to silence
warnings :(

fixed, committed, pushed, and a new patch level tarball created:

http://php-baustelle.de/osm2pgsql-0.70.4.tar.gz

--
hartmut



___
dev mailing list
dev@openstreetmap.org
http://lists.openstreetmap.org/listinfo/dev


Re: [OSM-dev] [Tagging] Super-relations or not

2010-11-02 Thread Matthias Julius

On Tue, 2 Nov 2010 01:02:37 +0800, Eugene Alvin Villar sea...@gmail.com
wrote:
 On Tue, Nov 2, 2010 at 12:25 AM, Peter Budny pet...@gatech.edu wrote:
 As far as I'm concerned, the difference in what's required to tag
things
 is minimal between these concerns.  Therefore, wouldn't it make the
most
 sense to choose whichever is programmatically the easiest and most
 flexible to deal with?
 
 It depends on what the you want to use route relations for. It's quite
 possible that different uses would demand different ways of
 structuring the route relation(s).

I would sey they should be set up that is best for mappers to deal with. 
Software can be made to deal with any scheme as long as there is a
consistent scheme.

Matthias

___
dev mailing list
dev@openstreetmap.org
http://lists.openstreetmap.org/listinfo/dev


Re: [OSM-dev] Mod_tile - apache 404 - no tiles please help

2010-11-02 Thread NicoG

the mod_tile config where in my web config 'osm' in site-available and
site-enabled

But i've also tried with mod_tile.conf in /etv/apache2/conf.d/mod_tile.conf
and that's not better.

Still no talk betweek apache and renderdeamon.
-- 
View this message in context: 
http://gis.638310.n2.nabble.com/Mod-tile-apache-404-no-tiles-please-help-tp5686447p5696276.html
Sent from the Developer Discussion mailing list archive at Nabble.com.

___
dev mailing list
dev@openstreetmap.org
http://lists.openstreetmap.org/listinfo/dev


[OSM-dev] Nominatim down

2010-11-02 Thread Peter Körner

Hi all

it seems, that nominatim is down:
http://downforeveryoneorjustme.com/nominatim.openstreetmap.org

I updated the wiki status page:
http://wiki.openstreetmap.org/wiki/Platform_Status

Peter

___
dev mailing list
dev@openstreetmap.org
http://lists.openstreetmap.org/listinfo/dev


Re: [OSM-dev] Multilingual Maps Overlays

2010-11-02 Thread Stefan Keller
Hi

Nice idea.

I don't see any labels except those already rendered by Mapnik. I
looked at osm-labes-de and -ch.

1. Can you give my an example Permalink?

2. Then I encountered a JavaScript problem (some CPU consuming endless
loop) when trying to click and launch a Permalink.

3. And the Peramlikn look like it has an endless layers parameter, like this:

http://toolserver.org/~osm/locale/?zoom=9lat=48.67146lon=9.1214layers=BFTTF

Yours, S.


2010/6/16 Peter Körner osm-li...@mazdermind.de:
 In a attempt to reactivate the Multilingual Maps Project, I started a
 testcase with language overlays instead of complete language
 maps. This should save a lot of RAM (loading all 270+ map styles took
 ~16GB of Memory only for renderd).

 It's still rendering the low-zoom tiles so it is very slow. I also
 activated only three language overlays to test the setup but the other
 stlye-files are already in place and will be activated one after another.

 So feel free to play around and give comments:
 http://toolserver.org/~osm/locale/

 Peter

 ___
 dev mailing list
 dev@openstreetmap.org
 http://lists.openstreetmap.org/listinfo/dev


___
dev mailing list
dev@openstreetmap.org
http://lists.openstreetmap.org/listinfo/dev


Re: [OSM-dev] Multilingual Maps Overlays

2010-11-02 Thread Andy Allan
On Mon, Jun 21, 2010 at 9:09 AM, Claudius claudiu...@gmx.de wrote:

 Now I recall where I see the problem with a fallback rule like

 de: name:de, name:en, name:fr, name

 If you look at Germany in the OSM db most of the placenames just have
 the german name in the name-tag but don't reproduce the redundant
 information in name:de. If you would take this example node:

 place=city
 name=München
 name:en=Munich

 the above rule would lead to the english name being shown on the german
 name overlay. So the fallback needs to be location aware and should
 probably not trigger in Germany, Austria and Switzerland.

Yeah, that's actually a bigger problem with the way we're tagging. I
get a slightly bizarre experience using nominatim - if I search for
United Kingdom the first result is Royaume Uni, if I search for
Scotland it results in Schottland. In both cases this is because
nominatim is picking up my browser language preferences - there's no
name:en on either so it falls back to name:de, name:fr or name:es -
and only if all those tags are missing from an object will it show me
the english name for things in the UK/USA/Canada.

Which is understandable, but seems bizarre to most people.

Cheers,
Andy

___
dev mailing list
dev@openstreetmap.org
http://lists.openstreetmap.org/listinfo/dev


Re: [OSM-dev] Multilingual Maps Overlays

2010-11-02 Thread Peter Körner

Am 02.11.2010 11:52, schrieb Stefan Keller:

Hi

Nice idea.

I don't see any labels except those already rendered by Mapnik. I
looked at osm-labes-de and -ch.
That's just because our tile server is very busy rendering those 
overlays. They are very young and most files below z0-6 have not been 
rendered yet.



1. Can you give my an example Permalink?
2. Then I encountered a JavaScript problem (some CPU consuming endless
loop) when trying to click and launch a Permalink.
3. And the Peramlikn look like it has an endless layers parameter, like this:


I guess that's all one single problem. Does sb. have an idea how get the 
permalink smaller? osm.org is using some layerCode parameter but I 
can't find it in the openlayers docs.


Peter

___
dev mailing list
dev@openstreetmap.org
http://lists.openstreetmap.org/listinfo/dev


Re: [OSM-dev] Nominatim down

2010-11-02 Thread Emilie Laffray
On 2 November 2010 10:44, Peter Körner osm-li...@mazdermind.de wrote:

 Hi all

 it seems, that nominatim is down:
 http://downforeveryoneorjustme.com/nominatim.openstreetmap.org

 I updated the wiki status page:
 http://wiki.openstreetmap.org/wiki/Platform_Status



I just talked to the admins about it. The machine hosting nominatim is
currently down due to an upgrade that failed (Operating system). The
nominatim service on the main site is still working fine though as it is
making use of the mapquest server now.

Emilie Laffray
___
dev mailing list
dev@openstreetmap.org
http://lists.openstreetmap.org/listinfo/dev


Re: [Potlatch-dev] Removing a way from a relation

2010-11-02 Thread Andy Allan
On Mon, Nov 1, 2010 at 10:21 PM, NopMap ekkeh...@gmx.de wrote:


 Richard Fairhurst wrote:

 Just fixed that in r23987 (which will make its way to the various
 deployments in due course). You now get a little 'x' button in the route
 'icon'.


 I guess there's still no way to check wich build a .swf is from.

Nope, but sorting out the build numbers (in a way that's fully
compatible with devs like me who run git-svn) is one of my top 2 todos
(the other is duplicate node highlighting).

Cheers,
Andy

___
Potlatch-dev mailing list
potlatch-...@openstreetmap.org
http://lists.openstreetmap.org/listinfo/potlatch-dev


[OSM-dev] OSM XMl Code snippets...where?

2010-11-02 Thread Matthias Meißer

Hi,

I knew that I saw a bunch of ready to use code for parsing OSM XML 
somewhere in the wiki...does anybody knew where?


I'd like to pin it at the Software page

regards
Matthias

___
dev mailing list
dev@openstreetmap.org
http://lists.openstreetmap.org/listinfo/dev


Re: [OSM-dev] PBF parsing frontend for osm2pgsql, tester wanted

2010-11-02 Thread Sven Geggus
Jon Burgess jburgess...@gmail.com wrote:

 Does protobuc-c exist or is this a typo?

The package is called libprotobuf-c0-dev (in Debian/unstable).

 protobuc-c = 0.14: no

The reason for this check is that it does not seem to work with Version 0.12
which is the default protobuc-c Version in Debian testing.

Sven

-- 
We just typed make
(Stephen Lambrigh, Director of Server Product Marketing at Informix
  about porting their Database to Linux)
/me is gig...@ircnet, http://sven.gegg.us/ on the Web

___
dev mailing list
dev@openstreetmap.org
http://lists.openstreetmap.org/listinfo/dev


Re: [OSM-dev] PBF parsing frontend for osm2pgsql, tester wanted

2010-11-02 Thread Peter Körner

Am 02.11.2010 14:55, schrieb Sven Geggus:

Jon Burgessjburgess...@gmail.com  wrote:


Does protobuc-c exist or is this a typo?


The package is called libprotobuf-c0-dev (in Debian/unstable).


protobuc-c= 0.14: no


The reason for this check is that it does not seem to work with Version 0.12
which is the default protobuc-c Version in Debian testing.


Is it really protobuc or is it protobuf?

Peter

___
dev mailing list
dev@openstreetmap.org
http://lists.openstreetmap.org/listinfo/dev


Re: [OSM-dev] PBF parsing frontend for osm2pgsql, tester wanted

2010-11-02 Thread Sven Geggus
Peter Körner osm-li...@mazdermind.de wrote:

 The reason for this check is that it does not seem to work with Version 0.12
 which is the default protobuc-c Version in Debian testing.
 
 Is it really protobuc or is it protobuf?

f not c. Cut and paste problem on my side.

Problem has been corrected in Hartmuts Version 0.70.4

Sven

-- 
I'm a bastard, and proud of it
  (Linus Torvalds, Wednesday Sep 6, 2000)

/me is gig...@ircnet, http://sven.gegg.us/ on the Web

___
dev mailing list
dev@openstreetmap.org
http://lists.openstreetmap.org/listinfo/dev


Re: [OSM-dev] PBF parsing frontend for osm2pgsql, tester wanted

2010-11-02 Thread Jon Burgess
On Tue, 2010-11-02 at 08:02 +0100, Hartmut Holzgraefe wrote:
 thanks for spotting, looks as if i deleted two lines instead of one
 when removing some unused variable declarations to silence
 warnings :(
 
 fixed, committed, pushed, and a new patch level tarball created:
 
 http://php-baustelle.de/osm2pgsql-0.70.4.tar.gz
 

When do you think the code will be ready to merge? 

There are a couple of other things I'd like to fix up and it may make
more sense to do that directly in SVN instead of bouncing patches via
the mailing list.

- Make the code automatically switch to .pbf mode if the filename has
that extension.
- Add PTHREAD to the configure scripts, several bits of the code already
look for HAVE_PTHREAD and will use multiple threads in a few places
- Move inputUTF8() to parse-xml2.c
- There are memory leaks in a couple of places
- I think there are some problems with the PBF tag handling, it seems to
call resetList((osmdata-tags)) in the wrong place in a few cases. It
should be looking at osmdata-extra_attributes to determine whether to
append the uid/version/timestamp tags from the node  way info.

The pthread change is the only real regression in the code, the Makefile
used to set it unconditionally. All the other issues are specific to the
PBF mode which people should probably expect to have a few minor issues.
I don't see this should be a blocker on merging the changes.

  Jon



___
dev mailing list
dev@openstreetmap.org
http://lists.openstreetmap.org/listinfo/dev


[OSM-dev] OSM Mapnik Fonts are Nonsense

2010-11-02 Thread maw269
I am having issues rendering non-English Alphabet fonts from Mapnik for an  
OSM world map tile server I am creating. I've done the research to no  
avail. I must be missing something. I am using Mapnik 0.7.1 on windows  
server 2008.


1. I have created a myOSM.xml stylesheet from the osm.xml template using:

generate_xml.py osm.xml myOSM.xml --dbname osm_planet --accept-none  
--password pw --host localhost --port 5432 --user postgres


2. After creating the xml I then downloaded the Winzip unifont archive for  
Mac and Windows from http://unifoundry.com/unifont.html  
(http://unifoundry.com/unifont-5.1.20080907.zip ).


3. I uzipped this to:

C:\mapnik-0.7.1\lib\mapnik\fonts

4. I then went to C:\mapnik-0.7.1\inc\fontset-settings.xml.inc and  
uncommented the unifont lines as such:


!--Settings for Mapnik Fonts
Uncomment the unifont entries if you have that font installed
in your mapnik fonts dir, and want to use it as a fallback font.
Mapnik includes this font by default since r1328.
To see the fonts you have installed with Mapnik do:
ls `python -c import mapnik;print mapnik.fontscollectionpath`--

FontSet name=book-fonts
Font face_name=DejaVu Sans Book /
Font face_name=unifont Medium /
/FontSet
FontSet name=bold-fonts
Font face_name=DejaVu Sans Bold /
Font face_name=unifont Medium /
/FontSet
FontSet name=oblique-fonts
Font face_name=DejaVu Sans Oblique /
Font face_name=unifont Medium /
/FontSet

5. I then opened the myOSM.xml and noticed that it only had listed the  
DejaVu fonts at the top. I then added the unifonts as such:


?xml version=1.0 encoding=utf-8?
Map srs=+proj=merc +a=6378137 +b=6378137 +lat_ts=0.0 +lon_0=0.0 +x_0=0.0  
+y_0=0 +k=1.0 +units=m +nadgri...@null +no_defs +over  
bgcolor=rgb(181,208,208)

FontSet name=book-fonts
Font face_name=DejaVu Sans Book /
Font face_name=unifont Medium /
/FontSet
FontSet name=bold-fonts
Font face_name=DejaVu Sans Bold /
Font face_name=unifont Medium /
/FontSet
FontSet name=oblique-fonts
Font face_name=DejaVu Sans Oblique /
Font face_name=unifont Medium /
/FontSet

6. I then ran the following from the command prompt as suggested in  
http://sajjad.in/mapping/setting-up-mapnik-for-rendering-tiles-in-your-language/:


python

from mapnik import *
for face in FontEngine.face_names(): print face

… [Enter]

It listed the 'unifont Medium' so I figured I was good to go.

7. I started to create tiles for the world using generate_tiles.py

All the letters in Eastern Europe, Asia, the Middle East, North Africa and  
similar areas that don't use the english alphabet, are nonsense.

See http://d.imagehost.org/0402/OSM.png

Can someone please help me?
___
dev mailing list
dev@openstreetmap.org
http://lists.openstreetmap.org/listinfo/dev


[OSM-dev] Mapnik/Python keeps crashing

2010-11-02 Thread Matthew Wechsler
I am having issues rendering tiles from Mapnik for an OSM world map
tile server I am creating. I am using Mapnik 0.7.1 on Windows Server
2008 1TB Raid5.
When I use generate_tiles.py everything starts out ok but then after a
few minutes it keeps crashing.

Here is the command line output:

Exception in thread Thread-3:
Traceback (most recent call last):
  File C:\Python25\lib\threading.py, line 486, in __bootstrap_inner
self.run()
  File C:\Python25\lib\threading.py, line 446, in run
self.__target(*self.__args, **self.__kwargs)
  File C:\mapnik-0.7.1\generate_tiles_planet.py, line 109, in loop
self.render_tile(tile_uri, x, y, z)
  File C:\mapnik-0.7.1\generate_tiles_planet.py, line 91, in render_tile
mapnik.render(self.m, im)
RuntimeError: PSQL error
Full sql was: 'SELECT AsBinary(way) AS geom from
  (select way from planet_osm_line where route='ferry' ) as routes
   WHERE way  SetSRID('BOX3D(1721973.37320845
-8609866.866042253,2348145.508920615 -7983694.730330086)'::box3d,
900913)'


Exception in thread Thread-4:
Traceback (most recent call last):
  File C:\Python25\lib\threading.py, line 486, in __bootstrap_inner
self.run()
  File C:\Python25\lib\threading.py, line 446, in run
self.__target(*self.__args, **self.__kwargs)
  File C:\mapnik-0.7.1\generate_tiles_planet.py, line 109, in loop
self.render_tile(tile_uri, x, y, z)
  File C:\mapnik-0.7.1\generate_tiles_planet.py, line 91, in render_tile
mapnik.render(self.m, im)
RuntimeError: PSQL error
Full sql was: 'SELECT AsBinary(way) AS geom,highway,railway from
  (select way,highway,railway,
   case when tunnel in ('yes','true','1') then 'yes'::text else
tunnel end as tunnel
   from planet_osm_roads
   where highway is not null
  or railway is not null
   order by z_order
  ) as roads
   WHERE way  SetSRID('BOX3D(1721973.373208451
-8296780.798186168,2348145.508920614 -7670608.662474006)'::box3d,
900913)'



Here is the Python.exe crash message box:

Problem signature:
  Problem Event Name:   APPCRASH
  Application Name: python.exe
  Application Version:  0.0.0.0
  Application Timestamp:4950f175
  Fault Module Name:postgis.input
  Fault Module Version: 0.0.0.0
  Fault Module Timestamp:   4ba7b361
  Exception Code:   c005
  Exception Offset: 0001a03e
  OS Version:   6.1.7600.2.0.0.274.10
  Locale ID:1033
  Additional Information 1: 1ec0
  Additional Information 2: 1ec0fd70d07d060e5bfcf53c69ad1739
  Additional Information 3: 3040
  Additional Information 4: 30403390ed20f1b32c61f314c386b874

Read our privacy statement online:
  http://go.microsoft.com/fwlink/?linkid=104288clcid=0x0409

If the online privacy statement is not available, please read our
privacy statement offline:
  C:\Windows\system32\en-US\erofflps.txt

Any ideas?

___
dev mailing list
dev@openstreetmap.org
http://lists.openstreetmap.org/listinfo/dev


Re: [OSM-dev] OSM Mapnik Fonts are Nonsense

2010-11-02 Thread Jon Burgess
On Tue, 2010-11-02 at 21:14 +, maw...@gmail.com wrote:
 All the letters in Eastern Europe, Asia, the Middle East, North Africa
 and similar areas that don't use the english alphabet, are nonsense. 
 See http://d.imagehost.org/0402/OSM.png 
 
 Can someone please help me? 

That looks quite broken but I'm not convinced the issue is with Mapnik
itself. Are you sure that the data was imported into postgres using a
UTF8 database?

gis= \l
  List of databases
   Name|  Owner   | Encoding |  Collation  |Ctype|   Access 
privileges   
---+--+--+-+-+---
 gis   | owner| UTF8 | en_GB.UTF-8 | en_GB.UTF-8 | 


Try reading one of the names which appears broken:

gis= select name from planet_osm_point where name like 'Tchad%' limit 1;
name

 Tchad تشاد



   Jon



___
dev mailing list
dev@openstreetmap.org
http://lists.openstreetmap.org/listinfo/dev


Re: [OSM-dev] Mapnik/Python keeps crashing

2010-11-02 Thread Jon Burgess
On Tue, 2010-11-02 at 17:23 -0400, Matthew Wechsler wrote:
 I am having issues rendering tiles from Mapnik for an OSM world map
 tile server I am creating. I am using Mapnik 0.7.1 on Windows Server
 2008 1TB Raid5.
 When I use generate_tiles.py everything starts out ok but then after a
 few minutes it keeps crashing.
 
 Here is the command line output:
 
 Exception in thread Thread-3:
 Traceback (most recent call last):
   File C:\Python25\lib\threading.py, line 486, in __bootstrap_inner
 self.run()
   File C:\Python25\lib\threading.py, line 446, in run
 self.__target(*self.__args, **self.__kwargs)
   File C:\mapnik-0.7.1\generate_tiles_planet.py, line 109, in loop
 self.render_tile(tile_uri, x, y, z)
   File C:\mapnik-0.7.1\generate_tiles_planet.py, line 91, in render_tile
 mapnik.render(self.m, im)
 RuntimeError: PSQL error
 Full sql was: 'SELECT AsBinary(way) AS geom from
   (select way from planet_osm_line where route='ferry' ) as routes
WHERE way  SetSRID('BOX3D(1721973.37320845
 -8609866.866042253,2348145.508920615 -7983694.730330086)'::box3d,
 900913)'

 Any ideas?

I think multi-threading problems on Windows have been reported before
but no one has been in a position to debug the exact cause. 

I recently received a modified version of the generate_tiles.py script
contributed by Bertrand Gervais which uses the python multiprocess
module which should avoid any threading issues. I have just added this
into SVN:

http://trac.openstreetmap.org/browser/applications/rendering/mapnik/generate_tiles_multiprocess.py

Could you give this a try?

Jon



___
dev mailing list
dev@openstreetmap.org
http://lists.openstreetmap.org/listinfo/dev


Re: [OSM-dev] OSM Mapnik Fonts are Nonsense

2010-11-02 Thread Jon Burgess
On Tue, 2010-11-02 at 21:35 +, Jon Burgess wrote:
 On Tue, 2010-11-02 at 21:14 +, maw...@gmail.com wrote:
  All the letters in Eastern Europe, Asia, the Middle East, North Africa
  and similar areas that don't use the english alphabet, are nonsense. 
  See http://d.imagehost.org/0402/OSM.png 
  
  Can someone please help me? 
 
 That looks quite broken but I'm not convinced the issue is with Mapnik
 itself. Are you sure that the data was imported into postgres using a
 UTF8 database?
 
 gis= \l
   List of databases
Name|  Owner   | Encoding |  Collation  |Ctype|   Access 
 privileges   
 ---+--+--+-+-+---
  gis   | owner| UTF8 | en_GB.UTF-8 | en_GB.UTF-8 | 
 
 
 Try reading one of the names which appears broken:
 
 gis= select name from planet_osm_point where name like 'Tchad%' limit 1;
 name
 
  Tchad تشاد

On second thoughts, there are several entries in the table which match
that and you might not get to see the right one. Either drop the 'limit
1' or try:

gis= select name from planet_osm_point where name like 'Tchad%' and 
place='country';
name

 Tchad تشاد

You might also want to verify that your client connection also uses
UTF8:

gis= show client_encoding;
 client_encoding 
-
 UTF8


Jon



___
dev mailing list
dev@openstreetmap.org
http://lists.openstreetmap.org/listinfo/dev


Re: [OSM-dev] OSM Mapnik Fonts are Nonsense

2010-11-02 Thread Lennard

On 2-11-2010 22:14, maw...@gmail.com wrote:


1. I have created a myOSM.xml stylesheet from the osm.xml template using:

generate_xml.py osm.xml myOSM.xml --dbname osm_planet --accept-none
--password pw --host localhost --port 5432 --user postgres


There is usually no need to generate a local copy of the osm.xml 
stylesheet. Generating a local copy includes all files from the inc/ 
directory into a single (monolithic) stylesheet file, but also means 
that every time that we update the stylesheet in svn, you have to rerun 
generate_xml.py in this way.


If you omit the osm.xml myOSM.xml part from your generate_xml.py call, 
it will only create 3 files in the inc/ directory based on the .template 
files there. You then point your tile generating script to osm.xml as 
the stylesheet. Updating the stylesheet is then also as easy as running 
svn up.


Did you read somewhere that you had to generate a local copy? Earlier 
versions of the most-used blog about setting up a mapnik rendering stack 
(hi rweait! :)) told you to do that, but I think that got corrected 
after pointing this out.



4. I then went to C:\mapnik-0.7.1\inc\fontset-settings.xml.inc and
uncommented the unifont lines as such:


That's fine.


5. I then opened the myOSM.xml and noticed that it only had listed the
DejaVu fonts at the top. I then added the unifonts as such:


And that's not surprising, for the reason I already mentioned: you 
generated a single file based on osm.xml and everything in inc/, and any 
changes you made after generate_xml.py didn't make it into your myOSM.xml.


--
Lennard

___
dev mailing list
dev@openstreetmap.org
http://lists.openstreetmap.org/listinfo/dev


Re: [OSM-dev] Mod_tile - apache 404 - no tiles please help

2010-11-02 Thread Jon Burgess
On Fri, 2010-10-29 at 06:26 -0700, NicoG wrote:
 Hi everyone,
 
 i'm setting up a local OSM server on a Debian Lenny 32bit for 3 days, and
 now i need some help with mod_tile ;)
 
 I've installed the postgresql database, postgis, osm2pgsql and mapnik tools
 correctly (i think :)
 generate_image.py works well, i can generate static png without problems !
 
 Now i'm trying to set up Mod_tile for rendering and thats a curse for me !
 (i'm not a linux professional).
 

See some of the comments in-line below...

 i get mod_tile from SVN ;
 This is how i've setup mod_tile and apache (long list but complete)
 
 -
 MOD TILE
 Makefile
 top_dir:=$(shell /usr/bin/apxs2 -q exp_installbuilddir) 
 APXS = apxs2
 -
 render_config.h
 #define HASH_PATH var/lib/mod_tile

Should that be:

#define HASH_PATH /var/lib/mod_tile

 #define TILE_PATH /var/www/osm_tiles2

This path should only get used if you have unset '#define
DIRECTORY_HASH' which you don't mention. Are you using the directory
hashing?

 #define RENDERD_CONFIG /etc/renderd.conf
 #define MAPNIK_PLUGINS /usr/local/lib/mapnik/input
 #define FONT_DIR /usr/share/fonts/truetype/ttf-dejavu/
 #define FONT_RECURSE 1
 -
 renderd.conf (the one in mod_tile folder)
 [renderd]
 socketname=/var/run/renderd/renderd.sock
 num_threads=2
 tile_dir=/var/lib/mod_tile ; DOES NOT WORK YET
 stats_file=/var/run/renderd/renderd.stats
 
 [mapnik]
 plugins_dir=/usr/local/lib/mapnik/input
 font_dir=/usr/local/lib/mapnik/fonts
 font_dir_recurse=1
 
 [default]
 URI=/osm_tiles2/
 XML=/root/travaux/osm-mapnik/osm.xml
 HOST=geolocalisation.renater.fr
 ;HTCPHOST=proxy.openstreetmap.org
 
 ---
 
 i've done make, make install
 
 the /etc/renderd.conf look like the one above
 
 ---
 APACHE : 
 in /etc/apache2/mods_available i have a file mod_tile.load with this line :
 LoadModule tile_module /usr/lib/apache2/modules/mod_tile.so
 
 and i've loaded it : a2enmod mod_tile
 
 in /etc/apache2:site_available i have a site 'osm' with this lines:
 DocumentRoot /var/www
 AddTileConfig /osm_tiles2/ default
 LoadTileConfigFile /etc/renderd.conf
 ModTileTileDir /var/lib/mod_tile
 ModTileRenderdSocketName /var/run/renderd/renderd.sock
 
 the module is loaded successfully with apache (apache2ctl -t -D
 DUMP_MODULES) 
 the socket file /var/run/renderd/renderd.sock exist.

Are you certain the apache user (often apache or www-data depending on
your OS) has write access to this file, try:

$ sudo -u www-data ls -l /var/run/renderd/renderd.sock

If you have SELinux enabled then this also prevents the apache process
from connecting to a socket. You may find errors being reported in your
Apache error_log file. If you enable the informational logging in Apache
then you should see more output from the module as it processes the
incoming requests.


 ---
 RENDER DEAMON 
 when i launch the render deamon :  ./renderd -f
 
 renderd[5948]: Rendering daemon started
 renderd[5948]: Parsing section renderd
 renderd[5948]: Parsing render section 0
 renderd[5948]: Parsing section mapnik
 renderd[5948]: Parsing section default
 renderd[5948]: config renderd: unix socketname=/var/run/renderd/renderd.sock
 renderd[5948]: config renderd: num_threads=2
 renderd[5948]: config renderd: num_slaves=0
 renderd[5948]: config renderd: tile_dir=/var/lib/mod_tile/
 renderd[5948]: config renderd: stats_file=(null)
 renderd[5948]: config mapnik:  plugins_dir=/usr/local/lib/mapnik/input
 renderd[5948]: config mapnik: 
 font_dir=/usr/share/fonts/truetype/ttf-dejavu/
 renderd[5948]: config mapnik:  font_dir_recurse=1
 renderd[5948]: config renderd(0): Active
 renderd[5948]: config renderd(0): unix
 socketname=/var/run/renderd/renderd.sock
 renderd[5948]: config renderd(0): num_threads=2
 renderd[5948]: config renderd(0): tile_dir=/var/lib/mod_tile/
 renderd[5948]: config renderd(0): stats_file=(null)
 renderd[5948]: config map 0:   name(default)
 file(/root/travaux/osm/osm-mapnik/osm.xml) uri(/osm_tiles2/) htcp()
 host(geolocalisation.renater.fr)
 renderd[5948]: Initialising unix server socket on
 /var/run/renderd/renderd.sock
 renderd[5948]: Created server socket 4

 
 
 Nothing happends in the deamon when i'm trying to access at
 http://localhost/osm_tiles2/0/1/2.png
 
 did i forget something ? thx you for your help
 
 Nicolas

The renderd output looks OK.

You could also see if the module responds to status requests via the
URL: http://localhost/mod_tile

If it works then you should see some output about the number of requests
it has processed:

NoResp200: 38408489
NoResp304: 1574321
NoResp404: 4257
...

   Jon




___
dev mailing list
dev@openstreetmap.org
http://lists.openstreetmap.org/listinfo/dev


Re: [OSM-dev] OSM Mapnik Fonts are Nonsense

2010-11-02 Thread Peter Körner



Am 02.11.2010 22:35, schrieb Jon Burgess:

On Tue, 2010-11-02 at 21:14 +, maw...@gmail.com wrote:

All the letters in Eastern Europe, Asia, the Middle East, North Africa
and similar areas that don't use the english alphabet, are nonsense.
See http://d.imagehost.org/0402/OSM.png

Can someone please help me?


That looks quite broken but I'm not convinced the issue is with Mapnik
itself. Are you sure that the data was imported into postgres using a
UTF8 database?


This is not necessary. On ptolemy, the wikimedia toolserver I missed to 
create the table as UTF8 and we have multilingual rendering nevertheless:


http://toolserver.org/~osm/locale/?locale=ar
http://toolserver.org/~osm/locale/?locale=zh
http://toolserver.org/~osm/locale/?locale=el
http://toolserver.org/~osm/locale/?locale=ru


maz...@ptolemy:~$ psql -h sql-mapnik -d osm_mapnik
Welcome to psql 8.3.11, the PostgreSQL interactive terminal.

Type:  \copyright for distribution terms
   \h for help with SQL commands
   \? for help with psql commands
   \g or terminate with semicolon to execute query
   \q to quit

osm_mapnik= \l
 List of databases
Name|  Owner   | Encoding
+--+---
 osm_api| osm  | SQL_ASCII
 osm_mapnik | osm  | SQL_ASCII
 postgres   | postgres | SQL_ASCII
 template0  | postgres | SQL_ASCII
 template1  | postgres | SQL_ASCII
 u_kolossos | kolossos | SQL_ASCII
(6 rows)



___
dev mailing list
dev@openstreetmap.org
http://lists.openstreetmap.org/listinfo/dev


Re: [OSM-dev] OSM Mapnik Fonts are Nonsense

2010-11-02 Thread Jon Burgess
On Tue, 2010-11-02 at 23:26 +0100, Peter Körner wrote:
 
 Am 02.11.2010 22:35, schrieb Jon Burgess:
  On Tue, 2010-11-02 at 21:14 +, maw...@gmail.com wrote:
  All the letters in Eastern Europe, Asia, the Middle East, North Africa
  and similar areas that don't use the english alphabet, are nonsense.
  See http://d.imagehost.org/0402/OSM.png
 
  Can someone please help me?
 
  That looks quite broken but I'm not convinced the issue is with Mapnik
  itself. Are you sure that the data was imported into postgres using a
  UTF8 database?
 
 This is not necessary. On ptolemy, the wikimedia toolserver I missed to 
 create the table as UTF8 and we have multilingual rendering nevertheless:
 
 http://toolserver.org/~osm/locale/?locale=ar
 http://toolserver.org/~osm/locale/?locale=zh
 http://toolserver.org/~osm/locale/?locale=el
 http://toolserver.org/~osm/locale/?locale=ru
 
 
 maz...@ptolemy:~$ psql -h sql-mapnik -d osm_mapnik
 Welcome to psql 8.3.11, the PostgreSQL interactive terminal.
 
 Type:  \copyright for distribution terms
 \h for help with SQL commands
 \? for help with psql commands
 \g or terminate with semicolon to execute query
 \q to quit
 
 osm_mapnik= \l
   List of databases
  Name|  Owner   | Encoding
 +--+---
   osm_api| osm  | SQL_ASCII
   osm_mapnik | osm  | SQL_ASCII
   postgres   | postgres | SQL_ASCII
   template0  | postgres | SQL_ASCII
   template1  | postgres | SQL_ASCII
   u_kolossos | kolossos | SQL_ASCII
 (6 rows)

Have you tried any other settings? I suspect that many other common
encodings will not work so well (LATIN1, WIN1252 etc). We know UTF8
works and that is what we recommend everyone should use.

  Jon




___
dev mailing list
dev@openstreetmap.org
http://lists.openstreetmap.org/listinfo/dev


Re: [OSM-dev] OSM Mapnik Fonts are Nonsense

2010-11-02 Thread Peter Körner

Am 02.11.2010 23:44, schrieb Jon Burgess:

Have you tried any other settings? I suspect that many other common
encodings will not work so well (LATIN1, WIN1252 etc). We know UTF8
works and that is what we recommend everyone should use.


No I didn't and I would advise everyone to creaate a new database with 
-E UTF-8 but now that the database is up and running, I don't know a way 
to change this without dropping and re-importing.


Peter

___
dev mailing list
dev@openstreetmap.org
http://lists.openstreetmap.org/listinfo/dev


Re: [OSM-dev] OSM Mapnik Fonts are Nonsense

2010-11-02 Thread maw269

  All the letters in Eastern Europe, Asia, the Middle East, North Africa
  and similar areas that don't use the english alphabet, are nonsense.
  See http://d.imagehost.org/0402/OSM.png
  Can someone please help me?



On second thoughts, there are several entries in the table which match
that and you might not get to see the right one. Either drop the 'limit
1' or try:


gis= select name from planet_osm_point where name like 'Tchad%' and  
place='country';

name

Tchad تشاد
You might also want to verify that your client connection also uses
UTF8:



gis= show client_encoding;
client_encoding
-
UTF8
Jon


I executed the select name from planet_osm_point where name like 'Tchad%'  
and place='country'; query and the result look similar to what I was  
getting on my map.


See result here: http://b.imagehost.org/0738/Chad.jpg

I also executed the show client_encoding; query and the result I got back  
was UNICODE


Could this be my issue?
___
dev mailing list
dev@openstreetmap.org
http://lists.openstreetmap.org/listinfo/dev


Re: [OSM-dev] PBF parsing frontend for osm2pgsql, tester wanted

2010-11-02 Thread Hartmut Holzgraefe

On 11/02/2010 10:07 PM, Jon Burgess wrote:

When do you think the code will be ready to merge?



There are a couple of other things I'd like to fix up and it may make
more sense to do that directly in SVN instead of bouncing patches via
the mailing list.

- Make the code automatically switch to .pbf mode if the filename has
that extension.



- Add PTHREAD to the configure scripts, several bits of the code already
look for HAVE_PTHREAD and will use multiple threads in a few places


fixed in the bzr tree


- Move inputUTF8() to parse-xml2.c


why not keep that in its own file?


- There are memory leaks in a couple of places



- I think there are some problems with the PBF tag handling, it seems to
call resetList((osmdata-tags)) in the wrong place in a few cases.


indeed ... moved it up to the beginning of the iteration loops now


It
should be looking at osmdata-extra_attributes to determine whether to
append the uid/version/timestamp tags from the node  way info.


right ... and fixed


The pthread change is the only real regression in the code, the Makefile
used to set it unconditionally. All the other issues are specific to the
PBF mode which people should probably expect to have a few minor issues.
I don't see this should be a blocker on merging the changes.


let me sleep over it ...

--
hartmut

___
dev mailing list
dev@openstreetmap.org
http://lists.openstreetmap.org/listinfo/dev


Re: [OSM-dev] OSM Mapnik Fonts are Nonsense

2010-11-02 Thread Jon Burgess
On Tue, 2010-11-02 at 23:47 +0100, Peter Körner wrote:
 Am 02.11.2010 23:44, schrieb Jon Burgess:
  Have you tried any other settings? I suspect that many other common
  encodings will not work so well (LATIN1, WIN1252 etc). We know UTF8
  works and that is what we recommend everyone should use.
 
 No I didn't and I would advise everyone to creaate a new database with 
 -E UTF-8 but now that the database is up and running, I don't know a way 
 to change this without dropping and re-importing.

If the database cluster was initialized with a localized encoding when
initdb was run then you may not even be able to choose a different
encoding by creating a new DB:

An important restriction, however, is that each database's character
set must be compatible with the database's LC_CTYPE and LC_COLLATE
locale settings. For C or POSIX locale, any character set is allowed,
but for other locales there is only one character set that will work
correctly. (On Windows, however, UTF-8 encoding can be used with any
locale.)

http://www.postgresql.org/docs/8.4/static/multibyte.html

   Jon



___
dev mailing list
dev@openstreetmap.org
http://lists.openstreetmap.org/listinfo/dev


Re: [OSM-dev] OSM Mapnik Fonts are Nonsense

2010-11-02 Thread Peter Körner



See result here: http://b.imagehost.org/0738/Chad.jpg

Could this be my issue?


So it seems your rendering is fine but your database is messed up. It 
may be worth trying with some small data extract [1] and juggling with 
osm2pgsql and createdb arguments.


Peter

[1] http://download.geofabrik.de/osm/
http://downloads.cloudmade.com/

___
dev mailing list
dev@openstreetmap.org
http://lists.openstreetmap.org/listinfo/dev


Re: [OSM-dev] Mapnik/Python keeps crashing

2010-11-02 Thread maw269

 I am having issues rendering tiles from Mapnik for an OSM world map
 tile server I am creating. I am using Mapnik 0.7.1 on Windows Server
 2008 1TB Raid5.
 When I use generate_tiles.py everything starts out ok but then after a
 few minutes it keeps crashing.

 Here is the command line output:

 Exception in thread Thread-3:
 Traceback (most recent call last):
 File C:\Python25\lib\threading.py, line 486, in __bootstrap_inner
 self.run()
 File C:\Python25\lib\threading.py, line 446, in run
 self.__target(*self.__args, **self.__kwargs)
 File C:\mapnik-0.7.1\generate_tiles_planet.py, line 109, in loop
 self.render_tile(tile_uri, x, y, z)
 File C:\mapnik-0.7.1\generate_tiles_planet.py, line 91, in render_tile
 mapnik.render(self.m, im)
 RuntimeError: PSQL error
 Full sql was: 'SELECT AsBinary(way) AS geom from
 (select way from planet_osm_line where route='ferry' ) as routes
 WHERE way  SetSRID('BOX3D(1721973.37320845
 -8609866.866042253,2348145.508920615 -7983694.730330086)'::box3d,
 900913)'
 Any ideas?



I think multi-threading problems on Windows have been reported before
but no one has been in a position to debug the exact cause.
I recently received a modified version of the generate_tiles.py script
contributed by Bertrand Gervais which uses the python multiprocess
module which should avoid any threading issues. I have just added this
into SVN:
http://trac.openstreetmap.org/browser/applications/rendering/mapnik/generate_tiles_multiprocess.py



Could you give this a try?



Jon



Thanks Jon. I have been rendering tiles now for the past hour or so with no  
interuption. It seems that after I got into zoom level 8 or so, the  
crashing ceased. However, as you have seen in my other thread regarding my  
OSM map label nonsense, I will inevitably have to recreate my tiles once I  
figure out why my non english letters are coming out wrong. When I do, I  
will love to try the generate_tiles_multiprocess.py.


Matt
Matt
___
dev mailing list
dev@openstreetmap.org
http://lists.openstreetmap.org/listinfo/dev


Re: [OSM-dev] Multilingual Maps Overlays

2010-11-02 Thread Stefan Keller
Thanks, Peter, for the explanations.

I still have some some problems of understanding the Multilingual Maps
Overlays project goal/idea and implementation:

1. What is the goal of this project/idea? Is it to simply display
alternative name Tags based on language's ISO 639 code?
At least the wiki page is not of much help explaining this:
http://wiki.openstreetmap.org/wiki/Multilingual_names

2. What about names in the local dialect (very important to me)? I'm
thinkin about 'Barça' for Barcelona, Spain, or 'Züri' which is Swiss
German for Zurich, Switzerland). How to tag those? = Something like
'ch' plus a subdomain?

3. Testing: Can you give me any URL as a demonstration and test case
you are using yourself to test the online map at
http://toolserver.org/~osm/locale/ ?

4. Regarding implementation and the layer parameter:

* I would restrict the layers (i.e. the language codes) to be
displayed at once, say three. So the parameter remains short.

* Instead of trying rendering (and preloading) each of the 275
languages as an own, self-contained half-transparent Mapnik tiles, how
about taking the basemap as well as a Web Map Server (like mapserver
or GeoServer) which delivers names as labels dynamically as GeoJSON.

* How to generate, display and control layers for local dialect names
(Barça, Züri)?

Yours, S.

2010/11/2 Peter Körner osm-li...@mazdermind.de:
 Am 02.11.2010 11:52, schrieb Stefan Keller:

 Hi

 Nice idea.

 I don't see any labels except those already rendered by Mapnik. I
 looked at osm-labes-de and -ch.

 That's just because our tile server is very busy rendering those overlays.
 They are very young and most files below z0-6 have not been rendered yet.

 1. Can you give my an example Permalink?
 2. Then I encountered a JavaScript problem (some CPU consuming endless
 loop) when trying to click and launch a Permalink.
 3. And the Peramlikn look like it has an endless layers parameter, like
 this:

 I guess that's all one single problem. Does sb. have an idea how get the
 permalink smaller? osm.org is using some layerCode parameter but I can't
 find it in the openlayers docs.

 Peter


___
dev mailing list
dev@openstreetmap.org
http://lists.openstreetmap.org/listinfo/dev