Jin, okay thanks very much for following through with this info. I'd
recommend you cc yourself on the ticket I originally mentioned (see
below, #581). That way we can track this general issue of
generate_tiles on windows.
Before giving up on windows entirely (I saw your other email
requesting hw spec) you could test running Linux on your windows box.
Virtualbox+ubuntu or the wubi installer are both good options if your
windows machine has a decent amount of memory >=2mb. generate_tiles.py
will run slower because of the filesystem overhead of the vm, but it
should work for you to accomplish your task.
However I should note I'm reponding based solely on your stated goal -
to precache all of osm japan down to z16. Normally it's easier to just
serve dynamically and simply cache on demand. Many of us here can
advise on that approach as well.
Dane
--- \o/ ---
Sent from my phone
On Nov 26, 2010, at 12:33 AM, Jin Kang <[email protected]> wrote:
Hi Dane,
Thanks for your comments and please refer to below.
The problem was in PROJ_LIB's setting. After change the settings
in PROJ_LIB, we were able to run generate_tiles.py. We don't see
any errors but still we cannot see the street name or any
character yet.
Can you give more detail here? So the script continues to run with
no errors and tiles are rendered just without anything but
background color?
JIN: Yes, the script is running without errors. Just background
color without any text data.
We checked the postgres' error log and found following errors. We
kind of suspect that this might be related to the fact that we are
not getting data described above.
2010-11-25 13:00:32 JST LOG: could not receive data from client:
No connection could be made because the target machine actively
refused it.
2010-11-25 13:00:32 JST LOG: unexpected EOF on client connection
Yes, surely the culprit. Surprising this does not halt the script.
Can you google this error a bit? I assume it has to do with
Postgres<-->windows and perhaps there is a solution outside of
Mapnik?
Also did you get this same problem when running the multiprocess
version of generate_tiles?
JIN: Yes, this happens with multiprocess as well. Regarding to
database connection, psql and pgAdmin can connect fine and firewall
is turned off.
Kind regards,
-Jin
On Nov 26, 2010, at 1:42 PM, Dane Springmeyer wrote:
On Nov 25, 2010, at 12:18 AM, Jin Kang <[email protected]>
wrote:
Hi Dane,
Again thanks much for your comments!
The problem was in PROJ_LIB's setting. After change the settings
in PROJ_LIB, we were able to run generate_tiles.py. We don't see
any errors but still we cannot see the street name or any
character yet.
Can you give more detail here? So the script continues to run with
no errors and tiles are rendered just without anything but
background color?
We checked the postgres' error log and found following errors. We
kind of suspect that this might be related to the fact that we are
not getting data described above.
2010-11-25 13:00:32 JST LOG: could not receive data from client:
No connection could be made because the target machine actively
refused it.
2010-11-25 13:00:32 JST LOG: unexpected EOF on client connection
Yes, surely the culprit. Surprising this does not halt the script.
Can you google this error a bit? I assume it has to do with
Postgres<-->windows and perhaps there is a solution outside of
Mapnik?
Also did you get this same problem when running the multiprocess
version of generate_tiles?
In osm.xm, we setup local database. Is this error familiar to you?
No I've personally never seen it before but I doubt it is uncommon.
If you have any comments from your experience, it will helps us.
Below are our S/W environment:
* PostgreSQL8.4.5/PostGIS1.5,
* Python2.6.6
* mapnik0.7.1
* proj.4.4.6
Regards,
-Jin
On Nov 25, 2010, at 5:13 AM, Dane Springmeyer wrote:
Yes, downloading the proj nad files and setting PROJ_LIB env
setting is the way to solve that error, so all I can say is to
double check your ENV settings.
A workaround is to switch from using the epsg lookup syntax to
+proj literal string in your stylesheet (and perhaps also in the
generate_tiles.py code). This way you bypass the need for proj4
to lookup values in the epsg file.
Dane
--- \o/ ---
Sent from my phone
On Nov 24, 2010, at 4:29 AM, Jin Kang <[email protected]>
wrote:
Hi Dane,
Thank you very much for your help on this! As you suggested, we
ran shapeindex with single thread script (generate_tiles.py) but
we got the following error messages:
proj_init_error:failed to initialize projection with:+init=epsg:
4326
World : 16 58199 25813 Empty Tile
propjr_oijnit_e_rirnoirt:_fearirolre:df atio iled to
initniitailaliizze e projec
The above error might occurred since proj epsg file cannot be
found so we downloaded win32 binary from proj.4 and set the PATH
and PROJ_LIB. However, we are still getting same error message.
The version of proj.4 is 4.4.6. At this point, we are not sure
how to resolve this. If you have previous experience, please
kindly let us know.
Regards,
-Jin
On Nov 23, 2010, at 2:05 AM, Dane Springmeyer wrote:
Hi Jin,
Does the generate_tiles.py script visibly stop at some point?
Is there any error visible in the terminal?
My guess is that you running into a known windows+mapnik
+postgtres problem. Basically that mapnik looses a proper
database connection during tile generation a high zoom levels
because rendering is fast and there is a higher likelyhood of
postgres connections being clobbered. This has been known to
happen on windows when using generate_tiles with threads >= 1 (http://trac.mapnik.org/ticket/581#comment:6
). I see below that you are testing using the multiprocess
script, but I would not be surprised if it is the same problem
manifesting. Can you try with either 1 thread or 1 process?
To narrow this down it would be good to know if you can render
*any* tile at >= z16. One easy way to check with would be to
install TileLite (http://bitbucket.org/springmeyer/tilelite/),
then launch a server on localhost:8000 and try to view a z18
tile, like http://tile.openstreetmap.org/18/232909/103242.png
at http://localhost:8000/18/232909/103242.png.
One last thing to do is rebuilt your shape indexes:
# on windows
cd world_boundaries
shapeindex processed_p
shapeindex shoreline_300
shapeindex 10m-populated-places
shapeindex 110m-admin-0-boundary-lines
Dane
On Nov 21, 2010, at 7:42 PM, Jin Kang wrote:
Hi everyone,
My engineer is trying to do rendering up to level 16 but we
kind of stuck right now. We are pretty new in this application
so if any of you could help us on this, it would be great help
to us. Please refer to below for more detail info.
---
---
---
----------------------------------------------------------------
We would like to do rendering OSM up to zoom level 16 using
mapnik. Right now, we are just focusing on Japanese map only
which you can find at http://www.openstreetmap.jp/.
We also referred to following link but didn't get the expected
result so far.
http://wiki.openstreetmap.org/wiki/Mapnik
http://wiki.openstreetmap.org/wiki/DE:Mapnik
The problem is that we can only render up to zoom level 10,
not 16 and at zoom level 11, we basically cannot see anything.
Even at zoom level 10, we cannot see any data such as street
name, country name or anything.
Regarding OSM, we imported from following link.
http://downloads.cloudmade.com/asia/japan#downloads_breadcrumbs
＊japan.osm.bz2
＊japan.osm.coastline.bz2
＊japan.osm.highway.bz2
We followed following steps:
1. Install PostgreSQL8.4.5/PostGIS1.5, Python2.6.6, mapnik0.7.1
2. Create database
$ createdb -U postgres -E UTF8 -O mapnik gis
3. Run sql
$ psql -U postgres -d gis -f "C:\Program
Files\PostgreSQL\8.4\share\contrib\postgis-1.5\postgis.sql"
$ psql -U postgres -d gis -f "C:\Program
Files\PostgreSQL\8.4\share\contrib
\postgis-1.5\spatial_ref_sys.sql"
$ psql -U postgres -d gis -f "C:\Program
Files\PostgreSQL\8.4\share\contrib\_int.sql"
$ psql -U postgres -d gis -f "C:\Program
Files\PostgreSQL\8.4\share\contrib\hstore.sql"
4. Run osm2pgsql
$ osm2pgsql -c -s -d gis -U postgres -S default.style
japan.osm.bz2
$ osm2pgsql -c -s -d gis -U postgres -S default.style
japan.osm.highway.bz2
$ osm2pgsql -c -s -d gis -U postgres -S default.style
japan.osm.coastline.bz2
$ osm2pgsql -c -s -d gis -U postgres -S default.style
japan.osm.administrative.bz2
5. world_boundaries(in mac)
$ tar xzf world_boundaries-spherical.tgz
$ tar xjf processed_p.tar.bz2 -C world_boundaries
$ tar xjf shoreline_300.tar.bz2 -C world_boundaries
$ unzip 10m-populated-places.zip -d world_boundaries
$ unzip 110m-admin-0-boundary-lines.zip -d world_boundaries
6. Check out mapnik repository
URL: http://svn.openstreetmap.org/applications/rendering/mapnik
7. Create mapnik setup file
$ generate_xml.py osm.xml out.xml --host localhost --user
postgres
--dbname gis --symbols ./symbols/ --world_boundaries ./
world_boundaries/
--port 5432 --password ''
8. Using generate_tiles_multiprocess.py, do rendering
$ set HOME=C:\mapnik-0.7.1\svn\
$ set MAPNIK_MAP_FILE=C:\mapnik-0.7.1\svn\out.xml
$ set MAPNIK_TILE_DIR=C:\mapnik-0.7.1\svn\tiles\
$ generate_tiles_multiprocess.py
The portion we changed to for Japanese map
# zoom level=16- describe Japan
bbox = (112.5,22.0,157.5,55.7)
render_tiles(bbox, mapfile, tile_dir, 16, 16 , "Japan")
# zoom level=10- describe Japan
bbox = (112.5,22.0,157.5,55.7)
render_tiles(bbox, mapfile, tile_dir, 10, 10 , "Japan")
Hardware spec:
PC Spec
CPU：Core2 6700 2.66G
RAM：3G
Hard Disk：256G
OS：Windows XP SP3
_______________________________________________
Mapnik-users mailing list
[email protected]
https://lists.berlios.de/mailman/listinfo/mapnik-users
_______________________________________________
Mapnik-users mailing list
[email protected]
https://lists.berlios.de/mailman/listinfo/mapnik-users
_______________________________________________
Mapnik-users mailing list
[email protected]
https://lists.berlios.de/mailman/listinfo/mapnik-users
