\o/ On Dec 1, 2010, at 5:39 PM, Jin Kang wrote:
> Hi Dane, > > Thank you so much for helping us out! We are now able to render without any > problem. > > Regards, > > -Jin > > On Dec 1, 2010, at 4:04 PM, Dane Springmeyer wrote: > >> Hi Jin, >> >> Thanks for the progress report. You should only need the 'japan.osm.bz2' >> file. I would assume the the other osm.something.bz2 are sub-selections from >> that, so unless you use the --append flag to osm2pgsql each import will >> replace the other (and with --append you would likely get duplicate objects). >> >> Dane >> >> On Nov 30, 2010, at 10:54 PM, Jin Kang wrote: >> >>> Hi Dane, >>> >>> Thanks for your input! Based on your suggestion, we installed virtual box >>> plus ubuntu combination and was able to made some progress. We now don't >>> see any error while rendering but still cannot see the following objects: >>> - building name >>> - river, forest, trees >>> - parking lot, bus mark >>> (arrow is being displayed now) >>> >>> FYI, we are getting data from following link: >>> http://downloads.cloudmade.com/asia/japan#downloads_breadcrumbs >>> >>> and using following 4 files. >>> * japan.osm.administrative.bz2 >>> * japan.osm.bz2 >>> * japan.osm.coastline.bz2 >>> * japan.osm.highway.bz2 >>> >>> Are there other files we need to use? In above link, there are 11 files as >>> below but we are not sure which is additionally needed? If need, we would >>> like to know how we can use those files. >>> japan.ai.zip (503.8M) >>> japan.img.zip (63.1M) >>> japan.navit.bin.zip (171M) >>> japan.osm.administrative.bz2 (72.1M) >>> japan.osm.bz2 (481.6M) >>> japan.osm.coastline.bz2 (46.4M) >>> japan.osm.highway.bz2 (43.1M) >>> japan.poi.gpx.zip (792.9K) >>> japan.poi.tomtom.zip (388.1K) >>> japan.poly (89.2K) >>> japan.shapefiles.zip (151.8M) >>> Thanks much in advance! >>> >>> -Jin >>> >>> >>> On Nov 28, 2010, at 1:55 AM, Dane Springmeyer wrote: >>> >>>> Jin, okay thanks very much for following through with this info. I'd >>>> recommend you cc yourself on the ticket I originally mentioned (see below, >>>> #581). That way we can track this general issue of generate_tiles on >>>> windows. >>>> >>>> Before giving up on windows entirely (I saw your other email requesting hw >>>> spec) you could test running Linux on your windows box. Virtualbox+ubuntu >>>> or the wubi installer are both good options if your windows machine has a >>>> decent amount of memory >=2mb. generate_tiles.py will run slower because >>>> of the filesystem overhead of the vm, but it should work for you to >>>> accomplish your task. >>>> >>>> However I should note I'm reponding based solely on your stated goal - to >>>> precache all of osm japan down to z16. Normally it's easier to just serve >>>> dynamically and simply cache on demand. Many of us here can advise on that >>>> approach as well. >>>> >>>> Dane >>>> >>>> --- \o/ --- >>>> Sent from my phone >>>> >>>> On Nov 26, 2010, at 12:33 AM, Jin Kang <[email protected]> wrote: >>>> >>>>> Hi Dane, >>>>> >>>>> Thanks for your comments and please refer to below. >>>>> >>>>>>> The problem was in PROJ_LIB's setting. After change the settings in >>>>>>> PROJ_LIB, we were able to run generate_tiles.py. We don't see any >>>>>>> errors but still we cannot see the street name or any character yet. >>>>>> >>>>>> Can you give more detail here? So the script continues to run with no >>>>>> errors and tiles are rendered just without anything but background color? >>>>>> >>>>> JIN: Yes, the script is running without errors. Just background color >>>>> without any text data. >>>>>>> >>>>>>> We checked the postgres' error log and found following errors. We kind >>>>>>> of suspect that this might be related to the fact that we are not >>>>>>> getting data described above. >>>>>>> >>>>>>> 2010-11-25 13:00:32 JST LOG: could not receive data from client: No >>>>>>> connection could be made because the target machine actively refused it. >>>>>>> 2010-11-25 13:00:32 JST LOG: unexpected EOF on client connection >>>>>> >>>>>> Yes, surely the culprit. Surprising this does not halt the script. Can >>>>>> you google this error a bit? I assume it has to do with >>>>>> Postgres<-->windows and perhaps there is a solution outside of Mapnik? >>>>>> >>>>>> Also did you get this same problem when running the multiprocess version >>>>>> of generate_tiles? >>>>> JIN: Yes, this happens with multiprocess as well. Regarding to database >>>>> connection, psql and pgAdmin can connect fine and firewall is turned off. >>>>> >>>>> Kind regards, >>>>> >>>>> -Jin >>>>> >>>>> >>>>> On Nov 26, 2010, at 1:42 PM, Dane Springmeyer wrote: >>>>> >>>>>> >>>>>> >>>>>> On Nov 25, 2010, at 12:18 AM, Jin Kang <[email protected]> wrote: >>>>>> >>>>>>> Hi Dane, >>>>>>> >>>>>>> Again thanks much for your comments! >>>>>>> >>>>>>> The problem was in PROJ_LIB's setting. After change the settings in >>>>>>> PROJ_LIB, we were able to run generate_tiles.py. We don't see any >>>>>>> errors but still we cannot see the street name or any character yet. >>>>>> >>>>>> Can you give more detail here? So the script continues to run with no >>>>>> errors and tiles are rendered just without anything but background color? >>>>>> >>>>>>> >>>>>>> We checked the postgres' error log and found following errors. We kind >>>>>>> of suspect that this might be related to the fact that we are not >>>>>>> getting data described above. >>>>>>> >>>>>>> 2010-11-25 13:00:32 JST LOG: could not receive data from client: No >>>>>>> connection could be made because the target machine actively refused it. >>>>>>> 2010-11-25 13:00:32 JST LOG: unexpected EOF on client connection >>>>>> >>>>>> Yes, surely the culprit. Surprising this does not halt the script. Can >>>>>> you google this error a bit? I assume it has to do with >>>>>> Postgres<-->windows and perhaps there is a solution outside of Mapnik? >>>>>> >>>>>> Also did you get this same problem when running the multiprocess version >>>>>> of generate_tiles? >>>>>> >>>>>>> >>>>>>> In osm.xm, we setup local database. Is this error familiar to you? >>>>>> >>>>>> No I've personally never seen it before but I doubt it is uncommon. >>>>>> >>>>>>> If you have any comments from your experience, it will helps us. >>>>>>> >>>>>>> Below are our S/W environment: >>>>>>> * PostgreSQL8.4.5/PostGIS1.5, >>>>>>> * Python2.6.6 >>>>>>> * mapnik0.7.1 >>>>>>> * proj.4.4.6 >>>>>>> >>>>>>> Regards, >>>>>>> >>>>>>> -Jin >>>>>>> >>>>>>> On Nov 25, 2010, at 5:13 AM, Dane Springmeyer wrote: >>>>>>> >>>>>>>> Yes, downloading the proj nad files and setting PROJ_LIB env setting >>>>>>>> is the way to solve that error, so all I can say is to double check >>>>>>>> your ENV settings. >>>>>>>> >>>>>>>> A workaround is to switch from using the epsg lookup syntax to +proj >>>>>>>> literal string in your stylesheet (and perhaps also in the >>>>>>>> generate_tiles.py code). This way you bypass the need for proj4 to >>>>>>>> lookup values in the epsg file. >>>>>>>> >>>>>>>> Dane >>>>>>>> >>>>>>>> --- \o/ --- >>>>>>>> Sent from my phone >>>>>>>> >>>>>>>> On Nov 24, 2010, at 4:29 AM, Jin Kang <[email protected]> wrote: >>>>>>>> >>>>>>>>> Hi Dane, >>>>>>>>> >>>>>>>>> Thank you very much for your help on this! As you suggested, we ran >>>>>>>>> shapeindex with single thread script (generate_tiles.py) but we got >>>>>>>>> the following error messages: >>>>>>>>> >>>>>>>>> proj_init_error:failed to initialize projection with:+init=epsg:4326 >>>>>>>>> World : 16 58199 25813 Empty Tile >>>>>>>>> propjr_oijnit_e_rirnoirt:_fearirolre:df atio iled to >>>>>>>>> initniitailaliizze e projec >>>>>>>>> >>>>>>>>> The above error might occurred since proj epsg file cannot be found >>>>>>>>> so we downloaded win32 binary from proj.4 and set the PATH and >>>>>>>>> PROJ_LIB. However, we are still getting same error message. The >>>>>>>>> version of proj.4 is 4.4.6. At this point, we are not sure how to >>>>>>>>> resolve this. If you have previous experience, please kindly let us >>>>>>>>> know. >>>>>>>>> >>>>>>>>> Regards, >>>>>>>>> >>>>>>>>> -Jin >>>>>>>>> >>>>>>>>> On Nov 23, 2010, at 2:05 AM, Dane Springmeyer wrote: >>>>>>>>> >>>>>>>>>> Hi Jin, >>>>>>>>>> >>>>>>>>>> Does the generate_tiles.py script visibly stop at some point? Is >>>>>>>>>> there any error visible in the terminal? >>>>>>>>>> >>>>>>>>>> My guess is that you running into a known windows+mapnik+postgtres >>>>>>>>>> problem. Basically that mapnik looses a proper database connection >>>>>>>>>> during tile generation a high zoom levels because rendering is fast >>>>>>>>>> and there is a higher likelyhood of postgres connections being >>>>>>>>>> clobbered. This has been known to happen on windows when using >>>>>>>>>> generate_tiles with threads >= 1 >>>>>>>>>> (http://trac.mapnik.org/ticket/581#comment:6). I see below that you >>>>>>>>>> are testing using the multiprocess script, but I would not be >>>>>>>>>> surprised if it is the same problem manifesting. Can you try with >>>>>>>>>> either 1 thread or 1 process? >>>>>>>>>> >>>>>>>>>> To narrow this down it would be good to know if you can render *any* >>>>>>>>>> tile at >= z16. One easy way to check with would be to install >>>>>>>>>> TileLite (http://bitbucket.org/springmeyer/tilelite/), then launch a >>>>>>>>>> server on localhost:8000 and try to view a z18 tile, like >>>>>>>>>> http://tile.openstreetmap.org/18/232909/103242.png at >>>>>>>>>> http://localhost:8000/18/232909/103242.png. >>>>>>>>>> >>>>>>>>>> One last thing to do is rebuilt your shape indexes: >>>>>>>>>> >>>>>>>>>> # on windows >>>>>>>>>> cd world_boundaries >>>>>>>>>> shapeindex processed_p >>>>>>>>>> shapeindex shoreline_300 >>>>>>>>>> shapeindex 10m-populated-places >>>>>>>>>> shapeindex 110m-admin-0-boundary-lines >>>>>>>>>> >>>>>>>>>> Dane >>>>>>>>>> >>>>>>>>>> On Nov 21, 2010, at 7:42 PM, Jin Kang wrote: >>>>>>>>>> >>>>>>>>>>> Hi everyone, >>>>>>>>>>> >>>>>>>>>>> My engineer is trying to do rendering up to level 16 but we kind of >>>>>>>>>>> stuck right now. We are pretty new in this application so if any of >>>>>>>>>>> you could help us on this, it would be great help to us. Please >>>>>>>>>>> refer to below for more detail info. >>>>>>>>>>> >>>>>>>>>>> ------------------------------------------------------------------------- >>>>>>>>>>> We would like to do rendering OSM up to zoom level 16 using mapnik. >>>>>>>>>>> Right now, we are just focusing on Japanese map only which you can >>>>>>>>>>> find at http://www.openstreetmap.jp/. >>>>>>>>>>> >>>>>>>>>>> We also referred to following link but didn't get the expected >>>>>>>>>>> result so far. >>>>>>>>>>> http://wiki.openstreetmap.org/wiki/Mapnik >>>>>>>>>>> http://wiki.openstreetmap.org/wiki/DE:Mapnik >>>>>>>>>>> >>>>>>>>>>> The problem is that we can only render up to zoom level 10, not 16 >>>>>>>>>>> and at zoom level 11, we basically cannot see anything. Even at >>>>>>>>>>> zoom level 10, we cannot see any data such as street name, country >>>>>>>>>>> name or anything. >>>>>>>>>>> >>>>>>>>>>> Regarding OSM, we imported from following link. >>>>>>>>>>> http://downloads.cloudmade.com/asia/japan#downloads_breadcrumbs >>>>>>>>>>> ＊japan.osm.bz2 >>>>>>>>>>> ＊japan.osm.coastline.bz2 >>>>>>>>>>> ＊japan.osm.highway.bz2 >>>>>>>>>>> >>>>>>>>>>> We followed following steps: >>>>>>>>>>> 1. Install PostgreSQL8.4.5/PostGIS1.5, Python2.6.6, mapnik0.7.1 >>>>>>>>>>> >>>>>>>>>>> 2. Create database >>>>>>>>>>> $ createdb -U postgres -E UTF8 -O mapnik gis >>>>>>>>>>> >>>>>>>>>>> 3. Run sql >>>>>>>>>>> $ psql -U postgres -d gis -f "C:\Program >>>>>>>>>>> Files\PostgreSQL\8.4\share\contrib\postgis-1.5\postgis.sql" >>>>>>>>>>> $ psql -U postgres -d gis -f "C:\Program >>>>>>>>>>> Files\PostgreSQL\8.4\share\contrib\postgis-1.5\spatial_ref_sys.sql" >>>>>>>>>>> $ psql -U postgres -d gis -f "C:\Program >>>>>>>>>>> Files\PostgreSQL\8.4\share\contrib\_int.sql" >>>>>>>>>>> $ psql -U postgres -d gis -f "C:\Program >>>>>>>>>>> Files\PostgreSQL\8.4\share\contrib\hstore.sql" >>>>>>>>>>> >>>>>>>>>>> 4. Run osm2pgsql >>>>>>>>>>> $ osm2pgsql -c -s -d gis -U postgres -S default.style japan.osm.bz2 >>>>>>>>>>> $ osm2pgsql -c -s -d gis -U postgres -S default.style >>>>>>>>>>> japan.osm.highway.bz2 >>>>>>>>>>> $ osm2pgsql -c -s -d gis -U postgres -S default.style >>>>>>>>>>> japan.osm.coastline.bz2 >>>>>>>>>>> $ osm2pgsql -c -s -d gis -U postgres -S default.style >>>>>>>>>>> japan.osm.administrative.bz2 >>>>>>>>>>> >>>>>>>>>>> 5. world_boundaries(in mac) >>>>>>>>>>> $ tar xzf world_boundaries-spherical.tgz >>>>>>>>>>> $ tar xjf processed_p.tar.bz2 -C world_boundaries >>>>>>>>>>> $ tar xjf shoreline_300.tar.bz2 -C world_boundaries >>>>>>>>>>> $ unzip 10m-populated-places.zip -d world_boundaries >>>>>>>>>>> $ unzip 110m-admin-0-boundary-lines.zip -d world_boundaries >>>>>>>>>>> >>>>>>>>>>> 6. Check out mapnik repository >>>>>>>>>>> URL: http://svn.openstreetmap.org/applications/rendering/mapnik >>>>>>>>>>> >>>>>>>>>>> 7. Create mapnik setup file >>>>>>>>>>> $ generate_xml.py osm.xml out.xml --host localhost --user postgres >>>>>>>>>>> --dbname gis --symbols ./symbols/ --world_boundaries >>>>>>>>>>> ./world_boundaries/ >>>>>>>>>>> --port 5432 --password '' >>>>>>>>>>> >>>>>>>>>>> 8. Using generate_tiles_multiprocess.py, do rendering >>>>>>>>>>> $ set HOME=C:\mapnik-0.7.1\svn\ >>>>>>>>>>> $ set MAPNIK_MAP_FILE=C:\mapnik-0.7.1\svn\out.xml >>>>>>>>>>> $ set MAPNIK_TILE_DIR=C:\mapnik-0.7.1\svn\tiles\ >>>>>>>>>>> $ generate_tiles_multiprocess.py >>>>>>>>>>> >>>>>>>>>>> The portion we changed to for Japanese map >>>>>>>>>>> # zoom level=16- describe Japan >>>>>>>>>>> bbox = (112.5,22.0,157.5,55.7) >>>>>>>>>>> render_tiles(bbox, mapfile, tile_dir, 16, 16 , "Japan") >>>>>>>>>>> # zoom level=10- describe Japan >>>>>>>>>>> bbox = (112.5,22.0,157.5,55.7) >>>>>>>>>>> render_tiles(bbox, mapfile, tile_dir, 10, 10 , "Japan") >>>>>>>>>>> >>>>>>>>>>> Hardware spec: >>>>>>>>>>> PC Spec >>>>>>>>>>> CPU：Core2 6700 2.66G >>>>>>>>>>> RAM：3G >>>>>>>>>>> Hard Disk：256G >>>>>>>>>>> OS：Windows XP SP3 >>>>>>>>>>> _______________________________________________ >>>>>>>>>>> Mapnik-users mailing list >>>>>>>>>>> [email protected] >>>>>>>>>>> https://lists.berlios.de/mailman/listinfo/mapnik-users >>>>>>>>>> >>>>>>>>> >>>>>>>>> _______________________________________________ >>>>>>>>> Mapnik-users mailing list >>>>>>>>> [email protected] >>>>>>>>> https://lists.berlios.de/mailman/listinfo/mapnik-users >>>>>>> >>>>> >>> >> >
_______________________________________________ Mapnik-users mailing list [email protected] https://lists.berlios.de/mailman/listinfo/mapnik-users
