[OSM-dev] Tile list

2011-12-27 Thread Yves CAINAUD
Hi Admins !
Is it possible to obtain a tile list of the rendered tiles on
openstreetmap.org for zoom 14 and 15?
This would be a very usefull info to have at
http://wiki.openstreetmap.org/wiki/Tile_Disk_Usage.

We are trying to setup a tile server for Osmand, however we need to seed
the cache efficiently, hence the need for such a list to pre-render this
zoom level. Our server is not that strong, and rendering at zoom 14 can
last several minutes.

Also, a apache log extract would be very appreciated to check the tiles
requests from Osmand and dimension properly our server.

Yves
___
dev mailing list
dev@openstreetmap.org
http://lists.openstreetmap.org/listinfo/dev


Re: [osmosis-dev] nodes column in way table and way_nodes table

2011-12-27 Thread Michel Seuthe
I did. 64-bit cmd.exe, 64-bit JVM and -Xmx 16000. It uses all the
physically available memory (nearly 16GB) and throws the exception when
that limit is reached.


2011/12/26 Brett Henderson br...@bretth.com

 On 26 December 2011 01:43, Michel Seuthe m.seu...@googlemail.com wrote:

 Ya, I used a similar statement. It took a few hours to build the
 linestrings for germany.
 I tried to use osmosis to build the geometries, but it always threw
 SystemOutOfMemory Exception when the linestring column was added to ways
 table. The box osmosis was running on got 16GB RAM and I used InMemory
 option.


 Did you specify the -Xmx option to java?  Were you using a 64-bit JVM?
 Java by default will automatically set a maximum available memory size
 which is fairly small compared to overall system RAM.


___
osmosis-dev mailing list
osmosis-...@openstreetmap.org
http://lists.openstreetmap.org/listinfo/osmosis-dev


Re: [osmosis-dev] nodes column in way table and way_nodes table

2011-12-27 Thread Brett Henderson
Wow, okay.  Perhaps the planet is just too big now.  I've never had enough
RAM to run it properly so don't have any numbers.  I've always had to use
nodeLocationStoreType=TempFile which is still faster than building
linestrings in the database itself.  It may also be worth experimenting
with nodeLocationStoreType=CompactTempFile which is more efficient for
small datasets.  I haven't done testing to determine the size of dataset at
which TempFile becomes better than CompactTempFile.

On 27 December 2011 19:21, Michel Seuthe m.seu...@googlemail.com wrote:

 I did. 64-bit cmd.exe, 64-bit JVM and -Xmx 16000. It uses all the
 physically available memory (nearly 16GB) and throws the exception when
 that limit is reached.


 2011/12/26 Brett Henderson br...@bretth.com

 On 26 December 2011 01:43, Michel Seuthe m.seu...@googlemail.com wrote:

 Ya, I used a similar statement. It took a few hours to build the
 linestrings for germany.
 I tried to use osmosis to build the geometries, but it always threw
 SystemOutOfMemory Exception when the linestring column was added to ways
 table. The box osmosis was running on got 16GB RAM and I used InMemory
 option.


 Did you specify the -Xmx option to java?  Were you using a 64-bit JVM?
 Java by default will automatically set a maximum available memory size
 which is fairly small compared to overall system RAM.



___
osmosis-dev mailing list
osmosis-...@openstreetmap.org
http://lists.openstreetmap.org/listinfo/osmosis-dev


Re: [OSM-dev] problem with osmosis to apply changeset to postgresql db

2011-12-27 Thread Brett Henderson
On 27 December 2011 08:10, Oon Arfiandwi ro...@ijo.me wrote:

 Hi brett,

 On Wed, Dec 21, 2011 at 5:04 AM, Brett Henderson br...@bretth.com wrote:
  On 20 December 2011 03:14, Oon Arfiandwi ro...@ijo.me wrote:
 
  I just try to apply osmosis command below,
  the problem is: Caused by: org.postgresql.util.PSQLException: ERROR:
  relation schema_migrations does not exist
 
  I read a solution about schema_migrations relation here:
  http://forum.openstreetmap.org/viewtopic.php?id=7396
 
  then I change the command to:
  osmosis --read-xml-change file=asiadiff.osc --write-pgsql-change
  database=gis user=osm password=x host=localhost
  or
  osmosis --read-xml-change file=asiadiff.osc --write-pgsimp-change
  database=gis user=osm password=x host=localhost
 
  but still no luck,
  I got another exception: org.postgresql.util.PSQLException: ERROR:
  relation schema_info does not exist
 
 
  any other references?
 
 
  How have you created your database?  Specifically, which scripts did you
 use
  to create the database tables?  The OpenStreetMap project has a number of
  different incompatible schemas using PostgreSQL PostGIS extensions all
  optimised for different purposes.
  http://wiki.openstreetmap.org/wiki/List_of_Database_Schemas

 I created database using osm2pgsql, here's the command:

 ./osm2pgsql -S default.style --slim -d gis -C 1024
 --number-processes=1 --cache-strategy=dense asia.osm.bz2

 how can I update the database which previously created by osm2pgsql?
 any reference?


Perhaps this page will be of some use:
http://wiki.openstreetmap.org/wiki/Minutely_Mapnik#Import_Replication_Data

In summary, you can use Osmosis to download and merge the replication
files, but you need to use osm2pgsql to apply them.




 
  If you wish to use the pgsql tasks in Osmosis you will need to use the
  pgsnapshot_*.sql scripts from the scripts directory of the Osmosis
  distribution.  More details are available here:
 
 http://wiki.openstreetmap.org/wiki/Osmosis/Detailed_Usage#PostGIS_Tasks_.28Snapshot_Schema.29
 

 or should I drop the existing database,
 and setup the new one by following
 http://wiki.openstreetmap.org/wiki/Osmosis_PostGIS_Setup ?
 so next time I can update my database using Osmosis?


That depends on what you're using the database for (apologies if you've
already mentioned it).  The osm2pgsql schema stores a subset of the OSM
data in a schema suitable for rendering, the Osmosis pgsnapshot provides a
complete snapshot of the OSM dataset in a generic schema that isn't
suitable for rendering.

Brett
___
dev mailing list
dev@openstreetmap.org
http://lists.openstreetmap.org/listinfo/dev


[OSM-dev] Fwd: Tile list

2011-12-27 Thread Serge Wroclawski
Forgot to CC the list. Ooops


-- Forwarded message --
From: Serge Wroclawski emac...@gmail.com
Date: Tue, Dec 27, 2011 at 10:42 AM
Subject: Re: [OSM-dev] Tile list
To: Yves CAINAUD yve...@gmail.com


On Tue, Dec 27, 2011 at 5:29 AM, Yves CAINAUD yve...@gmail.com wrote:
 Hi Admins !
 Is it possible to obtain a tile list of the rendered tiles on
 openstreetmap.org for zoom 14 and 15?

I'm not an admin, but the list of rendered tiles changes as requests come in.

If you read mod_tile and renderd, you see how it works.

 We are trying to setup a tile server for Osmand, however we need to seed the
 cache efficiently, hence the need for such a list to pre-render this zoom
 level. Our server is not that strong, and rendering at zoom 14 can last
 several minutes.

If your server is so slow, then I suggest using a commercial tile
rendering service instead of your own.

- Serge

___
dev mailing list
dev@openstreetmap.org
http://lists.openstreetmap.org/listinfo/dev


Re: [OSM-dev] How did Mapquest do the localized rendering schemes?

2011-12-27 Thread ikonor

Hi Stephan,

I don't know about the rendering process, but the Mapnik styles are 
available at Github [1] and there are three different styles for US, UK 
and EU.


ikonor

[1] https://github.com/MapQuest/MapQuest-Mapnik-Style


Am 27.12.2011 00:02, schrieb Stephan Knauss:

Hi,

the featured image shows a mapquest rendering that applies different
styles based on the region.

As it has the same font problem than mapnik I assume it's mapnik.

How did they do the localization? Adding a boundary check to every way
query? Sounds expensive. Also the rendering rules would explode if
applied to a lot of regions.

Is it documented somewhere how they did it?

Stephan


___
dev mailing list
dev@openstreetmap.org
http://lists.openstreetmap.org/listinfo/dev




___
dev mailing list
dev@openstreetmap.org
http://lists.openstreetmap.org/listinfo/dev


Re: [OSM-dev] Fwd: Tile list

2011-12-27 Thread Yves CAINAUD
If you look at http://wiki.openstreetmap.org/wiki/Tile_Disk_Usage, we can
see that only 32% of z14 and 15% of z15 are viewed, and I'd like to
pre-render them.
Subsequent zoom level are pretty fast to render, but z14 and z15 are too
big to be completely pre-rendered in cache.
Hence my request for the tile-list of rendered tile at this zoom levels on
Yevaud.
Then I can ask renderd to render them, without waiting for the user to have
the patience to request them.
Yves


2011/12/27 Serge Wroclawski emac...@gmail.com

 Forgot to CC the list. Ooops


 -- Forwarded message --
 From: Serge Wroclawski emac...@gmail.com
 Date: Tue, Dec 27, 2011 at 10:42 AM
 Subject: Re: [OSM-dev] Tile list
 To: Yves CAINAUD yve...@gmail.com


 On Tue, Dec 27, 2011 at 5:29 AM, Yves CAINAUD yve...@gmail.com wrote:
  Hi Admins !
  Is it possible to obtain a tile list of the rendered tiles on
  openstreetmap.org for zoom 14 and 15?

 I'm not an admin, but the list of rendered tiles changes as requests come
 in.

 If you read mod_tile and renderd, you see how it works.

  We are trying to setup a tile server for Osmand, however we need to seed
 the
  cache efficiently, hence the need for such a list to pre-render this zoom
  level. Our server is not that strong, and rendering at zoom 14 can last
  several minutes.

 If your server is so slow, then I suggest using a commercial tile
 rendering service instead of your own.

 - Serge

 ___
 dev mailing list
 dev@openstreetmap.org
 http://lists.openstreetmap.org/listinfo/dev

___
dev mailing list
dev@openstreetmap.org
http://lists.openstreetmap.org/listinfo/dev


Re: [OSM-dev] How did Mapquest do the localized rendering schemes?

2011-12-27 Thread Stephan Knauss

On 27.12.2011 12:05, ikonor wrote:

I don't know about the rendering process, but the Mapnik styles are
available at Github [1] and there are three different styles for US, UK
and EU.


Thanks for the pointer to the styles. Any Idea how they determine which 
style to use for which geometry?
I did not see anything that looks like a way to select the one style or 
the other based on the geographic location.


Can you do the location check while rendering or would it be a 
preprocessing step during import? I did not see an additional region 
column so no idea how the selection was done.


Stephan

___
dev mailing list
dev@openstreetmap.org
http://lists.openstreetmap.org/listinfo/dev


Re: [OSM-dev] Fwd: Tile list

2011-12-27 Thread Serge Wroclawski
On Tue, Dec 27, 2011 at 1:37 PM, Yves CAINAUD yve...@gmail.com wrote:
 If you look at http://wiki.openstreetmap.org/wiki/Tile_Disk_Usage, we can
 see that only 32% of z14 and 15% of z15 are viewed, and I'd like to
 pre-render them.

That's 32% at any time, not necessarily the same 32% But here's a nice
rule of thumb you may want to use:

2/3rds of the earth's surface is water.

- Serge

___
dev mailing list
dev@openstreetmap.org
http://lists.openstreetmap.org/listinfo/dev


Re: [Potlatch-dev] [OpenStreetMap] #4072: Tagging a way freezes tagging menu

2011-12-27 Thread OpenStreetMap
#4072: Tagging a way freezes tagging menu
---+
 Reporter:  mrpulley   |   Owner:  potlatch-dev@…
 Type:  defect |  Status:  new   
 Priority:  major  |   Milestone:
Component:  potlatch2  | Version:
 Keywords: |  
---+

Comment(by migurski):

 This occurs even when just clicking on a way or node for me; see
 ticket:4164.

-- 
Ticket URL: https://trac.openstreetmap.org/ticket/4072#comment:4
OpenStreetMap http://www.openstreetmap.org/
OpenStreetMap is a free editable map of the whole world

___
Potlatch-dev mailing list
potlatch-...@openstreetmap.org
http://lists.openstreetmap.org/listinfo/potlatch-dev


Re: [OSM-dev] map disappear on YourS local installation

2011-12-27 Thread Anwar Azulfa
i have follow refernce from : http://wiki.openstreetmap.org/wiki/Gosmore

include install some package :

sudo apt-get install libxml2-dev libgtk2.0-dev g++ make subversion
libcurl4-gnutls-dev libgps-dev


but, gosmore still error when i try make source

2011/12/28 Nic Roets nro...@gmail.com

 The correct package name is libxml2-dev

 On Tue, Dec 27, 2011 at 5:08 PM, Anwar Azulfa an...@troyans.net wrote:

 i cannot get libxml-2.0-dev from package


 user@ubuntu:~/Map/src/gosmore$ sudo apt-get install libxml-2.0-dev
 Reading package lists... Done
 Building dependency tree
 Reading state information... Done
 E: Unable to locate package libxml-2.0-dev
 E: Couldn't find any package by regex 'libxml-2.0-dev'



 2011/12/27 Nic Roets nro...@gmail.com

 Hello Anwar,

 It looks like you don't have libxml-2.0-dev installed.


 On Tue, Dec 27, 2011 at 3:32 AM, Anwar Azulfa an...@troyans.net wrote:

 i have copy bboxes.c into jni folder on ubuntu 11.10, but when i
 compile it.I got error like bellow :

 $make
 g++ -DCHILDREN=16 -O2 -DRES_DIR=\/usr/local/share/gosmore/\ -W -Wall
 `pkg-config --cflags libxml-2.0 || echo -I /usr/include/libxml2`
 `pkg-config --libs libxml-2.0 || echo -l xml2 -lm` \
   jni/gosmore.cpp jni/libgosm.cpp jni/openglespolygon.h
 \
   jni/openglespolygon.cpp -o gosmore `pkg-config
 --cflags --libs gtk+-2.0 || echo -D HEADLESS` `pkg-config --libs libcurl`
 `[ -e /usr/include/gps.h ]  echo -DUSE_GPSD -lgps ` `pkg-config --libs
 pkg-config --libs gthread-2.0`
 jni/gosmore.cpp: In function ‘void* UpdateMapThread(void*)’:
 jni/gosmore.cpp:1339:12: warning: variable ‘res’ set but not used
 [-Wunused-but-set-variable]
 jni/gosmore.cpp: At global scope:
 jni/gosmore.cpp:1655:5: warning: unused parameter ‘event’
 [-Wunused-parameter]
 jni/gosmore.cpp:1655:5: warning: unused parameter ‘ex’
 [-Wunused-parameter]
 jni/gosmore.cpp:1655:5: warning: unused parameter ‘ey’
 [-Wunused-parameter]
 jni/gosmore.cpp:2102:6: warning: unused parameter ‘width’
 [-Wunused-parameter]
 jni/gosmore.cpp: In function ‘gint DrawExpose()’:
 jni/gosmore.cpp:2997:40: warning: field precision specifier ‘.*’
 expects argument of type ‘int’, but argument 3 has type ‘long int’
 [-Wformat]
 jni/gosmore.cpp: In function ‘gint Drag(GtkWidget*, GdkEventMotion*,
 void*)’:
 jni/gosmore.cpp:3089:1: warning: no return statement in function
 returning non-void [-Wreturn-type]
 jni/gosmore.cpp: In function ‘int Click(GtkWidget*, GdkEventButton*,
 void*)’:
 jni/gosmore.cpp:3094:1: warning: no return statement in function
 returning non-void [-Wreturn-type]
 jni/gosmore.cpp: In function ‘int UserInterface(int, char**, const
 char*, const char*)’:
 jni/gosmore.cpp:3586:5: warning: cast to pointer from integer of
 different size [-Wint-to-pointer-cast]
 jni/gosmore.cpp:3350:26: warning: ignoring return value of ‘int
 chdir(const char*)’, declared with attribute warn_unused_result
 [-Wunused-result]
 jni/gosmore.cpp: In function ‘void* UpdateMapThread(void*)’:
 jni/gosmore.cpp:1359:29: warning: ignoring return value of ‘int
 system(const char*)’, declared with attribute warn_unused_result
 [-Wunused-result]
 jni/gosmore.cpp: In function ‘void DoFollowThing(gpsNewStruct*)’:
 jni/gosmore.cpp:878:67: warning: ‘n2Left’ may be used uninitialized in
 this function [-Wuninitialized]
 jni/gosmore.cpp: At global scope:
 jni/gosmore.cpp:2070:14: warning: ‘casing’ defined but not used
 [-Wunused-variable]
 jni/gosmore.cpp:3122:17: warning: ‘gboolean DropOnDraw(GtkWidget*,
 GdkDragContext*, gint, gint, guint, gpointer)’ defined but not used
 [-Wunused-function]
 jni/openglespolygon.cpp: In function ‘void Delete(PolygonEdge*)’:
 jni/openglespolygon.cpp:163:34: warning: variable ‘tmp’ set but not
 used [-Wunused-but-set-variable]
 jni/openglespolygon.cpp: In function ‘void Check(PolygonEdge*)’:
 jni/openglespolygon.cpp:243:3: warning: suggest parentheses around ‘’
 within ‘||’ [-Wparentheses]
 jni/openglespolygon.cpp: In function ‘void
 AddPolygon(std::vectorPolygonEdge, FixedPoint*, int)’:
 jni/openglespolygon.cpp:312:31: warning: comparison between signed and
 unsigned integer expressions [-Wsign-compare]
 jni/openglespolygon.cpp: In function ‘void
 Fill(std::vectorPolygonEdge, int, GdkWindow*, GdkGC*)’:
 jni/openglespolygon.cpp:367:26: warning: comparison between signed and
 unsigned integer expressions [-Wsign-compare]
 /tmp/cctCrIBO.o: In function `LoadElemstyles(char const*, char const*,
 styleStruct*, elemstyleMapping*)':
 libgosm.cpp:(.text+0x2e05): undefined reference to
 `xmlNewTextReaderFilename'
 libgosm.cpp:(.text+0x30fe): undefined reference to `xmlTextReaderRead'
 libgosm.cpp:(.text+0x3110): undefined reference to `xmlTextReaderName'
 libgosm.cpp:(.text+0x311f): undefined reference to
 `xmlTextReaderNodeType'
 libgosm.cpp:(.text+0x3172): undefined reference to
 `xmlTextReaderMoveToNextAttribute'
 libgosm.cpp:(.text+0x3186): undefined reference to `xmlTextReaderName'
 libgosm.cpp:(.text+0x3193): undefined reference 

Re: [OSM-dev] How did Mapquest do the localized rendering schemes?

2011-12-27 Thread Toby Murray
On Tue, Dec 27, 2011 at 12:38 PM, Stephan Knauss o...@stephans-server.de
 Thanks for the pointer to the styles. Any Idea how they determine which
 style to use for which geometry?
 I did not see anything that looks like a way to select the one style or the
 other based on the geographic location.

 Can you do the location check while rendering or would it be a preprocessing
 step during import? I did not see an additional region column so no idea
 how the selection was done.

I thought this was the case but after a little searching, I came up
with proof. MapQuest added this feature to Mapnik:
http://lists.openstreetmap.org/pipermail/talk-us/2010-November/004820.html

So it is apparently determined at render time. No clue how though :)

Toby

___
dev mailing list
dev@openstreetmap.org
http://lists.openstreetmap.org/listinfo/dev


Re: [josm-dev] Allow plugins to register search operators

2011-12-27 Thread Dirk Stöcker

On Tue, 27 Dec 2011, Josh Doe wrote:


I'd like to work on this functionality this week, any comments?


Only one: It is very unlikely that for most installations additional 
searches are registered and if, then only a few. So the aim should be to 
have the internal searches be as fast as possible and not to reduce 
performance too much due to large overhead.


I think at least for filters the compile speed may be relevant.

Ciao
--
http://www.dstoecker.eu/ (PGP key available)


___
josm-dev mailing list
josm-dev@openstreetmap.org
http://lists.openstreetmap.org/listinfo/josm-dev


Re: [josm-dev] Make josm use .mo files

2011-12-27 Thread Dirk Stöcker

On Tue, 27 Dec 2011, David Paleino wrote:


We dropped gettext files as they are wasting a lot of space in the
translation. The lang files only carry each string once and not multiple
times like .mo does.


What do you mean?
A gettext .mo file carries each string once -- a msgid + a msgstr. Maybe I
didn't understand what you meant? :)


We currently have 27 languages. Each english string is included once which 
means we have 27 times the same string in one jar-file. Wasting a lot of 
space. The current format has each string only once. Also some 
optimizations exist for strings which are translated equal to original.



(but I didn't notice .lang files were more compact than .mo, at least in
size, I admit it)


They have one big disadvantage. The en.lang and the translated files MUST 
be in sync (created together) or translation is broken.



Most of the advantages you describe can be reached by simply renaming the
lang files to .mo and install them in different locations.


Is that doable? Maybe some property to pass to ant during the build? If you're
ok with that, I can try doing it (if I'm able to ;)).


Only the language file loader must be adapted to search in different 
location for the files. Debian already does a lot of patching, so this 
should be no problem.


I18n.java is the only place where this is done. I changed the code a bit, 
so now there is one function getting the file, so a Debian specific patch 
could be minimalistic.


Ciao
--
http://www.dstoecker.eu/ (PGP key available)


___
josm-dev mailing list
josm-dev@openstreetmap.org
http://lists.openstreetmap.org/listinfo/josm-dev