Re: [OSM-dev] Can SQLite3 handle OSM 150G data file?

2009-04-28 Thread Shaun McDonald

On 28 Apr 2009, at 00:16, Kelly Jones wrote:

 I've seen many posts saying that SQLite2 can't handle OpenStreetMap's
 large planet.osm data file:

 http://planet.openstreetmap.org/planet-090421.osm.bz2

 which is 5.4G bzip2 compressed, about 150G uncompressed.

 Can SQLite3 handle this? Has anyone tried?

 I tried to do this myself, but I'm on a slow machine and it's taking
 too long (several days so far). If someone's done this, can I get a  
 copy?


SQLite isn't designed for huge databases like OpenStreetMap. You could  
get away with a city or small region, but more than that, you will get  
the slowness that you are seeing.
http://www.sqlite.org/faq.html#q19 and some other FAQs on that page.
You are much better using Postgres, or even MySQL.

Shaun


___
dev mailing list
dev@openstreetmap.org
http://lists.openstreetmap.org/listinfo/dev


Re: [OSM-dev] Can SQLite3 handle OSM 150G data file?

2009-04-28 Thread marcus.wolschon
On Tue, 28 Apr 2009 08:02:30 +0100, Shaun McDonald
 SQLite isn't designed for huge databases like OpenStreetMap. You could  
 get away with a city or small region, but more than that, you will get  
 the slowness that you are seeing.
 http://www.sqlite.org/faq.html#q19 and some other FAQs on that page.
 You are much better using Postgres, or even MySQL.

Is there ANY embedded database out there that can handle the planet?
Anything that does not require the (unskilled) user of a program to
install a local database-server first?

Marcus

___
dev mailing list
dev@openstreetmap.org
http://lists.openstreetmap.org/listinfo/dev


Re: [OSM-dev] Can SQLite3 handle OSM 150G data file?

2009-04-28 Thread Stefan de Konink
marcus.wolsc...@googlemail.com wrote:
 On Tue, 28 Apr 2009 08:02:30 +0100, Shaun McDonald
 SQLite isn't designed for huge databases like OpenStreetMap. You could  
 get away with a city or small region, but more than that, you will get  
 the slowness that you are seeing.
 http://www.sqlite.org/faq.html#q19 and some other FAQs on that page.
 You are much better using Postgres, or even MySQL.
 
 Is there ANY embedded database out there that can handle the planet?
 Anything that does not require the (unskilled) user of a program to
 install a local database-server first?

MonetDB can be running in embedded mode ;)


Stefan

___
dev mailing list
dev@openstreetmap.org
http://lists.openstreetmap.org/listinfo/dev


Re: [OSM-dev] Can SQLite3 handle OSM 150G data file?

2009-04-28 Thread Tomas Kolda
There is no reason to be sqlite slow. How much are you are using 
transactions on your local db? What are you using for import? I'm 
importing Czech republic (50Mb bziped) in one or two minutes. So for 
5.4GB it takes 108 minutes (two hours). But I'm importig to modified osm 
schema (something like mapnik schema in postgress). It is because of 
query speed.


I'm playing with sqlite and Mapnik. Sqlite knows RTree spatial index and 
with small modification to mapnik (sqlite datasource) it runs ok. If you 
use 8x8 tile per render, it is quite fast.


RTree in sqlite is fast, but there is overhead, when you use one bound 
rect per entity and also with mapnik (it queries many times per one 
render for same area). But if you do not need speed it works.


Tomas

Shaun McDonald napsal(a):

On 28 Apr 2009, at 00:16, Kelly Jones wrote:

  

I've seen many posts saying that SQLite2 can't handle OpenStreetMap's
large planet.osm data file:

http://planet.openstreetmap.org/planet-090421.osm.bz2

which is 5.4G bzip2 compressed, about 150G uncompressed.

Can SQLite3 handle this? Has anyone tried?

I tried to do this myself, but I'm on a slow machine and it's taking
too long (several days so far). If someone's done this, can I get a  
copy?





SQLite isn't designed for huge databases like OpenStreetMap. You could  
get away with a city or small region, but more than that, you will get  
the slowness that you are seeing.

http://www.sqlite.org/faq.html#q19 and some other FAQs on that page.
You are much better using Postgres, or even MySQL.

Shaun


___
dev mailing list
dev@openstreetmap.org
http://lists.openstreetmap.org/listinfo/dev
  


___
dev mailing list
dev@openstreetmap.org
http://lists.openstreetmap.org/listinfo/dev


Re: [OSM-dev] API: version number of newly created objects.

2009-04-28 Thread D Tucny
2009/4/28 Chris Browet c...@semperpax.com

 Hi,

 I see in the api doc:
 Version numbers will most of the time begin at *1* and increase by *1*every 
 time an element is changed but this behaviour is not guaranteed and
 should not be relied upon
 I understand that phrase as I cannot assume that a newly created object
 will be at version 1.

 As a creation PUT do not return the version number (AFAIK), does that mean
 that we are suppose to do a GET on the newly created object to get the
 version number?


If you do a diff upload (
http://wiki.openstreetmap.org/wiki/OSM_Protocol_Version_0.6#Diff_upload:_POST_.2Fapi.2F0.6.2Fchangeset.2F.23id.2Fupload)
you will get the version number back in the response and if you update an
existing individual object you will get the version number in the response,
but, as you say, as documented, creating an individual object won't return
the version... I don't know for sure, but, I'd hope that the version number
starting at 1 bit is guaranteed even if the increase by 1 isn't...

d
___
dev mailing list
dev@openstreetmap.org
http://lists.openstreetmap.org/listinfo/dev


Re: [OSM-dev] API: version number of newly created objects.

2009-04-28 Thread Frederik Ramm
Hi,

Chris Browet wrote:
 As a creation PUT do not return the version number (AFAIK), does that mean
 that we are suppose to do a GET on the newly created object to get the
 version number?

No, that would be the stupidest API. I have fixed the Wiki page. Assume 
new versions to always be 1. If this ever gets changed in the API then 
the creation call will have to be changed to return the version number 
as well.

Bye
Frederik

___
dev mailing list
dev@openstreetmap.org
http://lists.openstreetmap.org/listinfo/dev


Re: [OSM-dev] API: version number of newly created objects.

2009-04-28 Thread Chris Browet
Thanks

- Chris -

2009/4/28 Frederik Ramm frede...@remote.org

 Hi,

 Chris Browet wrote:

 As a creation PUT do not return the version number (AFAIK), does that mean
 that we are suppose to do a GET on the newly created object to get the
 version number?


 No, that would be the stupidest API. I have fixed the Wiki page. Assume new
 versions to always be 1. If this ever gets changed in the API then the
 creation call will have to be changed to return the version number as well.

 Bye
 Frederik

___
dev mailing list
dev@openstreetmap.org
http://lists.openstreetmap.org/listinfo/dev


Re: [OSM-dev] Can SQLite3 handle OSM 150G data file?

2009-04-28 Thread Matt Amos
On Tue, Apr 28, 2009 at 8:26 AM, Stefan de Konink ste...@konink.de wrote:
 marcus.wolsc...@googlemail.com wrote:
 On Tue, 28 Apr 2009 08:02:30 +0100, Shaun McDonald
 SQLite isn't designed for huge databases like OpenStreetMap. You could
 get away with a city or small region, but more than that, you will get
 the slowness that you are seeing.
 http://www.sqlite.org/faq.html#q19 and some other FAQs on that page.
 You are much better using Postgres, or even MySQL.

 Is there ANY embedded database out there that can handle the planet?
 Anything that does not require the (unskilled) user of a program to
 install a local database-server first?

 MonetDB can be running in embedded mode ;)

seriously, you should get paid for the amount you promote MonetDB ;-)

cheers,

matt

___
dev mailing list
dev@openstreetmap.org
http://lists.openstreetmap.org/listinfo/dev


Re: [OSM-dev] Problems with rendering tiles with mapnik

2009-04-28 Thread Barnett, Phillip
DISCLAIMER - I have not set up a mapnik server or followed these instructions.

Your error message is probably because it doesn’t understand ‘source’ – do you 
have this program/script installed? Might be from TCL if I read it correctly. 
Or it can’t find the file set-mapnik-env – try changing to the directory it’s 
in (mapnik?)

Do not omit the leading periods just means write the line exactly as shown, 
without skipping the dots at the start. This is again so that your OS knows 
where to find the scripts referred to.

Good luck



[http://www.itn.co.uk/images/ITN_Master_blue.gif]
PHILLIP BARNETT
SERVER MANAGER

200 GRAY'S INN ROAD
LONDON
WC1X 8XZ
UNITED KINGDOM
T +44 (0)20 7430 4474
F
E phillip.barn...@itn.co.uk
WWW.ITN.CO.UKhttp://WWW.ITN.CO.UK
P  Please consider the environment. Do you really need to print this email?


From: dev-boun...@openstreetmap.org [mailto:dev-boun...@openstreetmap.org] On 
Behalf Of Mohamad Ali
Sent: 28 April 2009 04:08
To: dev@openstreetmap.org
Subject: [OSM-dev] Problems with rendering tiles with mapnik

Hi,
I am trying to follow step by step this tutorial: 
www.weait.com/content/make-your-first-maphttp://www.weait.com/content/make-your-first-map

But when I try this command I get this error
u...@pc1:~/mapnik$ source set-mapnik-env
bash: #!/bin/sh: No such file or directory,


also in tutorial, what that mean:
Do not omit the leading periods on lines two and three.
source set-mapnik-env
./customize-mapnik-map $MAPNIK_MAP_FILE
./z0_generate_tiles.py

Thanks Guys
Please Note:

 

Any views or opinions are solely those of the author and do not necessarily 
represent 
those of Independent Television News Limited unless specifically stated. 
This email and any files attached are confidential and intended solely for the 
use of the individual
or entity to which they are addressed. 
If you have received this email in error, please notify postmas...@itn.co.uk 

Please note that to ensure regulatory compliance and for the protection of our 
clients and business,
we may monitor and read messages sent to and from our systems.

Thank You.

___
dev mailing list
dev@openstreetmap.org
http://lists.openstreetmap.org/listinfo/dev


Re: [josm-dev] Deletion conflicts

2009-04-28 Thread Shaun McDonald

On 28 Apr 2009, at 09:23, Frederik Ramm wrote:

 Hi,

 Shaun McDonald wrote:
 It is already possible to do a multiget,

 ... which will return 404 as soon as any one of its targets has been  
 deleted ;-)


Nope, you will only get a 404 if the elements have never existed  
before. If it has been deleted you will get a visible=false. Take this  
example:
http://openstreetmap.org/api/0.6/nodes?nodes=15,18

The maximum number you can request at one time is limited by the  
length of the GET request, there are no limits set our code, so you  
may need to bulk it into groups like the gps points call.

We could change the call to silently drop the 404, and always return  
all elements that it could find, with only the elements that could not  
be found being missing from the list. If no requested ids could be  
found, then and osm document with no nodes, ways and relations would  
be returned.

Shaun


___
josm-dev mailing list
josm-...@openstreetmap.org
http://lists.openstreetmap.org/listinfo/josm-dev


Re: [OSM-dev] Can SQLite3 handle OSM 150G data file?

2009-04-28 Thread marcus.wolschon
On Tue, 28 Apr 2009 09:26:21 +0200, Stefan de Konink ste...@konink.de
wrote:
 marcus.wolsc...@googlemail.com wrote:
 On Tue, 28 Apr 2009 08:02:30 +0100, Shaun McDonald
 SQLite isn't designed for huge databases like OpenStreetMap. You could 

 get away with a city or small region, but more than that, you will get 

 the slowness that you are seeing.
 http://www.sqlite.org/faq.html#q19 and some other FAQs on that page.
 You are much better using Postgres, or even MySQL.
 
 Is there ANY embedded database out there that can handle the planet?
 Anything that does not require the (unskilled) user of a program to
 install a local database-server first?
 
 MonetDB can be running in embedded mode ;)

From what I can see at
http://monetdb.cwi.nl/projects/monetdb/SQL/Documentation/Embedded-Server.html#Embedded-Server
the embedded-mode is still a server, just for
embedded systems.
I was talking about having the database as a library
be a part of the program.
Nothing to install or to start separately.

Marcus

___
dev mailing list
dev@openstreetmap.org
http://lists.openstreetmap.org/listinfo/dev


Re: [OSM-dev] Cloudmade routing for OSM rails_port site.

2009-04-28 Thread Eddy Petrișor
On Mon, Apr 27, 2009 at 11:04 AM, Марат Хасанов angedo...@gmail.com wrote:
 Hi all!

 Let me introduce Routing for OSM!

 My name is Marat Khasanov and I’m working for CloudMade as Front-End
 developer. Few days ago I’ve already finished routing tool for OSM project.
 With this tool you can aOSdd your own routes between points on the map or
 search for shortest or fastest way by car, bicycle or walking. Current
 version is based on CM Routing API and interacts with the server over
 cross-domain JSON requests(similarly to data and search window).

 You can find possibility to try it here:
 http://mkhasanov.sandbox.cloudmade.com/directions (only view and routing
 tabs works)

The current algorithm doesn't take into account that roads with
access=private or which have barriers on them with access private
should be passed through, by default:

http://mkhasanov.sandbox.cloudmade.com/directions?lat=44.42775lon=25.99423zoom=15layers=B000FTFTTtravel_mode=carwaypoints=25.98,44.43,26.01013,44.43377

And, as Maarten said, the Permalink is not precise enough, it should
provide 5 decimals to be effective in locating a point.


Another problem is that the default shortest route for cars should
probably avoid tracks, or a shortest on paved roads algorithm should
be provided.

Problem visible here:
http://mkhasanov.sandbox.cloudmade.com/directions?lat=44.3905lon=26.0228zoom=13layers=B000FTFTTtravel_mode=car/shortestwaypoints=25.99,44.41,25.99,44.38

Also, the fast and short route could be the same if the difference
isn't noticiable like above, where both the fast and the short route
are allegedly 4.7km long.


 Now it is easy to make your maps better and your mapping more effective
 finding not crossing roads or other lacks of existing maps. I appreciate
 community feedback and waiting till you review this functionality and
 attached patch.

 Marat.


 ___
 dev mailing list
 dev@openstreetmap.org
 http://lists.openstreetmap.org/listinfo/dev





-- 
Regards,
EddyP
=
Imagination is more important than knowledge A.Einstein

___
dev mailing list
dev@openstreetmap.org
http://lists.openstreetmap.org/listinfo/dev


[OSM-dev] Embedded databases

2009-04-28 Thread Nolan Darilek
I'm slowly hacking on a project that could benefit from an embedded
database, and I'm not smart enough to create my own binary format.
Furthermore, since we aren't usually under as severe constraints with
embedded resources these days, an actual embedded DB makes more sense. I
had a few questions regarding people's experiences, however.

At the moment, I'm hacking on a prototype that uses Tokyo Cabinet's
table store, and geohashes to implement geospatial searches. I'm still
working on refining the import process so haven't experimented with how
well searches work, and of course geohashes fail near the
equator/meridians, so it feels a bit kludgy. Even so, my Ruby code
imports a 13.4 meg OSM file into a 7.9M database in about a minute, so
performance doesn't seem terrible. I'll still have to implement routing,
though, and my geohash hack is about as far as I'll be able to take TC
without implementing a custom geospatial datastore, which should be
possible for someone smarter than I, but then TC's development process
is less than ideal and I don't think it's a good fit.

Has anyone used SQLite for more than rendering? There's one report of it
working well with Mapnik and another suggestion that it might not. Does
anyone have any other experiences to share? How about a working schema
and some example import code?

I've been reading references to MonetDB. I've googled, but its website
seems somewhat disorganized. There appears to be a kernel atop which
several interfaces are built? I've encountered references to geospatial
support, and routing/embedded use was mentioned here recently. Is the
geospatial support confined to a single implementation--only the SQL
support, for instance--or does it work across the board? Is there any
intro documentation anywhere? I mean, of course there are manuals and
tutorials for each component, but what about a tying-it-all-together
this is what our architecture gives you that others don't introduction
that helps me understand, say, how the different versions can interact?
How well does it work with Ruby? Again, either my GoogleFu is weak or
it's just not getting used much, because while it reveals the presence
of a Ruby library, I can't seem to find any here's what's cool about
this and how to start using it blog posts or articles. Feel free to
toss out URLs to anything I might have missed, as it certainly isn't my
intent to use this list for discussion if there are better resources
more readily available, but I'm just not seeing them. :) I've also
looked through some of the server/SQL/Xquery docs, but am not clear on
how they apply to OSM. Can an XML document be added in its XML form and
queried via SQL somehow? Or is there some intermediate import step that
makes the data available for routing? Or have I just mis-interpreted
what is currently possible? :)

Finally, are there any other embedded solutions I may have missed?
Ideally, whatever format I use should be accessible via Ruby, whether
via existing wrappers or by C libraries I can interface using FFI.



___
dev mailing list
dev@openstreetmap.org
http://lists.openstreetmap.org/listinfo/dev


Re: [OSM-dev] Cloudmade routing for OSM rails_port site .

2009-04-28 Thread marcus.wolschon
On Tue, 28 Apr 2009 16:15:47 +0300, Eddy Petrișor
eddy.petri...@gmail.com
wrote:
 I meant shouldn't be passed through. An exception should be made if
 one of the ends is within the private area. So in other words, the
 cost of going through an access=private node or way should be way
 higher than a regular road so that the passing should occur only if
 absolutely necessary (e.g. must leave a private area or must reach a
 private area).

Hint: 

Note that a very high cost also means that a huge number of roads
that would never lead anywhere near the destination get evaluated in
most routing-algorithms.
The proper way would probably be to threat ways with access=destination
as non-existent unless they contain the destination/start. However
that crossing multiple such ways to get to the nearest or the optimal
street that is generally available can be a small challenge in coding.
That is, if the internal data-format supports such rules at all.

So, access=destination is not as easy to implement as you may think.

(Same way no one has yet implemented no_uturn turn-restrictions or
turn-restrictions
 with more then 1 node or more then 0 ways in the via role.)

Marcus

___
dev mailing list
dev@openstreetmap.org
http://lists.openstreetmap.org/listinfo/dev


Re: [OSM-dev] Can SQLite3 handle OSM 150G data file?

2009-04-28 Thread Ævar Arnfjörð Bjarmason
On Tue, Apr 28, 2009 at 12:29 PM,  marcus.wolsc...@googlemail.com wrote:
 On Tue, 28 Apr 2009 09:26:21 +0200, Stefan de Konink ste...@konink.de
 wrote:
 marcus.wolsc...@googlemail.com wrote:
 On Tue, 28 Apr 2009 08:02:30 +0100, Shaun McDonald
 SQLite isn't designed for huge databases like OpenStreetMap. You could

 get away with a city or small region, but more than that, you will get

 the slowness that you are seeing.
 http://www.sqlite.org/faq.html#q19 and some other FAQs on that page.
 You are much better using Postgres, or even MySQL.

 Is there ANY embedded database out there that can handle the planet?
 Anything that does not require the (unskilled) user of a program to
 install a local database-server first?

 MonetDB can be running in embedded mode ;)

 From what I can see at
 http://monetdb.cwi.nl/projects/monetdb/SQL/Documentation/Embedded-Server.html#Embedded-Server
 the embedded-mode is still a server, just for
 embedded systems.
 I was talking about having the database as a library
 be a part of the program.
 Nothing to install or to start separately.

You could always make your program embed/start the database server
regardless of whether it's a library or a server. It would just mean
e.g. shipping the postgresql binaries with your program and doing some
magic in your program that ensures that the server is started when the
program is.

___
dev mailing list
dev@openstreetmap.org
http://lists.openstreetmap.org/listinfo/dev


Re: [OSM-dev] Embedded databases

2009-04-28 Thread Tomas Kolda
As I wrote in another thread I tried sqlite to do rendering along with 
mapnik. There is no problem to do it even with builtin rtree spatial 
index. I can try to create some SVN repos to share code, but it was just 
for playing (not for production). I tweaked postgress datasource in 
mapnik and make my own implementation of storing GIS geometries, because 
of no dependecy needs. Also look to existing GIS extension for sqlite.

http://www.gaia-gis.it/spatialite/

Importing into sqlite is very fast. I'm using simple C++ importer with 
expat parser and insert all data in one transaction. Sqlite has also 
very little size overhead (about 5x size than bzipped OSM).

For my another project I use my own datastore, because it is much more 
faster than universal databases. It uses leveled Z-index. For searching 
I'm using litmax bigmin method. Its performance is great.

So you must choose between speed and simple approach. For routing you 
will need some special data store to do it fast.


Nolan Darilek napsal(a):
 I'm slowly hacking on a project that could benefit from an embedded
 database, and I'm not smart enough to create my own binary format.
 Furthermore, since we aren't usually under as severe constraints with
 embedded resources these days, an actual embedded DB makes more sense. I
 had a few questions regarding people's experiences, however.

 At the moment, I'm hacking on a prototype that uses Tokyo Cabinet's
 table store, and geohashes to implement geospatial searches. I'm still
 working on refining the import process so haven't experimented with how
 well searches work, and of course geohashes fail near the
 equator/meridians, so it feels a bit kludgy. Even so, my Ruby code
 imports a 13.4 meg OSM file into a 7.9M database in about a minute, so
 performance doesn't seem terrible. I'll still have to implement routing,
 though, and my geohash hack is about as far as I'll be able to take TC
 without implementing a custom geospatial datastore, which should be
 possible for someone smarter than I, but then TC's development process
 is less than ideal and I don't think it's a good fit.

 Has anyone used SQLite for more than rendering? There's one report of it
 working well with Mapnik and another suggestion that it might not. Does
 anyone have any other experiences to share? How about a working schema
 and some example import code?

 I've been reading references to MonetDB. I've googled, but its website
 seems somewhat disorganized. There appears to be a kernel atop which
 several interfaces are built? I've encountered references to geospatial
 support, and routing/embedded use was mentioned here recently. Is the
 geospatial support confined to a single implementation--only the SQL
 support, for instance--or does it work across the board? Is there any
 intro documentation anywhere? I mean, of course there are manuals and
 tutorials for each component, but what about a tying-it-all-together
 this is what our architecture gives you that others don't introduction
 that helps me understand, say, how the different versions can interact?
 How well does it work with Ruby? Again, either my GoogleFu is weak or
 it's just not getting used much, because while it reveals the presence
 of a Ruby library, I can't seem to find any here's what's cool about
 this and how to start using it blog posts or articles. Feel free to
 toss out URLs to anything I might have missed, as it certainly isn't my
 intent to use this list for discussion if there are better resources
 more readily available, but I'm just not seeing them. :) I've also
 looked through some of the server/SQL/Xquery docs, but am not clear on
 how they apply to OSM. Can an XML document be added in its XML form and
 queried via SQL somehow? Or is there some intermediate import step that
 makes the data available for routing? Or have I just mis-interpreted
 what is currently possible? :)

 Finally, are there any other embedded solutions I may have missed?
 Ideally, whatever format I use should be accessible via Ruby, whether
 via existing wrappers or by C libraries I can interface using FFI.



 ___
 dev mailing list
 dev@openstreetmap.org
 http://lists.openstreetmap.org/listinfo/dev
   


___
dev mailing list
dev@openstreetmap.org
http://lists.openstreetmap.org/listinfo/dev


Re: [OSM-dev] Can SQLite3 handle OSM 150G data file?

2009-04-28 Thread Christoph Eckert
Hi,

 There is no reason to be sqlite slow. How much are you are using
 transactions on your local db? What are you using for import? I'm
 importing Czech republic (50Mb bziped) in one or two minutes. So for
 5.4GB it takes 108 minutes (two hours). But I'm importig to modified osm
 schema (something like mapnik schema in postgress). It is because of
 query speed.

sounds cool. Is the Script that does the conversion from osm.xml into sqlite 
available somewhere?

Thanks  best regards,

ce

___
dev mailing list
dev@openstreetmap.org
http://lists.openstreetmap.org/listinfo/dev


Re: [OSM-dev] [bug] direction of GPS traces

2009-04-28 Thread Graham Jones (Physics)
This thread seemed to fizzle out without coming to a conclusion.  I would
suggest the following:

   - Many developers (never mind users) did not appreciate that the opposite
   of 'public' in this context is 'anonymous'.
   - Although the wiki does explain this, the GPX upload page does not, it
   just has a 'public' checkbox.
   - It is not unreasonable for users to think that the opposite of 'public'
   is 'private' - ie, only visible to the user who uploaded the trace.
   - We should include some text next to the 'public' checkbox to explain -
   something like Note that all GPX traces uploaded to OSM are visible to all
   users.  Selecting 'public' will associate the trace the user who uploaded
   it, otherwise it will be anonymous.

Does this sound reasonable?  I would offer to add the text myself, but I
can't find the HTML in the SVN repository.  Please will someone either make
this change (or something similar), or tell me how to do it?

Regards


Graham.

2009/4/16 Johnny Rose Carlsen o...@wenix.dk

 Frederik Ramm frede...@remote.org wrote:
  Karl Newman wrote:
   I've been around OSM for a few years now and I was not aware
   private GPS trackpoints were available for download.
 
  Firstly, the API does not talk of private GPS tracks. It only gives
  you a checkbox saying public.

 If you go to My GPS traces, then it says PRIVATE with red letters.

 Maybe indicating that the traces are anonymous would be better.

 Best Regards,
  - Johnny Carlsen

 ___
 dev mailing list
 dev@openstreetmap.org
 http://lists.openstreetmap.org/listinfo/dev




-- 
Dr. Graham Jones
Hartlepool, UK
email: grahamjones...@gmail.com
___
dev mailing list
dev@openstreetmap.org
http://lists.openstreetmap.org/listinfo/dev


Re: [OSM-dev] Can SQLite3 handle OSM 150G data file?

2009-04-28 Thread Robert Joop
On 09-04-28 09:14:31 CEST, marcus.wolsc...@googlemail.com wrote:
 Is there ANY embedded database out there that can handle the planet?
 Anything that does not require the (unskilled) user of a program to
 install a local database-server first?

has anybody tried embedded innodb?
i saw mention of it in the news a few days ago.

rj

___
dev mailing list
dev@openstreetmap.org
http://lists.openstreetmap.org/listinfo/dev


[OSM-dev] Slippy Map Elevation Overlay

2009-04-28 Thread Graham Jones (Physics)
I sometimes think that the main slippy map has a bit too much plain white,
especially in undeveloped places where there are not many roads such as the
Pennines or North Yorkshire Moors in Northern England - I keep wondering if
this is an un-mapped area, or if there is nothing there

The cycle map is very good with shaded elevation contours, but the main
osmarender and mapnik maps do not include this.
I would like this sort of shading to be available for the main map too, but
I am not convinced that rendering it into the tiles is good, because
sometimes those extra colours or contour lines are a distraction, so it
would be nice for the user to be able to switch them off.

I wondered if there is any reason why we could not create an overlay of
elevation information (contours and or shading) that could sit on top of the
main map as a user selectable leayer?

I have had a quick go at http://maps.webhop.net/srtm.html.  It sort of works
- the high ground stands out, and you can see the shape of the ground, and
you can switch the overlay off and on.  It does not work that well as an
overlay though because it is not really transparent enough.  I find that
sometimes the transparency works quite well and you can see the map
underneath, and others it is practically opaque.

I struggle a bit with javascript and openlayers and wondered if anyone could
suggest how I could sort out the opacity problem a bit better?
Maybe the main map should use a transparent background, and use the
elevation data as the base layer with the map as the overlay?

Regards


Graham.

-- 
Dr. Graham Jones
Hartlepool, UK
email: grahamjones...@gmail.com
___
dev mailing list
dev@openstreetmap.org
http://lists.openstreetmap.org/listinfo/dev


[OSM-dev] Problems with rendering tiles with mapnik

2009-04-28 Thread Mohamad Ali
Actually guys, I have Ubuntu OS, and I am a newbie to Linux,

I think You are right, Ubuntu is missing the shell,

I googled about Install sh but I didn't find information that can help me
to fix the problem?

Please can u give me more details?

 

Thanks guys,

 

Mohamad

___
dev mailing list
dev@openstreetmap.org
http://lists.openstreetmap.org/listinfo/dev


Re: [OSM-dev] Problems with rendering tiles with mapnik

2009-04-28 Thread Iván Sánchez Ortega
El Miércoles, 29 de Abril de 2009, Mohamad Ali escribió:
 Actually guys, I have Ubuntu OS, and I am a newbie to Linux,

 I think You are right, Ubuntu is missing the shell,

Missing??

Applications - Accesories - Terminal ...

-- 
--
Iván Sánchez Ortega i...@sanchezortega.es

http://ivan.sanchezortega.es
MSN:i_eat_s_p_a_m_for_breakf...@hotmail.com
Jabber:ivansanc...@jabber.org ; ivansanc...@kdetalk.net
IRC: ivansanchez @ OFTC  freenode


signature.asc
Description: This is a digitally signed message part.
___
dev mailing list
dev@openstreetmap.org
http://lists.openstreetmap.org/listinfo/dev


[OSM-dev] More Immediate Changeset Feedback

2009-04-28 Thread Ian Dees
Would it be possible (I know, patches welcome -- I'm just asking about
feasibility right now) to stream the node IDs back as the API creates them
instead of waiting until the /changeset/upload operation is finished? This
would potentially kill two birds with one stone:

1. Give the clients the ability to show progress
2. Save some memory on the API server (don't have to store the node IDs in
memory, can just stream them out)
___
dev mailing list
dev@openstreetmap.org
http://lists.openstreetmap.org/listinfo/dev


Re: [OSM-dev] Problems with rendering tiles with mapnik

2009-04-28 Thread Iván Sánchez Ortega
El Miércoles, 29 de Abril de 2009, Dirk-Lüder Kreie escribió:
  I think You are right, Ubuntu is missing the shell,
 
  Missing??

 he has /bin/bash apparently, but not /bin/sh

Debian and Debian-like systems (i.e. Ubuntu) use bash as a replacement of sh.

So, if /bin/sh is *really* missing, just running ln -s /bin/bash /bin/sh 
should solve the problem.

-- 
--
Iván Sánchez Ortega i...@sanchezortega.es

A todos nos gustan las citas sin sentido sacadas de películas mediocres que 
nos hacen parecer intelectuales.
 -- The Ninja Bunny


signature.asc
Description: This is a digitally signed message part.
___
dev mailing list
dev@openstreetmap.org
http://lists.openstreetmap.org/listinfo/dev


Re: [OSM-dev] Problems with rendering tiles with mapnik

2009-04-28 Thread Mohamad Ali
I have 
Applications - Accesories - Terminal ...





-Original Message-
From: Dirk-Lüder Kreie [mailto:osm-l...@deelkar.net] 
Sent: Wednesday, April 29, 2009 10:05 AM
To: Iván Sánchez Ortega
Cc: dev@openstreetmap.org; Mohamad Ali
Subject: Re: [OSM-dev] Problems with rendering tiles with mapnik

Iván Sánchez Ortega schrieb:
 El Miércoles, 29 de Abril de 2009, Mohamad Ali escribió:
 Actually guys, I have Ubuntu OS, and I am a newbie to Linux,

 I think You are right, Ubuntu is missing the shell,
 
 Missing??

he has /bin/bash apparently, but not /bin/sh

-- 

Dirk-Lüder Deelkar Kreie
Bremen - 53.0952°N 8.8652°E



___
dev mailing list
dev@openstreetmap.org
http://lists.openstreetmap.org/listinfo/dev


Re: [OSM-dev] Slippy Map Elevation Overlay

2009-04-28 Thread MilesTogoe
Graham Jones (Physics) wrote:
 I sometimes think that the main slippy map has a bit too much plain 
 white, especially in undeveloped places where there are not many roads 
 such as the Pennines or North Yorkshire Moors in Northern England - I 
 keep wondering if this is an un-mapped area, or if there is nothing 
 there

 The cycle map is very good with shaded elevation contours, but the 
 main osmarender and mapnik maps do not include this.
 I would like this sort of shading to be available for the main map 
 too, but I am not convinced that rendering it into the tiles is good, 
 because sometimes those extra colours or contour lines are a 
 distraction, so it would be nice for the user to be able to switch 
 them off.

 I wondered if there is any reason why we could not create an overlay 
 of elevation information (contours and or shading) that could sit on 
 top of the main map as a user selectable leayer?

 I have had a quick go at http://maps.webhop.net/srtm.html.  It sort of 
 works - the high ground stands out, and you can see the shape of the 
 ground, and you can switch the overlay off and on.  It does not work 
 that well as an overlay though because it is not really transparent 
 enough.  I find that sometimes the transparency works quite well and 
 you can see the map underneath, and others it is practically opaque.
pretty nice, though when zoomed in, it gets blocky - maybe this is 
actually how the parcel boundaries are, maybe you where just trying to 
get stuff prototyped.I keep thinking it would be nice to integrate 
OSM data with free satellite data like java based WorldWind NASA data as 
the background - haven't really researched this yet. 



___
dev mailing list
dev@openstreetmap.org
http://lists.openstreetmap.org/listinfo/dev


[OSM-dev] Hi OpenStreetMap

2009-04-28 Thread Sam Mor
Hi Guys
We are very happy to join your Project,
Wonderful Project
We will take a breath and go deeper..

Have  a Nice Day 
Sam


  The new Internet Explorer 8 optimised for Yahoo!7: Faster, Safer, Easier.___
dev mailing list
dev@openstreetmap.org
http://lists.openstreetmap.org/listinfo/dev


[OSM-dev] List of Questions

2009-04-28 Thread Sam Mor
Sorry We are at beginning, but it's good to understand the basics,

 how do mapnik create the image from osm file?


where are the images are located?


  Enjoy a better web experience. Upgrade to the new Internet Explorer 8 
optimised for Yahoo!7. Get it now.___
dev mailing list
dev@openstreetmap.org
http://lists.openstreetmap.org/listinfo/dev


[OSM-dev] building A openstreetmap server

2009-04-28 Thread Sam Mor
I would to comment about I read:
is it correct that everyone can build his openstreet map server?
if yes , what are the needs of hardwares and softwares?


I tried long time to look for a free mapping system, but I didnt and I think 
OpenStreetMap is a Wonderful one if it's open source and can be used 
everywhere...

Cheers Guys



  Enjoy a safer web experience. Upgrade to the new Internet Explorer 8 
optimised for Yahoo!7. Get it now.___
dev mailing list
dev@openstreetmap.org
http://lists.openstreetmap.org/listinfo/dev


Re: [OSM-dev] List of Questions

2009-04-28 Thread Sam Mor

 
Mapnik get :
-the images from Symbols file 
- data from osm files 
then mapnik draws (renders) tha images
is it true?


and about mod_tile, we need to read it first.. sorry not yet finished

thanks, 
and it was a funny joke, hahaha

Cheers



From: Stephan Plepelits sk...@xover.htu.tuwien.ac.at
To: Sam Mor sam_...@y7mail.com
Cc: OpenstreetMap DevList dev@openstreetmap.org
Sent: Wednesday, 29 April, 2009 2:29:04 PM
Subject: Re: [OSM-dev] List of Questions

On Tue, Apr 28, 2009 at 08:35:35PM -0700, Sam Mor wrote:
 Sorry We are at beginning, but it's good to understand the basics,
  
  how do mapnik create the image from osm file?
  
Check out this howto:
http://wiki.openstreetmap.org/wiki/Mapnik

 where are the images are located?
It depends where you put them ;) Sorry  I'm kidding.

You can either render them before you serve them to the Web, which doesn't
sound bad first, but unfortunately it takes a long time. As alternative you
can use mod_tile, an extension for the apache webserver, which renders on
demand, and as an advantage serves cached tiles much faster than apache
alone.
http://wiki.openstreetmap.org/wiki/Mod_tile

Hope I could help you.

greetings,
        Stephan
-- 
Seid unbequem, seid Sand, nicht Öl im Getriebe der Welt! - Günther Eich
,-.
| Stephan Plepelits,                                                  |
| Technische Universität Wien  -    Studium Informatik  Raumplanung |
|  openstreetbrowser.org  couchsurfing.com  tubasis.at  bl.mud.at |
| sk...@xover..htu.tuwien.ac.at      -      My Blog: http://plepe.at |
`-'



  The new Internet Explorer 8 optimised for Yahoo!7: Faster, Safer, Easier.___
dev mailing list
dev@openstreetmap.org
http://lists.openstreetmap.org/listinfo/dev


Re: [josm-dev] Deletion conflicts

2009-04-28 Thread Dirk Stöcker
On Mon, 27 Apr 2009, Frederik Ramm wrote:

 Idea 2: Before re-downloading an area, let JOSM mark all objects that
 came from the API on the last download as possibly deleted. On merging
 the newly downloaded dataset with the existing data, reset that flag for
 every object retrieved from the API. The remaining objects flagged
 possibly deleted have been deleted on the server and should either be
 silently removed, or if they have local modifications, a conflict dialog
 needs to be shown.

Probably this idea combined with special status request for these nodes 
with that flag are best.

And if the node status request could be done for multiple nodes at once it 
would speed up a lot.

Ciao
-- 
http://www.dstoecker.eu/ (PGP key available)


___
josm-dev mailing list
josm-dev@openstreetmap.org
http://lists.openstreetmap.org/listinfo/josm-dev


Re: [josm-dev] Deletion conflicts

2009-04-28 Thread Shaun McDonald

On 28 Apr 2009, at 08:17, Dirk Stöcker wrote:

 On Mon, 27 Apr 2009, Frederik Ramm wrote:

 Idea 2: Before re-downloading an area, let JOSM mark all objects that
 came from the API on the last download as possibly deleted. On  
 merging
 the newly downloaded dataset with the existing data, reset that  
 flag for
 every object retrieved from the API. The remaining objects flagged
 possibly deleted have been deleted on the server and should  
 either be
 silently removed, or if they have local modifications, a conflict  
 dialog
 needs to be shown.

 Probably this idea combined with special status request for these  
 nodes
 with that flag are best.

 And if the node status request could be done for multiple nodes at  
 once it
 would speed up a lot.


It is already possible to do a multiget, thus up to 4 requests would  
be required. Map, then one for each of nodes, ways and relations.
http://wiki.openstreetmap.org/wiki/OSM_Protocol_Version_0.6#Multi_fetch:_GET_.2Fapi.2F0.6.2F.5Bnodes.7Cways.7Crelations.5D
 
 

Shaun


___
josm-dev mailing list
josm-dev@openstreetmap.org
http://lists.openstreetmap.org/listinfo/josm-dev


Re: [josm-dev] Deletion conflicts

2009-04-28 Thread Frederik Ramm
Hi,

Shaun McDonald wrote:
 It is already possible to do a multiget, 

... which will return 404 as soon as any one of its targets has been 
deleted ;-)

Bye
Frederik


___
josm-dev mailing list
josm-dev@openstreetmap.org
http://lists.openstreetmap.org/listinfo/josm-dev


Re: [josm-dev] Deletion conflicts

2009-04-28 Thread Marko Mäkelä
On Tue, Apr 28, 2009 at 11:32:51AM +0200, Rolf Bode-Meyer wrote:
 2009/4/27 Frederik Ramm frede...@remote.org:
  (Incidentally - how can a node have only one version and this is
  deleted? Would one not have to first create the node, making v1, then
  delete it, making v2?)
 
 Why? Deleting doesn't create a version of the deleted element. I don't
 think CVS does either.

CVS (and RCS, I think) do in a sense create a version of the deleted
element, by moving the ,v file to an Attic directory in the repository.

I think that the revision-per-tree approach of Subversion makes much more
sense than the revision-per-file approach of CVS and RCS.  The Subversion
model could be impractical for OSM, though.  There are so many objects
being edited concurrently, all over the world.  While someone is working
on a small local change, the global revision count could easily grow by
hundreds or thousands.

How do distributed revision control systems solve this problem?

Marko

___
josm-dev mailing list
josm-dev@openstreetmap.org
http://lists.openstreetmap.org/listinfo/josm-dev


Re: [josm-dev] Deletion conflicts

2009-04-28 Thread Frederik Ramm
Hi,

Rolf Bode-Meyer wrote:
 (Incidentally - how can a node have only one version and this is
 deleted? Would one not have to first create the node, making v1, then
 delete it, making v2?)
 
 Why? Deleting doesn't create a version of the deleted element. I don't
 think CVS does either.

I don't know about CVS, but in OSM, deleting something *does* create a 
new version that differs from the previous version only in the value of 
the visible attribute (and of course changeset and timestamp).

Bye
Frederik

___
josm-dev mailing list
josm-dev@openstreetmap.org
http://lists.openstreetmap.org/listinfo/josm-dev


Re: [josm-dev] Deletion conflicts

2009-04-28 Thread Rolf Bode-Meyer
2009/4/27 Frederik Ramm frede...@remote.org:
 (Incidentally - how can a node have only one version and this is
 deleted? Would one not have to first create the node, making v1, then
 delete it, making v2?)

Why? Deleting doesn't create a version of the deleted element. I don't
think CVS does either.

Rolf

___
josm-dev mailing list
josm-dev@openstreetmap.org
http://lists.openstreetmap.org/listinfo/josm-dev