Re: [OSM-dev] Fwd: Re: OSM and MongoDB

2011-04-13 Thread Greg Studer
Agree, think the issue in this case definitely wasn't related to multiple machines. In general, though, you often can do much better performance-wise on large data sets by running queries on data subsets across multiple systems, whatever software you use. Most NoSQL dbs try to make this particula

Re: [OSM-dev] Fwd: Re: OSM and MongoDB

2011-04-13 Thread Ian Dees
On Wed, Apr 13, 2011 at 2:35 PM, Andreas Scheucher < andreas.scheuc...@gmail.com> wrote: > hi, > > some weeks ago, i got interested in NoSQL datababase products. I had no > experience with them up to now, but as it was a requirement for an job, I > started to read about apache cassandra and thougt

Re: [OSM-dev] Fwd: Re: OSM and MongoDB

2011-04-13 Thread Andreas Scheucher
hi, some weeks ago, i got interested in NoSQL datababase products. I had no experience with them up to now, but as it was a requirement for an job, I started to read about apache cassandra and thougth, this would be interesting for openstreetmaps. up to now my findings are only theoreticaly, but

Re: [OSM-dev] Fwd: Re: OSM and MongoDB

2011-04-13 Thread Greg Studer
MongoDB does use a geohash as the indexing method for geo-searches, but pretty sure that's not the cause of the huge query times. The geohashing tends to be very fast, but the way points were buffered for return in pre-1.9 releases could in particular point distributions cause these slowdowns - I'

Re: [OSM-dev] Fwd: Re: OSM and MongoDB

2011-04-13 Thread Ian Dees
On Tue, Apr 12, 2011 at 3:56 PM, Steve Coast wrote: > Interesting. > > How efficient is the (big)int indexing and/or masking? > I haven't had a chance to look at the integer indexing/masking. If I remember it from discussions on dev a long while ago I think it's very close to geohashes. > > W

Re: [OSM-dev] Fwd: Re: OSM and MongoDB

2011-04-12 Thread Steve Coast
Interesting. How efficient is the (big)int indexing and/or masking? Was this all on a single machine? On 4/12/2011 1:52 PM, Ian Dees wrote: Yep. On Tue, Apr 12, 2011 at 3:51 PM, Steve Coast > wrote: and using the builtin spatial index? On 4/12/2011 1:

Re: [OSM-dev] Fwd: Re: OSM and MongoDB

2011-04-12 Thread Nolan Darilek
On 04/12/2011 03:47 PM, Steve Coast wrote: how was the data put in the db though? 1 document per node? Yes, with deeper structures for ways and relations. ___ dev mailing list dev@openstreetmap.org http://lists.openstreetmap.org/listinfo/dev

Re: [OSM-dev] Fwd: Re: OSM and MongoDB

2011-04-12 Thread Ian Dees
Yep. On Tue, Apr 12, 2011 at 3:51 PM, Steve Coast wrote: > and using the builtin spatial index? > > > > On 4/12/2011 1:50 PM, Ian Dees wrote: > > Yes, one document per node/way/relation. > > On Tue, Apr 12, 2011 at 3:47 PM, Steve Coast wrote: > >> how was the data put in the db though? 1 docu

Re: [OSM-dev] Fwd: Re: OSM and MongoDB

2011-04-12 Thread Steve Coast
and using the builtin spatial index? On 4/12/2011 1:50 PM, Ian Dees wrote: Yes, one document per node/way/relation. On Tue, Apr 12, 2011 at 3:47 PM, Steve Coast > wrote: how was the data put in the db though? 1 document per node? On 4/12/2011 1:39 PM, Nol

Re: [OSM-dev] Fwd: Re: OSM and MongoDB

2011-04-12 Thread Ian Dees
Yes, one document per node/way/relation. On Tue, Apr 12, 2011 at 3:47 PM, Steve Coast wrote: > how was the data put in the db though? 1 document per node? > > > On 4/12/2011 1:39 PM, Nolan Darilek wrote: > > Oopse, meant for this to go to the whole list. > > > > Original Message --

Re: [OSM-dev] Fwd: Re: OSM and MongoDB

2011-04-12 Thread Steve Coast
how was the data put in the db though? 1 document per node? On 4/12/2011 1:39 PM, Nolan Darilek wrote: Oopse, meant for this to go to the whole list. Original Message Subject:Re: [OSM-dev] OSM and MongoDB Date: Tue, 12 Apr 2011 15:26:41 -0500 From: Nolan Darilek

[OSM-dev] Fwd: Re: OSM and MongoDB

2011-04-12 Thread Nolan Darilek
Oopse, meant for this to go to the whole list. Original Message Subject:Re: [OSM-dev] OSM and MongoDB Date: Tue, 12 Apr 2011 15:26:41 -0500 From: Nolan Darilek To: Ian Dees I had/am having a somewhat bad experience storing OSM data in MongoDB. Initially I