Re: First Time Post, am I in the right place for this Post

2014-08-29 Thread Luke Bakken
Hi Spiro, The keys are generated by Riak CS and stored in the database. You'll want to use the Riak CS generated ones. -- Luke Bakken CSE lbak...@basho.com On Fri, Aug 29, 2014 at 8:12 AM, Spiro N wrote: > Hello, I love the idea of an s3 alternative and was wondering if there was > anyway to

Re: Buckets

2014-08-29 Thread lloyd
Good to know. Many thanks, Luke. Lloyd -Original Message- From: "Luke Bakken" Sent: Friday, August 29, 2014 1:18pm To: ll...@writersglen.com Cc: "riak-users" Subject: Re: Buckets Hi Lloyd, As long as the buckets use the default bucket properties (Riak 1.X series) or share a bucket ty

Re: Buckets

2014-08-29 Thread Luke Bakken
Hi Lloyd, As long as the buckets use the default bucket properties (Riak 1.X series) or share a bucket type (Riak 2.X series), there is no real limit to how many you can create outside of server capacity limits. -- Luke Bakken CSE lbak...@basho.com On Fri, Aug 29, 2014 at 10:08 AM, wrote: > H

Buckets

2014-08-29 Thread lloyd
Hello, Is there a practical limit to the number of buckets defined in a given Riak installation? E.g.: I could have a bucket called people with records for each person. Or, I could have a bucket for each person with records related to that person. But clearly, in the second case, the number of

Re: Riak Secondary Index Limits

2014-08-29 Thread Sean Cribbs
Correct, there is a key in LevelDB for each Riak key that has the index term attached. This is somewhat mitigated by Snappy compression (600K records might very well compress into a single block), but it is nowhere near the storage efficiency of something like Solr's indexes. It still has to scan.

Re: Riak Secondary Index Limits

2014-08-29 Thread Bryan
Hi Sean, Sweet! Thanks for the explanation. Much appreciated and very helpful. Just a bit more clarification, on an equality lookup, where the ‘foobar’ key has a value ‘barfoo’ that is the very low-cardinality, are those indexed objects individually stored as a key/value term which then is enu

Re: Riak VS Graph Databases

2014-08-29 Thread Alex De la rosa
Yeah, I know it might be hard to only use Riak, but I want to try see how much I can do with only 1 system. If later I have to add more complexity to the system, so be it :) but i will squeeze my brain as much as i can to model the data in a way not much relationships may be required and probably R

Re: Riak VS Graph Databases

2014-08-29 Thread Guido Medina
In a dream world my friend, we have Riak, PostgreSQL and Solr and might have to include a sort of query-able Big Table implementation in the future like Cassandra (we will try to avoid this last thing until we can't) Your Graph DB will have trade off versus KV fetch in general, I don't think y

First Time Post, am I in the right place for this Post

2014-08-29 Thread Spiro N
Hello, I love the idea of an s3 alternative and was wondering if there was anyway to use my s3 acces and secret keys with riak-cs. I tried substituting my keys for the generated ones in both riak-cs and stanchion app.config files to no avail. Thanks for any help you can provide, and if I posted in

Re: Riak VS Graph Databases

2014-08-29 Thread Pedro Larroy
Hi Alex Did you have a look at orientdb, it might fit the need that you describe. Pedro. On Aug 29, 2014 5:07 PM, "Alex De la rosa" wrote: > Hi Guido, > > This could be a solution; although I would try to do it in an homogeneous > system where only one NoSQL DB would be around if possible :) >

Re: Riak VS Graph Databases

2014-08-29 Thread Alex De la rosa
Hi Guido, This could be a solution; although I would try to do it in an homogeneous system where only one NoSQL DB would be around if possible :) Thanks! Alex On Fri, Aug 29, 2014 at 5:03 PM, Guido Medina wrote: > Maybe what you are looking for is a combination of both, say, your KV > data i

Re: Riak VS Graph Databases

2014-08-29 Thread Guido Medina
Maybe what you are looking for is a combination of both, say, your KV data in Riak with a combination of background processes able to build the necessary searching graphs in Neo4J, in such way your data is secure in a Riak cluster and searchable on several Neo4J servers. That's just an idea wh

Riak VS Graph Databases

2014-08-29 Thread Alex De la rosa
Hi there, For some time already I have in mind building a kind of social network myself. Is pretty ambitious project although it doesn't have in mind to be a new facebook; but still data will be quite big and complex. I like Riak and I had been following since version 0.14, and new additions in R

Re: Custom data-types

2014-08-29 Thread Alex De la rosa
Hi Sean, Seems I was wrong, that makes total sense now that you exposed it, looked a "too good" feature to me, but seems is not that easy. By the way, how does "schemas" really work for Riak Search? I went back and read the documentation but didn't see a real difference from using the default sch

Re: Riak Secondary Index Limits

2014-08-29 Thread Sean Cribbs
I made a minor mistake in my example, the PrimaryKey is part of the index key, whereas the value contains nothing. It's more like this: {i, IndexName, IndexTerm, PrimaryKey} => <<>> So for the initial seek, we construct a key like so: {i, <<"foobar_bin">>, <<"baz">>, <<>>} On Fri, Aug 29, 2014

Re: Riak Secondary Index Limits

2014-08-29 Thread Sean Cribbs
Hi Bryan, Index entries are just keys in LevelDB like normal values are. So, performance is relatively constant at write time but is O(N) at read (because you are scanning the index). The high-cardinality term will definitely be expensive to enumerate, but the low-cardinality terms will be much le

Re: Custom data-types

2014-08-29 Thread Sean Cribbs
Alex, In short, no, you can't create custom types through schemas. Schemas currently only refer to Riak Search 2. We would love that too, but it hasn't happened yet. The problem is not conceiving of a data type but making its behavior both sensible and convergent in the face of concurrent activit