Re: Secondary indexes or Riak search ?

2017-02-13 Thread John Daily
> > A quick look at riak_test it seems that the `return_body` parameter is > generally supported for both HTTP and PB now. I wasn’t aware of that. I’m not sure into which releases the feature has made it, but bewarned: if it works at all, return_body only works for system indexes: $bucket and $

Re: [Basho Riak] Fail To Update Document Repeatly With Cluster of 5 Nodes

2017-02-11 Thread John Daily
"young_vclock":20}} > > > I repeated with the steps as mentioning at previous email, I got the > following results : > > When response of riakc_pb_socket:modify_type are > {error,<<"{error,locked}">>}, I have to wait some seconds to call >

Re: [Basho Riak] Fail To Update Document Repeatly With Cluster of 5 Nodes

2017-02-10 Thread John Daily
; {update,{<<"end_time">>,register},{assign,<<"dont_use">>}},{update,{<<"currency">>,register},{assign,<<"cad">>}}, > >>> > > {update,{<<"created_time_dt">>,register}, > >>> > > {ass

Re: [Basho Riak] Fail To Update Document Repeatly With Cluster of 5 Nodes

2017-02-10 Thread John Daily
t;<"0-634736bc14e0bd3ed7e3fe0f1ee64443">>}}, >>>>>> {update,{<<"maintain_mode_b">>,register},{assign,<<"false">>}}, >>>>>> {update,{<<"id">>,register}, >>>>>> {assign,<&l

Re: [Basho Riak] Fail To Update Document Repeatly With Cluster of 5 Nodes

2017-02-06 Thread John Daily
Originally I suspected the context which allows Riak to resolve conflicts was not present in your data, but I see it in your map structure. Thanks for supplying such a detailed description. How fast is your turnaround time between an update and a fetch? Even if the cluster is healthy it’s not i

Re: List all keys on a small bucket

2016-12-08 Thread John Daily
coverage query, but if it’s leveldb at least you will seek to the > start of the bucket and iterate over only the keys in that bucket. > > Cheers > > Russell > >> On 8 Dec 2016, at 21:19, John Daily wrote: >> >> The size of the bucket has no real impact on th

Re: List all keys on a small bucket

2016-12-08 Thread John Daily
The size of the bucket has no real impact on the cost of a list keys operation because each key on the cluster must be examined to determined whether it resides in the relevant bucket. -John > On Dec 8, 2016, at 4:17 PM, Arun Rajagopalan > wrote: > > Hello Riak Users > > I have a use case w

Re: Inconsistency in Querying Riak TS?

2016-10-17 Thread John Daily
One of the catches regarding the quantum limit is that unless the query starts exactly on a boundary, the effective limit is one fewer because it is determined by the number of partitions the query has to touch. I suspect that's the behavior you're seeing. Sent from my iPhone > On Oct 17, 2016,

Re: RiakTS and Multi-Backend

2016-10-12 Thread John Daily
s. > > Are others who need both a general KV store and the TS functionality running > multiple clusters to handle this use case? > > Thanks for the quick reply! > > > Damion > >> On Oct 12, 2016, at 11:53 AM, John Daily wrote: >> >> We have not

Re: RiakTS and Multi-Backend

2016-10-12 Thread John Daily
We have not done any work to support the multi-backend, hence the error you’re seeing. TS depends exclusively on leveldb. We’re not recommending the use of KV functionality in the TS product yet, because the latter is still changing rapidly and we will need to go back and fix some basic KV mech

Re: Riak cluster protected by firewall

2016-09-17 Thread John Daily
You should find most of what you need here: http://docs.basho.com/riak/kv/2.1.4/using/security/ Sent from my iPhone On Sep 17, 2016, at 1:26 PM, Alex De la rosa wrote: Hi all, I have a cluster of 5 nodes connected to each other and now I want to use UFW to deny any external incoming traffic i

Re: Creating riak-kv bucket type programmatically

2016-07-05 Thread John Daily
We punted on a bucket type API with Riak 2.0 because we tied authorization heavily to bucket types and didn’t have the time to unravel that knot. Since then we have yet to prioritize it. I will make sure this is on the roadmap. -John > On Jul 5, 2016, at 2:15 PM, Nguyen, Kyle wrote: > > Hi a

Re: A put is not put in Riak

2015-12-30 Thread John Daily
This smells like a clock problem. Are you confident all of your servers’ clocks are set to the same time? Updates can be treacherous if clocks are not synchronized and multiple writes to the same key occur in a period of time short enough to fit within the clock skew. I wrote about this after

Re: Riak Character Encoding

2015-11-29 Thread John Daily
retrieved from the <<"відро"/utf8>> bucket. -John Daily jda...@basho.com On Thu, Nov 26, 2015 at 3:10 AM, Fasil K wrote: > Thanks Daniel. This means a lot > > With Regards, > > Fasil K > > On Thu, Nov 26, 2015 at 1:10 PM, Daniel Abrahamsson < > da

Re: Build Riak wirh Erlang 18

2015-11-17 Thread John Daily
One of our engineers has been working on 18 for a while now. He’s not around today, but hopefully will chime in soon. -John > On Nov 17, 2015, at 1:45 PM, Victor Medina wrote: > > =)first of all thanks! > > Im building it with OTP17. Everything seems to be just fine with 17 so far... > Thin

Re: Rolling upgrade from 1.4.2 to 2.0.5

2015-08-05 Thread John Daily
That’s correct: upgrades to either 2.0.x or 2.1.x are supported from the 1.4 series. Side note: I definitely recommend testing the upgrade process in a QA environment first. -John On Aug 5, 2015, at 12:13 PM, Sujay Mansingh wrote: Hello all, I have a 5 node riak cluster, all nodes running 1.4

Re: scaling up vertically upgrading HD

2015-04-23 Thread John Daily
Riak does not currently try to protect you against dumping 2 gallons of water in a 1 gallon jug, so each node will write data until it can’t. -John On Apr 23, 2015, at 10:42 AM, Alex De la rosa wrote: > Cool, thank you :) however, is true that if 4 nodes are 1TB and the other one > is 2TB; th

Re: riak 2.0 + riak-cs 2.0 trouble

2015-04-17 Thread John Daily
provided in an Erlang array, with square brackets and a period terminating it. See http://pastebin.com/90gh6amg. -John On Apr 17, 2015, at 8:24 AM, Stanislav Vlasov wrote: > 2015-04-17 17:04 GMT+05:00 John Daily : >> Unfortunately it’s very easy to introduce syntax errors in

Re: riak 2.0 + riak-cs 2.0 trouble

2015-04-17 Thread John Daily
Unfortunately it’s very easy to introduce syntax errors into Erlang configuration files (and tricky to diagnose them without Erlang experience), which is why we’re moving toward the newer sysctl-style files like riak.conf. The example in the documentation looks ok; can we see a copy of your adv

Re: Android client, Riak server

2015-04-16 Thread John Daily
Agreed: exposing any database directly to the Internet is risky, and Riak’s security introduced in 2.0 doesn’t really change that. -John On Apr 16, 2015, at 4:25 PM, Alexander Sicular wrote: > That should work but are you sure you want to expose your riak server to the > Internet? I would rec

Re: [riak-user] can store images directly in Riak?

2015-02-20 Thread John Daily
Both LevelDB and Bitcask are optimized for smaller objects, so neither will be particularly good at it. Again: this is possible but discouraged. -John On Feb 20, 2015, at 10:01 AM, SeanProtain wrote: > HI John, > > Thank you! Then which backend I should choose to store images? > > Subject:

Re: [riak-user] can store images directly in Riak?

2015-02-20 Thread John Daily
You certainly can with some careful tuning. However, if Riak is being used for heavy traffic loads, you’ll likely see poor performance as a consequence. Those large objects effectively clog the pipes temporarily. Hopefully someone can chime in with tuning recommendations, but make certain allo

Re: Riak 1.3.1 high swap usage

2015-02-19 Thread John Daily
Daniel, you may be aware of this, but a 3-node Riak cluster is not recommended and may be playing a minor role in your resource problems. Every request will hit every server (except for some requests that are being made twice against a single server, making I/O that much worse), and depending on yo

Re: Implementation of the possibility of "subscribe"

2015-01-27 Thread John Daily
otaryPhone > > On Jan 24, 2015, at 08:55, Никита Нежевский > wrote: > > Thank you for your reply, I will try to use post-commit hooks. But is it > possible to realize this possibility at riak-erlang-client? > > Sat Jan 24 2015 at 0:12:57, John Daily >: > >&g

Re: Implementation of the possibility of "subscribe"

2015-01-23 Thread John Daily
You may wish to take a look at the support for post-commit hooks: http://docs.basho.com/riak/latest/dev/advanced/commit-hooks/ -John On Jan 23, 2015, at 1:54 PM, Никита Нежевский wrote: > Hello. > I've used riak for online processing of incoming data and faced with problem. > I've used riak-er

Re: Data Modelling

2014-11-25 Thread John Daily
Agreed, that’s a useful article, highly recommended. -John On Nov 25, 2014, at 2:03 PM, Troy Melhase wrote: > Lots of insight here: > > https://highlyscalable.wordpress.com/2012/03/01/nosql-data-modeling-techniques/ > > > > On Tue, Nov 25, 2014 at 1:47 PM, John Daily

Re: Data Modelling

2014-11-25 Thread John Daily
I’ve written a bit about modeling patterns at http://basho.com/riak-development-anti-patterns/ I expanded a bit on it in contributions to the latest version of Eric Redmond’s outstanding http://littleriakbook.com (make sure to grab one of the downloads, the HTML is out of date). -John On Nov

Re: Is it possible to start with One node and increase later

2014-11-14 Thread John Daily
The n_val represents the number of copies of the data, regardless of the number of servers in the cluster. If you have n_val=3 and only 1 server, 3 copies of each piece of data will be on that server (and performance will be generally abysmal because every read and write request will effectively

Re: Connecting to a single host vs balancing requests

2014-10-08 Thread John Daily
If you can help us what goal is trying to be achieved by taking that approach, perhaps we can refute the logic (or find a better solution). It sounds suspiciously like someone is trying to avoid the complexities of siblings and conflict resolution (a goal which your architecture doesn't actually ac

Re: Rolling upgrade from 1.2 to 2.0

2014-09-19 Thread John Daily
Basho only tests and supports upgrades 2 major releases forward, so 1.3 or 1.4 can be upgraded to 2.0, but 1.2 may or may not work. I'd strongly recommend upgrading to 1.4.10 before moving to 2.0. Some useful links: * http://docs.basho.com/riak/latest/ops/upgrading/rolling-upgrades/ * http://docs

Re: Single node, nval = 1

2014-09-11 Thread John Daily
On Thu, Sep 11, 2014 at 7:42 AM, Dmitri Zagidulin wrote: > If you're running a single-node Riak instance to start with (such as a > prototype web app), but there's the possibility of expanding the cluster > and adding other nodes, you should run with n_val=3. (It's not recommended > to change th

Re: Avoid siblings in "data-type" bucket

2014-08-21 Thread John Daily
Siblings are resolved automatically by Riak when using our data types, thus the requirement that allow_mult=true. -John On Thu, Aug 21, 2014 at 3:17 PM, Alex De la rosa wrote: > Hi there, > > I was trying to create a bucket-type using the datatype MAP and it didn't > allow me to create it with

Re: Riak Search VS other query systems

2014-08-20 Thread John Daily
I don't have benchmarks to discuss query performance for different tools at different sizes, but I'd like to point out that the ultimate search tool for Riak is to not search at all. Riak Search, 2i, MapReduce are all capable tools, but they don't scale nearly as well as straight key/value request

Re: Riak CS with hadoop over s3 protocol

2014-07-31 Thread John Daily
This blog post on configuring S3 clients to work with CS may be useful: http://basho.com/riak-cs-proxy-vs-direct-configuration/ Sent from my iPhone On Jul 31, 2014, at 2:53 PM, Andrew Stone wrote: Hi Charles, AFAIK we haven't ever tested Riak Cs with the MapR connector. However, if MapR works

Re: Riak backup and restore for ubuntu

2014-07-23 Thread John Daily
We are disabling the backup component in riak-admin in 2.0. Instead, we recommend following the detailed instructions in http://docs.basho.com/riak/2.0.0/ops/running/backups/ -John On Wed, Jul 23, 2014 at 3:21 PM, Alfonso Hooker wrote: > I am looking for some information regarding the backup

Re: Cluster rebalancing

2014-07-07 Thread John Daily
Weighted claim is indeed on the wishlist, but I don't believe it has yet been assigned to any particular planned release. -John On Sun, Jul 6, 2014 at 9:09 AM, Thomas Santero wrote: > Hi Chaim, > > Inline > > On Jul 6, 2014, at 1:13 AM, Chaim Solomon > wrote: > > I don't think I was quite cle

Re: Help on bucket quorums

2014-06-28 Thread John Daily
I don't have time at the moment to respond in more detail, I'm afraid, but you should find this blog series quite useful. http://basho.com/understanding-riaks-configurable-behaviors-part-1/ Sent from my iPhone On Jun 28, 2014, at 5:56 AM, Alex De la rosa wrote: Hi there, Can somebody help me

Re: Riak CS Siblings

2014-04-28 Thread John Daily
Siblings in CS are strictly for internal purposes, and handled by the CS layer. They aren't exposed to S3 (or similar) clients. Sent from my iPhone > On Apr 28, 2014, at 12:37 PM, Lee Sylvester wrote: > > Hey guys, > > So, I'm using a Riak CS cluster and interfacing with it using Erlcloud. My

Re: 1.4 or 2.0?

2014-02-15 Thread John Daily
I strongly recommend sticking with the 1.4 series until 2.0 is formally released. The 2.0 features are great, but making certain that upgrades will go smoothly is a top priority for every major release of Riak, and this will be no exception. You can upgrade when the time is right for your needs

Riak Community Hangout #10: Data modeling

2014-02-14 Thread John Daily
Will be starting at ~3:30 Eastern. http://youtu.be/uDR-sdBCPug -John ___ riak-users mailing list riak-users@lists.basho.com http://lists.basho.com/mailman/listinfo/riak-users_lists.basho.com

Riak Community Hangout: 3:30 Eastern

2014-02-14 Thread John Daily
We pushed this week’s hangout back a bit due to scheduling conflicts. I’ll send out a link after 3pm. Today’s topic: data modeling. Don’t miss it. As a reminder, previous hangouts can be viewed at our YouTube page (and that’s another way to watch today’s live without waiting for me to send a di

Riak Recap for January 24th - February 11th

2014-02-11 Thread John Daily
week...). John Daily twitter.com/macintux --- Riak Recap for January 24th - February 11th === Riak CS 1.4.4 (bugfixes only) was released. - http://lists.basho.com/pipermail/riak-users_lists.basho.com/2014-February/014599.html -

Re: Level-db cluster

2014-02-11 Thread John Daily
After asking around a bit, I think we’re likely to remove that recommendation from the documentation. Tuning is always a bit of a dark art, so as always your mileage may vary, but there doesn’t seem to be any real advantage to lowering the thread count. Thanks for raising the issue. -John On

[ANN] Riak CS 1.4.4

2014-02-03 Thread John Daily
A minor Riak CS bugfix release, 1.4.4, is available. There are no Stanchion or Riak CS Control updates, so versions 1.4.3 and 1.0.2 remain the latest releases of those components. http://docs.basho.com/riakcs/latest/riakcs-downloads/ http://docs.basho.com/riakcs/latest/cookbooks/Riak-CS-Re

Re: last_write_wins

2014-01-30 Thread John Daily
Replies inline. (Thanks to Russell for the link to my blog series, but honestly, as I now re-read the section on conflict resolution, I’m unhappy with it. It’s a very confusing topic and I regret not doing a better job of clarifying it. This answer will undoubtedly also be more confusing than I

Impending Community Hangout

2014-01-24 Thread John Daily
If you’ve been a part of the Riak community for a while, you won’t want to miss today’s Community Hangout. Hector Castro and I will be joined by two people who have been among the more prominent faces for Basho for a very long time: Andy Gross and Mark Phillips. We’ll take a look back at where w

Riak Hangout starting shortly

2014-01-17 Thread John Daily
We’ll be talking CorrugatedIron with Jeremiah Peschka and David Rusek at 2 Eastern. Learn more about sausage-making in the client libraries. https://plus.google.com/events/cmovsvget093sa91rjas3ac4a3s -John ___ riak-users mailing list riak-users@lists

Riak Recap for December 18 - January 7

2014-01-07 Thread John Daily
Welcome to the first 2014 Riak Recap. Since last we spoke, Riak 1.4.6 was unveiled, along with an updated Chef cookbook: - http://lists.basho.com/pipermail/riak-users_lists.basho.com/2013-December/014327.html - http://community.opscode.com/cookbooks/riak We've also hosted another Riak Community

Re: anti_entropy_expire

2013-12-27 Thread John Daily
That'd be version 1.4.6. Sent from my iPhone > On Dec 27, 2013, at 4:42 PM, Matthew Von-Maszewski wrote: > > P.S. Unrelated to your question: Riak 1.4.4 is available for download. It > has a couple of nice bug fixes for leveldb. ___ riak-users mai

Re: Cluster restarted and doesn’t respond to queries

2013-12-23 Thread John Daily
Note this: {multi_backend, [ %% Here's where you set the individual multiplexed backends {<<"eleveldb_mult">>, riak_kv_eleveldb_backend, [ {data_root, "

Re: May allow_mult cause DoS?

2013-12-20 Thread John Daily
I could be wrong, but I believe there’s metadata overhead for each sibling, so even if all data in all siblings needs to be retained, it’s still more efficient to merge and save them as one object. -John On Dec 20, 2013, at 6:01 PM, Andrew Stone wrote: > Think of an object with thousands of s

[ANN]: Riak 1.4.6

2013-12-20 Thread John Daily
Riak users, Riak 1.4.6 was pushed to the apt and yum repositories and is now available for download from docs.basho.com. Along with bug fixes, the most notable changes involve 2i. We have reverted to unsorted key lists by default for better performance, added regular expression filters for ran

Re: Maps with multiple buckets

2013-12-18 Thread John Daily
Alex Moore and I provided some general time series advice and links on StackOverflow recently: http://stackoverflow.com/questions/19384686/what-is-the-most-efficient-way-to-store-time-series-in-riak-with-heavy-reads Broadly speaking, issuing dynamic queries via MapReduce is going to be less des

Riak Community Hangout ideas

2013-12-16 Thread John Daily
for a great 2013. -John Daily Technical Evangelist Basho Technologies ___ riak-users mailing list riak-users@lists.basho.com http://lists.basho.com/mailman/listinfo/riak-users_lists.basho.com

Updated Hangout link

2013-12-06 Thread John Daily
Technical difficulties, new link http://youtu.be/n8m8xlizekg -John ___ riak-users mailing list riak-users@lists.basho.com http://lists.basho.com/mailman/listinfo/riak-users_lists.basho.com

Riak Community Hangout #3 in 20 minutes

2013-12-06 Thread John Daily
We’ll be continuing our discussions of Riak 2.0: specifically, security and conflict resolution. 2pm Eastern. http://youtu.be/_QomrZc29fw -John ___ riak-users mailing list riak-users@lists.basho.com http://lists.basho.com/mailman/listinfo/ria

Re: Worried about the backends to use

2013-11-29 Thread John Daily
> > 2) You could set your default backend in the confgs to use multi-backend. > When it comes time to age out your data, you can switch the backend on a > bucket by bucket basis and hope for the best. This isn't supported or tested > by Basho (as far as I know), so you'll be on your own on this

[ANN] Riak CS 1.4.3

2013-11-25 Thread John Daily
-Release-Notes/ Downloads: http://docs.basho.com/riakcs/latest/riakcs-downloads/ Thanks. -John Daily Technical Evangelist Basho ___ riak-users mailing list riak-users@lists.basho.com http://lists.basho.com/mailman/listinfo/riak-users_lists.basho.com

Re: Search Crashes

2013-11-23 Thread John Daily
allow_mult=true is the recommended approach for addressing conflict resolution; when multiple writes to the same object are received and vector clocks cannot determine a causal history, all copies of the writes are retained for future merging/selection by the application. We are planning to make

Re: Forcing Siblings to Occur

2013-11-12 Thread John Daily
r my use case, but they > seem overkill for simple append operations when I don't need delete > functionality. Creating your own CRDTs are trivial if you never need to > delete. > > Thoughts are welcome, > Jason > From: John Daily > Sent: Wednesday, 13 November 2013

Re: Forcing Siblings to Occur

2013-11-12 Thread John Daily
Forcing siblings other than for testing purposes is not typically a good idea; as you indicate, the object size can easily become a problem as all siblings will live inside the same Riak value. Your counter-example sounds a lot like a use case for server-side CRDTs; data structures that allow t

Re: Corrupted data using Riak Python Client on Win7 64 bit

2013-11-08 Thread John Daily
(And the inverse would also be interesting to know.) -John On Nov 8, 2013, at 6:41 PM, John Daily wrote: > If you upload the files from Windows, and download them to the Ubuntu VM, do > inconsistencies ever appear? > > -John > > On Nov 8, 2013, at 4:58 PM, Engel Sanchez

Re: Corrupted data using Riak Python Client on Win7 64 bit

2013-11-08 Thread John Daily
If you upload the files from Windows, and download them to the Ubuntu VM, do inconsistencies ever appear? -John On Nov 8, 2013, at 4:58 PM, Engel Sanchez wrote: > Hello there, > > This looks puzzling. Just from looking at the code we haven't found anything > suspicious. Would you mind postin

▶ RC Hangout 001: Data Types and Search in 2.0 - YouTube

2013-11-08 Thread John Daily
And so it begins: http://www.youtube.com/watch?v=bxzGY6_DnQU -John ___ riak-users mailing list riak-users@lists.basho.com http://lists.basho.com/mailman/listinfo/riak-users_lists.basho.com

Re: Forcing Siblings to Occur

2013-11-08 Thread John Daily
Updating any key without supplying a vector clock is guaranteed to create a sibling. -John On Nov 8, 2013, at 1:29 PM, Mark A. Basil, Jr. wrote: > Is there some method that is either guaranteed or very highly likely to > create Siblings of an object (that isn’t a counter)? I would like to ha

[ANN] Weekly Riak Community Hangout (1st one happening shortly)

2013-11-08 Thread John Daily
The Basho TE team is kicking off a new weekly forum an hour from now: the Riak Community Hangout[1]. Most[2] Fridays at 11am Pacific/2pm Eastern/7pm[3] GMT we'll be holding a 15-30 minute, development-focused Google Hangout, with the video to be posted later on YouTube[4]. A primary focus for

Re: Riak Recap for September 26 - October 25

2013-10-25 Thread John Daily
com/index.html (for those of you who haven't seen > > Salt Stack yet) > > > > Basho now has a dedicated conference page on Lanyrd, if you're curious > > where you can find us next > > - http://lanyrd.com/basho/ > > > > While we're talking abo

Riak Recap for September 26 - October 25

2013-10-25 Thread John Daily
solutions - http://lists.basho.com/pipermail/riak-users_lists.basho.com/2013-October/013475.html Drew Searcy posted a blog on troubleshooting Riak daemon startup problems - http://drewsearcy.com/troubleshooting-riak-startup/ John Daily captured some of the differences between Riak and Riak CS

Re: Riak occasionally not storing objects

2013-10-23 Thread John Daily
How well-synchronized are your system clocks? Sent from my iPhone > On Oct 23, 2013, at 5:00 PM, David Greenstein wrote: > > > We’re doing new puts with a blank vector clock. There are several seconds > between updates to the object though. > > Dave > > >> On Oct 23, 2013, at 5:32 PM, Andrew Th

Re: Riak CS with a NFS storage backend

2013-10-21 Thread John Daily
If you really want an S3 API layer around NFS, I suspect you'd be better off taking the code from Riak CS and creating your own solution than attempting this approach. One example of how this would run into trouble: if any server fails, nearly every large object would be unavailable because of

Re: distribution of data among riak cluster physical nodes

2013-10-15 Thread John Daily
Replies inline On Oct 15, 2013, at 9:49 AM, kzhang wrote: > I think the below setting is what we want to use for our environment >> r = 1 >> notfound_ok=false >> basic_quorum = true >> >> the client gets notfound if the first two replies are notfound? if the >> first >> reply is found, the clie

Re: distribution of data among riak cluster physical nodes

2013-10-14 Thread John Daily
Responses inline. On Oct 11, 2013, at 7:10 PM, kzhang wrote: > I read the documentation again > (http://docs.basho.com/riak/latest/dev/references/http/fetch-object/). > > r - (read quorum) how many replicas need to agree when retrieving the object > (default is defined by the bucket) Not agree

[ANN] Riak CS 1.4.2 (and reorganized docs)

2013-10-14 Thread John Daily
oads: http://docs.basho.com/riakcs/latest/riakcs-downloads/ Thanks. -John Daily Technical Evangelist, Basho ___ riak-users mailing list riak-users@lists.basho.com http://lists.basho.com/mailman/listinfo/riak-users_lists.basho.com

Re: distribution of data among riak cluster physical nodes

2013-10-09 Thread John Daily
What you saw is actually quite typical when using R=1. When you turn off a node, Riak's sloppy quorum behavior will kick in and hand off some of your read requests to an empty data partition to supplement the two remaining partitions that still have a copy. Since the partition is empty, it can

Riak Recap for September 5 - September 25

2013-09-25 Thread John Daily
Riak Recap returns after a busy couple of weeks, including one of the more spectacular developer conferences anywhere in the world, Strange Loop. If you've not yet attended, you're missing out. Garrett Eardley of Riot Games talked at Strange Loop about migrating from MySQL to Riak for scale; we

Riak Recap for August 28 - September 5

2013-09-05 Thread John Daily
Summer draws to its unofficial close in the northern hemisphere, but that just means tech conferences are spinning back up. We know RICON will be high on the priority list for anyone reading this; check out the speakers list and ask yourself if you really want to miss a chance to bend the ear of

Riak Recap for August 1-27

2013-08-27 Thread John Daily
The Recap took an (unplanned) August vacation, rather like the rest of the civilized world, but we're back. The most important news: RICON West tickets are still available, but early bird ticket sales end Thursday morning (US). If you've been to a RICON, you know why you shouldn't miss this; if

Tweaked Riak development process

2013-08-26 Thread John Daily
ntact us on this list or via issues on GitHub if you have questions or concerns. [1] https://github.com/basho [2] https://github.com/basho/riak_cs/wiki/Git-Flow [3] http://nvie.com/posts/a-successful-git-branching-model/ [4] https://github.com/basho/riak/wiki/Basho-repository-management -Jo

Dallas, SoftLayer, and Riak

2013-08-12 Thread John Daily
in us for free food and drinks on August 27th. http://www.meetup.com/DFW-Riak-Meetup/events/134337442/ -John Daily Technical Evangelist Basho Technologies ___ riak-users mailing list riak-users@lists.basho.com http://lists.basho.com/mailman/listinfo

Re: performance

2013-08-05 Thread John Daily
gt; Paul Ingalls > Founder & CEO Fanzo > p...@fanzo.me > @paulingalls > http://www.linkedin.com/in/paulingalls > > > > On Aug 2, 2013, at 5:08 PM, John Daily wrote: > >> 50k definitely is a fair few. What's the objective for that many, if I may >&g

Re: performance

2013-08-02 Thread John Daily
Maybe 50k or so... Paul Ingalls Founder & CEO Fanzo p...@fanzo.me @paulingalls http://www.linkedin.com/in/paulingalls On Aug 2, 2013, at 3:54 PM, John Daily wrote: Excellent news. How many buckets with custom settings did you create? Sent from my iPhone On Aug 2, 2013, at 6:51 PM, Paul

Re: performance

2013-08-02 Thread John Daily
Excellent news. How many buckets with custom settings did you create? Sent from my iPhone On Aug 2, 2013, at 6:51 PM, Paul Ingalls wrote: For those interested, I identified my performance problem. I was creating a lot of buckets, and the properties did not match the default bucket properties o

Riak Recap for July 23-31

2013-07-31 Thread John Daily
Greetings, Riak world. It's time to say farewell to July. There will be many opportunities to see the Basho crew out and about in August, so I've included the next couple of weeks below, and you can always visit http://basho.com/events to see what's coming to your community. Don't forget that

Critical issue with Riak Control in Riak 1.4.0.

2013-07-30 Thread John Daily
atest/ops/advanced/riak-control/ [1] http://docs.basho.com/riak/latest/ops/running/rolling-upgrades/ -John Daily Technical Evangelist Basho ___ riak-users mailing list riak-users@lists.basho.com http://lists.basho.com/mailman/listinfo

Re: Scaling Riak CS to hundreds or thousands of servers

2013-07-25 Thread John Daily
riak cs for large files (50MB-15GB) is it possible to raise > the chunk size up to these Filesizes, to prevent the system from heavy > network traffic? Definitely not. Erlang's distribution protocol will behave badly with objects that large.

Re: Help... Something is wrong with my restore

2013-07-18 Thread John Daily
Per http://docs.basho.com/riak/latest/cookbooks/Backups/, you need not only Bitcask data but also ring data and configuration. -John On Jul 18, 2013, at 1:40 PM, Mark Wagner wrote: > Here is what I am doing: on OSX > > # Install riak on my local OSX development box > brew install riak > >

Re: bucket properties

2013-06-17 Thread John Daily
A couple of quick notes (that may be perfectly obvious, but just in case) to augment Joe's response: Nodes will have to be restarted before those properties take effect. Increasing n_val on buckets is risky: old keys will still only live on the original n_val (smaller) number of nodes, but requ

Re: 0 byte images saved to riak cluster

2013-06-12 Thread John Daily
> Correct. With lww = true, the vector clocks will be ignored and the > most-recent timestamp will win. Is this not what you're seeing? To be precise, the most recent timestamp will win as long as allow_mult=false. lww=true just optimizes the code path a bit. http://basho.com/understanding-riak

Re: setting n_val

2013-06-10 Thread John Daily
Two important points: First, n_val determines how many partitions (or virtual nodes) the data will be distributed to. The ring size determines how many partitions exist, and should be a much larger number than the number of servers your cluster will run on. Riak's default ring size is 64, so de

RICON West CFP now open

2013-06-04 Thread John Daily
r. If you have interesting Riak experiences to share (or other distributed systems theory/learnings), please contact us. Your active involvement can only improve RICON. CFP: http://ricon.io/blog/2013-06-03-West-cfp-officially-open.html RICON West: http://ricon.io/west.html -John Daily Technical E

Re: First Write Wins

2013-05-20 Thread John Daily
=pr=quorum. > > Immutable values is a much better way of putting it, although I technically > need deletion as well for this particular example. > > Cheers, > Jeremy > > > On Sun, May 19, 2013 at 7:24 PM, John Daily wrote: > A few quick thoughts... > > W

Re: First Write Wins

2013-05-19 Thread John Daily
and pr=quorum (which would mean that attempting to write the same key in a partitioned scenario would fail unless a majority of the primary vnodes are reachable). Hopefully someone else who's given this some thought in the past will jump in; I'll make further inquiries tomorrow. -John

Re: On siblings

2013-05-15 Thread John Daily
Thanks for the kind words, Jeremiah. Jeremy, if you find anything that's wrong with that description of sibling behavior, please let me know. It's always possible I missed something important. -John On Wednesday, May 15, 2013, Jeremiah Peschka wrote: > John Daily (@macintux) wrote

Riak 1.3.1 and w=1 performance change

2013-05-08 Thread John Daily
As you may have noticed, this week on the blog I've been tackling the deeper meanings of various behavioral configuration parameters, ranging from ye olde r/w parameters to the much more obscure basic_quorum. After posting today's missive, the esteemed Andrew Thompson noticed that something I d

Riak Recap for April 27 - April 30

2013-04-30 Thread John Daily
We're back with yet another Recap. Big news for the week: SoftLayer now offers Riak and Riak Enterprise out of the box in their bare metal server hosting environment. Big news for everyone at RICON East or NYC environs is that SoftLayer is sponsoring the after party, so if you somehow can't mak

Riak Recap for April 3 - April 19

2013-04-19 Thread John Daily
om/Atlanta-Riak-Meetup/events/112848852/ Eric Redmond will be talking about Riak at Railsberry in Krakow - April 23-24 / http://railsberry.com/ Steve Vinoski and Andy Gross will be talking at GOTO Chicago, where you can also find a Basho booth with John Daily talking Riak, Erlang, or chromatic harmon

Re: cluster capacity planning, 50M of writes per day

2013-04-08 Thread John Daily
e hardware currently in your account if you're not careful.) [1] https://github.com/basho/basho_bench [2] http://docs.basho.com/riak/latest/cookbooks/Benchmarking/ [3] http://www.baremetalcloud.com/ -John Daily Technical Evangelist Basho Technologies ___

Re: Error in documentation

2013-04-06 Thread John Daily
Actually, I believe the document is correct; there is a riak_cs_kv_multi_backend module in the CS tree which appears to be forked from riak_kv_multi_backend. In general, though, you're more than welcome to file tickets against the documentation set via github: https://github.com/basho/basho_doc

Austin-area Riak users: Data Day tomorrow, meetup coming 4/17

2013-03-29 Thread John Daily
in Texas this year, and I'll definitely be looking for users to talk about their experiences with Riak. Please let me know if you'd be interested in sharing your pain points and successes (not necessarily in that order). And, of course, the essentials: free food and swag. -John Daily

Riak Recap for March 6 - 12

2013-03-12 Thread John Daily
Reminder: early bird pricing for RICON East ends Friday, as does the CFP. * ---> http://ricon.io/east.html And don't forget: hoodies! John twitter.com/macintux Riak Recap for March 6 - 12 === 1) A new release of the Perl library Net::Riak has been released. It now suppo

  1   2   >