Hi Valter,
On Mon, Nov 25, 2013 at 4:47 PM, Valter Balegas <bale...@gmail.com> wrote:
> Hello,
>
> I’m trying to use strong consistency in a riak cluster with nodes in a
> wide-area network, but a timeout fires sometimes, regardless the timeout
> value.
>
How many nodes do you have? And where are they located geographically?
> I tried to increase the timeout of the get operation but it does not seem
> to help. Is there any parameter that i can change to increase the timeout?
> The latency between the nodes is the order of hundreds of milliseconds,
> and, since in the eventual-consistency setting this does not happen (even
> with a bigger read quorum), i’m assuming it has to do with Strong
> consistency parametrization.
> I’m using the most recent erlang client and riak versions and the client
> runs in the same machine as the node i connect to.
>
> {ok, Pid} = riakc_pb_socket:start_link(“NODELINK", 8087).
> {ok,<0.35.0>}
> 2>
> 2> riakc_pb_socket:get(Pid, {<<"STRONG">>,<<"ITEMS">>}, <<"KEY">>,
> [],5000).
> {error,<<"timeout">>}
> 3>riakc_pb_socket:get(Pid, {<<"STRONG">>,<<"ITEMS">>}, <<"KEY">>,
> [],5000).
> {ok,{riakc_obj,{<<"STRONG">>,<<"ITEMS">>},
> <<"KEY">>,
> <<107,206,97,96,96,96,204,96,74,97,96,73,45,78,45,204,96,
> 202,99,99,96,1,10,...>>,
> [{{dict,2,16,16,8,80,48,
> {[],[],[],[],[],[],[],[],[],[],[],[],...},
> {{[],[],[],[],[],[],[],[],[],[],...}}},
> <<"100">>}],
> undefined,undefined}}
> 4> riakc_pb_socket:get(Pid, {<<"STRONG">>,<<"ITEMS">>}, <<"KEY">>,
> [],5000000).
> {error,<<"timeout">>}
> 5> riakc_pb_socket:get(Pid, {<<"STRONG">>,<<"ITEMS">>}, <<"KEY">>,
> [],5000).
>
> =ERROR REPORT==== 26-Nov-2013::00:34:38 ===
> ** Generic server <0.35.0> terminating
> ** Last message in was {req_timeout,#Ref<0.0.0.113>}
> ** When Server state == {state,”NODELINK",
>
> 8087,false,false,undefined,gen_tcp,undefined,
> {[],[]},
> 1,[],infinity,undefined,undefined,undefined,
> undefined,100}
> ** Reason for termination ==
> ** disconnected
> ** exception exit: disconnected
>
> Thanks,
> Valter
>
>
>
> No dia 21/11/2013, às 11:40, Valter Balegas <bale...@gmail.com> escreveu:
>
> Thanks, it works now!
> i wouldn’t realize that bucket type had to be specified as a type. But i
> did say that i didn’t now what that meant. :)
>
> I hope i can do all my experiments now,
> Valter
>
> No dia 20/11/2013, às 21:04, Valter Balegas <bale...@gmail.com> escreveu:
>
> Hello,
>
> Here is the sequence of commands:
>
> --Compiled Riak with "make rel" and riak-erlang-client with “make". Erlang
> version R16B02; using the latest version on GitHub or the riak2.0.0.5pre
> package.
>
> ./bin/riak stop
>
> --changed the consensus flag to true on ./etc/riak.conf
>
> ./bin/riak start
>
> .bin//riak-admin bucket-type create bucket '{"props": {"consistent":
> true}}'
> ./bin/riak-admin bucket-type activate bucket
>
> ./bin/riak stop
> ./bin/riak start
>
> on a erlang console, initialized with:
>
> ./erts-5.10.3/bin/erl -pa ../riak-erlang-client/ebin
> ../riak-erlang-client/deps/*/ebin
>
> f(Pid), {ok, Pid} = riakc_pb_socket:start_link("localhost", 8087).
> NewA = riakc_obj:new(<<"bucket">>, <<"key">>, <<"my binary data">>).
> NewB = riakc_obj:new(<<"bucket">>, <<"key">>, <<"my other binary data">>).
> riakc_pb_socket:put(Pid, NewA, [return_body]).
> {ok,{riakc_obj,<<"bucket">>,<<"key">>,
> <<107,206,97,96,96,96,204,96,202,5,82,28,202,156,255,126,
> 6,245,74,255,202,96,74,...>>,
> [{{dict,2,16,16,8,80,48,
> {[],[],[],[],[],[],[],[],[],[],[],[],...},
> {{[],[],[],[],[],[],[],[],[],[],...}}},
> <<"my binary data">>}],
> undefined,undefined}}
> 5> riakc_pb_socket:put(Pid, NewB, [return_body]).
> {ok,{riakc_obj,<<"bucket">>,<<"key">>,
> <<107,206,97,96,96,96,204,96,202,5,82,28,202,156,255,126,
> 6,245,74,255,202,96,74,...>>,
> [{{dict,2,16,16,8,80,48,
> {[],[],[],[],[],[],[],[],[],[],[],[],...},
> {{[],[],[],[],[],[],[],[],[],[],...}}},
> <<"my binary data">>},
> {{dict,2,16,16,8,80,48,
> {[],[],[],[],[],[],[],[],[],[],[],...},
> {{[],[],[],[],[],[],[],[],[],...}}},
> <<"my other binary data">>}],
> undefined,undefined}}
>
> bin/riak-admin bucket-type status bucket
> bucket is active
>
> young_vclock: 20
> w: quorum
> small_vclock: 50
> rw: quorum
> r: quorum
> pw: 0
> precommit: []
> pr: 0
> postcommit: []
> old_vclock: 86400
> notfound_ok: true
> n_val: 3
> linkfun: {modfun,riak_kv_wm_link_walker,mapreduce_linkfun}
> last_write_wins: false
> dw: quorum
> consistent: true
> chash_keyfun: {riak_core_util,chash_std_keyfun}
> big_vclock: 50
> basic_quorum: false
> allow_mult: true
> active: true
> claimant: 'riak@127.0.0.1
>
> bin/riak-admin bucket-type list
> bucket (active)
>
>
>
> No dia 20/11/2013, às 17:23, Jordan West <jw...@basho.com> escreveu:
>
> Hi Valter,
>
> Could you provide the code you are using to generate the concurrent
> requests in addition to the output of `riak-admin bucket-type list` and
> `riak-admin bucket-type status <buckettype>` where <buckettype> is the name
> of the strongly consistent bucket you created (from one node should be
> sufficient)? I've been using this feature in a personal project and just
> tested on a local cluster using curl and was unable to reproduce (the
> cluster was a bit behind develop but there have been no recent changes to
> the feature).
>
> Cheers,
> Jordan
>
>
> On Wed, Nov 20, 2013 at 5:30 AM, Valter Balegas <bale...@gmail.com> wrote:
>
>> Hello,
>>
>> I was able to activate strong consistency, but the node keeps generating
>> siblings, when i execute two concurrent writes (Store two objects without
>> vector clock).
>> I tried with the Riak 2.0.0.5pre package and the latest version on the
>> repository. Am i missing anything? i was expecting operations to fail, in
>> this case.
>>
>> It seems that the error was caused by my Erlang version. The creation of
>> the bucket type didn’t fail with R16B02.
>>
>> Valter
>>
>> No dia 20/11/2013, às 03:13, Jordan West <jw...@basho.com> escreveu:
>>
>> Valter,
>>
>> You mentioned you are using a recent develop. Would you be able to pull
>> down any recent changes and update-deps (or build a fresh devrel)? I just
>> tried a fresh clone of develop and was unable to reproduce the same error.
>> I, also, tried with R15B01 (Riak 2.0 is slated to use R16B02 right now).
>>
>> Alternatively, you should be able to workaround this by doing a `riak
>> attach-direct` and defining the atom at the erlang shell:
>>
>> 1> consistent.
>> consistent
>>
>> Jordan
>>
>>
>> On Tue, Nov 19, 2013 at 3:06 PM, Valter Balegas <bale...@gmail.com>wrote:
>>
>>> I can’t create the bucket type:
>>>
>>> RPC to 'riak@127.0.0.1' failed: {'EXIT',
>>> {badarg,
>>> [{erlang,list_to_existing_atom,
>>> ["consistent"],
>>> []},
>>>
>>> {riak_kv_wm_utils,erlify_bucket_prop,1,
>>> [{file,"src/riak_kv_wm_utils.erl"},
>>> {line,393}]},
>>> {riak_kv_console,
>>> '-bucket_type_create/2-lc$^0/1-0-',1,
>>> [{file,"src/riak_kv_console.erl"},
>>> {line,483}]},
>>> {riak_kv_console,bucket_type_create,2,
>>> [{file,"src/riak_kv_console.erl"},
>>> {line,483}]},
>>> {rpc,'-handle_call_call/6-fun-0-',5,
>>> [{file,"rpc.erl"},{line,203}]}]}}
>>>
>>> I activated the consensus in riak.conf in the etc dir (find command
>>> seems not to find the pattern anywhere else).
>>> Is there any other way to create the bucket?
>>>
>>> Valter
>>>
>>> No dia 19/11/2013, às 18:10, Jordan West <jw...@basho.com> escreveu:
>>>
>>> On Tue, Nov 19, 2013 at 7:33 AM, Valter Balegas <bale...@gmail.com>wrote:
>>>
>>>>
>>>> Strong consistency:
>>>> How does one activate this? As i understand, either the pb or the http
>>>> clients do not accept the consistent property.
>>>>
>>>>
>>> Using strong consistency in the Tech Preview is a two-step process.
>>> First, turn on the feature in your riak.conf (the following command assumes
>>> you are using a devrel):
>>>
>>> for d in dev/dev*; do sed -e 's/## enable_consensus =
>>> true/enable_consensus = true/' -i $d/etc/riak.conf; done
>>>
>>> Then re(start) the cluster.
>>>
>>> With the enable_consensus=true un-commented and the cluster running
>>> create a strongly consistent bucket type:
>>>
>>> riak-admin bucket-type create <type name> '{"props": {"consistent":
>>> true}}'
>>> riak-admin bucket-type activate <type name>
>>>
>>> You can create and activate the bucket type without having
>>> enabled_consensus=true but both must be done to work with strongly
>>> consistent data.
>>>
>>> Once that is done you can make requests, just like you would to
>>> eventually consistent data in Riak, but the semantics will be different.
>>> For example, if you make two PUT requests to the same key, w/ no vector
>>> clock*, the second request will fail because the data already exists. More
>>> details on semantics of strongly consistent requests can be found in this
>>> PR: https://github.com/basho/riak_kv/pull/710
>>>
>>> Hope that helps get you started,
>>>
>>> Jordan
>>>
>>> * in strong consistency, the "vector clock" is not really a vector
>>> clock. its called such for familiarity, but like any real vector clock
>>> exposed to the client, should be treated like an opaque context.
>>>
>>>
>>>> Details about my environment:
>>>> -I’m running Mac OSX 10.9
>>>> -Erlang R15B01
>>>> -Compiling riak “develop” branch, from basho github
>>>> -Compiling riak-erlang-client “master” branch, from basho github.
>>>> -recompiled the latest versions of the branches just before writing
>>>> this email.
>>>>
>>>>
>>>> Thank you for your help,
>>>> Valter
>>>>
>>>>
>>>>
>>>> _______________________________________________
>>>> riak-users mailing list
>>>> riak-users@lists.basho.com
>>>> http://lists.basho.com/mailman/listinfo/riak-users_lists.basho.com
>>>>
>>>
>>>
>>>
>>
>>
>
>
>
>
> _______________________________________________
> riak-users mailing list
> riak-users@lists.basho.com
> http://lists.basho.com/mailman/listinfo/riak-users_lists.basho.com
>
>
_______________________________________________
riak-users mailing list
riak-users@lists.basho.com
http://lists.basho.com/mailman/listinfo/riak-users_lists.basho.com
