Hi Germain,
I'm not able to reproduce the errors locally but I do occasionally see the
following after a test ends:
=ERROR REPORT==== 9-Jun-2010::23:18:35 ===
webmachine error: path="/riak/test/5711"
{error,{error,{badmatch,{error,closed}},
[{webmachine_request,recv_unchunked_body,4},
{webmachine_request,do_recv_body,2},
{webmachine_request,call,2},
{wrq,req_body,1},
{riak_kv_wm_raw,accept_doc_body,2},
{webmachine_resource,resource_call,3},
{webmachine_resource,do,3},
{webmachine_decision_core,resource_call,1}]}}
It looks like this is happening because the basho bench workers are killed
off in the middle of a request.
On Wed, Jun 9, 2010 at 5:07 AM, Germain Maurice <
[email protected]> wrote:
> The backend used is http_raw as you can see in the benchmark config file :
>
> {mode, max}.
> {duration, 30}.
> {concurrent, 20}.
> {driver, basho_bench_driver_http_raw}.
> {code_paths, ["deps/stats",
> "deps/ibrowse"]}.
> {http_raw_ips, ["10.0.0.40", "10.0.0.41"]}.
> {key_generator, {uniform_int, 10000}}.
> {value_generator, {fixed_bin, 800000}}.
> {operations, [{get, 2}, {update, 2}]}.
> {http_raw_params, "?r=1&w=2"}.
>
>
> The webmachine errors occured immediately after shutting down the benchmark
> with no other requests.
> We repeated the benchmark and we got these errors again.
>
>
> Le 08/06/10 19:23, Dan Reverri a écrit :
>
> Hi Germain,
>
> I've confirmed that the basho bench drivers for riakclient and riakc_pb
> do not provide a content-type when submitting key/value pairs to Riak. This
> should not cause problems while running the benchmark.
>
> Which driver were you using when you noticed the webmachine errors? Were
> you making GET requests for keys created in the benchmark against the REST
> API after the benchmark?
>
> Thanks,
> Dan
>
> On Tue, Jun 8, 2010 at 9:29 AM, Dan Reverri <[email protected]> wrote:
>
>> Hi Germain,
>>
>> You should be able to work around this issue by specifying a full list
>> of default bucket properties with your change incorporated. For example, try
>> putting the following in your app.config:
>> {default_bucket_props, [{n_val,2},
>> {allow_mult,false},
>> {last_write_wins,false},
>> {precommit, []},
>> {postcommit, []},
>> {chash_keyfun, {riak_core_util,
>> chash_std_keyfun}}]}
>>
>>
>> This is the full list of default bucket properties that can be found in
>> "apps/riak_core/ebin/riak_core.app" with the n_val changed to "2".
>>
>>
>>
>>
>> On Tue, Jun 8, 2010 at 9:05 AM, Germain Maurice <
>> [email protected]> wrote:
>>
>>> You're right, i put this line in the app.config :
>>> ,{default_bucket_props, [{n_val, 2}]}
>>>
>>> Maybe, i made a mistake...
>>>
>>> Le 08/06/10 17:55, Dan Reverri a écrit :
>>>
>>> Forwarding my reply to the mailing list.
>>>
>>> ---------- Forwarded message ----------
>>> From: Dan Reverri <[email protected]>
>>> Date: Tue, Jun 8, 2010 at 8:45 AM
>>> Subject: Re: Errors when using basho_bench
>>> To: Germain Maurice <[email protected]>
>>>
>>>
>>> Hi Germain,
>>>
>>> The first error "{'function not
>>> exported',[{riak_core_bucket,defaults,[]}," would occur when a bucket does
>>> not have a "chash_keyfun" property defined. This could occur if you have
>>> specified default bucket properties in your app.config. There is a known
>>> issue where bucket properties defined in the app.config file are not merged
>>> with the hard coded defaults:
>>> http://issues.basho.com/show_bug.cgi?id=123
>>>
>>> I'm not sure why this issue would only occur when increasing the
>>> partition size. Were other changes made to app.config?
>>>
>>>
>>> The second error "{case_clause,{error,timeout}},
>>> [{riak_kv_wm_raw,content_types_provided,2}"
>>> occurs when a key/value pair has been inserted into Riak without a
>>> content-type and retrieved via the REST interface. This can happen when
>>> inserting key/value pairs with the native Erlang client or the protobuffs
>>> client. These clients don't require that a content-type be set. I assume the
>>> values in question were inserted by the basho bench utility so I will look
>>> into how those values are inserted by basho bench.
>>>
>>> Thanks,
>>> Dan
>>>
>>>
>>>
>>> On Tue, Jun 8, 2010 at 7:38 AM, Germain Maurice <
>>> [email protected]> wrote:
>>>
>>>> After viewing the demonstration of basho_bench during the webinar of the
>>>> last week, we led some tests.
>>>> Here are some errors we are meeting while doing a benchmark with
>>>> basho_bench.
>>>>
>>>> Big notice : when the ring partition size was 64, i never got this kind
>>>> of error (excepting a crash of a node, due to not enough memory i think,
>>>> 1,5GB RAM). But now, i have 128 partitions (see my other message on the
>>>> riak
>>>> ML about the ring partition size) and these errors occurs.
>>>>
>>>>
>>>> This error occured multiple times :
>>>>
>>>> =ERROR REPORT==== 8-Jun-2010::16:21:06 ===
>>>> ** State machine <0.937.0> terminating
>>>> ** Last event in was timeout
>>>> ** When State == initialize
>>>> ** Data ==
>>>> {state,<0.932.0>,undefined,2,undefined,undefined,undefined,
>>>> 8594018,undefined,undefined,undefined,undefined,
>>>> undefined,undefined,60000,undefined,
>>>> {<<"test">>,<<"25500">>},
>>>> {chstate,'[email protected]',
>>>> [{'[email protected]',{64,63443225844}}],
>>>> {128,
>>>> [{0,'[email protected]'},
>>>>
>>>> {11417981541647679048466287755595961091061972992,
>>>> '[email protected]'},
>>>>
>>>> {22835963083295358096932575511191922182123945984,
>>>> '[email protected]'},
>>>>
>>>> {34253944624943037145398863266787883273185918976,
>>>> '[email protected]'},
>>>>
>>>> {45671926166590716193865151022383844364247891968,
>>>> '[email protected]'},
>>>>
>>>> {57089907708238395242331438777979805455309864960,
>>>> '[email protected]'},
>>>> [...]
>>>>
>>>> {1415829711164312202009819681693899175291684651008,
>>>> '[email protected]'},
>>>>
>>>> {1427247692705959881058285969449495136382746624000,
>>>> '[email protected]'},
>>>>
>>>> {1438665674247607560106752257205091097473808596992,
>>>> '[email protected]'},
>>>>
>>>> {1450083655789255239155218544960687058564870569984,
>>>> '[email protected]'}]},
>>>> {dict,0,16,16,8,80,48,
>>>>
>>>> {[],[],[],[],[],[],[],[],[],[],[],[],[],[],[],[]},
>>>>
>>>> {{[],[],[],[],[],[],[],[],[],[],[],[],[],[],[],
>>>> []}}}},
>>>> undefined}
>>>> ** Reason for termination =
>>>> ** {'function not exported',[{riak_core_bucket,defaults,[]},
>>>> {riak_core_util,chash_key,1},
>>>> {riak_kv_get_fsm,initialize,2},
>>>> {gen_fsm,handle_msg,7},
>>>> {proc_lib,init_p_do_apply,3}]}
>>>>
>>>>
>>>> After shutting down the benchmark we also got this following error,
>>>> multiple times too :
>>>>
>>>>
>>>> =ERROR REPORT==== 8-Jun-2010::16:19:28 ===
>>>> webmachine error: path="/riak/test/16028"
>>>> [{webmachine_decision_core,'-decision/1-lc$^1/1-1-',
>>>> [{error,
>>>> {error,
>>>> {case_clause,{error,timeout}},
>>>> [{riak_kv_wm_raw,content_types_provided,2},
>>>> {webmachine_resource,resource_call,3},
>>>> {webmachine_resource,do,3},
>>>> {webmachine_decision_core,resource_call,1},
>>>> {webmachine_decision_core,decision,1},
>>>> {webmachine_decision_core,handle_request,2},
>>>> {webmachine_mochiweb,loop,1},
>>>> {mochiweb_http,headers,5}]}}]},
>>>> {webmachine_decision_core,decision,1},
>>>> {webmachine_decision_core,handle_request,2},
>>>> {webmachine_mochiweb,loop,1},
>>>> {mochiweb_http,headers,5},
>>>> {proc_lib,init_p_do_apply,3}]
>>>>
>>>>
>>>> Any idea about these errors ?
>>>> No problem with Webmachine ?
>>>>
>>>> --
>>>> Germain Maurice
>>>> Administrateur Système/Réseau
>>>> Tel : +33.(0)1.42.43.54.33
>>>>
>>>> http://www.linkfluence.net
>>>>
>>>>
>>>> _______________________________________________
>>>> riak-users mailing list
>>>> [email protected]
>>>> http://lists.basho.com/mailman/listinfo/riak-users_lists.basho.com
>>>>
>>>
>>>
>>>
>>>
>>> --
>>> Germain Maurice
>>> Administrateur Système/Réseau
>>> Tel : +33.(0)1.42.43.54.33
>>> http://www.linkfluence.net
>>>
>>>
>>> _______________________________________________
>>> riak-users mailing list
>>> [email protected]
>>> http://lists.basho.com/mailman/listinfo/riak-users_lists.basho.com
>>>
>>>
>>
>
>
> --
> Germain Maurice
> Administrateur Système/Réseau
> Tel : +33.(0)1.42.43.54.33
> http://www.linkfluence.net
>
>
> _______________________________________________
> riak-users mailing list
> [email protected]
> http://lists.basho.com/mailman/listinfo/riak-users_lists.basho.com
>
>
_______________________________________________
riak-users mailing list
[email protected]
http://lists.basho.com/mailman/listinfo/riak-users_lists.basho.com
