RE: Using Bucket Data Types slowed insert performance

2015-11-04 Thread Dennis Nicolay
...@basho.com] Sent: Tuesday, October 20, 2015 8:22 PM To: Dennis Nicolay Cc: Christopher Mancini; Mark Schmidt; Alexander Sicular; riak-users@lists.basho.com Subject: Re: Using Bucket Data Types slowed insert performance Hi Dennis & Mark, I noticed some timing code in your snip

RE: Using Bucket Data Types slowed insert performance

2015-10-21 Thread Mark Schmidt
.CdrValue.OriginationCountryCode.ToString()); > mapOperation.SetRegister("OriginationCost", cdr.CdrValue.OriginationCost.ToString()); > mapOperation.SetRegister("FixedPricePerCall", cdr.CdrValue.FixedPricePerCall.ToString()); > mapO

RE: Using Bucket Data Types slowed insert performance

2015-10-21 Thread Mark Schmidt
, 2015 8:22 PM To: Dennis Nicolay <dnico...@orcawave.net> Cc: Christopher Mancini <cmanc...@basho.com>; Mark Schmidt <mschm...@orcawave.net>; Alexander Sicular <sicul...@gmail.com>; riak-users@lists.basho.com Subject: Re: Using Bucket Data Types slowed insert performance

Re: Using Bucket Data Types slowed insert performance

2015-10-21 Thread Torben Hoffmann
>> mapOperation.SetRegister("DialedLataOcn", >> cdr.CdrValue.DialedLataOcn.ToString()); >> mapOperation.SetRegister("LrnLataOcn", >> cdr.CdrValue.LrnLataOcn.ToString()); >> mapOperation.SetRegister("CustomerPre

Re: Using Bucket Data Types slowed insert performance

2015-10-21 Thread Russell Brown
peration.SetRegister("CustomerPrefix", > cdr.CdrValue.CustomerPrefix.ToString()); > mapOperation.SetRegister("SupplierPrefix", > cdr.CdrValue.SupplierPrefix.ToString()); > mapOperation.SetRegister("OriginationCountryCode", > cdr.CdrValue.Originat

Re: Using Bucket Data Types slowed insert performance

2015-10-20 Thread Alexander Sicular
0, 2015 10:34 AM > To: Dennis Nicolay > Cc: Christopher Mancini; riak-users@lists.basho.com > Subject: Re: Using Bucket Data Types slowed insert performance > > Hi Dennis, > > It's a bit unclear what you are trying to do here. Are you 1. uploading the > entire file and saving it

RE: Using Bucket Data Types slowed insert performance

2015-10-20 Thread Dennis Nicolay
I would consider simply using a KV and not paying the CRDT computational penalty (and possibly even the write once bucket.) The CRDT penalty you pay is obviously subjective to your use case, configuration, hw deployment etc. Hope that helps! -Alexander @siculars http://siculars.posth

Re: Using Bucket Data Types slowed insert performance

2015-10-20 Thread Alexander Sicular
Hi Dennis, It's a bit unclear what you are trying to do here. Are you 1. uploading the entire file and saving it to one key with the value being the file? Or are you 2. parsing the file and storing each row as a register in a map? Either of those approaches are not appropriate in Riak KV. For

RE: Using Bucket Data Types slowed insert performance

2015-10-20 Thread Dennis Nicolay
-users@lists.basho.com Subject: Re: Using Bucket Data Types slowed insert performance Hi Dennis, It's a bit unclear what you are trying to do here. Are you 1. uploading the entire file and saving it to one key with the value being the file? Or are you 2. parsing the file and storing each

RE: Using Bucket Data Types slowed insert performance

2015-10-20 Thread Mark Schmidt
, October 20, 2015 10:55 AM To: Dennis Nicolay <dnico...@orcawave.net> Cc: Christopher Mancini <cmanc...@basho.com>; riak-users@lists.basho.com; Mark Schmidt <mschm...@orcawave.net> Subject: Re: Using Bucket Data Types slowed insert performance Let's talk about Riak data types for a

Re: Using Bucket Data Types slowed insert performance

2015-10-20 Thread Christopher Mancini
Hi Dennis, I am not the most experienced, but what I do know is that a file that size causes a great deal of network chatter because it has to handoff that data to the other nodes in the network and will cause delays in Riak's ability to send and confirm consistency across the ring. Typically we

Using Bucket Data Types slowed insert performance

2015-10-20 Thread Dennis Nicolay
Hi, I'm using .net RiakClient 2.0 to insert a 44mb delimited file with 139k rows of data into riak. I switched to a map bucket data type with registers. It is taking about 3 times longer to insert into this bucket vs non data typed bucket. Any suggestions? Thanks in advance, Dennis

Re: Using Bucket Data Types slowed insert performance

2015-10-20 Thread Alex Moore
ledLataOcn", > cdr.CdrValue.DialedLataOcn.ToString());* > > *mapOperation.SetRegister("LrnLataOcn", > cdr.CdrValue.LrnLataOcn.ToString());* > > *mapOperation.SetRegister("CustomerPrefix", > cdr.CdrValue.CustomerPrefix.ToString())