Re: Service discovery in the Cassandra cluster

2017-05-02 Thread Steve Robenalt
o <ro...@sproutling.com> wrote: >> >> If I understand how Cassandra nodes work, they must contain a list of >> seed’s IP addressed in config file. >> >> This requirement makes cluster setup unnecessarily complicated. Is it >> possible to use DNS name for seed

Re: results differ on two queries, based on secondary index key and partition key

2017-03-29 Thread Steve Robenalt
vice contained in this Email are subject > to the terms and conditions expressed in any applicable governing The Home > Depot terms of business or client engagement letter. The Home Depot > disclaims all responsibility and liability for the accuracy and content of > this attachment and f

Re: Unable to perform COUNT(*) on CASSANDRA table

2016-04-18 Thread Steve Robenalt
'min_sstable_size' : 50, > > 'min_threshold' : 4, > > 'tombstone_compaction_interval' : 86400, > > 'tombstone_threshold' : 0.2, > > 'unchecked_tombstone_compaction' : false > > }; > > > > > &g

Re: Is it possible to achieve "sticky" request routing?

2016-04-05 Thread Steve Robenalt
aware routing. >> >> Unless you're trying to do a coordinator tier (and you're not, according >> to your original post), this is a pretty bad idea and I'd advise you to >> push back on that requirement. >> >> On Tue, Apr 5, 2016 at 12:47 PM Steve Robenalt <sroben...@highwi

Re: Is it possible to achieve "sticky" request routing?

2016-04-05 Thread Steve Robenalt
>> preferred option. >> >> 2. Write a new load balancing policy that also uses the HostStateListener >> for tracking host up and down messages, that essentially accomplishes >> "sticky" request routing with failover to other nodes. >> >> Is option 2 the onl

Re: Large number of tombstones without delete or update

2016-03-23 Thread Steve Robenalt
ar 23, 2016 at 12:09 PM Robert Coli <rc...@eventbrite.com> >> wrote: >> >>> On Wed, Mar 23, 2016 at 9:50 AM, Ralf Steppacher <ralf.viva...@gmail.com >>> > wrote: >>> >>>> How come I end up with that large a number of tombstones? >>

Re: Experiencing strange disconnect issue

2016-03-19 Thread Steve Robenalt
ted and may be unlawful. When addressed >> to our clients any opinions or advice contained in this Email are subject >> to the terms and conditions expressed in any applicable governing The Home >> Depot terms of business or client engagement letter. The Home Depot >> disclaims all responsibility and liability for the accuracy and content of >> this attachment and for any damages or losses arising from any >> inaccuracies, errors, viruses, e.g., worms, trojan horses, etc., or other >> items of a destructive nature, which may be contained in this attachment >> and shall not be liable for direct, indirect, consequential or special >> damages in connection with this e-mail message or its attachment. >> > -- Steve Robenalt Software Architect sroben...@highwire.org <bza...@highwire.org> (office/cell): 916-505-1785 HighWire Press, Inc. 425 Broadway St, Redwood City, CA 94063 www.highwire.org Technology for Scholarly Communication

Re: Experiencing strange disconnect issue

2016-03-19 Thread Steve Robenalt
61298018c46954 > > It all goes south at about line 433 (time 19:46:43) where the client > throws a: > io.netty.handler.codec.DecoderException: > com.datastax.driver.core.exceptions.DriverInternalError: Adjusted frame > length exceeds 268435456: 462591744 - discarded > > Any

Re: nulls in prepared statement & tombstones?

2016-03-09 Thread Steve Robenalt
eneral statement. That makes sense. >> >> >> On Tue, Mar 8, 2016 at 10:06 AM Steve Robenalt <sroben...@highwire.org> >> wrote: >> >>> Hi Henry, >>> >>> I would suspect that the tombstones are necessary to overwrite any >>> previou

Re: nulls in prepared statement & tombstones?

2016-03-08 Thread Steve Robenalt
as wondering if someone could help explain why sending nulls as part of > a prepared statement update would result in tombstones. > > Thank you, > - Henry > -- Steve Robenalt Software Architect sroben...@highwire.org <bza...@highwire.org> (office/cell): 916-505-1785 HighWire P

Re: EC2 storage options for C*

2016-02-01 Thread Steve Robenalt
gt;>>> But Jeff, kudo that you are able to use EBS. I didn't go through the >>>>>> video, do you actually use PIOPS or just standard GP2 in your production >>>>>> cluster? >>>>>> >>>>>> On Sat, Jan 30, 2016 at 1:28 PM,

Re: EC2 storage options for C*

2016-02-01 Thread Steve Robenalt
be recommended going forward as well. > sure, technically, someone could use the legacy instances, but the question > is what we should be recommending as best practice going forward. > > Yeah, the i2 instances look like the sweet spot for any non-EBS clusters. > > -- Jack Krupansky

Re: EC2 storage options for C*

2016-02-01 Thread Steve Robenalt
gt;>>>>>>> >>>>>>>> We run using 4T GP2 volumes, which guarantee 10k iops. Even at 1M >>>>>>>> writes per second on 60 nodes, we didn’t come close to hitting even 50% >>>>>>>> utilization (10k is more than enough

Re: Questions about the replicas selection and remote coordinator

2016-01-29 Thread Steve Robenalt
s a lot. > > Also, is there any mechanism to select which node to be remote > coordinator? > > Thanks! > > Jun > -- Steve Robenalt Software Architect sroben...@highwire.org <bza...@highwire.org> (office/cell): 916-505-1785 HighWire Press, Inc. 425 Broadway St, Redwood City, CA 94063 www.highwire.org Technology for Scholarly Communication

Re: Cassandra driver class

2016-01-29 Thread Steve Robenalt
do I replace “” with? >>>> >>>> >>>> >>>> Is “com.datastax.driver.core” even correct, or am I going down the >>>> wrong path? I am using the DataStax 2.0.2 driver, with Cassandra 2.0.8. >>>> >>>> >>>> >>>> Should I be u

Re: Questions about the replicas selection and remote coordinator

2016-01-29 Thread Steve Robenalt
docs.datastax.com/en/cassandra/2.1/cassandra/dml/architectureClientRequestsMultiDCWrites_c.html. > It > shows that node 10 in DC 1 will send directly 3 copies to 3 nodes in DC2, > without using remote coordinator. > > I'm wondering which case is true, because in multiple data ce

Re: Query Consistency Issues...

2015-12-15 Thread Steve Robenalt
k for clock sync issues between nodes in our ring? >>> How close do they need to be? >>> >>> >>>> If you have high frequency updates in the same partition from the same >>>> client you should probably use client-side timestamps with a configure

Re: Cassandra and GPU's...

2015-12-01 Thread Steve Robenalt
, > > Can Cassandra use GPU's? If not can someone recommend a open source > database that runs on GPU's? I am interested in seeing the performance > difference of a database that is under 2GB run on a GPU card such as as > NVIDA gtx 980. > > Thanks, > -Tony > -- Stev

Re: Cassandra and GPU's...

2015-12-01 Thread Steve Robenalt
potential impact on the Spark and/or Titan integration with Cassandra, rather than on Cassandra itself. Steve On Tue, Dec 1, 2015 at 12:35 PM, james anderson <james.ander...@setf.de> wrote: > good evening; > > On 2015-12-01, at 21:17, Steve Robenalt <sroben...@highwire.org&g

Re: unsubscribe

2015-10-27 Thread Steve Robenalt
ian Tarbox <briantar...@gmail.com> wrote: > unsubscribe > > -- > http://about.me/BrianTarbox > -- Steve Robenalt Software Architect sroben...@highwire.org <bza...@highwire.org> (office/cell): 916-505-1785 HighWire Press, Inc. 425 Broadway St, Redwood City,

Re: Is replication possible with already existing data?

2015-10-23 Thread Steve Robenalt
5 AM, Michael Shuler <mich...@pbandjelly.org> >> wrote: >> >>> On 10/22/2015 10:14 PM, Ajay Garg wrote: >>> >>>> However, CAS11 refuses to come up now. >>>> Following is the error in /var/log/cassandra/system.log :: >>>> >>>> >>>> >>>> ERROR [main] 2015-10-23 03:07:34,242 CassandraDaemon.java:391 - Fatal >>>> configuration error >>>> org.apache.cassandra.exceptions.ConfigurationException: Cannot change >>>> the number of tokens from 1 to 256 >>>> >>> >>> Check your cassandra.yaml - this node has vnodes enabled in the >>> configuration when it did not, previously. Check all nodes. Something >>> changed. Mixed vnode/non-vnode clusters is bad juju. >>> >>> -- >>> Kind regards, >>> Michael >>> >> >> >> >> -- >> Regards, >> Ajay >> > > > > -- > Regards, > Ajay > -- Steve Robenalt Software Architect sroben...@highwire.org <bza...@highwire.org> (office/cell): 916-505-1785 HighWire Press, Inc. 425 Broadway St, Redwood City, CA 94063 www.highwire.org Technology for Scholarly Communication

Re: Realtime data and (C)AP

2015-10-09 Thread Steve Robenalt
the nature of the workload. Steve On Fri, Oct 9, 2015 at 12:36 PM, Brice Dutheil <brice.duth...@gmail.com> wrote: > On Fri, Oct 9, 2015 at 2:27 AM, Steve Robenalt <sroben...@highwire.org> > wrote: > > In general, if you write at QUORUM and read at ONE (or LOCAL variants &g

Re: Realtime data and (C)AP

2015-10-09 Thread Steve Robenalt
But we > very quickly fall back to local_one in the cases where some data fast is > better than a failure. Currently we do that on a per read basis but we > could I suppose detect a pattern or just look at the gossip to decide to go > en masse into a degraded read mode > > Sent from m

Re: Realtime data and (C)AP

2015-10-08 Thread Steve Robenalt
he AP side of the CAP theorem. So how Cassandra can >> deliver realtime consistent data? >> AFAIK, choosing a consistency level equals to ALL can be a huge >> performance hit for C*, so, please, explain me why I should choose C* >> for realtime data >> that s

Re: INSERT JSON TimeStamp

2015-09-28 Thread Steve Robenalt
"1": { > "condition": "BoardStation", > "action": "FareAmount=9.25", > "ruleOrder": "1" > } > } > > message="Error decoding JSON value for effectivestartdate:

Re: Cassandra Summit 2015 Roll Call!

2015-09-22 Thread Steve Robenalt
de IRC (irc.freenode.org) to chat and connect > with other attendees! > > > > MY CONTRIBUTION : > > -- > > I will be at the summit on Wednesday and Thursday. I am 5'8" or so, and > will be wearing glasses and either a red or blue "Eventbrite Engineering" > t-shirt with a graphic logo of gears on it. Come say hello! :D > > > > =Rob > > > > > -- Steve Robenalt Software Architect sroben...@highwire.org <bza...@highwire.org> (office/cell): 916-505-1785 HighWire Press, Inc. 425 Broadway St, Redwood City, CA 94063 www.highwire.org Technology for Scholarly Communication

Re: Denormalization leads to terrible, rather than better, Cassandra performance -- I am really puzzled

2015-05-04 Thread Steve Robenalt
A few observations from what you've said so far: 1) IN clauses in CQL can have performance impact by including sets of keys that are spread across the cluster. 2) We previously used m3.large instances in our cluster and would see occasional read timeouts even at CL.ONE. We upgraded to i2.xlarge

Re: Fwd: ReadTimeoutException in Cassandra 2.0.11

2015-01-23 Thread Steve Robenalt
, Steve Robenalt sroben...@highwire.org wrote: I agree with Rob. You shouldn't need to change the read timeout. We had similar issues with intermittent ReadTimeoutExceptions for a while when we ran Cassandra on underpowered nodes on AWS. We've also seen them when executing unconstrained queries

Re: Fwd: ReadTimeoutException in Cassandra 2.0.11

2015-01-22 Thread Steve Robenalt
I agree with Rob. You shouldn't need to change the read timeout. We had similar issues with intermittent ReadTimeoutExceptions for a while when we ran Cassandra on underpowered nodes on AWS. We've also seen them when executing unconstrained queries with very large ResultSets (because it takes

Question about EC2 and SSDs

2014-09-04 Thread Steve Robenalt
Hi all, We are migrating a small cluster on AWS from instances based on spinning disks (using instance store) to SSD-backed instances and we're trying to pick the proper instance type. Some of the recommendations for spinning disks say to use different drives for log vs data partitions to avoid

Re: Question about EC2 and SSDs

2014-09-04 Thread Steve Robenalt
Neelakantan On Sep 4, 2014, at 8:05 PM, Steve Robenalt sroben...@highwire.org wrote: Hi all, We are migrating a small cluster on AWS from instances based on spinning disks (using instance store) to SSD-backed instances and we're trying to pick the proper instance type. Some

Re: Question about EC2 and SSDs

2014-09-04 Thread Steve Robenalt
Thanks Robert! I am assuming that you meant that it's possible with a single SSD, right? On Thu, Sep 4, 2014 at 5:42 PM, Robert Coli rc...@eventbrite.com wrote: On Thu, Sep 4, 2014 at 5:05 PM, Steve Robenalt sroben...@highwire.org wrote: We are migrating a small cluster on AWS from

Re: Question about EC2 and SSDs

2014-09-04 Thread Steve Robenalt
, Robert Coli rc...@eventbrite.com wrote: On Thu, Sep 4, 2014 at 5:44 PM, Steve Robenalt sroben...@highwire.org wrote: Thanks Robert! I am assuming that you meant that it's possible with a single SSD, right? Yes, no matter how many SSDs you have you are unlikely to be able to convince one