Re: trouble setting up initial cluster: Host ID collision between active endpoint

2013-01-24 Thread Ben Bromhead
Instaclustr out. Cheers Ben Bromhead *Instaclustr* On Fri, Jan 25, 2013 at 12:35 AM, Tim Dunphy bluethu...@gmail.com wrote: Cool Thanks for the advice Aaron. I actually did get this working before I read your reply. The trick apparently for me was to use the IP for the first node in the seeds

Re: no other nodes seen on priam cluster

2013-02-26 Thread Ben Bromhead
Hi Marcelo A few questions: Have your added the priam java agent to cassandras JVM argurments (e.g. -javaagent:$CASS_HOME/lib/priam-cass-extensions-1.1.15.jar) and does the web container running priam have permissions to write to the cassandra config directory? Also what do the priam logs say?

Re: no other nodes seen on priam cluster

2013-02-27 Thread Ben Bromhead
why? It's probably what is causing cassandra to die, right? 2013/2/27 Marcelo Elias Del Valle mvall...@gmail.com Hello Ben, Thanks for the willingness to help, 2013/2/27 Ben Bromhead b...@instaclustr.com Have your added the priam java agent to cassandras JVM argurments (e.g. -javaagent

Re: no other nodes seen on priam cluster

2013-03-03 Thread Ben Bromhead
), I am guessing priam use the data backed up to S3 to restore a node data in another instance, right? []s 2013/2/28 Ben Bromhead b...@relational.io Off the top of my head I would check to make sure the Autoscaling Group you created is restricted to a single Availability Zone, also

Re: Cassandra instead of memcached

2013-03-05 Thread Ben Bromhead
Check out http://techblog.netflix.com/2012/07/benchmarking-high-performance-io-with.html Netflix used Cassandra with SSDs and were able to drop their memcache layer. Mind you they were not using it purely as an in memory KV store. Ben Instaclustr | www.instaclustr.com | @instaclustr On

Re: Using an EC2 cluster from the outside.

2013-04-17 Thread Ben Bromhead
Depending on your client, disable automatic client discovery and just specify a list of all your nodes in your client configuration. For more details check out http://xzheng.net/blogs/problem-when-connecting-to-cassandra-with-ruby/ , obviously this deals specifically with a ruby client but it

Re: Installing specific version

2013-07-07 Thread Ben Bromhead
On ubuntu it is: apt-get install cassandra=1.2.4 So should be similar for debian Ben Bromhead Instaclustr | www.instaclustr.com | @instaclustr | +61 415 936 359 On 05/07/2013, at 10:59 PM, Kais Ahmed k...@neteck-fr.com wrote: Hi ben, You can get it from http://archive.apache.org/dist

Re: Which of these VPS configurations would perform better for Cassandra ?

2013-08-04 Thread Ben Bromhead
(SmartOS is based on Solaris). Just make sure you test and benchmark all your options, a few days of testing now will save you weeks of pain. Good luck! Ben Bromhead Instaclustr | www.instaclustr.com | @instaclustr On 05/08/2013, at 12:34 AM, David Schairer dschai...@humbaba.net wrote: Of course

Re: Recommendation for hosting multi tenant clusters

2013-08-13 Thread Ben Bromhead
Ben Bromhead Instaclustr | www.instaclustr.com | @instaclustr | +61 415 936 359 On 14/08/2013, at 10:42 AM, Jon Haddad j...@jonhaddad.com wrote: I strongly recommend against EBS, even with optimized ebs provisioned. The throughput you'll get from local drives is significantly better than what

Re: PropertiesFileSnitch

2013-12-09 Thread Ben Bromhead
to define its dc / rack and it will use gossip to discover this information about other nodes. Ben Bromhead Instaclustr | www.instaclustr.com | @instaclustr | +61 415 936 359 On 10 Dec 2013, at 5:31 am, Marcelo Elias Del Valle marc...@s1mbi0se.com.br wrote: Hello everyone, I have

Re: in AWS is it worth trying to talk to a server in the same zone as your client?

2014-02-12 Thread Ben Bromhead
/apidocs/com/datastax/driver/core/policies/LoadBalancingPolicy.html … and set the distance based on which zone the node is in. An alternate method would be to define the zones as data centres and then you could leverage existing DC aware policies (We've never tried this though). Ben Bromhead

Re: Recommended OS

2014-02-12 Thread Ben Bromhead
in production (after all the warnings), run most of your cluster on linux, then run a single node or a separate DC with SmartOS, Solaris, BeOS, OS/2, Minix, Windows 3.1 or whatever it is that you choose and let us know how it all goes! Cheers Ben Bromhead Instaclustr | www.instaclustr.com | @instaclustr

Re: Load balancing issue with virtual nodes

2014-04-28 Thread Ben Bromhead
Some imbalance is expected and considered normal: See http://wiki.apache.org/cassandra/VirtualNodes/Balance As well as https://issues.apache.org/jira/browse/CASSANDRA-7032 Ben Bromhead Instaclustr | www.instaclustr.com | @instaclustr | +61 415 936 359 On 29 Apr 2014, at 7:30 am, DuyHai Doan

Re: Connect Cassandra rings in datacenter and ec2

2014-04-29 Thread Ben Bromhead
will be the way to go http://docs.aws.amazon.com/AmazonVPC/latest/UserGuide/VPN_CloudHub.html. Additionally to access your Cassandra instances from your other VPCs you can use VPC peering (within the same region). See http://docs.aws.amazon.com/AmazonVPC/latest/UserGuide/vpc-peering.html Ben

Re: Can Cassandra client programs use hostnames instead of IPs?

2014-05-13 Thread Ben Bromhead
the public IPs. If you run in a VPC without public addressing and want to connect from external hosts you will want to look at a VPN (http://docs.aws.amazon.com/AmazonVPC/latest/UserGuide/VPC_VPN.html). Ben Bromhead Instaclustr | www.instaclustr.com | @instaclustr | +61 415 936 359 On 13/05/2014

Re: Storing log structured data in Cassandra without compactions for performance boost.

2014-05-16 Thread Ben Bromhead
make range queries slower (the query has more files to visit). See http://stackoverflow.com/questions/8917882/cassandra-sstables-and-compaction (a little old but still relevant). Compaction also fixes up things like merging row fragments (when you write new columns to the same row). Ben Bromhead

Re: Ec2 Network I/O

2014-05-20 Thread Ben Bromhead
Also once you've got your phi_convict_threshold sorted, if you see these again check: http://status.aws.amazon.com/ AWS does occasionally have the odd increased latency issue / outage. Ben Bromhead Instaclustr | www.instaclustr.com | @instaclustr | +61 415 936 359 On 19/05/2014, at 1:15 PM

Re: autoscaling cassandra cluster

2014-05-21 Thread Ben Bromhead
nonetheless. Datastax OpsCenter also provides capacity planning and forecasting and can provide an easy set of metrics you can make your scaling decisions on. http://www.datastax.com/what-we-offer/products-services/datastax-opscenter Ben Bromhead Instaclustr | www.instaclustr.com | @instaclustr

Re: Multi-DC Environment Question

2014-05-29 Thread Ben Bromhead
-in-cassandra Ben Bromhead Instaclustr | www.instaclustr.com | @instaclustr | +61 415 936 359 On 30 May 2014, at 8:40 am, Tupshin Harper tups...@tupshin.com wrote: When one node or DC is down, coordinator nodes being written through will notice this fact and store hints (hinted handoff

Re: Managing truststores with inter-node encryption

2014-05-30 Thread Ben Bromhead
Java ssl sockets need to be able to build a chain of trust. So having either a nodes public cert or the root cert in the truststore works (as you found out). To get cassandra to use cypher suites 128 bit you will need to install the JCE unlimited strength jurisdiction policy files. You will know

Re: VPC AWS

2014-06-10 Thread Ben Bromhead
Cassandra in a VPC solution, but we haven’t ever used it in a production environment or with a heavy load, so caveat emptor. As for the snitch… the GPFS is definitely the most flexible. Ben Bromhead Instaclustr | www.instaclustr.com | @instaclustr | +61 415 936 359 On 10 Jun 2014, at 1:42 am

Re: Minimum Cluster size to accommodate a single node failure

2014-06-18 Thread Ben Bromhead
Yes your thinking is correct. This article from TLP sums it all up beautifully http://thelastpickle.com/blog/2011/06/13/Down-For-Me.html Ben Bromhead Instaclustr | www.instaclustr.com | @instaclustr | +61 415 936 359 On 18 Jun 2014, at 4:18 pm, Prabath Abeysekara prabathabeysek...@gmail.com

Re: EBS SSD - Cassandra ?

2014-06-18 Thread Ben Bromhead
. Ben Bromhead Instaclustr | www.instaclustr.com | @instaclustr | +61 415 936 359 On 18 Jun 2014, at 7:18 pm, Daniel Chia danc...@coursera.org wrote: While they guarantee IOPS, they don't really make any guarantees about latency. Since EBS goes over the network, there's so many things

Re: EBS SSD - Cassandra ?

2014-06-19 Thread Ben Bromhead
Nate you are right in that it is a function of logical separation helps for some reason. Ben Bromhead Instaclustr | www.instaclustr.com | @instaclustr | +61 415 936 359 On 20 Jun 2014, at 8:17 am, Nate McCall n...@thelastpickle.com wrote: Sorry - should have been clear I was speaking

Re: possible to have TTL on individual collection values?

2014-07-17 Thread Ben Bromhead
Create a table with a set as one of the columns using cqlsh, populate with a few records. Connect using the cassandra-cli, run list on your table/cf and you'll see how the sets work. Ben Bromhead Instaclustr | www.instaclustr.com | @instaclustr | +61 415 936 359 On 13/07/2014, at 11:19 AM

Re: any plans for coprocessors?

2014-07-27 Thread Ben Bromhead
http://www.datastax.com/dev/blog/whats-new-in-cassandra-2-0-prototype-triggers-support http://www.datastax.com/documentation/cql/3.1/cql/cql_reference/trigger_r.html Ben Bromhead Instaclustr | www.instaclustr.com | @instaclustr | +61 415 936 359 On 26 Jul 2014, at 11:32 am, Kevin Burton bur

Re: stalled nodetool repair?

2014-08-21 Thread Ben Bromhead
https://github.com/mstump/cassandra_range_repair Also very useful. Ben Bromhead Instaclustr | www.instaclustr.com | @instaclustr | +61 415 936 359 On 22/08/2014, at 6:12 AM, Robert Coli rc...@eventbrite.com wrote: On Thu, Aug 21, 2014 at 12:32 PM, Kevin Burton bur...@spinn3r.com wrote

Re: stalled nodetool repair?

2014-08-21 Thread Ben Bromhead
Ah sorry that is the original repo, see https://github.com/BrianGallew/cassandra_range_repair for the updated version of the script with vnode support Ben Bromhead Instaclustr | www.instaclustr.com | @instaclustr | +61 415 936 359 On 22 Aug 2014, at 2:19 pm, DuyHai Doan doanduy...@gmail.com

Re: Can't Add AWS Node due to /mnt/cassandra/data directory

2014-08-27 Thread Ben Bromhead
Make sure you have also setup the ephemeral drives as a raid device (use mdadm) and mounted it under /mnt/cassandra otherwise your data dir is the os partition which is usually very small. Ben Bromhead Instaclustr | www.instaclustr.com | @instaclustr | +61 415 936 359 On 27 Aug 2014, at 8:21

Re: Heterogenous cluster and vnodes

2014-08-30 Thread Ben Bromhead
as an admin for the cluster isn't. If you do add more hard drives you can also split out the commit log etc onto different disks. I would take less problems over trying to draw every last scrap of performance out of the available hardware any day of the year. Ben Bromhead Instaclustr

Re: Question about EC2 and SSDs

2014-09-04 Thread Ben Bromhead
into different volumes doesn’t do a whole lot of good on AWS irrespective of whether you are on spinning disks or SSDs. Simply because the volumes presented to the vm may be on the same disk. Just raid the available volumes and be done with it. Ben Bromhead Instaclustr | www.instaclustr.com

Re: Moving Cassandra from EC2 Classic into VPC

2014-09-08 Thread Ben Bromhead
On 8 Sep 2014, at 12:34 pm, Oleg Dulin oleg.du...@gmail.com wrote: Another idea I had was taking the ec2-snitch configuration and converting it into a Property file snitch. But I still don't understand how to perform this move since I need my newly created VPC instances to have public IPs --

Re: no change observed in read latency after switching from EBS to SSD storage

2014-09-16 Thread Ben Bromhead
, Mohammed -- Ben Bromhead Instaclustr | www.instaclustr.com | @instaclustr http://twitter.com/instaclustr | +61 415 936 359

Re: Repair taking long time

2014-09-30 Thread Ben Bromhead
such a thing exist? Ken -- Ben Bromhead Instaclustr | www.instaclustr.com | @instaclustr http://twitter.com/instaclustr | +61 415 936 359

Re: best practice for waiting for schema changes to propagate

2014-09-30 Thread Ben Bromhead
cluster. What is the best way to deal with this problem? Is there a standard way to wait for schema changes to propagate? Best regards, Clint -- Ben Bromhead Instaclustr | www.instaclustr.com | @instaclustr http://twitter.com/instaclustr | +61 415 936 359

Re: Experience with multihoming cassandra?

2014-09-30 Thread Ben Bromhead
) 443-2333 dona...@audiencescience.com [image: AudienceScience] -- Ben Bromhead Instaclustr | www.instaclustr.com | @instaclustr http://twitter.com/instaclustr | +61 415 936 359

Re: DSE install interfering with apache Cassandra 2.1.0

2014-09-30 Thread Ben Bromhead
cassandra runtime. Ta Andy The University of Dundee is a registered Scottish Charity, No: SC015096 The University of Dundee is a registered Scottish Charity, No: SC015096 -- Ben Bromhead Instaclustr | www.instaclustr.com | @instaclustr http://twitter.com/instaclustr | +61 415 936

Re: DSE install interfering with apache Cassandra 2.1.0

2014-09-30 Thread Ben Bromhead
Only recently! Moving off list (c* users bcc'd). On 30 September 2014 19:20, Andrew Cobley a.e.cob...@dundee.ac.uk wrote: HI Ben, yeah, that was it, recovered from the Cassandra summit ? Andy On 30 Sep 2014, at 08:19, Ben Bromhead b...@instaclustr.com wrote: check your cqlshrc

Re: How to enable client-to-node encrypt communication with Astyanax cassandra client

2014-10-08 Thread Ben Bromhead
) at com.netflix.astyanax.thrift.ThriftSyncConnectionFactoryImpl$ThriftConnection.open(ThriftSyncConnectionFactoryImpl.java:203) ... 6 more It looks like that my SSL settings are incorrect. Does anyone know how to resolve this issue? Thanks Boying -- Ben Bromhead Instaclustr | www.instaclustr.com | @instaclustr http

Re: Error: No module named cql

2014-10-14 Thread Ben Bromhead
/.local/lib/python2.7/site-packages', '/usr/local/lib/python2.7/site-packages'] Error: No module named cql I get the same exact error. How on earth do I break out of this feeback loop? Thanks! Tim -- GPG me!! gpg --keyserver pool.sks-keyservers.net --recv-keys F186197B -- Ben

Re: Dependency Hell: STORM 0.9.2 and Cassandra 2.0

2014-10-25 Thread Ben Bromhead
that is difficult to tackle. Cassandra 2.0Java driver requires google guava 1.6. Unfortuanately, storm 0.9.2 provides a lower version. Because of that, a topology will not be able to contact Cassandra databases. Thanks Gary -- Ben Bromhead Instaclustr | www.instaclustr.com | @instaclustr

Re: Repair/Compaction Completion Confirmation

2014-10-27 Thread Ben Bromhead
://www.datastax.com/dev/blog/anticompaction-in-cassandra-2-1 [2] Or, more sensibly, once a month with gc_grace_seconds set to 34 days. Thank you for getting back to me so quickly. Not the answer that I was secretly hoping for, but it is nice to have confirmation. :) Cheers! -Tim -- Ben

Re: bootstrapping manually when auto_bootstrap=false ?

2014-12-17 Thread Ben Bromhead
://spinn3r.com -- Ben Bromhead Instaclustr | www.instaclustr.com | @instaclustr http://twitter.com/instaclustr | +61 415 936 359

Re: simple data movement ?

2014-12-17 Thread Ben Bromhead
information that may be confidential. Unless you are the named addressee or an authorized designee, you may not copy or use it, or disclose it to anyone else. If you received it in error please notify us immediately and then destroy it -- Ben Bromhead Instaclustr | www.instaclustr.com

Re: Deleted snapshot files filling up /var/lib/cassandra

2015-03-16 Thread Ben Bromhead
, but decreases the burden placed on the nodes, and means you have less impact on reads/writes to the system.* On 16 March 2015 at 16:33, David Wahler dwah...@indeed.com wrote: On Mon, Mar 16, 2015 at 6:12 PM, Ben Bromhead b...@instaclustr.com wrote: Cassandra will by default snapshot your data directory

Re: Deleted snapshot files filling up /var/lib/cassandra

2015-03-16 Thread Ben Bromhead
server, and the space taken up by these deleted files is growing by several GB per day. For now we can work around the problem by periodically restarting servers to close the file handles, but that hurts our availability and seems like a hack. -- Ben Bromhead Instaclustr | www.instaclustr.com

Re: Deleted snapshot files filling up /var/lib/cassandra

2015-03-20 Thread Ben Bromhead
wrote: On Mon, Mar 16, 2015 at 6:51 PM, Ben Bromhead b...@instaclustr.com wrote: If you are running a sequential repair (or have previously run a sequential repair that is still running) Cassandra will still have the file descriptors open for files in the snapshot it is using

Re: how to clear data from disk

2015-03-12 Thread Ben Bromhead
is not removed from disk, I should reduce the gc_grace_seconds before the drop operation. I have to wait for 10 days, but there is not enough disk. Could you tell me there is method to clear the data from disk quickly? Thank you very much! Peter -- Ben Bromhead Instaclustr

Re: High latencies for simple queries

2015-03-28 Thread Ben Bromhead
than the internal C* python driver, but this might be a question for python-driver folk. On 28 March 2015 at 00:34, Artur Siekielski a...@vhex.net wrote: On 03/28/2015 12:13 AM, Ben Bromhead wrote: One other thing to keep in mind / check is that doing these tests locally the cassandra driver

Re: run cassandra on a small instance

2015-02-22 Thread Ben Bromhead
with a 6th monitoring server for light to moderate local testing in 16g of laptop ram. YMMV but it is possible. -- GPG me!! gpg --keyserver pool.sks-keyservers.net --recv-keys F186197B -- GPG me!! gpg --keyserver pool.sks-keyservers.net --recv-keys F186197B -- Ben Bromhead

Re: High latencies for simple queries

2015-03-27 Thread Ben Bromhead
of Cassandra compared to Postgresql is different, but for some scenarios this difference can matter. The question is: is it normal for Cassandra to have a minimum latency of 1 millisecond? I'm using Cassandra 2.1.2, python-driver. -- Tyler Hobbs DataStax http://datastax.com/ -- Ben

Re: Arbitrary nested tree hierarchy data model

2015-03-27 Thread Ben Bromhead
that allows us to display the entire tree quickly, as well as see the entire path to a leaf when selecting that leaf. If anyone has some suggestions/experience on how to model such a tree heirarchy we would greatly appreciate your input. -- Ben Bromhead Instaclustr | www.instaclustr.com

Re: Really high read latency

2015-03-23 Thread Ben Bromhead
%3Aprimary Twitter https://twitter.com/tink -- Ben Bromhead Instaclustr | www.instaclustr.com | @instaclustr http://twitter.com/instaclustr | (650) 284 9692

Re: Java 8

2015-05-07 Thread Ben Bromhead
plans to support Java 8 for Cassandra 2.0, now that Java 7 is EOL? Currently Java 7 is also recommended for 2.1. Are there any reasons not to recommend Java 8 for 2.1? Thanks, Stefan -- Ben Bromhead Instaclustr | www.instaclustr.com | @instaclustr http://twitter.com/instaclustr | (650

Re: Data migration

2015-04-14 Thread Ben Bromhead
please suggest some tool? -- Ben Bromhead Instaclustr | www.instaclustr.com | @instaclustr http://twitter.com/instaclustr | (650) 284 9692

Re: Spark SQL JDBC Server + DSE

2015-06-02 Thread Ben Bromhead
organizations are using this combination. If you do use DSE + Spark SQL JDBC server, it would be great if you could share your experience. For example, what kind of issues you have run into? How is the performance? What reporting tools you are using? Thank you! Mohammed -- Ben

Re: Deploying OpsCenter behind a HTTP(S) proxy

2015-06-18 Thread Ben Bromhead
-- Ben Bromhead Instaclustr | www.instaclustr.com | @instaclustr http://twitter.com/instaclustr | (650) 284 9692

Re: Lucene index plugin for Apache Cassandra

2015-06-11 Thread Ben Bromhead
community. Regards, -- Andrés de la Peña http://www.stratio.com/ Avenida de Europa, 26. Ática 5. 3ª Planta 28224 Pozuelo de Alarcón, Madrid Tel: +34 91 352 59 42 // *@stratiobd https://twitter.com/StratioBD* -- Ben Bromhead Instaclustr | www.instaclustr.com | @instaclustr http

Re: check active queries on cluster

2015-06-01 Thread Ben Bromhead
on cassandra ? You can get a count of them with : https://issues.apache.org/jira/browse/CASSANDRA-5084 =Rob -- Ben Bromhead Instaclustr | www.instaclustr.com | @instaclustr http://twitter.com/instaclustr | (650) 284 9692

Re: Multiple cassandra instances per physical node

2015-05-26 Thread Ben Bromhead
Austin, TX @zznate Co-Founder Sr. Technical Consultant Apache Cassandra Consulting http://www.thelastpickle.com -- Ben Bromhead Instaclustr | www.instaclustr.com | @instaclustr http://twitter.com/instaclustr | (650) 284 9692

Re: Back to the futex()? :(

2016-02-09 Thread Ben Bromhead
le_flush_writers as I was >> writing this--so I'll get on that. Aside from that, I'm not sure what to >> do. (Thanks, again, for reading.) >> >> * They were batched for consistency--I'm hoping to return to using them >> when I'm back at normal load, which is tiny compared to backloading, but >> the impact on performance was eye-opening. >> ___ >> Will Hayworth >> Developer, Engagement Engine >> Atlassian >> >> My pronoun is "they". <http://pronoun.is/they> >> >> >> > -- Ben Bromhead CTO | Instaclustr <https://www.instaclustr.com/> +1 650 284 9692 Managed Cassandra / Spark on AWS, Azure and Softlayer

Re: Re : Possibility of using 2 different snitches in the Multi_DC cluster

2016-02-03 Thread Ben Bromhead
=Rob >> PS - To answer your actual question... one "can" use different snitches >> on a per node basis, but ONE REALLY REALLY SHOULDN'T CONSIDER THIS A VALID >> APPROACH AND IF ONE TRIES AND FAILS I WILL POINT AND LAUGH AND NOT HELP >> THEM :D >> > > -- Ben Bromhead CTO | Instaclustr +1 650 284 9692

Re: Any tips on how to track down why Cassandra won't cluster?

2016-02-03 Thread Ben Bromhead
ght trigger this problem? I'm > not receiving any exceptions. > > > -- > -Richard L. Burton III > @rburton > -- Ben Bromhead CTO | Instaclustr +1 650 284 9692

Re: EC2 storage options for C*

2016-02-03 Thread Ben Bromhead
;> >>>>>>>> >>>>>>>> -- >>>>>>>> Jeff Jirsa >>>>>>>> >>>>>>>> >>>>>>>> On Jan 31, 2016, at 9:52 AM, Jack Krupansky < >>>>>>>> jack.krupan...@gmail.com> wrote: >>>>>>&g

Re: „Using Timestamp“ Feature

2016-02-23 Thread Ben Bromhead
> update statement (works with 'insert'). Is there a good reason for this, or >> is it a bug? >> > > The "USING TIMESTAMP" goes in a different place in update statements. It > should be something like: > > UPDATE mytable USING TIMESTAMP ? SET col = ? WHERE key =

Re: Sudden disk usage

2016-02-17 Thread Ben Bromhead
and have the unusual property of > growing larger over time. This is because they are hard links of data files > and do not take up disk space of their own until the files they link to are > compacted into new files. > > =Rob > > -- Ben Bromhead CTO | Instaclustr <https:/

Re: Cassandra nodes reduce disks per node

2016-02-17 Thread Ben Bromhead
>> the relevant cassandra home location folders, change the cassanda.yaml >>> configuration and restart the node. before starting i will shutdown the >>> cluster. >>> >> >> Yes. >> >> =Rob >> >> > > -- Ben Bromhead CTO | Instaclustr <https://www.instaclustr.com/> +1 650 284 9692 Managed Cassandra / Spark on AWS, Azure and Softlayer

Re: How can I make Cassandra stable in a 2GB RAM node environment ?

2016-03-07 Thread Ben Bromhead
13/08/31/building-the-perfect-cassandra-test-environment/ > > Has some good discussion of how to run Cassandra in a low memory > environment. Maybe someone should tell John that his 64MB of JVM heap for a > test node is 62x too small to be "supported"? :D > > =Rob > > -- Ben Bromhead CTO | Instaclustr <https://www.instaclustr.com/> +1 650 284 9692 Managed Cassandra / Spark on AWS, Azure and Softlayer

Re: Optional TLS CQL Encryption

2016-04-20 Thread Ben Bromhead
gement connections but not for same > datacenter usage (since the build/up tear down cost is too high for things > that don't use pools). > > Right now it appears if we enable encryption it requires it for all > connections, which definitely is not what we want. > > -J >

Re: Changing Racks of Nodes

2016-04-20 Thread Ben Bromhead
ts for the data it does not own > (meaning data will never “disappear”) ? > > > > I’d appreciate some details on this topic from experts ! > > > > Thanks ! > -- Ben Bromhead CTO | Instaclustr <https://www.instaclustr.com/> +1 650 284 9692 Managed Cassandra / Spark on AWS, Azure and Softlayer

Re: SS Tables Files Streaming

2016-05-09 Thread Ben Bromhead
n I ask is I am working on a solution for backup / restore and I > need to be sure if I boot a node, start copying over backed up files then > those files won’t get overwritten by something coming from other nodes. > > > > Thanks ! > > -- Ben Bromhead CTO | Instaclustr <https://www.instaclustr.com/> +1 650 284 9692 Managed Cassandra / Spark on AWS, Azure and Softlayer

Re: SS Tables Files Streaming

2016-05-09 Thread Ben Bromhead
Note that incremental repair strategies (2.1+) run anti-compaction against sstables in the range being repaired, so this will prevent overstreaming based on the ranges in the repair session. On Mon, 9 May 2016 at 10:31 Ben Bromhead <b...@instaclustr.com> wrote: > Yup, wi

Re: Authentication with Java driver

2017-02-07 Thread Ben Bromhead
the application process. I would not rely on Cassandra auth to authenticate downstream actors, not because it's bad, just its generally inefficient to create lots of session objects. The session object maintains a connection pool, pipelines requests, is thread safe and generally pretty solid.

Instaclustr Masters scholarship

2017-02-07 Thread Ben Bromhead
and is welcoming of foreign students. We are also open to sponsoring a PhD project with a more in depth focus for the right candidate. For more details please don't hesitate to get in touch with myself or reach out to i...@instaclustr.com. Cheers Ben -- Ben Bromhead CTO | Instaclustr <ht

Re: Authentication with Java driver

2017-02-07 Thread Ben Bromhead
ng keyspace, String user, String password) { > > if (cluster == null) { > > builder = Cluster.builder(); > > ... > > builder = builder.withCredentials(user, password); > > cluster = builder.build(); > > } > > session = sessio

Re: compaction falling behind

2017-02-13 Thread Ben Bromhead
not be the most reliable thing to use. > > > > - John > -- Ben Bromhead CTO | Instaclustr <https://www.instaclustr.com/> +1 650 284 9692 Managed Cassandra / Spark on AWS, Azure and Softlayer

Re: Authentication with Java driver

2017-02-09 Thread Ben Bromhead
> So, we aren't sure that the application works when a lot of > cluster/session objects are created. > Is it correct? > > Thank you, > Yuji > > > > On Wed, Feb 8, 2017 at 12:01 PM, Ben Bromhead <b...@instaclustr.com> wrote: > > On Tue, 7 Feb 2017 at 17:

Re: Cassandra Authentication

2017-01-18 Thread Ben Bromhead
3.1/cql/cql_using/update_ks_rf_t.html)? > or can I live with RF of 3 in each DC (other KS are using 3) > > If it has to be equal to the number of nodes then, every time adding or > removing a node requires update of RF. > > Thanks in advance. > -- Ben Bromhead CTO | Instaclustr <ht

Re: Cassandra Authentication

2017-01-18 Thread Ben Bromhead
eem...@gmail.com> wrote: > Thanks Ben, > > RF 3 isn't sufficient for system_auth? as we are using 3 RF for other > production KS, do you see any challenges? > > On Wed, Jan 18, 2017 at 2:39 PM, Ben Bromhead <b...@instaclustr.com> wrote: > > We have a process that syncs a

Re: How Fast Does Information Spread With Gossip?

2016-09-16 Thread Ben Bromhead
e upper bound for most clusters? Too high, too low? >> >> >> Thanks, >> >> Jerome >> > -- > > Jens Rantil > Backend Developer @ Tink > > Tink AB, Wallingatan 5, 111 60 Stockholm, Sweden > For urgent matters you can reach me at +46-708-84 18 32. > -- Ben Bromhead CTO | Instaclustr <https://www.instaclustr.com/> +1 650 284 9692 Managed Cassandra / Spark on AWS, Azure and Softlayer

Re: Handle Leap Seconds with Cassandra

2016-10-27 Thread Ben Bromhead
oo Mail on Android > <https://overview.mail.yahoo.com/mobile/?.src=Android> > > On Thu, 20 Oct, 2016 at 11:25 PM, Ben Bromhead > > <b...@instaclustr.com> wrote: > http://www.datastax.com/dev/blog/preparing-for-the-leap-second gives a > pretty good overview > >

Re: Are Cassandra writes are faster than reads?

2016-11-08 Thread Ben Bromhead
ound that reducing the batch size below 20 also increases the > writing speed and reduction in memory usage(especially for Python driver). > > Kind regards, > Rajesh R > > ------ > *From:* Ben Bromhead [b...@instaclustr.com] > *Sent:* 07 November 20

Re: Are Cassandra writes are faster than reads?

2016-11-06 Thread Ben Bromhead
Check out https://wiki.apache.org/cassandra/WritePathForUsers for the full gory details. On Sun, 6 Nov 2016 at 21:09 Ali Akhtar <ali.rac...@gmail.com> wrote: > How long does it take for updates to get merged / compacted into the main > data file? > > On Mon, Nov 7, 2016 at 5:3

Re: Are Cassandra writes are faster than reads?

2016-11-06 Thread Ben Bromhead
They can be and it depends on your compaction strategy :) On Sun, 6 Nov 2016 at 21:24 Ali Akhtar <ali.rac...@gmail.com> wrote: > tl;dr? I just want to know if updates are bad for performance, and if so, > for how long. > > On Mon, Nov 7, 2016 at 10:23 AM, Ben Bromhead <

Re: Are Cassandra writes are faster than reads?

2016-11-06 Thread Ben Bromhead
6, 2016 at 12:42 PM > *To: *"user@cassandra.apache.org" <user@cassandra.apache.org> > *Subject: *Are Cassandra writes are faster than reads? > > > > Hi all, > > > > Are Cassandra writes are faster than reads ?? If yes, why is this so? I am &g

Re: Handle Leap Seconds with Cassandra

2016-10-20 Thread Ben Bromhead
ng question: > > How do you handle wrong ordering of multiple writes (on same row and > column) during the leap second? You may overwrite the new value with old > one (disaster). > > And Downtime is no option :) > > I can see that CASSANDRA-9131 is still open.. > > FYI..we ar

Re: Introducing Cassandra 3.7 LTS

2016-10-20 Thread Ben Bromhead
; it seems safe to say it will change. There hasn't been any official > announcement yet, however. > > Kurt Greaves > k...@instaclustr.com > www.instaclustr.com > > > -- Ben Bromhead CTO | Instaclustr <https://www.instaclustr.com/> +1 650 284 9692 Managed Cassandra / Spark on AWS, Azure and Softlayer

Introducing Cassandra 3.7 LTS

2016-10-19 Thread Ben Bromhead
Instaclustr runs in production for Cassandra 3.7 and this is our way of helping the community get a similar level of stability as what you would get from our managed service. Cheers Ben -- Ben Bromhead CTO | Instaclustr <https://www.instaclustr.com/> +1 650 284 9692 Managed Cassandra / Spark

Re: High system CPU during high write workload

2016-11-14 Thread Ben Bromhead
eng) [566347] {CVE-2010-0623} Can some who has faced and resolved this issue help us here. Thanks, Abhishek -- Ben Bromhead CTO | Instaclustr <https://www.instaclustr.com/> +1 650 284 9692 Managed Cassandra / Spark on AWS, Azure and Softlayer

Re: Is it *safe* to issue multiple replace-node at the same time?

2016-11-21 Thread Ben Bromhead
need to replace multiple hosts in the same rack, is it safe > to replace them in parallel, using the replace-node command? > > Will it cause any data inconsistency if we do so? > > Thanks > Dikang. > > -- > Dikang > > -- Ben Bromhead CTO | Instaclustr <ht

Re: Clarify Support for 2.2 on Download Page

2016-11-21 Thread Ben Bromhead
, md5 > > <http://www.apache.org/dist/cassandra/2.1.16/apache-cassandra-2.1.16-bin.tar.gz.md5> > and sha1 > > <http://www.apache.org/dist/cassandra/2.1.16/apache-cassandra-2.1.16-bin.tar.gz.sha1>), >released on 2016-10-10. > > > What would be the best approach to help get this changed? > > -Derek > -- Ben Bromhead CTO | Instaclustr <https://www.instaclustr.com/> +1 650 284 9692 Managed Cassandra / Spark on AWS, Azure and Softlayer

Re: Any Bulk Load on Large Data Set Advice?

2016-11-17 Thread Ben Bromhead
s to all nodes simultaneously? Should I be doing any kind of sorting > by the partition key? > > This is a lot of data, so I figured I'd ask before I pulled the trigger. > Thanks in advance! > > > -- Ben Bromhead CTO | Instaclustr <https://www.instaclustr.com/> +1 650 284 9692 Managed Cassandra / Spark on AWS, Azure and Softlayer

Re: Priority for cassandra nodes in cluster

2016-11-12 Thread Ben Bromhead
to provide weightage or priority to the nodes in cluster. > > Eg., We want more more records to be written to first 2 nodes and less to > the 3rd node. We are thinking of this approach because we want to install > other IO intensive messaging server in the 3rd node, in order to reduce the &

Re: Introducing Cassandra 3.7 LTS

2016-11-02 Thread Ben Bromhead
Kai Wang <dep...@gmail.com> wrote: > > This is awesome! Stability is the king. > > Thank you so much! > > On Oct 19, 2016 2:56 PM, "Ben Bromhead" <b...@instaclustr.com> wrote: > > Hi All > > I am proud to announce we are making available our production b

Re: Handle Leap Seconds with Cassandra

2016-11-02 Thread Ben Bromhead
So, we want to be proactive with things. > > I agree that you should avoid such scebaruos with design (if possible). > > Good to know that you guys have setup your own NTP servers as per the > recommendation. Curious..Do you also do some monitoring around NTP? > > > >

Re: Is there any way to throttle the memtable flushing throughput?

2016-10-11 Thread Ben Bromhead
c: batch > - commitlog_sync_batch_window_in_ms: 2 > (Using default value for the other configurations) > > > Regards, > Satoshi > > -- Ben Bromhead CTO | Instaclustr <https://www.instaclustr.com/> +1 650 284 9692 Managed Cassandra / Spark on AWS, Azure and Softlayer

Re: Does increment/decrement by 0 generate any commits ?

2016-10-13 Thread Ben Bromhead
most > cases, I will increment 1 column by positive integer and the others by 0. > > Makes sense ? > -- Ben Bromhead CTO | Instaclustr <https://www.instaclustr.com/> +1 650 284 9692 Managed Cassandra / Spark on AWS, Azure and Softlayer

Re: Adding disk capacity to a running node

2016-10-17 Thread Ben Bromhead
to the list of data directories. My > question, is, will Cassandra use the new disk for compactions on sstables > that already exist in the primary directory? > > > > > > > > Thanks! > > > > > > > > CONFIDENTIALITY NOTE: This e-mail and any attachments are confidential and > may be legally privileged. If you are not the intended recipient, do not > disclose, copy, distribute, or use this email or any attachments. If you > have received this in error please let the sender know and then delete the > email and all attachments. > -- Ben Bromhead CTO | Instaclustr <https://www.instaclustr.com/> +1 650 284 9692 Managed Cassandra / Spark on AWS, Azure and Softlayer

Re: Adding disk capacity to a running node

2016-10-17 Thread Ben Bromhead
d to do some manual copying of files? such as > > mv /mnt/path/to/large/sstable.sd /mnt/newebs ? > > Thanks! > > On Mon, Oct 17, 2016 at 12:59 PM, Ben Bromhead <b...@instaclustr.com> > wrote: > > Yup as everyone has mentioned ephemeral are fine if you run in multiple

Re: Why does `now()` produce different times within the same query?

2016-12-01 Thread Ben Bromhead
> timeuuid spec (or as close to it as we can make it). > Maybe formally defined is the wrong term... Formally documented? > > On Thu, Dec 1, 2016 at 7:25 AM, Benjamin Roth <benjamin.r...@jaumo.com> > wrote: > > Great comment. +1 > > Am 01.12.2016 06:29 sch

  1   2   >