Re: Proposal to retroactively mark materialized views experimental

2017-10-09 Thread kurt greaves
> > My concerns have consistently been more fundamental - the basic properties > of a theoretically bug-free MV are simultaneously problematic and unknown. > How can we say we have a working feature, when we our definition of > ‘working’ is unknown? Well, we know to some extent that MV's are theor

Using SCT to test cassandra clusters

2017-10-09 Thread Roy Dahan
Hi, My name is Roy and I'm one of the maintainers of SCT , a framework to deploy and test Scylla & Cassandra clusters on various backends like (AWS, GCE, OpenStack and libvirt). In general: - scdm.cluster: Contains cluster/node abstractions

What would be the appropriate number of vnodes (num_tokens) to use?

2017-10-09 Thread Li, Guangxing
Hi, the documentation says that '...The recommended initial value for num_tokens is 256...' and this is what we did with our cluster which is running Cassandra Community 2.0.9, has 3 physical nodes with replication factor 3 for all keyspaces, each with 256 vnodes, each physical node has about 96 G

Re: What would be the appropriate number of vnodes (num_tokens) to use?

2017-10-09 Thread Jeff Jirsa
256 was chosen because the original vnode allocation algorithm was random and fewer than 256 could lead to unbalanced nodes In 3.0 there’s a less naive algorithm to ensure more balanced distribution, and there 16 or 32 is probably preferable -- Jeff Jirsa > On Oct 9, 2017, at 7:38 AM, Li,

Re: What would be the appropriate number of vnodes (num_tokens) to use?

2017-10-09 Thread Li, Guangxing
Jeff, so the key really is to keep nodes load balanced, and as long as that such balance is achieved, using a smaller amount of vnodes does not have other negative impact? Thanks. George On Mon, Oct 9, 2017 at 8:46 AM, Jeff Jirsa wrote: > 256 was chosen because the original vnode allocation a

Re: [VOTE PASSED] Release Apache Cassandra 3.0.15

2017-10-09 Thread Michael Shuler
With 8 binding +1, 1 non-binding +1, and no other votes, the 3.0.15 vote has passed. I'll get the artifacts published soon. -- Kind regards, Michael On 10/02/2017 12:18 PM, Michael Shuler wrote: > I propose the following artifacts for release as 3.0.15. > > sha1: b32a9e6452c78e6ad08e371314bf1ab

Re: [VOTE] Release Apache Cassandra 3.11.1

2017-10-09 Thread Michael Shuler
I count 7 binding +1 votes and no other votes for the 3.11.1 release. Thanks for all the feedback. I will publish the release artifacts shortly. -- Kind regards, Michael On 10/02/2017 12:58 PM, Michael Shuler wrote: > I propose the following artifacts for release as 3.11.1. > > sha1: 983c72a84a

Re: [VOTE PASSED] Release Apache Cassandra 3.11.1

2017-10-09 Thread Michael Shuler
On 10/09/2017 10:15 AM, Michael Shuler wrote: > I count 7 binding +1 votes and no other votes for the 3.11.1 release. > Thanks for all the feedback. I will publish the release artifacts shortly. > Resend with subject updated to [VOTE PASSED] :) -- Michael --

Re: What would be the appropriate number of vnodes (num_tokens) to use?

2017-10-09 Thread Jeff Jirsa
As long as balanced is achieved, fewer vnodes the better -- Jeff Jirsa > On Oct 9, 2017, at 7:53 AM, Li, Guangxing wrote: > > Jeff, > > so the key really is to keep nodes load balanced, and as long as that such > balance is achieved, using a smaller amount of vnodes does not have other > ne

Re: What would be the appropriate number of vnodes (num_tokens) to use?

2017-10-09 Thread Jeff Jirsa
One of my very smart coworkers who rarely posts to the list pointed out privately that I've oversimplified this, and there are other advantages to having more vnodes SOMETIMES. In particular: most of our longest streaming operations (bootstrap/decommission/removenode) are cpu bound on the stream r

Re: What would be the appropriate number of vnodes (num_tokens) to use?

2017-10-09 Thread Li, Guangxing
That is good info. Thanks. George On Mon, Oct 9, 2017 at 10:23 AM, Jeff Jirsa wrote: > One of my very smart coworkers who rarely posts to the list pointed out > privately that I've oversimplified this, and there are other advantages to > having more vnodes SOMETIMES. > > In particular: most of o

RE: CREATE INDEX without IF NOT EXISTS when snapshoting

2017-10-09 Thread ganesh.gadde
Hi, Is there a way to estimate the size of table and index ? I know we can estimate the size once table and index are already created using nodetool cfstats, but I want to know before loading data into table. Could you please help if there is any such formula to find out. Thanks and Regards Gan

Re: What would be the appropriate number of vnodes (num_tokens) to use?

2017-10-09 Thread kurt greaves
> > If you had more vnodes per > machine, you could stream more ranges in parallel, taking advantage of more > cores, streaming significantly faster. This is a very real gain if you are > regularly adding or removing a FEW nodes. In our experience 16 vnodes for streaming is much like 256. You tend

Stream is failing while removing the node

2017-10-09 Thread Varun Barala
Hi developers, Recently, I was removing one node from the cluster without downtime. Cluster size :: 3 node [test cluster with nodeA, nodeB, nodeC] *Procedure:-*1 Change RF to 1 2 Check all the nodes are up 3 Run repair on all the nodes 4 Run decommission on node nodeC 5 After decommission 6 Che

Re: Stream is failing while removing the node

2017-10-09 Thread Jason Brown
Varun, Please open a JIRA ticket with all the details of what you are seeing. Thanks, -Jason On Mon, Oct 9, 2017 at 7:54 PM, Varun Barala wrote: > Hi developers, > > Recently, I was removing one node from the cluster without downtime. > > Cluster size :: 3 node [test cluster with nodeA, nodeB