Re: Can we change the number of vnodes on existing nodes?

2016-09-09 Thread Brandon Williams
I am curious exactly what gossip issues you are encountering. On Fri, Sep 9, 2016 at 7:45 PM, Dikang Gu wrote: > Hi, > > We have some big cluster (500+ nodes), they have 256 vnodes on physical > host, which is causing a lot of problems to us, especially make the gossip > to

Re: Support Multi-Tenant in Cassandra

2016-09-09 Thread J. D. Jordan
I think the resource constraining aspects are one of the most important things we are missing. Actually doing resource constraints in SEDA is hard. In TPC it should be easier, so we put off some discussions we were having about it until we have TPC in place such that tracking resource use of a

Re: Support Multi-Tenant in Cassandra

2016-09-09 Thread Jason Brown
Heh, nice find, Jeremy. Thanks for digging it up On Friday, September 9, 2016, Jeremy Hanna wrote: > For posterity, our wiki page from many moons ago was > https://wiki.apache.org/cassandra/MultiTenant cassandra/MultiTenant>. It was a

Re: Support Multi-Tenant in Cassandra

2016-09-09 Thread Jeremy Hanna
For posterity, our wiki page from many moons ago was https://wiki.apache.org/cassandra/MultiTenant . It was a different era of the project but there might be some useful bits in there for anyone interested in MT. > On Sep 9, 2016, at 9:28 PM,

Re: Support Multi-Tenant in Cassandra

2016-09-09 Thread Jason Brown
The current implementation will probably be yanked when thrift as a whole is removed for 4.0. And I'm ok with that. That being said, there has been an undercurrent of interest over time about multitenancy, and I'm willing to entertain a renewed discussion. It might be instructive to see if any

Re: Support Multi-Tenant in Cassandra

2016-09-09 Thread Jeremy Hanna
I agree that the request scheduler should probably be deprecated and removed unless someone wants to put in something that's usable from the non thrift request processor. We added it for prioritization and QoS but I don't know of anyone ever using it. Our project we thought of using it for got

Re: Support Multi-Tenant in Cassandra

2016-09-09 Thread Mick Semb Wever
On 15 July 2016 at 16:38, jason zhao yang wrote: > > May I ask is there any plan of extending functionalities related to > Multi-Tenant? I had needs for this in the past and my questioning always seemed to eventuate to answers along the lines of this should be

Re: Can we change the number of vnodes on existing nodes?

2016-09-09 Thread Nate McCall
The "easiest" (in quotes given the size of that cluster) approach is to add a new datacenter with shiny new nodes and configured for single token. Once the 'add' is complete, de-commission the old one. This approach of evacuating to a new DC is pretty safe. The only downside is the temporary 2x

Re: Can we change the number of vnodes on existing nodes?

2016-09-09 Thread Jeff Jirsa
On 9/9/16, 5:45 PM, "Dikang Gu" wrote: >Hi, > >We have some big cluster (500+ nodes), they have 256 vnodes on physical >host, which is causing a lot of problems to us, especially make the gossip >to be in-efficient. > >There seems no way to change the number of vnodes on

Can we change the number of vnodes on existing nodes?

2016-09-09 Thread Dikang Gu
Hi, We have some big cluster (500+ nodes), they have 256 vnodes on physical host, which is causing a lot of problems to us, especially make the gossip to be in-efficient. There seems no way to change the number of vnodes on existing nodes, is there any reason that we can not support it? It

Re: Cassandra ASF Jenkins Compute Resources

2016-09-09 Thread Michael Shuler
On 09/09/2016 02:31 PM, Jeff Jirsa wrote: > Can you describe the size and number of slaves we need to do things "right"? > > How many cores? How much ram? How many slaves? We currently run all unit test jobs on m3.xlarge instances, which seems to work fine. (Almost all the dtest jobs run OK on

Re: Cassandra ASF Jenkins Compute Resources

2016-09-09 Thread Dave Lester
Could you link to the INFRA ticket so folks could follow? Thanks, Dave > On Sep 9, 2016, at 12:27 PM, Michael Shuler wrote: > > I have an ongoing INFRA ticket with the testing issues we've seen when > utilizing the ASF's Jenkins infrastructure. Basically, the results

Cassandra ASF Jenkins Compute Resources

2016-09-09 Thread Michael Shuler
I have an ongoing INFRA ticket with the testing issues we've seen when utilizing the ASF's Jenkins infrastructure. Basically, the results are erratic, due to other project (and Cassandra) concurrent test runs. Our testing on CassCI is pretty stable, since we do not run any concurrent tests.

Re: Support Multi-Tenant in Cassandra

2016-09-09 Thread jason zhao yang
Hi Romain, Thanks for the reply. > request_scheduler it is a legacy feature which only works for thrift api.. It will be great to have some sort of scheduling per user/role, but scheduling on the request will only provide limit isolation..if JVM crashes due to one tenant's invalid request(eg.