Re: reducing disk space consumption

2016-02-11 Thread Romain Hardouin
As Mohammed said "nodetool clearsnaphost" will do the trick. Cassandra takes a snapshot by default before keyspace/table dropping or truncation. You can disable this feature if it's a dev node (see auto_snapshot in cassandra.yaml) but if it's a production node is a good thing to keep auto

Re: Debugging write timeouts on Cassandra 2.2.5

2016-02-11 Thread Fabrice Facorat
Are your commitlog and data on the same disk ? If yes, you should put commitlogs on a separate disk which don't have a lot of IO. Others IO may have great impact impact on your commitlog writing and it may even block. An example of impact IO may have, even for Async writes:

Re: Keyspaces not found in cqlsh

2016-02-11 Thread Sebastian Estevez
If its a tarball then root should be fine but there were some files owned by the Cassandra user so you may want to chown those back to root. I haven't seen your exact issue before but you have two schema versions from your describe cluster so a rolling restart should help. all the best,

Re: Keyspaces not found in cqlsh

2016-02-11 Thread Ryan Svihla
Kedar, I recommend asking the user list user@cassandra.apache.org this list is for the development of cassandra and you're more likely to find someone on the user list who may have hit this issue. Curious issue though I haven't seen that myself. Regards, Ryan Svihla > On Feb 11, 2016, at

Re: stefania.alborghe...@datastax.com

2016-02-11 Thread Sebastian Estevez
The monitoring UI is called DataStax OpsCenter and it has its own install process. Check out our documentation on the subject: http://docs.datastax.com/en/opscenter/5.2/opsc/install/opscInstallOpsc_g.html all the best, Sebastián On Feb 9, 2016 8:01 PM, "Ted Yu" wrote: >

Re: Security labels

2016-02-11 Thread oleg yusim
Hi Dani, As promised, I sort of put all my questions under the "one roof". I would really appreciate you opinion on them. https://drive.google.com/open?id=0B2L9nW4Cyj41YWd1UkI4ZXVPYmM Thanks, Oleg On Fri, Jan 29, 2016 at 3:28 PM, Dani Traphagen wrote: > ​Hi

Re: Security labels

2016-02-11 Thread Dani Traphagen
Hi Oleg, I'm happy to take a look. Will update after review. Thanks, Dani On Thu, Feb 11, 2016 at 12:23 PM, oleg yusim wrote: > Hi Dani, > > As promised, I sort of put all my questions under the "one roof". I would > really appreciate you opinion on them. > >

Re: Session timeout

2016-02-11 Thread oleg yusim
Robert, Jack, Bryan, As you suggested, I put together document, titled Cassandra_Security_Topics_to_Discuss, put it on Google Drive and shared it with everybody on this list. The document contains list of questions I have on Cassandra, my take on it, and has a place for notes Community would like

Security assessment of Cassandra

2016-02-11 Thread oleg yusim
Greetings, Performing security assessment of Cassandra with the goal of generating STIG for Cassandra (iase.disa.mil/stigs/Pages/a-z.aspx) I ran across some questions regarding the way certain security features are implemented (or not) in Cassandra. I composed the list of questions on these

Re: Increase compaction performance

2016-02-11 Thread Michał Łowicki
On Thu, Feb 11, 2016 at 5:38 PM, Alain RODRIGUEZ wrote: > Also, are you using incremental repairs (not sure about the available > options in Spotify Reaper) what command did you run ? > > No. > 2016-02-11 17:33 GMT+01:00 Alain RODRIGUEZ : > >> CPU load

Re: Rows with same key

2016-02-11 Thread Kai Wang
Are you supplying timestamps from the client side? Are clocks in sync cross your nodes? On Thu, Feb 11, 2016 at 11:52 AM, Yulian Oifa wrote: > Hello to all > I have multiple rows with same id on one of cfs, one row is completely > empty ,another one has vaues. > Values

Keyspaces not found in cqlsh

2016-02-11 Thread kedar
I am using cqlsh 5.0.1 | Cassandra 2.1.2, recently we are unable to see / desc keyspaces and query tables through cqlsh on either of the two nodes cqlsh> desc keyspaces cqlsh> use user_index; cqlsh:user_index> desc table list_1_10; Keyspace 'user_index' not found. cqlsh:user_index> cqlsh>

Re: Keyspaces not found in cqlsh

2016-02-11 Thread kedar
Thanks for the reply. ls -l cassandra/data/* lists various *.db files This problem is on both nodes. Thanks, Kedar Parikh Ext : 2224 Dir : +91 22 61782224 Mob : +91 9819634734 Email : kedar.par...@netcore.co.in Web : www.netcore.co.in On Thursday 11 February 2016 03:57 PM, Romain Hardouin

Re: 3k sstables during a repair incremental !!

2016-02-11 Thread Jean Carlo
Hi ! @Paulo . Yes we are using vnodes, 256 per node and we have 6 nodes in the cluster. RF=3. The data is inserted using jmeter with consistency=LOCAL_ONE. Because this is a test, we generate our data and we insert them using jmeter. After the repair finished, all the nodes seems to be freezed,

Re: Keyspaces not found in cqlsh

2016-02-11 Thread Romain Hardouin
What is the output on both nodes of the following command? ls -l /var/lib/cassandra/data/system/* If one node seems odd you can try "nodetool resetlocalschema" but the other node must be in clean state. Best, Romain Le Jeudi 11 février 2016 11h10, kedar a écrit :

Re: reducing disk space consumption

2016-02-11 Thread Ted Yu
Thanks, Mohammed and Romain. On Thu, Feb 11, 2016 at 12:54 AM, Romain Hardouin wrote: > As Mohammed said "nodetool clearsnaphost" will do the trick. > Cassandra takes a snapshot by default before keyspace/table dropping or > truncation. > You can disable this feature if

Re: Keyspaces not found in cqlsh

2016-02-11 Thread Sebastian Estevez
Keep this on. The user list, it's not appropriate for the dev list. 1) I noticed that some of your files are owned by root and others by Cassandra. If this is a package install you should always start C* as a service and chown your files and directories so they are owned by the Cassandra user,

Re: Keyspaces not found in cqlsh

2016-02-11 Thread kedar
Thanks Sebastian, Cassandra installation in our case is simply an untar. Cassandra is started using supervisord and user as root, would you still recommend I try using Cassandra user. ./nodetool describecluster Cluster Information: Name: Test Cluster Snitch:

Re: Keyspaces not found in cqlsh

2016-02-11 Thread kedar
Thanks a ton Sebastian. On restart of one node 1 could see repeated errors like " Mutation of 22076203 bytes is too large for the maxiumum size of 16777216" So I increased commitlog_segment_size_in_mb from 32 to 64mb. Followed by a rolling restart again. And now there is a single version

Re: Cassandra Collections performance issue

2016-02-11 Thread Clint Martin
I have experienced excessive performance issues while using collections as well. Mostly my issue was due to the excessive number of cells per partition that having a modest map size requires. Since you are reading and writing the entire map, you can probably gain some performance the same way I

Increase compaction performance

2016-02-11 Thread Michał Łowicki
Hi, Using 2.1.12 across 3 DCs. Each DC has 8 nodes. Trying to run repair using Cassandra Reaper but nodes after couple of hours are full of pending compaction tasks (regular not the ones about validation) CPU load is fine, SSD disks below 30% utilization, no long GC pauses. How to speed up

Re: Cassandra Collections performance issue

2016-02-11 Thread Jack Krupansky
Just to help other users reading along here, what is your access pattern with maps? I mean, do you typically have a large or small number of keys set, are you typically mostly adding keys or deleting keys a lot, adding one at a time or adding and deleting a lot in a single request, or... what? And

Re: Guava version check in 3.0

2016-02-11 Thread Andrew Jorgensen
To answer my own question I was able to shade the dependencies in my jar which fixed the issue and allow the job to run on Hadoop org.apache.maven.plugins maven-shade-plugin

Re: Security labels

2016-02-11 Thread oleg yusim
Thanks Dani. Oleg On Thu, Feb 11, 2016 at 2:27 PM, Dani Traphagen wrote: > Hi Oleg, > > I'm happy to take a look. Will update after review. > > Thanks, > Dani > > On Thu, Feb 11, 2016 at 12:23 PM, oleg yusim wrote: > >> Hi Dani, >> >> As

Re: Security labels

2016-02-11 Thread Jack Krupansky
Thanks for putting the items together in a list. This allows people to see things with more context. Give people in the user community a little time to respond. A week, maybe. Hopefully some of the senior Cassandra committers will take a look as well. Will the final assessment become a public

Re: Session timeout

2016-02-11 Thread Jack Krupansky
Thanks! A useful contribution, no matter what the outcome. I trust your ability to read of the doc, so I don't expect a lot of change to the responses, but we'll see. At a minimum, it will probably be good to have doc to highlight areas where users will need to engage in explicit mitigation

Re: Rows with same key

2016-02-11 Thread Jack Krupansky
(Note to self... check docs to see if they give this troubleshooting tip. I didn't see it at first glance.) -- Jack Krupansky On Thu, Feb 11, 2016 at 2:45 PM, Kai Wang wrote: > Are you supplying timestamps from the client side? Are clocks in sync > cross your nodes? > > > On

Re: Session timeout

2016-02-11 Thread oleg yusim
Jack, This document doesn't cover all the areas where user will need to get engaged in explicit mitigation, it only covers those, I wasn't sure about. But - you are making a good point here. Let me update the document with the rest of the gaps, so community would have a complete list here.

Re: Security labels

2016-02-11 Thread oleg yusim
Jack, I asked my management, if I can share with community my assessment spreadsheet (whole thing, with gaps and desired configurations). Let's wait for their answer. I would definitely update the document I shared with the rest of gaps, so you, guys, would have it for sure. Now, in case if my

Guava version check in 3.0

2016-02-11 Thread Andrew Jorgensen
Hello, I am trying to get a cassandra v3.0 cluster up and running with the v3.0.0 of the datastax client. I am hitting a number of cases where I am running into the following exception: java.lang.IllegalStateException: Detected Guava issue #1635 which indicates that a version of Guava less than

Re: Increase compaction performance

2016-02-11 Thread Alain RODRIGUEZ
Also, are you using incremental repairs (not sure about the available options in Spotify Reaper) what command did you run ? 2016-02-11 17:33 GMT+01:00 Alain RODRIGUEZ : > CPU load is fine, SSD disks below 30% utilization, no long GC pauses > > > > What is your current

Re: Increase compaction performance

2016-02-11 Thread Alain RODRIGUEZ
> > CPU load is fine, SSD disks below 30% utilization, no long GC pauses What is your current compaction throughput ? The current value of 'concurrent_compactors' (cassandra.yaml or through JMX) ? nodetool getcompactionthroughput How to speed up compaction? Increased compaction throughput

Rows with same key

2016-02-11 Thread Yulian Oifa
Hello to all I have multiple rows with same id on one of cfs, one row is completely empty ,another one has vaues. Values are wrotten into new row , however they are retreived from old row... I guess one row is created due to removed values, and stucked somehow. I am trying to remove it with no

Re: Keyspaces not found in cqlsh

2016-02-11 Thread Sebastian Estevez
> > On restart of one node 1 could see repeated errors like " Mutation of > 22076203 bytes is too large for the maxiumum size of 16777216" Commitlog segment size is the right lever to get C* to accept larger writes but this is not a traditional use for cassandra. Cassandra is built to handle

Re: OpsCenter 5.2

2016-02-11 Thread Ted Yu
The installation partially failed. Please let me know how I can resume the installation or, the error below can be ignored. I verified on the Linux host that setuptools-0.6c11-py2.7.egg can be downloaded. Python 2.7.11 (default, Jan 5 2016, 11:21:51) -- python ez_setup.py Downloading

Re: Keyspaces not found in cqlsh

2016-02-11 Thread Romain Hardouin
Would you mind pasting the ouput for both nodes in gist/paste/whatever? https://gist.github.com http://paste.debian.net Le Jeudi 11 février 2016 11h57, kedar a écrit : Thanks for the reply. ls -l cassandra/data/* lists various *.db files This problem is on both

Re: Keyspaces not found in cqlsh

2016-02-11 Thread kedar
Thanks, kindly refer the following: https://gist.github.com/anonymous/3dddbe728a52c07d7c52 https://gist.github.com/anonymous/302ade0875dd6410087b Thanks, Kedar Parikh Ext : 2224 Dir : +91 22 61782224 Mob : +91 9819634734 Email : kedar.par...@netcore.co.in Web : www.netcore.co.in On Thursday

OpsCenter 5.2

2016-02-11 Thread Ted Yu
Thanks for the pointer. Just want to confirm that OpsCenter 5.2 is compatible with DSE 4.8.4 which I have deployed. Cheers On Thu, Feb 11, 2016 at 7:00 AM, Sebastian Estevez < sebastian.este...@datastax.com> wrote: > The monitoring UI is called DataStax OpsCenter and it has its own install >

Re: OpsCenter 5.2

2016-02-11 Thread Sebastian Estevez
Confirmed. all the best, Sebastián On Feb 11, 2016 12:44 PM, "Ted Yu" wrote: > Thanks for the pointer. > > Just want to confirm that OpsCenter 5.2 is compatible with DSE 4.8.4 which > I have deployed. > > Cheers > > On Thu, Feb 11, 2016 at 7:00 AM, Sebastian Estevez < >

ApacheCon NA 2016 - Important Dates!!!

2016-02-11 Thread Melissa Warnkin
Hello everyone! I hope this email finds you well.  I hope everyone is as excited about ApacheCon as I am! I'd like to remind you all of a couple of important dates, as well as ask for your assistance in spreading the word! Please use your social media platform(s) to get the word out! The more