Re: Restricting data access at column and/or row level

2023-10-04 Thread Nitan Kainth
/dynamic_data_masking.htmlI am not sure about specific rows. To my knowledge I do not think that is possible.From: Nitan Kainth Sent: Tuesday, October 3, 2023 23:31To: cassandraSubject: Restricting data access  at column and/or row levelYou don't often get email from nitankai

Restricting data access at column and/or row level

2023-10-03 Thread Nitan Kainth
Hi Team, I have a requirement to grant select privileges on a table to some user restricting few columns and few rows. Something like this: c1 | c2 | c3 | c4 +++ 5 | 1 | 5 | 1 10 | 1 | 1 | 1 1 | 1 | 1 | 1 8 | 1 | 1 | 1 2 | 1 | 1 | 1 4 | 1 | 1 | 1 7

Re: Export as csv

2022-07-21 Thread Nitan Kainth
Use copy command or dsbulk Regards, Nitan K. 510-449-9629 From: Arvinder Dhillon Date: Thursday, July 21, 2022 at 12:52 PM To: user@cassandra.apache.org Subject: Export as csv What tool do I use to dump a columns of a table having 40K partitions into a csv file? I tried caqsh with CAPTURE,

Re: Corrupt SSTable

2020-08-13 Thread Nitan Kainth
If you are not deleting or updating data then it should be safe to use 2nd approach. Regards, Nitan Cell: 510 449 9629 > On Aug 13, 2020, at 11:48 AM, Pushpendra Rajpoot > wrote: > >  > Hi, > > I have a cluster of 2 DC, each DC has 5 nodes in production. This cluster is > based on

Re: Is deleting live sstable safe in this scenario?

2020-05-27 Thread Nitan Kainth
are in >> sync (via merkle trees, etc), but ignore the third. >> >> >> >>> On Wed, May 27, 2020 at 10:45 AM Nitan Kainth wrote: >>> Jeff, >>> >>> If Cassandra is down how will it generate merkle tree to compare? >>> >>>

Re: Is deleting live sstable safe in this scenario?

2020-05-27 Thread Nitan Kainth
Jeff, If Cassandra is down how will it generate merkle tree to compare? Regards, Nitan Cell: 510 449 9629 > On May 27, 2020, at 11:15 AM, Jeff Jirsa wrote: > >  > You definitely can repair with a node down by passing `-hosts specific_hosts` > >> On Wed, May 27, 2020 at

Re: Is deleting live sstable safe in this scenario?

2020-05-27 Thread Nitan Kainth
I didn't get you Leon, But, the simple thing is just to follow the steps and you will be fine. You can't run the repair if the node is down. On Wed, May 27, 2020 at 10:34 AM Leon Zaruvinsky wrote: > Hey Jeff/Nitan, > > 1) this concern should not be a problem if the repair happens before the >

Re: Is deleting live sstable safe in this scenario?

2020-05-26 Thread Nitan Kainth
Stop the node Delete as per option 2 Run repair Regards, Nitan Cell: 510 449 9629 > On May 26, 2020, at 6:46 PM, Leon Zaruvinsky wrote: > >  > Hi all, > > I'm looking to understand Cassandra's behavior in an sstable corruption > scenario, and what the minimum amount of work is that needs

Re: Nodetool clearsnapshot does not delete snapshot for dropped column_family

2020-04-30 Thread Nitan Kainth
I don't think it works like that. clearsnapshot --all would remove all snapshots. Here is an example: $ ls -l /ss/xx/cassandra/data/ww/a-5bf825428b3811eabe0c6b7631a60bb0/snapshots/ total 8 drwxr-xr-x 2 cassandra cassandra 4096 Apr 30 23:17 dropped-1588288650821-a drwxr-xr-x 2 cassandra

Re: Disabling Swap for Cassandra

2020-04-16 Thread Nitan Kainth
Swap is controlled by OS and will use it when running short of memory. I don’t think you can disable at Cassandra level Regards, Nitan Cell: 510 449 9629 > On Apr 16, 2020, at 5:50 PM, Kunal wrote: > >  > Hello, > > I need some suggestion from you all. I am new to Cassandra and was

Re: Memory usage more than heap memory

2020-04-11 Thread Nitan Kainth
You can look at top command. There is column of memory Regards, Nitan Cell: 510 449 9629 > On Apr 11, 2020, at 11:10 AM, HImanshu Sharma > wrote: > >  > Hi > > But I see memory not decreasing even if there is no traffic on cluster. How > can I find actual memory usage by Cassandra

Re: Query data through python using IN clause

2020-04-02 Thread Nitan Kainth
rt dateutil.parser > > ck1 = dateutil.parser.parse('2020-01-01T00:00:00Z') > ck2 = dateutil.parser.parse('2021-01-01T00:00:00Z') > > rows = session.execute(query, (temp, ck1, ck2)) > for row in rows: > print row > > > > > Nitan Kainth at "Wed, 1 Apr 2020 18:21:54 -0

Re: sstableloader & num_tokens change

2020-01-24 Thread Nitan Kainth
ort migration cluster to cluster without CSV or JSON export? > > Thanks and Regards > >> On Fri, Jan 24, 2020, 8:34 AM Nitan Kainth wrote: >> Instead of sstableloader consider dsbulk by datastax. >> >>> On Fri, Jan 24, 2020 at 10:20 AM Reid Pinchback

Re: sstableloader & num_tokens change

2020-01-24 Thread Nitan Kainth
Instead of sstableloader consider dsbulk by datastax. On Fri, Jan 24, 2020 at 10:20 AM Reid Pinchback wrote: > Jon Haddad has previously made the case for num_tokens=4. His Accelerate > 2019 talk is available at: > > > > https://www.youtube.com/watch?v=swL7bCnolkU > > > > You might want to

Re: Cassandra2.0.14 : Obsolete files not being deleted after compaction

2020-01-21 Thread Nitan Kainth
If you are certain that you don’t need data, your plan is good. Make sure to delete all the files for any given sequence number ie data, index, toc etc Regards, Nitan Cell: 510 449 9629 > On Jan 21, 2020, at 5:36 AM, manish khandelwal > wrote: > >  > Hi Team > > I am observing some

Re: *URGENT* Migration across different Cassandra cluster few having same keyspace/table names

2020-01-16 Thread Nitan Kainth
If the keyspace already exist, use copy command or sstableloader to merge data. If data volume it too big, consider spark or a custom java program Regards, Nitan Cell: 510 449 9629 > On Jan 16, 2020, at 10:26 PM, Ankit Gadhiya wrote: > >  > Any leads on this ? > > — Ankit > >> On Thu,

Re: re-add column with same UDT fail

2019-11-21 Thread Nitan Kainth
I have seen this situation causing corruption due to different structure but same name column in old and new sstables. Regards, Nitan Cell: 510 449 9629 > On Nov 21, 2019, at 7:59 AM, Tommy Stendahl > wrote: > >  > Hi, > > I run in to problem with 3.11.5, I think its related to "* Toughen

Re: Multiple C* instances on same machine

2019-09-20 Thread Nitan Kainth
ces on one node can lead to consistency >> problems when a hosted node goes down for some reason with having RACK’s >> defined. So, this is very important to choose when going with this kind of >> setup. >> >> Hope this helps! >> >> Thanks, >> Sandee

Re: Multiple C* instances on same machine

2019-09-20 Thread Nitan Kainth
lict in some way. Might be > better for balancing resources between them as well, though using cgroups > directly can also accomplish that. > > On Fri, Sep 20, 2019, 8:27 AM Nitan Kainth wrote: >> Hi There, >> >> Any feedback pros/cons for having multiple insta

Multiple C* instances on same machine

2019-09-20 Thread Nitan Kainth
Hi There, Any feedback pros/cons for having multiple instances of C* on the same machine without Docker/container solution? The plan is to change the ports and run multiple C* processes, so we can isolate two applications as two different clusters.

Re: How can I add blank values instead of null values in cassandra ?

2019-09-09 Thread Nitan Kainth
You can set default values in driver but that also little code change Regards, Nitan Cell: 510 449 9629 > On Sep 9, 2019, at 8:15 PM, buchi adddagada wrote: > > We are using DSE 5.1.0 & Spring boot Java. > > While we are trying to insert data into cassandra , java by default inserts > null

Re: Datafile Corruption

2019-08-07 Thread Nitan Kainth
Repair during upgrade have caused corruption too. Also, dropping and adding columns with same name but different type Regards, Nitan Cell: 510 449 9629 > On Aug 7, 2019, at 2:42 PM, Jeff Jirsa wrote: > > Is compression enabled? > > If not, bit flips on disk can corrupt data files and reads

Re: Rebooting one Cassandra node caused all the application nodes go down

2019-07-19 Thread Nitan Kainth
You no corruption error or you see corruption error? Regards, Nitan Cell: 510 449 9629 > On Jul 19, 2019, at 1:52 PM, Rahul Reddy wrote: > > Schema matches and corruption errors in system.log > >> On Fri, Jul 19, 2019, 1:33 PM Nitan Kainth wrote: >> Do you see s

Re: Rebooting one Cassandra node caused all the application nodes go down

2019-07-19 Thread Nitan Kainth
Do you see schemat in sync? Nodetool describecluster. Check system log for any corruption. Regards, Nitan Cell: 510 449 9629 > On Jul 19, 2019, at 12:32 PM, ZAIDI, ASAD A wrote: > > “aws asked to set nvme_timeout to higher number in etc/grub.conf.” > > Did you ask AWS if setting higher

Re: commit_log way bigger than allowed

2019-06-25 Thread Nitan Kainth
You can delete commitlogs and start the node. But run repair on that node to sync any data mismatch. Regards, Nitan Cell: 510 449 9629 > On Jun 25, 2019, at 4:37 AM, pwozniak wrote: > > Hi, > > I have cluster of three Cassandra (v.2.1) machines. On one of the machines > files with commit

Re: Upgrade sstables vs major compaction

2019-06-24 Thread Nitan Kainth
i, Jun 21, 2019 at 7:02 PM Nitan Kainth > wrote: > >> >> we upgraded binaries from 3.0 to 4.0. >> > > Where did you get the binaries for 4.0? It is not released officially > yet, so I guess you were using SVN trunk? Or was there a pre-release? > > we run majo

Upgrade sstables vs major compaction

2019-06-21 Thread Nitan Kainth
Hi, we upgraded binaries from 3.0 to 4.0. we run major compaction periodically for some valid reasons. Now, we are considering running major compaction instead of upgradesstables. Repair is disabled, cluster have normal reads/writes (few hundered/second). Plan is to run major compaction to

Re: Compaction resume after node restart and upgrade

2019-06-17 Thread Nitan Kainth
6:02 PM, Nitan Kainth wrote: > > The interim/temp sstable will delete by itself? > > > Regards, > > Nitan > > Cell: 510 449 9629 > > On Jun 17, 2019, at 7:15 PM, Jeff Jirsa wrote: > > > > On Jun 17, 2019, at 4:22 PM, Nitan Kainth wrote: > > Hi

Re: Compaction resume after node restart and upgrade

2019-06-17 Thread Nitan Kainth
The interim/temp sstable will delete by itself? Regards, Nitan Cell: 510 449 9629 > On Jun 17, 2019, at 7:15 PM, Jeff Jirsa wrote: > > > >> On Jun 17, 2019, at 4:22 PM, Nitan Kainth wrote: >> >> Hi, >> >> C* version 3.0.16. >> Two que

Re: Compaction resume after node restart and upgrade

2019-06-17 Thread Nitan Kainth
Thanks Jeff! Regards, Nitan Cell: 510 449 9629 > On Jun 17, 2019, at 7:15 PM, Jeff Jirsa wrote: > > > >> On Jun 17, 2019, at 4:22 PM, Nitan Kainth wrote: >> >> Hi, >> >> C* version 3.0.16. >> Two questions: >> 1. If m

Compaction resume after node restart and upgrade

2019-06-17 Thread Nitan Kainth
Hi, C* version 3.0.16. Two questions: 1. If major compaction is in progress and we restart the node, will compaction start from beginning or will it resume from where the node was shut down? 2. If we upgrade binaries to C* 4.0 while compaction is running, will it resume the compaction or start

Re: Sstableloader

2019-05-29 Thread Nitan Kainth
If cassandra version is same, it should work Regards, Nitan Cell: 510 449 9629 > On May 28, 2019, at 4:21 PM, Rahul Reddy wrote: > > Hello, > > Does sstableloader works between datastax and Apache cassandra. I'm trying to > migrate dse 5.0.7 to Apache 3.11.1 ?

Re: Can sstable corruption cause schema mismatch?

2019-05-29 Thread Nitan Kainth
> Alain Rodriguez - al...@thelastpickle.com > France / Spain > > The Last Pickle - Apache Cassandra Consulting > http://www.thelastpickle.com > >> Le mar. 28 mai 2019 à 18:28, Nitan Kainth a écrit : >> Thank you Alain. >> >> Nodetool describecluster

Re: Can sstable corruption cause schema mismatch?

2019-05-28 Thread Nitan Kainth
Consulting > http://www.thelastpickle.com > > > >> Le mar. 28 mai 2019 à 17:13, Nitan Kainth a écrit : >> Hi, >> >> Two questions: >> 1. Can sstable corruption in application tables cause schema mismatch? >> 2. Do we need to disable repair while adding storage while Cassandra is down? >> >> >> Regards, >> Nitan >> Cell: 510 449 9629

Can sstable corruption cause schema mismatch?

2019-05-28 Thread Nitan Kainth
Hi, Two questions: 1. Can sstable corruption in application tables cause schema mismatch? 2. Do we need to disable repair while adding storage while Cassandra is down? Regards, Nitan Cell: 510 449 9629

Re: Corrupted sstables

2019-05-06 Thread Nitan Kainth
d) . I did not check it after cleanup > . > > On Mon, May 6, 2019, 23:43 Nitan Kainth wrote: > >> This is strange, never saw this. does it happen to same column family? >> >> Does it happen after cleanup? >> >> On Mon, May 6, 2019 at 3:41 PM Roy Burstein &

Re: Corrupted sstables

2019-05-06 Thread Nitan Kainth
This is strange, never saw this. does it happen to same column family? Does it happen after cleanup? On Mon, May 6, 2019 at 3:41 PM Roy Burstein wrote: > Yes. > > On Mon, May 6, 2019, 23:23 Nitan Kainth wrote: > >> Roy, >> >> You mean all nodes show corruption

Re: Corrupted sstables

2019-05-06 Thread Nitan Kainth
Roy, You mean all nodes show corruption when you add a node to cluster?? Regards, Nitan Cell: 510 449 9629 > On May 6, 2019, at 2:48 PM, Roy Burstein wrote: > > It happened on all the servers in the cluster every time I have added node > . > This is new cluster nothing was upgraded here ,

Re: Corrupted sstables

2019-05-06 Thread Nitan Kainth
Did you try sstablescrub? If that doesn't work, you can delete all files of this sstable id and then run repair -pr on this node. On Mon, May 6, 2019 at 9:20 AM Roy Burstein wrote: > Hi , > We are having issues with Cassandra 3.11.4 , after adding node to the > cluster we get many corrupted

Re: Accidentaly removed SSTables of unneeded data

2019-05-02 Thread Nitan Kainth
You can run nodetool refresh and then sstablescrub to see if there is any corruption. On Thu, May 2, 2019 at 9:53 AM Simon ELBAZ wrote: > Hi, > > I am running Cassandra v2.1 on a 3 node cluster. > > *# yum list installed | grep cassa* > *cassandra21.noarch2.1.12-1 > @datastax

Re: Increasing the size limits implications

2019-04-29 Thread Nitan Kainth
Increasing batch size could potentially lead to longer GC pauses. Try to break you batch size. 300kb is a decent limit for most use cases. Regards, Nitan Cell: 510 449 9629 > On Apr 29, 2019, at 12:17 PM, Bobbie Haynes wrote: > > Hi, > I'm inserting into cassandra in batches(With each

Re: time tracking for down node for nodetool repair

2019-04-08 Thread Nitan Kainth
Valid suggestion. Stick to the plan, avoid downtime of a node more than hinted handoff window. OR increase window to a larger value, if you know it is going to take longer than current setting Regards, Nitan Cell: 510 449 9629 > On Apr 8, 2019, at 8:43 PM, Soumya Jena wrote: > > Cassandra

Re: Audit in C*

2019-03-14 Thread Nitan Kainth
erring to? >> >>> On Wed, Mar 13, 2019 at 10:28 AM Nitan Kainth wrote: >>> Hi, >>> >>> Anybody have used auditing to find out failed login attempts, or >>> unauthorized access tries. >>> >>> I found ecAudit by Ericsson, is it free to use? Has anybody tried it? >>> >>> Ref: https://github.com/Ericsson/ecaudit

Re: Audit in C*

2019-03-14 Thread Nitan Kainth
: user@cassandra.apache.org > Subject: Re: Audit in C* > > Yes.we are using it and it is very helpful to u so far...! > > On Wed, Mar 13, 2019 at 11:38 AM Rahul Singh > wrote: > Which version are you referring to? > > On Wed, Mar 13, 2019 at 10:28 AM Nitan Kai

Re: Audit in C*

2019-03-14 Thread Nitan Kainth
:21 > To: user@cassandra.apache.org > Subject: Re: Audit in C* > > Yes.we are using it and it is very helpful to u so far...! > > On Wed, Mar 13, 2019 at 11:38 AM Rahul Singh > wrote: > Which version are you referring to? > > On Wed, Mar 13, 2019 at 10:28 AM Nit

Audit in C*

2019-03-13 Thread Nitan Kainth
Hi, Anybody have used auditing to find out failed login attempts, or unauthorized access tries. I found ecAudit by Ericsson, is it free to use? Has anybody tried it? Ref: https://github.com/Ericsson/ecaudit

Re: AxonOps - Cassandra operational management tool

2019-02-14 Thread Nitan Kainth
This is really cool! will it be open source or licensed in near future? On Thu, Feb 14, 2019 at 12:15 PM AxonOps wrote: > Hi folks, > > We are excited to announce AxonOps, an operational management tool for > Apache Cassandra, is now ready for Beta testing. > > We'd be interested to hear you

Re: Max number of windows when using TWCS

2019-02-11 Thread Nitan Kainth
ou have an ETL process that moves your raw Cassandra >>> data into S3 as parquet files, and you want to be sure that process is >>> completed before you delete the data. You could also start out without >>> setting a TTL and later realize you need one. This is

Re: Max number of windows when using TWCS

2019-02-11 Thread Nitan Kainth
n very high-write, high-disk-space use cases. > > > >> On Mon, Feb 11, 2019 at 12:34 PM Nitan Kainth wrote: >> Hi, >> In regards to comment “Purging data is also straightforward, just dropping >> SSTables (by a script) where create date is older than a threshold

Re: Max number of windows when using TWCS

2019-02-11 Thread Nitan Kainth
Hi, In regards to comment “Purging data is also straightforward, just dropping SSTables (by a script) where create date is older than a threshold, we don't even need to rely on TTL” Doesn’t the old sstables drop by itself? One ttl and gc grace seconds past whole sstable will have only

Re: datamodelling

2019-02-05 Thread Nitan Kainth
You could consider a sudo column like agent_type and make it a compound partition key. It will limit break your partition into smaller ones but you will have to query with agent_id and agent_type in that case. On Tue, Feb 5, 2019 at 12:59 PM Bobbie Haynes wrote: > Hi Everyone, >

Re: Quick question about compaction progress

2019-01-23 Thread Nitan Kainth
Thank you Jeff Regards, Nitan Cell: 510 449 9629 > On Jan 23, 2019, at 10:13 AM, Jeff Jirsa wrote: > > > >> On Jan 23, 2019, at 8:00 AM, Nitan Kainth wrote: >> >> Hi, >> >> Why does nodetool compactionstats not show time remaining when >>

Quick question about compaction progress

2019-01-23 Thread Nitan Kainth
Hi, Why does nodetool compactionstats not show time remaining when compactionthroughput is set to 0? If the node is restarted during compaction, does it continue from where it is left or does it start over? If it starts over, what happens to the new sstable that was being used for compaction?

Re: Compact storage removal effect

2019-01-22 Thread Nitan Kainth
> > Chris > > On Jan 22, 2019, at 10:21 AM, Nitan Kainth wrote: > > hey Chris, > > We upgraded form 3.0.4 to 3.11. yes, I did run upgradesstables -a to > migrate sstables. > Here is the table structure: > > CREATE TABLE ks.cf1 ( key text, column1 timestamp, value blob

Re: Compact storage removal effect

2019-01-22 Thread Nitan Kainth
les -a or > something to rebuild without the compact storage in your migration? > > After 3.0 the new format can be more or less the same size as the 2.x > compact storage tables depending on schema (which can impact things a lot). > > Chris > > > On Jan 22, 2019, at 9:58 AM, N

Compact storage removal effect

2019-01-22 Thread Nitan Kainth
Hi, We are testing to migrate off from compact storage. After removing compact storage, we were hoping to see an increase in disk usage but nothing changed. any feedback, why didn't we see an increase in storage?

Re: Partition key with 300K rows can it be queried and distributed using Spark

2019-01-17 Thread Nitan Kainth
Not sure about spark data distribution but yeah spark can be used to retrieve such data from Cassandra. Regards, Nitan Cell: 510 449 9629 > On Jan 17, 2019, at 2:15 PM, Goutham reddy wrote: > > Hi, > As each partition key can hold up to 2 Billion rows, even then it is an > anti-pattern to

Re: is there an upper limit of the size tier of stcs?

2019-01-14 Thread Nitan Kainth
too large to > compact (e.g. no spare disk room to merge two huge sstables). > Not to mention that huge file is likely to bring troubles for some > file systems, and it's hard to backup them. > > Nitan Kainth 于2019年1月14日周一 上午1:53写道: > > > > No, sstables keep compacting

Re: is there an upper limit of the size tier of stcs?

2019-01-13 Thread Nitan Kainth
No, sstables keep compacting when they meet criteria. Look for compaction sub properties Regards, Nitan Cell: 510 449 9629 > On Jan 13, 2019, at 8:18 AM, Jinhua Luo wrote: > > is there a largest tier where the sstables stop merging anymore? if so, then > does it mean some tombstones at

Re: Does long latency affect Cassandra's performance

2018-12-15 Thread Nitan Kainth
e not local quorum. > does the long latency will block coordinate and affect the performance? > > dayu > > > dayu > 邮箱:sdycre...@163.com > Signature is customized by Netease Mail Master > > On 12/16/2018 02:00, Nitan Kainth wrote: > Dayu, > > If you

Re: Does long latency affect Cassandra's performance

2018-12-15 Thread Nitan Kainth
Dayu, If you use local quorum it won't impact read and write latencies but there will be delay in across DC replication; which may cause some application issues if it is active active. But 2ms is probably negligible to see any effect. On Sat, Dec 15, 2018 at 11:57 AM dayu wrote: > Hi all, >

Re: Unexplainable spikes of requests latency

2018-12-13 Thread Nitan Kainth
count of DigestMismatchExceptions and > latency spikes (see attached graphs for example). > One important point I didn't mention in the original mail is that all > requests (both reads and writes) have CL=LOCAL_QUORUM. > > ср, 12 дек. 2018 г. в 19:49, Nitan Kainth : > >> DigestMismatc

Re: Unexplainable spikes of requests latency

2018-12-12 Thread Nitan Kainth
DigestMismatchExceptions --> could be due to data out of sync.Are you running repairs? On Wed, Dec 12, 2018 at 11:39 AM Виталий Савкин wrote: > Hi everyone! > > Few times a day I see spikes of requests latencies on my cassandra > clients. Usually 99thPercentile is below 100ms but that times

Re: Tracing in cassandra

2018-10-13 Thread Nitan Kainth
Using partition key is best way to query Sent from my iPhone > On Oct 12, 2018, at 6:49 PM, Abdul Patel wrote: > > Yes with range queries its timing out, one question was the where condition > is primary key rather than clustering key. > >> On Friday, October 12, 2018

Re: Tracing in cassandra

2018-10-12 Thread Nitan Kainth
dul Patel wrote: >> Let me try with limit 11 ..we have 18 node cluster ..no nodes down.. >> >>> On Friday, October 12, 2018, Nitan Kainth wrote: >>> Try query with partition key selection in where clause. But time for limit >>> 11 shouldn’t fail. Are all nod

Re: [EXTERNAL] Re: Tracing in cassandra

2018-10-12 Thread Nitan Kainth
Try query with partition key selection in where clause. But time for limit 11 shouldn’t fail. Are all nodes up? Do you see any corruption in ay sstable? Sent from my iPhone > On Oct 12, 2018, at 11:40 AM, Abdul Patel wrote: > > Sean, > > here it is : > CREATE TABLE Keyspave.tblname ( >

Re: Compaction Strategy

2018-09-19 Thread Nitan Kainth
It’s not recommended to disable compaction, you will end up with hundreds to thousands of sstables and increased read latency. If your data is immitable, means no update/deletes it will have least impact. Decreasing compaction throughput will release resources for application but don’t

Storage overhead for a row

2018-09-14 Thread Nitan Kainth
Hi, We are trying to get to exact size of a row in table. All the data is standard sized. As per dev team, partition size should be 10832 bytes. But as per tablehistograms partition size is 17084 As per

Re: default_time_to_live vs TTL on insert statement

2018-07-12 Thread Nitan Kainth
row, use UPDATE > instead: > > UPDATE USING TTL xxx SET = WHERE partition=yyy > >> On Thu, Jul 12, 2018 at 2:42 PM, Nitan Kainth wrote: >> >> Kurt, >> >> It is same menti

Re: default_time_to_live vs TTL on insert statement

2018-07-12 Thread Nitan Kainth
to fix that documentation I suggest contacting Datastax. > > On 11 July 2018 at 19:56, Nitan Kainth wrote: > >> Hi DuyHai, >> >> Could you please explain in what case C* will error based on documented >> statement: >> >> You can set a def

Re: default_time_to_live vs TTL on insert statement

2018-07-11 Thread Nitan Kainth
property by specifying a custom value for each CQL statement > > The behavior is correct, nothing wrong here > > On Wed, Jul 11, 2018 at 7:31 PM, Nitan Kainth > wrote: > >> Hi, >> >> As per document: https://docs.datastax.com/en/cql/3.3/cql/cql_ >

default_time_to_live vs TTL on insert statement

2018-07-11 Thread Nitan Kainth
Hi, As per document: https://docs.datastax.com/en/cql/3.3/cql/cql_using/useExpireExample.html - You can set a default TTL for an entire table by setting the table's default_time_to_live

Re: Problem to activate mode DEBUG to see the slow queries

2018-06-28 Thread Nitan Kainth
You can also enable traceprobability: /opt/cassandra/bin/nodetool settraceprobability 1 It will populate system_traces keyspace where you can see details on queries On Thu, Jun 28, 2018 at 5:32 AM, Jean Carlo wrote: > Thank you ahmed! > > > Saludos > > Jean Carlo > > "The best way to predict

Re: copy sstables while cassandra is running

2018-06-24 Thread Nitan Kainth
Yeah you are right Pradeep. I overlooked the point there. Sent from my iPhone > On Jun 24, 2018, at 1:10 PM, Pradeep Chhetri wrote: > > I doubt mv will run instantly because copy is across two different filesystems > >> On Sun, 24 Jun 2018 at 9:26 PM, Nitan Kainth wrote:

Re: copy sstables while cassandra is running

2018-06-24 Thread Nitan Kainth
To be safe you could follow below prices on each node one at a time: Stop Cassandra Move sstable— mv will do it instantly Start Cassandra If you do it online and a read trust comes for sane data that is being moved will fail. > On Jun 23, 2018, at 11:23 PM, onmstester onmstester > wrote: > >

Re: Timestamp on hints file and system.hints table data

2018-06-14 Thread Nitan Kainth
e cleaned up. > > On 14 June 2018 at 01:54, Nitan Kainth wrote: > >> Kurt, >> >> No node is down for months. And yes, I am surprised to look at Unix >> timestamp on files. >> >> >> >> On Jun 13, 2018, at 6:41 PM, kurt greaves wrote: >>

Re: Options to replace hardware of the cluster

2018-06-14 Thread Nitan Kainth
Both are good options, a new data center in same cluster will work faster as you can stream multiple nodes. Or you can add 8 nodes to existing data center and then decommission one node at a time but this is lengthy process including cleanup after decommission. One node at a time is equally

Re: Timestamp on hints file and system.hints table data

2018-06-13 Thread Nitan Kainth
ix timestamp in the file name? > Is there a node that's been down for several months? > >> On Wed., 13 Jun. 2018, 23:41 Nitan Kainth, wrote: >> Hi, >> >> I observed a strange behavior about stored hints. >> >> Time stamp of hints file shows several months o

Timestamp on hints file and system.hints table data

2018-06-13 Thread Nitan Kainth
Hi, I observed a strange behavior about stored hints. Time stamp of hints file shows several months old. I deleted them and saw new hints files created with same old date. Why is that? Also, I see hints files on disk but if I query system.hints table, it shows 0 rows. Why system.hints is not

Re: Restoring snapshot

2018-06-13 Thread Nitan Kainth
ica could be found” but the question is, why is it giving > the name of keyspace K2 when I was restoring only K1(It should have given > warning for K1). > > From: Nitan Kainth [mailto:nitankai...@gmail.com] > Sent: Wednesday, June 13, 2018 4:31 PM > To: user@cassandra.apache.o

Re: Restoring snapshot

2018-06-13 Thread Nitan Kainth
Verify dc name and replication factor in create keyspace command in new cluster. Sent from my iPhone > On Jun 13, 2018, at 2:40 AM, > wrote: > > Dear Community, > > I took a snapshot from a node which was part of a 2 node cluster. There were > 2 keyspaces in that cluster K1 and K2. I took

Re: Read Latency Doubles After Shrinking Cluster and Never Recovers

2018-06-11 Thread Nitan Kainth
d it have impacted read latency the > fact that some nodes still have sstables that they no longer need? > > Thanks > > ---- > Thank you > > From: Nitan Kainth > Sent: Monday, June 11, 2018 10:18 AM > To: user@cassandra.apache.org > Subject: Re: Rea

Re: Read Latency Doubles After Shrinking Cluster and Never Recovers

2018-06-11 Thread Nitan Kainth
Did you run cleanup too? On Mon, Jun 11, 2018 at 10:16 AM, Fred Habash wrote: > I have hit dead-ends every where I turned on this issue. > > We had a 15-node cluster that was doing 35 ms all along for years. At > some point, we made a decision to shrink it to 13. Read latency rose to > near 70

Re: How to identify which table causing Maximum Memory usage limit

2018-06-11 Thread Nitan Kainth
Sorry, I didn't mean to high jack the thread. But I have seen similar issues and ignore it always because it wasn't really causing any issues. But I am really curious on how to find these. On Mon, Jun 11, 2018 at 9:45 AM, Nitan Kainth wrote: > thanks Martin. > > 99 percentile of a

Re: How to identify which table causing Maximum Memory usage limit

2018-06-11 Thread Nitan Kainth
thanks Martin. 99 percentile of all tables are even size. Max is always higher in all tables. The question is, How do I identify, which table is throwing this "Maximum memory usage reached (512.000MiB)" usage message? On Mon, Jun 11, 2018 at 5:59 AM, Martin Mačura wrote: > Hi, > we've had

Re: Cassandra 3.0.X migarte to VPC

2018-06-07 Thread Nitan Kainth
discovered. > > If there were other snitches involved (especially SimpleSnitch), things get > much more complicated. > > > > >> On Thu, Jun 7, 2018 at 9:18 AM, Nitan Kainth wrote: >> Jeff, >> >> In this case, if Riccardo is adding new DC, then he ca

Re: Cassandra 3.0.X migarte to VPC

2018-06-07 Thread Nitan Kainth
Jeff, In this case, if Riccardo is adding new DC, then he can pickup new snitch protocol right? On Thu, Jun 7, 2018 at 12:15 PM, Jeff Jirsa wrote: > > > > On Thu, Jun 7, 2018 at 9:12 AM, Nitan Kainth > wrote: > >> Riccardo, >> >> Simplest method c

Re: Caused by: java.lang.RuntimeException: org.apache.cassandra.exceptions.ReadTimeoutException: Operation timed out - received only 0 responses.

2018-06-07 Thread Nitan Kainth
Check logs in your nodes, there could be GC or other issues causing timeouts. This can happen for various reasons, network blips, node down, node over loaded etc. On Thu, Jun 7, 2018 at 6:16 AM, Saurav Suman wrote: > Hi Team, > > > I am getting below error in all the nodes of cassandra . Can

Re: Cassandra 3.0.X migarte to VPC

2018-06-07 Thread Nitan Kainth
Riccardo, Simplest method can be is to add VPC as an additional datacenter to existing cluster; once New DC has synced up all data, just switch over your application. Only caveat is that there should be enough network bandwidth between EC2 and VPC. Horizontal scaling will help to some extent.

Re: how to immediately delete tombstones

2018-06-02 Thread Nitan Kainth
You can compact selective sstables using jmx Call. Sent from my iPhone > On Jun 2, 2018, at 12:04 AM, onmstester onmstester > wrote: > > Thanks for your replies > But my current situation is that i do not have enough free disk for my > biggest sstable, so i could not run major compaction or

Re: Log application Queries

2018-05-25 Thread Nitan Kainth
assandra 4.0 > > > > On Fri, May 25, 2018 at 8:24 AM, Nitan Kainth <nitankai...@gmail.com> > wrote: > >> Hi, >> >> I would like to log all C* queries hitting cluster. Could someone please >> tell me how can I do it at cluster level? >> Will nodetool setl

Re: Log application Queries

2018-05-25 Thread Nitan Kainth
t; Oracle 10g Certified >> >> On Fri, May 25, 2018 at 12:15 PM, Surbhi Gupta <surbhi.gupt...@gmail.com> >> wrote: >> >>> nodeool setlogginglevel is only valid for below : >>> >>> >>>- org.apache.cassandra >>>- org.

Re: Log application Queries

2018-05-25 Thread Nitan Kainth
nly valid for below : > > >- org.apache.cassandra >- org.apache.cassandra.db >- org.apache.cassandra.service.StorageProxy > > > On 25 May 2018 at 09:01, Nitan Kainth <nitankai...@gmail.com> wrote: > >> Thanks Surbhi. I found another way. I used nod

Re: Log application Queries

2018-05-25 Thread Nitan Kainth
s used for changing the > logging level as below but not for slow query . > >- ALL >- TRACE >- DEBUG >- INFO >- WARN >- ERROR >- OFF > > > > On 25 May 2018 at 08:24, Nitan Kainth <nitankai...@gmail.com> wrote: > >> Hi,

Log application Queries

2018-05-25 Thread Nitan Kainth
Hi, I would like to log all C* queries hitting cluster. Could someone please tell me how can I do it at cluster level? Will nodetool setlogginglevel work? If so, please share example with library name. C* version 3.11

Re: Snapshot SSTable modified??

2018-05-24 Thread Nitan Kainth
Jeff, Shouldn't Snapshot get consistent state of sstables? -tmp file shouldn't impact backup operation right? Regards, Nitan K. Cassandra and Oracle Architect/SME Datastax Certified Cassandra expert Oracle 10g Certified On Wed, May 23, 2018 at 6:26 PM, Jeff Jirsa wrote: >

Re: repair in C* 3.11.2 and anticompactions

2018-05-24 Thread Nitan Kainth
Jean, Have you considered nodetool repair -pr (primary range) OR reaper? With Reaper you can throttle repair load on system. These two uses ranges anyway, so you may not run into anti-compaction. Regards, Nitan K. Cassandra and Oracle Architect/SME Datastax Certified Cassandra expert Oracle 10g

Re: Academic paper about Cassandra database compaction

2018-05-14 Thread Nitan Kainth
Hi Lucas, I am not able to download. can you share as attachment in email? Regards, Nitan K. Cassandra and Oracle Architect/SME Datastax Certified Cassandra expert Oracle 10g Certified On Mon, May 14, 2018 at 9:12 AM, Lucas Benevides < lu...@maurobenevides.com.br> wrote: > Dear community, >

Re: Insert-only application repair

2018-05-12 Thread Nitan Kainth
If you have RF>CL then Repair needs to be run to make sure data is in sync. Sent from my iPhone > On May 12, 2018, at 3:54 AM, onmstester onmstester > wrote: > > > In an insert-only use case with TTL (6 months), should i run this command, > every 5-7 days on all the

Re: what happens for concurrent node add/removal?

2018-04-28 Thread Nitan Kainth
Seed node takes care of token re-assignment. But why do you even wanna do that? Add the node first and then remove. Sent from my iPhone > On Apr 28, 2018, at 5:10 AM, Jinhua Luo wrote: > > HI All, > > For example, if at the same time, two nodes joining and there nodes

  1   2   >