Re: Batch : Isolation and Atomicity for same partition on multiple table

2017-12-14 Thread Jeff Jirsa
Again, a lot of potential problems can be solved with data modeling - in particular consider things like conditional batches where the condition is on a static cell/column and writes go to different CQL rows. -- Jeff Jirsa > On Dec 14, 2017, at 9:57 PM, Mickael Delanoë

Re: Batch : Isolation and Atomicity for same partition on multiple table

2017-12-14 Thread Mickael Delanoë
Thanks Jeff, I am a little disappointed when you said the guarantee are even weeker.But I will take a look on this and try to understand what is really done. Le 13 déc. 2017 18:18, "Jeff Jirsa" a écrit : Entry point is here: https://github.com/apache/cassandra/blob/trunk/

Re: DataStax Java driver QueryBuilder: CREATE table?

2017-12-14 Thread Andy Tolbert
Hi Oliver, SchemaBuilder enables building schema DDL statements like CREATE TABLE, KEYSPACE and so on. You can find some examples in the tests

DataStax Java driver QueryBuilder: CREATE table?

2017-12-14 Thread Oliver Ruebenacker
Hello, I'm using the DataStax Java Driver, which has a QueryBuilder class to construct CQL statements. I can see how to build SELECT, INSERT, TRUNCATE etc statements, but I can't find how to build a CREATE statement. Am I missing something? Thanks! Best, Oliver -- Oliver

Re: Tablesnap with custom endpoint?

2017-12-14 Thread Jon Haddad
Tablesnap uses boto, you may be able to override the S3 endpoint. This Stack Overflow answer suggests it’s possible, but you might have to modify the tablesnap script a little: https://stackoverflow.com/questions/32618216/overwrite-s3-endpoint-using-boto3-configuration-file

Re: Any Cassandra Backup and Restore tool like Cassandra Reaper?

2017-12-14 Thread Lerh Chuan Low
Tablesnap assumes S3, and tableslurp can set up the stage for restoring by downloading the relevant SSTables (but then it's up to the operator to complete the restore from there). Restoring (especially point-in-time restore) isn't easy to handle so there aren't a lot available out there. There's

Re: Tablesnap with custom endpoint?

2017-12-14 Thread Lerh Chuan Low
Out of the box it assumes AWS S3 and is tailored to that using boto, so I think you would have to checkout the repository and make changes to specify a different endpoint (and submit a PR back to it if you feel it's useful :) ) On 15 December 2017 at 08:03, Roger Brown

Tablesnap with custom endpoint?

2017-12-14 Thread Roger Brown
I wanted to use tablesnap for backups. Instead of s3.amazonaws.com, I wanted to use our own s3-compatible endpoint. I could never figure it out. Do you know how to override the S3 endpoint tablesnap uses? Roger

Re: Any Cassandra Backup and Restore tool like Cassandra Reaper?

2017-12-14 Thread Rutvij Bhatt
There is tablesnap/tablechop/tableslurp - https://github.com/JeremyGrosser/tablesnap. On Thu, Dec 14, 2017 at 3:49 PM Roger Brown < roger.br...@perfectsearchcorp.com> wrote: > I've found nothing affordable that works with vnodes. If you have money, > you could use DataStax OpsCenter or Datos.io

Re: Any Cassandra Backup and Restore tool like Cassandra Reaper?

2017-12-14 Thread Roger Brown
I've found nothing affordable that works with vnodes. If you have money, you could use DataStax OpsCenter or Datos.io Recoverx. I ended up creating a cron job to make snapshots along with incremental_backups: true in the cassandra.yaml. And I'm thinking of setting up a replication strategy so

Any Cassandra Backup and Restore tool like Cassandra Reaper?

2017-12-14 Thread Harika Vangapelli -T (hvangape - AKRAYA INC at Cisco)
Any Cassandra Backup and Restore tool like Cassandra Reaper for Repairs? [http://wwwin.cisco.com/c/dam/cec/organizations/gmcc/services-tools/signaturetool/images/logo/logo_gradient.png] Harika Vangapelli Engineer - IT hvang...@cisco.com Tel: Cisco Systems, Inc.

Re: Bring 2 nodes down

2017-12-14 Thread Jeff Jirsa
Options, in order of desirability: The "right" way to configure such a setup when creating the cluster would be to define each physical machine as a "rack", and then use the right replication/snitch configurations to give you rack awareness, so you wouldn't have 2 replicas on the same physical

Re: Lots of simultaneous connections?

2017-12-14 Thread Max Campos
Hi Kurt, thanks for your reply — really appreciate your (and everyone else’s!) continual assistance of people in the C* user community. All of these clients & servers are on the same (internal) network, so there is no firewall between the clients & servers. Our C* application is a QA test

Bring 2 nodes down

2017-12-14 Thread Alaa Zubaidi (PDF)
Hi, I have a cluster of 8 Nodes, 4 physical machines 2 VMs each physical machine. RF=3, and we have read/write with QUORUM consistency requirement. One of the machines needs to be down for an hour or two to fix local disk. What is the best way to do that with out losing data? Regards -- Alaa --

Re: TWCS on partitions spanning multiple time windows

2017-12-14 Thread Jeff Jirsa
Inline -- Jeff Jirsa > On Dec 14, 2017, at 8:37 AM, Hannu Kröger wrote: > > Hi, > > I have been reading a bit about TWCS to understand how it functions. > > Current assumption: TWCS uses same tombstone checks as any other compaction > strategy to make sure that it

What is the maximum size/number of lines of cassandra cqlsh_history and cli.history?

2017-12-14 Thread Laxmikant Upadhyay
I am using cassandra version 2.1.16. I have verified that the cli.history files contains max 501 lines. However I don't see there is a limit for cqlsh_history file. Any idea on that ? -- regards, Laxmikant Upadhyay

TWCS on partitions spanning multiple time windows

2017-12-14 Thread Hannu Kröger
Hi, I have been reading a bit about TWCS to understand how it functions. Current assumption: TWCS uses same tombstone checks as any other compaction strategy to make sure that it doesn’t remove tombstones unless it is safe to do so. Scenario 1: So let’s assume that I have a tables like this:

Re: Upgrade using rebuild

2017-12-14 Thread Jon Haddad
Heh, hit send accidentally. You generally can’t run rebuild to upgrade, because it’s a streaming operation. Streaming isn’t supported between versions, although on 3.x it might work. > On Dec 14, 2017, at 11:01 AM, Jon Haddad wrote: > > no > >> On Dec 14, 2017, at 10:59

Re: Upgrade using rebuild

2017-12-14 Thread Jon Haddad
no > On Dec 14, 2017, at 10:59 AM, Anshu Vajpayee wrote: > > Thanks! I am aware with these steps. > > I m just thinking , is it possible to do the upgrade using nodetool rebuild > like we rebuld new dc ? > > Has anyone tried - upgrade with nodetool rebuild ? > >

Re: Upgrade using rebuild

2017-12-14 Thread Anshu Vajpayee
Thanks! I am aware with these steps. I m just thinking , is it possible to do the upgrade using nodetool rebuild like we rebuld new dc ? Has anyone tried - upgrade with nodetool rebuild ? On Thu, 14 Dec 2017 at 7:08 PM, Hannu Kröger wrote: > If you want to do a version

RE: When Replacing a Node, How to Force a Consistent Bootstrap

2017-12-14 Thread Fd Habash
“ … but it's better to repair before and after if possible …” After, I simply run ‘nodetool repair –full’ on the replaced node. But before bootstrapping, if my cluster is distributed over 3 AZ’s, what do I repair? The entire other AZ’s? As one pointed out earlier, I can use ‘nodetool repair

Re: Lots of simultaneous connections?

2017-12-14 Thread kurt greaves
I see time outs and I immediately blame firewalls. Have you triple checked then? Is this only occurring to a subset of clients? Also, 3.0.6 is pretty dated and has many bugs, you should definitely upgrade to the latest 3.0 (don't forget to read news.txt) On 14 Dec. 2017 19:18, "Max Campos"

Re: Deleted data comes back on node decommission

2017-12-14 Thread kurt greaves
Are you positive your repairs are completing successfully? Can you send through an example of the data in the wrong order? What you're saying certainly shouldn't happen, but there's a lot of room for mistakes. On 14 Dec. 2017 20:13, "Python_Max" wrote: > Thank you for

Re: Upgrade using rebuild

2017-12-14 Thread Hannu Kröger
If you want to do a version upgrade, you need to basically do follow node by node: 0) stop repairs 1) make sure your sstables are at the latest version (nodetool upgradesstables can do it) 2) stop cassandra 3) update cassandra software and update cassandra.yaml and cassandra-env.sh files 4) start

Upgrade using rebuild

2017-12-14 Thread Anshu Vajpayee
Hi - Is it possible to upgrade a cluster ( DC wise) using nodetool rebuild ? -- *C*heers,* *Anshu V*

Re: nodetool rebuild data size

2017-12-14 Thread Anshu Vajpayee
You will require to rebuild each node with nodetool rebuild command. it would be 60TB. On Thu, Dec 14, 2017 at 11:35 AM, Peng Xiao <2535...@qq.com> wrote: > Hi there, > > if we have a Cassandra DC1 with data size 60T,RF=3,then we rebuild a new > DC2(RF=3),how much data will stream to DC2?20T

Re: Deleted data comes back on node decommission

2017-12-14 Thread Python_Max
Thank you for reply. No, I did not execute 'nodetool cleanup'. Documentation https://docs.datastax.com/en/cassandra/3.0/cassandra/operations/opsRemoveNode.html does not mention that cleanup is required. Do yo think that extra data which node is not responsible for can lead to zombie data?

Lots of simultaneous connections?

2017-12-14 Thread Max Campos
Hi - We’re finally putting our new application under load, and we’re starting to get this error message from the Python driver when under heavy load: ('Unable to connect to any servers', {‘x.y.z.205': OperationTimedOut('errors=None, last_host=None',), ‘x.y.z.204':