Re: cross DC data sync starts without rebuilding nodes on new DC

2016-04-05 Thread Vijay Patil
ywhere). I will proceed with rebuilding nodes on new DC. Thanks, Vijay On 5 April 2016 at 18:56, Alain RODRIGUEZ <arodr...@gmail.com> wrote: > Hi Vijay. > > After completing step 7.a (which is altering keyspace with desired >> replication factor for new DC) data automatically sta

cross DC data sync starts without rebuilding nodes on new DC

2016-04-05 Thread Vijay Patil
DC's and I am using GossipingPropertyFileSnitch. Regards, Vijay

Bulk Load Hadoop to Cassandra

2014-11-05 Thread Vijay Kadel
: Found interface org.apache.hadoop.mapreduce.TaskAttemptContext, but class was expected Thanks, Vijay

Re: Cassandra Consistency problem with NTP

2013-01-27 Thread Vijay
Just FYI, For one of the projects, i got around the NTP Drift problem by always reading more than i need, For example i want to read all the messages before x seconds then i would query cassandra for (x seconds + 500ms) then filter the duplicates in the client. Yes it does more network and yes

Re: Flume-cassandra

2013-01-27 Thread Vijay
FYI, Not sure about this particular problem, https://github.com/Vijay2win/flume-cassandra-sink supports latest flume version, if you want to try it out. Regards, /VJ On Sun, Jan 27, 2013 at 8:05 PM, Sri Ramya ramya.1...@gmail.com wrote: hi, I am storing flume events in to cassandra by

Re:

2012-09-24 Thread Vijay
Hi Manu, Glad that you have the issue resolved. If i understand the issue correctly Your cassandra installation had RandomParitioner but the bulk loader configuration (cassandra.yaml) had Murmur3Partitioner? By fixing the cassandra.yaml for the bulk loader the issue got resolved? If not

Re: Question on Read Repair

2012-09-18 Thread Vijay
Yes, If you are using 1.1 take a look at: dclocal_read_repair_chance and read_repair_chance CF settings. Regards, /VJ On Sun, Sep 16, 2012 at 5:03 PM, Raj N raj.cassan...@gmail.com wrote: Hi, I have a 2 DC setup(DC1:3, DC2:3). All reads and writes are at LOCAL_QUORUM. The question is

Re: key_cache_size_in_mb

2012-06-29 Thread Vijay
You might want to show us the GC log's... if there are promotion failures, count on the objects which you can get by inspecting the heapdumps etc, I am kind of assuming stuff :) Regards, /VJ On Thu, Jun 28, 2012 at 11:01 PM, Gurpreet Singh gurpreet.si...@gmail.comwrote: Vijay, Thanks

Re: key_cache_size_in_mb

2012-06-28 Thread Vijay
in 1.1 we dont calculate the Key size accurately, hence we have the fix in https://issues.apache.org/jira/browse/CASSANDRA-4315 Regards, /VJ On Thu, Jun 28, 2012 at 11:25 AM, Gurpreet Singh gurpreet.si...@gmail.comwrote: anyone have an explanation for this? This kinda screws up memory

Re: key_cache_size_in_mb

2012-06-28 Thread Vijay
the Heap to hold all the objects. (If you are using the visualVM try to see the object counts). Regards, /VJ On Thu, Jun 28, 2012 at 3:40 PM, Gurpreet Singh gurpreet.si...@gmail.comwrote: Vijay, I am running into an issue right now, not sure if its related to this one. My cassandra 1.1

Re: inconsistent snapshots

2012-05-24 Thread Vijay
Can you attach the cassandra logs? How was it restored? Priam chunks and compresses before uploading it to S3 and when you restore you have to go thought Priam to restore... Regards, /VJ On Thu, May 24, 2012 at 3:58 AM, Jose Flexa jose.fl...@gmail.com wrote: Hi all, Having issues with

Re: Safely Disabling Compaction

2012-05-17 Thread Vijay
I would rather set the Keyspace setting min_compaction_threshold and max_compaction_threshold to be a higher number and once i am ready i will put the value back... This way i dont need to restart. Having said that why not set the compaction throughput to 1 (low enough to not have contention) and

Re: Cassandra backup question regarding commitlogs

2012-05-11 Thread Vijay
The incremental backups are generated when the flush is complete (Only during the flush), If the node crash before the flush completes then the commit logs in the local node's backup for the data in memory. It wouldn't help to copy the Commit log across because they are not immutable (They are

Re: getting status of long running repair

2012-05-09 Thread Vijay
. No dropped Mutations/Messages. I do see HintedHandoff messages. Bill On Tue, May 8, 2012 at 11:15 PM, Vijay vijay2...@gmail.com wrote: What is the version you are using? is it Multi DC setup? Are you seeing a lot of dropped Mutations/Messages? Are the nodes going up and down all the time

Re: Cassandra - crash with “free() invalid pointer”

2012-04-02 Thread Vijay
Can you send us the stack trace which you can find in the hs_err_pid*.log? is the system memory all used up (free)? any errors in the logs just before the crash? Regards, /VJ On Mon, Mar 26, 2012 at 12:35 AM, Maciej Miklas mac.mik...@googlemail.comwrote: I have row cache - it's about 20GB

Re: Multic DC on EC2 with no VPC

2012-03-09 Thread Vijay
Can you check if the ports are open and you are able to communicate? UNKNOWN-DC is printed when it is not gossiping with the other node. I would check the security group settings and verify if the telnet to the targe port is working as expected. Regards, /VJ On Thu, Mar 8, 2012 at 11:41 AM,

Astyanax: A New Cassandra Client.

2012-01-31 Thread Vijay
http://techblog.netflix.com/2012/01/announcing-astyanax.html * * *What is Astyanax?* Astyanax is a Java Cassandra client. It borrows many concepts from Hector but diverges in the connection pool implementation as well as the client API. One of the main design considerations was to provide a clean

Re: Astyanax: A New Cassandra Client.

2012-01-31 Thread Vijay
Fixing the CC list Regards, /VJ On Tue, Jan 31, 2012 at 5:40 PM, Vijay vijay2...@gmail.com wrote: http://techblog.netflix.com/2012/01/announcing-astyanax.html * * *What is Astyanax?* Astyanax is a Java Cassandra client. It borrows many concepts from Hector but diverges in the connection

Re: MUTATION messages dropped

2012-01-25 Thread Vijay
+ I would also check the GC settings :) and full gc events in the logs. Regards, /VJ On Wed, Jan 25, 2012 at 9:52 AM, aaron morton aa...@thelastpickle.comwrote: Am I missing data here? Yes, but you can repair it with nodetool. Is this means that my cluster is too loaded?

Re: Encryption related question

2012-01-20 Thread Vijay
I had the following writeup when i did the KS and TS creation... Hope this helps *Step 1:* Download your Organisation Cert/Cert Chain/Generate one. *Step 2:* Login to any of one machine do the following to create p12 # openssl pkcs12 -export -in cassandra-app.cert -inkey cassandra-app.key

Re: Installing C* on EC2

2012-01-13 Thread Vijay
http://www.datastax.com/docs/0.8/install/install_ami Image is the best way to go find a public AMI for 1.0 Are there any known issues when running C* on EC2? - Not that i know of but we prefer Ephimeral drives rather than EBS when using local storage on EC2 since local storage is gone at that

Re: EC2 Maintenance Reboot

2011-12-08 Thread Vijay
In addition to the below i would also think of rebooting one at a time, just to be safe... folks in my corp are seeing the reboot fail because of EBS or S3 dependencies while booting the image. Regards, /VJ On Thu, Dec 8, 2011 at 3:04 AM, Peter Sanford psanf...@nearbuysystems.comwrote: Just

Re: Single node

2011-12-08 Thread Vijay
You can add a DNS entry with multiple IP's or something like a elastic ip which will keep switching between the active machines. or you can also write your custom seed provider class. Not sure if you will get a quorum when there dev's are on vacation :) Regards, /VJ On Thu, Dec 8, 2011 at

Re: Second Cassandra users survey

2011-11-09 Thread Vijay
My wish list: 1) Conditional updates: if a column has a value then put column in the column family atomically else fail. 2) getAndSet: on counters: a separate API 3) Revert the count when client disconnects or receives a exception (so they can safely retry). 4) Something like a freeze API for

Re: Client traffic encryption best practices....

2011-08-11 Thread Vijay
https://issues.apache.org/jira/browse/THRIFT-106 seems to be the right way to go but the cassandra server needs to support too which we might want to add Regards, /VJ On Thu, Aug 11, 2011 at 2:54 PM, Chris Marino ch...@vcider.com wrote: Hello, is there any consensus on how to secure

Re: Running across multiple EC2 regions...

2011-07-29 Thread Vijay
So, my question is: If we use the EC2 Snitch patch to set up across regions, will the instance's private IP/interface *ever* be used? Or will all traffic always go in and out of the public interface?? Using the public interface is slower and more expensive that the private interface. If you use

Re: Running across multiple EC2 regions...

2011-07-29 Thread Vijay
intend to make it complicated i thought the operations part is what you have to be worried about... (Change the Security group in both the regions to allow the Public IP's) Regards, /VJ On Fri, Jul 29, 2011 at 4:37 PM, Chris Marino ch...@vcider.com wrote: Thanks Vijay, that helps a lot

Re: Off-heap Cache

2011-07-14 Thread Vijay
Use describe keyspace and see the settings are right. Check the logs on all the servers, Make sure you dont see errors... Check JNA jar in all the servers. Regards, /VJ On Wed, Jul 13, 2011 at 1:29 PM, Raj N raj.cassan...@gmail.com wrote: How do I ensure it is indeed using the

Re: gossiper problem

2011-07-14 Thread Vijay
How about GC logs, what are your pause times? JVM settings might help If you are not sure how to enable GC logs check cassandra.yaml look for application pause times. it is highly recommended not to swap -- include JNA jar. Regards, /VJ On Thu, Jul 14, 2011 at 1:42 AM, Donna Li

Re: Compressing data types

2011-06-21 Thread Vijay
You might want to watch https://issues.apache.org/jira/browse/CASSANDRA-47 Regards, /VJ On Tue, Jun 21, 2011 at 5:14 AM, Timo Nentwig timo.nent...@toptarif.dewrote: Hi! Just wondering why this doesn't already exist: wouldn't it make sense to have decorating data types that compress

Re: Docs: Token Selection

2011-06-15 Thread Vijay
/2011 6:10 PM, Vijay wrote: Yes... Thats right... If you are trying to say the below... DC1 Node1 Owns 50% (Ranges 8..4 - 8..5 8..5 - 0) Node2 Owns 50% (Ranges 0 - 1 1 - 8..4) DC2 Node1 Owns 50% (Ranges 8..5 - 0 0 - 1) Node2 Owns 50% (Ranges 1 - 8..4 8..4 - 8..5

Re: Docs: Token Selection

2011-06-15 Thread Vijay
15, 2011 at 11:10 AM, Vijay vijay2...@gmail.com wrote: The problem in the above approach is you have 2 nodes between 12 to 4 in DC1 but from 4 to 12 you just have 1 (Which will cause uneven distribution of data the node) It is easier to think of the DCs as ring and split equally

Re: Docs: Token Selection

2011-06-15 Thread Vijay
8.. DC2 Node 1 : token 7.. Regards, /VJ On Wed, Jun 15, 2011 at 12:28 PM, AJ a...@dude.podzone.net wrote: On 6/15/2011 12:14 PM, Vijay wrote: Correction The problem in the above approach is you have 2 nodes between 12 to 4 in DC1 but from 4 to 12 you just have 1 should

Re: Docs: Token Selection

2011-06-15 Thread Vijay
No it wont it will assume you are doing the right thing... Regards, /VJ On Wed, Jun 15, 2011 at 2:34 PM, AJ a...@dude.podzone.net wrote: Vijay, thank you for your thoughtful reply. Will Cass complain if I don't setup my tokens like in the examples? On 6/15/2011 2:41 PM, Vijay wrote

Re: Docs: Token Selection

2011-06-15 Thread Vijay
of the first data center. On 6/15/2011 5:51 PM, Vijay wrote: No it wont it will assume you are doing the right thing... Regards, /VJ On Wed, Jun 15, 2011 at 2:34 PM, AJ a...@dude.podzone.net wrote: Vijay, thank you for your thoughtful reply. Will Cass complain if I don't setup my tokens

Re: Docs: Token Selection

2011-06-14 Thread Vijay
Yes... Thats right... If you are trying to say the below... DC1 Node1 Owns 50% (Ranges 8..4 - 8..5 8..5 - 0) Node2 Owns 50% (Ranges 0 - 1 1 - 8..4) DC2 Node1 Owns 50% (Ranges 8..5 - 0 0 - 1) Node2 Owns 50% (Ranges 1 - 8..4 8..4 - 8..5) Regards, /VJ On Tue, Jun 14, 2011 at 3:47

Re: EC2 Snitch

2011-05-11 Thread Vijay
We are using this patch in our multi-region testing... yes this approach is going to be integrated into https://issues.apache.org/jira/browse/CASSANDRA-2491 once it is committed (you might want to wait for that). Yes this fix the Amazon infrastructure problems and it will automatically detect the

Re: Does anybody have experience with running Cassandra in Amazon's Virtual Private Cloud (VPC)?

2011-05-08 Thread Vijay
We are planning to use EIP's + https://issues.apache.org/jira/browse/CASSANDRA-2452 for AWS multi region deployment. Regards, /VJ On Thu, May 5, 2011 at 5:01 PM, aaron morton aa...@thelastpickle.comwrote: There have been some recent discussions about different EC2 deployments, may be be

Re: Optimizing a few nodes to handle all client connections?

2011-03-18 Thread Vijay
Are you saying you dont like the idea of the co-ordinator node being in the same ring? if yes have you looked at the cassandra fat client in contrib? Regards, /VJ On Fri, Mar 18, 2011 at 6:55 PM, Jason Harvey alie...@gmail.com wrote: Hola everyone, I have been considering making a few

Re: Is SuperColumn necessary?

2010-05-06 Thread Vijay
I would rather be interested in Tree type structure where supercolumns have supercolumns in it. you dont need to compare all the columns to find a set of columns and will also reduce the bytes transfered for separator, at least string concatenation (Or something like that) for read and write

Re: SuperColumns

2010-04-15 Thread Vijay
Yes a super column can only have columns in it. Regards, /VJ On Wed, Apr 14, 2010 at 10:28 PM, Christian Torres chtor...@gmail.comwrote: I'm defining a ColumnFamily (Table) type Super, It's posible to have a SuperColumn inside another SuperColumn or SuperColumns can only have normal

Re: Bug in Cassandra that occurs when removing a supercolumn.

2010-04-03 Thread Vijay
What version do you use? i think that bug was fixed in .6 https://issues.apache.org/jira/browse/CASSANDRA-703 Regards, /VJ On Sat, Apr 3, 2010 at 5:27 AM, Arash Bazrafshan ara...@gmail.com wrote: ello. A bug occurs for me when working with Cassandra. With this e-mail I intend to

Re: renaming a SuperColumn

2010-03-18 Thread Vijay
+1 for renaming the S Column/Column as a atomic operation :) Regards, /VJ On Thu, Mar 18, 2010 at 9:50 AM, Jonathan Ellis jbel...@gmail.com wrote: -1 on adding a special case for this. 2010/3/18 Ted Zlatanov t...@lifelogs.com: I find it useful in one particular schema to have