Re: cqlinputformat and retired cqlpagingingputformat creates lots of connections to query the server

2015-01-28 Thread Huiliang Zhang
If you are using replication factor 1 and 3 cassandra nodes, 256 virtual nodes should be evenly distributed on 3 nodes. So there are totally 256 virtual nodes. But in your experiment, you saw 3*257 mapper. Is that because of the setting cassandra.input.split.size=3? It is nothing with node

Re: cqlinputformat and retired cqlpagingingputformat creates lots of connections to query the server

2015-01-27 Thread Huiliang Zhang
=1, and using default number of tokens. You will have 3*256 mappers... In that case, you will be soon out of mappers or reach the limit. On Tue, Jan 27, 2015 at 10:59 PM, Huiliang Zhang zhl...@gmail.com wrote: Hi Shenghua, as I understand, each range is assigned to a mapper. Mapper

Re: EC2 cassandra cluster node address problem

2014-06-25 Thread Huiliang Zhang
. On Tue, Jun 24, 2014 at 10:01 PM, Huiliang Zhang zhl...@gmail.com wrote: Thanks. Is there a way to configure Cassandra to use elastic ip instead of private ip? On Tue, Jun 24, 2014 at 9:29 PM, Andrey Ilinykh ailin...@gmail.com wrote: Cassandra knows nothing about elastic ip. You have to use

Re: EC2 cassandra cluster node address problem

2014-06-25 Thread Huiliang Zhang
firewall. It is similar to your web router. You can forward your external port to local one, but application running on your local node doesn't know anything about it. On Wed, Jun 25, 2014 at 1:25 PM, Huiliang Zhang zhl...@gmail.com wrote: Thanks. In fact, it is Cassandra that returns private ip

Re: EC2 cassandra cluster node address problem

2014-06-25 Thread Huiliang Zhang
. On Wed, Jun 25, 2014 at 6:49 PM, Michael Shuler mich...@pbandjelly.org wrote: On 06/25/2014 08:31 PM, Huiliang Zhang wrote: Thanks, get it. It is working after I translate the private ip to elastic ip. This sounds like a nice way to work around a known networking limitation when using

Re: EC2 cassandra cluster node address problem

2014-06-25 Thread Huiliang Zhang
It should be good to use broadcast_address for my purpose. The only problem is coming from opscenter now because it cannot recognize the datacenter from the ip range. On Wed, Jun 25, 2014 at 7:13 PM, Michael Shuler mich...@pbandjelly.org wrote: On 06/25/2014 09:05 PM, Huiliang Zhang wrote

EC2 cassandra cluster node address problem

2014-06-24 Thread Huiliang Zhang
Hi, I am using Cassandra on EC2 instances. My cassandra always returns private ips of the instances to the thrift program. Then the program cannot connect to the private ips. I already changed the rpc_address: elastic ip rpc_address: elastic ip Then I restarted the cassandra cluster. But the

Re: EC2 cassandra cluster node address problem

2014-06-24 Thread Huiliang Zhang
On Tue, Jun 24, 2014 at 8:55 PM, Huiliang Zhang zhl...@gmail.com wrote: Hi, I am using Cassandra on EC2 instances. My cassandra always returns private ips of the instances to the thrift program. Then the program cannot connect to the private ips. I already changed the rpc_address: elastic ip

Re: Use Cassnadra thrift API with collection type

2014-06-24 Thread Huiliang Zhang
-- *From:* Huiliang Zhang zhl...@gmail.com *Sent:* Friday, June 20, 2014 10:10 PM *To:* user@cassandra.apache.org *Subject:* Use Cassnadra thrift API with collection type Hi, I have a problem when insert data of the map type into a cassandra table. I tried all kinds

Use Cassnadra thrift API with collection type

2014-06-20 Thread Huiliang Zhang
Hi, I have a problem when insert data of the map type into a cassandra table. I tried all kinds of MapSerializer to serialize the Map data and did not succeed. My code is like this: Column column = new Column(); column.name=columnSerializer.toByteBuffer(colname); // the

A problem with truncate and bulk loader

2014-06-13 Thread Huiliang Zhang
Hi, I have a very strange problem with Cassandra bulk loader. Appreciated for explanations. I am using a local cassandra server 2.0.5 with default setting. 1. I created a table A and load 108 rows into it by using a hadoop program with org.apache.cassandra.hadoop.BulkOutputFormat. 2. I run

Re: Can Cassandra client programs use hostnames instead of IPs?

2014-05-16 Thread Huiliang Zhang
, Huiliang Zhang zhl...@gmail.com wrote: Hi, Cassandra returns ips of the nodes in the cassandra cluster for further communication between hadoop program and the casandra cluster. Is there a way to configure the cassandra cluster to return hostnames instead of ips? My cassandra cluster is on AWS