Re: Cassandra counter column family performance
I get a lot of TExceptions What are the exceptions ? In general counters are slower than writes, but that does not lead them to fail like that. Check the logs for errors and/or messages from the GCInspector saying the garbage collection is going on. Cheers A - Aaron Morton New Zealand @aaronmorton Co-Founder Principal Consultant Apache Cassandra Consulting http://www.thelastpickle.com On 13/05/2014, at 9:51 pm, Batranut Bogdan batra...@yahoo.com wrote: Hello all, I have a counter CF defined as pk text PRIMARY KEY, a counter, b counter, c counter, d counter After inserting a few million keys... 55 mil, the performance goes down the drain, 2-3 nodes in the cluster are on medium load, and when inserting batches of same lengths writes take longer and longer until the whole cluster becomes loaded and I get a lot of TExceptions... and the cluster becomes unresponsive. Did anyone have the same problem? Feel free to comment and share experiences about counter CF performance.
Cassandra counter column family performance
Hello all, I have a counter CF defined as pk text PRIMARY KEY, a counter, b counter, c counter, d counter After inserting a few million keys... 55 mil, the performance goes down the drain, 2-3 nodes in the cluster are on medium load, and when inserting batches of same lengths writes take longer and longer until the whole cluster becomes loaded and I get a lot of TExceptions... and the cluster becomes unresponsive. Did anyone have the same problem? Feel free to comment and share experiences about counter CF performance.
Re: How to create counter column family via Pycassa?
What are the all possible values for cf_kwargs ??
SYSTEM_MANAGER.create_column_family('Narrative','Twitter_search_test',
comparator_type=UTF8Type, )
- Here I want to specify, Column data types and row key type. How can
I do that ?
On Thu, Aug 15, 2013 at 12:30 PM, Tyler Hobbs ty...@datastax.com wrote:
The column_validation_classes arg is just for defining individual column
types. Glad you got it figured out, though.
On Thu, Aug 15, 2013 at 11:23 AM, Pinak Pani
nishant.has.a.quest...@gmail.com wrote:
Thanks for quick reply. Apparantly, I was trying this to get working
cf_kwargs = {'default_validation_class':COUNTER_COLUMN_TYPE}
sys.create_column_family('my_ks', 'vote_count',
column_validation_classes=cf_kwargs) #1
But this works:
sys.create_column_family('my_ks', 'vote_count', **cf_kwargs) #2
I thought #1 should work.
On Thu, Aug 15, 2013 at 9:15 PM, Tyler Hobbs ty...@datastax.com wrote:
The only thing that makes a CF a counter CF is that the default
validation class is CounterColumnType, which you can set through
SystemManager.create_column_family().
On Thu, Aug 15, 2013 at 10:38 AM, Pinak Pani
nishant.has.a.quest...@gmail.com wrote:
I do not find a way to create a counter column family in Pycassa.
This[1] does not help.
Appreciate if someone can help me.
Thanks
1.
http://pycassa.github.io/pycassa/api/pycassa/system_manager.html#pycassa.system_manager.SystemManager.create_column_family
--
Tyler Hobbs
DataStax http://datastax.com/
--
Tyler Hobbs
DataStax http://datastax.com/
Re: How to create counter column family via Pycassa?
What options are available depends on what version of Cassandra you're
using.
You can specify the row key type with 'key_validation_class'.
For column types, use 'column_validation_classes', which is a dict mapping
column names to types. For example:
sys.create_column_family('mykeyspace', 'users',
column_validation_classes={'username': UTF8Type, 'age': IntegerType})
On Wed, Dec 11, 2013 at 10:32 AM, Kumar Ranjan winnerd...@gmail.com wrote:
What are the all possible values for cf_kwargs ??
SYSTEM_MANAGER.create_column_family('Narrative','Twitter_search_test',
comparator_type=UTF8Type, )
- Here I want to specify, Column data types and row key type. How can
I do that ?
On Thu, Aug 15, 2013 at 12:30 PM, Tyler Hobbs ty...@datastax.com wrote:
The column_validation_classes arg is just for defining individual column
types. Glad you got it figured out, though.
On Thu, Aug 15, 2013 at 11:23 AM, Pinak Pani
nishant.has.a.quest...@gmail.com wrote:
Thanks for quick reply. Apparantly, I was trying this to get working
cf_kwargs = {'default_validation_class':COUNTER_COLUMN_TYPE}
sys.create_column_family('my_ks', 'vote_count',
column_validation_classes=cf_kwargs) #1
But this works:
sys.create_column_family('my_ks', 'vote_count', **cf_kwargs) #2
I thought #1 should work.
On Thu, Aug 15, 2013 at 9:15 PM, Tyler Hobbs ty...@datastax.com wrote:
The only thing that makes a CF a counter CF is that the default
validation class is CounterColumnType, which you can set through
SystemManager.create_column_family().
On Thu, Aug 15, 2013 at 10:38 AM, Pinak Pani
nishant.has.a.quest...@gmail.com wrote:
I do not find a way to create a counter column family in Pycassa.
This[1] does not help.
Appreciate if someone can help me.
Thanks
1.
http://pycassa.github.io/pycassa/api/pycassa/system_manager.html#pycassa.system_manager.SystemManager.create_column_family
--
Tyler Hobbs
DataStax http://datastax.com/
--
Tyler Hobbs
DataStax http://datastax.com/
--
Tyler Hobbs
DataStax http://datastax.com/
Re: How to create counter column family via Pycassa?
validators = {
'approved': 'BooleanType',
'text': 'UTF8Type',
'favorite_count':'IntegerType',
'retweet_count': 'IntegerType',
'expanded_url': 'UTF8Type',
'tuid': 'LongType',
'screen_name': 'UTF8Type',
'profile_image': 'UTF8Type',
'embedly_data': 'CompositeType',
'created_at':'UTF8Type',
}
SYSTEM_MANAGER.create_column_family('Narrative','Twitter_search_test',
comparator_type='CompositeType', default_validation_class='UTF8Type',
key_validation_class='UTF8Type', column_validation_classes=validators)
throws:
*InvalidRequestException*: InvalidRequestException(why='Invalid definition
for comparator org.apache.cassandra.db.marshal.CompositeType.
Can you please explain why?
On Wed, Dec 11, 2013 at 12:08 PM, Tyler Hobbs ty...@datastax.com wrote:
What options are available depends on what version of Cassandra you're
using.
You can specify the row key type with 'key_validation_class'.
For column types, use 'column_validation_classes', which is a dict mapping
column names to types. For example:
sys.create_column_family('mykeyspace', 'users',
column_validation_classes={'username': UTF8Type, 'age': IntegerType})
On Wed, Dec 11, 2013 at 10:32 AM, Kumar Ranjan winnerd...@gmail.comwrote:
What are the all possible values for cf_kwargs ??
SYSTEM_MANAGER.create_column_family('Narrative','Twitter_search_test',
comparator_type=UTF8Type, )
- Here I want to specify, Column data types and row key type. How
can I do that ?
On Thu, Aug 15, 2013 at 12:30 PM, Tyler Hobbs ty...@datastax.com wrote:
The column_validation_classes arg is just for defining individual column
types. Glad you got it figured out, though.
On Thu, Aug 15, 2013 at 11:23 AM, Pinak Pani
nishant.has.a.quest...@gmail.com wrote:
Thanks for quick reply. Apparantly, I was trying this to get working
cf_kwargs = {'default_validation_class':COUNTER_COLUMN_TYPE}
sys.create_column_family('my_ks', 'vote_count',
column_validation_classes=cf_kwargs) #1
But this works:
sys.create_column_family('my_ks', 'vote_count', **cf_kwargs) #2
I thought #1 should work.
On Thu, Aug 15, 2013 at 9:15 PM, Tyler Hobbs ty...@datastax.comwrote:
The only thing that makes a CF a counter CF is that the default
validation class is CounterColumnType, which you can set through
SystemManager.create_column_family().
On Thu, Aug 15, 2013 at 10:38 AM, Pinak Pani
nishant.has.a.quest...@gmail.com wrote:
I do not find a way to create a counter column family in Pycassa.
This[1] does not help.
Appreciate if someone can help me.
Thanks
1.
http://pycassa.github.io/pycassa/api/pycassa/system_manager.html#pycassa.system_manager.SystemManager.create_column_family
--
Tyler Hobbs
DataStax http://datastax.com/
--
Tyler Hobbs
DataStax http://datastax.com/
--
Tyler Hobbs
DataStax http://datastax.com/
Re: How to create counter column family via Pycassa?
This works, When I remove the comparator_type
validators = {
'tid': 'IntegerType',
'approved': 'BooleanType',
'text': 'UTF8Type',
'favorite_count':'IntegerType',
'retweet_count': 'IntegerType',
'expanded_url': 'UTF8Type',
'tuid': 'LongType',
'screen_name': 'UTF8Type',
'profile_image': 'UTF8Type',
'embedly_data': 'BytesType',
'created_at':'UTF8Type',
}
SYSTEM_MANAGER.create_column_family('Narrative','Twitter_search',
default_validation_class='UTF8Type', key_validation_class='UTF8Type',
column_validation_classes=validators)
On Wed, Dec 11, 2013 at 12:23 PM, Kumar Ranjan winnerd...@gmail.com wrote:
I am using ccm cassandra version
*1.2.11*
On Wed, Dec 11, 2013 at 12:19 PM, Kumar Ranjan winnerd...@gmail.comwrote:
validators = {
'approved': 'BooleanType',
'text': 'UTF8Type',
'favorite_count':'IntegerType',
'retweet_count': 'IntegerType',
'expanded_url': 'UTF8Type',
'tuid': 'LongType',
'screen_name': 'UTF8Type',
'profile_image': 'UTF8Type',
'embedly_data': 'CompositeType',
'created_at':'UTF8Type',
}
SYSTEM_MANAGER.create_column_family('Narrative','Twitter_search_test',
comparator_type='CompositeType', default_validation_class='UTF8Type',
key_validation_class='UTF8Type', column_validation_classes=validators)
throws:
*InvalidRequestException*: InvalidRequestException(why='Invalid
definition for comparator org.apache.cassandra.db.marshal.CompositeType.
Can you please explain why?
On Wed, Dec 11, 2013 at 12:08 PM, Tyler Hobbs ty...@datastax.com wrote:
What options are available depends on what version of Cassandra you're
using.
You can specify the row key type with 'key_validation_class'.
For column types, use 'column_validation_classes', which is a dict
mapping column names to types. For example:
sys.create_column_family('mykeyspace', 'users',
column_validation_classes={'username': UTF8Type, 'age': IntegerType})
On Wed, Dec 11, 2013 at 10:32 AM, Kumar Ranjan winnerd...@gmail.comwrote:
What are the all possible values for cf_kwargs ??
SYSTEM_MANAGER.create_column_family('Narrative','Twitter_search_test',
comparator_type=UTF8Type, )
- Here I want to specify, Column data types and row key type. How
can I do that ?
On Thu, Aug 15, 2013 at 12:30 PM, Tyler Hobbs ty...@datastax.comwrote:
The column_validation_classes arg is just for defining individual
column types. Glad you got it figured out, though.
On Thu, Aug 15, 2013 at 11:23 AM, Pinak Pani
nishant.has.a.quest...@gmail.com wrote:
Thanks for quick reply. Apparantly, I was trying this to get working
cf_kwargs = {'default_validation_class':COUNTER_COLUMN_TYPE}
sys.create_column_family('my_ks', 'vote_count',
column_validation_classes=cf_kwargs) #1
But this works:
sys.create_column_family('my_ks', 'vote_count', **cf_kwargs) #2
I thought #1 should work.
On Thu, Aug 15, 2013 at 9:15 PM, Tyler Hobbs ty...@datastax.comwrote:
The only thing that makes a CF a counter CF is that the default
validation class is CounterColumnType, which you can set through
SystemManager.create_column_family().
On Thu, Aug 15, 2013 at 10:38 AM, Pinak Pani
nishant.has.a.quest...@gmail.com wrote:
I do not find a way to create a counter column family in Pycassa.
This[1] does not help.
Appreciate if someone can help me.
Thanks
1.
http://pycassa.github.io/pycassa/api/pycassa/system_manager.html#pycassa.system_manager.SystemManager.create_column_family
--
Tyler Hobbs
DataStax http://datastax.com/
--
Tyler Hobbs
DataStax http://datastax.com/
--
Tyler Hobbs
DataStax http://datastax.com/
How to create counter column family via Pycassa?
I do not find a way to create a counter column family in Pycassa. This[1] does not help. Appreciate if someone can help me. Thanks 1. http://pycassa.github.io/pycassa/api/pycassa/system_manager.html#pycassa.system_manager.SystemManager.create_column_family
Re: How to create counter column family via Pycassa?
The only thing that makes a CF a counter CF is that the default validation class is CounterColumnType, which you can set through SystemManager.create_column_family(). On Thu, Aug 15, 2013 at 10:38 AM, Pinak Pani nishant.has.a.quest...@gmail.com wrote: I do not find a way to create a counter column family in Pycassa. This[1] does not help. Appreciate if someone can help me. Thanks 1. http://pycassa.github.io/pycassa/api/pycassa/system_manager.html#pycassa.system_manager.SystemManager.create_column_family -- Tyler Hobbs DataStax http://datastax.com/
Re: How to create counter column family via Pycassa?
Thanks for quick reply. Apparantly, I was trying this to get working
cf_kwargs = {'default_validation_class':COUNTER_COLUMN_TYPE}
sys.create_column_family('my_ks', 'vote_count',
column_validation_classes=cf_kwargs) #1
But this works:
sys.create_column_family('my_ks', 'vote_count', **cf_kwargs) #2
I thought #1 should work.
On Thu, Aug 15, 2013 at 9:15 PM, Tyler Hobbs ty...@datastax.com wrote:
The only thing that makes a CF a counter CF is that the default validation
class is CounterColumnType, which you can set through
SystemManager.create_column_family().
On Thu, Aug 15, 2013 at 10:38 AM, Pinak Pani
nishant.has.a.quest...@gmail.com wrote:
I do not find a way to create a counter column family in Pycassa.
This[1] does not help.
Appreciate if someone can help me.
Thanks
1.
http://pycassa.github.io/pycassa/api/pycassa/system_manager.html#pycassa.system_manager.SystemManager.create_column_family
--
Tyler Hobbs
DataStax http://datastax.com/
Re: How to create counter column family via Pycassa?
The column_validation_classes arg is just for defining individual column
types. Glad you got it figured out, though.
On Thu, Aug 15, 2013 at 11:23 AM, Pinak Pani
nishant.has.a.quest...@gmail.com wrote:
Thanks for quick reply. Apparantly, I was trying this to get working
cf_kwargs = {'default_validation_class':COUNTER_COLUMN_TYPE}
sys.create_column_family('my_ks', 'vote_count',
column_validation_classes=cf_kwargs) #1
But this works:
sys.create_column_family('my_ks', 'vote_count', **cf_kwargs) #2
I thought #1 should work.
On Thu, Aug 15, 2013 at 9:15 PM, Tyler Hobbs ty...@datastax.com wrote:
The only thing that makes a CF a counter CF is that the default
validation class is CounterColumnType, which you can set through
SystemManager.create_column_family().
On Thu, Aug 15, 2013 at 10:38 AM, Pinak Pani
nishant.has.a.quest...@gmail.com wrote:
I do not find a way to create a counter column family in Pycassa.
This[1] does not help.
Appreciate if someone can help me.
Thanks
1.
http://pycassa.github.io/pycassa/api/pycassa/system_manager.html#pycassa.system_manager.SystemManager.create_column_family
--
Tyler Hobbs
DataStax http://datastax.com/
--
Tyler Hobbs
DataStax http://datastax.com/
Re: Added extra column as composite key while creation counter column family
On Tue, Apr 16, 2013 at 10:29 PM, Kuldeep Mishra kuld.cs.mis...@gmail.comwrote: cassandra 1.2.0 Is it a bug in 1.2.0 ? While I can't speak to this specific issue, 1.2.0 has meaningful known issues. I suggest upgrade to 1.2.3(/4) ASAP. =Rob
Re: Added extra column as composite key while creation counter column family
cassandra 1.2.0
Is it a bug in 1.2.0 ?
Thanks
KK
On Wed, Apr 17, 2013 at 2:56 AM, aaron morton aa...@thelastpickle.comwrote:
What version are you using ?
WIth 1.2.4 …
cqlsh:dev CREATE TABLE counters (
... key text,
... value counter,
... PRIMARY KEY (key)
... ) WITH COMPACT STORAGE;
cqlsh:dev describe table counters;
CREATE TABLE counters (
key text PRIMARY KEY,
value counter
) WITH COMPACT STORAGE AND
bloom_filter_fp_chance=0.01 AND
caching='KEYS_ONLY' AND
comment='' AND
dclocal_read_repair_chance=0.00 AND
gc_grace_seconds=864000 AND
read_repair_chance=0.10 AND
replicate_on_write='true' AND
populate_io_cache_on_flush='false' AND
compaction={'class': 'SizeTieredCompactionStrategy'} AND
compression={'sstable_compression': 'SnappyCompressor'};
Cheers
-
Aaron Morton
Freelance Cassandra Consultant
New Zealand
@aaronmorton
http://www.thelastpickle.com
On 15/04/2013, at 3:58 PM, Kuldeep Mishra kuld.cs.mis...@gmail.com
wrote:
Hi,
While I creating counter column family a extra column is being added
what I do ?
Table creation script
CREATE TABLE counters (
key text,
value counter,
PRIMARY KEY (key)
) WITH COMPACT STORAGE
after describing column family I am getting following
CREATE TABLE counters (
key text,
column1 text,
value counter,
PRIMARY KEY (key, column1)
) WITH COMPACT STORAGE AND
bloom_filter_fp_chance=0.01 AND
caching='KEYS_ONLY' AND
comment='' AND
dclocal_read_repair_chance=0.00 AND
gc_grace_seconds=864000 AND
read_repair_chance=0.10 AND
replicate_on_write='true' AND
compaction={'class': 'SizeTieredCompactionStrategy'} AND
compression={'sstable_compression': 'SnappyCompressor'};
extra column column1 is added
Please help
--
Thanks and Regards
Kuldeep Kumar Mishra
+919540965199
--
Thanks and Regards
Kuldeep Kumar Mishra
+919540965199
Added extra column as composite key while creation counter column family
Hi,
While I creating counter column family a extra column is being added
what I do ?
Table creation script
CREATE TABLE counters (
key text,
value counter,
PRIMARY KEY (key)
) WITH COMPACT STORAGE
after describing column family I am getting following
CREATE TABLE counters (
key text,
* column1 text,*
value counter,
PRIMARY KEY (key,* column1*)
) WITH COMPACT STORAGE AND
bloom_filter_fp_chance=0.01 AND
caching='KEYS_ONLY' AND
comment='' AND
dclocal_read_repair_chance=0.00 AND
gc_grace_seconds=864000 AND
read_repair_chance=0.10 AND
replicate_on_write='true' AND
compaction={'class': 'SizeTieredCompactionStrategy'} AND
compression={'sstable_compression': 'SnappyCompressor'};
extra column column1 is added
Please help
--
Thanks and Regards
Kuldeep Kumar Mishra
+919540965199
Re: Can I create a counter column family with many rows in 1.1.10?
What would be the exact CQL3 syntax to create a counter CF with composite row key and not predefined column names ? Is the following supposed to work ? CREATE TABLE composite_counter ( aid text, key1 text, key2 text, key3 text, value counter, PRIMARY KEY (aid, key1, key2, key3) ) First, when I do so I have no error shown, but I *can't* see this CF appear in my OpsCenter. update composite_counter set value = value + 5 where aid = '1' and key1 = 'test1' and key2 = 'test2' and key3 = 'test3'; works as expected too. But how can I have multiple counter columns using the schemaless property of cassandra ? I mean before, when I created counter CF with cli, things like this used to work: update composite_counter set 'value2' = 'value2' + 5 where aid = '1' and key1 = 'test1' and key2 = 'test2' and key3 = 'test3'; = Bad Request: line 1:29 no viable alternative at input 'value2' I also tried: update composite_counter set value2 = value2 + 5 where aid = '1' and key1 = 'test1' and key2 = 'test2' and key3 = 'test3'; = Bad Request: Unknown identifier value2 (as expected I guess) I want to make a counter CF with composite keys and a lot of counters using this pattern 20130306#event or (20130306, event), not sure if I should use composite columns there. Is it mandatory to create the CF with at least one column with the counter type ? I mean I will probably never use a column named 'value', I defined it just to be sure the CF is defined as a counter CF. 2013/3/6 Abhijit Chanda abhijit.chan...@gmail.com Thanks @aaron for the rectification On Wed, Mar 6, 2013 at 1:17 PM, aaron morton aa...@thelastpickle.comwrote: Note that CQL 3 in 1.1 is compatible with CQL 3 in 1.2. Also you do not have to use CQL 3, you can still use the cassandra-cli to create CF's. The syntax you use to populate it depends on the client you are using. Cheers - Aaron Morton Freelance Cassandra Developer New Zealand @aaronmorton http://www.thelastpickle.com On 5/03/2013, at 9:16 PM, Abhijit Chanda abhijit.chan...@gmail.com wrote: Yes you can , you just have to use CQL3 and 1.1.10 onward cassandra supports CQL3. Just you have to aware of the fact that a column family that contains a counter column can only contain counters. In other other words either all the columns of the column family excluding KEY have the counter type or none of them can have it. Best Regards, -- Abhijit Chanda +91-974395 -- Abhijit Chanda +91-974395
RE: Can I create a counter column family with many rows in 1.1.10?
Ah, I'ts with many columns, not rows. I use this in cql 2-3 create table cnt (key text PRIMARY KEY, y2003 counter, y2004 counter);it says this is not a counter column family, and if I try to use default_validation_class=CounterType,it says this is not a valid keyword.What I'm supposed to type in order to create it? From: aa...@thelastpickle.com Subject: Re: Can I create a counter column family with many rows in 1.1.10? Date: Tue, 5 Mar 2013 23:47:38 -0800 To: user@cassandra.apache.org Note that CQL 3 in 1.1 is compatible with CQL 3 in 1.2. Also you do not have to use CQL 3, you can still use the cassandra-cli to create CF's. The syntax you use to populate it depends on the client you are using. Cheers -Aaron MortonFreelance Cassandra DeveloperNew Zealand @aaronmortonhttp://www.thelastpickle.com On 5/03/2013, at 9:16 PM, Abhijit Chanda abhijit.chan...@gmail.com wrote:Yes you can , you just have to use CQL3 and 1.1.10 onward cassandra supports CQL3. Just you have to aware of the fact that a column family that contains a counter column can only contain counters. In other other words either all the columns of the column family excluding KEY have the counter type or none of them can have it. Best Regards, -- Abhijit Chanda +91-974395
RE: Can I create a counter column family with many rows in 1.1.10?
I got it now. From: mateus.ffrei...@hotmail.com To: user@cassandra.apache.org Subject: RE: Can I create a counter column family with many rows in 1.1.10? Date: Wed, 6 Mar 2013 08:42:37 -0300 Ah, I'ts with many columns, not rows. I use this in cql 2-3 create table cnt (key text PRIMARY KEY, y2003 counter, y2004 counter);it says this is not a counter column family, and if I try to use default_validation_class=CounterType,it says this is not a valid keyword.What I'm supposed to type in order to create it? From: aa...@thelastpickle.com Subject: Re: Can I create a counter column family with many rows in 1.1.10? Date: Tue, 5 Mar 2013 23:47:38 -0800 To: user@cassandra.apache.org Note that CQL 3 in 1.1 is compatible with CQL 3 in 1.2. Also you do not have to use CQL 3, you can still use the cassandra-cli to create CF's. The syntax you use to populate it depends on the client you are using. Cheers -Aaron MortonFreelance Cassandra DeveloperNew Zealand @aaronmortonhttp://www.thelastpickle.com On 5/03/2013, at 9:16 PM, Abhijit Chanda abhijit.chan...@gmail.com wrote:Yes you can , you just have to use CQL3 and 1.1.10 onward cassandra supports CQL3. Just you have to aware of the fact that a column family that contains a counter column can only contain counters. In other other words either all the columns of the column family excluding KEY have the counter type or none of them can have it. Best Regards, -- Abhijit Chanda +91-974395
Re: Can I create a counter column family with many rows in 1.1.10?
If you have one column in the table that is not part of the primary key and is a counter, then all columns that are not part of the primary key must also be a counter. Cheers - Aaron Morton Freelance Cassandra Developer New Zealand @aaronmorton http://www.thelastpickle.com On 6/03/2013, at 2:56 AM, Alain RODRIGUEZ arodr...@gmail.com wrote: What would be the exact CQL3 syntax to create a counter CF with composite row key and not predefined column names ? Is the following supposed to work ? CREATE TABLE composite_counter ( aid text, key1 text, key2 text, key3 text, value counter, PRIMARY KEY (aid, key1, key2, key3) ) First, when I do so I have no error shown, but I *can't* see this CF appear in my OpsCenter. update composite_counter set value = value + 5 where aid = '1' and key1 = 'test1' and key2 = 'test2' and key3 = 'test3'; works as expected too. But how can I have multiple counter columns using the schemaless property of cassandra ? I mean before, when I created counter CF with cli, things like this used to work: update composite_counter set 'value2' = 'value2' + 5 where aid = '1' and key1 = 'test1' and key2 = 'test2' and key3 = 'test3'; = Bad Request: line 1:29 no viable alternative at input 'value2' I also tried: update composite_counter set value2 = value2 + 5 where aid = '1' and key1 = 'test1' and key2 = 'test2' and key3 = 'test3'; = Bad Request: Unknown identifier value2 (as expected I guess) I want to make a counter CF with composite keys and a lot of counters using this pattern 20130306#event or (20130306, event), not sure if I should use composite columns there. Is it mandatory to create the CF with at least one column with the counter type ? I mean I will probably never use a column named 'value', I defined it just to be sure the CF is defined as a counter CF. 2013/3/6 Abhijit Chanda abhijit.chan...@gmail.com Thanks @aaron for the rectification On Wed, Mar 6, 2013 at 1:17 PM, aaron morton aa...@thelastpickle.com wrote: Note that CQL 3 in 1.1 is compatible with CQL 3 in 1.2. Also you do not have to use CQL 3, you can still use the cassandra-cli to create CF's. The syntax you use to populate it depends on the client you are using. Cheers - Aaron Morton Freelance Cassandra Developer New Zealand @aaronmorton http://www.thelastpickle.com On 5/03/2013, at 9:16 PM, Abhijit Chanda abhijit.chan...@gmail.com wrote: Yes you can , you just have to use CQL3 and 1.1.10 onward cassandra supports CQL3. Just you have to aware of the fact that a column family that contains a counter column can only contain counters. In other other words either all the columns of the column family excluding KEY have the counter type or none of them can have it. Best Regards, -- Abhijit Chanda +91-974395 -- Abhijit Chanda +91-974395
Re: Can I create a counter column family with many rows in 1.1.10?
Note that CQL 3 in 1.1 is compatible with CQL 3 in 1.2. Also you do not have to use CQL 3, you can still use the cassandra-cli to create CF's. The syntax you use to populate it depends on the client you are using. Cheers - Aaron Morton Freelance Cassandra Developer New Zealand @aaronmorton http://www.thelastpickle.com On 5/03/2013, at 9:16 PM, Abhijit Chanda abhijit.chan...@gmail.com wrote: Yes you can , you just have to use CQL3 and 1.1.10 onward cassandra supports CQL3. Just you have to aware of the fact that a column family that contains a counter column can only contain counters. In other other words either all the columns of the column family excluding KEY have the counter type or none of them can have it. Best Regards, -- Abhijit Chanda +91-974395
Re: Can I create a counter column family with many rows in 1.1.10?
Thanks @aaron for the rectification On Wed, Mar 6, 2013 at 1:17 PM, aaron morton aa...@thelastpickle.comwrote: Note that CQL 3 in 1.1 is compatible with CQL 3 in 1.2. Also you do not have to use CQL 3, you can still use the cassandra-cli to create CF's. The syntax you use to populate it depends on the client you are using. Cheers - Aaron Morton Freelance Cassandra Developer New Zealand @aaronmorton http://www.thelastpickle.com On 5/03/2013, at 9:16 PM, Abhijit Chanda abhijit.chan...@gmail.com wrote: Yes you can , you just have to use CQL3 and 1.1.10 onward cassandra supports CQL3. Just you have to aware of the fact that a column family that contains a counter column can only contain counters. In other other words either all the columns of the column family excluding KEY have the counter type or none of them can have it. Best Regards, -- Abhijit Chanda +91-974395 -- Abhijit Chanda +91-974395
Re: Counter column family
My problem was the result of Hector bug, see http://groups.google.com/group/hector-users/browse_thread/thread/8359538ed387564e So please ignore question, Thanks, *Tamar Fraenkel * Senior Software Engineer, TOK Media [image: Inline image 1] ta...@tok-media.com Tel: +972 2 6409736 Mob: +972 54 8356490 Fax: +972 2 5612956 On Tue, Apr 17, 2012 at 6:59 PM, Tamar Fraenkel ta...@tok-media.com wrote: Hi! I want to understand how incrementing of counter works. - I have a 3 node ring, - I use FailoverPolicy.FAIL_FAST, - RF is 2, I have the following counter column family ColumnFamily: tk_counters Key Validation Class: org.apache.cassandra.db.marshal.CompositeType( org.apache.cassandra.db.marshal.UTF8Type,org.apache.cassandra.db.marshal. UUIDType) Default column value validator: org.apache.cassandra.db.marshal. CounterColumnType Columns sorted by: org.apache.cassandra.db.marshal.UTF8Type Row cache size / save period in seconds / keys to save : 0.0/0/all Row Cache Provider: org.apache.cassandra.cache. SerializingCacheProvider Key cache size / save period in seconds: 0.0/14400 GC grace seconds: 864000 Compaction min/max thresholds: 4/32 Read repair chance: 1.0 Replicate on write: true Bloom Filter FP chance: default Built indexes: [] Compaction Strategy: org.apache.cassandra.db.compaction.SizeTieredCompactionStrategy My CL for this column family is Write=2, Read=1. When I increment a counter (using hector mutator), and execute returns without errors, what is the status of the nodes at that stage. Can execute return before the nodes are really updated? So that if a read is done immediately after the increment it will still read the previous values? Thanks, *Tamar Fraenkel * Senior Software Engineer, TOK Media [image: Inline image 1] ta...@tok-media.com Tel: +972 2 6409736 Mob: +972 54 8356490 Fax: +972 2 5612956 tokLogo.png
Counter column family
Hi! I want to understand how incrementing of counter works. - I have a 3 node ring, - I use FailoverPolicy.FAIL_FAST, - RF is 2, I have the following counter column family ColumnFamily: tk_counters Key Validation Class: org.apache.cassandra.db.marshal.CompositeType( org.apache.cassandra.db.marshal.UTF8Type,org.apache.cassandra.db.marshal. UUIDType) Default column value validator: org.apache.cassandra.db.marshal. CounterColumnType Columns sorted by: org.apache.cassandra.db.marshal.UTF8Type Row cache size / save period in seconds / keys to save : 0.0/0/all Row Cache Provider: org.apache.cassandra.cache. SerializingCacheProvider Key cache size / save period in seconds: 0.0/14400 GC grace seconds: 864000 Compaction min/max thresholds: 4/32 Read repair chance: 1.0 Replicate on write: true Bloom Filter FP chance: default Built indexes: [] Compaction Strategy: org.apache.cassandra.db.compaction.SizeTieredCompactionStrategy My CL for this column family is Write=2, Read=1. When I increment a counter (using hector mutator), and execute returns without errors, what is the status of the nodes at that stage. Can execute return before the nodes are really updated? So that if a read is done immediately after the increment it will still read the previous values? Thanks, *Tamar Fraenkel * Senior Software Engineer, TOK Media [image: Inline image 1] ta...@tok-media.com Tel: +972 2 6409736 Mob: +972 54 8356490 Fax: +972 2 5612956 tokLogo.png
Re: counter column family
You may have better luck with Hector specific questions on the Hector User Group https://groups.google.com/forum/?fromgroups#!forum/hector-users Cheers - Aaron Morton Freelance Developer @aaronmorton http://www.thelastpickle.com On 4/04/2012, at 5:54 PM, Tamar Fraenkel wrote: Hi! So, if I am using Hector, I need to do: cassandraHostConfigurator.setRetryDownedHosts(false)? How will this affect my application generally? Thanks Tamar Fraenkel Senior Software Engineer, TOK Media tokLogo.png ta...@tok-media.com Tel: +972 2 6409736 Mob: +972 54 8356490 Fax: +972 2 5612956 On Tue, Mar 27, 2012 at 4:25 PM, R. Verlangen ro...@us2.nl wrote: You should use a connection pool without retries to prevent a single increment of +1 have a result of e.g. +3. 2012/3/27 Rishabh Agrawal rishabh.agra...@impetus.co.in You can even define how much increment you want. But let me just warn you, as far my knowledge, it has consistency issues. From: puneet loya [mailto:puneetl...@gmail.com] Sent: Tuesday, March 27, 2012 5:59 PM To: user@cassandra.apache.org Subject: Re: counter column family thanxx a ton :) :) the counter column family works synonymous as 'auto increment' in other databases rite? I mean we have a column of type integer which increments with every insert. Am i goin the rite way?? please reply :) On Tue, Mar 27, 2012 at 5:50 PM, R. Verlangen ro...@us2.nl wrote: create column family MyCounterColumnFamily with default_validation_class=CounterColumnType and key_validation_class=UTF8Type and comparator=UTF8Type; There you go! Keys must be utf8, as well as the column names. Of course you can change those validators. Cheers! 2012/3/27 puneet loya puneetl...@gmail.com Can u give an example of create column family with counter column in it. Please reply Regards, Puneet Loya -- With kind regards, Robin Verlangen www.robinverlangen.nl Impetus to sponsor and exhibit at Structure Data 2012, NY; Mar 21-22. Know more about our Big Data quick-start program at the event. New Impetus webcast ‘Cloud-enabled Performance Testing vis-à-vis On-premise’ available at http://bit.ly/z6zT4L. NOTE: This message may contain information that is confidential, proprietary, privileged or otherwise protected by law. The message is intended solely for the named addressee. If received in error, please destroy and notify the sender. Any use of this email is prohibited when received in error. Impetus does not represent, warrant and/or guarantee, that the integrity of this communication has been maintained nor that the communication is free of errors, virus, interception or interference. -- With kind regards, Robin Verlangen www.robinverlangen.nl
Re: counter column family
Hi! So, if I am using Hector, I need to do: cassandraHostConfigurator.setRetryDownedHosts(false)? How will this affect my application generally? Thanks *Tamar Fraenkel * Senior Software Engineer, TOK Media [image: Inline image 1] ta...@tok-media.com Tel: +972 2 6409736 Mob: +972 54 8356490 Fax: +972 2 5612956 On Tue, Mar 27, 2012 at 4:25 PM, R. Verlangen ro...@us2.nl wrote: You should use a connection pool without retries to prevent a single increment of +1 have a result of e.g. +3. 2012/3/27 Rishabh Agrawal rishabh.agra...@impetus.co.in You can even define how much increment you want. But let me just warn you, as far my knowledge, it has consistency issues. *From:* puneet loya [mailto:puneetl...@gmail.com] *Sent:* Tuesday, March 27, 2012 5:59 PM *To:* user@cassandra.apache.org *Subject:* Re: counter column family thanxx a ton :) :) the counter column family works synonymous as 'auto increment' in other databases rite? I mean we have a column of type integer which increments with every insert. Am i goin the rite way?? please reply :) On Tue, Mar 27, 2012 at 5:50 PM, R. Verlangen ro...@us2.nl wrote: *create column family MyCounterColumnFamily with default_validation_class=CounterColumnType and key_validation_class=UTF8Type and comparator=UTF8Type;* There you go! Keys must be utf8, as well as the column names. Of course you can change those validators. Cheers! 2012/3/27 puneet loya puneetl...@gmail.com Can u give an example of create column family with counter column in it. Please reply Regards, Puneet Loya -- With kind regards, Robin Verlangen www.robinverlangen.nl -- Impetus to sponsor and exhibit at Structure Data 2012, NY; Mar 21-22. Know more about our Big Data quick-start program at the event. New Impetus webcast ‘Cloud-enabled Performance Testing vis-à-vis On-premise’ available at http://bit.ly/z6zT4L. NOTE: This message may contain information that is confidential, proprietary, privileged or otherwise protected by law. The message is intended solely for the named addressee. If received in error, please destroy and notify the sender. Any use of this email is prohibited when received in error. Impetus does not represent, warrant and/or guarantee, that the integrity of this communication has been maintained nor that the communication is free of errors, virus, interception or interference. -- With kind regards, Robin Verlangen www.robinverlangen.nl tokLogo.png
Re: counter column family
On Tue, Mar 27, 2012 at 9:35 AM, puneet loya puneetl...@gmail.com wrote: now i want to have a field incrementing with every row insertion. how do i do it in cassandra?? There's nothing that will do it automatically. You need to increment it yourself. -- Tyler Hobbs DataStax http://datastax.com/
counter column family
Can u give an example of create column family with counter column in it. Please reply Regards, Puneet Loya
Re: counter column family
*create column family MyCounterColumnFamily with default_validation_class=CounterColumnType and key_validation_class=UTF8Type and comparator=UTF8Type;* There you go! Keys must be utf8, as well as the column names. Of course you can change those validators. Cheers! 2012/3/27 puneet loya puneetl...@gmail.com Can u give an example of create column family with counter column in it. Please reply Regards, Puneet Loya -- With kind regards, Robin Verlangen www.robinverlangen.nl
Re: counter column family
thanxx a ton :) :) the counter column family works synonymous as 'auto increment' in other databases rite? I mean we have a column of type integer which increments with every insert. Am i goin the rite way?? please reply :) On Tue, Mar 27, 2012 at 5:50 PM, R. Verlangen ro...@us2.nl wrote: *create column family MyCounterColumnFamily with default_validation_class=CounterColumnType and key_validation_class=UTF8Type and comparator=UTF8Type;* There you go! Keys must be utf8, as well as the column names. Of course you can change those validators. Cheers! 2012/3/27 puneet loya puneetl...@gmail.com Can u give an example of create column family with counter column in it. Please reply Regards, Puneet Loya -- With kind regards, Robin Verlangen www.robinverlangen.nl
Re: counter column family
You should use a connection pool without retries to prevent a single increment of +1 have a result of e.g. +3. 2012/3/27 Rishabh Agrawal rishabh.agra...@impetus.co.in You can even define how much increment you want. But let me just warn you, as far my knowledge, it has consistency issues. *From:* puneet loya [mailto:puneetl...@gmail.com] *Sent:* Tuesday, March 27, 2012 5:59 PM *To:* user@cassandra.apache.org *Subject:* Re: counter column family thanxx a ton :) :) the counter column family works synonymous as 'auto increment' in other databases rite? I mean we have a column of type integer which increments with every insert. Am i goin the rite way?? please reply :) On Tue, Mar 27, 2012 at 5:50 PM, R. Verlangen ro...@us2.nl wrote: *create column family MyCounterColumnFamily with default_validation_class=CounterColumnType and key_validation_class=UTF8Type and comparator=UTF8Type;* There you go! Keys must be utf8, as well as the column names. Of course you can change those validators. Cheers! 2012/3/27 puneet loya puneetl...@gmail.com Can u give an example of create column family with counter column in it. Please reply Regards, Puneet Loya -- With kind regards, Robin Verlangen www.robinverlangen.nl -- Impetus to sponsor and exhibit at Structure Data 2012, NY; Mar 21-22. Know more about our Big Data quick-start program at the event. New Impetus webcast ‘Cloud-enabled Performance Testing vis-à-vis On-premise’ available at http://bit.ly/z6zT4L. NOTE: This message may contain information that is confidential, proprietary, privileged or otherwise protected by law. The message is intended solely for the named addressee. If received in error, please destroy and notify the sender. Any use of this email is prohibited when received in error. Impetus does not represent, warrant and/or guarantee, that the integrity of this communication has been maintained nor that the communication is free of errors, virus, interception or interference. -- With kind regards, Robin Verlangen www.robinverlangen.nl
Re: counter column family
wen i m using a counter column.. i m nt able to add columns of other type
to the column family.. is it so or it is just synactical error??
[default@CMDCv99] create column family status
... with comparator = AsciiType
... and column_metadata =
... [{
... column_name : Test,
... validation_class : IntegerType,
... index_type : 0,
... index_name : IdxName},
... {
... column_name : 'other name',
... validation_class : CounterColumnType
... }];
Cannot add a counter column (other name) in a non counter column family
On Tue, Mar 27, 2012 at 6:55 PM, R. Verlangen ro...@us2.nl wrote:
You should use a connection pool without retries to prevent a single
increment of +1 have a result of e.g. +3.
2012/3/27 Rishabh Agrawal rishabh.agra...@impetus.co.in
You can even define how much increment you want. But let me just warn
you, as far my knowledge, it has consistency issues.
*From:* puneet loya [mailto:puneetl...@gmail.com]
*Sent:* Tuesday, March 27, 2012 5:59 PM
*To:* user@cassandra.apache.org
*Subject:* Re: counter column family
thanxx a ton :) :)
the counter column family works synonymous as 'auto increment' in other
databases rite?
I mean we have a column of type integer which increments with every
insert.
Am i goin the rite way??
please reply :)
On Tue, Mar 27, 2012 at 5:50 PM, R. Verlangen ro...@us2.nl wrote:
*create column family MyCounterColumnFamily with
default_validation_class=CounterColumnType and
key_validation_class=UTF8Type and comparator=UTF8Type;*
There you go! Keys must be utf8, as well as the column names. Of course
you can change those validators.
Cheers!
2012/3/27 puneet loya puneetl...@gmail.com
Can u give an example of create column family with counter column in it.
Please reply
Regards,
Puneet Loya
--
With kind regards,
Robin Verlangen
www.robinverlangen.nl
--
Impetus to sponsor and exhibit at Structure Data 2012, NY; Mar 21-22.
Know more about our Big Data quick-start program at the event.
New Impetus webcast ‘Cloud-enabled Performance Testing vis-à-vis
On-premise’ available at http://bit.ly/z6zT4L.
NOTE: This message may contain information that is confidential,
proprietary, privileged or otherwise protected by law. The message is
intended solely for the named addressee. If received in error, please
destroy and notify the sender. Any use of this email is prohibited when
received in error. Impetus does not represent, warrant and/or guarantee,
that the integrity of this communication has been maintained nor that the
communication is free of errors, virus, interception or interference.
--
With kind regards,
Robin Verlangen
www.robinverlangen.nl
Re: counter column family
Counter columns are special, they must be in a column family to themselves.
On 03/27/2012 09:32 AM, puneet loya wrote:
wen i m using a counter column.. i m nt able to add columns of other
type to the column family.. is it so or it is just synactical error??
[default@CMDCv99] create column family status
... with comparator = AsciiType
... and column_metadata =
... [{
... column_name : Test,
... validation_class : IntegerType,
... index_type : 0,
... index_name : IdxName},
... {
... column_name : 'other name',
... validation_class : CounterColumnType
... }];
Cannot add a counter column (other name) in a non counter column family
On Tue, Mar 27, 2012 at 6:55 PM, R. Verlangen ro...@us2.nl
mailto:ro...@us2.nl wrote:
You should use a connection pool without retries to prevent a
single increment of +1 have a result of e.g. +3.
2012/3/27 Rishabh Agrawal rishabh.agra...@impetus.co.in
mailto:rishabh.agra...@impetus.co.in
You can even define how much increment you want. But let me
just warn you, as far my knowledge, it has consistency issues.
*From:*puneet loya [mailto:puneetl...@gmail.com
mailto:puneetl...@gmail.com]
*Sent:* Tuesday, March 27, 2012 5:59 PM
*To:* user@cassandra.apache.org mailto:user@cassandra.apache.org
*Subject:* Re: counter column family
thanxx a ton :) :)
the counter column family works synonymous as 'auto increment'
in other databases rite?
I mean we have a column of type integer which increments with
every insert.
Am i goin the rite way??
please reply :)
On Tue, Mar 27, 2012 at 5:50 PM, R. Verlangen ro...@us2.nl
mailto:ro...@us2.nl wrote:
*create column family MyCounterColumnFamily with
default_validation_class=CounterColumnType and
key_validation_class=UTF8Type and comparator=UTF8Type;*
There you go! Keys must be utf8, as well as the column names.
Of course you can change those validators.
Cheers!
2012/3/27 puneet loya puneetl...@gmail.com
mailto:puneetl...@gmail.com
Can u give an example of create column family with counter
column in it.
Please reply
Regards,
Puneet Loya
--
With kind regards,
Robin Verlangen
www.robinverlangen.nl http://www.robinverlangen.nl
Impetus to sponsor and exhibit at Structure Data 2012, NY; Mar
21-22. Know more about our Big Data quick-start program at the
event.
New Impetus webcast ‘Cloud-enabled Performance Testing
vis-à-vis On-premise’ available at http://bit.ly/z6zT4L.
NOTE: This message may contain information that is
confidential, proprietary, privileged or otherwise protected
by law. The message is intended solely for the named
addressee. If received in error, please destroy and notify the
sender. Any use of this email is prohibited when received in
error. Impetus does not represent, warrant and/or guarantee,
that the integrity of this communication has been maintained
nor that the communication is free of errors, virus,
interception or interference.
--
With kind regards,
Robin Verlangen
www.robinverlangen.nl http://www.robinverlangen.nl
Re: counter column family
now i want to have a field incrementing with every row insertion. how do i
do it in cassandra??
On Tue, Mar 27, 2012 at 7:34 PM, Dave Brosius dbros...@mebigfatguy.comwrote:
Counter columns are special, they must be in a column family to
themselves.
On 03/27/2012 09:32 AM, puneet loya wrote:
wen i m using a counter column.. i m nt able to add columns of other type
to the column family.. is it so or it is just synactical error??
[default@CMDCv99] create column family status
... with comparator = AsciiType
... and column_metadata =
... [{
... column_name : Test,
... validation_class : IntegerType,
... index_type : 0,
... index_name : IdxName},
... {
... column_name : 'other name',
... validation_class : CounterColumnType
... }];
Cannot add a counter column (other name) in a non counter column family
On Tue, Mar 27, 2012 at 6:55 PM, R. Verlangen ro...@us2.nl wrote:
You should use a connection pool without retries to prevent a single
increment of +1 have a result of e.g. +3.
2012/3/27 Rishabh Agrawal rishabh.agra...@impetus.co.in
You can even define how much increment you want. But let me just warn
you, as far my knowledge, it has consistency issues.
*From:* puneet loya [mailto:puneetl...@gmail.com]
*Sent:* Tuesday, March 27, 2012 5:59 PM
*To:* user@cassandra.apache.org
*Subject:* Re: counter column family
thanxx a ton :) :)
the counter column family works synonymous as 'auto increment' in other
databases rite?
I mean we have a column of type integer which increments with every
insert.
Am i goin the rite way??
please reply :)
On Tue, Mar 27, 2012 at 5:50 PM, R. Verlangen ro...@us2.nl wrote:
*create column family MyCounterColumnFamily with
default_validation_class=CounterColumnType and
key_validation_class=UTF8Type and comparator=UTF8Type;*
There you go! Keys must be utf8, as well as the column names. Of course
you can change those validators.
Cheers!
2012/3/27 puneet loya puneetl...@gmail.com
Can u give an example of create column family with counter column in it.
Please reply
Regards,
Puneet Loya
--
With kind regards,
Robin Verlangen
www.robinverlangen.nl
--
Impetus to sponsor and exhibit at Structure Data 2012, NY; Mar 21-22.
Know more about our Big Data quick-start program at the event.
New Impetus webcast ‘Cloud-enabled Performance Testing vis-à-vis
On-premise’ available at http://bit.ly/z6zT4L.
NOTE: This message may contain information that is confidential,
proprietary, privileged or otherwise protected by law. The message is
intended solely for the named addressee. If received in error, please
destroy and notify the sender. Any use of this email is prohibited when
received in error. Impetus does not represent, warrant and/or guarantee,
that the integrity of this communication has been maintained nor that the
communication is free of errors, virus, interception or interference.
--
With kind regards,
Robin Verlangen
www.robinverlangen.nl
Counter Column Family Inconsistent Node
[default@Race] list CounterCF; Using default limit of 100 --- RowKey: Stats = (counter=APP, value=7503) = (counter=FILEUPLOAD, value=155) = (counter=MQUPLOAD, value=4726775) = (counter=PAGES, value=131948) = (counter=REST, value=3) = (counter=SOAP, value=44) = (counter=WS, value=1943) 1 Row Returned. [default@Race] list CounterCF; Using default limit of 100 --- RowKey: Stats = (counter=APP, value=93683) = (counter=FILEUPLOAD, value=347) = (counter=MQUPLOAD, value=14961065367) = (counter=PAGES, value=183089568) = (counter=REST, value=3) = (counter=SOAP, value=44) = (counter=WS, value=23972) 1 Row Returned. [default@Race] list CounterCF; Using default limit of 100 --- RowKey: Stats = (counter=APP, value=7503) = (counter=FILEUPLOAD, value=155) = (counter=MQUPLOAD, value=4726775) = (counter=PAGES, value=131948) = (counter=REST, value=3) = (counter=SOAP, value=44) = (counter=WS, value=1943) 1 Row Returned. [default@Race] list CounterCF; Using default limit of 100 --- RowKey: Stats = (counter=APP, value=7503) = (counter=FILEUPLOAD, value=155) = (counter=MQUPLOAD, value=4726775) = (counter=PAGES, value=131948) = (counter=REST, value=3) = (counter=SOAP, value=44) = (counter=WS, value=1943)
Re: Counter Column Family Inconsistent Node
yeah, sorry about that... pushed click before I added my comments. I have a cluster of 5 nodes using 0.8.4 where I am using counters. One one of my nodes, every time I do a list command I get different results. The counters jump all over the place. Any ideas? I have run nodetool repair on all nodes. Thanks! Ryan On Tue, Aug 16, 2011 at 1:18 PM, Ryan Lowe ryanjl...@gmail.com wrote: [default@Race] list CounterCF; Using default limit of 100 --- RowKey: Stats = (counter=APP, value=7503) = (counter=FILEUPLOAD, value=155) = (counter=MQUPLOAD, value=4726775) = (counter=PAGES, value=131948) = (counter=REST, value=3) = (counter=SOAP, value=44) = (counter=WS, value=1943) 1 Row Returned. [default@Race] list CounterCF; Using default limit of 100 --- RowKey: Stats = (counter=APP, value=93683) = (counter=FILEUPLOAD, value=347) = (counter=MQUPLOAD, value=14961065367) = (counter=PAGES, value=183089568) = (counter=REST, value=3) = (counter=SOAP, value=44) = (counter=WS, value=23972) 1 Row Returned. [default@Race] list CounterCF; Using default limit of 100 --- RowKey: Stats = (counter=APP, value=7503) = (counter=FILEUPLOAD, value=155) = (counter=MQUPLOAD, value=4726775) = (counter=PAGES, value=131948) = (counter=REST, value=3) = (counter=SOAP, value=44) = (counter=WS, value=1943) 1 Row Returned. [default@Race] list CounterCF; Using default limit of 100 --- RowKey: Stats = (counter=APP, value=7503) = (counter=FILEUPLOAD, value=155) = (counter=MQUPLOAD, value=4726775) = (counter=PAGES, value=131948) = (counter=REST, value=3) = (counter=SOAP, value=44) = (counter=WS, value=1943)
Re: Counter Column Family Inconsistent Node
May be the same as https://issues.apache.org/jira/browse/CASSANDRA-3006 ? On Tue, Aug 16, 2011 at 12:20 PM, Ryan Lowe ryanjl...@gmail.com wrote: yeah, sorry about that... pushed click before I added my comments. I have a cluster of 5 nodes using 0.8.4 where I am using counters. One one of my nodes, every time I do a list command I get different results. The counters jump all over the place. Any ideas? I have run nodetool repair on all nodes. Thanks! Ryan On Tue, Aug 16, 2011 at 1:18 PM, Ryan Lowe ryanjl...@gmail.com wrote: [default@Race] list CounterCF; Using default limit of 100 --- RowKey: Stats = (counter=APP, value=7503) = (counter=FILEUPLOAD, value=155) = (counter=MQUPLOAD, value=4726775) = (counter=PAGES, value=131948) = (counter=REST, value=3) = (counter=SOAP, value=44) = (counter=WS, value=1943) 1 Row Returned. [default@Race] list CounterCF; Using default limit of 100 --- RowKey: Stats = (counter=APP, value=93683) = (counter=FILEUPLOAD, value=347) = (counter=MQUPLOAD, value=14961065367) = (counter=PAGES, value=183089568) = (counter=REST, value=3) = (counter=SOAP, value=44) = (counter=WS, value=23972) 1 Row Returned. [default@Race] list CounterCF; Using default limit of 100 --- RowKey: Stats = (counter=APP, value=7503) = (counter=FILEUPLOAD, value=155) = (counter=MQUPLOAD, value=4726775) = (counter=PAGES, value=131948) = (counter=REST, value=3) = (counter=SOAP, value=44) = (counter=WS, value=1943) 1 Row Returned. [default@Race] list CounterCF; Using default limit of 100 --- RowKey: Stats = (counter=APP, value=7503) = (counter=FILEUPLOAD, value=155) = (counter=MQUPLOAD, value=4726775) = (counter=PAGES, value=131948) = (counter=REST, value=3) = (counter=SOAP, value=44) = (counter=WS, value=1943) -- Jonathan Ellis Project Chair, Apache Cassandra co-founder of DataStax, the source for professional Cassandra support http://www.datastax.com
Re: Counter Column Family Inconsistent Node
Actually I think it was more related to our servers getting their time out of sync... after finding this article: http://ria101.wordpress.com/2011/02/08/cassandra-the-importance-of-system-clocks-avoiding-oom-and-how-to-escape-oom-meltdown/ I checked our servers, and sure enough, 2 of them were out of sync with each other with more than a 2 min difference! I reconfigured ntp and I think I am back in business. Thanks though! Ryan On Tue, Aug 16, 2011 at 2:53 PM, Jonathan Ellis jbel...@gmail.com wrote: May be the same as https://issues.apache.org/jira/browse/CASSANDRA-3006 ? On Tue, Aug 16, 2011 at 12:20 PM, Ryan Lowe ryanjl...@gmail.com wrote: yeah, sorry about that... pushed click before I added my comments. I have a cluster of 5 nodes using 0.8.4 where I am using counters. One one of my nodes, every time I do a list command I get different results. The counters jump all over the place. Any ideas? I have run nodetool repair on all nodes. Thanks! Ryan On Tue, Aug 16, 2011 at 1:18 PM, Ryan Lowe ryanjl...@gmail.com wrote: [default@Race] list CounterCF; Using default limit of 100 --- RowKey: Stats = (counter=APP, value=7503) = (counter=FILEUPLOAD, value=155) = (counter=MQUPLOAD, value=4726775) = (counter=PAGES, value=131948) = (counter=REST, value=3) = (counter=SOAP, value=44) = (counter=WS, value=1943) 1 Row Returned. [default@Race] list CounterCF; Using default limit of 100 --- RowKey: Stats = (counter=APP, value=93683) = (counter=FILEUPLOAD, value=347) = (counter=MQUPLOAD, value=14961065367) = (counter=PAGES, value=183089568) = (counter=REST, value=3) = (counter=SOAP, value=44) = (counter=WS, value=23972) 1 Row Returned. [default@Race] list CounterCF; Using default limit of 100 --- RowKey: Stats = (counter=APP, value=7503) = (counter=FILEUPLOAD, value=155) = (counter=MQUPLOAD, value=4726775) = (counter=PAGES, value=131948) = (counter=REST, value=3) = (counter=SOAP, value=44) = (counter=WS, value=1943) 1 Row Returned. [default@Race] list CounterCF; Using default limit of 100 --- RowKey: Stats = (counter=APP, value=7503) = (counter=FILEUPLOAD, value=155) = (counter=MQUPLOAD, value=4726775) = (counter=PAGES, value=131948) = (counter=REST, value=3) = (counter=SOAP, value=44) = (counter=WS, value=1943) -- Jonathan Ellis Project Chair, Apache Cassandra co-founder of DataStax, the source for professional Cassandra support http://www.datastax.com
Re: Counter Column family Cassandra 0.8 PHP Support ?
I'm not a php type person, but I can help a little with thrift. Install thrift 0.6 and then run this in the interface/ directory of the cassandra source... thrift --gen php cassandra.thrift You should end up with the interface/gen-php/ Hope that helps. - Aaron Morton Freelance Cassandra Developer @aaronmorton http://www.thelastpickle.com On 17 May 2011, at 11:26, bhanu choudhary wrote: I am using counters to read the counts on my website dynamically. I am looking for phpcassandra client(?) that supports counters natively. I was looking if any PHP developer could give me a lead in generating the PHP client code required using thrift. Thanks in advance!
