Wide Row with some indexes in CQL3

2013-10-24 Thread ono_matope
Hi, In my new project, I want to create a wide row CF with indexes in CQL3. In my project, users can store multipurpose data and backed to Cassandra. For example, my Profile CF has some user-defined properties as wide row. And users can add indexes on columns which they want. Of cource, we can

Data Model for time series with multiple interval / sub-sample

2013-10-24 Thread Ahmy Yulrizka
Hi, I'm very new with and trying out cassandra. I have couple of question regarding the design of the database. We have an API to store time series sensor data in millisecond precision. user can do CRUD operation through the Restful API. When user retrieve data, by default they can specify

Re: [RELEASE] Apache Cassandra 1.2.11 released

2013-10-24 Thread Cyril Scetbon
Yes it's included under commit 639c01a3504b -- Cyril SCETBON On 23 Oct 2013, at 19:33, Janne Jalkanen janne.jalka...@ecyrd.com wrote: Question - is https://issues.apache.org/jira/browse/CASSANDRA-6102 in 1.2.11 or not? CHANGES.txt says it's not, JIRA says it is. /Janne (temporarily

Re: MemtablePostFlusher pending

2013-10-24 Thread Kais Ahmed
Hello aaron, I hope you had a nice flight. Any information on how you are using cassandra, does the zero columns no row delete idea sound like something you are doing ? I do not know what I could do, but we use an old versions of phpcassa (0.8.a.2) that are not explictly compatible with

Re: Compaction issues

2013-10-24 Thread Russ Garrett
On 23 October 2013 21:25, Aaron Morton aa...@thelastpickle.com wrote: Is there ever a time when the pending count is non zero but nodetool compactionstats does not show any running tasks ? No - but there are times when the number of running compaction processes is less than

Problems using secondary index with IN keyword

2013-10-24 Thread Petter von Dolwitz (Hem)
Hi, I have a table that (in simplified version) looks like this: CREATE TABLE mytable ( a varchar, b varchar, c varchar d timstamp, e varchar, PRIMARY KEY (a, b, c, d) ); CREATE INDEX mytable_c_idx ON mytable ( c ); After populating I execute: SELECT * FROM mytable WHERE

Re: Problems using secondary index with IN keyword

2013-10-24 Thread Jan Algermissen
Petter, On 24.10.2013, at 14:38, Petter von Dolwitz (Hem) petter.von.dolw...@gmail.com wrote: Hi, I have a table that (in simplified version) looks like this: CREATE TABLE mytable ( a varchar, b varchar, c varchar d timstamp, e varchar, PRIMARY KEY (a, b, c, d) );

Re: Problems using secondary index with IN keyword

2013-10-24 Thread Petter von Dolwitz (Hem)
You cannot use a part in a where clause unless you specify the preceeding parts also. But the statement SELECT * FROM mytable WHERE c='myvalue'; works? What are secondary indexes for then if you can't use them in this way? Forgot to mention that I am on Cassandra 2.0.1 /Petter 2013/10/24 Jan

Re: read latencies?

2013-10-24 Thread Tyler Hobbs
The key is this line: Read 827 live and 6948 tombstoned cells That means you either have a lot of deleted or TTLed columns in that row. One option to help with that is to set a lower gc_grace for the table and repair more frequently; this will help tombstones get purged more quickly. Another

Re: Problems using secondary index with IN keyword

2013-10-24 Thread Jan Algermissen
On 24.10.2013, at 15:13, Petter von Dolwitz (Hem) petter.von.dolw...@gmail.com wrote: You cannot use a part in a where clause unless you specify the preceeding parts also. But the statement SELECT * FROM mytable WHERE c='myvalue'; works? What are secondary indexes for then if you can't

Re: Problems using secondary index with IN keyword

2013-10-24 Thread Petter von Dolwitz (Hem)
I have defined the secondary index on a field that is part of the primary key. This should be ok. Maybe you missed the CREATE INDEX bit in my original post. I might end up not using secondary indexes but since the feature is there and I need the functionality I would like to know its limitations

what does nodetool compact command do for leveled compactions?

2013-10-24 Thread rash aroskar
Hi, I have a column family created with strategy of leveled compaction. If I execute nodetool compact command, will the columnfamily be compacted using size tiered compaction strategy? If yes, after the major size tiered compaction finishes will it at any point trigger leveled compaction back on

Re: what does nodetool compact command do for leveled compactions?

2013-10-24 Thread Robert Coli
On Thu, Oct 24, 2013 at 3:13 PM, rash aroskar rashmi.aros...@gmail.comwrote: I have a column family created with strategy of leveled compaction. If I execute nodetool compact command, will the columnfamily be compacted using size tiered compaction strategy? No. If yes, after the major

Re: Problems using secondary index with IN keyword

2013-10-24 Thread Jan Algermissen
On 24.10.2013, at 22:00, Petter von Dolwitz (Hem) petter.von.dolw...@gmail.com wrote: I have defined the secondary index on a field that is part of the primary key. This should be ok. Maybe you missed the CREATE INDEX bit in my original post. Yes I did - despite actually looking for it

Re: Problems using secondary index with IN keyword

2013-10-24 Thread Robert Coli
Before CASSANDRA-1337 [1] (Cassandra 2.1 line) secondary indexes + vnodes can have very slow performance due to the potentially large number of splits/nodes sequentially scanned. =Rob [1] https://issues.apache.org/jira/browse/CASSANDRA-1337

Re: what does nodetool compact command do for leveled compactions?

2013-10-24 Thread Jayadev Jayaraman
Thanks for the reply. I have one more question. If multiple columns with identical names but with different timestamps are bulk loaded (with sstableloader) into a CF, and we had LCS running in the background, would a slice predicate query retrieve multiple columns with the same name assuming

Re: what does nodetool compact command do for leveled compactions?

2013-10-24 Thread Robert Coli
On Thu, Oct 24, 2013 at 4:58 PM, Jayadev Jayaraman jdisal...@gmail.comwrote: Or do queries return only the columns with the most recent timestamp for each name regardless? (I would guess at the latter but I wanted to make sure) This. =Rob