Cassandra on Window with SCOM running

2015-01-14 Thread Alaa Zubaidi (PDF)
Hi,
We are running an Old version of Cassandra 0.7.4 on Windows
At one point, the average read times is 2.1 seconds when SCOM (System
Center Operation Manager) is running, and 0.04 seconds when its disabled.

The problem is we CANNOT disable SCOM on these Windows VMs.
Any have seen this before? experience with SCOM in this situations?
any comments of feedback that could help us improve the performance while
this process is running?
Other than upgrading Cassandra to the latest (we know this is an option but
its NOT doable at this point).

Thanks and Regards,
Alaa

-- 
*This message may contain confidential and privileged information. If it 
has been sent to you in error, please reply to advise the sender of the 
error and then immediately permanently delete it and all attachments to it 
from your systems. If you are not the intended recipient, do not read, 
copy, disclose or otherwise use this message or any attachments to it. The 
sender disclaims any liability for such unauthorized use. PLEASE NOTE that 
all incoming e-mails sent to PDF e-mail accounts will be archived and may 
be scanned by us and/or by external service providers to detect and prevent 
threats to our systems, investigate illegal or inappropriate behavior, 
and/or eliminate unsolicited promotional e-mails (“spam”). If you have any 
concerns about this process, please contact us at *
*legal.departm...@pdf.com* legal.departm...@pdf.com*.*


create index on column of user defined type?

2015-01-14 Thread Mulert, Bill
Although I have not seen any documentation that says one cannot do this, 
version 2.1.2 is complaining about defining one.

CREATE TYPE wdm.thing (
   thing_name text,
...

CREATE TABLE wdm.ctins (
   foo_no text,
   itemfrozenthing,
   ...


CREATE INDEX foo ON wdm.gtins(item.thing_name);

Is there something I'm missing or is this truly disallowed?





This e-mail message, including any attachments, is for the sole use of the 
intended recipient(s) and may contain information that is confidential and 
protected by law from unauthorized disclosure. Any unauthorized review, use, 
disclosure or distribution is prohibited. If you are not the intended 
recipient, please contact the sender by reply e-mail and destroy all copies of 
the original message.


Re: create index on column of user defined type?

2015-01-14 Thread Michael Shuler

On 01/14/2015 02:49 PM, Mulert, Bill wrote:

Although I have not seen any documentation that says one cannot do this,
version 2.1.2 is complaining about defining one.

CREATE TYPE wdm.thing (

thing_name _text_,

 …

CREATE TABLE wdm.ctins (

foo_no text,

_item_frozen_thing_,

...

CREATE INDEX foo ON wdm.gtins(item.thing_name);

Is there something I’m missing or is this truly disallowed?


I believe this is planned for 3.0.

  https://issues.apache.org/jira/browse/CASSANDRA-6382

--
Michael


Schema changes: where in Java code are they sent?

2015-01-14 Thread Richard Dawe
Hello,

I’m doing some research on schema migrations for Cassandra.

I’ve been playing with cqlsh with TRACING ON, and I can see that a schema 
change like “CREATE TABLE” is sent to all nodes in the cluster. And also that 
“CREATE TABLE” fails if only one of my three nodes is up (with replication 
factor = 3).

I’ve been trying to find the Java code where the schema migration is sent to 
the other nodes in the cluster, to understand what the requirements are for 
successfully applying the update. E.g.: is QUORUM consistency level applied?

I spent an hour looking through the Java code last night, with no luck. I 
thought this code would be in StorageProxy.java, but I have not found it there, 
or in any of the other classes I looked at.

Any pointers would be appreciated.

Thanks, best regards, Rich



Re: Schema changes: where in Java code are they sent?

2015-01-14 Thread Tyler Hobbs
On Wed, Jan 14, 2015 at 5:13 PM, Richard Dawe rich.d...@messagesystems.com
wrote:


  I’ve been trying to find the Java code where the schema migration is
 sent to the other nodes in the cluster, to understand what the requirements
 are for successfully applying the update. E.g.: is QUORUM consistency level
 applied?


A quorum isn't required.  Schema changes are simply applied against the
local node (whichever node the client sends the query to) and then are
pushed out to the other nodes.  Nodes will also pull the latest schema from
other nodes as needed (for example, if a node was down during a schema
change).



  I spent an hour looking through the Java code last night, with no luck.
 I thought this code would be in StorageProxy.java, but I have not found it
 there, or in any of the other classes I looked at.


MigrationManager is probably the most central class for this stuff.


-- 
Tyler Hobbs
DataStax http://datastax.com/


Re: Tracing On, Partion Index 0 entries found

2015-01-14 Thread nitin padalia
Thanks! Tyler.
So how does it affects seeking operation?
I've seen for stables having some entries, next operation of seeking to
data file take lesser time however when entry is 0 it takes few
milliseconds..
On Jan 14, 2015 11:18 PM, Tyler Hobbs ty...@datastax.com wrote:

 It's referring to an index of the cells within the partition (in a single
 sstable).  It can have zero entries when there are very few cells in the
 partition.

 On Wed, Jan 14, 2015 at 5:48 AM, nitin padalia padalia.ni...@gmail.com
 wrote:

 Hi,

 While Tracing is on, we see a trace message,
 Partition index with X entries found for sstable Y

 What does it actually means?

 Does it mean in 'Partion Index' file has X partion key:offset entries
 for SSTable Y? If so then when could X be 0?

 --
 Nitin Padalia




 --
 Tyler Hobbs
 DataStax http://datastax.com/



Script to count tombstones by partition key

2015-01-14 Thread Jens Rantil
Hi all


I just recently put together a small script to count the number of tombstones 
grouped by partition id, for one or multiple sstables:


https://gist.github.com/JensRantil/063b7c56ca4a8dfe1c50



I needed this for debugging purposes and thought I’d share it with you guys in 
case anyone is interested.


Cheers,
Jens

———
Jens Rantil
Backend engineer
Tink AB

Email: jens.ran...@tink.se
Phone: +46 708 84 18 32
Web: www.tink.se

Facebook Linkedin Twitter

Re: Script to count tombstones by partition key

2015-01-14 Thread DuyHai Doan
Nice, thanks Jens

On Wed, Jan 14, 2015 at 4:21 PM, Jens Rantil jens.ran...@tink.se wrote:

  Hi all

 I just recently put together a small script to count the number of
 tombstones grouped by partition id, for one or multiple sstables:

 https://gist.github.com/JensRantil/063b7c56ca4a8dfe1c50

 I needed this for debugging purposes and thought I’d share it with you
 guys in case anyone is interested.

 Cheers,
 Jens

 ——— Jens Rantil Backend engineer Tink AB Email: jens.ran...@tink.se
 Phone: +46 708 84 18 32 Web: www.tink.se Facebook Linkedin Twitter



Re: Tracing On, Partion Index 0 entries found

2015-01-14 Thread Tyler Hobbs
It's referring to an index of the cells within the partition (in a single
sstable).  It can have zero entries when there are very few cells in the
partition.

On Wed, Jan 14, 2015 at 5:48 AM, nitin padalia padalia.ni...@gmail.com
wrote:

 Hi,

 While Tracing is on, we see a trace message,
 Partition index with X entries found for sstable Y

 What does it actually means?

 Does it mean in 'Partion Index' file has X partion key:offset entries
 for SSTable Y? If so then when could X be 0?

 --
 Nitin Padalia




-- 
Tyler Hobbs
DataStax http://datastax.com/


Re: Script to count tombstones by partition key

2015-01-14 Thread Robert Coli
On Wed, Jan 14, 2015 at 7:21 AM, Jens Rantil jens.ran...@tink.se wrote:

  I just recently put together a small script to count the number of
 tombstones grouped by partition id, for one or multiple sstables:


https://github.com/cloudian/support-tools

Has checksstablegarbage which does a similar thing without requiring the
sstable2json step, which is likely to be faster overall.

=Rob


YNT: Storing PDF data on Cassandra db

2015-01-14 Thread DENIZ
Hi ,
I have checked http://cassandra.apache.org The latest release is 2.1.2 .Do you 
know when will The 3.0 release be available?

Thanks in advance

-Orijinal İleti-
Kimden: Jonathan Haddad j...@jonhaddad.com
Gönderme tarihi: ‎13.‎1.‎2015 16:26
Kime: user@cassandra.apache.org user@cassandra.apache.org
Konu: Re: Storing PDF data on Cassandra db

For a new user, there's no point in learning Thrift if that user intends on 
upgrading past the version that they start with.  Thrift is a deprecated 
protocol and there's no new functionality going into it.  In 3.0 the sstable 
format is being upgraded to work primarily with native CQL partitions / rows 
and have a translation layer to work with thrift for compatibility.



If you're simply storing k-v there's no reason (or advantage) to thrift over 
CQL.


CREATE TABLE pdf ( pdf_id uuid primary key, content blob );


will work just fine.  Adding additional fields as the system changes is 
convenient and works with any tool that reads CQL and won't require custom 
deserialization or any other nonsense.  


Jon


On Tue Jan 13 2015 at 6:14:10 AM Peter Lin wool...@gmail.com wrote:



you want to store the raw bytes, so look at examples for saving raw bytes.


I generally recommend using Thrift if you're going to do a lot of read/write of 
binary data. CQL is good for primitive types, and maps/lists of primitive 
types. I'm bias, but it's simpler and easier to use thrift for storing file 
attachments.



On Tue, Jan 13, 2015 at 8:58 AM, DENIZ nilgree...@gmail.com wrote:

Hi All,

I want to store PDF documents on Cassandra db.What is the best way to store 
this type of data on Cassandra.How can I insert and select PDF file to the 
database.If possible can you explain with sample CQL statements

Thanks in Advance
Nil

Tracing On, Partion Index 0 entries found

2015-01-14 Thread nitin padalia
Hi,

While Tracing is on, we see a trace message,
Partition index with X entries found for sstable Y

What does it actually means?

Does it mean in 'Partion Index' file has X partion key:offset entries
for SSTable Y? If so then when could X be 0?

-- 
Nitin Padalia