RE: Version Upgrade

A related question: Is nodetool upgradesstables only necessary before you’re going to move major versions? I was under the impression that Cassandra N+1 could read the table format of Cassandra N. In other words, if I am running Cassandra 1.2.x and upgrading to 2.0.x, 2.0.x will continue to

Re: how to start a embed cassandra instance?

unit test on >> local,dont need to start a >> cassandra server. >> >> https://github.com/jsevellec/cassandra-unit this project is good,but the >> license is not suitable. >> how do you achieve this? >> >> thanks in advance >> >> ston

Re: automated CREATE TABLE just nuked my cluster after a 2.0 -> 2.1 upgrade....

gt;>> <https://plus.google.com/102718274791889610666/posts> >>>> >>>> >> >> >> -- >> We’re hiring if you know of any awesome Java Devops or Linux Operations >> Engineers! >> >> Founder/CEO Spinn3r.com >> Location

Re: automated CREATE TABLE just nuked my cluster after a 2.0 -> 2.1 upgrade....

gt; the plan is to use CAS. Until then we have to treat schema delicately. >> >> all the best, >> >> Sebastián >> On Feb 2, 2016 9:48 AM, "Ken Hancock" <ken.hanc...@schange.com> wrote: >> >>> So this rings odd to me. If you can accompli

Cassandra 1.2 & Compressed Data

We were running a contrived system test last week trying to measure the effect that compaction was having on our I/O and read performance. As a test, we set compaction throughput to 1MB/sec. As expected, we fell greatly behind and the number of SSTables grew. Unexpectedly, we went OOM. One of

Re: compaction_throughput_mb_per_sec

lack of clarity issue. On Mon, Jan 4, 2016 at 5:06 PM, Jeff Jirsa <jeff.ji...@crowdstrike.com> wrote: > Why do you think it’s cluster wide? That param is per-node, and you can > change it at runtime with nodetool (or via the JMX interface using jconsole > to ip:7199 ) > >

Re: compaction_throughput_mb_per_sec

ghput_mb_per_sec which refers to "across the entire system". node is the predominant term in the yaml configuration, though I can certainly see potential confusion with vnodes. On Tue, Jan 5, 2016 at 2:26 PM, Robert Coli <rc...@eventbrite.com> wrote: > On Tue, Jan 5, 201

Re: memtable flush size with LCS

Or if you're doing a high volume of writes, then your flushed file size may be completely determined by other CFs that have consumed the commitlog size, forcing any memtables whose commitlog is being delete to be forced to disk. On Wed, Oct 28, 2015 at 2:51 PM, Jeff Jirsa

Re: How to remove huge files with all expired data sooner?

On Mon, Sep 28, 2015 at 2:59 AM, Erick Ramirez wrote: > have many tables like this, and I'd like to reclaim those spaces sooner. > What would be the best way to do it? Should I run "nodetool compact" when I > see two large files that are 2 weeks old? Is there configuration

Re: How to run any application on Cassandra cluster in high availability mode

Off-topic to the Cassandra list, but corosync/pacemaker comes to mind for automatic service switchover between nodes. For monitoring and alerting, there's almost too many to mention... On Tue, Aug 18, 2015 at 2:45 PM, Vikram Kone vikramk...@gmail.com wrote: Hi John, I have posted the same

Re: nodetool getendpoints options

There is no difference. In #2, I'm guessing you're confusing using some of the column names as keys. You could also do getendpoints Mykeyspace Mytable 'foo' and Mykeyspace Mytable 'bar' getendpoints does not require any data in your column family to function; it only requires a schema for the

Re: Hundreds of sstables after every Repair

everything is in sync , why repair creates tiny sstables to repair data? Thanks Anuj Wadehra Sent from Yahoo Mail on Android https://overview.mail.yahoo.com/mobile/?.src=Android -- *From*:Ken Hancock ken.hanc...@schange.com *Date*:Tue, 9 Jun, 2015 at 8:24 pm *Subject

Re: Hundreds of sstables after every Repair

I think this came up recently in another thread. If you're getting large numbers of SSTables after repairs, that means that your nodes are diverging from the keys that they're supposed to be having. Likely you're dropping mutations. Do a nodetool tpstats on each of your nodes and look at the

Re: Multiple cassandra instances per physical node

, TX @zznate Co-Founder Sr. Technical Consultant Apache Cassandra Consulting http://www.thelastpickle.com -- *Ken Hancock *| System Architect, Advanced Advertising SeaChange International 50 Nagog Park Acton, Massachusetts 01720 ken.hanc...@schange.com | www.schange.com | NASDAQ:SEAC http

Re: Drop/Create table with same CF Name

Nate, how does this get around the issue? I'm guessing that just extends the timeout, but if I had a server failure such that the server was down for a couple hours, truncate would still have issues? On Sat, May 23, 2015 at 5:46 PM, Nate McCall n...@thelastpickle.com wrote: Truncate would

Re: Drop/Create table with same CF Name

share the content on this link please, I’m aware of issues where recreating key spaces can cause inconsistency in 2.0.13 if memTables are not flushed beforehand , is this the issues that is resolved? *From:* Ken Hancock [mailto:ken.hanc...@schange.com] *Sent:* 21 May 2015 17:13 *To:* user

Re: Drop/Create table with same CF Name

beforehand , is this the issues that is resolved? *From:* Ken Hancock [mailto:ken.hanc...@schange.com] *Sent:* 21 May 2015 17:13 *To:* user@cassandra.apache.org *Subject:* Re: Drop/Create table with same CF Name Thanks Mark (though that article doesn't appear publicly accessible

Re: Disabling auto snapshots

Is there any method to disable this programmatically on a table-by-table basis. I'm running into an issue regarding drop table which I'll post in a separate thread. On Thu, May 21, 2015 at 3:34 AM, Mark Reddy mark.l.re...@gmail.com wrote: To disable auto snapshots, set the property

Drop/Create table with same CF Name

We've been running into the reused key cache issue (CASSANDRA-5202) with dropping and recreating the same table in Cassandra 1.2.18 so we've been testing with key caches disabled which does not seem to solve the issue. In the latest logs it seems that old SSTables metadata gets read after the

Re: Drop/Create table with same CF Name

-than-2-1 Mark On 21 May 2015 at 15:31, Ken Hancock ken.hanc...@schange.com wrote: We've been running into the reused key cache issue (CASSANDRA-5202) with dropping and recreating the same table in Cassandra 1.2.18 so we've been testing with key caches disabled which does not seem to solve

Re: Updating only modified records (where lastModified current date)

While updates don't create tombstones, overwrites create a similar performance penalty at the read phase. That key will need to be fetched from every SSTable where it resides so the most recent column can be returned. On Wed, May 13, 2015 at 6:38 AM, Peer, Oded oded.p...@rsa.com wrote: You

Re: Why select returns tombstoned results?

in cqlsh, the deleted rows won't show up. How can I fix this? -- *Ken Hancock *| System Architect, Advanced Advertising SeaChange International 50 Nagog Park Acton, Massachusetts 01720 ken.hanc...@schange.com | www.schange.com | NASDAQ:SEAC http://www.schange.com/en-US/Company

Re: Are Triggers in Cassandra 2.1.2 performace Hog??

When last I looked at Datastax Enterprise (DSE 3.0ish), it exhibits the same problem that you highlight, no different than your good idea of asynchronously pushing to ES. Each Cassandra write was indexed independently by each server in the replication group. If a node timed out or a mutation was

Re: 答复:

and transactional backbone of choice for the worlds most innovative companies such as Netflix, Adobe, Intuit, and eBay. -- *Ken Hancock *| System Architect, Advanced Advertising SeaChange International 50 Nagog Park Acton, Massachusetts 01720 ken.hanc...@schange.com | www.schange.com | NASDAQ:SEAC

Re: Practical use of counters in the industry

Cassandra counters practically. Thanks in advance. Regards, Rajath Rajath Subramanyam -- *Ken Hancock *| System Architect, Advanced Advertising SeaChange International 50 Nagog Park Acton, Massachusetts 01720 ken.hanc...@schange.com | www.schange.com | NASDAQ:SEAC

Re: opscenter with community cassandra

. You can use OpsCenter community in production (however you'd like). -- Tyler Hobbs DataStax http://datastax.com/ -- *Ken Hancock *| System Architect, Advanced Advertising SeaChange International 50 Nagog Park Acton, Massachusetts 01720 ken.hanc...@schange.com | www.schange.com | NASDAQ:SEAC

Re: disk space issue

? Do you have any other suggestions? Best Regards, Cem. -- Dominic Letz Director of RD Exosite http://exosite.com -- *Ken Hancock *| System Architect, Advanced Advertising SeaChange International 50 Nagog Park Acton, Massachusetts 01720 ken.hanc...@schange.com | www.schange.com

Re: Repair taking long time

On Mon, Sep 29, 2014 at 2:29 PM, Robert Coli rc...@eventbrite.com wrote: As an aside, you just lose with vnodes and clusters of the size. I presume you plan to grow over appx 9 nodes per DC, in which case you probably do want vnodes enabled. I typically only see discussion on vnodes vs.

Re: Quickly loading C* dataset into memory (row cache)

Chan tofuda...@gmail.com wrote: What are you referring to when you say memory store? RAM disk? memcached? In 2014, probably Redis? =Rob -- *Ken Hancock *| System Architect, Advanced Advertising SeaChange International 50 Nagog Park Acton, Massachusetts 01720 ken.hanc...@schange.com

Re: Counters: consistency, atomic batch

groups email astyanax-cassandra-cli...@googlegroups.com but didn't receive any answers. -- Best regards, Eugene Voytitsky -- *Ken Hancock *| System Architect, Advanced Advertising SeaChange International 50 Nagog Park Acton, Massachusetts 01720 ken.hanc...@schange.com | www.schange.com

Re: Migration from Cassandra 1.2.5 to Cassandra 2.0.8 with changed partitioner settings

-apache-org.3065146.n2.nabble.com/Migra tion-from-Cassandra-1-2-5-to-Cassandra-2-0-8-with-changed-partitioner- settings-tp7596019p7596062.html Sent from the cassandra-u...@incubator.apache.org mailing list archive at Nabble.com. -- *Ken Hancock *| System Architect, Advanced Advertising

Re: Decommissioning a datacenter deletes the data (on decommissioned datacenter)

- is this correct ? =Rob -- *Ken Hancock *| System Architect, Advanced Advertising SeaChange International 50 Nagog Park Acton, Massachusetts 01720 ken.hanc...@schange.com | www.schange.com | NASDAQ:SEAC http://www.schange.com/en-US/Company/InvestorRelations.aspx Office: +1 (978) 889-3329 | [image

Re: data type is object when metric instrument using Gauge?

...etc? Thanks a lot for any suggestion! Best Regard! Mike -- Patricia Gorla @patriciagorla Consultant Apache Cassandra Consulting http://www.thelastpickle.com http://thelastpickle.com -- *Ken Hancock *| System Architect, Advanced Advertising SeaChange International 50

Re: Multi-column range scans

the application. We have a solution working in Oracle, but would like to store this data in Cassandra, as all the other data that this solution relies on already sits within Cassandra. Appreciate any guidance on this matter. Matt -- *Ken Hancock *| System Architect, Advanced

Re: Controlling system.log rotation

I think this essentially boils down the issue: https://issues.apache.org/bugzilla/show_bug.cgi?id=40407 Seems the best way would be to change the umask for user cassandra: http://stackoverflow.com/questions/7893511/permissions-on-log-files-created-by-log4j-rollingfileappender Ken On Mon, Jul

Re: Large SSTable not compacted with size tiered compaction

if any drawbacks are there to increasing the bucket_high property? In what scenarios could I wind up with such a disproportionately large SSTable like this? One thing that comes to mind is major compactions, but I have not that. - John -- *Ken Hancock *| System Architect, Advanced

Re: nodetool repair -snapshot option?

in 2.0.2? =Rob -- *Paulo Motta* Chaordic | *Platform* *www.chaordic.com.br http://www.chaordic.com.br/* +55 48 3232.3200 -- *Ken Hancock *| System Architect, Advanced Advertising SeaChange International 50 Nagog Park Acton, Massachusetts 01720 ken.hanc...@schange.com

Re: RPC timeout paging secondary index query results

You didn't post any timings, only when it started failing so it's unclear whether performance is dropping off or scaling in some sort of linear or non-linear fashion. Second the recommendation to do some traces which should be much more telling. On Fri, Jun 13, 2014 at 3:34 AM, Phil Luckhurst

Re: tracing thrift queries?

. Tracing them should help iron down whats happening. Kevin -- Founder/CEO Spinn3r.com Location: *San Francisco, CA* blog: http://burtonator.wordpress.com … or check out my Google+ profile https://plus.google.com/102718274791889610666/posts http://spinn3r.com -- *Ken Hancock

Re: Minimum Cluster size to accommodate a single node failure

Another nice resource... http://www.ecyrd.com/cassandracalculator/

Re: Configuring all nodes as seeds

Amen. I believe the whole seed node/bootstrapping confusion goes against the Why Cassandra, quoted from http://www.datastax.com/what-we-offer/products-services/datastax-enterprise/apache-cassandra *Operational simplicity* – with all nodes in a cluster being the same, there is no complex

Re: Cassanda JVM GC defaults question

GC interference and will impact write performance. If you're not sensitive to this impact, your expectation is correct, however make sure your flush_largest_memtables_at is always set to less than or equal to the occupancy fraction. On 4/23/14, Ken Hancock ken.hanc...@schange.com wrote: I'm

Cassanda JVM GC defaults question

I'm in the process of trying to tune the GC and I'm far from an expert in this area, so hoping someone can tell me I'm either out in left field or on-track. Cassandra's default GC settings are (abbreviated): +UseConcMarkSweepGC +CMSInitiaitingOccupancyFraction=75 +UseCMSInitiatingOccupancyOnly

Re: Bootstrap Timing

more than one node at a time to a cluster (especially with vnodes) is Not Supported. If I were you, I would stop all 3 bootstraps and then do one at a time. =Rob -- *Ken Hancock *| System Architect, Advanced Advertising SeaChange International 50 Nagog Park Acton, Massachusetts 01720

Re: Replication Factor question

Keep in mind if you lose the wrong two, you can't satisfy quorum. In a 5-node cluster with RF=3, it would be impossible to lose 2 nodes without affecting quorum for at least some of your data. In a 6 node cluster, once you've lost one node, if you were to lose another, you only have a 1-in-5

Re: Intermittent long application pauses on nodes

My searching my list archives shows this thread evaporated. Was a root cause ever found? Very curious. On Mon, Feb 3, 2014 at 11:52 AM, Benedict Elliott Smith belliottsm...@datastax.com wrote: Hi Frank, The 9391 under RevokeBias is the number of milliseconds spent synchronising on the

Re: Update SSTable fragmentation

implications for space as a trade off. Wayne -- *Ken Hancock *| System Architect, Advanced Advertising SeaChange International 50 Nagog Park Acton, Massachusetts 01720 ken.hanc...@schange.com | www.schange.com | NASDAQ:SEAChttp://www.schange.com/en-US/Company/InvestorRelations.aspx Office: +1 (978

Re: Installing Datastax Cassandra 1.2.15 Using Yum (Java Issue)

On Thu, Mar 27, 2014 at 4:53 PM, Jon Forrest jon.forr...@xoom.com wrote: It would be great to know the origin of this issue. See http://www.rudder-project.org/redmine/issues/2941 for the mess that has been created regarding java JRE dependencies. Ken

Re: Cassandra DSC 2.0.5 not starting - * could not access pidfile for Cassandra

/cassandra/install/ installJreDeb.html -- Kind regards, Michael -- *Ken Hancock *| System Architect, Advanced Advertising SeaChange International 50 Nagog Park Acton, Massachusetts 01720 ken.hanc...@schange.com | www.schange.com | NASDAQ:SEAChttp://www.schange.com/en-US/Company

Re: Weird timeouts

have any ideas? -- *Ken Hancock *| System Architect, Advanced Advertising SeaChange International 50 Nagog Park Acton, Massachusetts 01720 ken.hanc...@schange.com | www.schange.com | NASDAQ:SEAChttp://www.schange.com/en-US/Company/InvestorRelations.aspx Office: +1 (978) 889-3329 | [image

Re: Compaction does not remove tombstones if column has higher TTL

that get much larger (against a map column type). So be warned, mixing TTLs in a row does not appear to result in the data being compacted away. Thanks -- *Ken Hancock *| System Architect, Advanced Advertising SeaChange International 50 Nagog Park Acton, Massachusetts 01720 ken.hanc

Cassandra-cli and Composite columns

I've been trying to do some simple data modeling and since we're currently using Hector have been doing that modeling with cassandra-cli and running into issues with CompositeType columns. If I do a help set, I see: The help for create column family shows: create column family UseComposites

Re: Opscenter tabs

, but change the opscenter tabs to DC1, DC2, and DC3. Is this documented somewhere? -- Daniel Curry Sr Linux Systems Administrator Arrayent, Inc. 2317 Broadway Street, Suite 20 Redwood City, CA 94063 dan...@arrayent.com -- *Ken Hancock *| System Architect, Advanced Advertising SeaChange

Re: MUTATION messages dropped

indicated. Here they are: node1 6498 node2 6476 node3 6642 I guess this is not good :) What can we do to fix this problem? 2013/12/19 Ken Hancock ken.hanc...@schange.com We had issues where the number of CF families that were being flushed would align and then block writes

Re: Rowcache and quorum reads cassandra

is this still correct with quorum reads? How does cassandra handle row-cache hits in combination with quorum reads? Thanks! -- artur -- *Ken Hancock *| System Architect, Advanced Advertising SeaChange International 50 Nagog Park Acton, Massachusetts 01720 ken.hanc...@schange.com

Re: Rowcache and quorum reads cassandra

and all 3 fill up the row cache with the same data that would make my cache requirements bigger. Thanks! Artur On 10/10/13 14:06, Ken Hancock wrote: If you're hitting 3/5 nodes, it sounds like you've set your replication factor to 5. Is that what you're doing so you can have a 2-node

Re: Among Datastax community Cassandra debian package, which to choose for production install ?

is usually preferred for production installs ? I may need to use Opscenter but just *occasionally*. -- *Ken Hancock *| System Architect, Advanced Advertising SeaChange International 50 Nagog Park Acton, Massachusetts 01720 ken.hanc...@schange.com | www.schange.com | NASDAQ:SEAChttp

Re: Why Solandra stores Solr data in Cassandra ? Isn't solr complete solution ?

scale, is a single point of failure. The value add of DES is that the index has the same availability characteristics as the underlying data, because it is stored in the same cluster. =Rob -- *Ken Hancock *| System Architect, Advanced Advertising SeaChange International 50 Nagog Park Acton

Re: Why Solandra stores Solr data in Cassandra ? Isn't solr complete solution ?

will be inconsistent with other nodes in its replication group. Will repair fix it? -- *Ken Hancock *| System Architect, Advanced Advertising SeaChange International 50 Nagog Park Acton, Massachusetts 01720 ken.hanc...@schange.com | www.schange.com | NASDAQ:SEAChttp://www.schange.com/en-US

Re: Memtable flush blocking writes

, Sep 23, 2013 at 6:03 PM, Robert Coli rc...@eventbrite.com wrote: On Fri, Aug 23, 2013 at 10:35 AM, Ken Hancock ken.hanc...@schange.comwrote: I appear to have a problem illustrated by https://issues.apache.org/jira/browse/CASSANDRA-1955. At low data rates, I'm seeing mutation messages dropped

Re: cassandra just gone..no heap dump, no log info

, The Rocks NSW 2000 PO Box H58, Australia Square, Sydney NSW 1215 -- *Juan Manuel Formoso *Senior Geek http://twitter.com/juanformoso http://seniorgeek.com.ar LLAP -- *Ken Hancock *| System Architect, Advanced Advertising SeaChange International 50 Nagog Park Acton, Massachusetts 01720

Re: Flush writer all time blocked

On Thu, Aug 29, 2013 at 1:57 PM, Robert Coli rc...@eventbrite.com wrote: On Thu, Aug 29, 2013 at 10:49 AM, S C as...@outlook.com wrote: I see a high count All time blocked for Flush Writer on nodetool tpstats. Is it how many blocked ever since the server was online? Can somebody explain me

Re: Flush writer all time blocked

last week on this topic but didn't get any responses -- I'm very interested in this topic as I've had to set my queue size fairly large to avoid this issue. Ken -- Ken Hancock | System Architect, Advanced Advertising SeaChange International 50 Nagog Park Acton, Massachusetts 01720 ken.hanc

Memtable flush blocking writes

I appear to have a problem illustrated by https://issues.apache.org/jira/browse/CASSANDRA-1955. At low data rates, I'm seeing mutation messages dropped because writers are blocked as I get a storm of memtables being flushed. OpsCenter memtables seem to also contribute to this: INFO