Re: COPY command to export a table to CSV file

2015-04-20 Thread Sebastian Estevez
Try Brian's cassandra-unloader https://github.com/brianmhess/cassandra-loader#cassandra-unloader All the best, [image: datastax_logo.png] http://www.datastax.com/ Sebastián Estévez Solutions Architect | 954 905 8615 | sebastian.este...@datastax.com [image: linkedin.png]

Re: timeout creating table

2015-04-20 Thread Sebastian Estevez
Can you grep for GCInspector in your system.log? Maybe you have long GC pauses. All the best, [image: datastax_logo.png] http://www.datastax.com/ Sebastián Estévez Solutions Architect | 954 905 8615 | sebastian.este...@datastax.com [image: linkedin.png]

Re: COPY command to export a table to CSV file

2015-04-20 Thread Sebastian Estevez
? 2015-04-20 23:43 GMT+02:00 Sebastian Estevez sebastian.este...@datastax.com: Try Brian's cassandra-unloader https://github.com/brianmhess/cassandra-loader#cassandra-unloader All the best, [image: datastax_logo.png] http://www.datastax.com/ Sebastián Estévez Solutions Architect | 954

Re: What is 'Read Reuqests' on OpsCenter exaclty?

2015-04-23 Thread Sebastian Estevez
Carlos is right: *Read Requests* - The number of read requests per second on the coordinator nodes, analogous to client reads. Monitoring the number of requests over a given time period reveals system read workload and usage patterns. *Avg* - The average of values recorded during a time

Re: timeout creating table

2015-04-23 Thread Sebastian Estevez
normal given that our unit tests are doing lot of droping keyspace and creating keyspace/tables. I read the MigrationStage thread pool is default to one, so wondering if that could be a reason it may be doing something that block others? On Mon, Apr 20, 2015 at 2:40 PM, Sebastian Estevez

Re: Adding nodes to existing cluster

2015-04-20 Thread Sebastian Estevez
The documentation is referring to Consistent Range Movements. There is a change in 2.1 that won't allow you to bootstrap multiple nodes at the same time unless you explicitly turn off consistent range movements. Check out the jira: https://issues.apache.org/jira/browse/CASSANDRA-2434 All the

Re: LCS Strategy, compaction pending tasks keep increasing

2015-04-21 Thread Sebastian Estevez
Node licensing is more appropriate for this century. ​ -- Brice On Tue, Apr 21, 2015 at 11:19 PM, Sebastian Estevez sebastian.este...@datastax.com wrote: Do not enable multithreaded compaction. Overhead usually outweighs any benefit. It's removed in 2.1 because it harms more than helps

Re: LCS Strategy, compaction pending tasks keep increasing

2015-04-21 Thread Sebastian Estevez
Do not enable multithreaded compaction. Overhead usually outweighs any benefit. It's removed in 2.1 because it harms more than helps: https://issues.apache.org/jira/browse/CASSANDRA-6142 All the best, [image: datastax_logo.png] http://www.datastax.com/ Sebastián Estévez Solutions Architect |

Re: cassandra and spark from cloudera distirbution

2015-04-22 Thread Sebastian Estevez
There is no supported way to replace the embedded spark that comes in DSE with something else. However you could probably read or write from/to DSE / Cassandra from a cloudera spark cluster using the open source DataStax connector. Are you looking for a particular feature that is not available in

Re: cassandra and spark from cloudera distirbution

2015-04-22 Thread Sebastian Estevez
Sheypak serega.shey...@gmail.com wrote: What is embedded spark? Where can I read about it? Right now we just install spark 1.2 built fro hadoop 2.4 and use it to query data from cassandra. 2015-04-22 19:56 GMT+02:00 Sebastian Estevez sebastian.este...@datastax.com: There is no supported way

Re: Tracking ETA and % complete in nodetool netstats during a decommission ?

2015-05-08 Thread Sebastian Estevez
Not precisely, but you can estimate based on the streaming jobs in nodetool netstats. All the best, [image: datastax_logo.png] http://www.datastax.com/ Sebastián Estévez Solutions Architect | 954 905 8615 | sebastian.este...@datastax.com [image: linkedin.png]

Re: How to stop nodetool repair in 2.1.2?

2015-04-15 Thread Sebastian Estevez
nodetool stop *VALIDATION* On Apr 15, 2015 5:16 PM, Benyi Wang bewang.t...@gmail.com wrote: I ran nodetool repair -- keyspace table for a table, and it is still running after 4 days. I knew there is an issue for repair with vnodes https://issues.apache.org/jira/browse/CASSANDRA-5220. My

Re: hi error in importing the csv file to cassandra

2015-04-11 Thread Sebastian Estevez
Is that an error with the copy command? Give this loader a try. It's pretty user friendly: https://github.com/brianmhess/cassandra-loader All the best, [image: datastax_logo.png] http://www.datastax.com/ Sebastián Estévez Solutions Architect | 954 905 8615 | sebastian.este...@datastax.com

Re: Drawbacks of Major Compaction now that Automatic Tombstone Compaction Exists

2015-04-12 Thread Sebastian Estevez
Have you tried user defined compactions via JMX? On Apr 12, 2015 1:40 PM, Anuj Wadehra anujw_2...@yahoo.co.in wrote: Recently we faced an issue where every repair operation caused addition of hundreds of sstables (CASSANDRA-9146). In order to bring situation under control and make sure reads

Re: cqlsh commands for importing .CSV files into cassandra

2015-04-09 Thread Sebastian Estevez
Try this loader if cqlsh doesn't cut your needs -- https://github.com/brianmhess/cassandra-loader All the best, [image: datastax_logo.png] http://www.datastax.com/ Sebastián Estévez Solutions Architect | 954 905 8615 | sebastian.este...@datastax.com [image: linkedin.png]

Re: Reading too many tombstones

2015-06-04 Thread Sebastian Estevez
Check out the compaction subproperties for tombstones. http://docs.datastax.com/en/cql/3.1/cql/cql_reference/compactSubprop.html?scroll=compactSubprop__compactionSubpropertiesDTCS On Jun 4, 2015 1:29 PM, Aiman Parvaiz ai...@flipagram.com wrote: Thanks Carlos for pointing me in that direction, I

Re: sstableloader usage doubts

2015-06-04 Thread Sebastian Estevez
You don't need sstable loader if your topology hasn't changed and you have all your sstables backed up for each node. SStableloader actually streams data to all the nodes in a ring (this is what OpsCenter backup restore does). So you can actually restore to a larger or smaller cluster or a cluster

Re: sstableloader usage doubts

2015-06-05 Thread Sebastian Estevez
Since you only restored one dc's sstables, you should be able to rebuild them on the second DC. Refresh means pick up new SSTables that have been directly added to the data directory. Rebuild means stream data from other replicas to re create SSTables from scratch. On Jun 5, 2015 6:40 AM,

Re: CQL collections and Solr dynamic fields

2015-06-22 Thread Sebastian Estevez
Quick clarification, collections are implemented as dynamic fields in DSE (not multivalued fields). Fields that are both dynamic and multivalued are not supported, therefore, you cannot use multivalued fields for collections. All the best, [image: datastax_logo.png] http://www.datastax.com/

Re: CQL collections and Solr dynamic fields

2015-06-22 Thread Sebastian Estevez
PM, Sebastian Estevez sebastian.este...@datastax.com wrote: Quick clarification, collections are implemented as dynamic fields in DSE (not multivalued fields). Fields that are both dynamic and multivalued are not supported, therefore, you cannot use multivalued fields for collections. All

Re: Tuning Cassandra 2.1 for High Writes and Immediate Reads

2015-06-16 Thread Sebastian Estevez
If you use clustering order by and need to keep the top rows in cache, look at the row cache in 2.1. http://www.datastax.com/dev/blog/row-caching-in-cassandra-2-1 On Jun 16, 2015 5:39 AM, Pracheer Agarwal pracheeragar...@gmail.com wrote: Hi, We are evaluating Cassandra 2.1 for our new

Re: Lucene index plugin for Apache Cassandra

2015-06-16 Thread Sebastian Estevez
I understood that running Spark and Solr in the same data center was not possible. It was always possible, just not supported. This changed in 4.7, see the docs: http://docs.datastax.com/en/datastax_enterprise/4.7/datastax_enterprise/ana/dseSearchAnalyticsOverview.html All the best,

Re: Connection reset during repair service

2015-06-17 Thread Sebastian Estevez
Do you do a ton of random updates amd deletes? That would not be a good workload for DTCS. Where are all your tombstones coming from? On Jun 17, 2015 3:43 AM, Alain RODRIGUEZ arodr...@gmail.com wrote: Hi David, Edouard, Depending on your data model on event_data, you might want to consider

Re: Seed Node OOM

2015-06-13 Thread Sebastian Estevez
The commitlog size is likely a red herring. In 2.0 we had 1gb commitlogs by default. In 2.1 we have 8gb commitlogs by default. This is configurable at the yaml. Not sure what's causing the OOM. Did it generate an hprof file you can analyze? On Jun 13, 2015 7:42 AM, Oleksandr Petrov

Re: Spark SQL JDBC Server + DSE

2015-06-01 Thread Sebastian Estevez
Have you looked at job server? https://github.com/spark-jobserver/spark-jobserver https://www.youtube.com/watch?v=8k9ToZ4m6os http://planetcassandra.org/blog/post/fast-spark-queries-on-in-memory-datasets/ All the best, [image: datastax_logo.png] http://www.datastax.com/ Sebastián Estévez

Re: High load on cassandra node

2015-07-01 Thread Sebastian Estevez
Looks like a CASSANDRA-6405 (replicate on write is the counter tp). Upgrade to the latest 2.1 version and let us know if he situation improves. Major compactions are usually a bad idea by the way. Do you really want one huge sstable? On Jul 1, 2015 10:03 AM, Jayapandian Ponraj

Re: Migrate table data to another table

2015-07-01 Thread Sebastian Estevez
? 30 Haz 2015 Sal, 20:31 tarihinde, Sebastian Estevez sebastian.este...@datastax.com şunu yazdı: Another option is Brian's cassandra loader: https://github.com/brianmhess/cassandra-loader All the best, [image: datastax_logo.png] http://www.datastax.com/ Sebastián Estévez Solutions

Re: joining a node caused loads on some existing nodes to skyrocket

2015-07-03 Thread Sebastian Estevez
Hi KZ, We're you monitoring tpstats and netstats during the bootstrap? This could give us some more information. Your logs look a little like 8318 but there would have to be another error earlier in the logs and the ticket is for a node replacement not a fresh bootstrap... Can you check for an

Re: Decommissioned node still in Gossip

2015-07-03 Thread Sebastian Estevez
Is the ghost node in your system.peers on any node? Check every node (since it's local strategy). Otherwise the nodes must be in the endpoint list in memory and you'll have to rolling restart. Make sure you drain though before the rolling restart since it may be in your commit log somewhere too.

Re: Multiple cassandra instances per physical node

2015-05-21 Thread Sebastian Estevez
JBOD -- just a bunch of disks, no raid. All the best, [image: datastax_logo.png] http://www.datastax.com/ Sebastián Estévez Solutions Architect | 954 905 8615 | sebastian.este...@datastax.com [image: linkedin.png] https://www.linkedin.com/company/datastax [image: facebook.png]

Re: Performance penalty of multiple UPDATEs of non-pk columns

2015-05-21 Thread Sebastian Estevez
Counters differ significantly between 2.0 and 2.1 ( https://issues.apache.org/jira/browse/CASSANDRA-6405 among others). But in both scenarios, you will pay more for counter reconciles and compactions vs. regular updates. The final counter performance fix will come with CASSANDRA-6506. For

Re: Normal to have an 8g commit log?

2015-05-22 Thread Sebastian Estevez
Yes. 2.1 commitlogs are 8gb. 2.0 were 1gb. you can configure this in the yaml. http://docs.datastax.com/en/cassandra/1.2/cassandra/configuration/configCassandra_yaml_r.html?scroll=reference_ds_qfg_n1r_1k__commitlog_segment_size_in_mb All the best, [image: datastax_logo.png]

Re: Drop/Create table with same CF Name

2015-05-22 Thread Sebastian Estevez
I’m aware of issues where recreating key spaces can cause inconsistency in 2.0.13 if memTables are not flushed beforehand , is this the issues that is resolved? Yep, that's https://issues.apache.org/jira/browse/CASSANDRA-7511 All the best, [image: datastax_logo.png]

Re: Normal to have an 8g commit log?

2015-05-22 Thread Sebastian Estevez
...@gmail.com wrote: So it won't increase beyond 8gb ish? On May 22, 2015 6:39 PM, Sebastian Estevez sebastian.este...@datastax.com wrote: Yes. 2.1 commitlogs are 8gb. 2.0 were 1gb. you can configure this in the yaml. http://docs.datastax.com/en/cassandra/1.2/cassandra/configuration

Re: Bootstrap code

2015-07-06 Thread Sebastian Estevez
For 2.1- https://github.com/apache/cassandra/blob/cassandra-2.1/src/java/org/apache/cassandra/dht/BootStrapper.java#L61 All the best, [image: datastax_logo.png] http://www.datastax.com/ Sebastián Estévez Solutions Architect | 954 905 8615 | sebastian.este...@datastax.com [image:

Re: Null pointer exception after delete in a table with statics

2015-08-19 Thread Sebastian Estevez
Can you include your read code? On Aug 18, 2015 5:50 AM, Hervé Rivière herve.rivi...@zenika.com wrote: Hello, I have an issue with a ErrorMessage code= [Server error] message=java.lang.NullPointerException when I query a table with static fields (without where clause) with Cassandra

Re: Question about how to remove data

2015-08-21 Thread Sebastian Estevez
To clarify, you do not need a ttl for deletes to be compacted away in Cassandra. When you delete, we create a tombstone which will remain in the system __at least__ gc grace seconds. We wait this long to give the tombstone a chance to make it to all replica nodes, the best practice is to run

Re: Written data is lost and no exception thrown back to the client

2015-08-21 Thread Sebastian Estevez
Please let us know the Jira number. All the best, [image: datastax_logo.png] http://www.datastax.com/ Sebastián Estévez Solutions Architect | 954 905 8615 | sebastian.este...@datastax.com [image: linkedin.png] https://www.linkedin.com/company/datastax [image: facebook.png]

Re: Delete semantics

2015-08-24 Thread Sebastian Estevez
Hi Cameron, INSERTs did not always have the ability to do where in's and the functionality has not not been ported to DELETEs. This Jira should give you what you're looking for (ETA 3.0 beta 2): CASSANDRA-6237 https://issues.apache.org/jira/browse/CASSANDRA-6237 Check out CASSANDRA-6446

Re: Migrate table data to another table

2015-06-30 Thread Sebastian Estevez
Another option is Brian's cassandra loader: https://github.com/brianmhess/cassandra-loader All the best, [image: datastax_logo.png] http://www.datastax.com/ Sebastián Estévez Solutions Architect | 954 905 8615 | sebastian.este...@datastax.com [image: linkedin.png]

Re: Hash function

2015-08-11 Thread Sebastian Estevez
It's not the hash of the ip, there's some entropy in there for uniqueness. On Aug 11, 2015 5:05 AM, Thouraya TH thouray...@gmail.com wrote: Hi all, Each node in cassandra ring has a unique identifier nodeID of 128bytes, obtained by a hashing of ? ip address ? Thank you so much

Re: Long joining node

2015-08-05 Thread Sebastian Estevez
) at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:615) at java.lang.Thread.run(Thread.java:745) ANY help is greatly appreciated. Thanks, Stan On Tue, Aug 4, 2015 at 2:23 PM, Sebastian Estevez sebastian.este...@datastax.com wrote: That's the one. I set it to an hour to be safe

Re: Long joining node

2015-08-04 Thread Sebastian Estevez
to streaming_socket_timeout_in_ms correct? What value do you recommend? All of my nodes are currently at the default 0. Thanks, Stan On Tue, Aug 4, 2015 at 2:16 PM, Sebastian Estevez sebastian.este...@datastax.com wrote: It helps to set stream socket timeout in the yaml so that you don't

Re: Long joining node

2015-08-04 Thread Sebastian Estevez
It helps to set stream socket timeout in the yaml so that you don't hang forever on a lost / broken stream. All the best, [image: datastax_logo.png] http://www.datastax.com/ Sebastián Estévez Solutions Architect | 954 905 8615 | sebastian.este...@datastax.com [image: linkedin.png]

Re: Cassandra OOM on joining existing ring

2015-07-13 Thread Sebastian Estevez
is down? As I mentioned, it's taking forever to get the service up - it's stuck in reading those 5k sstable (+ another 5k of corresponding secondary index) files. :( Oh, did I mention I'm new to cassandra? Thanks, Kunal Kunal On 11 July 2015 at 03:29, Sebastian Estevez sebastian.este

Re: DROP Table

2015-07-14 Thread Sebastian Estevez
? After that, update the System table as well? Naidu Saladi -- *From:* Sebastian Estevez sebastian.este...@datastax.com *To:* user@cassandra.apache.org; Saladi Naidu naidusp2...@yahoo.com *Sent:* Friday, July 10, 2015 5:25 PM *Subject:* Re: DROP Table #1

Re: DROP Table

2015-07-14 Thread Sebastian Estevez
the .db file? It will override the current file right? 3. Do we have to rename the directory name to remove CFID i.e. just column family name without CFID? After that, update the System table as well? Naidu Saladi -- *From:* Sebastian Estevez sebastian.este

Re: OpsCenter datastax-agent 300% CPU

2015-07-15 Thread Sebastian Estevez
...@gmail.com wrote: Looks like it dies with OOM: https://gist.github.com/kluyg/03785041e16333015c2c On Tue, Jul 14, 2015 at 12:01 PM, Mikhail Strebkov streb...@gmail.com wrote: OpsCenter 5.1.3 and datastax-agent-5.1.3-standalone.jar On Tue, Jul 14, 2015 at 12:00 PM, Sebastian Estevez

Re: OpsCenter datastax-agent 300% CPU

2015-07-20 Thread Sebastian Estevez
, Jul 15, 2015 at 2:04 PM, Sebastian Estevez sebastian.este...@datastax.com wrote: OpsCenter 5.2 has a couple of fixes that may result in the symptoms you described: http://docs.datas tax.com/en/opscenter/5.2/opsc/release_notes/opscReleaseNotes520.html · Fixed issues with agent

Re: OpsCenter datastax-agent 300% CPU

2015-07-14 Thread Sebastian Estevez
What version of the agents and what version of OpsCenter are you running? I recently saw something like this and upgrading to matching versions fixed the issue. On Jul 14, 2015 2:58 PM, Mikhail Strebkov streb...@gmail.com wrote: Hi everyone, Recently I've noticed that most of the nodes have

Re: Cassandra compaction stuck? Should I disable?

2015-11-10 Thread Sebastian Estevez
Turn off Swap. http://docs.datastax.com/en/cassandra/2.1/cassandra/install/installRecommendSettings.html?scroll=reference_ds_sxl_gf3_2k__disable-swap All the best, [image: datastax_logo.png] Sebastián Estévez Solutions Architect | 954 905 8615 |

Re: UnknownColumnFamily exception / schema inconsistencies

2015-11-11 Thread Sebastian Estevez
ne of choice for the worlds most innovative companies such as Netflix, Adobe, Intuit, and eBay. On Wed, Nov 11, 2015 at 12:26 PM, Maciek Sakrejda <mac...@heroku.com> wrote: > On Tue, Nov 10, 2015 at 3:20 PM, Sebastian Estevez < > sebastian.este...@datastax.com> wrote: > >>

Re: Cassandra compaction stuck? Should I disable?

2015-11-11 Thread Sebastian Estevez
ian, >> >> Thanks for your response. >> >> No swap is used. No offense, I just don't see a reason why having swap >> would be the issue here. I put swapiness on 1. I also have jna installed. >> That should prevent java being swapped out as wel AFAIK. >

Re: UnknownColumnFamily exception / schema inconsistencies

2015-11-10 Thread Sebastian Estevez
#1 The cause of this problem is a CREATE TABLE statement collision. Do not generate tables dynamically from multiple clients, even with IF NOT EXISTS. First thing you need to do is fix your code so that this does not happen. Just create your tables manually from cqlsh allowing time for the schema

Re: UnknownColumnFamily exception / schema inconsistencies

2015-11-13 Thread Sebastian Estevez
2015 at 12:37 PM, Maciek Sakrejda <mac...@heroku.com> wrote: > Any advice on how to proceed here? Sebastian seems to have guessed > correctly at the underlying issue, but I'm still not sure how to resolve > this given what I see in the data directory and the catalogs. > > On We

Re: Cassandra stalls and dropped messages not due to GC

2015-10-29 Thread Sebastian Estevez
The thing about the CASSANDRA-9504 theory is that it was solved in 2.1.6 and Jeff's running 2.1.11. @Jeff How often does this happen? Can you watch ttop as soon as you notice increased read/write latencies? wget > https://bintray.com/artifact/download/aragozin/generic/sjk-plus-0.3.6.jar > java

Re: Cassandra -stress write - Storage location

2015-10-29 Thread Sebastian Estevez
By default this will go in Keyspace1 Standard1. All the best, [image: datastax_logo.png] Sebastián Estévez Solutions Architect | 954 905 8615 | sebastian.este...@datastax.com [image: linkedin.png] [image: facebook.png]

Re: Cassandra -stress write - Storage location

2015-10-29 Thread Sebastian Estevez
n > > On Thu, Oct 29, 2015 at 9:41 PM, Sebastian Estevez < > sebastian.este...@datastax.com> wrote: > >> By default this will go in Keyspace1 Standard1. >> >> All the best, >> >> >> [image: datastax_logo.png] <http://www.datastax.com/> >

Re: Can't save Opscenter Dashboard

2015-11-04 Thread Sebastian Estevez
Do they come back if you restart opscenterd? All the best, [image: datastax_logo.png] Sebastián Estévez Solutions Architect | 954 905 8615 | sebastian.este...@datastax.com [image: linkedin.png] [image: facebook.png]

Re: Can't save Opscenter Dashboard

2015-11-04 Thread Sebastian Estevez
e database technology and transactional backbone of choice for the worlds most innovative companies such as Netflix, Adobe, Intuit, and eBay. On Wed, Nov 4, 2015 at 3:46 PM, Kai Wang <dep...@gmail.com> wrote: > No they don't. > > On Wed, Nov 4, 2015 at 3:42 PM, Sebastian Estevez &l

Re: Too many open files Cassandra 2.1.11.872

2015-11-06 Thread Sebastian Estevez
You probably need to configure ulimits correctly . What does this give you? /proc//limits All the best, [image: datastax_logo.png] Sebastián Estévez Solutions Architect |

Re: compact/repair shouldn't compete for normal compaction resources.

2015-10-19 Thread Sebastian Estevez
The validation compaction part of repair is susceptible to the compaction throttling knob `nodetool getcompactionthroughput` / `nodetool setcompactionthroughput` and you can use that to tune down the resources that are being used by repair. Check out this post by driftx on advanced repair

Re: Does failing to run "nodetool cleanup" end up causing more data to be transferred during bootstrapping?

2015-10-07 Thread Sebastian Estevez
vnodes or single tokens? All the best, [image: datastax_logo.png] Sebastián Estévez Solutions Architect | 954 905 8615 | sebastian.este...@datastax.com [image: linkedin.png] [image: facebook.png]

Re: Data visualization tools for Cassandra

2015-10-20 Thread Sebastian Estevez
For zeppelin check Duy Hai's branch: https://github.com/doanduyhai/incubator-zeppelin/blob/Spark_Cassandra_Demo/README.md All the best, [image: datastax_logo.png] Sebastián Estévez Solutions Architect | 954 905 8615 | sebastian.este...@datastax.com [image:

Re: "invalid global counter shard detected" warning on 2.1.3 and 2.1.10

2015-10-20 Thread Sebastian Estevez
Hi Branton, >- How much should we be freaking out? > > The impact of this is possible counter inaccuracy (over counting or under counting). If you are expecting counters to be exactly accurate, you are already in trouble because they are not. This is because of the fact that they are not

Re: Removed node is not completely removed

2015-10-14 Thread Sebastian Estevez
We still keep endpoints in memory. Not sure how you git to this state but try a rolling restart. On Oct 14, 2015 9:43 AM, "Tom van den Berge" wrote: > Thanks for that Michael, I did not know that. However, the node is not > listed in the system.peers table on any node,

Re: Realtime data and (C)AP

2015-10-08 Thread Sebastian Estevez
Renato, please watch this netflix video on consistency: http://www.planetcassandra.org/blog/a-netflix-experiment-eventual-consistency-hopeful-consistency-by-christos-kalantzis/ All the best, [image: datastax_logo.png] Sebastián Estévez Solutions Architect | 954 905

Re: Post portem of a large Cassandra datacenter migration.

2015-10-12 Thread Sebastian Estevez
For 1 and 3 have you looked CASSANDRA-8611 For 4, you don't need to attach a profiler to check if GC is a problem. Just grep the system log for GCInspector. All the best, [image: datastax_logo.png] Sebastián

Re: Node in DL status cannot be removed

2015-10-07 Thread Sebastian Estevez
Doesn't sound like it finished decommissioning (which takes time because it will actually stream that node's data to other nodes who assume the token ranges). 1) If your node still exists, bring it up and nodetool decommission. Wait until the decommission finishes. 2) You can do nodetool

Re: Cassandra OOM on joining existing ring

2015-07-10 Thread Sebastian Estevez
the failing cassandra server? Thanks, Kunal On 10 July 2015 at 22:35, Sebastian Estevez sebastian.este...@datastax.com wrote: #1 You need more information. a) Take a look at your .hprof file (memory heap from the OOM) with an introspection tool like jhat or visualvm or java flight

Re: Cassandra OOM on joining existing ring

2015-07-10 Thread Sebastian Estevez
#1 You need more information. a) Take a look at your .hprof file (memory heap from the OOM) with an introspection tool like jhat or visualvm or java flight recorder and see what is using up your RAM. b) How big are your large rows (use nodetool cfstats on each node). If your data model is bad,

Re: Cassandra OOM on joining existing ring

2015-07-10 Thread Sebastian Estevez
help. Thanks, Kunal On 10 July 2015 at 23:33, Sebastian Estevez sebastian.este...@datastax.com wrote: 1. You want to look at # of sstables in cfhistograms or in cfstats look at: Compacted partition maximum bytes Maximum live cells per slice 2) No, here's the env.sh from 3.0 which

Re: DROP Table

2015-07-10 Thread Sebastian Estevez
#1 The cause of this problem is a CREATE TABLE statement collision. Do *not* generate tables dynamically from multiple clients, even with IF NOT EXISTS. First thing you need to do is fix your code so that this does not happen. Just create your tables manually from cqlsh allowing time for the

Re: Help diagnosing performance issue

2015-11-18 Thread Sebastian Estevez
re I > got something wrong. > > Regarding the heap configuration, both are very similar: > * 32G machine: -Xms8049M -Xmx8049M -Xmn800M > * 64G machine: -Xms8192M -Xmx8192M -Xmn1200M > I think we can rule that out. > > Thanks again for you help, I truly appreciate it.

Re: Help diagnosing performance issue

2015-11-17 Thread Sebastian Estevez
Hi, You're sstables are probably falling out of page cache on the smaller nodes and your slow disks are killing your latencies. Check to see if this is the case with pcstat: https://github.com/tobert/pcstat All the best, [image: datastax_logo.png] Sebastián

Re: Is ZooKeeper still use in Cassandra?

2015-08-30 Thread Sebastian Estevez
No it does not. Where are you reading this? On Aug 30, 2015 5:09 PM, ibrahim El-sanosi ibrahimsaba...@gmail.com wrote: Hi folks, I read Cassandra white paper, I come across a text says Cassandra system elects a leader amongst its nodes using a system called Zookeeper[13]. All nodes on

Re: Adding New Nodes/Data Center to an existing Cluster.

2015-08-31 Thread Sebastian Estevez
or https://issues.apache.org/jira/browse/CASSANDRA-8611 perhaps All the best, [image: datastax_logo.png] Sebastián Estévez Solutions Architect | 954 905 8615 | sebastian.este...@datastax.com [image: linkedin.png] [image:

Re: Adding New Nodes/Data Center to an existing Cluster.

2015-09-01 Thread Sebastian Estevez
ivedi <nehajtriv...@gmail.com>: >> >>> Hi, >>> Can you specify which version of Cassandra you are using? >>> Can you provide the Error Stack ? >>> >>> regards >>> Neha >>> >>> On Tue, Sep 1, 2015 at 2:56 AM, Sebas

Re: Why I can not do a "count(*) ... allow filtering " without facing operation timeout?

2015-09-04 Thread Sebastian Estevez
I hope this is not a production query... All the best, [image: datastax_logo.png] Sebastián Estévez Solutions Architect | 954 905 8615 | sebastian.este...@datastax.com [image: linkedin.png] [image: facebook.png]

Re: Re : Decommissioned node appears in logs, and is sometimes marked as "UNREACHEABLE" in `nodetool describecluster`

2015-09-01 Thread Sebastian Estevez
Are they in the system.peers table? On Aug 28, 2015 4:21 PM, "sai krishnam raju potturi" wrote: > We are using DSE on our clusters. > > DSE version : 4.6.7 > Cassandra version : 2.0.14 > > thanks > Sai Potturi > > > > On Fri, Aug 28, 2015 at 3:40 PM, Robert Coli

Re: Importing data from SQL Server

2015-09-14 Thread Sebastian Estevez
If you have a csv, try Brian's cassandra-loader. It is a full featured c* java import program built with all the best practices for data loading and writes. https://github.com/brianmhess/cassandra-loader All the best, [image: datastax_logo.png] Sebastián Estévez

Re: No schema agreement from live replicas

2015-09-16 Thread Sebastian Estevez
check nodetool describecluster to see the schema versions across your nodes. A rolling restart will help propagate schema if you have disagreement across your nodes. Just FYI: We do a lot of schema

Re: Cassandra adding node issue (no UJ status)

2015-09-15 Thread Sebastian Estevez
Check https://issues.apache.org/jira/browse/CASSANDRA-8611 All the best, [image: datastax_logo.png] Sebastián Estévez Solutions Architect | 954 905 8615 | sebastian.este...@datastax.com [image: linkedin.png] [image:

Re: Fwd: Column family ID mismatch

2015-10-01 Thread Sebastian Estevez
Check this post & my response: http://stackoverflow.com/questions/31576180/cassandra-2-1-system-schema-missing=0CBoQFjAAahUKEwit6uK1uqHIAhXLcD4KHWsxDK8=AFQjCNFfvPld2OOInC6B_M0X_QpfqHUbxA=aLeCqqe7vhpQlL10p9WFJA On Oct 1, 2015 4:33 AM, "kedar" wrote: > Got this error

RE: Consistency Issues

2015-10-01 Thread Sebastian Estevez
You're running describe with CL quorum aren't you? To see the inconsistency you'd have to check the system.schema_column family tables on each node. On Oct 1, 2015 8:07 AM, "Walsh, Stephen" wrote: > No such thing as a stupid questionJ > > I know they exist in some

Re: Consistency Issues

2015-09-30 Thread Sebastian Estevez
Can you provide exact details on where your load balancer is? Like Michael said, you shouldn't need one between your client and the c* cluster if you're using a DataStax driver. All the best, [image: datastax_logo.png] Sebastián Estévez Solutions Architect | 954 905

Re: Cassandra Summit 2015 Roll Call!

2015-09-23 Thread Sebastian Estevez
Hey guys, find me at the Startups booth! Looking forward to meeting some of you in person :) On Sep 22, 2015 8:44 PM, "Steve Robenalt" wrote: > I am here. Wearing my assorted Cassandra shirts from meetups and > conferences. Would be happy to meet anyone from this mailing

Re: Do vnodes need more memory?

2015-09-23 Thread Sebastian Estevez
This is interesting, where are you seeing that you're collecting 50% of the time? Is your env.sh the default? How much ram? Also, can you run this tool and send a minute worth of thread info: wget https://bintray.com/artifact/download/aragozin/generic/sjk-plus-0.3.6.jar java -jar

Re: Unable to remove dead node from cluster.

2015-09-21 Thread Sebastian Estevez
Order is decommission, remove, assassinate. Which have you tried? On Sep 21, 2015 10:47 AM, "Dikang Gu" wrote: > Hi there, > > I have a dead node in our cluster, which is a wired state right now, and > can not be removed from cluster. > > The nodestatus shows: > Datacenter:

Re: Rebuilding a new Cassandra node at 100Mb/s

2015-12-04 Thread Sebastian Estevez
If you change stream throughput it won't affect currently running streams but it should affect new ones. all the best, Sebastián On Dec 4, 2015 5:39 AM, "Jonathan Ballet" wrote: > Thanks for your answer Rob, > > On 12/03/2015 08:32 PM, Robert Coli wrote: > >> On Thu, Dec 3,

Re: cassandra-stress 2.1: Generating data

2015-12-03 Thread Sebastian Estevez
You can run stress from a separate machine to isolate that impact. All the best, [image: datastax_logo.png] Sebastián Estévez Solutions Architect | 954 905 8615 | sebastian.este...@datastax.com [image: linkedin.png]

Re: Re: cassandra full gc too long

2015-12-29 Thread Sebastian Estevez
Hi Xutom, What the " modern CQL client with paging support" mean? Is there opensource > CQL client ? I does not use any opensource CQL client and exporting data > with my java code. Use the datastax Java driver which is open source: github: https://github.com/datastax/java-driver docs:

Re: OpsCenter metrics growth can relates to compactions?

2015-12-21 Thread Sebastian Estevez
> > We do have a lot of keyspaces and column families. Be careful as c* (not just opscenter) will not run well with too many tables. Usually 2 or 3 hundred is a good upper bound though I've seen folks throw money at the problem and run more with special hardware (lots of RAM). Most importantly,

Re: Help diagnosing performance issue

2015-11-18 Thread Sebastian Estevez
> Sebastian, > > Your help is very much appreciated. I re-read the blog post and also > https://labs.spotify.com/2014/12/18/date-tiered-compaction/ but some > things are still confusing me. > > Please see my questions inline below. > > On 11/18/2015 04:21 PM, Sebas

Re: Upgrade instructions don't make sense

2015-11-23 Thread Sebastian Estevez
> > If your cluster does not use vnodes, disable vnodes in each new > cassandra.yaml If your cluster *does* use vnodes do *not* disable them. All the best, [image: datastax_logo.png] Sebastián Estévez Solutions Architect | 954 905 8615 |

Re: Upgrade instructions don't make sense

2015-11-23 Thread Sebastian Estevez
tions, especially for upgrades. Second, fixing > little things like broken links, etc, etc. > > Thanks > Jake Hathaway > Cassandra Beginner > > > On Nov 23, 2015, at 4:22 PM, Sebastian Estevez < > sebastian.este...@datastax.com> wrote: > > If your cluster does not

Re: Error while rebuilding a node: Stream failed

2016-05-27 Thread Sebastian Estevez
Check ifconfig for dripped tpc messages. Let's rule out your network. all the best, Sebastián On May 27, 2016 10:45 AM, "George Sigletos" wrote: > Hello, > > No there is no version mix. The first stack traces were indeed from > 2.1.13. Then I upgraded all nodes to

Re: Slow nodetool response time

2016-06-22 Thread Sebastian Estevez
Sounds like your process is spending a lot of time in blocked state (real - user - sys). Check your os subsystems, maybe your machine is bogged down by other work. FWIW, my time in an idle system is about 2 seconds but can go up to ~13 seconds on a busy system with 70% cpu utilized. No difference

Re: Cassandra 3.1.1 with respect to HeapSpace

2016-01-15 Thread Sebastian Estevez
elete all the commit logs, not only the last one > specified. Nevertheless I’m back in business. > > Would there be a better memory configuration to select for my nodes in a > C* 3 cluster? Currently I use MAX_HEAP_SIZE=“6G" HEAP_NEWSIZE=“496M” for > a 16M RAM node. > > Thanks for y

Re: compaction throughput

2016-01-15 Thread Sebastian Estevez
*nodetool setcompactionthroughput 0* Will only affect future compactions, not the ones that are currently running. All the best, [image: datastax_logo.png] Sebastián Estévez Solutions Architect | 954 905 8615 | sebastian.este...@datastax.com [image: linkedin.png]

  1   2   >