sstable-to-arrow

2021-07-28 Thread Sebastian Estevez
Hi folks, There was some discussion on here a couple of weeks ago about using the Apache Arrow in memory format for Cassandra data so I thought I'd share the following posts / code we just released as alpha (apache 2 license). Code: https://github.com/datastax/sstable-to-arrow Post Part 1:

Re: Nodetool clearsnapshot does not delete snapshot for dropped column_family

2020-04-30 Thread Sebastian Estevez
Perhaps you had a DDL collision and ended up with two data dirs for the table? In that case running drop table would only move the active table directory to snapshots and as Eric suggested would leave the data in the duplicate directory "orphaned". I haven't tried to reproduce this yet but I

Re: Table not updating

2020-03-23 Thread Sebastian Estevez
I have seen cases where folks thought they were writing successfully to the database but were really hitting timeouts due to an unhandled future in their loading program. This may very well not be your issue but it's common enough that I thought I would mention it. Hope you get to the bottom of

Re: GraalVM

2019-05-09 Thread Sebastian Estevez
d93-9501-904fd550e1ad=mainreglink=true> 20% Discount Code: estevez20 On Thu, May 9, 2019 at 1:19 PM Chris Hane wrote: > Awesome. Will try to join. > > Thanks for the links. Will look through them also. > > On Thu, May 9, 2019 at 8:33 AM Sebastian Estevez < > sebastian.es

Re: GraalVM

2019-05-09 Thread Sebastian Estevez
Hi Chris, Funny you mention this today of all days because we're doing a twitch streaming session in a few hours on this very topic with Adron from our dev-rel team. The short answer is yes it works. Here's the example project we're working on that uses GraalVM via quarkus.io:

Re: How to measure the schema size

2018-10-26 Thread Sebastian Estevez
Here's the metrics you want: http://cassandra.apache.org/doc/latest/operating/metrics.html#table-metrics The best practice is to run fewer bigger tables. If it's a lot of tables you're likely out of luck aside from throwing more RAM at the problem. All the best, Sebastián Estévez | Vanguard

Re: token distribution in multi-dc

2017-05-02 Thread Sebastian Estevez
Hi Justin, > each DC will have a complete token ring This statement--and the diagram--imply that you can have multiple nodes with the same token as long as they are in seperate DCs. This isn't the case, though I understand how it is easy to fall into that trap. To help reason about this

Re: what does this Note mean?

2016-10-13 Thread Sebastian Estevez
It means for accurate load statistics add the keyspace name after nodetool status. nodetool status All the best, On Thu, Oct 13, 2016 at 10:08 PM, Kant Kodali wrote: > > Note: Non-system keyspaces don't have the same replication settings, > effective ownership

Re: Are updates on map columns causing tombstones?

2016-07-12 Thread Sebastian Estevez
I did a short write-up on this. http://www.sestevez.com/on-cassandra-collections-updates-and-tombstones/ all the best, Sebastián On Jul 11, 2016 4:22 PM, "Alain RODRIGUEZ" wrote: > Hi Jan, > > >> when I replace the content of a map-valued column (when I replace the >>

Re: Problems with nodetool

2016-06-29 Thread Sebastian Estevez
Did you mean `nodetool status` not `node-tool status` ? All the best, [image: datastax_logo.png] Sebastián Estévez Solutions Architect | 954 905 8615 | sebastian.este...@datastax.com [image: linkedin.png] [image:

Re: Slow nodetool response time

2016-06-22 Thread Sebastian Estevez
Sounds like your process is spending a lot of time in blocked state (real - user - sys). Check your os subsystems, maybe your machine is bogged down by other work. FWIW, my time in an idle system is about 2 seconds but can go up to ~13 seconds on a busy system with 70% cpu utilized. No difference

Re: Error while rebuilding a node: Stream failed

2016-05-27 Thread Sebastian Estevez
Check ifconfig for dripped tpc messages. Let's rule out your network. all the best, Sebastián On May 27, 2016 10:45 AM, "George Sigletos" wrote: > Hello, > > No there is no version mix. The first stack traces were indeed from > 2.1.13. Then I upgraded all nodes to

Re: A question to 'paging' support in DataStax java driver

2016-05-10 Thread Sebastian Estevez
terprises. Datastax is built to be agile, always-on, and predictably scalable to any size. With more than 500 customers in 45 countries, DataStax is the database technology and transactional backbone of choice for the worlds most innovative companies such as Netflix, Adobe, Intuit, and eBay. On

RE: A question to 'paging' support in DataStax java driver

2016-05-10 Thread Sebastian Estevez
I think this request belongs in the java driver jira not the Cassandra jira. https://datastax-oss.atlassian.net/projects/JAVA/ all the best, Sebastián On May 10, 2016 1:09 AM, "Lu, Boying" wrote: > I filed a JIRA https://issues.apache.org/jira/browse/CASSANDRA-11741 to >

Re: Cassandra causing OOM Killer to strike on new cluster running 3.4

2016-03-11 Thread Sebastian Estevez
Sacrifice child in dmesg is your OS killing the process with the most ram. That means you're actually running out of memory at the Linux level outside of the JVM. Are you running anything other than Cassandra on this box? If so, does it have a memory leak? all the best, Sebastián On Mar 11,

Re: How to measure the write amplification of C*?

2016-03-10 Thread Sebastian Estevez
https://issues.apache.org/jira/browse/CASSANDRA-10805 All the best, [image: datastax_logo.png] Sebastián Estévez Solutions Architect | 954 905 8615 | sebastian.este...@datastax.com [image: linkedin.png] [image:

Re: How to complete bootstrap with exception due to stream failure?

2016-02-27 Thread Sebastian Estevez
progress: 361% does not look right (probably a bug). Can you check the corresponding messages on the other side of the stream? I.E. the system log for 192.168.10.8 around 18:02:06? All the best, [image: datastax_logo.png] Sebastián Estévez Solutions Architect | 954

Re: Keyspaces not found in cqlsh

2016-02-11 Thread Sebastian Estevez
87-be28fe499787: [Ip1] > > 9f5b5675-c9e7-3ae3-8ad6-6654fa4fb3e7: [Ip2] > > Interestingly > ./nodetool cfstats shows all the tables > > Thanks, > Kedar Parikh > > On Thursday 11 February 2016 07:34 PM, Sebastian Estevez wrote: > > Keep this on. The user list, it'

Re: stefania.alborghe...@datastax.com

2016-02-11 Thread Sebastian Estevez
The monitoring UI is called DataStax OpsCenter and it has its own install process. Check out our documentation on the subject: http://docs.datastax.com/en/opscenter/5.2/opsc/install/opscInstallOpsc_g.html all the best, Sebastián On Feb 9, 2016 8:01 PM, "Ted Yu" wrote: >

Re: Keyspaces not found in cqlsh

2016-02-11 Thread Sebastian Estevez
Keep this on. The user list, it's not appropriate for the dev list. 1) I noticed that some of your files are owned by root and others by Cassandra. If this is a package install you should always start C* as a service and chown your files and directories so they are owned by the Cassandra user,

Re: Keyspaces not found in cqlsh

2016-02-11 Thread Sebastian Estevez
versions: > 9f5b5675-c9e7-3ae3-8ad6-6654fa4fb3e7: [IP1, IP2] > > On the flip side what could be implications of increasing > commitlog_segment_size_in_mb > > Thanks, > Kedar Parikh > > On Thursday 11 February 2016 08:18 PM, Sebastian Estevez wrote: > > If its a

Re: OpsCenter 5.2

2016-02-11 Thread Sebastian Estevez
Confirmed. all the best, Sebastián On Feb 11, 2016 12:44 PM, "Ted Yu" <yuzhih...@gmail.com> wrote: > Thanks for the pointer. > > Just want to confirm that OpsCenter 5.2 is compatible with DSE 4.8.4 which > I have deployed. > > Cheers > > On Thu, Fe

Re: EC2 storage options for C*

2016-02-03 Thread Sebastian Estevez
Good points Bryan, some more color: Regular EBS is *not* okay for C*. But AWS has some nicer EBS now that has performed okay recently: http://docs.aws.amazon.com/AWSEC2/latest/UserGuide/EBSVolumeTypes.html https://www.youtube.com/watch?v=1R-mgOcOSd4 The cloud vendors are moving toward shared

Re: EC2 storage options for C*

2016-02-03 Thread Sebastian Estevez
ntuit, and eBay. On Wed, Feb 3, 2016 at 7:27 PM, Sebastian Estevez < sebastian.este...@datastax.com> wrote: > Good points Bryan, some more color: > > Regular EBS is *not* okay for C*. But AWS has some nicer EBS now that has > performed okay recently: > > http://d

Re: automated CREATE TABLE just nuked my cluster after a 2.0 -> 2.1 upgrade....

2016-02-02 Thread Sebastian Estevez
Hi Ken, Earlier in this thread I posted a link to https://issues.apache.org/jira/browse/CASSANDRA-9424 That is the fix for these schema disagreement issues and as ay commented, the plan is to use CAS. Until then we have to treat schema delicately. all the best, Sebastián On Feb 2, 2016 9:48

Re: Java Driver Question

2016-02-02 Thread Sebastian Estevez
Yes, topology changes get pushed to the client via the control connection: https://github.com/datastax/java-driver/blob/2.1/driver-core/src/main/java/com/datastax/driver/core/Cluster.java#L61 all the best, Sebastián On Feb 2, 2016 10:47 AM, "Richard L. Burton III" wrote: >

Re: automated CREATE TABLE just nuked my cluster after a 2.0 -> 2.1 upgrade....

2016-01-25 Thread Sebastian Estevez
You have to wait for schema agreement which most drivers should do by default. At least have a check schema agreement method you can use. https://datastax.github.io/java-driver/2.1.9/features/metadata/ The new cqlsh uses the python driver so the same should apply:

Re: automated CREATE TABLE just nuked my cluster after a 2.0 -> 2.1 upgrade....

2016-01-23 Thread Sebastian Estevez
CASSANDRA-9424 All the best, [image: datastax_logo.png] Sebastián Estévez Solutions Architect | 954 905 8615 | sebastian.este...@datastax.com [image: linkedin.png]

Re: Getting error while issuing Cassandra stress

2016-01-22 Thread Sebastian Estevez
255731278 > rack1 UN 10.41.55.21 227.44 KB 256 ? c68deba4-b9a2-43fc-bb13-6af74c88c210 > rack1 UN 10.41.55.23 222.71 KB 256 ? 8229aa87-af00-48fa-ad6b-3066d3dc0e58 > rack1 UN 10.41.55.22 218.72 KB 256 ? c7ba84fd-7992-41de-8c88-11574a72db99 > rack1 > > Regards, > Bhuvan Raw

Re: Getting error while issuing Cassandra stress

2016-01-22 Thread Sebastian Estevez
ve to specify > ip as well even when im logged in to that machine. > > $ cqlsh > Connection error: ('Unable to connect to any servers', {'127.0.0.1': > error(111, "Tried connecting to [('127.0.0.1', 9042)]. Last error: > Connection refused")}) > > whereas > $ cqlsh

Re: Getting error while issuing Cassandra stress

2016-01-22 Thread Sebastian Estevez
gt; connection failed. > > Can you point me to a sample java application to test pushing data from > external server? Let's see if that works > > On Sat, Jan 23, 2016 at 2:55 AM, Sebastian Estevez < > sebastian.este...@datastax.com> wrote: > >> when i opened my ca

Re: Getting error while issuing Cassandra stress

2016-01-22 Thread Sebastian Estevez
The output of `nodetool status` would help us diagnose. All the best, [image: datastax_logo.png] Sebastián Estévez Solutions Architect | 954 905 8615 | sebastian.este...@datastax.com [image: linkedin.png] [image:

Re: compaction throughput

2016-01-21 Thread Sebastian Estevez
>So compaction of one table will NOT spread over different cores. This is not exactly true. You actually can have multiple compactions running at the same time on the same table, it just doesn't happen all that often. You essentially would have to have two sets of sstables that are both eligible

Re: compaction throughput

2016-01-21 Thread Sebastian Estevez
erience. >> >> In my case I had a table that was compacting over and over... and only >> one CPU was used. So that made me believe it was not multithreaded (I >> actually believe I asked this on IRC however it's been a few months ago so >> I might be wrong). >>

Re: Unable to locate Solr Configuration file ( Generated using dsetool )

2016-01-18 Thread Sebastian Estevez
You can post it to the server using either curl or dsetool: http://docs.datastax.com/en/datastax_enterprise/4.8/datastax_enterprise/srch/srchReldCore.html use the solrconfig and schema options: OptionSettingsDefaultDescription schema= path n/a Path of the schema file used for reloading the core

Re: Too many compactions, maybe keyspace system?

2016-01-17 Thread Sebastian Estevez
I agree that this may be worth a jira. Can you clarify this statement? >>5 keyspaces and about 100 cfs months How many total empty tables did you create? Creating hundreds of tables is a bad practice in Cassandra but I was not aware of a compaction impact like what you're describing. all the

Re: Cassandra 3.1.1 with respect to HeapSpace

2016-01-15 Thread Sebastian Estevez
elete all the commit logs, not only the last one > specified. Nevertheless I’m back in business. > > Would there be a better memory configuration to select for my nodes in a > C* 3 cluster? Currently I use MAX_HEAP_SIZE=“6G" HEAP_NEWSIZE=“496M” for > a 16M RAM node. > > Thanks for y

Re: compaction throughput

2016-01-15 Thread Sebastian Estevez
*nodetool setcompactionthroughput 0* Will only affect future compactions, not the ones that are currently running. All the best, [image: datastax_logo.png] Sebastián Estévez Solutions Architect | 954 905 8615 | sebastian.este...@datastax.com [image: linkedin.png]

Re: compaction throughput

2016-01-15 Thread Sebastian Estevez
Correct. Why are you concerned with the raw throughput, are you accumulating pending compactions? Are you seeing high sstables per read statistics? all the best, Sebastián On Jan 15, 2016 6:18 PM, "Kai Wang" wrote: > Jeff & Sebastian, > > Thanks for the reply. There are 12

Re: compaction throughput

2016-01-15 Thread Sebastian Estevez
precisely single core speed bound. This is a > little surprising. > > Of course LCS is still superior in other aspects. > On Jan 15, 2016 6:34 PM, "Sebastian Estevez" < > sebastian.este...@datastax.com> wrote: > >> Correct. >> >> Why are you concerne

Re: Cassandra 3.1.1 with respect to HeapSpace

2016-01-14 Thread Sebastian Estevez
Try starting the other nodes. You may have to delete or mv the commitlog segment referenced in the error message for the node to come up since apparently it is corrupted. All the best, [image: datastax_logo.png] Sebastián Estévez Solutions Architect | 954 905 8615 |

Re: Re: cassandra full gc too long

2015-12-29 Thread Sebastian Estevez
Hi Xutom, What the " modern CQL client with paging support" mean? Is there opensource > CQL client ? I does not use any opensource CQL client and exporting data > with my java code. Use the datastax Java driver which is open source: github: https://github.com/datastax/java-driver docs:

Re: OpsCenter metrics growth can relates to compactions?

2015-12-21 Thread Sebastian Estevez
> > We do have a lot of keyspaces and column families. Be careful as c* (not just opscenter) will not run well with too many tables. Usually 2 or 3 hundred is a good upper bound though I've seen folks throw money at the problem and run more with special hardware (lots of RAM). Most importantly,

Re: Rebuilding a new Cassandra node at 100Mb/s

2015-12-04 Thread Sebastian Estevez
If you change stream throughput it won't affect currently running streams but it should affect new ones. all the best, Sebastián On Dec 4, 2015 5:39 AM, "Jonathan Ballet" wrote: > Thanks for your answer Rob, > > On 12/03/2015 08:32 PM, Robert Coli wrote: > >> On Thu, Dec 3,

Re: cassandra-stress 2.1: Generating data

2015-12-03 Thread Sebastian Estevez
You can run stress from a separate machine to isolate that impact. All the best, [image: datastax_logo.png] Sebastián Estévez Solutions Architect | 954 905 8615 | sebastian.este...@datastax.com [image: linkedin.png]

Re: Upgrade instructions don't make sense

2015-11-23 Thread Sebastian Estevez
> > If your cluster does not use vnodes, disable vnodes in each new > cassandra.yaml If your cluster *does* use vnodes do *not* disable them. All the best, [image: datastax_logo.png] Sebastián Estévez Solutions Architect | 954 905 8615 |

Re: Upgrade instructions don't make sense

2015-11-23 Thread Sebastian Estevez
tions, especially for upgrades. Second, fixing > little things like broken links, etc, etc. > > Thanks > Jake Hathaway > Cassandra Beginner > > > On Nov 23, 2015, at 4:22 PM, Sebastian Estevez < > sebastian.este...@datastax.com> wrote: > > If your cluster does not

Re: Help diagnosing performance issue

2015-11-18 Thread Sebastian Estevez
re I > got something wrong. > > Regarding the heap configuration, both are very similar: > * 32G machine: -Xms8049M -Xmx8049M -Xmn800M > * 64G machine: -Xms8192M -Xmx8192M -Xmn1200M > I think we can rule that out. > > Thanks again for you help, I truly appreciate it.

Re: Help diagnosing performance issue

2015-11-18 Thread Sebastian Estevez
> Sebastian, > > Your help is very much appreciated. I re-read the blog post and also > https://labs.spotify.com/2014/12/18/date-tiered-compaction/ but some > things are still confusing me. > > Please see my questions inline below. > > On 11/18/2015 04:21 PM, Sebas

Re: Help diagnosing performance issue

2015-11-17 Thread Sebastian Estevez
Hi, You're sstables are probably falling out of page cache on the smaller nodes and your slow disks are killing your latencies. Check to see if this is the case with pcstat: https://github.com/tobert/pcstat All the best, [image: datastax_logo.png] Sebastián

Re: UnknownColumnFamily exception / schema inconsistencies

2015-11-13 Thread Sebastian Estevez
2015 at 12:37 PM, Maciek Sakrejda <mac...@heroku.com> wrote: > Any advice on how to proceed here? Sebastian seems to have guessed > correctly at the underlying issue, but I'm still not sure how to resolve > this given what I see in the data directory and the catalogs. > > On We

Re: UnknownColumnFamily exception / schema inconsistencies

2015-11-11 Thread Sebastian Estevez
ne of choice for the worlds most innovative companies such as Netflix, Adobe, Intuit, and eBay. On Wed, Nov 11, 2015 at 12:26 PM, Maciek Sakrejda <mac...@heroku.com> wrote: > On Tue, Nov 10, 2015 at 3:20 PM, Sebastian Estevez < > sebastian.este...@datastax.com> wrote: > >>

Re: Cassandra compaction stuck? Should I disable?

2015-11-11 Thread Sebastian Estevez
ian, >> >> Thanks for your response. >> >> No swap is used. No offense, I just don't see a reason why having swap >> would be the issue here. I put swapiness on 1. I also have jna installed. >> That should prevent java being swapped out as wel AFAIK. >

Re: Cassandra compaction stuck? Should I disable?

2015-11-10 Thread Sebastian Estevez
Turn off Swap. http://docs.datastax.com/en/cassandra/2.1/cassandra/install/installRecommendSettings.html?scroll=reference_ds_sxl_gf3_2k__disable-swap All the best, [image: datastax_logo.png] Sebastián Estévez Solutions Architect | 954 905 8615 |

Re: UnknownColumnFamily exception / schema inconsistencies

2015-11-10 Thread Sebastian Estevez
#1 The cause of this problem is a CREATE TABLE statement collision. Do not generate tables dynamically from multiple clients, even with IF NOT EXISTS. First thing you need to do is fix your code so that this does not happen. Just create your tables manually from cqlsh allowing time for the schema

Re: Too many open files Cassandra 2.1.11.872

2015-11-06 Thread Sebastian Estevez
You probably need to configure ulimits correctly . What does this give you? /proc//limits All the best, [image: datastax_logo.png] Sebastián Estévez Solutions Architect |

Re: Can't save Opscenter Dashboard

2015-11-04 Thread Sebastian Estevez
Do they come back if you restart opscenterd? All the best, [image: datastax_logo.png] Sebastián Estévez Solutions Architect | 954 905 8615 | sebastian.este...@datastax.com [image: linkedin.png] [image: facebook.png]

Re: Can't save Opscenter Dashboard

2015-11-04 Thread Sebastian Estevez
e database technology and transactional backbone of choice for the worlds most innovative companies such as Netflix, Adobe, Intuit, and eBay. On Wed, Nov 4, 2015 at 3:46 PM, Kai Wang <dep...@gmail.com> wrote: > No they don't. > > On Wed, Nov 4, 2015 at 3:42 PM, Sebastian Estevez &l

Re: Cassandra stalls and dropped messages not due to GC

2015-10-29 Thread Sebastian Estevez
The thing about the CASSANDRA-9504 theory is that it was solved in 2.1.6 and Jeff's running 2.1.11. @Jeff How often does this happen? Can you watch ttop as soon as you notice increased read/write latencies? wget > https://bintray.com/artifact/download/aragozin/generic/sjk-plus-0.3.6.jar > java

Re: Cassandra -stress write - Storage location

2015-10-29 Thread Sebastian Estevez
By default this will go in Keyspace1 Standard1. All the best, [image: datastax_logo.png] Sebastián Estévez Solutions Architect | 954 905 8615 | sebastian.este...@datastax.com [image: linkedin.png] [image: facebook.png]

Re: Cassandra -stress write - Storage location

2015-10-29 Thread Sebastian Estevez
n > > On Thu, Oct 29, 2015 at 9:41 PM, Sebastian Estevez < > sebastian.este...@datastax.com> wrote: > >> By default this will go in Keyspace1 Standard1. >> >> All the best, >> >> >> [image: datastax_logo.png] <http://www.datastax.com/> >

Re: Data visualization tools for Cassandra

2015-10-20 Thread Sebastian Estevez
For zeppelin check Duy Hai's branch: https://github.com/doanduyhai/incubator-zeppelin/blob/Spark_Cassandra_Demo/README.md All the best, [image: datastax_logo.png] Sebastián Estévez Solutions Architect | 954 905 8615 | sebastian.este...@datastax.com [image:

Re: "invalid global counter shard detected" warning on 2.1.3 and 2.1.10

2015-10-20 Thread Sebastian Estevez
Hi Branton, >- How much should we be freaking out? > > The impact of this is possible counter inaccuracy (over counting or under counting). If you are expecting counters to be exactly accurate, you are already in trouble because they are not. This is because of the fact that they are not

Re: compact/repair shouldn't compete for normal compaction resources.

2015-10-19 Thread Sebastian Estevez
The validation compaction part of repair is susceptible to the compaction throttling knob `nodetool getcompactionthroughput` / `nodetool setcompactionthroughput` and you can use that to tune down the resources that are being used by repair. Check out this post by driftx on advanced repair

Re: Removed node is not completely removed

2015-10-14 Thread Sebastian Estevez
We still keep endpoints in memory. Not sure how you git to this state but try a rolling restart. On Oct 14, 2015 9:43 AM, "Tom van den Berge" wrote: > Thanks for that Michael, I did not know that. However, the node is not > listed in the system.peers table on any node,

Re: Post portem of a large Cassandra datacenter migration.

2015-10-12 Thread Sebastian Estevez
For 1 and 3 have you looked CASSANDRA-8611 For 4, you don't need to attach a profiler to check if GC is a problem. Just grep the system log for GCInspector. All the best, [image: datastax_logo.png] Sebastián

Re: Realtime data and (C)AP

2015-10-08 Thread Sebastian Estevez
Renato, please watch this netflix video on consistency: http://www.planetcassandra.org/blog/a-netflix-experiment-eventual-consistency-hopeful-consistency-by-christos-kalantzis/ All the best, [image: datastax_logo.png] Sebastián Estévez Solutions Architect | 954 905

Re: Does failing to run "nodetool cleanup" end up causing more data to be transferred during bootstrapping?

2015-10-07 Thread Sebastian Estevez
vnodes or single tokens? All the best, [image: datastax_logo.png] Sebastián Estévez Solutions Architect | 954 905 8615 | sebastian.este...@datastax.com [image: linkedin.png] [image: facebook.png]

Re: Node in DL status cannot be removed

2015-10-07 Thread Sebastian Estevez
Doesn't sound like it finished decommissioning (which takes time because it will actually stream that node's data to other nodes who assume the token ranges). 1) If your node still exists, bring it up and nodetool decommission. Wait until the decommission finishes. 2) You can do nodetool

Re: Fwd: Column family ID mismatch

2015-10-01 Thread Sebastian Estevez
Check this post & my response: http://stackoverflow.com/questions/31576180/cassandra-2-1-system-schema-missing=0CBoQFjAAahUKEwit6uK1uqHIAhXLcD4KHWsxDK8=AFQjCNFfvPld2OOInC6B_M0X_QpfqHUbxA=aLeCqqe7vhpQlL10p9WFJA On Oct 1, 2015 4:33 AM, "kedar" wrote: > Got this error

RE: Consistency Issues

2015-10-01 Thread Sebastian Estevez
You're running describe with CL quorum aren't you? To see the inconsistency you'd have to check the system.schema_column family tables on each node. On Oct 1, 2015 8:07 AM, "Walsh, Stephen" wrote: > No such thing as a stupid questionJ > > I know they exist in some

Re: Consistency Issues

2015-09-30 Thread Sebastian Estevez
Can you provide exact details on where your load balancer is? Like Michael said, you shouldn't need one between your client and the c* cluster if you're using a DataStax driver. All the best, [image: datastax_logo.png] Sebastián Estévez Solutions Architect | 954 905

Re: Cassandra Summit 2015 Roll Call!

2015-09-23 Thread Sebastian Estevez
Hey guys, find me at the Startups booth! Looking forward to meeting some of you in person :) On Sep 22, 2015 8:44 PM, "Steve Robenalt" wrote: > I am here. Wearing my assorted Cassandra shirts from meetups and > conferences. Would be happy to meet anyone from this mailing

Re: Do vnodes need more memory?

2015-09-23 Thread Sebastian Estevez
This is interesting, where are you seeing that you're collecting 50% of the time? Is your env.sh the default? How much ram? Also, can you run this tool and send a minute worth of thread info: wget https://bintray.com/artifact/download/aragozin/generic/sjk-plus-0.3.6.jar java -jar

Re: Unable to remove dead node from cluster.

2015-09-21 Thread Sebastian Estevez
Order is decommission, remove, assassinate. Which have you tried? On Sep 21, 2015 10:47 AM, "Dikang Gu" wrote: > Hi there, > > I have a dead node in our cluster, which is a wired state right now, and > can not be removed from cluster. > > The nodestatus shows: > Datacenter:

Re: No schema agreement from live replicas

2015-09-16 Thread Sebastian Estevez
check nodetool describecluster to see the schema versions across your nodes. A rolling restart will help propagate schema if you have disagreement across your nodes. Just FYI: We do a lot of schema

Re: Cassandra adding node issue (no UJ status)

2015-09-15 Thread Sebastian Estevez
Check https://issues.apache.org/jira/browse/CASSANDRA-8611 All the best, [image: datastax_logo.png] Sebastián Estévez Solutions Architect | 954 905 8615 | sebastian.este...@datastax.com [image: linkedin.png] [image:

Re: Importing data from SQL Server

2015-09-14 Thread Sebastian Estevez
If you have a csv, try Brian's cassandra-loader. It is a full featured c* java import program built with all the best practices for data loading and writes. https://github.com/brianmhess/cassandra-loader All the best, [image: datastax_logo.png] Sebastián Estévez

Re: Why I can not do a "count(*) ... allow filtering " without facing operation timeout?

2015-09-04 Thread Sebastian Estevez
I hope this is not a production query... All the best, [image: datastax_logo.png] Sebastián Estévez Solutions Architect | 954 905 8615 | sebastian.este...@datastax.com [image: linkedin.png] [image: facebook.png]

Re: Adding New Nodes/Data Center to an existing Cluster.

2015-09-01 Thread Sebastian Estevez
ivedi <nehajtriv...@gmail.com>: >> >>> Hi, >>> Can you specify which version of Cassandra you are using? >>> Can you provide the Error Stack ? >>> >>> regards >>> Neha >>> >>> On Tue, Sep 1, 2015 at 2:56 AM, Sebas

Re: Re : Decommissioned node appears in logs, and is sometimes marked as "UNREACHEABLE" in `nodetool describecluster`

2015-09-01 Thread Sebastian Estevez
Are they in the system.peers table? On Aug 28, 2015 4:21 PM, "sai krishnam raju potturi" wrote: > We are using DSE on our clusters. > > DSE version : 4.6.7 > Cassandra version : 2.0.14 > > thanks > Sai Potturi > > > > On Fri, Aug 28, 2015 at 3:40 PM, Robert Coli

Re: Adding New Nodes/Data Center to an existing Cluster.

2015-08-31 Thread Sebastian Estevez
or https://issues.apache.org/jira/browse/CASSANDRA-8611 perhaps All the best, [image: datastax_logo.png] Sebastián Estévez Solutions Architect | 954 905 8615 | sebastian.este...@datastax.com [image: linkedin.png] [image:

Re: Is ZooKeeper still use in Cassandra?

2015-08-30 Thread Sebastian Estevez
No it does not. Where are you reading this? On Aug 30, 2015 5:09 PM, ibrahim El-sanosi ibrahimsaba...@gmail.com wrote: Hi folks, I read Cassandra white paper, I come across a text says Cassandra system elects a leader amongst its nodes using a system called Zookeeper[13]. All nodes on

Re: Delete semantics

2015-08-24 Thread Sebastian Estevez
Hi Cameron, INSERTs did not always have the ability to do where in's and the functionality has not not been ported to DELETEs. This Jira should give you what you're looking for (ETA 3.0 beta 2): CASSANDRA-6237 https://issues.apache.org/jira/browse/CASSANDRA-6237 Check out CASSANDRA-6446

Re: Question about how to remove data

2015-08-21 Thread Sebastian Estevez
To clarify, you do not need a ttl for deletes to be compacted away in Cassandra. When you delete, we create a tombstone which will remain in the system __at least__ gc grace seconds. We wait this long to give the tombstone a chance to make it to all replica nodes, the best practice is to run

Re: Written data is lost and no exception thrown back to the client

2015-08-21 Thread Sebastian Estevez
Please let us know the Jira number. All the best, [image: datastax_logo.png] http://www.datastax.com/ Sebastián Estévez Solutions Architect | 954 905 8615 | sebastian.este...@datastax.com [image: linkedin.png] https://www.linkedin.com/company/datastax [image: facebook.png]

Re: Null pointer exception after delete in a table with statics

2015-08-19 Thread Sebastian Estevez
Can you include your read code? On Aug 18, 2015 5:50 AM, Hervé Rivière herve.rivi...@zenika.com wrote: Hello, I have an issue with a ErrorMessage code= [Server error] message=java.lang.NullPointerException when I query a table with static fields (without where clause) with Cassandra

Re: Hash function

2015-08-11 Thread Sebastian Estevez
It's not the hash of the ip, there's some entropy in there for uniqueness. On Aug 11, 2015 5:05 AM, Thouraya TH thouray...@gmail.com wrote: Hi all, Each node in cassandra ring has a unique identifier nodeID of 128bytes, obtained by a hashing of ? ip address ? Thank you so much

Re: Long joining node

2015-08-05 Thread Sebastian Estevez
) at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:615) at java.lang.Thread.run(Thread.java:745) ANY help is greatly appreciated. Thanks, Stan On Tue, Aug 4, 2015 at 2:23 PM, Sebastian Estevez sebastian.este...@datastax.com wrote: That's the one. I set it to an hour to be safe

Re: Long joining node

2015-08-04 Thread Sebastian Estevez
to streaming_socket_timeout_in_ms correct? What value do you recommend? All of my nodes are currently at the default 0. Thanks, Stan On Tue, Aug 4, 2015 at 2:16 PM, Sebastian Estevez sebastian.este...@datastax.com wrote: It helps to set stream socket timeout in the yaml so that you don't

Re: Long joining node

2015-08-04 Thread Sebastian Estevez
It helps to set stream socket timeout in the yaml so that you don't hang forever on a lost / broken stream. All the best, [image: datastax_logo.png] http://www.datastax.com/ Sebastián Estévez Solutions Architect | 954 905 8615 | sebastian.este...@datastax.com [image: linkedin.png]

Re: OpsCenter datastax-agent 300% CPU

2015-07-20 Thread Sebastian Estevez
, Jul 15, 2015 at 2:04 PM, Sebastian Estevez sebastian.este...@datastax.com wrote: OpsCenter 5.2 has a couple of fixes that may result in the symptoms you described: http://docs.datas tax.com/en/opscenter/5.2/opsc/release_notes/opscReleaseNotes520.html · Fixed issues with agent

Re: OpsCenter datastax-agent 300% CPU

2015-07-15 Thread Sebastian Estevez
...@gmail.com wrote: Looks like it dies with OOM: https://gist.github.com/kluyg/03785041e16333015c2c On Tue, Jul 14, 2015 at 12:01 PM, Mikhail Strebkov streb...@gmail.com wrote: OpsCenter 5.1.3 and datastax-agent-5.1.3-standalone.jar On Tue, Jul 14, 2015 at 12:00 PM, Sebastian Estevez

Re: DROP Table

2015-07-14 Thread Sebastian Estevez
? After that, update the System table as well? Naidu Saladi -- *From:* Sebastian Estevez sebastian.este...@datastax.com *To:* user@cassandra.apache.org; Saladi Naidu naidusp2...@yahoo.com *Sent:* Friday, July 10, 2015 5:25 PM *Subject:* Re: DROP Table #1

Re: DROP Table

2015-07-14 Thread Sebastian Estevez
the .db file? It will override the current file right? 3. Do we have to rename the directory name to remove CFID i.e. just column family name without CFID? After that, update the System table as well? Naidu Saladi -- *From:* Sebastian Estevez sebastian.este

Re: OpsCenter datastax-agent 300% CPU

2015-07-14 Thread Sebastian Estevez
What version of the agents and what version of OpsCenter are you running? I recently saw something like this and upgrading to matching versions fixed the issue. On Jul 14, 2015 2:58 PM, Mikhail Strebkov streb...@gmail.com wrote: Hi everyone, Recently I've noticed that most of the nodes have

Re: Cassandra OOM on joining existing ring

2015-07-13 Thread Sebastian Estevez
is down? As I mentioned, it's taking forever to get the service up - it's stuck in reading those 5k sstable (+ another 5k of corresponding secondary index) files. :( Oh, did I mention I'm new to cassandra? Thanks, Kunal Kunal On 11 July 2015 at 03:29, Sebastian Estevez sebastian.este

Re: Cassandra OOM on joining existing ring

2015-07-10 Thread Sebastian Estevez
the failing cassandra server? Thanks, Kunal On 10 July 2015 at 22:35, Sebastian Estevez sebastian.este...@datastax.com wrote: #1 You need more information. a) Take a look at your .hprof file (memory heap from the OOM) with an introspection tool like jhat or visualvm or java flight

Re: Cassandra OOM on joining existing ring

2015-07-10 Thread Sebastian Estevez
#1 You need more information. a) Take a look at your .hprof file (memory heap from the OOM) with an introspection tool like jhat or visualvm or java flight recorder and see what is using up your RAM. b) How big are your large rows (use nodetool cfstats on each node). If your data model is bad,

Re: Cassandra OOM on joining existing ring

2015-07-10 Thread Sebastian Estevez
help. Thanks, Kunal On 10 July 2015 at 23:33, Sebastian Estevez sebastian.este...@datastax.com wrote: 1. You want to look at # of sstables in cfhistograms or in cfstats look at: Compacted partition maximum bytes Maximum live cells per slice 2) No, here's the env.sh from 3.0 which

  1   2   >