Re: Recreating materialized views in cassandra

2020-07-29 Thread Jasonstack Zhao Yang
eating a JIRA describing: what's the workload/queries and how does it end up in an inconsistent state if you can reproduce it? On Wed, 29 Jul 2020 at 20:49, Jasonstack Zhao Yang < jasonstack.z...@gmail.com> wrote: > > The cluster started to crash when some partitions in MV crossed 1 G

Re: Recreating materialized views in cassandra

2020-07-29 Thread Jasonstack Zhao Yang
mentions cluster instability while creating and deleting mv's > > The cluster started to crash when some partitions in MV crossed 1 GB size >> at few nodes, whereas in other nodes it is less than 50 MB. > > > Should we be worried about this? > > On Mon, Jul 27, 2020

Re: Recreating materialized views in cassandra

2020-07-27 Thread Jasonstack Zhao Yang
Hi, > We are facing data inconsistency issues between base tables and materialized views. do you run "nodetool repair" on both base and view regularly? > What are all the possible scenarios that we should be watching out for in a production environment? more cpu/io/gc for populating views. > C

Re: Materialized View's additional PrimaryKey column

2019-07-25 Thread Jasonstack Zhao Yang
Hi Jon, Do you have any clue what's the cause of downtime using MV? eg. memory pressure, or overloaded by view writes? Thanks. On Fri, 26 Jul 2019 at 13:59, mehmet bursali wrote: > Thank you again for Clear information Jon! i give up 🤗 > > Android’de Yahoo Postadan gönderildi >

Re: Commit Log question

2017-04-27 Thread Jasonstack Zhao Yang
Hi Charulata, IMO, 64MB is fine unless you archive commit log or scan it for backup. Zhao Charulata Sharma (charshar) 于2017年4月28日周五 上午8:01写道: > Hi , > > Can anyone please tell me the implication of increasing the > commitlog_segment_size_in_mb > from the default value of 32 MB to a higher

Re: Drop tables takes too long

2017-04-21 Thread Jasonstack Zhao Yang
flush all schema info into sstable, then reads all on disk schema into memory (5k tables info + related column info).. > You also might need to increase the node count if you're resource constrained. More nodes won't help and most probably make it worse due to coordination. Zhao Y

Re: why dose it still have to seach in SSTable when getting data in memtable in the read flow?

2017-03-27 Thread jason zhao yang
Hi, Cassandra uses last-writetime-win strategy. In memory data doesn't mean it is the latest data due to custom write time, if data is also in Sstable, Cassandra has to read it and reconcile. Jasonstack On Mon, 27 Mar 2017 at 7:53 PM, 赵豫峰 wrote: > hello, I get the message that "If the memtable

Re:Question about compaction strategy changes

2016-10-21 Thread Zhao Yang
hi Edwards, when changibg gc_grace_second, no compaction willbbe triggered. regards, jasonstack Sent from my Mi phoneOn Seth Edwards , Oct 22, 2016 11:37 AM wrote:Hello! We're using TWCS and we notice that if we make changes to the options to the window unit or size, it seems to implicitly s

Re: Does anyone store larger values in Cassandra E.g. 500 KB?

2016-10-21 Thread jason zhao yang
1. usually before storing object, serialization is needed, so we can know the size. 2. add "chunk id" as last clustering key. Vikas Jaiman 于2016年10月21日周五 下午11:46写道: > Thanks for your answer but I am just curious about: > > i)How do you identify the size of the object which you are going to chunk?

Re: regarding drain process

2016-09-25 Thread jason zhao yang
Hi Varun, It looks like a scheduled job that runs "nodetool drain".. Zhao Yang Varun Barala 于2016年9月25日周日 下午7:45写道: > Jeff Jirsa thanks for your reply!! > > We are not using any chef/puppet and It happens only at one node other > nodes are working fine. > And all ma

Re: Read data from specific node in cassandra

2016-05-05 Thread jason zhao yang
Hi, Can you check LoadBalancing Policy -> whiteList ? jasonstack Varun Barala 于2016年5月5日周四 下午5:40写道: > Hi Siddharth Verma, > > You can define consistency level LOCAL_ONE. > > and you can applyh consistency level during statement creation. > > like this -> statement.setConsistencyLevel(Consisten

StatusLogger is logging too many information

2016-04-25 Thread jason zhao yang
Hi, Currently StatusLogger will log info when there are dropped messages or GC more than 200 ms. In my use case, there are about 1000 tables. The status-logger is logging too many information for each tables. I wonder is there a way to reduce this log? for example, only print the thread pool in

Re: Cassandra table limitation

2016-04-06 Thread jason zhao yang
the different (probably competing) workloads >> effectively. >> >> Mike >> >> On Tue, Apr 5, 2016 at 8:40 PM, jason zhao yang < >> zhaoyangsingap...@gmail.com> wrote: >> >>> Hi Jack, >>> >>> Thanks for the reply. >>&g

Re: Cassandra table limitation

2016-04-05 Thread jason zhao yang
to scale with the table count. For one each >> table/CF has some fixed memory footprint on *ALL* nodes. The consensus is >> you shouldn't have more than "a few hundreds" of tables. >> >> On Mon, Apr 4, 2016 at 10:17 AM, jason zhao yang < >> zhaoyangsin

Re: Cassandra table limitation

2016-04-05 Thread jason zhao yang
n Mon, Apr 4, 2016 at 10:17 AM, jason zhao yang < > zhaoyangsingap...@gmail.com> wrote: > >> Hi, >> >> This is Jason. >> >> Currently, I am using C* 2.1.10, I want to ask what's the optimal number >> of tables I should create in one cluster? >

Cassandra table limitation

2016-04-04 Thread jason zhao yang
Hi, This is Jason. Currently, I am using C* 2.1.10, I want to ask what's the optimal number of tables I should create in one cluster? My use case is that I will prepare a keyspace for each of my tenant, and every tenant will create tables they needed. Assume each tenant created 50 tables with no

read time coprocessor?

2015-12-10 Thread Li Yang
This is Yang from Apache Kylin project. We are thinking about using Cassandra instead of HBase as storage. I searched and read around and still have one question. Does Cassandra support read time coprocessor that allows moving computation to data node before scan result is returned? This shall

Re: linearizable consistency / Paxos ?

2015-08-03 Thread Yang
ou can look into the source code here: > https://github.com/apache/cassandra/blob/trunk/src/java/org/apache/cassandra/service/StorageProxy.java#L202 > > The Javadoc is also interesting to read because it explains briefly the > semantics > > > > On Mon, Aug 3, 2015 at 11:32

Re: linearizable consistency / Paxos ?

2015-08-03 Thread Yang
by Paxos but fails before being able > to commit (after the accept phase in the diagram), then any subsequent > operation on this partition key will commit this stalled operation before > starting its own. > > > > On Mon, Aug 3, 2015 at 4:30 AM, Yang wrote: > >> this link

linearizable consistency / Paxos ?

2015-08-02 Thread Yang
from that article is , what is the fundamental difference between the standard replication protocol and Paxos that prevents us from implementing a 2-pc on top of the standard protocol? Thanks! yang

Re: question about bootstrapping sequence

2015-07-28 Thread Yang
thanks. hmmm somehow I had the impression that untill B's streamingIn finished it does not adverise itself to other servers for receiving fresh replications. looks I'm wrong here, ler me check the code.. On Jul 28, 2015 2:07 PM, "Robert Coli" wrote: > On Tue, Jul 28

Re: question about bootstrapping sequence

2015-07-28 Thread Yang
quot;. but now the state of C and A, B are different. On Tue, Jul 28, 2015 at 12:40 PM, Robert Coli wrote: > On Tue, Jul 28, 2015 at 1:31 AM, Yang wrote: > >> I'm wondering how the Cassandra protocol brings a newly bootstrapped node >> "up to speed". >> &

Re: question about bootstrapping sequence

2015-07-28 Thread Yang
I'm wondering how the Cassandra protocol brings a newly bootstrapped node "up to speed". for ease of illustration, let's say we just have one key, K, and the value is continually updated: 1,2 ,3 ,4 originally we have 1 node, A, now node B joins, and needs to bootstrap and get its newly assig

Re: Counters 2.1 Accuracy

2015-06-24 Thread Phil Yang
ation-of-counters > > The blog post above states that the new counter implementations are > "safer" although I'm not sure what that means in practice. Will the > counters be 99.99% accurate? How often will they be over or under counted? > > Thanks, Mike. > -- Thanks, Phil Yang

Re: Tables showing up as our_table-147a2090ed4211e480153bc81e542ebd/ in data dir

2015-04-29 Thread Phil Yang
our_table-147a2090ed4211e480153bc81e542ebd/ > > > instead of as > > > our_table/ > > > Why would that happen? We're also seeing lagging compactions and high > cpu usage. > > > Thanks, Don > -- Thanks, Phil Yang

Re: Creating 'Put' requests

2015-04-24 Thread Phil Yang
ode this will quickly become unmanageable, > > and doesn’t lend itself well to dynamically creating row data based on > > various conditions. Is there a way to send a Java object, populated > > with the desired column/value pairs, to the server instead of executing > an > > insert statement? > > Would this require some other library, or does the DataStax Java > > driver support this already? > > > > > > > > Thanks in advance, > > > > Matt > > > > > -- Thanks, Phil Yang

Re: Is 2.1.5 ready for upgrade?

2015-04-22 Thread Phil Yang
; I personally would not run either version in production at this time, >>> but if forced, would prefer 2.1.5 over 2.1.2. >>> >>> =Rob >>> >>> >> >> >> -- >> Cheers, >> Brian >> http://www.integrallis.com >> >> -- Thanks, Phil Yang

Re: Getting " ParNew GC in ... CMS Old Gen ... " in logs

2015-04-22 Thread Phil Yang
Survivor Space: 0 -> 20970080 > > Is above line is indication of something that need to be fixed in the > system?? how can I resolve this? > > > best, > /Shahab > > -- Thanks, Phil Yang

Re: Re-bootstrap node after disk failure

2015-03-25 Thread Phil Yang
. 2015-03-25 13:46 GMT+08:00 Flavien Charlon : > Is it what this command does? In that case the documentation is misleading > because it says: "Use this command to bring up a new data center in an > existing cluster", which is not really what I'm trying to do. > > On

Re: Re-bootstrap node after disk failure

2015-03-24 Thread Phil Yang
ed, > and I would like to re-bootstrap it from the data stored on the other nodes > of the cluster (I have RF=3). > > I am not using vnodes. > > Thanks > Flavien > -- Thanks, Phil Yang

Re: Steps to do after schema changes

2015-03-11 Thread Phil Yang
mn or modifying any table properties? > > Thanks > Ajay > -- Thanks, Phil Yang

Re: Node stuck in joining the ring

2015-03-02 Thread Phil Yang
; >> We saw something similar when bootstrap crashed when rebuilding >> secondary indexes. >> >> See CASSANDRA-8798 >> >> ~mck >> >> >> >> > > > -- > - > Nate McCall > Austin, TX > @zznate > > Co-Founder & Sr. Technical Consultant > Apache Cassandra Consulting > http://www.thelastpickle.com > -- Thanks, Phil Yang

What are the factors that affect the release time of each minor version?

2015-02-28 Thread Phil Yang
ld we make each release more frequently? Or we may make a rule to decide if we need release a new version? For example: "If the latest version was released two weeks ago, or after the latest version we have already resolved 20 issues, we should release a new minor version". -- Thanks, Phil Yang

Re: Counter Column

2014-12-27 Thread Phil Yang
sorry for typo.. timestamp which Cassandra uses is independent on the timezone. Usually, it is recommended to use NTP to reduce the difference of timestamps in each nodes 2014-12-27 21:20 GMT+08:00 Phil Yang : > In java, > http://docs.oracle.com/javase/7/docs/api/java/lang/Syste

Re: Counter Column

2014-12-27 Thread Phil Yang
sandra ring are in different timezone, could it >>> affect the counter column as it depends on the timestamp? >>> >>> Thanks >>> Ajay >>> >> -- Thanks, Phil Yang

Re: 2014 nosql benchmark

2014-12-19 Thread Philo Yang
Today I've also seen this benchmark in Chinese websites. "SequoiaDB" seems come from a Chinese startup company, and in db-engines ranking it's score is 0.00. So IMO I have to say I think this benchmark is a "soft sell". They compare three databases, two written by

Re: full gc too often

2014-12-07 Thread Philo Yang
han the query for a single column. Is there any testing result for the relationship between the "pressure" and the "safety" heap size? We know query a slice with many tombstones is not a good use case, but query a slice without tombstones may be a common use case, right? >

Re: full gc too often

2014-12-04 Thread Philo Yang
Yang 2014-12-05 12:34 GMT+08:00 Tim Heckman : > On Dec 4, 2014 8:14 PM, "Philo Yang" wrote: > > > > Hi,all > > > > I have a cluster on C* 2.1.1 and jdk 1.7_u51. I have a trouble with full > gc that sometime there may be one or two nodes full gc more than o

full gc too often

2014-12-04 Thread Philo Yang
ine without gc trouble. Can anyone help me to find out where is the problem that full gc can't reduce CMS Old Gen? Is it because there are too many objects in heap can't be recycled? I think review the table scheme designing and add new nodes into cluster is a good idea, but I still want to know if there is any other reason causing this trouble. Thanks, Philo Yang

unsubscribe

2014-12-04 Thread Sheausong Yang
>

random thought: rewrite Cassandra using Scala ?

2014-11-04 Thread Yang
thought: would there be any value to rewrite the code in Scala? thanks Yang

RangeTombstoneList.diff AssertionError in 2.1.0

2014-09-28 Thread Philo Yang
(SEPWorker.java:103) [apache-cassandra-2.1.0.jar:2.1.0] at java.lang.Thread.run(Thread.java:744) [na:1.7.0_51] I have also posted this issue on JIRA <https://issues.apache.org/jira/browse/CASSANDRA-8013> Thanks, Philo Yang

Re: why bloom filter is only for row key?

2014-09-17 Thread Philo Yang
Thanks Rob Thanks, Philo Yang 2014-09-16 2:12 GMT+08:00 DuyHai Doan : > Nice catch Rob > > On Mon, Sep 15, 2014 at 8:04 PM, Robert Coli wrote: > >> On Sun, Sep 14, 2014 at 11:22 AM, Philo Yang wrote: >> >>> After reading some docs, I find that bloom filter

Re: why bloom filter is only for row key?

2014-09-15 Thread Philo Yang
loom filter's property between row keys and row keys+column names automatically or by user's config? Thanks, Philo Yang 2014-09-15 2:45 GMT+08:00 DuyHai Doan : > Hello Philo > > Building bloom filter for column names (what you call column key) is > technically possible but

why bloom filter is only for row key?

2014-09-14 Thread Philo Yang
on? Thanks, Philo Yang

Re: Best practices for frequently updated columns

2014-08-15 Thread Philo Yang
) to cache the read request. Write into C* and redis both and read only from redis for the latest bar. Read from C* for previous bars if the memory size is bottleneck. Thanks, Philo Yang 2014-08-14 2:13 GMT+08:00 Robert Coli : > On Wed, Aug 13, 2014 at 8:01 AM, Jeremy Jongsma > wrote: >

select many rows one time or select many times?

2014-07-31 Thread Philo Yang
nd select 1000 times? just like: select from word where user='someuser' and word = 'a'; select from word where user='someuser' and word = 'b'; select from word where user='someuser' and word = 'c'; . Which method will cause lower pressure on Cassandra cluster? Thanks, Philo Yang

Re: "ghost" table is breaking compactions and won't go away… even during a drop.

2014-07-21 Thread Philo Yang
work... Thanks, Philo Yang 2014-07-17 10:32 GMT+08:00 Kevin Burton : > you rock… glad it's fixed in 2.1… :) > > > > > On Wed, Jul 16, 2014 at 7:05 PM, graham sanderson wrote: > >> Known issue deleting and recreating a CF with the same name, fixed in 2.1 >&

Is "timestamp" a reserved word in CQL?

2014-07-04 Thread Philo Yang
s automatically. Is "timestamp" a reserved word in CQL? I'm using Cassandra 2.0.6. Thanks, Philo Yang

How to deal with SSTable FileNotFoundException?

2014-06-29 Thread Philo Yang
ctory) I think the reason is I have dropped this table and recreated it later. And I find this Exception blocks the stream from these nodes to others so bootstrap or rebuild can't finish and is stuck in 100% forever. What should I do to refresh the SSTable list in these nodes? -- Regards, Zhe Yang

Node never know a table has been DROP or CREATE if its gossip is disabled while executing this query

2014-04-26 Thread Zhe Yang
still doesn't know this table. And I find if each node knows there is a table but I drop it when one node's gossip is disabled, this node will never know the table has been dropped. Is this a bug? -- Regards, Zhe Yang

Re: Cassandra 1.20 with Cloudera Hadoop (CDH4) Compatibility Issue

2013-02-16 Thread Yang Song
e new map reduce > framework instead of the old mapred API. I don't see the C* project back > porting their code at this time and if anything Cloudera should update > their release!! > > On Feb 15, 2013, at 9:48 PM, "Yang Song" wrote: > > It is interesting though

Re: Cassandra 1.20 with Cloudera Hadoop (CDH4) Compatibility Issue

2013-02-15 Thread Yang Song
ith it :) > > On Feb 15, 2013, at 7:38 PM, "Dave Brosius" > wrote: > > see https://issues.apache.org/jira/browse/CASSANDRA-5201 > > > On 02/15/2013 10:05 PM, Yang Song wrote: > > Hi, > > Does anyone use CDH4's Hadoop with Cassandra to interact?

Cassandra 1.20 with Cloudera Hadoop (CDH4) Compatibility Issue

2013-02-15 Thread Yang Song
Hi, Does anyone use CDH4's Hadoop with Cassandra to interact? The goal is simply read/write to Cassandra from Hadoop direclty using ColumnFamilyInput(Output)Format, but seems a bit compatibility issue. There are two java exceptions 1. java.lang.IncompatibleClassChangeError: Found interface org.ap

Re: Starting Cassandra

2013-01-17 Thread Yang Song
Daemon.java:350) > > Caused by: java.lang.ClassNotFoundException: > org.apache.hadoop.mapred.JobConf > > at java.net.URLClassLoader$1.run(URLClassLoader.java:366) > > at java.net.URLClassLoader$1.run(URLClassLoader.java:355) > > at java.security.AccessController.doPriv

Re: Starting Cassandra

2013-01-10 Thread Yang Song
Could you also let us know if switching openjdk to jdk@oracle indeed solves the problem? Thanks! Yang 2013/1/10 Sloot, Hans-Peter > I have increased the memory to 4096. Did not help > > > > It is openjdk indeed. > > java-1.6.0-openjdk.x86_64 >

LOCAL_QUORUM vs EACH_QUORUM

2012-11-01 Thread Yang
use case? within the current code, is there a way to achieve that? if not, creating a new policy does not seem too difficult either. Thanks Yang

guarantee of write-read order?

2012-09-18 Thread Yang
lines; but the fourth line does not see both write results. Thanks Yang

Lock on Cassandra ---- using bakery algo

2012-09-17 Thread Yang
algorithm that provides no fairness, as the MAX() is replaced by a random choice pardon my beginner python usage :) thanks Yang

Re: replace_token code?

2012-09-11 Thread Yang
replied in blue, Thanks Yang I thought the very first log line already acquired ownership , instead of later in the sequence? WARN [main] 2012-09-10 08:00:21,855 TokenMetadata.java (line 160) Token 166594924822352415786406422619018814804 changing ownership from / 10.72.201.80 to

Re: replace_token code?

2012-09-10 Thread Yang
Thanks Jim, looks I'll have to read into the code to understand what is happening under the hood yang On Mon, Sep 10, 2012 at 9:45 AM, Jim Cistaro wrote: > We have seen various issues from these replaced nodes hanging around. > For clusters where a lot of nodes have been repla

replace_token code?

2012-09-10 Thread Yang
emove 80 forcefully from gossip. instead, a few seconds later, it believed that .80 became live again. I don't have much understanding of the Gossip protocol, but roughly know that it's probability-based, looks we need an "assertive"/"NOW" membership control message

Re: why do I have to use internal IP for EC2 nodes?

2012-09-04 Thread Yang
ton > Freelance Developer > @aaronmorton > http://www.thelastpickle.com > > On 5/09/2012, at 7:37 AM, Yang wrote: > > > http://www.datastax.com/docs/1.1/initialize/cluster_init > > > > > > says: > > > > " Note In the - seeds list property

Re: keyspace not propagated to a new node?

2012-09-04 Thread Yang
this is 1.1.2 unfortunately the logs does not show anything except for the initial startup sequences. on the siblings, somehow the /var/log/cassandra/system.log were wrongly deleted, so I can't see their responses either I'll try resetlocalschema next time thanks! yang On Tue, Sep 4,

keyspace not propagated to a new node?

2012-09-04 Thread Yang
does not see the KS. do I have to do something? I thought the bootstrap process would get the KS'es??? also I tried the -Dcassandra.replace_token, same issue thanks Yang

a simple solution to replace dead node

2012-08-29 Thread Yang
he drawback is that you can do automatic launching of the new host. but that limitation is due to nventor/Puppet. Just want to share with the community here, cuz many people probably run Puppet+nventory, so this simple solution might work well Thanks Yang

Re: JMX(RMI) dynamic port allocation problem still exists?

2012-08-29 Thread Yang
nice, thanks guys! On Tue, Aug 28, 2012 at 11:58 PM, Senthilvel Rangaswamy < senthil...@gmail.com> wrote: > We use Jolokia. Its pretty awesome. > > > On Tue, Aug 28, 2012 at 11:44 PM, Peter Schuller < > peter.schul...@infidyne.com> wrote: > >> I can recommend Jolokia highly for providing an HTTP/

Re: how is this possible ---- token range sum > 100% ?

2012-08-29 Thread Yang
/CASSANDRA-3412 > [2] > https://github.com/apache/cassandra/blob/trunk/src/java/org/apache/cassandra/service/StorageServiceMBean.java#L342 > > On Wed, Aug 29, 2012 at 7:02 PM, Yang wrote: > > I have 16 nodes, each of them should have only 6.25%, but now they all > show >

Re: JMX(RMI) dynamic port allocation problem still exists?

2012-08-28 Thread Yang
l.iac.com/owa/redir.aspx?C=PLVE6taKpU--Dxw69WVEOtdUcArCWM8IUH6LBjdXcM7STlqwkARq8mA8Nva_mtGaSKmmva4pWxE.&URL=http%3a%2f%2fwww.datastax.com%2fdocs%2f1.1%2finstall%2finstall_ami> Yang On Mon, Aug 27, 2012 at 9:03 PM, Nick Bailey wrote: > The problem still exists. There was a discussion a

Re: JMX(RMI) dynamic port allocation problem still exists?

2012-08-27 Thread Yang
ot;Hiller, Dean" wrote: > In cassandra-env.sh, search on JMX_PORT and it is set to 7199 (ie. Fixed) > so that solves your issue, correct? > > Dean > > From: Yang mailto:tedd...@gmail.com>> > Reply-To: "user@cassandra.apache.org<mailto:user@cassandra

JMX(RMI) dynamic port allocation problem still exists?

2012-08-27 Thread Yang
yself? Thanks Yang

nodetool output through REST API?

2012-08-20 Thread Yang
ot; , for example through some REST API or python API, so that I avoid the possible changes in formatting of the output? I checked pycassa, it doesn't seem to have an API for the JMX services Thanks Yang

Re: replace dead node? " token -1 "

2012-08-15 Thread Yang
1 approach. If you don't have the > need for token consistency, then it might be more attractive for you. We > don't use it, so I cannot say if that approach has any issues, etc. > > Jim > > From: Yang > Reply-To: > Date: Wed, 15 Aug 2012 02:00:55 -0700 >

Re: replace dead node? " token -1 "

2012-08-15 Thread Yang
ame in terms of partitioning the data range. Thanks Yang On Wed, Aug 15, 2012 at 1:39 AM, Yang wrote: > ok, I see, the cassandra.replace_token setting essentially executes the > manual removeToken step. so the dead node should be removed. > > is this the "old node hanging

Re: replace dead node? " token -1 "

2012-08-15 Thread Yang
lready, so it's another issue? Thanks Yang On Tue, Aug 14, 2012 at 11:03 PM, Yang wrote: > Jim: > > thanks a lot for the info. > > when you say "old nodes sometimes hanging around as "unreachable nodes" > when describing cluster", you mean after the

Re: replace dead node? " token -1 "

2012-08-14 Thread Yang
1. I'm doing more tests to confirm this behavior Thanks Yang On Tue, Aug 14, 2012 at 10:17 PM, Jim Cistaro wrote: > We use priam to replace nodes using replace_token. We do see some > issues (currently on 1.0.9, as well as earlier versions) with replace_token. > >

Re: replace dead node? " token -1 "

2012-08-14 Thread Yang
ken ownership is passed to the new node. > > Cheers > > - > Aaron Morton > Freelance Developer > @aaronmorton > http://www.thelastpickle.com > > On 15/08/2012, at 11:07 AM, Yang wrote: > > previously when a node dies, I remember the documents describes tha

replace dead node? " token -1 "

2012-08-14 Thread Yang
uot; thing, but assigns the original token T to the new node. if so, would the duplicate token (same token but different ip) cause problems? Thanks Yang

Re: incremental backup and Priam?

2012-08-14 Thread Yang
built in incremental backups off node. (AFAIK) > > Cheers > > - > Aaron Morton > Freelance Developer > @aaronmorton > http://www.thelastpickle.com > > On 15/08/2012, at 8:16 AM, Yang wrote: > > in the initial incremental backup implementation, >

incremental backup and Priam?

2012-08-14 Thread Yang
code pretty much does the same thing as the original addSSTable() incremental backup . so the Priam backup code operates outside of Cassandra write path? any insight into why this approach was chosen instead of using the incremental backup provided by Cassandra? thanks Yang

Dynamic columns in a column family?

2012-01-06 Thread Frank Yang
Hi everyone, I am wondering whether it is possible to not to define the column metadata when creating a column family, but to specify the column when client updates data, for example: CREATE COLUMN FAMILY products WITH default_validation_class= UTF8Type AND key_validation_class=UTF8Type AND compa

Re: how to debug/trace

2011-12-16 Thread Yang
normally I'd just fire up debug in eclipse, make a break point on the Cassandra.server methods. On Fri, Dec 16, 2011 at 2:19 PM, S Ahmed wrote: > How can you possibly trace a read/write in cassandra's codebase when it uses > so many threadpools/executers? > > I'm just getting into threads so I'm

Re: simple get_slice() gives error?

2011-10-24 Thread Yang
zero, possibly due to the slab allocator. so do you remember if there is some place in the Cassandra readpath that always copies the ByteBuffer to one that starts a 0 ? or I'm having some bug incidences I haven't noticed? Thanks Yang On Fri, Jun 10, 2011 at 7:09 PM, Jonathan Ellis wrot

Re: weird problem with performance

2011-10-21 Thread Yang
actually this is only an issue in HH, since HH writes all the stored messages into the same row, so locking is a problem 2011/10/21 Jérémy SEVELLEC : > @Araron you're right and i was wrong! > > 2011/10/20 Yang >> >> found it , https://issues.apache.org/jira/browse/C

Re: weird problem with performance

2011-10-20 Thread Yang
t_writes#hinted-handoff-writes > And it could be more expensive to achieve QUORUM when you read in that > context. > It may be one explanation. You can turn cassandra log into debug level to > see what happen when when there is a down node. > 2011/10/19 Yang >> >> 3 >&g

Re: SimpleAuthenticator / SimpleAuthorization missing

2011-10-20 Thread Yi Yang
See: https://issues.apache.org/jira/browse/CASSANDRA-2922 On Thu, Oct 20, 2011 at 4:08 AM, Pierre Chalamet wrote: > Hello, > > SimpleAuthenticator & SimpleAuthorization just disappear in release > 1.0.0... > > Will this stay like this or is it a release bug ? > > Thanks, > - Pierre >

Re: weird problem with performance

2011-10-19 Thread Yang
3 sorry forgot this important info On Oct 19, 2011 11:31 AM, "Jérémy SEVELLEC" wrote: > Hi, what is your replication_factor? > > 2011/10/19 Yang > >> I'm using a cassandra version compiled from 1.0.0 github HEAD. >> >> I have 3 nodes, A B and C

weird problem with performance

2011-10-19 Thread Yang
ny possible reasons for this?(or how to debug this?) Thanks Yang

Re: commitlog replay extremely slow?

2011-10-18 Thread Yang
if (mutatedIndexedColumns != null) it's a bit weird, since I checked that indexLockFor() does return distinct objects from the array of 4096 objects. but every time I do a jstack, it shows them in this state, what are they blocking on ?? On Tue, Oct 18, 2011 at 4:37 PM, Yang

commitlog replay extremely slow?

2011-10-18 Thread Yang
4f39d3e52f82d060bf96c2be0df6ff6782bc48e5 ? those changes after this do not sound immediately related to the possible issue I'm seeing Thanks Yang

DELETE where colname == given_value ?

2011-10-18 Thread Yang
there is not a way to do this in batch. is it possible to add this logic to a flow like get_range_slice, which scans through the sstables ? Thanks Yang

tombstone not removed after compaction?

2011-10-12 Thread Yang
I set GC_grace to 2 hours, for testing. then I compacted the sstables using nodecmd, but the resulting sstables contained many Deletion records older than 2 hours "0d5e32633036663463310001": [["0132f8820139303030303030303030303030303030303030303030303030303030

Re: different size sstable on different nodes?

2011-10-11 Thread Yang
TZ=GMT date Tue Oct 11 17:40:31 GMT 2011 so it's almost 3 hours old, but I just finished running the compaction, and GC_SECONDS is 7200 , set short for testing purpose. so this deletion column should have been thrown away during the compaction On Tue, Oct 11, 2011 at 10:33 AM, Yang

different size sstable on different nodes?

2011-10-11 Thread Yang
on to figure out, just want to see if there are any apparent things I missed thanks Yang

add bloomfilter results to nodetool?

2011-10-11 Thread Yang
I find the info about bloomfilter very helpful, could we add that to NodeCmd ? Thanks Yang

factors on the effectiveness of bloom filter?

2011-10-10 Thread Yang
changed (or the only possibility to change they key is simply juggle the byte order), is there any measure to increase the effectiveness of bloom filters? thanks Yang

Re: ebs or ephemeral

2011-10-10 Thread Yi Yang
Agree, EBS systems are not so good for cassandra systems and during previous conversations in this mail list, people tend to use ephemeral. 從我的 BlackBerry® 無線裝置 -Original Message- From: Sasha Dolgy Date: Mon, 10 Oct 2011 10:03:26 To: Reply-To: user@cassandra.apache.org Subject: Re: eb

Re: ebs or ephemeral

2011-10-07 Thread Yi Yang
Obviously ephemeral. It has higher IO availability, will not affect your Ethernet IO performance, and it is free (included in instance price) and the redundancy is provided by cassandra itself. 從我的 BlackBerry® 無線裝置 -Original Message- From: Madalina Matei Date: Fri, 7 Oct 2011 09:02:06

Re: Why is mutation stage increasing ??

2011-10-05 Thread Yi Yang
Well what client are you using? And can you give a hint to your node hardware? 從我的 BlackBerry® 無線裝置 -Original Message- From: Philippe Date: Wed, 5 Oct 2011 10:33:21 To: user Reply-To: user@cassandra.apache.org Subject: Why is mutation stage increasing ?? Hello, I have my 3-node, RF=3 c

Re: EC2 raid0 disks ?

2011-10-04 Thread Yang
rives are all virtual, would there be any benefit at all in doing a raid0 ? Yang 2011/10/4 Joaquin Casares : > Hello again, > Also, EBS volumes can be attached, but the performance issues cause other > issues when running a healthy cluster. From experience running clusters on > EBS vo

  1   2   3   >