NGCC 2017 Announcment

2017-08-01 Thread Gary Dusbabek
We are pleased to announce the 2017 Next Generation Cassandra Conference (NGCC) that will be held on Tuesday September 26th at the Geekdom Event Center in San Antonio, Texas. This one day conference is targed toward Apache Cassandra developers and large-scale cluster operators, but is opened to any

Cassandra at Apache: Big Data, Sept 28-30 in Budapest

2015-06-10 Thread Gary Dusbabek
://events.linuxfoundation.org/events/apache-big-data-europe/program/cfp You have until 10 July to put your proposals together. You will be notified by 24 July whether or not your proposal is accepted. Kind Regards, Gary Dusbabek

Re: Running multiple compactions concurrently

2011-02-25 Thread Gary Dusbabek
If your cluster has the overall IO capacity to perform a simultaneous compaction on every node and still adequately service reads and writes, then yes. If you're concerned about availability, your best bet will be to stagger the compactions. Gary. On Fri, Feb 25, 2011 at 04:24, Daniel Josefsson

Re: rename index

2011-02-17 Thread Gary Dusbabek
I haven't tried this, but it should work in theory... Keep the wrongly named index for now. Create the rightly named index, then bring down the node and swap file names for the indexes. After that, you can safely drop the wrongly named index. Unfortunately, you need to do this for each node. G

Re: Keyspace additions are not replicated to one node in the cluster

2011-02-16 Thread Gary Dusbabek
The first thing you should try is to restart the node that is not syncing. That will reset the version it gossips, which was not always getting updated (fixed in CASSANDRA-2083). Gary. On Tue, Feb 15, 2011 at 18:25, Shu Zhang wrote: > Hi, a node in my cassandra cluster will not accept keyspace

Re: ApplicationState Schema has drifted from DatabaseDescriptor

2011-02-09 Thread Gary Dusbabek
Aaron, It looks like you're experiencing a side-effect of CASSANDRA-2083. There was at least one place (when node B received updated schema from node A) where gossip was not being updated with the correct schema even though DatabaseDescriptor had the right version. I'm pretty sure this is what yo

Re: Newbie Replication/Cluster Question

2011-01-13 Thread Gary Dusbabek
It is impossible to properly bootstrap a new node into a system where there are not enough nodes to satisfy the replication factor. The cluster as it stands doesn't contain all the data you are asking it to replicate on the new node. Gary. On Thu, Jan 13, 2011 at 13:13, Mark Moseley wrote: > I

Re: cassandra.yaml customization per node

2010-12-30 Thread Gary Dusbabek
Funny you should mention that. I just put my half-baked solution to this problem on github today. https://github.com/gdusbabek/cassandra-maker. It generates cassandra.yaml files (and entire config directories too) that are based on the svn defaults. It should be easy to customize it to fit your

Re: Having trouble getting cassandra to stay up

2010-12-27 Thread Gary Dusbabek
You might want to try starting over. Configure your initial keyspaces in conf/cassandra.yaml and load them into your cluster with bin/schematool. That nasty stack trace indicates the server is getting data that is not formatted the way it expects. Please verify that your cassandra servers are bo

Re: Running multiple instances on a single server --micrandra ??

2010-12-14 Thread Gary Dusbabek
On Tue, Dec 7, 2010 at 20:25, Edward Capriolo wrote: > I am quite ready to be stoned for this thread but I have been thinking > about this for a while and I just wanted to bounce these ideas of some > guru's. > > ... > > The upsides ? > 1) Since disk/instance failure only degrades the overall perf

Re: cassandra version update and my cluster

2010-12-02 Thread Gary Dusbabek
0.6->0.7 will require a full cluster restart. 0.7->0.8 will require a rolling restart, so long as CASSANDRA-1015 is completed. keyspace/cf definitions will be readable across major versions, or there will be a way provided to migrate them if that is not possible. Gary. On Wed, Dec 1, 2010 at 19

Re: Booting Cassandra v0.7.0 on Windows: rename failed

2010-11-29 Thread Gary Dusbabek
Windows is notoriously bad about hanging on to file handles. Make sure there are no explorer windows or command line windows open to d:\cassandra\data\system\, and then hope for the best. Gary. On Mon, Nov 29, 2010 at 02:49, Ramon Rockx wrote: > Hi, > > Recently I downloaded Cassandra v0.7.0 rc

Re: Deleting the datadir for system keyspace in 0.7

2010-11-15 Thread Gary Dusbabek
Mostly these things: stored schema information, cached cluster info, the token, hints. Everything but the hints can be replaced. Gary. On Mon, Nov 15, 2010 at 06:29, Utku Can Topçu wrote: > Hello All, > > I'm wondering before restarting the a node in a cluster. If I delete the > system keyspace

Re: 0.6 to 0.7 upgrade assumptions

2010-11-02 Thread Gary Dusbabek
You'll need to convert from storage-conf.xml to cassandra.yaml and import your schema at some point. NEWS.txt outlines the general approach (see Upgrading). Gary. On Tue, Nov 2, 2010 at 13:31, Erik Onnen wrote: > Hello, > We're planning an upgrade from 0.6.7 (after it's released) to 0.7.0 (afte

Re: Fatal error: Error instantiating snitch class 'org.apache.cassandra.locator.SimpleSnitch'.

2010-10-29 Thread Gary Dusbabek
There's not a lot of useful information in that error. Cassandra consumes the stack trace and any exceptions underneath that cause the error instantiating the snitch. I've created https://issues.apache.org/jira/browse/CASSANDRA-1682 so we can include a full stack trace. In the meantime, I'd say

Re: Question regarding support of batch_mutate + delete + slice predicate

2010-10-28 Thread Gary Dusbabek
The main difficulty is that row mutations are currently represented only in terms of individual columns. This has implications in the way the transaction is carried out and represented in the commit log. Introducing deletable slices is doable, but keeping it within the semantics of column family o

Re: Time to wait for CF to be consistent after stopping writes.

2010-10-27 Thread Gary Dusbabek
On Wed, Oct 27, 2010 at 05:08, Utku Can Topçu wrote: > Hi, > > For a columnfamily in a keyspace which has RF=3, I'm issuing writes with > ConsistencyLevel.ONE. > > in the configuration I have: > - memtable_flush_after_mins : 30 > - memtable_throughput_in_mb : 32 > > I'm writing to this columnfamil

Re: Cassandra newbie question

2010-10-27 Thread Gary Dusbabek
On Wed, Oct 27, 2010 at 03:24, Arijit Mukherjee wrote: > Hi All > > I've another related question. > > I am using a stream of records of the form (A, B, n) where the pair > (A,B) can occur multiple times. For example, you could have the > following rset of records - > > A, B, 2 > P, Q, 5 > X, Y, 3

Re: Best practice for adding new nodes to ring

2010-10-26 Thread Gary Dusbabek
On Tue, Oct 26, 2010 at 14:56, Edward Capriolo wrote: > On Tue, Oct 26, 2010 at 1:45 PM, Stu Hood wrote: >> While the "adding virtual tokens/nodes to Cassandra" discussion is a good >> one, there are a few factors that might delay (or remove?) the necessity of >> adding that complexity: >> >> *

Re: batch_mutate in 0.7

2010-10-25 Thread Gary Dusbabek
client.set_keyspace() On Mon, Oct 25, 2010 at 12:59, Chris Oei wrote: > So, I'm a bit puzzled about how to change my old 0.6 code to 0.7. > In 0.6, I used: >   client.batch_mutate(keySpace, mutationMap, ConsistencyLevel.ONE); > But in 0.7, batch_mutate no longer has a keyspace argument, so I used

Re: Hung Repair

2010-10-25 Thread Gary Dusbabek
Can you produce a thread dump on the machine? kill -3 ought to do it. JConsole can be your friend at a time like this too. It might be painstaking, but you can check the CPU time used by each thread using the java.lang.Threading mbean. There's an interesting jconsole plugin that is supposed to

Re: how to CompareWith LongType

2010-10-14 Thread Gary Dusbabek
Pycassa should just take your long and do the right thing with it (packing it into a binary string) before passing it off to thrift. The system tests in the source (test/system/test_thrift_server.py) will give you a very good indication of how to do this. The long is packed into a string using st

Re: 0.7 beta2 - Fatal exception from RowMutationVerbHandler

2010-10-13 Thread Gary Dusbabek
Looks like a bug with hinted-handoff. Will you file a ticket? Gary On Tue, Oct 12, 2010 at 15:51, Michael Moores wrote: > I have a cluster of 8 nodes with a replication factor of 3 and consistency of > QUORUM. > When I stop one node in the cluster I end up with socket read timeouts to > other

Re: Null Pointer Exception / Secondary Indices

2010-10-13 Thread Gary Dusbabek
If you're not seeing the NullPointerException at this point, things are probably good. These messages are expected when logging at DEBUG. Gary. On Tue, Oct 12, 2010 at 02:35, J T wrote: > I rinsed & repeated after updating to the latest trunk version and checking > if the 1571 patch was include

Re: Cassandra newbie question

2010-10-11 Thread Gary Dusbabek
On Mon, Oct 11, 2010 at 04:01, Arijit Mukherjee wrote: > Hi All > > I've just started reading about Cassandra and writing simple tests > using Cassandra 0.6.5 to see if we can use it for our product. > > I have a data store with a set of columns, like C1, C2, C3, and C4, > but the columns aren't m

Re: replacing a dead node

2010-10-11 Thread Gary Dusbabek
On Mon, Oct 11, 2010 at 03:41, Chen Xinli wrote: > Hi, > > We have a cassandra cluster of 6 nodes with RF=3, read-repair enabled, > hinted handoff disabled, WRITE with QUORUM, READ with ONE. > we want to rely on read-repair totally for node failure, as returning > inconsistent result temporarily i

Re: Hardware change of a node in the cluster

2010-10-04 Thread Gary Dusbabek
It should work this way: 1. Move your data to the new node (scp, etc.) 2. Make sure the new node is configured to use the same token as the new node. 3. Stand up the new node. 4. Turn off the old node. If your environment is volatile, it's probably best to run `nodetool repair` on the new node.

Re: avro + cassandra + ruby

2010-09-29 Thread Gary Dusbabek
We have a system test that tests this (in avro python). see test/system/test_avro_standard.py:TestStandardOperations.test_multiget_slice_simple. On Wed, Sep 29, 2010 at 01:06, Gabor Torok wrote: > Hi, > I'm attempting to use avro to talk to cassandra because the ruby thrift > client's read perf

Re: inter node protocol for 0.7 nightly

2010-09-21 Thread Gary Dusbabek
1465 maybe? On Mon, Sep 20, 2010 at 16:00, Aaron Morton wrote: > Just took a look upgrading from from 31/08 nightly to the 20/09 and noticed > the news.txt says... > "The Cassandra inter-node protocol is incompatible with 0.6.x releases (and > with 0.7 beta1)" > Could someone point me to the tick

Re: Building a local cluster in Linux

2010-09-20 Thread Gary Dusbabek
On Mon, Sep 20, 2010 at 10:02, Rodrigo Hjort wrote: > Hello all, > > In order to build a Cassandra cluster exclusively for availability and > replication testings, I thought of a simple solution, based on a single > Linux instance, with no virtualization at all. > > The idea was to initialize ever

Re: FatClient Gossip error and some other problems

2010-09-20 Thread Gary Dusbabek
On Mon, Sep 20, 2010 at 09:51, shimi wrote: > I have a cluster with 6 nodes on 2 datacenters (3 on each datacenter). > I replaced all of the servers in the cluster (0.6.4) with new ones (0.6.5). > My old cluster was unbalanced since I was using Random Partitioner and I > bootstrapped all the nodes

Re: 0.7 live schema updates

2010-09-16 Thread Gary Dusbabek
beta-2 will include the ability to set these values and others. Look for the system_update_column_family() and system_update_keyspace() methods. Gary. On Thu, Sep 16, 2010 at 02:38, Marc Canaleta wrote: > Hi! > I like the new feature of making live schema updates. You can add, drop and > rename

Re: Getting client only example to work

2010-09-16 Thread Gary Dusbabek
I discovered some problems with the fat client earlier this week when I tried using it. It needs some fixes to keep up with all the 0.7 changes. Gary. On Thu, Sep 16, 2010 at 05:48, Asif Jan wrote: > > Hi > I am using 0.7.0-beta1 , and trying to get the contrib/client_only example > to work. >

Re: Embedded Cassandra in JBoss

2010-09-15 Thread Gary Dusbabek
On Wed, Sep 15, 2010 at 09:17, Sandor Molnar wrote: > Hello guys! > > I just started researching today whether we can use Cassandra in our software > or not and I need to know if it is possible to use embedded Cassandra in > Jboss somehow. I googled it and I found several pages like > http://wik

Re: Few questions regarding cassandra deployment on windows

2010-09-10 Thread Gary Dusbabek
On Thu, Sep 9, 2010 at 22:23, kannan chandrasekaran wrote: > > Thanks for the replies My comments in Bold... > Kannan > > > From: Gary Dusbabek > To: user@cassandra.apache.org > Sent: Thu, September 9, 2010 5:43:31 AM > Subject: Re: Few questions regarding cass

Re: Few questions regarding cassandra deployment on windows

2010-09-09 Thread Gary Dusbabek
On Tue, Sep 7, 2010 at 17:42, kannan chandrasekaran wrote: > Hi All, > > We are currently considering Cassandra for our application. > > Platform: > * a single-node cluster. > * windows '08 > * 64-bit jvm > > For the sake of brevity let, > Cassandra service =  a single node cassandra server runnin

Re: Calls block when using Thrift API

2010-08-30 Thread Gary Dusbabek
If you're only interested in accessing data natively, I suggest you try the "fat client." It brings up a node that participates in gossip, exposes the StorageProxy API, but does not receive a token and so does not have storage responsibilities. StorageService.instance.initClient(); in 0.7 you wi

Re: RowMutationVerbHandler.java (line 78) Error in row mutation

2010-08-30 Thread Gary Dusbabek
Is it possible this was a new node with a manual token and autobootstrap turned off? If not, could you give more details about the node? Gary. On Fri, Aug 27, 2010 at 17:58, B. Todd Burruss wrote: > i got the latest code this morning.  i'm testing with 0.7 > > > ERROR [ROW-MUTATION-STAGE:388]

Re: StackOverflowError on startup!

2010-08-26 Thread Gary Dusbabek
I'm willing to bet this has something to do with the system table initialization trying to delete its stats, which it can't do until it's initialized, which means it tries to delete its stats, which it can't do until it's initialized, which... you get the picture. The stack trace is very similar

Re: 0.7 beta 1 - "error in row mutation" and NPE

2010-08-23 Thread Gary Dusbabek
t the cluster is quiescent before sending schema updates to a random node. Gary. On Mon, Aug 23, 2010 at 14:03, Gary Dusbabek wrote: > It looks like you're running into > https://issues.apache.org/jira/browse/CASSANDRA-1403, which was fixed > last week and will be included in be

Re: 0.7 beta 1 - "error in row mutation" and NPE

2010-08-23 Thread Gary Dusbabek
It looks like you're running into https://issues.apache.org/jira/browse/CASSANDRA-1403, which was fixed last week and will be included in beta2. If you are experiencing this on trunk, please do file another ticket, or comment on the existing one. Gary. On Mon, Aug 23, 2010 at 13:33, B. Todd Bur

Re: Replication factor and other schema changes in >= 0.7

2010-08-20 Thread Gary Dusbabek
It is coming. In fact, I started working on this ticket yesterday. Most of the settings that you could change before will be modifiable. Unfortunately, you must still manually perform the repair operations, etc., afterward. https://issues.apache.org/jira/browse/CASSANDRA-1285 Gary. On Thu, Aug

Re: Errors with Cassandra 0.7

2010-08-20 Thread Gary Dusbabek
On Thu, Aug 19, 2010 at 16:30, Alaa Zubaidi wrote: > Hi, > > I am trying to run Cassandra 0.7 and I am getting different errors: First it > was while calling client.insert and now while calling set_keyspace (see > below). > > Note: I get the following when I start Cassandra: > *10/08/19 12:58:26 I

Re: MIGRATION-STAGE: IllegalArgumentException: value already present

2010-08-16 Thread Gary Dusbabek
Yes. definitely open a ticket. Gary On Mon, Aug 16, 2010 at 20:05, Arya Goudarzi wrote: > While inserting into a 3 node cluster, one of the nodes got this exception in > its log: > > ERROR [MIGRATION-STAGE:1] 2010-08-16 17:46:24,090 CassandraDaemon.java (line > 82) Uncaught exception in thread

Re: Index package

2010-08-14 Thread Gary Dusbabek
Please see ColumnFamilyStore.scan(). On Sat, Aug 14, 2010 at 15:01, Carlos Sanchez wrote: > All, > > Could I know what package or classes are used in Cassandra for secondary > column indices? > > Thanks > > Carlos > > This email message and any attachments are for the sole use of the intended >

Re: Count rows

2010-08-13 Thread Gary Dusbabek
Should we close https://issues.apache.org/jira/browse/CASSANDRA-653 then? Fetching a count of all rows is just a specific instance of fetching the count of a range or rows. I spoke to a programmer at the summit who was working on this ticket mainly as a way of getting familiar with the codebase.

Re: Reload/Update schema 0.7

2010-08-12 Thread Gary Dusbabek
You should take a look at http://wiki.apache.org/cassandra/LiveSchemaUpdates loadSchemaFromYaml() is intended to initialize the schema on a seed node in a new cluster (or one that has been upgraded from 0.6). It is an operation that should only be performed one time *per cluster.* Gary On Wed,

Re: TokenRange contains endpoints without any port information?

2010-08-09 Thread Gary Dusbabek
On Sun, Aug 8, 2010 at 07:21, Carsten Krebs wrote: > > I'm wondering why a TokenRange returned by describe_ring(keyspace) of the > thrift API just returns endpoints consisting only of an address but omits any > port information? > My first thought was, this method could be used to expose some in

Re: set ReplicationFactor and Token at Column Family/SuperColumn level.

2010-08-05 Thread Gary Dusbabek
On Thu, Aug 5, 2010 at 14:59, Zhong Li wrote: > All, > > Thanks for Apache Cassandra Project, it is great project. > > This is my first time to use it. We install it on 10 nodes and runs great. > The 10 nodes cross all 5 datacenters around the world. > > The big thing bother me is initial ring tok

Re: Changing schema w/o losing data - Can it be done?

2010-08-04 Thread Gary Dusbabek
NullPointerException--it sounds like you're restarting? If so, you should look into `nodetool drain`. http://wiki.apache.org/cassandra/FAQ#modify_cf_config Gary On Wed, Aug 4, 2010 at 03:27, David Boxenhorn wrote: > When I change schema I need to delete the commit logs - otherwise I get a > nul

Re: 0.6.4 tag

2010-07-29 Thread Gary Dusbabek
The vote is in process. http://permalink.gmane.org/gmane.comp.db.cassandra.devel/2010 Gary. On Thu, Jul 29, 2010 at 11:34, B. Todd Burruss wrote: > i see a 0.6.4 tag in SVN, but not on cassandra's download page.  is this > ready for use if building from SVN? > >

Re: Bootstrap question

2010-07-22 Thread Gary Dusbabek
On Wed, Jul 21, 2010 at 14:14, Anthony Molinaro wrote: > Sure, looks like that's in 0.6.4, so I'll probably just rebuild my server > based on the 0.6 branch, unless you want me to test just the patch for > 1221?  Most likely won't get a chance to try until tomorrow, so let me > know. > Either way

Re: Bootstrap question

2010-07-21 Thread Gary Dusbabek
Anthony, I think you're seeing the results of CASSANDRA-1221. Each node has two connections with its peers. One connection is used for gossip, the other for exchanging commands. What you see with 1221 is the command socket getting 'stuck' after a peer is convicted by gossip and then recovers.

Re: Define keyspaces in cassandra 0.7

2010-07-19 Thread Gary Dusbabek
s to manipulate keyspaces. Gary. On Mon, Jul 19, 2010 at 09:46, Gary Dusbabek wrote: > Defining at runtime is, very intentionally, an absolute must.  It > would have been very simple and perhaps user-friendly to add a flag > that loads the schema specified in yaml when cassandra starts

Re: Define keyspaces in cassandra 0.7

2010-07-19 Thread Gary Dusbabek
Defining at runtime is, very intentionally, an absolute must. It would have been very simple and perhaps user-friendly to add a flag that loads the schema specified in yaml when cassandra starts up. I decided against it when implementing the feature because I figured it would have been a disservi

Re: Increasing Replication Factor in 0.7

2010-07-16 Thread Gary Dusbabek
Arya, That is not currently possible in trunk. It would be a good feature though. Care to file a ticket? Gary. On Thu, Jul 15, 2010 at 22:13, Arya Goudarzi wrote: > I recall jbellis in his training showing us how to increase the replication > factor and repair data on a cluster in 0.6. How

Re: Bootstrap Token collision

2010-07-15 Thread Gary Dusbabek
Did you add a new node to the cluster at the time you restarted it? If not, I would think that each node already had a token that would make such a collision impossible, unless we have a new bug to troubleshoot. Gary. On Wed, Jul 14, 2010 at 20:46, Mubarak Seyed wrote: > The cluster nodes were r

Re: KeyRange deletion

2010-06-24 Thread Gary Dusbabek
See CASSANDRA-293 and CASSANDRA-494. Key-range updates touch multiple rows and cannot be performed atomically, so the consistency promise you get would be the same as with batch_mutate. Another other problem is that the update needs to be sent to *any* node that is responsible for part of the ran

Re: nodetool loadbalance : Strerams Continue on Non Acceptance of New Token

2010-06-23 Thread Gary Dusbabek
On Tue, Jun 22, 2010 at 20:16, Arya Goudarzi wrote: > Hi, > > Please confirm if this is an issue and should be reported or I am doing > something wrong. I could not find anything relevant on JIRA: > > Playing with 0.7 nightly (today's build), I setup a 3 node cluster this way: > >  - Added one no

Re: Finding new Cassandra data

2010-06-22 Thread Gary Dusbabek
On Tue, Jun 22, 2010 at 09:59, David Boxenhorn wrote: > In my system, I have a Cassandra front end, and an Oracle back end. Some > information is created in the back end, and pushed out to the front end, and > some information is created in the front end and pulled into the back end. > > Question:

Re: java.lang.RuntimeException: java.io.IOException: Value too large for defined data type

2010-06-18 Thread Gary Dusbabek
*Hopefully* fixed. I was never able to duplicate the problem on my workstation, but I had a pretty good idea what was causing the problem. Julie, if you're in a position to apply and test the fix, it would help help us make sure we've got this one nailed down. Gary. On Thu, Jun 17, 2010 at 00:3

Re: Some questions about using Cassandra

2010-06-16 Thread Gary Dusbabek
On Tue, Jun 15, 2010 at 19:49, Anthony Ikeda wrote: > Is there any concept of Listeners such that when data is added to Cassandra > we can fire off another process to do something with that data? E.g. create > a copy in a secondary database for Business Intelligence reports? Send the > data to an

Re: CF that is like a non-clustered index, are key lookups that fast?

2010-06-15 Thread Gary Dusbabek
On Tue, Jun 15, 2010 at 04:29, S Ahmed wrote: > If you store only the key mappings in a column family, for custom ordering > of rows etc. for things like: > friends = { > >    user_id : { friendid1, friendid2, } > } > or > topForumPosts = { > >     forum_id1 : { post2343, post32343, post32223,

Re: batch_mutate atomic?

2010-06-14 Thread Gary Dusbabek
This question has been coming up quite regularly now. I've added an entry to the FAQ. Please feel free to expand an clarify. http://wiki.apache.org/cassandra/FAQ#batch_mutate_atomic Gary. On Mon, Jun 14, 2010 at 06:43, Ran Tavory wrote: > no, it's not atomic. it just shortens the roundtrip of

Re: cassandra out of heap space crash

2010-06-11 Thread Gary Dusbabek
On Fri, Jun 11, 2010 at 10:14, Julie wrote: > Ran Tavory gmail.com> writes: > >> >> I can't say exactly how much memory is the correct amount, but surely 1G is > very little. By replicating 3 times your cluster now makes 3 times more work > than it used to do, both on reads and on writes while th

Re: Running Cassandra as a Windows Service

2010-06-11 Thread Gary Dusbabek
slightly more approachable on the Windows platform. > > Any suggestions on next steps? > > Todd. > > -Original Message- > From: Gary Dusbabek [mailto:gdusba...@gmail.com] > Sent: Thursday, June 10, 2010 10:59 AM > To: user@cassandra.apache.org > Subject: Re: Runn

Re: Running Cassandra as a Windows Service

2010-06-10 Thread Gary Dusbabek
IMO this is one of those things that would bitrot fairly quickly if it were not maintained. It may be useful in contrib, where curious parties could pick it up, get it back in shape, and send in the changes to be committed. Judging by the sparse interest so far, this probably wouldn't be a good f

Re: Cassandra Cluster Setup

2010-06-07 Thread Gary Dusbabek
ent, streaming > notification (we are talking about 5 rows in 1 cf). Thrift port is not > available for ~30 min. Why is that? I would expect it to be back in a matter > of maybe <1' (this should be data quantity related). > > Thanks, Stephan > > > -Original

Re: Expected wait while bootstrapping?

2010-06-04 Thread Gary Dusbabek
Most of the streaming messages are DEBUG, so you'll have to amp up logging. Gary. On Fri, Jun 4, 2010 at 12:26, Aaron Lav wrote: > I'm trying to bring up a new node.  The log on the new node says: > > INFO 19:00:47,794 Joining: getting bootstrap token > INFO 19:00:49,003 New token will be 98546

Re: Cassandra Cluster Setup

2010-06-04 Thread Gary Dusbabek
Great. It looks as if the replication factor is still 1, not 3. This means that each key lives only on one node. By increasing it to 3, data will be replicated across all 3 nodes. Gary. On Fri, Jun 4, 2010 at 06:51, Stephan Pfammatter wrote: > Tx Nahor/Gary/Ben. I blew everything away, adjus

Re: High CPU Usage since 0.6.2

2010-06-04 Thread Gary Dusbabek
Chris, Can you get me a stack dump of one of the busy nodes (kill -3)? Gary On Thu, Jun 3, 2010 at 22:50, Chris Goffinet wrote: > We're seeing this as well. We were testing with a 40+ node cluster on the > latest 0.6 branch from few days ago. > > -Chris > > On Jun 3, 2010, at 9:55 PM, Lu Ming

Re: Cassandra Cluster Setup

2010-06-03 Thread Gary Dusbabek
Your replication factor is only set to 1, which means that each key will only live on a single node. If you do wait for bootstrapping to commence (takes 90s in trunk, I don't recall in 0.6), you should see some keys moving unless your inserts were all into a small range. Perhaps your being impatie

Re: OutOfMemoryError

2010-06-03 Thread Gary Dusbabek
ipt itself? Thanks. > > Lev. > > On Thu, Jun 3, 2010 at 10:48 AM, Gary Dusbabek wrote: >> Are you running "ant test"?  It defaults to setting memory to 1G.  If >> you're running them outside of ant, you'll need to set max memory >> manually. >> &

Re: OutOfMemoryError

2010-06-03 Thread Gary Dusbabek
Are you running "ant test"? It defaults to setting memory to 1G. If you're running them outside of ant, you'll need to set max memory manually. Gary. On Thu, Jun 3, 2010 at 10:35, Lev Stesin wrote: > Hi, > > I am getting OOM during load tests: > > java.lang.OutOfMemoryError: Java heap space >

Re: Read operation with CL.ALL, not yet supported?

2010-06-02 Thread Gary Dusbabek
Yuki, Can you file a jira ticket for this (https://issues.apache.org/jira/browse/CASSANDRA)? The wiki indicates that this should be allowed: http://wiki.apache.org/cassandra/API Regards, Gary. On Tue, Jun 1, 2010 at 21:50, Yuki Morishita wrote: > Hi, > > I'm testing several read operations(

Re: Error during startup

2010-06-02 Thread Gary Dusbabek
I was able to reproduce the error by staring up a node using RandomPartioner, kill it, switch to OrderPreservingPartitioner, restart, kill, switch back to RandomPartitioner, BANG! So it looks like you tinkered with the partitioner at some point. This has the unfortunate effect of corrupting your s

Re: Questions regarding batch mutates and transactions

2010-05-27 Thread Gary Dusbabek
On Wed, May 26, 2010 at 04:45, Todd Nine wrote: > > Now, here is where I can't find what I need in the doc.  In case 1, if my > mutation from biz op 2 were to fail during a batch mutate operation > encapsulating all mutations, does the batch mutation as a whole not get > executed, or would I still

Re: New Changes in Cass 0.7 Thrift API Interface

2010-05-21 Thread Gary Dusbabek
On Thu, May 20, 2010 at 22:16, Arya Goudarzi wrote: > > P.S. By the way, if someone grants me access, I'd like to contribute to the > documentaions on Apache Cassandra. > I believe anybody can create a wiki account and make changes. Have at it! Gary.

Re: decommission and org.apache.thrift.TApplicationException: get_slice failed: unknown result

2010-05-18 Thread Gary Dusbabek
If I had to guess, I'd say that something at the transport layer had trouble. Possibly some kind of thrift hiccup that we haven't seen before. Your description makes it sound as if the decommission is proceeding normally though. Gary. On Tue, May 18, 2010 at 04:42, Ran Tavory wrote: > What's t

Re: Avro Example Code

2010-05-14 Thread Gary Dusbabek
Be warned: avro support is experimental and incomplete. The avro system tests are probably the best place to start looking. http://svn.apache.org/repos/asf/cassandra/trunk/test/system Gary. On Fri, May 14, 2010 at 15:52, David Wellman wrote: > Does anyone have a good link or example code that w

Re: batch mutate + deletion + slice range predicate unsupported

2010-05-13 Thread Gary Dusbabek
Yes--0.7. I aim to make it part of https://issues.apache.org/jira/browse/CASSANDRA-494 (remove_slice). Gary. On Thu, May 13, 2010 at 16:08, B. Todd Burruss wrote: > i just figured out that can't do a batch mutate + deletion that uses a slice > range predicate.  is adding this functionality targ

Re: how does cassandra compare with mongodb?

2010-05-13 Thread Gary Dusbabek
Cassandra has always enforced the tiniest bit of schema. You basically define how you want your columns and subcolumns to be sorted within column families. You also name the column families and keyspaces. That's all though. The part that is changing is that the keyspaces and column families wil

Re: list of columns

2010-05-13 Thread Gary Dusbabek
We have get_count at the thrift level. You supply a predicate and it returns the number of columns that match. There is also multi_get_count, which is the same operation against multiple keys. Gary. On Thu, May 13, 2010 at 04:18, Bill de hOra wrote: > Admin question - is there a way to list t

Re: How to setup multinode cluster over different servers through firewall

2010-05-11 Thread Gary Dusbabek
You didn't give a lot of details about the remoteness of the remote server. Remote hosts not be able to contact any host on the 192.168.*.* over the internet without routing support. If the remote host is on the same network as the 192.168.*.* host, it should work unless one of those hosts is run

Re: What is the optimal size of batch mutate batches?

2010-05-11 Thread Gary Dusbabek
On Tue, May 11, 2010 at 06:54, David Boxenhorn wrote: > My problem is that my rows are of very varying degrees of bushiness (i.e. > number of supercolums and columns per row). I inserted 592,500 rows > successfully, in a few minutes, and then I hit a batch of exceptionally > bushy rows and ran out

Re: updating column names

2010-05-11 Thread Gary Dusbabek
On Tue, May 11, 2010 at 04:45, vd wrote: > Hi > > I have a column named colom. Can we update column name "colom" to > "column" during runtime or via API ? > This will require two operations: remove and insert. Gary.

Re: Rolling upgrade

2010-05-11 Thread Gary Dusbabek
On Mon, May 10, 2010 at 17:01, Tatsuya Kawano wrote: > Hi, > > Does Cassandra support rolling restart recipe between minor version > upgrade? I mean rolling restart is a way to upgrade Cassandra version > or change configuration **without** bringing down the whole cluster. > The recipe will be som

Re: why is streaming done in 32 MB chunks ?

2010-05-06 Thread Gary Dusbabek
64 MB gave Windows heartburn. We never considered 16 MB chunks. Gary. On Thu, May 6, 2010 at 02:30, vineet daniel wrote: > Hi > > Just out of curiosity want to know why streaming is done with 32MB chunks > and not with 16 or 64 MB chunks. Any specific reasons behind 32 MB or its > just like th

Re: Add a new keyspace in cassandra cluster

2010-05-05 Thread Gary Dusbabek
Yes. You need to edit the configuration of every machine in the cluster. Gary. On Wed, May 5, 2010 at 06:27, Yu-Chun Chang wrote: > Dear all, > I'm a starter for playing Cassandra. I've set up three machines (called > PC_A, PC_B, PC_C) and run them as a Cassandra cluster. > I've inserted a reco

Re: Strange streaming behaviour

2010-05-03 Thread Gary Dusbabek
Martin, Please create a ticket and include the relevant parts of your storage-conf. To summarize, the output gives you the impression that bootstrap has completed normally, but when you check, it appears to be hung on the receiving nodes? Do you mind turning debug on and and seeing if you can re

Re: Regarding Cassandra Scalability

2010-04-19 Thread Gary Dusbabek
On Sun, Apr 18, 2010 at 11:14, dir dir wrote: > Hi Gary, > >>The main reason is that the compaction operation (removing deleted >>values) currently requires that an entire row be read into memory. > > Thank you for your explanation. But I still do not understand what do you > mean. > When you del

Re: Regarding Cassandra Scalability

2010-04-18 Thread Gary Dusbabek
On Sat, Apr 17, 2010 at 10:50, dir dir wrote: > > What problems can’t it solve? > > No flexible indices > No querying on non PK values > Not good for binary data (>64mb) unless you chunck > Row contents must fit in available memory > > Gary Dusbabek say: Row content

Re: Is it possible to get all records in a CF?

2010-04-15 Thread Gary Dusbabek
You'll have to scan the CF. If you're using OrderPreservingPartitioner please see 'get_range_slices' (http://wiki.apache.org/cassandra/API). It would help if you had an idea of where the key might be, so you would know where to start scanning. Gary. On Thu, Apr 15, 2010 at 21:01, Jared Laprise

Re: AssertionError: DecoratedKey(...) != DecoratedKey(...)

2010-04-15 Thread Gary Dusbabek
log I haven't seen any other > irregularities. (maybe there are, but they haven't surfaced). Does this > assertion mean data corruption or something else that's worth waiting to > 0.6.1 for? > > On Thu, Apr 15, 2010 at 2:00 PM, Gary Dusbabek wrote: >> >>

Re: Row key: string or binary (byte[])?

2010-04-15 Thread Gary Dusbabek
2010/4/15 Roland Hänel : > Is there any effort ongoing to make the row key a binary (byte[]) instead of > a string? Yes. It went into trunk last night. Please see https://issues.apache.org/jira/browse/CASSANDRA-767. Gary. > In the current cassandra.thrift file (0.6.0), I find: > > const string V

Re: AssertionError: DecoratedKey(...) != DecoratedKey(...)

2010-04-15 Thread Gary Dusbabek
Ran, It looks like you're seeing https://issues.apache.org/jira/browse/CASSANDRA-866. It's fixed in 0.6.1. Gary On Thu, Apr 15, 2010 at 04:06, Ran Tavory wrote: > When restarting one of the nodes in my cluster I found this error in the > log. What does this mean? > >  INFO [GC inspection] 2010

Re: Write consistency

2010-04-08 Thread Gary Dusbabek
On Thu, Apr 8, 2010 at 02:55, Paul Prescod wrote: > In this¹ debate, there seemed to be consensus on the following fact: > > "In Cassandra, say you use N=3, W=3 & R=1. Let’s say you managed to > only write to replicas A & B, but not C. In this case Cassandra will > return an error to the applicati

Re: best practice for migrating data

2010-04-02 Thread Gary Dusbabek
Correct. One node at a time, in rolling fashion. As long as the config files are not drastically different (you isolate your changes to the Keyspaces), you will not have a problem. Gary. On Fri, Apr 2, 2010 at 09:54, yaw wrote: > Hi all, > this tells us to stop and start Cassandra ... > I hope

Re: best practice for migrating data

2010-04-02 Thread Gary Dusbabek
AJ, The wiki gives an outline of how to do this: http://wiki.apache.org/cassandra/FAQ#modify_cf_config Gary On Thu, Apr 1, 2010 at 23:18, AJ Chen wrote: > when adding/changing a column to a column family for existing data in > cassandra, what's a good way to do it? > thanks, > -aj-- > AJ Chen,

Re: Stalled Bootstrapping Process

2010-04-01 Thread Gary Dusbabek
Does the JMX StreamingService list any incoming/outgoing files/hosts on the sending/receiving nodes? Gary. On Thu, Apr 1, 2010 at 10:26, Dan Di Spaltro wrote: > So we are adding another node to the cluster with the latest 0.6 branch > (RC1).  It seems to be hung in some limbo state. > Before boo

  1   2   >