ArchitectureGossip reverted to revision 7 on Cassandra Wiki

2011-04-23 Thread Apache Wiki
Dear wiki user,

You have subscribed to a wiki page Cassandra Wiki for change notification.

The page ArchitectureGossip has been reverted to revision 7 by MakiWatanabe.
The comment on this change is: Need to study more on Generation number logic.
http://wiki.apache.org/cassandra/ArchitectureGossip?action=diffrev1=8rev2=9

--

  
  == Data structures ==
   HeartBeatState 
- Consists of generation and version number. Generation is the timestamp when 
the node is started, represented by seconds since 1970/01/01. It stays the same 
when server is running and grows every time the node is started. Used for 
distinguishing state information before and after a node restart. Version 
number is shared with application states and guarantees ordering. Each node has 
one !HeartBeatState associated with it.
+ Consists of generation and version number. Generation stays the same when 
server is running and grows every time the node is started. Used for 
distinguishing state information before and after a node restart. Version 
number is shared with application states and guarantees ordering. Each node has 
one !HeartBeatState associated with it.
  
   ApplicationState 
  Consists of state and version number and represents a state of single 
component or element within Cassandra. For instance application state for 
load information could be (5.2, 45), which means that node load is 5.2 at 
version 45. Similarly a node that is bootstrapping would have bootstrapping 
application state: (bxLpassF3XD8Kyks, 56) where first one is bootstrap token, 
and the second is version. Version number is shared by application states and 
!HeartBeatState to guarantee ordering and can only grow.


[Cassandra Wiki] Update of SecondaryIndexes_JP by MakiWatanabe

2011-04-23 Thread Apache Wiki
Dear Wiki user,

You have subscribed to a wiki page or wiki category on Cassandra Wiki for 
change notification.

The SecondaryIndexes_JP page has been changed by MakiWatanabe.
http://wiki.apache.org/cassandra/SecondaryIndexes_JP?action=diffrev1=2rev2=3

--

  ## page was copied from SecondaryIndexes
  '''Articles/Blogs'''
-  * A good article by Jonathan Ellis: 
http://www.datastax.com/dev/blog/whats-new-cassandra-07-secondary-indexes
+  * Jonathan Ellisによる解説記事を参照して下さい: 
http://www.datastax.com/dev/blog/whats-new-cassandra-07-secondary-indexes
  
- '''FAQ for Secondary Indexes'''
+ '''セカンダリーインデックスのFAQ'''
  
-  * Q: Are there any limitations beside the hash properties (no between 
queries)? Like size or memory, etc?
-A: No.
+  * Q: ハッシュプロパティ以外にサイズやメモリなど、何か制限はありますか?
+A: いいえ。
  
-  * Q: Are they distributed? If so, how does that work? How are they stored on 
the nodes?
-A: Each node only indexes data that it holds locally.
+  * Q: セカンダリーインデックスは分散してますか?それはどのように動作するのでしょうか?またどのようにノードに格納されていますか?
+A: それぞれのノードは、ローカルに保持しているデータのみをインデックスします。
  
-  * Q: When you write a new row, when/how does the index get updated? What I 
would like to know is the atomicity of the operation, is the index write part 
of the row write?
-A: The row and index updates are one atomic operation.
+  * Q: 
新しい行を挿入した場合、インデックスはいつ、どのように更新されるのでしょうか?オペレーションのアトミック性に関心があります。インデックスの書き込みは行の書き込みの一部なのでしょうか?
+A: 行とインデックスの更新は単一のアトミックなオペレーションです。
  
-  * Q: Is there a difference between creating a secondary index vs creating an 
index CF manually such as users_by_country?
-A: Yes. First, when creating your own index, a node may index data held by 
another node. Second, updates to the index and data are not atomic.
+  * Q: 
セカンダリーインデックスを使うことと、users_by_countryのようなインデックス用のカラムファミリーを自分で作って使用することに違いはありますか?
+A: 
はい。まず、独自のインデックス用カラムファミリを作成した場合、各ノードは他のノードに保持されているデータのインデックスデータを持つ可能性があります。次にそのようなインデックスとデータの更新はアトミックではありません。
  


[Cassandra Wiki] Update of StorageConfiguration_JP by MakiWatanabe

2011-04-23 Thread Apache Wiki
Dear Wiki user,

You have subscribed to a wiki page or wiki category on Cassandra Wiki for 
change notification.

The StorageConfiguration_JP page has been changed by MakiWatanabe.
The comment on this change is: Modify link from SecondaryIndexes to 
SecondaryIndexes_JP.
http://wiki.apache.org/cassandra/StorageConfiguration_JP?action=diffrev1=79rev2=80

--

   * '''index_name'''、'''index_type'''
  
  
-   
このプロパティはセカンダリインデックスを制御します。セカンダリインデックスを使用する場合は両方の値を設定する必要があります。nameには覚えやすくカラムファミリ内で一意な名前を指定してください。typeに設定可能な値は現在はKEYSのみです。詳しくはSecondaryIndexesを参照してください。
+   
このプロパティはセカンダリインデックスを制御します。セカンダリインデックスを使用する場合は両方の値を設定する必要があります。nameには覚えやすくカラムファミリ内で一意な名前を指定してください。typeに設定可能な値は現在はKEYSのみです。詳しくは[[SecondaryIndexes_JP|SecondaryIndexes]]を参照してください。
  
|| プロパティ名 || デフォルト値 ||
|| `index_name` || `なし` ||


[Cassandra Wiki] Update of FAQ_JP by MakiWatanabe

2011-04-23 Thread Apache Wiki
Dear Wiki user,

You have subscribed to a wiki page or wiki category on Cassandra Wiki for 
change notification.

The FAQ_JP page has been changed by MakiWatanabe.
The comment on this change is: Add #seed and #seed_spof.
http://wiki.apache.org/cassandra/FAQ_JP?action=diffrev1=82rev2=83

--

   * [[#replicaplacement|Cassandraはどのデータがどのノードに配置されているかをどのように判定しますか?]]
   * 
[[#cachehitrateunits|JMXで行キャッシュあるいはキーキャッシュのヒット率が0.XX123456789のように表示されます。これはXX%という意味でしょうか?それとも0.XX%でしょうか?]]
   * [[#bigcommitlog|Commit Logが大変肥大化しています。Cassandraは古いCommit Logを削除しないのでしょうか?]]
+  * [[#seed|What are seeds?]]
+  * [[#seed_spof|Does single seed mean single point of failure?]]
+ 
  
  
  Anchor(cant_listen_on_ip_any)
@@ -499, +502 @@

  
  update column family XXX with memtable_flush_after=60;
  
+ Anchor(seed)
+ 
+ 
+ == What are seeds? ==
+ 
+ If you configure your nodes to refer some node as seed, nodes in your ring 
tend to send Gossip message to seeds more often ( Refer to 
[[ArchitectureGossip]] for details ) than to non-seeds. In other words, seeds 
are worked as hubs of Gossip network.
+ With seeds, each node can detect status changes of other nodes quickly.
+ 
+ Seeds are also referred by new nodes on bootstrap to learn other nodes in 
ring.
+ When you add a new node to ring, you need to specify at least one live
+ seed to contact. Once a node join the ring, it learns about the other
+ nodes, so it doesn't need seed on subsequent boot.
+ 
+ There is no special configuration for seed node itself. In stable and
+ static ring, you can point non-seed node as seed on bootstrap though
+ it is not recommended.
+ 
+ 
+ Anchor(seed_spof)
+ 
+ == Does single seed mean single point of failure? ==
+ 
+ If you are using replicated CF on the ring, only one seed in the ring
+ doesn't mean single point of failure. The ring can operate or boot
+ without the seed. However, it will need more time to spread status changes of 
node over the ring.
+ It is recommended to have multiple seeds in production system.
+ 


[jira] [Created] (CASSANDRA-2550) nodetool setcompactionthroughput requiring wrong number of arguments?

2011-04-23 Thread Terje Marthinussen (JIRA)
nodetool setcompactionthroughput requiring wrong number of arguments?
-

 Key: CASSANDRA-2550
 URL: https://issues.apache.org/jira/browse/CASSANDRA-2550
 Project: Cassandra
  Issue Type: Bug
  Components: Tools
Affects Versions: 0.8 beta 1
Reporter: Terje Marthinussen
Priority: Minor


---
case SETCOMPACTIONTHROUGHPUT :
if (arguments.length != 2) { badUse(Missing value argument.); 
}
probe.setCompactionThroughput(Integer.valueOf(arguments[1]));
break;
---

I would think arguments.length should be just 1?



--
This message is automatically generated by JIRA.
For more information on JIRA, see: http://www.atlassian.com/software/jira


[jira] [Updated] (CASSANDRA-2537) CQL: Support for batch insert/delete

2011-04-23 Thread Pavel Yaskevich (JIRA)

 [ 
https://issues.apache.org/jira/browse/CASSANDRA-2537?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
 ]

Pavel Yaskevich updated CASSANDRA-2537:
---

Attachment: CASSANDRA-2537.patch

 CQL: Support for batch insert/delete
 

 Key: CASSANDRA-2537
 URL: https://issues.apache.org/jira/browse/CASSANDRA-2537
 Project: Cassandra
  Issue Type: New Feature
Affects Versions: 0.8 beta 1
 Environment: 3-node Centos 5.5 cluster running 0.8 build from apr20.
Reporter: Cathy Daw
Assignee: Pavel Yaskevich
Priority: Minor
  Labels: cql
 Fix For: 0.8.1

 Attachments: CASSANDRA-2537.patch


 *Test Case To Run*
 {code}
 // Setup
 CREATE COLUMNFAMILY users (
   KEY varchar PRIMARY KEY,
   password varchar);
 //Batch Insert
 BEGIN BATCH USING QUORUM
 INSERT INTO users (KEY, password) VALUES ('user2', 'ch@ngem3b');
 INSERT INTO users (KEY, password) VALUES ('user3', 'ch@ngem3c');
 APPLY BATCH
 {code}
 *Actual Behavior*
 {code}
 cqlsh BEGIN BATCH USING QUORUM
... INSERT INTO users (KEY, password) VALUES ('user2', 'ch@ngem3b');
 Bad Request: line 0:-1 mismatched input 'EOF' expecting K_APPLY
 {code}
 *Documentation Sample*
 {code}
 BEGIN BATCH [USING CONSISTENCY]
 UPDATE CF1 SET name1 = value1, name2 = value2 WHERE KEY = keyname1;
 UPDATE CF1 SET name3 = value3 WHERE KEY = keyname2;
 UPDATE CF2 SET name4 = value4, name5 = value5 WHERE KEY = keyname3;
 APPLY BATCH
 {code}

--
This message is automatically generated by JIRA.
For more information on JIRA, see: http://www.atlassian.com/software/jira


[jira] [Created] (CASSANDRA-2551) nodetool: Automatically calculate compaction progress

2011-04-23 Thread Chris Burroughs (JIRA)
nodetool: Automatically calculate compaction progress
-

 Key: CASSANDRA-2551
 URL: https://issues.apache.org/jira/browse/CASSANDRA-2551
 Project: Cassandra
  Issue Type: Improvement
  Components: Core
Affects Versions: 0.7.4
Reporter: Chris Burroughs
Assignee: Chris Burroughs
Priority: Minor


Every time I run nodetool compaction stats I end up copying bytes compacted and 
in-progress to a shell and dividing them.  I would like a computer to 
automatically do this for me.

--
This message is automatically generated by JIRA.
For more information on JIRA, see: http://www.atlassian.com/software/jira


[jira] [Updated] (CASSANDRA-2551) nodetool: Automatically calculate compaction progress

2011-04-23 Thread Chris Burroughs (JIRA)

 [ 
https://issues.apache.org/jira/browse/CASSANDRA-2551?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
 ]

Chris Burroughs updated CASSANDRA-2551:
---

Attachment: cassandra-0.7-2551.txt

I think I got the jira workflow right...

 nodetool: Automatically calculate compaction progress
 -

 Key: CASSANDRA-2551
 URL: https://issues.apache.org/jira/browse/CASSANDRA-2551
 Project: Cassandra
  Issue Type: Improvement
  Components: Core
Affects Versions: 0.7.4
Reporter: Chris Burroughs
Assignee: Chris Burroughs
Priority: Minor
 Attachments: cassandra-0.7-2551.txt


 Every time I run nodetool compaction stats I end up copying bytes compacted 
 and in-progress to a shell and dividing them.  I would like a computer to 
 automatically do this for me.

--
This message is automatically generated by JIRA.
For more information on JIRA, see: http://www.atlassian.com/software/jira


[jira] [Updated] (CASSANDRA-2549) Start up of 0.8-beta1 on Ubuntu

2011-04-23 Thread Timu Eren (JIRA)

 [ 
https://issues.apache.org/jira/browse/CASSANDRA-2549?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
 ]

Timu Eren updated CASSANDRA-2549:
-

Attachment: cassandra-0.8.0beta1-debian-package.patch

 Start up of 0.8-beta1 on Ubuntu 
 

 Key: CASSANDRA-2549
 URL: https://issues.apache.org/jira/browse/CASSANDRA-2549
 Project: Cassandra
  Issue Type: Bug
  Components: Core
Affects Versions: 0.8 beta 1
 Environment: Linux home.broadley.org.nz 2.6.32-29-generic-pae 
 #58-Ubuntu SMP Fri Feb 11 19:15:25 UTC 2011 i686 GNU/Linux
Reporter: Drew Broadley
  Labels: core, start
 Attachments: cassandra-0.8.0beta1-debian-package.patch


 root@home:/home/drew# cassandra -f
  INFO 14:06:03,261 Logging initialized
  INFO 14:06:03,323 Heap size: 1543831552/1543831552
  INFO 14:06:03,332 JNA not found. Native methods will be disabled.
  INFO 14:06:03,379 Loading settings from file:/etc/cassandra/cassandra.yaml
  INFO 14:06:03,899 DiskAccessMode 'auto' determined to be standard, 
 indexAccessMode is standard
 ERROR 14:06:04,028 Exception encountered during startup.
 java.lang.NoClassDefFoundError: 
 org/apache/cassandra/thrift/UnavailableException
   at java.lang.Class.getDeclaredMethods0(Native Method)
   at java.lang.Class.privateGetDeclaredMethods(Class.java:2444)
   at java.lang.Class.privateGetPublicMethods(Class.java:2564)
   at java.lang.Class.getMethods(Class.java:1427)
   at 
 com.sun.jmx.mbeanserver.MBeanAnalyzer.initMaps(MBeanAnalyzer.java:126)
   at com.sun.jmx.mbeanserver.MBeanAnalyzer.init(MBeanAnalyzer.java:116)
   at 
 com.sun.jmx.mbeanserver.MBeanAnalyzer.analyzer(MBeanAnalyzer.java:104)
   at 
 com.sun.jmx.mbeanserver.StandardMBeanIntrospector.getAnalyzer(StandardMBeanIntrospector.java:66)
   at 
 com.sun.jmx.mbeanserver.MBeanIntrospector.getPerInterface(MBeanIntrospector.java:181)
   at com.sun.jmx.mbeanserver.MBeanSupport.init(MBeanSupport.java:136)
   at 
 com.sun.jmx.mbeanserver.StandardMBeanSupport.init(StandardMBeanSupport.java:64)
   at 
 com.sun.jmx.mbeanserver.Introspector.makeDynamicMBean(Introspector.java:174)
   at 
 com.sun.jmx.interceptor.DefaultMBeanServerInterceptor.registerObject(DefaultMBeanServerInterceptor.java:936)
   at 
 com.sun.jmx.interceptor.DefaultMBeanServerInterceptor.registerMBean(DefaultMBeanServerInterceptor.java:330)
   at 
 com.sun.jmx.mbeanserver.JmxMBeanServer.registerMBean(JmxMBeanServer.java:516)
   at 
 org.apache.cassandra.service.StorageService.init(StorageService.java:231)
   at 
 org.apache.cassandra.service.StorageService.clinit(StorageService.java:171)
   at 
 org.apache.cassandra.locator.DynamicEndpointSnitch.init(DynamicEndpointSnitch.java:78)
   at 
 org.apache.cassandra.config.DatabaseDescriptor.createEndpointSnitch(DatabaseDescriptor.java:429)
   at 
 org.apache.cassandra.config.DatabaseDescriptor.clinit(DatabaseDescriptor.java:294)
   at 
 org.apache.cassandra.service.AbstractCassandraDaemon.setup(AbstractCassandraDaemon.java:98)
   at 
 org.apache.cassandra.service.AbstractCassandraDaemon.activate(AbstractCassandraDaemon.java:314)
   at 
 org.apache.cassandra.thrift.CassandraDaemon.main(CassandraDaemon.java:80)
 Caused by: java.lang.ClassNotFoundException: 
 org.apache.cassandra.thrift.UnavailableException
   at java.net.URLClassLoader$1.run(URLClassLoader.java:217)
   at java.security.AccessController.doPrivileged(Native Method)
   at java.net.URLClassLoader.findClass(URLClassLoader.java:205)
   at java.lang.ClassLoader.loadClass(ClassLoader.java:321)
   at sun.misc.Launcher$AppClassLoader.loadClass(Launcher.java:294)
   at java.lang.ClassLoader.loadClass(ClassLoader.java:266)
   ... 23 more
 Exception encountered during startup.
 java.lang.NoClassDefFoundError: 
 org/apache/cassandra/thrift/UnavailableException
   at java.lang.Class.getDeclaredMethods0(Native Method)
   at java.lang.Class.privateGetDeclaredMethods(Class.java:2444)
   at java.lang.Class.privateGetPublicMethods(Class.java:2564)
   at java.lang.Class.getMethods(Class.java:1427)
   at 
 com.sun.jmx.mbeanserver.MBeanAnalyzer.initMaps(MBeanAnalyzer.java:126)
   at com.sun.jmx.mbeanserver.MBeanAnalyzer.init(MBeanAnalyzer.java:116)
   at 
 com.sun.jmx.mbeanserver.MBeanAnalyzer.analyzer(MBeanAnalyzer.java:104)
   at 
 com.sun.jmx.mbeanserver.StandardMBeanIntrospector.getAnalyzer(StandardMBeanIntrospector.java:66)
   at 
 com.sun.jmx.mbeanserver.MBeanIntrospector.getPerInterface(MBeanIntrospector.java:181)
   at com.sun.jmx.mbeanserver.MBeanSupport.init(MBeanSupport.java:136)
   at 
 com.sun.jmx.mbeanserver.StandardMBeanSupport.init(StandardMBeanSupport.java:64)
   at 
 

svn commit: r1096214 - in /cassandra/branches/cassandra-0.7/src/java/org/apache/cassandra: db/Table.java utils/BloomFilter.java

2011-04-23 Thread jbellis
Author: jbellis
Date: Sat Apr 23 20:16:31 2011
New Revision: 1096214

URL: http://svn.apache.org/viewvc?rev=1096214view=rev
Log:
cleanup

Modified:
cassandra/branches/cassandra-0.7/src/java/org/apache/cassandra/db/Table.java

cassandra/branches/cassandra-0.7/src/java/org/apache/cassandra/utils/BloomFilter.java

Modified: 
cassandra/branches/cassandra-0.7/src/java/org/apache/cassandra/db/Table.java
URL: 
http://svn.apache.org/viewvc/cassandra/branches/cassandra-0.7/src/java/org/apache/cassandra/db/Table.java?rev=1096214r1=1096213r2=1096214view=diff
==
--- 
cassandra/branches/cassandra-0.7/src/java/org/apache/cassandra/db/Table.java 
(original)
+++ 
cassandra/branches/cassandra-0.7/src/java/org/apache/cassandra/db/Table.java 
Sat Apr 23 20:16:31 2011
@@ -634,9 +634,9 @@ public class Table
 }
 }
 
-public String getDataFileLocation(long expectedCompactedFileSize)
+public String getDataFileLocation(long expectedSize)
 {
-String path = DatabaseDescriptor.getDataFileLocationForTable(name, 
expectedCompactedFileSize);
+String path = DatabaseDescriptor.getDataFileLocationForTable(name, 
expectedSize);
 if (path == null)
 {
 // retry after GCing to force unmap of compacted SSTables so they 
can be deleted
@@ -649,7 +649,7 @@ public class Table
 {
 throw new AssertionError(e);
 }
-path = DatabaseDescriptor.getDataFileLocationForTable(name, 
expectedCompactedFileSize);
+path = DatabaseDescriptor.getDataFileLocationForTable(name, 
expectedSize);
 }
 return path;
 }

Modified: 
cassandra/branches/cassandra-0.7/src/java/org/apache/cassandra/utils/BloomFilter.java
URL: 
http://svn.apache.org/viewvc/cassandra/branches/cassandra-0.7/src/java/org/apache/cassandra/utils/BloomFilter.java?rev=1096214r1=1096213r2=1096214view=diff
==
--- 
cassandra/branches/cassandra-0.7/src/java/org/apache/cassandra/utils/BloomFilter.java
 (original)
+++ 
cassandra/branches/cassandra-0.7/src/java/org/apache/cassandra/utils/BloomFilter.java
 Sat Apr 23 20:16:31 2011
@@ -46,23 +46,9 @@ public class BloomFilter extends Filter
 return serializer_;
 }
 
-long emptyBuckets()
-{
-long n = 0;
-for (long i = 0; i  buckets(); i++)
-{
-if (!bitset.get(i))
-{
-n++;
-}
-}
-return n;
-}
-
 private static OpenBitSet bucketsFor(long numElements, int bucketsPer)
 {
-long numBits = numElements * bucketsPer + EXCESS; //TODO overflow?
-return new OpenBitSet((long)Math.min(Long.MAX_VALUE, numBits));
+return new OpenBitSet(numElements * bucketsPer + EXCESS);
 }
 
 /**
@@ -76,7 +62,7 @@ public class BloomFilter extends Filter
 if (bucketsPerElement  targetBucketsPerElem)
 {
 logger.warn(String.format(Cannot provide an optimal BloomFilter 
for %d elements (%d/%d buckets per element).,
-numElements, bucketsPerElement, 
targetBucketsPerElem));
+  numElements, bucketsPerElement, 
targetBucketsPerElem));
 }
 BloomCalculations.BloomSpecification spec = 
BloomCalculations.computeBloomSpec(bucketsPerElement);
 return new BloomFilter(spec.K, bucketsFor(numElements, 
spec.bucketsPerElement));




[jira] [Updated] (CASSANDRA-2404) if out of disk space reclaim compacted SSTables during memtable flush

2011-04-23 Thread Jonathan Ellis (JIRA)

 [ 
https://issues.apache.org/jira/browse/CASSANDRA-2404?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
 ]

Jonathan Ellis updated CASSANDRA-2404:
--

Attachment: 2404-0.7.txt

Patch to route getFlushPath through table.getDataFileLocation so it shares the 
gc-to-clean-up-if-necessary logic.

 if out of disk space reclaim compacted SSTables during memtable flush
 -

 Key: CASSANDRA-2404
 URL: https://issues.apache.org/jira/browse/CASSANDRA-2404
 Project: Cassandra
  Issue Type: Improvement
  Components: Core
Reporter: Aaron Morton
Assignee: Jonathan Ellis
Priority: Minor
 Fix For: 0.7.6

 Attachments: 2404-0.7.txt, 2404-0.8.txt


 During compaction if there is not enough disk space we invoke GC to reclaim 
 unused space.
 During memtable and binary memtable flush we just error out if there is not 
 enough disk space to flush the table. 
 Can we make cfs.createFlushWriter() use the same logic as 
 Table.getDataFileLocation() to reclaim space if needed?

--
This message is automatically generated by JIRA.
For more information on JIRA, see: http://www.atlassian.com/software/jira


[jira] [Updated] (CASSANDRA-2404) if out of disk space reclaim compacted SSTables during memtable flush

2011-04-23 Thread Jonathan Ellis (JIRA)

 [ 
https://issues.apache.org/jira/browse/CASSANDRA-2404?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
 ]

Jonathan Ellis updated CASSANDRA-2404:
--

Attachment: 2404-0.8.txt

 if out of disk space reclaim compacted SSTables during memtable flush
 -

 Key: CASSANDRA-2404
 URL: https://issues.apache.org/jira/browse/CASSANDRA-2404
 Project: Cassandra
  Issue Type: Improvement
  Components: Core
Reporter: Aaron Morton
Assignee: Jonathan Ellis
Priority: Minor
 Fix For: 0.7.6

 Attachments: 2404-0.7.txt, 2404-0.8.txt


 During compaction if there is not enough disk space we invoke GC to reclaim 
 unused space.
 During memtable and binary memtable flush we just error out if there is not 
 enough disk space to flush the table. 
 Can we make cfs.createFlushWriter() use the same logic as 
 Table.getDataFileLocation() to reclaim space if needed?

--
This message is automatically generated by JIRA.
For more information on JIRA, see: http://www.atlassian.com/software/jira


[jira] [Commented] (CASSANDRA-2543) Node not responding, bringing down cluster, marked as up

2011-04-23 Thread Jonathan Ellis (JIRA)

[ 
https://issues.apache.org/jira/browse/CASSANDRA-2543?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=13023600#comment-13023600
 ] 

Jonathan Ellis commented on CASSANDRA-2543:
---

Sure sounds like a classic my memtables and/or caches are too large symptom 
to me. Note that the stack trace has nothing to do with compaction and is in 
fact OOMing trying to allocate a 256KB read buffer.

bq. All my table have a memtable limit of 32MB

Remember that the memtable throughput value is the *serialized* size, in-memory 
size is typically 8x to 12x that. So back of the envelope math is that you're 
in trouble if you haven't tuned the operations threshold down a lot.

 Node not responding, bringing down cluster, marked as up
 

 Key: CASSANDRA-2543
 URL: https://issues.apache.org/jira/browse/CASSANDRA-2543
 Project: Cassandra
  Issue Type: Bug
  Components: Core
Affects Versions: 0.7.4
Reporter: Thibaut
 Fix For: 0.7.6

 Attachments: jstack


 I have one node which constantly hangs and brings done the entire cluster 
 (not giving any answers).
 If I restart the node, the node will hang after a certain number of time. I 
 have no indication
 It's marked as up when executing the nodetool ring command.
 Executing the ring command on the node itself (without any traffic on the 
 cluster) takes at least 2 minutes to execute. The node takes about 50%-100% 
 of cpu over all cpus.
 Netstats doesn't list anything interesting:
 /software/cassandra/bin/nodetool -h localhost netstats
 Mode: Normal
 Not sending any streams.
 Not receiving any streams.
 Pool NameActive   Pending  Completed
 Commandsn/a 0  51064
 Responses   n/a 0 530479
 I attached the jstack of the node. There are no indications that the node has 
 faulty hardware. 
 /usr/bin/java -ea -XX:+UseThreadPriorities -XX:ThreadPriorityPolicy=42 
 -Xms5254M -Xmx5254M -Xmn400M -XX:+HeapDumpOnOutOfMemoryError -Xss128k 
 -XX:+UseParNewGC -XX:+UseConcMarkSweepGC -XX:+CMSParallelRemarkEnabled 
 -XX:SurvivorRatio=8 -XX:MaxTenuringThreshold=1 
 -XX:CMSInitiatingOccupancyFraction=75 -XX:+UseCMSInitiatingOccupancyOnly 
 -Djava.net.preferIPv4Stack=true -Dcom.sun.management.jmxremote.port=8080 
 -Dcom.sun.management.jmxremote.ssl=false 
 -Dcom.sun.management.jmxremote.authenticate=false 
 -Dlog4j.configuration=log4j-server.properties 
 -Dlog4j.defaultInitOverride=true -Dcassandra-foreground=yes -cp 
 /software/cassandra/bin/../conf:/software/cassandra/bin/../build/classes:/software/cassandra/bin/../lib/antlr-3.1.3.jar:/software/cassandra/bin/../lib/apache-cassandra-0.7.4.jar:/software/cassandra/bin/../lib/avro-1.4.0-fixes.jar:/software/cassandra/bin/../lib/avro-1.4.0-sources-fixes.jar:/software/cassandra/bin/../lib/commons-cli-1.1.jar:/software/cassandra/bin/../lib/commons-codec-1.2.jar:/software/cassandra/bin/../lib/commons-collections-3.2.1.jar:/software/cassandra/bin/../lib/commons-lang-2.4.jar:/software/cassandra/bin/../lib/concurrentlinkedhashmap-lru-1.1.jar:/software/cassandra/bin/../lib/guava-r05.jar:/software/cassandra/bin/../lib/high-scale-lib.jar:/software/cassandra/bin/../lib/jackson-core-asl-1.4.0.jar:/software/cassandra/bin/../lib/jackson-mapper-asl-1.4.0.jar:/software/cassandra/bin/../lib/jetty-6.1.21.jar:/software/cassandra/bin/../lib/jetty-util-6.1.21.jar:/software/cassandra/bin/../lib/jline-0.9.94.jar:/software/cassandra/bin/../lib/json-simple-1.1.jar:/software/cassandra/bin/../lib/jug-2.0.0.jar:/software/cassandra/bin/../lib/libthrift-0.5.jar:/software/cassandra/bin/../lib/log4j-1.2.16.jar:/software/cassandra/bin/../lib/servlet-api-2.5-20081211.jar:/software/cassandra/bin/../lib/slf4j-api-1.6.1.jar:/software/cassandra/bin/../lib/slf4j-log4j12-1.6.1.jar:/software/cassandra/bin/../lib/snakeyaml-1.6.jar
  org.apache.cassandra.thrift.CassandraDaemon

--
This message is automatically generated by JIRA.
For more information on JIRA, see: http://www.atlassian.com/software/jira


[jira] [Commented] (CASSANDRA-2549) Start up of 0.8-beta1 on Ubuntu

2011-04-23 Thread Jonathan Ellis (JIRA)

[ 
https://issues.apache.org/jira/browse/CASSANDRA-2549?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=13023629#comment-13023629
 ] 

Jonathan Ellis commented on CASSANDRA-2549:
---

No, there is only one jar in 0.7.

 Start up of 0.8-beta1 on Ubuntu 
 

 Key: CASSANDRA-2549
 URL: https://issues.apache.org/jira/browse/CASSANDRA-2549
 Project: Cassandra
  Issue Type: Bug
  Components: Packaging
Affects Versions: 0.8 beta 1
 Environment: Linux home.broadley.org.nz 2.6.32-29-generic-pae 
 #58-Ubuntu SMP Fri Feb 11 19:15:25 UTC 2011 i686 GNU/Linux
Reporter: Drew Broadley
  Labels: start
 Fix For: 0.8.0

 Attachments: cassandra-0.8.0beta1-debian-package.patch


 root@home:/home/drew# cassandra -f
  INFO 14:06:03,261 Logging initialized
  INFO 14:06:03,323 Heap size: 1543831552/1543831552
  INFO 14:06:03,332 JNA not found. Native methods will be disabled.
  INFO 14:06:03,379 Loading settings from file:/etc/cassandra/cassandra.yaml
  INFO 14:06:03,899 DiskAccessMode 'auto' determined to be standard, 
 indexAccessMode is standard
 ERROR 14:06:04,028 Exception encountered during startup.
 java.lang.NoClassDefFoundError: 
 org/apache/cassandra/thrift/UnavailableException
   at java.lang.Class.getDeclaredMethods0(Native Method)
   at java.lang.Class.privateGetDeclaredMethods(Class.java:2444)
   at java.lang.Class.privateGetPublicMethods(Class.java:2564)
   at java.lang.Class.getMethods(Class.java:1427)
   at 
 com.sun.jmx.mbeanserver.MBeanAnalyzer.initMaps(MBeanAnalyzer.java:126)
   at com.sun.jmx.mbeanserver.MBeanAnalyzer.init(MBeanAnalyzer.java:116)
   at 
 com.sun.jmx.mbeanserver.MBeanAnalyzer.analyzer(MBeanAnalyzer.java:104)
   at 
 com.sun.jmx.mbeanserver.StandardMBeanIntrospector.getAnalyzer(StandardMBeanIntrospector.java:66)
   at 
 com.sun.jmx.mbeanserver.MBeanIntrospector.getPerInterface(MBeanIntrospector.java:181)
   at com.sun.jmx.mbeanserver.MBeanSupport.init(MBeanSupport.java:136)
   at 
 com.sun.jmx.mbeanserver.StandardMBeanSupport.init(StandardMBeanSupport.java:64)
   at 
 com.sun.jmx.mbeanserver.Introspector.makeDynamicMBean(Introspector.java:174)
   at 
 com.sun.jmx.interceptor.DefaultMBeanServerInterceptor.registerObject(DefaultMBeanServerInterceptor.java:936)
   at 
 com.sun.jmx.interceptor.DefaultMBeanServerInterceptor.registerMBean(DefaultMBeanServerInterceptor.java:330)
   at 
 com.sun.jmx.mbeanserver.JmxMBeanServer.registerMBean(JmxMBeanServer.java:516)
   at 
 org.apache.cassandra.service.StorageService.init(StorageService.java:231)
   at 
 org.apache.cassandra.service.StorageService.clinit(StorageService.java:171)
   at 
 org.apache.cassandra.locator.DynamicEndpointSnitch.init(DynamicEndpointSnitch.java:78)
   at 
 org.apache.cassandra.config.DatabaseDescriptor.createEndpointSnitch(DatabaseDescriptor.java:429)
   at 
 org.apache.cassandra.config.DatabaseDescriptor.clinit(DatabaseDescriptor.java:294)
   at 
 org.apache.cassandra.service.AbstractCassandraDaemon.setup(AbstractCassandraDaemon.java:98)
   at 
 org.apache.cassandra.service.AbstractCassandraDaemon.activate(AbstractCassandraDaemon.java:314)
   at 
 org.apache.cassandra.thrift.CassandraDaemon.main(CassandraDaemon.java:80)
 Caused by: java.lang.ClassNotFoundException: 
 org.apache.cassandra.thrift.UnavailableException
   at java.net.URLClassLoader$1.run(URLClassLoader.java:217)
   at java.security.AccessController.doPrivileged(Native Method)
   at java.net.URLClassLoader.findClass(URLClassLoader.java:205)
   at java.lang.ClassLoader.loadClass(ClassLoader.java:321)
   at sun.misc.Launcher$AppClassLoader.loadClass(Launcher.java:294)
   at java.lang.ClassLoader.loadClass(ClassLoader.java:266)
   ... 23 more
 Exception encountered during startup.
 java.lang.NoClassDefFoundError: 
 org/apache/cassandra/thrift/UnavailableException
   at java.lang.Class.getDeclaredMethods0(Native Method)
   at java.lang.Class.privateGetDeclaredMethods(Class.java:2444)
   at java.lang.Class.privateGetPublicMethods(Class.java:2564)
   at java.lang.Class.getMethods(Class.java:1427)
   at 
 com.sun.jmx.mbeanserver.MBeanAnalyzer.initMaps(MBeanAnalyzer.java:126)
   at com.sun.jmx.mbeanserver.MBeanAnalyzer.init(MBeanAnalyzer.java:116)
   at 
 com.sun.jmx.mbeanserver.MBeanAnalyzer.analyzer(MBeanAnalyzer.java:104)
   at 
 com.sun.jmx.mbeanserver.StandardMBeanIntrospector.getAnalyzer(StandardMBeanIntrospector.java:66)
   at 
 com.sun.jmx.mbeanserver.MBeanIntrospector.getPerInterface(MBeanIntrospector.java:181)
   at com.sun.jmx.mbeanserver.MBeanSupport.init(MBeanSupport.java:136)
   at 
 com.sun.jmx.mbeanserver.StandardMBeanSupport.init(StandardMBeanSupport.java:64)
   at 
 

[jira] [Updated] (CASSANDRA-2549) Start up of 0.8-beta1 on Ubuntu

2011-04-23 Thread Jonathan Ellis (JIRA)

 [ 
https://issues.apache.org/jira/browse/CASSANDRA-2549?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
 ]

Jonathan Ellis updated CASSANDRA-2549:
--

 Reviewer: urandom
  Component/s: (was: Core)
   Packaging
Fix Version/s: 0.8.0
   Labels: start  (was: core start)

 Start up of 0.8-beta1 on Ubuntu 
 

 Key: CASSANDRA-2549
 URL: https://issues.apache.org/jira/browse/CASSANDRA-2549
 Project: Cassandra
  Issue Type: Bug
  Components: Packaging
Affects Versions: 0.8 beta 1
 Environment: Linux home.broadley.org.nz 2.6.32-29-generic-pae 
 #58-Ubuntu SMP Fri Feb 11 19:15:25 UTC 2011 i686 GNU/Linux
Reporter: Drew Broadley
  Labels: start
 Fix For: 0.8.0

 Attachments: cassandra-0.8.0beta1-debian-package.patch


 root@home:/home/drew# cassandra -f
  INFO 14:06:03,261 Logging initialized
  INFO 14:06:03,323 Heap size: 1543831552/1543831552
  INFO 14:06:03,332 JNA not found. Native methods will be disabled.
  INFO 14:06:03,379 Loading settings from file:/etc/cassandra/cassandra.yaml
  INFO 14:06:03,899 DiskAccessMode 'auto' determined to be standard, 
 indexAccessMode is standard
 ERROR 14:06:04,028 Exception encountered during startup.
 java.lang.NoClassDefFoundError: 
 org/apache/cassandra/thrift/UnavailableException
   at java.lang.Class.getDeclaredMethods0(Native Method)
   at java.lang.Class.privateGetDeclaredMethods(Class.java:2444)
   at java.lang.Class.privateGetPublicMethods(Class.java:2564)
   at java.lang.Class.getMethods(Class.java:1427)
   at 
 com.sun.jmx.mbeanserver.MBeanAnalyzer.initMaps(MBeanAnalyzer.java:126)
   at com.sun.jmx.mbeanserver.MBeanAnalyzer.init(MBeanAnalyzer.java:116)
   at 
 com.sun.jmx.mbeanserver.MBeanAnalyzer.analyzer(MBeanAnalyzer.java:104)
   at 
 com.sun.jmx.mbeanserver.StandardMBeanIntrospector.getAnalyzer(StandardMBeanIntrospector.java:66)
   at 
 com.sun.jmx.mbeanserver.MBeanIntrospector.getPerInterface(MBeanIntrospector.java:181)
   at com.sun.jmx.mbeanserver.MBeanSupport.init(MBeanSupport.java:136)
   at 
 com.sun.jmx.mbeanserver.StandardMBeanSupport.init(StandardMBeanSupport.java:64)
   at 
 com.sun.jmx.mbeanserver.Introspector.makeDynamicMBean(Introspector.java:174)
   at 
 com.sun.jmx.interceptor.DefaultMBeanServerInterceptor.registerObject(DefaultMBeanServerInterceptor.java:936)
   at 
 com.sun.jmx.interceptor.DefaultMBeanServerInterceptor.registerMBean(DefaultMBeanServerInterceptor.java:330)
   at 
 com.sun.jmx.mbeanserver.JmxMBeanServer.registerMBean(JmxMBeanServer.java:516)
   at 
 org.apache.cassandra.service.StorageService.init(StorageService.java:231)
   at 
 org.apache.cassandra.service.StorageService.clinit(StorageService.java:171)
   at 
 org.apache.cassandra.locator.DynamicEndpointSnitch.init(DynamicEndpointSnitch.java:78)
   at 
 org.apache.cassandra.config.DatabaseDescriptor.createEndpointSnitch(DatabaseDescriptor.java:429)
   at 
 org.apache.cassandra.config.DatabaseDescriptor.clinit(DatabaseDescriptor.java:294)
   at 
 org.apache.cassandra.service.AbstractCassandraDaemon.setup(AbstractCassandraDaemon.java:98)
   at 
 org.apache.cassandra.service.AbstractCassandraDaemon.activate(AbstractCassandraDaemon.java:314)
   at 
 org.apache.cassandra.thrift.CassandraDaemon.main(CassandraDaemon.java:80)
 Caused by: java.lang.ClassNotFoundException: 
 org.apache.cassandra.thrift.UnavailableException
   at java.net.URLClassLoader$1.run(URLClassLoader.java:217)
   at java.security.AccessController.doPrivileged(Native Method)
   at java.net.URLClassLoader.findClass(URLClassLoader.java:205)
   at java.lang.ClassLoader.loadClass(ClassLoader.java:321)
   at sun.misc.Launcher$AppClassLoader.loadClass(Launcher.java:294)
   at java.lang.ClassLoader.loadClass(ClassLoader.java:266)
   ... 23 more
 Exception encountered during startup.
 java.lang.NoClassDefFoundError: 
 org/apache/cassandra/thrift/UnavailableException
   at java.lang.Class.getDeclaredMethods0(Native Method)
   at java.lang.Class.privateGetDeclaredMethods(Class.java:2444)
   at java.lang.Class.privateGetPublicMethods(Class.java:2564)
   at java.lang.Class.getMethods(Class.java:1427)
   at 
 com.sun.jmx.mbeanserver.MBeanAnalyzer.initMaps(MBeanAnalyzer.java:126)
   at com.sun.jmx.mbeanserver.MBeanAnalyzer.init(MBeanAnalyzer.java:116)
   at 
 com.sun.jmx.mbeanserver.MBeanAnalyzer.analyzer(MBeanAnalyzer.java:104)
   at 
 com.sun.jmx.mbeanserver.StandardMBeanIntrospector.getAnalyzer(StandardMBeanIntrospector.java:66)
   at 
 com.sun.jmx.mbeanserver.MBeanIntrospector.getPerInterface(MBeanIntrospector.java:181)
   at com.sun.jmx.mbeanserver.MBeanSupport.init(MBeanSupport.java:136)
   at 
 

[jira] [Assigned] (CASSANDRA-2550) nodetool setcompactionthroughput requiring wrong number of arguments?

2011-04-23 Thread Stu Hood (JIRA)

 [ 
https://issues.apache.org/jira/browse/CASSANDRA-2550?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
 ]

Stu Hood reassigned CASSANDRA-2550:
---

Assignee: Stu Hood

 nodetool setcompactionthroughput requiring wrong number of arguments?
 -

 Key: CASSANDRA-2550
 URL: https://issues.apache.org/jira/browse/CASSANDRA-2550
 Project: Cassandra
  Issue Type: Bug
  Components: Tools
Affects Versions: 0.8 beta 1
Reporter: Terje Marthinussen
Assignee: Stu Hood
Priority: Minor
  Labels: nodetool

 ---
 case SETCOMPACTIONTHROUGHPUT :
 if (arguments.length != 2) { badUse(Missing value 
 argument.); }
 probe.setCompactionThroughput(Integer.valueOf(arguments[1]));
 break;
 ---
 I would think arguments.length should be just 1?

--
This message is automatically generated by JIRA.
For more information on JIRA, see: http://www.atlassian.com/software/jira