date:20110914

[jira] [Commented] (CASSANDRA-3200) Repair: compare all trees together (for a given range/cf) instead of by pair in isolation

2011-09-14 Thread Sylvain Lebresne (JIRA)

[
https://issues.apache.org/jira/browse/CASSANDRA-3200?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=13104361#comment-13104361
]

Sylvain Lebresne commented on CASSANDRA-3200:
-

Yes, having a not-bulky/continuous/incremental/ponies-powered repair would be
nice. It's worth looking into it and I'm not even saying I won't help with that.

That being said, I've heard a number of ideas on that (including the discussion
on CASSANDRA-2699) and I have yet to be fully convinced by one of those idea. I
do think it's not a simple problem. So until proved otherwise, the ETA for
CASSANDRA-2699 is unknown and unlikely in the very near future. In the
meantime, repair is there and used by people.

Besides, while I understand that the past suckiness of the repair process may
push one to think that we should throw everything away and use something
completely new, I think it would be wise to first ask ourselves if we can't
improve/built on what we have to make it good enough first. In particular,
repair is already able to work on any token range. It would be relatively easy
for instance to run more repair on smaller ranges. That plus the fact that both
(validation) compaction and streaming can now be throttled, that could make
repair much less bulky at a very little cost (in development time/new bug
potentially added).

And to get back to the issue at hand, it's actually not a complicated patch
(given how repair works nowadays) and a very isolated one in what it will
touch, so I see no reason why it wouldn't make it during the 1.0 series, while
any potential replacement solution is almost guaranteed to not make it before
1.1 *at best*.

Repair: compare all trees together (for a given range/cf) instead of by pair
in isolation
-

Key: CASSANDRA-3200
URL: https://issues.apache.org/jira/browse/CASSANDRA-3200
Project: Cassandra
Issue Type: Improvement
Components: Core
Reporter: Sylvain Lebresne
Assignee: Sylvain Lebresne
Priority: Minor
Labels: repair
Fix For: 1.0.1

Currently, repair compare merkle trees by pair, in isolation of any other
tree. What that means concretely is that if I have three node A, B and C
(RF=3) with A and B in sync, but C having some range r inconsitent with both
A and B (since those are consistent), we will do the following transfer of r:
A - C, C - A, B - C, C - B.
The fact that we do both A - C and C - A is fine, because we cannot know
which one is more to date from A or C. However, the transfer B - C is
useless provided we do A - C if A and B are in sync. Not doing that transfer
will be a 25% improvement in that case. With RF=5 and only one node
inconsistent with all the others, that almost a 40% improvement, etc...
Given that this situation of one node not in sync while the others are is
probably fairly common (one node died so it is behind), this could be a fair
improvement over what is transferred. In the case where we use repair to
rebuild completely a node, this will be a dramatic improvement, because it
will avoid the rebuilded node to get RF times the data it should get.

--
This message is automatically generated by JIRA.
For more information on JIRA, see: http://www.atlassian.com/software/jira

svn commit: r1170487 - in /cassandra/branches/cassandra-1.0.0: CHANGES.txt build.xml debian/changelog

2011-09-14 Thread slebresne

Author: slebresne
Date: Wed Sep 14 09:13:26 2011
New Revision: 1170487

URL: http://svn.apache.org/viewvc?rev=1170487view=rev
Log:
Update versions in preparation of 1.0.0-beta1 release

Modified:
cassandra/branches/cassandra-1.0.0/CHANGES.txt
cassandra/branches/cassandra-1.0.0/build.xml
cassandra/branches/cassandra-1.0.0/debian/changelog

Modified: cassandra/branches/cassandra-1.0.0/CHANGES.txt
URL: 
http://svn.apache.org/viewvc/cassandra/branches/cassandra-1.0.0/CHANGES.txt?rev=1170487r1=1170486r2=1170487view=diff
==
--- cassandra/branches/cassandra-1.0.0/CHANGES.txt (original)
+++ cassandra/branches/cassandra-1.0.0/CHANGES.txt Wed Sep 14 09:13:26 2011
@@ -1,4 +1,4 @@
-1.0
+1.0.0-beta1
  * removed binarymemtable (CASSANDRA-2692)
  * add commitlog_total_space_in_mb to prevent fragmented logs (CASSANDRA-2427)
  * removed commitlog_rotation_threshold_in_mb configuration (CASSANDRA-2771)

Modified: cassandra/branches/cassandra-1.0.0/build.xml
URL: 
http://svn.apache.org/viewvc/cassandra/branches/cassandra-1.0.0/build.xml?rev=1170487r1=1170486r2=1170487view=diff
==
--- cassandra/branches/cassandra-1.0.0/build.xml (original)
+++ cassandra/branches/cassandra-1.0.0/build.xml Wed Sep 14 09:13:26 2011
@@ -25,7 +25,7 @@
 property name=debuglevel value=source,lines,vars/
 
 !-- default version and SCM information (we need the default SCM info as 
people may checkout with git-svn) --
-property name=base.version value=1.0/
+property name=base.version value=1.0.0-beta1/
 property name=scm.default.path 
value=cassandra/branches/cassandra-1.0.0/
 property name=scm.default.connection 
value=scm:svn:http://svn.apache.org/repos/asf/${scm.default.path}/
 property name=scm.default.developerConnection 
value=scm:svn:https://svn.apache.org/repos/asf/${scm.default.path}/

Modified: cassandra/branches/cassandra-1.0.0/debian/changelog
URL: 
http://svn.apache.org/viewvc/cassandra/branches/cassandra-1.0.0/debian/changelog?rev=1170487r1=1170486r2=1170487view=diff
==
--- cassandra/branches/cassandra-1.0.0/debian/changelog (original)
+++ cassandra/branches/cassandra-1.0.0/debian/changelog Wed Sep 14 09:13:26 2011
@@ -1,3 +1,9 @@
+cassandra (1.0.0-beta1) unstable; urgency=low
+
+  * New beta release
+
+ -- Sylvain Lebresne slebre...@apache.org  Wed, 14 Sep 2011 11:07:47 +0200
+
 cassandra (0.8.1) unstable; urgency=low
 
   * New release

svn commit: r1170490 - in /cassandra/branches/cassandra-1.0.0: src/java/org/apache/cassandra/cql/jdbc/ src/java/org/apache/cassandra/db/columniterator/ src/java/org/apache/cassandra/db/compaction/ src

2011-09-14 Thread slebresne

Author: slebresne
Date: Wed Sep 14 09:18:28 2011
New Revision: 1170490

URL: http://svn.apache.org/viewvc?rev=1170490view=rev
Log:
Add missing license headers

Modified:

cassandra/branches/cassandra-1.0.0/src/java/org/apache/cassandra/cql/jdbc/JdbcCounterColumn.java

cassandra/branches/cassandra-1.0.0/src/java/org/apache/cassandra/cql/jdbc/TypesMap.java

cassandra/branches/cassandra-1.0.0/src/java/org/apache/cassandra/db/columniterator/ICountableColumnIterator.java

cassandra/branches/cassandra-1.0.0/src/java/org/apache/cassandra/db/compaction/AbstractCompactionIterable.java

cassandra/branches/cassandra-1.0.0/src/java/org/apache/cassandra/db/compaction/LeveledCompactionStrategy.java

cassandra/branches/cassandra-1.0.0/src/java/org/apache/cassandra/db/compaction/LeveledCompactionTask.java

cassandra/branches/cassandra-1.0.0/src/java/org/apache/cassandra/db/compaction/LeveledManifest.java

cassandra/branches/cassandra-1.0.0/src/java/org/apache/cassandra/locator/Ec2MultiRegionSnitch.java

cassandra/branches/cassandra-1.0.0/src/java/org/apache/cassandra/notifications/INotification.java

cassandra/branches/cassandra-1.0.0/src/java/org/apache/cassandra/notifications/INotificationConsumer.java

cassandra/branches/cassandra-1.0.0/src/java/org/apache/cassandra/notifications/SSTableAddedNotification.java

cassandra/branches/cassandra-1.0.0/src/java/org/apache/cassandra/notifications/SSTableListChangedNotification.java

cassandra/branches/cassandra-1.0.0/src/java/org/apache/cassandra/utils/IntervalTree/Interval.java

cassandra/branches/cassandra-1.0.0/src/java/org/apache/cassandra/utils/IntervalTree/IntervalNode.java

cassandra/branches/cassandra-1.0.0/src/java/org/apache/cassandra/utils/IntervalTree/IntervalTree.java

cassandra/branches/cassandra-1.0.0/test/unit/org/apache/cassandra/db/ArrayBackedSortedColumnsTest.java

cassandra/branches/cassandra-1.0.0/test/unit/org/apache/cassandra/net/MessageSerializer.java

cassandra/branches/cassandra-1.0.0/test/unit/org/apache/cassandra/utils/IntervalTest.java

cassandra/branches/cassandra-1.0.0/test/unit/org/apache/cassandra/utils/IntervalTreeTest.java

Modified: 
cassandra/branches/cassandra-1.0.0/src/java/org/apache/cassandra/cql/jdbc/JdbcCounterColumn.java
URL: 
http://svn.apache.org/viewvc/cassandra/branches/cassandra-1.0.0/src/java/org/apache/cassandra/cql/jdbc/JdbcCounterColumn.java?rev=1170490r1=1170489r2=1170490view=diff
==
--- 
cassandra/branches/cassandra-1.0.0/src/java/org/apache/cassandra/cql/jdbc/JdbcCounterColumn.java
 (original)
+++ 
cassandra/branches/cassandra-1.0.0/src/java/org/apache/cassandra/cql/jdbc/JdbcCounterColumn.java
 Wed Sep 14 09:18:28 2011
@@ -1,4 +1,25 @@
 package org.apache.cassandra.cql.jdbc;
+/*
+ * 
+ * Licensed to the Apache Software Foundation (ASF) under one
+ * or more contributor license agreements.  See the NOTICE file
+ * distributed with this work for additional information
+ * regarding copyright ownership.  The ASF licenses this file
+ * to you under the Apache License, Version 2.0 (the
+ * License); you may not use this file except in compliance
+ * with the License.  You may obtain a copy of the License at
+ * 
+ *   http://www.apache.org/licenses/LICENSE-2.0
+ * 
+ * Unless required by applicable law or agreed to in writing,
+ * software distributed under the License is distributed on an
+ * AS IS BASIS, WITHOUT WARRANTIES OR CONDITIONS OF ANY
+ * KIND, either express or implied.  See the License for the
+ * specific language governing permissions and limitations
+ * under the License.
+ * 
+ */
+
 
 public class JdbcCounterColumn extends JdbcLong
 {

Modified: 
cassandra/branches/cassandra-1.0.0/src/java/org/apache/cassandra/cql/jdbc/TypesMap.java
URL: 
http://svn.apache.org/viewvc/cassandra/branches/cassandra-1.0.0/src/java/org/apache/cassandra/cql/jdbc/TypesMap.java?rev=1170490r1=1170489r2=1170490view=diff
==
--- 
cassandra/branches/cassandra-1.0.0/src/java/org/apache/cassandra/cql/jdbc/TypesMap.java
 (original)
+++ 
cassandra/branches/cassandra-1.0.0/src/java/org/apache/cassandra/cql/jdbc/TypesMap.java
 Wed Sep 14 09:18:28 2011
@@ -1,4 +1,25 @@
 package org.apache.cassandra.cql.jdbc;
+/*
+ * 
+ * Licensed to the Apache Software Foundation (ASF) under one
+ * or more contributor license agreements.  See the NOTICE file
+ * distributed with this work for additional information
+ * regarding copyright ownership.  The ASF licenses this file
+ * to you under the Apache License, Version 2.0 (the
+ * License); you may not use this file except in compliance
+ * with the License.  You may obtain a copy of the License at
+ * 
+ *   http://www.apache.org/licenses/LICENSE-2.0
+ * 
+ * Unless required by applicable law or agreed to in writing,
+ * software distributed under the License is distributed on an
+ *

svn commit: r1170498 - /cassandra/branches/cassandra-1.0.0/NOTICE.txt

2011-09-14 Thread slebresne

Author: slebresne
Date: Wed Sep 14 09:31:13 2011
New Revision: 1170498

URL: http://svn.apache.org/viewvc?rev=1170498view=rev
Log:
Update NOTICE files

Modified:
cassandra/branches/cassandra-1.0.0/NOTICE.txt

Modified: cassandra/branches/cassandra-1.0.0/NOTICE.txt
URL: 
http://svn.apache.org/viewvc/cassandra/branches/cassandra-1.0.0/NOTICE.txt?rev=1170498r1=1170497r2=1170498view=diff
==
--- cassandra/branches/cassandra-1.0.0/NOTICE.txt (original)
+++ cassandra/branches/cassandra-1.0.0/NOTICE.txt Wed Sep 14 09:31:13 2011
@@ -31,3 +31,8 @@ YAML support provided by snakeyaml (http
 Copyright (c) 2008-2010 Andrey Somov
 
 Compression support provided by snappy-java 
(http://code.google.com/p/snappy-java/)
+Written by Taro L. Saito.
+
+Streaming compression support provided by ning-compress
+(https://github.com/ning/compress)
+Copyright 2009-2010 Ning, Inc.

svn commit: r1170515 - in /cassandra/branches/cassandra-0.8: build.xml debian/changelog

2011-09-14 Thread slebresne

Author: slebresne
Date: Wed Sep 14 10:26:45 2011
New Revision: 1170515

URL: http://svn.apache.org/viewvc?rev=1170515view=rev
Log:
update versions to 0.8.6

Modified:
cassandra/branches/cassandra-0.8/build.xml
cassandra/branches/cassandra-0.8/debian/changelog

Modified: cassandra/branches/cassandra-0.8/build.xml
URL: 
http://svn.apache.org/viewvc/cassandra/branches/cassandra-0.8/build.xml?rev=1170515r1=1170514r2=1170515view=diff
==
--- cassandra/branches/cassandra-0.8/build.xml (original)
+++ cassandra/branches/cassandra-0.8/build.xml Wed Sep 14 10:26:45 2011
@@ -25,7 +25,7 @@
 property name=debuglevel value=source,lines,vars/
 
 !-- default version and SCM information (we need the default SCM info as 
people may checkout with git-svn) --
-property name=base.version value=0.8.5/
+property name=base.version value=0.8.6/
 property name=scm.default.path 
value=cassandra/branches/cassandra-0.8/
 property name=scm.default.connection 
value=scm:svn:http://svn.apache.org/repos/asf/${scm.default.path}/
 property name=scm.default.developerConnection 
value=scm:svn:https://svn.apache.org/repos/asf/${scm.default.path}/

Modified: cassandra/branches/cassandra-0.8/debian/changelog
URL: 
http://svn.apache.org/viewvc/cassandra/branches/cassandra-0.8/debian/changelog?rev=1170515r1=1170514r2=1170515view=diff
==
--- cassandra/branches/cassandra-0.8/debian/changelog (original)
+++ cassandra/branches/cassandra-0.8/debian/changelog Wed Sep 14 10:26:45 2011
@@ -1,3 +1,9 @@
+cassandra (0.8.6) unstable; urgency=low
+
+  * New release
+
+ -- Sylvain Lebresne slebre...@apache.org  Wed, 14 Sep 2011 12:25:49 +0200
+
 cassandra (0.8.5) unstable; urgency=low
 
   * New release

[jira] [Commented] (CASSANDRA-3177) replication strategy with stress test results in keyspace creation error

2011-09-14 Thread Pavel Yaskevich (JIRA)


[ 
https://issues.apache.org/jira/browse/CASSANDRA-3177?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=13104411#comment-13104411
 ] 

Pavel Yaskevich commented on CASSANDRA-3177:


you can't specify --replication-factor with NetworkTopologyStrategy, the error 
in your system.log says
{noformat}
Caused by: org.apache.cassandra.config.ConfigurationException: 
replication_factor is an option for SimpleStrategy, not NetworkTopologyStrategy
{noformat}

Try `-D nodes2 --consistency-level=EACH_QUORUM --threads=10 --column-size=32 
--keep-going --num-keys=5 -r --replication-strategy=NetworkTopologyStrategy 
--strategy-properties=DC1:1,DC2:1`

That works fine for me.



 replication strategy with stress test results in keyspace creation error 
 -

 Key: CASSANDRA-3177
 URL: https://issues.apache.org/jira/browse/CASSANDRA-3177
 Project: Cassandra
  Issue Type: Bug
  Components: Tests
Affects Versions: 0.8.5
 Environment: ubuntu 10.04 lts server x64
 Linux ip-10-108-87-188 2.6.32-312-ec2 #24-Ubuntu SMP Fri Jan 7 18:30:50 UTC 
 2011 x86_64 GNU/Linux
 Amazon EC2 Multi Region Setup 
Reporter: Gourav Shah
Assignee: Pavel Yaskevich
Priority: Trivial

 I am using java stress testing utility packaged with cassandra. I tried 
 specifying replication strategy which results in keyspace not being created 
 and throws Internal error processing system_add_keyspace
 ./stress -D nodes2  --consistency-level=EACH_QUORUM --threads=10 
 --replication-factor=3 --column-size=32 --keep-going --num-keys=5  -r 
 --replication-strategy=NetworkTopologyStrategy 
 --strategy-properties=DC1:1,DC2:1
 Internal error processing system_add_keyspace
 Exception in thread Thread-10 java.lang.RuntimeException: Keyspace 
 Keyspace1 does not exist
 at org.apache.cassandra.stress.Session.getClient(Unknown Source)
 at org.apache.cassandra.stress.Session.getClient(Unknown Source)
 at org.apache.cassandra.stress.StressAction$Consumer.run(Unknown 
 Source)

--
This message is automatically generated by JIRA.
For more information on JIRA, see: http://www.atlassian.com/software/jira

[jira] [Resolved] (CASSANDRA-3177) replication strategy with stress test results in keyspace creation error

2011-09-14 Thread Pavel Yaskevich (JIRA)


 [ 
https://issues.apache.org/jira/browse/CASSANDRA-3177?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
 ]

Pavel Yaskevich resolved CASSANDRA-3177.


Resolution: Not A Problem

 replication strategy with stress test results in keyspace creation error 
 -

 Key: CASSANDRA-3177
 URL: https://issues.apache.org/jira/browse/CASSANDRA-3177
 Project: Cassandra
  Issue Type: Bug
  Components: Tests
Affects Versions: 0.8.5
 Environment: ubuntu 10.04 lts server x64
 Linux ip-10-108-87-188 2.6.32-312-ec2 #24-Ubuntu SMP Fri Jan 7 18:30:50 UTC 
 2011 x86_64 GNU/Linux
 Amazon EC2 Multi Region Setup 
Reporter: Gourav Shah
Assignee: Pavel Yaskevich
Priority: Trivial

 I am using java stress testing utility packaged with cassandra. I tried 
 specifying replication strategy which results in keyspace not being created 
 and throws Internal error processing system_add_keyspace
 ./stress -D nodes2  --consistency-level=EACH_QUORUM --threads=10 
 --replication-factor=3 --column-size=32 --keep-going --num-keys=5  -r 
 --replication-strategy=NetworkTopologyStrategy 
 --strategy-properties=DC1:1,DC2:1
 Internal error processing system_add_keyspace
 Exception in thread Thread-10 java.lang.RuntimeException: Keyspace 
 Keyspace1 does not exist
 at org.apache.cassandra.stress.Session.getClient(Unknown Source)
 at org.apache.cassandra.stress.Session.getClient(Unknown Source)
 at org.apache.cassandra.stress.StressAction$Consumer.run(Unknown 
 Source)

--
This message is automatically generated by JIRA.
For more information on JIRA, see: http://www.atlassian.com/software/jira

[jira] [Updated] (CASSANDRA-3195) Cassandra-CLI does not allow Config as column family name

2011-09-14 Thread Pavel Yaskevich (JIRA)


 [ 
https://issues.apache.org/jira/browse/CASSANDRA-3195?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
 ]

Pavel Yaskevich updated CASSANDRA-3195:
---

Attachment: CASSANDRA-3195.patch

CLI supports only single-quotes. Patch to support quoting of the ColumnFamily 
name is attached (`update column family` statement already supports that) and 
test for that.

 Cassandra-CLI does not allow Config as column family name
 ---

 Key: CASSANDRA-3195
 URL: https://issues.apache.org/jira/browse/CASSANDRA-3195
 Project: Cassandra
  Issue Type: Bug
  Components: Tools
Affects Versions: 0.8.5
Reporter: Mauri Tikka
Assignee: Pavel Yaskevich
Priority: Minor
 Attachments: CASSANDRA-3195.patch


 create column family Config does not work, create column family Configg 
 does.
 I suppose the intent is that column families can be named freely, that they 
 have a namespace completely of their own, and separate from, say, 
 Cassandra-CLI commands.

--
This message is automatically generated by JIRA.
For more information on JIRA, see: http://www.atlassian.com/software/jira

1 2 >

1 - 100 of 101 matches

Mail list logo