[jira] [Updated] (CASSANDRA-12760) SELECT JSON "firstName" FROM ... results in {"\"firstName\"": "Bill"}

2017-02-22 Thread Niek Bartholomeus (JIRA)

 [ 
https://issues.apache.org/jira/browse/CASSANDRA-12760?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
 ]

Niek Bartholomeus updated CASSANDRA-12760:
--
Issue Type: Improvement  (was: Bug)

> SELECT JSON "firstName" FROM ... results in {"\"firstName\"": "Bill"}
> -
>
> Key: CASSANDRA-12760
> URL: https://issues.apache.org/jira/browse/CASSANDRA-12760
> Project: Cassandra
>  Issue Type: Improvement
>  Components: Core
> Environment: Cassandra 3.7
>Reporter: Niek Bartholomeus
>Assignee: Shivang Nagaria
>  Labels: lhf
>
> I'm using Cassandra to store data coming from Spark and intended for being 
> consumed by a javascript front end.
> To avoid unnecessary field name mappings I have decided to use mixed case 
> fields in Cassandra. I also happily leave it to Cassandra to jsonify the data 
> (using SELECT JSON ...) so my scala/play web server can send the results from 
> Cassandra straight through to the front end.
> I noticed however that all mixed case fields (that were created with quotes 
> as Cassandra demands) end up having a double set of quotes
> {code}
> create table user(id text PRIMARY KEY, "firstName" text);
> insert into user(id, "firstName") values ('b', 'Bill');
> select json * from user;
>  [json]
> --
>  {"id": "b", "\"firstName\"": "Bill"}
> {code}
> Ideally that would be:
> {code}
>  [json]
> --
>  {"id": "b", "firstName": "Bill"}
> {code}
> I worked around it for now by removing all "\""'s before sending the json to 
> the front end.



--
This message was sent by Atlassian JIRA
(v6.3.15#6346)


[jira] [Commented] (CASSANDRA-13006) Disable automatic heap dumps on OOM error

2017-02-22 Thread anmols (JIRA)

[ 
https://issues.apache.org/jira/browse/CASSANDRA-13006?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15880056#comment-15880056
 ] 

anmols commented on CASSANDRA-13006:


I have suggested a patch for this issue, can you please let me know if this is 
acceptable for this issue?

> Disable automatic heap dumps on OOM error
> -
>
> Key: CASSANDRA-13006
> URL: https://issues.apache.org/jira/browse/CASSANDRA-13006
> Project: Cassandra
>  Issue Type: Bug
>  Components: Configuration
>Reporter: anmols
>Assignee: Benjamin Lerer
>Priority: Minor
> Fix For: 3.0.9
>
> Attachments: 13006-3.0.9.txt
>
>
> With CASSANDRA-9861, a change was added to enable collecting heap dumps by 
> default if the process encountered an OOM error. These heap dumps are stored 
> in the Apache Cassandra home directory unless configured otherwise (see 
> [Cassandra Support 
> Document|https://support.datastax.com/hc/en-us/articles/204225959-Generating-and-Analyzing-Heap-Dumps]
>  for this feature).
>  
> The creation and storage of heap dumps aides debugging and investigative 
> workflows, but is not be desirable for a production environment where these 
> heap dumps may occupy a large amount of disk space and require manual 
> intervention for cleanups. 
>  
> Managing heap dumps on out of memory errors and configuring the paths for 
> these heap dumps are available as JVM options in JVM. The current behavior 
> conflicts with the Boolean JVM flag HeapDumpOnOutOfMemoryError. 
>  
> A patch can be proposed here that would make the heap dump on OOM error honor 
> the HeapDumpOnOutOfMemoryError flag. Users who would want to still generate 
> heap dumps on OOM errors can set the -XX:+HeapDumpOnOutOfMemoryError JVM 
> option.



--
This message was sent by Atlassian JIRA
(v6.3.15#6346)


[jira] [Commented] (CASSANDRA-9292) ParentRepairSession potentially block ANTI_ENTROPY stage

2017-02-22 Thread Marcus Eriksson (JIRA)

[ 
https://issues.apache.org/jira/browse/CASSANDRA-9292?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15880044#comment-15880044
 ] 

Marcus Eriksson commented on CASSANDRA-9292:


Fixed and pushed, new builds triggered

> ParentRepairSession potentially block ANTI_ENTROPY stage
> 
>
> Key: CASSANDRA-9292
> URL: https://issues.apache.org/jira/browse/CASSANDRA-9292
> Project: Cassandra
>  Issue Type: Bug
>Reporter: Yuki Morishita
>Assignee: Marcus Eriksson
>Priority: Minor
> Fix For: 4.x
>
>
> Follow up from CASSANDRA-9151,
> {quote}
> potentially block this stage again since many methods are synchronized in 
> ActiveRepairService.
> Methods prepareForRepair(could block for 1 hour for prepare message response) 
> and finishParentSession(this one block for anticompaction to finish) are 
> synchronized and could hold on to the lock for a long time.
> In RepairMessageVerbHandler.doVerb, if there is an exception for another 
> repair, removeParentRepairSession(also synchronized) will block.
> {quote}



--
This message was sent by Atlassian JIRA
(v6.3.15#6346)


[jira] [Commented] (CASSANDRA-12760) SELECT JSON "firstName" FROM ... results in {"\"firstName\"": "Bill"}

2017-02-22 Thread Paul Fife (JIRA)

[ 
https://issues.apache.org/jira/browse/CASSANDRA-12760?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15879894#comment-15879894
 ] 

Paul Fife commented on CASSANDRA-12760:
---

I did find in the Apache docs as well: 
http://cassandra.apache.org/doc/latest/cql/json.html#cql-json

"The result map keys are the same as the column names in a normal result set. 
For example, a statement like SELECT JSON a, ttl(b) FROM ... would result in a 
map with keys "a" and "ttl(b)". However, this is one notable exception: for 
symmetry with INSERT JSON behavior, case-sensitive column names with upper-case 
letters will be surrounded with double quotes. For example, SELECT JSON 
myColumn FROM ... would result in a map key "\"myColumn\"" (note the escaped 
quotes)."

> SELECT JSON "firstName" FROM ... results in {"\"firstName\"": "Bill"}
> -
>
> Key: CASSANDRA-12760
> URL: https://issues.apache.org/jira/browse/CASSANDRA-12760
> Project: Cassandra
>  Issue Type: Bug
>  Components: Core
> Environment: Cassandra 3.7
>Reporter: Niek Bartholomeus
>Assignee: Shivang Nagaria
>  Labels: lhf
>
> I'm using Cassandra to store data coming from Spark and intended for being 
> consumed by a javascript front end.
> To avoid unnecessary field name mappings I have decided to use mixed case 
> fields in Cassandra. I also happily leave it to Cassandra to jsonify the data 
> (using SELECT JSON ...) so my scala/play web server can send the results from 
> Cassandra straight through to the front end.
> I noticed however that all mixed case fields (that were created with quotes 
> as Cassandra demands) end up having a double set of quotes
> {code}
> create table user(id text PRIMARY KEY, "firstName" text);
> insert into user(id, "firstName") values ('b', 'Bill');
> select json * from user;
>  [json]
> --
>  {"id": "b", "\"firstName\"": "Bill"}
> {code}
> Ideally that would be:
> {code}
>  [json]
> --
>  {"id": "b", "firstName": "Bill"}
> {code}
> I worked around it for now by removing all "\""'s before sending the json to 
> the front end.



--
This message was sent by Atlassian JIRA
(v6.3.15#6346)


[jira] [Commented] (CASSANDRA-12760) SELECT JSON "firstName" FROM ... results in {"\"firstName\"": "Bill"}

2017-02-22 Thread Paul Fife (JIRA)

[ 
https://issues.apache.org/jira/browse/CASSANDRA-12760?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15879891#comment-15879891
 ] 

Paul Fife commented on CASSANDRA-12760:
---

I was taking a look at this one and found the tests are verifying the 
"incorrect" behavior described in this JIRA. I can't find in the official docs 
but this post describes the behavior is intended in that both going in and out 
case sensitive column names would be in quotes and have an additional backslash 
quote at the beginning and end: 
http://www.datastax.com/dev/blog/whats-new-in-cassandra-2-2-json-support

"The results of SELECT JSON are designed to be usable in an INSERT JSON 
statement without any modifications, so all of the same rules about non-text 
map keys and case-sensitive column names apply."

Is this "not a bug"?

> SELECT JSON "firstName" FROM ... results in {"\"firstName\"": "Bill"}
> -
>
> Key: CASSANDRA-12760
> URL: https://issues.apache.org/jira/browse/CASSANDRA-12760
> Project: Cassandra
>  Issue Type: Bug
>  Components: Core
> Environment: Cassandra 3.7
>Reporter: Niek Bartholomeus
>Assignee: Shivang Nagaria
>  Labels: lhf
>
> I'm using Cassandra to store data coming from Spark and intended for being 
> consumed by a javascript front end.
> To avoid unnecessary field name mappings I have decided to use mixed case 
> fields in Cassandra. I also happily leave it to Cassandra to jsonify the data 
> (using SELECT JSON ...) so my scala/play web server can send the results from 
> Cassandra straight through to the front end.
> I noticed however that all mixed case fields (that were created with quotes 
> as Cassandra demands) end up having a double set of quotes
> {code}
> create table user(id text PRIMARY KEY, "firstName" text);
> insert into user(id, "firstName") values ('b', 'Bill');
> select json * from user;
>  [json]
> --
>  {"id": "b", "\"firstName\"": "Bill"}
> {code}
> Ideally that would be:
> {code}
>  [json]
> --
>  {"id": "b", "firstName": "Bill"}
> {code}
> I worked around it for now by removing all "\""'s before sending the json to 
> the front end.



--
This message was sent by Atlassian JIRA
(v6.3.15#6346)


[jira] [Updated] (CASSANDRA-6246) EPaxos

2017-02-22 Thread Michael Shuler (JIRA)

 [ 
https://issues.apache.org/jira/browse/CASSANDRA-6246?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
 ]

Michael Shuler updated CASSANDRA-6246:
--
Fix Version/s: (was: 3.11.x)
   4.x

> EPaxos
> --
>
> Key: CASSANDRA-6246
> URL: https://issues.apache.org/jira/browse/CASSANDRA-6246
> Project: Cassandra
>  Issue Type: Improvement
>Reporter: Jonathan Ellis
>Assignee: Blake Eggleston
>  Labels: messaging-service-bump-required
> Fix For: 4.x
>
>
> One reason we haven't optimized our Paxos implementation with Multi-paxos is 
> that Multi-paxos requires leader election and hence, a period of 
> unavailability when the leader dies.
> EPaxos is a Paxos variant that requires (1) less messages than multi-paxos, 
> (2) is particularly useful across multiple datacenters, and (3) allows any 
> node to act as coordinator: 
> http://sigops.org/sosp/sosp13/papers/p358-moraru.pdf
> However, there is substantial additional complexity involved if we choose to 
> implement it.



--
This message was sent by Atlassian JIRA
(v6.3.15#6346)


[jira] [Updated] (CASSANDRA-12202) LongLeveledCompactionStrategyTest flapping in 2.1, 2.2, 3.0

2017-02-22 Thread Yuki Morishita (JIRA)

 [ 
https://issues.apache.org/jira/browse/CASSANDRA-12202?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
 ]

Yuki Morishita updated CASSANDRA-12202:
---
   Resolution: Fixed
Fix Version/s: (was: 3.11.x)
   (was: 3.0.x)
   (was: 2.2.x)
   (was: 2.1.x)
   3.11.0
   3.0.12
   2.2.10
   Status: Resolved  (was: Ready to Commit)

Committed to 2.2+ as {{6ffd5cc5d28658b4d058de79a9bea9c10a82c8d4}}.

> LongLeveledCompactionStrategyTest flapping in 2.1, 2.2, 3.0
> ---
>
> Key: CASSANDRA-12202
> URL: https://issues.apache.org/jira/browse/CASSANDRA-12202
> Project: Cassandra
>  Issue Type: Bug
>Reporter: Marcus Eriksson
>Assignee: Marcus Eriksson
> Fix For: 2.2.10, 3.0.12, 3.11.0
>
>
> We actually fixed this for 3.7+ in CASSANDRA-11657, need to backport that fix 
> to 2.1+



--
This message was sent by Atlassian JIRA
(v6.3.15#6346)


[06/10] cassandra git commit: Merge branch 'cassandra-2.2' into cassandra-3.0

2017-02-22 Thread yukim
Merge branch 'cassandra-2.2' into cassandra-3.0


Project: http://git-wip-us.apache.org/repos/asf/cassandra/repo
Commit: http://git-wip-us.apache.org/repos/asf/cassandra/commit/61f0c988
Tree: http://git-wip-us.apache.org/repos/asf/cassandra/tree/61f0c988
Diff: http://git-wip-us.apache.org/repos/asf/cassandra/diff/61f0c988

Branch: refs/heads/cassandra-3.0
Commit: 61f0c988f78c00fec2c4e028cfb793b84069f737
Parents: 51796ea 6ffd5cc
Author: Yuki Morishita 
Authored: Thu Feb 23 11:01:32 2017 +0900
Committer: Yuki Morishita 
Committed: Thu Feb 23 11:01:32 2017 +0900

--
 CHANGES.txt |  1 +
 .../LongLeveledCompactionStrategyTest.java  | 58 
 .../LeveledCompactionStrategyTest.java  |  2 +-
 3 files changed, 37 insertions(+), 24 deletions(-)
--


http://git-wip-us.apache.org/repos/asf/cassandra/blob/61f0c988/CHANGES.txt
--
diff --cc CHANGES.txt
index afda236,033b366..e978a5c
--- a/CHANGES.txt
+++ b/CHANGES.txt
@@@ -1,7 -1,5 +1,8 @@@
 -2.2.10
 +3.0.12
 + * Remove unnecessary assertion from AntiCompactionTest (CASSANDRA-13070)
 + * Fix cqlsh COPY for dates before 1900 (CASSANDRA-13185)
 +Merged from 2.2
+  * Fix flaky LongLeveledCompactionStrategyTest (CASSANDRA-12202)
   * Fix failing COPY TO STDOUT (CASSANDRA-12497)
   * Fix ColumnCounter::countAll behaviour for reverse queries (CASSANDRA-13222)
   * Exceptions encountered calling getSeeds() breaks OTC thread 
(CASSANDRA-13018)

http://git-wip-us.apache.org/repos/asf/cassandra/blob/61f0c988/test/long/org/apache/cassandra/db/compaction/LongLeveledCompactionStrategyTest.java
--
diff --cc 
test/long/org/apache/cassandra/db/compaction/LongLeveledCompactionStrategyTest.java
index 79497aa,8e63006..562de22
--- 
a/test/long/org/apache/cassandra/db/compaction/LongLeveledCompactionStrategyTest.java
+++ 
b/test/long/org/apache/cassandra/db/compaction/LongLeveledCompactionStrategyTest.java
@@@ -53,9 -51,14 +55,11 @@@ public class LongLeveledCompactionStrat
  leveledOptions.put("sstable_size_in_mb", "1");
  SchemaLoader.prepareServer();
  SchemaLoader.createKeyspace(KEYSPACE1,
 -SimpleStrategy.class,
 -KSMetaData.optsWithRF(1),
 +KeyspaceParams.simple(1),
  SchemaLoader.standardCFMD(KEYSPACE1, 
CF_STANDARDLVL)
 -
.compactionStrategyClass(LeveledCompactionStrategy.class)
 -
.compactionStrategyOptions(leveledOptions),
++
.compaction(CompactionParams.lcs(leveledOptions)),
+ SchemaLoader.standardCFMD(KEYSPACE1, 
CF_STANDARDLVL2)
 -
.compactionStrategyClass(LeveledCompactionStrategy.class)
 -
.compactionStrategyOptions(leveledOptions));
 +
.compaction(CompactionParams.lcs(leveledOptions)));
  }
  
  @Test
@@@ -145,15 -149,34 +149,14 @@@
  @Test
  public void testLeveledScanner() throws Exception
  {
- testParallelLeveledCompaction();
  Keyspace keyspace = Keyspace.open(KEYSPACE1);
- ColumnFamilyStore store = 
keyspace.getColumnFamilyStore(CF_STANDARDLVL);
 -final ColumnFamilyStore store = 
keyspace.getColumnFamilyStore(CF_STANDARDLVL2);
 -WrappingCompactionStrategy strategy = ((WrappingCompactionStrategy) 
store.getCompactionStrategy());
 -final LeveledCompactionStrategy lcs = (LeveledCompactionStrategy) 
strategy.getWrappedStrategies().get(1);
 -
 -ByteBuffer value = ByteBuffer.wrap(new byte[100 * 1024]); // 100 KB 
value, make it easy to have multiple files
++ColumnFamilyStore store = 
keyspace.getColumnFamilyStore(CF_STANDARDLVL2);
 +store.disableAutoCompaction();
  
 -// Enough data to have a level 1 and 2
 -int rows = 128;
 -int columns = 10;
 +LeveledCompactionStrategy lcs = 
(LeveledCompactionStrategy)store.getCompactionStrategyManager().getStrategies().get(1);
  
- ByteBuffer value = ByteBuffer.wrap(new byte[10 * 1024]); // 10 KB 
value
 -// Adds enough data to trigger multiple sstable per level
 -for (int r = 0; r < rows; r++)
 -{
 -DecoratedKey key = Util.dk(String.valueOf(r));
 -Mutation rm = new Mutation(KEYSPACE1, key.getKey());
 -for (int c = 0; c < columns; c++)
 -{
 -rm.add(CF_STANDARDLVL2, 

[08/10] cassandra git commit: Merge branch 'cassandra-3.0' into cassandra-3.11

2017-02-22 Thread yukim
Merge branch 'cassandra-3.0' into cassandra-3.11


Project: http://git-wip-us.apache.org/repos/asf/cassandra/repo
Commit: http://git-wip-us.apache.org/repos/asf/cassandra/commit/b887ae94
Tree: http://git-wip-us.apache.org/repos/asf/cassandra/tree/b887ae94
Diff: http://git-wip-us.apache.org/repos/asf/cassandra/diff/b887ae94

Branch: refs/heads/cassandra-3.11
Commit: b887ae944bfbdbd0a808e368acbbc507311fce0e
Parents: f624b14 61f0c98
Author: Yuki Morishita 
Authored: Thu Feb 23 11:12:46 2017 +0900
Committer: Yuki Morishita 
Committed: Thu Feb 23 11:12:46 2017 +0900

--
 CHANGES.txt |  1 +
 .../LongLeveledCompactionStrategyTest.java  | 50 
 2 files changed, 31 insertions(+), 20 deletions(-)
--


http://git-wip-us.apache.org/repos/asf/cassandra/blob/b887ae94/CHANGES.txt
--
diff --cc CHANGES.txt
index ca490ba,e978a5c..3e38844
--- a/CHANGES.txt
+++ b/CHANGES.txt
@@@ -21,135 -23,6 +21,136 @@@ Merged from 3.0
 live rows in sstabledump (CASSANDRA-13177)
   * Provide user workaround when system_schema.columns does not contain entries
 for a table that's in system_schema.tables (CASSANDRA-13180)
 +Merged from 2.2:
++ * Fix flaky LongLeveledCompactionStrategyTest (CASSANDRA-12202)
 + * Fix failing COPY TO STDOUT (CASSANDRA-12497)
 + * Fix ColumnCounter::countAll behaviour for reverse queries (CASSANDRA-13222)
 + * Exceptions encountered calling getSeeds() breaks OTC thread 
(CASSANDRA-13018)
 + * Fix negative mean latency metric (CASSANDRA-12876)
 + * Use only one file pointer when creating commitlog segments 
(CASSANDRA-12539)
 +Merged from 2.1:
 + * Log stacktrace of uncaught exceptions (CASSANDRA-13108)
 + * Use portable stderr for java error in startup (CASSANDRA-13211)
 + * Fix Thread Leak in OutboundTcpConnection (CASSANDRA-13204)
 + * Coalescing strategy can enter infinite loop (CASSANDRA-13159)
 +
 +3.10
 + * Fix secondary index queries regression (CASSANDRA-13013)
 + * Add duration type to the protocol V5 (CASSANDRA-12850)
 + * Fix duration type validation (CASSANDRA-13143)
 + * Fix flaky GcCompactionTest (CASSANDRA-12664)
 + * Fix TestHintedHandoff.hintedhandoff_decom_test (CASSANDRA-13058)
 + * Fixed query monitoring for range queries (CASSANDRA-13050)
 + * Remove outboundBindAny configuration property (CASSANDRA-12673)
 + * Use correct bounds for all-data range when filtering (CASSANDRA-12666)
 + * Remove timing window in test case (CASSANDRA-12875)
 + * Resolve unit testing without JCE security libraries installed 
(CASSANDRA-12945)
 + * Fix inconsistencies in cassandra-stress load balancing policy 
(CASSANDRA-12919)
 + * Fix validation of non-frozen UDT cells (CASSANDRA-12916)
 + * Don't shut down socket input/output on StreamSession (CASSANDRA-12903)
 + * Fix Murmur3PartitionerTest (CASSANDRA-12858)
 + * Move cqlsh syntax rules into separate module and allow easier 
customization (CASSANDRA-12897)
 + * Fix CommitLogSegmentManagerTest (CASSANDRA-12283)
 + * Fix cassandra-stress truncate option (CASSANDRA-12695)
 + * Fix crossNode value when receiving messages (CASSANDRA-12791)
 + * Don't load MX4J beans twice (CASSANDRA-12869)
 + * Extend native protocol request flags, add versions to SUPPORTED, and 
introduce ProtocolVersion enum (CASSANDRA-12838)
 + * Set JOINING mode when running pre-join tasks (CASSANDRA-12836)
 + * remove net.mintern.primitive library due to license issue (CASSANDRA-12845)
 + * Properly format IPv6 addresses when logging JMX service URL 
(CASSANDRA-12454)
 + * Optimize the vnode allocation for single replica per DC (CASSANDRA-12777)
 + * Use non-token restrictions for bounds when token restrictions are 
overridden (CASSANDRA-12419)
 + * Fix CQLSH auto completion for PER PARTITION LIMIT (CASSANDRA-12803)
 + * Use different build directories for Eclipse and Ant (CASSANDRA-12466)
 + * Avoid potential AttributeError in cqlsh due to no table metadata 
(CASSANDRA-12815)
 + * Fix RandomReplicationAwareTokenAllocatorTest.testExistingCluster 
(CASSANDRA-12812)
 + * Upgrade commons-codec to 1.9 (CASSANDRA-12790)
 + * Make the fanout size for LeveledCompactionStrategy to be configurable 
(CASSANDRA-11550)
 + * Add duration data type (CASSANDRA-11873)
 + * Fix timeout in ReplicationAwareTokenAllocatorTest (CASSANDRA-12784)
 + * Improve sum aggregate functions (CASSANDRA-12417)
 + * Make cassandra.yaml docs for batch_size_*_threshold_in_kb reflect changes 
in CASSANDRA-10876 (CASSANDRA-12761)
 + * cqlsh fails to format collections when using aliases (CASSANDRA-11534)
 + * Check for hash conflicts in prepared statements (CASSANDRA-12733)
 + * Exit query parsing upon first error (CASSANDRA-12598)
 + * Fix cassandra-stress to use single seed in UUID generation 
(CASSANDRA-12729)
 + * 

[04/10] cassandra git commit: run LongLeveledCompactionStrategyTest.testLeveledScanner in a separate table

2017-02-22 Thread yukim
run LongLeveledCompactionStrategyTest.testLeveledScanner in a separate table

patch by marcuse; reviewed by yukim for CASSANDRA-12202


Project: http://git-wip-us.apache.org/repos/asf/cassandra/repo
Commit: http://git-wip-us.apache.org/repos/asf/cassandra/commit/6ffd5cc5
Tree: http://git-wip-us.apache.org/repos/asf/cassandra/tree/6ffd5cc5
Diff: http://git-wip-us.apache.org/repos/asf/cassandra/diff/6ffd5cc5

Branch: refs/heads/trunk
Commit: 6ffd5cc5d28658b4d058de79a9bea9c10a82c8d4
Parents: 88f36a0
Author: Marcus Eriksson 
Authored: Thu Jul 14 15:31:30 2016 +0200
Committer: Yuki Morishita 
Committed: Thu Feb 23 10:35:50 2017 +0900

--
 CHANGES.txt |  1 +
 .../LongLeveledCompactionStrategyTest.java  | 84 +---
 .../unit/org/apache/cassandra/SchemaLoader.java |  3 +
 .../LeveledCompactionStrategyTest.java  |  2 +-
 4 files changed, 62 insertions(+), 28 deletions(-)
--


http://git-wip-us.apache.org/repos/asf/cassandra/blob/6ffd5cc5/CHANGES.txt
--
diff --git a/CHANGES.txt b/CHANGES.txt
index 1a22814..033b366 100644
--- a/CHANGES.txt
+++ b/CHANGES.txt
@@ -1,4 +1,5 @@
 2.2.10
+ * Fix flaky LongLeveledCompactionStrategyTest (CASSANDRA-12202)
  * Fix failing COPY TO STDOUT (CASSANDRA-12497)
  * Fix ColumnCounter::countAll behaviour for reverse queries (CASSANDRA-13222)
  * Exceptions encountered calling getSeeds() breaks OTC thread 
(CASSANDRA-13018)

http://git-wip-us.apache.org/repos/asf/cassandra/blob/6ffd5cc5/test/long/org/apache/cassandra/db/compaction/LongLeveledCompactionStrategyTest.java
--
diff --git 
a/test/long/org/apache/cassandra/db/compaction/LongLeveledCompactionStrategyTest.java
 
b/test/long/org/apache/cassandra/db/compaction/LongLeveledCompactionStrategyTest.java
index 5439a72..8e63006 100644
--- 
a/test/long/org/apache/cassandra/db/compaction/LongLeveledCompactionStrategyTest.java
+++ 
b/test/long/org/apache/cassandra/db/compaction/LongLeveledCompactionStrategyTest.java
@@ -25,6 +25,7 @@ import 
org.apache.cassandra.db.columniterator.OnDiskAtomIterator;
 import org.apache.cassandra.io.sstable.ISSTableScanner;
 import org.apache.cassandra.io.sstable.format.SSTableReader;
 import org.junit.BeforeClass;
+import org.junit.Ignore;
 import org.junit.Test;
 
 import org.apache.cassandra.SchemaLoader;
@@ -41,6 +42,7 @@ public class LongLeveledCompactionStrategyTest
 {
 public static final String KEYSPACE1 = "LongLeveledCompactionStrategyTest";
 public static final String CF_STANDARDLVL = "StandardLeveled";
+public static final String CF_STANDARDLVL2 = "StandardLeveled2";
 
 @BeforeClass
 public static void defineSchema() throws ConfigurationException
@@ -53,6 +55,9 @@ public class LongLeveledCompactionStrategyTest
 KSMetaData.optsWithRF(1),
 SchemaLoader.standardCFMD(KEYSPACE1, 
CF_STANDARDLVL)
 
.compactionStrategyClass(LeveledCompactionStrategy.class)
+
.compactionStrategyOptions(leveledOptions),
+SchemaLoader.standardCFMD(KEYSPACE1, 
CF_STANDARDLVL2)
+
.compactionStrategyClass(LeveledCompactionStrategy.class)
 
.compactionStrategyOptions(leveledOptions));
 }
 
@@ -144,16 +149,34 @@ public class LongLeveledCompactionStrategyTest
 @Test
 public void testLeveledScanner() throws Exception
 {
-testParallelLeveledCompaction();
 Keyspace keyspace = Keyspace.open(KEYSPACE1);
-ColumnFamilyStore store = 
keyspace.getColumnFamilyStore(CF_STANDARDLVL);
-store.disableAutoCompaction();
-
+final ColumnFamilyStore store = 
keyspace.getColumnFamilyStore(CF_STANDARDLVL2);
 WrappingCompactionStrategy strategy = ((WrappingCompactionStrategy) 
store.getCompactionStrategy());
-LeveledCompactionStrategy lcs = (LeveledCompactionStrategy) 
strategy.getWrappedStrategies().get(1);
+final LeveledCompactionStrategy lcs = (LeveledCompactionStrategy) 
strategy.getWrappedStrategies().get(1);
 
-ByteBuffer value = ByteBuffer.wrap(new byte[10 * 1024]); // 10 KB value
+ByteBuffer value = ByteBuffer.wrap(new byte[100 * 1024]); // 100 KB 
value, make it easy to have multiple files
+
+// Enough data to have a level 1 and 2
+int rows = 128;
+int columns = 10;
 
+// Adds enough data to trigger multiple sstable per level
+for (int r = 0; r < rows; r++)
+{
+DecoratedKey key = Util.dk(String.valueOf(r));
+ 

[10/10] cassandra git commit: Merge branch 'cassandra-3.11' into trunk

2017-02-22 Thread yukim
Merge branch 'cassandra-3.11' into trunk


Project: http://git-wip-us.apache.org/repos/asf/cassandra/repo
Commit: http://git-wip-us.apache.org/repos/asf/cassandra/commit/ac210130
Tree: http://git-wip-us.apache.org/repos/asf/cassandra/tree/ac210130
Diff: http://git-wip-us.apache.org/repos/asf/cassandra/diff/ac210130

Branch: refs/heads/trunk
Commit: ac2101305722c81542ff8572b0fa082794846a7f
Parents: fbf7e12 b887ae9
Author: Yuki Morishita 
Authored: Thu Feb 23 11:13:13 2017 +0900
Committer: Yuki Morishita 
Committed: Thu Feb 23 11:13:13 2017 +0900

--
 CHANGES.txt |  1 +
 .../LongLeveledCompactionStrategyTest.java  | 50 
 2 files changed, 31 insertions(+), 20 deletions(-)
--


http://git-wip-us.apache.org/repos/asf/cassandra/blob/ac210130/CHANGES.txt
--

http://git-wip-us.apache.org/repos/asf/cassandra/blob/ac210130/test/long/org/apache/cassandra/db/compaction/LongLeveledCompactionStrategyTest.java
--



[07/10] cassandra git commit: Merge branch 'cassandra-2.2' into cassandra-3.0

2017-02-22 Thread yukim
Merge branch 'cassandra-2.2' into cassandra-3.0


Project: http://git-wip-us.apache.org/repos/asf/cassandra/repo
Commit: http://git-wip-us.apache.org/repos/asf/cassandra/commit/61f0c988
Tree: http://git-wip-us.apache.org/repos/asf/cassandra/tree/61f0c988
Diff: http://git-wip-us.apache.org/repos/asf/cassandra/diff/61f0c988

Branch: refs/heads/trunk
Commit: 61f0c988f78c00fec2c4e028cfb793b84069f737
Parents: 51796ea 6ffd5cc
Author: Yuki Morishita 
Authored: Thu Feb 23 11:01:32 2017 +0900
Committer: Yuki Morishita 
Committed: Thu Feb 23 11:01:32 2017 +0900

--
 CHANGES.txt |  1 +
 .../LongLeveledCompactionStrategyTest.java  | 58 
 .../LeveledCompactionStrategyTest.java  |  2 +-
 3 files changed, 37 insertions(+), 24 deletions(-)
--


http://git-wip-us.apache.org/repos/asf/cassandra/blob/61f0c988/CHANGES.txt
--
diff --cc CHANGES.txt
index afda236,033b366..e978a5c
--- a/CHANGES.txt
+++ b/CHANGES.txt
@@@ -1,7 -1,5 +1,8 @@@
 -2.2.10
 +3.0.12
 + * Remove unnecessary assertion from AntiCompactionTest (CASSANDRA-13070)
 + * Fix cqlsh COPY for dates before 1900 (CASSANDRA-13185)
 +Merged from 2.2
+  * Fix flaky LongLeveledCompactionStrategyTest (CASSANDRA-12202)
   * Fix failing COPY TO STDOUT (CASSANDRA-12497)
   * Fix ColumnCounter::countAll behaviour for reverse queries (CASSANDRA-13222)
   * Exceptions encountered calling getSeeds() breaks OTC thread 
(CASSANDRA-13018)

http://git-wip-us.apache.org/repos/asf/cassandra/blob/61f0c988/test/long/org/apache/cassandra/db/compaction/LongLeveledCompactionStrategyTest.java
--
diff --cc 
test/long/org/apache/cassandra/db/compaction/LongLeveledCompactionStrategyTest.java
index 79497aa,8e63006..562de22
--- 
a/test/long/org/apache/cassandra/db/compaction/LongLeveledCompactionStrategyTest.java
+++ 
b/test/long/org/apache/cassandra/db/compaction/LongLeveledCompactionStrategyTest.java
@@@ -53,9 -51,14 +55,11 @@@ public class LongLeveledCompactionStrat
  leveledOptions.put("sstable_size_in_mb", "1");
  SchemaLoader.prepareServer();
  SchemaLoader.createKeyspace(KEYSPACE1,
 -SimpleStrategy.class,
 -KSMetaData.optsWithRF(1),
 +KeyspaceParams.simple(1),
  SchemaLoader.standardCFMD(KEYSPACE1, 
CF_STANDARDLVL)
 -
.compactionStrategyClass(LeveledCompactionStrategy.class)
 -
.compactionStrategyOptions(leveledOptions),
++
.compaction(CompactionParams.lcs(leveledOptions)),
+ SchemaLoader.standardCFMD(KEYSPACE1, 
CF_STANDARDLVL2)
 -
.compactionStrategyClass(LeveledCompactionStrategy.class)
 -
.compactionStrategyOptions(leveledOptions));
 +
.compaction(CompactionParams.lcs(leveledOptions)));
  }
  
  @Test
@@@ -145,15 -149,34 +149,14 @@@
  @Test
  public void testLeveledScanner() throws Exception
  {
- testParallelLeveledCompaction();
  Keyspace keyspace = Keyspace.open(KEYSPACE1);
- ColumnFamilyStore store = 
keyspace.getColumnFamilyStore(CF_STANDARDLVL);
 -final ColumnFamilyStore store = 
keyspace.getColumnFamilyStore(CF_STANDARDLVL2);
 -WrappingCompactionStrategy strategy = ((WrappingCompactionStrategy) 
store.getCompactionStrategy());
 -final LeveledCompactionStrategy lcs = (LeveledCompactionStrategy) 
strategy.getWrappedStrategies().get(1);
 -
 -ByteBuffer value = ByteBuffer.wrap(new byte[100 * 1024]); // 100 KB 
value, make it easy to have multiple files
++ColumnFamilyStore store = 
keyspace.getColumnFamilyStore(CF_STANDARDLVL2);
 +store.disableAutoCompaction();
  
 -// Enough data to have a level 1 and 2
 -int rows = 128;
 -int columns = 10;
 +LeveledCompactionStrategy lcs = 
(LeveledCompactionStrategy)store.getCompactionStrategyManager().getStrategies().get(1);
  
- ByteBuffer value = ByteBuffer.wrap(new byte[10 * 1024]); // 10 KB 
value
 -// Adds enough data to trigger multiple sstable per level
 -for (int r = 0; r < rows; r++)
 -{
 -DecoratedKey key = Util.dk(String.valueOf(r));
 -Mutation rm = new Mutation(KEYSPACE1, key.getKey());
 -for (int c = 0; c < columns; c++)
 -{
 -rm.add(CF_STANDARDLVL2, 

[03/10] cassandra git commit: run LongLeveledCompactionStrategyTest.testLeveledScanner in a separate table

2017-02-22 Thread yukim
run LongLeveledCompactionStrategyTest.testLeveledScanner in a separate table

patch by marcuse; reviewed by yukim for CASSANDRA-12202


Project: http://git-wip-us.apache.org/repos/asf/cassandra/repo
Commit: http://git-wip-us.apache.org/repos/asf/cassandra/commit/6ffd5cc5
Tree: http://git-wip-us.apache.org/repos/asf/cassandra/tree/6ffd5cc5
Diff: http://git-wip-us.apache.org/repos/asf/cassandra/diff/6ffd5cc5

Branch: refs/heads/cassandra-3.11
Commit: 6ffd5cc5d28658b4d058de79a9bea9c10a82c8d4
Parents: 88f36a0
Author: Marcus Eriksson 
Authored: Thu Jul 14 15:31:30 2016 +0200
Committer: Yuki Morishita 
Committed: Thu Feb 23 10:35:50 2017 +0900

--
 CHANGES.txt |  1 +
 .../LongLeveledCompactionStrategyTest.java  | 84 +---
 .../unit/org/apache/cassandra/SchemaLoader.java |  3 +
 .../LeveledCompactionStrategyTest.java  |  2 +-
 4 files changed, 62 insertions(+), 28 deletions(-)
--


http://git-wip-us.apache.org/repos/asf/cassandra/blob/6ffd5cc5/CHANGES.txt
--
diff --git a/CHANGES.txt b/CHANGES.txt
index 1a22814..033b366 100644
--- a/CHANGES.txt
+++ b/CHANGES.txt
@@ -1,4 +1,5 @@
 2.2.10
+ * Fix flaky LongLeveledCompactionStrategyTest (CASSANDRA-12202)
  * Fix failing COPY TO STDOUT (CASSANDRA-12497)
  * Fix ColumnCounter::countAll behaviour for reverse queries (CASSANDRA-13222)
  * Exceptions encountered calling getSeeds() breaks OTC thread 
(CASSANDRA-13018)

http://git-wip-us.apache.org/repos/asf/cassandra/blob/6ffd5cc5/test/long/org/apache/cassandra/db/compaction/LongLeveledCompactionStrategyTest.java
--
diff --git 
a/test/long/org/apache/cassandra/db/compaction/LongLeveledCompactionStrategyTest.java
 
b/test/long/org/apache/cassandra/db/compaction/LongLeveledCompactionStrategyTest.java
index 5439a72..8e63006 100644
--- 
a/test/long/org/apache/cassandra/db/compaction/LongLeveledCompactionStrategyTest.java
+++ 
b/test/long/org/apache/cassandra/db/compaction/LongLeveledCompactionStrategyTest.java
@@ -25,6 +25,7 @@ import 
org.apache.cassandra.db.columniterator.OnDiskAtomIterator;
 import org.apache.cassandra.io.sstable.ISSTableScanner;
 import org.apache.cassandra.io.sstable.format.SSTableReader;
 import org.junit.BeforeClass;
+import org.junit.Ignore;
 import org.junit.Test;
 
 import org.apache.cassandra.SchemaLoader;
@@ -41,6 +42,7 @@ public class LongLeveledCompactionStrategyTest
 {
 public static final String KEYSPACE1 = "LongLeveledCompactionStrategyTest";
 public static final String CF_STANDARDLVL = "StandardLeveled";
+public static final String CF_STANDARDLVL2 = "StandardLeveled2";
 
 @BeforeClass
 public static void defineSchema() throws ConfigurationException
@@ -53,6 +55,9 @@ public class LongLeveledCompactionStrategyTest
 KSMetaData.optsWithRF(1),
 SchemaLoader.standardCFMD(KEYSPACE1, 
CF_STANDARDLVL)
 
.compactionStrategyClass(LeveledCompactionStrategy.class)
+
.compactionStrategyOptions(leveledOptions),
+SchemaLoader.standardCFMD(KEYSPACE1, 
CF_STANDARDLVL2)
+
.compactionStrategyClass(LeveledCompactionStrategy.class)
 
.compactionStrategyOptions(leveledOptions));
 }
 
@@ -144,16 +149,34 @@ public class LongLeveledCompactionStrategyTest
 @Test
 public void testLeveledScanner() throws Exception
 {
-testParallelLeveledCompaction();
 Keyspace keyspace = Keyspace.open(KEYSPACE1);
-ColumnFamilyStore store = 
keyspace.getColumnFamilyStore(CF_STANDARDLVL);
-store.disableAutoCompaction();
-
+final ColumnFamilyStore store = 
keyspace.getColumnFamilyStore(CF_STANDARDLVL2);
 WrappingCompactionStrategy strategy = ((WrappingCompactionStrategy) 
store.getCompactionStrategy());
-LeveledCompactionStrategy lcs = (LeveledCompactionStrategy) 
strategy.getWrappedStrategies().get(1);
+final LeveledCompactionStrategy lcs = (LeveledCompactionStrategy) 
strategy.getWrappedStrategies().get(1);
 
-ByteBuffer value = ByteBuffer.wrap(new byte[10 * 1024]); // 10 KB value
+ByteBuffer value = ByteBuffer.wrap(new byte[100 * 1024]); // 100 KB 
value, make it easy to have multiple files
+
+// Enough data to have a level 1 and 2
+int rows = 128;
+int columns = 10;
 
+// Adds enough data to trigger multiple sstable per level
+for (int r = 0; r < rows; r++)
+{
+DecoratedKey key = 

[01/10] cassandra git commit: run LongLeveledCompactionStrategyTest.testLeveledScanner in a separate table

2017-02-22 Thread yukim
Repository: cassandra
Updated Branches:
  refs/heads/cassandra-2.2 88f36a095 -> 6ffd5cc5d
  refs/heads/cassandra-3.0 51796ea63 -> 61f0c988f
  refs/heads/cassandra-3.11 f624b14ae -> b887ae944
  refs/heads/trunk fbf7e1274 -> ac2101305


run LongLeveledCompactionStrategyTest.testLeveledScanner in a separate table

patch by marcuse; reviewed by yukim for CASSANDRA-12202


Project: http://git-wip-us.apache.org/repos/asf/cassandra/repo
Commit: http://git-wip-us.apache.org/repos/asf/cassandra/commit/6ffd5cc5
Tree: http://git-wip-us.apache.org/repos/asf/cassandra/tree/6ffd5cc5
Diff: http://git-wip-us.apache.org/repos/asf/cassandra/diff/6ffd5cc5

Branch: refs/heads/cassandra-2.2
Commit: 6ffd5cc5d28658b4d058de79a9bea9c10a82c8d4
Parents: 88f36a0
Author: Marcus Eriksson 
Authored: Thu Jul 14 15:31:30 2016 +0200
Committer: Yuki Morishita 
Committed: Thu Feb 23 10:35:50 2017 +0900

--
 CHANGES.txt |  1 +
 .../LongLeveledCompactionStrategyTest.java  | 84 +---
 .../unit/org/apache/cassandra/SchemaLoader.java |  3 +
 .../LeveledCompactionStrategyTest.java  |  2 +-
 4 files changed, 62 insertions(+), 28 deletions(-)
--


http://git-wip-us.apache.org/repos/asf/cassandra/blob/6ffd5cc5/CHANGES.txt
--
diff --git a/CHANGES.txt b/CHANGES.txt
index 1a22814..033b366 100644
--- a/CHANGES.txt
+++ b/CHANGES.txt
@@ -1,4 +1,5 @@
 2.2.10
+ * Fix flaky LongLeveledCompactionStrategyTest (CASSANDRA-12202)
  * Fix failing COPY TO STDOUT (CASSANDRA-12497)
  * Fix ColumnCounter::countAll behaviour for reverse queries (CASSANDRA-13222)
  * Exceptions encountered calling getSeeds() breaks OTC thread 
(CASSANDRA-13018)

http://git-wip-us.apache.org/repos/asf/cassandra/blob/6ffd5cc5/test/long/org/apache/cassandra/db/compaction/LongLeveledCompactionStrategyTest.java
--
diff --git 
a/test/long/org/apache/cassandra/db/compaction/LongLeveledCompactionStrategyTest.java
 
b/test/long/org/apache/cassandra/db/compaction/LongLeveledCompactionStrategyTest.java
index 5439a72..8e63006 100644
--- 
a/test/long/org/apache/cassandra/db/compaction/LongLeveledCompactionStrategyTest.java
+++ 
b/test/long/org/apache/cassandra/db/compaction/LongLeveledCompactionStrategyTest.java
@@ -25,6 +25,7 @@ import 
org.apache.cassandra.db.columniterator.OnDiskAtomIterator;
 import org.apache.cassandra.io.sstable.ISSTableScanner;
 import org.apache.cassandra.io.sstable.format.SSTableReader;
 import org.junit.BeforeClass;
+import org.junit.Ignore;
 import org.junit.Test;
 
 import org.apache.cassandra.SchemaLoader;
@@ -41,6 +42,7 @@ public class LongLeveledCompactionStrategyTest
 {
 public static final String KEYSPACE1 = "LongLeveledCompactionStrategyTest";
 public static final String CF_STANDARDLVL = "StandardLeveled";
+public static final String CF_STANDARDLVL2 = "StandardLeveled2";
 
 @BeforeClass
 public static void defineSchema() throws ConfigurationException
@@ -53,6 +55,9 @@ public class LongLeveledCompactionStrategyTest
 KSMetaData.optsWithRF(1),
 SchemaLoader.standardCFMD(KEYSPACE1, 
CF_STANDARDLVL)
 
.compactionStrategyClass(LeveledCompactionStrategy.class)
+
.compactionStrategyOptions(leveledOptions),
+SchemaLoader.standardCFMD(KEYSPACE1, 
CF_STANDARDLVL2)
+
.compactionStrategyClass(LeveledCompactionStrategy.class)
 
.compactionStrategyOptions(leveledOptions));
 }
 
@@ -144,16 +149,34 @@ public class LongLeveledCompactionStrategyTest
 @Test
 public void testLeveledScanner() throws Exception
 {
-testParallelLeveledCompaction();
 Keyspace keyspace = Keyspace.open(KEYSPACE1);
-ColumnFamilyStore store = 
keyspace.getColumnFamilyStore(CF_STANDARDLVL);
-store.disableAutoCompaction();
-
+final ColumnFamilyStore store = 
keyspace.getColumnFamilyStore(CF_STANDARDLVL2);
 WrappingCompactionStrategy strategy = ((WrappingCompactionStrategy) 
store.getCompactionStrategy());
-LeveledCompactionStrategy lcs = (LeveledCompactionStrategy) 
strategy.getWrappedStrategies().get(1);
+final LeveledCompactionStrategy lcs = (LeveledCompactionStrategy) 
strategy.getWrappedStrategies().get(1);
 
-ByteBuffer value = ByteBuffer.wrap(new byte[10 * 1024]); // 10 KB value
+ByteBuffer value = ByteBuffer.wrap(new byte[100 * 1024]); // 100 KB 
value, make it easy to have multiple files
+
+// Enough data to have a level 1 

[05/10] cassandra git commit: Merge branch 'cassandra-2.2' into cassandra-3.0

2017-02-22 Thread yukim
Merge branch 'cassandra-2.2' into cassandra-3.0


Project: http://git-wip-us.apache.org/repos/asf/cassandra/repo
Commit: http://git-wip-us.apache.org/repos/asf/cassandra/commit/61f0c988
Tree: http://git-wip-us.apache.org/repos/asf/cassandra/tree/61f0c988
Diff: http://git-wip-us.apache.org/repos/asf/cassandra/diff/61f0c988

Branch: refs/heads/cassandra-3.11
Commit: 61f0c988f78c00fec2c4e028cfb793b84069f737
Parents: 51796ea 6ffd5cc
Author: Yuki Morishita 
Authored: Thu Feb 23 11:01:32 2017 +0900
Committer: Yuki Morishita 
Committed: Thu Feb 23 11:01:32 2017 +0900

--
 CHANGES.txt |  1 +
 .../LongLeveledCompactionStrategyTest.java  | 58 
 .../LeveledCompactionStrategyTest.java  |  2 +-
 3 files changed, 37 insertions(+), 24 deletions(-)
--


http://git-wip-us.apache.org/repos/asf/cassandra/blob/61f0c988/CHANGES.txt
--
diff --cc CHANGES.txt
index afda236,033b366..e978a5c
--- a/CHANGES.txt
+++ b/CHANGES.txt
@@@ -1,7 -1,5 +1,8 @@@
 -2.2.10
 +3.0.12
 + * Remove unnecessary assertion from AntiCompactionTest (CASSANDRA-13070)
 + * Fix cqlsh COPY for dates before 1900 (CASSANDRA-13185)
 +Merged from 2.2
+  * Fix flaky LongLeveledCompactionStrategyTest (CASSANDRA-12202)
   * Fix failing COPY TO STDOUT (CASSANDRA-12497)
   * Fix ColumnCounter::countAll behaviour for reverse queries (CASSANDRA-13222)
   * Exceptions encountered calling getSeeds() breaks OTC thread 
(CASSANDRA-13018)

http://git-wip-us.apache.org/repos/asf/cassandra/blob/61f0c988/test/long/org/apache/cassandra/db/compaction/LongLeveledCompactionStrategyTest.java
--
diff --cc 
test/long/org/apache/cassandra/db/compaction/LongLeveledCompactionStrategyTest.java
index 79497aa,8e63006..562de22
--- 
a/test/long/org/apache/cassandra/db/compaction/LongLeveledCompactionStrategyTest.java
+++ 
b/test/long/org/apache/cassandra/db/compaction/LongLeveledCompactionStrategyTest.java
@@@ -53,9 -51,14 +55,11 @@@ public class LongLeveledCompactionStrat
  leveledOptions.put("sstable_size_in_mb", "1");
  SchemaLoader.prepareServer();
  SchemaLoader.createKeyspace(KEYSPACE1,
 -SimpleStrategy.class,
 -KSMetaData.optsWithRF(1),
 +KeyspaceParams.simple(1),
  SchemaLoader.standardCFMD(KEYSPACE1, 
CF_STANDARDLVL)
 -
.compactionStrategyClass(LeveledCompactionStrategy.class)
 -
.compactionStrategyOptions(leveledOptions),
++
.compaction(CompactionParams.lcs(leveledOptions)),
+ SchemaLoader.standardCFMD(KEYSPACE1, 
CF_STANDARDLVL2)
 -
.compactionStrategyClass(LeveledCompactionStrategy.class)
 -
.compactionStrategyOptions(leveledOptions));
 +
.compaction(CompactionParams.lcs(leveledOptions)));
  }
  
  @Test
@@@ -145,15 -149,34 +149,14 @@@
  @Test
  public void testLeveledScanner() throws Exception
  {
- testParallelLeveledCompaction();
  Keyspace keyspace = Keyspace.open(KEYSPACE1);
- ColumnFamilyStore store = 
keyspace.getColumnFamilyStore(CF_STANDARDLVL);
 -final ColumnFamilyStore store = 
keyspace.getColumnFamilyStore(CF_STANDARDLVL2);
 -WrappingCompactionStrategy strategy = ((WrappingCompactionStrategy) 
store.getCompactionStrategy());
 -final LeveledCompactionStrategy lcs = (LeveledCompactionStrategy) 
strategy.getWrappedStrategies().get(1);
 -
 -ByteBuffer value = ByteBuffer.wrap(new byte[100 * 1024]); // 100 KB 
value, make it easy to have multiple files
++ColumnFamilyStore store = 
keyspace.getColumnFamilyStore(CF_STANDARDLVL2);
 +store.disableAutoCompaction();
  
 -// Enough data to have a level 1 and 2
 -int rows = 128;
 -int columns = 10;
 +LeveledCompactionStrategy lcs = 
(LeveledCompactionStrategy)store.getCompactionStrategyManager().getStrategies().get(1);
  
- ByteBuffer value = ByteBuffer.wrap(new byte[10 * 1024]); // 10 KB 
value
 -// Adds enough data to trigger multiple sstable per level
 -for (int r = 0; r < rows; r++)
 -{
 -DecoratedKey key = Util.dk(String.valueOf(r));
 -Mutation rm = new Mutation(KEYSPACE1, key.getKey());
 -for (int c = 0; c < columns; c++)
 -{
 -rm.add(CF_STANDARDLVL2, 

[09/10] cassandra git commit: Merge branch 'cassandra-3.0' into cassandra-3.11

2017-02-22 Thread yukim
Merge branch 'cassandra-3.0' into cassandra-3.11


Project: http://git-wip-us.apache.org/repos/asf/cassandra/repo
Commit: http://git-wip-us.apache.org/repos/asf/cassandra/commit/b887ae94
Tree: http://git-wip-us.apache.org/repos/asf/cassandra/tree/b887ae94
Diff: http://git-wip-us.apache.org/repos/asf/cassandra/diff/b887ae94

Branch: refs/heads/trunk
Commit: b887ae944bfbdbd0a808e368acbbc507311fce0e
Parents: f624b14 61f0c98
Author: Yuki Morishita 
Authored: Thu Feb 23 11:12:46 2017 +0900
Committer: Yuki Morishita 
Committed: Thu Feb 23 11:12:46 2017 +0900

--
 CHANGES.txt |  1 +
 .../LongLeveledCompactionStrategyTest.java  | 50 
 2 files changed, 31 insertions(+), 20 deletions(-)
--


http://git-wip-us.apache.org/repos/asf/cassandra/blob/b887ae94/CHANGES.txt
--
diff --cc CHANGES.txt
index ca490ba,e978a5c..3e38844
--- a/CHANGES.txt
+++ b/CHANGES.txt
@@@ -21,135 -23,6 +21,136 @@@ Merged from 3.0
 live rows in sstabledump (CASSANDRA-13177)
   * Provide user workaround when system_schema.columns does not contain entries
 for a table that's in system_schema.tables (CASSANDRA-13180)
 +Merged from 2.2:
++ * Fix flaky LongLeveledCompactionStrategyTest (CASSANDRA-12202)
 + * Fix failing COPY TO STDOUT (CASSANDRA-12497)
 + * Fix ColumnCounter::countAll behaviour for reverse queries (CASSANDRA-13222)
 + * Exceptions encountered calling getSeeds() breaks OTC thread 
(CASSANDRA-13018)
 + * Fix negative mean latency metric (CASSANDRA-12876)
 + * Use only one file pointer when creating commitlog segments 
(CASSANDRA-12539)
 +Merged from 2.1:
 + * Log stacktrace of uncaught exceptions (CASSANDRA-13108)
 + * Use portable stderr for java error in startup (CASSANDRA-13211)
 + * Fix Thread Leak in OutboundTcpConnection (CASSANDRA-13204)
 + * Coalescing strategy can enter infinite loop (CASSANDRA-13159)
 +
 +3.10
 + * Fix secondary index queries regression (CASSANDRA-13013)
 + * Add duration type to the protocol V5 (CASSANDRA-12850)
 + * Fix duration type validation (CASSANDRA-13143)
 + * Fix flaky GcCompactionTest (CASSANDRA-12664)
 + * Fix TestHintedHandoff.hintedhandoff_decom_test (CASSANDRA-13058)
 + * Fixed query monitoring for range queries (CASSANDRA-13050)
 + * Remove outboundBindAny configuration property (CASSANDRA-12673)
 + * Use correct bounds for all-data range when filtering (CASSANDRA-12666)
 + * Remove timing window in test case (CASSANDRA-12875)
 + * Resolve unit testing without JCE security libraries installed 
(CASSANDRA-12945)
 + * Fix inconsistencies in cassandra-stress load balancing policy 
(CASSANDRA-12919)
 + * Fix validation of non-frozen UDT cells (CASSANDRA-12916)
 + * Don't shut down socket input/output on StreamSession (CASSANDRA-12903)
 + * Fix Murmur3PartitionerTest (CASSANDRA-12858)
 + * Move cqlsh syntax rules into separate module and allow easier 
customization (CASSANDRA-12897)
 + * Fix CommitLogSegmentManagerTest (CASSANDRA-12283)
 + * Fix cassandra-stress truncate option (CASSANDRA-12695)
 + * Fix crossNode value when receiving messages (CASSANDRA-12791)
 + * Don't load MX4J beans twice (CASSANDRA-12869)
 + * Extend native protocol request flags, add versions to SUPPORTED, and 
introduce ProtocolVersion enum (CASSANDRA-12838)
 + * Set JOINING mode when running pre-join tasks (CASSANDRA-12836)
 + * remove net.mintern.primitive library due to license issue (CASSANDRA-12845)
 + * Properly format IPv6 addresses when logging JMX service URL 
(CASSANDRA-12454)
 + * Optimize the vnode allocation for single replica per DC (CASSANDRA-12777)
 + * Use non-token restrictions for bounds when token restrictions are 
overridden (CASSANDRA-12419)
 + * Fix CQLSH auto completion for PER PARTITION LIMIT (CASSANDRA-12803)
 + * Use different build directories for Eclipse and Ant (CASSANDRA-12466)
 + * Avoid potential AttributeError in cqlsh due to no table metadata 
(CASSANDRA-12815)
 + * Fix RandomReplicationAwareTokenAllocatorTest.testExistingCluster 
(CASSANDRA-12812)
 + * Upgrade commons-codec to 1.9 (CASSANDRA-12790)
 + * Make the fanout size for LeveledCompactionStrategy to be configurable 
(CASSANDRA-11550)
 + * Add duration data type (CASSANDRA-11873)
 + * Fix timeout in ReplicationAwareTokenAllocatorTest (CASSANDRA-12784)
 + * Improve sum aggregate functions (CASSANDRA-12417)
 + * Make cassandra.yaml docs for batch_size_*_threshold_in_kb reflect changes 
in CASSANDRA-10876 (CASSANDRA-12761)
 + * cqlsh fails to format collections when using aliases (CASSANDRA-11534)
 + * Check for hash conflicts in prepared statements (CASSANDRA-12733)
 + * Exit query parsing upon first error (CASSANDRA-12598)
 + * Fix cassandra-stress to use single seed in UUID generation 
(CASSANDRA-12729)
 + * CQLSSTableWriter does 

[02/10] cassandra git commit: run LongLeveledCompactionStrategyTest.testLeveledScanner in a separate table

2017-02-22 Thread yukim
run LongLeveledCompactionStrategyTest.testLeveledScanner in a separate table

patch by marcuse; reviewed by yukim for CASSANDRA-12202


Project: http://git-wip-us.apache.org/repos/asf/cassandra/repo
Commit: http://git-wip-us.apache.org/repos/asf/cassandra/commit/6ffd5cc5
Tree: http://git-wip-us.apache.org/repos/asf/cassandra/tree/6ffd5cc5
Diff: http://git-wip-us.apache.org/repos/asf/cassandra/diff/6ffd5cc5

Branch: refs/heads/cassandra-3.0
Commit: 6ffd5cc5d28658b4d058de79a9bea9c10a82c8d4
Parents: 88f36a0
Author: Marcus Eriksson 
Authored: Thu Jul 14 15:31:30 2016 +0200
Committer: Yuki Morishita 
Committed: Thu Feb 23 10:35:50 2017 +0900

--
 CHANGES.txt |  1 +
 .../LongLeveledCompactionStrategyTest.java  | 84 +---
 .../unit/org/apache/cassandra/SchemaLoader.java |  3 +
 .../LeveledCompactionStrategyTest.java  |  2 +-
 4 files changed, 62 insertions(+), 28 deletions(-)
--


http://git-wip-us.apache.org/repos/asf/cassandra/blob/6ffd5cc5/CHANGES.txt
--
diff --git a/CHANGES.txt b/CHANGES.txt
index 1a22814..033b366 100644
--- a/CHANGES.txt
+++ b/CHANGES.txt
@@ -1,4 +1,5 @@
 2.2.10
+ * Fix flaky LongLeveledCompactionStrategyTest (CASSANDRA-12202)
  * Fix failing COPY TO STDOUT (CASSANDRA-12497)
  * Fix ColumnCounter::countAll behaviour for reverse queries (CASSANDRA-13222)
  * Exceptions encountered calling getSeeds() breaks OTC thread 
(CASSANDRA-13018)

http://git-wip-us.apache.org/repos/asf/cassandra/blob/6ffd5cc5/test/long/org/apache/cassandra/db/compaction/LongLeveledCompactionStrategyTest.java
--
diff --git 
a/test/long/org/apache/cassandra/db/compaction/LongLeveledCompactionStrategyTest.java
 
b/test/long/org/apache/cassandra/db/compaction/LongLeveledCompactionStrategyTest.java
index 5439a72..8e63006 100644
--- 
a/test/long/org/apache/cassandra/db/compaction/LongLeveledCompactionStrategyTest.java
+++ 
b/test/long/org/apache/cassandra/db/compaction/LongLeveledCompactionStrategyTest.java
@@ -25,6 +25,7 @@ import 
org.apache.cassandra.db.columniterator.OnDiskAtomIterator;
 import org.apache.cassandra.io.sstable.ISSTableScanner;
 import org.apache.cassandra.io.sstable.format.SSTableReader;
 import org.junit.BeforeClass;
+import org.junit.Ignore;
 import org.junit.Test;
 
 import org.apache.cassandra.SchemaLoader;
@@ -41,6 +42,7 @@ public class LongLeveledCompactionStrategyTest
 {
 public static final String KEYSPACE1 = "LongLeveledCompactionStrategyTest";
 public static final String CF_STANDARDLVL = "StandardLeveled";
+public static final String CF_STANDARDLVL2 = "StandardLeveled2";
 
 @BeforeClass
 public static void defineSchema() throws ConfigurationException
@@ -53,6 +55,9 @@ public class LongLeveledCompactionStrategyTest
 KSMetaData.optsWithRF(1),
 SchemaLoader.standardCFMD(KEYSPACE1, 
CF_STANDARDLVL)
 
.compactionStrategyClass(LeveledCompactionStrategy.class)
+
.compactionStrategyOptions(leveledOptions),
+SchemaLoader.standardCFMD(KEYSPACE1, 
CF_STANDARDLVL2)
+
.compactionStrategyClass(LeveledCompactionStrategy.class)
 
.compactionStrategyOptions(leveledOptions));
 }
 
@@ -144,16 +149,34 @@ public class LongLeveledCompactionStrategyTest
 @Test
 public void testLeveledScanner() throws Exception
 {
-testParallelLeveledCompaction();
 Keyspace keyspace = Keyspace.open(KEYSPACE1);
-ColumnFamilyStore store = 
keyspace.getColumnFamilyStore(CF_STANDARDLVL);
-store.disableAutoCompaction();
-
+final ColumnFamilyStore store = 
keyspace.getColumnFamilyStore(CF_STANDARDLVL2);
 WrappingCompactionStrategy strategy = ((WrappingCompactionStrategy) 
store.getCompactionStrategy());
-LeveledCompactionStrategy lcs = (LeveledCompactionStrategy) 
strategy.getWrappedStrategies().get(1);
+final LeveledCompactionStrategy lcs = (LeveledCompactionStrategy) 
strategy.getWrappedStrategies().get(1);
 
-ByteBuffer value = ByteBuffer.wrap(new byte[10 * 1024]); // 10 KB value
+ByteBuffer value = ByteBuffer.wrap(new byte[100 * 1024]); // 100 KB 
value, make it easy to have multiple files
+
+// Enough data to have a level 1 and 2
+int rows = 128;
+int columns = 10;
 
+// Adds enough data to trigger multiple sstable per level
+for (int r = 0; r < rows; r++)
+{
+DecoratedKey key = 

[jira] [Updated] (CASSANDRA-12886) Streaming failed due to SSL Socket connection reset

2017-02-22 Thread Yuki Morishita (JIRA)

 [ 
https://issues.apache.org/jira/browse/CASSANDRA-12886?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
 ]

Yuki Morishita updated CASSANDRA-12886:
---
Status: Ready to Commit  (was: Patch Available)

> Streaming failed due to SSL Socket connection reset
> ---
>
> Key: CASSANDRA-12886
> URL: https://issues.apache.org/jira/browse/CASSANDRA-12886
> Project: Cassandra
>  Issue Type: Bug
>Reporter: Bing Wu
>Assignee: Paulo Motta
> Attachments: debug.log.2016-11-10_2319.gz
>
>
> While running "nodetool repair", I see many instances of 
> "javax.net.ssl.SSLException: java.net.SocketException: Connection reset" in 
> system.logs on some nodes in the cluster. Timestamps correspond to streaming 
> source/initiator's error messages of "sync failed between ..."
> Setup: 
> - Cassandra 3.7.01 
> - CentOS 6.7 in AWS (multi-region)
> - JDK version: {noformat}
> java version "1.8.0_102"
> Java(TM) SE Runtime Environment (build 1.8.0_102-b14)
> Java HotSpot(TM) 64-Bit Server VM (build 25.102-b14, mixed mode)
> {noformat}
> - cassandra.yaml:
> {noformat}
> server_encryption_options:
> internode_encryption: all
> keystore: [path]
> keystore_password: [password]
> truststore: [path]
> truststore_password: [password]
> # More advanced defaults below:
> # protocol: TLS
> # algorithm: SunX509
> # store_type: JKS
> # cipher_suites: 
> [TLS_RSA_WITH_AES_128_CBC_SHA,TLS_RSA_WITH_AES_256_CBC_SHA,TLS_DHE_RSA_WITH_AES_128_CBC_SHA,TLS_DHE_RSA_WITH_AES_256_CBC_SHA,TLS_ECDHE_RSA_WITH_AES_128_CBC_SHA,TLS_ECDHE_RSA_WITH_AES_256_CBC_SHA]
> require_client_auth: false
> {noformat}
> Error messages in system.log on the target host:
> {noformat}
> ERROR [STREAM-OUT-/54.247.111.232:7001] 2016-11-07 07:30:56,475 
> StreamSession.java:529 - [Stream #e14abcb0-a4bb-11e6-9758-55b9ac38b78e] 
> Streaming error occurred on session with peer 54.247.111.232
> javax.net.ssl.SSLException: Connection has been shutdown: 
> javax.net.ssl.SSLException: java.net.SocketException: Connection reset
> at sun.security.ssl.SSLSocketImpl.checkEOF(SSLSocketImpl.java:1541) 
> ~[na:1.8.0_102]
> at sun.security.ssl.SSLSocketImpl.checkWrite(SSLSocketImpl.java:1553) 
> ~[na:1.8.0_102]
> at sun.security.ssl.AppOutputStream.write(AppOutputStream.java:71) 
> ~[na:1.8.0_102]
> at 
> java.io.BufferedOutputStream.flushBuffer(BufferedOutputStream.java:82) 
> ~[na:1.8.0_102]
> at java.io.BufferedOutputStream.flush(BufferedOutputStream.java:140) 
> ~[na:1.8.0_102]
> at 
> org.apache.cassandra.io.util.WrappedDataOutputStreamPlus.flush(WrappedDataOutputStreamPlus.java:66)
>  ~[apache-cassandra-3.7.0.jar:3.7.0]
> at 
> org.apache.cassandra.streaming.ConnectionHandler$OutgoingMessageHandler.sendMessage(ConnectionHandler.java:371)
>  [apache-cassandra-3.7.0.jar:3.7.0]
> at 
> org.apache.cassandra.streaming.ConnectionHandler$OutgoingMessageHandler.run(ConnectionHandler.java:342)
>  [apache-cassandra-3.7.0.jar:3.7.0]
> at java.lang.Thread.run(Thread.java:745) [na:1.8.0_102]
> Caused by: javax.net.ssl.SSLException: java.net.SocketException: Connection 
> reset
> {noformat}



--
This message was sent by Atlassian JIRA
(v6.3.15#6346)


[jira] [Commented] (CASSANDRA-12886) Streaming failed due to SSL Socket connection reset

2017-02-22 Thread Yuki Morishita (JIRA)

[ 
https://issues.apache.org/jira/browse/CASSANDRA-12886?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15879647#comment-15879647
 ] 

Yuki Morishita commented on CASSANDRA-12886:


+1. (looks like 2 failed unit tests were due to some env issue.)

So this goes to 3.0 also, right?

> Streaming failed due to SSL Socket connection reset
> ---
>
> Key: CASSANDRA-12886
> URL: https://issues.apache.org/jira/browse/CASSANDRA-12886
> Project: Cassandra
>  Issue Type: Bug
>Reporter: Bing Wu
>Assignee: Paulo Motta
> Attachments: debug.log.2016-11-10_2319.gz
>
>
> While running "nodetool repair", I see many instances of 
> "javax.net.ssl.SSLException: java.net.SocketException: Connection reset" in 
> system.logs on some nodes in the cluster. Timestamps correspond to streaming 
> source/initiator's error messages of "sync failed between ..."
> Setup: 
> - Cassandra 3.7.01 
> - CentOS 6.7 in AWS (multi-region)
> - JDK version: {noformat}
> java version "1.8.0_102"
> Java(TM) SE Runtime Environment (build 1.8.0_102-b14)
> Java HotSpot(TM) 64-Bit Server VM (build 25.102-b14, mixed mode)
> {noformat}
> - cassandra.yaml:
> {noformat}
> server_encryption_options:
> internode_encryption: all
> keystore: [path]
> keystore_password: [password]
> truststore: [path]
> truststore_password: [password]
> # More advanced defaults below:
> # protocol: TLS
> # algorithm: SunX509
> # store_type: JKS
> # cipher_suites: 
> [TLS_RSA_WITH_AES_128_CBC_SHA,TLS_RSA_WITH_AES_256_CBC_SHA,TLS_DHE_RSA_WITH_AES_128_CBC_SHA,TLS_DHE_RSA_WITH_AES_256_CBC_SHA,TLS_ECDHE_RSA_WITH_AES_128_CBC_SHA,TLS_ECDHE_RSA_WITH_AES_256_CBC_SHA]
> require_client_auth: false
> {noformat}
> Error messages in system.log on the target host:
> {noformat}
> ERROR [STREAM-OUT-/54.247.111.232:7001] 2016-11-07 07:30:56,475 
> StreamSession.java:529 - [Stream #e14abcb0-a4bb-11e6-9758-55b9ac38b78e] 
> Streaming error occurred on session with peer 54.247.111.232
> javax.net.ssl.SSLException: Connection has been shutdown: 
> javax.net.ssl.SSLException: java.net.SocketException: Connection reset
> at sun.security.ssl.SSLSocketImpl.checkEOF(SSLSocketImpl.java:1541) 
> ~[na:1.8.0_102]
> at sun.security.ssl.SSLSocketImpl.checkWrite(SSLSocketImpl.java:1553) 
> ~[na:1.8.0_102]
> at sun.security.ssl.AppOutputStream.write(AppOutputStream.java:71) 
> ~[na:1.8.0_102]
> at 
> java.io.BufferedOutputStream.flushBuffer(BufferedOutputStream.java:82) 
> ~[na:1.8.0_102]
> at java.io.BufferedOutputStream.flush(BufferedOutputStream.java:140) 
> ~[na:1.8.0_102]
> at 
> org.apache.cassandra.io.util.WrappedDataOutputStreamPlus.flush(WrappedDataOutputStreamPlus.java:66)
>  ~[apache-cassandra-3.7.0.jar:3.7.0]
> at 
> org.apache.cassandra.streaming.ConnectionHandler$OutgoingMessageHandler.sendMessage(ConnectionHandler.java:371)
>  [apache-cassandra-3.7.0.jar:3.7.0]
> at 
> org.apache.cassandra.streaming.ConnectionHandler$OutgoingMessageHandler.run(ConnectionHandler.java:342)
>  [apache-cassandra-3.7.0.jar:3.7.0]
> at java.lang.Thread.run(Thread.java:745) [na:1.8.0_102]
> Caused by: javax.net.ssl.SSLException: java.net.SocketException: Connection 
> reset
> {noformat}



--
This message was sent by Atlassian JIRA
(v6.3.15#6346)


[jira] [Updated] (CASSANDRA-13258) Rethink read-time defragmentation introduced in 1.1 (CASSANDRA-2503)

2017-02-22 Thread Brandon Williams (JIRA)

 [ 
https://issues.apache.org/jira/browse/CASSANDRA-13258?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
 ]

Brandon Williams updated CASSANDRA-13258:
-
Summary: Rethink read-time defragmentation introduced in 1.1 
(CASSANDRA-2503)  (was: Rethink read-time defragmentation introduced in 1.0 
(CASSANDRA-2503))

> Rethink read-time defragmentation introduced in 1.1 (CASSANDRA-2503)
> 
>
> Key: CASSANDRA-13258
> URL: https://issues.apache.org/jira/browse/CASSANDRA-13258
> Project: Cassandra
>  Issue Type: Bug
>Reporter: Nate McCall
>
> tl,dr; we issue a Mutation(!) on a read when using STCS and there are more 
> than minCompactedThreshold SSTables encountered by the iterator. (See 
> org/apache/cassandra/db/SinglePartitionReadCommand.java:782)
> I can see a couple of use cases where this *might* be useful, but from a 
> practical stand point, this is an excellent way to exacerbate compaction 
> falling behind.
> With the introduction of other, purpose built compaction strategies, I would 
> be interested to hear why anyone would consider this still a good idea. Note 
> that we only do it for STCS so at best, we are inconsistent. 
> There are some interesting comments on CASSANDRA-10342 regarding this as well.



--
This message was sent by Atlassian JIRA
(v6.3.15#6346)


[jira] [Updated] (CASSANDRA-13070) unittest antiCompactionSizeTest is flaky

2017-02-22 Thread Yuki Morishita (JIRA)

 [ 
https://issues.apache.org/jira/browse/CASSANDRA-13070?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
 ]

Yuki Morishita updated CASSANDRA-13070:
---
   Resolution: Fixed
Fix Version/s: (was: 3.0.x)
   3.11.0
   3.0.12
   Status: Resolved  (was: Patch Available)

Thanks, committed as {{51796ea63420f8daa49c9d491588ba9740c6b0d1}}.

> unittest antiCompactionSizeTest is flaky
> 
>
> Key: CASSANDRA-13070
> URL: https://issues.apache.org/jira/browse/CASSANDRA-13070
> Project: Cassandra
>  Issue Type: Bug
>  Components: Testing
>Reporter: Jay Zhuang
>Assignee: Jay Zhuang
> Fix For: 3.0.12, 3.11.0
>
> Attachments: 13070-3.0.txt, 13070-update-3.0.txt
>
>
> Unittest 
> {{org.apache.cassandra.db.compaction.AntiCompactionTest.antiCompactionSizeTest}}
>  is failing from time to time on branch 3.0 
> ([13e9396|https://github.com/apache/cassandra/commit/13e939624d21eaf6e16d60b28636125e817ab286]):
> {code}
> [junit] Testcase: 
> antiCompactionSizeTest(org.apache.cassandra.db.compaction.AntiCompactionTest):
> FAILED
> [junit] expected:<1.29786604E8> but was:<1.13623354E8>
> [junit] junit.framework.AssertionFailedError: expected:<1.29786604E8> but 
> was:<1.13623354E8>
> [junit] at 
> org.apache.cassandra.db.compaction.AntiCompactionTest.antiCompactionSizeTest(AntiCompactionTest.java:164)
> {code}
> Run the single test 21 times:
> {code}
> for i in {0..20}; do echo ==$i; ant testsome 
> -Dtest.name=org.apache.cassandra.db.compaction.AntiCompactionTest 
> -Dtest.methods=antiCompactionSizeTest; echo $i $? >> ~/testresult; done
> {code}
> On mac, it passed for 5 times, on linux it passed for 6 times.



--
This message was sent by Atlassian JIRA
(v6.3.15#6346)


[6/6] cassandra git commit: Merge branch 'cassandra-3.11' into trunk

2017-02-22 Thread yukim
Merge branch 'cassandra-3.11' into trunk


Project: http://git-wip-us.apache.org/repos/asf/cassandra/repo
Commit: http://git-wip-us.apache.org/repos/asf/cassandra/commit/fbf7e127
Tree: http://git-wip-us.apache.org/repos/asf/cassandra/tree/fbf7e127
Diff: http://git-wip-us.apache.org/repos/asf/cassandra/diff/fbf7e127

Branch: refs/heads/trunk
Commit: fbf7e127424a006b6f7f9c1a669db72727efef87
Parents: cc51b4d f624b14
Author: Yuki Morishita 
Authored: Thu Feb 23 10:09:05 2017 +0900
Committer: Yuki Morishita 
Committed: Thu Feb 23 10:09:05 2017 +0900

--
 CHANGES.txt| 1 +
 .../org/apache/cassandra/db/compaction/AntiCompactionTest.java | 2 --
 2 files changed, 1 insertion(+), 2 deletions(-)
--


http://git-wip-us.apache.org/repos/asf/cassandra/blob/fbf7e127/CHANGES.txt
--

http://git-wip-us.apache.org/repos/asf/cassandra/blob/fbf7e127/test/unit/org/apache/cassandra/db/compaction/AntiCompactionTest.java
--



[2/6] cassandra git commit: Remove unnecessary assertion from AntiCompactionTest

2017-02-22 Thread yukim
Remove unnecessary assertion from AntiCompactionTest

patch by Jay Zhuang; reviewed by yukim for CASSANDRA-13070


Project: http://git-wip-us.apache.org/repos/asf/cassandra/repo
Commit: http://git-wip-us.apache.org/repos/asf/cassandra/commit/51796ea6
Tree: http://git-wip-us.apache.org/repos/asf/cassandra/tree/51796ea6
Diff: http://git-wip-us.apache.org/repos/asf/cassandra/diff/51796ea6

Branch: refs/heads/cassandra-3.11
Commit: 51796ea63420f8daa49c9d491588ba9740c6b0d1
Parents: 5fba118
Author: Jay Zhuang 
Authored: Thu Feb 23 10:06:57 2017 +0900
Committer: Yuki Morishita 
Committed: Thu Feb 23 10:08:37 2017 +0900

--
 CHANGES.txt| 1 +
 .../org/apache/cassandra/db/compaction/AntiCompactionTest.java | 2 --
 2 files changed, 1 insertion(+), 2 deletions(-)
--


http://git-wip-us.apache.org/repos/asf/cassandra/blob/51796ea6/CHANGES.txt
--
diff --git a/CHANGES.txt b/CHANGES.txt
index b744b40..afda236 100644
--- a/CHANGES.txt
+++ b/CHANGES.txt
@@ -1,4 +1,5 @@
 3.0.12
+ * Remove unnecessary assertion from AntiCompactionTest (CASSANDRA-13070)
  * Fix cqlsh COPY for dates before 1900 (CASSANDRA-13185)
 Merged from 2.2
  * Fix failing COPY TO STDOUT (CASSANDRA-12497)

http://git-wip-us.apache.org/repos/asf/cassandra/blob/51796ea6/test/unit/org/apache/cassandra/db/compaction/AntiCompactionTest.java
--
diff --git 
a/test/unit/org/apache/cassandra/db/compaction/AntiCompactionTest.java 
b/test/unit/org/apache/cassandra/db/compaction/AntiCompactionTest.java
index 4c25f3a..b98421d 100644
--- a/test/unit/org/apache/cassandra/db/compaction/AntiCompactionTest.java
+++ b/test/unit/org/apache/cassandra/db/compaction/AntiCompactionTest.java
@@ -143,7 +143,6 @@ public class AntiCompactionTest
 cfs.disableAutoCompaction();
 SSTableReader s = writeFile(cfs, 1000);
 cfs.addSSTable(s);
-long origSize = s.bytesOnDisk();
 Range range = new Range(new 
BytesToken(ByteBufferUtil.bytes(0)), new BytesToken(ByteBufferUtil.bytes(500)));
 Collection sstables = cfs.getLiveSSTables();
 UUID parentRepairSession = UUID.randomUUID();
@@ -161,7 +160,6 @@ public class AntiCompactionTest
 }
 assertEquals(sum, cfs.metric.liveDiskSpaceUsed.getCount());
 assertEquals(rows, 1000 * (1000 * 5));//See writeFile for how this 
number is derived
-assertEquals(origSize, cfs.metric.liveDiskSpaceUsed.getCount(), 
1600);
 }
 
 private SSTableReader writeFile(ColumnFamilyStore cfs, int count)



[4/6] cassandra git commit: Merge branch 'cassandra-3.0' into cassandra-3.11

2017-02-22 Thread yukim
Merge branch 'cassandra-3.0' into cassandra-3.11


Project: http://git-wip-us.apache.org/repos/asf/cassandra/repo
Commit: http://git-wip-us.apache.org/repos/asf/cassandra/commit/f624b14a
Tree: http://git-wip-us.apache.org/repos/asf/cassandra/tree/f624b14a
Diff: http://git-wip-us.apache.org/repos/asf/cassandra/diff/f624b14a

Branch: refs/heads/trunk
Commit: f624b14ae586b3dfd4c4d24e04990ea083bc2c17
Parents: b3490c0 51796ea
Author: Yuki Morishita 
Authored: Thu Feb 23 10:08:56 2017 +0900
Committer: Yuki Morishita 
Committed: Thu Feb 23 10:08:56 2017 +0900

--
 CHANGES.txt| 1 +
 .../org/apache/cassandra/db/compaction/AntiCompactionTest.java | 2 --
 2 files changed, 1 insertion(+), 2 deletions(-)
--


http://git-wip-us.apache.org/repos/asf/cassandra/blob/f624b14a/CHANGES.txt
--
diff --cc CHANGES.txt
index 3dc192f,afda236..ca490ba
--- a/CHANGES.txt
+++ b/CHANGES.txt
@@@ -1,16 -1,17 +1,17 @@@
 -3.0.12
 +3.11.0
 + * Obfuscate password in stress-graphs (CASSANDRA-12233)
 + * Move to FastThreadLocalThread and FastThreadLocal (CASSANDRA-13034)
 + * nodetool stopdaemon errors out (CASSANDRA-13030)
 + * Tables in system_distributed should not use gcgs of 0 (CASSANDRA-12954)
 + * Fix primary index calculation for SASI (CASSANDRA-12910)
 + * More fixes to the TokenAllocator (CASSANDRA-12990)
 + * NoReplicationTokenAllocator should work with zero replication factor 
(CASSANDRA-12983)
 +Merged from 3.0:
+  * Remove unnecessary assertion from AntiCompactionTest (CASSANDRA-13070)
   * Fix cqlsh COPY for dates before 1900 (CASSANDRA-13185)
 -Merged from 2.2
 - * Fix failing COPY TO STDOUT (CASSANDRA-12497)
 - * Fix ColumnCounter::countAll behaviour for reverse queries (CASSANDRA-13222)
 - * Exceptions encountered calling getSeeds() breaks OTC thread 
(CASSANDRA-13018)
 -Merged from 2.1:
 - * Log stacktrace of uncaught exceptions (CASSANDRA-13108)
 -
 -3.0.11
   * Use keyspace replication settings on system.size_estimates table 
(CASSANDRA-9639)
   * Add vm.max_map_count StartupCheck (CASSANDRA-13008)
 - * Hint related logging should include the IP address of the destination in 
addition to 
 + * Hint related logging should include the IP address of the destination in 
addition to
 host ID (CASSANDRA-13205)
   * Reloading logback.xml does not work (CASSANDRA-13173)
   * Lightweight transactions temporarily fail after upgrade from 2.1 to 3.0 
(CASSANDRA-13109)



[5/6] cassandra git commit: Merge branch 'cassandra-3.0' into cassandra-3.11

2017-02-22 Thread yukim
Merge branch 'cassandra-3.0' into cassandra-3.11


Project: http://git-wip-us.apache.org/repos/asf/cassandra/repo
Commit: http://git-wip-us.apache.org/repos/asf/cassandra/commit/f624b14a
Tree: http://git-wip-us.apache.org/repos/asf/cassandra/tree/f624b14a
Diff: http://git-wip-us.apache.org/repos/asf/cassandra/diff/f624b14a

Branch: refs/heads/cassandra-3.11
Commit: f624b14ae586b3dfd4c4d24e04990ea083bc2c17
Parents: b3490c0 51796ea
Author: Yuki Morishita 
Authored: Thu Feb 23 10:08:56 2017 +0900
Committer: Yuki Morishita 
Committed: Thu Feb 23 10:08:56 2017 +0900

--
 CHANGES.txt| 1 +
 .../org/apache/cassandra/db/compaction/AntiCompactionTest.java | 2 --
 2 files changed, 1 insertion(+), 2 deletions(-)
--


http://git-wip-us.apache.org/repos/asf/cassandra/blob/f624b14a/CHANGES.txt
--
diff --cc CHANGES.txt
index 3dc192f,afda236..ca490ba
--- a/CHANGES.txt
+++ b/CHANGES.txt
@@@ -1,16 -1,17 +1,17 @@@
 -3.0.12
 +3.11.0
 + * Obfuscate password in stress-graphs (CASSANDRA-12233)
 + * Move to FastThreadLocalThread and FastThreadLocal (CASSANDRA-13034)
 + * nodetool stopdaemon errors out (CASSANDRA-13030)
 + * Tables in system_distributed should not use gcgs of 0 (CASSANDRA-12954)
 + * Fix primary index calculation for SASI (CASSANDRA-12910)
 + * More fixes to the TokenAllocator (CASSANDRA-12990)
 + * NoReplicationTokenAllocator should work with zero replication factor 
(CASSANDRA-12983)
 +Merged from 3.0:
+  * Remove unnecessary assertion from AntiCompactionTest (CASSANDRA-13070)
   * Fix cqlsh COPY for dates before 1900 (CASSANDRA-13185)
 -Merged from 2.2
 - * Fix failing COPY TO STDOUT (CASSANDRA-12497)
 - * Fix ColumnCounter::countAll behaviour for reverse queries (CASSANDRA-13222)
 - * Exceptions encountered calling getSeeds() breaks OTC thread 
(CASSANDRA-13018)
 -Merged from 2.1:
 - * Log stacktrace of uncaught exceptions (CASSANDRA-13108)
 -
 -3.0.11
   * Use keyspace replication settings on system.size_estimates table 
(CASSANDRA-9639)
   * Add vm.max_map_count StartupCheck (CASSANDRA-13008)
 - * Hint related logging should include the IP address of the destination in 
addition to 
 + * Hint related logging should include the IP address of the destination in 
addition to
 host ID (CASSANDRA-13205)
   * Reloading logback.xml does not work (CASSANDRA-13173)
   * Lightweight transactions temporarily fail after upgrade from 2.1 to 3.0 
(CASSANDRA-13109)



[1/6] cassandra git commit: Remove unnecessary assertion from AntiCompactionTest

2017-02-22 Thread yukim
Repository: cassandra
Updated Branches:
  refs/heads/cassandra-3.0 5fba118e9 -> 51796ea63
  refs/heads/cassandra-3.11 b3490c062 -> f624b14ae
  refs/heads/trunk cc51b4db0 -> fbf7e1274


Remove unnecessary assertion from AntiCompactionTest

patch by Jay Zhuang; reviewed by yukim for CASSANDRA-13070


Project: http://git-wip-us.apache.org/repos/asf/cassandra/repo
Commit: http://git-wip-us.apache.org/repos/asf/cassandra/commit/51796ea6
Tree: http://git-wip-us.apache.org/repos/asf/cassandra/tree/51796ea6
Diff: http://git-wip-us.apache.org/repos/asf/cassandra/diff/51796ea6

Branch: refs/heads/cassandra-3.0
Commit: 51796ea63420f8daa49c9d491588ba9740c6b0d1
Parents: 5fba118
Author: Jay Zhuang 
Authored: Thu Feb 23 10:06:57 2017 +0900
Committer: Yuki Morishita 
Committed: Thu Feb 23 10:08:37 2017 +0900

--
 CHANGES.txt| 1 +
 .../org/apache/cassandra/db/compaction/AntiCompactionTest.java | 2 --
 2 files changed, 1 insertion(+), 2 deletions(-)
--


http://git-wip-us.apache.org/repos/asf/cassandra/blob/51796ea6/CHANGES.txt
--
diff --git a/CHANGES.txt b/CHANGES.txt
index b744b40..afda236 100644
--- a/CHANGES.txt
+++ b/CHANGES.txt
@@ -1,4 +1,5 @@
 3.0.12
+ * Remove unnecessary assertion from AntiCompactionTest (CASSANDRA-13070)
  * Fix cqlsh COPY for dates before 1900 (CASSANDRA-13185)
 Merged from 2.2
  * Fix failing COPY TO STDOUT (CASSANDRA-12497)

http://git-wip-us.apache.org/repos/asf/cassandra/blob/51796ea6/test/unit/org/apache/cassandra/db/compaction/AntiCompactionTest.java
--
diff --git 
a/test/unit/org/apache/cassandra/db/compaction/AntiCompactionTest.java 
b/test/unit/org/apache/cassandra/db/compaction/AntiCompactionTest.java
index 4c25f3a..b98421d 100644
--- a/test/unit/org/apache/cassandra/db/compaction/AntiCompactionTest.java
+++ b/test/unit/org/apache/cassandra/db/compaction/AntiCompactionTest.java
@@ -143,7 +143,6 @@ public class AntiCompactionTest
 cfs.disableAutoCompaction();
 SSTableReader s = writeFile(cfs, 1000);
 cfs.addSSTable(s);
-long origSize = s.bytesOnDisk();
 Range range = new Range(new 
BytesToken(ByteBufferUtil.bytes(0)), new BytesToken(ByteBufferUtil.bytes(500)));
 Collection sstables = cfs.getLiveSSTables();
 UUID parentRepairSession = UUID.randomUUID();
@@ -161,7 +160,6 @@ public class AntiCompactionTest
 }
 assertEquals(sum, cfs.metric.liveDiskSpaceUsed.getCount());
 assertEquals(rows, 1000 * (1000 * 5));//See writeFile for how this 
number is derived
-assertEquals(origSize, cfs.metric.liveDiskSpaceUsed.getCount(), 
1600);
 }
 
 private SSTableReader writeFile(ColumnFamilyStore cfs, int count)



[3/6] cassandra git commit: Remove unnecessary assertion from AntiCompactionTest

2017-02-22 Thread yukim
Remove unnecessary assertion from AntiCompactionTest

patch by Jay Zhuang; reviewed by yukim for CASSANDRA-13070


Project: http://git-wip-us.apache.org/repos/asf/cassandra/repo
Commit: http://git-wip-us.apache.org/repos/asf/cassandra/commit/51796ea6
Tree: http://git-wip-us.apache.org/repos/asf/cassandra/tree/51796ea6
Diff: http://git-wip-us.apache.org/repos/asf/cassandra/diff/51796ea6

Branch: refs/heads/trunk
Commit: 51796ea63420f8daa49c9d491588ba9740c6b0d1
Parents: 5fba118
Author: Jay Zhuang 
Authored: Thu Feb 23 10:06:57 2017 +0900
Committer: Yuki Morishita 
Committed: Thu Feb 23 10:08:37 2017 +0900

--
 CHANGES.txt| 1 +
 .../org/apache/cassandra/db/compaction/AntiCompactionTest.java | 2 --
 2 files changed, 1 insertion(+), 2 deletions(-)
--


http://git-wip-us.apache.org/repos/asf/cassandra/blob/51796ea6/CHANGES.txt
--
diff --git a/CHANGES.txt b/CHANGES.txt
index b744b40..afda236 100644
--- a/CHANGES.txt
+++ b/CHANGES.txt
@@ -1,4 +1,5 @@
 3.0.12
+ * Remove unnecessary assertion from AntiCompactionTest (CASSANDRA-13070)
  * Fix cqlsh COPY for dates before 1900 (CASSANDRA-13185)
 Merged from 2.2
  * Fix failing COPY TO STDOUT (CASSANDRA-12497)

http://git-wip-us.apache.org/repos/asf/cassandra/blob/51796ea6/test/unit/org/apache/cassandra/db/compaction/AntiCompactionTest.java
--
diff --git 
a/test/unit/org/apache/cassandra/db/compaction/AntiCompactionTest.java 
b/test/unit/org/apache/cassandra/db/compaction/AntiCompactionTest.java
index 4c25f3a..b98421d 100644
--- a/test/unit/org/apache/cassandra/db/compaction/AntiCompactionTest.java
+++ b/test/unit/org/apache/cassandra/db/compaction/AntiCompactionTest.java
@@ -143,7 +143,6 @@ public class AntiCompactionTest
 cfs.disableAutoCompaction();
 SSTableReader s = writeFile(cfs, 1000);
 cfs.addSSTable(s);
-long origSize = s.bytesOnDisk();
 Range range = new Range(new 
BytesToken(ByteBufferUtil.bytes(0)), new BytesToken(ByteBufferUtil.bytes(500)));
 Collection sstables = cfs.getLiveSSTables();
 UUID parentRepairSession = UUID.randomUUID();
@@ -161,7 +160,6 @@ public class AntiCompactionTest
 }
 assertEquals(sum, cfs.metric.liveDiskSpaceUsed.getCount());
 assertEquals(rows, 1000 * (1000 * 5));//See writeFile for how this 
number is derived
-assertEquals(origSize, cfs.metric.liveDiskSpaceUsed.getCount(), 
1600);
 }
 
 private SSTableReader writeFile(ColumnFamilyStore cfs, int count)



[jira] [Created] (CASSANDRA-13258) Rethink read-time defragmentation introduced in 1.0 (CASSANDRA-2503)

2017-02-22 Thread Nate McCall (JIRA)
Nate McCall created CASSANDRA-13258:
---

 Summary: Rethink read-time defragmentation introduced in 1.0 
(CASSANDRA-2503)
 Key: CASSANDRA-13258
 URL: https://issues.apache.org/jira/browse/CASSANDRA-13258
 Project: Cassandra
  Issue Type: Bug
Reporter: Nate McCall


tl,dr; we issue a Mutation(!) on a read when using STCS and there are more than 
minCompactedThreshold SSTables encountered by the iterator. (See 
org/apache/cassandra/db/SinglePartitionReadCommand.java:782)

I can see a couple of use cases where this *might* be useful, but from a 
practical stand point, this is an excellent way to exacerbate compaction 
falling behind.

With the introduction of other, purpose built compaction strategies, I would be 
interested to hear why anyone would consider this still a good idea. Note that 
we only do it for STCS so at best, we are inconsistent. 

There are some interesting comments on CASSANDRA-10342 regarding this as well.



--
This message was sent by Atlassian JIRA
(v6.3.15#6346)


[jira] [Commented] (CASSANDRA-13230) Build RPM packages for release

2017-02-22 Thread Michael Shuler (JIRA)

[ 
https://issues.apache.org/jira/browse/CASSANDRA-13230?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15879599#comment-15879599
 ] 

Michael Shuler commented on CASSANDRA-13230:


That is an excellent question. I'm not entirely sure, since this is not in the 
cassandra repo, but in cassandra-builds. Once things are worked out for 
inclusion, I see no reason we can't build for all the releases 2.1+ that we're 
still committing to, so I'll add all those current versions. Thanks!

> Build RPM packages for release
> --
>
> Key: CASSANDRA-13230
> URL: https://issues.apache.org/jira/browse/CASSANDRA-13230
> Project: Cassandra
>  Issue Type: New Feature
>  Components: Packaging
>Reporter: Michael Shuler
>Assignee: Stefan Podkowinski
> Fix For: 2.1.18, 2.2.10, 3.0.12, 3.11.0, 4.0
>
> Attachments: 13230.patch
>
>
> Currently, releases are built locally on Debian/Ubuntu based machines, 
> without native support for building RPM packages. This can be done with a 
> docker image.
> The current cassandra-release scripts are here (please, do not randomly run 
> and push tags..):
> https://git-wip-us.apache.org/repos/asf?p=cassandra-builds.git;a=tree;f=cassandra-release
> A couple incomplete docker run scripts are here:
> https://git-wip-us.apache.org/repos/asf?p=cassandra-builds.git;a=tree;f=docker-wip
> {code}
> git clone https://git-wip-us.apache.org/repos/asf/cassandra-builds.git
> {code}
> Patches for build infra improvements are welcome!
> /cc [~spo...@gmail.com] if you want to assign to yourself, I'd be happy to 
> review :)



--
This message was sent by Atlassian JIRA
(v6.3.15#6346)


[jira] [Updated] (CASSANDRA-13230) Build RPM packages for release

2017-02-22 Thread Michael Shuler (JIRA)

 [ 
https://issues.apache.org/jira/browse/CASSANDRA-13230?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
 ]

Michael Shuler updated CASSANDRA-13230:
---
Fix Version/s: 4.0
   3.11.0
   3.0.12
   2.2.10
   2.1.18

> Build RPM packages for release
> --
>
> Key: CASSANDRA-13230
> URL: https://issues.apache.org/jira/browse/CASSANDRA-13230
> Project: Cassandra
>  Issue Type: New Feature
>  Components: Packaging
>Reporter: Michael Shuler
>Assignee: Stefan Podkowinski
> Fix For: 2.1.18, 2.2.10, 3.0.12, 3.11.0, 4.0
>
> Attachments: 13230.patch
>
>
> Currently, releases are built locally on Debian/Ubuntu based machines, 
> without native support for building RPM packages. This can be done with a 
> docker image.
> The current cassandra-release scripts are here (please, do not randomly run 
> and push tags..):
> https://git-wip-us.apache.org/repos/asf?p=cassandra-builds.git;a=tree;f=cassandra-release
> A couple incomplete docker run scripts are here:
> https://git-wip-us.apache.org/repos/asf?p=cassandra-builds.git;a=tree;f=docker-wip
> {code}
> git clone https://git-wip-us.apache.org/repos/asf/cassandra-builds.git
> {code}
> Patches for build infra improvements are welcome!
> /cc [~spo...@gmail.com] if you want to assign to yourself, I'd be happy to 
> review :)



--
This message was sent by Atlassian JIRA
(v6.3.15#6346)


[jira] [Commented] (CASSANDRA-13174) Indexing is allowed on Duration type when it should not be

2017-02-22 Thread Tyler Hobbs (JIRA)

[ 
https://issues.apache.org/jira/browse/CASSANDRA-13174?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15879513#comment-15879513
 ] 

Tyler Hobbs commented on CASSANDRA-13174:
-

+1 on the patch.  Nice work on making thorough tests and good error messages!

> Indexing is allowed on Duration type when it should not be
> --
>
> Key: CASSANDRA-13174
> URL: https://issues.apache.org/jira/browse/CASSANDRA-13174
> Project: Cassandra
>  Issue Type: Bug
>  Components: CQL
> Environment: C* 3.10
>Reporter: Kishan Karunaratne
>Assignee: Benjamin Lerer
> Fix For: 3.11.x, 4.x
>
>
> Looks like secondary indexing is allowed on duration type columns. Since 
> comparisons are not possible for the duration type, indexing on it also 
> should be invalid.
> 1) 
> {noformat}
> CREATE TABLE duration_table (k int PRIMARY KEY, d duration);
> INSERT INTO duration_table (k, d) VALUES (0, 1s);
> SELECT * from duration_table WHERE d=1s ALLOW FILTERING;
> {noformat}
> The above throws an error: 
> {noformat}
> WARN  [ReadStage-2] 2017-01-31 17:09:57,821 
> AbstractLocalAwareExecutorService.java:167 - Uncaught exception on thread 
> Thread[ReadStage-2,10,main]: {}
> java.lang.RuntimeException: java.lang.UnsupportedOperationException
>   at 
> org.apache.cassandra.service.StorageProxy$DroppableRunnable.run(StorageProxy.java:2591)
>  ~[main/:na]
>   at 
> java.util.concurrent.Executors$RunnableAdapter.call(Executors.java:511) 
> ~[na:1.8.0_91]
>   at 
> org.apache.cassandra.concurrent.AbstractLocalAwareExecutorService$FutureTask.run(AbstractLocalAwareExecutorService.java:162)
>  ~[main/:na]
>   at 
> org.apache.cassandra.concurrent.AbstractLocalAwareExecutorService$LocalSessionFutureTask.run(AbstractLocalAwareExecutorService.java:134)
>  [main/:na]
>   at org.apache.cassandra.concurrent.SEPWorker.run(SEPWorker.java:109) 
> [main/:na]
>   at java.lang.Thread.run(Thread.java:745) [na:1.8.0_91]
> Caused by: java.lang.UnsupportedOperationException: null
>   at 
> org.apache.cassandra.db.marshal.AbstractType.compareCustom(AbstractType.java:174)
>  ~[main/:na]
>   at 
> org.apache.cassandra.db.marshal.AbstractType.compare(AbstractType.java:160) 
> ~[main/:na]
>   at 
> org.apache.cassandra.db.marshal.AbstractType.compareForCQL(AbstractType.java:204)
>  ~[main/:na]
>   at org.apache.cassandra.cql3.Operator.isSatisfiedBy(Operator.java:201) 
> ~[main/:na]
>   at 
> org.apache.cassandra.db.filter.RowFilter$SimpleExpression.isSatisfiedBy(RowFilter.java:719)
>  ~[main/:na]
>   at 
> org.apache.cassandra.db.filter.RowFilter$CQLFilter$1IsSatisfiedFilter.applyToRow(RowFilter.java:324)
>  ~[main/:na]
>   at 
> org.apache.cassandra.db.transform.BaseRows.applyOne(BaseRows.java:120) 
> ~[main/:na]
>   at org.apache.cassandra.db.transform.BaseRows.add(BaseRows.java:110) 
> ~[main/:na]
>   at 
> org.apache.cassandra.db.transform.UnfilteredRows.add(UnfilteredRows.java:44) 
> ~[main/:na]
>   at 
> org.apache.cassandra.db.transform.Transformation.add(Transformation.java:174) 
> ~[main/:na]
>   at 
> org.apache.cassandra.db.transform.Transformation.apply(Transformation.java:140)
>  ~[main/:na]
>   at 
> org.apache.cassandra.db.filter.RowFilter$CQLFilter$1IsSatisfiedFilter.applyToPartition(RowFilter.java:307)
>  ~[main/:na]
>   at 
> org.apache.cassandra.db.filter.RowFilter$CQLFilter$1IsSatisfiedFilter.applyToPartition(RowFilter.java:292)
>  ~[main/:na]
>   at 
> org.apache.cassandra.db.transform.BasePartitions.hasNext(BasePartitions.java:96)
>  ~[main/:na]
>   at 
> org.apache.cassandra.db.partitions.UnfilteredPartitionIterators$Serializer.serialize(UnfilteredPartitionIterators.java:310)
>  ~[main/:na]
>   at 
> org.apache.cassandra.db.ReadResponse$LocalDataResponse.build(ReadResponse.java:145)
>  ~[main/:na]
>   at 
> org.apache.cassandra.db.ReadResponse$LocalDataResponse.(ReadResponse.java:138)
>  ~[main/:na]
>   at 
> org.apache.cassandra.db.ReadResponse$LocalDataResponse.(ReadResponse.java:134)
>  ~[main/:na]
>   at 
> org.apache.cassandra.db.ReadResponse.createDataResponse(ReadResponse.java:76) 
> ~[main/:na]
>   at 
> org.apache.cassandra.db.ReadCommand.createResponse(ReadCommand.java:333) 
> ~[main/:na]
>   at 
> org.apache.cassandra.service.StorageProxy$LocalReadRunnable.runMayThrow(StorageProxy.java:1884)
>  ~[main/:na]
>   at 
> org.apache.cassandra.service.StorageProxy$DroppableRunnable.run(StorageProxy.java:2587)
>  ~[main/:na]
>   ... 5 common frames omitted
> {noformat}
> 2)
> Similarly, if an index is created on the duration column:
> {noformat}
> CREATE INDEX d_index ON simplex.duration_table (d);
> SELECT * from duration_table WHERE d=1s;
> {noformat}
> results in:
> {noformat}
> WARN  [ReadStage-2] 

[jira] [Updated] (CASSANDRA-13174) Indexing is allowed on Duration type when it should not be

2017-02-22 Thread Tyler Hobbs (JIRA)

 [ 
https://issues.apache.org/jira/browse/CASSANDRA-13174?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
 ]

Tyler Hobbs updated CASSANDRA-13174:

Status: Ready to Commit  (was: Patch Available)

> Indexing is allowed on Duration type when it should not be
> --
>
> Key: CASSANDRA-13174
> URL: https://issues.apache.org/jira/browse/CASSANDRA-13174
> Project: Cassandra
>  Issue Type: Bug
>  Components: CQL
> Environment: C* 3.10
>Reporter: Kishan Karunaratne
>Assignee: Benjamin Lerer
> Fix For: 3.11.x, 4.x
>
>
> Looks like secondary indexing is allowed on duration type columns. Since 
> comparisons are not possible for the duration type, indexing on it also 
> should be invalid.
> 1) 
> {noformat}
> CREATE TABLE duration_table (k int PRIMARY KEY, d duration);
> INSERT INTO duration_table (k, d) VALUES (0, 1s);
> SELECT * from duration_table WHERE d=1s ALLOW FILTERING;
> {noformat}
> The above throws an error: 
> {noformat}
> WARN  [ReadStage-2] 2017-01-31 17:09:57,821 
> AbstractLocalAwareExecutorService.java:167 - Uncaught exception on thread 
> Thread[ReadStage-2,10,main]: {}
> java.lang.RuntimeException: java.lang.UnsupportedOperationException
>   at 
> org.apache.cassandra.service.StorageProxy$DroppableRunnable.run(StorageProxy.java:2591)
>  ~[main/:na]
>   at 
> java.util.concurrent.Executors$RunnableAdapter.call(Executors.java:511) 
> ~[na:1.8.0_91]
>   at 
> org.apache.cassandra.concurrent.AbstractLocalAwareExecutorService$FutureTask.run(AbstractLocalAwareExecutorService.java:162)
>  ~[main/:na]
>   at 
> org.apache.cassandra.concurrent.AbstractLocalAwareExecutorService$LocalSessionFutureTask.run(AbstractLocalAwareExecutorService.java:134)
>  [main/:na]
>   at org.apache.cassandra.concurrent.SEPWorker.run(SEPWorker.java:109) 
> [main/:na]
>   at java.lang.Thread.run(Thread.java:745) [na:1.8.0_91]
> Caused by: java.lang.UnsupportedOperationException: null
>   at 
> org.apache.cassandra.db.marshal.AbstractType.compareCustom(AbstractType.java:174)
>  ~[main/:na]
>   at 
> org.apache.cassandra.db.marshal.AbstractType.compare(AbstractType.java:160) 
> ~[main/:na]
>   at 
> org.apache.cassandra.db.marshal.AbstractType.compareForCQL(AbstractType.java:204)
>  ~[main/:na]
>   at org.apache.cassandra.cql3.Operator.isSatisfiedBy(Operator.java:201) 
> ~[main/:na]
>   at 
> org.apache.cassandra.db.filter.RowFilter$SimpleExpression.isSatisfiedBy(RowFilter.java:719)
>  ~[main/:na]
>   at 
> org.apache.cassandra.db.filter.RowFilter$CQLFilter$1IsSatisfiedFilter.applyToRow(RowFilter.java:324)
>  ~[main/:na]
>   at 
> org.apache.cassandra.db.transform.BaseRows.applyOne(BaseRows.java:120) 
> ~[main/:na]
>   at org.apache.cassandra.db.transform.BaseRows.add(BaseRows.java:110) 
> ~[main/:na]
>   at 
> org.apache.cassandra.db.transform.UnfilteredRows.add(UnfilteredRows.java:44) 
> ~[main/:na]
>   at 
> org.apache.cassandra.db.transform.Transformation.add(Transformation.java:174) 
> ~[main/:na]
>   at 
> org.apache.cassandra.db.transform.Transformation.apply(Transformation.java:140)
>  ~[main/:na]
>   at 
> org.apache.cassandra.db.filter.RowFilter$CQLFilter$1IsSatisfiedFilter.applyToPartition(RowFilter.java:307)
>  ~[main/:na]
>   at 
> org.apache.cassandra.db.filter.RowFilter$CQLFilter$1IsSatisfiedFilter.applyToPartition(RowFilter.java:292)
>  ~[main/:na]
>   at 
> org.apache.cassandra.db.transform.BasePartitions.hasNext(BasePartitions.java:96)
>  ~[main/:na]
>   at 
> org.apache.cassandra.db.partitions.UnfilteredPartitionIterators$Serializer.serialize(UnfilteredPartitionIterators.java:310)
>  ~[main/:na]
>   at 
> org.apache.cassandra.db.ReadResponse$LocalDataResponse.build(ReadResponse.java:145)
>  ~[main/:na]
>   at 
> org.apache.cassandra.db.ReadResponse$LocalDataResponse.(ReadResponse.java:138)
>  ~[main/:na]
>   at 
> org.apache.cassandra.db.ReadResponse$LocalDataResponse.(ReadResponse.java:134)
>  ~[main/:na]
>   at 
> org.apache.cassandra.db.ReadResponse.createDataResponse(ReadResponse.java:76) 
> ~[main/:na]
>   at 
> org.apache.cassandra.db.ReadCommand.createResponse(ReadCommand.java:333) 
> ~[main/:na]
>   at 
> org.apache.cassandra.service.StorageProxy$LocalReadRunnable.runMayThrow(StorageProxy.java:1884)
>  ~[main/:na]
>   at 
> org.apache.cassandra.service.StorageProxy$DroppableRunnable.run(StorageProxy.java:2587)
>  ~[main/:na]
>   ... 5 common frames omitted
> {noformat}
> 2)
> Similarly, if an index is created on the duration column:
> {noformat}
> CREATE INDEX d_index ON simplex.duration_table (d);
> SELECT * from duration_table WHERE d=1s;
> {noformat}
> results in:
> {noformat}
> WARN  [ReadStage-2] 2017-01-31 17:12:00,623 
> AbstractLocalAwareExecutorService.java:167 - 

[jira] [Created] (CASSANDRA-13257) Add repair streaming preview

2017-02-22 Thread Blake Eggleston (JIRA)
Blake Eggleston created CASSANDRA-13257:
---

 Summary: Add repair streaming preview
 Key: CASSANDRA-13257
 URL: https://issues.apache.org/jira/browse/CASSANDRA-13257
 Project: Cassandra
  Issue Type: New Feature
Reporter: Blake Eggleston
Assignee: Blake Eggleston


It would be useful to be able to estimate the amount of repair streaming that 
needs to be done, without actually doing any streaming. Our main motivation for 
this having something this is validating CASSANDRA-9143 in production, but I’d 
imagine it could also be a useful tool in troubleshooting.



--
This message was sent by Atlassian JIRA
(v6.3.15#6346)


[jira] [Commented] (CASSANDRA-13230) Build RPM packages for release

2017-02-22 Thread Jeremiah Jordan (JIRA)

[ 
https://issues.apache.org/jira/browse/CASSANDRA-13230?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15879393#comment-15879393
 ] 

Jeremiah Jordan commented on CASSANDRA-13230:
-

fix version here? 4.0?

> Build RPM packages for release
> --
>
> Key: CASSANDRA-13230
> URL: https://issues.apache.org/jira/browse/CASSANDRA-13230
> Project: Cassandra
>  Issue Type: New Feature
>  Components: Packaging
>Reporter: Michael Shuler
>Assignee: Stefan Podkowinski
> Attachments: 13230.patch
>
>
> Currently, releases are built locally on Debian/Ubuntu based machines, 
> without native support for building RPM packages. This can be done with a 
> docker image.
> The current cassandra-release scripts are here (please, do not randomly run 
> and push tags..):
> https://git-wip-us.apache.org/repos/asf?p=cassandra-builds.git;a=tree;f=cassandra-release
> A couple incomplete docker run scripts are here:
> https://git-wip-us.apache.org/repos/asf?p=cassandra-builds.git;a=tree;f=docker-wip
> {code}
> git clone https://git-wip-us.apache.org/repos/asf/cassandra-builds.git
> {code}
> Patches for build infra improvements are welcome!
> /cc [~spo...@gmail.com] if you want to assign to yourself, I'd be happy to 
> review :)



--
This message was sent by Atlassian JIRA
(v6.3.15#6346)


[jira] [Updated] (CASSANDRA-12850) Add the duration type to the protocol V5

2017-02-22 Thread Adam Holmberg (JIRA)

 [ 
https://issues.apache.org/jira/browse/CASSANDRA-12850?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
 ]

Adam Holmberg updated CASSANDRA-12850:
--
Labels: client-impacting  (was: )

> Add the duration type to the protocol V5
> 
>
> Key: CASSANDRA-12850
> URL: https://issues.apache.org/jira/browse/CASSANDRA-12850
> Project: Cassandra
>  Issue Type: Sub-task
>  Components: CQL
>Reporter: Benjamin Lerer
>Assignee: Benjamin Lerer
>  Labels: client-impacting
> Fix For: 3.10
>
>
> The Duration type need to be added to the protocol specifications.



--
This message was sent by Atlassian JIRA
(v6.3.15#6346)


[jira] [Commented] (CASSANDRA-12886) Streaming failed due to SSL Socket connection reset

2017-02-22 Thread Paulo Motta (JIRA)

[ 
https://issues.apache.org/jira/browse/CASSANDRA-12886?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15879214#comment-15879214
 ] 

Paulo Motta commented on CASSANDRA-12886:
-

Tests look good now, can you have a look in the updated patch before I commit 
[~yukim]? Thanks!

> Streaming failed due to SSL Socket connection reset
> ---
>
> Key: CASSANDRA-12886
> URL: https://issues.apache.org/jira/browse/CASSANDRA-12886
> Project: Cassandra
>  Issue Type: Bug
>Reporter: Bing Wu
>Assignee: Paulo Motta
> Attachments: debug.log.2016-11-10_2319.gz
>
>
> While running "nodetool repair", I see many instances of 
> "javax.net.ssl.SSLException: java.net.SocketException: Connection reset" in 
> system.logs on some nodes in the cluster. Timestamps correspond to streaming 
> source/initiator's error messages of "sync failed between ..."
> Setup: 
> - Cassandra 3.7.01 
> - CentOS 6.7 in AWS (multi-region)
> - JDK version: {noformat}
> java version "1.8.0_102"
> Java(TM) SE Runtime Environment (build 1.8.0_102-b14)
> Java HotSpot(TM) 64-Bit Server VM (build 25.102-b14, mixed mode)
> {noformat}
> - cassandra.yaml:
> {noformat}
> server_encryption_options:
> internode_encryption: all
> keystore: [path]
> keystore_password: [password]
> truststore: [path]
> truststore_password: [password]
> # More advanced defaults below:
> # protocol: TLS
> # algorithm: SunX509
> # store_type: JKS
> # cipher_suites: 
> [TLS_RSA_WITH_AES_128_CBC_SHA,TLS_RSA_WITH_AES_256_CBC_SHA,TLS_DHE_RSA_WITH_AES_128_CBC_SHA,TLS_DHE_RSA_WITH_AES_256_CBC_SHA,TLS_ECDHE_RSA_WITH_AES_128_CBC_SHA,TLS_ECDHE_RSA_WITH_AES_256_CBC_SHA]
> require_client_auth: false
> {noformat}
> Error messages in system.log on the target host:
> {noformat}
> ERROR [STREAM-OUT-/54.247.111.232:7001] 2016-11-07 07:30:56,475 
> StreamSession.java:529 - [Stream #e14abcb0-a4bb-11e6-9758-55b9ac38b78e] 
> Streaming error occurred on session with peer 54.247.111.232
> javax.net.ssl.SSLException: Connection has been shutdown: 
> javax.net.ssl.SSLException: java.net.SocketException: Connection reset
> at sun.security.ssl.SSLSocketImpl.checkEOF(SSLSocketImpl.java:1541) 
> ~[na:1.8.0_102]
> at sun.security.ssl.SSLSocketImpl.checkWrite(SSLSocketImpl.java:1553) 
> ~[na:1.8.0_102]
> at sun.security.ssl.AppOutputStream.write(AppOutputStream.java:71) 
> ~[na:1.8.0_102]
> at 
> java.io.BufferedOutputStream.flushBuffer(BufferedOutputStream.java:82) 
> ~[na:1.8.0_102]
> at java.io.BufferedOutputStream.flush(BufferedOutputStream.java:140) 
> ~[na:1.8.0_102]
> at 
> org.apache.cassandra.io.util.WrappedDataOutputStreamPlus.flush(WrappedDataOutputStreamPlus.java:66)
>  ~[apache-cassandra-3.7.0.jar:3.7.0]
> at 
> org.apache.cassandra.streaming.ConnectionHandler$OutgoingMessageHandler.sendMessage(ConnectionHandler.java:371)
>  [apache-cassandra-3.7.0.jar:3.7.0]
> at 
> org.apache.cassandra.streaming.ConnectionHandler$OutgoingMessageHandler.run(ConnectionHandler.java:342)
>  [apache-cassandra-3.7.0.jar:3.7.0]
> at java.lang.Thread.run(Thread.java:745) [na:1.8.0_102]
> Caused by: javax.net.ssl.SSLException: java.net.SocketException: Connection 
> reset
> {noformat}



--
This message was sent by Atlassian JIRA
(v6.3.15#6346)


[jira] [Updated] (CASSANDRA-13174) Indexing is allowed on Duration type when it should not be

2017-02-22 Thread Benjamin Lerer (JIRA)

 [ 
https://issues.apache.org/jira/browse/CASSANDRA-13174?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
 ]

Benjamin Lerer updated CASSANDRA-13174:
---
Reviewer: Tyler Hobbs

> Indexing is allowed on Duration type when it should not be
> --
>
> Key: CASSANDRA-13174
> URL: https://issues.apache.org/jira/browse/CASSANDRA-13174
> Project: Cassandra
>  Issue Type: Bug
>  Components: CQL
> Environment: C* 3.10
>Reporter: Kishan Karunaratne
>Assignee: Benjamin Lerer
> Fix For: 3.11.x, 4.x
>
>
> Looks like secondary indexing is allowed on duration type columns. Since 
> comparisons are not possible for the duration type, indexing on it also 
> should be invalid.
> 1) 
> {noformat}
> CREATE TABLE duration_table (k int PRIMARY KEY, d duration);
> INSERT INTO duration_table (k, d) VALUES (0, 1s);
> SELECT * from duration_table WHERE d=1s ALLOW FILTERING;
> {noformat}
> The above throws an error: 
> {noformat}
> WARN  [ReadStage-2] 2017-01-31 17:09:57,821 
> AbstractLocalAwareExecutorService.java:167 - Uncaught exception on thread 
> Thread[ReadStage-2,10,main]: {}
> java.lang.RuntimeException: java.lang.UnsupportedOperationException
>   at 
> org.apache.cassandra.service.StorageProxy$DroppableRunnable.run(StorageProxy.java:2591)
>  ~[main/:na]
>   at 
> java.util.concurrent.Executors$RunnableAdapter.call(Executors.java:511) 
> ~[na:1.8.0_91]
>   at 
> org.apache.cassandra.concurrent.AbstractLocalAwareExecutorService$FutureTask.run(AbstractLocalAwareExecutorService.java:162)
>  ~[main/:na]
>   at 
> org.apache.cassandra.concurrent.AbstractLocalAwareExecutorService$LocalSessionFutureTask.run(AbstractLocalAwareExecutorService.java:134)
>  [main/:na]
>   at org.apache.cassandra.concurrent.SEPWorker.run(SEPWorker.java:109) 
> [main/:na]
>   at java.lang.Thread.run(Thread.java:745) [na:1.8.0_91]
> Caused by: java.lang.UnsupportedOperationException: null
>   at 
> org.apache.cassandra.db.marshal.AbstractType.compareCustom(AbstractType.java:174)
>  ~[main/:na]
>   at 
> org.apache.cassandra.db.marshal.AbstractType.compare(AbstractType.java:160) 
> ~[main/:na]
>   at 
> org.apache.cassandra.db.marshal.AbstractType.compareForCQL(AbstractType.java:204)
>  ~[main/:na]
>   at org.apache.cassandra.cql3.Operator.isSatisfiedBy(Operator.java:201) 
> ~[main/:na]
>   at 
> org.apache.cassandra.db.filter.RowFilter$SimpleExpression.isSatisfiedBy(RowFilter.java:719)
>  ~[main/:na]
>   at 
> org.apache.cassandra.db.filter.RowFilter$CQLFilter$1IsSatisfiedFilter.applyToRow(RowFilter.java:324)
>  ~[main/:na]
>   at 
> org.apache.cassandra.db.transform.BaseRows.applyOne(BaseRows.java:120) 
> ~[main/:na]
>   at org.apache.cassandra.db.transform.BaseRows.add(BaseRows.java:110) 
> ~[main/:na]
>   at 
> org.apache.cassandra.db.transform.UnfilteredRows.add(UnfilteredRows.java:44) 
> ~[main/:na]
>   at 
> org.apache.cassandra.db.transform.Transformation.add(Transformation.java:174) 
> ~[main/:na]
>   at 
> org.apache.cassandra.db.transform.Transformation.apply(Transformation.java:140)
>  ~[main/:na]
>   at 
> org.apache.cassandra.db.filter.RowFilter$CQLFilter$1IsSatisfiedFilter.applyToPartition(RowFilter.java:307)
>  ~[main/:na]
>   at 
> org.apache.cassandra.db.filter.RowFilter$CQLFilter$1IsSatisfiedFilter.applyToPartition(RowFilter.java:292)
>  ~[main/:na]
>   at 
> org.apache.cassandra.db.transform.BasePartitions.hasNext(BasePartitions.java:96)
>  ~[main/:na]
>   at 
> org.apache.cassandra.db.partitions.UnfilteredPartitionIterators$Serializer.serialize(UnfilteredPartitionIterators.java:310)
>  ~[main/:na]
>   at 
> org.apache.cassandra.db.ReadResponse$LocalDataResponse.build(ReadResponse.java:145)
>  ~[main/:na]
>   at 
> org.apache.cassandra.db.ReadResponse$LocalDataResponse.(ReadResponse.java:138)
>  ~[main/:na]
>   at 
> org.apache.cassandra.db.ReadResponse$LocalDataResponse.(ReadResponse.java:134)
>  ~[main/:na]
>   at 
> org.apache.cassandra.db.ReadResponse.createDataResponse(ReadResponse.java:76) 
> ~[main/:na]
>   at 
> org.apache.cassandra.db.ReadCommand.createResponse(ReadCommand.java:333) 
> ~[main/:na]
>   at 
> org.apache.cassandra.service.StorageProxy$LocalReadRunnable.runMayThrow(StorageProxy.java:1884)
>  ~[main/:na]
>   at 
> org.apache.cassandra.service.StorageProxy$DroppableRunnable.run(StorageProxy.java:2587)
>  ~[main/:na]
>   ... 5 common frames omitted
> {noformat}
> 2)
> Similarly, if an index is created on the duration column:
> {noformat}
> CREATE INDEX d_index ON simplex.duration_table (d);
> SELECT * from duration_table WHERE d=1s;
> {noformat}
> results in:
> {noformat}
> WARN  [ReadStage-2] 2017-01-31 17:12:00,623 
> AbstractLocalAwareExecutorService.java:167 - Uncaught exception 

[jira] [Resolved] (CASSANDRA-13255) move compaction strategies to dedicated pages and expand on details

2017-02-22 Thread Jon Haddad (JIRA)

 [ 
https://issues.apache.org/jira/browse/CASSANDRA-13255?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
 ]

Jon Haddad resolved CASSANDRA-13255.

Resolution: Duplicate

> move compaction strategies to dedicated pages and expand on details
> ---
>
> Key: CASSANDRA-13255
> URL: https://issues.apache.org/jira/browse/CASSANDRA-13255
> Project: Cassandra
>  Issue Type: Improvement
>  Components: Documentation and Website
>Reporter: Jon Haddad
> Fix For: 4.0
>
>
> current sections on compactions are lacking details.  we should split them 
> out into their own sections and improve each of them.



--
This message was sent by Atlassian JIRA
(v6.3.15#6346)


[jira] [Updated] (CASSANDRA-12497) COPY ... TO STDOUT regression in 2.2.7

2017-02-22 Thread Paulo Motta (JIRA)

 [ 
https://issues.apache.org/jira/browse/CASSANDRA-12497?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
 ]

Paulo Motta updated CASSANDRA-12497:

   Resolution: Fixed
Fix Version/s: 4.0
   3.11.0
   3.0.12
   2.2.10
Reproduced In:   (was: 2.2.7)
   Status: Resolved  (was: Patch Available)

Committed as 88f36a0955572e13316b83e7187c76c7cd0790b6 to 2.2 and merged up with 
pep8 nit fixed. Thanks!

> COPY ... TO STDOUT regression in 2.2.7
> --
>
> Key: CASSANDRA-12497
> URL: https://issues.apache.org/jira/browse/CASSANDRA-12497
> Project: Cassandra
>  Issue Type: Bug
>  Components: Tools
>Reporter: Max Bowsher
>Assignee: Márton Salomváry
> Fix For: 2.2.10, 3.0.12, 3.11.0, 4.0
>
>
> Cassandra 2.2.7 introduces a regression over 2.2.6 breaking COPY ... TO 
> STDOUT.
> In pylib/cqlshlib/copyutil.py, in CopyTask.__init__, self.printmsg is 
> conditionally defined to EITHER a module level function accepting arguments 
> (msg, eol=, encoding=), OR a lambda accepting arguments only (_, eol=).
> Consequently, when the lambda is in use (which requires COPY ... TO STDOUT 
> without --debug), any attempt to call CopyTask.printmsg with an encoding 
> parameter causes an exception.
> This occurs in ExportTask.run, thus rendering all COPY ... TO STDOUT without 
> --debug broken.
> The fix is to update the lambda's arguments to include encoding, or better, 
> replace it with a module-level function defined next to printmsg, so that 
> people realize the two argument lists must be kept in sync.
> The regression was introduced in this commit:
> commit 5de9de1f5832f2a0e92783e2f4412874423e6e15
> Author: Tyler Hobbs 
> Date:   Thu May 5 11:33:35 2016 -0500
> cqlsh: Handle non-ascii chars in error messages
> 
> Patch by Tyler Hobbs; reviewed by Paulo Motta for CASSANDRA-11626



--
This message was sent by Atlassian JIRA
(v6.3.15#6346)


[05/10] cassandra git commit: Merge branch 'cassandra-2.2' into cassandra-3.0

2017-02-22 Thread paulo
Merge branch 'cassandra-2.2' into cassandra-3.0


Project: http://git-wip-us.apache.org/repos/asf/cassandra/repo
Commit: http://git-wip-us.apache.org/repos/asf/cassandra/commit/5fba118e
Tree: http://git-wip-us.apache.org/repos/asf/cassandra/tree/5fba118e
Diff: http://git-wip-us.apache.org/repos/asf/cassandra/diff/5fba118e

Branch: refs/heads/cassandra-3.11
Commit: 5fba118e95b6bc834169141514b8f563d5ffe6fb
Parents: f70d8c0 88f36a0
Author: Paulo Motta 
Authored: Wed Feb 22 17:19:08 2017 -0300
Committer: Paulo Motta 
Committed: Wed Feb 22 17:19:08 2017 -0300

--
 CHANGES.txt| 2 +-
 pylib/cqlshlib/copyutil.py | 7 ++-
 2 files changed, 7 insertions(+), 2 deletions(-)
--


http://git-wip-us.apache.org/repos/asf/cassandra/blob/5fba118e/CHANGES.txt
--
diff --cc CHANGES.txt
index a4bb9cd,1a22814..b744b40
--- a/CHANGES.txt
+++ b/CHANGES.txt
@@@ -1,7 -1,5 +1,7 @@@
 -2.2.10
 +3.0.12
 + * Fix cqlsh COPY for dates before 1900 (CASSANDRA-13185)
- 
 +Merged from 2.2
+  * Fix failing COPY TO STDOUT (CASSANDRA-12497)
   * Fix ColumnCounter::countAll behaviour for reverse queries (CASSANDRA-13222)
   * Exceptions encountered calling getSeeds() breaks OTC thread 
(CASSANDRA-13018)
  Merged from 2.1:

http://git-wip-us.apache.org/repos/asf/cassandra/blob/5fba118e/pylib/cqlshlib/copyutil.py
--



[03/10] cassandra git commit: Fix failing COPY TO STDOUT

2017-02-22 Thread paulo
Fix failing COPY TO STDOUT

Patch by Márton Salomváry; Reviewed by Paulo Motta for CASSANDRA-12497


Project: http://git-wip-us.apache.org/repos/asf/cassandra/repo
Commit: http://git-wip-us.apache.org/repos/asf/cassandra/commit/88f36a09
Tree: http://git-wip-us.apache.org/repos/asf/cassandra/tree/88f36a09
Diff: http://git-wip-us.apache.org/repos/asf/cassandra/diff/88f36a09

Branch: refs/heads/cassandra-3.11
Commit: 88f36a0955572e13316b83e7187c76c7cd0790b6
Parents: 15e71ba
Author: Márton Salomváry 
Authored: Tue Feb 7 15:15:34 2017 +0100
Committer: Paulo Motta 
Committed: Wed Feb 22 17:12:34 2017 -0300

--
 CHANGES.txt| 1 +
 pylib/cqlshlib/copyutil.py | 7 ++-
 2 files changed, 7 insertions(+), 1 deletion(-)
--


http://git-wip-us.apache.org/repos/asf/cassandra/blob/88f36a09/CHANGES.txt
--
diff --git a/CHANGES.txt b/CHANGES.txt
index 91c11fa..1a22814 100644
--- a/CHANGES.txt
+++ b/CHANGES.txt
@@ -1,4 +1,5 @@
 2.2.10
+ * Fix failing COPY TO STDOUT (CASSANDRA-12497)
  * Fix ColumnCounter::countAll behaviour for reverse queries (CASSANDRA-13222)
  * Exceptions encountered calling getSeeds() breaks OTC thread 
(CASSANDRA-13018)
 Merged from 2.1:

http://git-wip-us.apache.org/repos/asf/cassandra/blob/88f36a09/pylib/cqlshlib/copyutil.py
--
diff --git a/pylib/cqlshlib/copyutil.py b/pylib/cqlshlib/copyutil.py
index d22f2fe..cf5b0eb 100644
--- a/pylib/cqlshlib/copyutil.py
+++ b/pylib/cqlshlib/copyutil.py
@@ -83,6 +83,11 @@ def printmsg(msg, eol='\n', encoding='utf8'):
 sys.stdout.flush()
 
 
+# Keep arguments in sync with printmsg
+def swallowmsg(msg, eol='', encoding=''):
+None
+
+
 class OneWayPipe(object):
 """
 A one way pipe protected by two process level locks, one for reading and 
one for writing.
@@ -241,7 +246,7 @@ class CopyTask(object):
 
 # do not display messages when exporting to STDOUT unless --debug is 
set
 self.printmsg = printmsg if self.fname is not None or direction == 
'from' or DEBUG \
-else lambda _, eol='\n': None
+else swallowmsg
 self.options = self.parse_options(opts, direction)
 
 self.num_processes = self.options.copy['numprocesses']



[07/10] cassandra git commit: Merge branch 'cassandra-2.2' into cassandra-3.0

2017-02-22 Thread paulo
Merge branch 'cassandra-2.2' into cassandra-3.0


Project: http://git-wip-us.apache.org/repos/asf/cassandra/repo
Commit: http://git-wip-us.apache.org/repos/asf/cassandra/commit/5fba118e
Tree: http://git-wip-us.apache.org/repos/asf/cassandra/tree/5fba118e
Diff: http://git-wip-us.apache.org/repos/asf/cassandra/diff/5fba118e

Branch: refs/heads/trunk
Commit: 5fba118e95b6bc834169141514b8f563d5ffe6fb
Parents: f70d8c0 88f36a0
Author: Paulo Motta 
Authored: Wed Feb 22 17:19:08 2017 -0300
Committer: Paulo Motta 
Committed: Wed Feb 22 17:19:08 2017 -0300

--
 CHANGES.txt| 2 +-
 pylib/cqlshlib/copyutil.py | 7 ++-
 2 files changed, 7 insertions(+), 2 deletions(-)
--


http://git-wip-us.apache.org/repos/asf/cassandra/blob/5fba118e/CHANGES.txt
--
diff --cc CHANGES.txt
index a4bb9cd,1a22814..b744b40
--- a/CHANGES.txt
+++ b/CHANGES.txt
@@@ -1,7 -1,5 +1,7 @@@
 -2.2.10
 +3.0.12
 + * Fix cqlsh COPY for dates before 1900 (CASSANDRA-13185)
- 
 +Merged from 2.2
+  * Fix failing COPY TO STDOUT (CASSANDRA-12497)
   * Fix ColumnCounter::countAll behaviour for reverse queries (CASSANDRA-13222)
   * Exceptions encountered calling getSeeds() breaks OTC thread 
(CASSANDRA-13018)
  Merged from 2.1:

http://git-wip-us.apache.org/repos/asf/cassandra/blob/5fba118e/pylib/cqlshlib/copyutil.py
--



[09/10] cassandra git commit: Merge branch 'cassandra-3.0' into cassandra-3.11

2017-02-22 Thread paulo
Merge branch 'cassandra-3.0' into cassandra-3.11


Project: http://git-wip-us.apache.org/repos/asf/cassandra/repo
Commit: http://git-wip-us.apache.org/repos/asf/cassandra/commit/b3490c06
Tree: http://git-wip-us.apache.org/repos/asf/cassandra/tree/b3490c06
Diff: http://git-wip-us.apache.org/repos/asf/cassandra/diff/b3490c06

Branch: refs/heads/trunk
Commit: b3490c06242cdaa8519bf4208dbf653fafacec62
Parents: b0ed0f4 5fba118
Author: Paulo Motta 
Authored: Wed Feb 22 17:20:37 2017 -0300
Committer: Paulo Motta 
Committed: Wed Feb 22 17:20:37 2017 -0300

--
 CHANGES.txt| 1 +
 pylib/cqlshlib/copyutil.py | 7 ++-
 2 files changed, 7 insertions(+), 1 deletion(-)
--


http://git-wip-us.apache.org/repos/asf/cassandra/blob/b3490c06/CHANGES.txt
--
diff --cc CHANGES.txt
index 6dd4edb,b744b40..3dc192f
--- a/CHANGES.txt
+++ b/CHANGES.txt
@@@ -20,134 -21,6 +20,135 @@@ Merged from 3.0
 live rows in sstabledump (CASSANDRA-13177)
   * Provide user workaround when system_schema.columns does not contain entries
 for a table that's in system_schema.tables (CASSANDRA-13180)
 +Merged from 2.2:
++ * Fix failing COPY TO STDOUT (CASSANDRA-12497)
 + * Fix ColumnCounter::countAll behaviour for reverse queries (CASSANDRA-13222)
 + * Exceptions encountered calling getSeeds() breaks OTC thread 
(CASSANDRA-13018)
 + * Fix negative mean latency metric (CASSANDRA-12876)
 + * Use only one file pointer when creating commitlog segments 
(CASSANDRA-12539)
 +Merged from 2.1:
 + * Log stacktrace of uncaught exceptions (CASSANDRA-13108)
 + * Use portable stderr for java error in startup (CASSANDRA-13211)
 + * Fix Thread Leak in OutboundTcpConnection (CASSANDRA-13204)
 + * Coalescing strategy can enter infinite loop (CASSANDRA-13159)
 +
 +3.10
 + * Fix secondary index queries regression (CASSANDRA-13013)
 + * Add duration type to the protocol V5 (CASSANDRA-12850)
 + * Fix duration type validation (CASSANDRA-13143)
 + * Fix flaky GcCompactionTest (CASSANDRA-12664)
 + * Fix TestHintedHandoff.hintedhandoff_decom_test (CASSANDRA-13058)
 + * Fixed query monitoring for range queries (CASSANDRA-13050)
 + * Remove outboundBindAny configuration property (CASSANDRA-12673)
 + * Use correct bounds for all-data range when filtering (CASSANDRA-12666)
 + * Remove timing window in test case (CASSANDRA-12875)
 + * Resolve unit testing without JCE security libraries installed 
(CASSANDRA-12945)
 + * Fix inconsistencies in cassandra-stress load balancing policy 
(CASSANDRA-12919)
 + * Fix validation of non-frozen UDT cells (CASSANDRA-12916)
 + * Don't shut down socket input/output on StreamSession (CASSANDRA-12903)
 + * Fix Murmur3PartitionerTest (CASSANDRA-12858)
 + * Move cqlsh syntax rules into separate module and allow easier 
customization (CASSANDRA-12897)
 + * Fix CommitLogSegmentManagerTest (CASSANDRA-12283)
 + * Fix cassandra-stress truncate option (CASSANDRA-12695)
 + * Fix crossNode value when receiving messages (CASSANDRA-12791)
 + * Don't load MX4J beans twice (CASSANDRA-12869)
 + * Extend native protocol request flags, add versions to SUPPORTED, and 
introduce ProtocolVersion enum (CASSANDRA-12838)
 + * Set JOINING mode when running pre-join tasks (CASSANDRA-12836)
 + * remove net.mintern.primitive library due to license issue (CASSANDRA-12845)
 + * Properly format IPv6 addresses when logging JMX service URL 
(CASSANDRA-12454)
 + * Optimize the vnode allocation for single replica per DC (CASSANDRA-12777)
 + * Use non-token restrictions for bounds when token restrictions are 
overridden (CASSANDRA-12419)
 + * Fix CQLSH auto completion for PER PARTITION LIMIT (CASSANDRA-12803)
 + * Use different build directories for Eclipse and Ant (CASSANDRA-12466)
 + * Avoid potential AttributeError in cqlsh due to no table metadata 
(CASSANDRA-12815)
 + * Fix RandomReplicationAwareTokenAllocatorTest.testExistingCluster 
(CASSANDRA-12812)
 + * Upgrade commons-codec to 1.9 (CASSANDRA-12790)
 + * Make the fanout size for LeveledCompactionStrategy to be configurable 
(CASSANDRA-11550)
 + * Add duration data type (CASSANDRA-11873)
 + * Fix timeout in ReplicationAwareTokenAllocatorTest (CASSANDRA-12784)
 + * Improve sum aggregate functions (CASSANDRA-12417)
 + * Make cassandra.yaml docs for batch_size_*_threshold_in_kb reflect changes 
in CASSANDRA-10876 (CASSANDRA-12761)
 + * cqlsh fails to format collections when using aliases (CASSANDRA-11534)
 + * Check for hash conflicts in prepared statements (CASSANDRA-12733)
 + * Exit query parsing upon first error (CASSANDRA-12598)
 + * Fix cassandra-stress to use single seed in UUID generation 
(CASSANDRA-12729)
 + * CQLSSTableWriter does not allow Update statement (CASSANDRA-12450)
 + * Config class uses boxed types but DD exposes primitive types 
(CASSANDRA-12199)
 + 

[08/10] cassandra git commit: Merge branch 'cassandra-3.0' into cassandra-3.11

2017-02-22 Thread paulo
Merge branch 'cassandra-3.0' into cassandra-3.11


Project: http://git-wip-us.apache.org/repos/asf/cassandra/repo
Commit: http://git-wip-us.apache.org/repos/asf/cassandra/commit/b3490c06
Tree: http://git-wip-us.apache.org/repos/asf/cassandra/tree/b3490c06
Diff: http://git-wip-us.apache.org/repos/asf/cassandra/diff/b3490c06

Branch: refs/heads/cassandra-3.11
Commit: b3490c06242cdaa8519bf4208dbf653fafacec62
Parents: b0ed0f4 5fba118
Author: Paulo Motta 
Authored: Wed Feb 22 17:20:37 2017 -0300
Committer: Paulo Motta 
Committed: Wed Feb 22 17:20:37 2017 -0300

--
 CHANGES.txt| 1 +
 pylib/cqlshlib/copyutil.py | 7 ++-
 2 files changed, 7 insertions(+), 1 deletion(-)
--


http://git-wip-us.apache.org/repos/asf/cassandra/blob/b3490c06/CHANGES.txt
--
diff --cc CHANGES.txt
index 6dd4edb,b744b40..3dc192f
--- a/CHANGES.txt
+++ b/CHANGES.txt
@@@ -20,134 -21,6 +20,135 @@@ Merged from 3.0
 live rows in sstabledump (CASSANDRA-13177)
   * Provide user workaround when system_schema.columns does not contain entries
 for a table that's in system_schema.tables (CASSANDRA-13180)
 +Merged from 2.2:
++ * Fix failing COPY TO STDOUT (CASSANDRA-12497)
 + * Fix ColumnCounter::countAll behaviour for reverse queries (CASSANDRA-13222)
 + * Exceptions encountered calling getSeeds() breaks OTC thread 
(CASSANDRA-13018)
 + * Fix negative mean latency metric (CASSANDRA-12876)
 + * Use only one file pointer when creating commitlog segments 
(CASSANDRA-12539)
 +Merged from 2.1:
 + * Log stacktrace of uncaught exceptions (CASSANDRA-13108)
 + * Use portable stderr for java error in startup (CASSANDRA-13211)
 + * Fix Thread Leak in OutboundTcpConnection (CASSANDRA-13204)
 + * Coalescing strategy can enter infinite loop (CASSANDRA-13159)
 +
 +3.10
 + * Fix secondary index queries regression (CASSANDRA-13013)
 + * Add duration type to the protocol V5 (CASSANDRA-12850)
 + * Fix duration type validation (CASSANDRA-13143)
 + * Fix flaky GcCompactionTest (CASSANDRA-12664)
 + * Fix TestHintedHandoff.hintedhandoff_decom_test (CASSANDRA-13058)
 + * Fixed query monitoring for range queries (CASSANDRA-13050)
 + * Remove outboundBindAny configuration property (CASSANDRA-12673)
 + * Use correct bounds for all-data range when filtering (CASSANDRA-12666)
 + * Remove timing window in test case (CASSANDRA-12875)
 + * Resolve unit testing without JCE security libraries installed 
(CASSANDRA-12945)
 + * Fix inconsistencies in cassandra-stress load balancing policy 
(CASSANDRA-12919)
 + * Fix validation of non-frozen UDT cells (CASSANDRA-12916)
 + * Don't shut down socket input/output on StreamSession (CASSANDRA-12903)
 + * Fix Murmur3PartitionerTest (CASSANDRA-12858)
 + * Move cqlsh syntax rules into separate module and allow easier 
customization (CASSANDRA-12897)
 + * Fix CommitLogSegmentManagerTest (CASSANDRA-12283)
 + * Fix cassandra-stress truncate option (CASSANDRA-12695)
 + * Fix crossNode value when receiving messages (CASSANDRA-12791)
 + * Don't load MX4J beans twice (CASSANDRA-12869)
 + * Extend native protocol request flags, add versions to SUPPORTED, and 
introduce ProtocolVersion enum (CASSANDRA-12838)
 + * Set JOINING mode when running pre-join tasks (CASSANDRA-12836)
 + * remove net.mintern.primitive library due to license issue (CASSANDRA-12845)
 + * Properly format IPv6 addresses when logging JMX service URL 
(CASSANDRA-12454)
 + * Optimize the vnode allocation for single replica per DC (CASSANDRA-12777)
 + * Use non-token restrictions for bounds when token restrictions are 
overridden (CASSANDRA-12419)
 + * Fix CQLSH auto completion for PER PARTITION LIMIT (CASSANDRA-12803)
 + * Use different build directories for Eclipse and Ant (CASSANDRA-12466)
 + * Avoid potential AttributeError in cqlsh due to no table metadata 
(CASSANDRA-12815)
 + * Fix RandomReplicationAwareTokenAllocatorTest.testExistingCluster 
(CASSANDRA-12812)
 + * Upgrade commons-codec to 1.9 (CASSANDRA-12790)
 + * Make the fanout size for LeveledCompactionStrategy to be configurable 
(CASSANDRA-11550)
 + * Add duration data type (CASSANDRA-11873)
 + * Fix timeout in ReplicationAwareTokenAllocatorTest (CASSANDRA-12784)
 + * Improve sum aggregate functions (CASSANDRA-12417)
 + * Make cassandra.yaml docs for batch_size_*_threshold_in_kb reflect changes 
in CASSANDRA-10876 (CASSANDRA-12761)
 + * cqlsh fails to format collections when using aliases (CASSANDRA-11534)
 + * Check for hash conflicts in prepared statements (CASSANDRA-12733)
 + * Exit query parsing upon first error (CASSANDRA-12598)
 + * Fix cassandra-stress to use single seed in UUID generation 
(CASSANDRA-12729)
 + * CQLSSTableWriter does not allow Update statement (CASSANDRA-12450)
 + * Config class uses boxed types but DD exposes primitive types 

[04/10] cassandra git commit: Fix failing COPY TO STDOUT

2017-02-22 Thread paulo
Fix failing COPY TO STDOUT

Patch by Márton Salomváry; Reviewed by Paulo Motta for CASSANDRA-12497


Project: http://git-wip-us.apache.org/repos/asf/cassandra/repo
Commit: http://git-wip-us.apache.org/repos/asf/cassandra/commit/88f36a09
Tree: http://git-wip-us.apache.org/repos/asf/cassandra/tree/88f36a09
Diff: http://git-wip-us.apache.org/repos/asf/cassandra/diff/88f36a09

Branch: refs/heads/trunk
Commit: 88f36a0955572e13316b83e7187c76c7cd0790b6
Parents: 15e71ba
Author: Márton Salomváry 
Authored: Tue Feb 7 15:15:34 2017 +0100
Committer: Paulo Motta 
Committed: Wed Feb 22 17:12:34 2017 -0300

--
 CHANGES.txt| 1 +
 pylib/cqlshlib/copyutil.py | 7 ++-
 2 files changed, 7 insertions(+), 1 deletion(-)
--


http://git-wip-us.apache.org/repos/asf/cassandra/blob/88f36a09/CHANGES.txt
--
diff --git a/CHANGES.txt b/CHANGES.txt
index 91c11fa..1a22814 100644
--- a/CHANGES.txt
+++ b/CHANGES.txt
@@ -1,4 +1,5 @@
 2.2.10
+ * Fix failing COPY TO STDOUT (CASSANDRA-12497)
  * Fix ColumnCounter::countAll behaviour for reverse queries (CASSANDRA-13222)
  * Exceptions encountered calling getSeeds() breaks OTC thread 
(CASSANDRA-13018)
 Merged from 2.1:

http://git-wip-us.apache.org/repos/asf/cassandra/blob/88f36a09/pylib/cqlshlib/copyutil.py
--
diff --git a/pylib/cqlshlib/copyutil.py b/pylib/cqlshlib/copyutil.py
index d22f2fe..cf5b0eb 100644
--- a/pylib/cqlshlib/copyutil.py
+++ b/pylib/cqlshlib/copyutil.py
@@ -83,6 +83,11 @@ def printmsg(msg, eol='\n', encoding='utf8'):
 sys.stdout.flush()
 
 
+# Keep arguments in sync with printmsg
+def swallowmsg(msg, eol='', encoding=''):
+None
+
+
 class OneWayPipe(object):
 """
 A one way pipe protected by two process level locks, one for reading and 
one for writing.
@@ -241,7 +246,7 @@ class CopyTask(object):
 
 # do not display messages when exporting to STDOUT unless --debug is 
set
 self.printmsg = printmsg if self.fname is not None or direction == 
'from' or DEBUG \
-else lambda _, eol='\n': None
+else swallowmsg
 self.options = self.parse_options(opts, direction)
 
 self.num_processes = self.options.copy['numprocesses']



[06/10] cassandra git commit: Merge branch 'cassandra-2.2' into cassandra-3.0

2017-02-22 Thread paulo
Merge branch 'cassandra-2.2' into cassandra-3.0


Project: http://git-wip-us.apache.org/repos/asf/cassandra/repo
Commit: http://git-wip-us.apache.org/repos/asf/cassandra/commit/5fba118e
Tree: http://git-wip-us.apache.org/repos/asf/cassandra/tree/5fba118e
Diff: http://git-wip-us.apache.org/repos/asf/cassandra/diff/5fba118e

Branch: refs/heads/cassandra-3.0
Commit: 5fba118e95b6bc834169141514b8f563d5ffe6fb
Parents: f70d8c0 88f36a0
Author: Paulo Motta 
Authored: Wed Feb 22 17:19:08 2017 -0300
Committer: Paulo Motta 
Committed: Wed Feb 22 17:19:08 2017 -0300

--
 CHANGES.txt| 2 +-
 pylib/cqlshlib/copyutil.py | 7 ++-
 2 files changed, 7 insertions(+), 2 deletions(-)
--


http://git-wip-us.apache.org/repos/asf/cassandra/blob/5fba118e/CHANGES.txt
--
diff --cc CHANGES.txt
index a4bb9cd,1a22814..b744b40
--- a/CHANGES.txt
+++ b/CHANGES.txt
@@@ -1,7 -1,5 +1,7 @@@
 -2.2.10
 +3.0.12
 + * Fix cqlsh COPY for dates before 1900 (CASSANDRA-13185)
- 
 +Merged from 2.2
+  * Fix failing COPY TO STDOUT (CASSANDRA-12497)
   * Fix ColumnCounter::countAll behaviour for reverse queries (CASSANDRA-13222)
   * Exceptions encountered calling getSeeds() breaks OTC thread 
(CASSANDRA-13018)
  Merged from 2.1:

http://git-wip-us.apache.org/repos/asf/cassandra/blob/5fba118e/pylib/cqlshlib/copyutil.py
--



[01/10] cassandra git commit: Fix failing COPY TO STDOUT

2017-02-22 Thread paulo
Repository: cassandra
Updated Branches:
  refs/heads/cassandra-2.2 15e71baf0 -> 88f36a095
  refs/heads/cassandra-3.0 f70d8c06c -> 5fba118e9
  refs/heads/cassandra-3.11 b0ed0f4c3 -> b3490c062
  refs/heads/trunk 77eec6dfd -> cc51b4db0


Fix failing COPY TO STDOUT

Patch by Márton Salomváry; Reviewed by Paulo Motta for CASSANDRA-12497


Project: http://git-wip-us.apache.org/repos/asf/cassandra/repo
Commit: http://git-wip-us.apache.org/repos/asf/cassandra/commit/88f36a09
Tree: http://git-wip-us.apache.org/repos/asf/cassandra/tree/88f36a09
Diff: http://git-wip-us.apache.org/repos/asf/cassandra/diff/88f36a09

Branch: refs/heads/cassandra-2.2
Commit: 88f36a0955572e13316b83e7187c76c7cd0790b6
Parents: 15e71ba
Author: Márton Salomváry 
Authored: Tue Feb 7 15:15:34 2017 +0100
Committer: Paulo Motta 
Committed: Wed Feb 22 17:12:34 2017 -0300

--
 CHANGES.txt| 1 +
 pylib/cqlshlib/copyutil.py | 7 ++-
 2 files changed, 7 insertions(+), 1 deletion(-)
--


http://git-wip-us.apache.org/repos/asf/cassandra/blob/88f36a09/CHANGES.txt
--
diff --git a/CHANGES.txt b/CHANGES.txt
index 91c11fa..1a22814 100644
--- a/CHANGES.txt
+++ b/CHANGES.txt
@@ -1,4 +1,5 @@
 2.2.10
+ * Fix failing COPY TO STDOUT (CASSANDRA-12497)
  * Fix ColumnCounter::countAll behaviour for reverse queries (CASSANDRA-13222)
  * Exceptions encountered calling getSeeds() breaks OTC thread 
(CASSANDRA-13018)
 Merged from 2.1:

http://git-wip-us.apache.org/repos/asf/cassandra/blob/88f36a09/pylib/cqlshlib/copyutil.py
--
diff --git a/pylib/cqlshlib/copyutil.py b/pylib/cqlshlib/copyutil.py
index d22f2fe..cf5b0eb 100644
--- a/pylib/cqlshlib/copyutil.py
+++ b/pylib/cqlshlib/copyutil.py
@@ -83,6 +83,11 @@ def printmsg(msg, eol='\n', encoding='utf8'):
 sys.stdout.flush()
 
 
+# Keep arguments in sync with printmsg
+def swallowmsg(msg, eol='', encoding=''):
+None
+
+
 class OneWayPipe(object):
 """
 A one way pipe protected by two process level locks, one for reading and 
one for writing.
@@ -241,7 +246,7 @@ class CopyTask(object):
 
 # do not display messages when exporting to STDOUT unless --debug is 
set
 self.printmsg = printmsg if self.fname is not None or direction == 
'from' or DEBUG \
-else lambda _, eol='\n': None
+else swallowmsg
 self.options = self.parse_options(opts, direction)
 
 self.num_processes = self.options.copy['numprocesses']



[10/10] cassandra git commit: Merge branch 'cassandra-3.11' into trunk

2017-02-22 Thread paulo
Merge branch 'cassandra-3.11' into trunk


Project: http://git-wip-us.apache.org/repos/asf/cassandra/repo
Commit: http://git-wip-us.apache.org/repos/asf/cassandra/commit/cc51b4db
Tree: http://git-wip-us.apache.org/repos/asf/cassandra/tree/cc51b4db
Diff: http://git-wip-us.apache.org/repos/asf/cassandra/diff/cc51b4db

Branch: refs/heads/trunk
Commit: cc51b4db09d774dc04792e41db393c14d9cac8e5
Parents: 77eec6d b3490c0
Author: Paulo Motta 
Authored: Wed Feb 22 17:21:09 2017 -0300
Committer: Paulo Motta 
Committed: Wed Feb 22 17:21:09 2017 -0300

--
 CHANGES.txt| 1 +
 pylib/cqlshlib/copyutil.py | 7 ++-
 2 files changed, 7 insertions(+), 1 deletion(-)
--


http://git-wip-us.apache.org/repos/asf/cassandra/blob/cc51b4db/CHANGES.txt
--



[02/10] cassandra git commit: Fix failing COPY TO STDOUT

2017-02-22 Thread paulo
Fix failing COPY TO STDOUT

Patch by Márton Salomváry; Reviewed by Paulo Motta for CASSANDRA-12497


Project: http://git-wip-us.apache.org/repos/asf/cassandra/repo
Commit: http://git-wip-us.apache.org/repos/asf/cassandra/commit/88f36a09
Tree: http://git-wip-us.apache.org/repos/asf/cassandra/tree/88f36a09
Diff: http://git-wip-us.apache.org/repos/asf/cassandra/diff/88f36a09

Branch: refs/heads/cassandra-3.0
Commit: 88f36a0955572e13316b83e7187c76c7cd0790b6
Parents: 15e71ba
Author: Márton Salomváry 
Authored: Tue Feb 7 15:15:34 2017 +0100
Committer: Paulo Motta 
Committed: Wed Feb 22 17:12:34 2017 -0300

--
 CHANGES.txt| 1 +
 pylib/cqlshlib/copyutil.py | 7 ++-
 2 files changed, 7 insertions(+), 1 deletion(-)
--


http://git-wip-us.apache.org/repos/asf/cassandra/blob/88f36a09/CHANGES.txt
--
diff --git a/CHANGES.txt b/CHANGES.txt
index 91c11fa..1a22814 100644
--- a/CHANGES.txt
+++ b/CHANGES.txt
@@ -1,4 +1,5 @@
 2.2.10
+ * Fix failing COPY TO STDOUT (CASSANDRA-12497)
  * Fix ColumnCounter::countAll behaviour for reverse queries (CASSANDRA-13222)
  * Exceptions encountered calling getSeeds() breaks OTC thread 
(CASSANDRA-13018)
 Merged from 2.1:

http://git-wip-us.apache.org/repos/asf/cassandra/blob/88f36a09/pylib/cqlshlib/copyutil.py
--
diff --git a/pylib/cqlshlib/copyutil.py b/pylib/cqlshlib/copyutil.py
index d22f2fe..cf5b0eb 100644
--- a/pylib/cqlshlib/copyutil.py
+++ b/pylib/cqlshlib/copyutil.py
@@ -83,6 +83,11 @@ def printmsg(msg, eol='\n', encoding='utf8'):
 sys.stdout.flush()
 
 
+# Keep arguments in sync with printmsg
+def swallowmsg(msg, eol='', encoding=''):
+None
+
+
 class OneWayPipe(object):
 """
 A one way pipe protected by two process level locks, one for reading and 
one for writing.
@@ -241,7 +246,7 @@ class CopyTask(object):
 
 # do not display messages when exporting to STDOUT unless --debug is 
set
 self.printmsg = printmsg if self.fname is not None or direction == 
'from' or DEBUG \
-else lambda _, eol='\n': None
+else swallowmsg
 self.options = self.parse_options(opts, direction)
 
 self.num_processes = self.options.copy['numprocesses']



[jira] [Updated] (CASSANDRA-13253) include a search on the doc home

2017-02-22 Thread Blake Eggleston (JIRA)

 [ 
https://issues.apache.org/jira/browse/CASSANDRA-13253?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
 ]

Blake Eggleston updated CASSANDRA-13253:

Reviewer: Blake Eggleston

> include a search on the doc home
> 
>
> Key: CASSANDRA-13253
> URL: https://issues.apache.org/jira/browse/CASSANDRA-13253
> Project: Cassandra
>  Issue Type: Improvement
>Reporter: Jon Haddad
>Assignee: Jon Haddad
>
> Current doc homepage doesn't have a search.  
> http://cassandra.apache.org/doc/latest/



--
This message was sent by Atlassian JIRA
(v6.3.15#6346)


[jira] [Updated] (CASSANDRA-13253) include a search on the doc home

2017-02-22 Thread Jon Haddad (JIRA)

 [ 
https://issues.apache.org/jira/browse/CASSANDRA-13253?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
 ]

Jon Haddad updated CASSANDRA-13253:
---
Status: Patch Available  (was: Open)

Patch here: 
https://github.com/apache/cassandra/compare/trunk...rustyrazorblade:CASSANDRA-13253.patch

> include a search on the doc home
> 
>
> Key: CASSANDRA-13253
> URL: https://issues.apache.org/jira/browse/CASSANDRA-13253
> Project: Cassandra
>  Issue Type: Improvement
>Reporter: Jon Haddad
>Assignee: Jon Haddad
>
> Current doc homepage doesn't have a search.  
> http://cassandra.apache.org/doc/latest/



--
This message was sent by Atlassian JIRA
(v6.3.15#6346)


[jira] [Updated] (CASSANDRA-13256) add documentation on contributing documentation

2017-02-22 Thread Jon Haddad (JIRA)

 [ 
https://issues.apache.org/jira/browse/CASSANDRA-13256?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
 ]

Jon Haddad updated CASSANDRA-13256:
---
Description: The contributing page has nothing on how to contribute 
documentation, an area the project is lacking.   (was: The contributing page 
has nothing on how to contribute documentation, an area the project is lacking. 
 I noticed {{ant gen-doc}} but it doesn't generate the docs using the same 
template as the website.  Is this intentional?)

> add documentation on contributing documentation
> ---
>
> Key: CASSANDRA-13256
> URL: https://issues.apache.org/jira/browse/CASSANDRA-13256
> Project: Cassandra
>  Issue Type: Improvement
>  Components: Documentation and Website
>Reporter: Jon Haddad
>
> The contributing page has nothing on how to contribute documentation, an area 
> the project is lacking. 



--
This message was sent by Atlassian JIRA
(v6.3.15#6346)


[jira] [Created] (CASSANDRA-13256) add documentation on contributing documentation

2017-02-22 Thread Jon Haddad (JIRA)
Jon Haddad created CASSANDRA-13256:
--

 Summary: add documentation on contributing documentation
 Key: CASSANDRA-13256
 URL: https://issues.apache.org/jira/browse/CASSANDRA-13256
 Project: Cassandra
  Issue Type: Improvement
  Components: Documentation and Website
Reporter: Jon Haddad


The contributing page has nothing on how to contribute documentation, an area 
the project is lacking.  I noticed {{ant gen-doc}} but it doesn't generate the 
docs using the same template as the website.  Is this intentional?



--
This message was sent by Atlassian JIRA
(v6.3.15#6346)


[jira] [Created] (CASSANDRA-13255) move compaction strategies to dedicated pages and expand on details

2017-02-22 Thread Jon Haddad (JIRA)
Jon Haddad created CASSANDRA-13255:
--

 Summary: move compaction strategies to dedicated pages and expand 
on details
 Key: CASSANDRA-13255
 URL: https://issues.apache.org/jira/browse/CASSANDRA-13255
 Project: Cassandra
  Issue Type: Improvement
  Components: Documentation and Website
Reporter: Jon Haddad
 Fix For: 4.0


current sections on compactions are lacking details.  we should split them out 
into their own sections and improve each of them.



--
This message was sent by Atlassian JIRA
(v6.3.15#6346)


[jira] [Created] (CASSANDRA-13254) move compaction strategies to dedicated pages and expand on details

2017-02-22 Thread Jon Haddad (JIRA)
Jon Haddad created CASSANDRA-13254:
--

 Summary: move compaction strategies to dedicated pages and expand 
on details
 Key: CASSANDRA-13254
 URL: https://issues.apache.org/jira/browse/CASSANDRA-13254
 Project: Cassandra
  Issue Type: Improvement
  Components: Documentation and Website
Reporter: Jon Haddad
 Fix For: 4.0


current sections on compactions are lacking details.  we should split them out 
into their own sections and improve each of them.



--
This message was sent by Atlassian JIRA
(v6.3.15#6346)


[jira] [Assigned] (CASSANDRA-13253) include a search on the doc home

2017-02-22 Thread Jon Haddad (JIRA)

 [ 
https://issues.apache.org/jira/browse/CASSANDRA-13253?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
 ]

Jon Haddad reassigned CASSANDRA-13253:
--

Assignee: Jon Haddad

> include a search on the doc home
> 
>
> Key: CASSANDRA-13253
> URL: https://issues.apache.org/jira/browse/CASSANDRA-13253
> Project: Cassandra
>  Issue Type: Improvement
>Reporter: Jon Haddad
>Assignee: Jon Haddad
>
> Current doc homepage doesn't have a search.  
> http://cassandra.apache.org/doc/latest/



--
This message was sent by Atlassian JIRA
(v6.3.15#6346)


[jira] [Created] (CASSANDRA-13253) include a search on the doc home

2017-02-22 Thread Jon Haddad (JIRA)
Jon Haddad created CASSANDRA-13253:
--

 Summary: include a search on the doc home
 Key: CASSANDRA-13253
 URL: https://issues.apache.org/jira/browse/CASSANDRA-13253
 Project: Cassandra
  Issue Type: Improvement
Reporter: Jon Haddad


Current doc homepage doesn't have a search.  

http://cassandra.apache.org/doc/latest/



--
This message was sent by Atlassian JIRA
(v6.3.15#6346)


[jira] [Commented] (CASSANDRA-12886) Streaming failed due to SSL Socket connection reset

2017-02-22 Thread Paulo Motta (JIRA)

[ 
https://issues.apache.org/jira/browse/CASSANDRA-12886?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15878991#comment-15878991
 ] 

Paulo Motta commented on CASSANDRA-12886:
-

Thanks for review! Some streaming unit tests failed due to the 
{{procotolVersion}} variable not being initialized after calling 
{{ConnectionHandler.sendInitMessage}} before {{ConnectionHandler.start(socket, 
protocolVersion}}, so I updated the patch to use a similar approach as 
CASSANDRA-11841 and send the init message on {{ConnectionHandler.start(socket, 
protocolVersion, initiator}}. Could you have a quick look?

Resubmitted tests using new approach.

> Streaming failed due to SSL Socket connection reset
> ---
>
> Key: CASSANDRA-12886
> URL: https://issues.apache.org/jira/browse/CASSANDRA-12886
> Project: Cassandra
>  Issue Type: Bug
>Reporter: Bing Wu
>Assignee: Paulo Motta
> Attachments: debug.log.2016-11-10_2319.gz
>
>
> While running "nodetool repair", I see many instances of 
> "javax.net.ssl.SSLException: java.net.SocketException: Connection reset" in 
> system.logs on some nodes in the cluster. Timestamps correspond to streaming 
> source/initiator's error messages of "sync failed between ..."
> Setup: 
> - Cassandra 3.7.01 
> - CentOS 6.7 in AWS (multi-region)
> - JDK version: {noformat}
> java version "1.8.0_102"
> Java(TM) SE Runtime Environment (build 1.8.0_102-b14)
> Java HotSpot(TM) 64-Bit Server VM (build 25.102-b14, mixed mode)
> {noformat}
> - cassandra.yaml:
> {noformat}
> server_encryption_options:
> internode_encryption: all
> keystore: [path]
> keystore_password: [password]
> truststore: [path]
> truststore_password: [password]
> # More advanced defaults below:
> # protocol: TLS
> # algorithm: SunX509
> # store_type: JKS
> # cipher_suites: 
> [TLS_RSA_WITH_AES_128_CBC_SHA,TLS_RSA_WITH_AES_256_CBC_SHA,TLS_DHE_RSA_WITH_AES_128_CBC_SHA,TLS_DHE_RSA_WITH_AES_256_CBC_SHA,TLS_ECDHE_RSA_WITH_AES_128_CBC_SHA,TLS_ECDHE_RSA_WITH_AES_256_CBC_SHA]
> require_client_auth: false
> {noformat}
> Error messages in system.log on the target host:
> {noformat}
> ERROR [STREAM-OUT-/54.247.111.232:7001] 2016-11-07 07:30:56,475 
> StreamSession.java:529 - [Stream #e14abcb0-a4bb-11e6-9758-55b9ac38b78e] 
> Streaming error occurred on session with peer 54.247.111.232
> javax.net.ssl.SSLException: Connection has been shutdown: 
> javax.net.ssl.SSLException: java.net.SocketException: Connection reset
> at sun.security.ssl.SSLSocketImpl.checkEOF(SSLSocketImpl.java:1541) 
> ~[na:1.8.0_102]
> at sun.security.ssl.SSLSocketImpl.checkWrite(SSLSocketImpl.java:1553) 
> ~[na:1.8.0_102]
> at sun.security.ssl.AppOutputStream.write(AppOutputStream.java:71) 
> ~[na:1.8.0_102]
> at 
> java.io.BufferedOutputStream.flushBuffer(BufferedOutputStream.java:82) 
> ~[na:1.8.0_102]
> at java.io.BufferedOutputStream.flush(BufferedOutputStream.java:140) 
> ~[na:1.8.0_102]
> at 
> org.apache.cassandra.io.util.WrappedDataOutputStreamPlus.flush(WrappedDataOutputStreamPlus.java:66)
>  ~[apache-cassandra-3.7.0.jar:3.7.0]
> at 
> org.apache.cassandra.streaming.ConnectionHandler$OutgoingMessageHandler.sendMessage(ConnectionHandler.java:371)
>  [apache-cassandra-3.7.0.jar:3.7.0]
> at 
> org.apache.cassandra.streaming.ConnectionHandler$OutgoingMessageHandler.run(ConnectionHandler.java:342)
>  [apache-cassandra-3.7.0.jar:3.7.0]
> at java.lang.Thread.run(Thread.java:745) [na:1.8.0_102]
> Caused by: javax.net.ssl.SSLException: java.net.SocketException: Connection 
> reset
> {noformat}



--
This message was sent by Atlassian JIRA
(v6.3.15#6346)


cassandra-builds git commit: Add Jenkins slave list for ASF INFRA reference

2017-02-22 Thread mshuler
Repository: cassandra-builds
Updated Branches:
  refs/heads/master 3477de5ed -> fe30f85bc


Add Jenkins slave list for ASF INFRA reference


Project: http://git-wip-us.apache.org/repos/asf/cassandra-builds/repo
Commit: http://git-wip-us.apache.org/repos/asf/cassandra-builds/commit/fe30f85b
Tree: http://git-wip-us.apache.org/repos/asf/cassandra-builds/tree/fe30f85b
Diff: http://git-wip-us.apache.org/repos/asf/cassandra-builds/diff/fe30f85b

Branch: refs/heads/master
Commit: fe30f85bc57943c131f77ed7881c1ee62a7b3c23
Parents: 3477de5
Author: Michael Shuler 
Authored: Wed Feb 22 12:50:12 2017 -0600
Committer: Michael Shuler 
Committed: Wed Feb 22 12:50:12 2017 -0600

--
 ASF-slaves.txt | 51 +++
 1 file changed, 51 insertions(+)
--


http://git-wip-us.apache.org/repos/asf/cassandra-builds/blob/fe30f85b/ASF-slaves.txt
--
diff --git a/ASF-slaves.txt b/ASF-slaves.txt
new file mode 100644
index 000..a489bdb
--- /dev/null
+++ b/ASF-slaves.txt
@@ -0,0 +1,51 @@
+This document is the list of servers and installed software for ASF INFRA
+  https://reference.apache.org/committer/node-hosting
+
+Additional compute resource donations for the Apache Cassandra project are
+appreciated. If you have questions about compute resource donations, ask
+Michael Shuler .
+
+The installed OS software is the stock online.net Ubuntu 16.04 LTS amd64 image
+with only their default installation of bind9 removed:
+  $ sudo apt-get autoremove --purge bind9
+  $ sudo rm -r /var/cache/bind
+
+Add jenkins user:
+  $ sudo useradd -m -s /bin/bash jenkins
+
+Add ssh pub key from puppet deployment repo:
+  
https://github.com/apache/infrastructure-puppet/blob/deployment/data/ubuntu/1404.yaml#L295
+  $ sudo mkdir /home/jenkins/.ssh
+  $ sudo sh -c "echo 
'B3NzaC1yc2EBIwAAAIEAtxkcKDiPh1OaVzaVdc80daKq2sRy8aAgt8u2uEcLClzMrnv/g19db7XVggfT4+HPCqcbFbO3mtVnUnWWtuSEpDjqriWnEcSj2G1P53zsdKEu9qCGLmEFMgwcq8b5plv78PRdAQn09WCBI1QrNMypjxgCKhNNn45WqV4AD8Jp7/8='
 > /home/jenkins/.ssh/authorized_keys"
+  $ sudo chown -R jenkins:jenkins /home/jenkins/.ssh
+  $ sudo chmod 700 /home/jenkins/.ssh
+  $ sudo chmod 600 /home/jenkins/.ssh/authorized_keys
+
+
+
+ONLINE Slaves:
+
+cassandra slaves (16G RAM)
+
+cassandra1 - 163.172.83.157 - Ubuntu 16.04 LTS amd64, donated by Datastax
+cassandra2 - 163.172.83.159 - Ubuntu 16.04 LTS amd64, donated by Datastax
+cassandra3 - 163.172.83.161 - Ubuntu 16.04 LTS amd64, donated by Datastax
+cassandra4 - 163.172.83.163 - Ubuntu 16.04 LTS amd64, donated by Datastax
+cassandra5 - 163.172.83.175 - Ubuntu 16.04 LTS amd64, donated by Datastax
+
+
+
+Slaves in progress of being added to pool:
+
+cassandra-large slaves (32G RAM)
+
+cassandra6 - 163.172.71.128 - Ubuntu 16.04 LTS amd64, donated by Datastax
+cassandra7 - 163.172.71.129 - Ubuntu 16.04 LTS amd64, donated by Datastax
+
+
+
+Contacts for system donators, when console hands may be needed by INFRA:
+
+  Datastax: Michael Shuler 
+alternative group list: cassandra...@datastax.com
+



[jira] [Assigned] (CASSANDRA-13248) testall failure in org.apache.cassandra.db.compaction.PendingRepairManagerTest.userDefinedTaskTest

2017-02-22 Thread Blake Eggleston (JIRA)

 [ 
https://issues.apache.org/jira/browse/CASSANDRA-13248?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
 ]

Blake Eggleston reassigned CASSANDRA-13248:
---

Assignee: Blake Eggleston

> testall failure in 
> org.apache.cassandra.db.compaction.PendingRepairManagerTest.userDefinedTaskTest
> --
>
> Key: CASSANDRA-13248
> URL: https://issues.apache.org/jira/browse/CASSANDRA-13248
> Project: Cassandra
>  Issue Type: Bug
>  Components: Testing
>Reporter: Sean McCarthy
>Assignee: Blake Eggleston
>  Labels: test-failure, testall
> Attachments: 
> TEST-org.apache.cassandra.db.compaction.PendingRepairManagerTest.log
>
>
> example failure:
> http://cassci.datastax.com/job/trunk_testall/1416/testReport/org.apache.cassandra.db.compaction/PendingRepairManagerTest/userDefinedTaskTest
> {code}
> Error Message
> expected:<1> but was:<0>
> {code}{code}
> Stacktrace
> junit.framework.AssertionFailedError: expected:<1> but was:<0>
>   at 
> org.apache.cassandra.db.compaction.PendingRepairManagerTest.userDefinedTaskTest(PendingRepairManagerTest.java:194)
> {code}{code}
> Standard Output
> ERROR [main] 2017-02-21 17:00:01,792 ?:? - SLF4J: stderr
> INFO  [main] 2017-02-21 17:00:02,001 ?:? - Configuration location: 
> file:/home/automaton/cassandra/test/conf/cassandra.yaml
> DEBUG [main] 2017-02-21 17:00:02,002 ?:? - Loading settings from 
> file:/home/automaton/cassandra/test/conf/cassandra.yaml
> INFO  [main] 2017-02-21 17:00:02,530 ?:? - Node 
> configuration:[allocate_tokens_for_keyspace=null; authenticator=null; 
> authorizer=null; auto_bootstrap=true; auto_snapshot=true; 
> back_pressure_enabled=false; back_pressure_strategy=null; 
> batch_size_fail_threshold_in_kb=50; batch_size_warn_threshold_in_kb=5; 
> batchlog_replay_throttle_in_kb=1024; broadcast_address=null; 
> broadcast_rpc_address=null; buffer_pool_use_heap_if_exhausted=true; 
> cas_contention_timeout_in_ms=1000; cdc_enabled=false; 
> cdc_free_space_check_interval_ms=250; 
> cdc_raw_directory=build/test/cassandra/cdc_raw:165; cdc_total_space_in_mb=0; 
> client_encryption_options=; cluster_name=Test Cluster; 
> column_index_cache_size_in_kb=2; column_index_size_in_kb=4; 
> commit_failure_policy=stop; commitlog_compression=null; 
> commitlog_directory=build/test/cassandra/commitlog:165; 
> commitlog_max_compression_buffers_in_pool=3; 
> commitlog_periodic_queue_size=-1; commitlog_segment_size_in_mb=5; 
> commitlog_sync=batch; commitlog_sync_batch_window_in_ms=1.0; 
> commitlog_sync_period_in_ms=0; commitlog_total_space_in_mb=null; 
> compaction_large_partition_warning_threshold_mb=100; 
> compaction_throughput_mb_per_sec=0; concurrent_compactors=4; 
> concurrent_counter_writes=32; concurrent_materialized_view_writes=32; 
> concurrent_reads=32; concurrent_replicates=null; concurrent_writes=32; 
> counter_cache_keys_to_save=2147483647; counter_cache_save_period=7200; 
> counter_cache_size_in_mb=null; counter_write_request_timeout_in_ms=5000; 
> credentials_cache_max_entries=1000; credentials_update_interval_in_ms=-1; 
> credentials_validity_in_ms=2000; cross_node_timeout=false; 
> data_file_directories=[Ljava.lang.String;@1757cd72; disk_access_mode=mmap; 
> disk_failure_policy=ignore; disk_optimization_estimate_percentile=0.95; 
> disk_optimization_page_cross_chance=0.1; disk_optimization_strategy=ssd; 
> dynamic_snitch=true; dynamic_snitch_badness_threshold=0.1; 
> dynamic_snitch_reset_interval_in_ms=60; 
> dynamic_snitch_update_interval_in_ms=100; 
> enable_scripted_user_defined_functions=true; 
> enable_user_defined_functions=true; 
> enable_user_defined_functions_threads=true; encryption_options=null; 
> endpoint_snitch=org.apache.cassandra.locator.SimpleSnitch; 
> file_cache_size_in_mb=null; gc_log_threshold_in_ms=200; 
> gc_warn_threshold_in_ms=0; hinted_handoff_disabled_datacenters=[]; 
> hinted_handoff_enabled=true; hinted_handoff_throttle_in_kb=1024; 
> hints_compression=null; hints_directory=build/test/cassandra/hints:165; 
> hints_flush_period_in_ms=1; incremental_backups=true; 
> index_interval=null; index_summary_capacity_in_mb=null; 
> index_summary_resize_interval_in_minutes=60; initial_token=null; 
> inter_dc_stream_throughput_outbound_megabits_per_sec=200; 
> inter_dc_tcp_nodelay=true; internode_authenticator=null; 
> internode_compression=none; internode_recv_buff_size_in_bytes=0; 
> internode_send_buff_size_in_bytes=0; key_cache_keys_to_save=2147483647; 
> key_cache_save_period=14400; key_cache_size_in_mb=null; 
> listen_address=127.0.0.1; listen_interface=null; 
> listen_interface_prefer_ipv6=false; listen_on_broadcast_address=false; 
> max_hint_window_in_ms=1080; max_hints_delivery_threads=2; 
> max_hints_file_size_in_mb=128; max_mutation_size_in_kb=null; 
> 

[jira] [Commented] (CASSANDRA-9292) ParentRepairSession potentially block ANTI_ENTROPY stage

2017-02-22 Thread Blake Eggleston (JIRA)

[ 
https://issues.apache.org/jira/browse/CASSANDRA-9292?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15878898#comment-15878898
 ] 

Blake Eggleston commented on CASSANDRA-9292:


I don't see anything in the prepare path we need to synchronize for, so this 
looks good, with the exception of [this 
wait|https://github.com/krummas/cassandra/blob/marcuse/9292/src/java/org/apache/cassandra/service/ActiveRepairService.java#L379].
 Could you set  that to {{DatabaseDescriptor.getRpcTimeout()}} as well?

> ParentRepairSession potentially block ANTI_ENTROPY stage
> 
>
> Key: CASSANDRA-9292
> URL: https://issues.apache.org/jira/browse/CASSANDRA-9292
> Project: Cassandra
>  Issue Type: Bug
>Reporter: Yuki Morishita
>Assignee: Marcus Eriksson
>Priority: Minor
> Fix For: 4.x
>
>
> Follow up from CASSANDRA-9151,
> {quote}
> potentially block this stage again since many methods are synchronized in 
> ActiveRepairService.
> Methods prepareForRepair(could block for 1 hour for prepare message response) 
> and finishParentSession(this one block for anticompaction to finish) are 
> synchronized and could hold on to the lock for a long time.
> In RepairMessageVerbHandler.doVerb, if there is an exception for another 
> repair, removeParentRepairSession(also synchronized) will block.
> {quote}



--
This message was sent by Atlassian JIRA
(v6.3.15#6346)


[jira] [Commented] (CASSANDRA-12100) Compactions are stuck after TRUNCATE

2017-02-22 Thread Marcus Eriksson (JIRA)

[ 
https://issues.apache.org/jira/browse/CASSANDRA-12100?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15878831#comment-15878831
 ] 

Marcus Eriksson commented on CASSANDRA-12100:
-

sure!

> Compactions are stuck after TRUNCATE
> 
>
> Key: CASSANDRA-12100
> URL: https://issues.apache.org/jira/browse/CASSANDRA-12100
> Project: Cassandra
>  Issue Type: Bug
>  Components: Compaction
>Reporter: Stefano Ortolani
>Assignee: Stefania
> Fix For: 3.0.9, 3.8
>
> Attachments: node3_jstack.log
>
>
> Hi,
> since the upgrade to C* 3.0.7 I see compaction tasks getting stuck when 
> truncating the column family. I verified this on all nodes of the cluster.
> Pending compactions seem to disappear after restarting the node.
> {noformat}
> root@node10:~# nodetool -h localhost compactionstats
> pending tasks: 6
>  id   compaction type  
> keyspacetable   completed  totalunit   progress
>24e1ad30-3cac-11e6-870d-5de740693258Compaction  
> schema  table_1   0   57558382   bytes  0.00%
>2be2e3b0-3cac-11e6-870d-5de740693258Compaction  
> schema  table_2   0   65063705   bytes  0.00%
>54de38f0-3cac-11e6-870d-5de740693258Compaction  
> schema  table_3   0 187031   bytes  0.00%
>31926ce0-3cac-11e6-870d-5de740693258Compaction  
> schema  table_4   0   42951119   bytes  0.00%
>3911ad00-3cac-11e6-870d-5de740693258Compaction  
> schema  table_5   0   25918949   bytes  0.00%
>3e6a8ab0-3cac-11e6-870d-5de740693258Compaction  
> schema  table_6   0   65466210   bytes  0.00%
> Active compaction remaining time :   0h00m15s
> {noformat}



--
This message was sent by Atlassian JIRA
(v6.3.15#6346)


[jira] [Updated] (CASSANDRA-13230) Build RPM packages for release

2017-02-22 Thread Michael Shuler (JIRA)

 [ 
https://issues.apache.org/jira/browse/CASSANDRA-13230?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
 ]

Michael Shuler updated CASSANDRA-13230:
---
Resolution: Fixed
Status: Resolved  (was: Ready to Commit)

I committed a couple fixes and we have packages! I really appreciate your help. 
Going to call this ticket done and we can work on CASSANDRA-13252 for inclusion.
{code}
(master)mshuler@hana:~/git/cassandra-builds$ ls -l dist/
total 324980
-rw-r--r-- 1 mshuler mshuler  27039356 Feb 22 10:49 cassandra-4.0-1.noarch.rpm
-rw-r--r-- 1 mshuler mshuler  30471871 Feb 22 10:49 cassandra-4.0-1.src.rpm
-rw-r--r-- 1 mshuler mshuler  5268 Feb 22 10:49 
cassandra-tools-4.0-1.noarch.rpm
-rw-r--r-- 1 mshuler mshuler  4584 Feb 22 10:50 cassandra-tools_4.0_all.deb
-rw-r--r-- 1 mshuler mshuler   903 Feb 22 10:50 cassandra_4.0.dsc
-rw-r--r-- 1 mshuler mshuler 248183858 Feb 22 10:50 cassandra_4.0.tar.gz
-rw-r--r-- 1 mshuler mshuler  27043084 Feb 22 10:50 cassandra_4.0_all.deb
-rw-r--r-- 1 mshuler mshuler  1493 Feb 22 10:50 cassandra_4.0_amd64.changes
{code}

> Build RPM packages for release
> --
>
> Key: CASSANDRA-13230
> URL: https://issues.apache.org/jira/browse/CASSANDRA-13230
> Project: Cassandra
>  Issue Type: New Feature
>  Components: Packaging
>Reporter: Michael Shuler
>Assignee: Stefan Podkowinski
> Attachments: 13230.patch
>
>
> Currently, releases are built locally on Debian/Ubuntu based machines, 
> without native support for building RPM packages. This can be done with a 
> docker image.
> The current cassandra-release scripts are here (please, do not randomly run 
> and push tags..):
> https://git-wip-us.apache.org/repos/asf?p=cassandra-builds.git;a=tree;f=cassandra-release
> A couple incomplete docker run scripts are here:
> https://git-wip-us.apache.org/repos/asf?p=cassandra-builds.git;a=tree;f=docker-wip
> {code}
> git clone https://git-wip-us.apache.org/repos/asf/cassandra-builds.git
> {code}
> Patches for build infra improvements are welcome!
> /cc [~spo...@gmail.com] if you want to assign to yourself, I'd be happy to 
> review :)



--
This message was sent by Atlassian JIRA
(v6.3.15#6346)


[jira] [Updated] (CASSANDRA-13230) Build RPM packages for release

2017-02-22 Thread Michael Shuler (JIRA)

 [ 
https://issues.apache.org/jira/browse/CASSANDRA-13230?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
 ]

Michael Shuler updated CASSANDRA-13230:
---
Status: Ready to Commit  (was: Patch Available)

> Build RPM packages for release
> --
>
> Key: CASSANDRA-13230
> URL: https://issues.apache.org/jira/browse/CASSANDRA-13230
> Project: Cassandra
>  Issue Type: New Feature
>  Components: Packaging
>Reporter: Michael Shuler
>Assignee: Stefan Podkowinski
> Attachments: 13230.patch
>
>
> Currently, releases are built locally on Debian/Ubuntu based machines, 
> without native support for building RPM packages. This can be done with a 
> docker image.
> The current cassandra-release scripts are here (please, do not randomly run 
> and push tags..):
> https://git-wip-us.apache.org/repos/asf?p=cassandra-builds.git;a=tree;f=cassandra-release
> A couple incomplete docker run scripts are here:
> https://git-wip-us.apache.org/repos/asf?p=cassandra-builds.git;a=tree;f=docker-wip
> {code}
> git clone https://git-wip-us.apache.org/repos/asf/cassandra-builds.git
> {code}
> Patches for build infra improvements are welcome!
> /cc [~spo...@gmail.com] if you want to assign to yourself, I'd be happy to 
> review :)



--
This message was sent by Atlassian JIRA
(v6.3.15#6346)


[jira] [Created] (CASSANDRA-13252) Include RPM packages in releases

2017-02-22 Thread Michael Shuler (JIRA)
Michael Shuler created CASSANDRA-13252:
--

 Summary: Include RPM packages in releases
 Key: CASSANDRA-13252
 URL: https://issues.apache.org/jira/browse/CASSANDRA-13252
 Project: Cassandra
  Issue Type: New Feature
  Components: Packaging
Reporter: Michael Shuler
Assignee: Michael Shuler


CASSANDRA-13230 sets up docker builds for deb and rpm packages out of the 
{{cassandra-builds}} git repo. We should now be able to do builds in CI, at 
least for build testing of snapshot packages.

In order to include in releases, we may wish to set up bintray for RPMs in a 
{{redhat/}} dir, similar to the current {{debian/}} dir redirect from 
cassandra-dist, or start with direct downloads from cassandra-dist and see how 
it goes.



--
This message was sent by Atlassian JIRA
(v6.3.15#6346)


cassandra-builds git commit: Fix build command order

2017-02-22 Thread mshuler
Repository: cassandra-builds
Updated Branches:
  refs/heads/master 15f616f65 -> 3477de5ed


Fix build command order


Project: http://git-wip-us.apache.org/repos/asf/cassandra-builds/repo
Commit: http://git-wip-us.apache.org/repos/asf/cassandra-builds/commit/3477de5e
Tree: http://git-wip-us.apache.org/repos/asf/cassandra-builds/tree/3477de5e
Diff: http://git-wip-us.apache.org/repos/asf/cassandra-builds/diff/3477de5e

Branch: refs/heads/master
Commit: 3477de5ed89126cdf893b37a614e5684324198e4
Parents: 15f616f
Author: Michael Shuler 
Authored: Wed Feb 22 10:42:35 2017 -0600
Committer: Michael Shuler 
Committed: Wed Feb 22 10:42:35 2017 -0600

--
 README.md | 4 ++--
 1 file changed, 2 insertions(+), 2 deletions(-)
--


http://git-wip-us.apache.org/repos/asf/cassandra-builds/blob/3477de5e/README.md
--
diff --git a/README.md b/README.md
index 056316e..89f95f2 100644
--- a/README.md
+++ b/README.md
@@ -11,9 +11,9 @@ Collection of scripts that can be used to create Cassandra 
Linux packages and to
```docker build -f docker/centos7-image.docker docker/```
 2. Run build script through docker (specify branch, e.g. cassandra-3.0 and 
version, e.g. 3.0.11):
* Debian:
-```docker run -v `pwd`/dist:/dist `docker images -f 
label=org.cassandra.buildenv=centos -q` /home/build/build-rpms.sh  
```
-   * RPM:
 ```docker run -v `pwd`/dist:/dist `docker images -f 
label=org.cassandra.buildenv=jessie -q` /home/build/build-debs.sh ```
+   * RPM:
+```docker run -v `pwd`/dist:/dist `docker images -f 
label=org.cassandra.buildenv=centos -q` /home/build/build-rpms.sh  
```
 
 You should find newly created Debian and RPM packages in the `dist` directory.
 



cassandra-builds git commit: Add trailing slash to COPY target dir

2017-02-22 Thread mshuler
Repository: cassandra-builds
Updated Branches:
  refs/heads/master f31eb5f04 -> 15f616f65


Add trailing slash to COPY target dir

Docker build fails on the target with "not a directory", unless it includes
a trailing slash.


Project: http://git-wip-us.apache.org/repos/asf/cassandra-builds/repo
Commit: http://git-wip-us.apache.org/repos/asf/cassandra-builds/commit/15f616f6
Tree: http://git-wip-us.apache.org/repos/asf/cassandra-builds/tree/15f616f6
Diff: http://git-wip-us.apache.org/repos/asf/cassandra-builds/diff/15f616f6

Branch: refs/heads/master
Commit: 15f616f65575a962871545a8f8a2bb569b48a219
Parents: f31eb5f
Author: Michael Shuler 
Authored: Wed Feb 22 10:38:34 2017 -0600
Committer: Michael Shuler 
Committed: Wed Feb 22 10:38:34 2017 -0600

--
 docker/centos7-image.docker | 2 +-
 docker/jessie-image.docker  | 3 +--
 2 files changed, 2 insertions(+), 3 deletions(-)
--


http://git-wip-us.apache.org/repos/asf/cassandra-builds/blob/15f616f6/docker/centos7-image.docker
--
diff --git a/docker/centos7-image.docker b/docker/centos7-image.docker
index f9b1e16..fc82d4d 100644
--- a/docker/centos7-image.docker
+++ b/docker/centos7-image.docker
@@ -44,4 +44,4 @@ RUN git clone https://git.apache.org/cassandra.git 
${CASSANDRA_DIR}
 WORKDIR $CASSANDRA_DIR
 RUN ant maven-ant-tasks-retrieve-build
 
-COPY build-rpms.sh $BUILD_HOME
+COPY build-rpms.sh $BUILD_HOME/

http://git-wip-us.apache.org/repos/asf/cassandra-builds/blob/15f616f6/docker/jessie-image.docker
--
diff --git a/docker/jessie-image.docker b/docker/jessie-image.docker
index 3de19d2..80bce88 100644
--- a/docker/jessie-image.docker
+++ b/docker/jessie-image.docker
@@ -39,5 +39,4 @@ RUN git clone https://git.apache.org/cassandra.git 
${CASSANDRA_DIR}
 WORKDIR ${CASSANDRA_DIR}
 RUN ant maven-ant-tasks-retrieve-build
 
-COPY build-debs.sh $BUILD_HOME
-
+COPY build-debs.sh $BUILD_HOME/



[jira] [Commented] (CASSANDRA-12100) Compactions are stuck after TRUNCATE

2017-02-22 Thread Stefania (JIRA)

[ 
https://issues.apache.org/jira/browse/CASSANDRA-12100?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15878643#comment-15878643
 ] 

Stefania commented on CASSANDRA-12100:
--

Tests launched. [~krummas], are you also +1 to back-port this to 2.2?

> Compactions are stuck after TRUNCATE
> 
>
> Key: CASSANDRA-12100
> URL: https://issues.apache.org/jira/browse/CASSANDRA-12100
> Project: Cassandra
>  Issue Type: Bug
>  Components: Compaction
>Reporter: Stefano Ortolani
>Assignee: Stefania
> Fix For: 3.0.9, 3.8
>
> Attachments: node3_jstack.log
>
>
> Hi,
> since the upgrade to C* 3.0.7 I see compaction tasks getting stuck when 
> truncating the column family. I verified this on all nodes of the cluster.
> Pending compactions seem to disappear after restarting the node.
> {noformat}
> root@node10:~# nodetool -h localhost compactionstats
> pending tasks: 6
>  id   compaction type  
> keyspacetable   completed  totalunit   progress
>24e1ad30-3cac-11e6-870d-5de740693258Compaction  
> schema  table_1   0   57558382   bytes  0.00%
>2be2e3b0-3cac-11e6-870d-5de740693258Compaction  
> schema  table_2   0   65063705   bytes  0.00%
>54de38f0-3cac-11e6-870d-5de740693258Compaction  
> schema  table_3   0 187031   bytes  0.00%
>31926ce0-3cac-11e6-870d-5de740693258Compaction  
> schema  table_4   0   42951119   bytes  0.00%
>3911ad00-3cac-11e6-870d-5de740693258Compaction  
> schema  table_5   0   25918949   bytes  0.00%
>3e6a8ab0-3cac-11e6-870d-5de740693258Compaction  
> schema  table_6   0   65466210   bytes  0.00%
> Active compaction remaining time :   0h00m15s
> {noformat}



--
This message was sent by Atlassian JIRA
(v6.3.15#6346)


[jira] [Commented] (CASSANDRA-12100) Compactions are stuck after TRUNCATE

2017-02-22 Thread Sotirios Delimanolis (JIRA)

[ 
https://issues.apache.org/jira/browse/CASSANDRA-12100?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15878636#comment-15878636
 ] 

Sotirios Delimanolis commented on CASSANDRA-12100:
--

Yes, please.

> Compactions are stuck after TRUNCATE
> 
>
> Key: CASSANDRA-12100
> URL: https://issues.apache.org/jira/browse/CASSANDRA-12100
> Project: Cassandra
>  Issue Type: Bug
>  Components: Compaction
>Reporter: Stefano Ortolani
>Assignee: Stefania
> Fix For: 3.0.9, 3.8
>
> Attachments: node3_jstack.log
>
>
> Hi,
> since the upgrade to C* 3.0.7 I see compaction tasks getting stuck when 
> truncating the column family. I verified this on all nodes of the cluster.
> Pending compactions seem to disappear after restarting the node.
> {noformat}
> root@node10:~# nodetool -h localhost compactionstats
> pending tasks: 6
>  id   compaction type  
> keyspacetable   completed  totalunit   progress
>24e1ad30-3cac-11e6-870d-5de740693258Compaction  
> schema  table_1   0   57558382   bytes  0.00%
>2be2e3b0-3cac-11e6-870d-5de740693258Compaction  
> schema  table_2   0   65063705   bytes  0.00%
>54de38f0-3cac-11e6-870d-5de740693258Compaction  
> schema  table_3   0 187031   bytes  0.00%
>31926ce0-3cac-11e6-870d-5de740693258Compaction  
> schema  table_4   0   42951119   bytes  0.00%
>3911ad00-3cac-11e6-870d-5de740693258Compaction  
> schema  table_5   0   25918949   bytes  0.00%
>3e6a8ab0-3cac-11e6-870d-5de740693258Compaction  
> schema  table_6   0   65466210   bytes  0.00%
> Active compaction remaining time :   0h00m15s
> {noformat}



--
This message was sent by Atlassian JIRA
(v6.3.15#6346)


[jira] [Updated] (CASSANDRA-13108) Uncaught exeption stack traces not logged

2017-02-22 Thread Tyler Hobbs (JIRA)

 [ 
https://issues.apache.org/jira/browse/CASSANDRA-13108?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
 ]

Tyler Hobbs updated CASSANDRA-13108:

   Resolution: Fixed
Fix Version/s: 3.11.0
   3.0.12
   2.2.10
   2.1.18
   Status: Resolved  (was: Testing)

Test results look good, so I've committed this to 2.1 as 
{{3c2f87610de0f11071f3d5c005c1d14c06c832f8}} and merged up to 2.2, 3.0, 3.11, 
and trunk.  Thanks for the patch!

> Uncaught exeption stack traces not logged
> -
>
> Key: CASSANDRA-13108
> URL: https://issues.apache.org/jira/browse/CASSANDRA-13108
> Project: Cassandra
>  Issue Type: Bug
>  Components: Core
>Reporter: Christopher Batey
>Assignee: Christopher Batey
>Priority: Trivial
> Fix For: 2.1.18, 2.2.10, 3.0.12, 3.11.0
>
>
> In a refactoring to parameterized logging we lost the stack traces of 
> uncaught exceptions. This means, apart from the thread, I have no idea where 
> they come from e.g.
> {code}
> ERROR [OptionalTasks:1] 2017-01-06 12:53:14,204 CassandraDaemon.java:231 - 
> Exception in thread Thread[OptionalTasks:1,5,main]
> java.lang.NullPointerException: null
> {code}



--
This message was sent by Atlassian JIRA
(v6.3.15#6346)


[jira] [Commented] (CASSANDRA-12014) IndexSummary > 2G causes an assertion error

2017-02-22 Thread Stefania (JIRA)

[ 
https://issues.apache.org/jira/browse/CASSANDRA-12014?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15878612#comment-15878612
 ] 

Stefania commented on CASSANDRA-12014:
--

[~jjirsa] I think this fell off the radar for both of us. Are you still OK 
being the reviewer? 

I strongly suggest we consider this [simplified 
patch|https://github.com/apache/cassandra/compare/cassandra-3.0...stef1927:12014-simplified-3.0]
 for 3.0, and possibly for 3.11 and trunk as well. I don't think the size of 
the original patch is justified just to remove this assertion. The simplified 
patch is basically what you suggested initially, using a configurable default 
key size. Instead of failing with an assertion, it will log an error and use an 
incomplete index summary. WDYT?

> IndexSummary > 2G causes an assertion error
> ---
>
> Key: CASSANDRA-12014
> URL: https://issues.apache.org/jira/browse/CASSANDRA-12014
> Project: Cassandra
>  Issue Type: Bug
>  Components: Core
>Reporter: Brandon Williams
>Assignee: Stefania
>Priority: Minor
> Fix For: 3.0.x, 3.11.x
>
>
> {noformat}
> ERROR [CompactionExecutor:1546280] 2016-06-01 13:21:00,444  
> CassandraDaemon.java:229 - Exception in thread 
> Thread[CompactionExecutor:1546280,1,main]
> java.lang.AssertionError: null
> at 
> org.apache.cassandra.io.sstable.IndexSummaryBuilder.maybeAddEntry(IndexSummaryBuilder.java:171)
>  ~[cassandra-all-2.1.12.1046.jar:2.1.12.1046]
> at 
> org.apache.cassandra.io.sstable.SSTableWriter$IndexWriter.append(SSTableWriter.java:634)
>  ~[cassandra-all-2.1.12.1046.jar:2.1.12.1046]
> at 
> org.apache.cassandra.io.sstable.SSTableWriter.afterAppend(SSTableWriter.java:179)
>  ~[cassandra-all-2.1.12.1046.jar:2.1.12.1046]
> at 
> org.apache.cassandra.io.sstable.SSTableWriter.append(SSTableWriter.java:205) 
> ~[cassandra-all-2.1.12.1046.jar:2.1.12.1046]
> at 
> org.apache.cassandra.io.sstable.SSTableRewriter.append(SSTableRewriter.java:126)
>  ~[cassandra-all-2.1.12.1046.jar:2.1.12.1046]
> at 
> org.apache.cassandra.db.compaction.CompactionTask.runMayThrow(CompactionTask.java:197)
>  ~[cassandra-all-2.1.12.1046.jar:2.1.12.1046]
> at 
> org.apache.cassandra.utils.WrappedRunnable.run(WrappedRunnable.java:28) 
> ~[cassandra-all-2.1.12.1046.jar:2.1.12.1046]
> at 
> org.apache.cassandra.db.compaction.CompactionTask.executeInternal(CompactionTask.java:73)
>  ~[cassandra-all-2.1.12.1046.jar:2.1.12.1046]
> at 
> org.apache.cassandra.db.compaction.AbstractCompactionTask.execute(AbstractCompactionTask.java:59)
>  ~[cassandra-all-2.1.12.1046.jar:2.1.12.1046]
> at 
> org.apache.cassandra.db.compaction.CompactionManager$BackgroundCompactionCandidate.run(CompactionManager.java:263)
>  ~[cassandra-all-2.1.12.1046.jar:2.1.12.1046]
> at 
> java.util.concurrent.Executors$RunnableAdapter.call(Executors.java:471) 
> ~[na:1.7.0_51]
> at java.util.concurrent.FutureTask.run(FutureTask.java:262) ~[na:1.7.0_51]
> at 
> java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1145)
>  ~[na:1.7.0_51]
> at 
> java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:615)
>  [na:1.7.0_51]
> at java.lang.Thread.run(Thread.java:744) [na:1.7.0_51]
> {noformat}
> I believe this can be fixed by raising the min_index_interval, but we should 
> have a better method of coping with this than throwing the AE.



--
This message was sent by Atlassian JIRA
(v6.3.15#6346)


[jira] [Updated] (CASSANDRA-13251) testall failure in org.apache.cassandra.dht.SplitterTest.randomSplitTestVNodesRandomPartitioner-compression

2017-02-22 Thread Sean McCarthy (JIRA)

 [ 
https://issues.apache.org/jira/browse/CASSANDRA-13251?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
 ]

Sean McCarthy updated CASSANDRA-13251:
--
Attachment: (was: TEST-org.apache.cassandra.dht.SplitterTest.log)

> testall failure in 
> org.apache.cassandra.dht.SplitterTest.randomSplitTestVNodesRandomPartitioner-compression
> ---
>
> Key: CASSANDRA-13251
> URL: https://issues.apache.org/jira/browse/CASSANDRA-13251
> Project: Cassandra
>  Issue Type: Bug
>Reporter: Sean McCarthy
>  Labels: test-failure, testall
> Attachments: TEST-org.apache.cassandra.dht.SplitterTest.log
>
>
> example failure:
> http://cassci.datastax.com/job/cassandra-3.11_testall/90/testReport/org.apache.cassandra.dht/SplitterTest/randomSplitTestVNodesRandomPartitioner_compression
> {code}
> Error Message
> Could not split 178 tokens with rf=2 into 5 parts 
> (localRanges=[(66983521362719266944456123083914511,85081278311930091024145847217249230],
>  (94621693294701866050131421626890369,155147924265201495106534043294393024], 
> (176538082184963300389348242162332035,305792111240343398238253450510339347], 
> (479458943131028805264977024868840564,744055653641599802914615283831492936], 
> (810589196372603073528089393161162866,831830538079653220048616862854206345], 
> (884694272972916497279600499364771720,917906129467813841720691087209229564], 
> (1190363158655498033200868362034857246,1343415933811428449688964742003709272],
>  
> (1636900237997891740636664883920747008,1753727385092156556836442591826435605],
>  
> (180124568401227495084977300291690,2528306899457406839219749257884865888],
>  
> (3150748204757995073614524576195208894,3224051670062256982022834977572896550],
>  
> (3585487947480198191351503755389672465,3634878371349827945309870445650281331],
>  
> (4030308375544369097920949957235793513,4370371117561995384766231663965756140],
>  
> (4535438169759213265090259029630802611,4689892560927039402953380743426486504],
>  
> (5287584146396015010572576411692276009,5406097111560335434282124987847604722],
>  
> (5474798573838792524085531666932132221,5783795445729041321850197497423607389],
>  
> (6483611830704416452149527075977393509,6554490532209812368334712015857832723],
>  
> (6769198671784117930281531448533862551,7068461798659361674887545682057269261],
>  
> (7321459781750457301852692823388183099,7448750723236904943507403940589890738],
>  
> (781742922765805774811726757866324,8469396585535281921975026967786880428],
>  
> (8756410520771255293393363154194997341,9286890681506309947906334839397894960],
>  
> (9289984562785308211551139473388367716,9321331828840441710600306717915048457],
>  
> (9469995775135107062094287100974323625,9470382363792511770098226296871216798],
>  
> (9631257428510732421512152732314666805,9641321600658666064769257433185081866],
>  
> (9702013322927550302527720051522091997,9780241872626230893279083352467815255],
>  
> (9879007640770428646298110236321423212,10182152036393621386537695331787643362],
>  
> (10360080166939453903119417544860436452,10603429529189820773994857334773625709],
>  
> (10692207402833482716776821297019768717,10838535107339145180497727737635889074],
>  
> (10860619443975305618726435337827820858,1114057559685360156937465840697571],
>  
> (11322875792646115624211851961004524304,11825112425833682786791532461593039643],
>  
> (12048513781140312188464187583088896317,12687919191650223582005439448687058175],
>  
> (12861816251305671464581304548879554150,12979292108191268111303901479436955430],
>  
> (13687075371975202983118946011266083299,13897613765528967198086671762344986499],
>  
> (13937446982894296731415008433912855071,14177085493396759172022529428284337497],
>  
> (14299014790401822915039688229331410744,14466298269240910614250610688198779566],
>  
> (14536342682029939793576617476528003691,14768357171390498288534602234783042815],
>  
> (14988099981250705818356170858242038058,15599412989878329362948087921887339668],
>  
> (15968468146419818468325000987016256626,16079182076390109538477997836412212011],
>  
> (16428466130201894182631991195294399068,17088413021649633531826439581836418129],
>  
> (17341287068644540915001525583405079818,17535942875297112645807432133857786812],
>  
> (18060989480816468648803710515232301420,18133373395482491286896814704489031702],
>  
> (18986353754623042416570994098920335302,19014892241623475840049677638441566177],
>  
> (19310575071842346465137910020595975021,19452801992936812168339988259445068315],
>  
> (19697153648980116903028606506675484549,19925997818291151917322736489810605468],
>  
> (19975410273801635978423827243772366001,1388998629507009063561500619627753],
>  
> (20019551596158054497149280446907913505,20031426394853251559839477096283033016],
>  
> 

[jira] [Updated] (CASSANDRA-13251) testall failure in org.apache.cassandra.dht.SplitterTest.randomSplitTestVNodesRandomPartitioner-compression

2017-02-22 Thread Sean McCarthy (JIRA)

 [ 
https://issues.apache.org/jira/browse/CASSANDRA-13251?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
 ]

Sean McCarthy updated CASSANDRA-13251:
--
Attachment: TEST-org.apache.cassandra.dht.SplitterTest.log

> testall failure in 
> org.apache.cassandra.dht.SplitterTest.randomSplitTestVNodesRandomPartitioner-compression
> ---
>
> Key: CASSANDRA-13251
> URL: https://issues.apache.org/jira/browse/CASSANDRA-13251
> Project: Cassandra
>  Issue Type: Bug
>Reporter: Sean McCarthy
>  Labels: test-failure, testall
> Attachments: TEST-org.apache.cassandra.dht.SplitterTest.log
>
>
> example failure:
> http://cassci.datastax.com/job/cassandra-3.11_testall/90/testReport/org.apache.cassandra.dht/SplitterTest/randomSplitTestVNodesRandomPartitioner_compression
> {code}
> Error Message
> Could not split 178 tokens with rf=2 into 5 parts 
> (localRanges=[(66983521362719266944456123083914511,85081278311930091024145847217249230],
>  (94621693294701866050131421626890369,155147924265201495106534043294393024], 
> (176538082184963300389348242162332035,305792111240343398238253450510339347], 
> (479458943131028805264977024868840564,744055653641599802914615283831492936], 
> (810589196372603073528089393161162866,831830538079653220048616862854206345], 
> (884694272972916497279600499364771720,917906129467813841720691087209229564], 
> (1190363158655498033200868362034857246,1343415933811428449688964742003709272],
>  
> (1636900237997891740636664883920747008,1753727385092156556836442591826435605],
>  
> (180124568401227495084977300291690,2528306899457406839219749257884865888],
>  
> (3150748204757995073614524576195208894,3224051670062256982022834977572896550],
>  
> (3585487947480198191351503755389672465,3634878371349827945309870445650281331],
>  
> (4030308375544369097920949957235793513,4370371117561995384766231663965756140],
>  
> (4535438169759213265090259029630802611,4689892560927039402953380743426486504],
>  
> (5287584146396015010572576411692276009,5406097111560335434282124987847604722],
>  
> (5474798573838792524085531666932132221,5783795445729041321850197497423607389],
>  
> (6483611830704416452149527075977393509,6554490532209812368334712015857832723],
>  
> (6769198671784117930281531448533862551,7068461798659361674887545682057269261],
>  
> (7321459781750457301852692823388183099,7448750723236904943507403940589890738],
>  
> (781742922765805774811726757866324,8469396585535281921975026967786880428],
>  
> (8756410520771255293393363154194997341,9286890681506309947906334839397894960],
>  
> (9289984562785308211551139473388367716,9321331828840441710600306717915048457],
>  
> (9469995775135107062094287100974323625,9470382363792511770098226296871216798],
>  
> (9631257428510732421512152732314666805,9641321600658666064769257433185081866],
>  
> (9702013322927550302527720051522091997,9780241872626230893279083352467815255],
>  
> (9879007640770428646298110236321423212,10182152036393621386537695331787643362],
>  
> (10360080166939453903119417544860436452,10603429529189820773994857334773625709],
>  
> (10692207402833482716776821297019768717,10838535107339145180497727737635889074],
>  
> (10860619443975305618726435337827820858,1114057559685360156937465840697571],
>  
> (11322875792646115624211851961004524304,11825112425833682786791532461593039643],
>  
> (12048513781140312188464187583088896317,12687919191650223582005439448687058175],
>  
> (12861816251305671464581304548879554150,12979292108191268111303901479436955430],
>  
> (13687075371975202983118946011266083299,13897613765528967198086671762344986499],
>  
> (13937446982894296731415008433912855071,14177085493396759172022529428284337497],
>  
> (14299014790401822915039688229331410744,14466298269240910614250610688198779566],
>  
> (14536342682029939793576617476528003691,14768357171390498288534602234783042815],
>  
> (14988099981250705818356170858242038058,15599412989878329362948087921887339668],
>  
> (15968468146419818468325000987016256626,16079182076390109538477997836412212011],
>  
> (16428466130201894182631991195294399068,17088413021649633531826439581836418129],
>  
> (17341287068644540915001525583405079818,17535942875297112645807432133857786812],
>  
> (18060989480816468648803710515232301420,18133373395482491286896814704489031702],
>  
> (18986353754623042416570994098920335302,19014892241623475840049677638441566177],
>  
> (19310575071842346465137910020595975021,19452801992936812168339988259445068315],
>  
> (19697153648980116903028606506675484549,19925997818291151917322736489810605468],
>  
> (19975410273801635978423827243772366001,1388998629507009063561500619627753],
>  
> (20019551596158054497149280446907913505,20031426394853251559839477096283033016],
>  
> 

[jira] [Created] (CASSANDRA-13251) testall failure in org.apache.cassandra.dht.SplitterTest.randomSplitTestVNodesRandomPartitioner-compression

2017-02-22 Thread Sean McCarthy (JIRA)
Sean McCarthy created CASSANDRA-13251:
-

 Summary: testall failure in 
org.apache.cassandra.dht.SplitterTest.randomSplitTestVNodesRandomPartitioner-compression
 Key: CASSANDRA-13251
 URL: https://issues.apache.org/jira/browse/CASSANDRA-13251
 Project: Cassandra
  Issue Type: Bug
Reporter: Sean McCarthy
 Attachments: TEST-org.apache.cassandra.dht.SplitterTest.log

example failure:

http://cassci.datastax.com/job/cassandra-3.11_testall/90/testReport/org.apache.cassandra.dht/SplitterTest/randomSplitTestVNodesRandomPartitioner_compression

{code}
Error Message

Could not split 178 tokens with rf=2 into 5 parts 
(localRanges=[(66983521362719266944456123083914511,85081278311930091024145847217249230],
 (94621693294701866050131421626890369,155147924265201495106534043294393024], 
(176538082184963300389348242162332035,305792111240343398238253450510339347], 
(479458943131028805264977024868840564,744055653641599802914615283831492936], 
(810589196372603073528089393161162866,831830538079653220048616862854206345], 
(884694272972916497279600499364771720,917906129467813841720691087209229564], 
(1190363158655498033200868362034857246,1343415933811428449688964742003709272], 
(1636900237997891740636664883920747008,1753727385092156556836442591826435605], 
(180124568401227495084977300291690,2528306899457406839219749257884865888], 
(3150748204757995073614524576195208894,3224051670062256982022834977572896550], 
(3585487947480198191351503755389672465,3634878371349827945309870445650281331], 
(4030308375544369097920949957235793513,4370371117561995384766231663965756140], 
(4535438169759213265090259029630802611,4689892560927039402953380743426486504], 
(5287584146396015010572576411692276009,5406097111560335434282124987847604722], 
(5474798573838792524085531666932132221,5783795445729041321850197497423607389], 
(6483611830704416452149527075977393509,6554490532209812368334712015857832723], 
(6769198671784117930281531448533862551,7068461798659361674887545682057269261], 
(7321459781750457301852692823388183099,7448750723236904943507403940589890738], 
(781742922765805774811726757866324,8469396585535281921975026967786880428], 
(8756410520771255293393363154194997341,9286890681506309947906334839397894960], 
(9289984562785308211551139473388367716,9321331828840441710600306717915048457], 
(9469995775135107062094287100974323625,9470382363792511770098226296871216798], 
(9631257428510732421512152732314666805,9641321600658666064769257433185081866], 
(9702013322927550302527720051522091997,9780241872626230893279083352467815255], 
(9879007640770428646298110236321423212,10182152036393621386537695331787643362], 
(10360080166939453903119417544860436452,10603429529189820773994857334773625709],
 
(10692207402833482716776821297019768717,10838535107339145180497727737635889074],
 
(10860619443975305618726435337827820858,1114057559685360156937465840697571],
 
(11322875792646115624211851961004524304,11825112425833682786791532461593039643],
 
(12048513781140312188464187583088896317,12687919191650223582005439448687058175],
 
(12861816251305671464581304548879554150,12979292108191268111303901479436955430],
 
(13687075371975202983118946011266083299,13897613765528967198086671762344986499],
 
(13937446982894296731415008433912855071,14177085493396759172022529428284337497],
 
(14299014790401822915039688229331410744,14466298269240910614250610688198779566],
 
(14536342682029939793576617476528003691,14768357171390498288534602234783042815],
 
(14988099981250705818356170858242038058,15599412989878329362948087921887339668],
 
(15968468146419818468325000987016256626,16079182076390109538477997836412212011],
 
(16428466130201894182631991195294399068,17088413021649633531826439581836418129],
 
(17341287068644540915001525583405079818,17535942875297112645807432133857786812],
 
(18060989480816468648803710515232301420,18133373395482491286896814704489031702],
 
(18986353754623042416570994098920335302,19014892241623475840049677638441566177],
 
(19310575071842346465137910020595975021,19452801992936812168339988259445068315],
 
(19697153648980116903028606506675484549,19925997818291151917322736489810605468],
 
(19975410273801635978423827243772366001,1388998629507009063561500619627753],
 
(20019551596158054497149280446907913505,20031426394853251559839477096283033016],
 
(20042928005578446353619224689233952750,20709229215708373444658402043130604313],
 
(20807519682898467334697474710658157995,20878056513834014155538987563666300139],
 
(21177405253241740605794357941163362166,21275307699959651181796890901605596653],
 
(22230192076577388356994820944093325329,22259659695005334289079475161839628068],
 
(22664816072921532556924226918506806780,22781436143918766865717004851052201970],
 
(23072342823915036068412558241730394309,23200299246843595255565661791994165636],
 
(23669810065267215337637628536126199294,24586362069770321177591427324083278232],
 

[07/15] cassandra git commit: Merge branch 'cassandra-2.1' into cassandra-2.2

2017-02-22 Thread tylerhobbs
Merge branch 'cassandra-2.1' into cassandra-2.2


Project: http://git-wip-us.apache.org/repos/asf/cassandra/repo
Commit: http://git-wip-us.apache.org/repos/asf/cassandra/commit/15e71baf
Tree: http://git-wip-us.apache.org/repos/asf/cassandra/tree/15e71baf
Diff: http://git-wip-us.apache.org/repos/asf/cassandra/diff/15e71baf

Branch: refs/heads/cassandra-2.2
Commit: 15e71baf05f03eeb07aeb3b6dcc547eacf4ee932
Parents: 7841908 3c2f876
Author: Tyler Hobbs 
Authored: Wed Feb 22 10:09:40 2017 -0600
Committer: Tyler Hobbs 
Committed: Wed Feb 22 10:09:40 2017 -0600

--
 CHANGES.txt| 2 ++
 src/java/org/apache/cassandra/service/CassandraDaemon.java | 4 ++--
 2 files changed, 4 insertions(+), 2 deletions(-)
--


http://git-wip-us.apache.org/repos/asf/cassandra/blob/15e71baf/CHANGES.txt
--
diff --cc CHANGES.txt
index 78f55f6,f3de538..91c11fa
--- a/CHANGES.txt
+++ b/CHANGES.txt
@@@ -1,40 -1,7 +1,42 @@@
 -2.1.18
 +2.2.10
 + * Fix ColumnCounter::countAll behaviour for reverse queries (CASSANDRA-13222)
 + * Exceptions encountered calling getSeeds() breaks OTC thread 
(CASSANDRA-13018)
++Merged from 2.1:
+  * Log stacktrace of uncaught exceptions (CASSANDRA-13108)
  
 -2.1.17
 +2.2.9
 + * Coalescing strategy sleeps too much (CASSANDRA-13090)
 + * Fix negative mean latency metric (CASSANDRA-12876)
 + * Use only one file pointer when creating commitlog segments 
(CASSANDRA-12539)
 + * Fix speculative retry bugs (CASSANDRA-13009)
 + * Fix handling of nulls and unsets in IN conditions (CASSANDRA-12981) 
 + * Remove support for non-JavaScript UDFs (CASSANDRA-12883)
 + * Fix DynamicEndpointSnitch noop in multi-datacenter situations 
(CASSANDRA-13074)
 + * cqlsh copy-from: encode column names to avoid primary key parsing errors 
(CASSANDRA-12909)
 + * Temporarily fix bug that creates commit log when running offline tools 
(CASSANDRA-8616)
 + * Reduce granuality of OpOrder.Group during index build (CASSANDRA-12796)
 + * Test bind parameters and unset parameters in InsertUpdateIfConditionTest 
(CASSANDRA-12980)
 + * Do not specify local address on outgoing connection when 
listen_on_broadcast_address is set (CASSANDRA-12673)
 + * Use saved tokens when setting local tokens on StorageService.joinRing 
(CASSANDRA-12935)
 + * cqlsh: fix DESC TYPES errors (CASSANDRA-12914)
 + * Fix leak on skipped SSTables in sstableupgrade (CASSANDRA-12899)
 + * Avoid blocking gossip during pending range calculation (CASSANDRA-12281)
 + * Fix purgeability of tombstones with max timestamp (CASSANDRA-12792)
 + * Fail repair if participant dies during sync or anticompaction 
(CASSANDRA-12901)
 + * cqlsh COPY: unprotected pk values before converting them if not using 
prepared statements (CASSANDRA-12863)
 + * Fix Util.spinAssertEquals (CASSANDRA-12283)
 + * Fix potential NPE for compactionstats (CASSANDRA-12462)
 + * Prepare legacy authenticate statement if credentials table initialised 
after node startup (CASSANDRA-12813)
 + * Change cassandra.wait_for_tracing_events_timeout_secs default to 0 
(CASSANDRA-12754)
 + * Clean up permissions when a UDA is dropped (CASSANDRA-12720)
 + * Limit colUpdateTimeDelta histogram updates to reasonable deltas 
(CASSANDRA-7)
 + * Fix leak errors and execution rejected exceptions when draining 
(CASSANDRA-12457)
 + * Fix merkle tree depth calculation (CASSANDRA-12580)
 + * Make Collections deserialization more robust (CASSANDRA-12618)
 + * Better handle invalid system roles table (CASSANDRA-12700)
 + * Split consistent range movement flag correction (CASSANDRA-12786)
 + * CompactionTasks now correctly drops sstables out of compaction when not 
enough disk space is available (CASSANDRA-12979)
 +Merged from 2.1:
   * Use portable stderr for java error in startup (CASSANDRA-13211)
   * Fix Thread Leak in OutboundTcpConnection (CASSANDRA-13204)
   * Coalescing strategy can enter infinite loop (CASSANDRA-13159)

http://git-wip-us.apache.org/repos/asf/cassandra/blob/15e71baf/src/java/org/apache/cassandra/service/CassandraDaemon.java
--



[04/15] cassandra git commit: Log full stack trace of uncaught exceptions

2017-02-22 Thread tylerhobbs
Log full stack trace of uncaught exceptions

Patch by Chris Batey; reviewed by Tyler Hobbs for CASSANDRA-13108


Project: http://git-wip-us.apache.org/repos/asf/cassandra/repo
Commit: http://git-wip-us.apache.org/repos/asf/cassandra/commit/3c2f8761
Tree: http://git-wip-us.apache.org/repos/asf/cassandra/tree/3c2f8761
Diff: http://git-wip-us.apache.org/repos/asf/cassandra/diff/3c2f8761

Branch: refs/heads/cassandra-3.0
Commit: 3c2f87610de0f11071f3d5c005c1d14c06c832f8
Parents: de1f24d
Author: Chris Batey 
Authored: Wed Feb 22 10:08:22 2017 -0600
Committer: Tyler Hobbs 
Committed: Wed Feb 22 10:08:22 2017 -0600

--
 CHANGES.txt| 2 +-
 src/java/org/apache/cassandra/service/CassandraDaemon.java | 4 ++--
 2 files changed, 3 insertions(+), 3 deletions(-)
--


http://git-wip-us.apache.org/repos/asf/cassandra/blob/3c2f8761/CHANGES.txt
--
diff --git a/CHANGES.txt b/CHANGES.txt
index 2266771..f3de538 100644
--- a/CHANGES.txt
+++ b/CHANGES.txt
@@ -1,5 +1,5 @@
 2.1.18
- * 
+ * Log stacktrace of uncaught exceptions (CASSANDRA-13108)
 
 2.1.17
  * Use portable stderr for java error in startup (CASSANDRA-13211)

http://git-wip-us.apache.org/repos/asf/cassandra/blob/3c2f8761/src/java/org/apache/cassandra/service/CassandraDaemon.java
--
diff --git a/src/java/org/apache/cassandra/service/CassandraDaemon.java 
b/src/java/org/apache/cassandra/service/CassandraDaemon.java
index 5a1fb14..dc22834 100644
--- a/src/java/org/apache/cassandra/service/CassandraDaemon.java
+++ b/src/java/org/apache/cassandra/service/CassandraDaemon.java
@@ -228,7 +228,7 @@ public class CassandraDaemon
 public void uncaughtException(Thread t, Throwable e)
 {
 StorageMetrics.exceptions.inc();
-logger.error("Exception in thread {}", t, e);
+logger.error("Exception in thread " + t, e);
 Tracing.trace("Exception in thread {}", t, e);
 for (Throwable e2 = e; e2 != null; e2 = e2.getCause())
 {
@@ -237,7 +237,7 @@ public class CassandraDaemon
 if (e2 instanceof FSError)
 {
 if (e2 != e) // make sure FSError gets logged exactly 
once.
-logger.error("Exception in thread {}", t, e2);
+logger.error("Exception in thread " + t, e2);
 FileUtils.handleFSError((FSError) e2);
 }
 



[02/15] cassandra git commit: Log full stack trace of uncaught exceptions

2017-02-22 Thread tylerhobbs
Log full stack trace of uncaught exceptions

Patch by Chris Batey; reviewed by Tyler Hobbs for CASSANDRA-13108


Project: http://git-wip-us.apache.org/repos/asf/cassandra/repo
Commit: http://git-wip-us.apache.org/repos/asf/cassandra/commit/3c2f8761
Tree: http://git-wip-us.apache.org/repos/asf/cassandra/tree/3c2f8761
Diff: http://git-wip-us.apache.org/repos/asf/cassandra/diff/3c2f8761

Branch: refs/heads/cassandra-2.2
Commit: 3c2f87610de0f11071f3d5c005c1d14c06c832f8
Parents: de1f24d
Author: Chris Batey 
Authored: Wed Feb 22 10:08:22 2017 -0600
Committer: Tyler Hobbs 
Committed: Wed Feb 22 10:08:22 2017 -0600

--
 CHANGES.txt| 2 +-
 src/java/org/apache/cassandra/service/CassandraDaemon.java | 4 ++--
 2 files changed, 3 insertions(+), 3 deletions(-)
--


http://git-wip-us.apache.org/repos/asf/cassandra/blob/3c2f8761/CHANGES.txt
--
diff --git a/CHANGES.txt b/CHANGES.txt
index 2266771..f3de538 100644
--- a/CHANGES.txt
+++ b/CHANGES.txt
@@ -1,5 +1,5 @@
 2.1.18
- * 
+ * Log stacktrace of uncaught exceptions (CASSANDRA-13108)
 
 2.1.17
  * Use portable stderr for java error in startup (CASSANDRA-13211)

http://git-wip-us.apache.org/repos/asf/cassandra/blob/3c2f8761/src/java/org/apache/cassandra/service/CassandraDaemon.java
--
diff --git a/src/java/org/apache/cassandra/service/CassandraDaemon.java 
b/src/java/org/apache/cassandra/service/CassandraDaemon.java
index 5a1fb14..dc22834 100644
--- a/src/java/org/apache/cassandra/service/CassandraDaemon.java
+++ b/src/java/org/apache/cassandra/service/CassandraDaemon.java
@@ -228,7 +228,7 @@ public class CassandraDaemon
 public void uncaughtException(Thread t, Throwable e)
 {
 StorageMetrics.exceptions.inc();
-logger.error("Exception in thread {}", t, e);
+logger.error("Exception in thread " + t, e);
 Tracing.trace("Exception in thread {}", t, e);
 for (Throwable e2 = e; e2 != null; e2 = e2.getCause())
 {
@@ -237,7 +237,7 @@ public class CassandraDaemon
 if (e2 instanceof FSError)
 {
 if (e2 != e) // make sure FSError gets logged exactly 
once.
-logger.error("Exception in thread {}", t, e2);
+logger.error("Exception in thread " + t, e2);
 FileUtils.handleFSError((FSError) e2);
 }
 



[13/15] cassandra git commit: Merge branch 'cassandra-3.0' into cassandra-3.11

2017-02-22 Thread tylerhobbs
Merge branch 'cassandra-3.0' into cassandra-3.11


Project: http://git-wip-us.apache.org/repos/asf/cassandra/repo
Commit: http://git-wip-us.apache.org/repos/asf/cassandra/commit/b0ed0f4c
Tree: http://git-wip-us.apache.org/repos/asf/cassandra/tree/b0ed0f4c
Diff: http://git-wip-us.apache.org/repos/asf/cassandra/diff/b0ed0f4c

Branch: refs/heads/cassandra-3.11
Commit: b0ed0f4c3e595cb425dc36760e325724a6f6c467
Parents: 10524bd f70d8c0
Author: Tyler Hobbs 
Authored: Wed Feb 22 10:11:09 2017 -0600
Committer: Tyler Hobbs 
Committed: Wed Feb 22 10:11:09 2017 -0600

--
 CHANGES.txt| 1 +
 src/java/org/apache/cassandra/service/CassandraDaemon.java | 4 ++--
 2 files changed, 3 insertions(+), 2 deletions(-)
--


http://git-wip-us.apache.org/repos/asf/cassandra/blob/b0ed0f4c/CHANGES.txt
--
diff --cc CHANGES.txt
index fd758dc,a4bb9cd..6dd4edb
--- a/CHANGES.txt
+++ b/CHANGES.txt
@@@ -20,133 -21,6 +20,134 @@@ Merged from 3.0
 live rows in sstabledump (CASSANDRA-13177)
   * Provide user workaround when system_schema.columns does not contain entries
 for a table that's in system_schema.tables (CASSANDRA-13180)
 +Merged from 2.2:
 + * Fix ColumnCounter::countAll behaviour for reverse queries (CASSANDRA-13222)
 + * Exceptions encountered calling getSeeds() breaks OTC thread 
(CASSANDRA-13018)
 + * Fix negative mean latency metric (CASSANDRA-12876)
 + * Use only one file pointer when creating commitlog segments 
(CASSANDRA-12539)
 +Merged from 2.1:
++ * Log stacktrace of uncaught exceptions (CASSANDRA-13108)
 + * Use portable stderr for java error in startup (CASSANDRA-13211)
 + * Fix Thread Leak in OutboundTcpConnection (CASSANDRA-13204)
 + * Coalescing strategy can enter infinite loop (CASSANDRA-13159)
 +
 +3.10
 + * Fix secondary index queries regression (CASSANDRA-13013)
 + * Add duration type to the protocol V5 (CASSANDRA-12850)
 + * Fix duration type validation (CASSANDRA-13143)
 + * Fix flaky GcCompactionTest (CASSANDRA-12664)
 + * Fix TestHintedHandoff.hintedhandoff_decom_test (CASSANDRA-13058)
 + * Fixed query monitoring for range queries (CASSANDRA-13050)
 + * Remove outboundBindAny configuration property (CASSANDRA-12673)
 + * Use correct bounds for all-data range when filtering (CASSANDRA-12666)
 + * Remove timing window in test case (CASSANDRA-12875)
 + * Resolve unit testing without JCE security libraries installed 
(CASSANDRA-12945)
 + * Fix inconsistencies in cassandra-stress load balancing policy 
(CASSANDRA-12919)
 + * Fix validation of non-frozen UDT cells (CASSANDRA-12916)
 + * Don't shut down socket input/output on StreamSession (CASSANDRA-12903)
 + * Fix Murmur3PartitionerTest (CASSANDRA-12858)
 + * Move cqlsh syntax rules into separate module and allow easier 
customization (CASSANDRA-12897)
 + * Fix CommitLogSegmentManagerTest (CASSANDRA-12283)
 + * Fix cassandra-stress truncate option (CASSANDRA-12695)
 + * Fix crossNode value when receiving messages (CASSANDRA-12791)
 + * Don't load MX4J beans twice (CASSANDRA-12869)
 + * Extend native protocol request flags, add versions to SUPPORTED, and 
introduce ProtocolVersion enum (CASSANDRA-12838)
 + * Set JOINING mode when running pre-join tasks (CASSANDRA-12836)
 + * remove net.mintern.primitive library due to license issue (CASSANDRA-12845)
 + * Properly format IPv6 addresses when logging JMX service URL 
(CASSANDRA-12454)
 + * Optimize the vnode allocation for single replica per DC (CASSANDRA-12777)
 + * Use non-token restrictions for bounds when token restrictions are 
overridden (CASSANDRA-12419)
 + * Fix CQLSH auto completion for PER PARTITION LIMIT (CASSANDRA-12803)
 + * Use different build directories for Eclipse and Ant (CASSANDRA-12466)
 + * Avoid potential AttributeError in cqlsh due to no table metadata 
(CASSANDRA-12815)
 + * Fix RandomReplicationAwareTokenAllocatorTest.testExistingCluster 
(CASSANDRA-12812)
 + * Upgrade commons-codec to 1.9 (CASSANDRA-12790)
 + * Make the fanout size for LeveledCompactionStrategy to be configurable 
(CASSANDRA-11550)
 + * Add duration data type (CASSANDRA-11873)
 + * Fix timeout in ReplicationAwareTokenAllocatorTest (CASSANDRA-12784)
 + * Improve sum aggregate functions (CASSANDRA-12417)
 + * Make cassandra.yaml docs for batch_size_*_threshold_in_kb reflect changes 
in CASSANDRA-10876 (CASSANDRA-12761)
 + * cqlsh fails to format collections when using aliases (CASSANDRA-11534)
 + * Check for hash conflicts in prepared statements (CASSANDRA-12733)
 + * Exit query parsing upon first error (CASSANDRA-12598)
 + * Fix cassandra-stress to use single seed in UUID generation 
(CASSANDRA-12729)
 + * CQLSSTableWriter does not allow Update statement (CASSANDRA-12450)
 + * Config class uses boxed types but DD exposes 

[12/15] cassandra git commit: Merge branch 'cassandra-2.2' into cassandra-3.0

2017-02-22 Thread tylerhobbs
Merge branch 'cassandra-2.2' into cassandra-3.0


Project: http://git-wip-us.apache.org/repos/asf/cassandra/repo
Commit: http://git-wip-us.apache.org/repos/asf/cassandra/commit/f70d8c06
Tree: http://git-wip-us.apache.org/repos/asf/cassandra/tree/f70d8c06
Diff: http://git-wip-us.apache.org/repos/asf/cassandra/diff/f70d8c06

Branch: refs/heads/cassandra-3.0
Commit: f70d8c06c052b5e65e4f6f843d29d39970082408
Parents: f0502aa 15e71ba
Author: Tyler Hobbs 
Authored: Wed Feb 22 10:09:48 2017 -0600
Committer: Tyler Hobbs 
Committed: Wed Feb 22 10:09:48 2017 -0600

--
 CHANGES.txt| 2 ++
 src/java/org/apache/cassandra/service/CassandraDaemon.java | 4 ++--
 2 files changed, 4 insertions(+), 2 deletions(-)
--


http://git-wip-us.apache.org/repos/asf/cassandra/blob/f70d8c06/CHANGES.txt
--
diff --cc CHANGES.txt
index 91a6b31,91c11fa..a4bb9cd
--- a/CHANGES.txt
+++ b/CHANGES.txt
@@@ -1,51 -1,10 +1,53 @@@
 -2.2.10
 +3.0.12
 + * Fix cqlsh COPY for dates before 1900 (CASSANDRA-13185)
 +
 +Merged from 2.2
   * Fix ColumnCounter::countAll behaviour for reverse queries (CASSANDRA-13222)
   * Exceptions encountered calling getSeeds() breaks OTC thread 
(CASSANDRA-13018)
+ Merged from 2.1:
+  * Log stacktrace of uncaught exceptions (CASSANDRA-13108)
  
 -2.2.9
 +3.0.11
 + * Use keyspace replication settings on system.size_estimates table 
(CASSANDRA-9639)
 + * Add vm.max_map_count StartupCheck (CASSANDRA-13008)
 + * Hint related logging should include the IP address of the destination in 
addition to 
 +   host ID (CASSANDRA-13205)
 + * Reloading logback.xml does not work (CASSANDRA-13173)
 + * Lightweight transactions temporarily fail after upgrade from 2.1 to 3.0 
(CASSANDRA-13109)
 + * Duplicate rows after upgrading from 2.1.16 to 3.0.10/3.9 (CASSANDRA-13125)
 + * Fix UPDATE queries with empty IN restrictions (CASSANDRA-13152)
 + * Abort or retry on failed hints delivery (CASSANDRA-13124)
 + * Fix handling of partition with partition-level deletion plus
 +   live rows in sstabledump (CASSANDRA-13177)
 + * Provide user workaround when system_schema.columns does not contain entries
 +   for a table that's in system_schema.tables (CASSANDRA-13180)
 + * Dump threads when unit tests time out (CASSANDRA-13117)
 + * Better error when modifying function permissions without explicit keyspace 
(CASSANDRA-12925)
 + * Indexer is not correctly invoked when building indexes over sstables 
(CASSANDRA-13075)
 + * Read repair is not blocking repair to finish in foreground repair 
(CASSANDRA-13115)
 + * Stress daemon help is incorrect (CASSANDRA-12563)
 + * Remove ALTER TYPE support (CASSANDRA-12443)
 + * Fix assertion for certain legacy range tombstone pattern (CASSANDRA-12203)
 + * Set javac encoding to utf-8 (CASSANDRA-11077)
 + * Replace empty strings with null values if they cannot be converted 
(CASSANDRA-12794)
 + * Fixed flacky SSTableRewriterTest: check file counts before calling 
validateCFS (CASSANDRA-12348)
 + * Fix deserialization of 2.x DeletedCells (CASSANDRA-12620)
 + * Add parent repair session id to anticompaction log message 
(CASSANDRA-12186)
 + * Improve contention handling on failure to acquire MV lock for streaming 
and hints (CASSANDRA-12905)
 + * Fix DELETE and UPDATE queries with empty IN restrictions (CASSANDRA-12829)
 + * Mark MVs as built after successful bootstrap (CASSANDRA-12984)
 + * Estimated TS drop-time histogram updated with Cell.NO_DELETION_TIME 
(CASSANDRA-13040)
 + * Nodetool compactionstats fails with NullPointerException (CASSANDRA-13021)
 + * Thread local pools never cleaned up (CASSANDRA-13033)
 + * Set RPC_READY to false when draining or if a node is marked as shutdown 
(CASSANDRA-12781)
 + * Make sure sstables only get committed when it's safe to discard commit log 
records (CASSANDRA-12956)
 + * Reject default_time_to_live option when creating or altering MVs 
(CASSANDRA-12868)
 + * Nodetool should use a more sane max heap size (CASSANDRA-12739)
 + * LocalToken ensures token values are cloned on heap (CASSANDRA-12651)
 + * AnticompactionRequestSerializer serializedSize is incorrect 
(CASSANDRA-12934)
 + * Prevent reloading of logback.xml from UDF sandbox (CASSANDRA-12535)
 + * Reenable HeapPool (CASSANDRA-12900)
 +Merged from 2.2:
   * Coalescing strategy sleeps too much (CASSANDRA-13090)
   * Fix negative mean latency metric (CASSANDRA-12876)
   * Use only one file pointer when creating commitlog segments 
(CASSANDRA-12539)

http://git-wip-us.apache.org/repos/asf/cassandra/blob/f70d8c06/src/java/org/apache/cassandra/service/CassandraDaemon.java
--



[10/15] cassandra git commit: Merge branch 'cassandra-2.2' into cassandra-3.0

2017-02-22 Thread tylerhobbs
Merge branch 'cassandra-2.2' into cassandra-3.0


Project: http://git-wip-us.apache.org/repos/asf/cassandra/repo
Commit: http://git-wip-us.apache.org/repos/asf/cassandra/commit/f70d8c06
Tree: http://git-wip-us.apache.org/repos/asf/cassandra/tree/f70d8c06
Diff: http://git-wip-us.apache.org/repos/asf/cassandra/diff/f70d8c06

Branch: refs/heads/trunk
Commit: f70d8c06c052b5e65e4f6f843d29d39970082408
Parents: f0502aa 15e71ba
Author: Tyler Hobbs 
Authored: Wed Feb 22 10:09:48 2017 -0600
Committer: Tyler Hobbs 
Committed: Wed Feb 22 10:09:48 2017 -0600

--
 CHANGES.txt| 2 ++
 src/java/org/apache/cassandra/service/CassandraDaemon.java | 4 ++--
 2 files changed, 4 insertions(+), 2 deletions(-)
--


http://git-wip-us.apache.org/repos/asf/cassandra/blob/f70d8c06/CHANGES.txt
--
diff --cc CHANGES.txt
index 91a6b31,91c11fa..a4bb9cd
--- a/CHANGES.txt
+++ b/CHANGES.txt
@@@ -1,51 -1,10 +1,53 @@@
 -2.2.10
 +3.0.12
 + * Fix cqlsh COPY for dates before 1900 (CASSANDRA-13185)
 +
 +Merged from 2.2
   * Fix ColumnCounter::countAll behaviour for reverse queries (CASSANDRA-13222)
   * Exceptions encountered calling getSeeds() breaks OTC thread 
(CASSANDRA-13018)
+ Merged from 2.1:
+  * Log stacktrace of uncaught exceptions (CASSANDRA-13108)
  
 -2.2.9
 +3.0.11
 + * Use keyspace replication settings on system.size_estimates table 
(CASSANDRA-9639)
 + * Add vm.max_map_count StartupCheck (CASSANDRA-13008)
 + * Hint related logging should include the IP address of the destination in 
addition to 
 +   host ID (CASSANDRA-13205)
 + * Reloading logback.xml does not work (CASSANDRA-13173)
 + * Lightweight transactions temporarily fail after upgrade from 2.1 to 3.0 
(CASSANDRA-13109)
 + * Duplicate rows after upgrading from 2.1.16 to 3.0.10/3.9 (CASSANDRA-13125)
 + * Fix UPDATE queries with empty IN restrictions (CASSANDRA-13152)
 + * Abort or retry on failed hints delivery (CASSANDRA-13124)
 + * Fix handling of partition with partition-level deletion plus
 +   live rows in sstabledump (CASSANDRA-13177)
 + * Provide user workaround when system_schema.columns does not contain entries
 +   for a table that's in system_schema.tables (CASSANDRA-13180)
 + * Dump threads when unit tests time out (CASSANDRA-13117)
 + * Better error when modifying function permissions without explicit keyspace 
(CASSANDRA-12925)
 + * Indexer is not correctly invoked when building indexes over sstables 
(CASSANDRA-13075)
 + * Read repair is not blocking repair to finish in foreground repair 
(CASSANDRA-13115)
 + * Stress daemon help is incorrect (CASSANDRA-12563)
 + * Remove ALTER TYPE support (CASSANDRA-12443)
 + * Fix assertion for certain legacy range tombstone pattern (CASSANDRA-12203)
 + * Set javac encoding to utf-8 (CASSANDRA-11077)
 + * Replace empty strings with null values if they cannot be converted 
(CASSANDRA-12794)
 + * Fixed flacky SSTableRewriterTest: check file counts before calling 
validateCFS (CASSANDRA-12348)
 + * Fix deserialization of 2.x DeletedCells (CASSANDRA-12620)
 + * Add parent repair session id to anticompaction log message 
(CASSANDRA-12186)
 + * Improve contention handling on failure to acquire MV lock for streaming 
and hints (CASSANDRA-12905)
 + * Fix DELETE and UPDATE queries with empty IN restrictions (CASSANDRA-12829)
 + * Mark MVs as built after successful bootstrap (CASSANDRA-12984)
 + * Estimated TS drop-time histogram updated with Cell.NO_DELETION_TIME 
(CASSANDRA-13040)
 + * Nodetool compactionstats fails with NullPointerException (CASSANDRA-13021)
 + * Thread local pools never cleaned up (CASSANDRA-13033)
 + * Set RPC_READY to false when draining or if a node is marked as shutdown 
(CASSANDRA-12781)
 + * Make sure sstables only get committed when it's safe to discard commit log 
records (CASSANDRA-12956)
 + * Reject default_time_to_live option when creating or altering MVs 
(CASSANDRA-12868)
 + * Nodetool should use a more sane max heap size (CASSANDRA-12739)
 + * LocalToken ensures token values are cloned on heap (CASSANDRA-12651)
 + * AnticompactionRequestSerializer serializedSize is incorrect 
(CASSANDRA-12934)
 + * Prevent reloading of logback.xml from UDF sandbox (CASSANDRA-12535)
 + * Reenable HeapPool (CASSANDRA-12900)
 +Merged from 2.2:
   * Coalescing strategy sleeps too much (CASSANDRA-13090)
   * Fix negative mean latency metric (CASSANDRA-12876)
   * Use only one file pointer when creating commitlog segments 
(CASSANDRA-12539)

http://git-wip-us.apache.org/repos/asf/cassandra/blob/f70d8c06/src/java/org/apache/cassandra/service/CassandraDaemon.java
--



[11/15] cassandra git commit: Merge branch 'cassandra-2.2' into cassandra-3.0

2017-02-22 Thread tylerhobbs
Merge branch 'cassandra-2.2' into cassandra-3.0


Project: http://git-wip-us.apache.org/repos/asf/cassandra/repo
Commit: http://git-wip-us.apache.org/repos/asf/cassandra/commit/f70d8c06
Tree: http://git-wip-us.apache.org/repos/asf/cassandra/tree/f70d8c06
Diff: http://git-wip-us.apache.org/repos/asf/cassandra/diff/f70d8c06

Branch: refs/heads/cassandra-3.11
Commit: f70d8c06c052b5e65e4f6f843d29d39970082408
Parents: f0502aa 15e71ba
Author: Tyler Hobbs 
Authored: Wed Feb 22 10:09:48 2017 -0600
Committer: Tyler Hobbs 
Committed: Wed Feb 22 10:09:48 2017 -0600

--
 CHANGES.txt| 2 ++
 src/java/org/apache/cassandra/service/CassandraDaemon.java | 4 ++--
 2 files changed, 4 insertions(+), 2 deletions(-)
--


http://git-wip-us.apache.org/repos/asf/cassandra/blob/f70d8c06/CHANGES.txt
--
diff --cc CHANGES.txt
index 91a6b31,91c11fa..a4bb9cd
--- a/CHANGES.txt
+++ b/CHANGES.txt
@@@ -1,51 -1,10 +1,53 @@@
 -2.2.10
 +3.0.12
 + * Fix cqlsh COPY for dates before 1900 (CASSANDRA-13185)
 +
 +Merged from 2.2
   * Fix ColumnCounter::countAll behaviour for reverse queries (CASSANDRA-13222)
   * Exceptions encountered calling getSeeds() breaks OTC thread 
(CASSANDRA-13018)
+ Merged from 2.1:
+  * Log stacktrace of uncaught exceptions (CASSANDRA-13108)
  
 -2.2.9
 +3.0.11
 + * Use keyspace replication settings on system.size_estimates table 
(CASSANDRA-9639)
 + * Add vm.max_map_count StartupCheck (CASSANDRA-13008)
 + * Hint related logging should include the IP address of the destination in 
addition to 
 +   host ID (CASSANDRA-13205)
 + * Reloading logback.xml does not work (CASSANDRA-13173)
 + * Lightweight transactions temporarily fail after upgrade from 2.1 to 3.0 
(CASSANDRA-13109)
 + * Duplicate rows after upgrading from 2.1.16 to 3.0.10/3.9 (CASSANDRA-13125)
 + * Fix UPDATE queries with empty IN restrictions (CASSANDRA-13152)
 + * Abort or retry on failed hints delivery (CASSANDRA-13124)
 + * Fix handling of partition with partition-level deletion plus
 +   live rows in sstabledump (CASSANDRA-13177)
 + * Provide user workaround when system_schema.columns does not contain entries
 +   for a table that's in system_schema.tables (CASSANDRA-13180)
 + * Dump threads when unit tests time out (CASSANDRA-13117)
 + * Better error when modifying function permissions without explicit keyspace 
(CASSANDRA-12925)
 + * Indexer is not correctly invoked when building indexes over sstables 
(CASSANDRA-13075)
 + * Read repair is not blocking repair to finish in foreground repair 
(CASSANDRA-13115)
 + * Stress daemon help is incorrect (CASSANDRA-12563)
 + * Remove ALTER TYPE support (CASSANDRA-12443)
 + * Fix assertion for certain legacy range tombstone pattern (CASSANDRA-12203)
 + * Set javac encoding to utf-8 (CASSANDRA-11077)
 + * Replace empty strings with null values if they cannot be converted 
(CASSANDRA-12794)
 + * Fixed flacky SSTableRewriterTest: check file counts before calling 
validateCFS (CASSANDRA-12348)
 + * Fix deserialization of 2.x DeletedCells (CASSANDRA-12620)
 + * Add parent repair session id to anticompaction log message 
(CASSANDRA-12186)
 + * Improve contention handling on failure to acquire MV lock for streaming 
and hints (CASSANDRA-12905)
 + * Fix DELETE and UPDATE queries with empty IN restrictions (CASSANDRA-12829)
 + * Mark MVs as built after successful bootstrap (CASSANDRA-12984)
 + * Estimated TS drop-time histogram updated with Cell.NO_DELETION_TIME 
(CASSANDRA-13040)
 + * Nodetool compactionstats fails with NullPointerException (CASSANDRA-13021)
 + * Thread local pools never cleaned up (CASSANDRA-13033)
 + * Set RPC_READY to false when draining or if a node is marked as shutdown 
(CASSANDRA-12781)
 + * Make sure sstables only get committed when it's safe to discard commit log 
records (CASSANDRA-12956)
 + * Reject default_time_to_live option when creating or altering MVs 
(CASSANDRA-12868)
 + * Nodetool should use a more sane max heap size (CASSANDRA-12739)
 + * LocalToken ensures token values are cloned on heap (CASSANDRA-12651)
 + * AnticompactionRequestSerializer serializedSize is incorrect 
(CASSANDRA-12934)
 + * Prevent reloading of logback.xml from UDF sandbox (CASSANDRA-12535)
 + * Reenable HeapPool (CASSANDRA-12900)
 +Merged from 2.2:
   * Coalescing strategy sleeps too much (CASSANDRA-13090)
   * Fix negative mean latency metric (CASSANDRA-12876)
   * Use only one file pointer when creating commitlog segments 
(CASSANDRA-12539)

http://git-wip-us.apache.org/repos/asf/cassandra/blob/f70d8c06/src/java/org/apache/cassandra/service/CassandraDaemon.java
--



[09/15] cassandra git commit: Merge branch 'cassandra-2.1' into cassandra-2.2

2017-02-22 Thread tylerhobbs
Merge branch 'cassandra-2.1' into cassandra-2.2


Project: http://git-wip-us.apache.org/repos/asf/cassandra/repo
Commit: http://git-wip-us.apache.org/repos/asf/cassandra/commit/15e71baf
Tree: http://git-wip-us.apache.org/repos/asf/cassandra/tree/15e71baf
Diff: http://git-wip-us.apache.org/repos/asf/cassandra/diff/15e71baf

Branch: refs/heads/cassandra-3.11
Commit: 15e71baf05f03eeb07aeb3b6dcc547eacf4ee932
Parents: 7841908 3c2f876
Author: Tyler Hobbs 
Authored: Wed Feb 22 10:09:40 2017 -0600
Committer: Tyler Hobbs 
Committed: Wed Feb 22 10:09:40 2017 -0600

--
 CHANGES.txt| 2 ++
 src/java/org/apache/cassandra/service/CassandraDaemon.java | 4 ++--
 2 files changed, 4 insertions(+), 2 deletions(-)
--


http://git-wip-us.apache.org/repos/asf/cassandra/blob/15e71baf/CHANGES.txt
--
diff --cc CHANGES.txt
index 78f55f6,f3de538..91c11fa
--- a/CHANGES.txt
+++ b/CHANGES.txt
@@@ -1,40 -1,7 +1,42 @@@
 -2.1.18
 +2.2.10
 + * Fix ColumnCounter::countAll behaviour for reverse queries (CASSANDRA-13222)
 + * Exceptions encountered calling getSeeds() breaks OTC thread 
(CASSANDRA-13018)
++Merged from 2.1:
+  * Log stacktrace of uncaught exceptions (CASSANDRA-13108)
  
 -2.1.17
 +2.2.9
 + * Coalescing strategy sleeps too much (CASSANDRA-13090)
 + * Fix negative mean latency metric (CASSANDRA-12876)
 + * Use only one file pointer when creating commitlog segments 
(CASSANDRA-12539)
 + * Fix speculative retry bugs (CASSANDRA-13009)
 + * Fix handling of nulls and unsets in IN conditions (CASSANDRA-12981) 
 + * Remove support for non-JavaScript UDFs (CASSANDRA-12883)
 + * Fix DynamicEndpointSnitch noop in multi-datacenter situations 
(CASSANDRA-13074)
 + * cqlsh copy-from: encode column names to avoid primary key parsing errors 
(CASSANDRA-12909)
 + * Temporarily fix bug that creates commit log when running offline tools 
(CASSANDRA-8616)
 + * Reduce granuality of OpOrder.Group during index build (CASSANDRA-12796)
 + * Test bind parameters and unset parameters in InsertUpdateIfConditionTest 
(CASSANDRA-12980)
 + * Do not specify local address on outgoing connection when 
listen_on_broadcast_address is set (CASSANDRA-12673)
 + * Use saved tokens when setting local tokens on StorageService.joinRing 
(CASSANDRA-12935)
 + * cqlsh: fix DESC TYPES errors (CASSANDRA-12914)
 + * Fix leak on skipped SSTables in sstableupgrade (CASSANDRA-12899)
 + * Avoid blocking gossip during pending range calculation (CASSANDRA-12281)
 + * Fix purgeability of tombstones with max timestamp (CASSANDRA-12792)
 + * Fail repair if participant dies during sync or anticompaction 
(CASSANDRA-12901)
 + * cqlsh COPY: unprotected pk values before converting them if not using 
prepared statements (CASSANDRA-12863)
 + * Fix Util.spinAssertEquals (CASSANDRA-12283)
 + * Fix potential NPE for compactionstats (CASSANDRA-12462)
 + * Prepare legacy authenticate statement if credentials table initialised 
after node startup (CASSANDRA-12813)
 + * Change cassandra.wait_for_tracing_events_timeout_secs default to 0 
(CASSANDRA-12754)
 + * Clean up permissions when a UDA is dropped (CASSANDRA-12720)
 + * Limit colUpdateTimeDelta histogram updates to reasonable deltas 
(CASSANDRA-7)
 + * Fix leak errors and execution rejected exceptions when draining 
(CASSANDRA-12457)
 + * Fix merkle tree depth calculation (CASSANDRA-12580)
 + * Make Collections deserialization more robust (CASSANDRA-12618)
 + * Better handle invalid system roles table (CASSANDRA-12700)
 + * Split consistent range movement flag correction (CASSANDRA-12786)
 + * CompactionTasks now correctly drops sstables out of compaction when not 
enough disk space is available (CASSANDRA-12979)
 +Merged from 2.1:
   * Use portable stderr for java error in startup (CASSANDRA-13211)
   * Fix Thread Leak in OutboundTcpConnection (CASSANDRA-13204)
   * Coalescing strategy can enter infinite loop (CASSANDRA-13159)

http://git-wip-us.apache.org/repos/asf/cassandra/blob/15e71baf/src/java/org/apache/cassandra/service/CassandraDaemon.java
--



[08/15] cassandra git commit: Merge branch 'cassandra-2.1' into cassandra-2.2

2017-02-22 Thread tylerhobbs
Merge branch 'cassandra-2.1' into cassandra-2.2


Project: http://git-wip-us.apache.org/repos/asf/cassandra/repo
Commit: http://git-wip-us.apache.org/repos/asf/cassandra/commit/15e71baf
Tree: http://git-wip-us.apache.org/repos/asf/cassandra/tree/15e71baf
Diff: http://git-wip-us.apache.org/repos/asf/cassandra/diff/15e71baf

Branch: refs/heads/cassandra-3.0
Commit: 15e71baf05f03eeb07aeb3b6dcc547eacf4ee932
Parents: 7841908 3c2f876
Author: Tyler Hobbs 
Authored: Wed Feb 22 10:09:40 2017 -0600
Committer: Tyler Hobbs 
Committed: Wed Feb 22 10:09:40 2017 -0600

--
 CHANGES.txt| 2 ++
 src/java/org/apache/cassandra/service/CassandraDaemon.java | 4 ++--
 2 files changed, 4 insertions(+), 2 deletions(-)
--


http://git-wip-us.apache.org/repos/asf/cassandra/blob/15e71baf/CHANGES.txt
--
diff --cc CHANGES.txt
index 78f55f6,f3de538..91c11fa
--- a/CHANGES.txt
+++ b/CHANGES.txt
@@@ -1,40 -1,7 +1,42 @@@
 -2.1.18
 +2.2.10
 + * Fix ColumnCounter::countAll behaviour for reverse queries (CASSANDRA-13222)
 + * Exceptions encountered calling getSeeds() breaks OTC thread 
(CASSANDRA-13018)
++Merged from 2.1:
+  * Log stacktrace of uncaught exceptions (CASSANDRA-13108)
  
 -2.1.17
 +2.2.9
 + * Coalescing strategy sleeps too much (CASSANDRA-13090)
 + * Fix negative mean latency metric (CASSANDRA-12876)
 + * Use only one file pointer when creating commitlog segments 
(CASSANDRA-12539)
 + * Fix speculative retry bugs (CASSANDRA-13009)
 + * Fix handling of nulls and unsets in IN conditions (CASSANDRA-12981) 
 + * Remove support for non-JavaScript UDFs (CASSANDRA-12883)
 + * Fix DynamicEndpointSnitch noop in multi-datacenter situations 
(CASSANDRA-13074)
 + * cqlsh copy-from: encode column names to avoid primary key parsing errors 
(CASSANDRA-12909)
 + * Temporarily fix bug that creates commit log when running offline tools 
(CASSANDRA-8616)
 + * Reduce granuality of OpOrder.Group during index build (CASSANDRA-12796)
 + * Test bind parameters and unset parameters in InsertUpdateIfConditionTest 
(CASSANDRA-12980)
 + * Do not specify local address on outgoing connection when 
listen_on_broadcast_address is set (CASSANDRA-12673)
 + * Use saved tokens when setting local tokens on StorageService.joinRing 
(CASSANDRA-12935)
 + * cqlsh: fix DESC TYPES errors (CASSANDRA-12914)
 + * Fix leak on skipped SSTables in sstableupgrade (CASSANDRA-12899)
 + * Avoid blocking gossip during pending range calculation (CASSANDRA-12281)
 + * Fix purgeability of tombstones with max timestamp (CASSANDRA-12792)
 + * Fail repair if participant dies during sync or anticompaction 
(CASSANDRA-12901)
 + * cqlsh COPY: unprotected pk values before converting them if not using 
prepared statements (CASSANDRA-12863)
 + * Fix Util.spinAssertEquals (CASSANDRA-12283)
 + * Fix potential NPE for compactionstats (CASSANDRA-12462)
 + * Prepare legacy authenticate statement if credentials table initialised 
after node startup (CASSANDRA-12813)
 + * Change cassandra.wait_for_tracing_events_timeout_secs default to 0 
(CASSANDRA-12754)
 + * Clean up permissions when a UDA is dropped (CASSANDRA-12720)
 + * Limit colUpdateTimeDelta histogram updates to reasonable deltas 
(CASSANDRA-7)
 + * Fix leak errors and execution rejected exceptions when draining 
(CASSANDRA-12457)
 + * Fix merkle tree depth calculation (CASSANDRA-12580)
 + * Make Collections deserialization more robust (CASSANDRA-12618)
 + * Better handle invalid system roles table (CASSANDRA-12700)
 + * Split consistent range movement flag correction (CASSANDRA-12786)
 + * CompactionTasks now correctly drops sstables out of compaction when not 
enough disk space is available (CASSANDRA-12979)
 +Merged from 2.1:
   * Use portable stderr for java error in startup (CASSANDRA-13211)
   * Fix Thread Leak in OutboundTcpConnection (CASSANDRA-13204)
   * Coalescing strategy can enter infinite loop (CASSANDRA-13159)

http://git-wip-us.apache.org/repos/asf/cassandra/blob/15e71baf/src/java/org/apache/cassandra/service/CassandraDaemon.java
--



[15/15] cassandra git commit: Merge branch 'cassandra-3.11' into trunk

2017-02-22 Thread tylerhobbs
Merge branch 'cassandra-3.11' into trunk


Project: http://git-wip-us.apache.org/repos/asf/cassandra/repo
Commit: http://git-wip-us.apache.org/repos/asf/cassandra/commit/77eec6df
Tree: http://git-wip-us.apache.org/repos/asf/cassandra/tree/77eec6df
Diff: http://git-wip-us.apache.org/repos/asf/cassandra/diff/77eec6df

Branch: refs/heads/trunk
Commit: 77eec6dfd4e68ca8a591b72544a1eb4bfa02decf
Parents: 95bcaef b0ed0f4
Author: Tyler Hobbs 
Authored: Wed Feb 22 10:11:16 2017 -0600
Committer: Tyler Hobbs 
Committed: Wed Feb 22 10:11:16 2017 -0600

--
 CHANGES.txt| 1 +
 src/java/org/apache/cassandra/service/CassandraDaemon.java | 4 ++--
 2 files changed, 3 insertions(+), 2 deletions(-)
--


http://git-wip-us.apache.org/repos/asf/cassandra/blob/77eec6df/CHANGES.txt
--
diff --cc CHANGES.txt
index b4eaf63,6dd4edb..58e9e78
--- a/CHANGES.txt
+++ b/CHANGES.txt
@@@ -63,12 -26,11 +63,13 @@@ Merged from 2.2
   * Fix negative mean latency metric (CASSANDRA-12876)
   * Use only one file pointer when creating commitlog segments 
(CASSANDRA-12539)
  Merged from 2.1:
+  * Log stacktrace of uncaught exceptions (CASSANDRA-13108)
   * Use portable stderr for java error in startup (CASSANDRA-13211)
   * Fix Thread Leak in OutboundTcpConnection (CASSANDRA-13204)
 + * Upgrade netty version to fix memory leak with client encryption 
(CASSANDRA-13114)
   * Coalescing strategy can enter infinite loop (CASSANDRA-13159)
  
 +
  3.10
   * Fix secondary index queries regression (CASSANDRA-13013)
   * Add duration type to the protocol V5 (CASSANDRA-12850)

http://git-wip-us.apache.org/repos/asf/cassandra/blob/77eec6df/src/java/org/apache/cassandra/service/CassandraDaemon.java
--



[06/15] cassandra git commit: Merge branch 'cassandra-2.1' into cassandra-2.2

2017-02-22 Thread tylerhobbs
Merge branch 'cassandra-2.1' into cassandra-2.2


Project: http://git-wip-us.apache.org/repos/asf/cassandra/repo
Commit: http://git-wip-us.apache.org/repos/asf/cassandra/commit/15e71baf
Tree: http://git-wip-us.apache.org/repos/asf/cassandra/tree/15e71baf
Diff: http://git-wip-us.apache.org/repos/asf/cassandra/diff/15e71baf

Branch: refs/heads/trunk
Commit: 15e71baf05f03eeb07aeb3b6dcc547eacf4ee932
Parents: 7841908 3c2f876
Author: Tyler Hobbs 
Authored: Wed Feb 22 10:09:40 2017 -0600
Committer: Tyler Hobbs 
Committed: Wed Feb 22 10:09:40 2017 -0600

--
 CHANGES.txt| 2 ++
 src/java/org/apache/cassandra/service/CassandraDaemon.java | 4 ++--
 2 files changed, 4 insertions(+), 2 deletions(-)
--


http://git-wip-us.apache.org/repos/asf/cassandra/blob/15e71baf/CHANGES.txt
--
diff --cc CHANGES.txt
index 78f55f6,f3de538..91c11fa
--- a/CHANGES.txt
+++ b/CHANGES.txt
@@@ -1,40 -1,7 +1,42 @@@
 -2.1.18
 +2.2.10
 + * Fix ColumnCounter::countAll behaviour for reverse queries (CASSANDRA-13222)
 + * Exceptions encountered calling getSeeds() breaks OTC thread 
(CASSANDRA-13018)
++Merged from 2.1:
+  * Log stacktrace of uncaught exceptions (CASSANDRA-13108)
  
 -2.1.17
 +2.2.9
 + * Coalescing strategy sleeps too much (CASSANDRA-13090)
 + * Fix negative mean latency metric (CASSANDRA-12876)
 + * Use only one file pointer when creating commitlog segments 
(CASSANDRA-12539)
 + * Fix speculative retry bugs (CASSANDRA-13009)
 + * Fix handling of nulls and unsets in IN conditions (CASSANDRA-12981) 
 + * Remove support for non-JavaScript UDFs (CASSANDRA-12883)
 + * Fix DynamicEndpointSnitch noop in multi-datacenter situations 
(CASSANDRA-13074)
 + * cqlsh copy-from: encode column names to avoid primary key parsing errors 
(CASSANDRA-12909)
 + * Temporarily fix bug that creates commit log when running offline tools 
(CASSANDRA-8616)
 + * Reduce granuality of OpOrder.Group during index build (CASSANDRA-12796)
 + * Test bind parameters and unset parameters in InsertUpdateIfConditionTest 
(CASSANDRA-12980)
 + * Do not specify local address on outgoing connection when 
listen_on_broadcast_address is set (CASSANDRA-12673)
 + * Use saved tokens when setting local tokens on StorageService.joinRing 
(CASSANDRA-12935)
 + * cqlsh: fix DESC TYPES errors (CASSANDRA-12914)
 + * Fix leak on skipped SSTables in sstableupgrade (CASSANDRA-12899)
 + * Avoid blocking gossip during pending range calculation (CASSANDRA-12281)
 + * Fix purgeability of tombstones with max timestamp (CASSANDRA-12792)
 + * Fail repair if participant dies during sync or anticompaction 
(CASSANDRA-12901)
 + * cqlsh COPY: unprotected pk values before converting them if not using 
prepared statements (CASSANDRA-12863)
 + * Fix Util.spinAssertEquals (CASSANDRA-12283)
 + * Fix potential NPE for compactionstats (CASSANDRA-12462)
 + * Prepare legacy authenticate statement if credentials table initialised 
after node startup (CASSANDRA-12813)
 + * Change cassandra.wait_for_tracing_events_timeout_secs default to 0 
(CASSANDRA-12754)
 + * Clean up permissions when a UDA is dropped (CASSANDRA-12720)
 + * Limit colUpdateTimeDelta histogram updates to reasonable deltas 
(CASSANDRA-7)
 + * Fix leak errors and execution rejected exceptions when draining 
(CASSANDRA-12457)
 + * Fix merkle tree depth calculation (CASSANDRA-12580)
 + * Make Collections deserialization more robust (CASSANDRA-12618)
 + * Better handle invalid system roles table (CASSANDRA-12700)
 + * Split consistent range movement flag correction (CASSANDRA-12786)
 + * CompactionTasks now correctly drops sstables out of compaction when not 
enough disk space is available (CASSANDRA-12979)
 +Merged from 2.1:
   * Use portable stderr for java error in startup (CASSANDRA-13211)
   * Fix Thread Leak in OutboundTcpConnection (CASSANDRA-13204)
   * Coalescing strategy can enter infinite loop (CASSANDRA-13159)

http://git-wip-us.apache.org/repos/asf/cassandra/blob/15e71baf/src/java/org/apache/cassandra/service/CassandraDaemon.java
--



[14/15] cassandra git commit: Merge branch 'cassandra-3.0' into cassandra-3.11

2017-02-22 Thread tylerhobbs
Merge branch 'cassandra-3.0' into cassandra-3.11


Project: http://git-wip-us.apache.org/repos/asf/cassandra/repo
Commit: http://git-wip-us.apache.org/repos/asf/cassandra/commit/b0ed0f4c
Tree: http://git-wip-us.apache.org/repos/asf/cassandra/tree/b0ed0f4c
Diff: http://git-wip-us.apache.org/repos/asf/cassandra/diff/b0ed0f4c

Branch: refs/heads/trunk
Commit: b0ed0f4c3e595cb425dc36760e325724a6f6c467
Parents: 10524bd f70d8c0
Author: Tyler Hobbs 
Authored: Wed Feb 22 10:11:09 2017 -0600
Committer: Tyler Hobbs 
Committed: Wed Feb 22 10:11:09 2017 -0600

--
 CHANGES.txt| 1 +
 src/java/org/apache/cassandra/service/CassandraDaemon.java | 4 ++--
 2 files changed, 3 insertions(+), 2 deletions(-)
--


http://git-wip-us.apache.org/repos/asf/cassandra/blob/b0ed0f4c/CHANGES.txt
--
diff --cc CHANGES.txt
index fd758dc,a4bb9cd..6dd4edb
--- a/CHANGES.txt
+++ b/CHANGES.txt
@@@ -20,133 -21,6 +20,134 @@@ Merged from 3.0
 live rows in sstabledump (CASSANDRA-13177)
   * Provide user workaround when system_schema.columns does not contain entries
 for a table that's in system_schema.tables (CASSANDRA-13180)
 +Merged from 2.2:
 + * Fix ColumnCounter::countAll behaviour for reverse queries (CASSANDRA-13222)
 + * Exceptions encountered calling getSeeds() breaks OTC thread 
(CASSANDRA-13018)
 + * Fix negative mean latency metric (CASSANDRA-12876)
 + * Use only one file pointer when creating commitlog segments 
(CASSANDRA-12539)
 +Merged from 2.1:
++ * Log stacktrace of uncaught exceptions (CASSANDRA-13108)
 + * Use portable stderr for java error in startup (CASSANDRA-13211)
 + * Fix Thread Leak in OutboundTcpConnection (CASSANDRA-13204)
 + * Coalescing strategy can enter infinite loop (CASSANDRA-13159)
 +
 +3.10
 + * Fix secondary index queries regression (CASSANDRA-13013)
 + * Add duration type to the protocol V5 (CASSANDRA-12850)
 + * Fix duration type validation (CASSANDRA-13143)
 + * Fix flaky GcCompactionTest (CASSANDRA-12664)
 + * Fix TestHintedHandoff.hintedhandoff_decom_test (CASSANDRA-13058)
 + * Fixed query monitoring for range queries (CASSANDRA-13050)
 + * Remove outboundBindAny configuration property (CASSANDRA-12673)
 + * Use correct bounds for all-data range when filtering (CASSANDRA-12666)
 + * Remove timing window in test case (CASSANDRA-12875)
 + * Resolve unit testing without JCE security libraries installed 
(CASSANDRA-12945)
 + * Fix inconsistencies in cassandra-stress load balancing policy 
(CASSANDRA-12919)
 + * Fix validation of non-frozen UDT cells (CASSANDRA-12916)
 + * Don't shut down socket input/output on StreamSession (CASSANDRA-12903)
 + * Fix Murmur3PartitionerTest (CASSANDRA-12858)
 + * Move cqlsh syntax rules into separate module and allow easier 
customization (CASSANDRA-12897)
 + * Fix CommitLogSegmentManagerTest (CASSANDRA-12283)
 + * Fix cassandra-stress truncate option (CASSANDRA-12695)
 + * Fix crossNode value when receiving messages (CASSANDRA-12791)
 + * Don't load MX4J beans twice (CASSANDRA-12869)
 + * Extend native protocol request flags, add versions to SUPPORTED, and 
introduce ProtocolVersion enum (CASSANDRA-12838)
 + * Set JOINING mode when running pre-join tasks (CASSANDRA-12836)
 + * remove net.mintern.primitive library due to license issue (CASSANDRA-12845)
 + * Properly format IPv6 addresses when logging JMX service URL 
(CASSANDRA-12454)
 + * Optimize the vnode allocation for single replica per DC (CASSANDRA-12777)
 + * Use non-token restrictions for bounds when token restrictions are 
overridden (CASSANDRA-12419)
 + * Fix CQLSH auto completion for PER PARTITION LIMIT (CASSANDRA-12803)
 + * Use different build directories for Eclipse and Ant (CASSANDRA-12466)
 + * Avoid potential AttributeError in cqlsh due to no table metadata 
(CASSANDRA-12815)
 + * Fix RandomReplicationAwareTokenAllocatorTest.testExistingCluster 
(CASSANDRA-12812)
 + * Upgrade commons-codec to 1.9 (CASSANDRA-12790)
 + * Make the fanout size for LeveledCompactionStrategy to be configurable 
(CASSANDRA-11550)
 + * Add duration data type (CASSANDRA-11873)
 + * Fix timeout in ReplicationAwareTokenAllocatorTest (CASSANDRA-12784)
 + * Improve sum aggregate functions (CASSANDRA-12417)
 + * Make cassandra.yaml docs for batch_size_*_threshold_in_kb reflect changes 
in CASSANDRA-10876 (CASSANDRA-12761)
 + * cqlsh fails to format collections when using aliases (CASSANDRA-11534)
 + * Check for hash conflicts in prepared statements (CASSANDRA-12733)
 + * Exit query parsing upon first error (CASSANDRA-12598)
 + * Fix cassandra-stress to use single seed in UUID generation 
(CASSANDRA-12729)
 + * CQLSSTableWriter does not allow Update statement (CASSANDRA-12450)
 + * Config class uses boxed types but DD exposes primitive types 

[05/15] cassandra git commit: Log full stack trace of uncaught exceptions

2017-02-22 Thread tylerhobbs
Log full stack trace of uncaught exceptions

Patch by Chris Batey; reviewed by Tyler Hobbs for CASSANDRA-13108


Project: http://git-wip-us.apache.org/repos/asf/cassandra/repo
Commit: http://git-wip-us.apache.org/repos/asf/cassandra/commit/3c2f8761
Tree: http://git-wip-us.apache.org/repos/asf/cassandra/tree/3c2f8761
Diff: http://git-wip-us.apache.org/repos/asf/cassandra/diff/3c2f8761

Branch: refs/heads/cassandra-3.11
Commit: 3c2f87610de0f11071f3d5c005c1d14c06c832f8
Parents: de1f24d
Author: Chris Batey 
Authored: Wed Feb 22 10:08:22 2017 -0600
Committer: Tyler Hobbs 
Committed: Wed Feb 22 10:08:22 2017 -0600

--
 CHANGES.txt| 2 +-
 src/java/org/apache/cassandra/service/CassandraDaemon.java | 4 ++--
 2 files changed, 3 insertions(+), 3 deletions(-)
--


http://git-wip-us.apache.org/repos/asf/cassandra/blob/3c2f8761/CHANGES.txt
--
diff --git a/CHANGES.txt b/CHANGES.txt
index 2266771..f3de538 100644
--- a/CHANGES.txt
+++ b/CHANGES.txt
@@ -1,5 +1,5 @@
 2.1.18
- * 
+ * Log stacktrace of uncaught exceptions (CASSANDRA-13108)
 
 2.1.17
  * Use portable stderr for java error in startup (CASSANDRA-13211)

http://git-wip-us.apache.org/repos/asf/cassandra/blob/3c2f8761/src/java/org/apache/cassandra/service/CassandraDaemon.java
--
diff --git a/src/java/org/apache/cassandra/service/CassandraDaemon.java 
b/src/java/org/apache/cassandra/service/CassandraDaemon.java
index 5a1fb14..dc22834 100644
--- a/src/java/org/apache/cassandra/service/CassandraDaemon.java
+++ b/src/java/org/apache/cassandra/service/CassandraDaemon.java
@@ -228,7 +228,7 @@ public class CassandraDaemon
 public void uncaughtException(Thread t, Throwable e)
 {
 StorageMetrics.exceptions.inc();
-logger.error("Exception in thread {}", t, e);
+logger.error("Exception in thread " + t, e);
 Tracing.trace("Exception in thread {}", t, e);
 for (Throwable e2 = e; e2 != null; e2 = e2.getCause())
 {
@@ -237,7 +237,7 @@ public class CassandraDaemon
 if (e2 instanceof FSError)
 {
 if (e2 != e) // make sure FSError gets logged exactly 
once.
-logger.error("Exception in thread {}", t, e2);
+logger.error("Exception in thread " + t, e2);
 FileUtils.handleFSError((FSError) e2);
 }
 



[03/15] cassandra git commit: Log full stack trace of uncaught exceptions

2017-02-22 Thread tylerhobbs
Log full stack trace of uncaught exceptions

Patch by Chris Batey; reviewed by Tyler Hobbs for CASSANDRA-13108


Project: http://git-wip-us.apache.org/repos/asf/cassandra/repo
Commit: http://git-wip-us.apache.org/repos/asf/cassandra/commit/3c2f8761
Tree: http://git-wip-us.apache.org/repos/asf/cassandra/tree/3c2f8761
Diff: http://git-wip-us.apache.org/repos/asf/cassandra/diff/3c2f8761

Branch: refs/heads/trunk
Commit: 3c2f87610de0f11071f3d5c005c1d14c06c832f8
Parents: de1f24d
Author: Chris Batey 
Authored: Wed Feb 22 10:08:22 2017 -0600
Committer: Tyler Hobbs 
Committed: Wed Feb 22 10:08:22 2017 -0600

--
 CHANGES.txt| 2 +-
 src/java/org/apache/cassandra/service/CassandraDaemon.java | 4 ++--
 2 files changed, 3 insertions(+), 3 deletions(-)
--


http://git-wip-us.apache.org/repos/asf/cassandra/blob/3c2f8761/CHANGES.txt
--
diff --git a/CHANGES.txt b/CHANGES.txt
index 2266771..f3de538 100644
--- a/CHANGES.txt
+++ b/CHANGES.txt
@@ -1,5 +1,5 @@
 2.1.18
- * 
+ * Log stacktrace of uncaught exceptions (CASSANDRA-13108)
 
 2.1.17
  * Use portable stderr for java error in startup (CASSANDRA-13211)

http://git-wip-us.apache.org/repos/asf/cassandra/blob/3c2f8761/src/java/org/apache/cassandra/service/CassandraDaemon.java
--
diff --git a/src/java/org/apache/cassandra/service/CassandraDaemon.java 
b/src/java/org/apache/cassandra/service/CassandraDaemon.java
index 5a1fb14..dc22834 100644
--- a/src/java/org/apache/cassandra/service/CassandraDaemon.java
+++ b/src/java/org/apache/cassandra/service/CassandraDaemon.java
@@ -228,7 +228,7 @@ public class CassandraDaemon
 public void uncaughtException(Thread t, Throwable e)
 {
 StorageMetrics.exceptions.inc();
-logger.error("Exception in thread {}", t, e);
+logger.error("Exception in thread " + t, e);
 Tracing.trace("Exception in thread {}", t, e);
 for (Throwable e2 = e; e2 != null; e2 = e2.getCause())
 {
@@ -237,7 +237,7 @@ public class CassandraDaemon
 if (e2 instanceof FSError)
 {
 if (e2 != e) // make sure FSError gets logged exactly 
once.
-logger.error("Exception in thread {}", t, e2);
+logger.error("Exception in thread " + t, e2);
 FileUtils.handleFSError((FSError) e2);
 }
 



[01/15] cassandra git commit: Log full stack trace of uncaught exceptions

2017-02-22 Thread tylerhobbs
Repository: cassandra
Updated Branches:
  refs/heads/cassandra-2.1 de1f24d70 -> 3c2f87610
  refs/heads/cassandra-2.2 7841908c3 -> 15e71baf0
  refs/heads/cassandra-3.0 f0502aa79 -> f70d8c06c
  refs/heads/cassandra-3.11 10524bda9 -> b0ed0f4c3
  refs/heads/trunk 95bcaef73 -> 77eec6dfd


Log full stack trace of uncaught exceptions

Patch by Chris Batey; reviewed by Tyler Hobbs for CASSANDRA-13108


Project: http://git-wip-us.apache.org/repos/asf/cassandra/repo
Commit: http://git-wip-us.apache.org/repos/asf/cassandra/commit/3c2f8761
Tree: http://git-wip-us.apache.org/repos/asf/cassandra/tree/3c2f8761
Diff: http://git-wip-us.apache.org/repos/asf/cassandra/diff/3c2f8761

Branch: refs/heads/cassandra-2.1
Commit: 3c2f87610de0f11071f3d5c005c1d14c06c832f8
Parents: de1f24d
Author: Chris Batey 
Authored: Wed Feb 22 10:08:22 2017 -0600
Committer: Tyler Hobbs 
Committed: Wed Feb 22 10:08:22 2017 -0600

--
 CHANGES.txt| 2 +-
 src/java/org/apache/cassandra/service/CassandraDaemon.java | 4 ++--
 2 files changed, 3 insertions(+), 3 deletions(-)
--


http://git-wip-us.apache.org/repos/asf/cassandra/blob/3c2f8761/CHANGES.txt
--
diff --git a/CHANGES.txt b/CHANGES.txt
index 2266771..f3de538 100644
--- a/CHANGES.txt
+++ b/CHANGES.txt
@@ -1,5 +1,5 @@
 2.1.18
- * 
+ * Log stacktrace of uncaught exceptions (CASSANDRA-13108)
 
 2.1.17
  * Use portable stderr for java error in startup (CASSANDRA-13211)

http://git-wip-us.apache.org/repos/asf/cassandra/blob/3c2f8761/src/java/org/apache/cassandra/service/CassandraDaemon.java
--
diff --git a/src/java/org/apache/cassandra/service/CassandraDaemon.java 
b/src/java/org/apache/cassandra/service/CassandraDaemon.java
index 5a1fb14..dc22834 100644
--- a/src/java/org/apache/cassandra/service/CassandraDaemon.java
+++ b/src/java/org/apache/cassandra/service/CassandraDaemon.java
@@ -228,7 +228,7 @@ public class CassandraDaemon
 public void uncaughtException(Thread t, Throwable e)
 {
 StorageMetrics.exceptions.inc();
-logger.error("Exception in thread {}", t, e);
+logger.error("Exception in thread " + t, e);
 Tracing.trace("Exception in thread {}", t, e);
 for (Throwable e2 = e; e2 != null; e2 = e2.getCause())
 {
@@ -237,7 +237,7 @@ public class CassandraDaemon
 if (e2 instanceof FSError)
 {
 if (e2 != e) // make sure FSError gets logged exactly 
once.
-logger.error("Exception in thread {}", t, e2);
+logger.error("Exception in thread " + t, e2);
 FileUtils.handleFSError((FSError) e2);
 }
 



[jira] [Created] (CASSANDRA-13250) dtest failure in cqlsh_tests.cqlsh_tests.TestCqlsh.test_describe

2017-02-22 Thread Sean McCarthy (JIRA)
Sean McCarthy created CASSANDRA-13250:
-

 Summary: dtest failure in 
cqlsh_tests.cqlsh_tests.TestCqlsh.test_describe
 Key: CASSANDRA-13250
 URL: https://issues.apache.org/jira/browse/CASSANDRA-13250
 Project: Cassandra
  Issue Type: Bug
  Components: Testing
Reporter: Sean McCarthy
 Attachments: node1_debug.log, node1_gc.log, node1.log

example failure:

http://cassci.datastax.com/job/trunk_offheap_dtest/430/testReport/cqlsh_tests.cqlsh_tests/TestCqlsh/test_describe

{code}
Error Message

Lists differ: ["CREATE KEYSPACE test WITH re... != ["CREATE KEYSPACE test WITH 
re...

First differing element 11:
"AND compression = {'chunk_length_in_kb': '64', 'class': 
'org.apache.cassandra.io.compress.LZ4Compressor'}"
"AND compression = {'chunk_length_in_kb': '64', 'class': 
'org.apache.cassandra.io.compress.LZ4Compressor', 'min_compress_ratio': '1.1'}"

  ["CREATE KEYSPACE test WITH replication = {'class': 'SimpleStrategy', 
'replication_factor': '1'}  AND durable_writes = true;",
   'CREATE TABLE test.test (',
   'id int,',
   'col int,',
   'val text,',
   'PRIMARY KEY (id, col)',
   ') WITH CLUSTERING ORDER BY (col ASC)',
   'AND bloom_filter_fp_chance = 0.01',
   "AND caching = {'keys': 'ALL', 'rows_per_partition': 'NONE'}",
   "AND comment = ''",
   "AND compaction = {'class': 
'org.apache.cassandra.db.compaction.SizeTieredCompactionStrategy', 
'max_threshold': '32', 'min_threshold': '4'}",
-  "AND compression = {'chunk_length_in_kb': '64', 'class': 
'org.apache.cassandra.io.compress.LZ4Compressor'}",
+  "AND compression = {'chunk_length_in_kb': '64', 'class': 
'org.apache.cassandra.io.compress.LZ4Compressor', 'min_compress_ratio': '1.1'}",
?   
+

   'AND crc_check_chance = 1.0',
   'AND dclocal_read_repair_chance = 0.1',
   'AND default_time_to_live = 0',
   'AND gc_grace_seconds = 864000',
   'AND max_index_interval = 2048',
   'AND memtable_flush_period_in_ms = 0',
   'AND min_index_interval = 128',
   'AND read_repair_chance = 0.0',
   "AND speculative_retry = '99PERCENTILE';",
   'CREATE INDEX test_val_idx ON test.test (val);',
   'CREATE INDEX test_col_idx ON test.test (col);',
   'CREATE TABLE test.users (',
   'userid text PRIMARY KEY,',
   'age int,',
   'firstname text,',
   'lastname text',
   ') WITH bloom_filter_fp_chance = 0.01',
   "AND caching = {'keys': 'ALL', 'rows_per_partition': 'NONE'}",
   "AND comment = ''",
   "AND compaction = {'class': 
'org.apache.cassandra.db.compaction.SizeTieredCompactionStrategy', 
'max_threshold': '32', 'min_threshold': '4'}",
-  "AND compression = {'chunk_length_in_kb': '64', 'class': 
'org.apache.cassandra.io.compress.LZ4Compressor'}",
+  "AND compression = {'chunk_length_in_kb': '64', 'class': 
'org.apache.cassandra.io.compress.LZ4Compressor', 'min_compress_ratio': '1.1'}",
?   
+

   'AND crc_check_chance = 1.0',
   'AND dclocal_read_repair_chance = 0.1',
   'AND default_time_to_live = 0',
   'AND gc_grace_seconds = 864000',
   'AND max_index_interval = 2048',
   'AND memtable_flush_period_in_ms = 0',
   'AND min_index_interval = 128',
   'AND read_repair_chance = 0.0',
   "AND speculative_retry = '99PERCENTILE';",
   'CREATE INDEX myindex ON test.users (age);']
{code}{code}
Stacktrace

  File "/usr/lib/python2.7/unittest/case.py", line 329, in run
testMethod()
  File "/home/automaton/cassandra-dtest/cqlsh_tests/cqlsh_tests.py", line 702, 
in test_describe
self.execute(cql="DESCRIBE KEYSPACE test", 
expected_output=self.get_keyspace_output())
  File "/home/automaton/cassandra-dtest/cqlsh_tests/cqlsh_tests.py", line 1042, 
in execute
self.check_response(output, expected_output)
  File "/home/automaton/cassandra-dtest/cqlsh_tests/cqlsh_tests.py", line 1049, 
in check_response
self.assertEqual(expected_lines, lines)
  File "/usr/lib/python2.7/unittest/case.py", line 513, in assertEqual
assertion_func(first, second, msg=msg)
  File "/usr/lib/python2.7/unittest/case.py", line 742, in assertListEqual
self.assertSequenceEqual(list1, list2, msg, seq_type=list)
  File "/usr/lib/python2.7/unittest/case.py", line 724, in assertSequenceEqual
self.fail(msg)
  File "/usr/lib/python2.7/unittest/case.py", line 410, in fail
raise self.failureException(msg)
{code}



--
This message was sent by Atlassian JIRA
(v6.3.15#6346)


[jira] [Created] (CASSANDRA-13248) testall failure in org.apache.cassandra.db.compaction.PendingRepairManagerTest.userDefinedTaskTest

2017-02-22 Thread Sean McCarthy (JIRA)
Sean McCarthy created CASSANDRA-13248:
-

 Summary: testall failure in 
org.apache.cassandra.db.compaction.PendingRepairManagerTest.userDefinedTaskTest
 Key: CASSANDRA-13248
 URL: https://issues.apache.org/jira/browse/CASSANDRA-13248
 Project: Cassandra
  Issue Type: Bug
  Components: Testing
Reporter: Sean McCarthy
 Attachments: 
TEST-org.apache.cassandra.db.compaction.PendingRepairManagerTest.log

example failure:

http://cassci.datastax.com/job/trunk_testall/1416/testReport/org.apache.cassandra.db.compaction/PendingRepairManagerTest/userDefinedTaskTest

{code}
Error Message

expected:<1> but was:<0>
{code}{code}
Stacktrace

junit.framework.AssertionFailedError: expected:<1> but was:<0>
at 
org.apache.cassandra.db.compaction.PendingRepairManagerTest.userDefinedTaskTest(PendingRepairManagerTest.java:194)
{code}{code}
Standard Output

ERROR [main] 2017-02-21 17:00:01,792 ?:? - SLF4J: stderr
INFO  [main] 2017-02-21 17:00:02,001 ?:? - Configuration location: 
file:/home/automaton/cassandra/test/conf/cassandra.yaml
DEBUG [main] 2017-02-21 17:00:02,002 ?:? - Loading settings from 
file:/home/automaton/cassandra/test/conf/cassandra.yaml
INFO  [main] 2017-02-21 17:00:02,530 ?:? - Node 
configuration:[allocate_tokens_for_keyspace=null; authenticator=null; 
authorizer=null; auto_bootstrap=true; auto_snapshot=true; 
back_pressure_enabled=false; back_pressure_strategy=null; 
batch_size_fail_threshold_in_kb=50; batch_size_warn_threshold_in_kb=5; 
batchlog_replay_throttle_in_kb=1024; broadcast_address=null; 
broadcast_rpc_address=null; buffer_pool_use_heap_if_exhausted=true; 
cas_contention_timeout_in_ms=1000; cdc_enabled=false; 
cdc_free_space_check_interval_ms=250; 
cdc_raw_directory=build/test/cassandra/cdc_raw:165; cdc_total_space_in_mb=0; 
client_encryption_options=; cluster_name=Test Cluster; 
column_index_cache_size_in_kb=2; column_index_size_in_kb=4; 
commit_failure_policy=stop; commitlog_compression=null; 
commitlog_directory=build/test/cassandra/commitlog:165; 
commitlog_max_compression_buffers_in_pool=3; commitlog_periodic_queue_size=-1; 
commitlog_segment_size_in_mb=5; commitlog_sync=batch; 
commitlog_sync_batch_window_in_ms=1.0; commitlog_sync_period_in_ms=0; 
commitlog_total_space_in_mb=null; 
compaction_large_partition_warning_threshold_mb=100; 
compaction_throughput_mb_per_sec=0; concurrent_compactors=4; 
concurrent_counter_writes=32; concurrent_materialized_view_writes=32; 
concurrent_reads=32; concurrent_replicates=null; concurrent_writes=32; 
counter_cache_keys_to_save=2147483647; counter_cache_save_period=7200; 
counter_cache_size_in_mb=null; counter_write_request_timeout_in_ms=5000; 
credentials_cache_max_entries=1000; credentials_update_interval_in_ms=-1; 
credentials_validity_in_ms=2000; cross_node_timeout=false; 
data_file_directories=[Ljava.lang.String;@1757cd72; disk_access_mode=mmap; 
disk_failure_policy=ignore; disk_optimization_estimate_percentile=0.95; 
disk_optimization_page_cross_chance=0.1; disk_optimization_strategy=ssd; 
dynamic_snitch=true; dynamic_snitch_badness_threshold=0.1; 
dynamic_snitch_reset_interval_in_ms=60; 
dynamic_snitch_update_interval_in_ms=100; 
enable_scripted_user_defined_functions=true; 
enable_user_defined_functions=true; enable_user_defined_functions_threads=true; 
encryption_options=null; 
endpoint_snitch=org.apache.cassandra.locator.SimpleSnitch; 
file_cache_size_in_mb=null; gc_log_threshold_in_ms=200; 
gc_warn_threshold_in_ms=0; hinted_handoff_disabled_datacenters=[]; 
hinted_handoff_enabled=true; hinted_handoff_throttle_in_kb=1024; 
hints_compression=null; hints_directory=build/test/cassandra/hints:165; 
hints_flush_period_in_ms=1; incremental_backups=true; index_interval=null; 
index_summary_capacity_in_mb=null; index_summary_resize_interval_in_minutes=60; 
initial_token=null; inter_dc_stream_throughput_outbound_megabits_per_sec=200; 
inter_dc_tcp_nodelay=true; internode_authenticator=null; 
internode_compression=none; internode_recv_buff_size_in_bytes=0; 
internode_send_buff_size_in_bytes=0; key_cache_keys_to_save=2147483647; 
key_cache_save_period=14400; key_cache_size_in_mb=null; 
listen_address=127.0.0.1; listen_interface=null; 
listen_interface_prefer_ipv6=false; listen_on_broadcast_address=false; 
max_hint_window_in_ms=1080; max_hints_delivery_threads=2; 
max_hints_file_size_in_mb=128; max_mutation_size_in_kb=null; 
max_streaming_retries=3; max_value_size_in_mb=256; 
memtable_allocation_type=offheap_objects; memtable_cleanup_threshold=null; 
memtable_flush_writers=0; memtable_heap_space_in_mb=null; 
memtable_offheap_space_in_mb=null; min_free_space_per_drive_in_mb=50; 
native_transport_max_concurrent_connections=-1; 
native_transport_max_concurrent_connections_per_ip=-1; 
native_transport_max_frame_size_in_mb=256; native_transport_max_threads=128; 
native_transport_port=9207; 

[jira] [Created] (CASSANDRA-13249) testall failure in org.apache.cassandra.pig.CqlTableTest.testCqlNativeStorageNullTuples

2017-02-22 Thread Sean McCarthy (JIRA)
Sean McCarthy created CASSANDRA-13249:
-

 Summary: testall failure in 
org.apache.cassandra.pig.CqlTableTest.testCqlNativeStorageNullTuples
 Key: CASSANDRA-13249
 URL: https://issues.apache.org/jira/browse/CASSANDRA-13249
 Project: Cassandra
  Issue Type: Bug
  Components: Testing
Reporter: Sean McCarthy


example failure:

http://cassci.datastax.com/job/cassandra-2.2_testall/645/testReport/org.apache.cassandra.pig/CqlTableTest/testCqlNativeStorageNullTuples

{code}
Error Message

expected:<1> but was:<2>
{code}{code}
Stacktrace

junit.framework.AssertionFailedError: expected:<1> but was:<2>
at 
org.apache.cassandra.pig.CqlTableTest.NullTupleTest(CqlTableTest.java:262)
at 
org.apache.cassandra.pig.CqlTableTest.testCqlNativeStorageNullTuples(CqlTableTest.java:246)
{code}



--
This message was sent by Atlassian JIRA
(v6.3.15#6346)


[jira] [Commented] (CASSANDRA-12100) Compactions are stuck after TRUNCATE

2017-02-22 Thread Stefania (JIRA)

[ 
https://issues.apache.org/jira/browse/CASSANDRA-12100?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15878484#comment-15878484
 ] 

Stefania commented on CASSANDRA-12100:
--

2.2.9 is closed, the next 2.2 release is 2.2.10.  The 2.2.x series is generally 
accepting only critical fixes, but this patch is so trivial and safe to 
backport that I think we can make an exception. The patch only fixes the 
compaction stats, nothing else, no real compaction is actually stuck and fixed 
by this patch.  [~s_delima] if you still want it in 2.2.10 I can start the 
tests:

||2.2||
|[patch|https://github.com/stef1927/cassandra/tree/12100-2.2]|
|[testall|http://cassci.datastax.com/view/Dev/view/stef1927/job/stef1927-12100-2.2-testall/]|
|[dtest|http://cassci.datastax.com/view/Dev/view/stef1927/job/stef1927-12100-2.2-dtest/]|

Sorry for the late reply.

> Compactions are stuck after TRUNCATE
> 
>
> Key: CASSANDRA-12100
> URL: https://issues.apache.org/jira/browse/CASSANDRA-12100
> Project: Cassandra
>  Issue Type: Bug
>  Components: Compaction
>Reporter: Stefano Ortolani
>Assignee: Stefania
> Fix For: 3.0.9, 3.8
>
> Attachments: node3_jstack.log
>
>
> Hi,
> since the upgrade to C* 3.0.7 I see compaction tasks getting stuck when 
> truncating the column family. I verified this on all nodes of the cluster.
> Pending compactions seem to disappear after restarting the node.
> {noformat}
> root@node10:~# nodetool -h localhost compactionstats
> pending tasks: 6
>  id   compaction type  
> keyspacetable   completed  totalunit   progress
>24e1ad30-3cac-11e6-870d-5de740693258Compaction  
> schema  table_1   0   57558382   bytes  0.00%
>2be2e3b0-3cac-11e6-870d-5de740693258Compaction  
> schema  table_2   0   65063705   bytes  0.00%
>54de38f0-3cac-11e6-870d-5de740693258Compaction  
> schema  table_3   0 187031   bytes  0.00%
>31926ce0-3cac-11e6-870d-5de740693258Compaction  
> schema  table_4   0   42951119   bytes  0.00%
>3911ad00-3cac-11e6-870d-5de740693258Compaction  
> schema  table_5   0   25918949   bytes  0.00%
>3e6a8ab0-3cac-11e6-870d-5de740693258Compaction  
> schema  table_6   0   65466210   bytes  0.00%
> Active compaction remaining time :   0h00m15s
> {noformat}



--
This message was sent by Atlassian JIRA
(v6.3.15#6346)


[jira] [Commented] (CASSANDRA-13232) "multiple versions of ant detected in path for junit" printed for every junit test case spawned by "ant test"

2017-02-22 Thread Ariel Weisberg (JIRA)

[ 
https://issues.apache.org/jira/browse/CASSANDRA-13232?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15878467#comment-15878467
 ] 

Ariel Weisberg commented on CASSANDRA-13232:


||code|utests|dtests||
|[trunk|https://github.com/apache/cassandra/compare/trunk...aweisberg:cassandra-13232?expand=1]|[utests|https://cassci.datastax.com/view/Dev/view/aweisberg/job/aweisberg-cassandra-13232-testall/1/]|[dtests|https://cassci.datastax.com/view/Dev/view/aweisberg/job/aweisberg-cassandra-13232-dtest/1/]|

> "multiple versions of ant detected in path for junit" printed for every junit 
> test case spawned by "ant test"
> -
>
> Key: CASSANDRA-13232
> URL: https://issues.apache.org/jira/browse/CASSANDRA-13232
> Project: Cassandra
>  Issue Type: Bug
>  Components: Build
>Reporter: Michael Kjellman
>Assignee: Michael Kjellman
> Fix For: 4.x
>
> Attachments: 673.diff
>
>
> There is a super annoying junit warning logged before every junit test case 
> when you run "ant test". This is due to the fact that the ant junit task that 
> we have configured in our build.xml sources the system class path and most 
> importantly what's in ant.library.dir.
> [junit] WARNING: multiple versions of ant detected in path for junit 
> [junit]  
> jar:file:/usr/local/ant/lib/ant.jar!/org/apache/tools/ant/Project.class
> [junit]  and 
> jar:file:/Users/mkjellman/Documents/mkjellman-cie-cassandra-trunk/build/lib/jars/ant-1.9.6.jar!/org/apache/tools/ant/Project.class
> The fix here is to explicitly exclude the ant jar downloaded from the maven 
> tasks that ends up in ${build.lib} and ${build.dir.lib} so only the ant 
> libraries from the system class path are used.
> I played around with excluding the ant classes/jars from the system class 
> path in favor of using the ones we copy into ${build.lib} and 
> ${build.dir.lib} with no success. After reading the documentation it seems 
> you always want to use the libs that shipped with whatever is in $ANT_HOME so 
> i believe excluding the jars from the build lib directories is the correct 
> change anyways.



--
This message was sent by Atlassian JIRA
(v6.3.15#6346)


[jira] [Commented] (CASSANDRA-12653) In-flight shadow round requests

2017-02-22 Thread Joel Knighton (JIRA)

[ 
https://issues.apache.org/jira/browse/CASSANDRA-12653?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15878461#comment-15878461
 ] 

Joel Knighton commented on CASSANDRA-12653:
---

I think I can answer these - feel free to correct me, [~spo...@gmail.com]

In order,
* Presently, the tests depend on the mock MessagingService, which was added in 
[CASSANDRA-12016] to 3.10+. We'd new tests for 2.2/3.0+, which is desirable, 
but I have no great ideas how to do it other than fiddly byteman tests. 
* I agree with this. Stefan and I discussed it on the first pass of review, and 
I wouldn't mind eliminating that check altogether and making it a boolean. 
OTOH, it's cheap to check deserialization time and excludes the messages that 
were deserialized prior to the check. OTOH, there's no meaningful distinction 
in correctness-preserving behaviors between that and arbitrarily delayed gossip 
messages, and we need to handle the latter correctly anyway. I'm most concerned 
about this check giving future readers false hope :).
* It also seems to be me that it doesn't presently need to be synchronized. 
That said, I assumed it was a defensive choice because the internals are 
definitely not safe to call on multiple threads, and someone may make that 
mistake in the future.

> In-flight shadow round requests
> ---
>
> Key: CASSANDRA-12653
> URL: https://issues.apache.org/jira/browse/CASSANDRA-12653
> Project: Cassandra
>  Issue Type: Bug
>  Components: Distributed Metadata
>Reporter: Stefan Podkowinski
>Assignee: Stefan Podkowinski
>Priority: Minor
> Fix For: 2.2.x, 3.0.x, 3.11.x, 4.x
>
>
> Bootstrapping or replacing a node in the cluster requires to gather and check 
> some host IDs or tokens by doing a gossip "shadow round" once before joining 
> the cluster. This is done by sending a gossip SYN to all seeds until we 
> receive a response with the cluster state, from where we can move on in the 
> bootstrap process. Receiving a response will call the shadow round done and 
> calls {{Gossiper.resetEndpointStateMap}} for cleaning up the received state 
> again.
> The issue here is that at this point there might be other in-flight requests 
> and it's very likely that shadow round responses from other seeds will be 
> received afterwards, while the current state of the bootstrap process doesn't 
> expect this to happen (e.g. gossiper may or may not be enabled). 
> One side effect will be that MigrationTasks are spawned for each shadow round 
> reply except the first. Tasks might or might not execute based on whether at 
> execution time {{Gossiper.resetEndpointStateMap}} had been called, which 
> effects the outcome of {{FailureDetector.instance.isAlive(endpoint))}} at 
> start of the task. You'll see error log messages such as follows when this 
> happend:
> {noformat}
> INFO  [SharedPool-Worker-1] 2016-09-08 08:36:39,255 Gossiper.java:993 - 
> InetAddress /xx.xx.xx.xx is now UP
> ERROR [MigrationStage:1]2016-09-08 08:36:39,255 FailureDetector.java:223 
> - unknown endpoint /xx.xx.xx.xx
> {noformat}
> Although is isn't pretty, I currently don't see any serious harm from this, 
> but it would be good to get a second opinion (feel free to close as "wont 
> fix").
> /cc [~Stefania] [~thobbs]



--
This message was sent by Atlassian JIRA
(v6.3.15#6346)


[jira] [Commented] (CASSANDRA-13230) Build RPM packages for release

2017-02-22 Thread Michael Shuler (JIRA)

[ 
https://issues.apache.org/jira/browse/CASSANDRA-13230?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15878418#comment-15878418
 ] 

Michael Shuler commented on CASSANDRA-13230:


Great, thanks! Committed to master. I'll do a trial run and then see if we can 
get builds working right in CI. Much appreciated.

> Build RPM packages for release
> --
>
> Key: CASSANDRA-13230
> URL: https://issues.apache.org/jira/browse/CASSANDRA-13230
> Project: Cassandra
>  Issue Type: New Feature
>  Components: Packaging
>Reporter: Michael Shuler
>Assignee: Stefan Podkowinski
> Attachments: 13230.patch
>
>
> Currently, releases are built locally on Debian/Ubuntu based machines, 
> without native support for building RPM packages. This can be done with a 
> docker image.
> The current cassandra-release scripts are here (please, do not randomly run 
> and push tags..):
> https://git-wip-us.apache.org/repos/asf?p=cassandra-builds.git;a=tree;f=cassandra-release
> A couple incomplete docker run scripts are here:
> https://git-wip-us.apache.org/repos/asf?p=cassandra-builds.git;a=tree;f=docker-wip
> {code}
> git clone https://git-wip-us.apache.org/repos/asf/cassandra-builds.git
> {code}
> Patches for build infra improvements are welcome!
> /cc [~spo...@gmail.com] if you want to assign to yourself, I'd be happy to 
> review :)



--
This message was sent by Atlassian JIRA
(v6.3.15#6346)


[jira] [Commented] (CASSANDRA-12213) dtest failure in write_failures_test.TestWriteFailures.test_paxos_any

2017-02-22 Thread Stefania (JIRA)

[ 
https://issues.apache.org/jira/browse/CASSANDRA-12213?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15878416#comment-15878416
 ] 

Stefania commented on CASSANDRA-12213:
--

Previous multiplexed 
[run|https://cassci.datastax.com/view/Parameterized/job/parameterized_dtest_multiplexer/387]
 completed without errors, repeating one more time 
[here|https://cassci.datastax.com/view/Parameterized/job/parameterized_dtest_multiplexer/388/].

> dtest failure in write_failures_test.TestWriteFailures.test_paxos_any
> -
>
> Key: CASSANDRA-12213
> URL: https://issues.apache.org/jira/browse/CASSANDRA-12213
> Project: Cassandra
>  Issue Type: Bug
>Reporter: Craig Kodman
>Assignee: Stefania
>  Labels: dtest
> Fix For: 3.11.x
>
> Attachments: jenkins-stef1927-12014-dtest-2_logs.001.tar.gz, 
> node1_debug.log, node1_gc.log, node1.log, node2_debug.log, node2_gc.log, 
> node2.log, node3_debug.log, node3_gc.log, node3.log
>
>
> example failure:
> http://cassci.datastax.com/job/cassandra-3.9_dtest/10/testReport/write_failures_test/TestWriteFailures/test_paxos_any
> and:
> http://cassci.datastax.com/job/cassandra-3.9_dtest/10/testReport/write_failures_test/TestWriteFailures/test_mutation_v3/
> Failed on CassCI build cassandra-3.9_dtest #10



--
This message was sent by Atlassian JIRA
(v6.3.15#6346)


cassandra-builds git commit: Update Dockerfiles for building RPMs and Debian packages

2017-02-22 Thread mshuler
Repository: cassandra-builds
Updated Branches:
  refs/heads/master ac05c7153 -> f31eb5f04


Update Dockerfiles for building RPMs and Debian packages

 * Creates re-usable docker images for build environment
 * Actual build is executed using `docker run` and dedicated build
   scripts
 * Resulting packages will end up in local dist directory


Project: http://git-wip-us.apache.org/repos/asf/cassandra-builds/repo
Commit: http://git-wip-us.apache.org/repos/asf/cassandra-builds/commit/f31eb5f0
Tree: http://git-wip-us.apache.org/repos/asf/cassandra-builds/tree/f31eb5f0
Diff: http://git-wip-us.apache.org/repos/asf/cassandra-builds/diff/f31eb5f0

Branch: refs/heads/master
Commit: f31eb5f04e451a1b06407416d271a9f23bf6946f
Parents: ac05c71
Author: Stefan Podkowinski 
Authored: Fri Feb 17 14:19:12 2017 +0100
Committer: Michael Shuler 
Committed: Wed Feb 22 09:02:38 2017 -0600

--
 .gitignore |  1 +
 README.md  | 24 +++--
 dist/.keep |  0
 docker-wip/centos7-rpmbuild.docker | 15 ---
 docker-wip/jessie-debbuild.docker  | 31 --
 docker/build-debs.sh   | 19 +
 docker/build-rpms.sh   | 20 ++
 docker/centos7-image.docker| 47 +
 docker/jessie-image.docker | 43 ++
 9 files changed, 152 insertions(+), 48 deletions(-)
--


http://git-wip-us.apache.org/repos/asf/cassandra-builds/blob/f31eb5f0/.gitignore
--
diff --git a/.gitignore b/.gitignore
new file mode 100644
index 000..7bb4cf8
--- /dev/null
+++ b/.gitignore
@@ -0,0 +1 @@
+dist/cassandra*

http://git-wip-us.apache.org/repos/asf/cassandra-builds/blob/f31eb5f0/README.md
--
diff --git a/README.md b/README.md
index 190fba0..056316e 100644
--- a/README.md
+++ b/README.md
@@ -1,2 +1,22 @@
-# cassandra-builds
-Apache Cassandra Builds
+# Cassandra Build Tools
+
+Collection of scripts that can be used to create Cassandra Linux packages and 
to push them to repositories.
+
+## Building packages
+
+1. Create build images containing the build tool-chain, Java and a Cassandra 
git working directory
+   * Debian:
+   ```docker build -f docker/jessie-image.docker docker/```
+   * RPM:
+   ```docker build -f docker/centos7-image.docker docker/```
+2. Run build script through docker (specify branch, e.g. cassandra-3.0 and 
version, e.g. 3.0.11):
+   * Debian:
+```docker run -v `pwd`/dist:/dist `docker images -f 
label=org.cassandra.buildenv=centos -q` /home/build/build-rpms.sh  
```
+   * RPM:
+```docker run -v `pwd`/dist:/dist `docker images -f 
label=org.cassandra.buildenv=jessie -q` /home/build/build-debs.sh ```
+
+You should find newly created Debian and RPM packages in the `dist` directory.
+
+## Publishing packages
+
+TODO

http://git-wip-us.apache.org/repos/asf/cassandra-builds/blob/f31eb5f0/dist/.keep
--
diff --git a/dist/.keep b/dist/.keep
new file mode 100644
index 000..e69de29

http://git-wip-us.apache.org/repos/asf/cassandra-builds/blob/f31eb5f0/docker-wip/centos7-rpmbuild.docker
--
diff --git a/docker-wip/centos7-rpmbuild.docker 
b/docker-wip/centos7-rpmbuild.docker
deleted file mode 100644
index 22c9429..000
--- a/docker-wip/centos7-rpmbuild.docker
+++ /dev/null
@@ -1,15 +0,0 @@
-FROM centos:7.0.1406
-
-# install deps
-RUN yum -y install ant epel-release git java-1.7.0-openjdk-devel 
java-1.8.0-openjdk-devel make rpm-build
-RUN yum -y install python2-pip
-RUN pip install Sphinx sphinx_rtd_theme
-RUN mkdir -p /root/rpmbuild/{BUILD,BUILDROOT,RPMS,SOURCES,SPECS,SRPMS}
-
-RUN git clone https://git.apache.org/cassandra.git
-# javadoc target is broken in docker without this mkdir
-RUN mkdir -p cassandra/build/javadoc
-RUN cd cassandra/ ; ant artifacts -Drelease=true
-RUN cp cassandra/build/apache-cassandra-*-src.tar.gz /root/rpmbuild/SOURCES/
-RUN rpmbuild --define="version 4.0" -ba cassandra/redhat/cassandra.spec
-RUN ls -lR /root/rpmbuild/*RPMS/

http://git-wip-us.apache.org/repos/asf/cassandra-builds/blob/f31eb5f0/docker-wip/jessie-debbuild.docker
--
diff --git a/docker-wip/jessie-debbuild.docker 
b/docker-wip/jessie-debbuild.docker
deleted file mode 100644
index 40c7b28..000
--- a/docker-wip/jessie-debbuild.docker
+++ /dev/null
@@ -1,31 +0,0 @@
-FROM debian:jessie-backports
-
-# install deps
-RUN apt-get update
-RUN apt-get -y install ant build-essential curl devscripts git
-RUN apt-get -y 

[jira] [Commented] (CASSANDRA-12653) In-flight shadow round requests

2017-02-22 Thread Jason Brown (JIRA)

[ 
https://issues.apache.org/jira/browse/CASSANDRA-12653?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15878356#comment-15878356
 ] 

Jason Brown commented on CASSANDRA-12653:
-

Also, I'm not sure {{Gossiper#doShadowRound}} needs to be {{synchronized}}. 
Currently, that method is only invoked from {{StorageService#prepareToJoin}}. 
Is it necessary to mark it as such? If it is, can you please add a comment to 
the method.

> In-flight shadow round requests
> ---
>
> Key: CASSANDRA-12653
> URL: https://issues.apache.org/jira/browse/CASSANDRA-12653
> Project: Cassandra
>  Issue Type: Bug
>  Components: Distributed Metadata
>Reporter: Stefan Podkowinski
>Assignee: Stefan Podkowinski
>Priority: Minor
> Fix For: 2.2.x, 3.0.x, 3.11.x, 4.x
>
>
> Bootstrapping or replacing a node in the cluster requires to gather and check 
> some host IDs or tokens by doing a gossip "shadow round" once before joining 
> the cluster. This is done by sending a gossip SYN to all seeds until we 
> receive a response with the cluster state, from where we can move on in the 
> bootstrap process. Receiving a response will call the shadow round done and 
> calls {{Gossiper.resetEndpointStateMap}} for cleaning up the received state 
> again.
> The issue here is that at this point there might be other in-flight requests 
> and it's very likely that shadow round responses from other seeds will be 
> received afterwards, while the current state of the bootstrap process doesn't 
> expect this to happen (e.g. gossiper may or may not be enabled). 
> One side effect will be that MigrationTasks are spawned for each shadow round 
> reply except the first. Tasks might or might not execute based on whether at 
> execution time {{Gossiper.resetEndpointStateMap}} had been called, which 
> effects the outcome of {{FailureDetector.instance.isAlive(endpoint))}} at 
> start of the task. You'll see error log messages such as follows when this 
> happend:
> {noformat}
> INFO  [SharedPool-Worker-1] 2016-09-08 08:36:39,255 Gossiper.java:993 - 
> InetAddress /xx.xx.xx.xx is now UP
> ERROR [MigrationStage:1]2016-09-08 08:36:39,255 FailureDetector.java:223 
> - unknown endpoint /xx.xx.xx.xx
> {noformat}
> Although is isn't pretty, I currently don't see any serious harm from this, 
> but it would be good to get a second opinion (feel free to close as "wont 
> fix").
> /cc [~Stefania] [~thobbs]



--
This message was sent by Atlassian JIRA
(v6.3.15#6346)


[jira] [Comment Edited] (CASSANDRA-12653) In-flight shadow round requests

2017-02-22 Thread Jason Brown (JIRA)

[ 
https://issues.apache.org/jira/browse/CASSANDRA-12653?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15878356#comment-15878356
 ] 

Jason Brown edited comment on CASSANDRA-12653 at 2/22/17 2:46 PM:
--

Also, I'm not sure {{Gossiper#doShadowRound}} needs to be {{synchronized}}. 
Currently, that method is only invoked from {{StorageService#prepareToJoin}} 
(in all current branches). Is it necessary to mark it as such? If it is, can 
you please add a comment to the method.


was (Author: jasobrown):
Also, I'm not sure {{Gossiper#doShadowRound}} needs to be {{synchronized}}. 
Currently, that method is only invoked from {{StorageService#prepareToJoin}}. 
Is it necessary to mark it as such? If it is, can you please add a comment to 
the method.

> In-flight shadow round requests
> ---
>
> Key: CASSANDRA-12653
> URL: https://issues.apache.org/jira/browse/CASSANDRA-12653
> Project: Cassandra
>  Issue Type: Bug
>  Components: Distributed Metadata
>Reporter: Stefan Podkowinski
>Assignee: Stefan Podkowinski
>Priority: Minor
> Fix For: 2.2.x, 3.0.x, 3.11.x, 4.x
>
>
> Bootstrapping or replacing a node in the cluster requires to gather and check 
> some host IDs or tokens by doing a gossip "shadow round" once before joining 
> the cluster. This is done by sending a gossip SYN to all seeds until we 
> receive a response with the cluster state, from where we can move on in the 
> bootstrap process. Receiving a response will call the shadow round done and 
> calls {{Gossiper.resetEndpointStateMap}} for cleaning up the received state 
> again.
> The issue here is that at this point there might be other in-flight requests 
> and it's very likely that shadow round responses from other seeds will be 
> received afterwards, while the current state of the bootstrap process doesn't 
> expect this to happen (e.g. gossiper may or may not be enabled). 
> One side effect will be that MigrationTasks are spawned for each shadow round 
> reply except the first. Tasks might or might not execute based on whether at 
> execution time {{Gossiper.resetEndpointStateMap}} had been called, which 
> effects the outcome of {{FailureDetector.instance.isAlive(endpoint))}} at 
> start of the task. You'll see error log messages such as follows when this 
> happend:
> {noformat}
> INFO  [SharedPool-Worker-1] 2016-09-08 08:36:39,255 Gossiper.java:993 - 
> InetAddress /xx.xx.xx.xx is now UP
> ERROR [MigrationStage:1]2016-09-08 08:36:39,255 FailureDetector.java:223 
> - unknown endpoint /xx.xx.xx.xx
> {noformat}
> Although is isn't pretty, I currently don't see any serious harm from this, 
> but it would be good to get a second opinion (feel free to close as "wont 
> fix").
> /cc [~Stefania] [~thobbs]



--
This message was sent by Atlassian JIRA
(v6.3.15#6346)


  1   2   >