[jira] [Commented] (CASSANDRA-7544) Allow storage port to be configurable per node

[Ariel Weisberg (JIRA)]

[ 
https://issues.apache.org/jira/browse/CASSANDRA-7544?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16369714#comment-16369714
 ] 

Ariel Weisberg commented on CASSANDRA-7544:
---

Committed ninja fix as 
[cc436770010034f5e9fbde06b9a2e713ddbffcee|https://github.com/apache/cassandra/commit/cc436770010034f5e9fbde06b9a2e713ddbffcee]

> Allow storage port to be configurable per node
> --
>
> Key: CASSANDRA-7544
> URL: https://issues.apache.org/jira/browse/CASSANDRA-7544
> Project: Cassandra
>  Issue Type: Improvement
>Reporter: Sam Overton
>Assignee: Ariel Weisberg
>Priority: Major
> Fix For: 4.0
>
>
> Currently storage_port must be configured identically on all nodes in a 
> cluster and it is assumed that this is the case when connecting to a remote 
> node.
> This prevents running in any environment that requires multiple nodes to be 
> able to bind to the same network interface, such as with many automatic 
> provisioning/deployment frameworks.
> The current solutions seems to be
> * use a separate network interface for each node deployed to the same box. 
> This puts a big requirement on IP allocation at large scale.
> * allow multiple clusters to be provisioned from the same resource pool, but 
> restrict allocation to a maximum of one node per host from each cluster, 
> assuming each cluster is running on a different storage port.
> It would make operations much simpler in these kind of environments if the 
> environment provisioning the resources could assign the ports to be used when 
> bringing up a new node on shared hardware.
> The changes required would be at least the following:
> 1. configure seeds as IP:port instead of just IP
> 2. gossip the storage port as part of a node's ApplicationState
> 3. refer internally to nodes by hostID instead of IP, since there will be 
> multiple nodes with the same IP
> (1) & (2) are mostly trivial and I already have a patch for these. The bulk 
> of the work to enable this is (3), and I would structure this as a separate 
> pre-requisite patch. 



--
This message was sent by Atlassian JIRA
(v7.6.3#76005)

-
To unsubscribe, e-mail: commits-unsubscr...@cassandra.apache.org
For additional commands, e-mail: commits-h...@cassandra.apache.org

cassandra git commit: Ninja fix bitwise OR to logical OR in StorageServer.onChange

[aweisberg]

Repository: cassandra
Updated Branches:
  refs/heads/trunk 720772033 -> cc4367700


Ninja fix bitwise OR to logical OR in StorageServer.onChange

Patch by Ariel Weisberg; Reviewed by Kurt Greaves for CASSANDRA-7544


Project: http://git-wip-us.apache.org/repos/asf/cassandra/repo
Commit: http://git-wip-us.apache.org/repos/asf/cassandra/commit/cc436770
Tree: http://git-wip-us.apache.org/repos/asf/cassandra/tree/cc436770
Diff: http://git-wip-us.apache.org/repos/asf/cassandra/diff/cc436770

Branch: refs/heads/trunk
Commit: cc436770010034f5e9fbde06b9a2e713ddbffcee
Parents: 7207720
Author: Ariel Weisberg 
Authored: Mon Feb 19 22:31:29 2018 -0500
Committer: Ariel Weisberg 
Committed: Mon Feb 19 22:31:29 2018 -0500

--
 src/java/org/apache/cassandra/service/StorageService.java | 2 +-
 1 file changed, 1 insertion(+), 1 deletion(-)
--


http://git-wip-us.apache.org/repos/asf/cassandra/blob/cc436770/src/java/org/apache/cassandra/service/StorageService.java
--
diff --git a/src/java/org/apache/cassandra/service/StorageService.java 
b/src/java/org/apache/cassandra/service/StorageService.java
index 42e3ddf..d465431 100644
--- a/src/java/org/apache/cassandra/service/StorageService.java
+++ b/src/java/org/apache/cassandra/service/StorageService.java
@@ -2011,7 +2011,7 @@ public class StorageService extends 
NotificationBroadcasterSupport implements IE
  */
 public void onChange(InetAddressAndPort endpoint, ApplicationState state, 
VersionedValue value)
 {
-if (state == ApplicationState.STATUS | state == 
ApplicationState.STATUS_WITH_PORT)
+if (state == ApplicationState.STATUS || state == 
ApplicationState.STATUS_WITH_PORT)
 {
 String[] pieces = splitValue(value);
 assert (pieces.length > 0);


-
To unsubscribe, e-mail: commits-unsubscr...@cassandra.apache.org
For additional commands, e-mail: commits-h...@cassandra.apache.org

[jira] [Commented] (CASSANDRA-14199) exception when dumping sstable with frozen collection of UUID

[Chris Lohfink (JIRA)]

[ 
https://issues.apache.org/jira/browse/CASSANDRA-14199?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16369706#comment-16369706
 ] 

Chris Lohfink commented on CASSANDRA-14199:
---

duplicate of CASSANDRA-12594 and CASSANDRA-13573 ? looks like it should be 
fixed in 3.0.x now, which version specifically are you using?

> exception when dumping sstable with frozen collection of UUID
> -
>
> Key: CASSANDRA-14199
> URL: https://issues.apache.org/jira/browse/CASSANDRA-14199
> Project: Cassandra
>  Issue Type: Bug
>  Components: Tools
>Reporter: Simon Zhou
>Assignee: Simon Zhou
>Priority: Major
> Fix For: 3.0.x
>
>
> When dumping (sstabledump) sstable with frozen collection of UUID, there is 
> exception like this:
> {code:java}
> Exception in thread "main" org.apache.cassandra.serializers.MarshalException: 
> UUID should be 16 or 0 bytes (24)
> at 
> org.apache.cassandra.serializers.UUIDSerializer.validate(UUIDSerializer.java:43)
> at 
> org.apache.cassandra.db.marshal.AbstractType.getString(AbstractType.java:128)
> at 
> org.apache.cassandra.tools.JsonTransformer.serializeCell(JsonTransformer.java:440)
> at 
> org.apache.cassandra.tools.JsonTransformer.serializeColumnData(JsonTransformer.java:374)
> at 
> org.apache.cassandra.tools.JsonTransformer.serializeRow(JsonTransformer.java:278)
> at 
> org.apache.cassandra.tools.JsonTransformer.serializePartition(JsonTransformer.java:213)
> at 
> java.util.stream.ForEachOps$ForEachOp$OfRef.accept(ForEachOps.java:184)
> at 
> java.util.stream.ReferencePipeline$2$1.accept(ReferencePipeline.java:175)
> at java.util.Iterator.forEachRemaining(Iterator.java:116)
> at 
> java.util.Spliterators$IteratorSpliterator.forEachRemaining(Spliterators.java:1801)
> at 
> java.util.stream.AbstractPipeline.copyInto(AbstractPipeline.java:481)
> at 
> java.util.stream.AbstractPipeline.wrapAndCopyInto(AbstractPipeline.java:471)
> at 
> java.util.stream.ForEachOps$ForEachOp.evaluateSequential(ForEachOps.java:151)
> at 
> java.util.stream.ForEachOps$ForEachOp$OfRef.evaluateSequential(ForEachOps.java:174)
> at 
> java.util.stream.AbstractPipeline.evaluate(AbstractPipeline.java:234)
> at 
> java.util.stream.ReferencePipeline.forEach(ReferencePipeline.java:418)
> at 
> org.apache.cassandra.tools.JsonTransformer.toJson(JsonTransformer.java:102)
> at 
> org.apache.cassandra.tools.SSTableExport.main(SSTableExport.java:242){code}
>  
> *Steps to reproduce:*
> {code:java}
> cqlsh> create TABLE stresscql.sstabledump_test(userid text PRIMARY KEY, c1 
> list, c2 frozen, c3 set, c4 frozen, c5 
> map, c6 frozen>);
> cqlsh> insert INTO stresscql.sstabledump_test (userid, c1, c2, c3, c4, c5, 
> c6) VALUES ( 'id', [6947e8c0-02fa-11e8-87e1-fb0d0e20b5c4], 
> [6947e8c0-02fa-11e8-87e1-fb0d0e20b5c4], {'set', 'user'}, {'view', 'over'}, 
> {'good': 'hello', 'root': 'text'}, {'driver': 'java', 'note': 'new'});{code}
>  
> *Root cause:*
> Frozen collection is treated as simple column and it's the client's 
> responsibility to parse the data from ByteBuffer. We have this logic in 
> different drivers but sstabledump doesn't have the logic in place. It just 
> treat the whole collection as a single UUID.



--
This message was sent by Atlassian JIRA
(v7.6.3#76005)

-
To unsubscribe, e-mail: commits-unsubscr...@cassandra.apache.org
For additional commands, e-mail: commits-h...@cassandra.apache.org

[jira] [Commented] (CASSANDRA-7544) Allow storage port to be configurable per node

[Ariel Weisberg (JIRA)]

[ 
https://issues.apache.org/jira/browse/CASSANDRA-7544?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16369682#comment-16369682
 ] 

Ariel Weisberg commented on CASSANDRA-7544:
---

Sure Kurt I will change that.

> Allow storage port to be configurable per node
> --
>
> Key: CASSANDRA-7544
> URL: https://issues.apache.org/jira/browse/CASSANDRA-7544
> Project: Cassandra
>  Issue Type: Improvement
>Reporter: Sam Overton
>Assignee: Ariel Weisberg
>Priority: Major
> Fix For: 4.0
>
>
> Currently storage_port must be configured identically on all nodes in a 
> cluster and it is assumed that this is the case when connecting to a remote 
> node.
> This prevents running in any environment that requires multiple nodes to be 
> able to bind to the same network interface, such as with many automatic 
> provisioning/deployment frameworks.
> The current solutions seems to be
> * use a separate network interface for each node deployed to the same box. 
> This puts a big requirement on IP allocation at large scale.
> * allow multiple clusters to be provisioned from the same resource pool, but 
> restrict allocation to a maximum of one node per host from each cluster, 
> assuming each cluster is running on a different storage port.
> It would make operations much simpler in these kind of environments if the 
> environment provisioning the resources could assign the ports to be used when 
> bringing up a new node on shared hardware.
> The changes required would be at least the following:
> 1. configure seeds as IP:port instead of just IP
> 2. gossip the storage port as part of a node's ApplicationState
> 3. refer internally to nodes by hostID instead of IP, since there will be 
> multiple nodes with the same IP
> (1) & (2) are mostly trivial and I already have a patch for these. The bulk 
> of the work to enable this is (3), and I would structure this as a separate 
> pre-requisite patch. 



--
This message was sent by Atlassian JIRA
(v7.6.3#76005)

-
To unsubscribe, e-mail: commits-unsubscr...@cassandra.apache.org
For additional commands, e-mail: commits-h...@cassandra.apache.org

[jira] [Created] (CASSANDRA-14242) Indexed static column returns inconsistent results

[Ross Black (JIRA)]

Ross Black created CASSANDRA-14242:
--

 Summary: Indexed static column returns inconsistent results
 Key: CASSANDRA-14242
 URL: https://issues.apache.org/jira/browse/CASSANDRA-14242
 Project: Cassandra
  Issue Type: Bug
 Environment: Cassandra 3.11.2

Java driver 3.4.0

Ubuntu - 4.4.0-112-generic
Reporter: Ross Black


I am using Cassandra 3.11.2, and the Java driver 3.4.0

I have a table that has a static column, where the static column has a 
secondary index.
When querying the table I get incomplete or duplicated results, depending on 
the fetch size.

e.g.
{code:java}
CREATE KEYSPACE hack WITH replication = {'class': 'SimpleStrategy', 
'replication_factor': 1};
CREATE TABLE hack.stuff (id int, kind text, chunk int static, val1 int, PRIMARY 
KEY (id, kind));
CREATE INDEX stuff_chunk_index ON hack.stuff (chunk);{code}

-- repeat with thousands of values for id =>
{code:java}
  INSERT INTO hack.stuff (id, chunk, kind, val1 ) VALUES (${id}, 777, 'A', 
123);{code}


Querying from Java:
{code:java}
    final SimpleStatement statement = new SimpleStatement("SELECT id, kind, 
val1 FROM hack.stuff WHERE chunk = " + chunk); 
    statement.setFetchSize(fetchSize);
    statement.setConsistencyLevel(ConsistencyLevel.ALL);
    final ResultSet resultSet = connection.getSession().execute(statement);
    for (Row row : resultSet) {
    final int id = row.getInt("id");
    }{code}

*The number of results returned depends on the fetch-size.*

e.g. For 30k values inserted, I get the following:
||fetch-size||result-size||
|4|3|
|2|30001|
|5000|30006|
|100|30303|



In production, I have a much larger table where the correct result size for a 
specific chunk is 20019, but some fetch sizes will return _significantly fewer_ 
results.
||fetch-size||result-size|| ||
|25000|20019| |
|5000||*<== this one is has far fewer results*|
|5001|20026| |

(so far been unable to reproduce this with the simpler test table)

Thanks,
Ross



--
This message was sent by Atlassian JIRA
(v7.6.3#76005)

-
To unsubscribe, e-mail: commits-unsubscr...@cassandra.apache.org
For additional commands, e-mail: commits-h...@cassandra.apache.org

[jira] [Commented] (CASSANDRA-7544) Allow storage port to be configurable per node

[Kurt Greaves (JIRA)]

[ 
https://issues.apache.org/jira/browse/CASSANDRA-7544?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16369610#comment-16369610
 ] 

Kurt Greaves commented on CASSANDRA-7544:
-

[~aweisberg] one nit: 
[this|https://github.com/apache/cassandra/blob/720772033a1f92b422065a307dcacc5f024b9c07/src/java/org/apache/cassandra/service/StorageService.java#L2014]
 if statement uses a bitwise OR in place of a logical OR. While the behaviour 
is the same, can you ninja a fix? Just to save us when the condition gets 
changed in the future and someone doesn't notice.

> Allow storage port to be configurable per node
> --
>
> Key: CASSANDRA-7544
> URL: https://issues.apache.org/jira/browse/CASSANDRA-7544
> Project: Cassandra
>  Issue Type: Improvement
>Reporter: Sam Overton
>Assignee: Ariel Weisberg
>Priority: Major
> Fix For: 4.0
>
>
> Currently storage_port must be configured identically on all nodes in a 
> cluster and it is assumed that this is the case when connecting to a remote 
> node.
> This prevents running in any environment that requires multiple nodes to be 
> able to bind to the same network interface, such as with many automatic 
> provisioning/deployment frameworks.
> The current solutions seems to be
> * use a separate network interface for each node deployed to the same box. 
> This puts a big requirement on IP allocation at large scale.
> * allow multiple clusters to be provisioned from the same resource pool, but 
> restrict allocation to a maximum of one node per host from each cluster, 
> assuming each cluster is running on a different storage port.
> It would make operations much simpler in these kind of environments if the 
> environment provisioning the resources could assign the ports to be used when 
> bringing up a new node on shared hardware.
> The changes required would be at least the following:
> 1. configure seeds as IP:port instead of just IP
> 2. gossip the storage port as part of a node's ApplicationState
> 3. refer internally to nodes by hostID instead of IP, since there will be 
> multiple nodes with the same IP
> (1) & (2) are mostly trivial and I already have a patch for these. The bulk 
> of the work to enable this is (3), and I would structure this as a separate 
> pre-requisite patch. 



--
This message was sent by Atlassian JIRA
(v7.6.3#76005)

-
To unsubscribe, e-mail: commits-unsubscr...@cassandra.apache.org
For additional commands, e-mail: commits-h...@cassandra.apache.org

[jira] [Updated] (CASSANDRA-14055) Index redistribution breaks SASI index

[Jordan West (JIRA)]

 [ 
https://issues.apache.org/jira/browse/CASSANDRA-14055?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
 ]

Jordan West updated CASSANDRA-14055:

Attachment: 14055-jrwest-trunk.patch
14055-jrwest-3.11.patch

> Index redistribution breaks SASI index
> --
>
> Key: CASSANDRA-14055
> URL: https://issues.apache.org/jira/browse/CASSANDRA-14055
> Project: Cassandra
>  Issue Type: Bug
>  Components: sasi
>Reporter: Ludovic Boutros
>Assignee: Ludovic Boutros
>Priority: Major
>  Labels: patch
> Fix For: 3.11.x, 4.x
>
> Attachments: 14055-jrwest-3.11.patch, 14055-jrwest-trunk.patch, 
> CASSANDRA-14055-jrwest.patch, CASSANDRA-14055.patch, CASSANDRA-14055.patch, 
> CASSANDRA-14055.patch
>
>
> During index redistribution process, a new view is created.
> During this creation, old indexes should be released.
> But, new indexes are "attached" to the same SSTable as the old indexes.
> This leads to the deletion of the last SASI index file and breaks the index.
> The issue is in this function : 
> [https://github.com/apache/cassandra/blob/9ee44db49b13d4b4c91c9d6332ce06a6e2abf944/src/java/org/apache/cassandra/index/sasi/conf/view/View.java#L62]



--
This message was sent by Atlassian JIRA
(v7.6.3#76005)

-
To unsubscribe, e-mail: commits-unsubscr...@cassandra.apache.org
For additional commands, e-mail: commits-h...@cassandra.apache.org

[jira] [Commented] (CASSANDRA-14055) Index redistribution breaks SASI index

[Jordan West (JIRA)]

[ 
https://issues.apache.org/jira/browse/CASSANDRA-14055?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16369601#comment-16369601
 ] 

Jordan West commented on CASSANDRA-14055:
-

[~lboutros]/[~jasobrown], some updates:

 
 I have attached two new patches. One for trunk and one of 3.11. Unfortunately, 
the test changes in trunk don't work well on 3.11 so we can't have one patch. 
The primary changes in this patch are to change the order we iterate over the 
indexes to ensure we retain the newer instance of {{SSTableIndex}} and thus the 
newer {{SSTableReader}}. I also changed the code to clone the {{oldSSTables}} 
collection since its visible outside the {{View}} constructor. 
||3.11||Trunk||
|[branch|https://github.com/jrwest/cassandra/tree/14055-jrwest-3.11]|[branch|https://github.com/jrwest/cassandra/tree/14055-jrwest-trunk]|
|[utests|https://circleci.com/gh/jrwest/cassandra/24]|[utests|https://circleci.com/gh/jrwest/cassandra/26]|

NOTE: same utests are failing on 
[trunk|https://circleci.com/gh/jrwest/cassandra/25] and I'm still working on 
getting dtests running with my CircleCI setup. 

 

Also, I spoke with some colleagues including [~beobal] and [~krummas] about the 
use of {{sstableRef.globalCount()}} to determine when to delete the SASI index 
file. I've come to the conclusion that its use at all is wrong because it 
represents the number of references to the instance, not globally. Given index 
summary redistribution, this isn't a safe assumption. Looking back at the 
original SASI patches, I am not sure why it got merged this way. The 
[patches|https://github.com/xedin/sasi/blob/master/src/java/org/apache/cassandra/db/index/sasi/SSTableIndex.java#L120]
 used {{sstable.isMarkedCompacted()}} but the [merged 
code|https://github.com/apache/cassandra/commit/72790dc8e34826b39ac696b03025ae6b7b6beb2b#diff-4873bb6fcef158ff18d221571ef2ec7cR124]
 used {{sstableRef.globalCount()}}. Fixing this is a larger undertaking, so I 
propose we split that work into a separate ticket and focus this one on SASI's 
failure to account for index redistribution in the {{View}}. The work covered 
by the other ticket would entail either a) deleting the SASI index files as 
part of {{SSTableTidier}} or by moving {{SSTableIndex}} to use {{Ref}} and 
implementing a tidier specific to it.

> Index redistribution breaks SASI index
> --
>
> Key: CASSANDRA-14055
> URL: https://issues.apache.org/jira/browse/CASSANDRA-14055
> Project: Cassandra
>  Issue Type: Bug
>  Components: sasi
>Reporter: Ludovic Boutros
>Assignee: Ludovic Boutros
>Priority: Major
>  Labels: patch
> Fix For: 3.11.x, 4.x
>
> Attachments: CASSANDRA-14055-jrwest.patch, CASSANDRA-14055.patch, 
> CASSANDRA-14055.patch, CASSANDRA-14055.patch
>
>
> During index redistribution process, a new view is created.
> During this creation, old indexes should be released.
> But, new indexes are "attached" to the same SSTable as the old indexes.
> This leads to the deletion of the last SASI index file and breaks the index.
> The issue is in this function : 
> [https://github.com/apache/cassandra/blob/9ee44db49b13d4b4c91c9d6332ce06a6e2abf944/src/java/org/apache/cassandra/index/sasi/conf/view/View.java#L62]



--
This message was sent by Atlassian JIRA
(v7.6.3#76005)

-
To unsubscribe, e-mail: commits-unsubscr...@cassandra.apache.org
For additional commands, e-mail: commits-h...@cassandra.apache.org

[jira] [Commented] (CASSANDRA-13396) Cassandra 3.10: ClassCastException in ThreadAwareSecurityManager

[Gus Heck (JIRA)]

[ 
https://issues.apache.org/jira/browse/CASSANDRA-13396?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16369594#comment-16369594
 ] 

Gus Heck commented on CASSANDRA-13396:
--

Though my embedded usage is not only for unit test, my choice of Cassandra 
relates more to the fact that you are Apache licensed, pure java and clustered 
rather than performance concerns. When there's a viable alternative I'll worry 
about whether or not you're faster... in the mean time, I'm very happy to be 
responsible for (or take credit for) any performance variation from plugging in 
my preferred logging framework (log4j2). Please don't use performance worries 
as an excuse to not fix this. Generally +1 on Eric's summary also. I don't mind 
doing something extra to enable pluggable logging so that you can default to 
your supported config, so long as it doesn't impact the command line invocation 
of my project (i.e. requiring -D or -agentlib, etc).

> Cassandra 3.10: ClassCastException in ThreadAwareSecurityManager
> 
>
> Key: CASSANDRA-13396
> URL: https://issues.apache.org/jira/browse/CASSANDRA-13396
> Project: Cassandra
>  Issue Type: Bug
>Reporter: Edward Capriolo
>Assignee: Eugene Fedotov
>Priority: Minor
>
> https://www.mail-archive.com/user@cassandra.apache.org/msg51603.html



--
This message was sent by Atlassian JIRA
(v7.6.3#76005)

-
To unsubscribe, e-mail: commits-unsubscr...@cassandra.apache.org
For additional commands, e-mail: commits-h...@cassandra.apache.org

[jira] [Commented] (CASSANDRA-11381) Node running with join_ring=false and authentication can not serve requests

[ASF GitHub Bot (JIRA)]

[ 
https://issues.apache.org/jira/browse/CASSANDRA-11381?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16369529#comment-16369529
 ] 

ASF GitHub Bot commented on CASSANDRA-11381:


Github user michaelsembwever commented on a diff in the pull request:

https://github.com/apache/cassandra-dtest/pull/19#discussion_r169173002
  
--- Diff: auth_join_ring_false_test.py ---
@@ -0,0 +1,212 @@
+import pytest
+import logging
+
+from cassandra import AuthenticationFailed, Unauthorized
+from cassandra.cluster import NoHostAvailable
+
+from dtest import Tester
+
+
+class TestAuth(Tester):
+
+
+def test_login_existing_node(self):
+"""
+* Launch a three node cluster
+* Restart the third node in `join_ring=false` mode
+* Connect as the default user/password
+* Verify that default user w/ bad password gives 
AuthenticationFailed exception
+* Verify that bad user gives AuthenticationFailed exception
+#"""
--- End diff --

oops. fixed.


> Node running with join_ring=false and authentication can not serve requests
> ---
>
> Key: CASSANDRA-11381
> URL: https://issues.apache.org/jira/browse/CASSANDRA-11381
> Project: Cassandra
>  Issue Type: Bug
>Reporter: mck
>Assignee: mck
>Priority: Major
> Fix For: 2.2.10, 3.0.14, 3.11.0, 4.0
>
>
> Starting up a node with {{-Dcassandra.join_ring=false}} in a cluster that has 
> authentication configured, eg PasswordAuthenticator, won't be able to serve 
> requests. This is because {{Auth.setup()}} never gets called during the 
> startup.
> Without {{Auth.setup()}} having been called in {{StorageService}} clients 
> connecting to the node fail with the node throwing
> {noformat}
> java.lang.NullPointerException
> at 
> org.apache.cassandra.auth.PasswordAuthenticator.authenticate(PasswordAuthenticator.java:119)
> at 
> org.apache.cassandra.thrift.CassandraServer.login(CassandraServer.java:1471)
> at 
> org.apache.cassandra.thrift.Cassandra$Processor$login.getResult(Cassandra.java:3505)
> at 
> org.apache.cassandra.thrift.Cassandra$Processor$login.getResult(Cassandra.java:3489)
> at org.apache.thrift.ProcessFunction.process(ProcessFunction.java:39)
> at org.apache.thrift.TBaseProcessor.process(TBaseProcessor.java:39)
> at com.thinkaurelius.thrift.Message.invoke(Message.java:314)
> at 
> com.thinkaurelius.thrift.Message$Invocation.execute(Message.java:90)
> at 
> com.thinkaurelius.thrift.TDisruptorServer$InvocationHandler.onEvent(TDisruptorServer.java:695)
> at 
> com.thinkaurelius.thrift.TDisruptorServer$InvocationHandler.onEvent(TDisruptorServer.java:689)
> at com.lmax.disruptor.WorkProcessor.run(WorkProcessor.java:112)
> at 
> java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1145)
> at 
> java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:615)
> at java.lang.Thread.run(Thread.java:745)
> {noformat}
> The exception thrown from the 
> [code|https://github.com/apache/cassandra/blob/cassandra-2.0.16/src/java/org/apache/cassandra/auth/PasswordAuthenticator.java#L119]
> {code}
> ResultMessage.Rows rows = 
> authenticateStatement.execute(QueryState.forInternalCalls(), new 
> QueryOptions(consistencyForUser(username),
>   
>Lists.newArrayList(ByteBufferUtil.bytes(username;
> {code}



--
This message was sent by Atlassian JIRA
(v7.6.3#76005)

-
To unsubscribe, e-mail: commits-unsubscr...@cassandra.apache.org
For additional commands, e-mail: commits-h...@cassandra.apache.org

[jira] [Comment Edited] (CASSANDRA-13929) BTree$Builder / io.netty.util.Recycler$Stack leaking memory

[Jay Zhuang (JIRA)]

[ 
https://issues.apache.org/jira/browse/CASSANDRA-13929?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16369517#comment-16369517
 ] 

Jay Zhuang edited comment on CASSANDRA-13929 at 2/19/18 8:58 PM:
-

Seems like the performance is better without {{Recycler}}. Here is microbench 
test result to build a BTree with and without {{Recycler}} 
([13929-3.11-perf|https://github.com/cooldoger/cassandra/tree/13929-3.11-perf]) 
(The score is operation per ms, higher is better)
{noformat}
 [java] Benchmark  (dataSize)  (treeBuilder)   
Mode  Cnt  Score   Error   Units
 [java] BTreeBuildBench.buildTreeTest   1  treeBuilderRecycleAdd  
thrpt6  23112.102 ? 17522.471  ops/ms
 [java] BTreeBuildBench.buildTreeTest   1 treeBuilderAdd  
thrpt6  46275.541 ? 60422.458  ops/ms
 [java] BTreeBuildBench.buildTreeTest   2  treeBuilderRecycleAdd  
thrpt6  23588.176 ? 16372.260  ops/ms
 [java] BTreeBuildBench.buildTreeTest   2 treeBuilderAdd  
thrpt6  42838.298 ? 25339.870  ops/ms
 [java] BTreeBuildBench.buildTreeTest   5  treeBuilderRecycleAdd  
thrpt6  24358.111 ? 24339.382  ops/ms
 [java] BTreeBuildBench.buildTreeTest   5 treeBuilderAdd  
thrpt6  60074.551 ? 47329.418  ops/ms
 [java] BTreeBuildBench.buildTreeTest  10  treeBuilderRecycleAdd  
thrpt6  21412.578 ?  6072.160  ops/ms
 [java] BTreeBuildBench.buildTreeTest  10 treeBuilderAdd  
thrpt6  50862.304 ? 30597.546  ops/ms
 [java] BTreeBuildBench.buildTreeTest  20  treeBuilderRecycleAdd  
thrpt6  15871.754 ?  5036.739  ops/ms
 [java] BTreeBuildBench.buildTreeTest  20 treeBuilderAdd  
thrpt6  33699.725 ? 10857.366  ops/ms
 [java] BTreeBuildBench.buildTreeTest  40  treeBuilderRecycleAdd  
thrpt6   5168.225 ?  1212.571  ops/ms
 [java] BTreeBuildBench.buildTreeTest  40 treeBuilderAdd  
thrpt6   8806.838 ?  7736.485  ops/ms
 [java] BTreeBuildBench.buildTreeTest 100  treeBuilderRecycleAdd  
thrpt6   2114.218 ?   639.589  ops/ms
 [java] BTreeBuildBench.buildTreeTest 100 treeBuilderAdd  
thrpt6   3213.333 ?   486.126  ops/ms
 [java] BTreeBuildBench.buildTreeTest1000  treeBuilderRecycleAdd  
thrpt6335.523 ?   101.230  ops/ms
 [java] BTreeBuildBench.buildTreeTest1000 treeBuilderAdd  
thrpt6386.678 ?   333.534  ops/ms
 [java] BTreeBuildBench.buildTreeTest   1  treeBuilderRecycleAdd  
thrpt6 35.644 ?32.171  ops/ms
 [java] BTreeBuildBench.buildTreeTest   1 treeBuilderAdd  
thrpt6 44.250 ? 8.180  ops/ms
 [java] BTreeBuildBench.buildTreeTest  10  treeBuilderRecycleAdd  
thrpt6  3.073 ? 2.165  ops/ms
 [java] BTreeBuildBench.buildTreeTest  10 treeBuilderAdd  
thrpt6  4.651 ? 4.137  ops/ms
{noformat}
And I think the performance gain for CASSANDRA-9766 is not because of the 
{{Recycler}} for BTree builder.

With {{Recycler}}, it does reduce the GC by reserving the memory. But for P95 
and sometimes P99, {{noRecycler}} is still better. Here is the test result with 
percentiles (score is time per operation, so smaller is better):
{noformat}
 [java] Benchmark(dataSize) 
 (treeBuilder)Mode   Cnt  Score   Error  Units
 [java] BTreeBuildBench.buildTreeTest 1  
treeBuilderRecycleAdd  sample   9244739   1435.033 ?   111.857  ns/op
 [java] BTreeBuildBench.buildTreeTest:buildTreeTest?p0.00 1  
treeBuilderRecycleAdd  sample   92.000  ns/op
 [java] BTreeBuildBench.buildTreeTest:buildTreeTest?p0.50 1  
treeBuilderRecycleAdd  sample  638.000  ns/op
 [java] BTreeBuildBench.buildTreeTest:buildTreeTest?p0.90 1  
treeBuilderRecycleAdd  sample 1688.000  ns/op
 [java] BTreeBuildBench.buildTreeTest:buildTreeTest?p0.95 1  
treeBuilderRecycleAdd  sample 2292.000  ns/op
 [java] BTreeBuildBench.buildTreeTest:buildTreeTest?p0.99 1  
treeBuilderRecycleAdd  sample 4544.000  ns/op
 [java] BTreeBuildBench.buildTreeTest:buildTreeTest?p0.9991  
treeBuilderRecycleAdd  sample13792.000  ns/op
 [java] BTreeBuildBench.buildTreeTest:buildTreeTest?p0.   1  
treeBuilderRecycleAdd  sample   124233.984  ns/op
 [java] BTreeBuildBench.buildTreeTest:buildTreeTest?p1.00 1  
treeBuilderRecycleAdd  sample104202240.000  ns/op
 

[jira] [Commented] (CASSANDRA-13929) BTree$Builder / io.netty.util.Recycler$Stack leaking memory

[Jay Zhuang (JIRA)]

[ 
https://issues.apache.org/jira/browse/CASSANDRA-13929?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16369517#comment-16369517
 ] 

Jay Zhuang commented on CASSANDRA-13929:


Seems like the performance is better without {{Recycler}}. Here is microbench 
test result to build a BTree with and without {{Recycler}} 
([13929-3.11-perf|https://github.com/cooldoger/cassandra/tree/13929-3.11-perf]) 
(The score is operation per ms, higher is better)
{noformat}
 [java] Benchmark  (dataSize)  (treeBuilder)   
Mode  Cnt  Score   Error   Units
 [java] BTreeBuildBench.buildTreeTest   1  treeBuilderRecycleAdd  
thrpt6  23112.102 ? 17522.471  ops/ms
 [java] BTreeBuildBench.buildTreeTest   1 treeBuilderAdd  
thrpt6  46275.541 ? 60422.458  ops/ms
 [java] BTreeBuildBench.buildTreeTest   2  treeBuilderRecycleAdd  
thrpt6  23588.176 ? 16372.260  ops/ms
 [java] BTreeBuildBench.buildTreeTest   2 treeBuilderAdd  
thrpt6  42838.298 ? 25339.870  ops/ms
 [java] BTreeBuildBench.buildTreeTest   5  treeBuilderRecycleAdd  
thrpt6  24358.111 ? 24339.382  ops/ms
 [java] BTreeBuildBench.buildTreeTest   5 treeBuilderAdd  
thrpt6  60074.551 ? 47329.418  ops/ms
 [java] BTreeBuildBench.buildTreeTest  10  treeBuilderRecycleAdd  
thrpt6  21412.578 ?  6072.160  ops/ms
 [java] BTreeBuildBench.buildTreeTest  10 treeBuilderAdd  
thrpt6  50862.304 ? 30597.546  ops/ms
 [java] BTreeBuildBench.buildTreeTest  20  treeBuilderRecycleAdd  
thrpt6  15871.754 ?  5036.739  ops/ms
 [java] BTreeBuildBench.buildTreeTest  20 treeBuilderAdd  
thrpt6  33699.725 ? 10857.366  ops/ms
 [java] BTreeBuildBench.buildTreeTest  40  treeBuilderRecycleAdd  
thrpt6   5168.225 ?  1212.571  ops/ms
 [java] BTreeBuildBench.buildTreeTest  40 treeBuilderAdd  
thrpt6   8806.838 ?  7736.485  ops/ms
 [java] BTreeBuildBench.buildTreeTest 100  treeBuilderRecycleAdd  
thrpt6   2114.218 ?   639.589  ops/ms
 [java] BTreeBuildBench.buildTreeTest 100 treeBuilderAdd  
thrpt6   3213.333 ?   486.126  ops/ms
 [java] BTreeBuildBench.buildTreeTest1000  treeBuilderRecycleAdd  
thrpt6335.523 ?   101.230  ops/ms
 [java] BTreeBuildBench.buildTreeTest1000 treeBuilderAdd  
thrpt6386.678 ?   333.534  ops/ms
 [java] BTreeBuildBench.buildTreeTest   1  treeBuilderRecycleAdd  
thrpt6 35.644 ?32.171  ops/ms
 [java] BTreeBuildBench.buildTreeTest   1 treeBuilderAdd  
thrpt6 44.250 ? 8.180  ops/ms
 [java] BTreeBuildBench.buildTreeTest  10  treeBuilderRecycleAdd  
thrpt6  3.073 ? 2.165  ops/ms
 [java] BTreeBuildBench.buildTreeTest  10 treeBuilderAdd  
thrpt6  4.651 ? 4.137  ops/ms
{noformat}
And I think the performance gain for CASSANDRA-9766 is not because of the 
{{Recycler}} for BTree builder.

With {{Recycler}}, it does reduce the GC by reserving the memory. But for P95 
and sometime P99, {{noRecycler}} is still better. Here is the test result with 
percentiles (score is time per operation, so smaller is better):
{noformat}
 [java] Benchmark(dataSize) 
 (treeBuilder)Mode   Cnt  Score   Error  Units
 [java] BTreeBuildBench.buildTreeTest 1  
treeBuilderRecycleAdd  sample   9244739   1435.033 ?   111.857  ns/op
 [java] BTreeBuildBench.buildTreeTest:buildTreeTest?p0.00 1  
treeBuilderRecycleAdd  sample   92.000  ns/op
 [java] BTreeBuildBench.buildTreeTest:buildTreeTest?p0.50 1  
treeBuilderRecycleAdd  sample  638.000  ns/op
 [java] BTreeBuildBench.buildTreeTest:buildTreeTest?p0.90 1  
treeBuilderRecycleAdd  sample 1688.000  ns/op
 [java] BTreeBuildBench.buildTreeTest:buildTreeTest?p0.95 1  
treeBuilderRecycleAdd  sample 2292.000  ns/op
 [java] BTreeBuildBench.buildTreeTest:buildTreeTest?p0.99 1  
treeBuilderRecycleAdd  sample 4544.000  ns/op
 [java] BTreeBuildBench.buildTreeTest:buildTreeTest?p0.9991  
treeBuilderRecycleAdd  sample13792.000  ns/op
 [java] BTreeBuildBench.buildTreeTest:buildTreeTest?p0.   1  
treeBuilderRecycleAdd  sample   124233.984  ns/op
 [java] BTreeBuildBench.buildTreeTest:buildTreeTest?p1.00 1  
treeBuilderRecycleAdd  sample104202240.000  ns/op
 [java] BTreeBuildBench.buildTreeTest

svn commit: r1824806 - in /cassandra/site: publish/download/index.html publish/index.html src/_data/releases.yaml

[mshuler]

Author: mshuler
Date: Mon Feb 19 19:28:03 2018
New Revision: 1824806

URL: http://svn.apache.org/viewvc?rev=1824806=rev
Log:
Update download page for 3.0.16 and 3.11.2 releases

Modified:
cassandra/site/publish/download/index.html
cassandra/site/publish/index.html
cassandra/site/src/_data/releases.yaml

Modified: cassandra/site/publish/download/index.html
URL: 
http://svn.apache.org/viewvc/cassandra/site/publish/download/index.html?rev=1824806=1824805=1824806=diff
==
--- cassandra/site/publish/download/index.html (original)
+++ cassandra/site/publish/download/index.html Mon Feb 19 19:28:03 2018
@@ -99,14 +99,14 @@
 
 Latest version
 
-Download the latest Apache Cassandra 3.11 release: http://www.apache.org/dyn/closer.lua/cassandra/3.11.1/apache-cassandra-3.11.1-bin.tar.gz;>3.11.1
 (http://www.apache.org/dist/cassandra/3.11.1/apache-cassandra-3.11.1-bin.tar.gz.asc;>pgp,
 http://www.apache.org/dist/cassandra/3.11.1/apache-cassandra-3.11.1-bin.tar.gz.md5;>md5
 and http://www.apache.org/dist/cassandra/3.11.1/apache-cassandra-3.11.1-bin.tar.gz.sha1;>sha1),
 released on 2017-10-10.
+Download the latest Apache Cassandra 3.11 release: http://www.apache.org/dyn/closer.lua/cassandra/3.11.2/apache-cassandra-3.11.2-bin.tar.gz;>3.11.2
 (http://www.apache.org/dist/cassandra/3.11.2/apache-cassandra-3.11.2-bin.tar.gz.asc;>pgp,
 http://www.apache.org/dist/cassandra/3.11.2/apache-cassandra-3.11.2-bin.tar.gz.md5;>md5
 and http://www.apache.org/dist/cassandra/3.11.2/apache-cassandra-3.11.2-bin.tar.gz.sha1;>sha1),
 released on 2018-02-19.
 
 Older supported releases
 
 The following older Cassandra releases are still supported:
 
 
-  Apache Cassandra 3.0 is supported until 6 months after 4.0 
release (date TBD). The latest release is http://www.apache.org/dyn/closer.lua/cassandra/3.0.15/apache-cassandra-3.0.15-bin.tar.gz;>3.0.15
 (http://www.apache.org/dist/cassandra/3.0.15/apache-cassandra-3.0.15-bin.tar.gz.asc;>pgp,
 http://www.apache.org/dist/cassandra/3.0.15/apache-cassandra-3.0.15-bin.tar.gz.md5;>md5
 and http://www.apache.org/dist/cassandra/3.0.15/apache-cassandra-3.0.15-bin.tar.gz.sha1;>sha1),
 released on 2017-10-10.
+  Apache Cassandra 3.0 is supported until 6 months after 4.0 
release (date TBD). The latest release is http://www.apache.org/dyn/closer.lua/cassandra/3.0.16/apache-cassandra-3.0.16-bin.tar.gz;>3.0.16
 (http://www.apache.org/dist/cassandra/3.0.16/apache-cassandra-3.0.16-bin.tar.gz.asc;>pgp,
 http://www.apache.org/dist/cassandra/3.0.16/apache-cassandra-3.0.16-bin.tar.gz.md5;>md5
 and http://www.apache.org/dist/cassandra/3.0.16/apache-cassandra-3.0.16-bin.tar.gz.sha1;>sha1),
 released on 2018-02-19.
   Apache Cassandra 2.2 is supported until 4.0 release (date 
TBD). The latest release is http://www.apache.org/dyn/closer.lua/cassandra/2.2.12/apache-cassandra-2.2.12-bin.tar.gz;>2.2.12
 (http://www.apache.org/dist/cassandra/2.2.12/apache-cassandra-2.2.12-bin.tar.gz.asc;>pgp,
 http://www.apache.org/dist/cassandra/2.2.12/apache-cassandra-2.2.12-bin.tar.gz.md5;>md5
 and http://www.apache.org/dist/cassandra/2.2.12/apache-cassandra-2.2.12-bin.tar.gz.sha1;>sha1),
 released on 2018-02-16.
   Apache Cassandra 2.1 is supported until 4.0 release (date 
TBD) with critical fixes only. The latest release is
 http://www.apache.org/dyn/closer.lua/cassandra/2.1.20/apache-cassandra-2.1.20-bin.tar.gz;>2.1.20
 (http://www.apache.org/dist/cassandra/2.1.20/apache-cassandra-2.1.20-bin.tar.gz.asc;>pgp,
 http://www.apache.org/dist/cassandra/2.1.20/apache-cassandra-2.1.20-bin.tar.gz.md5;>md5
 and http://www.apache.org/dist/cassandra/2.1.20/apache-cassandra-2.1.20-bin.tar.gz.sha1;>sha1),
 released on 2018-02-16.

Modified: cassandra/site/publish/index.html
URL: 
http://svn.apache.org/viewvc/cassandra/site/publish/index.html?rev=1824806=1824805=1824806=diff
==
--- cassandra/site/publish/index.html (original)
+++ cassandra/site/publish/index.html Mon Feb 19 19:28:03 2018
@@ -95,7 +95,7 @@
 
 
   http://git-wip-us.apache.org/repos/asf?p=cassandra.git;a=blob_plain;f=CHANGES.txt;hb=refs/tags/cassandra-3.11.1;>Cassandra
 3.11.1 Changelog
+ 
href="http://git-wip-us.apache.org/repos/asf?p=cassandra.git;a=blob_plain;f=CHANGES.txt;hb=refs/tags/cassandra-3.11.2;>Cassandra
 3.11.2 Changelog
   
 
   

Modified: cassandra/site/src/_data/releases.yaml
URL: 
http://svn.apache.org/viewvc/cassandra/site/src/_data/releases.yaml?rev=1824806=1824805=1824806=diff
==
--- cassandra/site/src/_data/releases.yaml (original)
+++ cassandra/site/src/_data/releases.yaml Mon Feb 19 19:28:03 2018
@@ -1,10 +1,10 @@
 latest:
-  name: "3.11.1"
-  date: 2017-10-10
+  name: "3.11.2"
+  date: 2018-02-19
 
 "3.0":
-  name: "3.0.15"
-  date: 2017-10-10
+  name: "3.0.16"
+  date: 

[jira] [Commented] (CASSANDRA-14200) NullPointerException when dumping sstable with null value for timestamp column

[Chris Lohfink (JIRA)]

[ 
https://issues.apache.org/jira/browse/CASSANDRA-14200?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16369434#comment-16369434
 ] 

Chris Lohfink commented on CASSANDRA-14200:
---

can you share sstable or schema or steps to reproduce?

> NullPointerException when dumping sstable with null value for timestamp column
> --
>
> Key: CASSANDRA-14200
> URL: https://issues.apache.org/jira/browse/CASSANDRA-14200
> Project: Cassandra
>  Issue Type: Bug
>Reporter: Simon Zhou
>Assignee: Simon Zhou
>Priority: Major
> Fix For: 3.0.x
>
>
> We have an sstable whose schema has a column of type timestamp and it's not 
> part of primary key. When dumping the sstable using sstabledump there is NPE 
> like this:
> {code:java}
> Exception in thread "main" java.lang.NullPointerException
> at java.util.Calendar.setTime(Calendar.java:1770)
> at java.text.SimpleDateFormat.format(SimpleDateFormat.java:943)
> at java.text.SimpleDateFormat.format(SimpleDateFormat.java:936)
> at java.text.DateFormat.format(DateFormat.java:345)
> at 
> org.apache.cassandra.db.marshal.TimestampType.toJSONString(TimestampType.java:93)
> at 
> org.apache.cassandra.tools.JsonTransformer.serializeCell(JsonTransformer.java:442)
> at 
> org.apache.cassandra.tools.JsonTransformer.serializeColumnData(JsonTransformer.java:376)
> at 
> org.apache.cassandra.tools.JsonTransformer.serializeRow(JsonTransformer.java:280)
> at 
> org.apache.cassandra.tools.JsonTransformer.serializePartition(JsonTransformer.java:215)
> at java.util.stream.ForEachOps$ForEachOp$OfRef.accept(ForEachOps.java:184)
> at java.util.stream.ReferencePipeline$2$1.accept(ReferencePipeline.java:175)
> at java.util.Iterator.forEachRemaining(Iterator.java:116)
> at 
> java.util.Spliterators$IteratorSpliterator.forEachRemaining(Spliterators.java:1801)
> at java.util.stream.AbstractPipeline.copyInto(AbstractPipeline.java:481)
> at 
> java.util.stream.AbstractPipeline.wrapAndCopyInto(AbstractPipeline.java:471)
> at 
> java.util.stream.ForEachOps$ForEachOp.evaluateSequential(ForEachOps.java:151)
> at 
> java.util.stream.ForEachOps$ForEachOp$OfRef.evaluateSequential(ForEachOps.java:174)
> at java.util.stream.AbstractPipeline.evaluate(AbstractPipeline.java:234)
> at java.util.stream.ReferencePipeline.forEach(ReferencePipeline.java:418)
> at org.apache.cassandra.tools.JsonTransformer.toJson(JsonTransformer.java:104)
> at org.apache.cassandra.tools.SSTableExport.main(SSTableExport.java:242){code}
> The reason is that we use a null Date when there is no value for this column:
> {code}
> public Date deserialize(ByteBuffer bytes)
> {
> return bytes.remaining() == 0 ? null : new 
> Date(ByteBufferUtil.toLong(bytes));
> }
> {code}
> It seems that we should not deserialize columns with null values.



--
This message was sent by Atlassian JIRA
(v7.6.3#76005)

-
To unsubscribe, e-mail: commits-unsubscr...@cassandra.apache.org
For additional commands, e-mail: commits-h...@cassandra.apache.org

svn commit: r25146 [2/2] - in /release/cassandra: 3.0.14/ 3.0.16/ 3.11.0/ 3.11.2/ debian/dists/30x/ debian/dists/30x/main/binary-amd64/ debian/dists/30x/main/binary-i386/ debian/dists/30x/main/source/

[mshuler]

Added: 
release/cassandra/redhat/311x/repodata/ee4b3b154f52858935a447c35b0843972469ef22b3977c0bc0e3a5f78ce0fa44-other.sqlite.bz2.asc
==
--- 
release/cassandra/redhat/311x/repodata/ee4b3b154f52858935a447c35b0843972469ef22b3977c0bc0e3a5f78ce0fa44-other.sqlite.bz2.asc
 (added)
+++ 
release/cassandra/redhat/311x/repodata/ee4b3b154f52858935a447c35b0843972469ef22b3977c0bc0e3a5f78ce0fa44-other.sqlite.bz2.asc
 Mon Feb 19 19:10:13 2018
@@ -0,0 +1,17 @@
+-BEGIN PGP SIGNATURE-
+Version: GnuPG v1
+
+iQIcBAABCAAGBQJaix7YAAoJEKJ4t4H+Syva1/AP/2dwJkseCKihnrgXKdwH+d3J
+hsCB492YPw62ZN7HrQ//SNHSzm2LnkhtE7hBOmubOU9fWh5HvJicE7zdFCHgGDrL
+Q8B7MRKko/vDX49wrzaO5LJT9jXv4Ql32UbPLz7mFsf5g936Dxqg+7/nFS2wuJnd
+hIBdZrObiv6DTVFpqUjBGMQ+Jmalkf2LhXerurAWnm7F9YlilQ/Wg+cFaXGE5gk0
+4ssZIE2G1c423VBv9s5x0ZK0KDxA74JnAS1s99L697YqgU/xm5L/np2K3/3YomtC
++gNpf8P9Y68FuLzZGTaBO9c+qwCFhQ+yN+2pX5yT06jS9HoWKYJbLtPh85I2MELC
+kHDzauIpIVu34dPuuL6nwP7KXPTQ9RPvDMtJ43dW/X2pTXj8iEKiOyLAZ0R98lQW
+BsapLMFLpcNWmCLQWivapTUBJLCuOboGdv6Y1A3vt4wJSOqtRrmWp5Xl9TxB7kQ8
+gf00UwNR/+AoaNT3JFQB5bx4zI1OV5/Hfvvlj3Bf8O1BXzyCWl8Gpuat2YWEiufk
+4jnPo2cSHevhGThwO+9VteVFXWT8gzapx0J+n9ribHMjnuNYv8ij1BrucnCQbGTO
+v8YeO5HEV+BPL3zA27Yq32otXKVCWKsslV/X4/h9ZhZOOTGsqBexaO0NSrijU0QV
+2XGI9vCEDPLRI90hoM65
+=BoCr
+-END PGP SIGNATURE-

Added: 
release/cassandra/redhat/311x/repodata/f90bbee49689a5b5e2ba3abcc7acc364d0e7eaa056f3bf6fb6781e53ac46ca12-primary.xml.gz
==
Binary file - no diff available.

Propchange: 
release/cassandra/redhat/311x/repodata/f90bbee49689a5b5e2ba3abcc7acc364d0e7eaa056f3bf6fb6781e53ac46ca12-primary.xml.gz
--
svn:mime-type = application/octet-stream

Modified: release/cassandra/redhat/311x/repodata/repomd.xml
==
--- release/cassandra/redhat/311x/repodata/repomd.xml (original)
+++ release/cassandra/redhat/311x/repodata/repomd.xml Mon Feb 19 19:10:13 2018
@@ -1,55 +1,55 @@
 
 http://linux.duke.edu/metadata/repo; 
xmlns:rpm="http://linux.duke.edu/metadata/rpm;>
- 1507667399
+ 1519066825
 
-  c1cc705a958336cc226d364c386373f96930486073525697b023dcc80d00e6b7
-  796d6fb07b20bcdd69d3c9461e98bccfed9735563edaceca822bae953e2dd6ab
-  
-  1507667400
-  2394
-  27795
+  2cd80bee869a1ebaa02922ab120c1bf10d3228b5ed53ab9cc19c368ac780d328
+  02f31e4ba47e82802750ecfcb6520a0909189188d941dccf869f3b2ed86eaeb5
+  
+  1519066826
+  2757
+  41796
 
 
-  2c7bc42537d98b816bda50c70fe6821fea6a4f28ebc84d7ddc540516a36c19d4
-  164f5fc3cce5d0815cb57bdf536b739368fdf12f903a29012845cd86d4e855d8
-  
-  1507667400
-  1960
-  15411
+  f90bbee49689a5b5e2ba3abcc7acc364d0e7eaa056f3bf6fb6781e53ac46ca12
+  00e00bf7933f64198ce27f6955a85dc421ca80415b0c699d5ffb495e2bc134aa
+  
+  1519066826
+  2294
+  23100
 
 
-  52bf89cd3d860765937698c4394de6970858e79d340c9d03ed414b19c07c023c
-  1bf399a92c46a8b23e5f87f94978a42eba2d8513df118fd886201b0663d7de0b
-  
-  1507667400
+  31e5ad37cff375cf3521038f746ae9e01b054fdcfe656295ebba9a1849edb732
+  e51015e1e1ca1a06b10ebd3429e926ec14da4fa4e075eedc869268bbd5db46f4
+  
+  1519066827
   10
-  6261
-  38912
+  8182
+  50176
 
 
-  f36475867e4cd68b55db42900c7eaa407ba72535c049172636475287196cc5c2
-  9deb1b386ad74fa0cfe4fca396694afba9eb538fd8e0e5ad032473001ce00238
-  
-  1507667400
+  ee4b3b154f52858935a447c35b0843972469ef22b3977c0bc0e3a5f78ce0fa44
+  c37e79a0ebd6990aa8de9585275aa45fbabf92377c890abbcc5f1ebc70bbadec
+  
+  1519066826
   10
-  1222
+  1479
   6144
 
 
-  5b989e501e8b50f6b9355948499c84c9cdb6cb32841a9f6143ed2fe28acac1a5
-  24ca74746c10ff8bf078dc5d424695ab86efb8b698f8f2ca474de21c4645f497
-  
-  1507667400
-  585
-  2071
+  5c7795df9cff4afbc87fc8a3993c7a4a92e58bddef2d924eac7f9728cc8e1234
+  5eda47730edbcd6a22b0afd1da438f7a0719c4a130097a8ccfb395f990d74720
+  
+  1519066826
+  723
+  3046
 
 
-  aa839740b4c4dc21f4bae4745af282d2745235118dd914571859e79ccaee2eeb
-  17e68a8212f3e9ca80360aafdeffcdaacdd46299195260c4b1814beae91bdf8c
-  
-  1507667400
+  24ed3d539ee9daec0a68ba6130d936b37f53f3e07c8d801e31b36698be95b7ac
+  3ac0422ece56b1748aa2d64196f27b3caea6bbd569c12af6c620a496e4cf3210
+  
+  1519066826
   10
-  4218
-  20480
+  5174
+  25600
 
 

Modified: release/cassandra/redhat/311x/repodata/repomd.xml.asc
==
--- release/cassandra/redhat/311x/repodata/repomd.xml.asc (original)
+++ release/cassandra/redhat/311x/repodata/repomd.xml.asc Mon Feb 19 19:10:13 
2018
@@ -1,17 +1,17 @@
 -BEGIN PGP SIGNATURE-
 Version: GnuPG v1
 
-iQIcBAABCAAGBQJZ3S3hAAoJEKJ4t4H+Syvap/UP/1wem5OdG5+W6X8zgjMn+vji
-tPkyVO3wQetwNB4eA6JTMwnEXFprSeQ/LIqzkRB6YDgOuJ17wQ+0E7lsVFE8Qk0C
-zQYnrcMIr5ghufiyEHTyMuWEhFKtf1f6kH2Z2vjkj8CFXagqnfSgdrOcgjkvbliu
-qg4DAHIz+sgV4vLbrZslbptDR+/idY7o4lmAnxlNkOsNRtzfKJHAjzXjaRD2t8SY

svn commit: r25146 [1/2] - in /release/cassandra: 3.0.14/ 3.0.16/ 3.11.0/ 3.11.2/ debian/dists/30x/ debian/dists/30x/main/binary-amd64/ debian/dists/30x/main/binary-i386/ debian/dists/30x/main/source/

[mshuler]

Author: mshuler
Date: Mon Feb 19 19:10:13 2018
New Revision: 25146

Log:
Release Apache Cassandra 3.0.16 and 3.11.2

Added:
release/cassandra/3.0.16/
release/cassandra/3.0.16/apache-cassandra-3.0.16-bin.tar.gz   (with props)
release/cassandra/3.0.16/apache-cassandra-3.0.16-bin.tar.gz.asc
release/cassandra/3.0.16/apache-cassandra-3.0.16-bin.tar.gz.asc.md5
release/cassandra/3.0.16/apache-cassandra-3.0.16-bin.tar.gz.asc.sha1
release/cassandra/3.0.16/apache-cassandra-3.0.16-bin.tar.gz.md5
release/cassandra/3.0.16/apache-cassandra-3.0.16-bin.tar.gz.sha1
release/cassandra/3.0.16/apache-cassandra-3.0.16-src.tar.gz   (with props)
release/cassandra/3.0.16/apache-cassandra-3.0.16-src.tar.gz.asc
release/cassandra/3.0.16/apache-cassandra-3.0.16-src.tar.gz.asc.md5
release/cassandra/3.0.16/apache-cassandra-3.0.16-src.tar.gz.asc.sha1
release/cassandra/3.0.16/apache-cassandra-3.0.16-src.tar.gz.md5
release/cassandra/3.0.16/apache-cassandra-3.0.16-src.tar.gz.sha1
release/cassandra/3.11.2/
release/cassandra/3.11.2/apache-cassandra-3.11.2-bin.tar.gz   (with props)
release/cassandra/3.11.2/apache-cassandra-3.11.2-bin.tar.gz.asc
release/cassandra/3.11.2/apache-cassandra-3.11.2-bin.tar.gz.asc.md5
release/cassandra/3.11.2/apache-cassandra-3.11.2-bin.tar.gz.asc.sha1
release/cassandra/3.11.2/apache-cassandra-3.11.2-bin.tar.gz.md5
release/cassandra/3.11.2/apache-cassandra-3.11.2-bin.tar.gz.sha1
release/cassandra/3.11.2/apache-cassandra-3.11.2-src.tar.gz   (with props)
release/cassandra/3.11.2/apache-cassandra-3.11.2-src.tar.gz.asc
release/cassandra/3.11.2/apache-cassandra-3.11.2-src.tar.gz.asc.md5
release/cassandra/3.11.2/apache-cassandra-3.11.2-src.tar.gz.asc.sha1
release/cassandra/3.11.2/apache-cassandra-3.11.2-src.tar.gz.md5
release/cassandra/3.11.2/apache-cassandra-3.11.2-src.tar.gz.sha1

release/cassandra/debian/pool/main/c/cassandra/cassandra-tools_3.0.16_all.deb   
(with props)

release/cassandra/debian/pool/main/c/cassandra/cassandra-tools_3.11.2_all.deb   
(with props)
release/cassandra/debian/pool/main/c/cassandra/cassandra_3.0.16.diff.gz   
(with props)
release/cassandra/debian/pool/main/c/cassandra/cassandra_3.0.16.dsc
release/cassandra/debian/pool/main/c/cassandra/cassandra_3.0.16.orig.tar.gz 
  (with props)

release/cassandra/debian/pool/main/c/cassandra/cassandra_3.0.16.orig.tar.gz.asc
release/cassandra/debian/pool/main/c/cassandra/cassandra_3.0.16_all.deb   
(with props)
release/cassandra/debian/pool/main/c/cassandra/cassandra_3.11.2.diff.gz   
(with props)
release/cassandra/debian/pool/main/c/cassandra/cassandra_3.11.2.dsc
release/cassandra/debian/pool/main/c/cassandra/cassandra_3.11.2.orig.tar.gz 
  (with props)

release/cassandra/debian/pool/main/c/cassandra/cassandra_3.11.2.orig.tar.gz.asc
release/cassandra/debian/pool/main/c/cassandra/cassandra_3.11.2_all.deb   
(with props)
release/cassandra/redhat/30x/cassandra-3.0.16-1.noarch.rpm   (with props)
release/cassandra/redhat/30x/cassandra-3.0.16-1.src.rpm   (with props)
release/cassandra/redhat/30x/cassandra-tools-3.0.16-1.noarch.rpm   (with 
props)

release/cassandra/redhat/30x/repodata/1c519e6816e6703491f679748cc785c0eea69143bde1ccc728409c53382ac8cc-primary.sqlite.bz2
   (with props)

release/cassandra/redhat/30x/repodata/1c519e6816e6703491f679748cc785c0eea69143bde1ccc728409c53382ac8cc-primary.sqlite.bz2.asc

release/cassandra/redhat/30x/repodata/203eb7226505158ce4c5c2e58956836c5fe7fad9192a9fdd01627a4cd5ec5ee9-primary.xml.gz
   (with props)

release/cassandra/redhat/30x/repodata/783c96158c9b31a751e36f32551959ac53f5bdd70e835dde25e1d0c7b249f0df-filelists.xml.gz
   (with props)

release/cassandra/redhat/30x/repodata/bda02a783cbbcb5948a261a910a9f9c890db2ee0bc4d190698a504f828d85f86-other.sqlite.bz2
   (with props)

release/cassandra/redhat/30x/repodata/bda02a783cbbcb5948a261a910a9f9c890db2ee0bc4d190698a504f828d85f86-other.sqlite.bz2.asc

release/cassandra/redhat/30x/repodata/dc2411f867de9e44ac5f7cfc82b385da0ffb15853fc72e9b9a8f2ba92ee31672-filelists.sqlite.bz2
   (with props)

release/cassandra/redhat/30x/repodata/dc2411f867de9e44ac5f7cfc82b385da0ffb15853fc72e9b9a8f2ba92ee31672-filelists.sqlite.bz2.asc

release/cassandra/redhat/30x/repodata/e2c443747e5e4ec0f0bdd90d7f15449d146083c480e531e1f300501341e5c869-other.xml.gz
   (with props)
release/cassandra/redhat/311x/cassandra-3.11.2-1.noarch.rpm   (with props)
release/cassandra/redhat/311x/cassandra-3.11.2-1.src.rpm   (with props)
release/cassandra/redhat/311x/cassandra-tools-3.11.2-1.noarch.rpm   (with 
props)

release/cassandra/redhat/311x/repodata/24ed3d539ee9daec0a68ba6130d936b37f53f3e07c8d801e31b36698be95b7ac-filelists.sqlite.bz2
   (with props)

release/cassandra/redhat/311x/repodata/24ed3d539ee9daec0a68ba6130d936b37f53f3e07c8d801e31b36698be95b7ac-filelists.sqlite.bz2.asc

[jira] [Assigned] (CASSANDRA-14241) Apache dtests not passing after pytest/python 3

[Marcus Eriksson (JIRA)]

 [ 
https://issues.apache.org/jira/browse/CASSANDRA-14241?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
 ]

Marcus Eriksson reassigned CASSANDRA-14241:
---

Assignee: Marcus Eriksson

> Apache dtests not passing after pytest/python 3
> ---
>
> Key: CASSANDRA-14241
> URL: https://issues.apache.org/jira/browse/CASSANDRA-14241
> Project: Cassandra
>  Issue Type: Task
>  Components: Testing
>Reporter: Ariel Weisberg
>Assignee: Marcus Eriksson
>Priority: Major
>
> Apache dtests are still not running correctly yet with pytest. Most of the 
> tests are running and passing but a solid chunk are still failing and these 
> are tests that don't fail in CircleCI.



--
This message was sent by Atlassian JIRA
(v7.6.3#76005)

-
To unsubscribe, e-mail: commits-unsubscr...@cassandra.apache.org
For additional commands, e-mail: commits-h...@cassandra.apache.org

[jira] [Commented] (CASSANDRA-14241) Apache dtests not passing after pytest/python 3

[Ariel Weisberg (JIRA)]

[ 
https://issues.apache.org/jira/browse/CASSANDRA-14241?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16369417#comment-16369417
 ] 

Ariel Weisberg commented on CASSANDRA-14241:


[~mkjellman] says Jolokia was broken before he started and he got it working in 
Docker for CircleCI but didn't fix it in Apache. He proposed using the Docker 
image we use for CircleCI for the Apache dtests so we get to a more consistent 
environment. Docker version 17.05.0-ce, build 89658be is installed on all the 
slaves so we can do it without waiting on INFRA, but I suspect it's a 
non-trivial amount of work to invoke Docker and then ensure the containers are 
cleaned up after.



> Apache dtests not passing after pytest/python 3
> ---
>
> Key: CASSANDRA-14241
> URL: https://issues.apache.org/jira/browse/CASSANDRA-14241
> Project: Cassandra
>  Issue Type: Task
>  Components: Testing
>Reporter: Ariel Weisberg
>Priority: Major
>
> Apache dtests are still not running correctly yet with pytest. Most of the 
> tests are running and passing but a solid chunk are still failing and these 
> are tests that don't fail in CircleCI.



--
This message was sent by Atlassian JIRA
(v7.6.3#76005)

-
To unsubscribe, e-mail: commits-unsubscr...@cassandra.apache.org
For additional commands, e-mail: commits-h...@cassandra.apache.org

[cassandra] Git Push Summary

[mshuler]

Repository: cassandra
Updated Tags:  refs/tags/cassandra-3.11.2 [created] 64b06fd0d

-
To unsubscribe, e-mail: commits-unsubscr...@cassandra.apache.org
For additional commands, e-mail: commits-h...@cassandra.apache.org

[cassandra] Git Push Summary

[mshuler]

Repository: cassandra
Updated Tags:  refs/tags/3.11.2-tentative [deleted] 1d506f9d0

-
To unsubscribe, e-mail: commits-unsubscr...@cassandra.apache.org
For additional commands, e-mail: commits-h...@cassandra.apache.org

[cassandra] Git Push Summary

[mshuler]

Repository: cassandra
Updated Tags:  refs/tags/cassandra-3.0.16 [created] fa13bd010

-
To unsubscribe, e-mail: commits-unsubscr...@cassandra.apache.org
For additional commands, e-mail: commits-h...@cassandra.apache.org

[cassandra] Git Push Summary

[mshuler]

Repository: cassandra
Updated Tags:  refs/tags/3.0.16-tentative [deleted] 890f31914

-
To unsubscribe, e-mail: commits-unsubscr...@cassandra.apache.org
For additional commands, e-mail: commits-h...@cassandra.apache.org

[jira] [Updated] (CASSANDRA-14210) Optimize SSTables upgrade task scheduling

[Marcus Eriksson (JIRA)]

 [ 
https://issues.apache.org/jira/browse/CASSANDRA-14210?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
 ]

Marcus Eriksson updated CASSANDRA-14210:

Reproduced In: 3.0.15, 2.2.11  (was: 2.2.11, 3.0.15)
   Status: Open  (was: Patch Available)

> Optimize SSTables upgrade task scheduling
> -
>
> Key: CASSANDRA-14210
> URL: https://issues.apache.org/jira/browse/CASSANDRA-14210
> Project: Cassandra
>  Issue Type: Improvement
>  Components: Compaction
>Reporter: Oleksandr Shulgin
>Assignee: Kurt Greaves
>Priority: Major
> Fix For: 4.x
>
>
> When starting the SSTable-rewrite process by running {{nodetool 
> upgradesstables --jobs N}}, with N > 1, not all of the provided N slots are 
> used.
> For example, we were testing with {{concurrent_compactors=5}} and {{N=4}}.  
> What we observed both for version 2.2 and 3.0, is that initially all 4 
> provided slots are used for "Upgrade sstables" compactions, but later when 
> some of the 4 tasks are finished, no new tasks are scheduled immediately.  It 
> takes the last of the 4 tasks to finish before new 4 tasks would be 
> scheduled.  This happens on every node we've observed.
> This doesn't utilize available resources to the full extent allowed by the 
> --jobs N parameter.  In the field, on a cluster of 12 nodes with 4-5 TiB data 
> each, we've seen that the whole process was taking more than 7 days, instead 
> of estimated 1.5-2 days (provided there would be close to full N slots 
> utilization).
> Instead, new tasks should be scheduled as soon as there is a free compaction 
> slot.
> Additionally, starting from the biggest SSTables could further reduce the 
> total time required for the whole process to finish on any given node.



--
This message was sent by Atlassian JIRA
(v7.6.3#76005)

-
To unsubscribe, e-mail: commits-unsubscr...@cassandra.apache.org
For additional commands, e-mail: commits-h...@cassandra.apache.org

[jira] [Commented] (CASSANDRA-14210) Optimize SSTables upgrade task scheduling

[Marcus Eriksson (JIRA)]

[ 
https://issues.apache.org/jira/browse/CASSANDRA-14210?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16369382#comment-16369382
 ] 

Marcus Eriksson commented on CASSANDRA-14210:
-

pushed a few improvments here: 
https://github.com/krummas/cassandra/commits/kgreav/14210

> Optimize SSTables upgrade task scheduling
> -
>
> Key: CASSANDRA-14210
> URL: https://issues.apache.org/jira/browse/CASSANDRA-14210
> Project: Cassandra
>  Issue Type: Improvement
>  Components: Compaction
>Reporter: Oleksandr Shulgin
>Assignee: Kurt Greaves
>Priority: Major
> Fix For: 4.x
>
>
> When starting the SSTable-rewrite process by running {{nodetool 
> upgradesstables --jobs N}}, with N > 1, not all of the provided N slots are 
> used.
> For example, we were testing with {{concurrent_compactors=5}} and {{N=4}}.  
> What we observed both for version 2.2 and 3.0, is that initially all 4 
> provided slots are used for "Upgrade sstables" compactions, but later when 
> some of the 4 tasks are finished, no new tasks are scheduled immediately.  It 
> takes the last of the 4 tasks to finish before new 4 tasks would be 
> scheduled.  This happens on every node we've observed.
> This doesn't utilize available resources to the full extent allowed by the 
> --jobs N parameter.  In the field, on a cluster of 12 nodes with 4-5 TiB data 
> each, we've seen that the whole process was taking more than 7 days, instead 
> of estimated 1.5-2 days (provided there would be close to full N slots 
> utilization).
> Instead, new tasks should be scheduled as soon as there is a free compaction 
> slot.
> Additionally, starting from the biggest SSTables could further reduce the 
> total time required for the whole process to finish on any given node.



--
This message was sent by Atlassian JIRA
(v7.6.3#76005)

-
To unsubscribe, e-mail: commits-unsubscr...@cassandra.apache.org
For additional commands, e-mail: commits-h...@cassandra.apache.org

[jira] [Updated] (CASSANDRA-14210) Optimize SSTables upgrade task scheduling

[Marcus Eriksson (JIRA)]

 [ 
https://issues.apache.org/jira/browse/CASSANDRA-14210?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
 ]

Marcus Eriksson updated CASSANDRA-14210:

Reproduced In: 3.0.15, 2.2.11  (was: 2.2.11, 3.0.15)
   Status: Awaiting Feedback  (was: Open)

> Optimize SSTables upgrade task scheduling
> -
>
> Key: CASSANDRA-14210
> URL: https://issues.apache.org/jira/browse/CASSANDRA-14210
> Project: Cassandra
>  Issue Type: Improvement
>  Components: Compaction
>Reporter: Oleksandr Shulgin
>Assignee: Kurt Greaves
>Priority: Major
> Fix For: 4.x
>
>
> When starting the SSTable-rewrite process by running {{nodetool 
> upgradesstables --jobs N}}, with N > 1, not all of the provided N slots are 
> used.
> For example, we were testing with {{concurrent_compactors=5}} and {{N=4}}.  
> What we observed both for version 2.2 and 3.0, is that initially all 4 
> provided slots are used for "Upgrade sstables" compactions, but later when 
> some of the 4 tasks are finished, no new tasks are scheduled immediately.  It 
> takes the last of the 4 tasks to finish before new 4 tasks would be 
> scheduled.  This happens on every node we've observed.
> This doesn't utilize available resources to the full extent allowed by the 
> --jobs N parameter.  In the field, on a cluster of 12 nodes with 4-5 TiB data 
> each, we've seen that the whole process was taking more than 7 days, instead 
> of estimated 1.5-2 days (provided there would be close to full N slots 
> utilization).
> Instead, new tasks should be scheduled as soon as there is a free compaction 
> slot.
> Additionally, starting from the biggest SSTables could further reduce the 
> total time required for the whole process to finish on any given node.



--
This message was sent by Atlassian JIRA
(v7.6.3#76005)

-
To unsubscribe, e-mail: commits-unsubscr...@cassandra.apache.org
For additional commands, e-mail: commits-h...@cassandra.apache.org

[jira] [Commented] (CASSANDRA-14241) Apache dtests not passing after pytest/python 3

[Ariel Weisberg (JIRA)]

[ 
https://issues.apache.org/jira/browse/CASSANDRA-14241?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16369297#comment-16369297
 ] 

Ariel Weisberg commented on CASSANDRA-14241:


{noformat}
==
jenkins-cassandra1
 17:37:21 up 195 days, 21:26,  0 users,  load average: 2.83, 2.57, 2.63
==
+ /home/jenkins/tools/java/latest1.8/bin/java -version
java version "1.8.0_152"
Java(TM) SE Runtime Environment (build 1.8.0_152-b16)
Java HotSpot(TM) 64-Bit Server VM (build 25.152-b16, mixed mode)
Finished: SUCCESS
Started by upstream project "Cassandra-slaves-util" build number 34
originally caused by:
 Started by user aweisberg
[EnvInject] - Loading node environment variables.
Building remotely on cassandra10 (cassandra) in workspace 
/home/jenkins/jenkins-slave/workspace/Cassandra-slaves-util/slave_label/cassandra10
Copying file to run_script.sh
[cassandra10] $ /bin/sh -e /tmp/jenkins5701964827218273567.sh
==
jenkins-cassandra10.apache.org
 16:37:22 up 171 days, 16:50,  0 users,  load average: 3.76, 4.99, 4.21
==
+ /home/jenkins/tools/java/latest1.8/bin/java -version
java version "1.8.0_152"
Java(TM) SE Runtime Environment (build 1.8.0_152-b16)
Java HotSpot(TM) 64-Bit Server VM (build 25.152-b16, mixed mode)
Finished: SUCCESS
Started by upstream project "Cassandra-slaves-util" build number 34
originally caused by:
 Started by user aweisberg
[EnvInject] - Loading node environment variables.
Building remotely on cassandra11 (cassandra) in workspace 
/home/jenkins/jenkins-slave/workspace/Cassandra-slaves-util/slave_label/cassandra11
Copying file to run_script.sh
[cassandra11] $ /bin/sh -e /tmp/jenkins536552494104545.sh
==
jenkins-cassandra11.apache.org
 16:37:22 up 171 days, 16:50,  0 users,  load average: 1.14, 1.79, 3.65
==
+ /home/jenkins/tools/java/latest1.8/bin/java -version
java version "1.8.0_152"
Java(TM) SE Runtime Environment (build 1.8.0_152-b16)
Java HotSpot(TM) 64-Bit Server VM (build 25.152-b16, mixed mode)
Finished: SUCCESS
Started by upstream project "Cassandra-slaves-util" build number 34
originally caused by:
 Started by user aweisberg
[EnvInject] - Loading node environment variables.
Building remotely on cassandra12 (cassandra) in workspace 
/home/jenkins/jenkins-slave/workspace/Cassandra-slaves-util/slave_label/cassandra12
Copying file to run_script.sh
[cassandra12] $ /bin/sh -e /tmp/jenkins8430724416943988183.sh
==
jenkins-cassandra12.apache.org
 16:37:22 up 171 days, 16:50,  0 users,  load average: 2.20, 2.34, 2.73
==
+ /home/jenkins/tools/java/latest1.8/bin/java -version
java version "1.8.0_152"
Java(TM) SE Runtime Environment (build 1.8.0_152-b16)
Java HotSpot(TM) 64-Bit Server VM (build 25.152-b16, mixed mode)
Finished: SUCCESS
Started by upstream project "Cassandra-slaves-util" build number 34
originally caused by:
 Started by user aweisberg
[EnvInject] - Loading node environment variables.
Building remotely on cassandra13 (cassandra) in workspace 
/home/jenkins/jenkins-slave/workspace/Cassandra-slaves-util/slave_label/cassandra13
Copying file to run_script.sh
[cassandra13] $ /bin/sh -e /tmp/jenkins2107839637611245472.sh
==
jenkins-cassandra13.apache.org
 16:37:21 up 171 days, 16:50,  0 users,  load average: 2.74, 2.31, 2.43
==
+ /home/jenkins/tools/java/latest1.8/bin/java -version
java version "1.8.0_152"
Java(TM) SE Runtime Environment (build 1.8.0_152-b16)
Java HotSpot(TM) 64-Bit Server VM (build 25.152-b16, mixed mode)
Finished: SUCCESS
Started by upstream project "Cassandra-slaves-util" build number 34
originally caused by:
 Started by user aweisberg
[EnvInject] - Loading node environment variables.
Building remotely on cassandra14 (cassandra) in workspace 
/home/jenkins/jenkins-slave/workspace/Cassandra-slaves-util/slave_label/cassandra14
Copying file to run_script.sh
[cassandra14] $ /bin/sh -e /tmp/jenkins867156827865353.sh
==
jenkins-cassandra14.apache.org
 16:37:23 up 171 days, 16:50,  0 users,  load average: 3.29, 2.87, 2.33
==
+ /home/jenkins/tools/java/latest1.8/bin/java -version
java version "1.8.0_144"
Java(TM) SE Runtime Environment (build 1.8.0_144-b01)
Java HotSpot(TM) 64-Bit Server VM (build 25.144-b01, mixed mode)
Finished: SUCCESS
Started by upstream project "Cassandra-slaves-util" build number 34
originally caused by:
 Started by user aweisberg
[EnvInject] - Loading node environment variables.
Building remotely on cassandra15 (cassandra) in workspace 
/home/jenkins/jenkins-slave/workspace/Cassandra-slaves-util/slave_label/cassandra15
Copying file to run_script.sh
[cassandra15] $ /bin/sh -e /tmp/jenkins1194137658354267002.sh
==

[jira] [Updated] (CASSANDRA-12763) Compaction performance issues when a table has a lot of sstables

[Marcus Eriksson (JIRA)]

 [ 
https://issues.apache.org/jira/browse/CASSANDRA-12763?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
 ]

Marcus Eriksson updated CASSANDRA-12763:

   Resolution: Fixed
Fix Version/s: (was: 3.11.x)
   (was: 4.x)
   (was: 3.0.x)
   3.11.3
   3.0.17
   4.0
   Status: Resolved  (was: Ready to Commit)

and committed as {{d73f45bad4cd6d8cf1cea7d9b35b76075dc277e1}}, thanks!

> Compaction performance issues when a table has a lot of sstables
> 
>
> Key: CASSANDRA-12763
> URL: https://issues.apache.org/jira/browse/CASSANDRA-12763
> Project: Cassandra
>  Issue Type: Bug
>  Components: Compaction
>Reporter: Tom van der Woerdt
>Assignee: Marcus Eriksson
>Priority: Major
> Fix For: 4.0, 3.0.17, 3.11.3
>
>
> An issue with a script flooded my cluster with sstables. There is now a table 
> with 100k sstables, all on the order of KBytes, and it's taking a long time 
> (ETA 20 days) to compact, even though the table is only ~30GB.
> Stack trace :
> {noformat}
> "CompactionExecutor:269" #7536 daemon prio=1 os_prio=4 tid=0x7f4acd40fc00 
> nid=0x14f8 runnable [0x7f4798436000]
>java.lang.Thread.State: RUNNABLE
>   at java.io.UnixFileSystem.list(Native Method)
>   at java.io.File.list(File.java:1122)
>   at java.io.File.listFiles(File.java:1248)
>   at 
> org.apache.cassandra.db.lifecycle.LogRecord.getExistingFiles(LogRecord.java:268)
>   at org.apache.cassandra.db.lifecycle.LogRecord.make(LogRecord.java:150)
>   at 
> org.apache.cassandra.db.lifecycle.LogFile.makeRecord(LogFile.java:293)
>   at org.apache.cassandra.db.lifecycle.LogFile.add(LogFile.java:283)
>   at 
> org.apache.cassandra.db.lifecycle.LogTransaction.obsoleted(LogTransaction.java:158)
>   at 
> org.apache.cassandra.db.lifecycle.Helpers.prepareForObsoletion(Helpers.java:134)
>   at 
> org.apache.cassandra.db.lifecycle.LifecycleTransaction.doPrepare(LifecycleTransaction.java:193)
>   at 
> org.apache.cassandra.utils.concurrent.Transactional$AbstractTransactional.prepareToCommit(Transactional.java:173)
>   at 
> org.apache.cassandra.io.sstable.SSTableRewriter.doPrepare(SSTableRewriter.java:376)
>   at 
> org.apache.cassandra.utils.concurrent.Transactional$AbstractTransactional.prepareToCommit(Transactional.java:173)
>   at 
> org.apache.cassandra.db.compaction.writers.CompactionAwareWriter.doPrepare(CompactionAwareWriter.java:84)
>   at 
> org.apache.cassandra.utils.concurrent.Transactional$AbstractTransactional.prepareToCommit(Transactional.java:173)
>   at 
> org.apache.cassandra.utils.concurrent.Transactional$AbstractTransactional.finish(Transactional.java:184)
>   at 
> org.apache.cassandra.db.compaction.writers.CompactionAwareWriter.finish(CompactionAwareWriter.java:94)
>   at 
> org.apache.cassandra.db.compaction.CompactionTask.runMayThrow(CompactionTask.java:194)
>   at 
> org.apache.cassandra.utils.WrappedRunnable.run(WrappedRunnable.java:28)
>   at 
> org.apache.cassandra.db.compaction.CompactionTask.executeInternal(CompactionTask.java:78)
>   at 
> org.apache.cassandra.db.compaction.AbstractCompactionTask.execute(AbstractCompactionTask.java:61)
>   at 
> org.apache.cassandra.db.compaction.CompactionManager$BackgroundCompactionCandidate.run(CompactionManager.java:263)
>   at 
> java.util.concurrent.Executors$RunnableAdapter.call(Executors.java:511)
>   at java.util.concurrent.FutureTask.run(FutureTask.java:266)
>   at 
> java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1142)
>   at 
> java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:617)
>   at java.lang.Thread.run(Thread.java:745)
> {noformat}
> listFiles is being called over and over, apparently scaling with the number 
> of files in the compaction.



--
This message was sent by Atlassian JIRA
(v7.6.3#76005)

-
To unsubscribe, e-mail: commits-unsubscr...@cassandra.apache.org
For additional commands, e-mail: commits-h...@cassandra.apache.org

[4/6] cassandra git commit: Merge branch 'cassandra-3.0' into cassandra-3.11

[marcuse]

Merge branch 'cassandra-3.0' into cassandra-3.11


Project: http://git-wip-us.apache.org/repos/asf/cassandra/repo
Commit: http://git-wip-us.apache.org/repos/asf/cassandra/commit/abd9be1e
Tree: http://git-wip-us.apache.org/repos/asf/cassandra/tree/abd9be1e
Diff: http://git-wip-us.apache.org/repos/asf/cassandra/diff/abd9be1e

Branch: refs/heads/trunk
Commit: abd9be1e4639c975b1fdf5d1ce26f6095236bb74
Parents: a798257 d73f45b
Author: Marcus Eriksson 
Authored: Mon Feb 19 07:53:43 2018 -0800
Committer: Marcus Eriksson 
Committed: Mon Feb 19 07:53:43 2018 -0800

--
 CHANGES.txt |  7 ++-
 .../apache/cassandra/db/lifecycle/Helpers.java  | 19 ++-
 .../apache/cassandra/db/lifecycle/LogFile.java  | 38 +++--
 .../cassandra/db/lifecycle/LogRecord.java   | 11 ++--
 .../cassandra/db/lifecycle/LogTransaction.java  | 33 ++--
 .../apache/cassandra/db/lifecycle/Tracker.java  |  2 +-
 .../cassandra/db/lifecycle/HelpersTest.java | 56 +---
 7 files changed, 79 insertions(+), 87 deletions(-)
--


http://git-wip-us.apache.org/repos/asf/cassandra/blob/abd9be1e/CHANGES.txt
--
diff --cc CHANGES.txt
index f8af8c4,8cf665e..33d5da3
--- a/CHANGES.txt
+++ b/CHANGES.txt
@@@ -1,40 -1,17 +1,43 @@@
 -3.0.17
 +3.11.3
 + * RateBasedBackPressure unnecessarily invokes a lock on the Guava 
RateLimiter (CASSANDRA-14163)
 + * Fix wildcard GROUP BY queries (CASSANDRA-14209)
- Merged from 2.2
++Merged from 3.0:
+  * Pre-create deletion log records to finish compactions quicker 
(CASSANDRA-12763)
 -Merged from 2.1:
 - * CVE-2017-5929 Security vulnerability in Logback warning in NEWS.txt 
(CASSANDRA-14183)
+ Merged from 2.2:
   * Backport circleci yaml (CASSANDRA-14240)
- Merged from 2.1
++Merged from 2.1:
 + * CVE-2017-5929 Security vulnerability in Logback warning in NEWS.txt 
(CASSANDRA-14183)
  
 -3.0.16
 - * Fix unit test failures in ViewComplexTest (CASSANDRA-14219)
 - * Add MinGW uname check to start scripts (CASSANDRA-12940)
 - * Protect against overflow of local expiration time (CASSANDRA-14092)
++
 +3.11.2
 + * Fix ReadCommandTest (CASSANDRA-14234)
 + * Remove trailing period from latency reports at keyspace level 
(CASSANDRA-14233)
 + * Backport CASSANDRA-13080: Use new token allocation for non bootstrap case 
as well (CASSANDRA-14212)
 + * Remove dependencies on JVM internal classes from JMXServerUtils 
(CASSANDRA-14173) 
 + * Add DEFAULT, UNSET, MBEAN and MBEANS to `ReservedKeywords` 
(CASSANDRA-14205)
 + * Add Unittest for schema migration fix (CASSANDRA-14140)
 + * Print correct snitch info from nodetool describecluster (CASSANDRA-13528)
 + * Close socket on error during connect on OutboundTcpConnection 
(CASSANDRA-9630)
 + * Enable CDC unittest (CASSANDRA-14141)
 + * Acquire read lock before accessing CompactionStrategyManager fields 
(CASSANDRA-14139)
 + * Split CommitLogStressTest to avoid timeout (CASSANDRA-14143)
 + * Avoid invalidating disk boundaries unnecessarily (CASSANDRA-14083)
 + * Avoid exposing compaction strategy index externally (CASSANDRA-14082)
 + * Prevent continuous schema exchange between 3.0 and 3.11 nodes 
(CASSANDRA-14109)
 + * Fix imbalanced disks when replacing node with same address with JBOD 
(CASSANDRA-14084)
 + * Reload compaction strategies when disk boundaries are invalidated 
(CASSANDRA-13948)
 + * Remove OpenJDK log warning (CASSANDRA-13916)
 + * Prevent compaction strategies from looping indefinitely (CASSANDRA-14079)
 + * Cache disk boundaries (CASSANDRA-13215)
 + * Add asm jar to build.xml for maven builds (CASSANDRA-11193)
 + * Round buffer size to powers of 2 for the chunk cache (CASSANDRA-13897)
 + * Update jackson JSON jars (CASSANDRA-13949)
 + * Avoid locks when checking LCS fanout and if we should defrag 
(CASSANDRA-13930)
 + * Correctly count range tombstones in traces and tombstone thresholds 
(CASSANDRA-8527)
 +Merged from 3.0:
 + * Add MinGW uname check to start scripts (CASSANDRA-12840)
   * Use the correct digest file and reload sstable metadata in nodetool verify 
(CASSANDRA-14217)
   * Handle failure when mutating repaired status in Verifier (CASSANDRA-13933)
 - * Close socket on error during connect on OutboundTcpConnection 
(CASSANDRA-9630)
   * Set encoding for javadoc generation (CASSANDRA-14154)
   * Fix index target computation for dense composite tables with dropped 
compact storage (CASSANDRA-14104)
   * Improve commit log chain marker updating (CASSANDRA-14108)

http://git-wip-us.apache.org/repos/asf/cassandra/blob/abd9be1e/src/java/org/apache/cassandra/db/lifecycle/LogFile.java
--
diff --cc src/java/org/apache/cassandra/db/lifecycle/LogFile.java
index 123dd8a,8425a6d..af6f435
--- 

[6/6] cassandra git commit: Merge branch 'cassandra-3.11' into trunk

[marcuse]

Merge branch 'cassandra-3.11' into trunk


Project: http://git-wip-us.apache.org/repos/asf/cassandra/repo
Commit: http://git-wip-us.apache.org/repos/asf/cassandra/commit/72077203
Tree: http://git-wip-us.apache.org/repos/asf/cassandra/tree/72077203
Diff: http://git-wip-us.apache.org/repos/asf/cassandra/diff/72077203

Branch: refs/heads/trunk
Commit: 720772033a1f92b422065a307dcacc5f024b9c07
Parents: 32110d6 abd9be1
Author: Marcus Eriksson 
Authored: Mon Feb 19 07:54:33 2018 -0800
Committer: Marcus Eriksson 
Committed: Mon Feb 19 07:54:33 2018 -0800

--
 CHANGES.txt |  2 +
 .../apache/cassandra/db/lifecycle/Helpers.java  | 19 ++-
 .../apache/cassandra/db/lifecycle/LogFile.java  | 38 +++--
 .../cassandra/db/lifecycle/LogRecord.java   | 11 ++--
 .../cassandra/db/lifecycle/LogTransaction.java  | 33 ++--
 .../apache/cassandra/db/lifecycle/Tracker.java  |  2 +-
 .../cassandra/db/lifecycle/HelpersTest.java | 56 +---
 7 files changed, 76 insertions(+), 85 deletions(-)
--


http://git-wip-us.apache.org/repos/asf/cassandra/blob/72077203/CHANGES.txt
--
diff --cc CHANGES.txt
index 251a5f1,33d5da3..40b18ae
--- a/CHANGES.txt
+++ b/CHANGES.txt
@@@ -1,201 -1,12 +1,203 @@@
 +4.0
 + * Add a few options to nodetool verify (CASSANDRA-14201)
 + * CVE-2017-5929 Security vulnerability and redefine default log rotation 
policy (CASSANDRA-14183)
 + * Use JVM default SSL validation algorithm instead of custom default 
(CASSANDRA-13259)
 + * Better document in code InetAddressAndPort usage post 7544, incorporate 
port into UUIDGen node (CASSANDRA-14226)
 + * Fix sstablemetadata date string for minLocalDeletionTime (CASSANDRA-14132)
 + * Make it possible to change neverPurgeTombstones during runtime 
(CASSANDRA-14214)
 + * Remove GossipDigestSynVerbHandler#doSort() (CASSANDRA-14174)
 + * Add nodetool clientlist (CASSANDRA-13665)
 + * Revert ProtocolVersion changes from CASSANDRA-7544 (CASSANDRA-14211)
 + * Non-disruptive seed node list reload (CASSANDRA-14190)
 + * Nodetool tablehistograms to print statics for all the tables 
(CASSANDRA-14185)
 + * Migrate dtests to use pytest and python3 (CASSANDRA-14134)
 + * Allow storage port to be configurable per node (CASSANDRA-7544)
 + * Make sub-range selection for non-frozen collections return null instead of 
empty (CASSANDRA-14182)
 + * BloomFilter serialization format should not change byte ordering 
(CASSANDRA-9067)
 + * Remove unused on-heap BloomFilter implementation (CASSANDRA-14152)
 + * Delete temp test files on exit (CASSANDRA-14153)
 + * Make PartitionUpdate and Mutation immutable (CASSANDRA-13867)
 + * Fix CommitLogReplayer exception for CDC data (CASSANDRA-14066)
 + * Fix cassandra-stress startup failure (CASSANDRA-14106)
 + * Remove initialDirectories from CFS (CASSANDRA-13928)
 + * Fix trivial log format error (CASSANDRA-14015)
 + * Allow sstabledump to do a json object per partition (CASSANDRA-13848)
 + * Add option to optimise merkle tree comparison across replicas 
(CASSANDRA-3200)
 + * Remove unused and deprecated methods from AbstractCompactionStrategy 
(CASSANDRA-14081)
 + * Fix Distribution.average in cassandra-stress (CASSANDRA-14090)
 + * Support a means of logging all queries as they were invoked 
(CASSANDRA-13983)
 + * Presize collections (CASSANDRA-13760)
 + * Add GroupCommitLogService (CASSANDRA-13530)
 + * Parallelize initial materialized view build (CASSANDRA-12245)
 + * Fix flaky SecondaryIndexManagerTest.assert[Not]MarkedAsBuilt 
(CASSANDRA-13965)
 + * Make LWTs send resultset metadata on every request (CASSANDRA-13992)
 + * Fix flaky indexWithFailedInitializationIsNotQueryableAfterPartialRebuild 
(CASSANDRA-13963)
 + * Introduce leaf-only iterator (CASSANDRA-9988)
 + * Upgrade Guava to 23.3 and Airline to 0.8 (CASSANDRA-13997)
 + * Allow only one concurrent call to StatusLogger (CASSANDRA-12182)
 + * Refactoring to specialised functional interfaces (CASSANDRA-13982)
 + * Speculative retry should allow more friendly params (CASSANDRA-13876)
 + * Throw exception if we send/receive repair messages to incompatible nodes 
(CASSANDRA-13944)
 + * Replace usages of MessageDigest with Guava's Hasher (CASSANDRA-13291)
 + * Add nodetool cmd to print hinted handoff window (CASSANDRA-13728)
 + * Fix some alerts raised by static analysis (CASSANDRA-13799)
 + * Checksum sstable metadata (CASSANDRA-13321, CASSANDRA-13593)
 + * Add result set metadata to prepared statement MD5 hash calculation 
(CASSANDRA-10786)
 + * Refactor GcCompactionTest to avoid boxing (CASSANDRA-13941)
 + * Expose recent histograms in JmxHistograms (CASSANDRA-13642)
 + * Fix buffer length comparison when decompressing in netty-based streaming 
(CASSANDRA-13899)
 + * Properly close 

[3/6] cassandra git commit: Pre-create deletion log records to finish compactions quicker

[marcuse]

Pre-create deletion log records to finish compactions quicker

Patch by marcuse; reviewed by Stefania Alborghetti for CASSANDRA-12763


Project: http://git-wip-us.apache.org/repos/asf/cassandra/repo
Commit: http://git-wip-us.apache.org/repos/asf/cassandra/commit/d73f45ba
Tree: http://git-wip-us.apache.org/repos/asf/cassandra/tree/d73f45ba
Diff: http://git-wip-us.apache.org/repos/asf/cassandra/diff/d73f45ba

Branch: refs/heads/trunk
Commit: d73f45bad4cd6d8cf1cea7d9b35b76075dc277e1
Parents: f39e28d
Author: Marcus Eriksson 
Authored: Mon Dec 11 15:11:20 2017 +0100
Committer: Marcus Eriksson 
Committed: Mon Feb 19 07:52:20 2018 -0800

--
 CHANGES.txt |  1 +
 .../apache/cassandra/db/lifecycle/Helpers.java  | 19 ++-
 .../apache/cassandra/db/lifecycle/LogFile.java  | 37 +++--
 .../cassandra/db/lifecycle/LogRecord.java   | 11 ++--
 .../cassandra/db/lifecycle/LogTransaction.java  | 33 ++--
 .../apache/cassandra/db/lifecycle/Tracker.java  |  2 +-
 .../cassandra/db/lifecycle/HelpersTest.java | 56 +---
 7 files changed, 74 insertions(+), 85 deletions(-)
--


http://git-wip-us.apache.org/repos/asf/cassandra/blob/d73f45ba/CHANGES.txt
--
diff --git a/CHANGES.txt b/CHANGES.txt
index 14a62a4..8cf665e 100644
--- a/CHANGES.txt
+++ b/CHANGES.txt
@@ -1,4 +1,5 @@
 3.0.17
+ * Pre-create deletion log records to finish compactions quicker 
(CASSANDRA-12763)
 Merged from 2.1:
  * CVE-2017-5929 Security vulnerability in Logback warning in NEWS.txt 
(CASSANDRA-14183)
 Merged from 2.2:

http://git-wip-us.apache.org/repos/asf/cassandra/blob/d73f45ba/src/java/org/apache/cassandra/db/lifecycle/Helpers.java
--
diff --git a/src/java/org/apache/cassandra/db/lifecycle/Helpers.java 
b/src/java/org/apache/cassandra/db/lifecycle/Helpers.java
index b9adc4b..8e0d514 100644
--- a/src/java/org/apache/cassandra/db/lifecycle/Helpers.java
+++ b/src/java/org/apache/cassandra/db/lifecycle/Helpers.java
@@ -22,6 +22,7 @@ import java.util.*;
 import com.google.common.base.Predicate;
 import com.google.common.collect.*;
 
+import org.apache.cassandra.io.sstable.SSTable;
 import org.apache.cassandra.io.sstable.format.SSTableReader;
 import org.apache.cassandra.utils.Throwables;
 
@@ -127,11 +128,12 @@ class Helpers
 
 static Throwable prepareForObsoletion(Iterable readers, 
LogTransaction txnLogs, List obsoletions, Throwable 
accumulate)
 {
+Map logRecords = 
txnLogs.makeRemoveRecords(readers);
 for (SSTableReader reader : readers)
 {
 try
 {
-obsoletions.add(new LogTransaction.Obsoletion(reader, 
txnLogs.obsoleted(reader)));
+obsoletions.add(new LogTransaction.Obsoletion(reader, 
txnLogs.obsoleted(reader, logRecords.get(reader;
 }
 catch (Throwable t)
 {
@@ -141,21 +143,6 @@ class Helpers
 return accumulate;
 }
 
-static Throwable prepareForBulkObsoletion(Iterable readers, 
LogTransaction txnLogs, List obsoletions, Throwable 
accumulate)
-{
-try
-{
-for (Map.Entry entry 
: txnLogs.bulkObsoletion(readers).entrySet())
-obsoletions.add(new LogTransaction.Obsoletion(entry.getKey(), 
entry.getValue()));
-}
-catch (Throwable t)
-{
-accumulate = Throwables.merge(accumulate, t);
-}
-
-return accumulate;
-}
-
 static Throwable abortObsoletion(List 
obsoletions, Throwable accumulate)
 {
 if (obsoletions == null || obsoletions.isEmpty())

http://git-wip-us.apache.org/repos/asf/cassandra/blob/d73f45ba/src/java/org/apache/cassandra/db/lifecycle/LogFile.java
--
diff --git a/src/java/org/apache/cassandra/db/lifecycle/LogFile.java 
b/src/java/org/apache/cassandra/db/lifecycle/LogFile.java
index be26163..8425a6d 100644
--- a/src/java/org/apache/cassandra/db/lifecycle/LogFile.java
+++ b/src/java/org/apache/cassandra/db/lifecycle/LogFile.java
@@ -281,18 +281,23 @@ final class LogFile implements AutoCloseable
 
 void add(Type type, SSTable table)
 {
-if (!addRecord(makeRecord(type, table)))
+add(makeRecord(type, table));
+}
+
+void add(LogRecord record)
+{
+if (!addRecord(record))
 throw new IllegalStateException();
 }
 
 public void addAll(Type type, Iterable toBulkAdd)
 {
-for (LogRecord record : makeRecords(type, toBulkAdd))
+for (LogRecord record : makeRecords(type, toBulkAdd).values())
 if 

[5/6] cassandra git commit: Merge branch 'cassandra-3.0' into cassandra-3.11

[marcuse]

Merge branch 'cassandra-3.0' into cassandra-3.11


Project: http://git-wip-us.apache.org/repos/asf/cassandra/repo
Commit: http://git-wip-us.apache.org/repos/asf/cassandra/commit/abd9be1e
Tree: http://git-wip-us.apache.org/repos/asf/cassandra/tree/abd9be1e
Diff: http://git-wip-us.apache.org/repos/asf/cassandra/diff/abd9be1e

Branch: refs/heads/cassandra-3.11
Commit: abd9be1e4639c975b1fdf5d1ce26f6095236bb74
Parents: a798257 d73f45b
Author: Marcus Eriksson 
Authored: Mon Feb 19 07:53:43 2018 -0800
Committer: Marcus Eriksson 
Committed: Mon Feb 19 07:53:43 2018 -0800

--
 CHANGES.txt |  7 ++-
 .../apache/cassandra/db/lifecycle/Helpers.java  | 19 ++-
 .../apache/cassandra/db/lifecycle/LogFile.java  | 38 +++--
 .../cassandra/db/lifecycle/LogRecord.java   | 11 ++--
 .../cassandra/db/lifecycle/LogTransaction.java  | 33 ++--
 .../apache/cassandra/db/lifecycle/Tracker.java  |  2 +-
 .../cassandra/db/lifecycle/HelpersTest.java | 56 +---
 7 files changed, 79 insertions(+), 87 deletions(-)
--


http://git-wip-us.apache.org/repos/asf/cassandra/blob/abd9be1e/CHANGES.txt
--
diff --cc CHANGES.txt
index f8af8c4,8cf665e..33d5da3
--- a/CHANGES.txt
+++ b/CHANGES.txt
@@@ -1,40 -1,17 +1,43 @@@
 -3.0.17
 +3.11.3
 + * RateBasedBackPressure unnecessarily invokes a lock on the Guava 
RateLimiter (CASSANDRA-14163)
 + * Fix wildcard GROUP BY queries (CASSANDRA-14209)
- Merged from 2.2
++Merged from 3.0:
+  * Pre-create deletion log records to finish compactions quicker 
(CASSANDRA-12763)
 -Merged from 2.1:
 - * CVE-2017-5929 Security vulnerability in Logback warning in NEWS.txt 
(CASSANDRA-14183)
+ Merged from 2.2:
   * Backport circleci yaml (CASSANDRA-14240)
- Merged from 2.1
++Merged from 2.1:
 + * CVE-2017-5929 Security vulnerability in Logback warning in NEWS.txt 
(CASSANDRA-14183)
  
 -3.0.16
 - * Fix unit test failures in ViewComplexTest (CASSANDRA-14219)
 - * Add MinGW uname check to start scripts (CASSANDRA-12940)
 - * Protect against overflow of local expiration time (CASSANDRA-14092)
++
 +3.11.2
 + * Fix ReadCommandTest (CASSANDRA-14234)
 + * Remove trailing period from latency reports at keyspace level 
(CASSANDRA-14233)
 + * Backport CASSANDRA-13080: Use new token allocation for non bootstrap case 
as well (CASSANDRA-14212)
 + * Remove dependencies on JVM internal classes from JMXServerUtils 
(CASSANDRA-14173) 
 + * Add DEFAULT, UNSET, MBEAN and MBEANS to `ReservedKeywords` 
(CASSANDRA-14205)
 + * Add Unittest for schema migration fix (CASSANDRA-14140)
 + * Print correct snitch info from nodetool describecluster (CASSANDRA-13528)
 + * Close socket on error during connect on OutboundTcpConnection 
(CASSANDRA-9630)
 + * Enable CDC unittest (CASSANDRA-14141)
 + * Acquire read lock before accessing CompactionStrategyManager fields 
(CASSANDRA-14139)
 + * Split CommitLogStressTest to avoid timeout (CASSANDRA-14143)
 + * Avoid invalidating disk boundaries unnecessarily (CASSANDRA-14083)
 + * Avoid exposing compaction strategy index externally (CASSANDRA-14082)
 + * Prevent continuous schema exchange between 3.0 and 3.11 nodes 
(CASSANDRA-14109)
 + * Fix imbalanced disks when replacing node with same address with JBOD 
(CASSANDRA-14084)
 + * Reload compaction strategies when disk boundaries are invalidated 
(CASSANDRA-13948)
 + * Remove OpenJDK log warning (CASSANDRA-13916)
 + * Prevent compaction strategies from looping indefinitely (CASSANDRA-14079)
 + * Cache disk boundaries (CASSANDRA-13215)
 + * Add asm jar to build.xml for maven builds (CASSANDRA-11193)
 + * Round buffer size to powers of 2 for the chunk cache (CASSANDRA-13897)
 + * Update jackson JSON jars (CASSANDRA-13949)
 + * Avoid locks when checking LCS fanout and if we should defrag 
(CASSANDRA-13930)
 + * Correctly count range tombstones in traces and tombstone thresholds 
(CASSANDRA-8527)
 +Merged from 3.0:
 + * Add MinGW uname check to start scripts (CASSANDRA-12840)
   * Use the correct digest file and reload sstable metadata in nodetool verify 
(CASSANDRA-14217)
   * Handle failure when mutating repaired status in Verifier (CASSANDRA-13933)
 - * Close socket on error during connect on OutboundTcpConnection 
(CASSANDRA-9630)
   * Set encoding for javadoc generation (CASSANDRA-14154)
   * Fix index target computation for dense composite tables with dropped 
compact storage (CASSANDRA-14104)
   * Improve commit log chain marker updating (CASSANDRA-14108)

http://git-wip-us.apache.org/repos/asf/cassandra/blob/abd9be1e/src/java/org/apache/cassandra/db/lifecycle/LogFile.java
--
diff --cc src/java/org/apache/cassandra/db/lifecycle/LogFile.java
index 123dd8a,8425a6d..af6f435
--- 

[1/6] cassandra git commit: Pre-create deletion log records to finish compactions quicker

[marcuse]

Repository: cassandra
Updated Branches:
  refs/heads/cassandra-3.0 f39e28dc7 -> d73f45bad
  refs/heads/cassandra-3.11 a798257ce -> abd9be1e4
  refs/heads/trunk 32110d6d2 -> 720772033


Pre-create deletion log records to finish compactions quicker

Patch by marcuse; reviewed by Stefania Alborghetti for CASSANDRA-12763


Project: http://git-wip-us.apache.org/repos/asf/cassandra/repo
Commit: http://git-wip-us.apache.org/repos/asf/cassandra/commit/d73f45ba
Tree: http://git-wip-us.apache.org/repos/asf/cassandra/tree/d73f45ba
Diff: http://git-wip-us.apache.org/repos/asf/cassandra/diff/d73f45ba

Branch: refs/heads/cassandra-3.0
Commit: d73f45bad4cd6d8cf1cea7d9b35b76075dc277e1
Parents: f39e28d
Author: Marcus Eriksson 
Authored: Mon Dec 11 15:11:20 2017 +0100
Committer: Marcus Eriksson 
Committed: Mon Feb 19 07:52:20 2018 -0800

--
 CHANGES.txt |  1 +
 .../apache/cassandra/db/lifecycle/Helpers.java  | 19 ++-
 .../apache/cassandra/db/lifecycle/LogFile.java  | 37 +++--
 .../cassandra/db/lifecycle/LogRecord.java   | 11 ++--
 .../cassandra/db/lifecycle/LogTransaction.java  | 33 ++--
 .../apache/cassandra/db/lifecycle/Tracker.java  |  2 +-
 .../cassandra/db/lifecycle/HelpersTest.java | 56 +---
 7 files changed, 74 insertions(+), 85 deletions(-)
--


http://git-wip-us.apache.org/repos/asf/cassandra/blob/d73f45ba/CHANGES.txt
--
diff --git a/CHANGES.txt b/CHANGES.txt
index 14a62a4..8cf665e 100644
--- a/CHANGES.txt
+++ b/CHANGES.txt
@@ -1,4 +1,5 @@
 3.0.17
+ * Pre-create deletion log records to finish compactions quicker 
(CASSANDRA-12763)
 Merged from 2.1:
  * CVE-2017-5929 Security vulnerability in Logback warning in NEWS.txt 
(CASSANDRA-14183)
 Merged from 2.2:

http://git-wip-us.apache.org/repos/asf/cassandra/blob/d73f45ba/src/java/org/apache/cassandra/db/lifecycle/Helpers.java
--
diff --git a/src/java/org/apache/cassandra/db/lifecycle/Helpers.java 
b/src/java/org/apache/cassandra/db/lifecycle/Helpers.java
index b9adc4b..8e0d514 100644
--- a/src/java/org/apache/cassandra/db/lifecycle/Helpers.java
+++ b/src/java/org/apache/cassandra/db/lifecycle/Helpers.java
@@ -22,6 +22,7 @@ import java.util.*;
 import com.google.common.base.Predicate;
 import com.google.common.collect.*;
 
+import org.apache.cassandra.io.sstable.SSTable;
 import org.apache.cassandra.io.sstable.format.SSTableReader;
 import org.apache.cassandra.utils.Throwables;
 
@@ -127,11 +128,12 @@ class Helpers
 
 static Throwable prepareForObsoletion(Iterable readers, 
LogTransaction txnLogs, List obsoletions, Throwable 
accumulate)
 {
+Map logRecords = 
txnLogs.makeRemoveRecords(readers);
 for (SSTableReader reader : readers)
 {
 try
 {
-obsoletions.add(new LogTransaction.Obsoletion(reader, 
txnLogs.obsoleted(reader)));
+obsoletions.add(new LogTransaction.Obsoletion(reader, 
txnLogs.obsoleted(reader, logRecords.get(reader;
 }
 catch (Throwable t)
 {
@@ -141,21 +143,6 @@ class Helpers
 return accumulate;
 }
 
-static Throwable prepareForBulkObsoletion(Iterable readers, 
LogTransaction txnLogs, List obsoletions, Throwable 
accumulate)
-{
-try
-{
-for (Map.Entry entry 
: txnLogs.bulkObsoletion(readers).entrySet())
-obsoletions.add(new LogTransaction.Obsoletion(entry.getKey(), 
entry.getValue()));
-}
-catch (Throwable t)
-{
-accumulate = Throwables.merge(accumulate, t);
-}
-
-return accumulate;
-}
-
 static Throwable abortObsoletion(List 
obsoletions, Throwable accumulate)
 {
 if (obsoletions == null || obsoletions.isEmpty())

http://git-wip-us.apache.org/repos/asf/cassandra/blob/d73f45ba/src/java/org/apache/cassandra/db/lifecycle/LogFile.java
--
diff --git a/src/java/org/apache/cassandra/db/lifecycle/LogFile.java 
b/src/java/org/apache/cassandra/db/lifecycle/LogFile.java
index be26163..8425a6d 100644
--- a/src/java/org/apache/cassandra/db/lifecycle/LogFile.java
+++ b/src/java/org/apache/cassandra/db/lifecycle/LogFile.java
@@ -281,18 +281,23 @@ final class LogFile implements AutoCloseable
 
 void add(Type type, SSTable table)
 {
-if (!addRecord(makeRecord(type, table)))
+add(makeRecord(type, table));
+}
+
+void add(LogRecord record)
+{
+if (!addRecord(record))
 throw new IllegalStateException();
 }
 
 public void addAll(Type 

[2/6] cassandra git commit: Pre-create deletion log records to finish compactions quicker

[marcuse]

Pre-create deletion log records to finish compactions quicker

Patch by marcuse; reviewed by Stefania Alborghetti for CASSANDRA-12763


Project: http://git-wip-us.apache.org/repos/asf/cassandra/repo
Commit: http://git-wip-us.apache.org/repos/asf/cassandra/commit/d73f45ba
Tree: http://git-wip-us.apache.org/repos/asf/cassandra/tree/d73f45ba
Diff: http://git-wip-us.apache.org/repos/asf/cassandra/diff/d73f45ba

Branch: refs/heads/cassandra-3.11
Commit: d73f45bad4cd6d8cf1cea7d9b35b76075dc277e1
Parents: f39e28d
Author: Marcus Eriksson 
Authored: Mon Dec 11 15:11:20 2017 +0100
Committer: Marcus Eriksson 
Committed: Mon Feb 19 07:52:20 2018 -0800

--
 CHANGES.txt |  1 +
 .../apache/cassandra/db/lifecycle/Helpers.java  | 19 ++-
 .../apache/cassandra/db/lifecycle/LogFile.java  | 37 +++--
 .../cassandra/db/lifecycle/LogRecord.java   | 11 ++--
 .../cassandra/db/lifecycle/LogTransaction.java  | 33 ++--
 .../apache/cassandra/db/lifecycle/Tracker.java  |  2 +-
 .../cassandra/db/lifecycle/HelpersTest.java | 56 +---
 7 files changed, 74 insertions(+), 85 deletions(-)
--


http://git-wip-us.apache.org/repos/asf/cassandra/blob/d73f45ba/CHANGES.txt
--
diff --git a/CHANGES.txt b/CHANGES.txt
index 14a62a4..8cf665e 100644
--- a/CHANGES.txt
+++ b/CHANGES.txt
@@ -1,4 +1,5 @@
 3.0.17
+ * Pre-create deletion log records to finish compactions quicker 
(CASSANDRA-12763)
 Merged from 2.1:
  * CVE-2017-5929 Security vulnerability in Logback warning in NEWS.txt 
(CASSANDRA-14183)
 Merged from 2.2:

http://git-wip-us.apache.org/repos/asf/cassandra/blob/d73f45ba/src/java/org/apache/cassandra/db/lifecycle/Helpers.java
--
diff --git a/src/java/org/apache/cassandra/db/lifecycle/Helpers.java 
b/src/java/org/apache/cassandra/db/lifecycle/Helpers.java
index b9adc4b..8e0d514 100644
--- a/src/java/org/apache/cassandra/db/lifecycle/Helpers.java
+++ b/src/java/org/apache/cassandra/db/lifecycle/Helpers.java
@@ -22,6 +22,7 @@ import java.util.*;
 import com.google.common.base.Predicate;
 import com.google.common.collect.*;
 
+import org.apache.cassandra.io.sstable.SSTable;
 import org.apache.cassandra.io.sstable.format.SSTableReader;
 import org.apache.cassandra.utils.Throwables;
 
@@ -127,11 +128,12 @@ class Helpers
 
 static Throwable prepareForObsoletion(Iterable readers, 
LogTransaction txnLogs, List obsoletions, Throwable 
accumulate)
 {
+Map logRecords = 
txnLogs.makeRemoveRecords(readers);
 for (SSTableReader reader : readers)
 {
 try
 {
-obsoletions.add(new LogTransaction.Obsoletion(reader, 
txnLogs.obsoleted(reader)));
+obsoletions.add(new LogTransaction.Obsoletion(reader, 
txnLogs.obsoleted(reader, logRecords.get(reader;
 }
 catch (Throwable t)
 {
@@ -141,21 +143,6 @@ class Helpers
 return accumulate;
 }
 
-static Throwable prepareForBulkObsoletion(Iterable readers, 
LogTransaction txnLogs, List obsoletions, Throwable 
accumulate)
-{
-try
-{
-for (Map.Entry entry 
: txnLogs.bulkObsoletion(readers).entrySet())
-obsoletions.add(new LogTransaction.Obsoletion(entry.getKey(), 
entry.getValue()));
-}
-catch (Throwable t)
-{
-accumulate = Throwables.merge(accumulate, t);
-}
-
-return accumulate;
-}
-
 static Throwable abortObsoletion(List 
obsoletions, Throwable accumulate)
 {
 if (obsoletions == null || obsoletions.isEmpty())

http://git-wip-us.apache.org/repos/asf/cassandra/blob/d73f45ba/src/java/org/apache/cassandra/db/lifecycle/LogFile.java
--
diff --git a/src/java/org/apache/cassandra/db/lifecycle/LogFile.java 
b/src/java/org/apache/cassandra/db/lifecycle/LogFile.java
index be26163..8425a6d 100644
--- a/src/java/org/apache/cassandra/db/lifecycle/LogFile.java
+++ b/src/java/org/apache/cassandra/db/lifecycle/LogFile.java
@@ -281,18 +281,23 @@ final class LogFile implements AutoCloseable
 
 void add(Type type, SSTable table)
 {
-if (!addRecord(makeRecord(type, table)))
+add(makeRecord(type, table));
+}
+
+void add(LogRecord record)
+{
+if (!addRecord(record))
 throw new IllegalStateException();
 }
 
 public void addAll(Type type, Iterable toBulkAdd)
 {
-for (LogRecord record : makeRecords(type, toBulkAdd))
+for (LogRecord record : makeRecords(type, toBulkAdd).values())
 if 

[jira] [Commented] (CASSANDRA-12763) Compaction performance issues when a table has a lot of sstables

[Marcus Eriksson (JIRA)]

[ 
https://issues.apache.org/jira/browse/CASSANDRA-12763?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16369234#comment-16369234
 ] 

Marcus Eriksson commented on CASSANDRA-12763:
-

got a clean run on trunk: https://circleci.com/gh/krummas/cassandra/268 - will 
get this committed



> Compaction performance issues when a table has a lot of sstables
> 
>
> Key: CASSANDRA-12763
> URL: https://issues.apache.org/jira/browse/CASSANDRA-12763
> Project: Cassandra
>  Issue Type: Bug
>  Components: Compaction
>Reporter: Tom van der Woerdt
>Assignee: Marcus Eriksson
>Priority: Major
> Fix For: 3.0.x, 3.11.x, 4.x
>
>
> An issue with a script flooded my cluster with sstables. There is now a table 
> with 100k sstables, all on the order of KBytes, and it's taking a long time 
> (ETA 20 days) to compact, even though the table is only ~30GB.
> Stack trace :
> {noformat}
> "CompactionExecutor:269" #7536 daemon prio=1 os_prio=4 tid=0x7f4acd40fc00 
> nid=0x14f8 runnable [0x7f4798436000]
>java.lang.Thread.State: RUNNABLE
>   at java.io.UnixFileSystem.list(Native Method)
>   at java.io.File.list(File.java:1122)
>   at java.io.File.listFiles(File.java:1248)
>   at 
> org.apache.cassandra.db.lifecycle.LogRecord.getExistingFiles(LogRecord.java:268)
>   at org.apache.cassandra.db.lifecycle.LogRecord.make(LogRecord.java:150)
>   at 
> org.apache.cassandra.db.lifecycle.LogFile.makeRecord(LogFile.java:293)
>   at org.apache.cassandra.db.lifecycle.LogFile.add(LogFile.java:283)
>   at 
> org.apache.cassandra.db.lifecycle.LogTransaction.obsoleted(LogTransaction.java:158)
>   at 
> org.apache.cassandra.db.lifecycle.Helpers.prepareForObsoletion(Helpers.java:134)
>   at 
> org.apache.cassandra.db.lifecycle.LifecycleTransaction.doPrepare(LifecycleTransaction.java:193)
>   at 
> org.apache.cassandra.utils.concurrent.Transactional$AbstractTransactional.prepareToCommit(Transactional.java:173)
>   at 
> org.apache.cassandra.io.sstable.SSTableRewriter.doPrepare(SSTableRewriter.java:376)
>   at 
> org.apache.cassandra.utils.concurrent.Transactional$AbstractTransactional.prepareToCommit(Transactional.java:173)
>   at 
> org.apache.cassandra.db.compaction.writers.CompactionAwareWriter.doPrepare(CompactionAwareWriter.java:84)
>   at 
> org.apache.cassandra.utils.concurrent.Transactional$AbstractTransactional.prepareToCommit(Transactional.java:173)
>   at 
> org.apache.cassandra.utils.concurrent.Transactional$AbstractTransactional.finish(Transactional.java:184)
>   at 
> org.apache.cassandra.db.compaction.writers.CompactionAwareWriter.finish(CompactionAwareWriter.java:94)
>   at 
> org.apache.cassandra.db.compaction.CompactionTask.runMayThrow(CompactionTask.java:194)
>   at 
> org.apache.cassandra.utils.WrappedRunnable.run(WrappedRunnable.java:28)
>   at 
> org.apache.cassandra.db.compaction.CompactionTask.executeInternal(CompactionTask.java:78)
>   at 
> org.apache.cassandra.db.compaction.AbstractCompactionTask.execute(AbstractCompactionTask.java:61)
>   at 
> org.apache.cassandra.db.compaction.CompactionManager$BackgroundCompactionCandidate.run(CompactionManager.java:263)
>   at 
> java.util.concurrent.Executors$RunnableAdapter.call(Executors.java:511)
>   at java.util.concurrent.FutureTask.run(FutureTask.java:266)
>   at 
> java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1142)
>   at 
> java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:617)
>   at java.lang.Thread.run(Thread.java:745)
> {noformat}
> listFiles is being called over and over, apparently scaling with the number 
> of files in the compaction.



--
This message was sent by Atlassian JIRA
(v7.6.3#76005)

-
To unsubscribe, e-mail: commits-unsubscr...@cassandra.apache.org
For additional commands, e-mail: commits-h...@cassandra.apache.org

[jira] [Updated] (CASSANDRA-14240) Backport circleci yaml

[Jason Brown (JIRA)]

 [ 
https://issues.apache.org/jira/browse/CASSANDRA-14240?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
 ]

Jason Brown updated CASSANDRA-14240:

   Resolution: Fixed
Fix Version/s: (was: 3.11.x)
   (was: 3.0.x)
   (was: 2.2.x)
   3.11.3
   3.0.17
   2.2.13
   Status: Resolved  (was: Ready to Commit)

committedas sha {{9715fc09b158d04796028d06b4bb4a46a7c3}}.

 

/cc [~zznate]

> Backport circleci yaml
> --
>
> Key: CASSANDRA-14240
> URL: https://issues.apache.org/jira/browse/CASSANDRA-14240
> Project: Cassandra
>  Issue Type: Task
>Reporter: Jason Brown
>Assignee: Jason Brown
>Priority: Trivial
> Fix For: 2.2.13, 3.0.17, 3.11.3
>
>
> Backport the circleci yaml (sha {{d6e508f33c1a7274b5826ad9d5ce814d719bd848}}) 
> to earlier branches



--
This message was sent by Atlassian JIRA
(v7.6.3#76005)

-
To unsubscribe, e-mail: commits-unsubscr...@cassandra.apache.org
For additional commands, e-mail: commits-h...@cassandra.apache.org

[04/10] cassandra git commit: Backport circleci yaml

[jasobrown]

Backport circleci yaml

patch by jasobrown; reviewed by Marcus Eriksson for CASSANDRA-14240


Project: http://git-wip-us.apache.org/repos/asf/cassandra/repo
Commit: http://git-wip-us.apache.org/repos/asf/cassandra/commit/9715fc09
Tree: http://git-wip-us.apache.org/repos/asf/cassandra/tree/9715fc09
Diff: http://git-wip-us.apache.org/repos/asf/cassandra/diff/9715fc09

Branch: refs/heads/trunk
Commit: 9715fc09b158d04796028d06b4bb4a46a7c3
Parents: 08ebe82
Author: Jason Brown 
Authored: Fri Feb 16 10:03:06 2018 -0800
Committer: Jason Brown 
Committed: Mon Feb 19 05:44:55 2018 -0800

--
 .circleci/config.yml | 339 ++
 CHANGES.txt  |   1 +
 circle.yml   |  18 ---
 3 files changed, 340 insertions(+), 18 deletions(-)
--


http://git-wip-us.apache.org/repos/asf/cassandra/blob/9715fc09/.circleci/config.yml
--
diff --git a/.circleci/config.yml b/.circleci/config.yml
new file mode 100644
index 000..f881b70
--- /dev/null
+++ b/.circleci/config.yml
@@ -0,0 +1,339 @@
+default_env_vars: _env_vars
+JAVA_HOME: /usr/local/openjdk8u154-cassandra-b02
+ANT_HOME: /usr/local/apache-ant-1.10.1
+LANG: en_US.UTF-8
+JDK_HOME: /usr/local/openjdk8u154-cassandra-b02
+JAVA8_HOME: /usr/local/openjdk8u154-cassandra-b02
+JAVA7_HOME: /usr/local/openjdk7u82-cassandra-b02
+KEEP_TEST_DIR: true
+DEFAULT_DIR: /home/cassandra/cassandra-dtest
+PYTHONIOENCODING: utf-8
+PYTHONUNBUFFERED: true
+CASS_DRIVER_NO_EXTENSIONS: true
+CASS_DRIVER_NO_CYTHON: true
+# For environments with xlarge instances, use more memory
+high_capacity_env_vars: _capacity_env_vars
+<<: *default_env_vars
+CCM_MAX_HEAP_SIZE: 2048M
+CCM_HEAP_NEWSIZE: 512M
+# For environments with limited memory (e.g the free OSS CircleCI Tier)
+resource_constrained_env_vars: _constrained_env_vars
+<<: *default_env_vars
+CCM_MAX_HEAP_SIZE: 1024M
+CCM_HEAP_NEWSIZE: 256M
+# Settings for users who do not have a paid CircleCI account
+default_env_settings: _env_settings
+resource_class: medium
+parallelism: 4
+# Settings for users with high-capacity, paid CircleCI account
+high_capacity_env_settings: _capacity_env_settings
+resource_class: xlarge
+parallelism: 100
+default_jobs: _jobs
+jobs:
+- build
+- unit_tests:
+  requires:
+  - build
+with_dtests_jobs: _dtest_jobs
+jobs:
+- build
+- unit_tests:
+  requires:
+  - build
+- dtests-with-vnodes:
+  requires:
+  - build
+- dtests-no-vnodes:
+  requires:
+  - build
+with_dtest_jobs_only: _dtest_jobs_only
+jobs:
+- build
+- dtests-with-vnodes:
+  requires:
+  - build
+- dtests-no-vnodes:
+  requires:
+  - build
+# Set env_settings, env_vars, and workflows/build_and_run_tests based on 
environment
+env_settings: _settings
+<<: *default_env_settings
+#<<: *high_capacity_env_settings
+env_vars: _vars
+<<: *resource_constrained_env_vars
+#<<: *high_capacity_env_vars
+workflows:
+version: 2
+build_and_run_tests: *default_jobs
+#build_and_run_tests: *with_dtest_jobs_only
+#build_and_run_tests: *with_dtest_jobs
+docker_image: _image kjellman/cassandra-test:0.4.3
+version: 2
+jobs:
+  build:
+<<: *env_settings
+parallelism: 1 # This job doesn't benefit from parallelism
+working_directory: ~/
+shell: /bin/bash -eo pipefail -l
+docker:
+  - image: *docker_image
+environment:
+<<: *env_vars
+steps:
+  - run:
+  name: Log Environment Information
+  command: |
+  echo '*** id ***'
+  id
+  echo '*** cat /proc/cpuinfo ***'
+  cat /proc/cpuinfo
+  echo '*** free -m ***'
+  free -m
+  echo '*** df -m ***'
+  df -m
+  echo '*** ifconfig -a ***'
+  ifconfig -a
+  echo '*** uname -a ***'
+  uname -a
+  echo '*** mount ***'
+  mount
+  echo '*** env ***'
+  env
+  - run:
+  name: Clone Cassandra Repository (via git)
+  command: |
+export LANG=en_US.UTF-8
+git clone --single-branch --depth 1 --branch $CIRCLE_BRANCH 
git://github.com/$CIRCLE_PROJECT_USERNAME/$CIRCLE_PROJECT_REPONAME.git 
~/cassandra
+  - run:
+  name: Build Cassandra
+  command: |
+export LANG=en_US.UTF-8
+ 

[02/10] cassandra git commit: Backport circleci yaml

[jasobrown]

Backport circleci yaml

patch by jasobrown; reviewed by Marcus Eriksson for CASSANDRA-14240


Project: http://git-wip-us.apache.org/repos/asf/cassandra/repo
Commit: http://git-wip-us.apache.org/repos/asf/cassandra/commit/9715fc09
Tree: http://git-wip-us.apache.org/repos/asf/cassandra/tree/9715fc09
Diff: http://git-wip-us.apache.org/repos/asf/cassandra/diff/9715fc09

Branch: refs/heads/cassandra-3.0
Commit: 9715fc09b158d04796028d06b4bb4a46a7c3
Parents: 08ebe82
Author: Jason Brown 
Authored: Fri Feb 16 10:03:06 2018 -0800
Committer: Jason Brown 
Committed: Mon Feb 19 05:44:55 2018 -0800

--
 .circleci/config.yml | 339 ++
 CHANGES.txt  |   1 +
 circle.yml   |  18 ---
 3 files changed, 340 insertions(+), 18 deletions(-)
--


http://git-wip-us.apache.org/repos/asf/cassandra/blob/9715fc09/.circleci/config.yml
--
diff --git a/.circleci/config.yml b/.circleci/config.yml
new file mode 100644
index 000..f881b70
--- /dev/null
+++ b/.circleci/config.yml
@@ -0,0 +1,339 @@
+default_env_vars: _env_vars
+JAVA_HOME: /usr/local/openjdk8u154-cassandra-b02
+ANT_HOME: /usr/local/apache-ant-1.10.1
+LANG: en_US.UTF-8
+JDK_HOME: /usr/local/openjdk8u154-cassandra-b02
+JAVA8_HOME: /usr/local/openjdk8u154-cassandra-b02
+JAVA7_HOME: /usr/local/openjdk7u82-cassandra-b02
+KEEP_TEST_DIR: true
+DEFAULT_DIR: /home/cassandra/cassandra-dtest
+PYTHONIOENCODING: utf-8
+PYTHONUNBUFFERED: true
+CASS_DRIVER_NO_EXTENSIONS: true
+CASS_DRIVER_NO_CYTHON: true
+# For environments with xlarge instances, use more memory
+high_capacity_env_vars: _capacity_env_vars
+<<: *default_env_vars
+CCM_MAX_HEAP_SIZE: 2048M
+CCM_HEAP_NEWSIZE: 512M
+# For environments with limited memory (e.g the free OSS CircleCI Tier)
+resource_constrained_env_vars: _constrained_env_vars
+<<: *default_env_vars
+CCM_MAX_HEAP_SIZE: 1024M
+CCM_HEAP_NEWSIZE: 256M
+# Settings for users who do not have a paid CircleCI account
+default_env_settings: _env_settings
+resource_class: medium
+parallelism: 4
+# Settings for users with high-capacity, paid CircleCI account
+high_capacity_env_settings: _capacity_env_settings
+resource_class: xlarge
+parallelism: 100
+default_jobs: _jobs
+jobs:
+- build
+- unit_tests:
+  requires:
+  - build
+with_dtests_jobs: _dtest_jobs
+jobs:
+- build
+- unit_tests:
+  requires:
+  - build
+- dtests-with-vnodes:
+  requires:
+  - build
+- dtests-no-vnodes:
+  requires:
+  - build
+with_dtest_jobs_only: _dtest_jobs_only
+jobs:
+- build
+- dtests-with-vnodes:
+  requires:
+  - build
+- dtests-no-vnodes:
+  requires:
+  - build
+# Set env_settings, env_vars, and workflows/build_and_run_tests based on 
environment
+env_settings: _settings
+<<: *default_env_settings
+#<<: *high_capacity_env_settings
+env_vars: _vars
+<<: *resource_constrained_env_vars
+#<<: *high_capacity_env_vars
+workflows:
+version: 2
+build_and_run_tests: *default_jobs
+#build_and_run_tests: *with_dtest_jobs_only
+#build_and_run_tests: *with_dtest_jobs
+docker_image: _image kjellman/cassandra-test:0.4.3
+version: 2
+jobs:
+  build:
+<<: *env_settings
+parallelism: 1 # This job doesn't benefit from parallelism
+working_directory: ~/
+shell: /bin/bash -eo pipefail -l
+docker:
+  - image: *docker_image
+environment:
+<<: *env_vars
+steps:
+  - run:
+  name: Log Environment Information
+  command: |
+  echo '*** id ***'
+  id
+  echo '*** cat /proc/cpuinfo ***'
+  cat /proc/cpuinfo
+  echo '*** free -m ***'
+  free -m
+  echo '*** df -m ***'
+  df -m
+  echo '*** ifconfig -a ***'
+  ifconfig -a
+  echo '*** uname -a ***'
+  uname -a
+  echo '*** mount ***'
+  mount
+  echo '*** env ***'
+  env
+  - run:
+  name: Clone Cassandra Repository (via git)
+  command: |
+export LANG=en_US.UTF-8
+git clone --single-branch --depth 1 --branch $CIRCLE_BRANCH 
git://github.com/$CIRCLE_PROJECT_USERNAME/$CIRCLE_PROJECT_REPONAME.git 
~/cassandra
+  - run:
+  name: Build Cassandra
+  command: |
+export 

[08/10] cassandra git commit: Merge branch 'cassandra-3.0' into cassandra-3.11

[jasobrown]

Merge branch 'cassandra-3.0' into cassandra-3.11


Project: http://git-wip-us.apache.org/repos/asf/cassandra/repo
Commit: http://git-wip-us.apache.org/repos/asf/cassandra/commit/a798257c
Tree: http://git-wip-us.apache.org/repos/asf/cassandra/tree/a798257c
Diff: http://git-wip-us.apache.org/repos/asf/cassandra/diff/a798257c

Branch: refs/heads/cassandra-3.11
Commit: a798257cefe96147370ecae87b7c07fe55769816
Parents: 0ab9fc4 f39e28d
Author: Jason Brown 
Authored: Mon Feb 19 05:50:08 2018 -0800
Committer: Jason Brown 
Committed: Mon Feb 19 05:50:55 2018 -0800

--
 .circleci/config.yml | 339 ++
 CHANGES.txt  |   2 +
 circle.yml   |  18 ---
 3 files changed, 341 insertions(+), 18 deletions(-)
--


http://git-wip-us.apache.org/repos/asf/cassandra/blob/a798257c/CHANGES.txt
--
diff --cc CHANGES.txt
index 022807f,14a62a4..f8af8c4
--- a/CHANGES.txt
+++ b/CHANGES.txt
@@@ -1,38 -1,16 +1,40 @@@
 -3.0.17
 -Merged from 2.1:
 - * CVE-2017-5929 Security vulnerability in Logback warning in NEWS.txt 
(CASSANDRA-14183)
 -Merged from 2.2:
 +3.11.3
 + * RateBasedBackPressure unnecessarily invokes a lock on the Guava 
RateLimiter (CASSANDRA-14163)
 + * Fix wildcard GROUP BY queries (CASSANDRA-14209)
++Merged from 2.2
+  * Backport circleci yaml (CASSANDRA-14240)
 +Merged from 2.1
 + * CVE-2017-5929 Security vulnerability in Logback warning in NEWS.txt 
(CASSANDRA-14183)
  
 -3.0.16
 - * Fix unit test failures in ViewComplexTest (CASSANDRA-14219)
 - * Add MinGW uname check to start scripts (CASSANDRA-12940)
 - * Protect against overflow of local expiration time (CASSANDRA-14092)
 +3.11.2
 + * Fix ReadCommandTest (CASSANDRA-14234)
 + * Remove trailing period from latency reports at keyspace level 
(CASSANDRA-14233)
 + * Backport CASSANDRA-13080: Use new token allocation for non bootstrap case 
as well (CASSANDRA-14212)
 + * Remove dependencies on JVM internal classes from JMXServerUtils 
(CASSANDRA-14173) 
 + * Add DEFAULT, UNSET, MBEAN and MBEANS to `ReservedKeywords` 
(CASSANDRA-14205)
 + * Add Unittest for schema migration fix (CASSANDRA-14140)
 + * Print correct snitch info from nodetool describecluster (CASSANDRA-13528)
 + * Close socket on error during connect on OutboundTcpConnection 
(CASSANDRA-9630)
 + * Enable CDC unittest (CASSANDRA-14141)
 + * Acquire read lock before accessing CompactionStrategyManager fields 
(CASSANDRA-14139)
 + * Split CommitLogStressTest to avoid timeout (CASSANDRA-14143)
 + * Avoid invalidating disk boundaries unnecessarily (CASSANDRA-14083)
 + * Avoid exposing compaction strategy index externally (CASSANDRA-14082)
 + * Prevent continuous schema exchange between 3.0 and 3.11 nodes 
(CASSANDRA-14109)
 + * Fix imbalanced disks when replacing node with same address with JBOD 
(CASSANDRA-14084)
 + * Reload compaction strategies when disk boundaries are invalidated 
(CASSANDRA-13948)
 + * Remove OpenJDK log warning (CASSANDRA-13916)
 + * Prevent compaction strategies from looping indefinitely (CASSANDRA-14079)
 + * Cache disk boundaries (CASSANDRA-13215)
 + * Add asm jar to build.xml for maven builds (CASSANDRA-11193)
 + * Round buffer size to powers of 2 for the chunk cache (CASSANDRA-13897)
 + * Update jackson JSON jars (CASSANDRA-13949)
 + * Avoid locks when checking LCS fanout and if we should defrag 
(CASSANDRA-13930)
 + * Correctly count range tombstones in traces and tombstone thresholds 
(CASSANDRA-8527)
 +Merged from 3.0:
 + * Add MinGW uname check to start scripts (CASSANDRA-12840)
   * Use the correct digest file and reload sstable metadata in nodetool verify 
(CASSANDRA-14217)
   * Handle failure when mutating repaired status in Verifier (CASSANDRA-13933)
 - * Close socket on error during connect on OutboundTcpConnection 
(CASSANDRA-9630)
   * Set encoding for javadoc generation (CASSANDRA-14154)
   * Fix index target computation for dense composite tables with dropped 
compact storage (CASSANDRA-14104)
   * Improve commit log chain marker updating (CASSANDRA-14108)


-
To unsubscribe, e-mail: commits-unsubscr...@cassandra.apache.org
For additional commands, e-mail: commits-h...@cassandra.apache.org

[05/10] cassandra git commit: Merge branch 'cassandra-2.2' into cassandra-3.0

[jasobrown]

Merge branch 'cassandra-2.2' into cassandra-3.0


Project: http://git-wip-us.apache.org/repos/asf/cassandra/repo
Commit: http://git-wip-us.apache.org/repos/asf/cassandra/commit/f39e28dc
Tree: http://git-wip-us.apache.org/repos/asf/cassandra/tree/f39e28dc
Diff: http://git-wip-us.apache.org/repos/asf/cassandra/diff/f39e28dc

Branch: refs/heads/cassandra-3.11
Commit: f39e28dc72935647ac4ea33b0a14ad79d1b64180
Parents: 2461187 9715fc0
Author: Jason Brown 
Authored: Mon Feb 19 05:45:50 2018 -0800
Committer: Jason Brown 
Committed: Mon Feb 19 05:49:03 2018 -0800

--
 .circleci/config.yml | 339 ++
 CHANGES.txt  |   2 +
 circle.yml   |  18 ---
 3 files changed, 341 insertions(+), 18 deletions(-)
--


http://git-wip-us.apache.org/repos/asf/cassandra/blob/f39e28dc/CHANGES.txt
--
diff --cc CHANGES.txt
index bbbca08,2e45b85..14a62a4
--- a/CHANGES.txt
+++ b/CHANGES.txt
@@@ -1,36 -1,9 +1,38 @@@
 -2.2.13
 - * Backport circleci yaml (CASSANDRA-14240)
 +3.0.17
  Merged from 2.1:
   * CVE-2017-5929 Security vulnerability in Logback warning in NEWS.txt 
(CASSANDRA-14183)
++Merged from 2.2:
++ * Backport circleci yaml (CASSANDRA-14240)
  
 -2.2.12
 +3.0.16
 + * Fix unit test failures in ViewComplexTest (CASSANDRA-14219)
 + * Add MinGW uname check to start scripts (CASSANDRA-12940)
 + * Protect against overflow of local expiration time (CASSANDRA-14092)
 + * Use the correct digest file and reload sstable metadata in nodetool verify 
(CASSANDRA-14217)
 + * Handle failure when mutating repaired status in Verifier (CASSANDRA-13933)
 + * Close socket on error during connect on OutboundTcpConnection 
(CASSANDRA-9630)
 + * Set encoding for javadoc generation (CASSANDRA-14154)
 + * Fix index target computation for dense composite tables with dropped 
compact storage (CASSANDRA-14104)
 + * Improve commit log chain marker updating (CASSANDRA-14108)
 + * Extra range tombstone bound creates double rows (CASSANDRA-14008)
 + * Fix SStable ordering by max timestamp in SinglePartitionReadCommand 
(CASSANDRA-14010)
 + * Accept role names containing forward-slash (CASSANDRA-14088)
 + * Optimize CRC check chance probability calculations (CASSANDRA-14094)
 + * Fix cleanup on keyspace with no replicas (CASSANDRA-13526)
 + * Fix updating base table rows with TTL not removing materialized view 
entries (CASSANDRA-14071)
 + * Reduce garbage created by DynamicSnitch (CASSANDRA-14091)
 + * More frequent commitlog chained markers (CASSANDRA-13987)
 + * Fix serialized size of DataLimits (CASSANDRA-14057)
 + * Add flag to allow dropping oversized read repair mutations 
(CASSANDRA-13975)
 + * Fix SSTableLoader logger message (CASSANDRA-14003)
 + * Fix repair race that caused gossip to block (CASSANDRA-13849)
 + * Tracing interferes with digest requests when using RandomPartitioner 
(CASSANDRA-13964)
 + * Add flag to disable materialized views, and warnings on creation 
(CASSANDRA-13959)
 + * Don't let user drop or generally break tables in system_distributed 
(CASSANDRA-13813)
 + * Provide a JMX call to sync schema with local storage (CASSANDRA-13954)
 + * Mishandling of cells for removed/dropped columns when reading legacy files 
(CASSANDRA-13939)
 + * Deserialise sstable metadata in nodetool verify (CASSANDRA-13922)
 +Merged from 2.2:
   * Fix the inspectJvmOptions startup check (CASSANDRA-14112)
   * Fix race that prevents submitting compaction for a table when executor is 
full (CASSANDRA-13801)
   * Rely on the JVM to handle OutOfMemoryErrors (CASSANDRA-13006)


-
To unsubscribe, e-mail: commits-unsubscr...@cassandra.apache.org
For additional commands, e-mail: commits-h...@cassandra.apache.org

[10/10] cassandra git commit: Merge branch 'cassandra-3.11' into trunk

[jasobrown]

Merge branch 'cassandra-3.11' into trunk


Project: http://git-wip-us.apache.org/repos/asf/cassandra/repo
Commit: http://git-wip-us.apache.org/repos/asf/cassandra/commit/32110d6d
Tree: http://git-wip-us.apache.org/repos/asf/cassandra/tree/32110d6d
Diff: http://git-wip-us.apache.org/repos/asf/cassandra/diff/32110d6d

Branch: refs/heads/trunk
Commit: 32110d6d2905d0579c99a9b2e0c646dd15a2e3be
Parents: a75b48b a798257
Author: Jason Brown 
Authored: Mon Feb 19 05:51:16 2018 -0800
Committer: Jason Brown 
Committed: Mon Feb 19 05:51:16 2018 -0800

--

--



-
To unsubscribe, e-mail: commits-unsubscr...@cassandra.apache.org
For additional commands, e-mail: commits-h...@cassandra.apache.org

[09/10] cassandra git commit: Merge branch 'cassandra-3.0' into cassandra-3.11

[jasobrown]

Merge branch 'cassandra-3.0' into cassandra-3.11


Project: http://git-wip-us.apache.org/repos/asf/cassandra/repo
Commit: http://git-wip-us.apache.org/repos/asf/cassandra/commit/a798257c
Tree: http://git-wip-us.apache.org/repos/asf/cassandra/tree/a798257c
Diff: http://git-wip-us.apache.org/repos/asf/cassandra/diff/a798257c

Branch: refs/heads/trunk
Commit: a798257cefe96147370ecae87b7c07fe55769816
Parents: 0ab9fc4 f39e28d
Author: Jason Brown 
Authored: Mon Feb 19 05:50:08 2018 -0800
Committer: Jason Brown 
Committed: Mon Feb 19 05:50:55 2018 -0800

--
 .circleci/config.yml | 339 ++
 CHANGES.txt  |   2 +
 circle.yml   |  18 ---
 3 files changed, 341 insertions(+), 18 deletions(-)
--


http://git-wip-us.apache.org/repos/asf/cassandra/blob/a798257c/CHANGES.txt
--
diff --cc CHANGES.txt
index 022807f,14a62a4..f8af8c4
--- a/CHANGES.txt
+++ b/CHANGES.txt
@@@ -1,38 -1,16 +1,40 @@@
 -3.0.17
 -Merged from 2.1:
 - * CVE-2017-5929 Security vulnerability in Logback warning in NEWS.txt 
(CASSANDRA-14183)
 -Merged from 2.2:
 +3.11.3
 + * RateBasedBackPressure unnecessarily invokes a lock on the Guava 
RateLimiter (CASSANDRA-14163)
 + * Fix wildcard GROUP BY queries (CASSANDRA-14209)
++Merged from 2.2
+  * Backport circleci yaml (CASSANDRA-14240)
 +Merged from 2.1
 + * CVE-2017-5929 Security vulnerability in Logback warning in NEWS.txt 
(CASSANDRA-14183)
  
 -3.0.16
 - * Fix unit test failures in ViewComplexTest (CASSANDRA-14219)
 - * Add MinGW uname check to start scripts (CASSANDRA-12940)
 - * Protect against overflow of local expiration time (CASSANDRA-14092)
 +3.11.2
 + * Fix ReadCommandTest (CASSANDRA-14234)
 + * Remove trailing period from latency reports at keyspace level 
(CASSANDRA-14233)
 + * Backport CASSANDRA-13080: Use new token allocation for non bootstrap case 
as well (CASSANDRA-14212)
 + * Remove dependencies on JVM internal classes from JMXServerUtils 
(CASSANDRA-14173) 
 + * Add DEFAULT, UNSET, MBEAN and MBEANS to `ReservedKeywords` 
(CASSANDRA-14205)
 + * Add Unittest for schema migration fix (CASSANDRA-14140)
 + * Print correct snitch info from nodetool describecluster (CASSANDRA-13528)
 + * Close socket on error during connect on OutboundTcpConnection 
(CASSANDRA-9630)
 + * Enable CDC unittest (CASSANDRA-14141)
 + * Acquire read lock before accessing CompactionStrategyManager fields 
(CASSANDRA-14139)
 + * Split CommitLogStressTest to avoid timeout (CASSANDRA-14143)
 + * Avoid invalidating disk boundaries unnecessarily (CASSANDRA-14083)
 + * Avoid exposing compaction strategy index externally (CASSANDRA-14082)
 + * Prevent continuous schema exchange between 3.0 and 3.11 nodes 
(CASSANDRA-14109)
 + * Fix imbalanced disks when replacing node with same address with JBOD 
(CASSANDRA-14084)
 + * Reload compaction strategies when disk boundaries are invalidated 
(CASSANDRA-13948)
 + * Remove OpenJDK log warning (CASSANDRA-13916)
 + * Prevent compaction strategies from looping indefinitely (CASSANDRA-14079)
 + * Cache disk boundaries (CASSANDRA-13215)
 + * Add asm jar to build.xml for maven builds (CASSANDRA-11193)
 + * Round buffer size to powers of 2 for the chunk cache (CASSANDRA-13897)
 + * Update jackson JSON jars (CASSANDRA-13949)
 + * Avoid locks when checking LCS fanout and if we should defrag 
(CASSANDRA-13930)
 + * Correctly count range tombstones in traces and tombstone thresholds 
(CASSANDRA-8527)
 +Merged from 3.0:
 + * Add MinGW uname check to start scripts (CASSANDRA-12840)
   * Use the correct digest file and reload sstable metadata in nodetool verify 
(CASSANDRA-14217)
   * Handle failure when mutating repaired status in Verifier (CASSANDRA-13933)
 - * Close socket on error during connect on OutboundTcpConnection 
(CASSANDRA-9630)
   * Set encoding for javadoc generation (CASSANDRA-14154)
   * Fix index target computation for dense composite tables with dropped 
compact storage (CASSANDRA-14104)
   * Improve commit log chain marker updating (CASSANDRA-14108)


-
To unsubscribe, e-mail: commits-unsubscr...@cassandra.apache.org
For additional commands, e-mail: commits-h...@cassandra.apache.org

[07/10] cassandra git commit: Merge branch 'cassandra-2.2' into cassandra-3.0

[jasobrown]

Merge branch 'cassandra-2.2' into cassandra-3.0


Project: http://git-wip-us.apache.org/repos/asf/cassandra/repo
Commit: http://git-wip-us.apache.org/repos/asf/cassandra/commit/f39e28dc
Tree: http://git-wip-us.apache.org/repos/asf/cassandra/tree/f39e28dc
Diff: http://git-wip-us.apache.org/repos/asf/cassandra/diff/f39e28dc

Branch: refs/heads/trunk
Commit: f39e28dc72935647ac4ea33b0a14ad79d1b64180
Parents: 2461187 9715fc0
Author: Jason Brown 
Authored: Mon Feb 19 05:45:50 2018 -0800
Committer: Jason Brown 
Committed: Mon Feb 19 05:49:03 2018 -0800

--
 .circleci/config.yml | 339 ++
 CHANGES.txt  |   2 +
 circle.yml   |  18 ---
 3 files changed, 341 insertions(+), 18 deletions(-)
--


http://git-wip-us.apache.org/repos/asf/cassandra/blob/f39e28dc/CHANGES.txt
--
diff --cc CHANGES.txt
index bbbca08,2e45b85..14a62a4
--- a/CHANGES.txt
+++ b/CHANGES.txt
@@@ -1,36 -1,9 +1,38 @@@
 -2.2.13
 - * Backport circleci yaml (CASSANDRA-14240)
 +3.0.17
  Merged from 2.1:
   * CVE-2017-5929 Security vulnerability in Logback warning in NEWS.txt 
(CASSANDRA-14183)
++Merged from 2.2:
++ * Backport circleci yaml (CASSANDRA-14240)
  
 -2.2.12
 +3.0.16
 + * Fix unit test failures in ViewComplexTest (CASSANDRA-14219)
 + * Add MinGW uname check to start scripts (CASSANDRA-12940)
 + * Protect against overflow of local expiration time (CASSANDRA-14092)
 + * Use the correct digest file and reload sstable metadata in nodetool verify 
(CASSANDRA-14217)
 + * Handle failure when mutating repaired status in Verifier (CASSANDRA-13933)
 + * Close socket on error during connect on OutboundTcpConnection 
(CASSANDRA-9630)
 + * Set encoding for javadoc generation (CASSANDRA-14154)
 + * Fix index target computation for dense composite tables with dropped 
compact storage (CASSANDRA-14104)
 + * Improve commit log chain marker updating (CASSANDRA-14108)
 + * Extra range tombstone bound creates double rows (CASSANDRA-14008)
 + * Fix SStable ordering by max timestamp in SinglePartitionReadCommand 
(CASSANDRA-14010)
 + * Accept role names containing forward-slash (CASSANDRA-14088)
 + * Optimize CRC check chance probability calculations (CASSANDRA-14094)
 + * Fix cleanup on keyspace with no replicas (CASSANDRA-13526)
 + * Fix updating base table rows with TTL not removing materialized view 
entries (CASSANDRA-14071)
 + * Reduce garbage created by DynamicSnitch (CASSANDRA-14091)
 + * More frequent commitlog chained markers (CASSANDRA-13987)
 + * Fix serialized size of DataLimits (CASSANDRA-14057)
 + * Add flag to allow dropping oversized read repair mutations 
(CASSANDRA-13975)
 + * Fix SSTableLoader logger message (CASSANDRA-14003)
 + * Fix repair race that caused gossip to block (CASSANDRA-13849)
 + * Tracing interferes with digest requests when using RandomPartitioner 
(CASSANDRA-13964)
 + * Add flag to disable materialized views, and warnings on creation 
(CASSANDRA-13959)
 + * Don't let user drop or generally break tables in system_distributed 
(CASSANDRA-13813)
 + * Provide a JMX call to sync schema with local storage (CASSANDRA-13954)
 + * Mishandling of cells for removed/dropped columns when reading legacy files 
(CASSANDRA-13939)
 + * Deserialise sstable metadata in nodetool verify (CASSANDRA-13922)
 +Merged from 2.2:
   * Fix the inspectJvmOptions startup check (CASSANDRA-14112)
   * Fix race that prevents submitting compaction for a table when executor is 
full (CASSANDRA-13801)
   * Rely on the JVM to handle OutOfMemoryErrors (CASSANDRA-13006)


-
To unsubscribe, e-mail: commits-unsubscr...@cassandra.apache.org
For additional commands, e-mail: commits-h...@cassandra.apache.org

[01/10] cassandra git commit: Backport circleci yaml

[jasobrown]

Repository: cassandra
Updated Branches:
  refs/heads/cassandra-2.2 08ebe8297 -> 9715fc09b
  refs/heads/cassandra-3.0 2461187c0 -> f39e28dc7
  refs/heads/cassandra-3.11 0ab9fc4b7 -> a798257ce
  refs/heads/trunk a75b48ba5 -> 32110d6d2


Backport circleci yaml

patch by jasobrown; reviewed by Marcus Eriksson for CASSANDRA-14240


Project: http://git-wip-us.apache.org/repos/asf/cassandra/repo
Commit: http://git-wip-us.apache.org/repos/asf/cassandra/commit/9715fc09
Tree: http://git-wip-us.apache.org/repos/asf/cassandra/tree/9715fc09
Diff: http://git-wip-us.apache.org/repos/asf/cassandra/diff/9715fc09

Branch: refs/heads/cassandra-2.2
Commit: 9715fc09b158d04796028d06b4bb4a46a7c3
Parents: 08ebe82
Author: Jason Brown 
Authored: Fri Feb 16 10:03:06 2018 -0800
Committer: Jason Brown 
Committed: Mon Feb 19 05:44:55 2018 -0800

--
 .circleci/config.yml | 339 ++
 CHANGES.txt  |   1 +
 circle.yml   |  18 ---
 3 files changed, 340 insertions(+), 18 deletions(-)
--


http://git-wip-us.apache.org/repos/asf/cassandra/blob/9715fc09/.circleci/config.yml
--
diff --git a/.circleci/config.yml b/.circleci/config.yml
new file mode 100644
index 000..f881b70
--- /dev/null
+++ b/.circleci/config.yml
@@ -0,0 +1,339 @@
+default_env_vars: _env_vars
+JAVA_HOME: /usr/local/openjdk8u154-cassandra-b02
+ANT_HOME: /usr/local/apache-ant-1.10.1
+LANG: en_US.UTF-8
+JDK_HOME: /usr/local/openjdk8u154-cassandra-b02
+JAVA8_HOME: /usr/local/openjdk8u154-cassandra-b02
+JAVA7_HOME: /usr/local/openjdk7u82-cassandra-b02
+KEEP_TEST_DIR: true
+DEFAULT_DIR: /home/cassandra/cassandra-dtest
+PYTHONIOENCODING: utf-8
+PYTHONUNBUFFERED: true
+CASS_DRIVER_NO_EXTENSIONS: true
+CASS_DRIVER_NO_CYTHON: true
+# For environments with xlarge instances, use more memory
+high_capacity_env_vars: _capacity_env_vars
+<<: *default_env_vars
+CCM_MAX_HEAP_SIZE: 2048M
+CCM_HEAP_NEWSIZE: 512M
+# For environments with limited memory (e.g the free OSS CircleCI Tier)
+resource_constrained_env_vars: _constrained_env_vars
+<<: *default_env_vars
+CCM_MAX_HEAP_SIZE: 1024M
+CCM_HEAP_NEWSIZE: 256M
+# Settings for users who do not have a paid CircleCI account
+default_env_settings: _env_settings
+resource_class: medium
+parallelism: 4
+# Settings for users with high-capacity, paid CircleCI account
+high_capacity_env_settings: _capacity_env_settings
+resource_class: xlarge
+parallelism: 100
+default_jobs: _jobs
+jobs:
+- build
+- unit_tests:
+  requires:
+  - build
+with_dtests_jobs: _dtest_jobs
+jobs:
+- build
+- unit_tests:
+  requires:
+  - build
+- dtests-with-vnodes:
+  requires:
+  - build
+- dtests-no-vnodes:
+  requires:
+  - build
+with_dtest_jobs_only: _dtest_jobs_only
+jobs:
+- build
+- dtests-with-vnodes:
+  requires:
+  - build
+- dtests-no-vnodes:
+  requires:
+  - build
+# Set env_settings, env_vars, and workflows/build_and_run_tests based on 
environment
+env_settings: _settings
+<<: *default_env_settings
+#<<: *high_capacity_env_settings
+env_vars: _vars
+<<: *resource_constrained_env_vars
+#<<: *high_capacity_env_vars
+workflows:
+version: 2
+build_and_run_tests: *default_jobs
+#build_and_run_tests: *with_dtest_jobs_only
+#build_and_run_tests: *with_dtest_jobs
+docker_image: _image kjellman/cassandra-test:0.4.3
+version: 2
+jobs:
+  build:
+<<: *env_settings
+parallelism: 1 # This job doesn't benefit from parallelism
+working_directory: ~/
+shell: /bin/bash -eo pipefail -l
+docker:
+  - image: *docker_image
+environment:
+<<: *env_vars
+steps:
+  - run:
+  name: Log Environment Information
+  command: |
+  echo '*** id ***'
+  id
+  echo '*** cat /proc/cpuinfo ***'
+  cat /proc/cpuinfo
+  echo '*** free -m ***'
+  free -m
+  echo '*** df -m ***'
+  df -m
+  echo '*** ifconfig -a ***'
+  ifconfig -a
+  echo '*** uname -a ***'
+  uname -a
+  echo '*** mount ***'
+  mount
+  echo '*** env ***'
+  env
+  - run:
+  name: Clone Cassandra Repository (via git)
+  command: |
+export LANG=en_US.UTF-8
+git clone 

[06/10] cassandra git commit: Merge branch 'cassandra-2.2' into cassandra-3.0

[jasobrown]

Merge branch 'cassandra-2.2' into cassandra-3.0


Project: http://git-wip-us.apache.org/repos/asf/cassandra/repo
Commit: http://git-wip-us.apache.org/repos/asf/cassandra/commit/f39e28dc
Tree: http://git-wip-us.apache.org/repos/asf/cassandra/tree/f39e28dc
Diff: http://git-wip-us.apache.org/repos/asf/cassandra/diff/f39e28dc

Branch: refs/heads/cassandra-3.0
Commit: f39e28dc72935647ac4ea33b0a14ad79d1b64180
Parents: 2461187 9715fc0
Author: Jason Brown 
Authored: Mon Feb 19 05:45:50 2018 -0800
Committer: Jason Brown 
Committed: Mon Feb 19 05:49:03 2018 -0800

--
 .circleci/config.yml | 339 ++
 CHANGES.txt  |   2 +
 circle.yml   |  18 ---
 3 files changed, 341 insertions(+), 18 deletions(-)
--


http://git-wip-us.apache.org/repos/asf/cassandra/blob/f39e28dc/CHANGES.txt
--
diff --cc CHANGES.txt
index bbbca08,2e45b85..14a62a4
--- a/CHANGES.txt
+++ b/CHANGES.txt
@@@ -1,36 -1,9 +1,38 @@@
 -2.2.13
 - * Backport circleci yaml (CASSANDRA-14240)
 +3.0.17
  Merged from 2.1:
   * CVE-2017-5929 Security vulnerability in Logback warning in NEWS.txt 
(CASSANDRA-14183)
++Merged from 2.2:
++ * Backport circleci yaml (CASSANDRA-14240)
  
 -2.2.12
 +3.0.16
 + * Fix unit test failures in ViewComplexTest (CASSANDRA-14219)
 + * Add MinGW uname check to start scripts (CASSANDRA-12940)
 + * Protect against overflow of local expiration time (CASSANDRA-14092)
 + * Use the correct digest file and reload sstable metadata in nodetool verify 
(CASSANDRA-14217)
 + * Handle failure when mutating repaired status in Verifier (CASSANDRA-13933)
 + * Close socket on error during connect on OutboundTcpConnection 
(CASSANDRA-9630)
 + * Set encoding for javadoc generation (CASSANDRA-14154)
 + * Fix index target computation for dense composite tables with dropped 
compact storage (CASSANDRA-14104)
 + * Improve commit log chain marker updating (CASSANDRA-14108)
 + * Extra range tombstone bound creates double rows (CASSANDRA-14008)
 + * Fix SStable ordering by max timestamp in SinglePartitionReadCommand 
(CASSANDRA-14010)
 + * Accept role names containing forward-slash (CASSANDRA-14088)
 + * Optimize CRC check chance probability calculations (CASSANDRA-14094)
 + * Fix cleanup on keyspace with no replicas (CASSANDRA-13526)
 + * Fix updating base table rows with TTL not removing materialized view 
entries (CASSANDRA-14071)
 + * Reduce garbage created by DynamicSnitch (CASSANDRA-14091)
 + * More frequent commitlog chained markers (CASSANDRA-13987)
 + * Fix serialized size of DataLimits (CASSANDRA-14057)
 + * Add flag to allow dropping oversized read repair mutations 
(CASSANDRA-13975)
 + * Fix SSTableLoader logger message (CASSANDRA-14003)
 + * Fix repair race that caused gossip to block (CASSANDRA-13849)
 + * Tracing interferes with digest requests when using RandomPartitioner 
(CASSANDRA-13964)
 + * Add flag to disable materialized views, and warnings on creation 
(CASSANDRA-13959)
 + * Don't let user drop or generally break tables in system_distributed 
(CASSANDRA-13813)
 + * Provide a JMX call to sync schema with local storage (CASSANDRA-13954)
 + * Mishandling of cells for removed/dropped columns when reading legacy files 
(CASSANDRA-13939)
 + * Deserialise sstable metadata in nodetool verify (CASSANDRA-13922)
 +Merged from 2.2:
   * Fix the inspectJvmOptions startup check (CASSANDRA-14112)
   * Fix race that prevents submitting compaction for a table when executor is 
full (CASSANDRA-13801)
   * Rely on the JVM to handle OutOfMemoryErrors (CASSANDRA-13006)


-
To unsubscribe, e-mail: commits-unsubscr...@cassandra.apache.org
For additional commands, e-mail: commits-h...@cassandra.apache.org

[03/10] cassandra git commit: Backport circleci yaml

[jasobrown]

Backport circleci yaml

patch by jasobrown; reviewed by Marcus Eriksson for CASSANDRA-14240


Project: http://git-wip-us.apache.org/repos/asf/cassandra/repo
Commit: http://git-wip-us.apache.org/repos/asf/cassandra/commit/9715fc09
Tree: http://git-wip-us.apache.org/repos/asf/cassandra/tree/9715fc09
Diff: http://git-wip-us.apache.org/repos/asf/cassandra/diff/9715fc09

Branch: refs/heads/cassandra-3.11
Commit: 9715fc09b158d04796028d06b4bb4a46a7c3
Parents: 08ebe82
Author: Jason Brown 
Authored: Fri Feb 16 10:03:06 2018 -0800
Committer: Jason Brown 
Committed: Mon Feb 19 05:44:55 2018 -0800

--
 .circleci/config.yml | 339 ++
 CHANGES.txt  |   1 +
 circle.yml   |  18 ---
 3 files changed, 340 insertions(+), 18 deletions(-)
--


http://git-wip-us.apache.org/repos/asf/cassandra/blob/9715fc09/.circleci/config.yml
--
diff --git a/.circleci/config.yml b/.circleci/config.yml
new file mode 100644
index 000..f881b70
--- /dev/null
+++ b/.circleci/config.yml
@@ -0,0 +1,339 @@
+default_env_vars: _env_vars
+JAVA_HOME: /usr/local/openjdk8u154-cassandra-b02
+ANT_HOME: /usr/local/apache-ant-1.10.1
+LANG: en_US.UTF-8
+JDK_HOME: /usr/local/openjdk8u154-cassandra-b02
+JAVA8_HOME: /usr/local/openjdk8u154-cassandra-b02
+JAVA7_HOME: /usr/local/openjdk7u82-cassandra-b02
+KEEP_TEST_DIR: true
+DEFAULT_DIR: /home/cassandra/cassandra-dtest
+PYTHONIOENCODING: utf-8
+PYTHONUNBUFFERED: true
+CASS_DRIVER_NO_EXTENSIONS: true
+CASS_DRIVER_NO_CYTHON: true
+# For environments with xlarge instances, use more memory
+high_capacity_env_vars: _capacity_env_vars
+<<: *default_env_vars
+CCM_MAX_HEAP_SIZE: 2048M
+CCM_HEAP_NEWSIZE: 512M
+# For environments with limited memory (e.g the free OSS CircleCI Tier)
+resource_constrained_env_vars: _constrained_env_vars
+<<: *default_env_vars
+CCM_MAX_HEAP_SIZE: 1024M
+CCM_HEAP_NEWSIZE: 256M
+# Settings for users who do not have a paid CircleCI account
+default_env_settings: _env_settings
+resource_class: medium
+parallelism: 4
+# Settings for users with high-capacity, paid CircleCI account
+high_capacity_env_settings: _capacity_env_settings
+resource_class: xlarge
+parallelism: 100
+default_jobs: _jobs
+jobs:
+- build
+- unit_tests:
+  requires:
+  - build
+with_dtests_jobs: _dtest_jobs
+jobs:
+- build
+- unit_tests:
+  requires:
+  - build
+- dtests-with-vnodes:
+  requires:
+  - build
+- dtests-no-vnodes:
+  requires:
+  - build
+with_dtest_jobs_only: _dtest_jobs_only
+jobs:
+- build
+- dtests-with-vnodes:
+  requires:
+  - build
+- dtests-no-vnodes:
+  requires:
+  - build
+# Set env_settings, env_vars, and workflows/build_and_run_tests based on 
environment
+env_settings: _settings
+<<: *default_env_settings
+#<<: *high_capacity_env_settings
+env_vars: _vars
+<<: *resource_constrained_env_vars
+#<<: *high_capacity_env_vars
+workflows:
+version: 2
+build_and_run_tests: *default_jobs
+#build_and_run_tests: *with_dtest_jobs_only
+#build_and_run_tests: *with_dtest_jobs
+docker_image: _image kjellman/cassandra-test:0.4.3
+version: 2
+jobs:
+  build:
+<<: *env_settings
+parallelism: 1 # This job doesn't benefit from parallelism
+working_directory: ~/
+shell: /bin/bash -eo pipefail -l
+docker:
+  - image: *docker_image
+environment:
+<<: *env_vars
+steps:
+  - run:
+  name: Log Environment Information
+  command: |
+  echo '*** id ***'
+  id
+  echo '*** cat /proc/cpuinfo ***'
+  cat /proc/cpuinfo
+  echo '*** free -m ***'
+  free -m
+  echo '*** df -m ***'
+  df -m
+  echo '*** ifconfig -a ***'
+  ifconfig -a
+  echo '*** uname -a ***'
+  uname -a
+  echo '*** mount ***'
+  mount
+  echo '*** env ***'
+  env
+  - run:
+  name: Clone Cassandra Repository (via git)
+  command: |
+export LANG=en_US.UTF-8
+git clone --single-branch --depth 1 --branch $CIRCLE_BRANCH 
git://github.com/$CIRCLE_PROJECT_USERNAME/$CIRCLE_PROJECT_REPONAME.git 
~/cassandra
+  - run:
+  name: Build Cassandra
+  command: |
+export 

[jira] [Commented] (CASSANDRA-14240) Backport circleci yaml

[Marcus Eriksson (JIRA)]

[ 
https://issues.apache.org/jira/browse/CASSANDRA-14240?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16369123#comment-16369123
 ] 

Marcus Eriksson commented on CASSANDRA-14240:
-

+1

> Backport circleci yaml
> --
>
> Key: CASSANDRA-14240
> URL: https://issues.apache.org/jira/browse/CASSANDRA-14240
> Project: Cassandra
>  Issue Type: Task
>Reporter: Jason Brown
>Assignee: Jason Brown
>Priority: Trivial
> Fix For: 2.2.x, 3.0.x, 3.11.x
>
>
> Backport the circleci yaml (sha {{d6e508f33c1a7274b5826ad9d5ce814d719bd848}}) 
> to earlier branches



--
This message was sent by Atlassian JIRA
(v7.6.3#76005)

-
To unsubscribe, e-mail: commits-unsubscr...@cassandra.apache.org
For additional commands, e-mail: commits-h...@cassandra.apache.org

[jira] [Updated] (CASSANDRA-14240) Backport circleci yaml

[Marcus Eriksson (JIRA)]

 [ 
https://issues.apache.org/jira/browse/CASSANDRA-14240?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
 ]

Marcus Eriksson updated CASSANDRA-14240:

Status: Ready to Commit  (was: Patch Available)

> Backport circleci yaml
> --
>
> Key: CASSANDRA-14240
> URL: https://issues.apache.org/jira/browse/CASSANDRA-14240
> Project: Cassandra
>  Issue Type: Task
>Reporter: Jason Brown
>Assignee: Jason Brown
>Priority: Trivial
> Fix For: 2.2.x, 3.0.x, 3.11.x
>
>
> Backport the circleci yaml (sha {{d6e508f33c1a7274b5826ad9d5ce814d719bd848}}) 
> to earlier branches



--
This message was sent by Atlassian JIRA
(v7.6.3#76005)

-
To unsubscribe, e-mail: commits-unsubscr...@cassandra.apache.org
For additional commands, e-mail: commits-h...@cassandra.apache.org

[jira] [Updated] (CASSANDRA-14240) Backport circleci yaml

[Marcus Eriksson (JIRA)]

 [ 
https://issues.apache.org/jira/browse/CASSANDRA-14240?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
 ]

Marcus Eriksson updated CASSANDRA-14240:

Reviewer: Marcus Eriksson

> Backport circleci yaml
> --
>
> Key: CASSANDRA-14240
> URL: https://issues.apache.org/jira/browse/CASSANDRA-14240
> Project: Cassandra
>  Issue Type: Task
>Reporter: Jason Brown
>Assignee: Jason Brown
>Priority: Trivial
> Fix For: 2.2.x, 3.0.x, 3.11.x
>
>
> Backport the circleci yaml (sha {{d6e508f33c1a7274b5826ad9d5ce814d719bd848}}) 
> to earlier branches



--
This message was sent by Atlassian JIRA
(v7.6.3#76005)

-
To unsubscribe, e-mail: commits-unsubscr...@cassandra.apache.org
For additional commands, e-mail: commits-h...@cassandra.apache.org

[jira] [Commented] (CASSANDRA-11381) Node running with join_ring=false and authentication can not serve requests

[ASF GitHub Bot (JIRA)]

[ 
https://issues.apache.org/jira/browse/CASSANDRA-11381?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16368978#comment-16368978
 ] 

ASF GitHub Bot commented on CASSANDRA-11381:


Github user ptnapoleon commented on a diff in the pull request:

https://github.com/apache/cassandra-dtest/pull/19#discussion_r169038355
  
--- Diff: auth_join_ring_false_test.py ---
@@ -0,0 +1,212 @@
+import pytest
+import logging
+
+from cassandra import AuthenticationFailed, Unauthorized
+from cassandra.cluster import NoHostAvailable
+
+from dtest import Tester
+
+
+class TestAuth(Tester):
+
+
+def test_login_existing_node(self):
+"""
+* Launch a three node cluster
+* Restart the third node in `join_ring=false` mode
+* Connect as the default user/password
+* Verify that default user w/ bad password gives 
AuthenticationFailed exception
+* Verify that bad user gives AuthenticationFailed exception
+#"""
--- End diff --

Seems like there's a loose # here?


> Node running with join_ring=false and authentication can not serve requests
> ---
>
> Key: CASSANDRA-11381
> URL: https://issues.apache.org/jira/browse/CASSANDRA-11381
> Project: Cassandra
>  Issue Type: Bug
>Reporter: mck
>Assignee: mck
>Priority: Major
> Fix For: 2.2.10, 3.0.14, 3.11.0, 4.0
>
>
> Starting up a node with {{-Dcassandra.join_ring=false}} in a cluster that has 
> authentication configured, eg PasswordAuthenticator, won't be able to serve 
> requests. This is because {{Auth.setup()}} never gets called during the 
> startup.
> Without {{Auth.setup()}} having been called in {{StorageService}} clients 
> connecting to the node fail with the node throwing
> {noformat}
> java.lang.NullPointerException
> at 
> org.apache.cassandra.auth.PasswordAuthenticator.authenticate(PasswordAuthenticator.java:119)
> at 
> org.apache.cassandra.thrift.CassandraServer.login(CassandraServer.java:1471)
> at 
> org.apache.cassandra.thrift.Cassandra$Processor$login.getResult(Cassandra.java:3505)
> at 
> org.apache.cassandra.thrift.Cassandra$Processor$login.getResult(Cassandra.java:3489)
> at org.apache.thrift.ProcessFunction.process(ProcessFunction.java:39)
> at org.apache.thrift.TBaseProcessor.process(TBaseProcessor.java:39)
> at com.thinkaurelius.thrift.Message.invoke(Message.java:314)
> at 
> com.thinkaurelius.thrift.Message$Invocation.execute(Message.java:90)
> at 
> com.thinkaurelius.thrift.TDisruptorServer$InvocationHandler.onEvent(TDisruptorServer.java:695)
> at 
> com.thinkaurelius.thrift.TDisruptorServer$InvocationHandler.onEvent(TDisruptorServer.java:689)
> at com.lmax.disruptor.WorkProcessor.run(WorkProcessor.java:112)
> at 
> java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1145)
> at 
> java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:615)
> at java.lang.Thread.run(Thread.java:745)
> {noformat}
> The exception thrown from the 
> [code|https://github.com/apache/cassandra/blob/cassandra-2.0.16/src/java/org/apache/cassandra/auth/PasswordAuthenticator.java#L119]
> {code}
> ResultMessage.Rows rows = 
> authenticateStatement.execute(QueryState.forInternalCalls(), new 
> QueryOptions(consistencyForUser(username),
>   
>Lists.newArrayList(ByteBufferUtil.bytes(username;
> {code}



--
This message was sent by Atlassian JIRA
(v7.6.3#76005)

-
To unsubscribe, e-mail: commits-unsubscr...@cassandra.apache.org
For additional commands, e-mail: commits-h...@cassandra.apache.org

[jira] [Commented] (CASSANDRA-14241) Apache dtests not passing after pytest/python 3

[Stefan Podkowinski (JIRA)]

[ 
https://issues.apache.org/jira/browse/CASSANDRA-14241?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16368936#comment-16368936
 ] 

Stefan Podkowinski commented on CASSANDRA-14241:


I can't see anything wrong with Jolokia and the provided process dump. The 
dtest tools/jmxutils.py script will disable the PerfDisableSharedMem flag in 
jvm.options on node1, as work around for the mentioned Jolokia issue. The 
process listing does confirm that the JVM is actually started without the 
PerfDisableSharedMem flag, which should allow the agent to attach just fine. 
I've been testing this locally with 1.8.0_151; what java version is used by 
Jenkins?

> Apache dtests not passing after pytest/python 3
> ---
>
> Key: CASSANDRA-14241
> URL: https://issues.apache.org/jira/browse/CASSANDRA-14241
> Project: Cassandra
>  Issue Type: Task
>  Components: Testing
>Reporter: Ariel Weisberg
>Priority: Major
>
> Apache dtests are still not running correctly yet with pytest. Most of the 
> tests are running and passing but a solid chunk are still failing and these 
> are tests that don't fail in CircleCI.



--
This message was sent by Atlassian JIRA
(v7.6.3#76005)

-
To unsubscribe, e-mail: commits-unsubscr...@cassandra.apache.org
For additional commands, e-mail: commits-h...@cassandra.apache.org

[jira] [Commented] (CASSANDRA-14087) NPE when CAS encounters empty frozen collection

[Benjamin Lerer (JIRA)]

[ 
https://issues.apache.org/jira/browse/CASSANDRA-14087?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16368930#comment-16368930
 ] 

Benjamin Lerer commented on CASSANDRA-14087:


Sorry, I misunderstood the problem. You can remove the assertion. It is a 
mistake from my part. I was only considering the {{IN}} logic and forgot about 
 frozen lists.

Small nit. {{CQLTester}} has some {{list}}, {{set}} and {{map}} methods that 
you can use instead of the {{Collections}} {{singleton}} methods.It makes the 
code more readable. 

> NPE when CAS encounters empty frozen collection
> ---
>
> Key: CASSANDRA-14087
> URL: https://issues.apache.org/jira/browse/CASSANDRA-14087
> Project: Cassandra
>  Issue Type: Bug
>Reporter: Jens Bannmann
>Assignee: Kurt Greaves
>Priority: Major
> Fix For: 3.0.x, 3.11.x
>
>
> When a compare-and-set operation specifying an equality criterion with a 
> non-{{null}} value encounters an empty collection ({{null}} cell), the server 
> throws a {{NullPointerException}} and the query fails.
> This does not happen for non-frozen collections.
> There's a self-contained test case at 
> [github|https://github.com/incub8/cassandra-npe-in-cas].
> The stack trace for 3.11.0 is:
> {code}
> ERROR [Native-Transport-Requests-1] 2017-11-27 12:59:26,924 
> QueryMessage.java:129 - Unexpected error during query
> java.lang.NullPointerException: null
> at 
> org.apache.cassandra.cql3.ColumnCondition$CollectionBound.appliesTo(ColumnCondition.java:546)
>  ~[apache-cassandra-3.11.0.jar:3.11.0]
> at 
> org.apache.cassandra.cql3.statements.CQL3CasRequest$ColumnsConditions.appliesTo(CQL3CasRequest.java:324)
>  ~[apache-cassandra-3.11.0.jar:3.11.0]
> at 
> org.apache.cassandra.cql3.statements.CQL3CasRequest.appliesTo(CQL3CasRequest.java:210)
>  ~[apache-cassandra-3.11.0.jar:3.11.0]
> at 
> org.apache.cassandra.service.StorageProxy.cas(StorageProxy.java:265) 
> ~[apache-cassandra-3.11.0.jar:3.11.0]
> at 
> org.apache.cassandra.cql3.statements.ModificationStatement.executeWithCondition(ModificationStatement.java:441)
>  ~[apache-cassandra-3.11.0.jar:3.11.0]
> at 
> org.apache.cassandra.cql3.statements.ModificationStatement.execute(ModificationStatement.java:416)
>  ~[apache-cassandra-3.11.0.jar:3.11.0]
> at 
> org.apache.cassandra.cql3.QueryProcessor.processStatement(QueryProcessor.java:217)
>  ~[apache-cassandra-3.11.0.jar:3.11.0]
> at 
> org.apache.cassandra.cql3.QueryProcessor.process(QueryProcessor.java:248) 
> ~[apache-cassandra-3.11.0.jar:3.11.0]
> at 
> org.apache.cassandra.cql3.QueryProcessor.process(QueryProcessor.java:233) 
> ~[apache-cassandra-3.11.0.jar:3.11.0]
> at 
> org.apache.cassandra.transport.messages.QueryMessage.execute(QueryMessage.java:116)
>  ~[apache-cassandra-3.11.0.jar:3.11.0]
> at 
> org.apache.cassandra.transport.Message$Dispatcher.channelRead0(Message.java:517)
>  [apache-cassandra-3.11.0.jar:3.11.0]
> at 
> org.apache.cassandra.transport.Message$Dispatcher.channelRead0(Message.java:410)
>  [apache-cassandra-3.11.0.jar:3.11.0]
> at 
> io.netty.channel.SimpleChannelInboundHandler.channelRead(SimpleChannelInboundHandler.java:105)
>  [netty-all-4.0.44.Final.jar:4.0.44.Final]
> at 
> io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:357)
>  [netty-all-4.0.44.Final.jar:4.0.44.Final]
> at 
> io.netty.channel.AbstractChannelHandlerContext.access$600(AbstractChannelHandlerContext.java:35)
>  [netty-all-4.0.44.Final.jar:4.0.44.Final]
> at 
> io.netty.channel.AbstractChannelHandlerContext$7.run(AbstractChannelHandlerContext.java:348)
>  [netty-all-4.0.44.Final.jar:4.0.44.Final]
> at 
> java.util.concurrent.Executors$RunnableAdapter.call(Executors.java:511) 
> [na:1.8.0_151]
> at 
> org.apache.cassandra.concurrent.AbstractLocalAwareExecutorService$FutureTask.run(AbstractLocalAwareExecutorService.java:162)
>  [apache-cassandra-3.11.0.jar:3.11.0]
> at org.apache.cassandra.concurrent.SEPWorker.run(SEPWorker.java:109) 
> [apache-cassandra-3.11.0.jar:3.11.0]
> at java.lang.Thread.run(Thread.java:748) [na:1.8.0_151]
> {code}



--
This message was sent by Atlassian JIRA
(v7.6.3#76005)

-
To unsubscribe, e-mail: commits-unsubscr...@cassandra.apache.org
For additional commands, e-mail: commits-h...@cassandra.apache.org

[jira] [Commented] (CASSANDRA-14087) NPE when CAS encounters empty frozen collection

[Benjamin Lerer (JIRA)]

[ 
https://issues.apache.org/jira/browse/CASSANDRA-14087?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16368853#comment-16368853
 ] 

Benjamin Lerer commented on CASSANDRA-14087:


[~KurtG] There are 2 {{of}} methods. One for a single term and one for a list 
of terms. For some reasons the wrong one is being picked.
I will have a look later today.

> NPE when CAS encounters empty frozen collection
> ---
>
> Key: CASSANDRA-14087
> URL: https://issues.apache.org/jira/browse/CASSANDRA-14087
> Project: Cassandra
>  Issue Type: Bug
>Reporter: Jens Bannmann
>Assignee: Kurt Greaves
>Priority: Major
> Fix For: 3.0.x, 3.11.x
>
>
> When a compare-and-set operation specifying an equality criterion with a 
> non-{{null}} value encounters an empty collection ({{null}} cell), the server 
> throws a {{NullPointerException}} and the query fails.
> This does not happen for non-frozen collections.
> There's a self-contained test case at 
> [github|https://github.com/incub8/cassandra-npe-in-cas].
> The stack trace for 3.11.0 is:
> {code}
> ERROR [Native-Transport-Requests-1] 2017-11-27 12:59:26,924 
> QueryMessage.java:129 - Unexpected error during query
> java.lang.NullPointerException: null
> at 
> org.apache.cassandra.cql3.ColumnCondition$CollectionBound.appliesTo(ColumnCondition.java:546)
>  ~[apache-cassandra-3.11.0.jar:3.11.0]
> at 
> org.apache.cassandra.cql3.statements.CQL3CasRequest$ColumnsConditions.appliesTo(CQL3CasRequest.java:324)
>  ~[apache-cassandra-3.11.0.jar:3.11.0]
> at 
> org.apache.cassandra.cql3.statements.CQL3CasRequest.appliesTo(CQL3CasRequest.java:210)
>  ~[apache-cassandra-3.11.0.jar:3.11.0]
> at 
> org.apache.cassandra.service.StorageProxy.cas(StorageProxy.java:265) 
> ~[apache-cassandra-3.11.0.jar:3.11.0]
> at 
> org.apache.cassandra.cql3.statements.ModificationStatement.executeWithCondition(ModificationStatement.java:441)
>  ~[apache-cassandra-3.11.0.jar:3.11.0]
> at 
> org.apache.cassandra.cql3.statements.ModificationStatement.execute(ModificationStatement.java:416)
>  ~[apache-cassandra-3.11.0.jar:3.11.0]
> at 
> org.apache.cassandra.cql3.QueryProcessor.processStatement(QueryProcessor.java:217)
>  ~[apache-cassandra-3.11.0.jar:3.11.0]
> at 
> org.apache.cassandra.cql3.QueryProcessor.process(QueryProcessor.java:248) 
> ~[apache-cassandra-3.11.0.jar:3.11.0]
> at 
> org.apache.cassandra.cql3.QueryProcessor.process(QueryProcessor.java:233) 
> ~[apache-cassandra-3.11.0.jar:3.11.0]
> at 
> org.apache.cassandra.transport.messages.QueryMessage.execute(QueryMessage.java:116)
>  ~[apache-cassandra-3.11.0.jar:3.11.0]
> at 
> org.apache.cassandra.transport.Message$Dispatcher.channelRead0(Message.java:517)
>  [apache-cassandra-3.11.0.jar:3.11.0]
> at 
> org.apache.cassandra.transport.Message$Dispatcher.channelRead0(Message.java:410)
>  [apache-cassandra-3.11.0.jar:3.11.0]
> at 
> io.netty.channel.SimpleChannelInboundHandler.channelRead(SimpleChannelInboundHandler.java:105)
>  [netty-all-4.0.44.Final.jar:4.0.44.Final]
> at 
> io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:357)
>  [netty-all-4.0.44.Final.jar:4.0.44.Final]
> at 
> io.netty.channel.AbstractChannelHandlerContext.access$600(AbstractChannelHandlerContext.java:35)
>  [netty-all-4.0.44.Final.jar:4.0.44.Final]
> at 
> io.netty.channel.AbstractChannelHandlerContext$7.run(AbstractChannelHandlerContext.java:348)
>  [netty-all-4.0.44.Final.jar:4.0.44.Final]
> at 
> java.util.concurrent.Executors$RunnableAdapter.call(Executors.java:511) 
> [na:1.8.0_151]
> at 
> org.apache.cassandra.concurrent.AbstractLocalAwareExecutorService$FutureTask.run(AbstractLocalAwareExecutorService.java:162)
>  [apache-cassandra-3.11.0.jar:3.11.0]
> at org.apache.cassandra.concurrent.SEPWorker.run(SEPWorker.java:109) 
> [apache-cassandra-3.11.0.jar:3.11.0]
> at java.lang.Thread.run(Thread.java:748) [na:1.8.0_151]
> {code}



--
This message was sent by Atlassian JIRA
(v7.6.3#76005)

-
To unsubscribe, e-mail: commits-unsubscr...@cassandra.apache.org
For additional commands, e-mail: commits-h...@cassandra.apache.org