[GitHub] cassandra pull request #239: [CASSANDRA-14556] Optimize Streaming

2018-07-26 Thread dineshjoshi
Github user dineshjoshi commented on a diff in the pull request: https://github.com/apache/cassandra/pull/239#discussion_r205532001 --- Diff: src/java/org/apache/cassandra/db/streaming/CassandraStreamHeader.java --- @@ -183,9 +261,26 @@ public CassandraStreamHeader deserialize

[GitHub] cassandra pull request #239: [CASSANDRA-14556] Optimize Streaming

2018-07-26 Thread dineshjoshi
Github user dineshjoshi commented on a diff in the pull request: https://github.com/apache/cassandra/pull/239#discussion_r205532049 --- Diff: test/unit/org/apache/cassandra/db/streaming/CassandraStreamHeaderTest.java --- @@ -43,8 +51,38 @@ public void serializerTest

[GitHub] cassandra pull request #239: [CASSANDRA-14556] Optimize Streaming

2018-07-26 Thread dineshjoshi
Github user dineshjoshi commented on a diff in the pull request: https://github.com/apache/cassandra/pull/239#discussion_r205532095 --- Diff: src/java/org/apache/cassandra/db/streaming/CassandraBlockStreamWriter.java --- @@ -0,0 +1,122 @@ +/* + * Licensed to the Apache

[GitHub] cassandra pull request #239: [CASSANDRA-14556] Optimize Streaming

2018-07-26 Thread dineshjoshi
Github user dineshjoshi commented on a diff in the pull request: https://github.com/apache/cassandra/pull/239#discussion_r205639791 --- Diff: src/java/org/apache/cassandra/db/streaming/CassandraBlockStreamReader.java --- @@ -0,0 +1,173 @@ +/* + * Licensed to the Apache

[GitHub] cassandra pull request #239: [CASSANDRA-14556] Optimize Streaming

2018-07-26 Thread dineshjoshi
Github user dineshjoshi commented on a diff in the pull request: https://github.com/apache/cassandra/pull/239#discussion_r205339231 --- Diff: src/java/org/apache/cassandra/db/streaming/CassandraBlockStreamWriter.java --- @@ -0,0 +1,109 @@ +/* + * Licensed to the Apache

[GitHub] cassandra pull request #239: [CASSANDRA-14556] Optimize Streaming

2018-07-25 Thread dineshjoshi
Github user dineshjoshi commented on a diff in the pull request: https://github.com/apache/cassandra/pull/239#discussion_r205277545 --- Diff: src/java/org/apache/cassandra/db/streaming/CassandraBlockStreamReader.java --- @@ -0,0 +1,177 @@ +/* + * Licensed to the Apache

[GitHub] cassandra pull request #239: [CASSANDRA-14556] Optimize Streaming

2018-07-25 Thread dineshjoshi
Github user dineshjoshi commented on a diff in the pull request: https://github.com/apache/cassandra/pull/239#discussion_r205277492 --- Diff: src/java/org/apache/cassandra/db/streaming/CassandraBlockStreamReader.java --- @@ -0,0 +1,177 @@ +/* + * Licensed to the Apache

[GitHub] cassandra pull request #239: [CASSANDRA-14556] Optimize Streaming

2018-07-25 Thread dineshjoshi
Github user dineshjoshi commented on a diff in the pull request: https://github.com/apache/cassandra/pull/239#discussion_r205298316 --- Diff: src/java/org/apache/cassandra/db/streaming/CassandraBlockStreamWriter.java --- @@ -0,0 +1,109 @@ +/* + * Licensed to the Apache

[GitHub] cassandra pull request #239: [CASSANDRA-14556] Optimize Streaming

2018-07-26 Thread dineshjoshi
Github user dineshjoshi commented on a diff in the pull request: https://github.com/apache/cassandra/pull/239#discussion_r205646170 --- Diff: src/java/org/apache/cassandra/db/streaming/ComponentManifest.java --- @@ -0,0 +1,130 @@ +/* + * Licensed to the Apache Software

[GitHub] cassandra issue #239: [CASSANDRA-14556] Optimize Streaming

2018-07-26 Thread dineshjoshi
Github user dineshjoshi commented on the issue: https://github.com/apache/cassandra/pull/239 @iamaleksey made a few more changes - 1. Got rid of `IStreamWriter` 2. Ensured we're logging the configuration warning only once at start up iff zero copy streaming is enabled

[GitHub] cassandra pull request #239: [CASSANDRA-14556] Optimize Streaming

2018-07-25 Thread dineshjoshi
Github user dineshjoshi commented on a diff in the pull request: https://github.com/apache/cassandra/pull/239#discussion_r205275130 --- Diff: src/java/org/apache/cassandra/db/compaction/Verifier.java --- @@ -361,12 +361,26 @@ public RangeOwnHelper(List> normalizedRan

[GitHub] cassandra pull request #239: [CASSANDRA-14556] Optimize Streaming

2018-07-25 Thread dineshjoshi
Github user dineshjoshi commented on a diff in the pull request: https://github.com/apache/cassandra/pull/239#discussion_r205276122 --- Diff: src/java/org/apache/cassandra/db/streaming/CassandraBlockStreamReader.java --- @@ -0,0 +1,177 @@ +/* + * Licensed to the Apache

[GitHub] cassandra pull request #239: [CASSANDRA-14556] Optimize Streaming

2018-07-25 Thread dineshjoshi
Github user dineshjoshi commented on a diff in the pull request: https://github.com/apache/cassandra/pull/239#discussion_r205276269 --- Diff: src/java/org/apache/cassandra/io/sstable/format/big/BigTableBlockWriter.java --- @@ -0,0 +1,221 @@ +/* + * Licensed to the Apache

[GitHub] cassandra pull request #239: [CASSANDRA-14556] Optimize Streaming

2018-07-25 Thread dineshjoshi
Github user dineshjoshi commented on a diff in the pull request: https://github.com/apache/cassandra/pull/239#discussion_r205276519 --- Diff: src/java/org/apache/cassandra/db/streaming/CassandraBlockStreamReader.java --- @@ -0,0 +1,177 @@ +/* + * Licensed to the Apache

[GitHub] cassandra pull request #239: [CASSANDRA-14556] Optimize Streaming

2018-07-25 Thread dineshjoshi
Github user dineshjoshi commented on a diff in the pull request: https://github.com/apache/cassandra/pull/239#discussion_r205299016 --- Diff: src/java/org/apache/cassandra/db/streaming/CassandraBlockStreamWriter.java --- @@ -0,0 +1,109 @@ +/* + * Licensed to the Apache

[GitHub] cassandra pull request #239: [CASSANDRA-14556] Optimize Streaming

2018-07-25 Thread dineshjoshi
Github user dineshjoshi commented on a diff in the pull request: https://github.com/apache/cassandra/pull/239#discussion_r205298028 --- Diff: src/java/org/apache/cassandra/db/streaming/CassandraBlockStreamWriter.java --- @@ -0,0 +1,109 @@ +/* + * Licensed to the Apache

[GitHub] cassandra pull request #239: [CASSANDRA-14556] Optimize Streaming

2018-07-25 Thread dineshjoshi
Github user dineshjoshi commented on a diff in the pull request: https://github.com/apache/cassandra/pull/239#discussion_r205297956 --- Diff: src/java/org/apache/cassandra/db/streaming/CassandraBlockStreamWriter.java --- @@ -0,0 +1,109 @@ +/* + * Licensed to the Apache

[GitHub] cassandra pull request #239: [CASSANDRA-14556] Optimize Streaming

2018-07-25 Thread dineshjoshi
Github user dineshjoshi commented on a diff in the pull request: https://github.com/apache/cassandra/pull/239#discussion_r205277660 --- Diff: src/java/org/apache/cassandra/db/streaming/CassandraBlockStreamReader.java --- @@ -0,0 +1,177 @@ +/* + * Licensed to the Apache

[GitHub] cassandra pull request #239: [CASSANDRA-14556] Optimize Streaming

2018-07-25 Thread dineshjoshi
Github user dineshjoshi commented on a diff in the pull request: https://github.com/apache/cassandra/pull/239#discussion_r205283093 --- Diff: src/java/org/apache/cassandra/io/sstable/format/big/BigTableBlockWriter.java --- @@ -0,0 +1,221 @@ +/* + * Licensed to the Apache

[GitHub] cassandra pull request #239: [CASSANDRA-14556] Optimize Streaming

2018-07-25 Thread dineshjoshi
Github user dineshjoshi commented on a diff in the pull request: https://github.com/apache/cassandra/pull/239#discussion_r205282807 --- Diff: src/java/org/apache/cassandra/io/sstable/format/big/BigTableBlockWriter.java --- @@ -0,0 +1,221 @@ +/* + * Licensed to the Apache

[GitHub] cassandra pull request #239: [CASSANDRA-14556] Optimize Streaming

2018-07-25 Thread dineshjoshi
Github user dineshjoshi commented on a diff in the pull request: https://github.com/apache/cassandra/pull/239#discussion_r205282784 --- Diff: src/java/org/apache/cassandra/io/sstable/format/big/BigTableBlockWriter.java --- @@ -0,0 +1,221 @@ +/* + * Licensed to the Apache

[GitHub] cassandra pull request #239: [CASSANDRA-14556] Optimize Streaming

2018-07-25 Thread dineshjoshi
Github user dineshjoshi commented on a diff in the pull request: https://github.com/apache/cassandra/pull/239#discussion_r205297558 --- Diff: src/java/org/apache/cassandra/db/streaming/ComponentManifest.java --- @@ -0,0 +1,129 @@ +/* + * Licensed to the Apache Software

[GitHub] cassandra pull request #239: [CASSANDRA-14556] Optimize Streaming

2018-07-25 Thread dineshjoshi
Github user dineshjoshi commented on a diff in the pull request: https://github.com/apache/cassandra/pull/239#discussion_r205297184 --- Diff: src/java/org/apache/cassandra/db/streaming/ComponentManifest.java --- @@ -0,0 +1,129 @@ +/* + * Licensed to the Apache Software

[GitHub] cassandra pull request #239: [CASSANDRA-14556] Optimize Streaming

2018-07-25 Thread dineshjoshi
Github user dineshjoshi commented on a diff in the pull request: https://github.com/apache/cassandra/pull/239#discussion_r205297151 --- Diff: src/java/org/apache/cassandra/db/streaming/ComponentManifest.java --- @@ -0,0 +1,129 @@ +/* + * Licensed to the Apache Software

[GitHub] cassandra issue #239: [CASSANDRA-14556] Optimize Streaming

2018-07-26 Thread dineshjoshi
Github user dineshjoshi commented on the issue: https://github.com/apache/cassandra/pull/239 @iamaleksey I've addressed your comments including the one about disabling faster streaming for legacy counter shards. I did add a much less expensive check for STCS. It won't get all

[GitHub] cassandra issue #244: Refactor and add samplers for CASSANDRA-14436

2018-08-03 Thread dineshjoshi
Github user dineshjoshi commented on the issue: https://github.com/apache/cassandra/pull/244 Stepping back a bit, I see the samplers are stateful classes that are enabled and disabled. This means, if there is an exception in the rmi thread that is executing the `beginLocalSampling

[GitHub] cassandra pull request #244: Refactor and add samplers for CASSANDRA-14436

2018-08-03 Thread dineshjoshi
Github user dineshjoshi commented on a diff in the pull request: https://github.com/apache/cassandra/pull/244#discussion_r207697017 --- Diff: src/java/org/apache/cassandra/metrics/TableMetrics.java --- @@ -281,7 +301,7 @@ public Long getValue() public final Meter

[GitHub] cassandra pull request #244: Refactor and add samplers for CASSANDRA-14436

2018-08-03 Thread dineshjoshi
Github user dineshjoshi commented on a diff in the pull request: https://github.com/apache/cassandra/pull/244#discussion_r207697707 --- Diff: src/java/org/apache/cassandra/metrics/Sampler.java --- @@ -0,0 +1,67 @@ +package org.apache.cassandra.metrics; + +import

[GitHub] cassandra pull request #244: Refactor and add samplers for CASSANDRA-14436

2018-08-03 Thread dineshjoshi
Github user dineshjoshi commented on a diff in the pull request: https://github.com/apache/cassandra/pull/244#discussion_r207697487 --- Diff: src/java/org/apache/cassandra/metrics/Sampler.java --- @@ -0,0 +1,67 @@ +package org.apache.cassandra.metrics; + +import

[GitHub] cassandra pull request #244: Refactor and add samplers for CASSANDRA-14436

2018-08-03 Thread dineshjoshi
Github user dineshjoshi commented on a diff in the pull request: https://github.com/apache/cassandra/pull/244#discussion_r207697651 --- Diff: src/java/org/apache/cassandra/tools/nodetool/ProfileLoad.java --- @@ -0,0 +1,178 @@ +package org.apache.cassandra.tools.nodetool

[GitHub] cassandra pull request #244: Refactor and add samplers for CASSANDRA-14436

2018-08-03 Thread dineshjoshi
Github user dineshjoshi commented on a diff in the pull request: https://github.com/apache/cassandra/pull/244#discussion_r207697217 --- Diff: src/java/org/apache/cassandra/db/ReadExecutionController.java --- @@ -113,6 +123,11 @@ static ReadExecutionController forCommand(ReadCommand

[GitHub] cassandra pull request #244: Refactor and add samplers for CASSANDRA-14436

2018-08-03 Thread dineshjoshi
Github user dineshjoshi commented on a diff in the pull request: https://github.com/apache/cassandra/pull/244#discussion_r207697430 --- Diff: src/java/org/apache/cassandra/metrics/FrequencySampler.java --- @@ -0,0 +1,105 @@ +/* + * Licensed to the Apache Software Foundation

[GitHub] cassandra pull request #244: Refactor and add samplers for CASSANDRA-14436

2018-08-03 Thread dineshjoshi
Github user dineshjoshi commented on a diff in the pull request: https://github.com/apache/cassandra/pull/244#discussion_r207697381 --- Diff: src/java/org/apache/cassandra/metrics/FrequencySampler.java --- @@ -0,0 +1,105 @@ +/* + * Licensed to the Apache Software Foundation

[GitHub] cassandra pull request #244: Refactor and add samplers for CASSANDRA-14436

2018-08-03 Thread dineshjoshi
Github user dineshjoshi commented on a diff in the pull request: https://github.com/apache/cassandra/pull/244#discussion_r207697637 --- Diff: src/java/org/apache/cassandra/tools/nodetool/ProfileLoad.java --- @@ -0,0 +1,178 @@ +package org.apache.cassandra.tools.nodetool

[GitHub] cassandra pull request #244: Refactor and add samplers for CASSANDRA-14436

2018-08-03 Thread dineshjoshi
Github user dineshjoshi commented on a diff in the pull request: https://github.com/apache/cassandra/pull/244#discussion_r207697287 --- Diff: src/java/org/apache/cassandra/db/ReadExecutionController.java --- @@ -132,6 +147,17 @@ public void close

[GitHub] cassandra pull request #244: Refactor and add samplers for CASSANDRA-14436

2018-08-03 Thread dineshjoshi
Github user dineshjoshi commented on a diff in the pull request: https://github.com/apache/cassandra/pull/244#discussion_r207697244 --- Diff: src/java/org/apache/cassandra/db/ReadExecutionController.java --- @@ -113,6 +123,11 @@ static ReadExecutionController forCommand(ReadCommand

[GitHub] cassandra pull request #244: Refactor and add samplers for CASSANDRA-14436

2018-08-03 Thread dineshjoshi
Github user dineshjoshi commented on a diff in the pull request: https://github.com/apache/cassandra/pull/244#discussion_r207697297 --- Diff: src/java/org/apache/cassandra/db/ReadExecutionController.java --- @@ -132,6 +147,17 @@ public void close

[GitHub] cassandra pull request #244: Refactor and add samplers for CASSANDRA-14436

2018-08-16 Thread dineshjoshi
Github user dineshjoshi commented on a diff in the pull request: https://github.com/apache/cassandra/pull/244#discussion_r210488658 --- Diff: src/java/org/apache/cassandra/metrics/MaxSampler.java --- @@ -0,0 +1,59 @@ +package org.apache.cassandra.metrics; + +import

[GitHub] cassandra pull request #244: Refactor and add samplers for CASSANDRA-14436

2018-08-16 Thread dineshjoshi
Github user dineshjoshi commented on a diff in the pull request: https://github.com/apache/cassandra/pull/244#discussion_r210487768 --- Diff: src/java/org/apache/cassandra/db/ReadExecutionController.java --- @@ -132,6 +145,15 @@ public void close

[GitHub] cassandra pull request #255: Marcuse/14618

2018-08-29 Thread dineshjoshi
Github user dineshjoshi commented on a diff in the pull request: https://github.com/apache/cassandra/pull/255#discussion_r213558547 --- Diff: src/java/org/apache/cassandra/tools/fqltool/QueryReplayer.java --- @@ -0,0 +1,150 @@ +/* + * Licensed to the Apache Software

[GitHub] cassandra pull request #255: Marcuse/14618

2018-08-29 Thread dineshjoshi
Github user dineshjoshi commented on a diff in the pull request: https://github.com/apache/cassandra/pull/255#discussion_r213558579 --- Diff: src/java/org/apache/cassandra/tools/fqltool/QueryReplayer.java --- @@ -0,0 +1,150 @@ +/* + * Licensed to the Apache Software

[GitHub] cassandra pull request #255: Marcuse/14618

2018-08-29 Thread dineshjoshi
Github user dineshjoshi commented on a diff in the pull request: https://github.com/apache/cassandra/pull/255#discussion_r213562817 --- Diff: src/java/org/apache/cassandra/tools/fqltool/FQLQuery.java --- @@ -0,0 +1,263 @@ +/* + * Licensed to the Apache Software Foundation

[GitHub] cassandra pull request #255: Marcuse/14618

2018-08-29 Thread dineshjoshi
Github user dineshjoshi commented on a diff in the pull request: https://github.com/apache/cassandra/pull/255#discussion_r213558075 --- Diff: src/java/org/apache/cassandra/tools/fqltool/QueryReplayer.java --- @@ -0,0 +1,150 @@ +/* + * Licensed to the Apache Software

[GitHub] cassandra pull request #255: Marcuse/14618

2018-08-29 Thread dineshjoshi
Github user dineshjoshi commented on a diff in the pull request: https://github.com/apache/cassandra/pull/255#discussion_r213563877 --- Diff: src/java/org/apache/cassandra/tools/fqltool/FQLQueryReader.java --- @@ -0,0 +1,95 @@ +/* + * Licensed to the Apache Software

[GitHub] cassandra pull request #255: Marcuse/14618

2018-08-29 Thread dineshjoshi
Github user dineshjoshi commented on a diff in the pull request: https://github.com/apache/cassandra/pull/255#discussion_r213564246 --- Diff: src/java/org/apache/cassandra/tools/fqltool/ResultComparator.java --- @@ -0,0 +1,122 @@ +/* + * Licensed to the Apache Software

[GitHub] cassandra pull request #255: Marcuse/14618

2018-08-29 Thread dineshjoshi
Github user dineshjoshi commented on a diff in the pull request: https://github.com/apache/cassandra/pull/255#discussion_r213562548 --- Diff: src/java/org/apache/cassandra/tools/fqltool/FQLQuery.java --- @@ -0,0 +1,263 @@ +/* + * Licensed to the Apache Software Foundation

[GitHub] cassandra pull request #255: Marcuse/14618

2018-08-29 Thread dineshjoshi
Github user dineshjoshi commented on a diff in the pull request: https://github.com/apache/cassandra/pull/255#discussion_r213557602 --- Diff: src/java/org/apache/cassandra/tools/fqltool/QueryReplayer.java --- @@ -0,0 +1,150 @@ +/* + * Licensed to the Apache Software

[GitHub] cassandra pull request #255: Marcuse/14618

2018-08-29 Thread dineshjoshi
Github user dineshjoshi commented on a diff in the pull request: https://github.com/apache/cassandra/pull/255#discussion_r213559247 --- Diff: src/java/org/apache/cassandra/tools/fqltool/FQLQueryIterator.java --- @@ -0,0 +1,71 @@ +/* + * Licensed to the Apache Software

[GitHub] cassandra pull request #255: Marcuse/14618

2018-08-29 Thread dineshjoshi
Github user dineshjoshi commented on a diff in the pull request: https://github.com/apache/cassandra/pull/255#discussion_r213557051 --- Diff: src/java/org/apache/cassandra/tools/fqltool/QueryReplayer.java --- @@ -0,0 +1,150 @@ +/* + * Licensed to the Apache Software

[GitHub] cassandra pull request #255: Marcuse/14618

2018-08-29 Thread dineshjoshi
Github user dineshjoshi commented on a diff in the pull request: https://github.com/apache/cassandra/pull/255#discussion_r213564852 --- Diff: src/java/org/apache/cassandra/tools/fqltool/ResultStore.java --- @@ -0,0 +1,144 @@ +/* + * Licensed to the Apache Software

[GitHub] cassandra pull request #255: Marcuse/14618

2018-08-29 Thread dineshjoshi
Github user dineshjoshi commented on a diff in the pull request: https://github.com/apache/cassandra/pull/255#discussion_r213558154 --- Diff: src/java/org/apache/cassandra/tools/fqltool/QueryReplayer.java --- @@ -0,0 +1,150 @@ +/* + * Licensed to the Apache Software

[GitHub] cassandra pull request #255: Marcuse/14618

2018-08-29 Thread dineshjoshi
Github user dineshjoshi commented on a diff in the pull request: https://github.com/apache/cassandra/pull/255#discussion_r213562282 --- Diff: src/java/org/apache/cassandra/tools/fqltool/DriverResultSet.java --- @@ -0,0 +1,253 @@ +/* + * Licensed to the Apache Software

[GitHub] cassandra pull request #255: Marcuse/14618

2018-08-29 Thread dineshjoshi
Github user dineshjoshi commented on a diff in the pull request: https://github.com/apache/cassandra/pull/255#discussion_r213563398 --- Diff: src/java/org/apache/cassandra/tools/fqltool/FQLQuery.java --- @@ -0,0 +1,263 @@ +/* + * Licensed to the Apache Software Foundation

[GitHub] cassandra pull request #255: Marcuse/14618

2018-08-29 Thread dineshjoshi
Github user dineshjoshi commented on a diff in the pull request: https://github.com/apache/cassandra/pull/255#discussion_r213562501 --- Diff: src/java/org/apache/cassandra/tools/fqltool/FQLQuery.java --- @@ -0,0 +1,263 @@ +/* + * Licensed to the Apache Software Foundation

[GitHub] cassandra pull request #255: Marcuse/14618

2018-08-29 Thread dineshjoshi
Github user dineshjoshi commented on a diff in the pull request: https://github.com/apache/cassandra/pull/255#discussion_r213564366 --- Diff: src/java/org/apache/cassandra/tools/fqltool/ResultHandler.java --- @@ -0,0 +1,124 @@ +/* + * Licensed to the Apache Software

[GitHub] cassandra issue #239: [CASSANDRA-14556] Optimize Streaming

2018-07-13 Thread dineshjoshi
Github user dineshjoshi commented on the issue: https://github.com/apache/cassandra/pull/239 @aweisberg I have updated the dtest to test with different compaction strategies and addressed remaining comments

[GitHub] cassandra pull request #239: [CASSANDRA-14556] Optimize Streaming

2018-07-23 Thread dineshjoshi
Github user dineshjoshi commented on a diff in the pull request: https://github.com/apache/cassandra/pull/239#discussion_r204586299 --- Diff: src/java/org/apache/cassandra/db/streaming/CassandraOutgoingFile.java --- @@ -114,13 +155,51 @@ public void write(StreamSession session

[GitHub] cassandra pull request #239: [CASSANDRA-14556] Optimize Streaming

2018-07-24 Thread dineshjoshi
Github user dineshjoshi commented on a diff in the pull request: https://github.com/apache/cassandra/pull/239#discussion_r204954749 --- Diff: src/java/org/apache/cassandra/config/DatabaseDescriptor.java --- @@ -2260,6 +2260,20 @@ public static int getStreamingConnectionsPerHost

[GitHub] cassandra pull request #239: [CASSANDRA-14556] Optimize Streaming

2018-07-24 Thread dineshjoshi
Github user dineshjoshi commented on a diff in the pull request: https://github.com/apache/cassandra/pull/239#discussion_r204954729 --- Diff: src/java/org/apache/cassandra/db/streaming/ComponentInfo.java --- @@ -0,0 +1,97 @@ +/* + * Licensed to the Apache Software

[GitHub] cassandra issue #239: [CASSANDRA-14556] Optimize Streaming

2018-07-24 Thread dineshjoshi
Github user dineshjoshi commented on the issue: https://github.com/apache/cassandra/pull/239 @iamaleksey I have resolved most of your comments. I still have a couple to go. I will update this PR when I am done with those and get a clean dtest run

[GitHub] cassandra pull request #239: [CASSANDRA-14556] Optimize Streaming

2018-07-24 Thread dineshjoshi
Github user dineshjoshi commented on a diff in the pull request: https://github.com/apache/cassandra/pull/239#discussion_r204954805 --- Diff: src/java/org/apache/cassandra/db/streaming/CassandraBlockStreamReader.java --- @@ -0,0 +1,184 @@ +/* + * Licensed to the Apache

[GitHub] cassandra pull request #239: [CASSANDRA-14556] Optimize Streaming

2018-07-24 Thread dineshjoshi
Github user dineshjoshi commented on a diff in the pull request: https://github.com/apache/cassandra/pull/239#discussion_r204955043 --- Diff: src/java/org/apache/cassandra/db/lifecycle/LogFile.java --- @@ -66,7 +66,7 @@ private final LogReplicaSet replicas = new

[GitHub] cassandra pull request #239: [CASSANDRA-14556] Optimize Streaming

2018-07-24 Thread dineshjoshi
Github user dineshjoshi commented on a diff in the pull request: https://github.com/apache/cassandra/pull/239#discussion_r204955316 --- Diff: src/java/org/apache/cassandra/db/streaming/CassandraOutgoingFile.java --- @@ -114,13 +155,51 @@ public void write(StreamSession session

[GitHub] cassandra pull request #239: [CASSANDRA-14556] Optimize Streaming

2018-07-24 Thread dineshjoshi
Github user dineshjoshi commented on a diff in the pull request: https://github.com/apache/cassandra/pull/239#discussion_r204955090 --- Diff: src/java/org/apache/cassandra/db/streaming/ComponentInfo.java --- @@ -0,0 +1,97 @@ +/* + * Licensed to the Apache Software

[GitHub] cassandra pull request #239: [CASSANDRA-14556] Optimize Streaming

2018-07-13 Thread dineshjoshi
Github user dineshjoshi commented on a diff in the pull request: https://github.com/apache/cassandra/pull/239#discussion_r202489810 --- Diff: src/java/org/apache/cassandra/net/async/RebufferingByteBufDataInputPlus.java --- @@ -249,4 +250,42 @@ public ByteBufAllocator getAllocator

[GitHub] cassandra pull request #239: [CASSANDRA-14556] Optimize Streaming

2018-07-13 Thread dineshjoshi
Github user dineshjoshi commented on a diff in the pull request: https://github.com/apache/cassandra/pull/239#discussion_r202492216 --- Diff: conf/cassandra.yaml --- @@ -784,6 +784,15 @@ compaction_throughput_mb_per_sec: 16 # between the sstables, reducing page cache churn

[GitHub] cassandra pull request #239: [CASSANDRA-14556] Optimize Streaming

2018-07-25 Thread dineshjoshi
Github user dineshjoshi commented on a diff in the pull request: https://github.com/apache/cassandra/pull/239#discussion_r204998639 --- Diff: src/java/org/apache/cassandra/db/streaming/CassandraOutgoingFile.java --- @@ -62,7 +90,23 @@ public CassandraOutgoingFile(StreamOperation

[GitHub] cassandra issue #239: [CASSANDRA-14556] Optimize Streaming

2018-07-25 Thread dineshjoshi
Github user dineshjoshi commented on the issue: https://github.com/apache/cassandra/pull/239 @iamaleksey I *think* I've resolved all your comments. The last dtest was all green. I'm not sure about the latest push but I don't forsee any breakages. Please let me know if there are more

[GitHub] cassandra pull request #239: [CASSANDRA-14556] Optimize Streaming

2018-07-24 Thread dineshjoshi
Github user dineshjoshi commented on a diff in the pull request: https://github.com/apache/cassandra/pull/239#discussion_r204842484 --- Diff: src/java/org/apache/cassandra/db/lifecycle/LogFile.java --- @@ -66,7 +66,7 @@ private final LogReplicaSet replicas = new

[GitHub] cassandra pull request #253: 13630

2018-09-07 Thread dineshjoshi
Github user dineshjoshi commented on a diff in the pull request: https://github.com/apache/cassandra/pull/253#discussion_r216047177 --- Diff: src/java/org/apache/cassandra/net/async/MessageOutHandler.java --- @@ -140,8 +125,17 @@ public void write(ChannelHandlerContext ctx, Object

[GitHub] cassandra pull request #253: 13630

2018-09-07 Thread dineshjoshi
Github user dineshjoshi commented on a diff in the pull request: https://github.com/apache/cassandra/pull/253#discussion_r215735492 --- Diff: src/java/org/apache/cassandra/streaming/async/NettyStreamingMessageSender.java --- @@ -393,6 +393,18 @@ private Channel getOrCreateChannel

[GitHub] cassandra pull request #253: 13630

2018-09-07 Thread dineshjoshi
Github user dineshjoshi commented on a diff in the pull request: https://github.com/apache/cassandra/pull/253#discussion_r215739220 --- Diff: src/java/org/apache/cassandra/net/MessageIn.java --- @@ -231,4 +241,437 @@ public String toString() sbuf.append("FROM:&quo

[GitHub] cassandra pull request #253: 13630

2018-09-07 Thread dineshjoshi
Github user dineshjoshi commented on a diff in the pull request: https://github.com/apache/cassandra/pull/253#discussion_r215733539 --- Diff: src/java/org/apache/cassandra/net/async/MessageOutHandler.java --- @@ -140,8 +125,17 @@ public void write(ChannelHandlerContext ctx, Object

[GitHub] cassandra pull request #253: 13630

2018-09-07 Thread dineshjoshi
Github user dineshjoshi commented on a diff in the pull request: https://github.com/apache/cassandra/pull/253#discussion_r215734926 --- Diff: src/java/org/apache/cassandra/net/async/RebufferingByteBufDataInputPlus.java --- @@ -183,6 +195,11 @@ public int available() throws

[GitHub] cassandra pull request #253: 13630

2018-09-07 Thread dineshjoshi
Github user dineshjoshi commented on a diff in the pull request: https://github.com/apache/cassandra/pull/253#discussion_r215733891 --- Diff: src/java/org/apache/cassandra/net/async/RebufferingByteBufDataInputPlus.java --- @@ -36,6 +37,11 @@ public class

[GitHub] cassandra pull request #253: 13630

2018-09-07 Thread dineshjoshi
Github user dineshjoshi commented on a diff in the pull request: https://github.com/apache/cassandra/pull/253#discussion_r216086521 --- Diff: src/java/org/apache/cassandra/net/async/RebufferingByteBufDataInputPlus.java --- @@ -36,6 +37,11 @@ public class

[GitHub] cassandra pull request #253: 13630

2018-09-07 Thread dineshjoshi
Github user dineshjoshi commented on a diff in the pull request: https://github.com/apache/cassandra/pull/253#discussion_r216106796 --- Diff: src/java/org/apache/cassandra/net/MessageOut.java --- @@ -180,6 +199,73 @@ public String toString() return sbuf.toString

[GitHub] cassandra pull request #253: 13630

2018-09-07 Thread dineshjoshi
Github user dineshjoshi commented on a diff in the pull request: https://github.com/apache/cassandra/pull/253#discussion_r216102238 --- Diff: test/unit/org/apache/cassandra/net/MessageInProcessorPre40Test.java --- @@ -0,0 +1,115 @@ +/* + * Licensed to the Apache Software

[GitHub] cassandra pull request #253: 13630

2018-09-07 Thread dineshjoshi
Github user dineshjoshi commented on a diff in the pull request: https://github.com/apache/cassandra/pull/253#discussion_r216103691 --- Diff: src/java/org/apache/cassandra/net/async/MessageInHandler.java --- @@ -18,143 +18,296 @@ package org.apache.cassandra.net.async

[GitHub] cassandra pull request #253: 13630

2018-09-07 Thread dineshjoshi
Github user dineshjoshi commented on a diff in the pull request: https://github.com/apache/cassandra/pull/253#discussion_r216105848 --- Diff: src/java/org/apache/cassandra/net/MessageOut.java --- @@ -180,6 +199,73 @@ public String toString() return sbuf.toString

[GitHub] cassandra pull request #253: 13630

2018-09-07 Thread dineshjoshi
Github user dineshjoshi commented on a diff in the pull request: https://github.com/apache/cassandra/pull/253#discussion_r216088059 --- Diff: src/java/org/apache/cassandra/net/MessageIn.java --- @@ -231,4 +241,437 @@ public String toString() sbuf.append("FROM:&quo

[GitHub] cassandra pull request #239: Optimize Streaming

2018-07-10 Thread dineshjoshi
Github user dineshjoshi commented on a diff in the pull request: https://github.com/apache/cassandra/pull/239#discussion_r201455458 --- Diff: src/java/org/apache/cassandra/net/async/ByteBufDataOutputStreamPlus.java --- @@ -135,6 +140,53 @@ public ChannelFuture writeToChannel

[GitHub] cassandra pull request #239: Optimize Streaming

2018-07-10 Thread dineshjoshi
Github user dineshjoshi commented on a diff in the pull request: https://github.com/apache/cassandra/pull/239#discussion_r201461195 --- Diff: src/java/org/apache/cassandra/io/util/RebufferingInputStream.java --- @@ -26,7 +26,9 @@ import java.nio.ByteOrder; import

[GitHub] cassandra pull request #239: Optimize Streaming

2018-07-10 Thread dineshjoshi
Github user dineshjoshi commented on a diff in the pull request: https://github.com/apache/cassandra/pull/239#discussion_r201461162 --- Diff: src/java/org/apache/cassandra/net/async/RebufferingByteBufDataInputPlus.java --- @@ -249,4 +253,50 @@ public ByteBufAllocator getAllocator

[GitHub] cassandra pull request #239: Optimize Streaming

2018-07-10 Thread dineshjoshi
Github user dineshjoshi commented on a diff in the pull request: https://github.com/apache/cassandra/pull/239#discussion_r201461066 --- Diff: src/java/org/apache/cassandra/net/async/RebufferingByteBufDataInputPlus.java --- @@ -249,4 +253,50 @@ public ByteBufAllocator getAllocator

[GitHub] cassandra pull request #239: Optimize Streaming

2018-07-11 Thread dineshjoshi
Github user dineshjoshi commented on a diff in the pull request: https://github.com/apache/cassandra/pull/239#discussion_r201604409 --- Diff: src/java/org/apache/cassandra/db/streaming/CassandraBlockStreamReader.java --- @@ -0,0 +1,172 @@ +/* + * Licensed to the Apache

[GitHub] cassandra pull request #239: Optimize Streaming

2018-07-03 Thread dineshjoshi
GitHub user dineshjoshi opened a pull request: https://github.com/apache/cassandra/pull/239 Optimize Streaming You can merge this pull request into a Git repository by running: $ git pull https://github.com/dineshjoshi/cassandra 14556-trunk-optimize-streaming Alternatively

[GitHub] cassandra issue #239: [CASSANDRA-14556] Optimize Streaming

2018-07-13 Thread dineshjoshi
Github user dineshjoshi commented on the issue: https://github.com/apache/cassandra/pull/239 1. Fixed the data directory selection 2. Added & updated unit tests 3. Added documentation in cassandra.yaml 4. Updated the microbenchmark to benchmark the read and write

[GitHub] cassandra pull request #239: [CASSANDRA-14556] Optimize Streaming

2018-07-13 Thread dineshjoshi
Github user dineshjoshi commented on a diff in the pull request: https://github.com/apache/cassandra/pull/239#discussion_r202488581 --- Diff: src/java/org/apache/cassandra/net/async/RebufferingByteBufDataInputPlus.java --- @@ -249,4 +250,42 @@ public ByteBufAllocator getAllocator

[GitHub] cassandra pull request #239: [CASSANDRA-14556] Optimize Streaming

2018-07-13 Thread dineshjoshi
Github user dineshjoshi commented on a diff in the pull request: https://github.com/apache/cassandra/pull/239#discussion_r202488672 --- Diff: conf/cassandra.yaml --- @@ -784,6 +784,15 @@ compaction_throughput_mb_per_sec: 16 # between the sstables, reducing page cache churn

[GitHub] cassandra pull request #239: [CASSANDRA-14556] Optimize Streaming

2018-07-13 Thread dineshjoshi
Github user dineshjoshi commented on a diff in the pull request: https://github.com/apache/cassandra/pull/239#discussion_r202477311 --- Diff: src/java/org/apache/cassandra/db/DiskBoundaries.java --- @@ -129,4 +129,19 @@ public int getBoundariesFromSSTableDirectory(Descriptor

[GitHub] cassandra pull request #239: [CASSANDRA-14556] Optimize Streaming

2018-07-13 Thread dineshjoshi
Github user dineshjoshi commented on a diff in the pull request: https://github.com/apache/cassandra/pull/239#discussion_r202491699 --- Diff: src/java/org/apache/cassandra/net/async/RebufferingByteBufDataInputPlus.java --- @@ -249,4 +250,42 @@ public ByteBufAllocator getAllocator

[GitHub] cassandra pull request #239: [CASSANDRA-14556] Optimize Streaming

2018-07-13 Thread dineshjoshi
Github user dineshjoshi commented on a diff in the pull request: https://github.com/apache/cassandra/pull/239#discussion_r202487016 --- Diff: conf/cassandra.yaml --- @@ -784,6 +784,15 @@ compaction_throughput_mb_per_sec: 16 # between the sstables, reducing page cache churn

[GitHub] cassandra pull request #239: [CASSANDRA-14556] Optimize Streaming

2018-07-13 Thread dineshjoshi
Github user dineshjoshi commented on a diff in the pull request: https://github.com/apache/cassandra/pull/239#discussion_r202493566 --- Diff: src/java/org/apache/cassandra/db/streaming/CassandraOutgoingFile.java --- @@ -114,13 +153,54 @@ public void write(StreamSession session

[GitHub] cassandra pull request #201: [JAVA-1771] Add Driver name and version informa...

2018-03-01 Thread dineshjoshi
Github user dineshjoshi closed the pull request at: https://github.com/apache/cassandra/pull/201 --- - To unsubscribe, e-mail: pr-unsubscr...@cassandra.apache.org For additional commands, e-mail: pr-h

[GitHub] cassandra issue #201: [JAVA-1771] Add Driver name and version information

2018-03-01 Thread dineshjoshi
Github user dineshjoshi commented on the issue: https://github.com/apache/cassandra/pull/201 Wrong repo! --- - To unsubscribe, e-mail: pr-unsubscr...@cassandra.apache.org For additional commands, e-mail: pr-h

[GitHub] cassandra pull request #201: [JAVA-1771] Add Driver name and version informa...

2018-03-01 Thread dineshjoshi
GitHub user dineshjoshi opened a pull request: https://github.com/apache/cassandra/pull/201 [JAVA-1771] Add Driver name and version information @aholmberg thank you for the review. Opening up the PR per your comments on the ticket. You can merge this pull request into a Git

[GitHub] cassandra pull request #279: CASSANDRA-14790 Fix flaky LongBufferPoolTest

2018-10-15 Thread dineshjoshi
Github user dineshjoshi commented on a diff in the pull request: https://github.com/apache/cassandra/pull/279#discussion_r225404206 --- Diff: test/burn/org/apache/cassandra/utils/memory/LongBufferPoolTest.java --- @@ -327,24 +373,41 @@ BufferCheck sample

[GitHub] cassandra pull request #279: CASSANDRA-14790 Fix flaky LongBufferPoolTest

2018-10-15 Thread dineshjoshi
Github user dineshjoshi commented on a diff in the pull request: https://github.com/apache/cassandra/pull/279#discussion_r225404225 --- Diff: test/burn/org/apache/cassandra/utils/memory/LongBufferPoolTest.java --- @@ -327,24 +373,41 @@ BufferCheck sample

[GitHub] cassandra pull request #279: CASSANDRA-14790 Fix flaky LongBufferPoolTest

2018-10-15 Thread dineshjoshi
Github user dineshjoshi commented on a diff in the pull request: https://github.com/apache/cassandra/pull/279#discussion_r225404189 --- Diff: test/burn/org/apache/cassandra/utils/memory/LongBufferPoolTest.java --- @@ -327,24 +373,41 @@ BufferCheck sample

  1   2   >