[GitHub] spark pull request #20698: [SPARK-23541][SS] Allow Kafka source to read data...

Github user asfgit closed the pull request at: https://github.com/apache/spark/pull/20698 --- - To unsubscribe, e-mail: reviews-unsubscr...@spark.apache.org For additional commands, e-mail: reviews-h...@spark.apache.org

[GitHub] spark pull request #20698: [SPARK-23541][SS] Allow Kafka source to read data...

Github user tdas commented on a diff in the pull request: https://github.com/apache/spark/pull/20698#discussion_r171989658 --- Diff: external/kafka-0-10-sql/src/main/scala/org/apache/spark/sql/kafka010/KafkaOffsetRangeCalculator.scala --- @@ -0,0 +1,106 @@ +/* + *

[GitHub] spark pull request #20698: [SPARK-23541][SS] Allow Kafka source to read data...

Github user brkyvz commented on a diff in the pull request: https://github.com/apache/spark/pull/20698#discussion_r171988510 --- Diff: external/kafka-0-10-sql/src/test/scala/org/apache/spark/sql/kafka010/KafkaOffsetRangeCalculatorSuite.scala --- @@ -0,0 +1,136 @@ +/* + *

[GitHub] spark pull request #20698: [SPARK-23541][SS] Allow Kafka source to read data...

Github user brkyvz commented on a diff in the pull request: https://github.com/apache/spark/pull/20698#discussion_r17198 --- Diff: external/kafka-0-10-sql/src/main/scala/org/apache/spark/sql/kafka010/KafkaOffsetRangeCalculator.scala --- @@ -0,0 +1,106 @@ +/* + *

[GitHub] spark pull request #20698: [SPARK-23541][SS] Allow Kafka source to read data...

Github user brkyvz commented on a diff in the pull request: https://github.com/apache/spark/pull/20698#discussion_r171987888 --- Diff: external/kafka-0-10-sql/src/main/scala/org/apache/spark/sql/kafka010/KafkaOffsetRangeCalculator.scala --- @@ -0,0 +1,106 @@ +/* + *

[GitHub] spark pull request #20698: [SPARK-23541][SS] Allow Kafka source to read data...

Github user brkyvz commented on a diff in the pull request: https://github.com/apache/spark/pull/20698#discussion_r171988062 --- Diff: external/kafka-0-10-sql/src/main/scala/org/apache/spark/sql/kafka010/KafkaOffsetRangeCalculator.scala --- @@ -0,0 +1,106 @@ +/* + *

[GitHub] spark pull request #20698: [SPARK-23541][SS] Allow Kafka source to read data...

Github user brkyvz commented on a diff in the pull request: https://github.com/apache/spark/pull/20698#discussion_r171988112 --- Diff: external/kafka-0-10-sql/src/main/scala/org/apache/spark/sql/kafka010/KafkaOffsetRangeCalculator.scala --- @@ -0,0 +1,106 @@ +/* + *

[GitHub] spark pull request #20698: [SPARK-23541][SS] Allow Kafka source to read data...

Github user brkyvz commented on a diff in the pull request: https://github.com/apache/spark/pull/20698#discussion_r171983185 --- Diff: external/kafka-0-10-sql/src/main/scala/org/apache/spark/sql/kafka010/KafkaOffsetRangeCalculator.scala --- @@ -0,0 +1,102 @@ +/* + *

[GitHub] spark pull request #20698: [SPARK-23541][SS] Allow Kafka source to read data...

Github user tdas commented on a diff in the pull request: https://github.com/apache/spark/pull/20698#discussion_r171750758 --- Diff: external/kafka-0-10-sql/src/main/scala/org/apache/spark/sql/kafka010/KafkaOffsetRangeCalculator.scala --- @@ -0,0 +1,105 @@ +/* + *

[GitHub] spark pull request #20698: [SPARK-23541][SS] Allow Kafka source to read data...

Github user tdas commented on a diff in the pull request: https://github.com/apache/spark/pull/20698#discussion_r171750580 --- Diff: external/kafka-0-10-sql/src/main/scala/org/apache/spark/sql/kafka010/KafkaOffsetRangeCalculator.scala --- @@ -0,0 +1,105 @@ +/* + *

[GitHub] spark pull request #20698: [SPARK-23541][SS] Allow Kafka source to read data...

Github user tdas commented on a diff in the pull request: https://github.com/apache/spark/pull/20698#discussion_r171750437 --- Diff: external/kafka-0-10-sql/src/main/scala/org/apache/spark/sql/kafka010/KafkaOffsetRangeCalculator.scala --- @@ -0,0 +1,105 @@ +/* + *

[GitHub] spark pull request #20698: [SPARK-23541][SS] Allow Kafka source to read data...

Github user tdas commented on a diff in the pull request: https://github.com/apache/spark/pull/20698#discussion_r171741765 --- Diff: external/kafka-0-10-sql/src/main/scala/org/apache/spark/sql/kafka010/KafkaOffsetRangeCalculator.scala --- @@ -0,0 +1,105 @@ +/* + *

[GitHub] spark pull request #20698: [SPARK-23541][SS] Allow Kafka source to read data...

Github user brkyvz commented on a diff in the pull request: https://github.com/apache/spark/pull/20698#discussion_r171732779 --- Diff: external/kafka-0-10-sql/src/main/scala/org/apache/spark/sql/kafka010/KafkaMicroBatchReader.scala --- @@ -370,8 +361,14 @@ private[kafka010] class

[GitHub] spark pull request #20698: [SPARK-23541][SS] Allow Kafka source to read data...

Github user brkyvz commented on a diff in the pull request: https://github.com/apache/spark/pull/20698#discussion_r171733516 --- Diff: external/kafka-0-10-sql/src/main/scala/org/apache/spark/sql/kafka010/KafkaOffsetRangeCalculator.scala --- @@ -0,0 +1,105 @@ +/* + *

[GitHub] spark pull request #20698: [SPARK-23541][SS] Allow Kafka source to read data...

Github user brkyvz commented on a diff in the pull request: https://github.com/apache/spark/pull/20698#discussion_r171733038 --- Diff: external/kafka-0-10-sql/src/main/scala/org/apache/spark/sql/kafka010/KafkaOffsetRangeCalculator.scala --- @@ -0,0 +1,105 @@ +/* + *

[GitHub] spark pull request #20698: [SPARK-23541][SS] Allow Kafka source to read data...

Github user brkyvz commented on a diff in the pull request: https://github.com/apache/spark/pull/20698#discussion_r171732729 --- Diff: external/kafka-0-10-sql/src/main/scala/org/apache/spark/sql/kafka010/KafkaMicroBatchReader.scala --- @@ -320,28 +300,39 @@ private[kafka010]

[GitHub] spark pull request #20698: [SPARK-23541][SS] Allow Kafka source to read data...

Github user brkyvz commented on a diff in the pull request: https://github.com/apache/spark/pull/20698#discussion_r171733181 --- Diff: external/kafka-0-10-sql/src/main/scala/org/apache/spark/sql/kafka010/KafkaOffsetRangeCalculator.scala --- @@ -0,0 +1,105 @@ +/* + *

[GitHub] spark pull request #20698: [SPARK-23541][SS] Allow Kafka source to read data...

Github user brkyvz commented on a diff in the pull request: https://github.com/apache/spark/pull/20698#discussion_r171732183 --- Diff: external/kafka-0-10-sql/src/main/scala/org/apache/spark/sql/kafka010/KafkaMicroBatchReader.scala --- @@ -199,10 +179,10 @@ private[kafka010]

[GitHub] spark pull request #20698: [SPARK-23541][SS] Allow Kafka source to read data...

Github user tdas commented on a diff in the pull request: https://github.com/apache/spark/pull/20698#discussion_r171732015 --- Diff: external/kafka-0-10-sql/src/main/scala/org/apache/spark/sql/kafka010/KafkaMicroBatchReader.scala --- @@ -199,10 +179,10 @@ private[kafka010] class

[GitHub] spark pull request #20698: [SPARK-23541][SS] Allow Kafka source to read data...

Github user jose-torres commented on a diff in the pull request: https://github.com/apache/spark/pull/20698#discussion_r171698925 --- Diff: external/kafka-0-10-sql/src/main/scala/org/apache/spark/sql/kafka010/KafkaOffsetRangeCalculator.scala --- @@ -0,0 +1,105 @@ +/* + *

[GitHub] spark pull request #20698: [SPARK-23541][SS] Allow Kafka source to read data...

Github user jose-torres commented on a diff in the pull request: https://github.com/apache/spark/pull/20698#discussion_r171685190 --- Diff: external/kafka-0-10-sql/src/main/scala/org/apache/spark/sql/kafka010/KafkaOffsetRangeCalculator.scala --- @@ -0,0 +1,105 @@ +/* + *

[GitHub] spark pull request #20698: [SPARK-23541][SS] Allow Kafka source to read data...

Github user jose-torres commented on a diff in the pull request: https://github.com/apache/spark/pull/20698#discussion_r171685001 --- Diff: external/kafka-0-10-sql/src/main/scala/org/apache/spark/sql/kafka010/KafkaOffsetRangeCalculator.scala --- @@ -0,0 +1,105 @@ +/* + *

[GitHub] spark pull request #20698: [SPARK-23541][SS] Allow Kafka source to read data...

Github user jose-torres commented on a diff in the pull request: https://github.com/apache/spark/pull/20698#discussion_r171685641 --- Diff: external/kafka-0-10-sql/src/main/scala/org/apache/spark/sql/kafka010/KafkaOffsetRangeCalculator.scala --- @@ -0,0 +1,105 @@ +/* + *

[GitHub] spark pull request #20698: [SPARK-23541][SS] Allow Kafka source to read data...

Github user tdas commented on a diff in the pull request: https://github.com/apache/spark/pull/20698#discussion_r171441133 --- Diff: external/kafka-0-10-sql/src/main/scala/org/apache/spark/sql/kafka010/KafkaOffsetRangeCalculator.scala --- @@ -0,0 +1,105 @@ +/* + *

[GitHub] spark pull request #20698: [SPARK-23541][SS] Allow Kafka source to read data...

GitHub user tdas opened a pull request: https://github.com/apache/spark/pull/20698 [SPARK-23541][SS] Allow Kafka source to read data with greater parallelism than the number of topic-partitions ## What changes were proposed in this pull request? Currently, when the Kafka