This is an automated email from the ASF dual-hosted git repository.
vanzin pushed a change to branch master
in repository https://gitbox.apache.org/repos/asf/spark.git.
from 712874f [SPARK-28931][CORE][TESTS] Fix couple of bugs in
FsHistoryProviderSuite
add 594c9c5 [SPARK-25151][SS] Apply Apache Commons Pool to
KafkaDataConsumer
No new revisions were added by this update.
Summary of changes:
docs/structured-streaming-kafka-integration.md | 73 ++-
external/kafka-0-10-sql/pom.xml | 10 +
.../spark/sql/kafka010/FetchedDataPool.scala | 183 ++++++
.../sql/kafka010/InternalKafkaConsumerPool.scala | 221 +++++++
.../org/apache/spark/sql/kafka010/KafkaBatch.scala | 2 +-
.../sql/kafka010/KafkaBatchPartitionReader.scala | 11 +-
.../spark/sql/kafka010/KafkaContinuousStream.scala | 2 +-
.../spark/sql/kafka010/KafkaDataConsumer.scala | 689 ++++++++++-----------
.../spark/sql/kafka010/KafkaMicroBatchStream.scala | 7 +-
.../apache/spark/sql/kafka010/KafkaRelation.scala | 2 +-
.../apache/spark/sql/kafka010/KafkaSource.scala | 3 +-
.../apache/spark/sql/kafka010/KafkaSourceRDD.scala | 5 +-
.../org/apache/spark/sql/kafka010/package.scala | 36 ++
.../spark/sql/kafka010/FetchedDataPoolSuite.scala | 304 +++++++++
.../kafka010/InternalKafkaConsumerPoolSuite.scala | 285 +++++++++
.../sql/kafka010/KafkaDataConsumerSuite.scala | 205 +++++-
.../sql/kafka010/KafkaMicroBatchSourceSuite.scala | 1 -
pom.xml | 2 +
18 files changed, 1642 insertions(+), 399 deletions(-)
create mode 100644
external/kafka-0-10-sql/src/main/scala/org/apache/spark/sql/kafka010/FetchedDataPool.scala
create mode 100644
external/kafka-0-10-sql/src/main/scala/org/apache/spark/sql/kafka010/InternalKafkaConsumerPool.scala
create mode 100644
external/kafka-0-10-sql/src/test/scala/org/apache/spark/sql/kafka010/FetchedDataPoolSuite.scala
create mode 100644
external/kafka-0-10-sql/src/test/scala/org/apache/spark/sql/kafka010/InternalKafkaConsumerPoolSuite.scala
---------------------------------------------------------------------
To unsubscribe, e-mail: commits-unsubscr...@spark.apache.org
For additional commands, e-mail: commits-h...@spark.apache.org
