Github user cloud-fan commented on a diff in the pull request:
https://github.com/apache/spark/pull/19925#discussion_r156872558
--- Diff:
sql/core/src/main/java/org/apache/spark/sql/sources/v2/writer/ContinuousWriter.java
---
@@ -0,0 +1,41 @@
+/*
+ * Licensed to the
Github user cloud-fan commented on a diff in the pull request:
https://github.com/apache/spark/pull/19925#discussion_r156872002
--- Diff:
sql/core/src/main/java/org/apache/spark/sql/sources/v2/reader/MicroBatchReader.java
---
@@ -0,0 +1,64 @@
+/*
+ * Licensed to the
Github user cloud-fan commented on a diff in the pull request:
https://github.com/apache/spark/pull/19925#discussion_r156871819
--- Diff:
sql/core/src/main/java/org/apache/spark/sql/sources/v2/reader/MicroBatchReader.java
---
@@ -0,0 +1,64 @@
+/*
+ * Licensed to the
Github user cloud-fan commented on a diff in the pull request:
https://github.com/apache/spark/pull/19925#discussion_r156871677
--- Diff:
sql/core/src/main/java/org/apache/spark/sql/sources/v2/reader/ContinuousReader.java
---
@@ -0,0 +1,68 @@
+/*
+ * Licensed to the
Github user cloud-fan commented on a diff in the pull request:
https://github.com/apache/spark/pull/19925#discussion_r156871374
--- Diff:
sql/core/src/main/java/org/apache/spark/sql/sources/v2/reader/ContinuousDataReader.java
---
@@ -0,0 +1,36 @@
+/*
+ * Licensed to the
Github user cloud-fan commented on a diff in the pull request:
https://github.com/apache/spark/pull/19925#discussion_r156870726
--- Diff:
sql/core/src/main/java/org/apache/spark/sql/sources/v2/MicroBatchWriteSupport.java
---
@@ -0,0 +1,58 @@
+/*
+ * Licensed to the Apache
Github user asfgit closed the pull request at:
https://github.com/apache/spark/pull/19925
---
-
To unsubscribe, e-mail: reviews-unsubscr...@spark.apache.org
For additional commands, e-mail: reviews-h...@spark.apache.org
Github user zsxwing commented on a diff in the pull request:
https://github.com/apache/spark/pull/19925#discussion_r156779552
--- Diff:
sql/core/src/test/scala/org/apache/spark/sql/execution/streaming/RateSourceV2Suite.scala
---
@@ -0,0 +1,128 @@
+/*
+ * Licensed to the
Github user zsxwing commented on a diff in the pull request:
https://github.com/apache/spark/pull/19925#discussion_r156779156
--- Diff:
sql/core/src/test/scala/org/apache/spark/sql/execution/streaming/RateSourceV2Suite.scala
---
@@ -0,0 +1,128 @@
+/*
+ * Licensed to the
Github user joseph-torres commented on a diff in the pull request:
https://github.com/apache/spark/pull/19925#discussion_r156741131
--- Diff:
sql/core/src/main/scala/org/apache/spark/sql/execution/streaming/continuous/ContinuousRateStreamSource.scala
---
@@ -0,0 +1,155 @@
+/*
Github user joseph-torres commented on a diff in the pull request:
https://github.com/apache/spark/pull/19925#discussion_r156740666
--- Diff:
sql/core/src/main/scala/org/apache/spark/sql/execution/streaming/memoryV2.scala
---
@@ -0,0 +1,185 @@
+/*
+ * Licensed to the
Github user joseph-torres commented on a diff in the pull request:
https://github.com/apache/spark/pull/19925#discussion_r156542366
--- Diff:
sql/core/src/main/scala/org/apache/spark/sql/execution/streaming/continuous/ContinuousRateStreamSource.scala
---
@@ -0,0 +1,155 @@
+/*
Github user joseph-torres commented on a diff in the pull request:
https://github.com/apache/spark/pull/19925#discussion_r156540689
--- Diff:
sql/core/src/main/scala/org/apache/spark/sql/execution/streaming/continuous/ContinuousRateStreamSource.scala
---
@@ -0,0 +1,155 @@
+/*
Github user zsxwing commented on a diff in the pull request:
https://github.com/apache/spark/pull/19925#discussion_r156540301
--- Diff:
sql/core/src/main/scala/org/apache/spark/sql/execution/streaming/continuous/ContinuousRateStreamSource.scala
---
@@ -0,0 +1,155 @@
+/*
+
Github user joseph-torres commented on a diff in the pull request:
https://github.com/apache/spark/pull/19925#discussion_r156539696
--- Diff:
sql/core/src/main/scala/org/apache/spark/sql/execution/streaming/continuous/ContinuousRateStreamSource.scala
---
@@ -0,0 +1,155 @@
+/*
Github user zsxwing commented on a diff in the pull request:
https://github.com/apache/spark/pull/19925#discussion_r156524302
--- Diff:
sql/core/src/main/java/org/apache/spark/sql/sources/v2/reader/PartitionOffset.java
---
@@ -0,0 +1,28 @@
+/*
+ * Licensed to the Apache
Github user zsxwing commented on a diff in the pull request:
https://github.com/apache/spark/pull/19925#discussion_r156535101
--- Diff:
sql/core/src/main/scala/org/apache/spark/sql/execution/streaming/continuous/ContinuousRateStreamSource.scala
---
@@ -0,0 +1,155 @@
+/*
+
Github user zsxwing commented on a diff in the pull request:
https://github.com/apache/spark/pull/19925#discussion_r156526139
--- Diff:
sql/core/src/main/java/org/apache/spark/sql/sources/v2/reader/Offset.java ---
@@ -0,0 +1,54 @@
+/*
+ * Licensed to the Apache Software
Github user zsxwing commented on a diff in the pull request:
https://github.com/apache/spark/pull/19925#discussion_r156535839
--- Diff:
sql/core/src/main/scala/org/apache/spark/sql/execution/streaming/memoryV2.scala
---
@@ -0,0 +1,185 @@
+/*
+ * Licensed to the Apache
Github user zsxwing commented on a diff in the pull request:
https://github.com/apache/spark/pull/19925#discussion_r156532274
--- Diff:
sql/core/src/main/scala/org/apache/spark/sql/execution/streaming/continuous/ContinuousRateStreamSource.scala
---
@@ -0,0 +1,155 @@
+/*
+
Github user zsxwing commented on a diff in the pull request:
https://github.com/apache/spark/pull/19925#discussion_r156530920
--- Diff:
sql/core/src/main/scala/org/apache/spark/sql/execution/streaming/continuous/ContinuousRateStreamSource.scala
---
@@ -0,0 +1,155 @@
+/*
+
Github user zsxwing commented on a diff in the pull request:
https://github.com/apache/spark/pull/19925#discussion_r156530584
--- Diff:
sql/core/src/main/scala/org/apache/spark/sql/execution/streaming/continuous/ContinuousRateStreamSource.scala
---
@@ -0,0 +1,155 @@
+/*
+
Github user zsxwing commented on a diff in the pull request:
https://github.com/apache/spark/pull/19925#discussion_r156533755
--- Diff:
sql/core/src/main/scala/org/apache/spark/sql/execution/streaming/continuous/ContinuousRateStreamSource.scala
---
@@ -0,0 +1,155 @@
+/*
+
Github user zsxwing commented on a diff in the pull request:
https://github.com/apache/spark/pull/19925#discussion_r156531367
--- Diff:
sql/core/src/main/scala/org/apache/spark/sql/execution/streaming/continuous/ContinuousRateStreamSource.scala
---
@@ -0,0 +1,155 @@
+/*
+
Github user joseph-torres commented on a diff in the pull request:
https://github.com/apache/spark/pull/19925#discussion_r155867163
--- Diff:
sql/core/src/main/java/org/apache/spark/sql/sources/v2/MicroBatchWriteSupport.java
---
@@ -0,0 +1,58 @@
+/*
+ * Licensed to the
Github user brkyvz commented on a diff in the pull request:
https://github.com/apache/spark/pull/19925#discussion_r155834182
--- Diff:
sql/core/src/main/java/org/apache/spark/sql/sources/v2/MicroBatchWriteSupport.java
---
@@ -0,0 +1,58 @@
+/*
+ * Licensed to the Apache
GitHub user joseph-torres opened a pull request:
https://github.com/apache/spark/pull/19925
[SPARK-22732] Add Structured Streaming APIs to DataSourceV2
## What changes were proposed in this pull request?
This PR provides DataSourceV2 API support for structured streaming,
27 matches
Mail list logo
