Github user AmplabJenkins commented on the pull request:
https://github.com/apache/spark/pull/10208#issuecomment-163074814
Test FAILed.
Refer to this link for build results (access rights to CI server needed):
Github user AmplabJenkins commented on the pull request:
https://github.com/apache/spark/pull/10208#issuecomment-163074811
Merged build finished. Test FAILed.
---
If your project is set up for it, you can reply to this email and have your
reply appear on GitHub as well. If your
Github user AmplabJenkins commented on the pull request:
https://github.com/apache/spark/pull/10211#issuecomment-163074777
Test PASSed.
Refer to this link for build results (access rights to CI server needed):
Github user felixcheung commented on the pull request:
https://github.com/apache/spark/pull/10191#issuecomment-163076251
sure - read.df doesn't match DataFrameReader so there are certain sources
that it couldn't handle
---
If your project is set up for it, you can reply to this
Github user SparkQA commented on the pull request:
https://github.com/apache/spark/pull/10170#issuecomment-163082947
**[Test build #47383 has
started](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/47383/consoleFull)**
for PR 10170 at commit
Github user AmplabJenkins commented on the pull request:
https://github.com/apache/spark/pull/10170#issuecomment-163086560
Merged build finished. Test FAILed.
---
If your project is set up for it, you can reply to this email and have your
reply appear on GitHub as well. If your
Github user AmplabJenkins commented on the pull request:
https://github.com/apache/spark/pull/10170#issuecomment-163086561
Test FAILed.
Refer to this link for build results (access rights to CI server needed):
Github user AmplabJenkins commented on the pull request:
https://github.com/apache/spark/pull/10181#issuecomment-163086712
Merged build finished. Test FAILed.
---
If your project is set up for it, you can reply to this email and have your
reply appear on GitHub as well. If your
Github user SparkQA commented on the pull request:
https://github.com/apache/spark/pull/10170#issuecomment-163086522
**[Test build #47380 has
finished](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/47380/consoleFull)**
for PR 10170 at commit
Github user AmplabJenkins commented on the pull request:
https://github.com/apache/spark/pull/10181#issuecomment-163086714
Test FAILed.
Refer to this link for build results (access rights to CI server needed):
Github user SparkQA commented on the pull request:
https://github.com/apache/spark/pull/10181#issuecomment-163086711
**[Test build #47386 has
started](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/47386/consoleFull)**
for PR 10181 at commit
Github user ted-yu commented on the pull request:
https://github.com/apache/spark/pull/10181#issuecomment-163046834
Jenkins, test this please
---
If your project is set up for it, you can reply to this email and have your
reply appear on GitHub as well. If your project does not have
Github user andrewor14 commented on a diff in the pull request:
https://github.com/apache/spark/pull/10170#discussion_r47029205
--- Diff:
core/src/test/scala/org/apache/spark/memory/UnifiedMemoryManagerSuite.scala ---
@@ -154,32 +177,34 @@ class UnifiedMemoryManagerSuite extends
Github user vanzin commented on the pull request:
https://github.com/apache/spark/pull/10159#issuecomment-163053807
So, I'm a little confused; is the text rendered correctly or not? If it is,
then that part was not a bug, right (and doesn't need to be mentioned in the pr
title)?
Github user davies commented on a diff in the pull request:
https://github.com/apache/spark/pull/9819#discussion_r47031556
--- Diff:
sql/core/src/main/scala/org/apache/spark/sql/execution/Window.scala ---
@@ -156,36 +165,90 @@ case class Window(
* @param frame boundaries.
Github user andrewor14 commented on a diff in the pull request:
https://github.com/apache/spark/pull/10170#discussion_r47032863
--- Diff:
core/src/test/scala/org/apache/spark/memory/UnifiedMemoryManagerSuite.scala ---
@@ -143,7 +148,25 @@ class UnifiedMemoryManagerSuite extends
Github user ted-yu commented on the pull request:
https://github.com/apache/spark/pull/10181#issuecomment-163061030
```
[error]
/home/jenkins/workspace/SparkPullRequestBuilder@2/unsafe/src/main/java/org/apache/spark/unsafe/Platform.java:21:
error: Bits is not public in java.nio;
Github user AmplabJenkins commented on the pull request:
https://github.com/apache/spark/pull/8513#issuecomment-163065217
Merged build finished. Test PASSed.
---
If your project is set up for it, you can reply to this email and have your
reply appear on GitHub as well. If your
Github user AmplabJenkins commented on the pull request:
https://github.com/apache/spark/pull/8513#issuecomment-163065219
Test PASSed.
Refer to this link for build results (access rights to CI server needed):
Github user SparkQA commented on the pull request:
https://github.com/apache/spark/pull/10197#issuecomment-163067069
**[Test build #47376 has
started](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/47376/consoleFull)**
for PR 10197 at commit
Github user ajbozarth commented on the pull request:
https://github.com/apache/spark/pull/10154#issuecomment-163066981
added the MiMa exclude, please advise if I did it correctly
---
If your project is set up for it, you can reply to this email and have your
reply appear on GitHub as
Github user jerryshao commented on the pull request:
https://github.com/apache/spark/pull/7786#issuecomment-163069474
@steveloughran , by default Yarn will preempt the container 15 seconds
after the warning. Yarn RM gives the warning to AM depends on the cluster usage
at that time,
Github user jkbradley commented on a diff in the pull request:
https://github.com/apache/spark/pull/10207#discussion_r47039765
--- Diff: docs/ml-classification-regression.md ---
@@ -0,0 +1,762 @@
+---
+layout: global
+title: Classification and regression - spark.ml
Github user jkbradley commented on a diff in the pull request:
https://github.com/apache/spark/pull/10207#discussion_r47039758
--- Diff: docs/ml-classification-regression.md ---
@@ -0,0 +1,762 @@
+---
+layout: global
+title: Classification and regression - spark.ml
Github user jkbradley commented on a diff in the pull request:
https://github.com/apache/spark/pull/10207#discussion_r47039742
--- Diff: docs/ml-classification-regression.md ---
@@ -0,0 +1,762 @@
+---
+layout: global
+title: Classification and regression - spark.ml
Github user sun-rui commented on the pull request:
https://github.com/apache/spark/pull/10191#issuecomment-163074514
@felixcheung, what do you mean "a generic read() method"? we have read.df()
yet?
---
If your project is set up for it, you can reply to this email and have your
reply
Github user jkbradley commented on a diff in the pull request:
https://github.com/apache/spark/pull/10207#discussion_r47039750
--- Diff: docs/ml-classification-regression.md ---
@@ -0,0 +1,762 @@
+---
+layout: global
+title: Classification and regression - spark.ml
Github user jkbradley commented on a diff in the pull request:
https://github.com/apache/spark/pull/10207#discussion_r47039755
--- Diff: docs/ml-classification-regression.md ---
@@ -0,0 +1,762 @@
+---
+layout: global
+title: Classification and regression - spark.ml
Github user SparkQA commented on the pull request:
https://github.com/apache/spark/pull/10211#issuecomment-163074684
**[Test build #47379 has
finished](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/47379/consoleFull)**
for PR 10211 at commit
Github user SparkQA commented on the pull request:
https://github.com/apache/spark/pull/10207#issuecomment-163087316
**[Test build #2187 has
finished](https://amplab.cs.berkeley.edu/jenkins/job/NewSparkPullRequestBuilder/2187/consoleFull)**
for PR 10207 at commit
Github user SparkQA commented on the pull request:
https://github.com/apache/spark/pull/10207#issuecomment-163087384
**[Test build #47384 has
finished](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/47384/consoleFull)**
for PR 10207 at commit
Github user SparkQA commented on the pull request:
https://github.com/apache/spark/pull/10205#issuecomment-163087383
**[Test build #47388 has
started](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/47388/consoleFull)**
for PR 10205 at commit
Github user AmplabJenkins commented on the pull request:
https://github.com/apache/spark/pull/10207#issuecomment-163087452
Merged build finished. Test PASSed.
---
If your project is set up for it, you can reply to this email and have your
reply appear on GitHub as well. If your
Github user winningsix commented on the pull request:
https://github.com/apache/spark/pull/10144#issuecomment-163087290
Hi @vanzin
This PR includes two parts:
1. Add user information to SessionState which is required to initialize the
authorizer.
2. Add parser rules to
Github user vanzin commented on the pull request:
https://github.com/apache/spark/pull/10144#issuecomment-163087431
This is not really my area, but I'm sure SQL guys will pick this up. ok to
test
---
If your project is set up for it, you can reply to this email and have your
reply
Github user AmplabJenkins commented on the pull request:
https://github.com/apache/spark/pull/10207#issuecomment-163087454
Test PASSed.
Refer to this link for build results (access rights to CI server needed):
Github user SparkQA commented on the pull request:
https://github.com/apache/spark/pull/10210#issuecomment-163087272
**[Test build #47387 has
started](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/47387/consoleFull)**
for PR 10210 at commit
Github user SparkQA commented on the pull request:
https://github.com/apache/spark/pull/10162#issuecomment-163038142
**[Test build #47368 has
started](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/47368/consoleFull)**
for PR 10162 at commit
Github user andrewor14 commented on a diff in the pull request:
https://github.com/apache/spark/pull/10170#discussion_r47028774
--- Diff:
core/src/main/scala/org/apache/spark/memory/StorageMemoryPool.scala ---
@@ -73,27 +73,31 @@ class StorageMemoryPool(lock: Object) extends
Github user andrewor14 commented on a diff in the pull request:
https://github.com/apache/spark/pull/10170#discussion_r47028931
--- Diff:
core/src/test/scala/org/apache/spark/memory/UnifiedMemoryManagerSuite.scala ---
@@ -154,32 +177,34 @@ class UnifiedMemoryManagerSuite extends
Github user andrewor14 commented on the pull request:
https://github.com/apache/spark/pull/10170#issuecomment-163052886
@JoshRosen despite the number of comments I left I think this patch looks
good. I did a close review to verify its correctness and that the two bugs were
real
Github user davies commented on a diff in the pull request:
https://github.com/apache/spark/pull/9819#discussion_r47035762
--- Diff:
sql/catalyst/src/main/scala/org/apache/spark/sql/catalyst/expressions/windowExpressions.scala
---
@@ -328,3 +281,222 @@ object
Github user JoshRosen commented on a diff in the pull request:
https://github.com/apache/spark/pull/10170#discussion_r47035741
--- Diff:
core/src/test/scala/org/apache/spark/memory/UnifiedMemoryManagerSuite.scala ---
@@ -143,7 +148,25 @@ class UnifiedMemoryManagerSuite extends
Github user SparkQA commented on the pull request:
https://github.com/apache/spark/pull/8513#issuecomment-163065129
**[Test build #47372 has
finished](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/47372/consoleFull)**
for PR 8513 at commit
Github user scwf commented on the pull request:
https://github.com/apache/spark/pull/9748#issuecomment-163074120
ok, should i send pr to master and branch-1.6 both?
---
If your project is set up for it, you can reply to this email and have your
reply appear on GitHub as well. If your
Github user HyukjinKwon commented on the pull request:
https://github.com/apache/spark/pull/9687#issuecomment-163081502
I will add that function to `SharedSQLContext` if it is okay.
---
If your project is set up for it, you can reply to this email and have your
reply appear on GitHub
Github user jkbradley commented on the pull request:
https://github.com/apache/spark/pull/10207#issuecomment-163085055
Thanks for updating it! LGTM pending tests.
---
If your project is set up for it, you can reply to this email and have your
reply appear on GitHub as well. If your
Github user AmplabJenkins commented on the pull request:
https://github.com/apache/spark/pull/10170#issuecomment-163085038
Test FAILed.
Refer to this link for build results (access rights to CI server needed):
Github user AmplabJenkins commented on the pull request:
https://github.com/apache/spark/pull/10170#issuecomment-163085035
Merged build finished. Test FAILed.
---
If your project is set up for it, you can reply to this email and have your
reply appear on GitHub as well. If your
Github user SparkQA commented on the pull request:
https://github.com/apache/spark/pull/10170#issuecomment-163084981
**[Test build #47378 has
finished](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/47378/consoleFull)**
for PR 10170 at commit
Github user marmbrus commented on the pull request:
https://github.com/apache/spark/pull/10210#issuecomment-163085627
ok to test
---
If your project is set up for it, you can reply to this email and have your
reply appear on GitHub as well. If your project does not have this feature
Github user andrewor14 commented on a diff in the pull request:
https://github.com/apache/spark/pull/10045#discussion_r47027308
--- Diff:
core/src/main/scala/org/apache/spark/scheduler/TaskSetManager.scala ---
@@ -58,14 +58,21 @@ private[spark] class TaskSetManager(
Github user andrewor14 commented on a diff in the pull request:
https://github.com/apache/spark/pull/10045#discussion_r47027403
--- Diff:
core/src/main/scala/org/apache/spark/scheduler/TaskSetManager.scala ---
@@ -58,14 +58,21 @@ private[spark] class TaskSetManager(
Github user SparkQA commented on the pull request:
https://github.com/apache/spark/pull/10060#issuecomment-163059528
**[Test build #47366 has
finished](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/47366/consoleFull)**
for PR 10060 at commit
Github user davies commented on a diff in the pull request:
https://github.com/apache/spark/pull/9819#discussion_r47034214
--- Diff:
sql/catalyst/src/main/scala/org/apache/spark/sql/catalyst/analysis/Analyzer.scala
---
@@ -870,26 +878,37 @@ class Analyzer(
//
Github user AmplabJenkins commented on the pull request:
https://github.com/apache/spark/pull/10162#issuecomment-163061446
Merged build finished. Test PASSed.
---
If your project is set up for it, you can reply to this email and have your
reply appear on GitHub as well. If your
Github user hvanhovell commented on a diff in the pull request:
https://github.com/apache/spark/pull/9819#discussion_r47034276
--- Diff:
sql/catalyst/src/main/scala/org/apache/spark/sql/catalyst/analysis/Analyzer.scala
---
@@ -567,6 +567,8 @@ class Analyzer(
case u
Github user SparkQA commented on the pull request:
https://github.com/apache/spark/pull/8512#issuecomment-163067717
**[Test build #47377 has
started](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/47377/consoleFull)**
for PR 8512 at commit
GitHub user yhuai opened a pull request:
https://github.com/apache/spark/pull/10211
[SPARK-11678] [SQL] [DOCS] Document basePath in the programming guide.
This PR adds document for `basePath`, which is a new parameter used by
`HadoopFsRelation`.
The compiled doc is shown
Github user yhuai commented on the pull request:
https://github.com/apache/spark/pull/10211#issuecomment-163070439
cc @marmbrus @liancheng
---
If your project is set up for it, you can reply to this email and have your
reply appear on GitHub as well. If your project does not have
Github user jerryshao commented on the pull request:
https://github.com/apache/spark/pull/10197#issuecomment-163078191
Hi @viirya , I really don't see any difference compared to receiver based
Kafka stream, the only difference is that you change the high-level consumer
API to
Github user SparkQA commented on the pull request:
https://github.com/apache/spark/pull/8880#issuecomment-163080081
**[Test build #47381 has
started](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/47381/consoleFull)**
for PR 8880 at commit
Github user sun-rui commented on a diff in the pull request:
https://github.com/apache/spark/pull/10201#discussion_r47042545
--- Diff: R/pkg/R/DataFrame.R ---
@@ -1324,12 +1312,16 @@ setMethod("selectExpr",
#' path <- "path/to/file.json"
#' df <- jsonFile(sqlContext,
Github user SparkQA commented on the pull request:
https://github.com/apache/spark/pull/9598#issuecomment-163081913
**[Test build #2186 has
finished](https://amplab.cs.berkeley.edu/jenkins/job/NewSparkPullRequestBuilder/2186/consoleFull)**
for PR 9598 at commit
Github user AmplabJenkins commented on the pull request:
https://github.com/apache/spark/pull/8512#issuecomment-163085307
Test PASSed.
Refer to this link for build results (access rights to CI server needed):
Github user SparkQA commented on the pull request:
https://github.com/apache/spark/pull/10207#issuecomment-163085255
**[Test build #2187 has
started](https://amplab.cs.berkeley.edu/jenkins/job/NewSparkPullRequestBuilder/2187/consoleFull)**
for PR 10207 at commit
Github user AmplabJenkins commented on the pull request:
https://github.com/apache/spark/pull/8512#issuecomment-163085306
Merged build finished. Test PASSed.
---
If your project is set up for it, you can reply to this email and have your
reply appear on GitHub as well. If your
Github user SparkQA commented on the pull request:
https://github.com/apache/spark/pull/8512#issuecomment-163085217
**[Test build #47377 has
finished](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/47377/consoleFull)**
for PR 8512 at commit
Github user ted-yu commented on the pull request:
https://github.com/apache/spark/pull/10181#issuecomment-163085130
Jenkins, test this please
---
If your project is set up for it, you can reply to this email and have your
reply appear on GitHub as well. If your project does not have
Github user SparkQA commented on the pull request:
https://github.com/apache/spark/pull/10207#issuecomment-163085251
**[Test build #47384 has
started](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/47384/consoleFull)**
for PR 10207 at commit
Github user SparkQA commented on the pull request:
https://github.com/apache/spark/pull/10181#issuecomment-163087096
**[Test build #47386 has
finished](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/47386/consoleFull)**
for PR 10181 at commit
Github user AmplabJenkins commented on the pull request:
https://github.com/apache/spark/pull/10181#issuecomment-163087103
Test FAILed.
Refer to this link for build results (access rights to CI server needed):
Github user sun-rui commented on the pull request:
https://github.com/apache/spark/pull/10191#issuecomment-163090230
@felixcheung, could you detail more about "read.df doesn't match
DataFrameReader"? The only exception is JDBC source?
---
If your project is set up for it, you can
Github user jkbradley commented on a diff in the pull request:
https://github.com/apache/spark/pull/9939#discussion_r47046310
--- Diff:
mllib/src/main/scala/org/apache/spark/mllib/clustering/BisectingKMeansModel.scala
---
@@ -33,7 +33,7 @@ import org.apache.spark.rdd.RDD
Github user SparkQA commented on the pull request:
https://github.com/apache/spark/pull/10210#issuecomment-163092076
**[Test build #47397 has
finished](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/47397/consoleFull)**
for PR 10210 at commit
Github user AmplabJenkins commented on the pull request:
https://github.com/apache/spark/pull/10210#issuecomment-163092090
Test FAILed.
Refer to this link for build results (access rights to CI server needed):
Github user AmplabJenkins commented on the pull request:
https://github.com/apache/spark/pull/10210#issuecomment-163092088
Merged build finished. Test FAILed.
---
If your project is set up for it, you can reply to this email and have your
reply appear on GitHub as well. If your
Github user SparkQA commented on the pull request:
https://github.com/apache/spark/pull/10191#issuecomment-163094060
**[Test build #47401 has
started](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/47401/consoleFull)**
for PR 10191 at commit
Github user SparkQA commented on the pull request:
https://github.com/apache/spark/pull/10210#issuecomment-163094614
**[Test build #47403 has
started](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/47403/consoleFull)**
for PR 10210 at commit
Github user SparkQA commented on the pull request:
https://github.com/apache/spark/pull/10210#issuecomment-163096022
**[Test build #47403 has
finished](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/47403/consoleFull)**
for PR 10210 at commit
Github user SparkQA commented on the pull request:
https://github.com/apache/spark/pull/10191#issuecomment-163095986
**[Test build #47401 has
finished](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/47401/consoleFull)**
for PR 10191 at commit
Github user SparkQA commented on the pull request:
https://github.com/apache/spark/pull/10204#issuecomment-163107948
**[Test build #47404 has
finished](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/47404/consoleFull)**
for PR 10204 at commit
Github user AmplabJenkins commented on the pull request:
https://github.com/apache/spark/pull/10181#issuecomment-163109335
Test PASSed.
Refer to this link for build results (access rights to CI server needed):
Github user SparkQA commented on the pull request:
https://github.com/apache/spark/pull/10181#issuecomment-163109273
**[Test build #47402 has
finished](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/47402/consoleFull)**
for PR 10181 at commit
Github user AmplabJenkins commented on the pull request:
https://github.com/apache/spark/pull/10181#issuecomment-163109332
Merged build finished. Test PASSed.
---
If your project is set up for it, you can reply to this email and have your
reply appear on GitHub as well. If your
Github user AmplabJenkins commented on the pull request:
https://github.com/apache/spark/pull/10215#issuecomment-163120392
Merged build finished. Test PASSed.
---
If your project is set up for it, you can reply to this email and have your
reply appear on GitHub as well. If your
Github user SparkQA commented on the pull request:
https://github.com/apache/spark/pull/10215#issuecomment-163120309
**[Test build #47405 has
finished](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/47405/consoleFull)**
for PR 10215 at commit
Github user AmplabJenkins commented on the pull request:
https://github.com/apache/spark/pull/10215#issuecomment-163120394
Test PASSed.
Refer to this link for build results (access rights to CI server needed):
GitHub user HyukjinKwon opened a pull request:
https://github.com/apache/spark/pull/10218
[SPARK-12227][SQL] Support drop multiple columns specified by Column class
in DataFrame API
https://issues.apache.org/jira/browse/SPARK-12227
In this PR, I added the support to drop
GitHub user sun-rui opened a pull request:
https://github.com/apache/spark/pull/10220
[SPARK-12235][SPARKR] Enhance mutate() to support replace existing columns.
Make the behavior of mutate more consistent with that in dplyr, besides
support for replacing existing columns.
1.
Github user asfgit closed the pull request at:
https://github.com/apache/spark/pull/10207
---
If your project is set up for it, you can reply to this email and have your
reply appear on GitHub as well. If your project does not have this feature
enabled and wishes so, or if the feature is
Github user AmplabJenkins commented on the pull request:
https://github.com/apache/spark/pull/8880#issuecomment-163090672
Merged build finished. Test FAILed.
---
If your project is set up for it, you can reply to this email and have your
reply appear on GitHub as well. If your
Github user AmplabJenkins commented on the pull request:
https://github.com/apache/spark/pull/8880#issuecomment-163090674
Test FAILed.
Refer to this link for build results (access rights to CI server needed):
Github user SparkQA commented on the pull request:
https://github.com/apache/spark/pull/8880#issuecomment-163090647
**[Test build #47392 has
finished](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/47392/consoleFull)**
for PR 8880 at commit
Github user SparkQA commented on the pull request:
https://github.com/apache/spark/pull/10213#issuecomment-163090489
**[Test build #47396 has
started](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/47396/consoleFull)**
for PR 10213 at commit
Github user viirya commented on the pull request:
https://github.com/apache/spark/pull/10197#issuecomment-163092418
We need the exactly once feature of DirectKafkaInputDStream. But we
observed that it introduces the latency compared with KafkaInputDStream due to
its implementation.
Github user gatorsmile commented on the pull request:
https://github.com/apache/spark/pull/10149#issuecomment-163093870
@marmbrus @cloud-fan This PR changes the external API. Not sure if this
will be merged or we should revisit it after the release of 1.6? Thank you!
---
If your
Github user jerryshao commented on the pull request:
https://github.com/apache/spark/pull/10197#issuecomment-163096778
I'm really doubt changing to low-level API could guarantee exact-once
semantics without any other changes.
CC\ @koeninger
---
If your project is set up
Github user viirya commented on the pull request:
https://github.com/apache/spark/pull/10197#issuecomment-163102160
Hmm, I think its exactly-once semantics should be as same as what
DirectKafkaInputDStream does.
---
If your project is set up for it, you can reply to this email and
GitHub user gatorsmile opened a pull request:
https://github.com/apache/spark/pull/10215
[SPARK-12164] [SQL] Decode the encoded values and then display
Based on the suggestions from @marmbrus @cloud-fan in
https://github.com/apache/spark/pull/10165 , this PR is to print the decoded
501 - 600 of 766 matches
Mail list logo
