[GitHub] spark issue #16296: [SPARK-18885][SQL] unify CREATE TABLE syntax for data so...

2016-12-20 Thread AmplabJenkins
Github user AmplabJenkins commented on the issue: https://github.com/apache/spark/pull/16296 Test PASSed. Refer to this link for build results (access rights to CI server needed): https://amplab.cs.berkeley.edu/jenkins//job/SparkPullRequestBuilder/70447/ Test PASSed. ---

[GitHub] spark issue #16296: [SPARK-18885][SQL] unify CREATE TABLE syntax for data so...

2016-12-20 Thread SparkQA
Github user SparkQA commented on the issue: https://github.com/apache/spark/pull/16296 **[Test build #70447 has finished](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/70447/testReport)** for PR 16296 at commit

[GitHub] spark issue #16296: [SPARK-18885][SQL] unify CREATE TABLE syntax for data so...

2016-12-20 Thread AmplabJenkins
Github user AmplabJenkins commented on the issue: https://github.com/apache/spark/pull/16296 Merged build finished. Test PASSed. --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this feature

[GitHub] spark issue #16323: [SPARK-18911] [SQL] Define CatalogStatistics to interact...

2016-12-20 Thread wzhfy
Github user wzhfy commented on the issue: https://github.com/apache/spark/pull/16323 Since adding a switch for cbo is not a trivial one, I want to do it in a separate pr, and let this one only deal with decoupling Statistics from CatalogTable. Do you agree? @cloud-fan --- If your

[GitHub] spark issue #16350: [SPARK-18700][SQL][BACKPORT-2.0] Add StripedLock for eac...

2016-12-20 Thread SparkQA
Github user SparkQA commented on the issue: https://github.com/apache/spark/pull/16350 **[Test build #70452 has finished](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/70452/consoleFull)** for PR 16350 at commit

[GitHub] spark pull request #16360: [SPARK-18234][SS] Made update mode public

2016-12-20 Thread tdas
Github user tdas commented on a diff in the pull request: https://github.com/apache/spark/pull/16360#discussion_r93353173 --- Diff: sql/core/src/main/scala/org/apache/spark/sql/execution/streaming/StatefulAggregate.scala --- @@ -180,11 +181,41 @@ case class StateStoreSaveExec(

[GitHub] spark issue #16304: [SPARK-18894][SS] Fix event time watermark delay thresho...

2016-12-20 Thread SparkQA
Github user SparkQA commented on the issue: https://github.com/apache/spark/pull/16304 **[Test build #70420 has finished](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/70420/testReport)** for PR 16304 at commit

[GitHub] spark issue #16364: [DOC][BUILD][MINOR] add doc on new make-distribution swi...

2016-12-20 Thread AmplabJenkins
Github user AmplabJenkins commented on the issue: https://github.com/apache/spark/pull/16364 Merged build finished. Test PASSed. --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this feature

[GitHub] spark pull request #16282: [SPARK-18588][SS][Kafka]Create a new KafkaConsume...

2016-12-20 Thread tdas
Github user tdas commented on a diff in the pull request: https://github.com/apache/spark/pull/16282#discussion_r93356161 --- Diff: external/kafka-0-10-sql/src/main/scala/org/apache/spark/sql/kafka010/KafkaSource.scala --- @@ -511,12 +537,20 @@ private[kafka010] object

[GitHub] spark issue #16360: [SPARK-18234][SS] Made update mode public

2016-12-20 Thread SparkQA
Github user SparkQA commented on the issue: https://github.com/apache/spark/pull/16360 **[Test build #70429 has finished](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/70429/testReport)** for PR 16360 at commit

[GitHub] spark pull request #16282: [SPARK-18588][SS][Kafka]Create a new KafkaConsume...

2016-12-20 Thread tdas
Github user tdas commented on a diff in the pull request: https://github.com/apache/spark/pull/16282#discussion_r93356589 --- Diff: external/kafka-0-10-sql/src/main/scala/org/apache/spark/sql/kafka010/KafkaSource.scala --- @@ -81,14 +81,16 @@ import

[GitHub] spark pull request #16282: [SPARK-18588][SS][Kafka]Create a new KafkaConsume...

2016-12-20 Thread tdas
Github user tdas commented on a diff in the pull request: https://github.com/apache/spark/pull/16282#discussion_r93356979 --- Diff: external/kafka-0-10-sql/src/main/scala/org/apache/spark/sql/kafka010/KafkaSource.scala --- @@ -81,14 +81,16 @@ import

[GitHub] spark pull request #16282: [SPARK-18588][SS][Kafka]Create a new KafkaConsume...

2016-12-20 Thread tdas
Github user tdas commented on a diff in the pull request: https://github.com/apache/spark/pull/16282#discussion_r93355639 --- Diff: external/kafka-0-10-sql/src/main/scala/org/apache/spark/sql/kafka010/KafkaSource.scala --- @@ -511,12 +537,20 @@ private[kafka010] object

[GitHub] spark pull request #16282: [SPARK-18588][SS][Kafka]Create a new KafkaConsume...

2016-12-20 Thread tdas
Github user tdas commented on a diff in the pull request: https://github.com/apache/spark/pull/16282#discussion_r93356414 --- Diff: external/kafka-0-10-sql/src/main/scala/org/apache/spark/sql/kafka010/KafkaSource.scala --- @@ -81,14 +81,16 @@ import

[GitHub] spark issue #16365: [SPARK-18950][SQL] Report conflicting fields when mergin...

2016-12-20 Thread HyukjinKwon
Github user HyukjinKwon commented on the issue: https://github.com/apache/spark/pull/16365 This is actually the message users face in some cases. Isn't it :)? ```scala val df1 = spark.range(10).selectExpr("id as intcol", "cast(id as int) as longcol")

[GitHub] spark pull request #16282: [SPARK-18588][SS][Kafka]Create a new KafkaConsume...

2016-12-20 Thread zsxwing
Github user zsxwing commented on a diff in the pull request: https://github.com/apache/spark/pull/16282#discussion_r93359305 --- Diff: external/kafka-0-10-sql/src/main/scala/org/apache/spark/sql/kafka010/KafkaSource.scala --- @@ -511,12 +537,20 @@ private[kafka010] object

[GitHub] spark pull request #16282: [SPARK-18588][SS][Kafka]Create a new KafkaConsume...

2016-12-20 Thread zsxwing
Github user zsxwing commented on a diff in the pull request: https://github.com/apache/spark/pull/16282#discussion_r93359340 --- Diff: external/kafka-0-10-sql/src/main/scala/org/apache/spark/sql/kafka010/KafkaSource.scala --- @@ -81,14 +81,16 @@ import

[GitHub] spark issue #16322: [SPARK-18908][SS] Creating StreamingQueryException shoul...

2016-12-20 Thread AmplabJenkins
Github user AmplabJenkins commented on the issue: https://github.com/apache/spark/pull/16322 Test PASSed. Refer to this link for build results (access rights to CI server needed): https://amplab.cs.berkeley.edu/jenkins//job/SparkPullRequestBuilder/70425/ Test PASSed. ---

[GitHub] spark issue #16322: [SPARK-18908][SS] Creating StreamingQueryException shoul...

2016-12-20 Thread SparkQA
Github user SparkQA commented on the issue: https://github.com/apache/spark/pull/16322 **[Test build #70425 has finished](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/70425/testReport)** for PR 16322 at commit

[GitHub] spark issue #16360: [SPARK-18234][SS] Made update mode public

2016-12-20 Thread AmplabJenkins
Github user AmplabJenkins commented on the issue: https://github.com/apache/spark/pull/16360 Merged build finished. Test PASSed. --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this feature

[GitHub] spark issue #16360: [SPARK-18234][SS] Made update mode public

2016-12-20 Thread SparkQA
Github user SparkQA commented on the issue: https://github.com/apache/spark/pull/16360 **[Test build #70430 has finished](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/70430/testReport)** for PR 16360 at commit

[GitHub] spark issue #16352: [SPARK-18947][SQL] SQLContext.tableNames should not call...

2016-12-20 Thread SparkQA
Github user SparkQA commented on the issue: https://github.com/apache/spark/pull/16352 **[Test build #70446 has started](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/70446/testReport)** for PR 16352 at commit

[GitHub] spark issue #16363: [BUILD] make-distribution should find JAVA_HOME for non-...

2016-12-20 Thread AmplabJenkins
Github user AmplabJenkins commented on the issue: https://github.com/apache/spark/pull/16363 Merged build finished. Test PASSed. --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this feature

[GitHub] spark issue #16363: [BUILD] make-distribution should find JAVA_HOME for non-...

2016-12-20 Thread SparkQA
Github user SparkQA commented on the issue: https://github.com/apache/spark/pull/16363 **[Test build #70437 has finished](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/70437/testReport)** for PR 16363 at commit

[GitHub] spark pull request #16368: [SPARK-18958][SPARKR] R API toJSON on DataFrame

2016-12-20 Thread felixcheung
GitHub user felixcheung opened a pull request: https://github.com/apache/spark/pull/16368 [SPARK-18958][SPARKR] R API toJSON on DataFrame ## What changes were proposed in this pull request? It would make it easier to integrate with other component expecting JSON format.

[GitHub] spark issue #16366: [SPARK-18953][CORE][WEB UI] Do now show the link to a de...

2016-12-20 Thread AmplabJenkins
Github user AmplabJenkins commented on the issue: https://github.com/apache/spark/pull/16366 Merged build finished. Test PASSed. --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this feature

[GitHub] spark issue #16366: [SPARK-18953][CORE][WEB UI] Do now show the link to a de...

2016-12-20 Thread AmplabJenkins
Github user AmplabJenkins commented on the issue: https://github.com/apache/spark/pull/16366 Test PASSed. Refer to this link for build results (access rights to CI server needed): https://amplab.cs.berkeley.edu/jenkins//job/SparkPullRequestBuilder/70442/ Test PASSed. ---

[GitHub] spark issue #16366: [SPARK-18953][CORE][WEB UI] Do now show the link to a de...

2016-12-20 Thread viirya
Github user viirya commented on the issue: https://github.com/apache/spark/pull/16366 One question: should we do the same thing for `WorkerState.DECOMMISSIONED` and `WorkerState.UNKNOWN` ? --- If your project is set up for it, you can reply to this email and have your reply appear

[GitHub] spark issue #16359: [SPARK-18951] Upgrade com.thoughtworks.paranamer/paranam...

2016-12-20 Thread SparkQA
Github user SparkQA commented on the issue: https://github.com/apache/spark/pull/16359 **[Test build #70445 has finished](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/70445/testReport)** for PR 16359 at commit

[GitHub] spark pull request #16323: [SPARK-18911] [SQL] Define CatalogStatistics to i...

2016-12-20 Thread wzhfy
Github user wzhfy commented on a diff in the pull request: https://github.com/apache/spark/pull/16323#discussion_r93376249 --- Diff: sql/catalyst/src/main/scala/org/apache/spark/sql/catalyst/catalog/interface.scala --- @@ -198,6 +200,10 @@ case class CatalogTable(

[GitHub] spark pull request #16362: [SPARK-18954]Fix flaky test: o.a.s.streaming.Basi...

2016-12-20 Thread zsxwing
GitHub user zsxwing opened a pull request: https://github.com/apache/spark/pull/16362 [SPARK-18954]Fix flaky test: o.a.s.streaming.BasicOperationsSuite rdd cleanup - map and window ## What changes were proposed in this pull request? The issue in this test is the cleanup of

[GitHub] spark issue #16211: [SPARK-18576][PYTHON] Add basic TaskContext information ...

2016-12-20 Thread rxin
Github user rxin commented on the issue: https://github.com/apache/spark/pull/16211 Thanks - merging in master. --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this feature enabled and

[GitHub] spark issue #16360: [SPARK-18234][SS] Made update mode public

2016-12-20 Thread AmplabJenkins
Github user AmplabJenkins commented on the issue: https://github.com/apache/spark/pull/16360 Test FAILed. Refer to this link for build results (access rights to CI server needed): https://amplab.cs.berkeley.edu/jenkins//job/SparkPullRequestBuilder/70428/ Test FAILed. ---

[GitHub] spark issue #16360: [SPARK-18234][SS] Made update mode public

2016-12-20 Thread AmplabJenkins
Github user AmplabJenkins commented on the issue: https://github.com/apache/spark/pull/16360 Merged build finished. Test FAILed. --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this feature

[GitHub] spark pull request #16304: [SPARK-18894][SS] Fix event time watermark delay ...

2016-12-20 Thread zsxwing
Github user zsxwing commented on a diff in the pull request: https://github.com/apache/spark/pull/16304#discussion_r93357063 --- Diff: sql/core/src/main/scala/org/apache/spark/sql/execution/streaming/StreamExecution.scala --- @@ -387,7 +387,7 @@ class StreamExecution(

[GitHub] spark issue #16356: [SPARK-18949] [SQL] Add recoverPartitions API to Catalog

2016-12-20 Thread SparkQA
Github user SparkQA commented on the issue: https://github.com/apache/spark/pull/16356 **[Test build #70423 has finished](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/70423/testReport)** for PR 16356 at commit

[GitHub] spark issue #16362: [SPARK-18954][Tests]Fix flaky test: o.a.s.streaming.Basi...

2016-12-20 Thread AmplabJenkins
Github user AmplabJenkins commented on the issue: https://github.com/apache/spark/pull/16362 Merged build finished. Test PASSed. --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this feature

[GitHub] spark issue #16282: [SPARK-18588][SS][Kafka]Create a new KafkaConsumer when ...

2016-12-20 Thread SparkQA
Github user SparkQA commented on the issue: https://github.com/apache/spark/pull/16282 **[Test build #70444 has started](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/70444/testReport)** for PR 16282 at commit

[GitHub] spark issue #16359: [SPARK-18951] Upgrade com.thoughtworks.paranamer/paranam...

2016-12-20 Thread yhuai
Github user yhuai commented on the issue: https://github.com/apache/spark/pull/16359 test this please --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this feature enabled and wishes so, or

[GitHub] spark issue #16365: [SPARK-18950][SQL] Report conflicting fields when mergin...

2016-12-20 Thread bravo-zhang
Github user bravo-zhang commented on the issue: https://github.com/apache/spark/pull/16365 Thanks for the review @HyukjinKwon ! Are your stacktrace of Before and After swapped? Do you mean the message is confusing? How about correcting it to `Failed to merge field longcol:

[GitHub] spark issue #16361: [SPARK-18952] Regex strings not properly escaped in code...

2016-12-20 Thread SparkQA
Github user SparkQA commented on the issue: https://github.com/apache/spark/pull/16361 **[Test build #70433 has finished](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/70433/testReport)** for PR 16361 at commit

[GitHub] spark pull request #16314: [SPARK-18900][FLAKY-TEST] StateStoreSuite.mainten...

2016-12-20 Thread asfgit
Github user asfgit closed the pull request at: https://github.com/apache/spark/pull/16314 --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this feature enabled and wishes so, or if the feature is

[GitHub] spark issue #16350: [SPARK-18700][SQL][BACKPORT-2.0] Add StripedLock for eac...

2016-12-20 Thread ericl
Github user ericl commented on the issue: https://github.com/apache/spark/pull/16350 yeah, i don't think we need the unit test for 2.0 --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this

[GitHub] spark issue #16366: [SPARK-18953][CORE][WEB UI] Do now show the link to a de...

2016-12-20 Thread SparkQA
Github user SparkQA commented on the issue: https://github.com/apache/spark/pull/16366 **[Test build #70442 has finished](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/70442/testReport)** for PR 16366 at commit

[GitHub] spark issue #16368: [SPARK-18958][SPARKR] R API toJSON on DataFrame

2016-12-20 Thread SparkQA
Github user SparkQA commented on the issue: https://github.com/apache/spark/pull/16368 **[Test build #70451 has finished](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/70451/testReport)** for PR 16368 at commit

[GitHub] spark issue #16368: [SPARK-18958][SPARKR] R API toJSON on DataFrame

2016-12-20 Thread AmplabJenkins
Github user AmplabJenkins commented on the issue: https://github.com/apache/spark/pull/16368 Merged build finished. Test PASSed. --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this feature

[GitHub] spark issue #16368: [SPARK-18958][SPARKR] R API toJSON on DataFrame

2016-12-20 Thread AmplabJenkins
Github user AmplabJenkins commented on the issue: https://github.com/apache/spark/pull/16368 Test PASSed. Refer to this link for build results (access rights to CI server needed): https://amplab.cs.berkeley.edu/jenkins//job/SparkPullRequestBuilder/70451/ Test PASSed. ---

[GitHub] spark issue #16360: [SPARK-18234][SS] Made update mode public

2016-12-20 Thread AmplabJenkins
Github user AmplabJenkins commented on the issue: https://github.com/apache/spark/pull/16360 Merged build finished. Test PASSed. --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this feature

[GitHub] spark issue #16360: [SPARK-18234][SS] Made update mode public

2016-12-20 Thread AmplabJenkins
Github user AmplabJenkins commented on the issue: https://github.com/apache/spark/pull/16360 Test PASSed. Refer to this link for build results (access rights to CI server needed): https://amplab.cs.berkeley.edu/jenkins//job/SparkPullRequestBuilder/70450/ Test PASSed. ---

[GitHub] spark pull request #16363: [BUILD] make-distribution should find JAVA_HOME f...

2016-12-20 Thread felixcheung
GitHub user felixcheung opened a pull request: https://github.com/apache/spark/pull/16363 [BUILD] make-distribution should find JAVA_HOME for non-RHEL systems ## What changes were proposed in this pull request? make-distribution.sh should find JAVA_HOME for Ubuntu, Mac and

[GitHub] spark issue #16343: [FLAKY-TEST] InputStreamsSuite.socket input stream

2016-12-20 Thread SparkQA
Github user SparkQA commented on the issue: https://github.com/apache/spark/pull/16343 **[Test build #70431 has finished](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/70431/testReport)** for PR 16343 at commit

[GitHub] spark issue #16364: [DOC][BUILD][MINOR] add doc on new make-distribution swi...

2016-12-20 Thread SparkQA
Github user SparkQA commented on the issue: https://github.com/apache/spark/pull/16364 **[Test build #70440 has started](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/70440/testReport)** for PR 16364 at commit

[GitHub] spark issue #16343: [FLAKY-TEST] InputStreamsSuite.socket input stream

2016-12-20 Thread AmplabJenkins
Github user AmplabJenkins commented on the issue: https://github.com/apache/spark/pull/16343 Merged build finished. Test PASSed. --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this feature

[GitHub] spark issue #16343: [FLAKY-TEST] InputStreamsSuite.socket input stream

2016-12-20 Thread AmplabJenkins
Github user AmplabJenkins commented on the issue: https://github.com/apache/spark/pull/16343 Test PASSed. Refer to this link for build results (access rights to CI server needed): https://amplab.cs.berkeley.edu/jenkins//job/SparkPullRequestBuilder/70434/ Test PASSed. ---

[GitHub] spark issue #16343: [FLAKY-TEST] InputStreamsSuite.socket input stream

2016-12-20 Thread SparkQA
Github user SparkQA commented on the issue: https://github.com/apache/spark/pull/16343 **[Test build #70434 has finished](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/70434/testReport)** for PR 16343 at commit

[GitHub] spark issue #16296: [SPARK-18885][SQL] unify CREATE TABLE syntax for data so...

2016-12-20 Thread SparkQA
Github user SparkQA commented on the issue: https://github.com/apache/spark/pull/16296 **[Test build #70447 has started](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/70447/testReport)** for PR 16296 at commit

[GitHub] spark pull request #16304: [SPARK-18894][SS] Fix event time watermark delay ...

2016-12-20 Thread tdas
Github user tdas commented on a diff in the pull request: https://github.com/apache/spark/pull/16304#discussion_r93364798 --- Diff: sql/core/src/main/scala/org/apache/spark/sql/execution/streaming/StreamExecution.scala --- @@ -387,7 +387,7 @@ class StreamExecution(

[GitHub] spark issue #16330: [SPARK-18817][SPARKR][SQL] change derby log output and m...

2016-12-20 Thread AmplabJenkins
Github user AmplabJenkins commented on the issue: https://github.com/apache/spark/pull/16330 Merged build finished. Test PASSed. --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this feature

[GitHub] spark issue #16330: [SPARK-18817][SPARKR][SQL] change derby log output and m...

2016-12-20 Thread SparkQA
Github user SparkQA commented on the issue: https://github.com/apache/spark/pull/16330 **[Test build #70435 has finished](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/70435/testReport)** for PR 16330 at commit

[GitHub] spark issue #16330: [SPARK-18817][SPARKR][SQL] change derby log output and m...

2016-12-20 Thread AmplabJenkins
Github user AmplabJenkins commented on the issue: https://github.com/apache/spark/pull/16330 Test PASSed. Refer to this link for build results (access rights to CI server needed): https://amplab.cs.berkeley.edu/jenkins//job/SparkPullRequestBuilder/70435/ Test PASSed. ---

[GitHub] spark issue #16368: [SPARK-18958][SPARKR] R API toJSON on DataFrame

2016-12-20 Thread SparkQA
Github user SparkQA commented on the issue: https://github.com/apache/spark/pull/16368 **[Test build #70451 has started](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/70451/testReport)** for PR 16368 at commit

[GitHub] spark issue #16282: [SPARK-18588][SS][Kafka]Create a new KafkaConsumer when ...

2016-12-20 Thread SparkQA
Github user SparkQA commented on the issue: https://github.com/apache/spark/pull/16282 **[Test build #70439 has finished](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/70439/testReport)** for PR 16282 at commit

[GitHub] spark issue #16282: [SPARK-18588][SS][Kafka]Create a new KafkaConsumer when ...

2016-12-20 Thread AmplabJenkins
Github user AmplabJenkins commented on the issue: https://github.com/apache/spark/pull/16282 Test FAILed. Refer to this link for build results (access rights to CI server needed): https://amplab.cs.berkeley.edu/jenkins//job/SparkPullRequestBuilder/70439/ Test FAILed. ---

[GitHub] spark issue #16282: [SPARK-18588][SS][Kafka]Create a new KafkaConsumer when ...

2016-12-20 Thread AmplabJenkins
Github user AmplabJenkins commented on the issue: https://github.com/apache/spark/pull/16282 Merged build finished. Test FAILed. --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this feature

[GitHub] spark issue #16330: [SPARK-18817][SPARKR][SQL] change derby log output and m...

2016-12-20 Thread SparkQA
Github user SparkQA commented on the issue: https://github.com/apache/spark/pull/16330 **[Test build #70435 has started](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/70435/testReport)** for PR 16330 at commit

[GitHub] spark issue #16343: [FLAKY-TEST] InputStreamsSuite.socket input stream

2016-12-20 Thread SparkQA
Github user SparkQA commented on the issue: https://github.com/apache/spark/pull/16343 **[Test build #70434 has started](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/70434/testReport)** for PR 16343 at commit

[GitHub] spark issue #16253: [SPARK-18537][Web UI] Add a REST api to serve spark stre...

2016-12-20 Thread SparkQA
Github user SparkQA commented on the issue: https://github.com/apache/spark/pull/16253 **[Test build #70436 has started](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/70436/testReport)** for PR 16253 at commit

[GitHub] spark pull request #16358: [SPARK-18761][branch-2.0] Introduce "task reaper"...

2016-12-20 Thread JoshRosen
Github user JoshRosen closed the pull request at: https://github.com/apache/spark/pull/16358 --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this feature enabled and wishes so, or if the feature is

[GitHub] spark pull request #16365: [SPARK-18950][SQL] Report conflicting fields when...

2016-12-20 Thread bravo-zhang
GitHub user bravo-zhang opened a pull request: https://github.com/apache/spark/pull/16365 [SPARK-18950][SQL] Report conflicting fields when merging two StructTypes ## What changes were proposed in this pull request? Currently, StructType.merge() only reports data types of

[GitHub] spark issue #16360: [SPARK-18234][SS] Made update mode public

2016-12-20 Thread SparkQA
Github user SparkQA commented on the issue: https://github.com/apache/spark/pull/16360 **[Test build #70441 has started](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/70441/testReport)** for PR 16360 at commit

[GitHub] spark issue #16360: [SPARK-18234][SS] Made update mode public

2016-12-20 Thread brkyvz
Github user brkyvz commented on the issue: https://github.com/apache/spark/pull/16360 @tdas Can you also please update pyspark docs: https://github.com/apache/spark/blob/master/python/pyspark/sql/streaming.py#L659 --- If your project is set up for it, you can reply to this email

[GitHub] spark issue #16359: [SPARK-18951] Upgrade com.thoughtworks.paranamer/paranam...

2016-12-20 Thread SparkQA
Github user SparkQA commented on the issue: https://github.com/apache/spark/pull/16359 **[Test build #70424 has finished](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/70424/testReport)** for PR 16359 at commit

[GitHub] spark pull request #16282: [SPARK-18588][SS][Kafka]Create a new KafkaConsume...

2016-12-20 Thread zsxwing
Github user zsxwing commented on a diff in the pull request: https://github.com/apache/spark/pull/16282#discussion_r93360442 --- Diff: dev/sparktestsupport/modules.py --- @@ -245,7 +245,8 @@ def __hash__(self): name="streaming-kafka-0-10",

[GitHub] spark issue #16282: [SPARK-18588][SS][Kafka]Create a new KafkaConsumer when ...

2016-12-20 Thread SparkQA
Github user SparkQA commented on the issue: https://github.com/apache/spark/pull/16282 **[Test build #70443 has finished](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/70443/testReport)** for PR 16282 at commit

[GitHub] spark issue #16282: [SPARK-18588][SS][Kafka]Create a new KafkaConsumer when ...

2016-12-20 Thread AmplabJenkins
Github user AmplabJenkins commented on the issue: https://github.com/apache/spark/pull/16282 Test PASSed. Refer to this link for build results (access rights to CI server needed): https://amplab.cs.berkeley.edu/jenkins//job/SparkPullRequestBuilder/70443/ Test PASSed. ---

[GitHub] spark issue #16282: [SPARK-18588][SS][Kafka]Create a new KafkaConsumer when ...

2016-12-20 Thread AmplabJenkins
Github user AmplabJenkins commented on the issue: https://github.com/apache/spark/pull/16282 Merged build finished. Test PASSed. --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this feature

[GitHub] spark issue #16361: [SPARK-18952] Regex strings not properly escaped in code...

2016-12-20 Thread AmplabJenkins
Github user AmplabJenkins commented on the issue: https://github.com/apache/spark/pull/16361 Test PASSed. Refer to this link for build results (access rights to CI server needed): https://amplab.cs.berkeley.edu/jenkins//job/SparkPullRequestBuilder/70433/ Test PASSed. ---

[GitHub] spark issue #16361: [SPARK-18952] Regex strings not properly escaped in code...

2016-12-20 Thread AmplabJenkins
Github user AmplabJenkins commented on the issue: https://github.com/apache/spark/pull/16361 Merged build finished. Test PASSed. --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this feature

[GitHub] spark issue #16363: [BUILD] make-distribution should find JAVA_HOME for non-...

2016-12-20 Thread AmplabJenkins
Github user AmplabJenkins commented on the issue: https://github.com/apache/spark/pull/16363 Test PASSed. Refer to this link for build results (access rights to CI server needed): https://amplab.cs.berkeley.edu/jenkins//job/SparkPullRequestBuilder/70437/ Test PASSed. ---

[GitHub] spark issue #16365: [SPARK-18950][SQL] Report conflicting fields when mergin...

2016-12-20 Thread HyukjinKwon
Github user HyukjinKwon commented on the issue: https://github.com/apache/spark/pull/16365 Dho, yeap, I just edited. I just simply meant I support this PR :). --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your

[GitHub] spark issue #16367: [SPARK-18903][SPARKR] Add API to get SparkUI URL

2016-12-20 Thread AmplabJenkins
Github user AmplabJenkins commented on the issue: https://github.com/apache/spark/pull/16367 Test PASSed. Refer to this link for build results (access rights to CI server needed): https://amplab.cs.berkeley.edu/jenkins//job/SparkPullRequestBuilder/70448/ Test PASSed. ---

[GitHub] spark issue #16367: [SPARK-18903][SPARKR] Add API to get SparkUI URL

2016-12-20 Thread SparkQA
Github user SparkQA commented on the issue: https://github.com/apache/spark/pull/16367 **[Test build #70448 has finished](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/70448/testReport)** for PR 16367 at commit

[GitHub] spark issue #16367: [SPARK-18903][SPARKR] Add API to get SparkUI URL

2016-12-20 Thread AmplabJenkins
Github user AmplabJenkins commented on the issue: https://github.com/apache/spark/pull/16367 Merged build finished. Test PASSed. --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this feature

[GitHub] spark issue #16314: [SPARK-18900][FLAKY-TEST] StateStoreSuite.maintenance

2016-12-20 Thread tdas
Github user tdas commented on the issue: https://github.com/apache/spark/pull/16314 Merging this master and 2.1 --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this feature enabled and

[GitHub] spark issue #16362: [SPARK-18954][Tests]Fix flaky test: o.a.s.streaming.Basi...

2016-12-20 Thread tdas
Github user tdas commented on the issue: https://github.com/apache/spark/pull/16362 LGTM. Did you run it many times? --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this feature enabled and

[GitHub] spark issue #16356: [SPARK-18949] [SQL] Add recoverPartitions API to Catalog

2016-12-20 Thread SparkQA
Github user SparkQA commented on the issue: https://github.com/apache/spark/pull/16356 **[Test build #3511 has started](https://amplab.cs.berkeley.edu/jenkins/job/NewSparkPullRequestBuilder/3511/testReport)** for PR 16356 at commit

[GitHub] spark issue #16304: [SPARK-18894][SS] Fix event time watermark delay thresho...

2016-12-20 Thread SparkQA
Github user SparkQA commented on the issue: https://github.com/apache/spark/pull/16304 **[Test build #70449 has finished](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/70449/testReport)** for PR 16304 at commit

[GitHub] spark issue #16304: [SPARK-18894][SS] Fix event time watermark delay thresho...

2016-12-20 Thread AmplabJenkins
Github user AmplabJenkins commented on the issue: https://github.com/apache/spark/pull/16304 Merged build finished. Test PASSed. --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this feature

[GitHub] spark issue #16304: [SPARK-18894][SS] Fix event time watermark delay thresho...

2016-12-20 Thread AmplabJenkins
Github user AmplabJenkins commented on the issue: https://github.com/apache/spark/pull/16304 Test PASSed. Refer to this link for build results (access rights to CI server needed): https://amplab.cs.berkeley.edu/jenkins//job/SparkPullRequestBuilder/70449/ Test PASSed. ---

[GitHub] spark issue #12775: [SPARK-14958][Core] Failed task not handled when there's...

2016-12-20 Thread lirui-intel
Github user lirui-intel commented on the issue: https://github.com/apache/spark/pull/12775 I don't think the failure is related, and it can't be reproduced locally. --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your

[GitHub] spark issue #16337: [SPARK-18871][SQL] New test cases for IN/NOT IN subquery

2016-12-20 Thread SparkQA
Github user SparkQA commented on the issue: https://github.com/apache/spark/pull/16337 **[Test build #70457 has started](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/70457/testReport)** for PR 16337 at commit

[GitHub] spark issue #16337: [SPARK-18871][SQL] New test cases for IN/NOT IN subquery

2016-12-20 Thread kevinyu98
Github user kevinyu98 commented on the issue: https://github.com/apache/spark/pull/16337 Hello All: I have divided the test case to small groups based the discussion, and this pr will be the first pr for the IN subquery, it covers the simple and group-by cases. This the

[GitHub] spark issue #16369: [SPARK-18956][SQL][PySpark] Reuse existing SparkSession ...

2016-12-20 Thread SparkQA
Github user SparkQA commented on the issue: https://github.com/apache/spark/pull/16369 **[Test build #70460 has started](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/70460/testReport)** for PR 16369 at commit

[GitHub] spark issue #16351: [SPARK-18943][SQL] Avoid per-record type dispatch in CSV...

2016-12-20 Thread SparkQA
Github user SparkQA commented on the issue: https://github.com/apache/spark/pull/16351 **[Test build #70461 has started](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/70461/testReport)** for PR 16351 at commit

[GitHub] spark issue #16356: [SPARK-18949] [SQL] Add recoverPartitions API to Catalog

2016-12-20 Thread gatorsmile
Github user gatorsmile commented on the issue: https://github.com/apache/spark/pull/16356 Sure, let me do it now. --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this feature enabled and

[GitHub] spark issue #16369: [SPARK-18956][SQL][PySpark] Reuse existing SparkSession ...

2016-12-20 Thread AmplabJenkins
Github user AmplabJenkins commented on the issue: https://github.com/apache/spark/pull/16369 Test PASSed. Refer to this link for build results (access rights to CI server needed): https://amplab.cs.berkeley.edu/jenkins//job/SparkPullRequestBuilder/70460/ Test PASSed. ---

[GitHub] spark issue #16369: [SPARK-18956][SQL][PySpark] Reuse existing SparkSession ...

2016-12-20 Thread SparkQA
Github user SparkQA commented on the issue: https://github.com/apache/spark/pull/16369 **[Test build #70460 has finished](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/70460/testReport)** for PR 16369 at commit

[GitHub] spark pull request #16352: [SPARK-18947][SQL] SQLContext.tableNames should n...

2016-12-20 Thread gatorsmile
Github user gatorsmile commented on a diff in the pull request: https://github.com/apache/spark/pull/16352#discussion_r93390578 --- Diff: sql/core/src/main/scala/org/apache/spark/sql/api/r/SQLUtils.scala --- @@ -276,11 +276,12 @@ private[sql] object SQLUtils extends Logging {

[GitHub] spark pull request #16370: [SPARK-18960][SQL][SS] Avoid double reading file ...

2016-12-20 Thread uncleGen
GitHub user uncleGen opened a pull request: https://github.com/apache/spark/pull/16370 [SPARK-18960][SQL][SS] Avoid double reading file which is being copied. ## What changes were proposed in this pull request? In HDFS, when we copy a file into target directory, there will

[GitHub] spark issue #12775: [SPARK-14958][Core] Failed task not handled when there's...

2016-12-20 Thread kayousterhout
Github user kayousterhout commented on the issue: https://github.com/apache/spark/pull/12775 Jenkins, retest this please --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this feature enabled

<    1   2   3   4   5   >