[GitHub] spark pull request: [SPARK-3369] [CORE] [STREAMING] Java mapPartit...

2015-12-22 Thread AmplabJenkins
Github user AmplabJenkins commented on the pull request: https://github.com/apache/spark/pull/10413#issuecomment-166577642 Test FAILed. Refer to this link for build results (access rights to CI server needed): https://amplab.cs.berkeley.edu/jenkins//job/SparkPullRequestBuilder/

[GitHub] spark pull request: [SPARK-3369] [CORE] [STREAMING] Java mapPartit...

2015-12-22 Thread SparkQA
Github user SparkQA commented on the pull request: https://github.com/apache/spark/pull/10413#issuecomment-166577576 **[Test build #48179 has finished](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/48179/consoleFull)** for PR 10413 at commit [`afe2af0`](https://g

[GitHub] spark pull request: [SPARK-12393] [SparkR] Add read.text and write...

2015-12-22 Thread AmplabJenkins
Github user AmplabJenkins commented on the pull request: https://github.com/apache/spark/pull/10348#issuecomment-166576436 Merged build finished. Test PASSed. --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your projec

[GitHub] spark pull request: [SPARK-12393] [SparkR] Add read.text and write...

2015-12-22 Thread AmplabJenkins
Github user AmplabJenkins commented on the pull request: https://github.com/apache/spark/pull/10348#issuecomment-166576442 Test PASSed. Refer to this link for build results (access rights to CI server needed): https://amplab.cs.berkeley.edu/jenkins//job/SparkPullRequestBuilder/

[GitHub] spark pull request: [SPARK-12393] [SparkR] Add read.text and write...

2015-12-22 Thread SparkQA
Github user SparkQA commented on the pull request: https://github.com/apache/spark/pull/10348#issuecomment-166576336 **[Test build #48185 has finished](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/48185/consoleFull)** for PR 10348 at commit [`85c3c4a`](https://g

[GitHub] spark pull request: [SPARK-12371][SQL] Runtime nullability check f...

2015-12-22 Thread AmplabJenkins
Github user AmplabJenkins commented on the pull request: https://github.com/apache/spark/pull/10331#issuecomment-166575199 Test PASSed. Refer to this link for build results (access rights to CI server needed): https://amplab.cs.berkeley.edu/jenkins//job/SparkPullRequestBuilder/

[GitHub] spark pull request: [SPARK-12371][SQL] Runtime nullability check f...

2015-12-22 Thread AmplabJenkins
Github user AmplabJenkins commented on the pull request: https://github.com/apache/spark/pull/10331#issuecomment-166575195 Merged build finished. Test PASSed. --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your projec

[GitHub] spark pull request: [SPARK-12371][SQL] Runtime nullability check f...

2015-12-22 Thread SparkQA
Github user SparkQA commented on the pull request: https://github.com/apache/spark/pull/10331#issuecomment-166574866 **[Test build #48178 has finished](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/48178/consoleFull)** for PR 10331 at commit [`759c20d`](https://g

[GitHub] spark pull request: [SPARK-12331][ML] R^2 for regression through t...

2015-12-22 Thread dbtsai
Github user dbtsai commented on a diff in the pull request: https://github.com/apache/spark/pull/10384#discussion_r48239945 --- Diff: mllib/src/test/scala/org/apache/spark/mllib/evaluation/RegressionMetricsSuite.scala --- @@ -22,91 +22,115 @@ import org.apache.spark.mllib.util.ML

[GitHub] spark pull request: [SPARK-12331][ML] R^2 for regression through t...

2015-12-22 Thread dbtsai
Github user dbtsai commented on a diff in the pull request: https://github.com/apache/spark/pull/10384#discussion_r48239605 --- Diff: mllib/src/main/scala/org/apache/spark/mllib/evaluation/RegressionMetrics.scala --- @@ -23,15 +23,23 @@ import org.apache.spark.Logging import

[GitHub] spark pull request: [SPARK-12440][Core] - Avoid setCheckpoint warn...

2015-12-22 Thread SparkQA
Github user SparkQA commented on the pull request: https://github.com/apache/spark/pull/10392#issuecomment-166573828 **[Test build #48186 has started](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/48186/consoleFull)** for PR 10392 at commit [`707ce5b`](https://gi

[GitHub] spark pull request: [SPARK-12440][Core] - Avoid setCheckpoint warn...

2015-12-22 Thread pierre-borckmans
Github user pierre-borckmans commented on the pull request: https://github.com/apache/spark/pull/10392#issuecomment-166572991 @srowen I fixed the scala style issues and the string interpolator. --- If your project is set up for it, you can reply to this email and have your reply appea

[GitHub] spark pull request: [SPARK-12331][ML] R^2 for regression through t...

2015-12-22 Thread dbtsai
Github user dbtsai commented on a diff in the pull request: https://github.com/apache/spark/pull/10384#discussion_r48239336 --- Diff: mllib/src/main/scala/org/apache/spark/mllib/evaluation/RegressionMetrics.scala --- @@ -23,15 +23,23 @@ import org.apache.spark.Logging import

[GitHub] spark pull request: [SPARK-12393] [SparkR] Add read.text and write...

2015-12-22 Thread SparkQA
Github user SparkQA commented on the pull request: https://github.com/apache/spark/pull/10348#issuecomment-166572552 **[Test build #48185 has started](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/48185/consoleFull)** for PR 10348 at commit [`85c3c4a`](https://gi

[GitHub] spark pull request: [SPARK-12331][ML] R^2 for regression through t...

2015-12-22 Thread dbtsai
Github user dbtsai commented on a diff in the pull request: https://github.com/apache/spark/pull/10384#discussion_r48239041 --- Diff: mllib/src/main/scala/org/apache/spark/mllib/evaluation/RegressionMetrics.scala --- @@ -23,15 +23,23 @@ import org.apache.spark.Logging import

[GitHub] spark pull request: [SPARK-12440][Core] - Avoid setCheckpoint warn...

2015-12-22 Thread SparkQA
Github user SparkQA commented on the pull request: https://github.com/apache/spark/pull/10392#issuecomment-166571605 **[Test build #48184 has started](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/48184/consoleFull)** for PR 10392 at commit [`c316479`](https://gi

[GitHub] spark pull request: [SPARK-12311][CORE] Restore previous value of ...

2015-12-22 Thread kiszk
Github user kiszk commented on a diff in the pull request: https://github.com/apache/spark/pull/10289#discussion_r48238546 --- Diff: yarn/src/test/scala/org/apache/spark/deploy/yarn/ClientSuite.scala --- @@ -43,12 +45,21 @@ import org.apache.spark.util.Utils class Client

[GitHub] spark pull request: [SPARK-12311][CORE] Restore previous value of ...

2015-12-22 Thread kiszk
Github user kiszk commented on a diff in the pull request: https://github.com/apache/spark/pull/10289#discussion_r48238449 --- Diff: yarn/src/test/scala/org/apache/spark/deploy/yarn/BaseYarnClusterSuite.scala --- @@ -116,7 +120,7 @@ abstract class BaseYarnClusterSuite

[GitHub] spark pull request: [SPARK-12393] [SparkR] Add read.text and write...

2015-12-22 Thread yanboliang
Github user yanboliang commented on a diff in the pull request: https://github.com/apache/spark/pull/10348#discussion_r48238445 --- Diff: R/pkg/R/DataFrame.R --- @@ -661,6 +661,34 @@ setMethod("saveAsParquetFile", write.parquet(x, path) }) +

[GitHub] spark pull request: [SPARK-12102][SQL] Cast a non-nullable struct ...

2015-12-22 Thread SparkQA
Github user SparkQA commented on the pull request: https://github.com/apache/spark/pull/10156#issuecomment-166570688 **[Test build #48183 has started](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/48183/consoleFull)** for PR 10156 at commit [`3b715f0`](https://gi

[GitHub] spark pull request: [SPARK-12476][SQL] Implement JdbcRelation#unha...

2015-12-22 Thread HyukjinKwon
Github user HyukjinKwon commented on the pull request: https://github.com/apache/spark/pull/10427#issuecomment-166570264 cc @liancheng @yhuai --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have

[GitHub] spark pull request: [SPARK-12476][SQL] Implement JdbcRelation#unha...

2015-12-22 Thread HyukjinKwon
Github user HyukjinKwon commented on a diff in the pull request: https://github.com/apache/spark/pull/10427#discussion_r48237984 --- Diff: sql/core/src/main/scala/org/apache/spark/sql/execution/datasources/jdbc/JDBCRelation.scala --- @@ -90,6 +90,19 @@ private[sql] case class JDBC

[GitHub] spark pull request: [SPARK-12440][Core] - Avoid setCheckpoint warn...

2015-12-22 Thread srowen
Github user srowen commented on a diff in the pull request: https://github.com/apache/spark/pull/10392#discussion_r48237938 --- Diff: core/src/main/scala/org/apache/spark/SparkContext.scala --- @@ -2073,8 +2073,9 @@ class SparkContext(config: SparkConf) extends Logging with Executo

[GitHub] spark pull request: [SPARK-12475][BUILD][test-maven] Upgrade Zinc ...

2015-12-22 Thread AmplabJenkins
Github user AmplabJenkins commented on the pull request: https://github.com/apache/spark/pull/10426#issuecomment-166569243 Merged build finished. Test PASSed. --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your projec

[GitHub] spark pull request: [SPARK-12475][BUILD][test-maven] Upgrade Zinc ...

2015-12-22 Thread AmplabJenkins
Github user AmplabJenkins commented on the pull request: https://github.com/apache/spark/pull/10426#issuecomment-166569245 Test PASSed. Refer to this link for build results (access rights to CI server needed): https://amplab.cs.berkeley.edu/jenkins//job/SparkPullRequestBuilder/

[GitHub] spark pull request: [SPARK-12475][BUILD][test-maven] Upgrade Zinc ...

2015-12-22 Thread SparkQA
Github user SparkQA commented on the pull request: https://github.com/apache/spark/pull/10426#issuecomment-166569061 **[Test build #48172 has finished](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/48172/consoleFull)** for PR 10426 at commit [`9c4d7ff`](https://g

[GitHub] spark pull request: [HOT-FIX] bypass hive test when parse logical ...

2015-12-22 Thread SparkQA
Github user SparkQA commented on the pull request: https://github.com/apache/spark/pull/10430#issuecomment-166568715 **[Test build #48182 has started](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/48182/consoleFull)** for PR 10430 at commit [`7547cf8`](https://gi

[GitHub] spark pull request: [SPARK-12440][Core] - Avoid setCheckpoint warn...

2015-12-22 Thread AmplabJenkins
Github user AmplabJenkins commented on the pull request: https://github.com/apache/spark/pull/10392#issuecomment-166568589 Test FAILed. Refer to this link for build results (access rights to CI server needed): https://amplab.cs.berkeley.edu/jenkins//job/SparkPullRequestBuilder/

[GitHub] spark pull request: [SPARK-12440][Core] - Avoid setCheckpoint warn...

2015-12-22 Thread SparkQA
Github user SparkQA commented on the pull request: https://github.com/apache/spark/pull/10392#issuecomment-166568584 **[Test build #48181 has finished](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/48181/consoleFull)** for PR 10392 at commit [`6e21b23`](https://g

[GitHub] spark pull request: [SPARK-12102][SQL] Cast a non-nullable struct ...

2015-12-22 Thread cloud-fan
Github user cloud-fan commented on the pull request: https://github.com/apache/spark/pull/10156#issuecomment-166568432 retest this please. --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this

[GitHub] spark pull request: [SPARK-12440][Core] - Avoid setCheckpoint warn...

2015-12-22 Thread AmplabJenkins
Github user AmplabJenkins commented on the pull request: https://github.com/apache/spark/pull/10392#issuecomment-166568588 Merged build finished. Test FAILed. --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your projec

[GitHub] spark pull request: [SPARK-12476][SQL] Implement JdbcRelation#unha...

2015-12-22 Thread HyukjinKwon
Github user HyukjinKwon commented on the pull request: https://github.com/apache/spark/pull/10427#issuecomment-166568408 cc @liancheng @yhuai --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have

[GitHub] spark pull request: [SPARK-12440][Core] - Avoid setCheckpoint warn...

2015-12-22 Thread SparkQA
Github user SparkQA commented on the pull request: https://github.com/apache/spark/pull/10392#issuecomment-166568388 **[Test build #48181 has started](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/48181/consoleFull)** for PR 10392 at commit [`6e21b23`](https://gi

[GitHub] spark pull request: [SPARK-12440][Core] - Avoid setCheckpoint warn...

2015-12-22 Thread AmplabJenkins
Github user AmplabJenkins commented on the pull request: https://github.com/apache/spark/pull/10392#issuecomment-166568253 Test FAILed. Refer to this link for build results (access rights to CI server needed): https://amplab.cs.berkeley.edu/jenkins//job/SparkPullRequestBuilder/

[GitHub] spark pull request: [SPARK-12440][Core] - Avoid setCheckpoint warn...

2015-12-22 Thread AmplabJenkins
Github user AmplabJenkins commented on the pull request: https://github.com/apache/spark/pull/10392#issuecomment-166568251 Merged build finished. Test FAILed. --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your projec

[GitHub] spark pull request: [SPARK-12321][SQL] JSON format for TreeNode (u...

2015-12-22 Thread cloud-fan
Github user cloud-fan commented on the pull request: https://github.com/apache/spark/pull/10311#issuecomment-166568142 hi @JoshRosen , I opend https://github.com/apache/spark/pull/10430 for hot fix, if you think this is emergent. I'll spend more time to come up with a proper fix. --

[GitHub] spark pull request: [SPARK-12476][SQL] Implement JdbcRelation#unha...

2015-12-22 Thread HyukjinKwon
Github user HyukjinKwon commented on a diff in the pull request: https://github.com/apache/spark/pull/10427#discussion_r48236730 --- Diff: sql/core/src/test/scala/org/apache/spark/sql/jdbc/JDBCSuite.scala --- @@ -176,14 +178,23 @@ class JDBCSuite extends SparkFunSuite with BeforeA

[GitHub] spark pull request: [HOT-FIX] bypass hive test when parse logical ...

2015-12-22 Thread cloud-fan
Github user cloud-fan commented on the pull request: https://github.com/apache/spark/pull/10430#issuecomment-166567713 cc @JoshRosen @marmbrus --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have

[GitHub] spark pull request: [HOT-FIX] bypass hive test when parse logical ...

2015-12-22 Thread cloud-fan
GitHub user cloud-fan opened a pull request: https://github.com/apache/spark/pull/10430 [HOT-FIX] bypass hive test when parse logical plan to json https://github.com/apache/spark/pull/10311 introduces some rare, non-deterministic flakiness for hive udf tests, see https://github.com

[GitHub] spark pull request: [Spark-12260][wip][Streaming]Graceful Shutdown...

2015-12-22 Thread adrian-wang
Github user adrian-wang commented on a diff in the pull request: https://github.com/apache/spark/pull/10252#discussion_r48235929 --- Diff: streaming/src/main/scala/org/apache/spark/streaming/dstream/DStream.scala --- @@ -330,6 +330,20 @@ abstract class DStream[T: ClassTag] (

[GitHub] spark pull request: [SPARK-12440][Core] - Avoid setCheckpoint warn...

2015-12-22 Thread pierre-borckmans
Github user pierre-borckmans commented on the pull request: https://github.com/apache/spark/pull/10392#issuecomment-166565536 @srowen Agreed. I reverted my changes, and updated the warning message. Thanks for your review. --- If your project is set up for it, you can reply to this

[GitHub] spark pull request: [SPARK-12409][SQL]add filter (IN, AND, OR)

2015-12-22 Thread maropu
Github user maropu commented on the pull request: https://github.com/apache/spark/pull/10386#issuecomment-166565039 Please add tests by referring #10409. --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project doe

[GitHub] spark pull request: [SPARK-10427][SQL]Respect -S option for spark-...

2015-12-22 Thread AmplabJenkins
Github user AmplabJenkins commented on the pull request: https://github.com/apache/spark/pull/8915#issuecomment-166564763 Test FAILed. Refer to this link for build results (access rights to CI server needed): https://amplab.cs.berkeley.edu/jenkins//job/SparkPullRequestBuilder/4

[GitHub] spark pull request: [SPARK-10427][SQL]Respect -S option for spark-...

2015-12-22 Thread AmplabJenkins
Github user AmplabJenkins commented on the pull request: https://github.com/apache/spark/pull/8915#issuecomment-166564761 Merged build finished. Test FAILed. --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project

[GitHub] spark pull request: [SPARK-12457] [SQL] Add ExpressionDescription ...

2015-12-22 Thread AmplabJenkins
Github user AmplabJenkins commented on the pull request: https://github.com/apache/spark/pull/10418#issuecomment-166564656 Test FAILed. Refer to this link for build results (access rights to CI server needed): https://amplab.cs.berkeley.edu/jenkins//job/SparkPullRequestBuilder/

[GitHub] spark pull request: [SPARK-10427][SQL]Respect -S option for spark-...

2015-12-22 Thread SparkQA
Github user SparkQA commented on the pull request: https://github.com/apache/spark/pull/8915#issuecomment-166564709 **[Test build #48173 has finished](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/48173/consoleFull)** for PR 8915 at commit [`592ed63`](https://git

[GitHub] spark pull request: [SPARK-12457] [SQL] Add ExpressionDescription ...

2015-12-22 Thread AmplabJenkins
Github user AmplabJenkins commented on the pull request: https://github.com/apache/spark/pull/10418#issuecomment-166564653 Merged build finished. Test FAILed. --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your projec

[GitHub] spark pull request: [SPARK-12457] [SQL] Add ExpressionDescription ...

2015-12-22 Thread SparkQA
Github user SparkQA commented on the pull request: https://github.com/apache/spark/pull/10418#issuecomment-166564588 **[Test build #48177 has finished](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/48177/consoleFull)** for PR 10418 at commit [`99cb7d8`](https://g

[GitHub] spark pull request: [SPARK-12421][SQL] Fixed copy() method of Gene...

2015-12-22 Thread Apo1
Github user Apo1 commented on the pull request: https://github.com/apache/spark/pull/10374#issuecomment-166564092 @hvanhovell Ok, I try. But I'm not sure where's the right place for the unit test. `sql/catalyst/src/test/scala/org/apache/spark/sql/Rowtest` seems to initialize a Generic

[GitHub] spark pull request: [SPARK-12311][CORE] Restore previous value of ...

2015-12-22 Thread srowen
Github user srowen commented on a diff in the pull request: https://github.com/apache/spark/pull/10289#discussion_r48234885 --- Diff: yarn/src/test/scala/org/apache/spark/deploy/yarn/BaseYarnClusterSuite.scala --- @@ -116,7 +120,7 @@ abstract class BaseYarnClusterSuite

[GitHub] spark pull request: [SPARK-12311][CORE] Restore previous value of ...

2015-12-22 Thread srowen
Github user srowen commented on a diff in the pull request: https://github.com/apache/spark/pull/10289#discussion_r48234838 --- Diff: yarn/src/test/scala/org/apache/spark/deploy/yarn/ClientSuite.scala --- @@ -43,12 +45,21 @@ import org.apache.spark.util.Utils class Clien

[GitHub] spark pull request: [SPARK-3369] [CORE] [STREAMING] Java mapPartit...

2015-12-22 Thread SparkQA
Github user SparkQA commented on the pull request: https://github.com/apache/spark/pull/10413#issuecomment-166563807 **[Test build #48179 has started](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/48179/consoleFull)** for PR 10413 at commit [`afe2af0`](https://gi

[GitHub] spark pull request: [SPARK 12477][SQL] Tungsten projection fails f...

2015-12-22 Thread pierre-borckmans
Github user pierre-borckmans commented on the pull request: https://github.com/apache/spark/pull/10429#issuecomment-166562978 @rxin This PR incidentally also fixes another issue. Accessing a null element in an array of IntegerType erroneously returned 0: ``` scala> val df = sc

[GitHub] spark pull request: [SPARK 12477][SQL] Tungsten projection fails f...

2015-12-22 Thread pierre-borckmans
Github user pierre-borckmans commented on the pull request: https://github.com/apache/spark/pull/10429#issuecomment-166561023 @rxin I added a small test, let me know if more should be added. --- If your project is set up for it, you can reply to this email and have your reply appear o

[GitHub] spark pull request: [SPARK-12396][Core]Once driver connect to a ma...

2015-12-22 Thread echoTomei
Github user echoTomei commented on the pull request: https://github.com/apache/spark/pull/10407#issuecomment-166560619 @SparkQA The build error shows that the function cancel() is not a member of [java.util.concurrent.ScheduledFuture[_]] . I check the interface ScheduledFuture API ,c

[GitHub] spark pull request: [SPARK-12247] [ML] [DOC] Documentation for spa...

2015-12-22 Thread AmplabJenkins
Github user AmplabJenkins commented on the pull request: https://github.com/apache/spark/pull/10411#issuecomment-166560438 Merged build finished. Test PASSed. --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your projec

[GitHub] spark pull request: [SPARK-12317][SQL]Support configurable value i...

2015-12-22 Thread kevinyu98
Github user kevinyu98 commented on the pull request: https://github.com/apache/spark/pull/10314#issuecomment-166560467 @srowen Hello Sean: I am sorry that I have't been able to submit the PR yet. I will conti. work on it tomorrow. --- If your project is set up for it, you can reply

[GitHub] spark pull request: [SPARK-12247] [ML] [DOC] Documentation for spa...

2015-12-22 Thread AmplabJenkins
Github user AmplabJenkins commented on the pull request: https://github.com/apache/spark/pull/10411#issuecomment-166560440 Test PASSed. Refer to this link for build results (access rights to CI server needed): https://amplab.cs.berkeley.edu/jenkins//job/SparkPullRequestBuilder/

[GitHub] spark pull request: [SPARK-12247] [ML] [DOC] Documentation for spa...

2015-12-22 Thread SparkQA
Github user SparkQA commented on the pull request: https://github.com/apache/spark/pull/10411#issuecomment-166560317 **[Test build #48176 has finished](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/48176/consoleFull)** for PR 10411 at commit [`b086ffd`](https://g

[GitHub] spark pull request: [SPARK-7727] [SQL] Avoid inner classes in Rule...

2015-12-22 Thread AmplabJenkins
Github user AmplabJenkins commented on the pull request: https://github.com/apache/spark/pull/10174#issuecomment-166560115 Merged build finished. Test FAILed. --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your projec

[GitHub] spark pull request: [SPARK-7727] [SQL] Avoid inner classes in Rule...

2015-12-22 Thread AmplabJenkins
Github user AmplabJenkins commented on the pull request: https://github.com/apache/spark/pull/10174#issuecomment-166560116 Test FAILed. Refer to this link for build results (access rights to CI server needed): https://amplab.cs.berkeley.edu/jenkins//job/SparkPullRequestBuilder/

[GitHub] spark pull request: [SPARK-7727] [SQL] Avoid inner classes in Rule...

2015-12-22 Thread SparkQA
Github user SparkQA commented on the pull request: https://github.com/apache/spark/pull/10174#issuecomment-166560077 **[Test build #48175 has finished](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/48175/consoleFull)** for PR 10174 at commit [`c7ea3b1`](https://g

[GitHub] spark pull request: [SPARK-12010][SQL] Spark JDBC requires support...

2015-12-22 Thread AmplabJenkins
Github user AmplabJenkins commented on the pull request: https://github.com/apache/spark/pull/10380#issuecomment-166558340 Merged build finished. Test PASSed. --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your projec

[GitHub] spark pull request: [SPARK-12475][BUILD][test-maven] Upgrade Zinc ...

2015-12-22 Thread srowen
Github user srowen commented on the pull request: https://github.com/apache/spark/pull/10426#issuecomment-166558448 +1 FWIW I have been using the latest zinc for a while with Spark, including 0.3.9 and never had an issue --- If your project is set up for it, you can reply to this ema

[GitHub] spark pull request: [SPARK-12010][SQL] Spark JDBC requires support...

2015-12-22 Thread AmplabJenkins
Github user AmplabJenkins commented on the pull request: https://github.com/apache/spark/pull/10380#issuecomment-166558344 Test PASSed. Refer to this link for build results (access rights to CI server needed): https://amplab.cs.berkeley.edu/jenkins//job/SparkPullRequestBuilder/

[GitHub] spark pull request: [SPARK-12331][ML] R^2 for regression through t...

2015-12-22 Thread srowen
Github user srowen commented on the pull request: https://github.com/apache/spark/pull/10384#issuecomment-166558267 That LGTM; let me wait for comments --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does

[GitHub] spark pull request: [SPARK-12010][SQL] Spark JDBC requires support...

2015-12-22 Thread SparkQA
Github user SparkQA commented on the pull request: https://github.com/apache/spark/pull/10380#issuecomment-166558182 **[Test build #48168 has finished](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/48168/consoleFull)** for PR 10380 at commit [`c130e31`](https://g

[GitHub] spark pull request: [SPARK-12302][EXAMPLES] Example for basic auth...

2015-12-22 Thread Lewuathe
Github user Lewuathe commented on the pull request: https://github.com/apache/spark/pull/10273#issuecomment-166557625 @srowen Sorry for late. Sure I close the PR. Thanks. --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If

[GitHub] spark pull request: [SPARK-12010][SQL] Spark JDBC requires support...

2015-12-22 Thread srowen
Github user srowen commented on a diff in the pull request: https://github.com/apache/spark/pull/10380#discussion_r48232961 --- Diff: sql/core/src/main/scala/org/apache/spark/sql/execution/datasources/jdbc/JdbcUtils.scala --- @@ -62,15 +62,12 @@ object JdbcUtils extends Logging {

[GitHub] spark pull request: [SPARK-12463][SPARK-12464][SPARK-12465][SPARK-...

2015-12-22 Thread AmplabJenkins
Github user AmplabJenkins commented on the pull request: https://github.com/apache/spark/pull/10057#issuecomment-166557670 Test PASSed. Refer to this link for build results (access rights to CI server needed): https://amplab.cs.berkeley.edu/jenkins//job/SparkPullRequestBuilder/

[GitHub] spark pull request: [SPARK-12463][SPARK-12464][SPARK-12465][SPARK-...

2015-12-22 Thread AmplabJenkins
Github user AmplabJenkins commented on the pull request: https://github.com/apache/spark/pull/10057#issuecomment-166557669 Merged build finished. Test PASSed. --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your projec

[GitHub] spark pull request: [SPARK-12302][EXAMPLES] Example for basic auth...

2015-12-22 Thread Lewuathe
Github user Lewuathe closed the pull request at: https://github.com/apache/spark/pull/10273 --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this feature enabled and wishes so, or if the feature is e

[GitHub] spark pull request: [SPARK-12463][SPARK-12464][SPARK-12465][SPARK-...

2015-12-22 Thread SparkQA
Github user SparkQA commented on the pull request: https://github.com/apache/spark/pull/10057#issuecomment-166557494 **[Test build #48170 has finished](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/48170/consoleFull)** for PR 10057 at commit [`4a56f6c`](https://g

[GitHub] spark pull request: [SPARK 12477][SQL] Tungsten projection fails f...

2015-12-22 Thread rxin
Github user rxin commented on the pull request: https://github.com/apache/spark/pull/10429#issuecomment-166557339 Maybe DataFrameComplexTypeSuite? --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not

[GitHub] spark pull request: [SPARK-12446][SQL] Add unit tests for JDBCRDD ...

2015-12-22 Thread SparkQA
Github user SparkQA commented on the pull request: https://github.com/apache/spark/pull/10409#issuecomment-166556285 **[Test build #2244 has finished](https://amplab.cs.berkeley.edu/jenkins/job/NewSparkPullRequestBuilder/2244/consoleFull)** for PR 10409 at commit [`46c0e7f`](https://

[GitHub] spark pull request: [SPARK-12247] [ML] [DOC] Documentation for spa...

2015-12-22 Thread AmplabJenkins
Github user AmplabJenkins commented on the pull request: https://github.com/apache/spark/pull/10411#issuecomment-166557203 Merged build finished. Test PASSed. --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your projec

[GitHub] spark pull request: [SPARK-12446][SQL] Add unit tests for JDBCRDD ...

2015-12-22 Thread SparkQA
Github user SparkQA commented on the pull request: https://github.com/apache/spark/pull/10409#issuecomment-166557313 **[Test build #2246 has finished](https://amplab.cs.berkeley.edu/jenkins/job/NewSparkPullRequestBuilder/2246/consoleFull)** for PR 10409 at commit [`46c0e7f`](https://

[GitHub] spark pull request: [SPARK-12247] [ML] [DOC] Documentation for spa...

2015-12-22 Thread AmplabJenkins
Github user AmplabJenkins commented on the pull request: https://github.com/apache/spark/pull/10411#issuecomment-166557205 Test PASSed. Refer to this link for build results (access rights to CI server needed): https://amplab.cs.berkeley.edu/jenkins//job/SparkPullRequestBuilder/

[GitHub] spark pull request: [SPARK-12456][SQL] Add ExpressionDescription t...

2015-12-22 Thread SparkQA
Github user SparkQA commented on the pull request: https://github.com/apache/spark/pull/10423#issuecomment-166557245 **[Test build #2243 has finished](https://amplab.cs.berkeley.edu/jenkins/job/NewSparkPullRequestBuilder/2243/consoleFull)** for PR 10423 at commit [`b49df75`](https://

[GitHub] spark pull request: [SPARK-12247] [ML] [DOC] Documentation for spa...

2015-12-22 Thread SparkQA
Github user SparkQA commented on the pull request: https://github.com/apache/spark/pull/10411#issuecomment-166557094 **[Test build #48174 has finished](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/48174/consoleFull)** for PR 10411 at commit [`3a860b1`](https://g

[GitHub] spark pull request: [SPARK 12477][SQL] Tungsten projection fails f...

2015-12-22 Thread AmplabJenkins
Github user AmplabJenkins commented on the pull request: https://github.com/apache/spark/pull/10429#issuecomment-166557047 Can one of the admins verify this patch? --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your p

[GitHub] spark pull request: [SPARK 12477][SQL] Tungsten projection fails f...

2015-12-22 Thread pierre-borckmans
Github user pierre-borckmans commented on the pull request: https://github.com/apache/spark/pull/10429#issuecomment-166557024 @rxin Where should it go to be sure? --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your pr

[GitHub] spark pull request: [SPARK 12477][SQL] Tungsten projection fails f...

2015-12-22 Thread pierre-borckmans
Github user pierre-borckmans commented on the pull request: https://github.com/apache/spark/pull/10429#issuecomment-166556972 @rxin Sure! --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this

[GitHub] spark pull request: [SPARK-12446][SQL] Add unit tests for JDBCRDD ...

2015-12-22 Thread asfgit
Github user asfgit closed the pull request at: https://github.com/apache/spark/pull/10409 --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this feature enabled and wishes so, or if the feature is ena

[GitHub] spark pull request: [SPARK-12446][SQL] Add unit tests for JDBCRDD ...

2015-12-22 Thread SparkQA
Github user SparkQA commented on the pull request: https://github.com/apache/spark/pull/10409#issuecomment-166556987 **[Test build #2245 has finished](https://amplab.cs.berkeley.edu/jenkins/job/NewSparkPullRequestBuilder/2245/consoleFull)** for PR 10409 at commit [`46c0e7f`](https://

[GitHub] spark pull request: [SPARK 12477][SQL] Tungsten projection fails f...

2015-12-22 Thread rxin
Github user rxin commented on the pull request: https://github.com/apache/spark/pull/10429#issuecomment-166556865 Can you also add a unit test? --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not hav

[GitHub] spark pull request: [SPARK-11807] Remove support for Hadoop < 2.2

2015-12-22 Thread srowen
Github user srowen commented on the pull request: https://github.com/apache/spark/pull/10404#issuecomment-166556768 Yeah the benefits of supporting only 2.6 would be roughly: - Another Jenkins build or two goes away - Less JAR hell to reason about / newer transitive depende

[GitHub] spark pull request: [SPARK-12446][SQL] Add unit tests for JDBCRDD ...

2015-12-22 Thread rxin
Github user rxin commented on the pull request: https://github.com/apache/spark/pull/10409#issuecomment-166556731 Thanks - I've merged this. --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have t

[GitHub] spark pull request: [SPARK-12421][SQL] Fixed copy() method of Gene...

2015-12-22 Thread hvanhovell
Github user hvanhovell commented on the pull request: https://github.com/apache/spark/pull/10374#issuecomment-166556640 @Apo1 Could you add a unit test for this? --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your pro

[GitHub] spark pull request: [SPARK 12477][SQL] Tungsten projection fails f...

2015-12-22 Thread pierre-borckmans
GitHub user pierre-borckmans opened a pull request: https://github.com/apache/spark/pull/10429 [SPARK 12477][SQL] Tungsten projection fails for null values in array fields Accessing null elements in an array field fails when tungsten is enabled. It works in Spark 1.3.1, and in Sp

[GitHub] spark pull request: [SPARK-12421][SQL] Fixed copy() method of Gene...

2015-12-22 Thread sarutak
Github user sarutak commented on the pull request: https://github.com/apache/spark/pull/10374#issuecomment-166556560 CC: @rxin @marmbrus --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this

[GitHub] spark pull request: [SPARK-12102][SQL] Cast a non-nullable struct ...

2015-12-22 Thread dilipbiswal
Github user dilipbiswal commented on the pull request: https://github.com/apache/spark/pull/10156#issuecomment-166556355 retest this please --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have thi

[GitHub] spark pull request: [Spark-12260][wip][Streaming]Graceful Shutdown...

2015-12-22 Thread adrian-wang
Github user adrian-wang commented on a diff in the pull request: https://github.com/apache/spark/pull/10252#discussion_r48232309 --- Diff: streaming/src/main/scala/org/apache/spark/streaming/DStreamGraph.scala --- @@ -171,6 +173,23 @@ final private[streaming] class DStreamGraph ext

[GitHub] spark pull request: [Spark-12260][wip][Streaming]Graceful Shutdown...

2015-12-22 Thread adrian-wang
Github user adrian-wang commented on a diff in the pull request: https://github.com/apache/spark/pull/10252#discussion_r48232238 --- Diff: streaming/src/main/scala/org/apache/spark/streaming/dstream/DStream.scala --- @@ -330,6 +330,20 @@ abstract class DStream[T: ClassTag] (

[GitHub] spark pull request: [SPARK-12371][SQL] Runtime nullability check f...

2015-12-22 Thread SparkQA
Github user SparkQA commented on the pull request: https://github.com/apache/spark/pull/10331#issuecomment-166555191 **[Test build #48178 has started](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/48178/consoleFull)** for PR 10331 at commit [`759c20d`](https://gi

[GitHub] spark pull request: [SPARK-12457] [SQL] Add ExpressionDescription ...

2015-12-22 Thread SparkQA
Github user SparkQA commented on the pull request: https://github.com/apache/spark/pull/10418#issuecomment-166555105 **[Test build #48177 has started](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/48177/consoleFull)** for PR 10418 at commit [`99cb7d8`](https://gi

[GitHub] spark pull request: [SPARK-12476][SQL] Implement JdbcRelation#unha...

2015-12-22 Thread HyukjinKwon
Github user HyukjinKwon commented on the pull request: https://github.com/apache/spark/pull/10427#issuecomment-166553543 cc @liancheng @yhuai --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have

[GitHub] spark pull request: [SPARK-12476][SQL] Implement JdbcRelation#unha...

2015-12-22 Thread HyukjinKwon
Github user HyukjinKwon commented on a diff in the pull request: https://github.com/apache/spark/pull/10427#discussion_r48231701 --- Diff: sql/core/src/main/scala/org/apache/spark/sql/execution/datasources/jdbc/JDBCRelation.scala --- @@ -90,6 +90,19 @@ private[sql] case class JDBC

[GitHub] spark pull request: [SPARK-12371][SQL] Runtime nullability check f...

2015-12-22 Thread liancheng
Github user liancheng commented on the pull request: https://github.com/apache/spark/pull/10331#issuecomment-166553530 The last build failure was irrelevant. --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project

[GitHub] spark pull request: [SPARK-12421][SQL] Fixed copy() method of Gene...

2015-12-22 Thread Apo1
Github user Apo1 commented on a diff in the pull request: https://github.com/apache/spark/pull/10374#discussion_r48231498 --- Diff: sql/catalyst/src/main/scala/org/apache/spark/sql/catalyst/expressions/rows.scala --- @@ -201,7 +201,7 @@ class GenericRow(protected[sql] val values:

<    1   2   3   4   5   6   >