[GitHub] spark issue #15102: [SPARK-17346][SQL] Add Kafka source for Structured Strea...

2016-09-20 Thread SparkQA
Github user SparkQA commented on the issue: https://github.com/apache/spark/pull/15102 **[Test build #65694 has started](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/65694/consoleFull)** for PR 15102 at commit

[GitHub] spark issue #15171: [SPARK-17617][SQL] Remainder(%) expression.eval returns ...

2016-09-20 Thread SparkQA
Github user SparkQA commented on the issue: https://github.com/apache/spark/pull/15171 **[Test build #65693 has started](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/65693/consoleFull)** for PR 15171 at commit

[GitHub] spark issue #15159: [SPARK-17605][SPARK_SUBMIT] Add option spark.usePython a...

2016-09-20 Thread zjffdu
Github user zjffdu commented on the issue: https://github.com/apache/spark/pull/15159 @felixcheung Just as I mention in the jira description, zeppelin/livy would use both pyspark and sparkR. I try this PR with zeppelin (but needs some code change in zeppelin), and it works. ---

[GitHub] spark issue #15171: [SPARK-17617][SQL] Remainder(%) expression.eval returns ...

2016-09-20 Thread clockfly
Github user clockfly commented on the issue: https://github.com/apache/spark/pull/15171 @cloud-fan --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this feature enabled and wishes so, or if

[GitHub] spark pull request #15171: [SPARK-17617][SQL] Remainder(%) expression.eval r...

2016-09-20 Thread clockfly
GitHub user clockfly opened a pull request: https://github.com/apache/spark/pull/15171 [SPARK-17617][SQL] Remainder(%) expression.eval returns incorrect result on double value ## What changes were proposed in this pull request? Remainder(%) expression's `eval()` returns

[GitHub] spark issue #15147: [SPARK-17545] [SQL] Handle additional time offset format...

2016-09-20 Thread HyukjinKwon
Github user HyukjinKwon commented on the issue: https://github.com/apache/spark/pull/15147 @nbeyer Thanks for bearing with me. --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this feature

[GitHub] spark issue #15170: [MINOR][BUILD] Fix CheckStyle Error

2016-09-20 Thread SparkQA
Github user SparkQA commented on the issue: https://github.com/apache/spark/pull/15170 **[Test build #65691 has started](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/65691/consoleFull)** for PR 15170 at commit

[GitHub] spark issue #15120: [SPARK-4563][core] Allow driver to advertise a different...

2016-09-20 Thread SparkQA
Github user SparkQA commented on the issue: https://github.com/apache/spark/pull/15120 **[Test build #65692 has started](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/65692/consoleFull)** for PR 15120 at commit

[GitHub] spark issue #15170: [MINOR][BUILD] Fix CheckStyle Error

2016-09-20 Thread Sherry302
Github user Sherry302 commented on the issue: https://github.com/apache/spark/pull/15170 Retest this please. --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this feature enabled and wishes

[GitHub] spark issue #14471: [SPARK-14387][SQL] Enable Hive-1.x ORC compatibility wit...

2016-09-20 Thread AmplabJenkins
Github user AmplabJenkins commented on the issue: https://github.com/apache/spark/pull/14471 Test PASSed. Refer to this link for build results (access rights to CI server needed): https://amplab.cs.berkeley.edu/jenkins//job/SparkPullRequestBuilder/65687/ Test PASSed. ---

[GitHub] spark issue #14471: [SPARK-14387][SQL] Enable Hive-1.x ORC compatibility wit...

2016-09-20 Thread AmplabJenkins
Github user AmplabJenkins commented on the issue: https://github.com/apache/spark/pull/14471 Merged build finished. Test PASSed. --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this feature

[GitHub] spark issue #14471: [SPARK-14387][SQL] Enable Hive-1.x ORC compatibility wit...

2016-09-20 Thread SparkQA
Github user SparkQA commented on the issue: https://github.com/apache/spark/pull/14471 **[Test build #65687 has finished](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/65687/consoleFull)** for PR 14471 at commit

[GitHub] spark issue #15170: [MINOR][BUILD] Fix CheckStyle Error

2016-09-20 Thread Sherry302
Github user Sherry302 commented on the issue: https://github.com/apache/spark/pull/15170 There is 0 failures (±0) , 1 skipped (±0) in the Test Result page. I'll re-trigger again. --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub

[GitHub] spark pull request #15147: [SPARK-17545] [SQL] Handle additional time offset...

2016-09-20 Thread nbeyer
Github user nbeyer closed the pull request at: https://github.com/apache/spark/pull/15147 --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this feature enabled and wishes so, or if the feature is

[GitHub] spark issue #15147: [SPARK-17545] [SQL] Handle additional time offset format...

2016-09-20 Thread nbeyer
Github user nbeyer commented on the issue: https://github.com/apache/spark/pull/15147 @HyukjinKwon Yeah, I agree, this PR doesn't really apply anymore. I'll work up a different JIRA and PR. --- If your project is set up for it, you can reply to this email and have your reply appear

[GitHub] spark issue #15046: [SPARK-17492] [SQL] Fix Reading Cataloged Data Sources w...

2016-09-20 Thread AmplabJenkins
Github user AmplabJenkins commented on the issue: https://github.com/apache/spark/pull/15046 Merged build finished. Test PASSed. --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this feature

[GitHub] spark issue #15046: [SPARK-17492] [SQL] Fix Reading Cataloged Data Sources w...

2016-09-20 Thread AmplabJenkins
Github user AmplabJenkins commented on the issue: https://github.com/apache/spark/pull/15046 Test PASSed. Refer to this link for build results (access rights to CI server needed): https://amplab.cs.berkeley.edu/jenkins//job/SparkPullRequestBuilder/65684/ Test PASSed. ---

[GitHub] spark issue #15046: [SPARK-17492] [SQL] Fix Reading Cataloged Data Sources w...

2016-09-20 Thread SparkQA
Github user SparkQA commented on the issue: https://github.com/apache/spark/pull/15046 **[Test build #65684 has finished](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/65684/consoleFull)** for PR 15046 at commit

[GitHub] spark issue #15170: [MINOR][BUILD] Fix CheckStyle Error

2016-09-20 Thread AmplabJenkins
Github user AmplabJenkins commented on the issue: https://github.com/apache/spark/pull/15170 Test FAILed. Refer to this link for build results (access rights to CI server needed): https://amplab.cs.berkeley.edu/jenkins//job/SparkPullRequestBuilder/65682/ Test FAILed. ---

[GitHub] spark issue #15090: [SPARK-17073] [SQL] generate column-level statistics

2016-09-20 Thread SparkQA
Github user SparkQA commented on the issue: https://github.com/apache/spark/pull/15090 **[Test build #65690 has started](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/65690/consoleFull)** for PR 15090 at commit

[GitHub] spark issue #15170: [MINOR][BUILD] Fix CheckStyle Error

2016-09-20 Thread AmplabJenkins
Github user AmplabJenkins commented on the issue: https://github.com/apache/spark/pull/15170 Merged build finished. Test FAILed. --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this feature

[GitHub] spark issue #15170: [MINOR][BUILD] Fix CheckStyle Error

2016-09-20 Thread SparkQA
Github user SparkQA commented on the issue: https://github.com/apache/spark/pull/15170 **[Test build #65682 has finished](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/65682/consoleFull)** for PR 15170 at commit

[GitHub] spark issue #15169: [SPARK-17613] S3A base paths with no '/' at the end retu...

2016-09-20 Thread AmplabJenkins
Github user AmplabJenkins commented on the issue: https://github.com/apache/spark/pull/15169 Test PASSed. Refer to this link for build results (access rights to CI server needed): https://amplab.cs.berkeley.edu/jenkins//job/SparkPullRequestBuilder/65683/ Test PASSed. ---

[GitHub] spark issue #15169: [SPARK-17613] S3A base paths with no '/' at the end retu...

2016-09-20 Thread AmplabJenkins
Github user AmplabJenkins commented on the issue: https://github.com/apache/spark/pull/15169 Merged build finished. Test PASSed. --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this feature

[GitHub] spark issue #15169: [SPARK-17613] S3A base paths with no '/' at the end retu...

2016-09-20 Thread SparkQA
Github user SparkQA commented on the issue: https://github.com/apache/spark/pull/15169 **[Test build #65683 has finished](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/65683/consoleFull)** for PR 15169 at commit

[GitHub] spark issue #15169: [SPARK-17613] S3A base paths with no '/' at the end retu...

2016-09-20 Thread SparkQA
Github user SparkQA commented on the issue: https://github.com/apache/spark/pull/15169 **[Test build #65689 has started](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/65689/consoleFull)** for PR 15169 at commit

[GitHub] spark pull request #15131: [SPARK-17577][SparkR][Core] SparkR support add fi...

2016-09-20 Thread HyukjinKwon
Github user HyukjinKwon commented on a diff in the pull request: https://github.com/apache/spark/pull/15131#discussion_r79735513 --- Diff: core/src/main/scala/org/apache/spark/SparkContext.scala --- @@ -1426,7 +1426,7 @@ class SparkContext(config: SparkConf) extends Logging with

[GitHub] spark issue #15169: [SPARK-17613] S3A base paths with no '/' at the end retu...

2016-09-20 Thread SparkQA
Github user SparkQA commented on the issue: https://github.com/apache/spark/pull/15169 **[Test build #65688 has finished](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/65688/consoleFull)** for PR 15169 at commit

[GitHub] spark issue #15169: [SPARK-17613] S3A base paths with no '/' at the end retu...

2016-09-20 Thread AmplabJenkins
Github user AmplabJenkins commented on the issue: https://github.com/apache/spark/pull/15169 Test FAILed. Refer to this link for build results (access rights to CI server needed): https://amplab.cs.berkeley.edu/jenkins//job/SparkPullRequestBuilder/65688/ Test FAILed. ---

[GitHub] spark issue #15169: [SPARK-17613] S3A base paths with no '/' at the end retu...

2016-09-20 Thread AmplabJenkins
Github user AmplabJenkins commented on the issue: https://github.com/apache/spark/pull/15169 Merged build finished. Test FAILed. --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this feature

[GitHub] spark issue #15169: [SPARK-17613] S3A base paths with no '/' at the end retu...

2016-09-20 Thread SparkQA
Github user SparkQA commented on the issue: https://github.com/apache/spark/pull/15169 **[Test build #65688 has started](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/65688/consoleFull)** for PR 15169 at commit

[GitHub] spark issue #14818: [SPARK-17157][SPARKR][WIP]: Add multiclass logistic regr...

2016-09-20 Thread wangmiao1981
Github user wangmiao1981 commented on the issue: https://github.com/apache/spark/pull/14818 Yes. I am reviewing the code in #14834 to check if we just have to modify existing wrapper to be consistent with Scala side API. --- If your project is set up for it, you can reply to this

[GitHub] spark pull request #15131: [SPARK-17577][SparkR][Core] SparkR support add fi...

2016-09-20 Thread HyukjinKwon
Github user HyukjinKwon commented on a diff in the pull request: https://github.com/apache/spark/pull/15131#discussion_r79732092 --- Diff: core/src/main/scala/org/apache/spark/SparkContext.scala --- @@ -1457,8 +1457,8 @@ class SparkContext(config: SparkConf) extends Logging with

[GitHub] spark issue #15168: [SPARK-17612][SQL] Support `DESCRIBE table PARTITION` SQ...

2016-09-20 Thread dongjoon-hyun
Github user dongjoon-hyun commented on the issue: https://github.com/apache/spark/pull/15168 Hi, @rxin . Could you review this PR to implement `DESCRIBE table PARTITION`? --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as

[GitHub] spark pull request #15120: [SPARK-4563][core] Allow driver to advertise a di...

2016-09-20 Thread vanzin
Github user vanzin commented on a diff in the pull request: https://github.com/apache/spark/pull/15120#discussion_r79731837 --- Diff: core/src/main/scala/org/apache/spark/internal/config/package.scala --- @@ -143,4 +144,23 @@ package object config { .internal()

[GitHub] spark pull request #15120: [SPARK-4563][core] Allow driver to advertise a di...

2016-09-20 Thread zsxwing
Github user zsxwing commented on a diff in the pull request: https://github.com/apache/spark/pull/15120#discussion_r79731291 --- Diff: core/src/main/scala/org/apache/spark/internal/config/package.scala --- @@ -143,4 +144,23 @@ package object config { .internal()

[GitHub] spark pull request #15131: [SPARK-17577][SparkR][Core] SparkR support add fi...

2016-09-20 Thread HyukjinKwon
Github user HyukjinKwon commented on a diff in the pull request: https://github.com/apache/spark/pull/15131#discussion_r79731142 --- Diff: core/src/main/scala/org/apache/spark/SparkContext.scala --- @@ -1426,7 +1426,7 @@ class SparkContext(config: SparkConf) extends Logging with

[GitHub] spark pull request #15120: [SPARK-4563][core] Allow driver to advertise a di...

2016-09-20 Thread vanzin
Github user vanzin commented on a diff in the pull request: https://github.com/apache/spark/pull/15120#discussion_r79730940 --- Diff: core/src/main/scala/org/apache/spark/internal/config/package.scala --- @@ -143,4 +144,23 @@ package object config { .internal()

[GitHub] spark pull request #15166: [SPARK-17513][SQL] Make StreamExecution garbage-c...

2016-09-20 Thread frreiss
Github user frreiss commented on a diff in the pull request: https://github.com/apache/spark/pull/15166#discussion_r79730904 --- Diff: sql/core/src/test/scala/org/apache/spark/sql/streaming/StreamingQuerySuite.scala --- @@ -125,6 +125,30 @@ class StreamingQuerySuite extends

[GitHub] spark issue #15167: [SPARK-17418] Prevent kinesis-asl-assembly artifacts fro...

2016-09-20 Thread AmplabJenkins
Github user AmplabJenkins commented on the issue: https://github.com/apache/spark/pull/15167 Merged build finished. Test PASSed. --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this feature

[GitHub] spark issue #15167: [SPARK-17418] Prevent kinesis-asl-assembly artifacts fro...

2016-09-20 Thread AmplabJenkins
Github user AmplabJenkins commented on the issue: https://github.com/apache/spark/pull/15167 Test PASSed. Refer to this link for build results (access rights to CI server needed): https://amplab.cs.berkeley.edu/jenkins//job/SparkPullRequestBuilder/65681/ Test PASSed. ---

[GitHub] spark pull request #15166: [SPARK-17513][SQL] Make StreamExecution garbage-c...

2016-09-20 Thread frreiss
Github user frreiss commented on a diff in the pull request: https://github.com/apache/spark/pull/15166#discussion_r79730664 --- Diff: sql/core/src/test/scala/org/apache/spark/sql/streaming/StreamingQuerySuite.scala --- @@ -125,6 +125,30 @@ class StreamingQuerySuite extends

[GitHub] spark pull request #15120: [SPARK-4563][core] Allow driver to advertise a di...

2016-09-20 Thread zsxwing
Github user zsxwing commented on a diff in the pull request: https://github.com/apache/spark/pull/15120#discussion_r79729632 --- Diff: core/src/main/scala/org/apache/spark/internal/config/package.scala --- @@ -143,4 +144,23 @@ package object config { .internal()

[GitHub] spark issue #15167: [SPARK-17418] Prevent kinesis-asl-assembly artifacts fro...

2016-09-20 Thread SparkQA
Github user SparkQA commented on the issue: https://github.com/apache/spark/pull/15167 **[Test build #65681 has finished](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/65681/consoleFull)** for PR 15167 at commit

[GitHub] spark pull request #15166: [SPARK-17513][SQL] Make StreamExecution garbage-c...

2016-09-20 Thread petermaxlee
Github user petermaxlee commented on a diff in the pull request: https://github.com/apache/spark/pull/15166#discussion_r79730198 --- Diff: sql/core/src/test/scala/org/apache/spark/sql/streaming/StreamingQuerySuite.scala --- @@ -125,6 +125,30 @@ class StreamingQuerySuite extends

[GitHub] spark issue #15102: [SPARK-17346][SQL] Add Kafka source for Structured Strea...

2016-09-20 Thread koeninger
Github user koeninger commented on the issue: https://github.com/apache/spark/pull/15102 > We are not giving the developer the option to manually configure a consumer in this way for this PR precisely because I don't think we can while still maintaining the semantics that structured

[GitHub] spark pull request #15166: [SPARK-17513][SQL] Make StreamExecution garbage-c...

2016-09-20 Thread petermaxlee
Github user petermaxlee commented on a diff in the pull request: https://github.com/apache/spark/pull/15166#discussion_r79730104 --- Diff: sql/core/src/test/scala/org/apache/spark/sql/streaming/StreamingQuerySuite.scala --- @@ -125,6 +125,30 @@ class StreamingQuerySuite extends

[GitHub] spark issue #14471: [SPARK-14387][SQL] Enable Hive-1.x ORC compatibility wit...

2016-09-20 Thread SparkQA
Github user SparkQA commented on the issue: https://github.com/apache/spark/pull/14471 **[Test build #65687 has started](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/65687/consoleFull)** for PR 14471 at commit

[GitHub] spark issue #14471: [SPARK-14387][SQL] Enable Hive-1.x ORC compatibility wit...

2016-09-20 Thread JoshRosen
Github user JoshRosen commented on the issue: https://github.com/apache/spark/pull/14471 Jenkins, retest this please. --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this feature enabled and

[GitHub] spark issue #10212: [SPARK-12221] add cpu time to metrics

2016-09-20 Thread SparkQA
Github user SparkQA commented on the issue: https://github.com/apache/spark/pull/10212 **[Test build #65686 has started](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/65686/consoleFull)** for PR 10212 at commit

[GitHub] spark issue #15102: [SPARK-17346][SQL] Add Kafka source for Structured Strea...

2016-09-20 Thread SparkQA
Github user SparkQA commented on the issue: https://github.com/apache/spark/pull/15102 **[Test build #65685 has started](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/65685/consoleFull)** for PR 15102 at commit

[GitHub] spark issue #15168: [SPARK-17612][SQL] Support `DESCRIBE table PARTITION` SQ...

2016-09-20 Thread AmplabJenkins
Github user AmplabJenkins commented on the issue: https://github.com/apache/spark/pull/15168 Test PASSed. Refer to this link for build results (access rights to CI server needed): https://amplab.cs.berkeley.edu/jenkins//job/SparkPullRequestBuilder/65680/ Test PASSed. ---

[GitHub] spark issue #15168: [SPARK-17612][SQL] Support `DESCRIBE table PARTITION` SQ...

2016-09-20 Thread AmplabJenkins
Github user AmplabJenkins commented on the issue: https://github.com/apache/spark/pull/15168 Merged build finished. Test PASSed. --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this feature

[GitHub] spark issue #15168: [SPARK-17612][SQL] Support `DESCRIBE table PARTITION` SQ...

2016-09-20 Thread SparkQA
Github user SparkQA commented on the issue: https://github.com/apache/spark/pull/15168 **[Test build #65680 has finished](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/65680/consoleFull)** for PR 15168 at commit

[GitHub] spark pull request #15167: [SPARK-17418] Prevent kinesis-asl-assembly artifa...

2016-09-20 Thread JoshRosen
Github user JoshRosen commented on a diff in the pull request: https://github.com/apache/spark/pull/15167#discussion_r79723911 --- Diff: external/kinesis-asl-assembly/pom.xml --- @@ -141,6 +141,21 @@ target/scala-${scala.binary.version}/classes

[GitHub] spark issue #15046: [SPARK-17492] [SQL] Fix Reading Cataloged Data Sources w...

2016-09-20 Thread SparkQA
Github user SparkQA commented on the issue: https://github.com/apache/spark/pull/15046 **[Test build #65684 has started](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/65684/consoleFull)** for PR 15046 at commit

[GitHub] spark issue #14467: [SPARK-16861][PYSPARK][CORE] Refactor PySpark accumulato...

2016-09-20 Thread AmplabJenkins
Github user AmplabJenkins commented on the issue: https://github.com/apache/spark/pull/14467 Merged build finished. Test PASSed. --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this feature

[GitHub] spark issue #14467: [SPARK-16861][PYSPARK][CORE] Refactor PySpark accumulato...

2016-09-20 Thread AmplabJenkins
Github user AmplabJenkins commented on the issue: https://github.com/apache/spark/pull/14467 Test PASSed. Refer to this link for build results (access rights to CI server needed): https://amplab.cs.berkeley.edu/jenkins//job/SparkPullRequestBuilder/65678/ Test PASSed. ---

[GitHub] spark issue #14467: [SPARK-16861][PYSPARK][CORE] Refactor PySpark accumulato...

2016-09-20 Thread SparkQA
Github user SparkQA commented on the issue: https://github.com/apache/spark/pull/14467 **[Test build #65678 has finished](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/65678/consoleFull)** for PR 14467 at commit

[GitHub] spark pull request #15131: [SPARK-17577][SparkR][Core] SparkR support add fi...

2016-09-20 Thread felixcheung
Github user felixcheung commented on a diff in the pull request: https://github.com/apache/spark/pull/15131#discussion_r79723200 --- Diff: core/src/main/scala/org/apache/spark/SparkContext.scala --- @@ -1426,7 +1426,7 @@ class SparkContext(config: SparkConf) extends Logging with

[GitHub] spark pull request #15131: [SPARK-17577][SparkR][Core] SparkR support add fi...

2016-09-20 Thread felixcheung
Github user felixcheung commented on a diff in the pull request: https://github.com/apache/spark/pull/15131#discussion_r79723221 --- Diff: core/src/main/scala/org/apache/spark/SparkContext.scala --- @@ -1457,8 +1457,8 @@ class SparkContext(config: SparkConf) extends Logging with

[GitHub] spark pull request #15131: [SPARK-17577][SparkR][Core] SparkR support add fi...

2016-09-20 Thread felixcheung
Github user felixcheung commented on a diff in the pull request: https://github.com/apache/spark/pull/15131#discussion_r79723039 --- Diff: R/pkg/R/context.R --- @@ -225,6 +225,51 @@ setCheckpointDir <- function(sc, dirName) { invisible(callJMethod(sc, "setCheckpointDir",

[GitHub] spark pull request #15131: [SPARK-17577][SparkR][Core] SparkR support add fi...

2016-09-20 Thread felixcheung
Github user felixcheung commented on a diff in the pull request: https://github.com/apache/spark/pull/15131#discussion_r79722919 --- Diff: R/pkg/R/context.R --- @@ -225,6 +225,51 @@ setCheckpointDir <- function(sc, dirName) { invisible(callJMethod(sc, "setCheckpointDir",

[GitHub] spark pull request #15131: [SPARK-17577][SparkR][Core] SparkR support add fi...

2016-09-20 Thread felixcheung
Github user felixcheung commented on a diff in the pull request: https://github.com/apache/spark/pull/15131#discussion_r79722962 --- Diff: R/pkg/R/context.R --- @@ -225,6 +225,51 @@ setCheckpointDir <- function(sc, dirName) { invisible(callJMethod(sc, "setCheckpointDir",

[GitHub] spark issue #15131: [SPARK-17577][SparkR][Core] SparkR support add files to ...

2016-09-20 Thread felixcheung
Github user felixcheung commented on the issue: https://github.com/apache/spark/pull/15131 just a thought - I think names like "spark.getSparkFilesRootDirectory" is a bit verbose and perhaps repetitive. Is "SparkFile" a term? Could this be "spark.getFileDir" and "spark.getFiles" or

[GitHub] spark pull request #15166: [SPARK-17513][SQL] Make StreamExecution garbage-c...

2016-09-20 Thread frreiss
Github user frreiss commented on a diff in the pull request: https://github.com/apache/spark/pull/15166#discussion_r79722643 --- Diff: sql/core/src/test/scala/org/apache/spark/sql/streaming/StreamingQuerySuite.scala --- @@ -125,6 +125,30 @@ class StreamingQuerySuite extends

[GitHub] spark pull request #14981: [SPARK-17418] Remove Kinesis artifacts from Spark...

2016-09-20 Thread lresende
Github user lresende closed the pull request at: https://github.com/apache/spark/pull/14981 --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this feature enabled and wishes so, or if the feature is

[GitHub] spark pull request #15046: [SPARK-17492] [SQL] Fix Reading Cataloged Data So...

2016-09-20 Thread gatorsmile
Github user gatorsmile commented on a diff in the pull request: https://github.com/apache/spark/pull/15046#discussion_r79721868 --- Diff: sql/core/src/test/scala/org/apache/spark/sql/sources/TableScanSuite.scala --- @@ -345,34 +345,72 @@ class TableScanSuite extends DataSourceTest

[GitHub] spark issue #15170: [MINOR][BUILD] Fix CheckStyle Error

2016-09-20 Thread SparkQA
Github user SparkQA commented on the issue: https://github.com/apache/spark/pull/15170 **[Test build #65682 has started](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/65682/consoleFull)** for PR 15170 at commit

[GitHub] spark issue #15169: [SPARK-17613] S3A base paths with no '/' at the end retu...

2016-09-20 Thread SparkQA
Github user SparkQA commented on the issue: https://github.com/apache/spark/pull/15169 **[Test build #65683 has started](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/65683/consoleFull)** for PR 15169 at commit

[GitHub] spark pull request #15170: [MINOR][BUILD] Fix CheckStyle Error

2016-09-20 Thread Sherry302
GitHub user Sherry302 opened a pull request: https://github.com/apache/spark/pull/15170 [MINOR][BUILD] Fix CheckStyle Error ## What changes were proposed in this pull request? This PR is to fix the code style errors before 2.0.1 release. ## How was this patch tested?

[GitHub] spark pull request #15046: [SPARK-17492] [SQL] Fix Reading Cataloged Data So...

2016-09-20 Thread gatorsmile
Github user gatorsmile commented on a diff in the pull request: https://github.com/apache/spark/pull/15046#discussion_r79720526 --- Diff: sql/core/src/test/scala/org/apache/spark/sql/test/DataFrameReaderWriterSuite.scala --- @@ -293,6 +293,39 @@ class DataFrameReaderWriterSuite

[GitHub] spark issue #15169: [SPARK-17613] S3A base paths with no '/' at the end retu...

2016-09-20 Thread brkyvz
Github user brkyvz commented on the issue: https://github.com/apache/spark/pull/15169 cc @tdas This is the fix for the issue you were facing. --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have

[GitHub] spark pull request #15169: [SPARK-17613] S3A base paths with no '/' at the e...

2016-09-20 Thread brkyvz
GitHub user brkyvz opened a pull request: https://github.com/apache/spark/pull/15169 [SPARK-17613] S3A base paths with no '/' at the end return empty DataFrames ## What changes were proposed in this pull request? Consider you have a bucket as `s3a://some-bucket` and

[GitHub] spark pull request #15166: [SPARK-17513][SQL] Make StreamExecution garbage-c...

2016-09-20 Thread wangmiao1981
Github user wangmiao1981 commented on a diff in the pull request: https://github.com/apache/spark/pull/15166#discussion_r79720299 --- Diff: sql/core/src/test/scala/org/apache/spark/sql/streaming/StreamingQuerySuite.scala --- @@ -125,6 +125,30 @@ class StreamingQuerySuite extends

[GitHub] spark issue #10212: [SPARK-12221] add cpu time to metrics

2016-09-20 Thread AmplabJenkins
Github user AmplabJenkins commented on the issue: https://github.com/apache/spark/pull/10212 Test FAILed. Refer to this link for build results (access rights to CI server needed): https://amplab.cs.berkeley.edu/jenkins//job/SparkPullRequestBuilder/65679/ Test FAILed. ---

[GitHub] spark issue #10212: [SPARK-12221] add cpu time to metrics

2016-09-20 Thread AmplabJenkins
Github user AmplabJenkins commented on the issue: https://github.com/apache/spark/pull/10212 Merged build finished. Test FAILed. --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this feature

[GitHub] spark issue #10212: [SPARK-12221] add cpu time to metrics

2016-09-20 Thread SparkQA
Github user SparkQA commented on the issue: https://github.com/apache/spark/pull/10212 **[Test build #65679 has finished](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/65679/consoleFull)** for PR 10212 at commit

[GitHub] spark issue #14659: [SPARK-16757] Set up Spark caller context to HDFS and YA...

2016-09-20 Thread AmplabJenkins
Github user AmplabJenkins commented on the issue: https://github.com/apache/spark/pull/14659 Merged build finished. Test PASSed. --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this feature

[GitHub] spark issue #14659: [SPARK-16757] Set up Spark caller context to HDFS and YA...

2016-09-20 Thread AmplabJenkins
Github user AmplabJenkins commented on the issue: https://github.com/apache/spark/pull/14659 Test PASSed. Refer to this link for build results (access rights to CI server needed): https://amplab.cs.berkeley.edu/jenkins//job/SparkPullRequestBuilder/65677/ Test PASSed. ---

[GitHub] spark pull request #15168: [SPARK-17612][SQL] Support `DESCRIBE table PARTIT...

2016-09-20 Thread dongjoon-hyun
Github user dongjoon-hyun commented on a diff in the pull request: https://github.com/apache/spark/pull/15168#discussion_r79717996 --- Diff: sql/hive/src/test/scala/org/apache/spark/sql/hive/execution/SQLQuerySuite.scala --- @@ -341,6 +342,25 @@ class SQLQuerySuite extends

[GitHub] spark issue #14659: [SPARK-16757] Set up Spark caller context to HDFS and YA...

2016-09-20 Thread SparkQA
Github user SparkQA commented on the issue: https://github.com/apache/spark/pull/14659 **[Test build #65677 has finished](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/65677/consoleFull)** for PR 14659 at commit

[GitHub] spark issue #15159: [SPARK-17605][SPARK_SUBMIT] Add option spark.usePython a...

2016-09-20 Thread felixcheung
Github user felixcheung commented on the issue: https://github.com/apache/spark/pull/15159 Do you have a test or use case that have both Python and R code? I'm not quite sure that actually work.. --- If your project is set up for it, you can reply to this email and have your reply

[GitHub] spark issue #15139: [SPARK-17315][Follow-up][SparkR][ML] Fix print of Kolmog...

2016-09-20 Thread felixcheung
Github user felixcheung commented on the issue: https://github.com/apache/spark/pull/15139 LGTM, @junyangq do you have any comment? --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this

[GitHub] spark pull request #15139: [SPARK-17315][Follow-up][SparkR][ML] Fix print of...

2016-09-20 Thread felixcheung
Github user felixcheung commented on a diff in the pull request: https://github.com/apache/spark/pull/15139#discussion_r79716511 --- Diff: R/pkg/R/mllib.R --- @@ -1398,20 +1398,22 @@ setMethod("summary", signature(object = "KSTest"), distParams <-

[GitHub] spark pull request #15168: [SPARK-17612][SQL] Support `DESCRIBE table PARTIT...

2016-09-20 Thread skambha
Github user skambha commented on a diff in the pull request: https://github.com/apache/spark/pull/15168#discussion_r79716333 --- Diff: sql/hive/src/test/scala/org/apache/spark/sql/hive/execution/SQLQuerySuite.scala --- @@ -341,6 +342,25 @@ class SQLQuerySuite extends QueryTest

[GitHub] spark issue #14818: [SPARK-17157][SPARKR][WIP]: Add multiclass logistic regr...

2016-09-20 Thread felixcheung
Github user felixcheung commented on the issue: https://github.com/apache/spark/pull/14818 thanks - let's review if the name `glmnet` should be used or should this be part of our support for logit --- If your project is set up for it, you can reply to this email and have your reply

[GitHub] spark issue #13680: [SPARK-15962][SQL] Introduce implementation with a dense...

2016-09-20 Thread AmplabJenkins
Github user AmplabJenkins commented on the issue: https://github.com/apache/spark/pull/13680 Merged build finished. Test PASSed. --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this feature

[GitHub] spark issue #13680: [SPARK-15962][SQL] Introduce implementation with a dense...

2016-09-20 Thread AmplabJenkins
Github user AmplabJenkins commented on the issue: https://github.com/apache/spark/pull/13680 Test PASSed. Refer to this link for build results (access rights to CI server needed): https://amplab.cs.berkeley.edu/jenkins//job/SparkPullRequestBuilder/65676/ Test PASSed. ---

[GitHub] spark issue #13680: [SPARK-15962][SQL] Introduce implementation with a dense...

2016-09-20 Thread SparkQA
Github user SparkQA commented on the issue: https://github.com/apache/spark/pull/13680 **[Test build #65676 has finished](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/65676/consoleFull)** for PR 13680 at commit

[GitHub] spark issue #15051: [SPARK-17499][SparkR][ML][MLLib] make the default params...

2016-09-20 Thread felixcheung
Github user felixcheung commented on the issue: https://github.com/apache/spark/pull/15051 could you add a test for passing seed and a test for not passing seed - I'm not sure if we have a good way to check for specific result (likely there is since we choose the seed value) but

[GitHub] spark pull request #15161: [SPARK-17611][yarn][test] Make shuffle service te...

2016-09-20 Thread asfgit
Github user asfgit closed the pull request at: https://github.com/apache/spark/pull/15161 --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this feature enabled and wishes so, or if the feature is

[GitHub] spark issue #15152: [SPARK-17365][Core] Remove/Kill multiple executors toget...

2016-09-20 Thread AmplabJenkins
Github user AmplabJenkins commented on the issue: https://github.com/apache/spark/pull/15152 Test PASSed. Refer to this link for build results (access rights to CI server needed): https://amplab.cs.berkeley.edu/jenkins//job/SparkPullRequestBuilder/65675/ Test PASSed. ---

[GitHub] spark issue #15152: [SPARK-17365][Core] Remove/Kill multiple executors toget...

2016-09-20 Thread AmplabJenkins
Github user AmplabJenkins commented on the issue: https://github.com/apache/spark/pull/15152 Merged build finished. Test PASSed. --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this feature

[GitHub] spark issue #15152: [SPARK-17365][Core] Remove/Kill multiple executors toget...

2016-09-20 Thread SparkQA
Github user SparkQA commented on the issue: https://github.com/apache/spark/pull/15152 **[Test build #65675 has finished](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/65675/consoleFull)** for PR 15152 at commit

[GitHub] spark issue #15161: [SPARK-17611][yarn][test] Make shuffle service test real...

2016-09-20 Thread vanzin
Github user vanzin commented on the issue: https://github.com/apache/spark/pull/15161 Merging to master. --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this feature enabled and wishes so,

[GitHub] spark issue #14444: [SPARK-16839] [SQL] redundant aliases after cleanupAlias...

2016-09-20 Thread eyalfa
Github user eyalfa commented on the issue: https://github.com/apache/spark/pull/1 @cloud-fan, @hvanhovell, test failures assured my concerns about not using the names of unresolved named expressions, it turns out there are cases where the name is available for unresolved

[GitHub] spark pull request #15168: [SPARK-17612][SQL] Support `DESCRIBE table PARTIT...

2016-09-20 Thread dongjoon-hyun
Github user dongjoon-hyun commented on a diff in the pull request: https://github.com/apache/spark/pull/15168#discussion_r79713201 --- Diff: sql/hive/src/test/scala/org/apache/spark/sql/hive/execution/SQLQuerySuite.scala --- @@ -341,6 +342,25 @@ class SQLQuerySuite extends

[GitHub] spark pull request #15168: [SPARK-17612][SQL] Support `DESCRIBE table PARTIT...

2016-09-20 Thread skambha
Github user skambha commented on a diff in the pull request: https://github.com/apache/spark/pull/15168#discussion_r79710335 --- Diff: sql/hive/src/test/scala/org/apache/spark/sql/hive/execution/SQLQuerySuite.scala --- @@ -341,6 +342,25 @@ class SQLQuerySuite extends QueryTest

[GitHub] spark issue #15166: [SPARK-17513][SQL] Make StreamExecution garbage-collect ...

2016-09-20 Thread AmplabJenkins
Github user AmplabJenkins commented on the issue: https://github.com/apache/spark/pull/15166 Merged build finished. Test PASSed. --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this feature

<    1   2   3   4   5   6   >