[GitHub] spark issue #15659: [SPARK-1267][SPARK-18129] Allow PySpark to be pip instal...

2016-11-11 Thread SparkQA
Github user SparkQA commented on the issue: https://github.com/apache/spark/pull/15659 **[Test build #68557 has started](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/68557/consoleFull)** for PR 15659 at commit

[GitHub] spark issue #13837: [SPARK-16126] [SQL] Better Error Message When using Data...

2016-11-11 Thread SparkQA
Github user SparkQA commented on the issue: https://github.com/apache/spark/pull/13837 **[Test build #68556 has started](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/68556/consoleFull)** for PR 13837 at commit

[GitHub] spark pull request #13837: [SPARK-16126] [SQL] Better Error Message When usi...

2016-11-11 Thread gatorsmile
GitHub user gatorsmile reopened a pull request: https://github.com/apache/spark/pull/13837 [SPARK-16126] [SQL] Better Error Message When using DataFrameReader without `path` What changes were proposed in this pull request? When users do not specify the path in

[GitHub] spark pull request #15704: [SPARK-17732][SQL] ALTER TABLE DROP PARTITION sho...

2016-11-11 Thread dongjoon-hyun
Github user dongjoon-hyun commented on a diff in the pull request: https://github.com/apache/spark/pull/15704#discussion_r87688739 --- Diff: sql/core/src/main/scala/org/apache/spark/sql/execution/command/ddl.scala --- @@ -418,27 +419,66 @@ case class

[GitHub] spark issue #15659: [SPARK-1267][SPARK-18129] Allow PySpark to be pip instal...

2016-11-11 Thread holdenk
Github user holdenk commented on the issue: https://github.com/apache/spark/pull/15659 So the simplest thing sounds like updating the error message, for now I'll avoid changing the maven build since that might have some unintended collateral effects and this change is currently

[GitHub] spark pull request #15563: [SPARK-16759][CORE] Add a configuration property ...

2016-11-11 Thread rxin
Github user rxin commented on a diff in the pull request: https://github.com/apache/spark/pull/15563#discussion_r87688574 --- Diff: core/src/main/scala/org/apache/spark/internal/config/package.scala --- @@ -207,6 +207,10 @@ package object config { .booleanConf

[GitHub] spark issue #15717: [SPARK-17910][SQL] Allow users to update the comment of ...

2016-11-11 Thread gatorsmile
Github user gatorsmile commented on the issue: https://github.com/apache/spark/pull/15717 Any update on this PR? --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this feature enabled and

[GitHub] spark issue #15854: [SPARK-18415] [SQL] Weird Plan Output when CTE used in R...

2016-11-11 Thread SparkQA
Github user SparkQA commented on the issue: https://github.com/apache/spark/pull/15854 **[Test build #68555 has started](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/68555/consoleFull)** for PR 15854 at commit

[GitHub] spark pull request #15704: [SPARK-17732][SQL] ALTER TABLE DROP PARTITION sho...

2016-11-11 Thread viirya
Github user viirya commented on a diff in the pull request: https://github.com/apache/spark/pull/15704#discussion_r87688495 --- Diff: sql/core/src/main/scala/org/apache/spark/sql/execution/command/ddl.scala --- @@ -418,27 +419,66 @@ case class AlterTableRenamePartitionCommand(

[GitHub] spark pull request #15854: [SPARK-18415] [SQL] Weird Plan Output when CTE us...

2016-11-11 Thread gatorsmile
Github user gatorsmile commented on a diff in the pull request: https://github.com/apache/spark/pull/15854#discussion_r87688482 --- Diff: sql/core/src/main/scala/org/apache/spark/sql/execution/command/views.scala --- @@ -33,7 +33,9 @@ import

[GitHub] spark issue #15659: [SPARK-1267][SPARK-18129] Allow PySpark to be pip instal...

2016-11-11 Thread AmplabJenkins
Github user AmplabJenkins commented on the issue: https://github.com/apache/spark/pull/15659 Merged build finished. Test PASSed. --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this feature

[GitHub] spark issue #15659: [SPARK-1267][SPARK-18129] Allow PySpark to be pip instal...

2016-11-11 Thread AmplabJenkins
Github user AmplabJenkins commented on the issue: https://github.com/apache/spark/pull/15659 Test PASSed. Refer to this link for build results (access rights to CI server needed): https://amplab.cs.berkeley.edu/jenkins//job/SparkPullRequestBuilder/68554/ Test PASSed. ---

[GitHub] spark issue #15659: [SPARK-1267][SPARK-18129] Allow PySpark to be pip instal...

2016-11-11 Thread SparkQA
Github user SparkQA commented on the issue: https://github.com/apache/spark/pull/15659 **[Test build #68554 has finished](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/68554/consoleFull)** for PR 15659 at commit

[GitHub] spark pull request #15563: [SPARK-16759][CORE] Add a configuration property ...

2016-11-11 Thread weiqingy
Github user weiqingy commented on a diff in the pull request: https://github.com/apache/spark/pull/15563#discussion_r87688398 --- Diff: core/src/main/scala/org/apache/spark/util/Utils.scala --- @@ -2578,26 +2579,38 @@ private[util] object CallerContext extends Logging { *

[GitHub] spark pull request #15563: [SPARK-16759][CORE] Add a configuration property ...

2016-11-11 Thread weiqingy
Github user weiqingy commented on a diff in the pull request: https://github.com/apache/spark/pull/15563#discussion_r87688391 --- Diff: core/src/main/scala/org/apache/spark/internal/config/package.scala --- @@ -207,6 +207,10 @@ package object config { .booleanConf

[GitHub] spark issue #15659: [SPARK-1267][SPARK-18129] Allow PySpark to be pip instal...

2016-11-11 Thread AmplabJenkins
Github user AmplabJenkins commented on the issue: https://github.com/apache/spark/pull/15659 Merged build finished. Test PASSed. --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this feature

[GitHub] spark issue #15659: [SPARK-1267][SPARK-18129] Allow PySpark to be pip instal...

2016-11-11 Thread AmplabJenkins
Github user AmplabJenkins commented on the issue: https://github.com/apache/spark/pull/15659 Test PASSed. Refer to this link for build results (access rights to CI server needed): https://amplab.cs.berkeley.edu/jenkins//job/SparkPullRequestBuilder/68553/ Test PASSed. ---

[GitHub] spark issue #15659: [SPARK-1267][SPARK-18129] Allow PySpark to be pip instal...

2016-11-11 Thread SparkQA
Github user SparkQA commented on the issue: https://github.com/apache/spark/pull/15659 **[Test build #68553 has finished](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/68553/consoleFull)** for PR 15659 at commit

[GitHub] spark issue #15860: [SPARK-18418] Fix flags for make_binary_release for hado...

2016-11-11 Thread AmplabJenkins
Github user AmplabJenkins commented on the issue: https://github.com/apache/spark/pull/15860 Merged build finished. Test PASSed. --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this feature

[GitHub] spark issue #15860: [SPARK-18418] Fix flags for make_binary_release for hado...

2016-11-11 Thread AmplabJenkins
Github user AmplabJenkins commented on the issue: https://github.com/apache/spark/pull/15860 Test PASSed. Refer to this link for build results (access rights to CI server needed): https://amplab.cs.berkeley.edu/jenkins//job/SparkPullRequestBuilder/68552/ Test PASSed. ---

[GitHub] spark issue #15860: [SPARK-18418] Fix flags for make_binary_release for hado...

2016-11-11 Thread SparkQA
Github user SparkQA commented on the issue: https://github.com/apache/spark/pull/15860 **[Test build #68552 has finished](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/68552/consoleFull)** for PR 15860 at commit

[GitHub] spark issue #15659: [SPARK-1267][SPARK-18129] Allow PySpark to be pip instal...

2016-11-11 Thread minrk
Github user minrk commented on the issue: https://github.com/apache/spark/pull/15659 > Any ideas on how we could follow up and support that install pattern? To go all the way to the two commands I expected to work based on Python tradition: ```bash ./build/mvn

[GitHub] spark pull request #15854: [SPARK-18415] [SQL] Weird Plan Output when CTE us...

2016-11-11 Thread rxin
Github user rxin commented on a diff in the pull request: https://github.com/apache/spark/pull/15854#discussion_r87687899 --- Diff: sql/core/src/main/scala/org/apache/spark/sql/execution/command/views.scala --- @@ -33,7 +33,9 @@ import org.apache.spark.sql.types.MetadataBuilder

[GitHub] spark pull request #15563: [SPARK-16759][CORE] Add a configuration property ...

2016-11-11 Thread rxin
Github user rxin commented on a diff in the pull request: https://github.com/apache/spark/pull/15563#discussion_r87687846 --- Diff: core/src/main/scala/org/apache/spark/util/Utils.scala --- @@ -2578,26 +2579,38 @@ private[util] object CallerContext extends Logging { * @param

[GitHub] spark issue #15659: [SPARK-1267][SPARK-18129] Allow PySpark to be pip instal...

2016-11-11 Thread holdenk
Github user holdenk commented on the issue: https://github.com/apache/spark/pull/15659 Thanks @JoshRosen for taking time to review this. The factoured out fix is at https://github.com/apache/spark/pull/15860 :) --- If your project is set up for it, you can reply to this email and

[GitHub] spark issue #15763: [SPARK-17348][SQL] Incorrect results from subquery trans...

2016-11-11 Thread AmplabJenkins
Github user AmplabJenkins commented on the issue: https://github.com/apache/spark/pull/15763 Test PASSed. Refer to this link for build results (access rights to CI server needed): https://amplab.cs.berkeley.edu/jenkins//job/SparkPullRequestBuilder/68551/ Test PASSed. ---

[GitHub] spark issue #15763: [SPARK-17348][SQL] Incorrect results from subquery trans...

2016-11-11 Thread AmplabJenkins
Github user AmplabJenkins commented on the issue: https://github.com/apache/spark/pull/15763 Merged build finished. Test PASSed. --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this feature

[GitHub] spark issue #15763: [SPARK-17348][SQL] Incorrect results from subquery trans...

2016-11-11 Thread SparkQA
Github user SparkQA commented on the issue: https://github.com/apache/spark/pull/15763 **[Test build #68551 has finished](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/68551/consoleFull)** for PR 15763 at commit

[GitHub] spark issue #15704: [SPARK-17732][SQL] ALTER TABLE DROP PARTITION should sup...

2016-11-11 Thread AmplabJenkins
Github user AmplabJenkins commented on the issue: https://github.com/apache/spark/pull/15704 Merged build finished. Test PASSed. --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this feature

[GitHub] spark issue #15704: [SPARK-17732][SQL] ALTER TABLE DROP PARTITION should sup...

2016-11-11 Thread AmplabJenkins
Github user AmplabJenkins commented on the issue: https://github.com/apache/spark/pull/15704 Test PASSed. Refer to this link for build results (access rights to CI server needed): https://amplab.cs.berkeley.edu/jenkins//job/SparkPullRequestBuilder/68550/ Test PASSed. ---

[GitHub] spark issue #15704: [SPARK-17732][SQL] ALTER TABLE DROP PARTITION should sup...

2016-11-11 Thread SparkQA
Github user SparkQA commented on the issue: https://github.com/apache/spark/pull/15704 **[Test build #68550 has finished](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/68550/consoleFull)** for PR 15704 at commit

[GitHub] spark issue #15659: [SPARK-1267][SPARK-18129] Allow PySpark to be pip instal...

2016-11-11 Thread SparkQA
Github user SparkQA commented on the issue: https://github.com/apache/spark/pull/15659 **[Test build #68554 has started](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/68554/consoleFull)** for PR 15659 at commit

[GitHub] spark issue #15659: [SPARK-1267][SPARK-18129] Allow PySpark to be pip instal...

2016-11-11 Thread holdenk
Github user holdenk commented on the issue: https://github.com/apache/spark/pull/15659 @minrk thanks :) Any ideas on how we could follow up and support that install pattern? --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as

[GitHub] spark issue #15659: [SPARK-1267][SPARK-18129] Allow PySpark to be pip instal...

2016-11-11 Thread SparkQA
Github user SparkQA commented on the issue: https://github.com/apache/spark/pull/15659 **[Test build #68553 has started](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/68553/consoleFull)** for PR 15659 at commit

[GitHub] spark pull request #15659: [SPARK-1267][SPARK-18129] Allow PySpark to be pip...

2016-11-11 Thread holdenk
Github user holdenk commented on a diff in the pull request: https://github.com/apache/spark/pull/15659#discussion_r87686589 --- Diff: pom.xml --- @@ -26,6 +26,7 @@ org.apache.spark spark-parent_2.11 + --- End diff -- @JoshRosen so we

[GitHub] spark issue #15860: [SPARK-18418] Fix flags for make_binary_release for hado...

2016-11-11 Thread SparkQA
Github user SparkQA commented on the issue: https://github.com/apache/spark/pull/15860 **[Test build #68552 has started](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/68552/consoleFull)** for PR 15860 at commit

[GitHub] spark issue #15840: [SPARK-18398][SQL] Fix nullabilities of MapObjects and o...

2016-11-11 Thread kiszk
Github user kiszk commented on the issue: https://github.com/apache/spark/pull/15840 I agree that this case is fine. --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this feature enabled and

[GitHub] spark issue #15659: [SPARK-1267][SPARK-18129] Allow PySpark to be pip instal...

2016-11-11 Thread holdenk
Github user holdenk commented on the issue: https://github.com/apache/spark/pull/15659 @joshrosen Is `shellcheck` intended to be part of our standard linting? --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your

[GitHub] spark pull request #15659: [SPARK-1267][SPARK-18129] Allow PySpark to be pip...

2016-11-11 Thread holdenk
Github user holdenk commented on a diff in the pull request: https://github.com/apache/spark/pull/15659#discussion_r87686249 --- Diff: dev/create-release/release-build.sh --- @@ -187,10 +208,10 @@ if [[ "$1" == "package" ]]; then # We increment the Zinc port each time to

[GitHub] spark pull request #15860: [SPARK-18418] Fix flags for make_binary_release f...

2016-11-11 Thread holdenk
GitHub user holdenk opened a pull request: https://github.com/apache/spark/pull/15860 [SPARK-18418] Fix flags for make_binary_release for hadoop profile ## What changes were proposed in this pull request? Fix the flags used to specify the hadoop version ## How was

[GitHub] spark issue #15859: [SPARK-18416][Structured Streaming] Fixed temp file leak...

2016-11-11 Thread AmplabJenkins
Github user AmplabJenkins commented on the issue: https://github.com/apache/spark/pull/15859 Test PASSed. Refer to this link for build results (access rights to CI server needed): https://amplab.cs.berkeley.edu/jenkins//job/SparkPullRequestBuilder/68548/ Test PASSed. ---

[GitHub] spark issue #15763: [SPARK-17348][SQL] Incorrect results from subquery trans...

2016-11-11 Thread SparkQA
Github user SparkQA commented on the issue: https://github.com/apache/spark/pull/15763 **[Test build #68551 has started](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/68551/consoleFull)** for PR 15763 at commit

[GitHub] spark issue #15859: [SPARK-18416][Structured Streaming] Fixed temp file leak...

2016-11-11 Thread AmplabJenkins
Github user AmplabJenkins commented on the issue: https://github.com/apache/spark/pull/15859 Merged build finished. Test PASSed. --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this feature

[GitHub] spark issue #15859: [SPARK-18416][Structured Streaming] Fixed temp file leak...

2016-11-11 Thread SparkQA
Github user SparkQA commented on the issue: https://github.com/apache/spark/pull/15859 **[Test build #68548 has finished](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/68548/consoleFull)** for PR 15859 at commit

[GitHub] spark issue #15859: [SPARK-18416][Structured Streaming] Fixed temp file leak...

2016-11-11 Thread AmplabJenkins
Github user AmplabJenkins commented on the issue: https://github.com/apache/spark/pull/15859 Test PASSed. Refer to this link for build results (access rights to CI server needed): https://amplab.cs.berkeley.edu/jenkins//job/SparkPullRequestBuilder/68547/ Test PASSed. ---

[GitHub] spark issue #15859: [SPARK-18416][Structured Streaming] Fixed temp file leak...

2016-11-11 Thread AmplabJenkins
Github user AmplabJenkins commented on the issue: https://github.com/apache/spark/pull/15859 Merged build finished. Test PASSed. --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this feature

[GitHub] spark issue #15859: [SPARK-18416][Structured Streaming] Fixed temp file leak...

2016-11-11 Thread AmplabJenkins
Github user AmplabJenkins commented on the issue: https://github.com/apache/spark/pull/15859 Test PASSed. Refer to this link for build results (access rights to CI server needed): https://amplab.cs.berkeley.edu/jenkins//job/SparkPullRequestBuilder/68549/ Test PASSed. ---

[GitHub] spark issue #15859: [SPARK-18416][Structured Streaming] Fixed temp file leak...

2016-11-11 Thread AmplabJenkins
Github user AmplabJenkins commented on the issue: https://github.com/apache/spark/pull/15859 Merged build finished. Test PASSed. --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this feature

[GitHub] spark issue #15859: [SPARK-18416][Structured Streaming] Fixed temp file leak...

2016-11-11 Thread SparkQA
Github user SparkQA commented on the issue: https://github.com/apache/spark/pull/15859 **[Test build #68547 has finished](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/68547/consoleFull)** for PR 15859 at commit

[GitHub] spark issue #15859: [SPARK-18416][Structured Streaming] Fixed temp file leak...

2016-11-11 Thread SparkQA
Github user SparkQA commented on the issue: https://github.com/apache/spark/pull/15859 **[Test build #68549 has finished](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/68549/consoleFull)** for PR 15859 at commit

[GitHub] spark issue #15854: [SPARK-18415] [SQL] Weird Plan Output when CTE used in R...

2016-11-11 Thread gatorsmile
Github user gatorsmile commented on the issue: https://github.com/apache/spark/pull/15854 @hvanhovell The PR description is updated. How about the latest change? --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your

[GitHub] spark issue #15854: [SPARK-18415] [SQL] Weird Plan Output when CTE used in R...

2016-11-11 Thread AmplabJenkins
Github user AmplabJenkins commented on the issue: https://github.com/apache/spark/pull/15854 Test PASSed. Refer to this link for build results (access rights to CI server needed): https://amplab.cs.berkeley.edu/jenkins//job/SparkPullRequestBuilder/68544/ Test PASSed. ---

[GitHub] spark issue #15838: [SPARK-18396][HISTORYSERVER]"Duration" column makes sear...

2016-11-11 Thread WangTaoTheTonic
Github user WangTaoTheTonic commented on the issue: https://github.com/apache/spark/pull/15838 Is it good to go? @srowen @vanzin --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this feature

[GitHub] spark issue #15854: [SPARK-18415] [SQL] Weird Plan Output when CTE used in R...

2016-11-11 Thread AmplabJenkins
Github user AmplabJenkins commented on the issue: https://github.com/apache/spark/pull/15854 Merged build finished. Test PASSed. --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this feature

[GitHub] spark issue #15854: [SPARK-18415] [SQL] Weird Plan Output when CTE used in R...

2016-11-11 Thread SparkQA
Github user SparkQA commented on the issue: https://github.com/apache/spark/pull/15854 **[Test build #68544 has finished](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/68544/consoleFull)** for PR 15854 at commit

[GitHub] spark issue #15840: [SPARK-18398][SQL] Fix nullabilities of MapObjects and o...

2016-11-11 Thread ueshin
Github user ueshin commented on the issue: https://github.com/apache/spark/pull/15840 @kiszk I have not checked all the case yet but I think the case that we need to generate else-clause doesn't match the case we discuss here. Of course we can add the method you suggested when we

[GitHub] spark issue #15859: [SPARK-18416][Structured Streaming] Fixed temp file leak...

2016-11-11 Thread AmplabJenkins
Github user AmplabJenkins commented on the issue: https://github.com/apache/spark/pull/15859 Test FAILed. Refer to this link for build results (access rights to CI server needed): https://amplab.cs.berkeley.edu/jenkins//job/SparkPullRequestBuilder/68546/ Test FAILed. ---

[GitHub] spark issue #15859: [SPARK-18416][Structured Streaming] Fixed temp file leak...

2016-11-11 Thread AmplabJenkins
Github user AmplabJenkins commented on the issue: https://github.com/apache/spark/pull/15859 Merged build finished. Test FAILed. --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this feature

[GitHub] spark issue #15859: [SPARK-18416][Structured Streaming] Fixed temp file leak...

2016-11-11 Thread SparkQA
Github user SparkQA commented on the issue: https://github.com/apache/spark/pull/15859 **[Test build #68546 has finished](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/68546/consoleFull)** for PR 15859 at commit

[GitHub] spark pull request #13909: [SPARK-16213][SQL] Reduce runtime overhead of a p...

2016-11-11 Thread viirya
Github user viirya commented on a diff in the pull request: https://github.com/apache/spark/pull/13909#discussion_r87685165 --- Diff: sql/catalyst/src/test/scala/org/apache/spark/sql/catalyst/expressions/ExpressionEvalHelper.scala --- @@ -43,11 +43,38 @@ trait

[GitHub] spark issue #15563: [SPARK-16759][CORE] Add a configuration property to pass...

2016-11-11 Thread weiqingy
Github user weiqingy commented on the issue: https://github.com/apache/spark/pull/15563 Thanks a lot for the review, @tgravescs @mridulm --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this

[GitHub] spark issue #15704: [SPARK-17732][SQL] ALTER TABLE DROP PARTITION should sup...

2016-11-11 Thread SparkQA
Github user SparkQA commented on the issue: https://github.com/apache/spark/pull/15704 **[Test build #68550 has started](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/68550/consoleFull)** for PR 15704 at commit

[GitHub] spark pull request #15704: [SPARK-17732][SQL] ALTER TABLE DROP PARTITION sho...

2016-11-11 Thread dongjoon-hyun
Github user dongjoon-hyun commented on a diff in the pull request: https://github.com/apache/spark/pull/15704#discussion_r87684919 --- Diff: sql/hive/src/test/scala/org/apache/spark/sql/hive/execution/HiveDDLSuite.scala --- @@ -225,6 +226,111 @@ class HiveDDLSuite }

[GitHub] spark pull request #15563: [SPARK-16759][CORE] Add a configuration property ...

2016-11-11 Thread asfgit
Github user asfgit closed the pull request at: https://github.com/apache/spark/pull/15563 --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this feature enabled and wishes so, or if the feature is

[GitHub] spark issue #15563: [SPARK-16759][CORE] Add a configuration property to pass...

2016-11-11 Thread mridulm
Github user mridulm commented on the issue: https://github.com/apache/spark/pull/15563 Merging into master --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this feature enabled and wishes so,

[GitHub] spark issue #15856: [SPARK-17982][SQL][BACKPORT-2.0] SQLBuilder should wrap ...

2016-11-11 Thread dongjoon-hyun
Github user dongjoon-hyun commented on the issue: https://github.com/apache/spark/pull/15856 Thank you! --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this feature enabled and wishes so, or

[GitHub] spark pull request #15856: [SPARK-17982][SQL][BACKPORT-2.0] SQLBuilder shoul...

2016-11-11 Thread dongjoon-hyun
Github user dongjoon-hyun closed the pull request at: https://github.com/apache/spark/pull/15856 --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this feature enabled and wishes so, or if the

[GitHub] spark issue #15857: [SPARK-18300][SQL] Do not apply foldable propagation wit...

2016-11-11 Thread AmplabJenkins
Github user AmplabJenkins commented on the issue: https://github.com/apache/spark/pull/15857 Merged build finished. Test PASSed. --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this feature

[GitHub] spark issue #15857: [SPARK-18300][SQL] Do not apply foldable propagation wit...

2016-11-11 Thread AmplabJenkins
Github user AmplabJenkins commented on the issue: https://github.com/apache/spark/pull/15857 Test PASSed. Refer to this link for build results (access rights to CI server needed): https://amplab.cs.berkeley.edu/jenkins//job/SparkPullRequestBuilder/68543/ Test PASSed. ---

[GitHub] spark issue #15857: [SPARK-18300][SQL] Do not apply foldable propagation wit...

2016-11-11 Thread SparkQA
Github user SparkQA commented on the issue: https://github.com/apache/spark/pull/15857 **[Test build #68543 has finished](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/68543/consoleFull)** for PR 15857 at commit

[GitHub] spark pull request #13909: [SPARK-16213][SQL] Reduce runtime overhead of a p...

2016-11-11 Thread viirya
Github user viirya commented on a diff in the pull request: https://github.com/apache/spark/pull/13909#discussion_r87684528 --- Diff: sql/catalyst/src/main/scala/org/apache/spark/sql/catalyst/CatalystTypeConverters.scala --- @@ -421,6 +421,17 @@ object CatalystTypeConverters {

[GitHub] spark issue #15563: [SPARK-16759][CORE] Add a configuration property to pass...

2016-11-11 Thread mridulm
Github user mridulm commented on the issue: https://github.com/apache/spark/pull/15563 Looks good to me --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this feature enabled and wishes so, or

[GitHub] spark pull request #15704: [SPARK-17732][SQL] ALTER TABLE DROP PARTITION sho...

2016-11-11 Thread viirya
Github user viirya commented on a diff in the pull request: https://github.com/apache/spark/pull/15704#discussion_r87683697 --- Diff: sql/hive/src/test/scala/org/apache/spark/sql/hive/execution/HiveDDLSuite.scala --- @@ -225,6 +226,111 @@ class HiveDDLSuite } }

[GitHub] spark pull request #15704: [SPARK-17732][SQL] ALTER TABLE DROP PARTITION sho...

2016-11-11 Thread viirya
Github user viirya commented on a diff in the pull request: https://github.com/apache/spark/pull/15704#discussion_r87683492 --- Diff: sql/core/src/main/scala/org/apache/spark/sql/execution/command/ddl.scala --- @@ -418,27 +419,66 @@ case class AlterTableRenamePartitionCommand(

[GitHub] spark issue #15593: [SPARK-18060][ML] Avoid unnecessary computation for MLOR

2016-11-11 Thread sethah
Github user sethah commented on the issue: https://github.com/apache/spark/pull/15593 Thanks @dbtsai! --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this feature enabled and wishes so, or

[GitHub] spark issue #15843: [SPARK-18274][ML][PYSPARK] Memory leak in PySpark JavaWr...

2016-11-11 Thread viirya
Github user viirya commented on the issue: https://github.com/apache/spark/pull/15843 @jkbradley Sounds making sense more. --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this feature

[GitHub] spark pull request #15593: [SPARK-18060][ML] Avoid unnecessary computation f...

2016-11-11 Thread asfgit
Github user asfgit closed the pull request at: https://github.com/apache/spark/pull/15593 --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this feature enabled and wishes so, or if the feature is

[GitHub] spark issue #15593: [SPARK-18060][ML] Avoid unnecessary computation for MLOR

2016-11-11 Thread dbtsai
Github user dbtsai commented on the issue: https://github.com/apache/spark/pull/15593 Thanks all for working on this PR. I merged this into master, and I'll create a followup task and PR to handle the abstraction together with handling the smoothing in the initialization of

[GitHub] spark issue #15856: [SPARK-17982][SQL][BACKPORT-2.0] SQLBuilder should wrap ...

2016-11-11 Thread gatorsmile
Github user gatorsmile commented on the issue: https://github.com/apache/spark/pull/15856 @dongjoon-hyun Thanks! It has been merged. Could you close it? --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project

[GitHub] spark issue #15856: [SPARK-17982][SQL][BACKPORT-2.0] SQLBuilder should wrap ...

2016-11-11 Thread AmplabJenkins
Github user AmplabJenkins commented on the issue: https://github.com/apache/spark/pull/15856 Merged build finished. Test PASSed. --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this feature

[GitHub] spark issue #15856: [SPARK-17982][SQL][BACKPORT-2.0] SQLBuilder should wrap ...

2016-11-11 Thread AmplabJenkins
Github user AmplabJenkins commented on the issue: https://github.com/apache/spark/pull/15856 Test PASSed. Refer to this link for build results (access rights to CI server needed): https://amplab.cs.berkeley.edu/jenkins//job/SparkPullRequestBuilder/68542/ Test PASSed. ---

[GitHub] spark issue #15856: [SPARK-17982][SQL][BACKPORT-2.0] SQLBuilder should wrap ...

2016-11-11 Thread SparkQA
Github user SparkQA commented on the issue: https://github.com/apache/spark/pull/15856 **[Test build #68542 has finished](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/68542/consoleFull)** for PR 15856 at commit

[GitHub] spark issue #15859: [SPARK-18416][Structured Streaming] Fixed temp file leak...

2016-11-11 Thread SparkQA
Github user SparkQA commented on the issue: https://github.com/apache/spark/pull/15859 **[Test build #68549 has started](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/68549/consoleFull)** for PR 15859 at commit

[GitHub] spark issue #15859: [SPARK-18416][Structured Streaming] Fixed temp file leak...

2016-11-11 Thread SparkQA
Github user SparkQA commented on the issue: https://github.com/apache/spark/pull/15859 **[Test build #68548 has started](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/68548/consoleFull)** for PR 15859 at commit

[GitHub] spark issue #15853: [MINOR][SS] a minor refactor of getOffset in KafkaSource

2016-11-11 Thread AmplabJenkins
Github user AmplabJenkins commented on the issue: https://github.com/apache/spark/pull/15853 Merged build finished. Test PASSed. --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this feature

[GitHub] spark issue #15853: [MINOR][SS] a minor refactor of getOffset in KafkaSource

2016-11-11 Thread AmplabJenkins
Github user AmplabJenkins commented on the issue: https://github.com/apache/spark/pull/15853 Test PASSed. Refer to this link for build results (access rights to CI server needed): https://amplab.cs.berkeley.edu/jenkins//job/SparkPullRequestBuilder/68545/ Test PASSed. ---

[GitHub] spark issue #15853: [MINOR][SS] a minor refactor of getOffset in KafkaSource

2016-11-11 Thread SparkQA
Github user SparkQA commented on the issue: https://github.com/apache/spark/pull/15853 **[Test build #68545 has finished](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/68545/consoleFull)** for PR 15853 at commit

[GitHub] spark issue #15859: [SPARK-18416][Structured Streaming] Fixed temp file leak...

2016-11-11 Thread SparkQA
Github user SparkQA commented on the issue: https://github.com/apache/spark/pull/15859 **[Test build #68547 has started](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/68547/consoleFull)** for PR 15859 at commit

[GitHub] spark issue #15859: [SPARK-18416][Structured Streaming] Fixed temp file leak...

2016-11-11 Thread zsxwing
Github user zsxwing commented on the issue: https://github.com/apache/spark/pull/15859 LGTM pending tests. --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this feature enabled and wishes so,

[GitHub] spark issue #15859: [SPARK-18416][Structured Streaming] Fixed temp file leak...

2016-11-11 Thread SparkQA
Github user SparkQA commented on the issue: https://github.com/apache/spark/pull/15859 **[Test build #68546 has started](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/68546/consoleFull)** for PR 15859 at commit

[GitHub] spark pull request #15859: Fixed state store bug

2016-11-11 Thread tdas
GitHub user tdas opened a pull request: https://github.com/apache/spark/pull/15859 Fixed state store bug ## What changes were proposed in this pull request? StateStore.get() causes temporary files to be created immediately, even if the store is not used to make updates for

[GitHub] spark issue #15855: [SPARK-16808][Core] History Server main page does not ho...

2016-11-11 Thread AmplabJenkins
Github user AmplabJenkins commented on the issue: https://github.com/apache/spark/pull/15855 Test PASSed. Refer to this link for build results (access rights to CI server needed): https://amplab.cs.berkeley.edu/jenkins//job/SparkPullRequestBuilder/68540/ Test PASSed. ---

[GitHub] spark issue #15855: [SPARK-16808][Core] History Server main page does not ho...

2016-11-11 Thread AmplabJenkins
Github user AmplabJenkins commented on the issue: https://github.com/apache/spark/pull/15855 Merged build finished. Test PASSed. --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this feature

[GitHub] spark issue #15855: [SPARK-16808][Core] History Server main page does not ho...

2016-11-11 Thread SparkQA
Github user SparkQA commented on the issue: https://github.com/apache/spark/pull/15855 **[Test build #68540 has finished](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/68540/consoleFull)** for PR 15855 at commit

[GitHub] spark issue #15853: [MINOR][SS] a minor refactor of getOffset in KafkaSource

2016-11-11 Thread SparkQA
Github user SparkQA commented on the issue: https://github.com/apache/spark/pull/15853 **[Test build #68545 has started](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/68545/consoleFull)** for PR 15853 at commit

[GitHub] spark issue #15854: [SPARK-18415] [SQL] Weird Plan Output when CTE used in R...

2016-11-11 Thread SparkQA
Github user SparkQA commented on the issue: https://github.com/apache/spark/pull/15854 **[Test build #68544 has started](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/68544/consoleFull)** for PR 15854 at commit

[GitHub] spark pull request #15659: [SPARK-1267][SPARK-18129] Allow PySpark to be pip...

2016-11-11 Thread JoshRosen
Github user JoshRosen commented on a diff in the pull request: https://github.com/apache/spark/pull/15659#discussion_r87678827 --- Diff: dev/run-pip-tests-2 --- @@ -0,0 +1,105 @@ +#!/usr/bin/env bash + +# +# Licensed to the Apache Software Foundation (ASF) under one

[GitHub] spark pull request #15659: [SPARK-1267][SPARK-18129] Allow PySpark to be pip...

2016-11-11 Thread JoshRosen
Github user JoshRosen commented on a diff in the pull request: https://github.com/apache/spark/pull/15659#discussion_r87679919 --- Diff: dev/create-release/release-build.sh --- @@ -187,10 +208,10 @@ if [[ "$1" == "package" ]]; then # We increment the Zinc port each time to

[GitHub] spark pull request #15659: [SPARK-1267][SPARK-18129] Allow PySpark to be pip...

2016-11-11 Thread JoshRosen
Github user JoshRosen commented on a diff in the pull request: https://github.com/apache/spark/pull/15659#discussion_r87678482 --- Diff: dev/run-pip-tests --- @@ -0,0 +1,35 @@ +#!/usr/bin/env bash + +# +# Licensed to the Apache Software Foundation (ASF) under one or

[GitHub] spark pull request #15659: [SPARK-1267][SPARK-18129] Allow PySpark to be pip...

2016-11-11 Thread JoshRosen
Github user JoshRosen commented on a diff in the pull request: https://github.com/apache/spark/pull/15659#discussion_r87677806 --- Diff: bin/beeline --- @@ -25,7 +25,7 @@ set -o posix # Figure out if SPARK_HOME is set if [ -z "${SPARK_HOME}" ]; then - export

  1   2   3   4   >