[GitHub] spark issue #14279: [SPARK-16216][SQL] Write Timestamp and Date in ISO 8601 ...

2016-07-20 Thread AmplabJenkins
Github user AmplabJenkins commented on the issue: https://github.com/apache/spark/pull/14279 Merged build finished. Test PASSed. --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this feature

[GitHub] spark issue #14279: [SPARK-16216][SQL] Write Timestamp and Date in ISO 8601 ...

2016-07-20 Thread AmplabJenkins
Github user AmplabJenkins commented on the issue: https://github.com/apache/spark/pull/14279 Test PASSed. Refer to this link for build results (access rights to CI server needed): https://amplab.cs.berkeley.edu/jenkins//job/SparkPullRequestBuilder/62597/ Test PASSed. ---

[GitHub] spark issue #14279: [SPARK-16216][SQL] Write Timestamp and Date in ISO 8601 ...

2016-07-20 Thread SparkQA
Github user SparkQA commented on the issue: https://github.com/apache/spark/pull/14279 **[Test build #62597 has finished](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/62597/consoleFull)** for PR 14279 at commit

[GitHub] spark issue #13893: [SPARK-14172][SQL] Hive table partition predicate not pa...

2016-07-20 Thread AmplabJenkins
Github user AmplabJenkins commented on the issue: https://github.com/apache/spark/pull/13893 Merged build finished. Test PASSed. --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this feature

[GitHub] spark issue #13893: [SPARK-14172][SQL] Hive table partition predicate not pa...

2016-07-20 Thread AmplabJenkins
Github user AmplabJenkins commented on the issue: https://github.com/apache/spark/pull/13893 Test PASSed. Refer to this link for build results (access rights to CI server needed): https://amplab.cs.berkeley.edu/jenkins//job/SparkPullRequestBuilder/62596/ Test PASSed. ---

[GitHub] spark issue #13893: [SPARK-14172][SQL] Hive table partition predicate not pa...

2016-07-20 Thread SparkQA
Github user SparkQA commented on the issue: https://github.com/apache/spark/pull/13893 **[Test build #62596 has finished](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/62596/consoleFull)** for PR 13893 at commit

[GitHub] spark pull request #14277: [SPARK-16640][SQL] Add codegen for Elt function

2016-07-20 Thread cloud-fan
Github user cloud-fan commented on a diff in the pull request: https://github.com/apache/spark/pull/14277#discussion_r71512431 --- Diff: sql/catalyst/src/main/scala/org/apache/spark/sql/catalyst/expressions/stringExpressions.scala --- @@ -204,6 +204,29 @@ case class Elt(children:

[GitHub] spark pull request #14277: [SPARK-16640][SQL] Add codegen for Elt function

2016-07-20 Thread cloud-fan
Github user cloud-fan commented on a diff in the pull request: https://github.com/apache/spark/pull/14277#discussion_r71511742 --- Diff: sql/catalyst/src/main/scala/org/apache/spark/sql/catalyst/expressions/stringExpressions.scala --- @@ -204,6 +204,29 @@ case class Elt(children:

[GitHub] spark pull request #14277: [SPARK-16640][SQL] Add codegen for Elt function

2016-07-20 Thread cloud-fan
Github user cloud-fan commented on a diff in the pull request: https://github.com/apache/spark/pull/14277#discussion_r71511689 --- Diff: sql/catalyst/src/main/scala/org/apache/spark/sql/catalyst/expressions/stringExpressions.scala --- @@ -204,6 +204,29 @@ case class Elt(children:

[GitHub] spark issue #12896: [SPARK-14489][ML][PYSPARK] ALS unknown user/item predict...

2016-07-20 Thread SparkQA
Github user SparkQA commented on the issue: https://github.com/apache/spark/pull/12896 **[Test build #62599 has started](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/62599/consoleFull)** for PR 12896 at commit

[GitHub] spark pull request #14240: [SPARK-16594] [SQL] Remove Physical Plan Differen...

2016-07-20 Thread cloud-fan
Github user cloud-fan commented on a diff in the pull request: https://github.com/apache/spark/pull/14240#discussion_r71506928 --- Diff: sql/core/src/test/scala/org/apache/spark/sql/sources/PrunedScanSuite.scala --- @@ -114,16 +114,15 @@ class PrunedScanSuite extends

[GitHub] spark issue #12896: [SPARK-14489][ML][PYSPARK] ALS unknown user/item predict...

2016-07-20 Thread AmplabJenkins
Github user AmplabJenkins commented on the issue: https://github.com/apache/spark/pull/12896 Test PASSed. Refer to this link for build results (access rights to CI server needed): https://amplab.cs.berkeley.edu/jenkins//job/SparkPullRequestBuilder/62598/ Test PASSed. ---

[GitHub] spark issue #12896: [SPARK-14489][ML][PYSPARK] ALS unknown user/item predict...

2016-07-20 Thread AmplabJenkins
Github user AmplabJenkins commented on the issue: https://github.com/apache/spark/pull/12896 Merged build finished. Test PASSed. --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this feature

[GitHub] spark issue #12896: [SPARK-14489][ML][PYSPARK] ALS unknown user/item predict...

2016-07-20 Thread SparkQA
Github user SparkQA commented on the issue: https://github.com/apache/spark/pull/12896 **[Test build #62598 has finished](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/62598/consoleFull)** for PR 12896 at commit

[GitHub] spark issue #13894: [SPARK-15254][DOC] Improve ML pipeline Cross Validation ...

2016-07-20 Thread MLnick
Github user MLnick commented on the issue: https://github.com/apache/spark/pull/13894 @krishnakalyan3 still merge conflicts - could you rebase to current master? --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your

[GitHub] spark issue #13894: [SPARK-15254][DOC] Improve ML pipeline Cross Validation ...

2016-07-20 Thread AmplabJenkins
Github user AmplabJenkins commented on the issue: https://github.com/apache/spark/pull/13894 Test PASSed. Refer to this link for build results (access rights to CI server needed): https://amplab.cs.berkeley.edu/jenkins//job/SparkPullRequestBuilder/62591/ Test PASSed. ---

[GitHub] spark issue #13894: [SPARK-15254][DOC] Improve ML pipeline Cross Validation ...

2016-07-20 Thread AmplabJenkins
Github user AmplabJenkins commented on the issue: https://github.com/apache/spark/pull/13894 Build finished. Test PASSed. --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this feature enabled

[GitHub] spark issue #13894: [SPARK-15254][DOC] Improve ML pipeline Cross Validation ...

2016-07-20 Thread SparkQA
Github user SparkQA commented on the issue: https://github.com/apache/spark/pull/13894 **[Test build #62591 has finished](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/62591/consoleFull)** for PR 13894 at commit

[GitHub] spark issue #14222: [SPARK-16391][SQL] KeyValueGroupedDataset.reduceGroups s...

2016-07-20 Thread AmplabJenkins
Github user AmplabJenkins commented on the issue: https://github.com/apache/spark/pull/14222 Merged build finished. Test PASSed. --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this feature

[GitHub] spark issue #14222: [SPARK-16391][SQL] KeyValueGroupedDataset.reduceGroups s...

2016-07-20 Thread AmplabJenkins
Github user AmplabJenkins commented on the issue: https://github.com/apache/spark/pull/14222 Test PASSed. Refer to this link for build results (access rights to CI server needed): https://amplab.cs.berkeley.edu/jenkins//job/SparkPullRequestBuilder/62594/ Test PASSed. ---

[GitHub] spark issue #14222: [SPARK-16391][SQL] KeyValueGroupedDataset.reduceGroups s...

2016-07-20 Thread SparkQA
Github user SparkQA commented on the issue: https://github.com/apache/spark/pull/14222 **[Test build #62594 has finished](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/62594/consoleFull)** for PR 14222 at commit

[GitHub] spark issue #14283: [SPARK-16645][SQL] rename CatalogStorageFormat.serdeProp...

2016-07-20 Thread AmplabJenkins
Github user AmplabJenkins commented on the issue: https://github.com/apache/spark/pull/14283 Merged build finished. Test PASSed. --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this feature

[GitHub] spark issue #14283: [SPARK-16645][SQL] rename CatalogStorageFormat.serdeProp...

2016-07-20 Thread AmplabJenkins
Github user AmplabJenkins commented on the issue: https://github.com/apache/spark/pull/14283 Test PASSed. Refer to this link for build results (access rights to CI server needed): https://amplab.cs.berkeley.edu/jenkins//job/SparkPullRequestBuilder/62592/ Test PASSed. ---

[GitHub] spark issue #14283: [SPARK-16645][SQL] rename CatalogStorageFormat.serdeProp...

2016-07-20 Thread SparkQA
Github user SparkQA commented on the issue: https://github.com/apache/spark/pull/14283 **[Test build #62592 has finished](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/62592/consoleFull)** for PR 14283 at commit

[GitHub] spark issue #14284: [SPARK-16633] [SPARK-16642] Fixes three issues related t...

2016-07-20 Thread AmplabJenkins
Github user AmplabJenkins commented on the issue: https://github.com/apache/spark/pull/14284 Merged build finished. Test FAILed. --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this feature

[GitHub] spark issue #14284: [SPARK-16633] [SPARK-16642] Fixes three issues related t...

2016-07-20 Thread AmplabJenkins
Github user AmplabJenkins commented on the issue: https://github.com/apache/spark/pull/14284 Test FAILed. Refer to this link for build results (access rights to CI server needed): https://amplab.cs.berkeley.edu/jenkins//job/SparkPullRequestBuilder/62593/ Test FAILed. ---

[GitHub] spark issue #14284: [SPARK-16633] [SPARK-16642] Fixes three issues related t...

2016-07-20 Thread SparkQA
Github user SparkQA commented on the issue: https://github.com/apache/spark/pull/14284 **[Test build #62593 has finished](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/62593/consoleFull)** for PR 14284 at commit

[GitHub] spark pull request #14242: Add a comment

2016-07-20 Thread HyukjinKwon
Github user HyukjinKwon commented on a diff in the pull request: https://github.com/apache/spark/pull/14242#discussion_r71501991 --- Diff: examples/src/main/scala/org/apache/spark/examples/SparkKMeans.scala --- @@ -33,7 +33,6 @@ object SparkKMeans { def parseVector(line:

[GitHub] spark issue #14281: [SPARK-16644][SQL] Aggregate should not propagate constr...

2016-07-20 Thread AmplabJenkins
Github user AmplabJenkins commented on the issue: https://github.com/apache/spark/pull/14281 Test PASSed. Refer to this link for build results (access rights to CI server needed): https://amplab.cs.berkeley.edu/jenkins//job/SparkPullRequestBuilder/62589/ Test PASSed. ---

[GitHub] spark issue #14281: [SPARK-16644][SQL] Aggregate should not propagate constr...

2016-07-20 Thread AmplabJenkins
Github user AmplabJenkins commented on the issue: https://github.com/apache/spark/pull/14281 Merged build finished. Test PASSed. --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this feature

[GitHub] spark issue #14281: [SPARK-16644][SQL] Aggregate should not propagate constr...

2016-07-20 Thread SparkQA
Github user SparkQA commented on the issue: https://github.com/apache/spark/pull/14281 **[Test build #62589 has finished](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/62589/consoleFull)** for PR 14281 at commit

[GitHub] spark issue #14164: Allow comparisons between UDTs and Datatypes

2016-07-20 Thread srowen
Github user srowen commented on the issue: https://github.com/apache/spark/pull/14164 Please read https://cwiki.apache.org/confluence/display/SPARK/Contributing+to+Spark and attach this to your JIRA via the title. I fixed some fields in your JIRA --- If your project is set up for

[GitHub] spark issue #14282: [SPARK-16628][SQL] Don't convert Orc Metastore tables to...

2016-07-20 Thread AmplabJenkins
Github user AmplabJenkins commented on the issue: https://github.com/apache/spark/pull/14282 Merged build finished. Test PASSed. --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this feature

[GitHub] spark issue #14282: [SPARK-16628][SQL] Don't convert Orc Metastore tables to...

2016-07-20 Thread AmplabJenkins
Github user AmplabJenkins commented on the issue: https://github.com/apache/spark/pull/14282 Test PASSed. Refer to this link for build results (access rights to CI server needed): https://amplab.cs.berkeley.edu/jenkins//job/SparkPullRequestBuilder/62590/ Test PASSed. ---

[GitHub] spark issue #12896: [SPARK-14489][ML][PYSPARK] ALS unknown user/item predict...

2016-07-20 Thread SparkQA
Github user SparkQA commented on the issue: https://github.com/apache/spark/pull/12896 **[Test build #62598 has started](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/62598/consoleFull)** for PR 12896 at commit

[GitHub] spark issue #14282: [SPARK-16628][SQL] Don't convert Orc Metastore tables to...

2016-07-20 Thread SparkQA
Github user SparkQA commented on the issue: https://github.com/apache/spark/pull/14282 **[Test build #62590 has finished](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/62590/consoleFull)** for PR 14282 at commit

[GitHub] spark issue #14279: [SPARK-16216][SQL] Write Timestamp and Date in ISO 8601 ...

2016-07-20 Thread SparkQA
Github user SparkQA commented on the issue: https://github.com/apache/spark/pull/14279 **[Test build #62597 has started](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/62597/consoleFull)** for PR 14279 at commit

[GitHub] spark issue #13893: [SPARK-14172][SQL] Hive table partition predicate not pa...

2016-07-20 Thread SparkQA
Github user SparkQA commented on the issue: https://github.com/apache/spark/pull/13893 **[Test build #62596 has started](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/62596/consoleFull)** for PR 13893 at commit

[GitHub] spark issue #13893: [SPARK-14172][SQL] Hive table partition predicate not pa...

2016-07-20 Thread cloud-fan
Github user cloud-fan commented on the issue: https://github.com/apache/spark/pull/13893 retest this please --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this feature enabled and wishes

[GitHub] spark pull request #14259: [SPARK-16622][SQL] Fix NullPointerException when ...

2016-07-20 Thread cloud-fan
Github user cloud-fan commented on a diff in the pull request: https://github.com/apache/spark/pull/14259#discussion_r71496316 --- Diff: sql/catalyst/src/main/scala/org/apache/spark/sql/catalyst/expressions/objects/objects.scala --- @@ -166,11 +185,11 @@ case class Invoke(

[GitHub] spark issue #14164: Allow comparisons between UDTs and Datatypes

2016-07-20 Thread AmplabJenkins
Github user AmplabJenkins commented on the issue: https://github.com/apache/spark/pull/14164 Can one of the admins verify this patch? --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this

[GitHub] spark pull request #14268: [SPARK-16440][MLlib] Destroy broadcasted variable...

2016-07-20 Thread asfgit
Github user asfgit closed the pull request at: https://github.com/apache/spark/pull/14268 --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this feature enabled and wishes so, or if the feature is

[GitHub] spark issue #14268: [SPARK-16440][MLlib] Destroy broadcasted variables even ...

2016-07-20 Thread srowen
Github user srowen commented on the issue: https://github.com/apache/spark/pull/14268 Merged to master/2.0/1.6 to match the original PR --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this

[GitHub] spark issue #14216: [SPARK-16561][MLLib] fix multivarOnlineSummary min/max b...

2016-07-20 Thread srowen
Github user srowen commented on the issue: https://github.com/apache/spark/pull/14216 @WeichenXu123 one last request, how about a quick test case that shows that the problem you identified initially is fixed? --- If your project is set up for it, you can reply to this email and have

[GitHub] spark issue #14280: [SPARK-16515][SQL][FOLLOW-UP] Fix test `script` on OS X/...

2016-07-20 Thread AmplabJenkins
Github user AmplabJenkins commented on the issue: https://github.com/apache/spark/pull/14280 Merged build finished. Test PASSed. --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this feature

[GitHub] spark issue #14280: [SPARK-16515][SQL][FOLLOW-UP] Fix test `script` on OS X/...

2016-07-20 Thread AmplabJenkins
Github user AmplabJenkins commented on the issue: https://github.com/apache/spark/pull/14280 Test PASSed. Refer to this link for build results (access rights to CI server needed): https://amplab.cs.berkeley.edu/jenkins//job/SparkPullRequestBuilder/62588/ Test PASSed. ---

[GitHub] spark issue #14280: [SPARK-16515][SQL][FOLLOW-UP] Fix test `script` on OS X/...

2016-07-20 Thread SparkQA
Github user SparkQA commented on the issue: https://github.com/apache/spark/pull/14280 **[Test build #62588 has finished](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/62588/consoleFull)** for PR 14280 at commit

[GitHub] spark issue #14260: [SPARK-16613] [CORE] RDD.pipe returns values for empty p...

2016-07-20 Thread SparkQA
Github user SparkQA commented on the issue: https://github.com/apache/spark/pull/14260 **[Test build #62595 has started](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/62595/consoleFull)** for PR 14260 at commit

[GitHub] spark issue #13893: [SPARK-14172][SQL] Hive table partition predicate not pa...

2016-07-20 Thread jiangxb1987
Github user jiangxb1987 commented on the issue: https://github.com/apache/spark/pull/13893 With [PR#14012](https://github.com/apache/spark/pull/14012) the order between deterministic and non-deterministic predicates would not be changed arbitrarily, so I think we could apply this

[GitHub] spark issue #14280: [SPARK-16515][SQL][FOLLOW-UP] Fix test `script` on OS X/...

2016-07-20 Thread AmplabJenkins
Github user AmplabJenkins commented on the issue: https://github.com/apache/spark/pull/14280 Test PASSed. Refer to this link for build results (access rights to CI server needed): https://amplab.cs.berkeley.edu/jenkins//job/SparkPullRequestBuilder/62587/ Test PASSed. ---

[GitHub] spark issue #14280: [SPARK-16515][SQL][FOLLOW-UP] Fix test `script` on OS X/...

2016-07-20 Thread AmplabJenkins
Github user AmplabJenkins commented on the issue: https://github.com/apache/spark/pull/14280 Merged build finished. Test PASSed. --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this feature

[GitHub] spark issue #14280: [SPARK-16515][SQL][FOLLOW-UP] Fix test `script` on OS X/...

2016-07-20 Thread SparkQA
Github user SparkQA commented on the issue: https://github.com/apache/spark/pull/14280 **[Test build #62587 has finished](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/62587/consoleFull)** for PR 14280 at commit

[GitHub] spark issue #13950: [SPARK-15487] [Web UI] Spark Master UI to reverse proxy ...

2016-07-20 Thread gurvindersingh
Github user gurvindersingh commented on the issue: https://github.com/apache/spark/pull/13950 Changed the path from `target` to `proxy` Let me know if there is anything else before this PR can be merged. --- If your project is set up for it, you can reply to this email and have your

[GitHub] spark issue #14284: [SPARK-16633] [SPARK-16642] Fixes three issues related t...

2016-07-20 Thread yhuai
Github user yhuai commented on the issue: https://github.com/apache/spark/pull/14284 Without a good reason and providing a way  to make lead and lag respect Bulls, we should not change the behavior. On Wed, Jul 20, 2016 at 2:04 AM -0700, "Apache

[GitHub] spark issue #14167: [SPARK-16194] Mesos Driver env vars

2016-07-20 Thread viirya
Github user viirya commented on the issue: https://github.com/apache/spark/pull/14167 nit: From the code, it is `spark.mesos.driverEnv` but in PR description it is `spark.mesos.env`. --- If your project is set up for it, you can reply to this email and have your reply appear on

[GitHub] spark issue #14284: [SPARK-16633] [SPARK-16642] Fixes three issues related t...

2016-07-20 Thread SparkQA
Github user SparkQA commented on the issue: https://github.com/apache/spark/pull/14284 **[Test build #62593 has started](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/62593/consoleFull)** for PR 14284 at commit

[GitHub] spark pull request #14284: [SPARK-16633] [SPARK-16642] Fixes three issues re...

2016-07-20 Thread yhuai
Github user yhuai commented on a diff in the pull request: https://github.com/apache/spark/pull/14284#discussion_r71489063 --- Diff: sql/core/src/main/scala/org/apache/spark/sql/execution/WindowExec.scala --- @@ -582,25 +582,43 @@ private[execution] final class

[GitHub] spark issue #14222: [SPARK-16391][SQL] KeyValueGroupedDataset.reduceGroups s...

2016-07-20 Thread SparkQA
Github user SparkQA commented on the issue: https://github.com/apache/spark/pull/14222 **[Test build #62594 has started](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/62594/consoleFull)** for PR 14222 at commit

[GitHub] spark pull request #14222: [SPARK-16391][SQL] KeyValueGroupedDataset.reduceG...

2016-07-20 Thread viirya
Github user viirya commented on a diff in the pull request: https://github.com/apache/spark/pull/14222#discussion_r71488669 --- Diff: sql/core/src/test/scala/org/apache/spark/sql/expressions/ReduceAggregatorSuite.scala --- @@ -0,0 +1,62 @@ +/* + * Licensed to the Apache

[GitHub] spark pull request #14284: [SPARK-16633] [SPARK-16642] Fixes three issues re...

2016-07-20 Thread yhuai
Github user yhuai commented on a diff in the pull request: https://github.com/apache/spark/pull/14284#discussion_r71488537 --- Diff: sql/catalyst/src/main/scala/org/apache/spark/sql/catalyst/expressions/windowExpressions.scala --- @@ -382,7 +382,7 @@ abstract class

[GitHub] spark issue #14280: [SPARK-16515][SQL][FOLLOW-UP] Fix test `script` on OS X/...

2016-07-20 Thread AmplabJenkins
Github user AmplabJenkins commented on the issue: https://github.com/apache/spark/pull/14280 Test PASSed. Refer to this link for build results (access rights to CI server needed): https://amplab.cs.berkeley.edu/jenkins//job/SparkPullRequestBuilder/62586/ Test PASSed. ---

[GitHub] spark pull request #14284: [SPARK-16633] [SPARK-16642] Fixes three issues re...

2016-07-20 Thread yhuai
GitHub user yhuai opened a pull request: https://github.com/apache/spark/pull/14284 [SPARK-16633] [SPARK-16642] Fixes three issues related to window functions ## What changes were proposed in this pull request? This PR contains three changes. First, this PR changes the

[GitHub] spark issue #14280: [SPARK-16515][SQL][FOLLOW-UP] Fix test `script` on OS X/...

2016-07-20 Thread AmplabJenkins
Github user AmplabJenkins commented on the issue: https://github.com/apache/spark/pull/14280 Merged build finished. Test PASSed. --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this feature

[GitHub] spark issue #14280: [SPARK-16515][SQL][FOLLOW-UP] Fix test `script` on OS X/...

2016-07-20 Thread SparkQA
Github user SparkQA commented on the issue: https://github.com/apache/spark/pull/14280 **[Test build #62586 has finished](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/62586/consoleFull)** for PR 14280 at commit

[GitHub] spark issue #14167: [SPARK-16194] Mesos Driver env vars

2016-07-20 Thread srowen
Github user srowen commented on the issue: https://github.com/apache/spark/pull/14167 I don't know anything about mesos, but I presume y'all are pretty expert. Unless anyone else with Mesos knowledge chimes in, and tests pass and all that, OK to merge. --- If your project is set up

[GitHub] spark issue #14283: [SPARK-16645][SQL] rename CatalogStorageFormat.serdeProp...

2016-07-20 Thread SparkQA
Github user SparkQA commented on the issue: https://github.com/apache/spark/pull/14283 **[Test build #62592 has started](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/62592/consoleFull)** for PR 14283 at commit

[GitHub] spark issue #14283: [SPARK-16645][SQL] rename CatalogStorageFormat.serdeProp...

2016-07-20 Thread cloud-fan
Github user cloud-fan commented on the issue: https://github.com/apache/spark/pull/14283 cc @yhuai @liancheng --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this feature enabled and wishes

[GitHub] spark pull request #14283: [SPARK-16645][SQL] rename CatalogStorageFormat.se...

2016-07-20 Thread cloud-fan
GitHub user cloud-fan opened a pull request: https://github.com/apache/spark/pull/14283 [SPARK-16645][SQL] rename CatalogStorageFormat.serdeProperties to properties ## What changes were proposed in this pull request? we also store data source table options in this field,

[GitHub] spark issue #14278: [SPARK-16632][SQL] Use Spark requested schema to guide v...

2016-07-20 Thread AmplabJenkins
Github user AmplabJenkins commented on the issue: https://github.com/apache/spark/pull/14278 Test PASSed. Refer to this link for build results (access rights to CI server needed): https://amplab.cs.berkeley.edu/jenkins//job/SparkPullRequestBuilder/62585/ Test PASSed. ---

[GitHub] spark issue #14278: [SPARK-16632][SQL] Use Spark requested schema to guide v...

2016-07-20 Thread AmplabJenkins
Github user AmplabJenkins commented on the issue: https://github.com/apache/spark/pull/14278 Merged build finished. Test PASSed. --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this feature

[GitHub] spark issue #14278: [SPARK-16632][SQL] Use Spark requested schema to guide v...

2016-07-20 Thread SparkQA
Github user SparkQA commented on the issue: https://github.com/apache/spark/pull/14278 **[Test build #62585 has finished](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/62585/consoleFull)** for PR 14278 at commit

[GitHub] spark issue #13894: [SPARK-15254][DOC] Improve ML pipeline Cross Validation ...

2016-07-20 Thread SparkQA
Github user SparkQA commented on the issue: https://github.com/apache/spark/pull/13894 **[Test build #62591 has started](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/62591/consoleFull)** for PR 13894 at commit

[GitHub] spark issue #14276: [WIP][SPARK-16638][ML][Optimizer] fix L2 reg computation...

2016-07-20 Thread WeichenXu123
Github user WeichenXu123 commented on the issue: https://github.com/apache/spark/pull/14276 @srowen I re-think the code again and maybe my previous idea is wrong. The intension of author may be to use w[i] / featuresStd[i] to reduce penalty on large scale dimension (because these

[GitHub] spark issue #14282: [SPARK-16628][SQL] Don't convert Orc Metastore tables to...

2016-07-20 Thread SparkQA
Github user SparkQA commented on the issue: https://github.com/apache/spark/pull/14282 **[Test build #62590 has started](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/62590/consoleFull)** for PR 14282 at commit

[GitHub] spark pull request #14282: [SPARK-16628][SQL] Don't convert Orc Metastore ta...

2016-07-20 Thread viirya
GitHub user viirya opened a pull request: https://github.com/apache/spark/pull/14282 [SPARK-16628][SQL] Don't convert Orc Metastore tables to datasource tables if metastore schema does not match schema stored in the files ## What changes were proposed in this pull request?

[GitHub] spark issue #14278: [SPARK-16632][SQL] Use Spark requested schema to guide v...

2016-07-20 Thread AmplabJenkins
Github user AmplabJenkins commented on the issue: https://github.com/apache/spark/pull/14278 Merged build finished. Test PASSed. --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this feature

[GitHub] spark issue #14279: [SPARK-16216][SQL] Write Timestamp and Date in ISO 8601 ...

2016-07-20 Thread HyukjinKwon
Github user HyukjinKwon commented on the issue: https://github.com/apache/spark/pull/14279 It seems due to https://issues.apache.org/jira/browse/LANG-982 I will look into this deeper --- If your project is set up for it, you can reply to this email and have your reply appear on

[GitHub] spark issue #14278: [SPARK-16632][SQL] Use Spark requested schema to guide v...

2016-07-20 Thread AmplabJenkins
Github user AmplabJenkins commented on the issue: https://github.com/apache/spark/pull/14278 Test PASSed. Refer to this link for build results (access rights to CI server needed): https://amplab.cs.berkeley.edu/jenkins//job/SparkPullRequestBuilder/62583/ Test PASSed. ---

[GitHub] spark issue #14278: [SPARK-16632][SQL] Use Spark requested schema to guide v...

2016-07-20 Thread SparkQA
Github user SparkQA commented on the issue: https://github.com/apache/spark/pull/14278 **[Test build #62583 has finished](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/62583/consoleFull)** for PR 14278 at commit

[GitHub] spark issue #14276: [WIP][SPARK-16638][ML][Optimizer] fix L2 reg computation...

2016-07-20 Thread srowen
Github user srowen commented on the issue: https://github.com/apache/spark/pull/14276 It's worth double-checking with @holdenk and @dbtsai. I think this is working as intended since `WeightedLeastSquares` does show multiplying each feature by sigma. To undo it you'd need to divide

[GitHub] spark issue #14086: [SPARK-16463][SQL] Support `truncate` option in Overwrit...

2016-07-20 Thread AmplabJenkins
Github user AmplabJenkins commented on the issue: https://github.com/apache/spark/pull/14086 Merged build finished. Test PASSed. --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this feature

[GitHub] spark issue #14086: [SPARK-16463][SQL] Support `truncate` option in Overwrit...

2016-07-20 Thread AmplabJenkins
Github user AmplabJenkins commented on the issue: https://github.com/apache/spark/pull/14086 Test PASSed. Refer to this link for build results (access rights to CI server needed): https://amplab.cs.berkeley.edu/jenkins//job/SparkPullRequestBuilder/62582/ Test PASSed. ---

[GitHub] spark issue #14086: [SPARK-16463][SQL] Support `truncate` option in Overwrit...

2016-07-20 Thread SparkQA
Github user SparkQA commented on the issue: https://github.com/apache/spark/pull/14086 **[Test build #62582 has finished](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/62582/consoleFull)** for PR 14086 at commit

[GitHub] spark issue #14281: [SPARK-16644][SQL] Aggregate should not propagate constr...

2016-07-20 Thread SparkQA
Github user SparkQA commented on the issue: https://github.com/apache/spark/pull/14281 **[Test build #62589 has started](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/62589/consoleFull)** for PR 14281 at commit

[GitHub] spark pull request #14281: [SPARK-16644][SQL] Aggregate should not propagate...

2016-07-20 Thread cloud-fan
GitHub user cloud-fan opened a pull request: https://github.com/apache/spark/pull/14281 [SPARK-16644][SQL] Aggregate should not propagate constraints containing aggregate expressions ## What changes were proposed in this pull request? aggregate expressions can only be

[GitHub] spark issue #14281: [SPARK-16644][SQL] Aggregate should not propagate constr...

2016-07-20 Thread cloud-fan
Github user cloud-fan commented on the issue: https://github.com/apache/spark/pull/14281 cc @sameeragarwal @yhuai @liancheng --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this feature

[GitHub] spark issue #14045: [SPARK-16362][SQL] Support ArrayType and StructType in v...

2016-07-20 Thread viirya
Github user viirya commented on the issue: https://github.com/apache/spark/pull/14045 @liancheng Thank you! --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this feature enabled and wishes

[GitHub] spark issue #14179: [SPARK-16055][SPARKR] warning added while using sparkPac...

2016-07-20 Thread krishnakalyan3
Github user krishnakalyan3 commented on the issue: https://github.com/apache/spark/pull/14179 @shivaram @felixcheung thanks for the reviews. Will keep the feedbacks in mind. --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as

[GitHub] spark issue #14217: [SPARK-16562][SQL] Do not allow downcast in INT32 based ...

2016-07-20 Thread HyukjinKwon
Github user HyukjinKwon commented on the issue: https://github.com/apache/spark/pull/14217 Closing this due to HIVE-14294. This will causes SPARK-16632 for normal parquet reader as well. --- If your project is set up for it, you can reply to this email and have your reply appear on

[GitHub] spark pull request #14217: [SPARK-16562][SQL] Do not allow downcast in INT32...

2016-07-20 Thread HyukjinKwon
Github user HyukjinKwon closed the pull request at: https://github.com/apache/spark/pull/14217 --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this feature enabled and wishes so, or if the feature

[GitHub] spark issue #14279: [SPARK-16216][SQL] Write Timestamp and Date in ISO 8601 ...

2016-07-20 Thread AmplabJenkins
Github user AmplabJenkins commented on the issue: https://github.com/apache/spark/pull/14279 Merged build finished. Test FAILed. --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this feature

[GitHub] spark issue #14279: [SPARK-16216][SQL] Write Timestamp and Date in ISO 8601 ...

2016-07-20 Thread SparkQA
Github user SparkQA commented on the issue: https://github.com/apache/spark/pull/14279 **[Test build #62584 has finished](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/62584/consoleFull)** for PR 14279 at commit

[GitHub] spark issue #14279: [SPARK-16216][SQL] Write Timestamp and Date in ISO 8601 ...

2016-07-20 Thread AmplabJenkins
Github user AmplabJenkins commented on the issue: https://github.com/apache/spark/pull/14279 Test FAILed. Refer to this link for build results (access rights to CI server needed): https://amplab.cs.berkeley.edu/jenkins//job/SparkPullRequestBuilder/62584/ Test FAILed. ---

[GitHub] spark issue #14163: [SPARK-15923][YARN] Spark Application rest api returns '...

2016-07-20 Thread srowen
Github user srowen commented on the issue: https://github.com/apache/spark/pull/14163 @steveloughran does that look right? --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this feature

[GitHub] spark issue #14280: [SPARK-16515][SQL][FOLLOW-UP] Fix test `script` on OS X/...

2016-07-20 Thread SparkQA
Github user SparkQA commented on the issue: https://github.com/apache/spark/pull/14280 **[Test build #62588 has started](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/62588/consoleFull)** for PR 14280 at commit

[GitHub] spark issue #14278: [SPARK-16632][SQL] Use Spark requested schema to guide v...

2016-07-20 Thread viirya
Github user viirya commented on the issue: https://github.com/apache/spark/pull/14278 @liancheng Yea, you are right! After double-checking, the `sparkSchema` is override later. Thanks for clarifying it! --- If your project is set up for it, you can reply to this email and have your

[GitHub] spark issue #14280: [SPARK-16515][SQL][FOLLOW-UP] Fix test `script` on OS X/...

2016-07-20 Thread lw-lin
Github user lw-lin commented on the issue: https://github.com/apache/spark/pull/14280 `sed $'...'` works on both Linux & OS X! So let's switch back to `sed`. @srowen thanks a lot for the `$`! --- If your project is set up for it, you can reply to this email and have your reply

[GitHub] spark pull request #14065: [SPARK-14743][YARN] Add a configurable token mana...

2016-07-20 Thread jerryshao
Github user jerryshao commented on a diff in the pull request: https://github.com/apache/spark/pull/14065#discussion_r71481579 --- Diff: yarn/src/main/scala/org/apache/spark/deploy/yarn/security/ExecutorDelegationTokenUpdater.scala --- @@ -107,6 +110,14 @@ private[spark] class

[GitHub] spark issue #14274: [MINOR][DOCS][STREAMING] Minor docfix schema of csv rath...

2016-07-20 Thread srowen
Github user srowen commented on the issue: https://github.com/apache/spark/pull/14274 LGTM --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this feature enabled and wishes so, or if the

[GitHub] spark issue #14271: [SPARK-16634][sql] Workaround JVM bug by moving some cod...

2016-07-20 Thread srowen
Github user srowen commented on the issue: https://github.com/apache/spark/pull/14271 LGTM --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this feature enabled and wishes so, or if the

<    1   2   3   4   5   6   >