[GitHub] spark issue #15587: [SPARK-18051][Spark Core] fix bug of custom PartitionCoa...

2016-10-22 Thread SparkQA
Github user SparkQA commented on the issue: https://github.com/apache/spark/pull/15587 **[Test build #67375 has finished](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/67375/consoleFull)** for PR 15587 at commit [`0411839`](https://github.com/apache/spark/commit/

[GitHub] spark issue #15587: [SPARK-18051][Spark Core] fix bug of custom PartitionCoa...

2016-10-22 Thread AmplabJenkins
Github user AmplabJenkins commented on the issue: https://github.com/apache/spark/pull/15587 Merged build finished. Test PASSed. --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this feature e

[GitHub] spark issue #15587: [SPARK-18051][Spark Core] fix bug of custom PartitionCoa...

2016-10-22 Thread AmplabJenkins
Github user AmplabJenkins commented on the issue: https://github.com/apache/spark/pull/15587 Test PASSed. Refer to this link for build results (access rights to CI server needed): https://amplab.cs.berkeley.edu/jenkins//job/SparkPullRequestBuilder/67375/ Test PASSed. ---

[GitHub] spark issue #12913: [SPARK-928][CORE] Add support for Unsafe-based serialize...

2016-10-22 Thread AmplabJenkins
Github user AmplabJenkins commented on the issue: https://github.com/apache/spark/pull/12913 Merged build finished. Test FAILed. --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this feature e

[GitHub] spark issue #12913: [SPARK-928][CORE] Add support for Unsafe-based serialize...

2016-10-22 Thread SparkQA
Github user SparkQA commented on the issue: https://github.com/apache/spark/pull/12913 **[Test build #67377 has finished](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/67377/consoleFull)** for PR 12913 at commit [`3977ccb`](https://github.com/apache/spark/commit/

[GitHub] spark issue #12913: [SPARK-928][CORE] Add support for Unsafe-based serialize...

2016-10-22 Thread AmplabJenkins
Github user AmplabJenkins commented on the issue: https://github.com/apache/spark/pull/12913 Test FAILed. Refer to this link for build results (access rights to CI server needed): https://amplab.cs.berkeley.edu/jenkins//job/SparkPullRequestBuilder/67377/ Test FAILed. ---

[GitHub] spark issue #12913: [SPARK-928][CORE] Add support for Unsafe-based serialize...

2016-10-22 Thread SparkQA
Github user SparkQA commented on the issue: https://github.com/apache/spark/pull/12913 **[Test build #67376 has finished](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/67376/consoleFull)** for PR 12913 at commit [`ed2c3a1`](https://github.com/apache/spark/commit/

[GitHub] spark issue #12913: [SPARK-928][CORE] Add support for Unsafe-based serialize...

2016-10-22 Thread AmplabJenkins
Github user AmplabJenkins commented on the issue: https://github.com/apache/spark/pull/12913 Test PASSed. Refer to this link for build results (access rights to CI server needed): https://amplab.cs.berkeley.edu/jenkins//job/SparkPullRequestBuilder/67376/ Test PASSed. ---

[GitHub] spark issue #12913: [SPARK-928][CORE] Add support for Unsafe-based serialize...

2016-10-22 Thread AmplabJenkins
Github user AmplabJenkins commented on the issue: https://github.com/apache/spark/pull/12913 Merged build finished. Test PASSed. --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this feature e

[GitHub] spark issue #15557: [SPARK-17944] [DEPLOY] sbin/start-* scripts use of `host...

2016-10-22 Thread srowen
Github user srowen commented on the issue: https://github.com/apache/spark/pull/15557 Merged to master --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this feature enabled and wishes so, or i

[GitHub] spark pull request #15557: [SPARK-17944] [DEPLOY] sbin/start-* scripts use o...

2016-10-22 Thread asfgit
Github user asfgit closed the pull request at: https://github.com/apache/spark/pull/15557 --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this feature enabled and wishes so, or if the feature is ena

[GitHub] spark pull request #14050: [MINOR][EXAMPLES] Window function examples

2016-10-22 Thread aokolnychyi
Github user aokolnychyi closed the pull request at: https://github.com/apache/spark/pull/14050 --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this feature enabled and wishes so, or if the feature i

[GitHub] spark issue #15584: [SPARK-17898] [DOCS] --repositories needs username and p...

2016-10-22 Thread srowen
Github user srowen commented on the issue: https://github.com/apache/spark/pull/15584 Merged to master --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this feature enabled and wishes so, or i

[GitHub] spark pull request #15584: [SPARK-17898] [DOCS] --repositories needs usernam...

2016-10-22 Thread srowen
Github user srowen closed the pull request at: https://github.com/apache/spark/pull/15584 --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this feature enabled and wishes so, or if the feature is ena

[GitHub] spark issue #15597: [SPARK-18063][SQL] Failed to infer constraints over mult...

2016-10-22 Thread SparkQA
Github user SparkQA commented on the issue: https://github.com/apache/spark/pull/15597 **[Test build #67379 has finished](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/67379/consoleFull)** for PR 15597 at commit [`2fe728f`](https://github.com/apache/spark/commit/

[GitHub] spark issue #15597: [SPARK-18063][SQL] Failed to infer constraints over mult...

2016-10-22 Thread AmplabJenkins
Github user AmplabJenkins commented on the issue: https://github.com/apache/spark/pull/15597 Merged build finished. Test FAILed. --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this feature e

[GitHub] spark issue #15597: [SPARK-18063][SQL] Failed to infer constraints over mult...

2016-10-22 Thread AmplabJenkins
Github user AmplabJenkins commented on the issue: https://github.com/apache/spark/pull/15597 Test FAILed. Refer to this link for build results (access rights to CI server needed): https://amplab.cs.berkeley.edu/jenkins//job/SparkPullRequestBuilder/67379/ Test FAILed. ---

[GitHub] spark pull request #15588: [SPARK-18039][Scheduler] fix bug maxRegisteredWai...

2016-10-22 Thread srowen
Github user srowen commented on a diff in the pull request: https://github.com/apache/spark/pull/15588#discussion_r84572963 --- Diff: streaming/src/main/scala/org/apache/spark/streaming/scheduler/ReceiverTracker.scala --- @@ -440,7 +430,10 @@ class ReceiverTracker(ssc: StreamingCo

[GitHub] spark issue #15588: [SPARK-18039][Scheduler] fix bug maxRegisteredWaitingTim...

2016-10-22 Thread srowen
Github user srowen commented on the issue: https://github.com/apache/spark/pull/15588 I don't think it's necessarily true that you want to wait for all receivers to begin processing. This change won't work in any event. --- If your project is set up for it, you can reply to this emai

[GitHub] spark pull request #15377: [SPARK-17802] Improved caller context logging.

2016-10-22 Thread srowen
Github user srowen commented on a diff in the pull request: https://github.com/apache/spark/pull/15377#discussion_r84573004 --- Diff: core/src/main/scala/org/apache/spark/util/Utils.scala --- @@ -2432,6 +2432,30 @@ private[spark] object Utils extends Logging { } }

[GitHub] spark pull request #15598: [SPARK-18027][YARN] .sparkStaging not clean on RM...

2016-10-22 Thread srowen
GitHub user srowen opened a pull request: https://github.com/apache/spark/pull/15598 [SPARK-18027][YARN] .sparkStaging not clean on RM ApplicationNotFoundException ## What changes were proposed in this pull request? Cleanup YARN staging dir on all `KILLED`/`FAILED` paths in

[GitHub] spark issue #12913: [SPARK-928][CORE] Add support for Unsafe-based serialize...

2016-10-22 Thread SparkQA
Github user SparkQA commented on the issue: https://github.com/apache/spark/pull/12913 **[Test build #67378 has finished](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/67378/consoleFull)** for PR 12913 at commit [`cdf535e`](https://github.com/apache/spark/commit/

[GitHub] spark issue #12913: [SPARK-928][CORE] Add support for Unsafe-based serialize...

2016-10-22 Thread AmplabJenkins
Github user AmplabJenkins commented on the issue: https://github.com/apache/spark/pull/12913 Merged build finished. Test PASSed. --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this feature e

[GitHub] spark issue #12913: [SPARK-928][CORE] Add support for Unsafe-based serialize...

2016-10-22 Thread AmplabJenkins
Github user AmplabJenkins commented on the issue: https://github.com/apache/spark/pull/12913 Test PASSed. Refer to this link for build results (access rights to CI server needed): https://amplab.cs.berkeley.edu/jenkins//job/SparkPullRequestBuilder/67378/ Test PASSed. ---

[GitHub] spark issue #15526: [SPARK-17986] [ML] SQLTransformer should remove temporar...

2016-10-22 Thread yanboliang
Github user yanboliang commented on the issue: https://github.com/apache/spark/pull/15526 Good catch! LGTM, merged into master and branch-2.0. Thanks! @drewrobb @leoromanovsky --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as w

[GitHub] spark issue #15598: [SPARK-18027][YARN] .sparkStaging not clean on RM Applic...

2016-10-22 Thread SparkQA
Github user SparkQA commented on the issue: https://github.com/apache/spark/pull/15598 **[Test build #67380 has started](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/67380/consoleFull)** for PR 15598 at commit [`e08`](https://github.com/apache/spark/commit/e

[GitHub] spark pull request #15599: [SPARK-18022][SQL] java.lang.NullPointerException...

2016-10-22 Thread srowen
GitHub user srowen opened a pull request: https://github.com/apache/spark/pull/15599 [SPARK-18022][SQL] java.lang.NullPointerException instead of real exception when saving DF to MySQL ## What changes were proposed in this pull request? On null next exception in JDBC, don't

[GitHub] spark pull request #15526: [SPARK-17986] [ML] SQLTransformer should remove t...

2016-10-22 Thread asfgit
Github user asfgit closed the pull request at: https://github.com/apache/spark/pull/15526 --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this feature enabled and wishes so, or if the feature is ena

[GitHub] spark issue #15599: [SPARK-18022][SQL] java.lang.NullPointerException instea...

2016-10-22 Thread SparkQA
Github user SparkQA commented on the issue: https://github.com/apache/spark/pull/15599 **[Test build #67381 has started](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/67381/consoleFull)** for PR 15599 at commit [`231223f`](https://github.com/apache/spark/commit/2

[GitHub] spark issue #15555: [Minor][ML] Refactor clustering summary.

2016-10-22 Thread yanboliang
Github user yanboliang commented on the issue: https://github.com/apache/spark/pull/1 @srowen Would you mind to have a look when you available? Thanks. --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project d

[GitHub] spark issue #15553: [SPARK-18008] [build] Add support for -Dmaven.test.skip=...

2016-10-22 Thread srowen
Github user srowen commented on the issue: https://github.com/apache/spark/pull/15553 I think we should fix the jetty thing separately. I don't think I would support this profile to disable test compilation as it's a sort of cheap form of testing and don't think it's expensive. ---

[GitHub] spark issue #15598: [SPARK-18027][YARN] .sparkStaging not clean on RM Applic...

2016-10-22 Thread SparkQA
Github user SparkQA commented on the issue: https://github.com/apache/spark/pull/15598 **[Test build #67380 has finished](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/67380/consoleFull)** for PR 15598 at commit [`e08`](https://github.com/apache/spark/commit/

[GitHub] spark issue #15598: [SPARK-18027][YARN] .sparkStaging not clean on RM Applic...

2016-10-22 Thread AmplabJenkins
Github user AmplabJenkins commented on the issue: https://github.com/apache/spark/pull/15598 Merged build finished. Test PASSed. --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this feature e

[GitHub] spark issue #15598: [SPARK-18027][YARN] .sparkStaging not clean on RM Applic...

2016-10-22 Thread AmplabJenkins
Github user AmplabJenkins commented on the issue: https://github.com/apache/spark/pull/15598 Test PASSed. Refer to this link for build results (access rights to CI server needed): https://amplab.cs.berkeley.edu/jenkins//job/SparkPullRequestBuilder/67380/ Test PASSed. ---

[GitHub] spark pull request #15441: [SPARK-4411] [Web UI] Add "kill" link for jobs in...

2016-10-22 Thread srowen
Github user srowen commented on a diff in the pull request: https://github.com/apache/spark/pull/15441#discussion_r84573559 --- Diff: core/src/main/scala/org/apache/spark/ui/jobs/JobsTab.scala --- @@ -35,4 +37,20 @@ private[ui] class JobsTab(parent: SparkUI) extends SparkUITab(pare

[GitHub] spark pull request #15441: [SPARK-4411] [Web UI] Add "kill" link for jobs in...

2016-10-22 Thread srowen
Github user srowen commented on a diff in the pull request: https://github.com/apache/spark/pull/15441#discussion_r84573574 --- Diff: core/src/test/scala/org/apache/spark/ui/UISeleniumSuite.scala --- @@ -651,6 +671,15 @@ class UISeleniumSuite extends SparkFunSuite with WebBrowser w

[GitHub] spark pull request #15441: [SPARK-4411] [Web UI] Add "kill" link for jobs in...

2016-10-22 Thread srowen
Github user srowen commented on a diff in the pull request: https://github.com/apache/spark/pull/15441#discussion_r84573575 --- Diff: docs/configuration.md --- @@ -624,7 +624,7 @@ Apart from these, the following properties are also available, and may be useful spark.ui.killE

[GitHub] spark issue #15297: [SPARK-9862]Handling data skew

2016-10-22 Thread YuhuWang2002
Github user YuhuWang2002 commented on the issue: https://github.com/apache/spark/pull/15297 @tgravescs : In join case,some like : select count(*) from A join B. if the parameter spark.sql.shuffle.partitions=200 ,then we get 200 tasks output about 'count num', the output is not in HDF

[GitHub] spark pull request #15513: [SPARK-17963][SQL][Documentation] Add examples (e...

2016-10-22 Thread srowen
Github user srowen commented on a diff in the pull request: https://github.com/apache/spark/pull/15513#discussion_r84573769 --- Diff: sql/catalyst/src/main/scala/org/apache/spark/sql/catalyst/expressions/arithmetic.scala --- @@ -367,8 +410,16 @@ case class Remainder(left: Expressi

[GitHub] spark pull request #15513: [SPARK-17963][SQL][Documentation] Add examples (e...

2016-10-22 Thread srowen
Github user srowen commented on a diff in the pull request: https://github.com/apache/spark/pull/15513#discussion_r84574033 --- Diff: sql/catalyst/src/main/scala/org/apache/spark/sql/catalyst/expressions/mathExpressions.scala --- @@ -666,8 +910,16 @@ case class ShiftLeft(left: Exp

[GitHub] spark pull request #15513: [SPARK-17963][SQL][Documentation] Add examples (e...

2016-10-22 Thread srowen
Github user srowen commented on a diff in the pull request: https://github.com/apache/spark/pull/15513#discussion_r84573688 --- Diff: sql/catalyst/src/main/scala/org/apache/spark/sql/catalyst/expressions/arithmetic.scala --- @@ -62,7 +66,11 @@ case class UnaryMinus(child: Expressi

[GitHub] spark pull request #15513: [SPARK-17963][SQL][Documentation] Add examples (e...

2016-10-22 Thread srowen
Github user srowen commented on a diff in the pull request: https://github.com/apache/spark/pull/15513#discussion_r84574087 --- Diff: sql/catalyst/src/main/scala/org/apache/spark/sql/catalyst/expressions/predicates.scala --- @@ -435,8 +458,15 @@ case class EqualTo(left: Expression

[GitHub] spark pull request #15513: [SPARK-17963][SQL][Documentation] Add examples (e...

2016-10-22 Thread srowen
Github user srowen commented on a diff in the pull request: https://github.com/apache/spark/pull/15513#discussion_r84573731 --- Diff: sql/catalyst/src/main/scala/org/apache/spark/sql/catalyst/expressions/arithmetic.scala --- @@ -286,7 +324,12 @@ case class Divide(left: Expression,

[GitHub] spark pull request #15513: [SPARK-17963][SQL][Documentation] Add examples (e...

2016-10-22 Thread srowen
Github user srowen commented on a diff in the pull request: https://github.com/apache/spark/pull/15513#discussion_r84573927 --- Diff: sql/catalyst/src/main/scala/org/apache/spark/sql/catalyst/expressions/mathExpressions.scala --- @@ -159,28 +167,69 @@ case class Pi() extends LeafM

[GitHub] spark pull request #15513: [SPARK-17963][SQL][Documentation] Add examples (e...

2016-10-22 Thread srowen
Github user srowen commented on a diff in the pull request: https://github.com/apache/spark/pull/15513#discussion_r84573878 --- Diff: sql/catalyst/src/main/scala/org/apache/spark/sql/catalyst/expressions/datetimeExpressions.scala --- @@ -847,7 +1010,16 @@ case class MonthsBetween(

[GitHub] spark pull request #15513: [SPARK-17963][SQL][Documentation] Add examples (e...

2016-10-22 Thread srowen
Github user srowen commented on a diff in the pull request: https://github.com/apache/spark/pull/15513#discussion_r84574029 --- Diff: sql/catalyst/src/main/scala/org/apache/spark/sql/catalyst/expressions/mathExpressions.scala --- @@ -603,8 +823,16 @@ case class Unhex(child: Expres

[GitHub] spark pull request #15513: [SPARK-17963][SQL][Documentation] Add examples (e...

2016-10-22 Thread srowen
Github user srowen commented on a diff in the pull request: https://github.com/apache/spark/pull/15513#discussion_r84574107 --- Diff: sql/catalyst/src/main/scala/org/apache/spark/sql/catalyst/expressions/predicates.scala --- @@ -518,7 +563,12 @@ case class GreaterThan(left: Expres

[GitHub] spark pull request #15513: [SPARK-17963][SQL][Documentation] Add examples (e...

2016-10-22 Thread srowen
Github user srowen commented on a diff in the pull request: https://github.com/apache/spark/pull/15513#discussion_r84573696 --- Diff: sql/catalyst/src/main/scala/org/apache/spark/sql/catalyst/expressions/arithmetic.scala --- @@ -25,7 +25,11 @@ import org.apache.spark.sql.types._

[GitHub] spark pull request #15513: [SPARK-17963][SQL][Documentation] Add examples (e...

2016-10-22 Thread srowen
Github user srowen commented on a diff in the pull request: https://github.com/apache/spark/pull/15513#discussion_r84574135 --- Diff: sql/catalyst/src/main/scala/org/apache/spark/sql/catalyst/expressions/stringExpressions.scala --- @@ -986,7 +1155,14 @@ case class StringReverse(ch

[GitHub] spark pull request #15513: [SPARK-17963][SQL][Documentation] Add examples (e...

2016-10-22 Thread srowen
Github user srowen commented on a diff in the pull request: https://github.com/apache/spark/pull/15513#discussion_r84574143 --- Diff: sql/catalyst/src/main/scala/org/apache/spark/sql/catalyst/expressions/stringExpressions.scala --- @@ -1100,7 +1304,14 @@ case class Levenshtein(lef

[GitHub] spark pull request #15513: [SPARK-17963][SQL][Documentation] Add examples (e...

2016-10-22 Thread srowen
Github user srowen commented on a diff in the pull request: https://github.com/apache/spark/pull/15513#discussion_r84573971 --- Diff: sql/catalyst/src/main/scala/org/apache/spark/sql/catalyst/expressions/mathExpressions.scala --- @@ -384,71 +502,157 @@ case class Log2(child: Expre

[GitHub] spark pull request #15513: [SPARK-17963][SQL][Documentation] Add examples (e...

2016-10-22 Thread srowen
Github user srowen commented on a diff in the pull request: https://github.com/apache/spark/pull/15513#discussion_r84574050 --- Diff: sql/catalyst/src/main/scala/org/apache/spark/sql/catalyst/expressions/misc.scala --- @@ -159,8 +183,15 @@ case class Sha1(child: Expression) extend

[GitHub] spark pull request #15513: [SPARK-17963][SQL][Documentation] Add examples (e...

2016-10-22 Thread srowen
Github user srowen commented on a diff in the pull request: https://github.com/apache/spark/pull/15513#discussion_r84573906 --- Diff: sql/catalyst/src/main/scala/org/apache/spark/sql/catalyst/expressions/mathExpressions.scala --- @@ -149,7 +153,11 @@ case class EulerNumber() exten

[GitHub] spark pull request #15513: [SPARK-17963][SQL][Documentation] Add examples (e...

2016-10-22 Thread srowen
Github user srowen commented on a diff in the pull request: https://github.com/apache/spark/pull/15513#discussion_r84573897 --- Diff: sql/catalyst/src/main/scala/org/apache/spark/sql/catalyst/expressions/mathExpressions.scala --- @@ -140,7 +140,11 @@ abstract class BinaryMathExpre

[GitHub] spark pull request #15513: [SPARK-17963][SQL][Documentation] Add examples (e...

2016-10-22 Thread srowen
Github user srowen commented on a diff in the pull request: https://github.com/apache/spark/pull/15513#discussion_r84573728 --- Diff: sql/catalyst/src/main/scala/org/apache/spark/sql/catalyst/expressions/arithmetic.scala --- @@ -209,8 +239,16 @@ case class Multiply(left: Expressio

[GitHub] spark pull request #15513: [SPARK-17963][SQL][Documentation] Add examples (e...

2016-10-22 Thread srowen
Github user srowen commented on a diff in the pull request: https://github.com/apache/spark/pull/15513#discussion_r84574009 --- Diff: sql/catalyst/src/main/scala/org/apache/spark/sql/catalyst/expressions/mathExpressions.scala --- @@ -384,71 +502,157 @@ case class Log2(child: Expre

[GitHub] spark pull request #15513: [SPARK-17963][SQL][Documentation] Add examples (e...

2016-10-22 Thread srowen
Github user srowen commented on a diff in the pull request: https://github.com/apache/spark/pull/15513#discussion_r84574163 --- Diff: sql/catalyst/src/main/scala/org/apache/spark/sql/catalyst/expressions/xml/xpath.scala --- @@ -150,8 +220,18 @@ case class XPathString(xml: Expressi

[GitHub] spark pull request #15513: [SPARK-17963][SQL][Documentation] Add examples (e...

2016-10-22 Thread srowen
Github user srowen commented on a diff in the pull request: https://github.com/apache/spark/pull/15513#discussion_r84573933 --- Diff: sql/catalyst/src/main/scala/org/apache/spark/sql/catalyst/expressions/mathExpressions.scala --- @@ -159,28 +167,69 @@ case class Pi() extends LeafM

[GitHub] spark pull request #15513: [SPARK-17963][SQL][Documentation] Add examples (e...

2016-10-22 Thread srowen
Github user srowen commented on a diff in the pull request: https://github.com/apache/spark/pull/15513#discussion_r84573871 --- Diff: sql/catalyst/src/main/scala/org/apache/spark/sql/catalyst/expressions/datetimeExpressions.scala --- @@ -706,7 +842,16 @@ case class TimeAdd(start:

[GitHub] spark pull request #15513: [SPARK-17963][SQL][Documentation] Add examples (e...

2016-10-22 Thread srowen
Github user srowen commented on a diff in the pull request: https://github.com/apache/spark/pull/15513#discussion_r84574104 --- Diff: sql/catalyst/src/main/scala/org/apache/spark/sql/catalyst/expressions/predicates.scala --- @@ -490,7 +525,12 @@ case class LessThan(left: Expressio

[GitHub] spark pull request #15513: [SPARK-17963][SQL][Documentation] Add examples (e...

2016-10-22 Thread srowen
Github user srowen commented on a diff in the pull request: https://github.com/apache/spark/pull/15513#discussion_r84573952 --- Diff: sql/catalyst/src/main/scala/org/apache/spark/sql/catalyst/expressions/mathExpressions.scala --- @@ -361,13 +465,27 @@ case class Factorial(child: E

[GitHub] spark issue #15513: [SPARK-17963][SQL][Documentation] Add examples (extend) ...

2016-10-22 Thread HyukjinKwon
Github user HyukjinKwon commented on the issue: https://github.com/apache/spark/pull/15513 @srowen Oh, I didn't notice the review was being proceeded but just pushed another commit. Will try to address the comments as well. --- If your project is set up for it, you can reply to this

[GitHub] spark issue #15513: [SPARK-17963][SQL][Documentation] Add examples (extend) ...

2016-10-22 Thread SparkQA
Github user SparkQA commented on the issue: https://github.com/apache/spark/pull/15513 **[Test build #67382 has started](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/67382/consoleFull)** for PR 15513 at commit [`caa71c8`](https://github.com/apache/spark/commit/c

[GitHub] spark issue #15463: [SPARK-17894] [CORE] Ensure uniqueness of TaskSetManager...

2016-10-22 Thread erenavsarogullari
Github user erenavsarogullari commented on the issue: https://github.com/apache/spark/pull/15463 Thanks all for the support. Jenkins looks failed due to timeout. Jenkins, retest this please --- If your project is set up for it, you can reply to this email and have your reply appe

[GitHub] spark pull request #15513: [SPARK-17963][SQL][Documentation] Add examples (e...

2016-10-22 Thread HyukjinKwon
Github user HyukjinKwon commented on a diff in the pull request: https://github.com/apache/spark/pull/15513#discussion_r84574950 --- Diff: sql/catalyst/src/main/scala/org/apache/spark/sql/catalyst/expressions/datetimeExpressions.scala --- @@ -706,7 +842,16 @@ case class TimeAdd(st

[GitHub] spark issue #15599: [SPARK-18022][SQL] java.lang.NullPointerException instea...

2016-10-22 Thread SparkQA
Github user SparkQA commented on the issue: https://github.com/apache/spark/pull/15599 **[Test build #67381 has finished](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/67381/consoleFull)** for PR 15599 at commit [`231223f`](https://github.com/apache/spark/commit/

[GitHub] spark issue #15599: [SPARK-18022][SQL] java.lang.NullPointerException instea...

2016-10-22 Thread AmplabJenkins
Github user AmplabJenkins commented on the issue: https://github.com/apache/spark/pull/15599 Test PASSed. Refer to this link for build results (access rights to CI server needed): https://amplab.cs.berkeley.edu/jenkins//job/SparkPullRequestBuilder/67381/ Test PASSed. ---

[GitHub] spark issue #15599: [SPARK-18022][SQL] java.lang.NullPointerException instea...

2016-10-22 Thread AmplabJenkins
Github user AmplabJenkins commented on the issue: https://github.com/apache/spark/pull/15599 Merged build finished. Test PASSed. --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this feature e

[GitHub] spark issue #15513: [SPARK-17963][SQL][Documentation] Add examples (extend) ...

2016-10-22 Thread SparkQA
Github user SparkQA commented on the issue: https://github.com/apache/spark/pull/15513 **[Test build #67382 has finished](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/67382/consoleFull)** for PR 15513 at commit [`caa71c8`](https://github.com/apache/spark/commit/

[GitHub] spark issue #15513: [SPARK-17963][SQL][Documentation] Add examples (extend) ...

2016-10-22 Thread AmplabJenkins
Github user AmplabJenkins commented on the issue: https://github.com/apache/spark/pull/15513 Test FAILed. Refer to this link for build results (access rights to CI server needed): https://amplab.cs.berkeley.edu/jenkins//job/SparkPullRequestBuilder/67382/ Test FAILed. ---

[GitHub] spark issue #15513: [SPARK-17963][SQL][Documentation] Add examples (extend) ...

2016-10-22 Thread AmplabJenkins
Github user AmplabJenkins commented on the issue: https://github.com/apache/spark/pull/15513 Merged build finished. Test FAILed. --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this feature e

[GitHub] spark pull request #15513: [SPARK-17963][SQL][Documentation] Add examples (e...

2016-10-22 Thread HyukjinKwon
Github user HyukjinKwon commented on a diff in the pull request: https://github.com/apache/spark/pull/15513#discussion_r84576139 --- Diff: sql/catalyst/src/main/scala/org/apache/spark/sql/catalyst/expressions/arithmetic.scala --- @@ -367,8 +410,16 @@ case class Remainder(left: Exp

[GitHub] spark issue #15513: [SPARK-17963][SQL][Documentation] Add examples (extend) ...

2016-10-22 Thread SparkQA
Github user SparkQA commented on the issue: https://github.com/apache/spark/pull/15513 **[Test build #67383 has started](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/67383/consoleFull)** for PR 15513 at commit [`5163a87`](https://github.com/apache/spark/commit/5

[GitHub] spark issue #15513: [SPARK-17963][SQL][Documentation] Add examples (extend) ...

2016-10-22 Thread SparkQA
Github user SparkQA commented on the issue: https://github.com/apache/spark/pull/15513 **[Test build #67384 has started](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/67384/consoleFull)** for PR 15513 at commit [`f8d11aa`](https://github.com/apache/spark/commit/f

[GitHub] spark issue #15513: [SPARK-17963][SQL][Documentation] Add examples (extend) ...

2016-10-22 Thread SparkQA
Github user SparkQA commented on the issue: https://github.com/apache/spark/pull/15513 **[Test build #67385 has started](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/67385/consoleFull)** for PR 15513 at commit [`da40f85`](https://github.com/apache/spark/commit/d

[GitHub] spark pull request #15580: [SPARK-18042][SQL] OutputWriter should expose fil...

2016-10-22 Thread HyukjinKwon
Github user HyukjinKwon commented on a diff in the pull request: https://github.com/apache/spark/pull/15580#discussion_r84577126 --- Diff: sql/core/src/main/scala/org/apache/spark/sql/execution/datasources/parquet/ParquetOptions.scala --- @@ -35,7 +35,7 @@ private[parquet] class P

[GitHub] spark issue #15428: [SPARK-17219][ML] enhanced NaN value handling in Bucketi...

2016-10-22 Thread SparkQA
Github user SparkQA commented on the issue: https://github.com/apache/spark/pull/15428 **[Test build #67386 has started](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/67386/consoleFull)** for PR 15428 at commit [`47aad24`](https://github.com/apache/spark/commit/4

[GitHub] spark pull request #15484: [SPARK-17868][SQL] Do not use bitmasks during par...

2016-10-22 Thread hvanhovell
Github user hvanhovell commented on a diff in the pull request: https://github.com/apache/spark/pull/15484#discussion_r84577307 --- Diff: sql/catalyst/src/main/scala/org/apache/spark/sql/catalyst/plans/logical/basicLogicalOperators.scala --- @@ -518,59 +517,58 @@ case class Window

[GitHub] spark issue #15513: [SPARK-17963][SQL][Documentation] Add examples (extend) ...

2016-10-22 Thread SparkQA
Github user SparkQA commented on the issue: https://github.com/apache/spark/pull/15513 **[Test build #67383 has finished](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/67383/consoleFull)** for PR 15513 at commit [`5163a87`](https://github.com/apache/spark/commit/

[GitHub] spark issue #15513: [SPARK-17963][SQL][Documentation] Add examples (extend) ...

2016-10-22 Thread AmplabJenkins
Github user AmplabJenkins commented on the issue: https://github.com/apache/spark/pull/15513 Test FAILed. Refer to this link for build results (access rights to CI server needed): https://amplab.cs.berkeley.edu/jenkins//job/SparkPullRequestBuilder/67383/ Test FAILed. ---

[GitHub] spark issue #15513: [SPARK-17963][SQL][Documentation] Add examples (extend) ...

2016-10-22 Thread AmplabJenkins
Github user AmplabJenkins commented on the issue: https://github.com/apache/spark/pull/15513 Merged build finished. Test FAILed. --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this feature e

[GitHub] spark issue #15354: [SPARK-17764][SQL] Add `to_json` supporting to convert n...

2016-10-22 Thread HyukjinKwon
Github user HyukjinKwon commented on the issue: https://github.com/apache/spark/pull/15354 @felixcheung Thank you for pinging! @marmbrus Do you please mind if I handle checking the schema ahead for csv/json in read/write in another PR? --- If your project is set up for it, y

[GitHub] spark issue #15354: [SPARK-17764][SQL] Add `to_json` supporting to convert n...

2016-10-22 Thread SparkQA
Github user SparkQA commented on the issue: https://github.com/apache/spark/pull/15354 **[Test build #67387 has started](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/67387/consoleFull)** for PR 15354 at commit [`bbbfaff`](https://github.com/apache/spark/commit/b

[GitHub] spark issue #15539: [SPARK-17994] [SQL] Add back a file status cache for cat...

2016-10-22 Thread cloud-fan
Github user cloud-fan commented on the issue: https://github.com/apache/spark/pull/15539 merging to master! --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this feature enabled and wishes so,

[GitHub] spark pull request #15539: [SPARK-17994] [SQL] Add back a file status cache ...

2016-10-22 Thread asfgit
Github user asfgit closed the pull request at: https://github.com/apache/spark/pull/15539 --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this feature enabled and wishes so, or if the feature is ena

[GitHub] spark issue #15517: [SPARK-17972][SQL] Build Datasets upon `withCachedData` ...

2016-10-22 Thread naliazheli
Github user naliazheli commented on the issue: https://github.com/apache/spark/pull/15517 dataset.checkpoint is what i need. --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this feature enab

[GitHub] spark issue #13771: [SPARK-13748][PYSPARK][DOC] Add the description for expl...

2016-10-22 Thread HyukjinKwon
Github user HyukjinKwon commented on the issue: https://github.com/apache/spark/pull/13771 gentle ping @davies --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this feature enabled and wishes

[GitHub] spark issue #14627: [SPARK-16975][SQL][FOLLOWUP] Do not duplicately check fi...

2016-10-22 Thread HyukjinKwon
Github user HyukjinKwon commented on the issue: https://github.com/apache/spark/pull/14627 @liancheng If you are uncertain of `OrcFileOperator.scala` I will definitely remove this in this PR. --- If your project is set up for it, you can reply to this email and have your reply appear

[GitHub] spark issue #14660: [SPARK-17071][SQL] Add an option to support for reading ...

2016-10-22 Thread HyukjinKwon
Github user HyukjinKwon commented on the issue: https://github.com/apache/spark/pull/14660 Could you please take a look please @rxin and @liancheng? --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not

[GitHub] spark issue #14788: [SPARK-17174][SQL] Add the support for TimestampType for...

2016-10-22 Thread HyukjinKwon
Github user HyukjinKwon commented on the issue: https://github.com/apache/spark/pull/14788 @rxin @hvanhovell @cloud-fan Could I please ask the behaviour we want here? 1. Separate expressions for both `DateType` and `TimestampType` 2. Returns `DateType` for `DateType` and `T

[GitHub] spark issue #15049: [SPARK-17310][SQL] Add an option to disable record-level...

2016-10-22 Thread HyukjinKwon
Github user HyukjinKwon commented on the issue: https://github.com/apache/spark/pull/15049 gentle ping @davies @liancheng @yhuai --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this feature

[GitHub] spark issue #15072: [SPARK-17123][SQL] Use type-widened encoder for DataFram...

2016-10-22 Thread HyukjinKwon
Github user HyukjinKwon commented on the issue: https://github.com/apache/spark/pull/15072 @liancheng @hvanhovell @davies @cloud-fan Would there be other things maybe I should take care of ? --- If your project is set up for it, you can reply to this email and have your reply appear

[GitHub] spark issue #15361: [SPARK-17765][SQL] Support for writing out user-defined ...

2016-10-22 Thread HyukjinKwon
Github user HyukjinKwon commented on the issue: https://github.com/apache/spark/pull/15361 @chenghao-intel @davies Would there be other things maybe I should test or take care of? --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub

[GitHub] spark issue #15587: [SPARK-18051][Spark Core] fix bug of custom PartitionCoa...

2016-10-22 Thread WeichenXu123
Github user WeichenXu123 commented on the issue: https://github.com/apache/spark/pull/15587 @rxin Good suggestion. code & document updated, thanks! --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not

[GitHub] spark issue #15580: [SPARK-18042][SQL] OutputWriter should expose file path ...

2016-10-22 Thread HyukjinKwon
Github user HyukjinKwon commented on the issue: https://github.com/apache/spark/pull/15580 @rxin BTW, could I please ask to include https://github.com/apache/spark/pull/14529 in your future related PRs? I will close if you will. --- If your project is set up for it, you can reply to

[GitHub] spark issue #15566: [SPARK-18026][SQL] should not always lowercase partition...

2016-10-22 Thread cloud-fan
Github user cloud-fan commented on the issue: https://github.com/apache/spark/pull/15566 I have changed it to `This PR makes partition spec case preserving at parser`, sorry for the confusion. Previously we were lazy and alway lower case the column names in partition spec. In

[GitHub] spark issue #15587: [SPARK-18051][Spark Core] fix bug of custom PartitionCoa...

2016-10-22 Thread SparkQA
Github user SparkQA commented on the issue: https://github.com/apache/spark/pull/15587 **[Test build #67388 has started](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/67388/consoleFull)** for PR 15587 at commit [`fe770b3`](https://github.com/apache/spark/commit/f

[GitHub] spark issue #15566: [SPARK-18026][SQL] should not always lowercase partition...

2016-10-22 Thread cloud-fan
Github user cloud-fan commented on the issue: https://github.com/apache/spark/pull/15566 retest this please --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this feature enabled and wishes so,

[GitHub] spark issue #15513: [SPARK-17963][SQL][Documentation] Add examples (extend) ...

2016-10-22 Thread SparkQA
Github user SparkQA commented on the issue: https://github.com/apache/spark/pull/15513 **[Test build #67384 has finished](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/67384/consoleFull)** for PR 15513 at commit [`f8d11aa`](https://github.com/apache/spark/commit/

[GitHub] spark issue #15513: [SPARK-17963][SQL][Documentation] Add examples (extend) ...

2016-10-22 Thread AmplabJenkins
Github user AmplabJenkins commented on the issue: https://github.com/apache/spark/pull/15513 Merged build finished. Test FAILed. --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this feature e

  1   2   3   4   >