[GitHub] spark issue #18643: [SPARK-21426] [2.0] [SQL] [TEST] Fix test failure due to...

Github user gatorsmile commented on the issue: https://github.com/apache/spark/pull/18643 cc @cloud-fan @jiangxb1987 --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this feature enabled and

[GitHub] spark issue #14995: [Test Only][SPARK-6235][CORE]Address various 2G limits

Github user j143 commented on the issue: https://github.com/apache/spark/pull/14995 Hi @witgo, Did you test this PR in production environment. If yes, can you share the results on this [jira](https://issues.apache.org/jira/browse/SPARK-6235). If you have problems with downloading

[GitHub] spark issue #18555: [SPARK-21353][CORE]add checkValue in spark.internal.conf...

Github user SparkQA commented on the issue: https://github.com/apache/spark/pull/18555 **[Test build #79639 has started](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/79639/testReport)** for PR 18555 at commit

[GitHub] spark issue #18643: [SPARK-21426] [2.0] [SQL] [TEST] Fix test failure due to...

Github user AmplabJenkins commented on the issue: https://github.com/apache/spark/pull/18643 Test PASSed. Refer to this link for build results (access rights to CI server needed): https://amplab.cs.berkeley.edu/jenkins//job/SparkPullRequestBuilder/79638/ Test PASSed. ---

[GitHub] spark issue #18643: [SPARK-21426] [2.0] [SQL] [TEST] Fix test failure due to...

Github user AmplabJenkins commented on the issue: https://github.com/apache/spark/pull/18643 Merged build finished. Test PASSed. --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this feature

[GitHub] spark issue #18643: [SPARK-21426] [2.0] [SQL] [TEST] Fix test failure due to...

Github user SparkQA commented on the issue: https://github.com/apache/spark/pull/18643 **[Test build #79638 has finished](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/79638/consoleFull)** for PR 18643 at commit

[GitHub] spark issue #18643: [SPARK-21426] [2.0] [SQL] [TEST] Fix test failure due to...

Github user SparkQA commented on the issue: https://github.com/apache/spark/pull/18643 **[Test build #79638 has started](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/79638/consoleFull)** for PR 18643 at commit

[GitHub] spark pull request #18643: [SPARK-21426] [2.0] [SQL] [TEST] Fix test failure...

GitHub user gatorsmile opened a pull request: https://github.com/apache/spark/pull/18643 [SPARK-21426] [2.0] [SQL] [TEST] Fix test failure due to missing literal representation ## What changes were proposed in this pull request? SPARK 2.0 does not support hex literal. Thus,

[GitHub] spark pull request #18323: [SPARK-21117][SQL] Built-in SQL Function Support ...

Github user gatorsmile commented on a diff in the pull request: https://github.com/apache/spark/pull/18323#discussion_r127595777 --- Diff: sql/catalyst/src/main/scala/org/apache/spark/sql/catalyst/expressions/mathExpressions.scala --- @@ -1186,3 +1186,51 @@ case class

[GitHub] spark pull request #18323: [SPARK-21117][SQL] Built-in SQL Function Support ...

Github user gatorsmile commented on a diff in the pull request: https://github.com/apache/spark/pull/18323#discussion_r127595711 --- Diff: sql/catalyst/src/main/scala/org/apache/spark/sql/catalyst/expressions/mathExpressions.scala --- @@ -1186,3 +1186,51 @@ case class

[GitHub] spark issue #18641: [SPARK-21413][SQL] Fix 64KB JVM bytecode limit problem i...

Github user kiszk commented on the issue: https://github.com/apache/spark/pull/18641 @viirya @cloud-fan could you please take a look? --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this

[GitHub] spark pull request #18513: [SPARK-13969][ML] Add FeatureHasher transformer

Github user hhbyyh commented on a diff in the pull request: https://github.com/apache/spark/pull/18513#discussion_r127590053 --- Diff: mllib/src/main/scala/org/apache/spark/ml/feature/FeatureHasher.scala --- @@ -0,0 +1,185 @@ +/* + * Licensed to the Apache Software

[GitHub] spark pull request #18513: [SPARK-13969][ML] Add FeatureHasher transformer

Github user hhbyyh commented on a diff in the pull request: https://github.com/apache/spark/pull/18513#discussion_r127589970 --- Diff: mllib/src/main/scala/org/apache/spark/ml/feature/FeatureHasher.scala --- @@ -0,0 +1,185 @@ +/* + * Licensed to the Apache Software

[GitHub] spark issue #18605: [SparkR][SPARK-21381]:SparkR: pass on setHandleInvalid f...

Github user wangmiao1981 commented on the issue: https://github.com/apache/spark/pull/18605 Sure. I am reading the #18613 comments. Just come back from a business travel. Thanks! --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub

[GitHub] spark issue #18555: [SPARK-21353][CORE]add checkValue in spark.internal.conf...

Github user AmplabJenkins commented on the issue: https://github.com/apache/spark/pull/18555 Merged build finished. Test FAILed. --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this feature

[GitHub] spark issue #18555: [SPARK-21353][CORE]add checkValue in spark.internal.conf...

Github user AmplabJenkins commented on the issue: https://github.com/apache/spark/pull/18555 Test FAILed. Refer to this link for build results (access rights to CI server needed): https://amplab.cs.berkeley.edu/jenkins//job/SparkPullRequestBuilder/79637/ Test FAILed. ---

[GitHub] spark issue #18555: [SPARK-21353][CORE]add checkValue in spark.internal.conf...

Github user SparkQA commented on the issue: https://github.com/apache/spark/pull/18555 **[Test build #79637 has finished](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/79637/testReport)** for PR 18555 at commit

[GitHub] spark issue #18641: [SPARK-21413][SQL] Fix 64KB JVM bytecode limit problem i...

Github user AmplabJenkins commented on the issue: https://github.com/apache/spark/pull/18641 Test PASSed. Refer to this link for build results (access rights to CI server needed): https://amplab.cs.berkeley.edu/jenkins//job/SparkPullRequestBuilder/79636/ Test PASSed. ---

[GitHub] spark issue #18641: [SPARK-21413][SQL] Fix 64KB JVM bytecode limit problem i...

Github user AmplabJenkins commented on the issue: https://github.com/apache/spark/pull/18641 Merged build finished. Test PASSed. --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this feature

[GitHub] spark issue #18641: [SPARK-21413][SQL] Fix 64KB JVM bytecode limit problem i...

Github user SparkQA commented on the issue: https://github.com/apache/spark/pull/18641 **[Test build #79636 has finished](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/79636/testReport)** for PR 18641 at commit

[GitHub] spark issue #18640: [SPARK-21422][BUILD] Depend on Apache ORC 1.4.0

Github user dongjoon-hyun commented on the issue: https://github.com/apache/spark/pull/18640 Hi, @rxin , @srowen , @sameeragarwal , @cloud-fan , @hvanhovell , @gatorsmile , @ueshin , @viirya , @kiszk . Could you review this small PR about depedency change? This is a

[GitHub] spark issue #18555: [SPARK-21353][CORE]add checkValue in spark.internal.conf...

Github user SparkQA commented on the issue: https://github.com/apache/spark/pull/18555 **[Test build #79637 has started](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/79637/testReport)** for PR 18555 at commit

[GitHub] spark issue #18641: [SPARK-21413][SQL] Fix 64KB JVM bytecode limit problem i...

Github user SparkQA commented on the issue: https://github.com/apache/spark/pull/18641 **[Test build #79636 has started](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/79636/testReport)** for PR 18641 at commit

[GitHub] spark issue #17980: [SPARK-20728][SQL] Make ORCFileFormat configurable betwe...

Github user dongjoon-hyun commented on the issue: https://github.com/apache/spark/pull/17980 I developed new ORC component and tests in `sql/core` module without `sql/hive` module. Do you mean add a `sql/hive` module test-dependency into `sql` module? --- If your project is set up

[GitHub] spark pull request #18444: [SPARK-16542][SQL][PYSPARK] Fix bugs about types ...

Github user HyukjinKwon commented on a diff in the pull request: https://github.com/apache/spark/pull/18444#discussion_r127584948 --- Diff: python/pyspark/sql/types.py --- @@ -938,12 +1023,17 @@ def _infer_type(obj): return MapType(_infer_type(key),

[GitHub] spark pull request #18444: [SPARK-16542][SQL][PYSPARK] Fix bugs about types ...

Github user HyukjinKwon commented on a diff in the pull request: https://github.com/apache/spark/pull/18444#discussion_r127584880 --- Diff: python/pyspark/sql/tests.py --- @@ -30,6 +30,10 @@ import functools import time import datetime +import array +import

[GitHub] spark pull request #18444: [SPARK-16542][SQL][PYSPARK] Fix bugs about types ...

Github user HyukjinKwon commented on a diff in the pull request: https://github.com/apache/spark/pull/18444#discussion_r127584800 --- Diff: core/src/main/scala/org/apache/spark/api/python/SerDeUtil.scala --- @@ -57,11 +57,11 @@ private[spark] object SerDeUtil extends Logging {

[GitHub] spark pull request #18444: [SPARK-16542][SQL][PYSPARK] Fix bugs about types ...

Github user HyukjinKwon commented on a diff in the pull request: https://github.com/apache/spark/pull/18444#discussion_r127584731 --- Diff: python/pyspark/sql/types.py --- @@ -915,6 +916,90 @@ def _parse_datatype_json_value(json_value): long: LongType, })

[GitHub] spark pull request #18444: [SPARK-16542][SQL][PYSPARK] Fix bugs about types ...

Github user HyukjinKwon commented on a diff in the pull request: https://github.com/apache/spark/pull/18444#discussion_r127584576 --- Diff: python/pyspark/sql/tests.py --- @@ -30,6 +30,10 @@ import functools import time import datetime +import array +import

[GitHub] spark pull request #18444: [SPARK-16542][SQL][PYSPARK] Fix bugs about types ...

Github user HyukjinKwon commented on a diff in the pull request: https://github.com/apache/spark/pull/18444#discussion_r127584600 --- Diff: python/pyspark/sql/types.py --- @@ -938,12 +1023,17 @@ def _infer_type(obj): return MapType(_infer_type(key),

[GitHub] spark pull request #18612: [SPARK-21388][ML][PySpark] GBTs inherit from HasS...

Github user yanboliang commented on a diff in the pull request: https://github.com/apache/spark/pull/18612#discussion_r127584690 --- Diff: mllib/src/main/scala/org/apache/spark/ml/param/shared/sharedParams.scala --- @@ -162,7 +162,7 @@ private[ml] trait HasThreshold extends Params

[GitHub] spark pull request #18613: [SPARK-20307][ML][SPARKR][FOLLOW-UP] RFormula sho...

Github user asfgit closed the pull request at: https://github.com/apache/spark/pull/18613 --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this feature enabled and wishes so, or if the feature is

[GitHub] spark issue #18613: [SPARK-20307][ML][SPARKR][FOLLOW-UP] RFormula should han...

Github user yanboliang commented on the issue: https://github.com/apache/spark/pull/18613 Merged into master. Thanks for all reviewing. --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this

[GitHub] spark issue #18642: [MINOR][REFACTORING] KeyValueGroupedDataset.mapGroupsWit...

Github user AmplabJenkins commented on the issue: https://github.com/apache/spark/pull/18642 Merged build finished. Test PASSed. --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this feature

[GitHub] spark issue #18642: [MINOR][REFACTORING] KeyValueGroupedDataset.mapGroupsWit...

Github user AmplabJenkins commented on the issue: https://github.com/apache/spark/pull/18642 Test PASSed. Refer to this link for build results (access rights to CI server needed): https://amplab.cs.berkeley.edu/jenkins//job/SparkPullRequestBuilder/79633/ Test PASSed. ---

[GitHub] spark issue #18642: [MINOR][REFACTORING] KeyValueGroupedDataset.mapGroupsWit...

Github user SparkQA commented on the issue: https://github.com/apache/spark/pull/18642 **[Test build #79633 has finished](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/79633/testReport)** for PR 18642 at commit

[GitHub] spark issue #18555: [SPARK-21353][CORE]add checkValue in spark.internal.conf...

Github user AmplabJenkins commented on the issue: https://github.com/apache/spark/pull/18555 Test FAILed. Refer to this link for build results (access rights to CI server needed): https://amplab.cs.berkeley.edu/jenkins//job/SparkPullRequestBuilder/79635/ Test FAILed. ---

[GitHub] spark issue #18555: [SPARK-21353][CORE]add checkValue in spark.internal.conf...

Github user SparkQA commented on the issue: https://github.com/apache/spark/pull/18555 **[Test build #79635 has finished](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/79635/testReport)** for PR 18555 at commit

[GitHub] spark issue #18555: [SPARK-21353][CORE]add checkValue in spark.internal.conf...

Github user AmplabJenkins commented on the issue: https://github.com/apache/spark/pull/18555 Merged build finished. Test FAILed. --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this feature

[GitHub] spark issue #18555: [SPARK-21353][CORE]add checkValue in spark.internal.conf...

Github user SparkQA commented on the issue: https://github.com/apache/spark/pull/18555 **[Test build #79635 has started](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/79635/testReport)** for PR 18555 at commit

[GitHub] spark issue #18555: [SPARK-21353][CORE]add checkValue in spark.internal.conf...

Github user AmplabJenkins commented on the issue: https://github.com/apache/spark/pull/18555 Merged build finished. Test FAILed. --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this feature

[GitHub] spark issue #18555: [SPARK-21353][CORE]add checkValue in spark.internal.conf...

Github user AmplabJenkins commented on the issue: https://github.com/apache/spark/pull/18555 Test FAILed. Refer to this link for build results (access rights to CI server needed): https://amplab.cs.berkeley.edu/jenkins//job/SparkPullRequestBuilder/79634/ Test FAILed. ---

[GitHub] spark issue #18555: [SPARK-21353][CORE]add checkValue in spark.internal.conf...

Github user SparkQA commented on the issue: https://github.com/apache/spark/pull/18555 **[Test build #79634 has finished](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/79634/testReport)** for PR 18555 at commit

[GitHub] spark issue #18555: [SPARK-21353][CORE]add checkValue in spark.internal.conf...

Github user SparkQA commented on the issue: https://github.com/apache/spark/pull/18555 **[Test build #79634 has started](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/79634/testReport)** for PR 18555 at commit

[GitHub] spark issue #18555: [SPARK-21353][CORE]add checkValue in spark.internal.conf...

Github user heary-cao commented on the issue: https://github.com/apache/spark/pull/18555 @gatorsmile thank you. I have update it. please review it again. thanks. --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as

[GitHub] spark issue #18641: [SPARK-21413][SQL] Fix 64KB JVM bytecode limit problem i...

Github user AmplabJenkins commented on the issue: https://github.com/apache/spark/pull/18641 Test FAILed. Refer to this link for build results (access rights to CI server needed): https://amplab.cs.berkeley.edu/jenkins//job/SparkPullRequestBuilder/79632/ Test FAILed. ---

[GitHub] spark issue #18641: [SPARK-21413][SQL] Fix 64KB JVM bytecode limit problem i...

Github user AmplabJenkins commented on the issue: https://github.com/apache/spark/pull/18641 Merged build finished. Test FAILed. --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this feature

[GitHub] spark issue #18641: [SPARK-21413][SQL] Fix 64KB JVM bytecode limit problem i...

Github user SparkQA commented on the issue: https://github.com/apache/spark/pull/18641 **[Test build #79632 has finished](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/79632/testReport)** for PR 18641 at commit

[GitHub] spark issue #17373: [SPARK-12664] Expose probability in mlp model

Github user LeoIV commented on the issue: https://github.com/apache/spark/pull/17373 Right 🙈 That explains why it works perfectly fine in with my classifier :-) --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If

[GitHub] spark issue #18642: [MINOR][REFACTORING] KeyValueGroupedDataset.mapGroupsWit...

Github user SparkQA commented on the issue: https://github.com/apache/spark/pull/18642 **[Test build #79633 has started](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/79633/testReport)** for PR 18642 at commit

[GitHub] spark pull request #18642: [MINOR][REFACTORING] KeyValueGroupedDataset.mapGr...

GitHub user jaceklaskowski opened a pull request: https://github.com/apache/spark/pull/18642 [MINOR][REFACTORING] KeyValueGroupedDataset.mapGroupsWithState uses flatMapGroupsWithState ## What changes were proposed in this pull request? Refactored

[GitHub] spark issue #18641: [SPARK-21413][SQL] Fix 64KB JVM bytecode limit problem i...

Github user SparkQA commented on the issue: https://github.com/apache/spark/pull/18641 **[Test build #79632 has started](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/79632/testReport)** for PR 18641 at commit

[GitHub] spark pull request #18641: [SPARK-21413][SQL] Fix 64KB JVM bytecode limit pr...

GitHub user kiszk opened a pull request: https://github.com/apache/spark/pull/18641 [SPARK-21413][SQL] Fix 64KB JVM bytecode limit problem in multiple projections with CASE WHEN ## What changes were proposed in this pull request? This PR changes casewhen's code generation

[GitHub] spark pull request #18625: [SPARK-21267][DOCS][MINOR] Follow up to avoid ref...

Github user asfgit closed the pull request at: https://github.com/apache/spark/pull/18625 --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this feature enabled and wishes so, or if the feature is

[GitHub] spark issue #18625: [SPARK-21267][DOCS][MINOR] Follow up to avoid referencin...

Github user srowen commented on the issue: https://github.com/apache/spark/pull/18625 Merged to master/2.2 --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this feature enabled and wishes so,

[GitHub] spark issue #17373: [SPARK-12664] Expose probability in mlp model

Github user WeichenXu123 commented on the issue: https://github.com/apache/spark/pull/17373 They are, I think some values are something like 4.7532244532E-10 the display truncate them. Thanks Sent from my iPhone On 15 Jul 2017, at 12:35 AM, Leonard Hövelmann

[GitHub] spark issue #17373: [SPARK-12664] Expose probability in mlp model

Github user LeoIV commented on the issue: https://github.com/apache/spark/pull/17373 Alright, thanks. But have a look at the probabilities. They aren’t in [0,1] either. --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well.

[GitHub] spark issue #16441: [SPARK-14975][ML] Fixed GBTClassifier to predict probabi...

Github user yonglyhoo commented on the issue: https://github.com/apache/spark/pull/16441 Great! Thanks Nick!Yong Sent from Yahoo Mail for iPhone On Friday, July 14, 2017, 10:59 PM, Nick Pentreath wrote: Should be in 2.2.0