[GitHub] spark issue #15286: [SPARK-17710][HOTFIX] Fix ClassCircularityError in ReplS...

2016-09-28 Thread AmplabJenkins
Github user AmplabJenkins commented on the issue: https://github.com/apache/spark/pull/15286 Test PASSed. Refer to this link for build results (access rights to CI server needed): https://amplab.cs.berkeley.edu/jenkins//job/SparkPullRequestBuilder/66066/ Test PASSed. ---

[GitHub] spark issue #15286: [SPARK-17710][HOTFIX] Fix ClassCircularityError in ReplS...

2016-09-28 Thread AmplabJenkins
Github user AmplabJenkins commented on the issue: https://github.com/apache/spark/pull/15286 Merged build finished. Test PASSed. --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this feature e

[GitHub] spark issue #15286: [SPARK-17710][HOTFIX] Fix ClassCircularityError in ReplS...

2016-09-28 Thread SparkQA
Github user SparkQA commented on the issue: https://github.com/apache/spark/pull/15286 **[Test build #66066 has finished](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/66066/consoleFull)** for PR 15286 at commit [`59bfa23`](https://github.com/apache/spark/commit/

[GitHub] spark issue #15264: [SPARK-17477][SQL] SparkSQL cannot handle schema evoluti...

2016-09-28 Thread sameeragarwal
Github user sameeragarwal commented on the issue: https://github.com/apache/spark/pull/15264 That's a great explanation. Yes, this patch is really targeted at fixing the second issue and it does seem like a subset of SPARK-16544. If you have cycles towards working on a broader fix, it

[GitHub] spark issue #15078: [SPARK-17523] Support to generate build info file when b...

2016-09-28 Thread HyukjinKwon
Github user HyukjinKwon commented on the issue: https://github.com/apache/spark/pull/15078 From the discussion above, I would like to stay against this PR. --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project d

[GitHub] spark issue #15078: [SPARK-17523] Support to generate build info file when b...

2016-09-28 Thread felixcheung
Github user felixcheung commented on the issue: https://github.com/apache/spark/pull/15078 I'm not sure older Windows versions have powershell installed by default.. --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your

[GitHub] spark issue #15263: [SPARK-14525][SQL][FOLLOWUP] Clean up JdbcRelationProvid...

2016-09-28 Thread SparkQA
Github user SparkQA commented on the issue: https://github.com/apache/spark/pull/15263 **[Test build #66077 has started](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/66077/consoleFull)** for PR 15263 at commit [`15b38a8`](https://github.com/apache/spark/commit/1

[GitHub] spark issue #15263: [SPARK-14525][SQL][FOLLOWUP] Clean up JdbcRelationProvid...

2016-09-28 Thread SparkQA
Github user SparkQA commented on the issue: https://github.com/apache/spark/pull/15263 **[Test build #66076 has started](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/66076/consoleFull)** for PR 15263 at commit [`016f11d`](https://github.com/apache/spark/commit/0

[GitHub] spark issue #15290: [SPARK-17715] [Scheduler] Make task launch logs DEBUG

2016-09-28 Thread AmplabJenkins
Github user AmplabJenkins commented on the issue: https://github.com/apache/spark/pull/15290 Can one of the admins verify this patch? --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this feat

[GitHub] spark pull request #15290: [SPARK-17715] [Scheduler] Make task launch logs D...

2016-09-28 Thread dafrista
GitHub user dafrista opened a pull request: https://github.com/apache/spark/pull/15290 [SPARK-17715] [Scheduler] Make task launch logs DEBUG ## What changes were proposed in this pull request? Ramp down the task launch logs from INFO to DEBUG. Task launches can happen order

[GitHub] spark issue #15248: [SPARK-17671] Spark 2.0 history server summary page is s...

2016-09-28 Thread AmplabJenkins
Github user AmplabJenkins commented on the issue: https://github.com/apache/spark/pull/15248 Merged build finished. Test FAILed. --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this feature e

[GitHub] spark issue #15248: [SPARK-17671] Spark 2.0 history server summary page is s...

2016-09-28 Thread AmplabJenkins
Github user AmplabJenkins commented on the issue: https://github.com/apache/spark/pull/15248 Test FAILed. Refer to this link for build results (access rights to CI server needed): https://amplab.cs.berkeley.edu/jenkins//job/SparkPullRequestBuilder/66064/ Test FAILed. ---

[GitHub] spark issue #15248: [SPARK-17671] Spark 2.0 history server summary page is s...

2016-09-28 Thread SparkQA
Github user SparkQA commented on the issue: https://github.com/apache/spark/pull/15248 **[Test build #66064 has finished](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/66064/consoleFull)** for PR 15248 at commit [`07b78a3`](https://github.com/apache/spark/commit/

[GitHub] spark issue #15288: [SPARK-17697][ML] Fixed bug in summary calculations that...

2016-09-28 Thread AmplabJenkins
Github user AmplabJenkins commented on the issue: https://github.com/apache/spark/pull/15288 Test PASSed. Refer to this link for build results (access rights to CI server needed): https://amplab.cs.berkeley.edu/jenkins//job/SparkPullRequestBuilder/66072/ Test PASSed. ---

[GitHub] spark issue #15288: [SPARK-17697][ML] Fixed bug in summary calculations that...

2016-09-28 Thread AmplabJenkins
Github user AmplabJenkins commented on the issue: https://github.com/apache/spark/pull/15288 Merged build finished. Test PASSed. --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this feature e

[GitHub] spark issue #15288: [SPARK-17697][ML] Fixed bug in summary calculations that...

2016-09-28 Thread SparkQA
Github user SparkQA commented on the issue: https://github.com/apache/spark/pull/15288 **[Test build #66072 has finished](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/66072/consoleFull)** for PR 15288 at commit [`5c50861`](https://github.com/apache/spark/commit/

[GitHub] spark issue #15284: [SPARK-17368] [SQL] Add support for value class serializ...

2016-09-28 Thread AmplabJenkins
Github user AmplabJenkins commented on the issue: https://github.com/apache/spark/pull/15284 Test PASSed. Refer to this link for build results (access rights to CI server needed): https://amplab.cs.berkeley.edu/jenkins//job/SparkPullRequestBuilder/66060/ Test PASSed. ---

[GitHub] spark pull request #14897: [SPARK-17338][SQL] add global temp view

2016-09-28 Thread cloud-fan
Github user cloud-fan commented on a diff in the pull request: https://github.com/apache/spark/pull/14897#discussion_r81044097 --- Diff: sql/core/src/main/scala/org/apache/spark/sql/Dataset.scala --- @@ -2433,31 +2433,65 @@ class Dataset[T] private[sql]( } /**

[GitHub] spark issue #15284: [SPARK-17368] [SQL] Add support for value class serializ...

2016-09-28 Thread AmplabJenkins
Github user AmplabJenkins commented on the issue: https://github.com/apache/spark/pull/15284 Merged build finished. Test PASSed. --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this feature e

[GitHub] spark issue #15284: [SPARK-17368] [SQL] Add support for value class serializ...

2016-09-28 Thread SparkQA
Github user SparkQA commented on the issue: https://github.com/apache/spark/pull/15284 **[Test build #66060 has finished](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/66060/consoleFull)** for PR 15284 at commit [`a3dce9f`](https://github.com/apache/spark/commit/

[GitHub] spark issue #14644: [SPARK-14082][MESOS] Enable GPU support with Mesos

2016-09-28 Thread tnachen
Github user tnachen commented on the issue: https://github.com/apache/spark/pull/14644 @mgummelt @srowen Please review as well --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this feature ena

[GitHub] spark pull request #15257: [SPARK-17683][SQL] Support ArrayType in Literal.a...

2016-09-28 Thread maropu
Github user maropu commented on a diff in the pull request: https://github.com/apache/spark/pull/15257#discussion_r81043337 --- Diff: sql/catalyst/src/main/scala/org/apache/spark/sql/catalyst/expressions/literals.scala --- @@ -60,6 +70,45 @@ object Literal { }

[GitHub] spark issue #15248: [SPARK-17671] Spark 2.0 history server summary page is s...

2016-09-28 Thread SparkQA
Github user SparkQA commented on the issue: https://github.com/apache/spark/pull/15248 **[Test build #66062 has finished](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/66062/consoleFull)** for PR 15248 at commit [`a07ff90`](https://github.com/apache/spark/commit/

[GitHub] spark issue #15257: [SPARK-17683][SQL] Support ArrayType in Literal.apply

2016-09-28 Thread SparkQA
Github user SparkQA commented on the issue: https://github.com/apache/spark/pull/15257 **[Test build #66075 has started](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/66075/consoleFull)** for PR 15257 at commit [`c843840`](https://github.com/apache/spark/commit/c

[GitHub] spark issue #15248: [SPARK-17671] Spark 2.0 history server summary page is s...

2016-09-28 Thread AmplabJenkins
Github user AmplabJenkins commented on the issue: https://github.com/apache/spark/pull/15248 Test FAILed. Refer to this link for build results (access rights to CI server needed): https://amplab.cs.berkeley.edu/jenkins//job/SparkPullRequestBuilder/66062/ Test FAILed. ---

[GitHub] spark issue #15248: [SPARK-17671] Spark 2.0 history server summary page is s...

2016-09-28 Thread AmplabJenkins
Github user AmplabJenkins commented on the issue: https://github.com/apache/spark/pull/15248 Merged build finished. Test FAILed. --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this feature e

[GitHub] spark issue #15269: [WIP][TEST] Experiment with running Scoverage in tests

2016-09-28 Thread AmplabJenkins
Github user AmplabJenkins commented on the issue: https://github.com/apache/spark/pull/15269 Test FAILed. Refer to this link for build results (access rights to CI server needed): https://amplab.cs.berkeley.edu/jenkins//job/SparkPullRequestBuilder/66049/ Test FAILed. ---

[GitHub] spark issue #15269: [WIP][TEST] Experiment with running Scoverage in tests

2016-09-28 Thread AmplabJenkins
Github user AmplabJenkins commented on the issue: https://github.com/apache/spark/pull/15269 Merged build finished. Test FAILed. --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this feature e

[GitHub] spark issue #15269: [WIP][TEST] Experiment with running Scoverage in tests

2016-09-28 Thread SparkQA
Github user SparkQA commented on the issue: https://github.com/apache/spark/pull/15269 **[Test build #66049 has finished](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/66049/consoleFull)** for PR 15269 at commit [`e22b406`](https://github.com/apache/spark/commit/

[GitHub] spark pull request #15289: [SPARK-17712][SQL] Fix invalid pushdown of data-i...

2016-09-28 Thread JoshRosen
Github user JoshRosen commented on a diff in the pull request: https://github.com/apache/spark/pull/15289#discussion_r81040912 --- Diff: sql/catalyst/src/main/scala/org/apache/spark/sql/catalyst/optimizer/Optimizer.scala --- @@ -710,7 +710,7 @@ object PushDownPredicate extends Rul

[GitHub] spark issue #15289: [SPARK-17712][SQL] Fix invalid pushdown of data-independ...

2016-09-28 Thread SparkQA
Github user SparkQA commented on the issue: https://github.com/apache/spark/pull/15289 **[Test build #66074 has started](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/66074/consoleFull)** for PR 15289 at commit [`87504e4`](https://github.com/apache/spark/commit/8

[GitHub] spark issue #14659: [SPARK-16757] Set up Spark caller context to HDFS and YA...

2016-09-28 Thread Sherry302
Github user Sherry302 commented on the issue: https://github.com/apache/spark/pull/14659 Hi, @tgravescs [SPARK-17714](https://issues.apache.org/jira/browse/SPARK-17714) has been created for further investigation. --- If your project is set up for it, you can reply to this email and

[GitHub] spark pull request #15249: [SPARK-17675] [CORE] Expand Blacklist for TaskSet...

2016-09-28 Thread kayousterhout
Github user kayousterhout commented on a diff in the pull request: https://github.com/apache/spark/pull/15249#discussion_r81040313 --- Diff: core/src/main/scala/org/apache/spark/scheduler/BlacklistTracker.scala --- @@ -0,0 +1,130 @@ +/* + * Licensed to the Apache Software F

[GitHub] spark issue #15247: [SPARK-17672] Spark 2.0 history server web Ui takes too ...

2016-09-28 Thread AmplabJenkins
Github user AmplabJenkins commented on the issue: https://github.com/apache/spark/pull/15247 Test FAILed. Refer to this link for build results (access rights to CI server needed): https://amplab.cs.berkeley.edu/jenkins//job/SparkPullRequestBuilder/66059/ Test FAILed. ---

[GitHub] spark pull request #15289: [SPARK-17712][SQL] Fix invalid pushdown of data-i...

2016-09-28 Thread JoshRosen
GitHub user JoshRosen opened a pull request: https://github.com/apache/spark/pull/15289 [SPARK-17712][SQL] Fix invalid pushdown of data-independent filters beneath aggregates ## What changes were proposed in this pull request? This patch fixes a minor correctness issue impa

[GitHub] spark issue #15247: [SPARK-17672] Spark 2.0 history server web Ui takes too ...

2016-09-28 Thread AmplabJenkins
Github user AmplabJenkins commented on the issue: https://github.com/apache/spark/pull/15247 Merged build finished. Test FAILed. --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this feature e

[GitHub] spark issue #15247: [SPARK-17672] Spark 2.0 history server web Ui takes too ...

2016-09-28 Thread SparkQA
Github user SparkQA commented on the issue: https://github.com/apache/spark/pull/15247 **[Test build #66059 has finished](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/66059/consoleFull)** for PR 15247 at commit [`67ea2de`](https://github.com/apache/spark/commit/

[GitHub] spark issue #15148: [SPARK-5992][ML] Locality Sensitive Hashing

2016-09-28 Thread AmplabJenkins
Github user AmplabJenkins commented on the issue: https://github.com/apache/spark/pull/15148 Test PASSed. Refer to this link for build results (access rights to CI server needed): https://amplab.cs.berkeley.edu/jenkins//job/SparkPullRequestBuilder/66068/ Test PASSed. ---

[GitHub] spark issue #15148: [SPARK-5992][ML] Locality Sensitive Hashing

2016-09-28 Thread AmplabJenkins
Github user AmplabJenkins commented on the issue: https://github.com/apache/spark/pull/15148 Merged build finished. Test PASSed. --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this feature e

[GitHub] spark issue #15148: [SPARK-5992][ML] Locality Sensitive Hashing

2016-09-28 Thread SparkQA
Github user SparkQA commented on the issue: https://github.com/apache/spark/pull/15148 **[Test build #66068 has finished](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/66068/consoleFull)** for PR 15148 at commit [`f82f3fe`](https://github.com/apache/spark/commit/

[GitHub] spark pull request #15257: [SPARK-17683][SQL] Support ArrayType in Literal.a...

2016-09-28 Thread jodersky
Github user jodersky commented on a diff in the pull request: https://github.com/apache/spark/pull/15257#discussion_r81033312 --- Diff: sql/catalyst/src/main/scala/org/apache/spark/sql/catalyst/expressions/literals.scala --- @@ -60,6 +70,45 @@ object Literal { }

[GitHub] spark pull request #15208: [SPARK-17641][SQL] Collect_list/Collect_set shoul...

2016-09-28 Thread asfgit
Github user asfgit closed the pull request at: https://github.com/apache/spark/pull/15208 --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this feature enabled and wishes so, or if the feature is ena

[GitHub] spark issue #15208: [SPARK-17641][SQL] Collect_list/Collect_set should not c...

2016-09-28 Thread rxin
Github user rxin commented on the issue: https://github.com/apache/spark/pull/15208 Merging in master/2.0. --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this feature enabled and wishes so,

[GitHub] spark pull request #15287: [SPARK-17713] [SQL] Move row-datasource related t...

2016-09-28 Thread asfgit
Github user asfgit closed the pull request at: https://github.com/apache/spark/pull/15287 --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this feature enabled and wishes so, or if the feature is ena

[GitHub] spark issue #15248: [SPARK-17671] Spark 2.0 history server summary page is s...

2016-09-28 Thread SparkQA
Github user SparkQA commented on the issue: https://github.com/apache/spark/pull/15248 **[Test build #66073 has started](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/66073/consoleFull)** for PR 15248 at commit [`4ea20b5`](https://github.com/apache/spark/commit/4

[GitHub] spark issue #15287: [SPARK-17713] [SQL] Move row-datasource related tests ou...

2016-09-28 Thread rxin
Github user rxin commented on the issue: https://github.com/apache/spark/pull/15287 Thanks - merging in master. --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this feature enabled and wishe

[GitHub] spark issue #15282: [SPARK-17673] [SQL] Incorrect exchange reuse with RowDat...

2016-09-28 Thread rxin
Github user rxin commented on the issue: https://github.com/apache/spark/pull/15282 Merging in branch-2.0. --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this feature enabled and wishes so,

[GitHub] spark pull request #15249: [SPARK-17675] [CORE] Expand Blacklist for TaskSet...

2016-09-28 Thread markhamstra
Github user markhamstra commented on a diff in the pull request: https://github.com/apache/spark/pull/15249#discussion_r81036771 --- Diff: core/src/main/scala/org/apache/spark/scheduler/TaskSetManager.scala --- @@ -592,34 +587,54 @@ private[spark] class TaskSetManager( * fa

[GitHub] spark issue #15288: [SPARK-17697][ML] Fixed bug in summary calculations that...

2016-09-28 Thread BryanCutler
Github user BryanCutler commented on the issue: https://github.com/apache/spark/pull/15288 @jkbradley I checked the other algorithms for similar issues. `ml.LinearRegression` and `ml.evaluation.*` already cast Labels to `DoubleType`, but `GeneralizedLinearRegression` did have errors

[GitHub] spark issue #15078: [SPARK-17523] Support to generate build info file when b...

2016-09-28 Thread HyukjinKwon
Github user HyukjinKwon commented on the issue: https://github.com/apache/spark/pull/15078 FWIW, doesn't Power shell allows executing bash? (I haven't tried that by myself but I think I saw some usages and documentation before) --- If your project is set up for it, you can reply to t

[GitHub] spark issue #15288: [SPARK-17697][ML] Fixed bug in summary calculations that...

2016-09-28 Thread SparkQA
Github user SparkQA commented on the issue: https://github.com/apache/spark/pull/15288 **[Test build #66072 has started](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/66072/consoleFull)** for PR 15288 at commit [`5c50861`](https://github.com/apache/spark/commit/5

[GitHub] spark pull request #15288: [SPARK-17697][ML] Fixed bug in summary calculatio...

2016-09-28 Thread BryanCutler
GitHub user BryanCutler opened a pull request: https://github.com/apache/spark/pull/15288 [SPARK-17697][ML] Fixed bug in summary calculations that pattern match against label without casting ## What changes were proposed in this pull request? In calling LogisticRegression.evalua

[GitHub] spark issue #15264: [SPARK-17477][SQL] SparkSQL cannot handle schema evoluti...

2016-09-28 Thread HyukjinKwon
Github user HyukjinKwon commented on the issue: https://github.com/apache/spark/pull/15264 I wouldn't stay against this if you strongly this one is a right fix. We could go merging this and then introduce a general upcasting logic later. --- If your project is set up for it, you can

[GitHub] spark issue #15287: [SPARK-17713] [SQL] Move row-datasource related tests ou...

2016-09-28 Thread SparkQA
Github user SparkQA commented on the issue: https://github.com/apache/spark/pull/15287 **[Test build #66071 has started](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/66071/consoleFull)** for PR 15287 at commit [`5e5a6f1`](https://github.com/apache/spark/commit/5

[GitHub] spark issue #15264: [SPARK-17477][SQL] SparkSQL cannot handle schema evoluti...

2016-09-28 Thread HyukjinKwon
Github user HyukjinKwon commented on the issue: https://github.com/apache/spark/pull/15264 Hi @sameeragarwal , I just meant if we want to read new and old Parquet files (one having int and one having long for the same column) described in the JIRA and PR description, we could do one o

[GitHub] spark pull request #15249: [SPARK-17675] [CORE] Expand Blacklist for TaskSet...

2016-09-28 Thread markhamstra
Github user markhamstra commented on a diff in the pull request: https://github.com/apache/spark/pull/15249#discussion_r81035029 --- Diff: core/src/main/scala/org/apache/spark/scheduler/TaskSetManager.scala --- @@ -478,8 +473,8 @@ private[spark] class TaskSetManager(

[GitHub] spark pull request #15287: [SPARK-17713] [SQL] Move row-datasource related t...

2016-09-28 Thread ericl
GitHub user ericl opened a pull request: https://github.com/apache/spark/pull/15287 [SPARK-17713] [SQL] Move row-datasource related tests out of JDBCSuite ## What changes were proposed in this pull request? As a followup for https://github.com/apache/spark/pull/15273 we shou

[GitHub] spark issue #14553: [SPARK-16963] [STREAMING] [SQL] Changes to Source trait ...

2016-09-28 Thread AmplabJenkins
Github user AmplabJenkins commented on the issue: https://github.com/apache/spark/pull/14553 Merged build finished. Test FAILed. --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this feature e

[GitHub] spark issue #14553: [SPARK-16963] [STREAMING] [SQL] Changes to Source trait ...

2016-09-28 Thread AmplabJenkins
Github user AmplabJenkins commented on the issue: https://github.com/apache/spark/pull/14553 Test FAILed. Refer to this link for build results (access rights to CI server needed): https://amplab.cs.berkeley.edu/jenkins//job/SparkPullRequestBuilder/66070/ Test FAILed. ---

[GitHub] spark issue #14553: [SPARK-16963] [STREAMING] [SQL] Changes to Source trait ...

2016-09-28 Thread SparkQA
Github user SparkQA commented on the issue: https://github.com/apache/spark/pull/14553 **[Test build #66070 has finished](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/66070/consoleFull)** for PR 14553 at commit [`6334a4b`](https://github.com/apache/spark/commit/

[GitHub] spark issue #14553: [SPARK-16963] [STREAMING] [SQL] Changes to Source trait ...

2016-09-28 Thread SparkQA
Github user SparkQA commented on the issue: https://github.com/apache/spark/pull/14553 **[Test build #66070 has started](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/66070/consoleFull)** for PR 14553 at commit [`6334a4b`](https://github.com/apache/spark/commit/6

[GitHub] spark issue #15149: [SPARK-17057] [ML] ProbabilisticClassifierModels' thresh...

2016-09-28 Thread jkbradley
Github user jkbradley commented on the issue: https://github.com/apache/spark/pull/15149 Thanks all for handling this edge case! Coming late to the discussion...but I like the decisions made here. --- If your project is set up for it, you can reply to this email and have your reply

[GitHub] spark issue #14872: [SPARK-3162][MLlib][WIP] Add local tree training for dec...

2016-09-28 Thread AmplabJenkins
Github user AmplabJenkins commented on the issue: https://github.com/apache/spark/pull/14872 Merged build finished. Test FAILed. --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this feature e

[GitHub] spark issue #14872: [SPARK-3162][MLlib][WIP] Add local tree training for dec...

2016-09-28 Thread AmplabJenkins
Github user AmplabJenkins commented on the issue: https://github.com/apache/spark/pull/14872 Test FAILed. Refer to this link for build results (access rights to CI server needed): https://amplab.cs.berkeley.edu/jenkins//job/SparkPullRequestBuilder/66067/ Test FAILed. ---

[GitHub] spark issue #14872: [SPARK-3162][MLlib][WIP] Add local tree training for dec...

2016-09-28 Thread SparkQA
Github user SparkQA commented on the issue: https://github.com/apache/spark/pull/14872 **[Test build #66067 has finished](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/66067/consoleFull)** for PR 14872 at commit [`ee56ffe`](https://github.com/apache/spark/commit/

[GitHub] spark issue #15047: [SPARK-17495] [SQL] Add Hash capability semantically equ...

2016-09-28 Thread SparkQA
Github user SparkQA commented on the issue: https://github.com/apache/spark/pull/15047 **[Test build #66069 has started](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/66069/consoleFull)** for PR 15047 at commit [`238dbb8`](https://github.com/apache/spark/commit/2

[GitHub] spark issue #15047: [SPARK-17495] [SQL] Add Hash capability semantically equ...

2016-09-28 Thread tejasapatil
Github user tejasapatil commented on the issue: https://github.com/apache/spark/pull/15047 jenkins retest this please --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this feature enabled and

[GitHub] spark issue #15047: [SPARK-17495] [SQL] Add Hash capability semantically equ...

2016-09-28 Thread AmplabJenkins
Github user AmplabJenkins commented on the issue: https://github.com/apache/spark/pull/15047 Merged build finished. Test FAILed. --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this feature e

[GitHub] spark issue #15047: [SPARK-17495] [SQL] Add Hash capability semantically equ...

2016-09-28 Thread AmplabJenkins
Github user AmplabJenkins commented on the issue: https://github.com/apache/spark/pull/15047 Test FAILed. Refer to this link for build results (access rights to CI server needed): https://amplab.cs.berkeley.edu/jenkins//job/SparkPullRequestBuilder/66058/ Test FAILed. ---

[GitHub] spark issue #15047: [SPARK-17495] [SQL] Add Hash capability semantically equ...

2016-09-28 Thread SparkQA
Github user SparkQA commented on the issue: https://github.com/apache/spark/pull/15047 **[Test build #66058 has finished](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/66058/consoleFull)** for PR 15047 at commit [`238dbb8`](https://github.com/apache/spark/commit/

[GitHub] spark issue #15286: [SPARK-17710][HOTFIX] Fix ClassCircularityError in ReplS...

2016-09-28 Thread Sherry302
Github user Sherry302 commented on the issue: https://github.com/apache/spark/pull/15286 @JoshRosen Yes. The title has been changed. @tgravescs Yes. Now I am creating a separate jira to investigate this more. --- If your project is set up for it, you can reply to this email and ha

[GitHub] spark issue #15148: [SPARK-5992][ML] Locality Sensitive Hashing

2016-09-28 Thread SparkQA
Github user SparkQA commented on the issue: https://github.com/apache/spark/pull/15148 **[Test build #66068 has started](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/66068/consoleFull)** for PR 15148 at commit [`f82f3fe`](https://github.com/apache/spark/commit/f

[GitHub] spark issue #15286: [SPARK-16757][HOTFIX] Fix ClassCircularityError in ReplS...

2016-09-28 Thread JoshRosen
Github user JoshRosen commented on the issue: https://github.com/apache/spark/pull/15286 Can you change the JIRA number to SPARK-17710, which is the JIRA that I created for this build break? https://issues.apache.org/jira/browse/SPARK-17710 --- If your project is set up for

[GitHub] spark pull request #15148: [SPARK-5992][ML] Locality Sensitive Hashing

2016-09-28 Thread Yunni
Github user Yunni commented on a diff in the pull request: https://github.com/apache/spark/pull/15148#discussion_r81031684 --- Diff: mllib/src/main/scala/org/apache/spark/ml/feature/LSH.scala --- @@ -0,0 +1,322 @@ +/* + * Licensed to the Apache Software Foundation (ASF) unde

[GitHub] spark issue #15148: [SPARK-5992][ML] Locality Sensitive Hashing

2016-09-28 Thread Yunni
Github user Yunni commented on the issue: https://github.com/apache/spark/pull/15148 @jkbradley I see. Thanks Joseph! --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this feature enabled and

[GitHub] spark issue #15282: [SPARK-17673] [SQL] Incorrect exchange reuse with RowDat...

2016-09-28 Thread AmplabJenkins
Github user AmplabJenkins commented on the issue: https://github.com/apache/spark/pull/15282 Test PASSed. Refer to this link for build results (access rights to CI server needed): https://amplab.cs.berkeley.edu/jenkins//job/SparkPullRequestBuilder/66056/ Test PASSed. ---

[GitHub] spark issue #15282: [SPARK-17673] [SQL] Incorrect exchange reuse with RowDat...

2016-09-28 Thread AmplabJenkins
Github user AmplabJenkins commented on the issue: https://github.com/apache/spark/pull/15282 Merged build finished. Test PASSed. --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this feature e

[GitHub] spark issue #14872: [SPARK-3162][MLlib][WIP] Add local tree training for dec...

2016-09-28 Thread SparkQA
Github user SparkQA commented on the issue: https://github.com/apache/spark/pull/14872 **[Test build #66067 has started](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/66067/consoleFull)** for PR 14872 at commit [`ee56ffe`](https://github.com/apache/spark/commit/e

[GitHub] spark issue #15282: [SPARK-17673] [SQL] Incorrect exchange reuse with RowDat...

2016-09-28 Thread SparkQA
Github user SparkQA commented on the issue: https://github.com/apache/spark/pull/15282 **[Test build #66056 has finished](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/66056/consoleFull)** for PR 15282 at commit [`dde4834`](https://github.com/apache/spark/commit/

[GitHub] spark issue #15286: [SPARK-16757][HOTFIX] Fix ClassCircularityError in ReplS...

2016-09-28 Thread Sherry302
Github user Sherry302 commented on the issue: https://github.com/apache/spark/pull/15286 Yes. The title has been changed. Thanks. @tgravescs --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have t

[GitHub] spark issue #15248: [SPARK-17671] Spark 2.0 history server summary page is s...

2016-09-28 Thread AmplabJenkins
Github user AmplabJenkins commented on the issue: https://github.com/apache/spark/pull/15248 Test FAILed. Refer to this link for build results (access rights to CI server needed): https://amplab.cs.berkeley.edu/jenkins//job/SparkPullRequestBuilder/66063/ Test FAILed. ---

[GitHub] spark issue #15248: [SPARK-17671] Spark 2.0 history server summary page is s...

2016-09-28 Thread SparkQA
Github user SparkQA commented on the issue: https://github.com/apache/spark/pull/15248 **[Test build #66063 has finished](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/66063/consoleFull)** for PR 15248 at commit [`d81d9d5`](https://github.com/apache/spark/commit/

[GitHub] spark issue #15286: [SPARK-16757][HOTFIX] Fix ClassCircularityError in ReplS...

2016-09-28 Thread tgravescs
Github user tgravescs commented on the issue: https://github.com/apache/spark/pull/15286 changes look fine, waiting on Jenkins. --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this feature en

[GitHub] spark issue #15248: [SPARK-17671] Spark 2.0 history server summary page is s...

2016-09-28 Thread AmplabJenkins
Github user AmplabJenkins commented on the issue: https://github.com/apache/spark/pull/15248 Merged build finished. Test FAILed. --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this feature e

[GitHub] spark issue #15286: [SPARK-16757][HOTFIX] Fix ClassCircularityError in ReplS...

2016-09-28 Thread tgravescs
Github user tgravescs commented on the issue: https://github.com/apache/spark/pull/15286 Also please file a separate jira to investigate more. Link it to https://issues.apache.org/jira/browse/SPARK-15857 and if needed we pull in people more familiar with the Repl classloader stuff.

[GitHub] spark issue #15078: [SPARK-17523] Support to generate build info file when b...

2016-09-28 Thread jodersky
Github user jodersky commented on the issue: https://github.com/apache/spark/pull/15078 How wide-spread is powershell on windows computers? I assume that modern versions ship with it, but I also heard that they come with a bash-like shell in the latest version. Does the current build

[GitHub] spark issue #15286: [SPARK-16757][Follow UP] Fix ClassCircularityError in Re...

2016-09-28 Thread tgravescs
Github user tgravescs commented on the issue: https://github.com/apache/spark/pull/15286 please change [Follow UP] to [HOTFIX] --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this feature en

[GitHub] spark issue #14872: [SPARK-3162][MLlib][WIP] Add local tree training for dec...

2016-09-28 Thread jkbradley
Github user jkbradley commented on the issue: https://github.com/apache/spark/pull/14872 ok to test --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this feature enabled and wishes so, or if t

[GitHub] spark pull request #15172: [SPARK-13331] AES support for over-the-wire encry...

2016-09-28 Thread cjjnjust
Github user cjjnjust commented on a diff in the pull request: https://github.com/apache/spark/pull/15172#discussion_r81030532 --- Diff: common/network-common/src/main/java/org/apache/spark/network/sasl/aes/SparkAesCipher.java --- @@ -0,0 +1,270 @@ +/* + * Licensed to the A

[GitHub] spark issue #15148: [SPARK-5992][ML] Locality Sensitive Hashing

2016-09-28 Thread jkbradley
Github user jkbradley commented on the issue: https://github.com/apache/spark/pull/15148 > Our use case is mainly using similarity join to find fraud trips. I think I can change the NN-search to only single-probing NN search of dataframe if you think it's fine. What do you think?

[GitHub] spark issue #15062: SPARK-17424: Fix unsound substitution bug in ScalaReflec...

2016-09-28 Thread jodersky
Github user jodersky commented on the issue: https://github.com/apache/spark/pull/15062 Oh, I was too quick to comment, I see a complete description is in the JIRA. It would still be good if you could add a test though. --- If your project is set up for it, you can reply to this e

[GitHub] spark issue #14659: [SPARK-16757] Set up Spark caller context to HDFS and YA...

2016-09-28 Thread Sherry302
Github user Sherry302 commented on the issue: https://github.com/apache/spark/pull/14659 Thanks @tgravescs yes. I have created a PR [15286](https://github.com/apache/spark/pull/15286). --- If your project is set up for it, you can reply to this email and have your reply appear on Gi

[GitHub] spark pull request #15148: [SPARK-5992][ML] Locality Sensitive Hashing

2016-09-28 Thread jkbradley
Github user jkbradley commented on a diff in the pull request: https://github.com/apache/spark/pull/15148#discussion_r81029208 --- Diff: mllib/src/main/scala/org/apache/spark/ml/feature/LSH.scala --- @@ -0,0 +1,322 @@ +/* + * Licensed to the Apache Software Foundation (ASF)

[GitHub] spark issue #15062: SPARK-17424: Fix unsound substitution bug in ScalaReflec...

2016-09-28 Thread jodersky
Github user jodersky commented on the issue: https://github.com/apache/spark/pull/15062 I don't quite understand what use-case this patch fixes. Can you provide an example (in the form of a test) that reproduces the issue? --- If your project is set up for it, you can reply to this e

[GitHub] spark issue #15286: [SPARK-16757][Follow UP] Fix ClassCircularityError in Re...

2016-09-28 Thread SparkQA
Github user SparkQA commented on the issue: https://github.com/apache/spark/pull/15286 **[Test build #66066 has started](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/66066/consoleFull)** for PR 15286 at commit [`59bfa23`](https://github.com/apache/spark/commit/5

[GitHub] spark issue #15285: [SPARK-17711] Compress rolled executor log

2016-09-28 Thread AmplabJenkins
Github user AmplabJenkins commented on the issue: https://github.com/apache/spark/pull/15285 Can one of the admins verify this patch? --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this feat

[GitHub] spark pull request #15286: [SPARK-16757][Follow UP] Fix ClassCircularityErro...

2016-09-28 Thread Sherry302
GitHub user Sherry302 opened a pull request: https://github.com/apache/spark/pull/15286 [SPARK-16757][Follow UP] Fix ClassCircularityError in ReplSuite tests in Maven build: use 'Class.forName' instead of 'Utils.classForName' ## What changes were proposed in this pull request? F

[GitHub] spark issue #15281: [DOCS] Reorganize explanation of Accumulators and Broadc...

2016-09-28 Thread vanzin
Github user vanzin commented on the issue: https://github.com/apache/spark/pull/15281 Looks fine but I second Reynold's question. Sounds like no modifications from your summary. --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as

[GitHub] spark pull request #15285: [SPARK-17711] Compress rolled executor log

2016-09-28 Thread loneknightpy
GitHub user loneknightpy opened a pull request: https://github.com/apache/spark/pull/15285 [SPARK-17711] Compress rolled executor log ## What changes were proposed in this pull request? This PR adds support for executor log compression. ## How was this patch tested

[GitHub] spark issue #15148: [SPARK-5992][ML] Locality Sensitive Hashing

2016-09-28 Thread AmplabJenkins
Github user AmplabJenkins commented on the issue: https://github.com/apache/spark/pull/15148 Merged build finished. Test FAILed. --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this feature e

<    1   2   3   4   5   >