[GitHub] spark issue #15148: [SPARK-5992][ML] Locality Sensitive Hashing

2016-09-28 Thread AmplabJenkins
Github user AmplabJenkins commented on the issue: https://github.com/apache/spark/pull/15148 Test FAILed. Refer to this link for build results (access rights to CI server needed): https://amplab.cs.berkeley.edu/jenkins//job/SparkPullRequestBuilder/66065/ Test FAILed. ---

[GitHub] spark issue #15148: [SPARK-5992][ML] Locality Sensitive Hashing

2016-09-28 Thread SparkQA
Github user SparkQA commented on the issue: https://github.com/apache/spark/pull/15148 **[Test build #66065 has finished](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/66065/consoleFull)** for PR 15148 at commit [`8f04ee8`](https://github.com/apache/spark/commit/

[GitHub] spark issue #15090: [SPARK-17073] [SQL] generate column-level statistics

2016-09-28 Thread AmplabJenkins
Github user AmplabJenkins commented on the issue: https://github.com/apache/spark/pull/15090 Merged build finished. Test PASSed. --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this feature e

[GitHub] spark issue #15090: [SPARK-17073] [SQL] generate column-level statistics

2016-09-28 Thread AmplabJenkins
Github user AmplabJenkins commented on the issue: https://github.com/apache/spark/pull/15090 Test PASSed. Refer to this link for build results (access rights to CI server needed): https://amplab.cs.berkeley.edu/jenkins//job/SparkPullRequestBuilder/66053/ Test PASSed. ---

[GitHub] spark issue #15090: [SPARK-17073] [SQL] generate column-level statistics

2016-09-28 Thread SparkQA
Github user SparkQA commented on the issue: https://github.com/apache/spark/pull/15090 **[Test build #66053 has finished](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/66053/consoleFull)** for PR 15090 at commit [`1d3dd62`](https://github.com/apache/spark/commit/

[GitHub] spark issue #15264: [SPARK-17477][SQL] SparkSQL cannot handle schema evoluti...

2016-09-28 Thread sameeragarwal
Github user sameeragarwal commented on the issue: https://github.com/apache/spark/pull/15264 @HyukjinKwon thanks for taking a look at the previous patch. I suggested this fix to @wgtmac offline but perhaps I didn't quite understand the "old"/"new" file issue that you mentioned. Can yo

[GitHub] spark issue #15248: [SPARK-17671] Spark 2.0 history server summary page is s...

2016-09-28 Thread SparkQA
Github user SparkQA commented on the issue: https://github.com/apache/spark/pull/15248 **[Test build #66064 has started](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/66064/consoleFull)** for PR 15248 at commit [`07b78a3`](https://github.com/apache/spark/commit/0

[GitHub] spark issue #15148: [SPARK-5992][ML] Locality Sensitive Hashing

2016-09-28 Thread SparkQA
Github user SparkQA commented on the issue: https://github.com/apache/spark/pull/15148 **[Test build #66065 has started](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/66065/consoleFull)** for PR 15148 at commit [`8f04ee8`](https://github.com/apache/spark/commit/8

[GitHub] spark pull request #15248: [SPARK-17671] Spark 2.0 history server summary pa...

2016-09-28 Thread wgtmac
Github user wgtmac commented on a diff in the pull request: https://github.com/apache/spark/pull/15248#discussion_r81027833 --- Diff: core/src/main/scala/org/apache/spark/deploy/history/HistoryServer.scala --- @@ -179,7 +180,11 @@ class HistoryServer( } --- End diff --

[GitHub] spark issue #15248: [SPARK-17671] Spark 2.0 history server summary page is s...

2016-09-28 Thread SparkQA
Github user SparkQA commented on the issue: https://github.com/apache/spark/pull/15248 **[Test build #66063 has started](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/66063/consoleFull)** for PR 15248 at commit [`d81d9d5`](https://github.com/apache/spark/commit/d

[GitHub] spark issue #15274: [SPARK-17699] Support for parsing JSON string columns

2016-09-28 Thread SparkQA
Github user SparkQA commented on the issue: https://github.com/apache/spark/pull/15274 **[Test build #66052 has finished](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/66052/consoleFull)** for PR 15274 at commit [`360b97b`](https://github.com/apache/spark/commit/

[GitHub] spark pull request #15270: [SPARK-17696][core] Partial backport of SPARK-123...

2016-09-28 Thread vanzin
Github user vanzin closed the pull request at: https://github.com/apache/spark/pull/15270 --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this feature enabled and wishes so, or if the feature is ena

[GitHub] spark issue #15248: [SPARK-17671] Spark 2.0 history server summary page is s...

2016-09-28 Thread SparkQA
Github user SparkQA commented on the issue: https://github.com/apache/spark/pull/15248 **[Test build #66062 has started](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/66062/consoleFull)** for PR 15248 at commit [`a07ff90`](https://github.com/apache/spark/commit/a

[GitHub] spark issue #15148: [SPARK-5992][ML] Locality Sensitive Hashing

2016-09-28 Thread AmplabJenkins
Github user AmplabJenkins commented on the issue: https://github.com/apache/spark/pull/15148 Merged build finished. Test FAILed. --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this feature e

[GitHub] spark issue #15148: [SPARK-5992][ML] Locality Sensitive Hashing

2016-09-28 Thread AmplabJenkins
Github user AmplabJenkins commented on the issue: https://github.com/apache/spark/pull/15148 Test FAILed. Refer to this link for build results (access rights to CI server needed): https://amplab.cs.berkeley.edu/jenkins//job/SparkPullRequestBuilder/66061/ Test FAILed. ---

[GitHub] spark issue #15148: [SPARK-5992][ML] Locality Sensitive Hashing

2016-09-28 Thread SparkQA
Github user SparkQA commented on the issue: https://github.com/apache/spark/pull/15148 **[Test build #66061 has finished](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/66061/consoleFull)** for PR 15148 at commit [`f805658`](https://github.com/apache/spark/commit/

[GitHub] spark issue #15148: [SPARK-5992][ML] Locality Sensitive Hashing

2016-09-28 Thread SparkQA
Github user SparkQA commented on the issue: https://github.com/apache/spark/pull/15148 **[Test build #66061 has started](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/66061/consoleFull)** for PR 15148 at commit [`f805658`](https://github.com/apache/spark/commit/f

[GitHub] spark issue #15284: [SPARK-17368] [SQL] Add support for value class serializ...

2016-09-28 Thread SparkQA
Github user SparkQA commented on the issue: https://github.com/apache/spark/pull/15284 **[Test build #66060 has started](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/66060/consoleFull)** for PR 15284 at commit [`a3dce9f`](https://github.com/apache/spark/commit/a

[GitHub] spark pull request #15284: [SPARK-17368] [SQL] Add support for value class s...

2016-09-28 Thread jodersky
Github user jodersky commented on a diff in the pull request: https://github.com/apache/spark/pull/15284#discussion_r81025673 --- Diff: sql/catalyst/src/test/scala/org/apache/spark/sql/catalyst/encoders/ExpressionEncoderSuite.scala --- @@ -66,8 +66,6 @@ case class RepeatedData(

[GitHub] spark pull request #15284: [SPARK-17368] [SQL] Add support for value class s...

2016-09-28 Thread jodersky
GitHub user jodersky opened a pull request: https://github.com/apache/spark/pull/15284 [SPARK-17368] [SQL] Add support for value class serialization and deserialization ## What changes were proposed in this pull request? Value classes were unsupported because catalyst data types

[GitHub] spark issue #15274: [SPARK-17699] Support for parsing JSON string columns

2016-09-28 Thread AmplabJenkins
Github user AmplabJenkins commented on the issue: https://github.com/apache/spark/pull/15274 Test PASSed. Refer to this link for build results (access rights to CI server needed): https://amplab.cs.berkeley.edu/jenkins//job/SparkPullRequestBuilder/66052/ Test PASSed. ---

[GitHub] spark issue #15274: [SPARK-17699] Support for parsing JSON string columns

2016-09-28 Thread AmplabJenkins
Github user AmplabJenkins commented on the issue: https://github.com/apache/spark/pull/15274 Merged build finished. Test PASSed. --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this feature e

[GitHub] spark issue #14897: [SPARK-17338][SQL] add global temp view

2016-09-28 Thread gatorsmile
Github user gatorsmile commented on the issue: https://github.com/apache/spark/pull/14897 Different from `CREATE TEMPORARY VIEW`, the view created by `CREATE GLOBAL TEMPORARY VIEW` is not allowed to insert. Could you add a test case for it? Thanks! --- If your project is set up for

[GitHub] spark issue #15247: [SPARK-17672] Spark 2.0 history server web Ui takes too ...

2016-09-28 Thread SparkQA
Github user SparkQA commented on the issue: https://github.com/apache/spark/pull/15247 **[Test build #66059 has started](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/66059/consoleFull)** for PR 15247 at commit [`67ea2de`](https://github.com/apache/spark/commit/6

[GitHub] spark issue #14659: [SPARK-16757] Set up Spark caller context to HDFS and YA...

2016-09-28 Thread tgravescs
Github user tgravescs commented on the issue: https://github.com/apache/spark/pull/14659 its there to make sure everyone is using the same classloader and to handle if it they are chained. I'm not really familiar with all the scenarios of the repl. I see the Suite itself is getting t

[GitHub] spark pull request #15249: [SPARK-17675] [CORE] Expand Blacklist for TaskSet...

2016-09-28 Thread markhamstra
Github user markhamstra commented on a diff in the pull request: https://github.com/apache/spark/pull/15249#discussion_r81024744 --- Diff: core/src/main/scala/org/apache/spark/scheduler/TaskSetManager.scala --- @@ -421,7 +412,11 @@ private[spark] class TaskSetManager( ma

[GitHub] spark issue #14720: SPARK-12868: Allow Add jar to add jars from hdfs/s3n url...

2016-09-28 Thread Parth-Brahmbhatt
Github user Parth-Brahmbhatt commented on the issue: https://github.com/apache/spark/pull/14720 Ping. --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this feature enabled and wishes so, or if

[GitHub] spark issue #15247: [SPARK-17672] Spark 2.0 history server web Ui takes too ...

2016-09-28 Thread ajbozarth
Github user ajbozarth commented on the issue: https://github.com/apache/spark/pull/15247 Jenkins, retest this please --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this feature enabled and w

[GitHub] spark issue #15270: [SPARK-17696][core] Partial backport of SPARK-12330 to b...

2016-09-28 Thread zsxwing
Github user zsxwing commented on the issue: https://github.com/apache/spark/pull/15270 @vanzin Merged. Could you close this PR, please? --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this fe

[GitHub] spark issue #15102: [SPARK-17346][SQL] Add Kafka source for Structured Strea...

2016-09-28 Thread AmplabJenkins
Github user AmplabJenkins commented on the issue: https://github.com/apache/spark/pull/15102 Merged build finished. Test PASSed. --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this feature e

[GitHub] spark issue #15239: [SPARK-17665][SPARKR] Support options/mode all for read/...

2016-09-28 Thread felixcheung
Github user felixcheung commented on the issue: https://github.com/apache/spark/pull/15239 We probably do, would be good to double check we have at least a test for each. Thanks! --- If your project is set up for it, you can reply to this email and have your reply appear on GitHu

[GitHub] spark issue #15102: [SPARK-17346][SQL] Add Kafka source for Structured Strea...

2016-09-28 Thread AmplabJenkins
Github user AmplabJenkins commented on the issue: https://github.com/apache/spark/pull/15102 Test PASSed. Refer to this link for build results (access rights to CI server needed): https://amplab.cs.berkeley.edu/jenkins//job/SparkPullRequestBuilder/66047/ Test PASSed. ---

[GitHub] spark issue #14659: [SPARK-16757] Set up Spark caller context to HDFS and YA...

2016-09-28 Thread Sherry302
Github user Sherry302 commented on the issue: https://github.com/apache/spark/pull/14659 @tgravescs @srowen Thanks. Using `Class.forName` which uses `this.getClass().getClassLoader()` by default makes all the tests passed (both sbt and maven). However there must be some reason we pref

[GitHub] spark issue #15102: [SPARK-17346][SQL] Add Kafka source for Structured Strea...

2016-09-28 Thread SparkQA
Github user SparkQA commented on the issue: https://github.com/apache/spark/pull/15102 **[Test build #66047 has finished](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/66047/consoleFull)** for PR 15102 at commit [`9d95d52`](https://github.com/apache/spark/commit/

[GitHub] spark pull request #15247: [SPARK-17672] Spark 2.0 history server web Ui tak...

2016-09-28 Thread wgtmac
GitHub user wgtmac reopened a pull request: https://github.com/apache/spark/pull/15247 [SPARK-17672] Spark 2.0 history server web Ui takes too long for a single application ## What changes were proposed in this pull request? Added a new API getApplicationInfo(appId: String)

[GitHub] spark pull request #15247: [SPARK-17672] Spark 2.0 history server web Ui tak...

2016-09-28 Thread wgtmac
Github user wgtmac closed the pull request at: https://github.com/apache/spark/pull/15247 --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this feature enabled and wishes so, or if the feature is ena

[GitHub] spark issue #15270: [SPARK-17696][core] Partial backport of SPARK-12330 to b...

2016-09-28 Thread zsxwing
Github user zsxwing commented on the issue: https://github.com/apache/spark/pull/15270 Okey. I'm going to merge it. We can change it in another PR on master. --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project

[GitHub] spark issue #15247: [SPARK-17672] Spark 2.0 history server web Ui takes too ...

2016-09-28 Thread wgtmac
Github user wgtmac commented on the issue: https://github.com/apache/spark/pull/15247 Anyone knows why the last test failed in the sql module? My change has nothing to do with it. --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub a

[GitHub] spark pull request #15249: [SPARK-17675] [CORE] Expand Blacklist for TaskSet...

2016-09-28 Thread markhamstra
Github user markhamstra commented on a diff in the pull request: https://github.com/apache/spark/pull/15249#discussion_r81022074 --- Diff: core/src/main/scala/org/apache/spark/scheduler/TaskSetManager.scala --- @@ -266,19 +263,11 @@ private[spark] class TaskSetManager( tas

[GitHub] spark pull request #15270: [SPARK-17696][core] Partial backport of SPARK-123...

2016-09-28 Thread vanzin
Github user vanzin commented on a diff in the pull request: https://github.com/apache/spark/pull/15270#discussion_r81021249 --- Diff: core/src/main/scala/org/apache/spark/executor/CoarseGrainedExecutorBackend.scala --- @@ -45,6 +46,7 @@ private[spark] class CoarseGrainedExecutorBa

[GitHub] spark issue #15247: [SPARK-17672] Spark 2.0 history server web Ui takes too ...

2016-09-28 Thread AmplabJenkins
Github user AmplabJenkins commented on the issue: https://github.com/apache/spark/pull/15247 Test FAILed. Refer to this link for build results (access rights to CI server needed): https://amplab.cs.berkeley.edu/jenkins//job/SparkPullRequestBuilder/66050/ Test FAILed. ---

[GitHub] spark issue #15247: [SPARK-17672] Spark 2.0 history server web Ui takes too ...

2016-09-28 Thread AmplabJenkins
Github user AmplabJenkins commented on the issue: https://github.com/apache/spark/pull/15247 Merged build finished. Test FAILed. --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this feature e

[GitHub] spark issue #15247: [SPARK-17672] Spark 2.0 history server web Ui takes too ...

2016-09-28 Thread SparkQA
Github user SparkQA commented on the issue: https://github.com/apache/spark/pull/15247 **[Test build #66050 has finished](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/66050/consoleFull)** for PR 15247 at commit [`67ea2de`](https://github.com/apache/spark/commit/

[GitHub] spark pull request #15249: [SPARK-17675] [CORE] Expand Blacklist for TaskSet...

2016-09-28 Thread markhamstra
Github user markhamstra commented on a diff in the pull request: https://github.com/apache/spark/pull/15249#discussion_r81020674 --- Diff: core/src/main/scala/org/apache/spark/scheduler/BlacklistTracker.scala --- @@ -0,0 +1,130 @@ +/* + * Licensed to the Apache Software Fou

[GitHub] spark issue #15283: [README] Edits syntax throughout ReadMe for better clari...

2016-09-28 Thread AmplabJenkins
Github user AmplabJenkins commented on the issue: https://github.com/apache/spark/pull/15283 Can one of the admins verify this patch? --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this feat

[GitHub] spark pull request #15249: [SPARK-17675] [CORE] Expand Blacklist for TaskSet...

2016-09-28 Thread markhamstra
Github user markhamstra commented on a diff in the pull request: https://github.com/apache/spark/pull/15249#discussion_r81020284 --- Diff: core/src/main/scala/org/apache/spark/scheduler/BlacklistTracker.scala --- @@ -0,0 +1,130 @@ +/* + * Licensed to the Apache Software Fou

[GitHub] spark pull request #15283: [README] Edits syntax throughout ReadMe for bette...

2016-09-28 Thread stephvelazquez
GitHub user stephvelazquez opened a pull request: https://github.com/apache/spark/pull/15283 [README] Edits syntax throughout ReadMe for better clarity/flow ## What changes were proposed in this pull request? (Please fill in changes proposed in this fix) Grammatical edit

[GitHub] spark issue #15270: [SPARK-17696][core] Partial backport of SPARK-12330 to b...

2016-09-28 Thread zsxwing
Github user zsxwing commented on the issue: https://github.com/apache/spark/pull/15270 LGTM except a nit. --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this feature enabled and wishes so, o

[GitHub] spark pull request #15270: [SPARK-17696][core] Partial backport of SPARK-123...

2016-09-28 Thread zsxwing
Github user zsxwing commented on a diff in the pull request: https://github.com/apache/spark/pull/15270#discussion_r81019238 --- Diff: core/src/main/scala/org/apache/spark/executor/CoarseGrainedExecutorBackend.scala --- @@ -45,6 +46,7 @@ private[spark] class CoarseGrainedExecutorB

[GitHub] spark pull request #15249: [SPARK-17675] [CORE] Expand Blacklist for TaskSet...

2016-09-28 Thread markhamstra
Github user markhamstra commented on a diff in the pull request: https://github.com/apache/spark/pull/15249#discussion_r81018983 --- Diff: core/src/main/scala/org/apache/spark/scheduler/TaskSetManager.scala --- @@ -50,22 +48,12 @@ import org.apache.spark.util.{AccumulatorV2, Clock,

[GitHub] spark issue #15148: [SPARK-5992][ML] Locality Sensitive Hashing

2016-09-28 Thread AmplabJenkins
Github user AmplabJenkins commented on the issue: https://github.com/apache/spark/pull/15148 Merged build finished. Test FAILed. --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this feature e

[GitHub] spark issue #15148: [SPARK-5992][ML] Locality Sensitive Hashing

2016-09-28 Thread AmplabJenkins
Github user AmplabJenkins commented on the issue: https://github.com/apache/spark/pull/15148 Test FAILed. Refer to this link for build results (access rights to CI server needed): https://amplab.cs.berkeley.edu/jenkins//job/SparkPullRequestBuilder/66055/ Test FAILed. ---

[GitHub] spark issue #15148: [SPARK-5992][ML] Locality Sensitive Hashing

2016-09-28 Thread SparkQA
Github user SparkQA commented on the issue: https://github.com/apache/spark/pull/15148 **[Test build #66055 has finished](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/66055/consoleFull)** for PR 15148 at commit [`b79ebbd`](https://github.com/apache/spark/commit/

[GitHub] spark issue #14897: [SPARK-17338][SQL] add global temp view

2016-09-28 Thread gatorsmile
Github user gatorsmile commented on the issue: https://github.com/apache/spark/pull/14897 `SHOW DATABASES` does not output the database name. I am wondering how users can quickly find the global temporary database name? ```Scala sql(s"SET spark.sql.globalTempDatabase").sh

[GitHub] spark pull request #15047: [SPARK-17495] [SQL] Add Hash capability semantica...

2016-09-28 Thread tejasapatil
Github user tejasapatil commented on a diff in the pull request: https://github.com/apache/spark/pull/15047#discussion_r81014894 --- Diff: sql/catalyst/src/test/scala/org/apache/spark/sql/HashByteArrayBenchmark.scala --- @@ -59,90 +59,110 @@ object HashByteArrayBenchmark {

[GitHub] spark issue #14659: [SPARK-16757] Set up Spark caller context to HDFS and YA...

2016-09-28 Thread tgravescs
Github user tgravescs commented on the issue: https://github.com/apache/spark/pull/14659 Yeah its definitely caused by the call in Task to the Utils.CallerContext.setCurrent(). It seems to be from it using the ExecutorClassLoader to go try to check the class for the executor and I gu

[GitHub] spark issue #15281: [DOCS] Reorganize explanation of Accumulators and Broadc...

2016-09-28 Thread rxin
Github user rxin commented on the issue: https://github.com/apache/spark/pull/15281 Thanks - this change makes sense. Did you change any of the content besides moving them? --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub

[GitHub] spark pull request #14897: [SPARK-17338][SQL] add global temp view

2016-09-28 Thread gatorsmile
Github user gatorsmile commented on a diff in the pull request: https://github.com/apache/spark/pull/14897#discussion_r81012097 --- Diff: sql/catalyst/src/main/scala/org/apache/spark/sql/catalyst/catalog/SessionCatalog.scala --- @@ -472,27 +557,48 @@ class SessionCatalog(

[GitHub] spark issue #15148: [SPARK-5992][ML] Locality Sensitive Hashing

2016-09-28 Thread AmplabJenkins
Github user AmplabJenkins commented on the issue: https://github.com/apache/spark/pull/15148 Merged build finished. Test FAILed. --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this feature e

[GitHub] spark issue #15148: [SPARK-5992][ML] Locality Sensitive Hashing

2016-09-28 Thread AmplabJenkins
Github user AmplabJenkins commented on the issue: https://github.com/apache/spark/pull/15148 Test FAILed. Refer to this link for build results (access rights to CI server needed): https://amplab.cs.berkeley.edu/jenkins//job/SparkPullRequestBuilder/66057/ Test FAILed. ---

[GitHub] spark issue #15148: [SPARK-5992][ML] Locality Sensitive Hashing

2016-09-28 Thread SparkQA
Github user SparkQA commented on the issue: https://github.com/apache/spark/pull/15148 **[Test build #66057 has finished](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/66057/consoleFull)** for PR 15148 at commit [`7936315`](https://github.com/apache/spark/commit/

[GitHub] spark issue #15047: [SPARK-17495] [SQL] Add Hash capability semantically equ...

2016-09-28 Thread SparkQA
Github user SparkQA commented on the issue: https://github.com/apache/spark/pull/15047 **[Test build #66058 has started](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/66058/consoleFull)** for PR 15047 at commit [`238dbb8`](https://github.com/apache/spark/commit/2

[GitHub] spark issue #15148: [SPARK-5992][ML] Locality Sensitive Hashing

2016-09-28 Thread SparkQA
Github user SparkQA commented on the issue: https://github.com/apache/spark/pull/15148 **[Test build #66057 has started](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/66057/consoleFull)** for PR 15148 at commit [`7936315`](https://github.com/apache/spark/commit/7

[GitHub] spark issue #15282: [SPARK-17673] [SQL] Incorrect exchange reuse with RowDat...

2016-09-28 Thread SparkQA
Github user SparkQA commented on the issue: https://github.com/apache/spark/pull/15282 **[Test build #66056 has started](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/66056/consoleFull)** for PR 15282 at commit [`dde4834`](https://github.com/apache/spark/commit/d

[GitHub] spark pull request #15282: [SPARK-17673] [SQL] Incorrect exchange reuse with...

2016-09-28 Thread ericl
GitHub user ericl opened a pull request: https://github.com/apache/spark/pull/15282 [SPARK-17673] [SQL] Incorrect exchange reuse with RowDataSourceScan (backport) This backports https://github.com/apache/spark/pull/15273 to branch-2.0 Also verified the test passes after the

[GitHub] spark issue #14963: [SPARK-16992][PYSPARK] Virtualenv for Pylint and pep8 in...

2016-09-28 Thread AmplabJenkins
Github user AmplabJenkins commented on the issue: https://github.com/apache/spark/pull/14963 Merged build finished. Test PASSed. --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this feature e

[GitHub] spark issue #14963: [SPARK-16992][PYSPARK] Virtualenv for Pylint and pep8 in...

2016-09-28 Thread AmplabJenkins
Github user AmplabJenkins commented on the issue: https://github.com/apache/spark/pull/14963 Test PASSed. Refer to this link for build results (access rights to CI server needed): https://amplab.cs.berkeley.edu/jenkins//job/SparkPullRequestBuilder/66044/ Test PASSed. ---

[GitHub] spark issue #14963: [SPARK-16992][PYSPARK] Virtualenv for Pylint and pep8 in...

2016-09-28 Thread SparkQA
Github user SparkQA commented on the issue: https://github.com/apache/spark/pull/14963 **[Test build #66044 has finished](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/66044/consoleFull)** for PR 14963 at commit [`3f74d2d`](https://github.com/apache/spark/commit/

[GitHub] spark issue #15148: [SPARK-5992][ML] Locality Sensitive Hashing

2016-09-28 Thread SparkQA
Github user SparkQA commented on the issue: https://github.com/apache/spark/pull/15148 **[Test build #66055 has started](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/66055/consoleFull)** for PR 15148 at commit [`b79ebbd`](https://github.com/apache/spark/commit/b

[GitHub] spark pull request #15273: [SPARK-17673] [SQL] Incorrect exchange reuse with...

2016-09-28 Thread asfgit
Github user asfgit closed the pull request at: https://github.com/apache/spark/pull/15273 --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this feature enabled and wishes so, or if the feature is ena

[GitHub] spark issue #15281: [DOCS] Reorganize explanation of Accumulators and Broadc...

2016-09-28 Thread AmplabJenkins
Github user AmplabJenkins commented on the issue: https://github.com/apache/spark/pull/15281 Can one of the admins verify this patch? --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this feat

[GitHub] spark pull request #15281: [DOCS] Reorganize explanation of Accumulators and...

2016-09-28 Thread jsoltren
GitHub user jsoltren opened a pull request: https://github.com/apache/spark/pull/15281 [DOCS] Reorganize explanation of Accumulators and Broadcast Variables ## What changes were proposed in this pull request? The discussion of the interaction of Accumulators and Broadcast Va

[GitHub] spark issue #15273: [SPARK-17673] [SQL] Incorrect exchange reuse with RowDat...

2016-09-28 Thread rxin
Github user rxin commented on the issue: https://github.com/apache/spark/pull/15273 Thanks - merging in master/2.0. I think the test is actually in a non-ideal location, but I'm going to merge first in order to make 2.0.1 rc4. --- If your project is set up for it, you can r

[GitHub] spark issue #15148: [SPARK-5992][ML] Locality Sensitive Hashing

2016-09-28 Thread SparkQA
Github user SparkQA commented on the issue: https://github.com/apache/spark/pull/15148 **[Test build #66054 has finished](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/66054/consoleFull)** for PR 15148 at commit [`396ad60`](https://github.com/apache/spark/commit/

[GitHub] spark issue #15148: [SPARK-5992][ML] Locality Sensitive Hashing

2016-09-28 Thread AmplabJenkins
Github user AmplabJenkins commented on the issue: https://github.com/apache/spark/pull/15148 Test FAILed. Refer to this link for build results (access rights to CI server needed): https://amplab.cs.berkeley.edu/jenkins//job/SparkPullRequestBuilder/66054/ Test FAILed. ---

[GitHub] spark issue #15148: [SPARK-5992][ML] Locality Sensitive Hashing

2016-09-28 Thread AmplabJenkins
Github user AmplabJenkins commented on the issue: https://github.com/apache/spark/pull/15148 Merged build finished. Test FAILed. --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this feature e

[GitHub] spark pull request #15248: [SPARK-17671] Spark 2.0 history server summary pa...

2016-09-28 Thread wgtmac
Github user wgtmac commented on a diff in the pull request: https://github.com/apache/spark/pull/15248#discussion_r81007488 --- Diff: core/src/main/scala/org/apache/spark/deploy/history/HistoryServer.scala --- @@ -179,7 +180,11 @@ class HistoryServer( } --- End diff --

[GitHub] spark issue #15148: [SPARK-5992][ML] Locality Sensitive Hashing

2016-09-28 Thread SparkQA
Github user SparkQA commented on the issue: https://github.com/apache/spark/pull/15148 **[Test build #66054 has started](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/66054/consoleFull)** for PR 15148 at commit [`396ad60`](https://github.com/apache/spark/commit/3

[GitHub] spark issue #15148: [SPARK-5992][ML] Locality Sensitive Hashing

2016-09-28 Thread Yunni
Github user Yunni commented on the issue: https://github.com/apache/spark/pull/15148 Hi @MLnick @jkbradley Thanks for the code review. I made some changes based on your comments. - I agree it's better to align the input types to vector in internal implementation. Spa

[GitHub] spark issue #15090: [SPARK-17073] [SQL] generate column-level statistics

2016-09-28 Thread wzhfy
Github user wzhfy commented on the issue: https://github.com/apache/spark/pull/15090 When encoding, I convert the InternalRow(UnsafeRow) into a byte array and use Base64 to encode as a string; when decoding, use Base64 to decode from a string and convert the byte array to an UnsafeR

[GitHub] spark issue #15090: [SPARK-17073] [SQL] generate column-level statistics

2016-09-28 Thread SparkQA
Github user SparkQA commented on the issue: https://github.com/apache/spark/pull/15090 **[Test build #66053 has started](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/66053/consoleFull)** for PR 15090 at commit [`1d3dd62`](https://github.com/apache/spark/commit/1

[GitHub] spark issue #15148: [SPARK-5992][ML] Locality Sensitive Hashing

2016-09-28 Thread AmplabJenkins
Github user AmplabJenkins commented on the issue: https://github.com/apache/spark/pull/15148 Test FAILed. Refer to this link for build results (access rights to CI server needed): https://amplab.cs.berkeley.edu/jenkins//job/SparkPullRequestBuilder/66051/ Test FAILed. ---

[GitHub] spark issue #15148: [SPARK-5992][ML] Locality Sensitive Hashing

2016-09-28 Thread SparkQA
Github user SparkQA commented on the issue: https://github.com/apache/spark/pull/15148 **[Test build #66051 has finished](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/66051/consoleFull)** for PR 15148 at commit [`a1c344b`](https://github.com/apache/spark/commit/

[GitHub] spark issue #15148: [SPARK-5992][ML] Locality Sensitive Hashing

2016-09-28 Thread AmplabJenkins
Github user AmplabJenkins commented on the issue: https://github.com/apache/spark/pull/15148 Merged build finished. Test FAILed. --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this feature e

[GitHub] spark issue #15274: [SPARK-17699] Support for parsing JSON string columns

2016-09-28 Thread SparkQA
Github user SparkQA commented on the issue: https://github.com/apache/spark/pull/15274 **[Test build #66052 has started](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/66052/consoleFull)** for PR 15274 at commit [`360b97b`](https://github.com/apache/spark/commit/3

[GitHub] spark issue #15148: [SPARK-5992][ML] Locality Sensitive Hashing

2016-09-28 Thread SparkQA
Github user SparkQA commented on the issue: https://github.com/apache/spark/pull/15148 **[Test build #66051 has started](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/66051/consoleFull)** for PR 15148 at commit [`a1c344b`](https://github.com/apache/spark/commit/a

[GitHub] spark issue #15247: [SPARK-17672] Spark 2.0 history server web Ui takes too ...

2016-09-28 Thread SparkQA
Github user SparkQA commented on the issue: https://github.com/apache/spark/pull/15247 **[Test build #66050 has started](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/66050/consoleFull)** for PR 15247 at commit [`67ea2de`](https://github.com/apache/spark/commit/6

[GitHub] spark pull request #15148: [SPARK-5992][ML] Locality Sensitive Hashing

2016-09-28 Thread Yunni
Github user Yunni commented on a diff in the pull request: https://github.com/apache/spark/pull/15148#discussion_r81000695 --- Diff: mllib/src/test/scala/org/apache/spark/ml/feature/lsh/LSHTest.scala --- @@ -0,0 +1,125 @@ +/* + * Licensed to the Apache Software Foundation (

[GitHub] spark pull request #15148: [SPARK-5992][ML] Locality Sensitive Hashing

2016-09-28 Thread Yunni
Github user Yunni commented on a diff in the pull request: https://github.com/apache/spark/pull/15148#discussion_r81000597 --- Diff: mllib/src/main/scala/org/apache/spark/ml/feature/lsh/MinHash.scala --- @@ -0,0 +1,94 @@ +/* + * Licensed to the Apache Software Foundation (A

[GitHub] spark pull request #15148: [SPARK-5992][ML] Locality Sensitive Hashing

2016-09-28 Thread Yunni
Github user Yunni commented on a diff in the pull request: https://github.com/apache/spark/pull/15148#discussion_r81000578 --- Diff: mllib/src/main/scala/org/apache/spark/ml/feature/lsh/MinHash.scala --- @@ -0,0 +1,94 @@ +/* + * Licensed to the Apache Software Foundation (A

[GitHub] spark pull request #15148: [SPARK-5992][ML] Locality Sensitive Hashing

2016-09-28 Thread Yunni
Github user Yunni commented on a diff in the pull request: https://github.com/apache/spark/pull/15148#discussion_r81000599 --- Diff: mllib/src/main/scala/org/apache/spark/ml/feature/lsh/RandomProjection.scala --- @@ -0,0 +1,88 @@ +/* + * Licensed to the Apache Software Foun

[GitHub] spark pull request #15148: [SPARK-5992][ML] Locality Sensitive Hashing

2016-09-28 Thread Yunni
Github user Yunni commented on a diff in the pull request: https://github.com/apache/spark/pull/15148#discussion_r81000707 --- Diff: mllib/src/test/scala/org/apache/spark/ml/feature/lsh/LSHTest.scala --- @@ -0,0 +1,125 @@ +/* + * Licensed to the Apache Software Foundation (

[GitHub] spark pull request #15148: [SPARK-5992][ML] Locality Sensitive Hashing

2016-09-28 Thread Yunni
Github user Yunni commented on a diff in the pull request: https://github.com/apache/spark/pull/15148#discussion_r81000698 --- Diff: mllib/src/test/scala/org/apache/spark/ml/feature/lsh/LSHTest.scala --- @@ -0,0 +1,125 @@ +/* + * Licensed to the Apache Software Foundation (

[GitHub] spark pull request #15148: [SPARK-5992][ML] Locality Sensitive Hashing

2016-09-28 Thread Yunni
Github user Yunni commented on a diff in the pull request: https://github.com/apache/spark/pull/15148#discussion_r81000563 --- Diff: mllib/src/main/scala/org/apache/spark/ml/feature/lsh/LSH.scala --- @@ -0,0 +1,304 @@ +/* + * Licensed to the Apache Software Foundation (ASF)

[GitHub] spark pull request #15148: [SPARK-5992][ML] Locality Sensitive Hashing

2016-09-28 Thread Yunni
Github user Yunni commented on a diff in the pull request: https://github.com/apache/spark/pull/15148#discussion_r81000584 --- Diff: mllib/src/main/scala/org/apache/spark/ml/feature/lsh/MinHash.scala --- @@ -0,0 +1,94 @@ +/* + * Licensed to the Apache Software Foundation (A

[GitHub] spark pull request #15148: [SPARK-5992][ML] Locality Sensitive Hashing

2016-09-28 Thread Yunni
Github user Yunni commented on a diff in the pull request: https://github.com/apache/spark/pull/15148#discussion_r81000669 --- Diff: mllib/src/test/scala/org/apache/spark/ml/feature/lsh/LSHTest.scala --- @@ -0,0 +1,125 @@ +/* + * Licensed to the Apache Software Foundation (

[GitHub] spark pull request #15148: [SPARK-5992][ML] Locality Sensitive Hashing

2016-09-28 Thread Yunni
Github user Yunni commented on a diff in the pull request: https://github.com/apache/spark/pull/15148#discussion_r81000659 --- Diff: mllib/src/main/scala/org/apache/spark/ml/feature/lsh/RandomProjection.scala --- @@ -0,0 +1,88 @@ +/* + * Licensed to the Apache Software Foun

[GitHub] spark pull request #15148: [SPARK-5992][ML] Locality Sensitive Hashing

2016-09-28 Thread Yunni
Github user Yunni commented on a diff in the pull request: https://github.com/apache/spark/pull/15148#discussion_r81000555 --- Diff: mllib/src/main/scala/org/apache/spark/ml/feature/lsh/LSH.scala --- @@ -0,0 +1,304 @@ +/* + * Licensed to the Apache Software Foundation (ASF)

[GitHub] spark pull request #15148: [SPARK-5992][ML] Locality Sensitive Hashing

2016-09-28 Thread Yunni
Github user Yunni commented on a diff in the pull request: https://github.com/apache/spark/pull/15148#discussion_r81000488 --- Diff: mllib/src/main/scala/org/apache/spark/ml/feature/lsh/LSH.scala --- @@ -0,0 +1,290 @@ +/* + * Licensed to the Apache Software Foundation (ASF)

[GitHub] spark pull request #15148: [SPARK-5992][ML] Locality Sensitive Hashing

2016-09-28 Thread Yunni
Github user Yunni commented on a diff in the pull request: https://github.com/apache/spark/pull/15148#discussion_r81000523 --- Diff: mllib/src/main/scala/org/apache/spark/ml/feature/lsh/LSH.scala --- @@ -0,0 +1,304 @@ +/* + * Licensed to the Apache Software Foundation (ASF)

<    1   2   3   4   5   >