[GitHub] spark pull request: [SPARK-4017] show progress bar in console

Github user SparkQA commented on the pull request: https://github.com/apache/spark/pull/3029#issuecomment-63208925 [Test build #23438 has finished](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/23438/consoleFull) for PR 3029 at commit [`38c42f1`](https://gith

[GitHub] spark pull request: [SPARK-4017] show progress bar in console

Github user AmplabJenkins commented on the pull request: https://github.com/apache/spark/pull/3029#issuecomment-63208927 Test PASSed. Refer to this link for build results (access rights to CI server needed): https://amplab.cs.berkeley.edu/jenkins//job/SparkPullRequestBuilder/23

[GitHub] spark pull request: [SPARK-4419] Upgrade snappy-java to 1.1.1.6

Github user asfgit closed the pull request at: https://github.com/apache/spark/pull/3287 --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this feature enabled and wishes so, or if the feature is enab

[GitHub] spark pull request: [SPARK-4426][SQL][Minor] The symbol of Bitwise...

Github user asfgit closed the pull request at: https://github.com/apache/spark/pull/3284 --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this feature enabled and wishes so, or if the feature is enab

[GitHub] spark pull request: [SPARK-4397][Core] Reorganize 'implicit's to i...

Github user zsxwing commented on a diff in the pull request: https://github.com/apache/spark/pull/3262#discussion_r20407706 --- Diff: core/src/main/scala/org/apache/spark/SparkContext.scala --- @@ -1750,3 +1780,46 @@ private[spark] class WritableConverter[T]( val writableCl

[GitHub] spark pull request: [SPARK-4397][Core] Reorganize 'implicit's to i...

Github user zsxwing commented on a diff in the pull request: https://github.com/apache/spark/pull/3262#discussion_r20407704 --- Diff: core/src/main/scala/org/apache/spark/SparkContext.scala --- @@ -1750,3 +1780,46 @@ private[spark] class WritableConverter[T]( val writableCl

[GitHub] spark pull request: [SPARK-4397][Core] Reorganize 'implicit's to i...

Github user SparkQA commented on the pull request: https://github.com/apache/spark/pull/3262#issuecomment-63208608 [Test build #23439 has started](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/23439/consoleFull) for PR 3262 at commit [`34641d4`](https://githu

[GitHub] spark pull request: [SPARK-4172] [PySpark] Progress API in Python

Github user SparkQA commented on the pull request: https://github.com/apache/spark/pull/3027#issuecomment-63208102 [Test build #522 has finished](https://amplab.cs.berkeley.edu/jenkins/job/NewSparkPullRequestBuilder/522/consoleFull) for PR 3027 at commit [`c0f1021`](https://githu

[GitHub] spark pull request: [SPARK-4421] Wrong link in spark-standalone.ht...

Github user srowen commented on the pull request: https://github.com/apache/spark/pull/3280#issuecomment-63207627 That makes sense. I don't know if it is better to leave this or let the merger apply this change when it is applied to 1.1. It may not be worth it since docs are made from

[GitHub] spark pull request: [SPARK-4397][Core] Reorganize 'implicit's to i...

Github user mateiz commented on a diff in the pull request: https://github.com/apache/spark/pull/3262#discussion_r20407571 --- Diff: core/src/main/scala/org/apache/spark/SparkContext.scala --- @@ -1750,3 +1780,46 @@ private[spark] class WritableConverter[T]( val writableCla

[GitHub] spark pull request: [SPARK-4397][Core] Reorganize 'implicit's to i...

Github user mateiz commented on a diff in the pull request: https://github.com/apache/spark/pull/3262#discussion_r20407569 --- Diff: core/src/main/scala/org/apache/spark/SparkContext.scala --- @@ -1750,3 +1780,46 @@ private[spark] class WritableConverter[T]( val writableCla

[GitHub] spark pull request: [SPARK-4433] fix a racing condition in zipWith...

Github user rxin commented on the pull request: https://github.com/apache/spark/pull/3291#issuecomment-63206919 This makes the whole thing eager, isn't it? --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project d

[GitHub] spark pull request: [SPARK-4017] show progress bar in console

Github user SparkQA commented on the pull request: https://github.com/apache/spark/pull/3029#issuecomment-63206812 [Test build #23437 has finished](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/23437/consoleFull) for PR 3029 at commit [`ab87958`](https://gith

[GitHub] spark pull request: [SPARK-4017] show progress bar in console

Github user AmplabJenkins commented on the pull request: https://github.com/apache/spark/pull/3029#issuecomment-63206817 Test FAILed. Refer to this link for build results (access rights to CI server needed): https://amplab.cs.berkeley.edu/jenkins//job/SparkPullRequestBuilder/23

[GitHub] spark pull request: [SPARK-4017] show progress bar in console

Github user SparkQA commented on the pull request: https://github.com/apache/spark/pull/3029#issuecomment-63206787 [Test build #23438 has started](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/23438/consoleFull) for PR 3029 at commit [`38c42f1`](https://githu

[GitHub] spark pull request: [SPARK-4419] Upgrade snappy-java to 1.1.1.6

Github user rxin commented on the pull request: https://github.com/apache/spark/pull/3287#issuecomment-63206729 Merging in master & branch-1.2. --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have

[GitHub] spark pull request: [SPARK-4433] fix a racing condition in zipWith...

Github user AmplabJenkins commented on the pull request: https://github.com/apache/spark/pull/3291#issuecomment-63206535 Test PASSed. Refer to this link for build results (access rights to CI server needed): https://amplab.cs.berkeley.edu/jenkins//job/SparkPullRequestBuilder/23

[GitHub] spark pull request: [SPARK-4433] fix a racing condition in zipWith...

Github user SparkQA commented on the pull request: https://github.com/apache/spark/pull/3291#issuecomment-63206533 [Test build #23433 has finished](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/23433/consoleFull) for PR 3291 at commit [`c284d9f`](https://gith

[GitHub] spark pull request: [SPARK-4017] show progress bar in console

Github user SparkQA commented on the pull request: https://github.com/apache/spark/pull/3029#issuecomment-63206404 [Test build #23436 has finished](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/23436/consoleFull) for PR 3029 at commit [`30ac852`](https://gith

[GitHub] spark pull request: [SPARK-4017] show progress bar in console

Github user AmplabJenkins commented on the pull request: https://github.com/apache/spark/pull/3029#issuecomment-63206407 Test FAILed. Refer to this link for build results (access rights to CI server needed): https://amplab.cs.berkeley.edu/jenkins//job/SparkPullRequestBuilder/23

[GitHub] spark pull request: [Spark-4432]close InStream after the block is ...

Github user AmplabJenkins commented on the pull request: https://github.com/apache/spark/pull/3290#issuecomment-63206391 Test FAILed. Refer to this link for build results (access rights to CI server needed): https://amplab.cs.berkeley.edu/jenkins//job/SparkPullRequestBuilder/23

[GitHub] spark pull request: [Spark-4432]close InStream after the block is ...

Github user SparkQA commented on the pull request: https://github.com/apache/spark/pull/3290#issuecomment-63206388 **[Test build #23432 timed out](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/23432/consoleFull)** for PR 3290 at commit [`52dd088`](https://git

[GitHub] spark pull request: [SPARK-4017] show progress bar in console

Github user SparkQA commented on the pull request: https://github.com/apache/spark/pull/3029#issuecomment-63206309 [Test build #521 has finished](https://amplab.cs.berkeley.edu/jenkins/job/NewSparkPullRequestBuilder/521/consoleFull) for PR 3029 at commit [`0cee236`](https://githu

[GitHub] spark pull request: [SPARK-4172] [PySpark] Progress API in Python

Github user SparkQA commented on the pull request: https://github.com/apache/spark/pull/3027#issuecomment-63205975 [Test build #522 has started](https://amplab.cs.berkeley.edu/jenkins/job/NewSparkPullRequestBuilder/522/consoleFull) for PR 3027 at commit [`c0f1021`](https://github

[GitHub] spark pull request: [SPARK-4421] Wrong link in spark-standalone.ht...

Github user tsudukim commented on the pull request: https://github.com/apache/spark/pull/3280#issuecomment-63205228 Thank you @srowen for following this ticket. I know PR should be for master generally, and I already sent one for master (#3279). But the details of modification

[GitHub] spark pull request: [SPARK-4017] show progress bar in console

Github user SparkQA commented on the pull request: https://github.com/apache/spark/pull/3029#issuecomment-63204979 [Test build #23437 has started](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/23437/consoleFull) for PR 3029 at commit [`ab87958`](https://githu

[GitHub] spark pull request: [SPARK-4017] show progress bar in console

Github user AmplabJenkins commented on the pull request: https://github.com/apache/spark/pull/3029#issuecomment-63204911 Test FAILed. Refer to this link for build results (access rights to CI server needed): https://amplab.cs.berkeley.edu/jenkins//job/SparkPullRequestBuilder/23

[GitHub] spark pull request: [SPARK-4017] show progress bar in console

Github user SparkQA commented on the pull request: https://github.com/apache/spark/pull/3029#issuecomment-63204747 [Test build #23436 has started](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/23436/consoleFull) for PR 3029 at commit [`30ac852`](https://githu

[GitHub] spark pull request: [SPARK-4017] show progress bar in console

Github user davies commented on the pull request: https://github.com/apache/spark/pull/3029#issuecomment-63204768 @JoshRosen @pwendell @kayousterhout @squito I had re-implemented it using the new poll based progress api. The progress bar is much simplified as the original one, remo

[GitHub] spark pull request: [SPARK-4017] show progress bar in console

Github user SparkQA commented on the pull request: https://github.com/apache/spark/pull/3029#issuecomment-63204653 [Test build #521 has started](https://amplab.cs.berkeley.edu/jenkins/job/NewSparkPullRequestBuilder/521/consoleFull) for PR 3029 at commit [`0cee236`](https://github

[GitHub] spark pull request: [SPARK-4017] show progress bar in console

Github user SparkQA commented on the pull request: https://github.com/apache/spark/pull/3029#issuecomment-63204432 [Test build #23434 has started](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/23434/consoleFull) for PR 3029 at commit [`0cee236`](https://githu

[GitHub] spark pull request: [SPARK-4017] show progress bar in console

Github user SparkQA commented on the pull request: https://github.com/apache/spark/pull/3029#issuecomment-63204436 [Test build #23434 has finished](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/23434/consoleFull) for PR 3029 at commit [`0cee236`](https://gith

[GitHub] spark pull request: [SPARK-4017] show progress bar in console

Github user AmplabJenkins commented on the pull request: https://github.com/apache/spark/pull/3029#issuecomment-63204439 Test FAILed. Refer to this link for build results (access rights to CI server needed): https://amplab.cs.berkeley.edu/jenkins//job/SparkPullRequestBuilder/23

[GitHub] spark pull request: [SPARK-4433] fix a racing condition in zipWith...

Github user SparkQA commented on the pull request: https://github.com/apache/spark/pull/3291#issuecomment-63204362 [Test build #23433 has started](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/23433/consoleFull) for PR 3291 at commit [`c284d9f`](https://githu

[GitHub] spark pull request: [SPARK-4433] fix a racing condition in zipWith...

GitHub user mengxr opened a pull request: https://github.com/apache/spark/pull/3291 [SPARK-4433] fix a racing condition in zipWithIndex Spark hangs with the following code: ~~~ sc.parallelize(1 to 10).zipWithIndex.repartition(10).count() ~~~ This is because

[GitHub] spark pull request: Bumping version to 1.3.0-SNAPSHOT.

Github user witgo commented on the pull request: https://github.com/apache/spark/pull/3277#issuecomment-63203941 [package.scala#L47](https://github.com/apache/spark/blob/master/core/src/main/scala/org/apache/spark/package.scala#L47) should be modified --- If your project is set up f

[GitHub] spark pull request: [Spark-4432]close InStream after the block is ...

Github user SparkQA commented on the pull request: https://github.com/apache/spark/pull/3290#issuecomment-63203429 [Test build #23432 has started](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/23432/consoleFull) for PR 3290 at commit [`52dd088`](https://githu

[GitHub] spark pull request: [Spark-4432]close InStream after the block is ...

GitHub user shimingfei opened a pull request: https://github.com/apache/spark/pull/3290 [Spark-4432]close InStream after the block is accessed InStream is not closed after data is read from Tachyon. which makes the blocks in Tachyon locked after accessed. You can merge this pull re

[GitHub] spark pull request: [SPARK-1977][MLLIB] use immutable BitSet in AL...

Github user aaronlin commented on the pull request: https://github.com/apache/spark/pull/925#issuecomment-63203111 Thanks for your reply. I will try this solution. Thanks --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If

[GitHub] spark pull request: [SPARK-1977][MLLIB] use immutable BitSet in AL...

Github user mengxr commented on the pull request: https://github.com/apache/spark/pull/925#issuecomment-63202927 The registration could be done through configuration. For example, there is an `ALSRegistrator` under `examples/` and you can enable it through configuration without changi

[GitHub] spark pull request: [SPARK-4404] remove shutdown hook if subproces...

Github user AmplabJenkins commented on the pull request: https://github.com/apache/spark/pull/3289#issuecomment-63202441 Test PASSed. Refer to this link for build results (access rights to CI server needed): https://amplab.cs.berkeley.edu/jenkins//job/SparkPullRequestBuilder/23

[GitHub] spark pull request: [SPARK-4404] remove shutdown hook if subproces...

Github user SparkQA commented on the pull request: https://github.com/apache/spark/pull/3289#issuecomment-63202438 [Test build #23431 has finished](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/23431/consoleFull) for PR 3289 at commit [`4d11366`](https://gith

[GitHub] spark pull request: [SPARK-4387][PySpark] Refactoring python profi...

Github user davies commented on the pull request: https://github.com/apache/spark/pull/3255#issuecomment-63202204 LGTM, thanks! --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this feature en

[GitHub] spark pull request: [SPARK-4387][PySpark] Refactoring python profi...

Github user udnay commented on the pull request: https://github.com/apache/spark/pull/3255#issuecomment-63201938 Fixed the issue and deleted the unused function --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your pro

[GitHub] spark pull request: [SPARK-4431][MLlib] Implement efficient active...

Github user AmplabJenkins commented on the pull request: https://github.com/apache/spark/pull/3288#issuecomment-63201701 Test PASSed. Refer to this link for build results (access rights to CI server needed): https://amplab.cs.berkeley.edu/jenkins//job/SparkPullRequestBuilder/23

[GitHub] spark pull request: [SPARK-4431][MLlib] Implement efficient active...

Github user SparkQA commented on the pull request: https://github.com/apache/spark/pull/3288#issuecomment-63201699 [Test build #23430 has finished](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/23430/consoleFull) for PR 3288 at commit [`101c2ea`](https://gith

[GitHub] spark pull request: [SPARK-4404] remove shutdown hook if subproces...

Github user aarondav commented on the pull request: https://github.com/apache/spark/pull/3289#issuecomment-63201456 Also not sure I understand this -- if the subprocess is already dead, doesn't process.waitFor() return immediately? --- If your project is set up for it, you can reply

[GitHub] spark pull request: [SPARK-4404] remove shutdown hook if subproces...

Github user WangTaoTheTonic commented on the pull request: https://github.com/apache/spark/pull/3289#issuecomment-63201312 Thanks for fixing! But I don't understand the hook mechanism. Would you mind explaining this commit to me? --- If your project is set up for it, you can rep

[GitHub] spark pull request: SPARK-4228 SchemaRDD to JSON

Github user yhuai commented on a diff in the pull request: https://github.com/apache/spark/pull/3213#discussion_r20406598 --- Diff: sql/core/src/main/scala/org/apache/spark/sql/SchemaRDD.scala --- @@ -131,6 +134,69 @@ class SchemaRDD( */ lazy val schema: StructType =

[GitHub] spark pull request: SPARK-4228 SchemaRDD to JSON

Github user yhuai commented on the pull request: https://github.com/apache/spark/pull/3213#issuecomment-63200778 Seems we also need the Java API (`JavaSchemaRDD`). --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your p

[GitHub] spark pull request: SPARK-4228 SchemaRDD to JSON

Github user yhuai commented on a diff in the pull request: https://github.com/apache/spark/pull/3213#discussion_r20406568 --- Diff: sql/core/src/main/scala/org/apache/spark/sql/SchemaRDD.scala --- @@ -131,6 +134,69 @@ class SchemaRDD( */ lazy val schema: StructType =

[GitHub] spark pull request: [SPARK-4404] remove shutdown hook if subproces...

Github user SparkQA commented on the pull request: https://github.com/apache/spark/pull/3289#issuecomment-63200658 [Test build #23431 has started](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/23431/consoleFull) for PR 3289 at commit [`4d11366`](https://githu

[GitHub] spark pull request: SPARK-4228 SchemaRDD to JSON

Github user yhuai commented on a diff in the pull request: https://github.com/apache/spark/pull/3213#discussion_r20406544 --- Diff: sql/core/src/main/scala/org/apache/spark/sql/SchemaRDD.scala --- @@ -17,9 +17,12 @@ package org.apache.spark.sql -import java.util

[GitHub] spark pull request: [SPARK-4404] remove shutdown hook if subproces...

GitHub user davies opened a pull request: https://github.com/apache/spark/pull/3289 [SPARK-4404] remove shutdown hook if subprocess die fist If SparkSubmit die first, then bootstrapper will be blocked by shutdown hook. cc @andrewor14 You can merge this pull request into a

[GitHub] spark pull request: SPARK-4228 SchemaRDD to JSON

Github user yhuai commented on a diff in the pull request: https://github.com/apache/spark/pull/3213#discussion_r20406537 --- Diff: sql/core/src/test/scala/org/apache/spark/sql/SQLQuerySuite.scala --- @@ -591,6 +591,30 @@ class SQLQuerySuite extends QueryTest with BeforeAndAfterAl

[GitHub] spark pull request: SPARK-4228 SchemaRDD to JSON

Github user yhuai commented on a diff in the pull request: https://github.com/apache/spark/pull/3213#discussion_r20406534 --- Diff: sql/core/src/main/scala/org/apache/spark/sql/SchemaRDD.scala --- @@ -131,6 +134,69 @@ class SchemaRDD( */ lazy val schema: StructType =

[GitHub] spark pull request: SPARK-4228 SchemaRDD to JSON

Github user dwmclary commented on a diff in the pull request: https://github.com/apache/spark/pull/3213#discussion_r20406513 --- Diff: sql/core/src/main/scala/org/apache/spark/sql/SchemaRDD.scala --- @@ -131,6 +134,68 @@ class SchemaRDD( */ lazy val schema: StructType

[GitHub] spark pull request: SPARK-4228 SchemaRDD to JSON

Github user yhuai commented on the pull request: https://github.com/apache/spark/pull/3213#issuecomment-63200033 @dwmclary Can you reformat the code to follow the [2-space convention](http://docs.scala-lang.org/style/indentation.html)? --- If your project is set up for it, you can re

[GitHub] spark pull request: SPARK-4228 SchemaRDD to JSON

Github user yhuai commented on a diff in the pull request: https://github.com/apache/spark/pull/3213#discussion_r20406459 --- Diff: sql/core/src/main/scala/org/apache/spark/sql/SchemaRDD.scala --- @@ -131,6 +134,68 @@ class SchemaRDD( */ lazy val schema: StructType =

[GitHub] spark pull request: [SPARK-4431][MLlib] Implement efficient active...

Github user SparkQA commented on the pull request: https://github.com/apache/spark/pull/3288#issuecomment-6310 [Test build #23430 has started](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/23430/consoleFull) for PR 3288 at commit [`101c2ea`](https://githu

[GitHub] spark pull request: Bumping version to 1.3.0-SNAPSHOT.

Github user AmplabJenkins commented on the pull request: https://github.com/apache/spark/pull/3277#issuecomment-63199891 Test PASSed. Refer to this link for build results (access rights to CI server needed): https://amplab.cs.berkeley.edu/jenkins//job/SparkPullRequestBuilder/23

[GitHub] spark pull request: Bumping version to 1.3.0-SNAPSHOT.

Github user SparkQA commented on the pull request: https://github.com/apache/spark/pull/3277#issuecomment-63199890 [Test build #23429 has finished](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/23429/consoleFull) for PR 3277 at commit [`b628a4c`](https://gith

[GitHub] spark pull request: [SPARK-4431][MLlib] Implement efficient active...

GitHub user dbtsai opened a pull request: https://github.com/apache/spark/pull/3288 [SPARK-4431][MLlib] Implement efficient activeIterator for dense and sparse vector Previously, we were using Breeze's activeIterator to access the non-zero elements in sparse vector, and explic

[GitHub] spark pull request: SPARK-4228 SchemaRDD to JSON

Github user davies commented on the pull request: https://github.com/apache/spark/pull/3213#issuecomment-63199746 @dwmclary I will like to have str as default instead, which use less memory and better performance (avoid decode and encode in some cases). --- If your project is set up

[GitHub] spark pull request: [SPARK-4419] Upgrade snappy-java to 1.1.1.6

Github user SparkQA commented on the pull request: https://github.com/apache/spark/pull/3287#issuecomment-63198131 [Test build #23428 has finished](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/23428/consoleFull) for PR 3287 at commit [`5d6f4cc`](https://gith

[GitHub] spark pull request: [SPARK-4419] Upgrade snappy-java to 1.1.1.6

Github user AmplabJenkins commented on the pull request: https://github.com/apache/spark/pull/3287#issuecomment-63198133 Test PASSed. Refer to this link for build results (access rights to CI server needed): https://amplab.cs.berkeley.edu/jenkins//job/SparkPullRequestBuilder/23

[GitHub] spark pull request: Bumping version to 1.3.0-SNAPSHOT.

Github user SparkQA commented on the pull request: https://github.com/apache/spark/pull/3277#issuecomment-63197146 [Test build #23429 has started](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/23429/consoleFull) for PR 3277 at commit [`b628a4c`](https://githu

[GitHub] spark pull request: [MLLIB] [spark-2352] Implementation of an 1-hi...

Github user jkbradley commented on the pull request: https://github.com/apache/spark/pull/1290#issuecomment-63196649 @avulanov Thanks for running tests! It would be great if we could calibrate tests somehow. Some options would be: (a) trying to reproduce tests in a published paper

[GitHub] spark pull request: [SPARK-4419] Upgrade snappy-java to 1.1.1.6

Github user SparkQA commented on the pull request: https://github.com/apache/spark/pull/3287#issuecomment-63195524 [Test build #23428 has started](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/23428/consoleFull) for PR 3287 at commit [`5d6f4cc`](https://githu

[GitHub] spark pull request: [SPARK-4419] Upgrade snappy-java to 1.1.1.6

Github user JoshRosen commented on the pull request: https://github.com/apache/spark/pull/3287#issuecomment-63195337 Jenkins, retest this please. --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not ha

[GitHub] spark pull request: [SPARK-4419] Upgrade snappy-java to 1.1.1.6

Github user AmplabJenkins commented on the pull request: https://github.com/apache/spark/pull/3287#issuecomment-63194775 Test FAILed. Refer to this link for build results (access rights to CI server needed): https://amplab.cs.berkeley.edu/jenkins//job/SparkPullRequestBuilder/23

[GitHub] spark pull request: [SPARK-4419] Upgrade snappy-java to 1.1.1.6

Github user SparkQA commented on the pull request: https://github.com/apache/spark/pull/3287#issuecomment-63194773 **[Test build #23426 timed out](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/23426/consoleFull)** for PR 3287 at commit [`5d6f4cc`](https://git

[GitHub] spark pull request: SPARK-4228 SchemaRDD to JSON

Github user dwmclary commented on the pull request: https://github.com/apache/spark/pull/3213#issuecomment-63194531 @davies -- that's much cleaner; thanks! I think unicode should be default, but optional for the deserializer so I added that to the method. @yhuai

[GitHub] spark pull request: [SPARK-4327] [PySpark] Python API for RDD.rand...

Github user SparkQA commented on the pull request: https://github.com/apache/spark/pull/3193#issuecomment-63193623 [Test build #23427 has finished](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/23427/consoleFull) for PR 3193 at commit [`78bf997`](https://gith

[GitHub] spark pull request: [SPARK-4327] [PySpark] Python API for RDD.rand...

Github user AmplabJenkins commented on the pull request: https://github.com/apache/spark/pull/3193#issuecomment-63193624 Test PASSed. Refer to this link for build results (access rights to CI server needed): https://amplab.cs.berkeley.edu/jenkins//job/SparkPullRequestBuilder/23

[GitHub] spark pull request: [SPARK-4419] Upgrade snappy-java to 1.1.1.6

Github user SparkQA commented on the pull request: https://github.com/apache/spark/pull/3287#issuecomment-63188346 [Test build #23426 has started](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/23426/consoleFull) for PR 3287 at commit [`5d6f4cc`](https://githu

[GitHub] spark pull request: [SPARK-4327] [PySpark] Python API for RDD.rand...

Github user SparkQA commented on the pull request: https://github.com/apache/spark/pull/3193#issuecomment-63188326 [Test build #23427 has started](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/23427/consoleFull) for PR 3193 at commit [`78bf997`](https://githu

[GitHub] spark pull request: [SPARK-3133] embed small object in broadcast t...

Github user JoshRosen commented on the pull request: https://github.com/apache/spark/pull/2681#issuecomment-63188181 I've pushed a commit to `spark-perf` which allows us to benchmark task launching throughput using different sized closures: https://github.com/databricks/spark-perf/com

[GitHub] spark pull request: [SPARK-4327] [PySpark] Python API for RDD.rand...

Github user davies commented on the pull request: https://github.com/apache/spark/pull/3193#issuecomment-63187956 @mengxr @JoshRosen I had reverted the changes about numpy, because it blocks this PR, let's think about it later. --- If your project is set up for it, you can reply to

[GitHub] spark pull request: [SPARK-4419] Upgrade snappy-java to 1.1.1.6

GitHub user JoshRosen opened a pull request: https://github.com/apache/spark/pull/3287 [SPARK-4419] Upgrade snappy-java to 1.1.1.6 This upgrades snappy-java to 1.1.1.6, which includes a patch that improves error messages when attempting to deserialize empty inputs using SnappyInput

[GitHub] spark pull request: [SPARK-4397][Core] Reorganize 'implicit's to i...

Github user AmplabJenkins commented on the pull request: https://github.com/apache/spark/pull/3262#issuecomment-63182150 Test PASSed. Refer to this link for build results (access rights to CI server needed): https://amplab.cs.berkeley.edu/jenkins//job/SparkPullRequestBuilder/23

[GitHub] spark pull request: [SPARK-4397][Core] Reorganize 'implicit's to i...

Github user SparkQA commented on the pull request: https://github.com/apache/spark/pull/3262#issuecomment-63182148 [Test build #23425 has finished](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/23425/consoleFull) for PR 3262 at commit [`7266218`](https://gith

[GitHub] spark pull request: [WIP][SPARK-4428][BUILD] Use ${scala.binary.ve...

Github user ueshin commented on the pull request: https://github.com/apache/spark/pull/3285#issuecomment-63182028 @markhamstra, @srowen, Thank you for the pointing. Now I'm closing this. --- If your project is set up for it, you can reply to this email and have your reply appear on Gi

[GitHub] spark pull request: [WIP][SPARK-4428][BUILD] Use ${scala.binary.ve...

Github user ueshin closed the pull request at: https://github.com/apache/spark/pull/3285 --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this feature enabled and wishes so, or if the feature is enab

[GitHub] spark pull request: [WIP][SPARK-4428][BUILD] Use ${scala.binary.ve...

Github user srowen commented on the pull request: https://github.com/apache/spark/pull/3285#issuecomment-63181365 @ueshin Have a look at this discussion, which was related at least: https://github.com/apache/spark/pull/2318 I can't find the thread where I believe Prashant said he foun

[GitHub] spark pull request: [WIP][SPARK-4428][BUILD] Use ${scala.binary.ve...

Github user markhamstra commented on the pull request: https://github.com/apache/spark/pull/3285#issuecomment-63181339 That was quite awhile back and would require some searching of the mail archives and repo from when Spark was in the Apache incubator. I did what you did soon after

[GitHub] spark pull request: [WIP][SPARK-4428][BUILD] Use ${scala.binary.ve...

Github user ueshin commented on the pull request: https://github.com/apache/spark/pull/3285#issuecomment-63180871 I see. I'll close this but can I have the pointer where you discussed about this? --- If your project is set up for it, you can reply to this email and have your reply ap

[GitHub] spark pull request: SPARK-2811 upgrade algebird to 0.8.1

Github user adampingel commented on the pull request: https://github.com/apache/spark/pull/2947#issuecomment-63180343 the new one is https://github.com/apache/spark/pull/3282 --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well

[GitHub] spark pull request: [SPARK-4397][Core] Reorganize 'implicit's to i...

Github user zsxwing commented on a diff in the pull request: https://github.com/apache/spark/pull/3262#discussion_r20403436 --- Diff: core/src/main/scala/org/apache/spark/SparkContext.scala --- @@ -1750,3 +1780,46 @@ private[spark] class WritableConverter[T]( val writableCl

[GitHub] spark pull request: [SPARK-4397][Core] Reorganize 'implicit's to i...

Github user zsxwing commented on the pull request: https://github.com/apache/spark/pull/3262#issuecomment-63178744 @rxin Thank you for the great summary and reviewing. Already updated it accordingly. --- If your project is set up for it, you can reply to this email and have your repl

[GitHub] spark pull request: [SPARK-4397][Core] Reorganize 'implicit's to i...

Github user SparkQA commented on the pull request: https://github.com/apache/spark/pull/3262#issuecomment-63178643 [Test build #23425 has started](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/23425/consoleFull) for PR 3262 at commit [`7266218`](https://githu

[GitHub] spark pull request: [SPARK-4050][SQL] Fix caching of temporary tab...

Github user OlivierA commented on the pull request: https://github.com/apache/spark/pull/2912#issuecomment-63176033 I'm having caching issues with Spark 1.1.0 for queries on temporary tables. In my case it even happens when the query is a simple ```SELECT * temp```. I understand th

[GitHub] spark pull request: [WIP][SPARK-4428][BUILD] Use ${scala.binary.ve...

Github user markhamstra commented on the pull request: https://github.com/apache/spark/pull/3285#issuecomment-63175889 @srowen is correct, this kind of parameterized artifactId has already been considered but is not permissible. Please close this PR. --- If your project is set up fo

[GitHub] spark pull request: Exclude dependency on hbase-annotations module

Github user AmplabJenkins commented on the pull request: https://github.com/apache/spark/pull/3286#issuecomment-63175856 Can one of the admins verify this patch? --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your pro

[GitHub] spark pull request: Exclude dependency on hbase-annotations module

GitHub user tedyu opened a pull request: https://github.com/apache/spark/pull/3286 Exclude dependency on hbase-annotations module @pwendell Please take a look You can merge this pull request into a Git repository by running: $ git pull https://github.com/tedyu/spark master

[GitHub] spark pull request: [WIP][SPARK-4428][BUILD] Use ${scala.binary.ve...

Github user AmplabJenkins commented on the pull request: https://github.com/apache/spark/pull/3285#issuecomment-63175485 Test PASSed. Refer to this link for build results (access rights to CI server needed): https://amplab.cs.berkeley.edu/jenkins//job/SparkPullRequestBuilder/23

[GitHub] spark pull request: [WIP][SPARK-4428][BUILD] Use ${scala.binary.ve...

Github user SparkQA commented on the pull request: https://github.com/apache/spark/pull/3285#issuecomment-63175479 [Test build #23424 has finished](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/23424/consoleFull) for PR 3285 at commit [`8a0b059`](https://gith

[GitHub] spark pull request: [WIP][SPARK-4428][BUILD] Use ${scala.binary.ve...

Github user srowen commented on the pull request: https://github.com/apache/spark/pull/3285#issuecomment-63173519 Yes, I thought this was discussed and this doesn't work? --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If

[GitHub] spark pull request: [SPARK-4421] Wrong link in spark-standalone.ht...

Github user srowen commented on the pull request: https://github.com/apache/spark/pull/3280#issuecomment-63173455 @tsudukim I think the practice is always to open a PR for master, not branches. The patch will be back-ported as appropriate. Could you change your PRs into one for master

[GitHub] spark pull request: [WIP][SPARK-4251][SPARK-2352][MLLIB]Add RBM, A...

Github user witgo commented on the pull request: https://github.com/apache/spark/pull/3222#issuecomment-63172769 Sorry, This patch is still work in process., I will add the annotation and document at later. BTW, My English is poor. we can communicate in email,This is more efficient

  1   2   >