[GitHub] spark pull request: Spark-1230: Enable SparkContext.addJars() to l...

2014-04-07 Thread pwendell
Github user pwendell commented on the pull request: https://github.com/apache/spark/pull/351#issuecomment-39817138 I don't think this merges cleanly at present - mind up-merging it? Also the test utility has been merged into mater now so you can remove it from this PR. --- If your pr

[GitHub] spark pull request: SPARK-1428: MLlib should convert non-float64 N...

2014-04-07 Thread AmplabJenkins
Github user AmplabJenkins commented on the pull request: https://github.com/apache/spark/pull/356#issuecomment-39816913 Can one of the admins verify this patch? --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your proj

[GitHub] spark pull request: Fix:SPARK-1441 Compile Spark Core error with H...

2014-04-07 Thread AmplabJenkins
Github user AmplabJenkins commented on the pull request: https://github.com/apache/spark/pull/357#issuecomment-39816909 Can one of the admins verify this patch? --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your proj

[GitHub] spark pull request: Fix:SPARK-1441 Compile Spark Core error with H...

2014-04-07 Thread witgo
GitHub user witgo opened a pull request: https://github.com/apache/spark/pull/357 Fix:SPARK-1441 Compile Spark Core error with Hadoop 0.23.x You can merge this pull request into a Git repository by running: $ git pull https://github.com/witgo/spark SPARK-1441 Alternatively yo

[GitHub] spark pull request: SPARK-1428: MLlib should convert non-float64 N...

2014-04-07 Thread techaddict
GitHub user techaddict opened a pull request: https://github.com/apache/spark/pull/356 SPARK-1428: MLlib should convert non-float64 NumPy arrays to float64 instead of complaining You can merge this pull request into a Git repository by running: $ git pull https://github.com/t

[GitHub] spark pull request: [SPARK-1103] [WIP] Automatic garbage collectio...

2014-04-07 Thread witgo
Github user witgo commented on the pull request: https://github.com/apache/spark/pull/126#issuecomment-39816405 Good job, guys. --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this feature en

[GitHub] spark pull request: [SPARK-1103] [WIP] Automatic garbage collectio...

2014-04-07 Thread pwendell
Github user pwendell commented on the pull request: https://github.com/apache/spark/pull/126#issuecomment-39816346 Merged into master. --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this fea

[GitHub] spark pull request: [SPARK-1103] [WIP] Automatic garbage collectio...

2014-04-07 Thread pwendell
Github user pwendell commented on the pull request: https://github.com/apache/spark/pull/126#issuecomment-39816204 Looks good to me. Thanks @tdas and @andrewor14 for a ton of work on this patch. I'll merge this. --- If your project is set up for it, you can reply to this email and ha

[GitHub] spark pull request: Spark 939 allow user jars to take precedence o...

2014-04-07 Thread AmplabJenkins
Github user AmplabJenkins commented on the pull request: https://github.com/apache/spark/pull/217#issuecomment-39815229 Refer to this link for build results: https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/13881/ --- If your project is set up for it, you can r

[GitHub] spark pull request: Spark 939 allow user jars to take precedence o...

2014-04-07 Thread AmplabJenkins
Github user AmplabJenkins commented on the pull request: https://github.com/apache/spark/pull/217#issuecomment-39815228 Merged build finished. --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have

[GitHub] spark pull request: Spark 939 allow user jars to take precedence o...

2014-04-07 Thread AmplabJenkins
Github user AmplabJenkins commented on the pull request: https://github.com/apache/spark/pull/217#issuecomment-39815143 Merged build triggered. --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not ha

[GitHub] spark pull request: Spark 939 allow user jars to take precedence o...

2014-04-07 Thread AmplabJenkins
Github user AmplabJenkins commented on the pull request: https://github.com/apache/spark/pull/217#issuecomment-39815148 Merged build started. --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have

[GitHub] spark pull request: [SPARK-1103] [WIP] Automatic garbage collectio...

2014-04-07 Thread AmplabJenkins
Github user AmplabJenkins commented on the pull request: https://github.com/apache/spark/pull/126#issuecomment-39814561 Merged build finished. All automated tests passed. --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If

[GitHub] spark pull request: SPARK-1242 Add aggregate to python rdd

2014-04-07 Thread AmplabJenkins
Github user AmplabJenkins commented on the pull request: https://github.com/apache/spark/pull/139#issuecomment-39814560 All automated tests passed. Refer to this link for build results: https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/13879/ --- If your project

[GitHub] spark pull request: Spark 1271 (1320) cogroup and groupby should p...

2014-04-07 Thread AmplabJenkins
Github user AmplabJenkins commented on the pull request: https://github.com/apache/spark/pull/242#issuecomment-39814557 Build finished. --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this f

[GitHub] spark pull request: SPARK-1242 Add aggregate to python rdd

2014-04-07 Thread AmplabJenkins
Github user AmplabJenkins commented on the pull request: https://github.com/apache/spark/pull/139#issuecomment-39814559 Build finished. All automated tests passed. --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your p

[GitHub] spark pull request: Spark 1271 (1320) cogroup and groupby should p...

2014-04-07 Thread AmplabJenkins
Github user AmplabJenkins commented on the pull request: https://github.com/apache/spark/pull/242#issuecomment-39814558 Refer to this link for build results: https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/13878/ --- If your project is set up for it, you can r

[GitHub] spark pull request: [SPARK-1103] [WIP] Automatic garbage collectio...

2014-04-07 Thread AmplabJenkins
Github user AmplabJenkins commented on the pull request: https://github.com/apache/spark/pull/126#issuecomment-39814562 All automated tests passed. Refer to this link for build results: https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/13880/ --- If your project

[GitHub] spark pull request: [SPARK-1103] [WIP] Automatic garbage collectio...

2014-04-07 Thread pwendell
Github user pwendell commented on the pull request: https://github.com/apache/spark/pull/126#issuecomment-39814456 This passed tests, it appears there was an issue with the junit output stuff on jenkins... --- If your project is set up for it, you can reply to this email and have you

[GitHub] spark pull request: [SPARK-1402] Added 3 more compression schemes

2014-04-07 Thread asfgit
Github user asfgit closed the pull request at: https://github.com/apache/spark/pull/330 --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this feature enabled and wishes so, or if the feature is enabl

[GitHub] spark pull request: [SPARK-1402] Added 3 more compression schemes

2014-04-07 Thread rxin
Github user rxin commented on the pull request: https://github.com/apache/spark/pull/330#issuecomment-39812816 ok i merged this. thanks --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this fe

[GitHub] spark pull request: SPARK-1157: L-BFGS Optimizer based on Breeze's...

2014-04-07 Thread AmplabJenkins
Github user AmplabJenkins commented on the pull request: https://github.com/apache/spark/pull/353#issuecomment-39812370 All automated tests passed. Refer to this link for build results: https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/13877/ --- If your project

[GitHub] spark pull request: SPARK-1157: L-BFGS Optimizer based on Breeze's...

2014-04-07 Thread AmplabJenkins
Github user AmplabJenkins commented on the pull request: https://github.com/apache/spark/pull/353#issuecomment-39812368 Merged build finished. All automated tests passed. --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If

[GitHub] spark pull request: SPARK-1433: Upgrade Mesos dependency to 0.17.0

2014-04-07 Thread AmplabJenkins
Github user AmplabJenkins commented on the pull request: https://github.com/apache/spark/pull/355#issuecomment-39812203 Can one of the admins verify this patch? --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your proj

[GitHub] spark pull request: SPARK-729: Closures not always serialized at c...

2014-04-07 Thread willb
Github user willb commented on the pull request: https://github.com/apache/spark/pull/189#issuecomment-39812228 I'm still tracking down exactly where this problem is coming from, but here's a little more detail on what's going wrong with Python accumulators when the closure passed to

[GitHub] spark pull request: SPARK-1433: Upgrade Mesos dependency to 0.17.0

2014-04-07 Thread techaddict
GitHub user techaddict opened a pull request: https://github.com/apache/spark/pull/355 SPARK-1433: Upgrade Mesos dependency to 0.17.0 Mesos 0.13.0 was released 6 months ago. Upgrade Mesos dependency to 0.17.0 You can merge this pull request into a Git repository by running:

[GitHub] spark pull request: SPARK-1242 Add aggregate to python rdd

2014-04-07 Thread AmplabJenkins
Github user AmplabJenkins commented on the pull request: https://github.com/apache/spark/pull/139#issuecomment-39811442 Build triggered. --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this

[GitHub] spark pull request: SPARK-1242 Add aggregate to python rdd

2014-04-07 Thread AmplabJenkins
Github user AmplabJenkins commented on the pull request: https://github.com/apache/spark/pull/139#issuecomment-39811446 Build started. --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this fe

[GitHub] spark pull request: [SPARK-1103] [WIP] Automatic garbage collectio...

2014-04-07 Thread AmplabJenkins
Github user AmplabJenkins commented on the pull request: https://github.com/apache/spark/pull/126#issuecomment-39811444 Merged build triggered. --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not ha

[GitHub] spark pull request: [SPARK-1103] [WIP] Automatic garbage collectio...

2014-04-07 Thread AmplabJenkins
Github user AmplabJenkins commented on the pull request: https://github.com/apache/spark/pull/126#issuecomment-39811447 Merged build started. --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have

[GitHub] spark pull request: Spark 1271 (1320) cogroup and groupby should p...

2014-04-07 Thread AmplabJenkins
Github user AmplabJenkins commented on the pull request: https://github.com/apache/spark/pull/242#issuecomment-39811244 Build triggered. --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this

[GitHub] spark pull request: Spark 1271 (1320) cogroup and groupby should p...

2014-04-07 Thread AmplabJenkins
Github user AmplabJenkins commented on the pull request: https://github.com/apache/spark/pull/242#issuecomment-39811251 Build started. --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this fe

[GitHub] spark pull request: [SPARK-1103] [WIP] Automatic garbage collectio...

2014-04-07 Thread pwendell
Github user pwendell commented on the pull request: https://github.com/apache/spark/pull/126#issuecomment-39810858 Looks like there were failures here: ``` [info] - query block statuses *** FAILED *** (30 seconds, 11 milliseconds) [info] java.util.concurrent.TimeoutEx

[GitHub] spark pull request: SPARK-1157: L-BFGS Optimizer based on Breeze's...

2014-04-07 Thread AmplabJenkins
Github user AmplabJenkins commented on the pull request: https://github.com/apache/spark/pull/353#issuecomment-39810855 Merged build started. --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have

[GitHub] spark pull request: SPARK-1157: L-BFGS Optimizer based on Breeze's...

2014-04-07 Thread AmplabJenkins
Github user AmplabJenkins commented on the pull request: https://github.com/apache/spark/pull/353#issuecomment-39810849 Merged build triggered. --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not ha

[GitHub] spark pull request: [SPARK-1103] [WIP] Automatic garbage collectio...

2014-04-07 Thread AmplabJenkins
Github user AmplabJenkins commented on the pull request: https://github.com/apache/spark/pull/126#issuecomment-39810678 Merged build finished. --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have

[GitHub] spark pull request: [SPARK-1103] [WIP] Automatic garbage collectio...

2014-04-07 Thread AmplabJenkins
Github user AmplabJenkins commented on the pull request: https://github.com/apache/spark/pull/126#issuecomment-39810679 Refer to this link for build results: https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/13876/ --- If your project is set up for it, you can r

[GitHub] spark pull request: [SQL] SPARK-1424 Generalize insertIntoTable fu...

2014-04-07 Thread rxin
Github user rxin commented on a diff in the pull request: https://github.com/apache/spark/pull/354#discussion_r11375853 --- Diff: sql/core/src/main/scala/org/apache/spark/sql/SchemaRDDLike.scala --- @@ -62,4 +64,41 @@ trait SchemaRDDLike { def registerAsTable(tableName: Stri

[GitHub] spark pull request: [SQL] SPARK-1424 Generalize insertIntoTable fu...

2014-04-07 Thread rxin
Github user rxin commented on a diff in the pull request: https://github.com/apache/spark/pull/354#discussion_r11375843 --- Diff: sql/core/src/main/scala/org/apache/spark/sql/SchemaRDDLike.scala --- @@ -62,4 +64,41 @@ trait SchemaRDDLike { def registerAsTable(tableName: Stri

[GitHub] spark pull request: [SQL] SPARK-1424 Generalize insertIntoTable fu...

2014-04-07 Thread rxin
Github user rxin commented on a diff in the pull request: https://github.com/apache/spark/pull/354#discussion_r11375848 --- Diff: sql/core/src/main/scala/org/apache/spark/sql/SchemaRDDLike.scala --- @@ -62,4 +64,41 @@ trait SchemaRDDLike { def registerAsTable(tableName: Stri

[GitHub] spark pull request: [SPARK-1103] [WIP] Automatic garbage collectio...

2014-04-07 Thread tdas
Github user tdas commented on a diff in the pull request: https://github.com/apache/spark/pull/126#discussion_r11375673 --- Diff: core/src/main/scala/org/apache/spark/util/TimeStampedHashMap.scala --- @@ -87,53 +86,67 @@ class TimeStampedHashMap[A, B](updateTimeStampOnGet: Boolean

[GitHub] spark pull request: [SPARK-1103] [WIP] Automatic garbage collectio...

2014-04-07 Thread AmplabJenkins
Github user AmplabJenkins commented on the pull request: https://github.com/apache/spark/pull/126#issuecomment-39809380 Merged build triggered. --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not ha

[GitHub] spark pull request: [SPARK-1103] [WIP] Automatic garbage collectio...

2014-04-07 Thread AmplabJenkins
Github user AmplabJenkins commented on the pull request: https://github.com/apache/spark/pull/126#issuecomment-39809384 Merged build started. --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have

[GitHub] spark pull request: [SPARK-1103] [WIP] Automatic garbage collectio...

2014-04-07 Thread pwendell
Github user pwendell commented on the pull request: https://github.com/apache/spark/pull/126#issuecomment-39809254 Jenkins, test this please. --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have t

[GitHub] spark pull request: [SPARK-1103] [WIP] Automatic garbage collectio...

2014-04-07 Thread pwendell
Github user pwendell commented on a diff in the pull request: https://github.com/apache/spark/pull/126#discussion_r11375347 --- Diff: core/src/main/scala/org/apache/spark/util/TimeStampedHashMap.scala --- @@ -87,53 +86,67 @@ class TimeStampedHashMap[A, B](updateTimeStampOnGet: Boo

[GitHub] spark pull request: [SPARK-1357] [MLLIB] Annotate developer and ex...

2014-04-07 Thread manishamde
Github user manishamde commented on the pull request: https://github.com/apache/spark/pull/298#issuecomment-39808066 LGTM! A couple of minor suggestions: + case class Split could be marked as Developer API + def loadLabeledData and val usage in DecisionTree object could

[GitHub] spark pull request: [SQL] SPARK-1424 Generalize insertIntoTable fu...

2014-04-07 Thread AmplabJenkins
Github user AmplabJenkins commented on the pull request: https://github.com/apache/spark/pull/354#issuecomment-39807995 All automated tests passed. Refer to this link for build results: https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/13875/ --- If your project

[GitHub] spark pull request: [SQL] SPARK-1424 Generalize insertIntoTable fu...

2014-04-07 Thread AmplabJenkins
Github user AmplabJenkins commented on the pull request: https://github.com/apache/spark/pull/354#issuecomment-39807993 Merged build finished. All automated tests passed. --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If

[GitHub] spark pull request: [SPARK-1103] [WIP] Automatic garbage collectio...

2014-04-07 Thread tdas
Github user tdas commented on a diff in the pull request: https://github.com/apache/spark/pull/126#discussion_r11375039 --- Diff: core/src/main/scala/org/apache/spark/storage/DiskBlockManager.scala --- @@ -90,6 +90,20 @@ private[spark] class DiskBlockManager(shuffleManager: Shuffl

[GitHub] spark pull request: [SPARK-1103] [WIP] Automatic garbage collectio...

2014-04-07 Thread pwendell
Github user pwendell commented on a diff in the pull request: https://github.com/apache/spark/pull/126#discussion_r11375031 --- Diff: core/src/main/scala/org/apache/spark/storage/DiskBlockManager.scala --- @@ -90,6 +90,20 @@ private[spark] class DiskBlockManager(shuffleManager: Sh

[GitHub] spark pull request: [SPARK-1402] Added 3 more compression schemes

2014-04-07 Thread AmplabJenkins
Github user AmplabJenkins commented on the pull request: https://github.com/apache/spark/pull/330#issuecomment-39806917 Merged build finished. All automated tests passed. --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If

[GitHub] spark pull request: [SPARK-1402] Added 3 more compression schemes

2014-04-07 Thread AmplabJenkins
Github user AmplabJenkins commented on the pull request: https://github.com/apache/spark/pull/330#issuecomment-39806918 All automated tests passed. Refer to this link for build results: https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/13874/ --- If your project

[GitHub] spark pull request: SPARK-1093: Annotate developer and experimenta...

2014-04-07 Thread AmplabJenkins
Github user AmplabJenkins commented on the pull request: https://github.com/apache/spark/pull/274#issuecomment-39806363 All automated tests passed. Refer to this link for build results: https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/13871/ --- If your project

[GitHub] spark pull request: SPARK-1093: Annotate developer and experimenta...

2014-04-07 Thread AmplabJenkins
Github user AmplabJenkins commented on the pull request: https://github.com/apache/spark/pull/274#issuecomment-39806362 Build finished. All automated tests passed. --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your p

[GitHub] spark pull request: [SPARK-1103] [WIP] Automatic garbage collectio...

2014-04-07 Thread pwendell
Github user pwendell commented on a diff in the pull request: https://github.com/apache/spark/pull/126#discussion_r11374624 --- Diff: core/src/main/scala/org/apache/spark/broadcast/HttpBroadcast.scala --- @@ -54,7 +85,15 @@ private[spark] class HttpBroadcast[T](@transient var valu

[GitHub] spark pull request: [SPARK-1103] [WIP] Automatic garbage collectio...

2014-04-07 Thread tdas
Github user tdas commented on a diff in the pull request: https://github.com/apache/spark/pull/126#discussion_r11374621 --- Diff: core/src/main/scala/org/apache/spark/broadcast/HttpBroadcast.scala --- @@ -54,7 +85,15 @@ private[spark] class HttpBroadcast[T](@transient var value_ :

[GitHub] spark pull request: [SPARK-1103] [WIP] Automatic garbage collectio...

2014-04-07 Thread pwendell
Github user pwendell commented on a diff in the pull request: https://github.com/apache/spark/pull/126#discussion_r11374594 --- Diff: core/src/main/scala/org/apache/spark/broadcast/HttpBroadcast.scala --- @@ -54,7 +85,15 @@ private[spark] class HttpBroadcast[T](@transient var valu

[GitHub] spark pull request: [SQL] SPARK-1424 Generalize insertIntoTable fu...

2014-04-07 Thread AmplabJenkins
Github user AmplabJenkins commented on the pull request: https://github.com/apache/spark/pull/354#issuecomment-39806215 Merged build triggered. --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not ha

[GitHub] spark pull request: [SQL] SPARK-1424 Generalize insertIntoTable fu...

2014-04-07 Thread AmplabJenkins
Github user AmplabJenkins commented on the pull request: https://github.com/apache/spark/pull/354#issuecomment-39806224 Merged build started. --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have

[GitHub] spark pull request: [SPARK-1103] [WIP] Automatic garbage collectio...

2014-04-07 Thread tdas
Github user tdas commented on a diff in the pull request: https://github.com/apache/spark/pull/126#discussion_r11374596 --- Diff: core/src/main/scala/org/apache/spark/broadcast/HttpBroadcast.scala --- @@ -17,34 +17,65 @@ package org.apache.spark.broadcast -impo

[GitHub] spark pull request: Added eval for Rand (without any support for u...

2014-04-07 Thread asfgit
Github user asfgit closed the pull request at: https://github.com/apache/spark/pull/349 --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this feature enabled and wishes so, or if the feature is enabl

[GitHub] spark pull request: [SPARK-1103] [WIP] Automatic garbage collectio...

2014-04-07 Thread pwendell
Github user pwendell commented on a diff in the pull request: https://github.com/apache/spark/pull/126#discussion_r11374568 --- Diff: core/src/main/scala/org/apache/spark/broadcast/HttpBroadcast.scala --- @@ -17,34 +17,65 @@ package org.apache.spark.broadcast -

[GitHub] spark pull request: Removed the default eval implementation from E...

2014-04-07 Thread asfgit
Github user asfgit closed the pull request at: https://github.com/apache/spark/pull/350 --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this feature enabled and wishes so, or if the feature is enabl

[GitHub] spark pull request: [sql] Rename execution/aggregates.scala Aggreg...

2014-04-07 Thread asfgit
Github user asfgit closed the pull request at: https://github.com/apache/spark/pull/348 --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this feature enabled and wishes so, or if the feature is enabl

[GitHub] spark pull request: Change timestamp cast semantics. When cast to ...

2014-04-07 Thread asfgit
Github user asfgit closed the pull request at: https://github.com/apache/spark/pull/352 --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this feature enabled and wishes so, or if the feature is enabl

[GitHub] spark pull request: [SPARK-1103] [WIP] Automatic garbage collectio...

2014-04-07 Thread tdas
Github user tdas commented on a diff in the pull request: https://github.com/apache/spark/pull/126#discussion_r11374564 --- Diff: core/src/main/scala/org/apache/spark/broadcast/BroadcastFactory.scala --- @@ -27,7 +27,8 @@ import org.apache.spark.SparkConf * entire Spark job.

[GitHub] spark pull request: [SQL] SPARK-1424 Generalize insertIntoTable fu...

2014-04-07 Thread marmbrus
GitHub user marmbrus opened a pull request: https://github.com/apache/spark/pull/354 [SQL] SPARK-1424 Generalize insertIntoTable functions on SchemaRDDs I don't think this is quite done yet, but want to hear what people think about this API. You can merge this pull request into a G

[GitHub] spark pull request: [SPARK-1103] [WIP] Automatic garbage collectio...

2014-04-07 Thread tdas
Github user tdas commented on a diff in the pull request: https://github.com/apache/spark/pull/126#discussion_r11374533 --- Diff: core/src/main/scala/org/apache/spark/broadcast/Broadcast.scala --- @@ -51,49 +51,80 @@ import org.apache.spark._ * @tparam T Type of the data conta

[GitHub] spark pull request: [SPARK-1103] [WIP] Automatic garbage collectio...

2014-04-07 Thread pwendell
Github user pwendell commented on a diff in the pull request: https://github.com/apache/spark/pull/126#discussion_r11374527 --- Diff: core/src/main/scala/org/apache/spark/broadcast/BroadcastFactory.scala --- @@ -27,7 +27,8 @@ import org.apache.spark.SparkConf * entire Spark j

[GitHub] spark pull request: [SPARK-1103] [WIP] Automatic garbage collectio...

2014-04-07 Thread tdas
Github user tdas commented on a diff in the pull request: https://github.com/apache/spark/pull/126#discussion_r11374505 --- Diff: core/src/main/scala/org/apache/spark/ContextCleaner.scala --- @@ -0,0 +1,203 @@ +/* + * Licensed to the Apache Software Foundation (ASF) under on

[GitHub] spark pull request: [SPARK-1103] [WIP] Automatic garbage collectio...

2014-04-07 Thread pwendell
Github user pwendell commented on a diff in the pull request: https://github.com/apache/spark/pull/126#discussion_r11374503 --- Diff: core/src/main/scala/org/apache/spark/broadcast/Broadcast.scala --- @@ -51,49 +51,80 @@ import org.apache.spark._ * @tparam T Type of the data c

[GitHub] spark pull request: [SPARK-1103] [WIP] Automatic garbage collectio...

2014-04-07 Thread tdas
Github user tdas commented on a diff in the pull request: https://github.com/apache/spark/pull/126#discussion_r11374454 --- Diff: core/src/main/scala/org/apache/spark/ContextCleaner.scala --- @@ -0,0 +1,203 @@ +/* + * Licensed to the Apache Software Foundation (ASF) under on

[GitHub] spark pull request: [SPARK-1103] [WIP] Automatic garbage collectio...

2014-04-07 Thread tdas
Github user tdas commented on a diff in the pull request: https://github.com/apache/spark/pull/126#discussion_r11374450 --- Diff: core/src/main/scala/org/apache/spark/SparkContext.scala --- @@ -233,6 +233,13 @@ class SparkContext( @volatile private[spark] var dagScheduler = n

[GitHub] spark pull request: [SPARK-1103] [WIP] Automatic garbage collectio...

2014-04-07 Thread tdas
Github user tdas commented on a diff in the pull request: https://github.com/apache/spark/pull/126#discussion_r11374414 --- Diff: core/src/main/scala/org/apache/spark/ContextCleaner.scala --- @@ -0,0 +1,203 @@ +/* + * Licensed to the Apache Software Foundation (ASF) under on

[GitHub] spark pull request: Change timestamp cast semantics. When cast to ...

2014-04-07 Thread rxin
Github user rxin commented on the pull request: https://github.com/apache/spark/pull/352#issuecomment-39805816 ok merged --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this feature enabled a

[GitHub] spark pull request: [SPARK-1103] [WIP] Automatic garbage collectio...

2014-04-07 Thread pwendell
Github user pwendell commented on a diff in the pull request: https://github.com/apache/spark/pull/126#discussion_r11374381 --- Diff: core/src/main/scala/org/apache/spark/SparkContext.scala --- @@ -233,6 +233,13 @@ class SparkContext( @volatile private[spark] var dagScheduler

[GitHub] spark pull request: [SPARK-1103] [WIP] Automatic garbage collectio...

2014-04-07 Thread tdas
Github user tdas commented on a diff in the pull request: https://github.com/apache/spark/pull/126#discussion_r11374398 --- Diff: core/src/main/scala/org/apache/spark/ContextCleaner.scala --- @@ -0,0 +1,203 @@ +/* + * Licensed to the Apache Software Foundation (ASF) under on

[GitHub] spark pull request: [SPARK-1103] [WIP] Automatic garbage collectio...

2014-04-07 Thread pwendell
Github user pwendell commented on a diff in the pull request: https://github.com/apache/spark/pull/126#discussion_r11374288 --- Diff: core/src/main/scala/org/apache/spark/ContextCleaner.scala --- @@ -0,0 +1,203 @@ +/* + * Licensed to the Apache Software Foundation (ASF) unde

[GitHub] spark pull request: [SPARK-1103] [WIP] Automatic garbage collectio...

2014-04-07 Thread pwendell
Github user pwendell commented on a diff in the pull request: https://github.com/apache/spark/pull/126#discussion_r11374262 --- Diff: core/src/main/scala/org/apache/spark/ContextCleaner.scala --- @@ -0,0 +1,203 @@ +/* + * Licensed to the Apache Software Foundation (ASF) unde

[GitHub] spark pull request: SPARK-1157: L-BFGS Optimizer based on Breeze's...

2014-04-07 Thread AmplabJenkins
Github user AmplabJenkins commented on the pull request: https://github.com/apache/spark/pull/353#issuecomment-39805202 Refer to this link for build results: https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/13873/ --- If your project is set up for it, you can r

[GitHub] spark pull request: SPARK-1157: L-BFGS Optimizer based on Breeze's...

2014-04-07 Thread AmplabJenkins
Github user AmplabJenkins commented on the pull request: https://github.com/apache/spark/pull/353#issuecomment-39805201 Merged build finished. --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have

[GitHub] spark pull request: [SPARK-1103] [WIP] Automatic garbage collectio...

2014-04-07 Thread pwendell
Github user pwendell commented on a diff in the pull request: https://github.com/apache/spark/pull/126#discussion_r11374136 --- Diff: core/src/main/scala/org/apache/spark/ContextCleaner.scala --- @@ -0,0 +1,203 @@ +/* + * Licensed to the Apache Software Foundation (ASF) unde

[GitHub] spark pull request: [SPARK-1402] Added 3 more compression schemes

2014-04-07 Thread liancheng
Github user liancheng commented on the pull request: https://github.com/apache/spark/pull/330#issuecomment-39805127 Hi @rxin @marmbrus, fixed the bug and added a regression test. Please help to verify, thanks. --- If your project is set up for it, you can reply to this email and have

[GitHub] spark pull request: [SPARK-1402] Added 3 more compression schemes

2014-04-07 Thread AmplabJenkins
Github user AmplabJenkins commented on the pull request: https://github.com/apache/spark/pull/330#issuecomment-39805065 Merged build triggered. --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not ha

[GitHub] spark pull request: [SPARK-1402] Added 3 more compression schemes

2014-04-07 Thread AmplabJenkins
Github user AmplabJenkins commented on the pull request: https://github.com/apache/spark/pull/330#issuecomment-39805074 Merged build started. --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have

[GitHub] spark pull request: SPARK-1157: L-BFGS Optimizer based on Breeze's...

2014-04-07 Thread AmplabJenkins
Github user AmplabJenkins commented on the pull request: https://github.com/apache/spark/pull/353#issuecomment-39804835 Merged build triggered. --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not ha

[GitHub] spark pull request: SPARK-1157: L-BFGS Optimizer based on Breeze's...

2014-04-07 Thread AmplabJenkins
Github user AmplabJenkins commented on the pull request: https://github.com/apache/spark/pull/353#issuecomment-39804838 Merged build started. --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have

[GitHub] spark pull request: Change timestamp cast semantics. When cast to ...

2014-04-07 Thread AmplabJenkins
Github user AmplabJenkins commented on the pull request: https://github.com/apache/spark/pull/352#issuecomment-39804704 Merged build finished. --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have

[GitHub] spark pull request: Change timestamp cast semantics. When cast to ...

2014-04-07 Thread AmplabJenkins
Github user AmplabJenkins commented on the pull request: https://github.com/apache/spark/pull/352#issuecomment-39804706 Refer to this link for build results: https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/13870/ --- If your project is set up for it, you can r

[GitHub] spark pull request: SPARK-1157: L-BFGS Optimizer based on Breeze's...

2014-04-07 Thread AmplabJenkins
Github user AmplabJenkins commented on the pull request: https://github.com/apache/spark/pull/353#issuecomment-39804441 Merged build finished. --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have

[GitHub] spark pull request: SPARK-1157: L-BFGS Optimizer based on Breeze's...

2014-04-07 Thread AmplabJenkins
Github user AmplabJenkins commented on the pull request: https://github.com/apache/spark/pull/353#issuecomment-39804443 Refer to this link for build results: https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/13872/ --- If your project is set up for it, you can r

[GitHub] spark pull request: Remove extendedDebugInfo option in test build ...

2014-04-07 Thread marmbrus
Github user marmbrus commented on the pull request: https://github.com/apache/spark/pull/346#issuecomment-39804460 Here is a case where the streaming tests passed with the option turned on. The solution to the hive tests is to parallelize them as was done here: https://travis-

[GitHub] spark pull request: Remove extendedDebugInfo option in test build ...

2014-04-07 Thread haosdent
Github user haosdent commented on the pull request: https://github.com/apache/spark/pull/346#issuecomment-39804422 Thank you for your quick reply. I should do some learning about this. Thank you again! --- If your project is set up for it, you can reply to this email and have your re

[GitHub] spark pull request: SPARK-1157: L-BFGS Optimizer based on Breeze's...

2014-04-07 Thread AmplabJenkins
Github user AmplabJenkins commented on the pull request: https://github.com/apache/spark/pull/353#issuecomment-39804336 Merged build triggered. --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not ha

[GitHub] spark pull request: SPARK-1157: L-BFGS Optimizer based on Breeze's...

2014-04-07 Thread AmplabJenkins
Github user AmplabJenkins commented on the pull request: https://github.com/apache/spark/pull/353#issuecomment-39804341 Merged build started. --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have

[GitHub] spark pull request: Remove extendedDebugInfo option in test build ...

2014-04-07 Thread marmbrus
Github user marmbrus commented on the pull request: https://github.com/apache/spark/pull/346#issuecomment-39804217 The hive tests are likely failing to complete more often because #275 turned on a whole bunch more. --- If your project is set up for it, you can reply to this email and

[GitHub] spark pull request: SPARK-1157: L-BFGS Optimizer based on Breeze's...

2014-04-07 Thread dbtsai
GitHub user dbtsai opened a pull request: https://github.com/apache/spark/pull/353 SPARK-1157: L-BFGS Optimizer based on Breeze's implementation. This PR uses Breeze's L-BFGS implement, and Breeze dependency has already been introduced by Xiangrui's sparse input format work in SPARK

[GitHub] spark pull request: Remove extendedDebugInfo option in test build ...

2014-04-07 Thread marmbrus
Github user marmbrus commented on the pull request: https://github.com/apache/spark/pull/346#issuecomment-39804104 InputStreamsSuite has been failing and the hive tests have taken more than 50 minutes long before this option was turned on. They have also both passed since this

[GitHub] spark pull request: Remove extendedDebugInfo option in test build ...

2014-04-07 Thread haosdent
Github user haosdent commented on the pull request: https://github.com/apache/spark/pull/346#issuecomment-39803998 @marmbrus IMHO, I am afraid this option trigger potential exist bugs related serialization. After the commit, all builds in travis have two problem: 1. Failed in

[GitHub] spark pull request: SPARK-1093: Annotate developer and experimenta...

2014-04-07 Thread AmplabJenkins
Github user AmplabJenkins commented on the pull request: https://github.com/apache/spark/pull/274#issuecomment-39803855 Build triggered. --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this

  1   2   3   4   >