[GitHub] spark pull request: [SPARK-1103] [WIP] Automatic garbage collectio...

2014-04-08 Thread pwendell
Github user pwendell commented on the pull request: https://github.com/apache/spark/pull/126#issuecomment-39814456 This passed tests, it appears there was an issue with the junit output stuff on jenkins... --- If your project is set up for it, you can reply to this email and have

[GitHub] spark pull request: Spark 1271 (1320) cogroup and groupby should p...

2014-04-08 Thread AmplabJenkins
Github user AmplabJenkins commented on the pull request: https://github.com/apache/spark/pull/242#issuecomment-39814558 Refer to this link for build results: https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/13878/ --- If your project is set up for it, you can

[GitHub] spark pull request: [SPARK-1103] [WIP] Automatic garbage collectio...

2014-04-08 Thread AmplabJenkins
Github user AmplabJenkins commented on the pull request: https://github.com/apache/spark/pull/126#issuecomment-39814562 All automated tests passed. Refer to this link for build results: https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/13880/ --- If your project

[GitHub] spark pull request: [SPARK-1103] [WIP] Automatic garbage collectio...

2014-04-08 Thread AmplabJenkins
Github user AmplabJenkins commented on the pull request: https://github.com/apache/spark/pull/126#issuecomment-39814561 Merged build finished. All automated tests passed. --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well.

[GitHub] spark pull request: Spark 939 allow user jars to take precedence o...

2014-04-08 Thread AmplabJenkins
Github user AmplabJenkins commented on the pull request: https://github.com/apache/spark/pull/217#issuecomment-39815143 Merged build triggered. --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not

[GitHub] spark pull request: Spark 939 allow user jars to take precedence o...

2014-04-08 Thread AmplabJenkins
Github user AmplabJenkins commented on the pull request: https://github.com/apache/spark/pull/217#issuecomment-39815228 Merged build finished. --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not

[GitHub] spark pull request: Spark 939 allow user jars to take precedence o...

2014-04-08 Thread AmplabJenkins
Github user AmplabJenkins commented on the pull request: https://github.com/apache/spark/pull/217#issuecomment-39815229 Refer to this link for build results: https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/13881/ --- If your project is set up for it, you can

[GitHub] spark pull request: [SPARK-1103] [WIP] Automatic garbage collectio...

2014-04-08 Thread pwendell
Github user pwendell commented on the pull request: https://github.com/apache/spark/pull/126#issuecomment-39816204 Looks good to me. Thanks @tdas and @andrewor14 for a ton of work on this patch. I'll merge this. --- If your project is set up for it, you can reply to this email and

[GitHub] spark pull request: [SPARK-1103] [WIP] Automatic garbage collectio...

2014-04-08 Thread pwendell
Github user pwendell commented on the pull request: https://github.com/apache/spark/pull/126#issuecomment-39816346 Merged into master. --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this

[GitHub] spark pull request: [SPARK-1103] [WIP] Automatic garbage collectio...

2014-04-08 Thread witgo
Github user witgo commented on the pull request: https://github.com/apache/spark/pull/126#issuecomment-39816405 Good job, guys. --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this feature

[GitHub] spark pull request: SPARK-1428: MLlib should convert non-float64 N...

2014-04-08 Thread techaddict
GitHub user techaddict opened a pull request: https://github.com/apache/spark/pull/356 SPARK-1428: MLlib should convert non-float64 NumPy arrays to float64 instead of complaining You can merge this pull request into a Git repository by running: $ git pull

[GitHub] spark pull request: Fix:SPARK-1441 Compile Spark Core error with H...

2014-04-08 Thread witgo
GitHub user witgo opened a pull request: https://github.com/apache/spark/pull/357 Fix:SPARK-1441 Compile Spark Core error with Hadoop 0.23.x You can merge this pull request into a Git repository by running: $ git pull https://github.com/witgo/spark SPARK-1441 Alternatively

[GitHub] spark pull request: Spark-1230: Enable SparkContext.addJars() to l...

2014-04-08 Thread pwendell
Github user pwendell commented on the pull request: https://github.com/apache/spark/pull/351#issuecomment-39817138 I don't think this merges cleanly at present - mind up-merging it? Also the test utility has been merged into mater now so you can remove it from this PR. --- If your

[GitHub] spark pull request: [SPARK-1331] Added graceful shutdown to Spark ...

2014-04-08 Thread pwendell
Github user pwendell commented on the pull request: https://github.com/apache/spark/pull/247#issuecomment-39817343 Looks good TD, merging this. --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not

[GitHub] spark pull request: Remove extra semicolon in import statement and...

2014-04-08 Thread hsaputra
GitHub user hsaputra opened a pull request: https://github.com/apache/spark/pull/358 Remove extra semicolon in import statement and unused import in ApplicationMaster Small nit cleanup to remove extra semicolon and unused import in Yarn's stable ApplicationMaster (it bothers me

[GitHub] spark pull request: Spark 939 allow user jars to take precedence o...

2014-04-08 Thread pwendell
Github user pwendell commented on a diff in the pull request: https://github.com/apache/spark/pull/217#discussion_r11378521 --- Diff: core/src/main/scala/org/apache/spark/TestUtils.scala --- @@ -95,4 +109,22 @@ object TestUtils { result.renameTo(out) out }

[GitHub] spark pull request: Fix:SPARK-1441 Compile Spark Core error with H...

2014-04-08 Thread srowen
Github user srowen commented on the pull request: https://github.com/apache/spark/pull/357#issuecomment-39817720 You're not enabling the yarn-alpha build profile here, and Hadoop 0.23.x is what it's for. Similarity for SBT although the profile is enabled by the SPARK_YARN env

[GitHub] spark pull request: Remove extra semicolon in import statement and...

2014-04-08 Thread rxin
Github user rxin commented on the pull request: https://github.com/apache/spark/pull/358#issuecomment-39817779 bothers me too. will merge once jenkins is happy. --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your

[GitHub] spark pull request: Remove extra semicolon in import statement and...

2014-04-08 Thread AmplabJenkins
Github user AmplabJenkins commented on the pull request: https://github.com/apache/spark/pull/358#issuecomment-39817794 Merged build started. --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have

[GitHub] spark pull request: Spark 939 allow user jars to take precedence o...

2014-04-08 Thread pwendell
Github user pwendell commented on a diff in the pull request: https://github.com/apache/spark/pull/217#discussion_r11378555 --- Diff: core/src/main/scala/org/apache/spark/TestUtils.scala --- @@ -42,6 +42,20 @@ object TestUtils { } /** + * Create a jar that

[GitHub] spark pull request: Remove extra semicolon in import statement and...

2014-04-08 Thread AmplabJenkins
Github user AmplabJenkins commented on the pull request: https://github.com/apache/spark/pull/358#issuecomment-39817788 Merged build triggered. --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not

[GitHub] spark pull request: Remove extra semicolon in import statement and...

2014-04-08 Thread srowen
Github user srowen commented on the pull request: https://github.com/apache/spark/pull/358#issuecomment-39818305 Meta question - all of the unused imports can be zapped in one go with an IDE and semicolons too. Is that worth one big PR here? --- If your project is set up for it, you

[GitHub] spark pull request: [SPARK-1434] [MLLIB] change labelParser from a...

2014-04-08 Thread mengxr
Github user mengxr commented on the pull request: https://github.com/apache/spark/pull/345#issuecomment-39818345 Jenkins, retest this please. --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have

[GitHub] spark pull request: [SPARK-1390] Refactoring of matrices backed by...

2014-04-08 Thread AmplabJenkins
Github user AmplabJenkins commented on the pull request: https://github.com/apache/spark/pull/296#issuecomment-39818431 Merged build started. --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have

[GitHub] spark pull request: Spark 939 allow user jars to take precedence o...

2014-04-08 Thread pwendell
Github user pwendell commented on a diff in the pull request: https://github.com/apache/spark/pull/217#discussion_r11378778 --- Diff: repl/src/main/scala/org/apache/spark/repl/ExecutorClassLoader.scala --- @@ -26,21 +26,28 @@ import org.apache.hadoop.fs.{FileSystem, Path}

[GitHub] spark pull request: [SPARK-1390] Refactoring of matrices backed by...

2014-04-08 Thread AmplabJenkins
Github user AmplabJenkins commented on the pull request: https://github.com/apache/spark/pull/296#issuecomment-39818423 Merged build triggered. --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not

[GitHub] spark pull request: [SPARK-1434] [MLLIB] change labelParser from a...

2014-04-08 Thread AmplabJenkins
Github user AmplabJenkins commented on the pull request: https://github.com/apache/spark/pull/345#issuecomment-39818419 Merged build triggered. --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not

[GitHub] spark pull request: [SPARK-1434] [MLLIB] change labelParser from a...

2014-04-08 Thread AmplabJenkins
Github user AmplabJenkins commented on the pull request: https://github.com/apache/spark/pull/345#issuecomment-39818430 Merged build started. --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have

[GitHub] spark pull request: [SPARK-1390] Refactoring of matrices backed by...

2014-04-08 Thread mengxr
Github user mengxr commented on the pull request: https://github.com/apache/spark/pull/296#issuecomment-39818904 @mateiz , I added `computeSVD` and `computeGramianMatrix` to `IndexedRowMatrix`. Covariance and PCA computation are affected by empty rows. Maybe we can assume

[GitHub] spark pull request: Spark 939 allow user jars to take precedence o...

2014-04-08 Thread pwendell
Github user pwendell commented on a diff in the pull request: https://github.com/apache/spark/pull/217#discussion_r11378988 --- Diff: repl/src/main/scala/org/apache/spark/repl/ExecutorClassLoader.scala --- @@ -26,21 +26,28 @@ import org.apache.hadoop.fs.{FileSystem, Path}

[GitHub] spark pull request: Remove extra semicolon in import statement and...

2014-04-08 Thread hsaputra
Github user hsaputra commented on the pull request: https://github.com/apache/spark/pull/358#issuecomment-39819023 @srowen there has been PRs to remove unnecessary semicolons and imports before and I believe we had remove most of them. Probably the best way to have some kind

[GitHub] spark pull request: Spark 615 map partitions with index callable f...

2014-04-08 Thread AmplabJenkins
Github user AmplabJenkins commented on the pull request: https://github.com/apache/spark/pull/16#issuecomment-39819091 Build triggered. --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this

[GitHub] spark pull request: Spark 615 map partitions with index callable f...

2014-04-08 Thread AmplabJenkins
Github user AmplabJenkins commented on the pull request: https://github.com/apache/spark/pull/16#issuecomment-39819097 Build started. --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this

[GitHub] spark pull request: Fix SPARK-1413: Parquet messes up stdout and s...

2014-04-08 Thread witgo
Github user witgo commented on the pull request: https://github.com/apache/spark/pull/325#issuecomment-39819593 @AndreSchumacher You're right,the code has been modified. --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as

[GitHub] spark pull request: [SPARK-1103] [WIP] Automatic garbage collectio...

2014-04-08 Thread asfgit
Github user asfgit closed the pull request at: https://github.com/apache/spark/pull/126 --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this feature enabled and wishes so, or if the feature is

[GitHub] spark pull request: Remove extra semicolon in import statement and...

2014-04-08 Thread AmplabJenkins
Github user AmplabJenkins commented on the pull request: https://github.com/apache/spark/pull/358#issuecomment-39820120 Refer to this link for build results: https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/13882/ --- If your project is set up for it, you can

[GitHub] spark pull request: Remove extra semicolon in import statement and...

2014-04-08 Thread AmplabJenkins
Github user AmplabJenkins commented on the pull request: https://github.com/apache/spark/pull/358#issuecomment-39820119 Merged build finished. --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not

[GitHub] spark pull request: [SPARK-1357] [MLLIB] Annotate developer and ex...

2014-04-08 Thread AmplabJenkins
Github user AmplabJenkins commented on the pull request: https://github.com/apache/spark/pull/298#issuecomment-39820261 Merged build triggered. --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not

[GitHub] spark pull request: Spark 939 allow user jars to take precedence o...

2014-04-08 Thread AmplabJenkins
Github user AmplabJenkins commented on the pull request: https://github.com/apache/spark/pull/217#issuecomment-39820263 Merged build triggered. --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not

[GitHub] spark pull request: Spark 939 allow user jars to take precedence o...

2014-04-08 Thread AmplabJenkins
Github user AmplabJenkins commented on the pull request: https://github.com/apache/spark/pull/217#issuecomment-39820273 Merged build started. --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have

[GitHub] spark pull request: [SPARK-1357] [MLLIB] Annotate developer and ex...

2014-04-08 Thread AmplabJenkins
Github user AmplabJenkins commented on the pull request: https://github.com/apache/spark/pull/298#issuecomment-39820270 Merged build started. --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have

[GitHub] spark pull request: Spark-1230: Enable SparkContext.addJars() to l...

2014-04-08 Thread AmplabJenkins
Github user AmplabJenkins commented on the pull request: https://github.com/apache/spark/pull/351#issuecomment-39820259 Build triggered. --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have

[GitHub] spark pull request: Spark-1230: Enable SparkContext.addJars() to l...

2014-04-08 Thread AmplabJenkins
Github user AmplabJenkins commented on the pull request: https://github.com/apache/spark/pull/351#issuecomment-39820268 Build started. --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this

[GitHub] spark pull request: Spark 939 allow user jars to take precedence o...

2014-04-08 Thread AmplabJenkins
Github user AmplabJenkins commented on the pull request: https://github.com/apache/spark/pull/217#issuecomment-39820353 Refer to this link for build results: https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/13888/ --- If your project is set up for it, you can

[GitHub] spark pull request: Spark 939 allow user jars to take precedence o...

2014-04-08 Thread AmplabJenkins
Github user AmplabJenkins commented on the pull request: https://github.com/apache/spark/pull/217#issuecomment-39820352 Merged build finished. --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not

[GitHub] spark pull request: [SPARK-1434] [MLLIB] change labelParser from a...

2014-04-08 Thread AmplabJenkins
Github user AmplabJenkins commented on the pull request: https://github.com/apache/spark/pull/345#issuecomment-39821086 Merged build finished. All automated tests passed. --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well.

[GitHub] spark pull request: [SPARK-1434] [MLLIB] change labelParser from a...

2014-04-08 Thread AmplabJenkins
Github user AmplabJenkins commented on the pull request: https://github.com/apache/spark/pull/345#issuecomment-39821087 All automated tests passed. Refer to this link for build results: https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/13883/ --- If your project

[GitHub] spark pull request: Spark 1271 (1320) cogroup and groupby should p...

2014-04-08 Thread pwendell
Github user pwendell commented on a diff in the pull request: https://github.com/apache/spark/pull/242#discussion_r11379907 --- Diff: core/src/main/scala/org/apache/spark/rdd/PairRDDFunctions.scala --- @@ -298,7 +298,8 @@ class PairRDDFunctions[K: ClassTag, V: ClassTag](self:

[GitHub] spark pull request: Spark 939 allow user jars to take precedence o...

2014-04-08 Thread AmplabJenkins
Github user AmplabJenkins commented on the pull request: https://github.com/apache/spark/pull/217#issuecomment-39821357 Merged build triggered. --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not

[GitHub] spark pull request: Spark 939 allow user jars to take precedence o...

2014-04-08 Thread AmplabJenkins
Github user AmplabJenkins commented on the pull request: https://github.com/apache/spark/pull/217#issuecomment-39821371 Merged build started. --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have

[GitHub] spark pull request: [SPARK-1396] Properly cleanup DAGScheduler on ...

2014-04-08 Thread kayousterhout
Github user kayousterhout commented on the pull request: https://github.com/apache/spark/pull/305#issuecomment-39821467 I've merged this into master --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does

[GitHub] spark pull request: SPARK-1127 Add spark-hbase.

2014-04-08 Thread haosdent
Github user haosdent commented on the pull request: https://github.com/apache/spark/pull/194#issuecomment-39821743 @pwendell @marmbrus Could you help me review this pull request again? Thank you in advance. --- If your project is set up for it, you can reply to this email and have

[GitHub] spark pull request: Spark 615 map partitions with index callable f...

2014-04-08 Thread AmplabJenkins
Github user AmplabJenkins commented on the pull request: https://github.com/apache/spark/pull/16#issuecomment-39822160 Build finished. All automated tests passed. --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your

[GitHub] spark pull request: [SPARK-1390] Refactoring of matrices backed by...

2014-04-08 Thread AmplabJenkins
Github user AmplabJenkins commented on the pull request: https://github.com/apache/spark/pull/296#issuecomment-39822162 All automated tests passed. Refer to this link for build results: https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/13884/ --- If your project

[GitHub] spark pull request: Spark 615 map partitions with index callable f...

2014-04-08 Thread AmplabJenkins
Github user AmplabJenkins commented on the pull request: https://github.com/apache/spark/pull/16#issuecomment-39822161 All automated tests passed. Refer to this link for build results: https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/13885/ --- If your project

[GitHub] spark pull request: [SPARK-1390] Refactoring of matrices backed by...

2014-04-08 Thread AmplabJenkins
Github user AmplabJenkins commented on the pull request: https://github.com/apache/spark/pull/296#issuecomment-39822159 Merged build finished. All automated tests passed. --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well.

[GitHub] spark pull request: [WIP] [SPARK-1328] Add vector statistics

2014-04-08 Thread mengxr
Github user mengxr commented on the pull request: https://github.com/apache/spark/pull/268#issuecomment-39822204 @yinxusen Yes, let's wait until #296 gets merged. Thanks for being patient! --- If your project is set up for it, you can reply to this email and have your reply appear

[GitHub] spark pull request: Spark 1271 (1320) cogroup and groupby should p...

2014-04-08 Thread pwendell
Github user pwendell commented on a diff in the pull request: https://github.com/apache/spark/pull/242#discussion_r11380250 --- Diff: core/src/main/scala/org/apache/spark/rdd/PairRDDFunctions.scala --- @@ -328,9 +330,10 @@ class PairRDDFunctions[K: ClassTag, V: ClassTag](self:

[GitHub] spark pull request: Spark 1271 (1320) cogroup and groupby should p...

2014-04-08 Thread pwendell
Github user pwendell commented on a diff in the pull request: https://github.com/apache/spark/pull/242#discussion_r11380312 --- Diff: core/src/test/java/org/apache/spark/JavaAPISuite.java --- @@ -78,6 +79,38 @@ public int compare(Integer a, Integer b) { } }

[GitHub] spark pull request: [WIP] [SPARK-1328] Add vector statistics

2014-04-08 Thread mengxr
Github user mengxr commented on the pull request: https://github.com/apache/spark/pull/268#issuecomment-39822477 Btw, can we use sample variance instead of population variance? --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as

[GitHub] spark pull request: Spark 1271 (1320) cogroup and groupby should p...

2014-04-08 Thread pwendell
Github user pwendell commented on a diff in the pull request: https://github.com/apache/spark/pull/242#discussion_r11380438 --- Diff: extras/java8-tests/src/test/java/org/apache/spark/Java8APISuite.java --- @@ -60,6 +60,16 @@ public void tearDown() {

[GitHub] spark pull request: Spark 1271 (1320) cogroup and groupby should p...

2014-04-08 Thread pwendell
Github user pwendell commented on a diff in the pull request: https://github.com/apache/spark/pull/242#discussion_r11380428 --- Diff: examples/src/main/java/org/apache/spark/examples/JavaPageRank.java --- @@ -86,12 +87,18 @@ public Double call(ListString rs) { for (int

[GitHub] spark pull request: [WIP] [SPARK-1328] Add vector statistics

2014-04-08 Thread yinxusen
Github user yinxusen commented on the pull request: https://github.com/apache/spark/pull/268#issuecomment-39822920 @mengxr Yep, I have substituted the population variance with sample variance. See line 97. in VectorRDDStatistics. --- If your project is set up for it, you can reply

[GitHub] spark pull request: Spark-1230: Enable SparkContext.addJars() to l...

2014-04-08 Thread AmplabJenkins
Github user AmplabJenkins commented on the pull request: https://github.com/apache/spark/pull/351#issuecomment-39823030 Refer to this link for build results: https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/13886/ --- If your project is set up for it, you can

[GitHub] spark pull request: Spark-1230: Enable SparkContext.addJars() to l...

2014-04-08 Thread AmplabJenkins
Github user AmplabJenkins commented on the pull request: https://github.com/apache/spark/pull/351#issuecomment-39823028 Build finished. --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this

[GitHub] spark pull request: SPARK-1127 Add spark-hbase.

2014-04-08 Thread BlackNiuza
Github user BlackNiuza commented on the pull request: https://github.com/apache/spark/pull/194#issuecomment-39823084 This PR looks good to me. --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have

[GitHub] spark pull request: SPARK-1433: Upgrade Mesos dependency to 0.17.0

2014-04-08 Thread pwendell
Github user pwendell commented on the pull request: https://github.com/apache/spark/pull/355#issuecomment-39823493 Are the api's backwards compatible in mesos? Or could this cause incompatibilities for certain users? --- If your project is set up for it, you can reply to this email

[GitHub] spark pull request: Pysql

2014-04-08 Thread ahirreddy
GitHub user ahirreddy opened a pull request: https://github.com/apache/spark/pull/359 Pysql You can merge this pull request into a Git repository by running: $ git pull https://github.com/ahirreddy/spark pysql Alternatively you can review and apply these changes as the patch

[GitHub] spark pull request: Pysql

2014-04-08 Thread AmplabJenkins
Github user AmplabJenkins commented on the pull request: https://github.com/apache/spark/pull/359#issuecomment-39824109 Merged build started. --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have

[GitHub] spark pull request: Pysql

2014-04-08 Thread AmplabJenkins
Github user AmplabJenkins commented on the pull request: https://github.com/apache/spark/pull/359#issuecomment-39824095 Merged build triggered. --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not

[GitHub] spark pull request: SPARK-1127 Add spark-hbase.

2014-04-08 Thread haosdent
Github user haosdent commented on the pull request: https://github.com/apache/spark/pull/194#issuecomment-39824171 OK, I see. Thank you for your reply. :-) @pwendell --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If

[GitHub] spark pull request: Pysql

2014-04-08 Thread ahirreddy
Github user ahirreddy closed the pull request at: https://github.com/apache/spark/pull/359 --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this feature enabled and wishes so, or if the feature is

[GitHub] spark pull request: [SPARK-1396] Properly cleanup DAGScheduler on ...

2014-04-08 Thread asfgit
Github user asfgit closed the pull request at: https://github.com/apache/spark/pull/305 --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this feature enabled and wishes so, or if the feature is

[GitHub] spark pull request: Pysql

2014-04-08 Thread AmplabJenkins
Github user AmplabJenkins commented on the pull request: https://github.com/apache/spark/pull/359#issuecomment-39824273 Merged build finished. --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not

[GitHub] spark pull request: Pysql

2014-04-08 Thread AmplabJenkins
Github user AmplabJenkins commented on the pull request: https://github.com/apache/spark/pull/359#issuecomment-39824274 Refer to this link for build results: https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/13890/ --- If your project is set up for it, you can

[GitHub] spark pull request: Spark 939 allow user jars to take precedence o...

2014-04-08 Thread AmplabJenkins
Github user AmplabJenkins commented on the pull request: https://github.com/apache/spark/pull/217#issuecomment-39825018 Merged build finished. --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not

[GitHub] spark pull request: [SPARK-1357] [MLLIB] Annotate developer and ex...

2014-04-08 Thread AmplabJenkins
Github user AmplabJenkins commented on the pull request: https://github.com/apache/spark/pull/298#issuecomment-39825019 Refer to this link for build results: https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/13887/ --- If your project is set up for it, you can

[GitHub] spark pull request: Spark 939 allow user jars to take precedence o...

2014-04-08 Thread AmplabJenkins
Github user AmplabJenkins commented on the pull request: https://github.com/apache/spark/pull/217#issuecomment-39825020 Refer to this link for build results: https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/13889/ --- If your project is set up for it, you can

[GitHub] spark pull request: SPARK-1433: Upgrade Mesos dependency to 0.17.0

2014-04-08 Thread pelick
Github user pelick commented on the pull request: https://github.com/apache/spark/pull/355#issuecomment-39825191 List several main improvements that mean something to spark ? --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as

[GitHub] spark pull request: [WIP] [SPARK-1328] Add vector statistics

2014-04-08 Thread yinxusen
Github user yinxusen commented on a diff in the pull request: https://github.com/apache/spark/pull/268#discussion_r11382104 --- Diff: mllib/src/main/scala/org/apache/spark/mllib/rdd/VectorRDDFunctions.scala --- @@ -0,0 +1,208 @@ +/* + * Licensed to the Apache Software

[GitHub] spark pull request: Spark 1271 (1320) cogroup and groupby should p...

2014-04-08 Thread AmplabJenkins
Github user AmplabJenkins commented on the pull request: https://github.com/apache/spark/pull/242#issuecomment-39841083 Build started. --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this

[GitHub] spark pull request: [SPARK-1276] Add a HistoryServer to render per...

2014-04-08 Thread tgravescs
Github user tgravescs commented on a diff in the pull request: https://github.com/apache/spark/pull/204#discussion_r11388641 --- Diff: bin/spark-class --- @@ -47,9 +47,9 @@ DEFAULT_MEM=${SPARK_MEM:-512m} SPARK_DAEMON_JAVA_OPTS=$SPARK_DAEMON_JAVA_OPTS

[GitHub] spark pull request: Spark 1271 (1320) cogroup and groupby should p...

2014-04-08 Thread AmplabJenkins
Github user AmplabJenkins commented on the pull request: https://github.com/apache/spark/pull/242#issuecomment-39845685 All automated tests passed. Refer to this link for build results: https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/13891/ --- If your project

[GitHub] spark pull request: Spark 1271 (1320) cogroup and groupby should p...

2014-04-08 Thread AmplabJenkins
Github user AmplabJenkins commented on the pull request: https://github.com/apache/spark/pull/242#issuecomment-39845684 Build finished. All automated tests passed. --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your

[GitHub] spark pull request: [SPARK-1276] Add a HistoryServer to render per...

2014-04-08 Thread tgravescs
Github user tgravescs commented on a diff in the pull request: https://github.com/apache/spark/pull/204#discussion_r11389162 --- Diff: core/src/main/scala/org/apache/spark/deploy/history/HistoryServer.scala --- @@ -0,0 +1,265 @@ +/* + * Licensed to the Apache Software

[GitHub] spark pull request: [SPARK-1276] Add a HistoryServer to render per...

2014-04-08 Thread tgravescs
Github user tgravescs commented on a diff in the pull request: https://github.com/apache/spark/pull/204#discussion_r11389264 --- Diff: core/src/main/scala/org/apache/spark/deploy/history/HistoryServer.scala --- @@ -0,0 +1,265 @@ +/* + * Licensed to the Apache Software

[GitHub] spark pull request: [SPARK-1276] Add a HistoryServer to render per...

2014-04-08 Thread tgravescs
Github user tgravescs commented on the pull request: https://github.com/apache/spark/pull/204#issuecomment-39849170 I realized I'm unfortunately still hitting SPARK-1407 also. I'll look at the issue running on secure hdfs this morning. I haven't reviewed the changes to the

[GitHub] spark pull request: SPARK-1417: Spark on Yarn - spark UI link from...

2014-04-08 Thread tgravescs
Github user tgravescs commented on a diff in the pull request: https://github.com/apache/spark/pull/344#discussion_r11390149 --- Diff: core/src/main/scala/org/apache/spark/ui/SparkUI.scala --- @@ -112,6 +112,11 @@ private[spark] class SparkUI( logInfo(Stopped Spark Web UI

[GitHub] spark pull request: SPARK-1417: Spark on Yarn - spark UI link from...

2014-04-08 Thread AmplabJenkins
Github user AmplabJenkins commented on the pull request: https://github.com/apache/spark/pull/344#issuecomment-39850494 Merged build started. --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have

[GitHub] spark pull request: SPARK-1417: Spark on Yarn - spark UI link from...

2014-04-08 Thread AmplabJenkins
Github user AmplabJenkins commented on the pull request: https://github.com/apache/spark/pull/344#issuecomment-39850477 Merged build triggered. --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not

[GitHub] spark pull request: Remove extra semicolon in import statement and...

2014-04-08 Thread hsaputra
Github user hsaputra commented on the pull request: https://github.com/apache/spark/pull/358#issuecomment-39851403 Seems like Jenkins had build error related to some PySpark file parsing. Can we try it again? --- If your project is set up for it, you can reply to this email and

[GitHub] spark pull request: [SPARK-1276] Add a HistoryServer to render per...

2014-04-08 Thread tgravescs
Github user tgravescs commented on the pull request: https://github.com/apache/spark/pull/204#issuecomment-39853553 For some reason I seem to have to refresh my browser twice in order to pick up new applications. Have you seen this or is it just something funky with my browser?

[GitHub] spark pull request: SPARK-1417: Spark on Yarn - spark UI link from...

2014-04-08 Thread AmplabJenkins
Github user AmplabJenkins commented on the pull request: https://github.com/apache/spark/pull/344#issuecomment-39855170 Merged build finished. --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not

[GitHub] spark pull request: SPARK-1428: MLlib should convert non-float64 N...

2014-04-08 Thread techaddict
Github user techaddict commented on the pull request: https://github.com/apache/spark/pull/356#issuecomment-39857157 @mengxr ok i'll try adding some test's --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project

[GitHub] spark pull request: SPARK-1433: Upgrade Mesos dependency to 0.17.0

2014-04-08 Thread techaddict
Github user techaddict commented on the pull request: https://github.com/apache/spark/pull/355#issuecomment-39857208 @pwendell yupp it is fully compatible although i'm checking every single line :+1: --- If your project is set up for it, you can reply to this email and have your

[GitHub] spark pull request: SPARK-1293 [SQL] WIP Parquet support for neste...

2014-04-08 Thread AndreSchumacher
GitHub user AndreSchumacher opened a pull request: https://github.com/apache/spark/pull/360 SPARK-1293 [SQL] WIP Parquet support for nested types It should be possible to import and export data stored in Parquet's columnar format that contains nested types. For example: ```java

[GitHub] spark pull request: SPARK-1293 [SQL] WIP Parquet support for neste...

2014-04-08 Thread AmplabJenkins
Github user AmplabJenkins commented on the pull request: https://github.com/apache/spark/pull/360#issuecomment-39861375 Merged build triggered. --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not

[GitHub] spark pull request: SPARK-1293 [SQL] WIP Parquet support for neste...

2014-04-08 Thread AmplabJenkins
Github user AmplabJenkins commented on the pull request: https://github.com/apache/spark/pull/360#issuecomment-39861391 Merged build started. --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have

[GitHub] spark pull request: SPARK-1293 [SQL] WIP Parquet support for neste...

2014-04-08 Thread AndreSchumacher
Github user AndreSchumacher commented on the pull request: https://github.com/apache/spark/pull/360#issuecomment-39861625 @marmbrus I had to do some changes to both the attribute resolution and the SQLParser. Would be great if you could have a look. I think it would be actually much

[GitHub] spark pull request: [SPARK-1276] Add a HistoryServer to render per...

2014-04-08 Thread tgravescs
Github user tgravescs commented on a diff in the pull request: https://github.com/apache/spark/pull/204#discussion_r11394897 --- Diff: core/src/main/scala/org/apache/spark/deploy/history/HistoryServer.scala --- @@ -0,0 +1,265 @@ +/* + * Licensed to the Apache Software

  1   2   3   4   >