[jira] [Commented] (SPARK-6050) Spark on YARN does not work --executor-cores is specified

2015-02-27 Thread Thomas Graves (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-6050?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14340433#comment-14340433 ] Thomas Graves commented on SPARK-6050: -- Note, the problem is in determining whether c

[jira] [Commented] (SPARK-6050) Spark on YARN does not work --executor-cores is specified

2015-02-27 Thread Thomas Graves (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-6050?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14340431#comment-14340431 ] Thomas Graves commented on SPARK-6050: -- Ah good point. Note that 1.2 didn't always

[jira] [Commented] (SPARK-6050) Spark on YARN does not work --executor-cores is specified

2015-02-27 Thread Marcelo Vanzin (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-6050?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14340411#comment-14340411 ] Marcelo Vanzin commented on SPARK-6050: --- Is there any downside to always requesting

[jira] [Commented] (SPARK-6048) SparkConf.translateConfKey should translate on get, not set

2015-02-27 Thread Marcelo Vanzin (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-6048?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14340398#comment-14340398 ] Marcelo Vanzin commented on SPARK-6048: --- But the current patch has a precedence prob

[jira] [Commented] (SPARK-6050) Spark on YARN does not work --executor-cores is specified

2015-02-27 Thread Mridul Muralidharan (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-6050?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14340379#comment-14340379 ] Mridul Muralidharan commented on SPARK-6050: [~tgraves] You are right, cpu sc

[jira] [Updated] (SPARK-5556) Latent Dirichlet Allocation (LDA) using Gibbs sampler

2015-02-27 Thread Xiangrui Meng (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-5556?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Xiangrui Meng updated SPARK-5556: - Target Version/s: 1.4.0 > Latent Dirichlet Allocation (LDA) using Gibbs sampler > ---

[jira] [Updated] (SPARK-5556) Latent Dirichlet Allocation (LDA) using Gibbs sampler

2015-02-27 Thread Xiangrui Meng (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-5556?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Xiangrui Meng updated SPARK-5556: - Shepherd: Joseph K. Bradley Assignee: Pedro Rodriguez > Latent Dirichlet Allocation (LDA) usin

[jira] [Commented] (SPARK-5654) Integrate SparkR into Apache Spark

2015-02-27 Thread Hari Sekhon (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-5654?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14340355#comment-14340355 ] Hari Sekhon commented on SPARK-5654: Ok replace the word packaging with upstream integ

[jira] [Comment Edited] (SPARK-5654) Integrate SparkR into Apache Spark

2015-02-27 Thread Hari Sekhon (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-5654?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14340355#comment-14340355 ] Hari Sekhon edited comment on SPARK-5654 at 2/27/15 4:42 PM: -

[jira] [Commented] (SPARK-5654) Integrate SparkR into Apache Spark

2015-02-27 Thread Sean Owen (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-5654?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14340299#comment-14340299 ] Sean Owen commented on SPARK-5654: -- [~harisekhon] Yes, we work for banks as you know. I d

[jira] [Commented] (SPARK-5654) Integrate SparkR into Apache Spark

2015-02-27 Thread Hari Sekhon (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-5654?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14340294#comment-14340294 ] Hari Sekhon commented on SPARK-5654: Sean - ever worked for a bank? What you've said

[jira] [Commented] (SPARK-4900) MLlib SingularValueDecomposition ARPACK IllegalStateException

2015-02-27 Thread Sean Owen (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-4900?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14340278#comment-14340278 ] Sean Owen commented on SPARK-4900: -- [~mengxr] what do you think on this one? I/we could i

[jira] [Commented] (SPARK-4814) Enable assertions in SBT, Maven tests / AssertionError from Hive's LazyBinaryInteger

2015-02-27 Thread Sean Owen (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-4814?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14340275#comment-14340275 ] Sean Owen commented on SPARK-4814: -- General question on back-ports: at this stage, is it

[jira] [Updated] (SPARK-5297) JavaStreamingContext.fileStream won't work because type info isn't propagated

2015-02-27 Thread Sean Owen (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-5297?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Sean Owen updated SPARK-5297: - Labels: (was: backport-needed) > JavaStreamingContext.fileStream won't work because type info isn't prop

[jira] [Commented] (SPARK-5297) JavaStreamingContext.fileStream won't work because type info isn't propagated

2015-02-27 Thread Sean Owen (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-5297?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14340271#comment-14340271 ] Sean Owen commented on SPARK-5297: -- Decided not to back port to 1.2 per tdas > JavaStrea

[jira] [Resolved] (SPARK-5297) JavaStreamingContext.fileStream won't work because type info isn't propagated

2015-02-27 Thread Sean Owen (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-5297?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Sean Owen resolved SPARK-5297. -- Resolution: Fixed Target Version/s: (was: 1.3.0, 1.2.1) > JavaStreamingContext.fileStream wo

[jira] [Commented] (SPARK-5417) Remove redundant executor-ID set() call

2015-02-27 Thread Sean Owen (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-5417?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14340268#comment-14340268 ] Sean Owen commented on SPARK-5417: -- Backported to 1.2 as well. > Remove redundant execut

[jira] [Resolved] (SPARK-5417) Remove redundant executor-ID set() call

2015-02-27 Thread Sean Owen (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-5417?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Sean Owen resolved SPARK-5417. -- Resolution: Fixed Fix Version/s: 1.2.2 Target Version/s: (was: 1.3.0, 1.2.1) > Remove

[jira] [Updated] (SPARK-5417) Remove redundant executor-ID set() call

2015-02-27 Thread Sean Owen (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-5417?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Sean Owen updated SPARK-5417: - Labels: (was: backport-needed) > Remove redundant executor-ID set() call > -

[jira] [Commented] (SPARK-4900) MLlib SingularValueDecomposition ARPACK IllegalStateException

2015-02-27 Thread Mike Beyer (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-4900?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14340235#comment-14340235 ] Mike Beyer commented on SPARK-4900: --- I would suggest a printVal

[jira] [Commented] (SPARK-4900) MLlib SingularValueDecomposition ARPACK IllegalStateException

2015-02-27 Thread Sean Owen (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-4900?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14340229#comment-14340229 ] Sean Owen commented on SPARK-4900: -- This is still mostly counting on the user to validate

[jira] [Commented] (SPARK-4900) MLlib SingularValueDecomposition ARPACK IllegalStateException

2015-02-27 Thread Mike Beyer (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-4900?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14340208#comment-14340208 ] Mike Beyer commented on SPARK-4900: --- in my opinion there should be no automatic error ch

[jira] [Comment Edited] (SPARK-6049) HiveThriftServer2 may expose Inheritable methods

2015-02-27 Thread Littlestar (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-6049?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14340096#comment-14340096 ] Littlestar edited comment on SPARK-6049 at 2/27/15 2:43 PM: ve

[jira] [Commented] (SPARK-4900) MLlib SingularValueDecomposition ARPACK IllegalStateException

2015-02-27 Thread Sean Owen (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-4900?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14340202#comment-14340202 ] Sean Owen commented on SPARK-4900: -- Hm, I tend to agree that upfront error checking is go

[jira] [Reopened] (SPARK-4900) MLlib SingularValueDecomposition ARPACK IllegalStateException

2015-02-27 Thread Mike Beyer (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-4900?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Mike Beyer reopened SPARK-4900: --- i traced the problem back due to Double.NaN, Double.POSITIVE_INFINITY or Double.NEGATIVE_INFINITY values

[jira] [Commented] (SPARK-6050) Spark on YARN does not work --executor-cores is specified

2015-02-27 Thread Thomas Graves (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-6050?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14340195#comment-14340195 ] Thomas Graves commented on SPARK-6050: -- Thanks for investigating this more. This is

[jira] [Updated] (SPARK-5434) Preserve spaces in path to spark-ec2

2015-02-27 Thread Sean Owen (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-5434?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Sean Owen updated SPARK-5434: - Labels: (was: backport-needed) > Preserve spaces in path to spark-ec2 >

[jira] [Resolved] (SPARK-5434) Preserve spaces in path to spark-ec2

2015-02-27 Thread Sean Owen (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-5434?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Sean Owen resolved SPARK-5434. -- Resolution: Fixed Fix Version/s: 1.2.2 Target Version/s: (was: 1.3.0, 1.2.1) I backpo

[jira] [Updated] (SPARK-6059) Add volatile to ApplicationMaster.reporterThread and ApplicationMaster.allocator

2015-02-27 Thread Sean Owen (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-6059?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Sean Owen updated SPARK-6059: - Assignee: Shixiong Zhu > Add volatile to ApplicationMaster.reporterThread and > ApplicationMaster.allocat

[jira] [Resolved] (SPARK-6059) Add volatile to ApplicationMaster.reporterThread and ApplicationMaster.allocator

2015-02-27 Thread Sean Owen (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-6059?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Sean Owen resolved SPARK-6059. -- Resolution: Fixed Fix Version/s: 1.4.0 Issue resolved by pull request 4814 [https://github.com/ap

[jira] [Resolved] (SPARK-6058) Log the error for the EXIT_EXCEPTION_USER_CLASS exit code

2015-02-27 Thread Sean Owen (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-6058?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Sean Owen resolved SPARK-6058. -- Resolution: Fixed Fix Version/s: 1.3.0 Issue resolved by pull request 4813 [https://github.com/ap

[jira] [Updated] (SPARK-6058) Log the error for the EXIT_EXCEPTION_USER_CLASS exit code

2015-02-27 Thread Sean Owen (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-6058?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Sean Owen updated SPARK-6058: - Assignee: Shixiong Zhu > Log the error for the EXIT_EXCEPTION_USER_CLASS exit code > -

[jira] [Resolved] (SPARK-5570) No docs stating that `new SparkConf().set("spark.driver.memory", ...) will not work

2015-02-27 Thread Sean Owen (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-5570?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Sean Owen resolved SPARK-5570. -- Resolution: Fixed Fix Version/s: 1.3.0 Assignee: Ilya Ganelin (was: Andrew Or) > No doc

[jira] [Updated] (SPARK-5570) No docs stating that `new SparkConf().set("spark.driver.memory", ...) will not work

2015-02-27 Thread Sean Owen (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-5570?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Sean Owen updated SPARK-5570: - Component/s: (was: Spark Core) Priority: Minor (was: Major) Target Version/s: (

[jira] [Updated] (SPARK-5081) Shuffle write increases

2015-02-27 Thread Dr. Christian Betz (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-5081?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Dr. Christian Betz updated SPARK-5081: -- Attachment: diff.txt And diff.txt is my diff from CDH-version to pure-version. Sorry, no

[jira] [Resolved] (SPARK-5615) Fix testPackage in StreamingContextSuite

2015-02-27 Thread Sean Owen (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-5615?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Sean Owen resolved SPARK-5615. -- Resolution: Duplicate OK, this was superseded by / subsumed by the follow up issue SPARK-5681 > Fix tes

[jira] [Resolved] (SPARK-5739) Size exceeds Integer.MAX_VALUE in File Map

2015-02-27 Thread Sean Owen (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-5739?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Sean Owen resolved SPARK-5739. -- Resolution: Duplicate I think at best this reduces to just hitting the issue that blocks can't be >2GB

[jira] [Resolved] (SPARK-5809) OutOfMemoryError in logDebug in RandomForest.scala

2015-02-27 Thread Sean Owen (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-5809?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Sean Owen resolved SPARK-5809. -- Resolution: Not a Problem So I think this is basically NotAProblem in the sense that it's ToBeExpected

[jira] [Resolved] (SPARK-5917) Distinct is broken

2015-02-27 Thread Sean Owen (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-5917?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Sean Owen resolved SPARK-5917. -- Resolution: Duplicate Resolving with the most likely explanation; reopen if there is evidence to the co

[jira] [Resolved] (SPARK-6049) HiveThriftServer2 may expose Inheritable methods

2015-02-27 Thread Littlestar (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-6049?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Littlestar resolved SPARK-6049. --- Resolution: Invalid very sorry, HiveThriftServer2.startWithContext can be called by java. I will open

[jira] [Resolved] (SPARK-6033) the description abou the "spark.worker.cleanup.enabled" is not matched with the code

2015-02-27 Thread Sean Owen (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-6033?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Sean Owen resolved SPARK-6033. -- Resolution: Fixed Fix Version/s: 1.2.2 1.1.2 1.3.0

[jira] [Commented] (SPARK-5081) Shuffle write increases

2015-02-27 Thread Dr. Christian Betz (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-5081?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14340089#comment-14340089 ] Dr. Christian Betz commented on SPARK-5081: --- Ok, I can really bring the Thread s

[jira] [Updated] (SPARK-6054) SQL UDF returning object of case class; regression from 1.2.0

2015-02-27 Thread Sean Owen (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-6054?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Sean Owen updated SPARK-6054: - Component/s: SQL > SQL UDF returning object of case class; regression from 1.2.0 > ---

[jira] [Commented] (SPARK-5124) Standardize internal RPC interface

2015-02-27 Thread Shixiong Zhu (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-5124?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14340066#comment-14340066 ] Shixiong Zhu commented on SPARK-5124: - I have not tested the performance. OK, I will r

[jira] [Commented] (SPARK-6042) spark-submit giving Exception in thread "main" java.lang.NoSuchMethodError: org.apache.spark.sql.hive.HiveContext.sql(Ljava/lang/String;)Lorg/apache/spark/sql/SchemaRDD

2015-02-27 Thread Sean Owen (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-6042?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14340061#comment-14340061 ] Sean Owen commented on SPARK-6042: -- There is no Spark 1.3.0 release at this point. You sh

[jira] [Commented] (SPARK-6042) spark-submit giving Exception in thread "main" java.lang.NoSuchMethodError: org.apache.spark.sql.hive.HiveContext.sql(Ljava/lang/String;)Lorg/apache/spark/sql/SchemaRDD

2015-02-27 Thread Tarek Abouzeid (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-6042?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14340046#comment-14340046 ] Tarek Abouzeid commented on SPARK-6042: --- i have spark 1.3 installed on the virtual m

[jira] [Commented] (SPARK-6062) HashMap.merged - Null Pointer Exception

2015-02-27 Thread Sean Owen (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-6062?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14340044#comment-14340044 ] Sean Owen commented on SPARK-6062: -- Hm, I can't reproduce this. I get the result {{Map(Te

[jira] [Commented] (SPARK-5654) Integrate SparkR into Apache Spark

2015-02-27 Thread Sean Owen (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-5654?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14340042#comment-14340042 ] Sean Owen commented on SPARK-5654: -- [~harisekhon] I think that's an orthogonal concern. I

[jira] [Comment Edited] (SPARK-5654) Integrate SparkR into Apache Spark

2015-02-27 Thread Hari Sekhon (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-5654?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14340026#comment-14340026 ] Hari Sekhon edited comment on SPARK-5654 at 2/27/15 11:33 AM: --

[jira] [Commented] (SPARK-5654) Integrate SparkR into Apache Spark

2015-02-27 Thread Hari Sekhon (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-5654?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14340026#comment-14340026 ] Hari Sekhon commented on SPARK-5654: SparkR absolutely must go in to mainline and be s

[jira] [Updated] (SPARK-6062) HashMap.merged - Null Pointer Exception

2015-02-27 Thread John Sandiford (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-6062?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] John Sandiford updated SPARK-6062: -- Summary: HashMap.merged - Null Pointer Exception (was: Null Pointer Exception) > HashMap.merge

[jira] [Created] (SPARK-6062) Null Pointer Exception

2015-02-27 Thread John Sandiford (JIRA)
John Sandiford created SPARK-6062: - Summary: Null Pointer Exception Key: SPARK-6062 URL: https://issues.apache.org/jira/browse/SPARK-6062 Project: Spark Issue Type: Bug Components:

[jira] [Commented] (SPARK-6049) HiveThriftServer2 may expose Inheritable methods

2015-02-27 Thread Sean Owen (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-6049?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14340022#comment-14340022 ] Sean Owen commented on SPARK-6049: -- I'm not clear what you're asking -- do you have a dif

[jira] [Commented] (SPARK-6049) HiveThriftServer2 may expose Inheritable methods

2015-02-27 Thread Littlestar (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-6049?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14340018#comment-14340018 ] Littlestar commented on SPARK-6049: --- thanks. I call ok by static methods, but not tables

[jira] [Commented] (SPARK-6049) HiveThriftServer2 may expose Inheritable methods

2015-02-27 Thread Sean Owen (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-6049?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14339988#comment-14339988 ] Sean Owen commented on SPARK-6049: -- The non-private interface is an {{object}} in Scala.

[jira] [Comment Edited] (SPARK-6049) HiveThriftServer2 may expose Inheritable methods

2015-02-27 Thread Littlestar (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-6049?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14339980#comment-14339980 ] Littlestar edited comment on SPARK-6049 at 2/27/15 10:33 AM: -

[jira] [Commented] (SPARK-6049) HiveThriftServer2 may expose Inheritable methods

2015-02-27 Thread Littlestar (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-6049?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14339980#comment-14339980 ] Littlestar commented on SPARK-6049: --- HiveThriftServer2.scala is can't call directly in o

[jira] [Created] (SPARK-6061) File source dstream can not include the old file which timestamp is before the system time

2015-02-27 Thread Jack Hu (JIRA)
Jack Hu created SPARK-6061: -- Summary: File source dstream can not include the old file which timestamp is before the system time Key: SPARK-6061 URL: https://issues.apache.org/jira/browse/SPARK-6061 Project:

[jira] [Resolved] (SPARK-5495) Offer user the ability to kill application in master web UI for standalone mode

2015-02-27 Thread Sean Owen (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-5495?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Sean Owen resolved SPARK-5495. -- Resolution: Fixed Fix Version/s: 1.4.0 Assignee: Saisai Shao It looks like this was merg

[jira] [Commented] (SPARK-6049) HiveThriftServer2 may expose Inheritable methods

2015-02-27 Thread Sean Owen (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-6049?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14339961#comment-14339961 ] Sean Owen commented on SPARK-6049: -- Are you asking a question? You can call its main meth

[jira] [Created] (SPARK-6060) List type missing for catalyst's package.scala

2015-02-27 Thread Stephan Drescher (JIRA)
Stephan Drescher created SPARK-6060: --- Summary: List type missing for catalyst's package.scala Key: SPARK-6060 URL: https://issues.apache.org/jira/browse/SPARK-6060 Project: Spark Issue Type

[jira] [Commented] (SPARK-6059) Add volatile to ApplicationMaster.reporterThread and ApplicationMaster.allocator

2015-02-27 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-6059?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14339955#comment-14339955 ] Apache Spark commented on SPARK-6059: - User 'zsxwing' has created a pull request for t

[jira] [Created] (SPARK-6059) Add volatile to ApplicationMaster.reporterThread and ApplicationMaster.allocator

2015-02-27 Thread Shixiong Zhu (JIRA)
Shixiong Zhu created SPARK-6059: --- Summary: Add volatile to ApplicationMaster.reporterThread and ApplicationMaster.allocator Key: SPARK-6059 URL: https://issues.apache.org/jira/browse/SPARK-6059 Project:

[jira] [Resolved] (SPARK-1015) Visualize the DAG of RDD

2015-02-27 Thread Sean Owen (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-1015?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Sean Owen resolved SPARK-1015. -- Resolution: Won't Fix That sounds great, but also sounds like something non-core enough that it can be

[jira] [Comment Edited] (SPARK-5556) Latent Dirichlet Allocation (LDA) using Gibbs sampler

2015-02-27 Thread Guoqiang Li (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-5556?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14339847#comment-14339847 ] Guoqiang Li edited comment on SPARK-5556 at 2/27/15 9:47 AM: -

[jira] [Resolved] (SPARK-6057) All Pairs Shortest Paths in pure Spark without using GraphX

2015-02-27 Thread Sean Owen (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-6057?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Sean Owen resolved SPARK-6057. -- Resolution: Won't Fix Deep as I think you're aware, you already proposed this in a PR and it was decide

[jira] [Commented] (SPARK-6058) Log the error for the EXIT_EXCEPTION_USER_CLASS exit code

2015-02-27 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-6058?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14339920#comment-14339920 ] Apache Spark commented on SPARK-6058: - User 'zsxwing' has created a pull request for t

[jira] [Created] (SPARK-6058) Log the error for the EXIT_EXCEPTION_USER_CLASS exit code

2015-02-27 Thread Shixiong Zhu (JIRA)
Shixiong Zhu created SPARK-6058: --- Summary: Log the error for the EXIT_EXCEPTION_USER_CLASS exit code Key: SPARK-6058 URL: https://issues.apache.org/jira/browse/SPARK-6058 Project: Spark Issue T

[jira] [Commented] (SPARK-5953) NoSuchMethodException with a Kafka input stream and custom decoder in Scala

2015-02-27 Thread Aleksandar Stojadinovic (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-5953?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14339903#comment-14339903 ] Aleksandar Stojadinovic commented on SPARK-5953: Just to add that I acknow

[jira] [Comment Edited] (SPARK-5953) NoSuchMethodException with a Kafka input stream and custom decoder in Scala

2015-02-27 Thread Aleksandar Stojadinovic (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-5953?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14339903#comment-14339903 ] Aleksandar Stojadinovic edited comment on SPARK-5953 at 2/27/15 8:55 AM: ---

[jira] [Commented] (SPARK-4226) SparkSQL - Add support for subqueries in predicates

2015-02-27 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-4226?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14339901#comment-14339901 ] Apache Spark commented on SPARK-4226: - User 'chenghao-intel' has created a pull reques

[jira] [Comment Edited] (SPARK-3530) Pipeline and Parameters

2015-02-27 Thread Jao Rabary (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-3530?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14339899#comment-14339899 ] Jao Rabary edited comment on SPARK-3530 at 2/27/15 8:54 AM: So

[jira] [Commented] (SPARK-3530) Pipeline and Parameters

2015-02-27 Thread Jao Rabary (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-3530?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14339899#comment-14339899 ] Jao Rabary commented on SPARK-3530: --- Some questions after playing a little with the new

[jira] [Updated] (SPARK-6057) All Pairs Shortest Paths in pure Spark without using GraphX

2015-02-27 Thread Deep Narayan Pradhan (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-6057?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Deep Narayan Pradhan updated SPARK-6057: Attachment: SparkAPSP.scala > All Pairs Shortest Paths in pure Spark without using G

[jira] [Created] (SPARK-6057) All Pairs Shortest Paths in pure Spark without using GraphX

2015-02-27 Thread Deep Narayan Pradhan (JIRA)
Deep Narayan Pradhan created SPARK-6057: --- Summary: All Pairs Shortest Paths in pure Spark without using GraphX Key: SPARK-6057 URL: https://issues.apache.org/jira/browse/SPARK-6057 Project: Spar

[jira] [Updated] (SPARK-6056) Unlimit offHeap memory use cause RM killing the container

2015-02-27 Thread SaintBacchus (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-6056?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] SaintBacchus updated SPARK-6056: Description: No matter set the `preferDirectBufs` or limit the number of thread or not ,spark can n

[jira] [Comment Edited] (SPARK-6056) Unlimit offHeap memory use cause RM killing the container

2015-02-27 Thread SaintBacchus (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-6056?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14339861#comment-14339861 ] SaintBacchus edited comment on SPARK-6056 at 2/27/15 8:13 AM: --

[jira] [Commented] (SPARK-6056) Unlimit offHeap memory use cause RM killing the container

2015-02-27 Thread SaintBacchus (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-6056?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14339861#comment-14339861 ] SaintBacchus commented on SPARK-6056: - Hi,[~adav] [~lianhuiwang][~zzcclp] I had read y

[jira] [Commented] (SPARK-6050) Spark on YARN does not work --executor-cores is specified

2015-02-27 Thread Patrick Wendell (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-6050?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14339857#comment-14339857 ] Patrick Wendell commented on SPARK-6050: [~mrid...@yahoo-inc.com] thanks for testi

<    1   2