[jira] [Commented] (SPARK-6068) KMeans Parallel test may fail

2015-02-28 Thread Derrick Burns (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-6068?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14341417#comment-14341417 ] Derrick Burns commented on SPARK-6068: -- Thanks Sean for your thoughtful comments!

[jira] [Commented] (SPARK-6080) LogisticRegressionWithLBFGS in PySpark was assigned wrong regType parameter

2015-02-28 Thread Yanbo Liang (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-6080?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14341426#comment-14341426 ] Yanbo Liang commented on SPARK-6080: This bug is easy to reproduce. In a PySpark

[jira] [Updated] (SPARK-6080) LogisticRegressionWithLBFGS in PySpark was assigned wrong regType parameter

2015-02-28 Thread Yanbo Liang (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-6080?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Yanbo Liang updated SPARK-6080: --- Summary: LogisticRegressionWithLBFGS in PySpark was assigned wrong regType parameter (was:

[jira] [Commented] (SPARK-6080) LogisticRegressionWithLBFGS in PySpark is assigned wrong regType parameter

2015-02-28 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-6080?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14341421#comment-14341421 ] Apache Spark commented on SPARK-6080: - User 'yanboliang' has created a pull request

[jira] [Created] (SPARK-6080) LogisticRegressionWithLBFGS in PySpark is assigned wrong regType parameter

2015-02-28 Thread Yanbo Liang (JIRA)
Yanbo Liang created SPARK-6080: -- Summary: LogisticRegressionWithLBFGS in PySpark is assigned wrong regType parameter Key: SPARK-6080 URL: https://issues.apache.org/jira/browse/SPARK-6080 Project: Spark

[jira] [Comment Edited] (SPARK-6080) LogisticRegressionWithLBFGS in PySpark was assigned wrong regType parameter

2015-02-28 Thread Yanbo Liang (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-6080?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14341426#comment-14341426 ] Yanbo Liang edited comment on SPARK-6080 at 2/28/15 9:19 AM: -

[jira] [Comment Edited] (SPARK-6080) LogisticRegressionWithLBFGS in PySpark was assigned wrong regType parameter

2015-02-28 Thread Yanbo Liang (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-6080?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14341426#comment-14341426 ] Yanbo Liang edited comment on SPARK-6080 at 2/28/15 9:19 AM: -

[jira] [Comment Edited] (SPARK-6080) LogisticRegressionWithLBFGS in PySpark was assigned wrong regType parameter

2015-02-28 Thread Yanbo Liang (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-6080?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14341426#comment-14341426 ] Yanbo Liang edited comment on SPARK-6080 at 2/28/15 9:15 AM: -

[jira] [Comment Edited] (SPARK-6080) LogisticRegressionWithLBFGS in PySpark was assigned wrong regType parameter

2015-02-28 Thread Yanbo Liang (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-6080?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14341426#comment-14341426 ] Yanbo Liang edited comment on SPARK-6080 at 2/28/15 9:16 AM: -

[jira] [Updated] (SPARK-6063) MLlib doesn't pass mvn scalastyle check due to UTF chars in LDAModel.scala

2015-02-28 Thread Sean Owen (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-6063?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Sean Owen updated SPARK-6063: - Component/s: (was: MLlib) Windows Build

[jira] [Commented] (SPARK-6069) Deserialization Error ClassNotFound

2015-02-28 Thread Pat Ferrel (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-6069?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14341608#comment-14341608 ] Pat Ferrel commented on SPARK-6069: --- It may be a dup, [~vanzin] said as much but I

[jira] [Resolved] (SPARK-5775) GenericRow cannot be cast to SpecificMutableRow when nested data and partitioned table

2015-02-28 Thread Cheng Lian (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-5775?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Cheng Lian resolved SPARK-5775. --- Resolution: Fixed Fix Version/s: 1.3.0 GenericRow cannot be cast to SpecificMutableRow when

[jira] [Comment Edited] (SPARK-6056) Unlimit offHeap memory use cause RM killing the container

2015-02-28 Thread Lianhui Wang (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-6056?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14341498#comment-14341498 ] Lianhui Wang edited comment on SPARK-6056 at 2/28/15 12:36 PM:

[jira] [Commented] (SPARK-6056) Unlimit offHeap memory use cause RM killing the container

2015-02-28 Thread Lianhui Wang (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-6056?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14341498#comment-14341498 ] Lianhui Wang commented on SPARK-6056: - [~carlmartin] what is your executor's memory?

[jira] [Updated] (SPARK-6063) MLlib doesn't pass mvn scalastyle check due to UTF chars in LDAModel.scala

2015-02-28 Thread Sean Owen (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-6063?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Sean Owen updated SPARK-6063: - Assignee: Michael Griffiths MLlib doesn't pass mvn scalastyle check due to UTF chars in LDAModel.scala

[jira] [Resolved] (SPARK-1965) Spark UI throws NPE on trying to load the app page for non-existent app

2015-02-28 Thread Sean Owen (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-1965?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Sean Owen resolved SPARK-1965. -- Resolution: Fixed Fix Version/s: 1.4.0 Issue resolved by pull request 4777

[jira] [Assigned] (SPARK-1965) Spark UI throws NPE on trying to load the app page for non-existent app

2015-02-28 Thread Sean Owen (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-1965?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Sean Owen reassigned SPARK-1965: Assignee: Sean Owen Spark UI throws NPE on trying to load the app page for non-existent app

[jira] [Updated] (SPARK-5427) Add support for floor function in Spark SQL

2015-02-28 Thread Ted Yu (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-5427?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Ted Yu updated SPARK-5427: -- Labels: math (was: ) Add support for floor function in Spark SQL ---

[jira] [Resolved] (SPARK-6063) MLlib doesn't pass mvn scalastyle check due to UTF chars in LDAModel.scala

2015-02-28 Thread Sean Owen (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-6063?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Sean Owen resolved SPARK-6063. -- Resolution: Fixed Fix Version/s: 1.4.0 Issue resolved by pull request 4815

[jira] [Commented] (SPARK-6077) Multiple spark streaming tabs on UI when reuse the same sparkcontext

2015-02-28 Thread Sean Owen (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-6077?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14341563#comment-14341563 ] Sean Owen commented on SPARK-6077: -- Would this fix SPARK-2463? That one seems like a

[jira] [Commented] (SPARK-6084) spark-shell broken on Windows

2015-02-28 Thread Nicholas Chammas (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-6084?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14341787#comment-14341787 ] Nicholas Chammas commented on SPARK-6084: - Ah, there's also SPARK-5396, though

[jira] [Commented] (SPARK-5389) spark-shell.cmd does not run from DOS Windows 7

2015-02-28 Thread Nicholas Chammas (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-5389?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14341789#comment-14341789 ] Nicholas Chammas commented on SPARK-5389: - Yeah, I think we found another instance

[jira] [Commented] (SPARK-6068) KMeans Parallel test may fail

2015-02-28 Thread Joseph K. Bradley (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-6068?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14341833#comment-14341833 ] Joseph K. Bradley commented on SPARK-6068: -- [~derrickburns] I'm sorry about how

[jira] [Commented] (SPARK-3357) Internal log messages should be set at DEBUG level instead of INFO

2015-02-28 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-3357?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14341846#comment-14341846 ] Apache Spark commented on SPARK-3357: - User 'srowen' has created a pull request for

[jira] [Resolved] (SPARK-2301) add ability to submit multiple jars for Driver

2015-02-28 Thread Sean Owen (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-2301?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Sean Owen resolved SPARK-2301. -- Resolution: Won't Fix The PR says this is WontFix. add ability to submit multiple jars for Driver

[jira] [Resolved] (SPARK-5983) Don't respond to HTTP TRACE in HTTP-based UIs

2015-02-28 Thread Sean Owen (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-5983?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Sean Owen resolved SPARK-5983. -- Resolution: Fixed Fix Version/s: 1.4.0 Assignee: Sean Owen Don't respond to HTTP TRACE

[jira] [Updated] (SPARK-5983) Don't respond to HTTP TRACE in HTTP-based UIs

2015-02-28 Thread Sean Owen (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-5983?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Sean Owen updated SPARK-5983: - Component/s: (was: Spark Core) Web UI Labels: security (was: ) Resolved by

[jira] [Reopened] (SPARK-6084) spark-shell broken on Windows

2015-02-28 Thread Nicholas Chammas (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-6084?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Nicholas Chammas reopened SPARK-6084: - Don't see how this is a dup of SPARK-4833. spark-shell broken on Windows

[jira] [Commented] (SPARK-6084) spark-shell broken on Windows

2015-02-28 Thread Sean Owen (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-6084?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14341785#comment-14341785 ] Sean Owen commented on SPARK-6084: -- Oops, I meant SPARK-5389. It still may not be the

[jira] [Resolved] (SPARK-6084) spark-shell broken on Windows

2015-02-28 Thread Nicholas Chammas (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-6084?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Nicholas Chammas resolved SPARK-6084. - Resolution: Duplicate Resolving as duplicate of SPARK-5389. That seems a more likely

[jira] [Comment Edited] (SPARK-6069) Deserialization Error ClassNotFound

2015-02-28 Thread Pat Ferrel (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-6069?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14341640#comment-14341640 ] Pat Ferrel edited comment on SPARK-6069 at 2/28/15 4:48 PM: I

[jira] [Comment Edited] (SPARK-6069) Deserialization Error ClassNotFound

2015-02-28 Thread Pat Ferrel (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-6069?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14341640#comment-14341640 ] Pat Ferrel edited comment on SPARK-6069 at 2/28/15 4:47 PM: I

[jira] [Commented] (SPARK-6081) DriverRunner doesn't support pulling HTTP/HTTPS URIs

2015-02-28 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-6081?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14341687#comment-14341687 ] Apache Spark commented on SPARK-6081: - User 'tnachen' has created a pull request for

[jira] [Created] (SPARK-6081) DriverRunner doesn't support pulling HTTP/HTTPS URIs

2015-02-28 Thread Timothy Chen (JIRA)
Timothy Chen created SPARK-6081: --- Summary: DriverRunner doesn't support pulling HTTP/HTTPS URIs Key: SPARK-6081 URL: https://issues.apache.org/jira/browse/SPARK-6081 Project: Spark Issue Type:

[jira] [Commented] (SPARK-6069) Deserialization Error ClassNotFound

2015-02-28 Thread ASF GitHub Bot (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-6069?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14341689#comment-14341689 ] ASF GitHub Bot commented on SPARK-6069: --- Github user pferrel commented on the pull

[jira] [Resolved] (SPARK-3402) Library for Natural Language Processing over Spark.

2015-02-28 Thread Sean Owen (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-3402?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Sean Owen resolved SPARK-3402. -- Resolution: Won't Fix I think the consensus at this point would be that most third-party libraries

[jira] [Commented] (SPARK-3413) Spark Blocked due to Executor lost in FIFO MODE

2015-02-28 Thread Sean Owen (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-3413?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14341732#comment-14341732 ] Sean Owen commented on SPARK-3413: -- This looks like it might be stale. It's also not a

[jira] [Created] (SPARK-6082) SparkSQL should fail gracefully when input data format doesn't match expectations

2015-02-28 Thread Kay Ousterhout (JIRA)
Kay Ousterhout created SPARK-6082: - Summary: SparkSQL should fail gracefully when input data format doesn't match expectations Key: SPARK-6082 URL: https://issues.apache.org/jira/browse/SPARK-6082

[jira] [Created] (SPARK-6085) Increase default value for memory overhead

2015-02-28 Thread Ted Yu (JIRA)
Ted Yu created SPARK-6085: - Summary: Increase default value for memory overhead Key: SPARK-6085 URL: https://issues.apache.org/jira/browse/SPARK-6085 Project: Spark Issue Type: Improvement

[jira] [Commented] (SPARK-5396) Syntax error in spark scripts on windows.

2015-02-28 Thread Nicholas Chammas (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-5396?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14341788#comment-14341788 ] Nicholas Chammas commented on SPARK-5396: - What does that error message say in

[jira] [Commented] (SPARK-6069) Deserialization Error ClassNotFoundException with Kryo, Guava 14

2015-02-28 Thread Sean Owen (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-6069?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14341819#comment-14341819 ] Sean Owen commented on SPARK-6069: -- No I set it kind of preemptively. I don't know that I

[jira] [Created] (SPARK-6086) Exceptions in DAGScheduler.updateAccumulators

2015-02-28 Thread Kai Zeng (JIRA)
Kai Zeng created SPARK-6086: --- Summary: Exceptions in DAGScheduler.updateAccumulators Key: SPARK-6086 URL: https://issues.apache.org/jira/browse/SPARK-6086 Project: Spark Issue Type: Bug

[jira] [Updated] (SPARK-5389) spark-shell.cmd does not run from DOS Windows 7

2015-02-28 Thread Nicholas Chammas (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-5389?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Nicholas Chammas updated SPARK-5389: Description: spark-shell.cmd crashes in DOS prompt Windows 7. Works fine under PowerShell.

[jira] [Reopened] (SPARK-5389) spark-shell.cmd does not run from DOS Windows 7

2015-02-28 Thread Nicholas Chammas (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-5389?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Nicholas Chammas reopened SPARK-5389: - spark-shell.cmd does not run from DOS Windows 7

[jira] [Comment Edited] (SPARK-5389) spark-shell.cmd does not run from DOS Windows 7

2015-02-28 Thread Nicholas Chammas (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-5389?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14341790#comment-14341790 ] Nicholas Chammas edited comment on SPARK-5389 at 2/28/15 9:48 PM:

[jira] [Commented] (SPARK-6069) Deserialization Error ClassNotFoundException with Kryo, Guava 14

2015-02-28 Thread Pat Ferrel (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-6069?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14341809#comment-14341809 ] Pat Ferrel commented on SPARK-6069: --- Embarrassed to say still on Hadoop 1.2.1 and so no

[jira] [Commented] (SPARK-6084) spark-shell broken on Windows

2015-02-28 Thread Nicholas Chammas (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-6084?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14341776#comment-14341776 ] Nicholas Chammas commented on SPARK-6084: - I took a look at the linked issue

[jira] [Commented] (SPARK-6069) Deserialization Error ClassNotFound

2015-02-28 Thread Sean Owen (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-6069?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14341655#comment-14341655 ] Sean Owen commented on SPARK-6069: -- This is an app-level setting as it's specific to the

[jira] [Commented] (SPARK-6069) Deserialization Error ClassNotFound

2015-02-28 Thread Pat Ferrel (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-6069?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14341672#comment-14341672 ] Pat Ferrel commented on SPARK-6069: --- Not sure I completely trust this result--I'm away

[jira] [Resolved] (SPARK-3387) Misleading stage description on the driver UI

2015-02-28 Thread Sean Owen (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-3387?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Sean Owen resolved SPARK-3387. -- Resolution: Not a Problem Your code does not include a call to {{groupBy}}, right? It calls

[jira] [Issue Comment Deleted] (SPARK-6075) After SPARK-3885, some tasks' accumulator updates may be lost

2015-02-28 Thread Josh Rosen (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-6075?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Josh Rosen updated SPARK-6075: -- Comment: was deleted (was: I left some notes on the PR that might have introduced the bug:

[jira] [Assigned] (SPARK-6075) After SPARK-3885, some tasks' accumulator updates may be lost

2015-02-28 Thread Josh Rosen (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-6075?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Josh Rosen reassigned SPARK-6075: - Assignee: Josh Rosen After SPARK-3885, some tasks' accumulator updates may be lost

[jira] [Updated] (SPARK-6075) After SPARK-3885, some tasks' accumulator updates may be lost

2015-02-28 Thread Josh Rosen (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-6075?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Josh Rosen updated SPARK-6075: -- Description: It looks like some of the AccumulatorSuite tests have started failing

[jira] [Updated] (SPARK-6075) After SPARK-3885, some tasks' accumulator updates may be lost

2015-02-28 Thread Josh Rosen (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-6075?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Josh Rosen updated SPARK-6075: -- Priority: Blocker (was: Critical) After SPARK-3885, some tasks' accumulator updates may be lost

[jira] [Updated] (SPARK-6075) After SPARK-3885, some tasks' accumulator updates may be lost

2015-02-28 Thread Josh Rosen (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-6075?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Josh Rosen updated SPARK-6075: -- Labels: (was: flaky-test) After SPARK-3885, some tasks' accumulator updates may be lost

[jira] [Commented] (SPARK-6068) KMeans Parallel test may fail

2015-02-28 Thread Sean Owen (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-6068?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14341634#comment-14341634 ] Sean Owen commented on SPARK-6068: -- Yes, it seems like too much change to the existing

[jira] [Resolved] (SPARK-6078) create event log directory automatically if not exists

2015-02-28 Thread Sean Owen (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-6078?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Sean Owen resolved SPARK-6078. -- Resolution: Duplicate create event log directory automatically if not exists

[jira] [Updated] (SPARK-2930) clarify docs on using webhdfs with spark.yarn.access.namenodes

2015-02-28 Thread Sean Owen (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-2930?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Sean Owen updated SPARK-2930: - Component/s: YARN Priority: Minor (was: Major) Issue Type: Improvement (was: Bug) Seems

[jira] [Updated] (SPARK-6075) Flaky AccumulatorSuite.add value to collection accumulators test

2015-02-28 Thread Josh Rosen (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-6075?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Josh Rosen updated SPARK-6075: -- Priority: Critical (was: Major) Flaky AccumulatorSuite.add value to collection accumulators test

[jira] [Commented] (SPARK-3885) Provide mechanism to remove accumulators once they are no longer used

2015-02-28 Thread Josh Rosen (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-3885?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14341753#comment-14341753 ] Josh Rosen commented on SPARK-3885: --- I found a correctness issue in this patch, which

[jira] [Resolved] (SPARK-6084) spark-shell broken on Windows

2015-02-28 Thread Sean Owen (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-6084?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Sean Owen resolved SPARK-6084. -- Resolution: Duplicate Target Version/s: (was: 1.3.0) I think a lot does not work on

[jira] [Commented] (SPARK-6069) Deserialization Error ClassNotFound

2015-02-28 Thread Sean Owen (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-6069?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14341625#comment-14341625 ] Sean Owen commented on SPARK-6069: -- No, I am not suggesting that {{--conf

[jira] [Commented] (SPARK-6083) Make Python API example consistent in NaiveBayes

2015-02-28 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-6083?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14341735#comment-14341735 ] Apache Spark commented on SPARK-6083: - User 'MechCoder' has created a pull request for

[jira] [Commented] (SPARK-5981) pyspark ML models should support predict/transform on vector within map

2015-02-28 Thread Manoj Kumar (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-5981?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14341752#comment-14341752 ] Manoj Kumar commented on SPARK-5981: It seems for NaiveBayes it does work, see

[jira] [Commented] (SPARK-6069) Deserialization Error ClassNotFound

2015-02-28 Thread Pat Ferrel (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-6069?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14341679#comment-14341679 ] Pat Ferrel commented on SPARK-6069: --- No goodness from spark.executor.userClassPathFirst

[jira] [Commented] (SPARK-6069) Deserialization Error ClassNotFound

2015-02-28 Thread Sean Owen (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-6069?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14341699#comment-14341699 ] Sean Owen commented on SPARK-6069: -- Hm, the thing is I have been successfully running an

[jira] [Commented] (SPARK-6069) Deserialization Error ClassNotFound

2015-02-28 Thread Pat Ferrel (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-6069?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14341705#comment-14341705 ] Pat Ferrel commented on SPARK-6069: --- I agree, that part makes me suspicious, which is

[jira] [Updated] (SPARK-6069) Deserialization Error ClassNotFoundException with Kryo, Guava 14

2015-02-28 Thread Sean Owen (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-6069?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Sean Owen updated SPARK-6069: - Priority: Critical (was: Major) Summary: Deserialization Error ClassNotFoundException with Kryo,

[jira] [Commented] (SPARK-3312) Add a groupByKey which returns a special GroupBy object like in pandas

2015-02-28 Thread Sean Owen (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-3312?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14341727#comment-14341727 ] Sean Owen commented on SPARK-3312: -- Interesting, is the reduce / max / min in question

[jira] [Created] (SPARK-6084) spark-shell broken on Windows

2015-02-28 Thread Nicholas Chammas (JIRA)
Nicholas Chammas created SPARK-6084: --- Summary: spark-shell broken on Windows Key: SPARK-6084 URL: https://issues.apache.org/jira/browse/SPARK-6084 Project: Spark Issue Type: Bug

[jira] [Commented] (SPARK-6084) spark-shell broken on Windows

2015-02-28 Thread Nicholas Chammas (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-6084?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14341746#comment-14341746 ] Nicholas Chammas commented on SPARK-6084: - cc [~pwendell], [~andrewor14] I

[jira] [Commented] (SPARK-6075) After SPARK-3885, some tasks' accumulator updates may be lost

2015-02-28 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-6075?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14341767#comment-14341767 ] Apache Spark commented on SPARK-6075: - User 'JoshRosen' has created a pull request for

[jira] [Commented] (SPARK-6069) Deserialization Error ClassNotFound

2015-02-28 Thread Pat Ferrel (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-6069?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14341640#comment-14341640 ] Pat Ferrel commented on SPARK-6069: --- I can try it. Are you suggesting an app change or a

[jira] [Resolved] (SPARK-5993) Published Kafka-assembly JAR was empty in 1.3.0-RC1

2015-02-28 Thread Sean Owen (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-5993?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Sean Owen resolved SPARK-5993. -- Resolution: Fixed Looks like this was resolved in https://github.com/apache/spark/pull/4753 Published

[jira] [Comment Edited] (SPARK-6069) Deserialization Error ClassNotFound

2015-02-28 Thread Pat Ferrel (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-6069?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14341672#comment-14341672 ] Pat Ferrel edited comment on SPARK-6069 at 2/28/15 5:31 PM:

[jira] [Commented] (SPARK-5628) Add option to return spark-ec2 version

2015-02-28 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-5628?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14341724#comment-14341724 ] Apache Spark commented on SPARK-5628: - User 'srowen' has created a pull request for

[jira] [Updated] (SPARK-6081) DriverRunner doesn't support pulling HTTP/HTTPS URIs

2015-02-28 Thread Sean Owen (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-6081?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Sean Owen updated SPARK-6081: - Component/s: Spark Submit Priority: Minor (was: Major) DriverRunner doesn't support pulling

[jira] [Created] (SPARK-6083) Make Python API example consistent in NaiveBayes

2015-02-28 Thread Manoj Kumar (JIRA)
Manoj Kumar created SPARK-6083: -- Summary: Make Python API example consistent in NaiveBayes Key: SPARK-6083 URL: https://issues.apache.org/jira/browse/SPARK-6083 Project: Spark Issue Type:

[jira] [Updated] (SPARK-6075) After SPARK-3885, some tasks' accumulator updates may be lost

2015-02-28 Thread Josh Rosen (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-6075?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Josh Rosen updated SPARK-6075: -- Summary: After SPARK-3885, some tasks' accumulator updates may be lost (was: Flaky

[jira] [Updated] (SPARK-6088) UI is malformed when tasks fetch remote results

2015-02-28 Thread Kay Ousterhout (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-6088?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Kay Ousterhout updated SPARK-6088: -- Description: There are three issues when tasks get remote results: (1) The status never

[jira] [Commented] (SPARK-4144) Support incremental model training of Naive Bayes classifier

2015-02-28 Thread Chris Fregly (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-4144?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14341901#comment-14341901 ] Chris Fregly commented on SPARK-4144: - Hey [~freeman-lab]! I was literally just

[jira] [Commented] (SPARK-5771) Number of Cores in Completed Applications of Standalone Master Web Page always be 0 if sc.stop() is called

2015-02-28 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-5771?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14341947#comment-14341947 ] Apache Spark commented on SPARK-5771: - User 'jerryshao' has created a pull request for

[jira] [Updated] (SPARK-6056) Unlimit offHeap memory use cause RM killing the container

2015-02-28 Thread SaintBacchus (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-6056?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] SaintBacchus updated SPARK-6056: Description: No matter set the `preferDirectBufs` or limit the number of thread or not ,spark can

[jira] [Updated] (SPARK-6056) Unlimit offHeap memory use cause RM killing the container

2015-02-28 Thread SaintBacchus (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-6056?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] SaintBacchus updated SPARK-6056: Description: No matter set the `preferDirectBufs` or limit the number of thread or not ,spark can

[jira] [Commented] (SPARK-6066) Metadata in event log makes it very difficult for external libraries to parse event log

2015-02-28 Thread Patrick Wendell (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-6066?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14341881#comment-14341881 ] Patrick Wendell commented on SPARK-6066: [~vanzin] - yes you are right (an early

[jira] [Commented] (SPARK-2620) case class cannot be used as key for reduce

2015-02-28 Thread Marko Bonaci (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-2620?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14341895#comment-14341895 ] Marko Bonaci commented on SPARK-2620: - *Spark 1.2 shell local:* {code:java} scala

[jira] [Created] (SPARK-6088) UI is malformed when tasks fetch remote results

2015-02-28 Thread Kay Ousterhout (JIRA)
Kay Ousterhout created SPARK-6088: - Summary: UI is malformed when tasks fetch remote results Key: SPARK-6088 URL: https://issues.apache.org/jira/browse/SPARK-6088 Project: Spark Issue Type:

[jira] [Updated] (SPARK-6056) Unlimit offHeap memory use cause RM killing the container

2015-02-28 Thread SaintBacchus (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-6056?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] SaintBacchus updated SPARK-6056: Description: No matter set the `preferDirectBufs` or limit the number of thread or not ,spark can

[jira] [Updated] (SPARK-6056) Unlimit offHeap memory use cause RM killing the container

2015-02-28 Thread SaintBacchus (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-6056?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] SaintBacchus updated SPARK-6056: Description: No matter set the `preferDirectBufs` or limit the number of thread or not ,spark can

[jira] [Commented] (SPARK-3889) JVM dies with SIGBUS, resulting in ConnectionManager failed ACK

2015-02-28 Thread Aaron Davidson (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-3889?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14341962#comment-14341962 ] Aaron Davidson commented on SPARK-3889: --- This may be a new issue. I would open a new

[jira] [Updated] (SPARK-6086) Exceptions in DAGScheduler.updateAccumulators

2015-02-28 Thread Patrick Wendell (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-6086?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Patrick Wendell updated SPARK-6086: --- Component/s: Spark Core Exceptions in DAGScheduler.updateAccumulators

[jira] [Updated] (SPARK-6086) Exceptions in DAGScheduler.updateAccumulators

2015-02-28 Thread Patrick Wendell (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-6086?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Patrick Wendell updated SPARK-6086: --- Description: Class Cast Exceptions in DAGScheduler.updateAccumulators, when DAGScheduler is

[jira] [Updated] (SPARK-6088) UI is malformed when tasks fetch remote results

2015-02-28 Thread Shivaram Venkataraman (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-6088?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Shivaram Venkataraman updated SPARK-6088: - Attachment: Screenshot 2015-02-28 18.24.42.png UI is malformed when tasks fetch

[jira] [Comment Edited] (SPARK-6056) Unlimit offHeap memory use cause RM killing the container

2015-02-28 Thread SaintBacchus (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-6056?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14341957#comment-14341957 ] SaintBacchus edited comment on SPARK-6056 at 3/1/15 6:01 AM: -

[jira] [Commented] (SPARK-6056) Unlimit offHeap memory use cause RM killing the container

2015-02-28 Thread SaintBacchus (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-6056?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14341957#comment-14341957 ] SaintBacchus commented on SPARK-6056: - [~adav] Thx for comment. I can't understand

[jira] [Commented] (SPARK-6056) Unlimit offHeap memory use cause RM killing the container

2015-02-28 Thread Aaron Davidson (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-6056?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14341970#comment-14341970 ] Aaron Davidson commented on SPARK-6056: --- It's possible that it's actually the

[jira] [Commented] (SPARK-3889) JVM dies with SIGBUS, resulting in ConnectionManager failed ACK

2015-02-28 Thread Mridul Muralidharan (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-3889?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14341997#comment-14341997 ] Mridul Muralidharan commented on SPARK-3889: [~adav] I have seen this a lot in

[jira] [Created] (SPARK-6089) Size of task result fetched can't be found in UI

2015-02-28 Thread Shivaram Venkataraman (JIRA)
Shivaram Venkataraman created SPARK-6089: Summary: Size of task result fetched can't be found in UI Key: SPARK-6089 URL: https://issues.apache.org/jira/browse/SPARK-6089 Project: Spark

[jira] [Commented] (SPARK-6088) UI is malformed when tasks fetch remote results

2015-02-28 Thread Shivaram Venkataraman (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-6088?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14341896#comment-14341896 ] Shivaram Venkataraman commented on SPARK-6088: -- Also for some reason the get

[jira] [Commented] (SPARK-6088) UI is malformed when tasks fetch remote results

2015-02-28 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-6088?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14341898#comment-14341898 ] Apache Spark commented on SPARK-6088: - User 'kayousterhout' has created a pull request

  1   2   >