[jira] [Updated] (SPARK-7826) Suppress extra calling getCacheLocs.

2015-05-23 Thread Josh Rosen (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-7826?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Josh Rosen updated SPARK-7826: -- Component/s: Scheduler Suppress extra calling getCacheLocs.

[jira] [Updated] (SPARK-7826) Suppress extra calling getCacheLocs.

2015-05-23 Thread Josh Rosen (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-7826?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Josh Rosen updated SPARK-7826: -- Assignee: Takuya Ueshin Suppress extra calling getCacheLocs.

[jira] [Commented] (SPARK-4653) DAGScheduler refactoring and cleanup

2015-05-23 Thread Josh Rosen (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-4653?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14557544#comment-14557544 ] Josh Rosen commented on SPARK-4653: --- Before we begin code-changing refactorings, I would

[jira] [Commented] (SPARK-2456) Scheduler refactoring

2015-05-23 Thread Josh Rosen (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-2456?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14557547#comment-14557547 ] Josh Rosen commented on SPARK-2456: --- Before we begin code-changing refactorings, I would

[jira] [Resolved] (SPARK-2647) DAGScheduler plugs others when processing one JobSubmitted event

2015-05-23 Thread Josh Rosen (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-2647?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Josh Rosen resolved SPARK-2647. --- Resolution: Incomplete To help keep the Scheduler component JIRAs tidy, I'm going to close this issue

[jira] [Commented] (SPARK-7481) Add Hadoop 2.6+ profile to pull in object store FS accessors

2015-05-23 Thread Peng Cheng (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-7481?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14557549#comment-14557549 ] Peng Cheng commented on SPARK-7481: --- I've tried to do it but I get a lot of headaches,

[jira] [Commented] (SPARK-6086) Exceptions in DAGScheduler.updateAccumulators

2015-05-23 Thread Josh Rosen (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-6086?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14557548#comment-14557548 ] Josh Rosen commented on SPARK-6086: --- Is this still an issue? Can this be reproduced

[jira] [Commented] (SPARK-5874) How to improve the current ML pipeline API?

2015-05-23 Thread Eron Wright (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-5874?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14557550#comment-14557550 ] Eron Wright commented on SPARK-5874: - A suggestion, please pass the DataFrame (or at

[jira] [Commented] (SPARK-5981) pyspark ML models should support predict/transform on vector within map

2015-05-23 Thread Joseph K. Bradley (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-5981?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14557464#comment-14557464 ] Joseph K. Bradley commented on SPARK-5981: -- I think it would be nice at some

[jira] [Updated] (SPARK-7820) Java8-tests suite compile error under SBT

2015-05-23 Thread Patrick Wendell (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-7820?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Patrick Wendell updated SPARK-7820: --- Priority: Critical (was: Blocker) Java8-tests suite compile error under SBT

[jira] [Commented] (SPARK-7820) Java8-tests suite compile error under SBT

2015-05-23 Thread Patrick Wendell (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-7820?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14557581#comment-14557581 ] Patrick Wendell commented on SPARK-7820: Since this only affects tests I'm

[jira] [Assigned] (SPARK-7786) Allow StreamingListener to be specified in SparkConf and loaded when creating StreamingContext

2015-05-23 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-7786?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-7786: --- Assignee: Apache Spark Allow StreamingListener to be specified in SparkConf and loaded when

[jira] [Assigned] (SPARK-7786) Allow StreamingListener to be specified in SparkConf and loaded when creating StreamingContext

2015-05-23 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-7786?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-7786: --- Assignee: (was: Apache Spark) Allow StreamingListener to be specified in SparkConf and

[jira] [Commented] (SPARK-7786) Allow StreamingListener to be specified in SparkConf and loaded when creating StreamingContext

2015-05-23 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-7786?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14557597#comment-14557597 ] Apache Spark commented on SPARK-7786: - User 'His-name-is-Joof' has created a pull

[jira] [Updated] (SPARK-4823) rowSimilarities

2015-05-23 Thread Debasish Das (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-4823?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Debasish Das updated SPARK-4823: Attachment: MovieLensSimilarity Comparisons.pdf The attached file shows the runtime comparison of

[jira] [Commented] (SPARK-7287) Flaky test: o.a.s.deploy.SparkSubmitSuite --packages

2015-05-23 Thread Patrick Wendell (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-7287?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14557610#comment-14557610 ] Patrick Wendell commented on SPARK-7287: [~brkyvz] I am going to disable this test

[jira] [Created] (SPARK-7843) Several thrift server failures in Spark 1.4 sbt build with hadoop 1

2015-05-23 Thread Yin Huai (JIRA)
Yin Huai created SPARK-7843: --- Summary: Several thrift server failures in Spark 1.4 sbt build with hadoop 1 Key: SPARK-7843 URL: https://issues.apache.org/jira/browse/SPARK-7843 Project: Spark

[jira] [Updated] (SPARK-7843) Several thrift server failures in Spark 1.4 sbt build with hadoop 1

2015-05-23 Thread Yin Huai (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-7843?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Yin Huai updated SPARK-7843: Attachment:

[jira] [Assigned] (SPARK-7840) Movie Python DataFrame.insertInto into DataFrameWriter

2015-05-23 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-7840?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-7840: --- Assignee: Apache Spark (was: Davies Liu) Movie Python DataFrame.insertInto into

[jira] [Commented] (SPARK-7840) Movie Python DataFrame.insertInto into DataFrameWriter

2015-05-23 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-7840?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14557165#comment-14557165 ] Apache Spark commented on SPARK-7840: - User 'davies' has created a pull request for

[jira] [Resolved] (SPARK-6811) Building binary R packages for SparkR

2015-05-23 Thread Shivaram Venkataraman (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-6811?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Shivaram Venkataraman resolved SPARK-6811. -- Resolution: Fixed Fix Version/s: 1.4.0 Issue resolved by pull request

[jira] [Resolved] (SPARK-7779) Dynamic allocation: confusing message when canceling requests

2015-05-23 Thread Sean Owen (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-7779?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Sean Owen resolved SPARK-7779. -- Resolution: Fixed Fix Version/s: 1.4.0 Dynamic allocation: confusing message when canceling

[jira] [Resolved] (SPARK-6806) SparkR examples in programming guide

2015-05-23 Thread Shivaram Venkataraman (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-6806?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Shivaram Venkataraman resolved SPARK-6806. -- Resolution: Fixed Fix Version/s: 1.4.0 Issue resolved by pull request

[jira] [Resolved] (SPARK-5090) The improvement of python converter for hbase

2015-05-23 Thread Davies Liu (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-5090?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Davies Liu resolved SPARK-5090. --- Resolution: Fixed Fix Version/s: 1.5.0 Assignee: Gen TANG The improvement of python

[jira] [Closed] (SPARK-7838) Set scope name for Kinesis stream

2015-05-23 Thread Andrew Or (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-7838?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Andrew Or closed SPARK-7838. Resolution: Fixed Fix Version/s: 1.4.0 Set scope name for Kinesis stream

[jira] [Commented] (SPARK-7819) Isolated Hive Client Loader appears to cause Native Library libMapRClient.4.0.2-mapr.so already loaded in another classloader error

2015-05-23 Thread Fi (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-7819?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14557161#comment-14557161 ] Fi commented on SPARK-7819: --- Adding the prefixes did not seem to work. I tried adding this to

[jira] [Updated] (SPARK-7836) DataFrame.ntile() should only accept Int as parameter

2015-05-23 Thread Reynold Xin (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-7836?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Reynold Xin updated SPARK-7836: --- Issue Type: Sub-task (was: Bug) Parent: SPARK-6116 DataFrame.ntile() should only accept Int

[jira] [Assigned] (SPARK-7840) Movie Python DataFrame.insertInto into DataFrameWriter

2015-05-23 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-7840?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-7840: --- Assignee: Davies Liu (was: Apache Spark) Movie Python DataFrame.insertInto into

[jira] [Created] (SPARK-7840) Movie Python DataFrame.insertInto into DataFrameWriter

2015-05-23 Thread Davies Liu (JIRA)
Davies Liu created SPARK-7840: - Summary: Movie Python DataFrame.insertInto into DataFrameWriter Key: SPARK-7840 URL: https://issues.apache.org/jira/browse/SPARK-7840 Project: Spark Issue Type:

[jira] [Assigned] (SPARK-3674) Add support for launching YARN clusters in spark-ec2

2015-05-23 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-3674?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-3674: --- Assignee: Shivaram Venkataraman (was: Apache Spark) Add support for launching YARN

[jira] [Resolved] (SPARK-7777) Fix a flaky test: org.apache.spark.streaming.BasicOperationsSuite.rdd cleanup - input blocks and persisted RDDs

2015-05-23 Thread Tathagata Das (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Tathagata Das resolved SPARK-. -- Resolution: Fixed Fix Version/s: 1.4.0 Fix a flaky test:

[jira] [Created] (SPARK-7842) For InsertIntoHadoopFsRelation, if an exception is thrown while committing a task, the task is not aborted

2015-05-23 Thread Cheng Lian (JIRA)
Cheng Lian created SPARK-7842: - Summary: For InsertIntoHadoopFsRelation, if an exception is thrown while committing a task, the task is not aborted Key: SPARK-7842 URL:

[jira] [Assigned] (SPARK-7842) For InsertIntoHadoopFsRelation, if an exception is thrown while committing a task, the task is not aborted

2015-05-23 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-7842?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-7842: --- Assignee: Apache Spark (was: Cheng Lian) For InsertIntoHadoopFsRelation, if an exception

[jira] [Commented] (SPARK-7842) For InsertIntoHadoopFsRelation, if an exception is thrown while committing a task, the task is not aborted

2015-05-23 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-7842?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14557351#comment-14557351 ] Apache Spark commented on SPARK-7842: - User 'liancheng' has created a pull request for

[jira] [Assigned] (SPARK-7842) For InsertIntoHadoopFsRelation, if an exception is thrown while committing a task, the task is not aborted

2015-05-23 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-7842?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-7842: --- Assignee: Cheng Lian (was: Apache Spark) For InsertIntoHadoopFsRelation, if an exception

[jira] [Created] (SPARK-7841) Spark build should not use lib_managed for dependencies

2015-05-23 Thread Iulian Dragos (JIRA)
Iulian Dragos created SPARK-7841: Summary: Spark build should not use lib_managed for dependencies Key: SPARK-7841 URL: https://issues.apache.org/jira/browse/SPARK-7841 Project: Spark Issue

[jira] [Commented] (SPARK-5981) pyspark ML models should support predict/transform on vector within map

2015-05-23 Thread Manoj Kumar (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-5981?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14557324#comment-14557324 ] Manoj Kumar commented on SPARK-5981: [~josephkb] Coming back to this. Do you think

[jira] [Resolved] (SPARK-7836) DataFrame.ntile() should only accept Int as parameter

2015-05-23 Thread Yin Huai (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-7836?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Yin Huai resolved SPARK-7836. - Resolution: Fixed Fix Version/s: 1.4.0 It has been resolved by

[jira] [Resolved] (SPARK-7822) Window function support in Python DataFrame DSL

2015-05-23 Thread Yin Huai (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-7822?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Yin Huai resolved SPARK-7822. - Resolution: Fixed Fix Version/s: 1.4.0 It has been resolved by

[jira] [Commented] (SPARK-7322) Window function support in Scala/Java DataFrame DSL

2015-05-23 Thread Yin Huai (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-7322?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14557386#comment-14557386 ] Yin Huai commented on SPARK-7322: - It has been resolved by

[jira] [Updated] (SPARK-7119) ScriptTransform doesn't consider the output data type

2015-05-23 Thread Cheng Lian (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-7119?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Cheng Lian updated SPARK-7119: -- Description: {code:sql} from (from src select transform(key, value) using 'cat' as (thing1 int, thing2

[jira] [Resolved] (SPARK-7840) Move Python DataFrame.insertInto into DataFrameWriter

2015-05-23 Thread Davies Liu (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-7840?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Davies Liu resolved SPARK-7840. --- Resolution: Fixed Fix Version/s: 1.4.0 Move Python DataFrame.insertInto into DataFrameWriter

[jira] [Updated] (SPARK-7840) Move Python DataFrame.insertInto into DataFrameWriter

2015-05-23 Thread Davies Liu (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-7840?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Davies Liu updated SPARK-7840: -- Summary: Move Python DataFrame.insertInto into DataFrameWriter (was: Movie Python DataFrame.insertInto

[jira] [Commented] (SPARK-6784) Make sure values of partitioning columns are correctly converted based on their data types

2015-05-23 Thread Yin Huai (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-6784?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14557424#comment-14557424 ] Yin Huai commented on SPARK-6784: - Seems the issue for partitioning columns is that we did

[jira] [Commented] (SPARK-2426) Quadratic Minimization for MLlib ALS

2015-05-23 Thread Debasish Das (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-2426?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14557416#comment-14557416 ] Debasish Das commented on SPARK-2426: - [~mengxr] Should I add the PR to spark packages

[jira] [Updated] (SPARK-7791) Set user for executors in standalone-mode

2015-05-23 Thread JIRA
[ https://issues.apache.org/jira/browse/SPARK-7791?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Tomasz Früboes updated SPARK-7791: -- Issue Type: Wish (was: New Feature) Set user for executors in standalone-mode

[jira] [Assigned] (SPARK-3674) Add support for launching YARN clusters in spark-ec2

2015-05-23 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-3674?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-3674: --- Assignee: Apache Spark (was: Shivaram Venkataraman) Add support for launching YARN

[jira] [Commented] (SPARK-3674) Add support for launching YARN clusters in spark-ec2

2015-05-23 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-3674?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14557174#comment-14557174 ] Apache Spark commented on SPARK-3674: - User 'shivaram' has created a pull request for

[jira] [Comment Edited] (SPARK-7843) Several thrift server failures in Spark 1.4 sbt build with hadoop 1

2015-05-23 Thread Yin Huai (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-7843?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14557615#comment-14557615 ] Yin Huai edited comment on SPARK-7843 at 5/24/15 2:57 AM: -- I am

[jira] [Commented] (SPARK-7843) Several thrift server failures in Spark 1.4 sbt build with hadoop 1

2015-05-23 Thread Yin Huai (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-7843?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14557617#comment-14557617 ] Yin Huai commented on SPARK-7843: - I think that the change in 117 does not affect the

[jira] [Updated] (SPARK-7392) Kryo buffer size can not be larger than 2M

2015-05-23 Thread Josh Rosen (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-7392?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Josh Rosen updated SPARK-7392: -- Affects Version/s: 1.4.0 Kryo buffer size can not be larger than 2M

[jira] [Assigned] (SPARK-6391) Update Tachyon version compatibility documentation

2015-05-23 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-6391?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-6391: --- Assignee: Apache Spark Update Tachyon version compatibility documentation

[jira] [Assigned] (SPARK-6391) Update Tachyon version compatibility documentation

2015-05-23 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-6391?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-6391: --- Assignee: (was: Apache Spark) Update Tachyon version compatibility documentation

[jira] [Commented] (SPARK-6391) Update Tachyon version compatibility documentation

2015-05-23 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-6391?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14557622#comment-14557622 ] Apache Spark commented on SPARK-6391: - User 'calvinjia' has created a pull request for

[jira] [Updated] (SPARK-7655) Akka timeout exception from ask and table broadcast

2015-05-23 Thread Josh Rosen (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-7655?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Josh Rosen updated SPARK-7655: -- Component/s: Scheduler Akka timeout exception from ask and table broadcast

[jira] [Assigned] (SPARK-4723) To abort the stages which have attempted some times

2015-05-23 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-4723?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-4723: --- Assignee: Apache Spark To abort the stages which have attempted some times

[jira] [Assigned] (SPARK-4723) To abort the stages which have attempted some times

2015-05-23 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-4723?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-4723: --- Assignee: (was: Apache Spark) To abort the stages which have attempted some times

[jira] [Commented] (SPARK-7287) Flaky test: o.a.s.deploy.SparkSubmitSuite --packages

2015-05-23 Thread Burak Yavuz (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-7287?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14557631#comment-14557631 ] Burak Yavuz commented on SPARK-7287: I don't understand why that's failing. It's not

[jira] [Commented] (SPARK-7843) Several thrift server failures in Spark 1.4 sbt build with hadoop 1

2015-05-23 Thread Yin Huai (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-7843?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14557616#comment-14557616 ] Yin Huai commented on SPARK-7843: - In thrift server log, I see {code} 15/05/23 19:49:47

[jira] [Commented] (SPARK-7308) Should there be multiple concurrent attempts for one stage?

2015-05-23 Thread Josh Rosen (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-7308?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14557620#comment-14557620 ] Josh Rosen commented on SPARK-7308: --- I think that properly fixing this set of issues

[jira] [Commented] (SPARK-7829) SortShuffleWriter writes inconsistent data index files on stage retry

2015-05-23 Thread Josh Rosen (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-7829?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14557624#comment-14557624 ] Josh Rosen commented on SPARK-7829: --- Thanks for splitting this off as a sub-issue from

[jira] [Commented] (SPARK-6910) Support for pushing predicates down to metastore for partition pruning

2015-05-23 Thread Cheolsoo Park (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-6910?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14557628#comment-14557628 ] Cheolsoo Park commented on SPARK-6910: -- I don't know what's the best way to fix this,

[jira] [Updated] (SPARK-790) Implement the reregistered() callback in MesosScheduler to support master failover

2015-05-23 Thread Josh Rosen (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-790?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Josh Rosen updated SPARK-790: - Component/s: Mesos Implement the reregistered() callback in MesosScheduler to support master failover

[jira] [Resolved] (SPARK-912) Take stage breakdown functionality and runLocally out of the main event loop in DAGScheduler

2015-05-23 Thread Josh Rosen (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-912?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Josh Rosen resolved SPARK-912. -- Resolution: Fixed It looks like the task result deserialization code was moved out of the main loop in

[jira] [Commented] (SPARK-4723) To abort the stages which have attempted some times

2015-05-23 Thread Josh Rosen (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-4723?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14557630#comment-14557630 ] Josh Rosen commented on SPARK-4723: --- I think the original PR here was closed because

[jira] [Updated] (SPARK-7843) Several thrift server failures in Spark 1.4 sbt build with hadoop 1

2015-05-23 Thread Yin Huai (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-7843?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Yin Huai updated SPARK-7843: Attachment: 12a345adcbaee359199ddfed4f41bf0e19d66d48 This