[jira] [Commented] (SPARK-2089) With YARN, preferredNodeLocalityData isn't honored

[ https://issues.apache.org/jira/browse/SPARK-2089?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14099533#comment-14099533 ] Sandy Ryza commented on SPARK-2089: --- These customizations should only come from Hadoop

[jira] [Commented] (SPARK-3019) Pluggable block transfer (data plane communication) interface

[ https://issues.apache.org/jira/browse/SPARK-3019?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14099537#comment-14099537 ] Sandy Ryza commented on SPARK-3019: --- Just scanned this, so apologies if the answer is

[jira] [Commented] (SPARK-1405) parallel Latent Dirichlet Allocation (LDA) atop of spark in MLlib

[ https://issues.apache.org/jira/browse/SPARK-1405?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14099538#comment-14099538 ] Apache Spark commented on SPARK-1405: - User 'witgo' has created a pull request for

[jira] [Created] (SPARK-3082) yarn.Client.logClusterResourceDetails throws NPE if YARN's getQueueInfo returns null

Sandy Ryza created SPARK-3082: - Summary: yarn.Client.logClusterResourceDetails throws NPE if YARN's getQueueInfo returns null Key: SPARK-3082 URL: https://issues.apache.org/jira/browse/SPARK-3082

[jira] [Updated] (SPARK-3082) yarn.Client.logClusterResourceDetails throws NPE if requested queue doesn't exist

[ https://issues.apache.org/jira/browse/SPARK-3082?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Sandy Ryza updated SPARK-3082: -- Summary: yarn.Client.logClusterResourceDetails throws NPE if requested queue doesn't exist (was:

[jira] [Commented] (SPARK-3082) yarn.Client.logClusterResourceDetails throws NPE if requested queue doesn't exist

[ https://issues.apache.org/jira/browse/SPARK-3082?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14099557#comment-14099557 ] Apache Spark commented on SPARK-3082: - User 'sryza' has created a pull request for

[jira] [Updated] (SPARK-2964) Improve spark-sql and start-thriftserver to leverage bin/util.sh

[ https://issues.apache.org/jira/browse/SPARK-2964?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Kousuke Saruta updated SPARK-2964: -- Description: Now, we have bin/utils.sh, so let's improve spark-sql and start-thriftserver.sh

[jira] [Updated] (SPARK-2964) Improve spark-sql and start-thriftserver to leverage bin/util.sh

[ https://issues.apache.org/jira/browse/SPARK-2964?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Kousuke Saruta updated SPARK-2964: -- Summary: Improve spark-sql and start-thriftserver to leverage bin/util.sh (was: Wrong silent

[jira] [Commented] (SPARK-3019) Pluggable block transfer (data plane communication) interface

[ https://issues.apache.org/jira/browse/SPARK-3019?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14099571#comment-14099571 ] Reynold Xin commented on SPARK-3019: Sandy I don't know if that is a big problem in

[jira] [Created] (SPARK-3083) Unnecessarily removing sendingConnection twice when closing connections

Liang-Chi Hsieh created SPARK-3083: -- Summary: Unnecessarily removing sendingConnection twice when closing connections Key: SPARK-3083 URL: https://issues.apache.org/jira/browse/SPARK-3083 Project:

[jira] [Commented] (SPARK-3083) Unnecessarily removing sendingConnection twice when closing connections

[ https://issues.apache.org/jira/browse/SPARK-3083?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14099658#comment-14099658 ] Apache Spark commented on SPARK-3083: - User 'viirya' has created a pull request for

[jira] [Commented] (SPARK-2608) scheduler backend create executor launch command not correctly

[ https://issues.apache.org/jira/browse/SPARK-2608?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14099688#comment-14099688 ] Apache Spark commented on SPARK-2608: - User 'scwf' has created a pull request for this

[jira] [Resolved] (SPARK-3076) Gracefully report build timeouts in Jenkins

[ https://issues.apache.org/jira/browse/SPARK-3076?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Patrick Wendell resolved SPARK-3076. Resolution: Fixed Fix Version/s: 1.2.0 Issue resolved by pull request 1974

[jira] [Updated] (SPARK-3076) Gracefully report build timeouts in Jenkins

[ https://issues.apache.org/jira/browse/SPARK-3076?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Patrick Wendell updated SPARK-3076: --- Assignee: Nicholas Chammas Gracefully report build timeouts in Jenkins

[jira] [Resolved] (SPARK-2677) BasicBlockFetchIterator#next can wait forever

[ https://issues.apache.org/jira/browse/SPARK-2677?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Josh Rosen resolved SPARK-2677. --- Resolution: Fixed Fix Version/s: 1.1.0 Assignee: Kousuke Saruta (was: Josh Rosen)

[jira] [Resolved] (SPARK-2977) Fix handling of short shuffle manager names in ShuffleBlockManager

[ https://issues.apache.org/jira/browse/SPARK-2977?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Patrick Wendell resolved SPARK-2977. Resolution: Fixed Fix handling of short shuffle manager names in ShuffleBlockManager

[jira] [Resolved] (SPARK-2878) Inconsistent Kryo serialisation with custom Kryo Registrator

[ https://issues.apache.org/jira/browse/SPARK-2878?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Patrick Wendell resolved SPARK-2878. Resolution: Fixed Fixed by SPARK-3046 via: https://github.com/apache/spark/pull/1972

[jira] [Updated] (SPARK-2878) Inconsistent Kryo serialisation with custom Kryo Registrator

[ https://issues.apache.org/jira/browse/SPARK-2878?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Patrick Wendell updated SPARK-2878: --- Fix Version/s: 1.1.0 Inconsistent Kryo serialisation with custom Kryo Registrator

[jira] [Updated] (SPARK-2878) Inconsistent Kryo serialisation with custom Kryo Registrator

[ https://issues.apache.org/jira/browse/SPARK-2878?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Patrick Wendell updated SPARK-2878: --- Fix Version/s: 1.0.3 Inconsistent Kryo serialisation with custom Kryo Registrator

[jira] [Resolved] (SPARK-3048) Make LabeledPointParser public

[ https://issues.apache.org/jira/browse/SPARK-3048?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Xiangrui Meng resolved SPARK-3048. -- Resolution: Fixed Fix Version/s: 1.1.0 Issue resolved by pull request 1952

[jira] [Resolved] (SPARK-3081) Rename RandomRDDGenerators to RandomRDDs

[ https://issues.apache.org/jira/browse/SPARK-3081?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Xiangrui Meng resolved SPARK-3081. -- Resolution: Fixed Fix Version/s: 1.1.0 Issue resolved by pull request 1979

[jira] [Resolved] (SPARK-3035) Wrong example with SparkContext.addFile

[ https://issues.apache.org/jira/browse/SPARK-3035?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Josh Rosen resolved SPARK-3035. --- Resolution: Fixed Fix Version/s: (was: 1.0.2) 1.1.0 Wrong example

[jira] [Resolved] (SPARK-2325) Utils.getLocalDir had better check the directory and choose a good one instead of choosing the first one directly

[ https://issues.apache.org/jira/browse/SPARK-2325?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Josh Rosen resolved SPARK-2325. --- Resolution: Duplicate Resolving as duplicate of SPARK-2974, which I'm working on fixing.

[jira] [Commented] (SPARK-2975) SPARK_LOCAL_DIRS may cause problems when running in local mode

[ https://issues.apache.org/jira/browse/SPARK-2975?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14099841#comment-14099841 ] Josh Rosen commented on SPARK-2975: --- The driver's configuration properties seem to be

[jira] [Comment Edited] (SPARK-2975) SPARK_LOCAL_DIRS may cause problems when running in local mode

[ https://issues.apache.org/jira/browse/SPARK-2975?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14099841#comment-14099841 ] Josh Rosen edited comment on SPARK-2975 at 8/17/14 12:31 AM: -

[jira] [Resolved] (SPARK-2701) ConnectionManager throws out of Could not find reference for received ack message xxx exception

[ https://issues.apache.org/jira/browse/SPARK-2701?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Guoqiang Li resolved SPARK-2701. Resolution: Fixed Fix Version/s: 1.1.0 https://github.com/apache/spark/pull/1632

[jira] [Commented] (SPARK-2881) Snappy is now default codec - could lead to conflicts since uses /tmp

[ https://issues.apache.org/jira/browse/SPARK-2881?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14099849#comment-14099849 ] Patrick Wendell commented on SPARK-2881: Actually since this uses a static system

[jira] [Created] (SPARK-3084) Collect broadcasted tables in parallel in joins

Matei Zaharia created SPARK-3084: Summary: Collect broadcasted tables in parallel in joins Key: SPARK-3084 URL: https://issues.apache.org/jira/browse/SPARK-3084 Project: Spark Issue Type:

[jira] [Commented] (SPARK-3084) Collect broadcasted tables in parallel in joins

[ https://issues.apache.org/jira/browse/SPARK-3084?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14099853#comment-14099853 ] Apache Spark commented on SPARK-3084: - User 'mateiz' has created a pull request for

[jira] [Commented] (SPARK-2881) Snappy is now default codec - could lead to conflicts since uses /tmp

[ https://issues.apache.org/jira/browse/SPARK-2881?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14099857#comment-14099857 ] Patrick Wendell commented on SPARK-2881: I filed a bug to have snappy deal with

[jira] [Updated] (SPARK-3085) Use compact data structures in SQL joins

[ https://issues.apache.org/jira/browse/SPARK-3085?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Matei Zaharia updated SPARK-3085: - Description: We can reuse the CompactBuffer from Spark Core. (was: We can reuse the

[jira] [Commented] (SPARK-2881) Snappy is now default codec - could lead to conflicts since uses /tmp

[ https://issues.apache.org/jira/browse/SPARK-2881?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14099859#comment-14099859 ] Apache Spark commented on SPARK-2881: - User 'pwendell' has created a pull request for

[jira] [Commented] (SPARK-3010) fix redundant conditional

[ https://issues.apache.org/jira/browse/SPARK-3010?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14099860#comment-14099860 ] Apache Spark commented on SPARK-3010: - User 'scwf' has created a pull request for this

[jira] [Commented] (SPARK-3085) Use compact data structures in SQL joins

[ https://issues.apache.org/jira/browse/SPARK-3085?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14099862#comment-14099862 ] Apache Spark commented on SPARK-3085: - User 'mateiz' has created a pull request for

[jira] [Commented] (SPARK-2881) Snappy is now default codec - could lead to conflicts since uses /tmp

[ https://issues.apache.org/jira/browse/SPARK-2881?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14099867#comment-14099867 ] Apache Spark commented on SPARK-2881: - User 'pwendell' has created a pull request for

[jira] [Commented] (SPARK-2881) Snappy is now default codec - could lead to conflicts since uses /tmp

[ https://issues.apache.org/jira/browse/SPARK-2881?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14099870#comment-14099870 ] Taro L. Saito commented on SPARK-2881: -- This problem is fixed in snappy-java 1.1.1.3.

[jira] [Comment Edited] (SPARK-2881) Snappy is now default codec - could lead to conflicts since uses /tmp

[ https://issues.apache.org/jira/browse/SPARK-2881?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14099870#comment-14099870 ] Taro L. Saito edited comment on SPARK-2881 at 8/17/14 3:31 AM:

[jira] [Created] (SPARK-3086) Use 1-indexing for decision tree nodes

Xiangrui Meng created SPARK-3086: Summary: Use 1-indexing for decision tree nodes Key: SPARK-3086 URL: https://issues.apache.org/jira/browse/SPARK-3086 Project: Spark Issue Type: Improvement

[jira] [Resolved] (SPARK-3077) ChiSqTest bugs

[ https://issues.apache.org/jira/browse/SPARK-3077?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Xiangrui Meng resolved SPARK-3077. -- Resolution: Fixed Fix Version/s: 1.1.0 Issue resolved by pull request 1982

[jira] [Created] (SPARK-3087) ChiSqTest only stores results in the first 100 columns.

Xiangrui Meng created SPARK-3087: Summary: ChiSqTest only stores results in the first 100 columns. Key: SPARK-3087 URL: https://issues.apache.org/jira/browse/SPARK-3087 Project: Spark Issue