[jira] [Commented] (SPARK-10342) Cooperative memory management

2015-10-22 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-10342?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14970548#comment-14970548 ] Apache Spark commented on SPARK-10342: -- User 'davies' has created a pull request for

[jira] [Assigned] (SPARK-10342) Cooperative memory management

2015-10-22 Thread Davies Liu (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-10342?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Davies Liu reassigned SPARK-10342: -- Assignee: Davies Liu > Cooperative memory management > - > >

[jira] [Updated] (SPARK-11275) [SQL] Regression in rollup/cube

2015-10-22 Thread Xiao Li (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-11275?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Xiao Li updated SPARK-11275: Description: Spark SQL is unable to generate a correct result when the following query using rollup.

[jira] [Created] (SPARK-11275) Regression in rollup/cube

2015-10-22 Thread Xiao Li (JIRA)
Xiao Li created SPARK-11275: --- Summary: Regression in rollup/cube Key: SPARK-11275 URL: https://issues.apache.org/jira/browse/SPARK-11275 Project: Spark Issue Type: Bug Components: SQL

[jira] [Updated] (SPARK-11275) [SQL] Regression in rollup/cube

2015-10-22 Thread Xiao Li (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-11275?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Xiao Li updated SPARK-11275: Summary: [SQL] Regression in rollup/cube (was: Regression in rollup/cube ) > [SQL] Regression in rollup/c

[jira] [Resolved] (SPARK-11134) Flaky test: o.a.s.launcher.LauncherBackendSuite

2015-10-22 Thread Reynold Xin (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-11134?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Reynold Xin resolved SPARK-11134. - Resolution: Fixed Assignee: Marcelo Vanzin Fix Version/s: 1.6.0 > Flaky test: o.a

[jira] [Commented] (SPARK-11274) Text data source support for Spark SQL

2015-10-22 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-11274?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14970483#comment-14970483 ] Apache Spark commented on SPARK-11274: -- User 'rxin' has created a pull request for t

[jira] [Assigned] (SPARK-11274) Text data source support for Spark SQL

2015-10-22 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-11274?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-11274: Assignee: Apache Spark (was: Reynold Xin) > Text data source support for Spark SQL >

[jira] [Assigned] (SPARK-11274) Text data source support for Spark SQL

2015-10-22 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-11274?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-11274: Assignee: Reynold Xin (was: Apache Spark) > Text data source support for Spark SQL >

[jira] [Created] (SPARK-11274) Text data source support for Spark SQL

2015-10-22 Thread Reynold Xin (JIRA)
Reynold Xin created SPARK-11274: --- Summary: Text data source support for Spark SQL Key: SPARK-11274 URL: https://issues.apache.org/jira/browse/SPARK-11274 Project: Spark Issue Type: Bug

[jira] [Assigned] (SPARK-11273) ArrayData and MapData shouldn't be public in types package

2015-10-22 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-11273?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-11273: Assignee: Apache Spark (was: Reynold Xin) > ArrayData and MapData shouldn't be public in

[jira] [Assigned] (SPARK-11273) ArrayData and MapData shouldn't be public in types package

2015-10-22 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-11273?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-11273: Assignee: Reynold Xin (was: Apache Spark) > ArrayData and MapData shouldn't be public in

[jira] [Commented] (SPARK-11273) ArrayData and MapData shouldn't be public in types package

2015-10-22 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-11273?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14970417#comment-14970417 ] Apache Spark commented on SPARK-11273: -- User 'rxin' has created a pull request for t

[jira] [Created] (SPARK-11273) ArrayData and MapData shouldn't be public in types package

2015-10-22 Thread Reynold Xin (JIRA)
Reynold Xin created SPARK-11273: --- Summary: ArrayData and MapData shouldn't be public in types package Key: SPARK-11273 URL: https://issues.apache.org/jira/browse/SPARK-11273 Project: Spark Issu

[jira] [Commented] (SPARK-11272) Support importing and exporting event logs from HistoryServer web portal

2015-10-22 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-11272?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14970403#comment-14970403 ] Apache Spark commented on SPARK-11272: -- User 'jerryshao' has created a pull request

[jira] [Assigned] (SPARK-11272) Support importing and exporting event logs from HistoryServer web portal

2015-10-22 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-11272?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-11272: Assignee: Apache Spark > Support importing and exporting event logs from HistoryServer web

[jira] [Assigned] (SPARK-11272) Support importing and exporting event logs from HistoryServer web portal

2015-10-22 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-11272?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-11272: Assignee: (was: Apache Spark) > Support importing and exporting event logs from Histor

[jira] [Resolved] (SPARK-11098) RPC message ordering is not guaranteed

2015-10-22 Thread Reynold Xin (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-11098?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Reynold Xin resolved SPARK-11098. - Resolution: Fixed Assignee: Shixiong Zhu Fix Version/s: 1.6.0 > RPC message order

[jira] [Updated] (SPARK-11272) Support importing and exporting event logs from HistoryServer web portal

2015-10-22 Thread Saisai Shao (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-11272?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Saisai Shao updated SPARK-11272: Summary: Support importing and exporting event logs from HistoryServer web portal (was: Support im

[jira] [Updated] (SPARK-11272) Support importing and exporting event logs from History web portal

2015-10-22 Thread Saisai Shao (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-11272?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Saisai Shao updated SPARK-11272: Description: Many users who met the problems when running Spark applications will send the logs to

[jira] [Updated] (SPARK-11272) Support importing and exporting event logs from History web portal

2015-10-22 Thread Saisai Shao (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-11272?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Saisai Shao updated SPARK-11272: Attachment: screenshot-1.png > Support importing and exporting event logs from History web portal >

[jira] [Created] (SPARK-11272) Support importing and exporting event logs from History web portal

2015-10-22 Thread Saisai Shao (JIRA)
Saisai Shao created SPARK-11272: --- Summary: Support importing and exporting event logs from History web portal Key: SPARK-11272 URL: https://issues.apache.org/jira/browse/SPARK-11272 Project: Spark

[jira] [Assigned] (SPARK-11267) NettyRpcEnv and sparkDriver services report the same port in the logs

2015-10-22 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-11267?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-11267: Assignee: Apache Spark > NettyRpcEnv and sparkDriver services report the same port in the

[jira] [Assigned] (SPARK-11267) NettyRpcEnv and sparkDriver services report the same port in the logs

2015-10-22 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-11267?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-11267: Assignee: (was: Apache Spark) > NettyRpcEnv and sparkDriver services report the same p

[jira] [Commented] (SPARK-11267) NettyRpcEnv and sparkDriver services report the same port in the logs

2015-10-22 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-11267?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14970336#comment-14970336 ] Apache Spark commented on SPARK-11267: -- User 'zsxwing' has created a pull request fo

[jira] [Commented] (SPARK-5569) Checkpoints cannot reference classes defined outside of Spark's assembly

2015-10-22 Thread Deming Zhu (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-5569?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14970326#comment-14970326 ] Deming Zhu commented on SPARK-5569: --- 1. create a class let's call it TestCls, and makes

[jira] [Created] (SPARK-11271) MapStatus too large for driver

2015-10-22 Thread JIRA
姚琴 created SPARK-11271: -- Summary: MapStatus too large for driver Key: SPARK-11271 URL: https://issues.apache.org/jira/browse/SPARK-11271 Project: Spark Issue Type: Improvement Components: Shuf

[jira] [Commented] (SPARK-11167) Incorrect type resolution on heterogeneous data structures

2015-10-22 Thread Felix Cheung (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-11167?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14970304#comment-14970304 ] Felix Cheung commented on SPARK-11167: -- Shouldn't it try to infer the tightest type

[jira] [Commented] (SPARK-11270) Add improved equality testing for TopicAndPartition from the Kafka Streaming API

2015-10-22 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-11270?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14970124#comment-14970124 ] Apache Spark commented on SPARK-11270: -- User 'manygrams' has created a pull request

[jira] [Assigned] (SPARK-11270) Add improved equality testing for TopicAndPartition from the Kafka Streaming API

2015-10-22 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-11270?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-11270: Assignee: (was: Apache Spark) > Add improved equality testing for TopicAndPartition fr

[jira] [Assigned] (SPARK-11270) Add improved equality testing for TopicAndPartition from the Kafka Streaming API

2015-10-22 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-11270?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-11270: Assignee: Apache Spark > Add improved equality testing for TopicAndPartition from the Kafk

[jira] [Created] (SPARK-11270) Add improved equality testing for TopicAndPartition from the Kafka Streaming API

2015-10-22 Thread Nick Evans (JIRA)
Nick Evans created SPARK-11270: -- Summary: Add improved equality testing for TopicAndPartition from the Kafka Streaming API Key: SPARK-11270 URL: https://issues.apache.org/jira/browse/SPARK-11270 Project:

[jira] [Commented] (SPARK-11246) [1.5] Table cache for Parquet broken in 1.5

2015-10-22 Thread Xin Wu (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-11246?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14970071#comment-14970071 ] Xin Wu commented on SPARK-11246: Root cause found, fix is being tested. will submit PR sh

[jira] [Resolved] (SPARK-11251) Page size calculation is wrong in local mode

2015-10-22 Thread Reynold Xin (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-11251?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Reynold Xin resolved SPARK-11251. - Resolution: Fixed Fix Version/s: 1.6.0 1.5.2 > Page size calculation is

[jira] [Assigned] (SPARK-11134) Flaky test: o.a.s.launcher.LauncherBackendSuite

2015-10-22 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-11134?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-11134: Assignee: Apache Spark > Flaky test: o.a.s.launcher.LauncherBackendSuite > ---

[jira] [Commented] (SPARK-11134) Flaky test: o.a.s.launcher.LauncherBackendSuite

2015-10-22 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-11134?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14970053#comment-14970053 ] Apache Spark commented on SPARK-11134: -- User 'vanzin' has created a pull request for

[jira] [Assigned] (SPARK-11134) Flaky test: o.a.s.launcher.LauncherBackendSuite

2015-10-22 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-11134?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-11134: Assignee: (was: Apache Spark) > Flaky test: o.a.s.launcher.LauncherBackendSuite >

[jira] [Resolved] (SPARK-7021) JUnit output for Python tests

2015-10-22 Thread Davies Liu (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-7021?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Davies Liu resolved SPARK-7021. --- Resolution: Fixed Fix Version/s: 1.6.0 Issue resolved by pull request 8323 [https://github.com/

[jira] [Created] (SPARK-11269) Java API support & test cases

2015-10-22 Thread Reynold Xin (JIRA)
Reynold Xin created SPARK-11269: --- Summary: Java API support & test cases Key: SPARK-11269 URL: https://issues.apache.org/jira/browse/SPARK-11269 Project: Spark Issue Type: Sub-task

[jira] [Resolved] (SPARK-11116) Initial API Draft

2015-10-22 Thread Reynold Xin (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-6?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Reynold Xin resolved SPARK-6. - Resolution: Fixed Fix Version/s: 1.6.0 > Initial API Draft > - > >

[jira] [Commented] (SPARK-8277) SparkR createDataFrame is slow

2015-10-22 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-8277?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14969993#comment-14969993 ] Apache Spark commented on SPARK-8277: - User 'saurfang' has created a pull request for

[jira] [Assigned] (SPARK-8277) SparkR createDataFrame is slow

2015-10-22 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-8277?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-8277: --- Assignee: Apache Spark > SparkR createDataFrame is slow > -- > >

[jira] [Assigned] (SPARK-8277) SparkR createDataFrame is slow

2015-10-22 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-8277?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-8277: --- Assignee: (was: Apache Spark) > SparkR createDataFrame is slow >

[jira] [Created] (SPARK-11268) Non-daemon startup scripts

2015-10-22 Thread Simon Hafner (JIRA)
Simon Hafner created SPARK-11268: Summary: Non-daemon startup scripts Key: SPARK-11268 URL: https://issues.apache.org/jira/browse/SPARK-11268 Project: Spark Issue Type: Improvement

[jira] [Assigned] (SPARK-10024) Python API RF and GBT related params clear up

2015-10-22 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-10024?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-10024: Assignee: Apache Spark > Python API RF and GBT related params clear up > -

[jira] [Commented] (SPARK-10024) Python API RF and GBT related params clear up

2015-10-22 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-10024?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14969945#comment-14969945 ] Apache Spark commented on SPARK-10024: -- User 'vectorijk' has created a pull request

[jira] [Assigned] (SPARK-10024) Python API RF and GBT related params clear up

2015-10-22 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-10024?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-10024: Assignee: (was: Apache Spark) > Python API RF and GBT related params clear up > --

[jira] [Commented] (SPARK-11267) NettyRpcEnv and sparkDriver services report the same port in the logs

2015-10-22 Thread Sean Owen (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-11267?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14969923#comment-14969923 ] Sean Owen commented on SPARK-11267: --- Huh that does look weird. [~zsxwing] does this som

[jira] [Reopened] (SPARK-11229) NPE in JoinedRow.isNullAt when spark.shuffle.memoryFraction=0

2015-10-22 Thread Michael Armbrust (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-11229?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Michael Armbrust reopened SPARK-11229: -- > NPE in JoinedRow.isNullAt when spark.shuffle.memoryFraction=0 > -

[jira] [Closed] (SPARK-11229) NPE in JoinedRow.isNullAt when spark.shuffle.memoryFraction=0

2015-10-22 Thread Michael Armbrust (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-11229?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Michael Armbrust closed SPARK-11229. Resolution: Fixed Fix Version/s: 1.6.0 > NPE in JoinedRow.isNullAt when spark.shuffl

[jira] [Created] (SPARK-11267) NettyRpcEnv and sparkDriver services report the same port in the logs

2015-10-22 Thread Jacek Laskowski (JIRA)
Jacek Laskowski created SPARK-11267: --- Summary: NettyRpcEnv and sparkDriver services report the same port in the logs Key: SPARK-11267 URL: https://issues.apache.org/jira/browse/SPARK-11267 Project:

[jira] [Updated] (SPARK-11265) YarnClient can't get tokens to talk to Hive in a secure cluster

2015-10-22 Thread Steve Loughran (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-11265?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Steve Loughran updated SPARK-11265: --- Summary: YarnClient can't get tokens to talk to Hive in a secure cluster (was: YarnClient ca

[jira] [Updated] (SPARK-11242) In conf/spark-env.sh.template SPARK_DRIVER_MEMORY is documented incorrectly

2015-10-22 Thread Sean Owen (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-11242?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Sean Owen updated SPARK-11242: -- Assignee: Xiu > In conf/spark-env.sh.template SPARK_DRIVER_MEMORY is documented incorrectly > -

[jira] [Resolved] (SPARK-11242) In conf/spark-env.sh.template SPARK_DRIVER_MEMORY is documented incorrectly

2015-10-22 Thread Sean Owen (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-11242?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Sean Owen resolved SPARK-11242. --- Resolution: Fixed Fix Version/s: 1.6.0 Issue resolved by pull request 9201 [https://github.com

[jira] [Created] (SPARK-11266) Peak memory tests swallow failures

2015-10-22 Thread Andrew Or (JIRA)
Andrew Or created SPARK-11266: - Summary: Peak memory tests swallow failures Key: SPARK-11266 URL: https://issues.apache.org/jira/browse/SPARK-11266 Project: Spark Issue Type: Bug Compon

[jira] [Updated] (SPARK-10812) Spark Hadoop Util does not support stopping a non-yarn Spark Context & starting a Yarn spark context.

2015-10-22 Thread Marcelo Vanzin (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-10812?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Marcelo Vanzin updated SPARK-10812: --- Fix Version/s: 1.5.2 Backported to branch-1.5 (clean merge) to fix SPARK-11201. > Spark Hado

[jira] [Commented] (SPARK-11265) YarnClient cant get tokens to talk to Hive in a secure cluster

2015-10-22 Thread Steve Loughran (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-11265?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14969818#comment-14969818 ] Steve Loughran commented on SPARK-11265: Initial report from Chester Chen {nofo

[jira] [Commented] (SPARK-10002) SSH problem during Setup of Spark(1.3.0) cluster on EC2

2015-10-22 Thread Nicholas Chammas (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-10002?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14969814#comment-14969814 ] Nicholas Chammas commented on SPARK-10002: -- [~deepalib] - Is {{--private-ips}} t

[jira] [Resolved] (SPARK-9735) Auto infer partition schema of HadoopFsRelation should should respected the user specified one

2015-10-22 Thread Josh Rosen (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-9735?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Josh Rosen resolved SPARK-9735. --- Resolution: Fixed Fix Version/s: 1.6.0 Issue resolved by pull request 8026 [https://github.com/

[jira] [Created] (SPARK-11265) YarnClient cant get tokens to talk to Hive in a secure cluster

2015-10-22 Thread Steve Loughran (JIRA)
Steve Loughran created SPARK-11265: -- Summary: YarnClient cant get tokens to talk to Hive in a secure cluster Key: SPARK-11265 URL: https://issues.apache.org/jira/browse/SPARK-11265 Project: Spark

[jira] [Updated] (SPARK-11264) ./bin/spark-class can't find assembly jars with certain GREP_OPTIONS set

2015-10-22 Thread Jeffrey Naisbitt (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-11264?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Jeffrey Naisbitt updated SPARK-11264: - Description: Some GREP_OPTIONS will modify the output of the grep commands that are looki

[jira] [Resolved] (SPARK-11078) Ensure spilling tests are actually spilling

2015-10-22 Thread Josh Rosen (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-11078?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Josh Rosen resolved SPARK-11078. Resolution: Fixed Fix Version/s: 1.6.0 > Ensure spilling tests are actually spilling > -

[jira] [Updated] (SPARK-11264) ./bin/spark-class can't find assembly jars with certain GREP_OPTIONS set

2015-10-22 Thread Jeffrey Naisbitt (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-11264?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Jeffrey Naisbitt updated SPARK-11264: - Component/s: Spark Shell > ./bin/spark-class can't find assembly jars with certain GREP_O

[jira] [Assigned] (SPARK-11264) ./bin/spark-class can't find assembly jars with certain GREP_OPTIONS set

2015-10-22 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-11264?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-11264: Assignee: (was: Apache Spark) > ./bin/spark-class can't find assembly jars with certai

[jira] [Created] (SPARK-11264) ./bin/spark-class can't find assembly jars with certain GREP_OPTIONS set

2015-10-22 Thread Jeffrey Naisbitt (JIRA)
Jeffrey Naisbitt created SPARK-11264: Summary: ./bin/spark-class can't find assembly jars with certain GREP_OPTIONS set Key: SPARK-11264 URL: https://issues.apache.org/jira/browse/SPARK-11264 Proj

[jira] [Commented] (SPARK-11264) ./bin/spark-class can't find assembly jars with certain GREP_OPTIONS set

2015-10-22 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-11264?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14969745#comment-14969745 ] Apache Spark commented on SPARK-11264: -- User 'naisbitt' has created a pull request f

[jira] [Assigned] (SPARK-11264) ./bin/spark-class can't find assembly jars with certain GREP_OPTIONS set

2015-10-22 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-11264?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-11264: Assignee: Apache Spark > ./bin/spark-class can't find assembly jars with certain GREP_OPTI

[jira] [Created] (SPARK-11263) lintr Throws Warnings on Commented Code in Documentation

2015-10-22 Thread Sen Fang (JIRA)
Sen Fang created SPARK-11263: Summary: lintr Throws Warnings on Commented Code in Documentation Key: SPARK-11263 URL: https://issues.apache.org/jira/browse/SPARK-11263 Project: Spark Issue Type:

[jira] [Assigned] (SPARK-11262) Unit test for gradient, loss layers, memory management for multilayer perceptron

2015-10-22 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-11262?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-11262: Assignee: (was: Apache Spark) > Unit test for gradient, loss layers, memory management

[jira] [Commented] (SPARK-11262) Unit test for gradient, loss layers, memory management for multilayer perceptron

2015-10-22 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-11262?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14969637#comment-14969637 ] Apache Spark commented on SPARK-11262: -- User 'avulanov' has created a pull request f

[jira] [Assigned] (SPARK-11262) Unit test for gradient, loss layers, memory management for multilayer perceptron

2015-10-22 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-11262?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-11262: Assignee: Apache Spark > Unit test for gradient, loss layers, memory management for multil

[jira] [Created] (SPARK-11262) Unit test for gradient, loss layers, memory management for multilayer perceptron

2015-10-22 Thread Alexander Ulanov (JIRA)
Alexander Ulanov created SPARK-11262: Summary: Unit test for gradient, loss layers, memory management for multilayer perceptron Key: SPARK-11262 URL: https://issues.apache.org/jira/browse/SPARK-11262

[jira] [Resolved] (SPARK-11163) Remove unnecessary addPendingTask calls in TaskSetManager.executorLost

2015-10-22 Thread Kay Ousterhout (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-11163?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Kay Ousterhout resolved SPARK-11163. Resolution: Fixed Fix Version/s: 1.6.0 Issue resolved by pull request 9154 [https://

[jira] [Resolved] (SPARK-11232) NettyRpcEndpointRef.send should not be interrupted

2015-10-22 Thread Marcelo Vanzin (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-11232?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Marcelo Vanzin resolved SPARK-11232. Resolution: Fixed Assignee: Shixiong Zhu > NettyRpcEndpointRef.send should not be int

[jira] [Assigned] (SPARK-11261) Provide a more flexible alternative to Jdbc RDD

2015-10-22 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-11261?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-11261: Assignee: (was: Apache Spark) > Provide a more flexible alternative to Jdbc RDD >

[jira] [Assigned] (SPARK-11261) Provide a more flexible alternative to Jdbc RDD

2015-10-22 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-11261?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-11261: Assignee: Apache Spark > Provide a more flexible alternative to Jdbc RDD > ---

[jira] [Commented] (SPARK-11261) Provide a more flexible alternative to Jdbc RDD

2015-10-22 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-11261?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14969595#comment-14969595 ] Apache Spark commented on SPARK-11261: -- User 'rmarsch' has created a pull request fo

[jira] [Created] (SPARK-11261) Provide a more flexible alternative to Jdbc RDD

2015-10-22 Thread Richard Marscher (JIRA)
Richard Marscher created SPARK-11261: Summary: Provide a more flexible alternative to Jdbc RDD Key: SPARK-11261 URL: https://issues.apache.org/jira/browse/SPARK-11261 Project: Spark Issue

[jira] [Updated] (SPARK-10562) .partitionBy() creates the metastore partition columns in all lowercase, but persists the data path as MixedCase resulting in an error when the data is later attempted t

2015-10-22 Thread Yin Huai (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-10562?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Yin Huai updated SPARK-10562: - Assignee: Wenchen Fan > .partitionBy() creates the metastore partition columns in all lowercase, but > p

[jira] [Commented] (SPARK-11195) Exception thrown on executor throws ClassNotFound on driver

2015-10-22 Thread Hurshal Patel (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-11195?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14969535#comment-14969535 ] Hurshal Patel commented on SPARK-11195: --- the only difference between my repro and y

[jira] [Commented] (SPARK-9865) Flaky SparkR test: test_sparkSQL.R: sample on a DataFrame

2015-10-22 Thread Weiqiang Zhuang (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-9865?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14969536#comment-14969536 ] Weiqiang Zhuang commented on SPARK-9865: Just FYI, I also got this test failure a

[jira] [Comment Edited] (SPARK-11195) Exception thrown on executor throws ClassNotFound on driver

2015-10-22 Thread Hurshal Patel (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-11195?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14969535#comment-14969535 ] Hurshal Patel edited comment on SPARK-11195 at 10/22/15 5:47 PM: --

[jira] [Commented] (SPARK-11245) Upgrade twitter4j to version 4.x

2015-10-22 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-11245?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14969527#comment-14969527 ] Apache Spark commented on SPARK-11245: -- User 'pronix' has created a pull request for

[jira] [Commented] (SPARK-11260) Add 'with' API

2015-10-22 Thread Weiqiang Zhuang (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-11260?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14969528#comment-14969528 ] Weiqiang Zhuang commented on SPARK-11260: - I will be working on this. > Add 'wit

[jira] [Assigned] (SPARK-11245) Upgrade twitter4j to version 4.x

2015-10-22 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-11245?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-11245: Assignee: (was: Apache Spark) > Upgrade twitter4j to version 4.x > ---

[jira] [Assigned] (SPARK-11245) Upgrade twitter4j to version 4.x

2015-10-22 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-11245?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-11245: Assignee: Apache Spark > Upgrade twitter4j to version 4.x > --

[jira] [Created] (SPARK-11260) Add 'with' API

2015-10-22 Thread Weiqiang Zhuang (JIRA)
Weiqiang Zhuang created SPARK-11260: --- Summary: Add 'with' API Key: SPARK-11260 URL: https://issues.apache.org/jira/browse/SPARK-11260 Project: Spark Issue Type: Sub-task Component

[jira] [Resolved] (SPARK-10708) Consolidate SortShuffleManager and UnsafeShuffleManager

2015-10-22 Thread Josh Rosen (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-10708?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Josh Rosen resolved SPARK-10708. Resolution: Fixed Fix Version/s: 1.6.0 Merged my patch into 1.6. > Consolidate SortShuffleM

[jira] [Updated] (SPARK-11244) sparkR.stop doesn't clean up .sparkRSQLsc in environment

2015-10-22 Thread Shivaram Venkataraman (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-11244?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Shivaram Venkataraman updated SPARK-11244: -- Assignee: Sen Fang > sparkR.stop doesn't clean up .sparkRSQLsc in environment >

[jira] [Resolved] (SPARK-11244) sparkR.stop doesn't clean up .sparkRSQLsc in environment

2015-10-22 Thread Shivaram Venkataraman (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-11244?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Shivaram Venkataraman resolved SPARK-11244. --- Resolution: Fixed Fix Version/s: 1.5.2 1.6.0 Issue

[jira] [Updated] (SPARK-11252) ShuffleClient should release connection after fetching blocks had been completed in yarn's external shuffle

2015-10-22 Thread Lianhui Wang (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-11252?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Lianhui Wang updated SPARK-11252: - Summary: ShuffleClient should release connection after fetching blocks had been completed in yarn

[jira] [Updated] (SPARK-11252) andrewor14

2015-10-22 Thread Lianhui Wang (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-11252?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Lianhui Wang updated SPARK-11252: - Summary: andrewor14 (was: ExternalShuffleClient should release connection after it had complete

[jira] [Assigned] (SPARK-11252) ExternalShuffleClient should release connection after it had completed to fetch blocks from yarn's NameManager

2015-10-22 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-11252?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-11252: Assignee: (was: Apache Spark) > ExternalShuffleClient should release connection after

[jira] [Assigned] (SPARK-11252) ExternalShuffleClient should release connection after it had completed to fetch blocks from yarn's NameManager

2015-10-22 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-11252?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-11252: Assignee: Apache Spark > ExternalShuffleClient should release connection after it had comp

[jira] [Commented] (SPARK-11252) ExternalShuffleClient should release connection after it had completed to fetch blocks from yarn's NameManager

2015-10-22 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-11252?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14969375#comment-14969375 ] Apache Spark commented on SPARK-11252: -- User 'lianhuiwang' has created a pull reques

[jira] [Commented] (SPARK-10024) Python API RF and GBT related params clear up

2015-10-22 Thread Kai Jiang (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-10024?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14969358#comment-14969358 ] Kai Jiang commented on SPARK-10024: --- PR hours later > Python API RF and GBT related pa

[jira] [Assigned] (SPARK-10562) .partitionBy() creates the metastore partition columns in all lowercase, but persists the data path as MixedCase resulting in an error when the data is later attempted

2015-10-22 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-10562?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-10562: Assignee: Apache Spark > .partitionBy() creates the metastore partition columns in all low

[jira] [Assigned] (SPARK-10562) .partitionBy() creates the metastore partition columns in all lowercase, but persists the data path as MixedCase resulting in an error when the data is later attempted

2015-10-22 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-10562?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-10562: Assignee: (was: Apache Spark) > .partitionBy() creates the metastore partition columns

[jira] [Commented] (SPARK-10562) .partitionBy() creates the metastore partition columns in all lowercase, but persists the data path as MixedCase resulting in an error when the data is later attempted

2015-10-22 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-10562?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14969356#comment-14969356 ] Apache Spark commented on SPARK-10562: -- User 'cloud-fan' has created a pull request

[jira] [Comment Edited] (SPARK-11195) Exception thrown on executor throws ClassNotFound on driver

2015-10-22 Thread Hao Ren (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-11195?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14969271#comment-14969271 ] Hao Ren edited comment on SPARK-11195 at 10/22/15 3:04 PM: --- Tha

  1   2   >