[jira] [Issue Comment Deleted] (SPARK-8582) Optimize checkpointing to avoid computing an RDD twice

2017-08-25 Thread Lev Katzav (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-8582?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Lev Katzav updated SPARK-8582: -- Comment: was deleted (was: Any update on this? what are the plans for spark 2? thanks) > Optimize

[jira] [Assigned] (SPARK-21751) CodeGeneraor.splitExpressions counts code size more precisely

2017-08-25 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-21751?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-21751: Assignee: Apache Spark > CodeGeneraor.splitExpressions counts code size more precisely >

[jira] [Assigned] (SPARK-21751) CodeGeneraor.splitExpressions counts code size more precisely

2017-08-25 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-21751?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-21751: Assignee: (was: Apache Spark) > CodeGeneraor.splitExpressions counts code size more

[jira] [Assigned] (SPARK-21781) Modify DataSourceScanExec to use concrete ColumnVector type.

2017-08-25 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-21781?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-21781: Assignee: (was: Apache Spark) > Modify DataSourceScanExec to use concrete

[jira] [Assigned] (SPARK-21781) Modify DataSourceScanExec to use concrete ColumnVector type.

2017-08-25 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-21781?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-21781: Assignee: Apache Spark > Modify DataSourceScanExec to use concrete ColumnVector type. >

[jira] [Commented] (SPARK-21781) Modify DataSourceScanExec to use concrete ColumnVector type.

2017-08-25 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-21781?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16142606#comment-16142606 ] Apache Spark commented on SPARK-21781: -- User 'ueshin' has created a pull request for this issue:

[jira] [Assigned] (SPARK-21781) Modify DataSourceScanExec to use concrete ColumnVector type.

2017-08-25 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-21781?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-21781: Assignee: (was: Apache Spark) > Modify DataSourceScanExec to use concrete

[jira] [Assigned] (SPARK-21781) Modify DataSourceScanExec to use concrete ColumnVector type.

2017-08-25 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-21781?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-21781: Assignee: Apache Spark > Modify DataSourceScanExec to use concrete ColumnVector type. >

[jira] [Assigned] (SPARK-21751) CodeGeneraor.splitExpressions counts code size more precisely

2017-08-25 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-21751?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-21751: Assignee: Apache Spark > CodeGeneraor.splitExpressions counts code size more precisely >

[jira] [Assigned] (SPARK-21751) CodeGeneraor.splitExpressions counts code size more precisely

2017-08-25 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-21751?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-21751: Assignee: Apache Spark > CodeGeneraor.splitExpressions counts code size more precisely >

[jira] [Assigned] (SPARK-21751) CodeGeneraor.splitExpressions counts code size more precisely

2017-08-25 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-21751?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-21751: Assignee: (was: Apache Spark) > CodeGeneraor.splitExpressions counts code size more

[jira] [Assigned] (SPARK-21751) CodeGeneraor.splitExpressions counts code size more precisely

2017-08-25 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-21751?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-21751: Assignee: (was: Apache Spark) > CodeGeneraor.splitExpressions counts code size more

[jira] [Commented] (SPARK-21832) Merge SQLBuilderTest into ExpressionSQLBuilderSuite

2017-08-25 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-21832?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16142580#comment-16142580 ] Apache Spark commented on SPARK-21832: -- User 'dongjoon-hyun' has created a pull request for this

[jira] [Commented] (SPARK-21832) Merge SQLBuilderTest into ExpressionSQLBuilderSuite

2017-08-25 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-21832?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16142579#comment-16142579 ] Apache Spark commented on SPARK-21832: -- User 'dongjoon-hyun' has created a pull request for this

[jira] [Assigned] (SPARK-21751) CodeGeneraor.splitExpressions counts code size more precisely

2017-08-25 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-21751?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-21751: Assignee: (was: Apache Spark) > CodeGeneraor.splitExpressions counts code size more

[jira] [Assigned] (SPARK-21751) CodeGeneraor.splitExpressions counts code size more precisely

2017-08-25 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-21751?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-21751: Assignee: Apache Spark > CodeGeneraor.splitExpressions counts code size more precisely >

[jira] [Closed] (SPARK-21831) Remove `spark.sql.hive.convertMetastoreOrc` config in HiveCompatibilitySuite

2017-08-25 Thread Xiao Li (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-21831?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Xiao Li closed SPARK-21831. --- Resolution: Fixed Assignee: Dongjoon Hyun Fix Version/s: 2.3.0 > Remove

[jira] [Assigned] (SPARK-21831) Remove `spark.sql.hive.convertMetastoreOrc` config in HiveCompatibilitySuite

2017-08-25 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-21831?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-21831: Assignee: (was: Apache Spark) > Remove `spark.sql.hive.convertMetastoreOrc` config in

[jira] [Assigned] (SPARK-21831) Remove `spark.sql.hive.convertMetastoreOrc` config in HiveCompatibilitySuite

2017-08-25 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-21831?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-21831: Assignee: Apache Spark > Remove `spark.sql.hive.convertMetastoreOrc` config in

[jira] [Assigned] (SPARK-21831) Remove `spark.sql.hive.convertMetastoreOrc` config in HiveCompatibilitySuite

2017-08-25 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-21831?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-21831: Assignee: (was: Apache Spark) > Remove `spark.sql.hive.convertMetastoreOrc` config in

[jira] [Assigned] (SPARK-21831) Remove `spark.sql.hive.convertMetastoreOrc` config in HiveCompatibilitySuite

2017-08-25 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-21831?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-21831: Assignee: Apache Spark > Remove `spark.sql.hive.convertMetastoreOrc` config in

[jira] [Assigned] (SPARK-21834) Incorrect executor request in case of dynamic allocation

2017-08-25 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-21834?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-21834: Assignee: (was: Apache Spark) > Incorrect executor request in case of dynamic

[jira] [Assigned] (SPARK-21834) Incorrect executor request in case of dynamic allocation

2017-08-25 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-21834?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-21834: Assignee: Apache Spark > Incorrect executor request in case of dynamic allocation >

[jira] [Assigned] (SPARK-21834) Incorrect executor request in case of dynamic allocation

2017-08-25 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-21834?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-21834: Assignee: (was: Apache Spark) > Incorrect executor request in case of dynamic

[jira] [Assigned] (SPARK-21834) Incorrect executor request in case of dynamic allocation

2017-08-25 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-21834?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-21834: Assignee: Apache Spark > Incorrect executor request in case of dynamic allocation >

[jira] [Assigned] (SPARK-21834) Incorrect executor request in case of dynamic allocation

2017-08-25 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-21834?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-21834: Assignee: (was: Apache Spark) > Incorrect executor request in case of dynamic

[jira] [Assigned] (SPARK-21834) Incorrect executor request in case of dynamic allocation

2017-08-25 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-21834?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-21834: Assignee: Apache Spark > Incorrect executor request in case of dynamic allocation >

[jira] [Assigned] (SPARK-21751) CodeGeneraor.splitExpressions counts code size more precisely

2017-08-25 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-21751?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-21751: Assignee: (was: Apache Spark) > CodeGeneraor.splitExpressions counts code size more

[jira] [Assigned] (SPARK-21751) CodeGeneraor.splitExpressions counts code size more precisely

2017-08-25 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-21751?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-21751: Assignee: Apache Spark > CodeGeneraor.splitExpressions counts code size more precisely >

[jira] [Commented] (SPARK-21751) CodeGeneraor.splitExpressions counts code size more precisely

2017-08-25 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-21751?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16142535#comment-16142535 ] Apache Spark commented on SPARK-21751: -- User 'kiszk' has created a pull request for this issue:

[jira] [Assigned] (SPARK-21843) testNameNote should be "(minNumPostShufflePartitions: " + numPartitions + ")" in ExchangeCoordinatorSuite

2017-08-25 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-21843?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-21843: Assignee: (was: Apache Spark) > testNameNote should be "(minNumPostShufflePartitions:

[jira] [Assigned] (SPARK-21843) testNameNote should be "(minNumPostShufflePartitions: " + numPartitions + ")" in ExchangeCoordinatorSuite

2017-08-25 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-21843?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-21843: Assignee: Apache Spark > testNameNote should be "(minNumPostShufflePartitions: " +

[jira] [Assigned] (SPARK-21843) testNameNote should be "(minNumPostShufflePartitions: " + numPartitions + ")" in ExchangeCoordinatorSuite

2017-08-25 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-21843?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-21843: Assignee: (was: Apache Spark) > testNameNote should be "(minNumPostShufflePartitions:

[jira] [Assigned] (SPARK-21843) testNameNote should be "(minNumPostShufflePartitions: " + numPartitions + ")" in ExchangeCoordinatorSuite

2017-08-25 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-21843?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-21843: Assignee: Apache Spark > testNameNote should be "(minNumPostShufflePartitions: " +

[jira] [Assigned] (SPARK-21843) testNameNote should be "(minNumPostShufflePartitions: " + numPartitions + ")" in ExchangeCoordinatorSuite

2017-08-25 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-21843?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-21843: Assignee: Apache Spark > testNameNote should be "(minNumPostShufflePartitions: " +

[jira] [Assigned] (SPARK-21843) testNameNote should be "(minNumPostShufflePartitions: " + numPartitions + ")" in ExchangeCoordinatorSuite

2017-08-25 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-21843?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-21843: Assignee: (was: Apache Spark) > testNameNote should be "(minNumPostShufflePartitions:

[jira] [Commented] (SPARK-21843) testNameNote should be "(minNumPostShufflePartitions: " + numPartitions + ")" in ExchangeCoordinatorSuite

2017-08-25 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-21843?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16142505#comment-16142505 ] Apache Spark commented on SPARK-21843: -- User 'iamhumanbeing' has created a pull request for this

[jira] [Assigned] (SPARK-21834) Incorrect executor request in case of dynamic allocation

2017-08-25 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-21834?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-21834: Assignee: (was: Apache Spark) > Incorrect executor request in case of dynamic

[jira] [Assigned] (SPARK-21834) Incorrect executor request in case of dynamic allocation

2017-08-25 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-21834?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-21834: Assignee: Apache Spark > Incorrect executor request in case of dynamic allocation >

[jira] [Assigned] (SPARK-21834) Incorrect executor request in case of dynamic allocation

2017-08-25 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-21834?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-21834: Assignee: Apache Spark > Incorrect executor request in case of dynamic allocation >

[jira] [Assigned] (SPARK-21834) Incorrect executor request in case of dynamic allocation

2017-08-25 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-21834?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-21834: Assignee: (was: Apache Spark) > Incorrect executor request in case of dynamic

[jira] [Assigned] (SPARK-21834) Incorrect executor request in case of dynamic allocation

2017-08-25 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-21834?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-21834: Assignee: Apache Spark > Incorrect executor request in case of dynamic allocation >

[jira] [Assigned] (SPARK-21834) Incorrect executor request in case of dynamic allocation

2017-08-25 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-21834?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-21834: Assignee: (was: Apache Spark) > Incorrect executor request in case of dynamic

[jira] [Assigned] (SPARK-21834) Incorrect executor request in case of dynamic allocation

2017-08-25 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-21834?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-21834: Assignee: Apache Spark > Incorrect executor request in case of dynamic allocation >

[jira] [Commented] (SPARK-21834) Incorrect executor request in case of dynamic allocation

2017-08-25 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-21834?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16142468#comment-16142468 ] Apache Spark commented on SPARK-21834: -- User 'sitalkedia' has created a pull request for this issue:

[jira] [Assigned] (SPARK-21834) Incorrect executor request in case of dynamic allocation

2017-08-25 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-21834?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-21834: Assignee: (was: Apache Spark) > Incorrect executor request in case of dynamic

[jira] [Closed] (SPARK-21772) HiveException unable to move results from srcf to destf in InsertIntoHiveTable

2017-08-25 Thread Xiao Li (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-21772?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Xiao Li closed SPARK-21772. --- Resolution: Cannot Reproduce > HiveException unable to move results from srcf to destf in >

[jira] [Commented] (SPARK-21691) Accessing canonicalized plan for query with limit throws exception

2017-08-25 Thread Xiao Li (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-21691?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16142395#comment-16142395 ] Xiao Li commented on SPARK-21691: - If you really need to call `canonicalized`, you can do it {noformat}

[jira] [Commented] (SPARK-21691) Accessing canonicalized plan for query with limit throws exception

2017-08-25 Thread Xiao Li (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-21691?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16142391#comment-16142391 ] Xiao Li commented on SPARK-21691: - This is a pretty internal API. We do not expect users to call it.

[jira] [Created] (SPARK-21843) testNameNote should be "(minNumPostShufflePartitions: " + numPartitions + ")" in ExchangeCoordinatorSuite

2017-08-25 Thread iamhumanbeing (JIRA)
iamhumanbeing created SPARK-21843: - Summary: testNameNote should be "(minNumPostShufflePartitions: " + numPartitions + ")" in ExchangeCoordinatorSuite Key: SPARK-21843 URL:

[jira] [Assigned] (SPARK-21798) No config to replace deprecated SPARK_CLASSPATH config for launching daemons like History Server

2017-08-25 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-21798?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-21798: Assignee: Apache Spark > No config to replace deprecated SPARK_CLASSPATH config for

[jira] [Assigned] (SPARK-21798) No config to replace deprecated SPARK_CLASSPATH config for launching daemons like History Server

2017-08-25 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-21798?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-21798: Assignee: (was: Apache Spark) > No config to replace deprecated SPARK_CLASSPATH

[jira] [Assigned] (SPARK-21798) No config to replace deprecated SPARK_CLASSPATH config for launching daemons like History Server

2017-08-25 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-21798?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-21798: Assignee: Apache Spark > No config to replace deprecated SPARK_CLASSPATH config for

[jira] [Assigned] (SPARK-21798) No config to replace deprecated SPARK_CLASSPATH config for launching daemons like History Server

2017-08-25 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-21798?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-21798: Assignee: (was: Apache Spark) > No config to replace deprecated SPARK_CLASSPATH

[jira] [Assigned] (SPARK-21798) No config to replace deprecated SPARK_CLASSPATH config for launching daemons like History Server

2017-08-25 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-21798?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-21798: Assignee: (was: Apache Spark) > No config to replace deprecated SPARK_CLASSPATH

[jira] [Assigned] (SPARK-21798) No config to replace deprecated SPARK_CLASSPATH config for launching daemons like History Server

2017-08-25 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-21798?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-21798: Assignee: Apache Spark > No config to replace deprecated SPARK_CLASSPATH config for

[jira] [Commented] (SPARK-21798) No config to replace deprecated SPARK_CLASSPATH config for launching daemons like History Server

2017-08-25 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-21798?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16142357#comment-16142357 ] Apache Spark commented on SPARK-21798: -- User 'pgandhi999' has created a pull request for this issue:

[jira] [Assigned] (SPARK-21839) Support SQL config for ORC compression

2017-08-25 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-21839?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-21839: Assignee: Apache Spark > Support SQL config for ORC compression >

[jira] [Assigned] (SPARK-21839) Support SQL config for ORC compression

2017-08-25 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-21839?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-21839: Assignee: (was: Apache Spark) > Support SQL config for ORC compression >

[jira] [Assigned] (SPARK-21839) Support SQL config for ORC compression

2017-08-25 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-21839?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-21839: Assignee: Apache Spark > Support SQL config for ORC compression >

[jira] [Assigned] (SPARK-21839) Support SQL config for ORC compression

2017-08-25 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-21839?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-21839: Assignee: (was: Apache Spark) > Support SQL config for ORC compression >

[jira] [Assigned] (SPARK-21839) Support SQL config for ORC compression

2017-08-25 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-21839?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-21839: Assignee: Apache Spark > Support SQL config for ORC compression >

[jira] [Assigned] (SPARK-21839) Support SQL config for ORC compression

2017-08-25 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-21839?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-21839: Assignee: (was: Apache Spark) > Support SQL config for ORC compression >

[jira] [Commented] (SPARK-16742) Kerberos support for Spark on Mesos

2017-08-25 Thread Arthur Rand (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-16742?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16142337#comment-16142337 ] Arthur Rand commented on SPARK-16742: - Gotcha, https://issues.apache.org/jira/browse/SPARK-21842 is

[jira] [Created] (SPARK-21842) Support Kerberos ticket renewal and creation in Mesos

2017-08-25 Thread Arthur Rand (JIRA)
Arthur Rand created SPARK-21842: --- Summary: Support Kerberos ticket renewal and creation in Mesos Key: SPARK-21842 URL: https://issues.apache.org/jira/browse/SPARK-21842 Project: Spark Issue

[jira] [Assigned] (SPARK-21839) Support SQL config for ORC compression

2017-08-25 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-21839?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-21839: Assignee: Apache Spark > Support SQL config for ORC compression >

[jira] [Assigned] (SPARK-21839) Support SQL config for ORC compression

2017-08-25 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-21839?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-21839: Assignee: (was: Apache Spark) > Support SQL config for ORC compression >

[jira] [Assigned] (SPARK-21839) Support SQL config for ORC compression

2017-08-25 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-21839?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-21839: Assignee: (was: Apache Spark) > Support SQL config for ORC compression >

[jira] [Assigned] (SPARK-21839) Support SQL config for ORC compression

2017-08-25 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-21839?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-21839: Assignee: Apache Spark > Support SQL config for ORC compression >

[jira] [Assigned] (SPARK-21839) Support SQL config for ORC compression

2017-08-25 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-21839?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-21839: Assignee: Apache Spark > Support SQL config for ORC compression >

[jira] [Assigned] (SPARK-21839) Support SQL config for ORC compression

2017-08-25 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-21839?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-21839: Assignee: (was: Apache Spark) > Support SQL config for ORC compression >

[jira] [Assigned] (SPARK-21839) Support SQL config for ORC compression

2017-08-25 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-21839?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-21839: Assignee: Apache Spark > Support SQL config for ORC compression >

[jira] [Assigned] (SPARK-21839) Support SQL config for ORC compression

2017-08-25 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-21839?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-21839: Assignee: (was: Apache Spark) > Support SQL config for ORC compression >

[jira] [Assigned] (SPARK-21839) Support SQL config for ORC compression

2017-08-25 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-21839?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-21839: Assignee: (was: Apache Spark) > Support SQL config for ORC compression >

[jira] [Assigned] (SPARK-21839) Support SQL config for ORC compression

2017-08-25 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-21839?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-21839: Assignee: Apache Spark > Support SQL config for ORC compression >

[jira] [Commented] (SPARK-17321) YARN shuffle service should use good disk from yarn.nodemanager.local-dirs

2017-08-25 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-17321?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16142227#comment-16142227 ] Apache Spark commented on SPARK-17321: -- User 'jerryshao' has created a pull request for this issue:

[jira] [Commented] (SPARK-17321) YARN shuffle service should use good disk from yarn.nodemanager.local-dirs

2017-08-25 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-17321?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16142229#comment-16142229 ] Apache Spark commented on SPARK-17321: -- User 'jerryshao' has created a pull request for this issue:

[jira] [Created] (SPARK-21841) Spark SQL doesn't pick up column added in hive when table created with saveAsTable

2017-08-25 Thread Thomas Graves (JIRA)
Thomas Graves created SPARK-21841: - Summary: Spark SQL doesn't pick up column added in hive when table created with saveAsTable Key: SPARK-21841 URL: https://issues.apache.org/jira/browse/SPARK-21841

[jira] [Assigned] (SPARK-20812) Add Mesos Secrets support to the spark dispatcher

2017-08-25 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-20812?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-20812: Assignee: (was: Apache Spark) > Add Mesos Secrets support to the spark dispatcher >

[jira] [Assigned] (SPARK-20812) Add Mesos Secrets support to the spark dispatcher

2017-08-25 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-20812?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-20812: Assignee: Apache Spark > Add Mesos Secrets support to the spark dispatcher >

[jira] [Assigned] (SPARK-20812) Add Mesos Secrets support to the spark dispatcher

2017-08-25 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-20812?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-20812: Assignee: Apache Spark > Add Mesos Secrets support to the spark dispatcher >

[jira] [Commented] (SPARK-20812) Add Mesos Secrets support to the spark dispatcher

2017-08-25 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-20812?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16142201#comment-16142201 ] Apache Spark commented on SPARK-20812: -- User 'ArtRand' has created a pull request for this issue:

[jira] [Assigned] (SPARK-21806) BinaryClassificationMetrics pr(): first point (0.0, 1.0) is misleading

2017-08-25 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-21806?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-21806: Assignee: (was: Apache Spark) > BinaryClassificationMetrics pr(): first point (0.0,

[jira] [Commented] (SPARK-21765) Ensure all leaf nodes that are derived from streaming sources have isStreaming=true

2017-08-25 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-21765?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16142171#comment-16142171 ] Apache Spark commented on SPARK-21765: -- User 'joseph-torres' has created a pull request for this

[jira] [Assigned] (SPARK-21806) BinaryClassificationMetrics pr(): first point (0.0, 1.0) is misleading

2017-08-25 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-21806?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-21806: Assignee: Apache Spark > BinaryClassificationMetrics pr(): first point (0.0, 1.0) is

[jira] [Assigned] (SPARK-21806) BinaryClassificationMetrics pr(): first point (0.0, 1.0) is misleading

2017-08-25 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-21806?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-21806: Assignee: Apache Spark > BinaryClassificationMetrics pr(): first point (0.0, 1.0) is

[jira] [Assigned] (SPARK-21806) BinaryClassificationMetrics pr(): first point (0.0, 1.0) is misleading

2017-08-25 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-21806?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-21806: Assignee: (was: Apache Spark) > BinaryClassificationMetrics pr(): first point (0.0,

[jira] [Assigned] (SPARK-21806) BinaryClassificationMetrics pr(): first point (0.0, 1.0) is misleading

2017-08-25 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-21806?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-21806: Assignee: (was: Apache Spark) > BinaryClassificationMetrics pr(): first point (0.0,

[jira] [Assigned] (SPARK-21806) BinaryClassificationMetrics pr(): first point (0.0, 1.0) is misleading

2017-08-25 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-21806?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-21806: Assignee: Apache Spark > BinaryClassificationMetrics pr(): first point (0.0, 1.0) is

[jira] [Assigned] (SPARK-21728) Allow SparkSubmit to use logging

2017-08-25 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-21728?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-21728: Assignee: Apache Spark > Allow SparkSubmit to use logging >

[jira] [Assigned] (SPARK-21728) Allow SparkSubmit to use logging

2017-08-25 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-21728?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-21728: Assignee: (was: Apache Spark) > Allow SparkSubmit to use logging >

[jira] [Assigned] (SPARK-21728) Allow SparkSubmit to use logging

2017-08-25 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-21728?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-21728: Assignee: Apache Spark > Allow SparkSubmit to use logging >

[jira] [Assigned] (SPARK-21728) Allow SparkSubmit to use logging

2017-08-25 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-21728?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-21728: Assignee: (was: Apache Spark) > Allow SparkSubmit to use logging >

[jira] [Commented] (SPARK-21728) Allow SparkSubmit to use logging

2017-08-25 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-21728?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16142151#comment-16142151 ] Apache Spark commented on SPARK-21728: -- User 'vanzin' has created a pull request for this issue:

[jira] [Assigned] (SPARK-21728) Allow SparkSubmit to use logging

2017-08-25 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-21728?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-21728: Assignee: (was: Apache Spark) > Allow SparkSubmit to use logging >

[jira] [Assigned] (SPARK-21728) Allow SparkSubmit to use logging

2017-08-25 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-21728?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-21728: Assignee: Apache Spark > Allow SparkSubmit to use logging >

[jira] [Commented] (SPARK-21728) Allow SparkSubmit to use logging

2017-08-25 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-21728?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16142149#comment-16142149 ] Apache Spark commented on SPARK-21728: -- User 'vanzin' has created a pull request for this issue:

[jira] [Resolved] (SPARK-21837) UserDefinedTypeSuite local UDFs not actually testing what it intends

2017-08-25 Thread Xiao Li (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-21837?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Xiao Li resolved SPARK-21837. - Resolution: Fixed Fix Version/s: 2.3.0 > UserDefinedTypeSuite local UDFs not actually testing

[jira] [Assigned] (SPARK-21837) UserDefinedTypeSuite local UDFs not actually testing what it intends

2017-08-25 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-21837?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-21837: Assignee: Sean Owen (was: Apache Spark) > UserDefinedTypeSuite local UDFs not actually

[jira] [Commented] (SPARK-20682) Support a new faster ORC data source based on Apache ORC

2017-08-25 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-20682?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16142138#comment-16142138 ] Apache Spark commented on SPARK-20682: -- User 'dongjoon-hyun' has created a pull request for this

  1   2   >