[jira] [Assigned] (SPARK-24901) Merge the codegen of RegularHashMap and fastHashMap to reduce compiler maxCodesize when VectorizedHashMap is false

2018-10-31 Thread Wenchen Fan (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-24901?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Wenchen Fan reassigned SPARK-24901: --- Assignee: caoxuewen > Merge the codegen of RegularHashMap and fastHashMap to reduce

[jira] [Updated] (SPARK-25868) One part of Spark MLlib Kmean Logic Performance problem

2018-10-31 Thread Liang Li (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-25868?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Liang Li updated SPARK-25868: - Description: In function fastSquaredDistance, there is a low performance logic: the sqDist =

[jira] [Updated] (SPARK-25868) One part of Spark MLlib Kmean Logic Performance problem

2018-10-31 Thread Liang Li (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-25868?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Liang Li updated SPARK-25868: - Description: In function fastSquaredDistance, there is a low performance logic Already update a patch 

[jira] [Resolved] (SPARK-25661) Refactor AvroWriteBenchmark to use main method

2018-10-31 Thread Dongjoon Hyun (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-25661?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Dongjoon Hyun resolved SPARK-25661. --- Resolution: Fixed Fix Version/s: 3.0.0 Issue resolved by pull request 22861

[jira] [Resolved] (SPARK-25663) Refactor BuiltInDataSourceWriteBenchmark and DataSourceWriteBenchmark to use main method

2018-10-31 Thread Dongjoon Hyun (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-25663?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Dongjoon Hyun resolved SPARK-25663. --- Resolution: Fixed Fix Version/s: 3.0.0 Issue resolved by pull request 22861

[jira] [Assigned] (SPARK-25663) Refactor BuiltInDataSourceWriteBenchmark and DataSourceWriteBenchmark to use main method

2018-10-31 Thread Dongjoon Hyun (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-25663?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Dongjoon Hyun reassigned SPARK-25663: - Assignee: yucai > Refactor BuiltInDataSourceWriteBenchmark and

[jira] [Assigned] (SPARK-25661) Refactor AvroWriteBenchmark to use main method

2018-10-31 Thread Dongjoon Hyun (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-25661?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Dongjoon Hyun reassigned SPARK-25661: - Assignee: yucai > Refactor AvroWriteBenchmark to use main method >

[jira] [Commented] (SPARK-22354) --executor-cores in spark-submit fails to set "spark.executor.cores" for mesos workers

2018-10-31 Thread antoine (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-22354?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16669855#comment-16669855 ] antoine commented on SPARK-22354: - I'm not 100% sure but it seems I have a similar issue.  I have a

[jira] [Resolved] (SPARK-25618) KafkaContinuousSourceStressForDontFailOnDataLossSuite: stress test for failOnDataLoss=false 1 min 1 sec

2018-10-31 Thread Dongjoon Hyun (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-25618?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Dongjoon Hyun resolved SPARK-25618. --- Resolution: Fixed Fix Version/s: 3.0.0 Issue resolved by pull request 22900

[jira] [Assigned] (SPARK-25618) KafkaContinuousSourceStressForDontFailOnDataLossSuite: stress test for failOnDataLoss=false 1 min 1 sec

2018-10-31 Thread Dongjoon Hyun (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-25618?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Dongjoon Hyun reassigned SPARK-25618: - Assignee: Dilip Biswal > KafkaContinuousSourceStressForDontFailOnDataLossSuite: stress

[jira] [Commented] (SPARK-25893) Show a directional error message for unsupported Hive Metastore versions

2018-10-31 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-25893?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16669811#comment-16669811 ] Apache Spark commented on SPARK-25893: -- User 'dongjoon-hyun' has created a pull request for this

[jira] [Assigned] (SPARK-25893) Show a directional error message for unsupported Hive Metastore versions

2018-10-31 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-25893?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-25893: Assignee: (was: Apache Spark) > Show a directional error message for unsupported

[jira] [Assigned] (SPARK-25893) Show a directional error message for unsupported Hive Metastore versions

2018-10-31 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-25893?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-25893: Assignee: Apache Spark > Show a directional error message for unsupported Hive Metastore

[jira] [Created] (SPARK-25893) Show a directional error message for unsupported Hive Metastore versions

2018-10-31 Thread Dongjoon Hyun (JIRA)
Dongjoon Hyun created SPARK-25893: - Summary: Show a directional error message for unsupported Hive Metastore versions Key: SPARK-25893 URL: https://issues.apache.org/jira/browse/SPARK-25893 Project:

[jira] [Created] (SPARK-25892) AttributeReference.withMetadata method should have return type AttributeReference

2018-10-31 Thread Jari Kujansuu (JIRA)
Jari Kujansuu created SPARK-25892: - Summary: AttributeReference.withMetadata method should have return type AttributeReference Key: SPARK-25892 URL: https://issues.apache.org/jira/browse/SPARK-25892

[jira] [Commented] (SPARK-25891) Upgrade to Py4J 0.10.8.1

2018-10-31 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-25891?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16669727#comment-16669727 ] Apache Spark commented on SPARK-25891: -- User 'dongjoon-hyun' has created a pull request for this

[jira] [Assigned] (SPARK-25891) Upgrade to Py4J 0.10.8.1

2018-10-31 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-25891?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-25891: Assignee: Apache Spark > Upgrade to Py4J 0.10.8.1 > > >

[jira] [Assigned] (SPARK-25891) Upgrade to Py4J 0.10.8.1

2018-10-31 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-25891?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-25891: Assignee: (was: Apache Spark) > Upgrade to Py4J 0.10.8.1 >

[jira] [Created] (SPARK-25891) Upgrade to Py4J 0.10.8.1

2018-10-31 Thread Dongjoon Hyun (JIRA)
Dongjoon Hyun created SPARK-25891: - Summary: Upgrade to Py4J 0.10.8.1 Key: SPARK-25891 URL: https://issues.apache.org/jira/browse/SPARK-25891 Project: Spark Issue Type: Improvement

[jira] [Resolved] (SPARK-25883) Override method `prettyName` in `from_avro`/`to_avro`

2018-10-31 Thread Xiao Li (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-25883?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Xiao Li resolved SPARK-25883. - Resolution: Fixed Assignee: Gengliang Wang Fix Version/s: 3.0.0 > Override method

[jira] [Assigned] (SPARK-25618) KafkaContinuousSourceStressForDontFailOnDataLossSuite: stress test for failOnDataLoss=false 1 min 1 sec

2018-10-31 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-25618?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-25618: Assignee: (was: Apache Spark) >

[jira] [Commented] (SPARK-25618) KafkaContinuousSourceStressForDontFailOnDataLossSuite: stress test for failOnDataLoss=false 1 min 1 sec

2018-10-31 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-25618?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16669672#comment-16669672 ] Apache Spark commented on SPARK-25618: -- User 'dilipbiswal' has created a pull request for this

[jira] [Assigned] (SPARK-25618) KafkaContinuousSourceStressForDontFailOnDataLossSuite: stress test for failOnDataLoss=false 1 min 1 sec

2018-10-31 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-25618?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-25618: Assignee: Apache Spark > KafkaContinuousSourceStressForDontFailOnDataLossSuite: stress

[jira] [Assigned] (SPARK-25573) Combine resolveExpression and resolve in the rule ResolveReferences

2018-10-31 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-25573?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-25573: Assignee: (was: Apache Spark) > Combine resolveExpression and resolve in the rule

[jira] [Assigned] (SPARK-25573) Combine resolveExpression and resolve in the rule ResolveReferences

2018-10-31 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-25573?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-25573: Assignee: Apache Spark > Combine resolveExpression and resolve in the rule

[jira] [Commented] (SPARK-25573) Combine resolveExpression and resolve in the rule ResolveReferences

2018-10-31 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-25573?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16669664#comment-16669664 ] Apache Spark commented on SPARK-25573: -- User 'dilipbiswal' has created a pull request for this

[jira] [Commented] (SPARK-25573) Combine resolveExpression and resolve in the rule ResolveReferences

2018-10-31 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-25573?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16669665#comment-16669665 ] Apache Spark commented on SPARK-25573: -- User 'dilipbiswal' has created a pull request for this

[jira] [Assigned] (SPARK-25833) Update migration guide for Hive view compatibility

2018-10-31 Thread Dongjoon Hyun (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-25833?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Dongjoon Hyun reassigned SPARK-25833: - Assignee: Chenxiao Mao > Update migration guide for Hive view compatibility >

[jira] [Resolved] (SPARK-25833) Update migration guide for Hive view compatibility

2018-10-31 Thread Dongjoon Hyun (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-25833?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Dongjoon Hyun resolved SPARK-25833. --- Resolution: Fixed Fix Version/s: 3.0.0 Issue resolved by pull request 22868

<    1   2