[jira] [Created] (SPARK-23600) conda_panda_example test fails to import panda lib with Spark 2.3

2018-03-05 Thread Supreeth Sharma (JIRA)
Supreeth Sharma created SPARK-23600: --- Summary: conda_panda_example test fails to import panda lib with Spark 2.3 Key: SPARK-23600 URL: https://issues.apache.org/jira/browse/SPARK-23600 Project:

[jira] [Resolved] (SPARK-23496) Locality of coalesced partitions can be severely skewed by the order of input partitions

2018-03-05 Thread Herman van Hovell (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-23496?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Herman van Hovell resolved SPARK-23496. --- Resolution: Fixed Assignee: Ala Luszczak Fix Version/s: 2.4.0 >

[jira] [Created] (SPARK-23599) The UUID() expression is too non-deterministic

2018-03-05 Thread Herman van Hovell (JIRA)
Herman van Hovell created SPARK-23599: - Summary: The UUID() expression is too non-deterministic Key: SPARK-23599 URL: https://issues.apache.org/jira/browse/SPARK-23599 Project: Spark

[jira] [Updated] (SPARK-23599) The UUID() expression is too non-deterministic

2018-03-05 Thread Herman van Hovell (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-23599?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Herman van Hovell updated SPARK-23599: -- Priority: Critical (was: Major) > The UUID() expression is too non-deterministic >

[jira] [Updated] (SPARK-23598) WholeStageCodegen can lead to IllegalAccessError calling append for HashAggregateExec

2018-03-05 Thread David Vogelbacher (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-23598?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] David Vogelbacher updated SPARK-23598: -- Description: Got the following stacktrace for a large QueryPlan using

[jira] [Updated] (SPARK-23598) WholeStageCodegen can lead to IllegalAccessError calling append for HashAggregateExec

2018-03-05 Thread David Vogelbacher (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-23598?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] David Vogelbacher updated SPARK-23598: -- Description: Got the following stacktrace for a large QueryPlan using

[jira] [Updated] (SPARK-23598) WholeStageCodegen can lead to IllegalAccessError calling append for HashAggregateExec

2018-03-05 Thread David Vogelbacher (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-23598?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] David Vogelbacher updated SPARK-23598: -- Description: Got the following stacktrace for a large QueryPlan using

[jira] [Assigned] (SPARK-23586) Add interpreted execution for WrapOption expression

2018-03-05 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-23586?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-23586: Assignee: Apache Spark > Add interpreted execution for WrapOption expression >

[jira] [Assigned] (SPARK-23586) Add interpreted execution for WrapOption expression

2018-03-05 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-23586?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-23586: Assignee: (was: Apache Spark) > Add interpreted execution for WrapOption expression >

[jira] [Commented] (SPARK-23586) Add interpreted execution for WrapOption expression

2018-03-05 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-23586?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16386069#comment-16386069 ] Apache Spark commented on SPARK-23586: -- User 'mgaido91' has created a pull request for this issue:

[jira] [Updated] (SPARK-23598) WholeStageCodegen can lead to IllegalAccessError calling append for HashAggregateExec

2018-03-05 Thread David Vogelbacher (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-23598?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] David Vogelbacher updated SPARK-23598: -- Description: Got the following stacktrace for a large QueryPlan using

[jira] [Updated] (SPARK-23598) WholeStageCodegen can lead to IllegalAccessError calling append for HashAggregateExec

2018-03-05 Thread David Vogelbacher (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-23598?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] David Vogelbacher updated SPARK-23598: -- Description: Got the following stacktrace for a large QueryPlan using

[jira] [Updated] (SPARK-23598) WholeStageCodegen can lead to IllegalAccessError calling append for HashAggregateExec

2018-03-05 Thread David Vogelbacher (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-23598?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] David Vogelbacher updated SPARK-23598: -- Description: Got the following stacktrace for a large QueryPlan using

[jira] [Created] (SPARK-23598) WholeStageCodegen can lead to IllegalAccessError calling append for HashAggregateExec

2018-03-05 Thread David Vogelbacher (JIRA)
David Vogelbacher created SPARK-23598: - Summary: WholeStageCodegen can lead to IllegalAccessError calling append for HashAggregateExec Key: SPARK-23598 URL: https://issues.apache.org/jira/browse/SPARK-23598

[jira] [Created] (SPARK-23597) Audit Spark SQL code base for non-interpreted expressions

2018-03-05 Thread Herman van Hovell (JIRA)
Herman van Hovell created SPARK-23597: - Summary: Audit Spark SQL code base for non-interpreted expressions Key: SPARK-23597 URL: https://issues.apache.org/jira/browse/SPARK-23597 Project: Spark

[jira] [Created] (SPARK-23596) Modify Dataset test harness to include interpreted execution

2018-03-05 Thread Herman van Hovell (JIRA)
Herman van Hovell created SPARK-23596: - Summary: Modify Dataset test harness to include interpreted execution Key: SPARK-23596 URL: https://issues.apache.org/jira/browse/SPARK-23596 Project:

[jira] [Created] (SPARK-23595) Add interpreted execution for ValidateExternalType expression

2018-03-05 Thread Herman van Hovell (JIRA)
Herman van Hovell created SPARK-23595: - Summary: Add interpreted execution for ValidateExternalType expression Key: SPARK-23595 URL: https://issues.apache.org/jira/browse/SPARK-23595 Project:

[jira] [Created] (SPARK-23594) Add interpreted execution for GetExternalRowField expression

2018-03-05 Thread Herman van Hovell (JIRA)
Herman van Hovell created SPARK-23594: - Summary: Add interpreted execution for GetExternalRowField expression Key: SPARK-23594 URL: https://issues.apache.org/jira/browse/SPARK-23594 Project:

[jira] [Created] (SPARK-23593) Add interpreted execution for InitializeJavaBean expression

2018-03-05 Thread Herman van Hovell (JIRA)
Herman van Hovell created SPARK-23593: - Summary: Add interpreted execution for InitializeJavaBean expression Key: SPARK-23593 URL: https://issues.apache.org/jira/browse/SPARK-23593 Project: Spark

[jira] [Created] (SPARK-23592) Add interpreted execution for DecodeUsingSerializer expression

2018-03-05 Thread Herman van Hovell (JIRA)
Herman van Hovell created SPARK-23592: - Summary: Add interpreted execution for DecodeUsingSerializer expression Key: SPARK-23592 URL: https://issues.apache.org/jira/browse/SPARK-23592 Project:

[jira] [Created] (SPARK-23591) Add interpreted execution for EncodeUsingSerializer expression

2018-03-05 Thread Herman van Hovell (JIRA)
Herman van Hovell created SPARK-23591: - Summary: Add interpreted execution for EncodeUsingSerializer expression Key: SPARK-23591 URL: https://issues.apache.org/jira/browse/SPARK-23591 Project:

[jira] [Created] (SPARK-23590) Add interpreted execution for CreateExternalRow

2018-03-05 Thread Herman van Hovell (JIRA)
Herman van Hovell created SPARK-23590: - Summary: Add interpreted execution for CreateExternalRow Key: SPARK-23590 URL: https://issues.apache.org/jira/browse/SPARK-23590 Project: Spark

[jira] [Updated] (SPARK-23590) Add interpreted execution for CreateExternalRow expression

2018-03-05 Thread Herman van Hovell (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-23590?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Herman van Hovell updated SPARK-23590: -- Summary: Add interpreted execution for CreateExternalRow expression (was: Add

[jira] [Created] (SPARK-23589) Add interpreted execution for ExternalMapToCatalyst expression

2018-03-05 Thread Herman van Hovell (JIRA)
Herman van Hovell created SPARK-23589: - Summary: Add interpreted execution for ExternalMapToCatalyst expression Key: SPARK-23589 URL: https://issues.apache.org/jira/browse/SPARK-23589 Project:

[jira] [Created] (SPARK-23588) Add interpreted execution for CatalystToExternalMap expression

2018-03-05 Thread Herman van Hovell (JIRA)
Herman van Hovell created SPARK-23588: - Summary: Add interpreted execution for CatalystToExternalMap expression Key: SPARK-23588 URL: https://issues.apache.org/jira/browse/SPARK-23588 Project:

[jira] [Updated] (SPARK-23587) Add interpreted execution for MapObjects expression

2018-03-05 Thread Herman van Hovell (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-23587?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Herman van Hovell updated SPARK-23587: -- Issue Type: Sub-task (was: Bug) Parent: SPARK-23580 > Add interpreted

[jira] [Created] (SPARK-23587) Add interpreted execution for MapObjects expression

2018-03-05 Thread Herman van Hovell (JIRA)
Herman van Hovell created SPARK-23587: - Summary: Add interpreted execution for MapObjects expression Key: SPARK-23587 URL: https://issues.apache.org/jira/browse/SPARK-23587 Project: Spark

[jira] [Created] (SPARK-23586) Add interpreted execution for WrapOption expression

2018-03-05 Thread Herman van Hovell (JIRA)
Herman van Hovell created SPARK-23586: - Summary: Add interpreted execution for WrapOption expression Key: SPARK-23586 URL: https://issues.apache.org/jira/browse/SPARK-23586 Project: Spark

[jira] [Updated] (SPARK-23585) Add interpreted execution for UnwrapOption expression

2018-03-05 Thread Herman van Hovell (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-23585?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Herman van Hovell updated SPARK-23585: -- Summary: Add interpreted execution for UnwrapOption expression (was: Add interpreted

[jira] [Updated] (SPARK-23582) Add interpreted execution to StaticInvoke expression

2018-03-05 Thread Herman van Hovell (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-23582?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Herman van Hovell updated SPARK-23582: -- Summary: Add interpreted execution to StaticInvoke expression (was: Add interpreted

[jira] [Updated] (SPARK-23585) Add interpreted execition for UnwrapOption expression

2018-03-05 Thread Herman van Hovell (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-23585?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Herman van Hovell updated SPARK-23585: -- Summary: Add interpreted execition for UnwrapOption expression (was: Add interpreted

[jira] [Updated] (SPARK-23584) Add interpreted execution to NewInstance expression

2018-03-05 Thread Herman van Hovell (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-23584?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Herman van Hovell updated SPARK-23584: -- Issue Type: Sub-task (was: Bug) Parent: SPARK-23580 > Add interpreted

[jira] [Updated] (SPARK-23585) Add interpreted mode for UnwrapOption expression

2018-03-05 Thread Herman van Hovell (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-23585?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Herman van Hovell updated SPARK-23585: -- Issue Type: Sub-task (was: Bug) Parent: SPARK-23580 > Add interpreted mode

[jira] [Created] (SPARK-23584) Add interpreted execution to NewInstance expression

2018-03-05 Thread Herman van Hovell (JIRA)
Herman van Hovell created SPARK-23584: - Summary: Add interpreted execution to NewInstance expression Key: SPARK-23584 URL: https://issues.apache.org/jira/browse/SPARK-23584 Project: Spark

[jira] [Created] (SPARK-23585) Add interpreted mode for UnwrapOption expression

2018-03-05 Thread Herman van Hovell (JIRA)
Herman van Hovell created SPARK-23585: - Summary: Add interpreted mode for UnwrapOption expression Key: SPARK-23585 URL: https://issues.apache.org/jira/browse/SPARK-23585 Project: Spark

[jira] [Created] (SPARK-23582) Add interpreted execution to StaticInvoke

2018-03-05 Thread Herman van Hovell (JIRA)
Herman van Hovell created SPARK-23582: - Summary: Add interpreted execution to StaticInvoke Key: SPARK-23582 URL: https://issues.apache.org/jira/browse/SPARK-23582 Project: Spark Issue

[jira] [Created] (SPARK-23583) Add interpreted execution to Invoke expression

2018-03-05 Thread Herman van Hovell (JIRA)
Herman van Hovell created SPARK-23583: - Summary: Add interpreted execution to Invoke expression Key: SPARK-23583 URL: https://issues.apache.org/jira/browse/SPARK-23583 Project: Spark

[jira] [Created] (SPARK-23581) Add an interpreted version of GenerateUnsafeProjection

2018-03-05 Thread Herman van Hovell (JIRA)
Herman van Hovell created SPARK-23581: - Summary: Add an interpreted version of GenerateUnsafeProjection Key: SPARK-23581 URL: https://issues.apache.org/jira/browse/SPARK-23581 Project: Spark

[jira] [Created] (SPARK-23580) Interpreted mode fallback should be implemented for all expressions & projections

2018-03-05 Thread Herman van Hovell (JIRA)
Herman van Hovell created SPARK-23580: - Summary: Interpreted mode fallback should be implemented for all expressions & projections Key: SPARK-23580 URL: https://issues.apache.org/jira/browse/SPARK-23580

[jira] [Commented] (SPARK-23510) Support read data from Hive 2.2 and Hive 2.3 metastore

2018-03-05 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-23510?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16386010#comment-16386010 ] Apache Spark commented on SPARK-23510: -- User 'wangyum' has created a pull request for this issue:

[jira] [Resolved] (SPARK-23546) Refactor non-stateful methods/values in CodegenContext

2018-03-05 Thread Herman van Hovell (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-23546?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Herman van Hovell resolved SPARK-23546. --- Resolution: Fixed Assignee: Kazuaki Ishizaki Target Version/s:

[jira] [Resolved] (SPARK-23516) I think it is unnecessary to transfer unroll memory to storage memory

2018-03-05 Thread liuxian (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-23516?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] liuxian resolved SPARK-23516. - Resolution: Invalid > I think it is unnecessary to transfer unroll memory to storage memory >

<    1   2