[jira] [Assigned] (SPARK-29037) [Core] Spark gives duplicate result when an application was killed and rerun

2020-04-30 Thread Apache Spark (Jira)
[ https://issues.apache.org/jira/browse/SPARK-29037?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-29037: Assignee: (was: Apache Spark) > [Core] Spark gives duplicate result when an applicati

[jira] [Assigned] (SPARK-28670) [UDF] create permanent UDF does not throw Exception if jar does not exist in HDFS path or Local

2020-04-30 Thread Apache Spark (Jira)
[ https://issues.apache.org/jira/browse/SPARK-28670?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-28670: Assignee: Sandeep Katta (was: Apache Spark) > [UDF] create permanent UDF does not throw

[jira] [Assigned] (SPARK-30069) Clean up non-shuffle disk block manager files following executor exists on YARN

2020-04-30 Thread Apache Spark (Jira)
[ https://issues.apache.org/jira/browse/SPARK-30069?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-30069: Assignee: Apache Spark > Clean up non-shuffle disk block manager files following executor

[jira] [Assigned] (SPARK-31317) Add withField method to Column class

2020-04-30 Thread Apache Spark (Jira)
[ https://issues.apache.org/jira/browse/SPARK-31317?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-31317: Assignee: (was: Apache Spark) > Add withField method to Column class > --

[jira] [Assigned] (SPARK-26494) Support Oracle TIMESTAMP WITH LOCAL TIME ZONE type

2020-04-30 Thread Apache Spark (Jira)
[ https://issues.apache.org/jira/browse/SPARK-26494?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-26494: Assignee: Apache Spark > Support Oracle TIMESTAMP WITH LOCAL TIME ZONE type > ---

[jira] [Assigned] (SPARK-30514) add ENV_PYSPARK_MAJOR_PYTHON_VERSION support for JavaMainAppResource

2020-04-30 Thread Apache Spark (Jira)
[ https://issues.apache.org/jira/browse/SPARK-30514?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-30514: Assignee: (was: Apache Spark) > add ENV_PYSPARK_MAJOR_PYTHON_VERSION support for Java

[jira] [Assigned] (SPARK-28670) [UDF] create permanent UDF does not throw Exception if jar does not exist in HDFS path or Local

2020-04-30 Thread Apache Spark (Jira)
[ https://issues.apache.org/jira/browse/SPARK-28670?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-28670: Assignee: Apache Spark (was: Sandeep Katta) > [UDF] create permanent UDF does not throw

[jira] [Assigned] (SPARK-29644) Corrected ShortType and ByteType mapping to SmallInt and TinyInt in JDBCUtils

2020-04-30 Thread Apache Spark (Jira)
[ https://issues.apache.org/jira/browse/SPARK-29644?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-29644: Assignee: Apache Spark > Corrected ShortType and ByteType mapping to SmallInt and TinyInt

[jira] [Assigned] (SPARK-30427) Add config item for limiting partition number when calculating statistics through File System

2020-04-30 Thread Apache Spark (Jira)
[ https://issues.apache.org/jira/browse/SPARK-30427?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-30427: Assignee: (was: Apache Spark) > Add config item for limiting partition number when ca

[jira] [Assigned] (SPARK-28148) repartition after join is not optimized away

2020-04-30 Thread Apache Spark (Jira)
[ https://issues.apache.org/jira/browse/SPARK-28148?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-28148: Assignee: (was: Apache Spark) > repartition after join is not optimized away > --

[jira] [Assigned] (SPARK-30471) Fix issue when compare string and IntegerType

2020-04-30 Thread Apache Spark (Jira)
[ https://issues.apache.org/jira/browse/SPARK-30471?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-30471: Assignee: (was: Apache Spark) > Fix issue when compare string and IntegerType > -

[jira] [Assigned] (SPARK-30516) statistic estimation of FileScan should take partitionFilters and partition number into account

2020-04-30 Thread Apache Spark (Jira)
[ https://issues.apache.org/jira/browse/SPARK-30516?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-30516: Assignee: (was: Apache Spark) > statistic estimation of FileScan should take partitio

[jira] [Assigned] (SPARK-23626) DAGScheduler blocked due to JobSubmitted event

2020-04-30 Thread Apache Spark (Jira)
[ https://issues.apache.org/jira/browse/SPARK-23626?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-23626: Assignee: Apache Spark > DAGScheduler blocked due to JobSubmitted event > --

[jira] [Assigned] (SPARK-30519) Executor can't use spark.executorEnv.HADOOP_USER_NAME to change the user accessing to hdfs

2020-04-30 Thread Apache Spark (Jira)
[ https://issues.apache.org/jira/browse/SPARK-30519?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-30519: Assignee: Apache Spark > Executor can't use spark.executorEnv.HADOOP_USER_NAME to change

[jira] [Assigned] (SPARK-30519) Executor can't use spark.executorEnv.HADOOP_USER_NAME to change the user accessing to hdfs

2020-04-30 Thread Apache Spark (Jira)
[ https://issues.apache.org/jira/browse/SPARK-30519?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-30519: Assignee: (was: Apache Spark) > Executor can't use spark.executorEnv.HADOOP_USER_NAME

[jira] [Assigned] (SPARK-30469) Partition columns should not be involved when calculating sizeInBytes of Project logical plan

2020-04-30 Thread Apache Spark (Jira)
[ https://issues.apache.org/jira/browse/SPARK-30469?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-30469: Assignee: (was: Apache Spark) > Partition columns should not be involved when calcula

[jira] [Assigned] (SPARK-28478) Optimizer rule to remove unnecessary explicit null checks for null-intolerant expressions (e.g. if(x is null, x, f(x)))

2020-04-30 Thread Apache Spark (Jira)
[ https://issues.apache.org/jira/browse/SPARK-28478?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-28478: Assignee: Apache Spark > Optimizer rule to remove unnecessary explicit null checks for nu

[jira] [Assigned] (SPARK-30244) Emit pre/post events for "Partition" methods in ExternalCatalogWithListener

2020-04-30 Thread Apache Spark (Jira)
[ https://issues.apache.org/jira/browse/SPARK-30244?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-30244: Assignee: (was: Apache Spark) > Emit pre/post events for "Partition" methods in Exter

[jira] [Assigned] (SPARK-30191) AM should update pending resource request faster when driver lost executor

2020-04-30 Thread Apache Spark (Jira)
[ https://issues.apache.org/jira/browse/SPARK-30191?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-30191: Assignee: (was: Apache Spark) > AM should update pending resource request faster when

[jira] [Assigned] (SPARK-30394) Skip collecting stats in DetermineTableStats rule when hive table is convertible to datasource tables

2020-04-30 Thread Apache Spark (Jira)
[ https://issues.apache.org/jira/browse/SPARK-30394?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-30394: Assignee: (was: Apache Spark) > Skip collecting stats in DetermineTableStats rule whe

[jira] [Assigned] (SPARK-30153) Extend data exchange options for vectorized UDF functions with vanilla Arrow serialization

2020-04-30 Thread Apache Spark (Jira)
[ https://issues.apache.org/jira/browse/SPARK-30153?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-30153: Assignee: Apache Spark > Extend data exchange options for vectorized UDF functions with v

[jira] [Assigned] (SPARK-30394) Skip collecting stats in DetermineTableStats rule when hive table is convertible to datasource tables

2020-04-30 Thread Apache Spark (Jira)
[ https://issues.apache.org/jira/browse/SPARK-30394?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-30394: Assignee: Apache Spark > Skip collecting stats in DetermineTableStats rule when hive tabl

[jira] [Assigned] (SPARK-30319) Adds a stricter version of as[T]

2020-04-30 Thread Apache Spark (Jira)
[ https://issues.apache.org/jira/browse/SPARK-30319?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-30319: Assignee: (was: Apache Spark) > Adds a stricter version of as[T] > --

[jira] [Assigned] (SPARK-30324) Simplify API for JSON access in DataFrames/SQL

2020-04-30 Thread Apache Spark (Jira)
[ https://issues.apache.org/jira/browse/SPARK-30324?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-30324: Assignee: (was: Apache Spark) > Simplify API for JSON access in DataFrames/SQL >

[jira] [Assigned] (SPARK-30461) details link when expanded should change the status from collapse to expand state

2020-04-30 Thread Apache Spark (Jira)
[ https://issues.apache.org/jira/browse/SPARK-30461?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-30461: Assignee: Apache Spark > details link when expanded should change the status from collaps

[jira] [Assigned] (SPARK-26346) Upgrade parquet to 1.11.1

2020-04-30 Thread Apache Spark (Jira)
[ https://issues.apache.org/jira/browse/SPARK-26346?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-26346: Assignee: Apache Spark > Upgrade parquet to 1.11.1 > - > >

[jira] [Assigned] (SPARK-25061) Spark SQL Thrift Server fails to not pick up hiveconf passing parameter

2020-04-30 Thread Apache Spark (Jira)
[ https://issues.apache.org/jira/browse/SPARK-25061?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-25061: Assignee: Apache Spark > Spark SQL Thrift Server fails to not pick up hiveconf passing p

[jira] [Assigned] (SPARK-29596) Task duration not updating for running tasks

2020-04-30 Thread Apache Spark (Jira)
[ https://issues.apache.org/jira/browse/SPARK-29596?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-29596: Assignee: (was: Apache Spark) > Task duration not updating for running tasks > --

[jira] [Assigned] (SPARK-30432) reduce degree recomputation in StronglyConnectedComponents

2020-04-30 Thread Apache Spark (Jira)
[ https://issues.apache.org/jira/browse/SPARK-30432?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-30432: Assignee: Apache Spark > reduce degree recomputation in StronglyConnectedComponents > ---

[jira] [Assigned] (SPARK-30352) DataSourceV2: Add CURRENT_CATALOG function

2020-04-30 Thread Apache Spark (Jira)
[ https://issues.apache.org/jira/browse/SPARK-30352?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-30352: Assignee: (was: Apache Spark) > DataSourceV2: Add CURRENT_CATALOG function >

[jira] [Assigned] (SPARK-30027) Support codegen for filter exprs in HashAggregateExec

2020-04-30 Thread Apache Spark (Jira)
[ https://issues.apache.org/jira/browse/SPARK-30027?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-30027: Assignee: (was: Apache Spark) > Support codegen for filter exprs in HashAggregateExec

[jira] [Assigned] (SPARK-30441) Improve the memory usage in StronglyConnectedComponents

2020-04-30 Thread Apache Spark (Jira)
[ https://issues.apache.org/jira/browse/SPARK-30441?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-30441: Assignee: Apache Spark > Improve the memory usage in StronglyConnectedComponents > --

[jira] [Assigned] (SPARK-30273) Add melt() function

2020-04-30 Thread Apache Spark (Jira)
[ https://issues.apache.org/jira/browse/SPARK-30273?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-30273: Assignee: Apache Spark > Add melt() function > --- > > Ke

[jira] [Assigned] (SPARK-20656) Incremental parsing of event logs in SHS

2020-04-30 Thread Apache Spark (Jira)
[ https://issues.apache.org/jira/browse/SPARK-20656?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-20656: Assignee: (was: Apache Spark) > Incremental parsing of event logs in SHS > --

[jira] [Assigned] (SPARK-30320) Insert overwrite to DataSource table with dynamic partition error when running multiple task attempts

2020-04-30 Thread Apache Spark (Jira)
[ https://issues.apache.org/jira/browse/SPARK-30320?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-30320: Assignee: Apache Spark > Insert overwrite to DataSource table with dynamic partition erro

[jira] [Assigned] (SPARK-30153) Extend data exchange options for vectorized UDF functions with vanilla Arrow serialization

2020-04-30 Thread Apache Spark (Jira)
[ https://issues.apache.org/jira/browse/SPARK-30153?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-30153: Assignee: (was: Apache Spark) > Extend data exchange options for vectorized UDF funct

[jira] [Assigned] (SPARK-20656) Incremental parsing of event logs in SHS

2020-04-30 Thread Apache Spark (Jira)
[ https://issues.apache.org/jira/browse/SPARK-20656?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-20656: Assignee: Apache Spark > Incremental parsing of event logs in SHS > -

[jira] [Assigned] (SPARK-30244) Emit pre/post events for "Partition" methods in ExternalCatalogWithListener

2020-04-30 Thread Apache Spark (Jira)
[ https://issues.apache.org/jira/browse/SPARK-30244?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-30244: Assignee: Apache Spark > Emit pre/post events for "Partition" methods in ExternalCatalogW

[jira] [Assigned] (SPARK-25061) Spark SQL Thrift Server fails to not pick up hiveconf passing parameter

2020-04-30 Thread Apache Spark (Jira)
[ https://issues.apache.org/jira/browse/SPARK-25061?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-25061: Assignee: (was: Apache Spark) > Spark SQL Thrift Server fails to not pick up hivecon

[jira] [Assigned] (SPARK-26346) Upgrade parquet to 1.11.1

2020-04-30 Thread Apache Spark (Jira)
[ https://issues.apache.org/jira/browse/SPARK-26346?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-26346: Assignee: (was: Apache Spark) > Upgrade parquet to 1.11.1 > -

[jira] [Assigned] (SPARK-30069) Clean up non-shuffle disk block manager files following executor exists on YARN

2020-04-30 Thread Apache Spark (Jira)
[ https://issues.apache.org/jira/browse/SPARK-30069?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-30069: Assignee: (was: Apache Spark) > Clean up non-shuffle disk block manager files followi

[jira] [Assigned] (SPARK-30334) Add metadata around semi-structured columns to Spark

2020-04-30 Thread Apache Spark (Jira)
[ https://issues.apache.org/jira/browse/SPARK-30334?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-30334: Assignee: (was: Apache Spark) > Add metadata around semi-structured columns to Spark

[jira] [Assigned] (SPARK-30352) DataSourceV2: Add CURRENT_CATALOG function

2020-04-30 Thread Apache Spark (Jira)
[ https://issues.apache.org/jira/browse/SPARK-30352?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-30352: Assignee: Apache Spark > DataSourceV2: Add CURRENT_CATALOG function > ---

[jira] [Assigned] (SPARK-30320) Insert overwrite to DataSource table with dynamic partition error when running multiple task attempts

2020-04-30 Thread Apache Spark (Jira)
[ https://issues.apache.org/jira/browse/SPARK-30320?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-30320: Assignee: (was: Apache Spark) > Insert overwrite to DataSource table with dynamic par

[jira] [Assigned] (SPARK-30191) AM should update pending resource request faster when driver lost executor

2020-04-30 Thread Apache Spark (Jira)
[ https://issues.apache.org/jira/browse/SPARK-30191?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-30191: Assignee: Apache Spark > AM should update pending resource request faster when driver los

[jira] [Assigned] (SPARK-30461) details link when expanded should change the status from collapse to expand state

2020-04-30 Thread Apache Spark (Jira)
[ https://issues.apache.org/jira/browse/SPARK-30461?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-30461: Assignee: (was: Apache Spark) > details link when expanded should change the status f

[jira] [Assigned] (SPARK-29037) [Core] Spark gives duplicate result when an application was killed and rerun

2020-04-30 Thread Apache Spark (Jira)
[ https://issues.apache.org/jira/browse/SPARK-29037?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-29037: Assignee: Apache Spark > [Core] Spark gives duplicate result when an application was kill

[jira] [Assigned] (SPARK-28148) repartition after join is not optimized away

2020-04-30 Thread Apache Spark (Jira)
[ https://issues.apache.org/jira/browse/SPARK-28148?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-28148: Assignee: Apache Spark > repartition after join is not optimized away > -

[jira] [Assigned] (SPARK-30324) Simplify API for JSON access in DataFrames/SQL

2020-04-30 Thread Apache Spark (Jira)
[ https://issues.apache.org/jira/browse/SPARK-30324?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-30324: Assignee: Apache Spark > Simplify API for JSON access in DataFrames/SQL > ---

[jira] [Assigned] (SPARK-30441) Improve the memory usage in StronglyConnectedComponents

2020-04-30 Thread Apache Spark (Jira)
[ https://issues.apache.org/jira/browse/SPARK-30441?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-30441: Assignee: (was: Apache Spark) > Improve the memory usage in StronglyConnectedComponen

[jira] [Assigned] (SPARK-30334) Add metadata around semi-structured columns to Spark

2020-04-30 Thread Apache Spark (Jira)
[ https://issues.apache.org/jira/browse/SPARK-30334?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-30334: Assignee: Apache Spark > Add metadata around semi-structured columns to Spark > -

[jira] [Assigned] (SPARK-30471) Fix issue when compare string and IntegerType

2020-04-30 Thread Apache Spark (Jira)
[ https://issues.apache.org/jira/browse/SPARK-30471?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-30471: Assignee: Apache Spark > Fix issue when compare string and IntegerType >

[jira] [Assigned] (SPARK-30273) Add melt() function

2020-04-30 Thread Apache Spark (Jira)
[ https://issues.apache.org/jira/browse/SPARK-30273?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-30273: Assignee: (was: Apache Spark) > Add melt() function > --- > >

[jira] [Assigned] (SPARK-30027) Support codegen for filter exprs in HashAggregateExec

2020-04-30 Thread Apache Spark (Jira)
[ https://issues.apache.org/jira/browse/SPARK-30027?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-30027: Assignee: Apache Spark > Support codegen for filter exprs in HashAggregateExec >

[jira] [Assigned] (SPARK-27495) SPIP: Support Stage level resource configuration and scheduling

2020-04-30 Thread Apache Spark (Jira)
[ https://issues.apache.org/jira/browse/SPARK-27495?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-27495: Assignee: Apache Spark (was: Thomas Graves) > SPIP: Support Stage level resource configu

[jira] [Assigned] (SPARK-31317) Add withField method to Column class

2020-04-30 Thread Apache Spark (Jira)
[ https://issues.apache.org/jira/browse/SPARK-31317?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-31317: Assignee: Apache Spark > Add withField method to Column class > -

[jira] [Assigned] (SPARK-27495) SPIP: Support Stage level resource configuration and scheduling

2020-04-30 Thread Apache Spark (Jira)
[ https://issues.apache.org/jira/browse/SPARK-27495?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-27495: Assignee: Thomas Graves (was: Apache Spark) > SPIP: Support Stage level resource configu

[jira] [Assigned] (SPARK-30087) Enhanced implementation of JmxSink on RMI remote calls.

2020-04-30 Thread Apache Spark (Jira)
[ https://issues.apache.org/jira/browse/SPARK-30087?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-30087: Assignee: Apache Spark > Enhanced implementation of JmxSink on RMI remote calls. > --

[jira] [Assigned] (SPARK-30427) Add config item for limiting partition number when calculating statistics through File System

2020-04-30 Thread Apache Spark (Jira)
[ https://issues.apache.org/jira/browse/SPARK-30427?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-30427: Assignee: Apache Spark > Add config item for limiting partition number when calculating s

[jira] [Assigned] (SPARK-30306) Instrument Python UDF execution time and metrics using Spark Metrics system

2020-04-30 Thread Apache Spark (Jira)
[ https://issues.apache.org/jira/browse/SPARK-30306?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-30306: Assignee: (was: Apache Spark) > Instrument Python UDF execution time and metrics usin

[jira] [Assigned] (SPARK-30432) reduce degree recomputation in StronglyConnectedComponents

2020-04-30 Thread Apache Spark (Jira)
[ https://issues.apache.org/jira/browse/SPARK-30432?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-30432: Assignee: (was: Apache Spark) > reduce degree recomputation in StronglyConnectedCompo

[jira] [Assigned] (SPARK-25065) Driver and executors pick the wrong logging configuration file.

2020-04-30 Thread Apache Spark (Jira)
[ https://issues.apache.org/jira/browse/SPARK-25065?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-25065: Assignee: Apache Spark > Driver and executors pick the wrong logging configuration file.

[jira] [Assigned] (SPARK-29965) Race in executor shutdown handling can lead to executor never fully unregistering

2020-04-30 Thread Apache Spark (Jira)
[ https://issues.apache.org/jira/browse/SPARK-29965?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-29965: Assignee: Apache Spark > Race in executor shutdown handling can lead to executor never fu

[jira] [Assigned] (SPARK-29302) dynamic partition overwrite with speculation enabled

2020-04-30 Thread Apache Spark (Jira)
[ https://issues.apache.org/jira/browse/SPARK-29302?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-29302: Assignee: Apache Spark > dynamic partition overwrite with speculation enabled > -

[jira] [Assigned] (SPARK-30033) Use Spark plugin support to manage shuffle plugin lifecycle

2020-04-30 Thread Apache Spark (Jira)
[ https://issues.apache.org/jira/browse/SPARK-30033?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-30033: Assignee: Apache Spark > Use Spark plugin support to manage shuffle plugin lifecycle > --

[jira] [Assigned] (SPARK-30055) Allow configurable restart policy of driver and executor pods

2020-04-30 Thread Apache Spark (Jira)
[ https://issues.apache.org/jira/browse/SPARK-30055?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-30055: Assignee: Apache Spark > Allow configurable restart policy of driver and executor pods >

[jira] [Assigned] (SPARK-28948) Support passing all Table metadata in TableProvider

2020-04-30 Thread Apache Spark (Jira)
[ https://issues.apache.org/jira/browse/SPARK-28948?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-28948: Assignee: Apache Spark (was: Wenchen Fan) > Support passing all Table metadata in TableP

[jira] [Assigned] (SPARK-30059) Stop AsyncEventQueue when interrupted in dispatch

2020-04-30 Thread Apache Spark (Jira)
[ https://issues.apache.org/jira/browse/SPARK-30059?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-30059: Assignee: (was: Apache Spark) > Stop AsyncEventQueue when interrupted in dispatch > -

[jira] [Assigned] (SPARK-29606) Improve EliminateOuterJoin performance

2020-04-30 Thread Apache Spark (Jira)
[ https://issues.apache.org/jira/browse/SPARK-29606?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-29606: Assignee: (was: Apache Spark) > Improve EliminateOuterJoin performance >

[jira] [Assigned] (SPARK-29563) CREATE TABLE LIKE should look up catalog/table like v2 commands

2020-04-30 Thread Apache Spark (Jira)
[ https://issues.apache.org/jira/browse/SPARK-29563?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-29563: Assignee: Dilip Biswal (was: Apache Spark) > CREATE TABLE LIKE should look up catalog/ta

[jira] [Assigned] (SPARK-29606) Improve EliminateOuterJoin performance

2020-04-30 Thread Apache Spark (Jira)
[ https://issues.apache.org/jira/browse/SPARK-29606?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-29606: Assignee: Apache Spark > Improve EliminateOuterJoin performance > ---

[jira] [Assigned] (SPARK-25351) Handle Pandas category type when converting from Python with Arrow

2020-04-30 Thread Apache Spark (Jira)
[ https://issues.apache.org/jira/browse/SPARK-25351?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-25351: Assignee: (was: Apache Spark) > Handle Pandas category type when converting from Pyth

[jira] [Assigned] (SPARK-30033) Use Spark plugin support to manage shuffle plugin lifecycle

2020-04-30 Thread Apache Spark (Jira)
[ https://issues.apache.org/jira/browse/SPARK-30033?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-30033: Assignee: (was: Apache Spark) > Use Spark plugin support to manage shuffle plugin lif

[jira] [Assigned] (SPARK-29965) Race in executor shutdown handling can lead to executor never fully unregistering

2020-04-30 Thread Apache Spark (Jira)
[ https://issues.apache.org/jira/browse/SPARK-29965?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-29965: Assignee: (was: Apache Spark) > Race in executor shutdown handling can lead to execut

[jira] [Assigned] (SPARK-29302) dynamic partition overwrite with speculation enabled

2020-04-30 Thread Apache Spark (Jira)
[ https://issues.apache.org/jira/browse/SPARK-29302?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-29302: Assignee: (was: Apache Spark) > dynamic partition overwrite with speculation enabled

[jira] [Assigned] (SPARK-29786) Fix MetaException when dropping a partition not exists on HDFS.

2020-04-30 Thread Apache Spark (Jira)
[ https://issues.apache.org/jira/browse/SPARK-29786?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-29786: Assignee: (was: Apache Spark) > Fix MetaException when dropping a partition not exist

[jira] [Assigned] (SPARK-29786) Fix MetaException when dropping a partition not exists on HDFS.

2020-04-30 Thread Apache Spark (Jira)
[ https://issues.apache.org/jira/browse/SPARK-29786?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-29786: Assignee: Apache Spark > Fix MetaException when dropping a partition not exists on HDFS.

[jira] [Assigned] (SPARK-25351) Handle Pandas category type when converting from Python with Arrow

2020-04-30 Thread Apache Spark (Jira)
[ https://issues.apache.org/jira/browse/SPARK-25351?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-25351: Assignee: Apache Spark > Handle Pandas category type when converting from Python with Arr

[jira] [Assigned] (SPARK-30059) Stop AsyncEventQueue when interrupted in dispatch

2020-04-30 Thread Apache Spark (Jira)
[ https://issues.apache.org/jira/browse/SPARK-30059?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-30059: Assignee: Apache Spark > Stop AsyncEventQueue when interrupted in dispatch >

[jira] [Assigned] (SPARK-29880) Handle submit exception when target hadoop cluster is Federation

2020-04-30 Thread Apache Spark (Jira)
[ https://issues.apache.org/jira/browse/SPARK-29880?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-29880: Assignee: (was: Apache Spark) > Handle submit exception when target hadoop cluster is

[jira] [Assigned] (SPARK-30055) Allow configurable restart policy of driver and executor pods

2020-04-30 Thread Apache Spark (Jira)
[ https://issues.apache.org/jira/browse/SPARK-30055?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-30055: Assignee: (was: Apache Spark) > Allow configurable restart policy of driver and execu

[jira] [Assigned] (SPARK-29594) Create a Dataset from a Sequence of Case class

2020-04-30 Thread Apache Spark (Jira)
[ https://issues.apache.org/jira/browse/SPARK-29594?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-29594: Assignee: (was: Apache Spark) > Create a Dataset from a Sequence of Case class >

[jira] [Assigned] (SPARK-29166) Add parameters to limit the number of dynamic partitions for data source table

2020-04-30 Thread Apache Spark (Jira)
[ https://issues.apache.org/jira/browse/SPARK-29166?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-29166: Assignee: (was: Apache Spark) > Add parameters to limit the number of dynamic partiti

[jira] [Assigned] (SPARK-29683) Job failed due to executor failures all available nodes are blacklisted

2020-04-30 Thread Apache Spark (Jira)
[ https://issues.apache.org/jira/browse/SPARK-29683?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-29683: Assignee: Apache Spark > Job failed due to executor failures all available nodes are blac

[jira] [Assigned] (SPARK-29880) Handle submit exception when target hadoop cluster is Federation

2020-04-30 Thread Apache Spark (Jira)
[ https://issues.apache.org/jira/browse/SPARK-29880?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-29880: Assignee: Apache Spark > Handle submit exception when target hadoop cluster is Federation

[jira] [Assigned] (SPARK-28659) insert overwrite directory using stored as parquet does not creates snappy.parquet data file at HDFS side

2020-04-30 Thread Apache Spark (Jira)
[ https://issues.apache.org/jira/browse/SPARK-28659?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-28659: Assignee: Apache Spark > insert overwrite directory using stored as parquet does not cre

[jira] [Assigned] (SPARK-28659) insert overwrite directory using stored as parquet does not creates snappy.parquet data file at HDFS side

2020-04-30 Thread Apache Spark (Jira)
[ https://issues.apache.org/jira/browse/SPARK-28659?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-28659: Assignee: (was: Apache Spark) > insert overwrite directory using stored as parquet d

[jira] [Assigned] (SPARK-28992) Support update dependencies from hdfs when task run on executor pods

2020-04-30 Thread Apache Spark (Jira)
[ https://issues.apache.org/jira/browse/SPARK-28992?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-28992: Assignee: Apache Spark > Support update dependencies from hdfs when task run on executor

[jira] [Assigned] (SPARK-29018) Build spark thrift server on it's own code based on protocol v11

2020-04-30 Thread Apache Spark (Jira)
[ https://issues.apache.org/jira/browse/SPARK-29018?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-29018: Assignee: Apache Spark > Build spark thrift server on it's own code based on protocol v11

[jira] [Assigned] (SPARK-29431) Improve Web UI / Sql tab visualization with cached dataframes.

2020-04-30 Thread Apache Spark (Jira)
[ https://issues.apache.org/jira/browse/SPARK-29431?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-29431: Assignee: Apache Spark > Improve Web UI / Sql tab visualization with cached dataframes. >

[jira] [Assigned] (SPARK-27736) Improve handling of FetchFailures caused by ExternalShuffleService losing track of executor registrations

2020-04-30 Thread Apache Spark (Jira)
[ https://issues.apache.org/jira/browse/SPARK-27736?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-27736: Assignee: Apache Spark > Improve handling of FetchFailures caused by ExternalShuffleServi

[jira] [Assigned] (SPARK-27936) Support local dependency uploading from --py-files

2020-04-30 Thread Apache Spark (Jira)
[ https://issues.apache.org/jira/browse/SPARK-27936?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-27936: Assignee: (was: Apache Spark) > Support local dependency uploading from --py-files >

[jira] [Assigned] (SPARK-29128) Split predicate code in OR expressions

2020-04-30 Thread Apache Spark (Jira)
[ https://issues.apache.org/jira/browse/SPARK-29128?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-29128: Assignee: Apache Spark > Split predicate code in OR expressions > ---

[jira] [Assigned] (SPARK-29128) Split predicate code in OR expressions

2020-04-30 Thread Apache Spark (Jira)
[ https://issues.apache.org/jira/browse/SPARK-29128?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-29128: Assignee: (was: Apache Spark) > Split predicate code in OR expressions >

[jira] [Assigned] (SPARK-29577) Implement p-value simulation and unit tests for chi2 test

2020-04-30 Thread Apache Spark (Jira)
[ https://issues.apache.org/jira/browse/SPARK-29577?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-29577: Assignee: (was: Apache Spark) > Implement p-value simulation and unit tests for chi2

[jira] [Assigned] (SPARK-27736) Improve handling of FetchFailures caused by ExternalShuffleService losing track of executor registrations

2020-04-30 Thread Apache Spark (Jira)
[ https://issues.apache.org/jira/browse/SPARK-27736?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-27736: Assignee: (was: Apache Spark) > Improve handling of FetchFailures caused by ExternalS

[jira] [Assigned] (SPARK-29166) Add parameters to limit the number of dynamic partitions for data source table

2020-04-30 Thread Apache Spark (Jira)
[ https://issues.apache.org/jira/browse/SPARK-29166?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-29166: Assignee: Apache Spark > Add parameters to limit the number of dynamic partitions for dat

[jira] [Assigned] (SPARK-28419) A patch for SparkThriftServer support multi-tenant authentication

2020-04-30 Thread Apache Spark (Jira)
[ https://issues.apache.org/jira/browse/SPARK-28419?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-28419: Assignee: Apache Spark > A patch for SparkThriftServer support multi-tenant authenticatio

[jira] [Assigned] (SPARK-29563) CREATE TABLE LIKE should look up catalog/table like v2 commands

2020-04-30 Thread Apache Spark (Jira)
[ https://issues.apache.org/jira/browse/SPARK-29563?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-29563: Assignee: Apache Spark (was: Dilip Biswal) > CREATE TABLE LIKE should look up catalog/ta

[jira] [Assigned] (SPARK-29594) Create a Dataset from a Sequence of Case class

2020-04-30 Thread Apache Spark (Jira)
[ https://issues.apache.org/jira/browse/SPARK-29594?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-29594: Assignee: Apache Spark > Create a Dataset from a Sequence of Case class > ---

<    1   2   3   4   >