[jira] [Created] (SPARK-21428) CliSessionState never be recognized because of IsolatedClientLoader

2017-07-16 Thread Kent Yao (JIRA)
Kent Yao created SPARK-21428: Summary: CliSessionState never be recognized because of IsolatedClientLoader Key: SPARK-21428 URL: https://issues.apache.org/jira/browse/SPARK-21428 Project: Spark

[jira] [Created] (SPARK-21449) Hive client's SessionState was not closed properly in HiveExternalCatalog

2017-07-17 Thread Kent Yao (JIRA)
Kent Yao created SPARK-21449: Summary: Hive client's SessionState was not closed properly in HiveExternalCatalog Key: SPARK-21449 URL: https://issues.apache.org/jira/browse/SPARK-21449 Project: Spark

[jira] [Created] (SPARK-21451) HiveConf in SparkSQLCLIDriver doesn't respect spark.hadoop.some.hive.variables

2017-07-17 Thread Kent Yao (JIRA)
Kent Yao created SPARK-21451: Summary: HiveConf in SparkSQLCLIDriver doesn't respect spark.hadoop.some.hive.variables Key: SPARK-21451 URL: https://issues.apache.org/jira/browse/SPARK-21451 Project: Spark

[jira] [Created] (SPARK-27183) YarnConfiguration in ApplicationMaster should be cluster-specific

2019-03-17 Thread Kent Yao (JIRA)
Kent Yao created SPARK-27183: Summary: YarnConfiguration in ApplicationMaster should be cluster-specific Key: SPARK-27183 URL: https://issues.apache.org/jira/browse/SPARK-27183 Project: Spark Is

[jira] [Created] (SPARK-27301) DStreamCheckpointData failed to clean up because it's fileSystem cached

2019-03-28 Thread Kent Yao (JIRA)
Kent Yao created SPARK-27301: Summary: DStreamCheckpointData failed to clean up because it's fileSystem cached Key: SPARK-27301 URL: https://issues.apache.org/jira/browse/SPARK-27301 Project: Spark

[jira] [Updated] (SPARK-27301) DStreamCheckpointData failed to clean up because it's fileSystem cached

2019-03-28 Thread Kent Yao (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-27301?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Kent Yao updated SPARK-27301: - Description: The cached FileSystem's token will expire if no tokens explicitly are add into it. {code:j

[jira] [Commented] (SPARK-34128) Suppress excessive logging of TTransportExceptions in Spark ThriftServer

2021-01-15 Thread Kent Yao (Jira)
[ https://issues.apache.org/jira/browse/SPARK-34128?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17266025#comment-17266025 ] Kent Yao commented on SPARK-34128: -- cc [~dongjoon] [~srowen] [~hyukjin.kwon] > Suppre

[jira] [Created] (SPARK-34130) Impove preformace for char varchar padding and length check with StaticInvoke

2021-01-15 Thread Kent Yao (Jira)
Kent Yao created SPARK-34130: Summary: Impove preformace for char varchar padding and length check with StaticInvoke Key: SPARK-34130 URL: https://issues.apache.org/jira/browse/SPARK-34130 Project: Spark

[jira] [Updated] (SPARK-34037) aggOrder should not be output as a auxiliary internal attribute

2021-01-15 Thread Kent Yao (Jira)
[ https://issues.apache.org/jira/browse/SPARK-34037?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Kent Yao updated SPARK-34037: - Description: The type-coercion for numeric types of average and sum is not necessary at all, as the res

[jira] [Updated] (SPARK-34037) aggOrder should not be output as a auxiliary internal attribute

2021-01-15 Thread Kent Yao (Jira)
[ https://issues.apache.org/jira/browse/SPARK-34037?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Kent Yao updated SPARK-34037: - Issue Type: Improvement (was: Bug) > aggOrder should not be output as a auxiliary internal attribute >

[jira] [Updated] (SPARK-34037) aggOrder should not be output as a auxiliary internal attribute

2021-01-15 Thread Kent Yao (Jira)
[ https://issues.apache.org/jira/browse/SPARK-34037?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Kent Yao updated SPARK-34037: - Priority: Major (was: Blocker) > aggOrder should not be output as a auxiliary internal attribute >

[jira] [Updated] (SPARK-34037) Remove unnecessary upcasting for Avg & Sum which handle by themself internally

2021-01-15 Thread Kent Yao (Jira)
[ https://issues.apache.org/jira/browse/SPARK-34037?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Kent Yao updated SPARK-34037: - Summary: Remove unnecessary upcasting for Avg & Sum which handle by themself internally (was: aggOrder

[jira] [Comment Edited] (SPARK-34037) Remove unnecessary upcasting for Avg & Sum which handle by themself internally

2021-01-15 Thread Kent Yao (Jira)
[ https://issues.apache.org/jira/browse/SPARK-34037?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17260270#comment-17260270 ] Kent Yao edited comment on SPARK-34037 at 1/15/21, 5:43 PM:

[jira] [Created] (SPARK-34164) Improve write side varchar check to visit only last few tailing spaces

2021-01-19 Thread Kent Yao (Jira)
Kent Yao created SPARK-34164: Summary: Improve write side varchar check to visit only last few tailing spaces Key: SPARK-34164 URL: https://issues.apache.org/jira/browse/SPARK-34164 Project: Spark

[jira] [Created] (SPARK-34188) Char varchar length check blocks CBO statistics

2021-01-20 Thread Kent Yao (Jira)
Kent Yao created SPARK-34188: Summary: Char varchar length check blocks CBO statistics Key: SPARK-34188 URL: https://issues.apache.org/jira/browse/SPARK-34188 Project: Spark Issue Type: Bug

[jira] [Updated] (SPARK-34188) Char varchar length check blocks CBO statistics

2021-01-20 Thread Kent Yao (Jira)
[ https://issues.apache.org/jira/browse/SPARK-34188?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Kent Yao updated SPARK-34188: - Attachment: screenshot-1.png > Char varchar length check blocks CBO statistics > ---

[jira] [Updated] (SPARK-34188) Char varchar length check blocks CBO statistics

2021-01-20 Thread Kent Yao (Jira)
[ https://issues.apache.org/jira/browse/SPARK-34188?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Kent Yao updated SPARK-34188: - Description: !screenshot-1.png! the char varchar length check changes the output by projection and t

[jira] [Created] (SPARK-34192) Move char padding to write side

2021-01-21 Thread Kent Yao (Jira)
Kent Yao created SPARK-34192: Summary: Move char padding to write side Key: SPARK-34192 URL: https://issues.apache.org/jira/browse/SPARK-34192 Project: Spark Issue Type: Improvement Com

[jira] [Created] (SPARK-34203) FileSource table null partition can not be dropped

2021-01-22 Thread Kent Yao (Jira)
Kent Yao created SPARK-34203: Summary: FileSource table null partition can not be dropped Key: SPARK-34203 URL: https://issues.apache.org/jira/browse/SPARK-34203 Project: Spark Issue Type: Bug

[jira] [Commented] (SPARK-34216) typeName of CalendarIntervalType changed from spark 2 to 3

2021-01-24 Thread Kent Yao (Jira)
[ https://issues.apache.org/jira/browse/SPARK-34216?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17271103#comment-17271103 ] Kent Yao commented on SPARK-34216: -- oh, I have been negligent. It's better we had a mig

[jira] [Updated] (SPARK-34192) Move char padding to write side

2021-01-24 Thread Kent Yao (Jira)
[ https://issues.apache.org/jira/browse/SPARK-34192?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Kent Yao updated SPARK-34192: - Description: On the read side, the char length check and padding bring issues to CBO and PPD and other

[jira] [Updated] (SPARK-34192) Move char padding to write side

2021-01-25 Thread Kent Yao (Jira)
[ https://issues.apache.org/jira/browse/SPARK-34192?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Kent Yao updated SPARK-34192: - Description: On the read side, the char length check and padding bring issues to CBO and PPD and other

[jira] [Created] (SPARK-34223) NPE for static partion with null in InsertIntoHadoopFsRelationCommand

2021-01-25 Thread Kent Yao (Jira)
Kent Yao created SPARK-34223: Summary: NPE for static partion with null in InsertIntoHadoopFsRelationCommand Key: SPARK-34223 URL: https://issues.apache.org/jira/browse/SPARK-34223 Project: Spark

[jira] [Created] (SPARK-34233) NPE for char padding in binary comparison

2021-01-25 Thread Kent Yao (Jira)
Kent Yao created SPARK-34233: Summary: NPE for char padding in binary comparison Key: SPARK-34233 URL: https://issues.apache.org/jira/browse/SPARK-34233 Project: Spark Issue Type: Bug C

[jira] [Created] (SPARK-34236) v2 Overwrite will null static partition raise Cannot translate expression to source filter: null

2021-01-25 Thread Kent Yao (Jira)
Kent Yao created SPARK-34236: Summary: v2 Overwrite will null static partition raise Cannot translate expression to source filter: null Key: SPARK-34236 URL: https://issues.apache.org/jira/browse/SPARK-34236

[jira] [Updated] (SPARK-34236) v2 Overwrite w/ null static partition raise Cannot translate expression to source filter: null

2021-01-25 Thread Kent Yao (Jira)
[ https://issues.apache.org/jira/browse/SPARK-34236?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Kent Yao updated SPARK-34236: - Summary: v2 Overwrite w/ null static partition raise Cannot translate expression to source filter: null

[jira] [Created] (SPARK-34346) io.file.buffer.size set by spark.buffer.size will override by hive-site.xml may cause perf regression

2021-02-03 Thread Kent Yao (Jira)
Kent Yao created SPARK-34346: Summary: io.file.buffer.size set by spark.buffer.size will override by hive-site.xml may cause perf regression Key: SPARK-34346 URL: https://issues.apache.org/jira/browse/SPARK-34346

[jira] [Created] (SPARK-34373) HiveThriftServer2 startWithContext may hang with a race issue

2021-02-04 Thread Kent Yao (Jira)
Kent Yao created SPARK-34373: Summary: HiveThriftServer2 startWithContext may hang with a race issue Key: SPARK-34373 URL: https://issues.apache.org/jira/browse/SPARK-34373 Project: Spark Issue

[jira] [Updated] (SPARK-34376) Support regexp as function

2021-02-05 Thread Kent Yao (Jira)
[ https://issues.apache.org/jira/browse/SPARK-34376?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Kent Yao updated SPARK-34376: - Issue Type: New Feature (was: Bug) > Support regexp as function > -- > >

[jira] [Created] (SPARK-34376) Support regexp as function

2021-02-05 Thread Kent Yao (Jira)
Kent Yao created SPARK-34376: Summary: Support regexp as function Key: SPARK-34376 URL: https://issues.apache.org/jira/browse/SPARK-34376 Project: Spark Issue Type: Bug Components: SQL

[jira] [Updated] (SPARK-34376) Support regexp as a function

2021-02-05 Thread Kent Yao (Jira)
[ https://issues.apache.org/jira/browse/SPARK-34376?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Kent Yao updated SPARK-34376: - Summary: Support regexp as a function (was: Support regexp as function) > Support regexp as a function

[jira] [Updated] (SPARK-34376) Support regexp as a function

2021-02-05 Thread Kent Yao (Jira)
[ https://issues.apache.org/jira/browse/SPARK-34376?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Kent Yao updated SPARK-34376: - Description: We have equality in SqlBase.g4 for RLIKE: 'RLIKE' | 'REGEXP'; We seemed to miss adding REGE

[jira] [Created] (SPARK-34522) Issue Tracker for JDK related Bugs

2021-02-24 Thread Kent Yao (Jira)
Kent Yao created SPARK-34522: Summary: Issue Tracker for JDK related Bugs Key: SPARK-34522 URL: https://issues.apache.org/jira/browse/SPARK-34522 Project: Spark Issue Type: Documentation

[jira] [Updated] (SPARK-34523) JDK-8194653

2021-02-24 Thread Kent Yao (Jira)
[ https://issues.apache.org/jira/browse/SPARK-34523?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Kent Yao updated SPARK-34523: - Attachment: 4303.log > JDK-8194653 > --- > > Key: SPARK-34523 >

[jira] [Updated] (SPARK-34523) JDK-8194653: Deadlock involving FileSystems.getDefault and System.loadLibrary call

2021-02-24 Thread Kent Yao (Jira)
[ https://issues.apache.org/jira/browse/SPARK-34523?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Kent Yao updated SPARK-34523: - Summary: JDK-8194653: Deadlock involving FileSystems.getDefault and System.loadLibrary call (was: JDK-

[jira] [Updated] (SPARK-34523) JDK-8194653: JDK-8194653 Deadlock involving FileSystems.getDefault and System.loadLibrary call

2021-02-24 Thread Kent Yao (Jira)
[ https://issues.apache.org/jira/browse/SPARK-34523?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Kent Yao updated SPARK-34523: - Summary: JDK-8194653: JDK-8194653 Deadlock involving FileSystems.getDefault and System.loadLibrary call

[jira] [Resolved] (SPARK-34523) JDK-8194653: Deadlock involving FileSystems.getDefault and System.loadLibrary call

2021-02-24 Thread Kent Yao (Jira)
[ https://issues.apache.org/jira/browse/SPARK-34523?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Kent Yao resolved SPARK-34523. -- Resolution: Information Provided > JDK-8194653: Deadlock involving FileSystems.getDefault and > Syst

[jira] [Created] (SPARK-34523) JDK-8194653

2021-02-24 Thread Kent Yao (Jira)
Kent Yao created SPARK-34523: Summary: JDK-8194653 Key: SPARK-34523 URL: https://issues.apache.org/jira/browse/SPARK-34523 Project: Spark Issue Type: Sub-task Components: Spark Core

[jira] [Updated] (SPARK-34523) JDK-8194653: Deadlock involving FileSystems.getDefault and System.loadLibrary call

2021-02-24 Thread Kent Yao (Jira)
[ https://issues.apache.org/jira/browse/SPARK-34523?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Kent Yao updated SPARK-34523: - Attachment: screenshot-1.png > JDK-8194653: Deadlock involving FileSystems.getDefault and > System.loa

[jira] [Updated] (SPARK-34523) JDK-8194653: Deadlock involving FileSystems.getDefault and System.loadLibrary call

2021-02-24 Thread Kent Yao (Jira)
[ https://issues.apache.org/jira/browse/SPARK-34523?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Kent Yao updated SPARK-34523: - Description: This will cause deadlock and hangs concurrent tasks forever on the same executor. for exam

[jira] [Updated] (SPARK-34523) JDK-8194653: Deadlock involving FileSystems.getDefault and System.loadLibrary call

2021-02-24 Thread Kent Yao (Jira)
[ https://issues.apache.org/jira/browse/SPARK-34523?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Kent Yao updated SPARK-34523: - Attachment: screenshot-2.png > JDK-8194653: Deadlock involving FileSystems.getDefault and > System.loa

[jira] [Updated] (SPARK-34523) JDK-8194653: Deadlock involving FileSystems.getDefault and System.loadLibrary call

2021-02-24 Thread Kent Yao (Jira)
[ https://issues.apache.org/jira/browse/SPARK-34523?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Kent Yao updated SPARK-34523: - Description: This will cause deadlock and hangs concurrent tasks forever on the same executor. for exam

[jira] [Updated] (SPARK-34523) JDK-8194653: Deadlock involving FileSystems.getDefault and System.loadLibrary call

2021-02-24 Thread Kent Yao (Jira)
[ https://issues.apache.org/jira/browse/SPARK-34523?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Kent Yao updated SPARK-34523: - Description: This will cause deadlock and hangs concurrent tasks forever on the same executor. for exam

[jira] [Updated] (SPARK-34523) JDK-8194653: Deadlock involving FileSystems.getDefault and System.loadLibrary call

2021-02-24 Thread Kent Yao (Jira)
[ https://issues.apache.org/jira/browse/SPARK-34523?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Kent Yao updated SPARK-34523: - Description: h2. Instruction This will cause deadlock and hangs concurrent tasks forever on the same e

[jira] [Updated] (SPARK-34523) JDK-8194653: Deadlock involving FileSystems.getDefault and System.loadLibrary call

2021-02-24 Thread Kent Yao (Jira)
[ https://issues.apache.org/jira/browse/SPARK-34523?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Kent Yao updated SPARK-34523: - Description: h2. Instruction This will cause deadlock and hangs concurrent tasks forever on the same e

[jira] [Commented] (SPARK-34523) JDK-8194653: Deadlock involving FileSystems.getDefault and System.loadLibrary call

2021-02-24 Thread Kent Yao (Jira)
[ https://issues.apache.org/jira/browse/SPARK-34523?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17290631#comment-17290631 ] Kent Yao commented on SPARK-34523: -- Hi [~dongjoon], thanks for your suggestions. When

[jira] [Comment Edited] (SPARK-34523) JDK-8194653: Deadlock involving FileSystems.getDefault and System.loadLibrary call

2021-02-24 Thread Kent Yao (Jira)
[ https://issues.apache.org/jira/browse/SPARK-34523?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17290631#comment-17290631 ] Kent Yao edited comment on SPARK-34523 at 2/25/21, 2:56 AM:

[jira] [Created] (SPARK-34558) warehouse path should be resolved ahead of populating and use

2021-02-26 Thread Kent Yao (Jira)
Kent Yao created SPARK-34558: Summary: warehouse path should be resolved ahead of populating and use Key: SPARK-34558 URL: https://issues.apache.org/jira/browse/SPARK-34558 Project: Spark Issue

[jira] [Created] (SPARK-34570) Remove dead code from constructors of [Hive]SessionStateBuilder

2021-02-28 Thread Kent Yao (Jira)
Kent Yao created SPARK-34570: Summary: Remove dead code from constructors of [Hive]SessionStateBuilder Key: SPARK-34570 URL: https://issues.apache.org/jira/browse/SPARK-34570 Project: Spark Issu

[jira] [Updated] (SPARK-34570) Remove dead code from constructors of [Hive]SessionStateBuilder

2021-02-28 Thread Kent Yao (Jira)
[ https://issues.apache.org/jira/browse/SPARK-34570?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Kent Yao updated SPARK-34570: - Issue Type: Improvement (was: Bug) > Remove dead code from constructors of [Hive]SessionStateBuilder >

[jira] [Created] (SPARK-34710) Add isView for SHOW TABLES to distinguish view and tables

2021-03-10 Thread Kent Yao (Jira)
Kent Yao created SPARK-34710: Summary: Add isView for SHOW TABLES to distinguish view and tables Key: SPARK-34710 URL: https://issues.apache.org/jira/browse/SPARK-34710 Project: Spark Issue Type:

[jira] [Resolved] (SPARK-34188) Char varchar length check blocks CBO statistics

2021-03-12 Thread Kent Yao (Jira)
[ https://issues.apache.org/jira/browse/SPARK-34188?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Kent Yao resolved SPARK-34188. -- Resolution: Not A Problem applied another solution, not a problem anymore > Char varchar length check

[jira] [Commented] (SPARK-34128) Suppress excessive logging of TTransportExceptions in Spark ThriftServer

2021-03-13 Thread Kent Yao (Jira)
[ https://issues.apache.org/jira/browse/SPARK-34128?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17300862#comment-17300862 ] Kent Yao commented on SPARK-34128: -- Unfortunately, I tried the newly released `libthrif

[jira] [Updated] (SPARK-34710) Add tableType for SHOW TABLES to distinguish view and tables

2021-03-13 Thread Kent Yao (Jira)
[ https://issues.apache.org/jira/browse/SPARK-34710?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Kent Yao updated SPARK-34710: - Summary: Add tableType for SHOW TABLES to distinguish view and tables (was: Add isView for SHOW TABLES

[jira] [Updated] (SPARK-33944) Incorrect logging for warehouse keys in SharedState options

2021-03-13 Thread Kent Yao (Jira)
[ https://issues.apache.org/jira/browse/SPARK-33944?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Kent Yao updated SPARK-33944: - Description: While using SparkSession's initial options to generate the sharable Spark conf and Hadoop c

[jira] [Assigned] (SPARK-34766) Do not capture maven config for views

2021-03-17 Thread Kent Yao (Jira)
[ https://issues.apache.org/jira/browse/SPARK-34766?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Kent Yao reassigned SPARK-34766: Assignee: ulysses you > Do not capture maven config for views > -

[jira] [Resolved] (SPARK-34766) Do not capture maven config for views

2021-03-17 Thread Kent Yao (Jira)
[ https://issues.apache.org/jira/browse/SPARK-34766?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Kent Yao resolved SPARK-34766. -- Fix Version/s: 3.2.0 Resolution: Fixed Issue resolved by pull request 31856 [https://github.com

[jira] [Commented] (SPARK-34786) read parquet uint64 as decimal

2021-03-18 Thread Kent Yao (Jira)
[ https://issues.apache.org/jira/browse/SPARK-34786?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17304136#comment-17304136 ] Kent Yao commented on SPARK-34786: -- I'd like to do this. > read parquet uint64 as deci

[jira] [Assigned] (SPARK-34760) run JavaSQLDataSourceExample failed with Exception in runBasicDataSourceExample().

2021-03-18 Thread Kent Yao (Jira)
[ https://issues.apache.org/jira/browse/SPARK-34760?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Kent Yao reassigned SPARK-34760: Assignee: zengrui > run JavaSQLDataSourceExample failed with Exception in > runBasicDataSourceEx

[jira] [Resolved] (SPARK-34760) run JavaSQLDataSourceExample failed with Exception in runBasicDataSourceExample().

2021-03-18 Thread Kent Yao (Jira)
[ https://issues.apache.org/jira/browse/SPARK-34760?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Kent Yao resolved SPARK-34760. -- Fix Version/s: 3.0.3 3.1.2 3.2.0 Resolution: Fixed Issue

[jira] [Created] (SPARK-34816) Support for Parquet unsigned LogicalTypes

2021-03-21 Thread Kent Yao (Jira)
Kent Yao created SPARK-34816: Summary: Support for Parquet unsigned LogicalTypes Key: SPARK-34816 URL: https://issues.apache.org/jira/browse/SPARK-34816 Project: Spark Issue Type: Improvement

[jira] [Updated] (SPARK-34786) read parquet uint64 as decimal

2021-03-21 Thread Kent Yao (Jira)
[ https://issues.apache.org/jira/browse/SPARK-34786?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Kent Yao updated SPARK-34786: - Parent: SPARK-34816 Issue Type: Sub-task (was: Improvement) > read parquet uint64 as decimal >

[jira] [Updated] (SPARK-34816) Support for Parquet unsigned LogicalTypes

2021-03-21 Thread Kent Yao (Jira)
[ https://issues.apache.org/jira/browse/SPARK-34816?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Kent Yao updated SPARK-34816: - Description: Parquet supports some unsigned datatypes. Here is the definition related in parquet.thrif

[jira] [Created] (SPARK-34817) read parquet uint8/16/32 logical types

2021-03-21 Thread Kent Yao (Jira)
Kent Yao created SPARK-34817: Summary: read parquet uint8/16/32 logical types Key: SPARK-34817 URL: https://issues.apache.org/jira/browse/SPARK-34817 Project: Spark Issue Type: Sub-task

[jira] [Commented] (SPARK-34852) Close Hive session state should use withHiveState

2021-03-24 Thread Kent Yao (Jira)
[ https://issues.apache.org/jira/browse/SPARK-34852?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17308295#comment-17308295 ] Kent Yao commented on SPARK-34852: -- Issue fixed by https://github.com/apache/spark/pull

[jira] [Resolved] (SPARK-34852) Close Hive session state should use withHiveState

2021-03-24 Thread Kent Yao (Jira)
[ https://issues.apache.org/jira/browse/SPARK-34852?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Kent Yao resolved SPARK-34852. -- Fix Version/s: 3.2.0 Assignee: ulysses you Resolution: Fixed > Close Hive session stat

[jira] [Assigned] (SPARK-34786) read parquet uint64 as decimal

2021-03-25 Thread Kent Yao (Jira)
[ https://issues.apache.org/jira/browse/SPARK-34786?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Kent Yao reassigned SPARK-34786: Assignee: Kent Yao > read parquet uint64 as decimal > -- > >

[jira] [Resolved] (SPARK-34786) read parquet uint64 as decimal

2021-03-25 Thread Kent Yao (Jira)
[ https://issues.apache.org/jira/browse/SPARK-34786?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Kent Yao resolved SPARK-34786. -- Fix Version/s: 3.2.0 Resolution: Fixed Issue resolved by pull request 31960 [https://github.com

[jira] [Assigned] (SPARK-34816) Support for Parquet unsigned LogicalTypes

2021-03-25 Thread Kent Yao (Jira)
[ https://issues.apache.org/jira/browse/SPARK-34816?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Kent Yao reassigned SPARK-34816: Assignee: Kent Yao > Support for Parquet unsigned LogicalTypes >

[jira] [Resolved] (SPARK-34816) Support for Parquet unsigned LogicalTypes

2021-03-25 Thread Kent Yao (Jira)
[ https://issues.apache.org/jira/browse/SPARK-34816?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Kent Yao resolved SPARK-34816. -- Fix Version/s: 3.2.0 Resolution: Fixed > Support for Parquet unsigned LogicalTypes > --

[jira] [Assigned] (SPARK-34744) Improve error message for casting cause overflow error

2021-03-26 Thread Kent Yao (Jira)
[ https://issues.apache.org/jira/browse/SPARK-34744?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Kent Yao reassigned SPARK-34744: Assignee: Apache Spark > Improve error message for casting cause overflow error > ---

[jira] [Resolved] (SPARK-34744) Improve error message for casting cause overflow error

2021-03-26 Thread Kent Yao (Jira)
[ https://issues.apache.org/jira/browse/SPARK-34744?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Kent Yao resolved SPARK-34744. -- Fix Version/s: 3.2.0 Resolution: Fixed Issue resolved by pull request 31971 [https://github.com

[jira] [Assigned] (SPARK-34744) Improve error message for casting cause overflow error

2021-03-26 Thread Kent Yao (Jira)
[ https://issues.apache.org/jira/browse/SPARK-34744?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Kent Yao reassigned SPARK-34744: Assignee: angerszhu (was: Apache Spark) > Improve error message for casting cause overflow error

[jira] [Created] (SPARK-34894) Use 'io.connectionTimeout' as a hint instead of `spark.network.timeout`

2021-03-28 Thread Kent Yao (Jira)
Kent Yao created SPARK-34894: Summary: Use 'io.connectionTimeout' as a hint instead of `spark.network.timeout` Key: SPARK-34894 URL: https://issues.apache.org/jira/browse/SPARK-34894 Project: Spark

[jira] [Resolved] (SPARK-34894) Use 'io.connectionTimeout' as a hint instead of `spark.network.timeout`

2021-03-29 Thread Kent Yao (Jira)
[ https://issues.apache.org/jira/browse/SPARK-34894?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Kent Yao resolved SPARK-34894. -- Fix Version/s: 3.2.0 Resolution: Fixed Issue resolved by pull request 31990 [https://github.com

[jira] [Assigned] (SPARK-34894) Use 'io.connectionTimeout' as a hint instead of `spark.network.timeout`

2021-03-29 Thread Kent Yao (Jira)
[ https://issues.apache.org/jira/browse/SPARK-34894?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Kent Yao reassigned SPARK-34894: Assignee: Kent Yao > Use 'io.connectionTimeout' as a hint instead of `spark.network.timeout` > --

[jira] [Created] (SPARK-34908) Add test cases for char and varchar with functions

2021-03-30 Thread Kent Yao (Jira)
Kent Yao created SPARK-34908: Summary: Add test cases for char and varchar with functions Key: SPARK-34908 URL: https://issues.apache.org/jira/browse/SPARK-34908 Project: Spark Issue Type: Improv

[jira] [Updated] (SPARK-34908) Add test cases for char and varchar with functions

2021-03-30 Thread Kent Yao (Jira)
[ https://issues.apache.org/jira/browse/SPARK-34908?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Kent Yao updated SPARK-34908: - Priority: Minor (was: Major) > Add test cases for char and varchar with functions > ---

[jira] [Created] (SPARK-34935) CREATE TABLE LIKE should respect the reserved properties of tables

2021-04-01 Thread Kent Yao (Jira)
Kent Yao created SPARK-34935: Summary: CREATE TABLE LIKE should respect the reserved properties of tables Key: SPARK-34935 URL: https://issues.apache.org/jira/browse/SPARK-34935 Project: Spark I

[jira] [Assigned] (SPARK-37098) Alter table properties should invalidate cache

2021-10-25 Thread Kent Yao (Jira)
[ https://issues.apache.org/jira/browse/SPARK-37098?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Kent Yao reassigned SPARK-37098: Assignee: XiDuo You > Alter table properties should invalidate cache > --

[jira] [Resolved] (SPARK-37098) Alter table properties should invalidate cache

2021-10-25 Thread Kent Yao (Jira)
[ https://issues.apache.org/jira/browse/SPARK-37098?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Kent Yao resolved SPARK-37098. -- Fix Version/s: 3.3.0 3.2.1 3.1.3 Resolution: Fixed > Alte

[jira] [Commented] (SPARK-37098) Alter table properties should invalidate cache

2021-10-25 Thread Kent Yao (Jira)
[ https://issues.apache.org/jira/browse/SPARK-37098?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17433614#comment-17433614 ] Kent Yao commented on SPARK-37098: -- Issuse resolved by [https://github.com/apache/spark

[jira] [Updated] (SPARK-37098) Alter table properties should invalidate cache

2021-10-25 Thread Kent Yao (Jira)
[ https://issues.apache.org/jira/browse/SPARK-37098?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Kent Yao updated SPARK-37098: - Fix Version/s: (was: 3.1.3) > Alter table properties should invalidate cache > -

[jira] [Created] (SPARK-37215) Support Application Timeouts on YARN

2021-11-05 Thread Kent Yao (Jira)
Kent Yao created SPARK-37215: Summary: Support Application Timeouts on YARN Key: SPARK-37215 URL: https://issues.apache.org/jira/browse/SPARK-37215 Project: Spark Issue Type: Improvement

[jira] [Created] (SPARK-37452) Char and Varchar breaks backward compatibility between v3 and v2

2021-11-24 Thread Kent Yao (Jira)
Kent Yao created SPARK-37452: Summary: Char and Varchar breaks backward compatibility between v3 and v2 Key: SPARK-37452 URL: https://issues.apache.org/jira/browse/SPARK-37452 Project: Spark Iss

[jira] [Created] (SPARK-37481) Disappearance of skipped stages mislead the bug hunting

2021-11-28 Thread Kent Yao (Jira)
Kent Yao created SPARK-37481: Summary: Disappearance of skipped stages mislead the bug hunting Key: SPARK-37481 URL: https://issues.apache.org/jira/browse/SPARK-37481 Project: Spark Issue Type:

[jira] [Updated] (SPARK-37481) Disappearance of skipped stages mislead the bug hunting

2021-11-28 Thread Kent Yao (Jira)
[ https://issues.apache.org/jira/browse/SPARK-37481?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Kent Yao updated SPARK-37481: - Description: # ## With FetchFailedException and Map Stage Retries When rerunning spark-sql shell with

[jira] [Assigned] (SPARK-37452) Char and Varchar breaks backward compatibility between v3 and v2

2021-11-29 Thread Kent Yao (Jira)
[ https://issues.apache.org/jira/browse/SPARK-37452?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Kent Yao reassigned SPARK-37452: Assignee: Kent Yao > Char and Varchar breaks backward compatibility between v3 and v2 > -

[jira] [Resolved] (SPARK-37452) Char and Varchar breaks backward compatibility between v3 and v2

2021-11-29 Thread Kent Yao (Jira)
[ https://issues.apache.org/jira/browse/SPARK-37452?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Kent Yao resolved SPARK-37452. -- Fix Version/s: 3.2.1 3.3.0 Resolution: Fixed Issue resolved by https://githu

[jira] [Created] (SPARK-37530) Spark reads many paths very slow though newAPIHadoopFile

2021-12-02 Thread Kent Yao (Jira)
Kent Yao created SPARK-37530: Summary: Spark reads many paths very slow though newAPIHadoopFile Key: SPARK-37530 URL: https://issues.apache.org/jira/browse/SPARK-37530 Project: Spark Issue Type:

[jira] [Created] (SPARK-37532) RDD name could be very long and memory costly

2021-12-02 Thread Kent Yao (Jira)
Kent Yao created SPARK-37532: Summary: RDD name could be very long and memory costly Key: SPARK-37532 URL: https://issues.apache.org/jira/browse/SPARK-37532 Project: Spark Issue Type: Improvement

[jira] [Assigned] (SPARK-37530) Spark reads many paths very slow though newAPIHadoopFile

2021-12-03 Thread Kent Yao (Jira)
[ https://issues.apache.org/jira/browse/SPARK-37530?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Kent Yao reassigned SPARK-37530: Assignee: Kent Yao > Spark reads many paths very slow though newAPIHadoopFile > -

[jira] [Resolved] (SPARK-37530) Spark reads many paths very slow though newAPIHadoopFile

2021-12-03 Thread Kent Yao (Jira)
[ https://issues.apache.org/jira/browse/SPARK-37530?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Kent Yao resolved SPARK-37530. -- Fix Version/s: 3.3.0 Resolution: Fixed Issue resolved by pull request 34792 [https://github.com

[jira] [Resolved] (SPARK-35414) Completely fix the broadcast timeout issue in AQE

2021-12-10 Thread Kent Yao (Jira)
[ https://issues.apache.org/jira/browse/SPARK-35414?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Kent Yao resolved SPARK-35414. -- Target Version/s: 3.2.0 Assignee: (was: Yu Zhong) Resolution: Duplicate AQE

[jira] [Created] (SPARK-37661) SparkSQLCLIDriver will use hive defaults to resolve warehouse dir

2021-12-16 Thread Kent Yao (Jira)
Kent Yao created SPARK-37661: Summary: SparkSQLCLIDriver will use hive defaults to resolve warehouse dir Key: SPARK-37661 URL: https://issues.apache.org/jira/browse/SPARK-37661 Project: Spark Is

[jira] [Commented] (SPARK-38587) Validating new location for rename command should use formatted names

2022-03-23 Thread Kent Yao (Jira)
[ https://issues.apache.org/jira/browse/SPARK-38587?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17511152#comment-17511152 ] Kent Yao commented on SPARK-38587: -- resolved by https://github.com/apache/spark/pull/35

[jira] [Resolved] (SPARK-38587) Validating new location for rename command should use formatted names

2022-03-23 Thread Kent Yao (Jira)
[ https://issues.apache.org/jira/browse/SPARK-38587?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Kent Yao resolved SPARK-38587. -- Fix Version/s: 3.1.3 3.0.4 3.3.0 3.2.2

[jira] [Commented] (SPARK-38631) Arbitrary shell command injection via Utils.unpack()

2022-03-25 Thread Kent Yao (Jira)
[ https://issues.apache.org/jira/browse/SPARK-38631?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17512296#comment-17512296 ] Kent Yao commented on SPARK-38631: -- [~hyukjin.kwon] Hi, shall we update the fixed versi

[jira] [Commented] (SPARK-38695) ORC can not surport the dataType,such as char or varchar

2022-03-31 Thread Kent Yao (Jira)
[ https://issues.apache.org/jira/browse/SPARK-38695?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17515222#comment-17515222 ] Kent Yao commented on SPARK-38695: -- do you see this error in spark 3.2.1 too? It shall

[jira] [Resolved] (SPARK-38695) ORC can not surport the dataType,such as char or varchar

2022-03-31 Thread Kent Yao (Jira)
[ https://issues.apache.org/jira/browse/SPARK-38695?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Kent Yao resolved SPARK-38695. -- Resolution: Duplicate This issue has been resolved and duplicated, I will close it. Feel free to reop

  1   2   3   4   5   6   7   8   9   10   >