[jira] [Created] (SPARK-49211) V2 Catalog can also support built-in data sources

2024-08-12 Thread Rui Wang (Jira)
Rui Wang created SPARK-49211: Summary: V2 Catalog can also support built-in data sources Key: SPARK-49211 URL: https://issues.apache.org/jira/browse/SPARK-49211 Project: Spark Issue Type: Improve

[jira] [Updated] (SPARK-49152) V2SessionCatalog should use V2Command

2024-08-08 Thread Rui Wang (Jira)
[ https://issues.apache.org/jira/browse/SPARK-49152?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Rui Wang updated SPARK-49152: - Summary: V2SessionCatalog should use V2Command (was: V2SessionCatalog should use V2Command when possibl

[jira] [Created] (SPARK-49152) V2SessionCatalog should use V2Command when possible

2024-08-07 Thread Rui Wang (Jira)
Rui Wang created SPARK-49152: Summary: V2SessionCatalog should use V2Command when possible Key: SPARK-49152 URL: https://issues.apache.org/jira/browse/SPARK-49152 Project: Spark Issue Type: Impro

[jira] [Created] (SPARK-49099) Refactor CatalogManager.setCurrentNamespace

2024-08-02 Thread Rui Wang (Jira)
Rui Wang created SPARK-49099: Summary: Refactor CatalogManager.setCurrentNamespace Key: SPARK-49099 URL: https://issues.apache.org/jira/browse/SPARK-49099 Project: Spark Issue Type: Improvement

[jira] [Created] (SPARK-48790) Use checkDatasetUnorderly in DeprecatedDatasetAggregatorSuite

2024-07-02 Thread Rui Wang (Jira)
Rui Wang created SPARK-48790: Summary: Use checkDatasetUnorderly in DeprecatedDatasetAggregatorSuite Key: SPARK-48790 URL: https://issues.apache.org/jira/browse/SPARK-48790 Project: Spark Issue

[jira] [Created] (SPARK-48773) Document config "spark.default.parallelism"

2024-07-01 Thread Rui Wang (Jira)
Rui Wang created SPARK-48773: Summary: Document config "spark.default.parallelism" Key: SPARK-48773 URL: https://issues.apache.org/jira/browse/SPARK-48773 Project: Spark Issue Type: Improvement

[jira] [Created] (SPARK-48512) Refactor Python tests

2024-06-03 Thread Rui Wang (Jira)
Rui Wang created SPARK-48512: Summary: Refactor Python tests Key: SPARK-48512 URL: https://issues.apache.org/jira/browse/SPARK-48512 Project: Spark Issue Type: Sub-task Components: PySp

[jira] [Created] (SPARK-48491) Refactor HiveWindowFunctionQuerySuite in BeforeAll and AfterAll

2024-05-31 Thread Rui Wang (Jira)
Rui Wang created SPARK-48491: Summary: Refactor HiveWindowFunctionQuerySuite in BeforeAll and AfterAll Key: SPARK-48491 URL: https://issues.apache.org/jira/browse/SPARK-48491 Project: Spark Issu

[jira] [Updated] (SPARK-48477) Refactor CollationSuite, CoalesceShufflePartitionsSuite, SQLExecutionSuite

2024-05-30 Thread Rui Wang (Jira)
[ https://issues.apache.org/jira/browse/SPARK-48477?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Rui Wang updated SPARK-48477: - Summary: Refactor CollationSuite, CoalesceShufflePartitionsSuite, SQLExecutionSuite (was: Refactor Coll

[jira] [Created] (SPARK-48477) Refactor CollationSuite, CoalesceShufflePartitionsSuite, SQLExecutionSuite, HivePlanTest

2024-05-30 Thread Rui Wang (Jira)
Rui Wang created SPARK-48477: Summary: Refactor CollationSuite, CoalesceShufflePartitionsSuite, SQLExecutionSuite, HivePlanTest Key: SPARK-48477 URL: https://issues.apache.org/jira/browse/SPARK-48477 Proj

[jira] [Created] (SPARK-48464) Refactor SQLConfSuite and StatisticsSuite

2024-05-29 Thread Rui Wang (Jira)
Rui Wang created SPARK-48464: Summary: Refactor SQLConfSuite and StatisticsSuite Key: SPARK-48464 URL: https://issues.apache.org/jira/browse/SPARK-48464 Project: Spark Issue Type: Sub-task

[jira] [Created] (SPARK-48462) Refactor HiveQuerySuite.scala and HiveTableScanSuite

2024-05-29 Thread Rui Wang (Jira)
Rui Wang created SPARK-48462: Summary: Refactor HiveQuerySuite.scala and HiveTableScanSuite Key: SPARK-48462 URL: https://issues.apache.org/jira/browse/SPARK-48462 Project: Spark Issue Type: Sub-

[jira] [Created] (SPARK-48444) Refactor SQLQuerySuite

2024-05-28 Thread Rui Wang (Jira)
Rui Wang created SPARK-48444: Summary: Refactor SQLQuerySuite Key: SPARK-48444 URL: https://issues.apache.org/jira/browse/SPARK-48444 Project: Spark Issue Type: Sub-task Components: Tes

[jira] [Created] (SPARK-48443) Use withSQLConf in tests

2024-05-28 Thread Rui Wang (Jira)
Rui Wang created SPARK-48443: Summary: Use withSQLConf in tests Key: SPARK-48443 URL: https://issues.apache.org/jira/browse/SPARK-48443 Project: Spark Issue Type: Improvement Component

[jira] [Created] (SPARK-48277) Improve error message for ErrorClassesJsonReader.getErrorMessage

2024-05-14 Thread Rui Wang (Jira)
Rui Wang created SPARK-48277: Summary: Improve error message for ErrorClassesJsonReader.getErrorMessage Key: SPARK-48277 URL: https://issues.apache.org/jira/browse/SPARK-48277 Project: Spark Iss

[jira] [Created] (SPARK-47176) Have a ResolveAllExpressionsUpWithPruning helper function

2024-02-26 Thread Rui Wang (Jira)
Rui Wang created SPARK-47176: Summary: Have a ResolveAllExpressionsUpWithPruning helper function Key: SPARK-47176 URL: https://issues.apache.org/jira/browse/SPARK-47176 Project: Spark Issue Type:

[jira] [Created] (SPARK-46740) Only convert to ParquetFileScan for normal Hive Parquet table

2024-01-16 Thread Rui Wang (Jira)
Rui Wang created SPARK-46740: Summary: Only convert to ParquetFileScan for normal Hive Parquet table Key: SPARK-46740 URL: https://issues.apache.org/jira/browse/SPARK-46740 Project: Spark Issue

[jira] [Created] (SPARK-46610) Create table should throw exception when no value for a key in options

2024-01-06 Thread Rui Wang (Jira)
Rui Wang created SPARK-46610: Summary: Create table should throw exception when no value for a key in options Key: SPARK-46610 URL: https://issues.apache.org/jira/browse/SPARK-46610 Project: Spark

[jira] [Created] (SPARK-46600) Move shared code between SqlConf and SqlApiConf to another object

2024-01-04 Thread Rui Wang (Jira)
Rui Wang created SPARK-46600: Summary: Move shared code between SqlConf and SqlApiConf to another object Key: SPARK-46600 URL: https://issues.apache.org/jira/browse/SPARK-46600 Project: Spark Is

[jira] [Updated] (SPARK-46448) InlineTable column should be nullable when converted to Decimal might cause null

2023-12-18 Thread Rui Wang (Jira)
[ https://issues.apache.org/jira/browse/SPARK-46448?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Rui Wang updated SPARK-46448: - Summary: InlineTable column should be nullable when converted to Decimal might cause null (was: InlineT

[jira] [Created] (SPARK-46448) InlineTable column should be nullable when converted to Decimal and overflow

2023-12-18 Thread Rui Wang (Jira)
Rui Wang created SPARK-46448: Summary: InlineTable column should be nullable when converted to Decimal and overflow Key: SPARK-46448 URL: https://issues.apache.org/jira/browse/SPARK-46448 Project: Spark

[jira] [Created] (SPARK-46285) Add foreachWithSubqueries

2023-12-06 Thread Rui Wang (Jira)
Rui Wang created SPARK-46285: Summary: Add foreachWithSubqueries Key: SPARK-46285 URL: https://issues.apache.org/jira/browse/SPARK-46285 Project: Spark Issue Type: Improvement Component

[jira] [Created] (SPARK-46145) spark.catalog.listTables does not throw exception when the table or view is not found

2023-11-28 Thread Rui Wang (Jira)
Rui Wang created SPARK-46145: Summary: spark.catalog.listTables does not throw exception when the table or view is not found Key: SPARK-46145 URL: https://issues.apache.org/jira/browse/SPARK-46145 Project

[jira] [Created] (SPARK-45752) Unreferenced CTE should all be checked by CheckAnalysis0

2023-10-31 Thread Rui Wang (Jira)
Rui Wang created SPARK-45752: Summary: Unreferenced CTE should all be checked by CheckAnalysis0 Key: SPARK-45752 URL: https://issues.apache.org/jira/browse/SPARK-45752 Project: Spark Issue Type:

[jira] [Created] (SPARK-45421) Catch AnalysisException over InlineCTE

2023-10-04 Thread Rui Wang (Jira)
Rui Wang created SPARK-45421: Summary: Catch AnalysisException over InlineCTE Key: SPARK-45421 URL: https://issues.apache.org/jira/browse/SPARK-45421 Project: Spark Issue Type: Task Com

[jira] [Resolved] (SPARK-45242) Use DataFrame ID to semantically validate CollectMetrics

2023-09-22 Thread Rui Wang (Jira)
[ https://issues.apache.org/jira/browse/SPARK-45242?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Rui Wang resolved SPARK-45242. -- Fix Version/s: 4.0.0 Resolution: Fixed https://github.com/apache/spark/pull/43010 > Use DataFr

[jira] [Created] (SPARK-45242) Use DataFrame ID to semantically validate CollectMetrics

2023-09-20 Thread Rui Wang (Jira)
Rui Wang created SPARK-45242: Summary: Use DataFrame ID to semantically validate CollectMetrics Key: SPARK-45242 URL: https://issues.apache.org/jira/browse/SPARK-45242 Project: Spark Issue Type:

[jira] [Updated] (SPARK-45012) CheckAnalysis should throw inlined plan in AnalysisException

2023-08-30 Thread Rui Wang (Jira)
[ https://issues.apache.org/jira/browse/SPARK-45012?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Rui Wang updated SPARK-45012: - Affects Version/s: 4.0.0 (was: 3.5.0) > CheckAnalysis should throw inlined pl

[jira] [Created] (SPARK-45012) CheckAnalysis should throw inlined plan in AnalysisException

2023-08-29 Thread Rui Wang (Jira)
Rui Wang created SPARK-45012: Summary: CheckAnalysis should throw inlined plan in AnalysisException Key: SPARK-45012 URL: https://issues.apache.org/jira/browse/SPARK-45012 Project: Spark Issue T

[jira] [Created] (SPARK-44921) Remove SqlBaseLexer.tokens from codebase

2023-08-22 Thread Rui Wang (Jira)
Rui Wang created SPARK-44921: Summary: Remove SqlBaseLexer.tokens from codebase Key: SPARK-44921 URL: https://issues.apache.org/jira/browse/SPARK-44921 Project: Spark Issue Type: Task C

[jira] [Resolved] (SPARK-44258) Move Metadata to sql/api

2023-08-04 Thread Rui Wang (Jira)
[ https://issues.apache.org/jira/browse/SPARK-44258?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Rui Wang resolved SPARK-44258. -- Resolution: Fixed > Move Metadata to sql/api > > > Key: SPARK

[jira] [Resolved] (SPARK-42887) Simple DataType interface

2023-08-04 Thread Rui Wang (Jira)
[ https://issues.apache.org/jira/browse/SPARK-42887?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Rui Wang resolved SPARK-42887. -- Resolution: Fixed > Simple DataType interface > - > > Key: SPA

[jira] [Created] (SPARK-44574) Errors that moved into sq/api should also use Analysis

2023-07-27 Thread Rui Wang (Jira)
Rui Wang created SPARK-44574: Summary: Errors that moved into sq/api should also use Analysis Key: SPARK-44574 URL: https://issues.apache.org/jira/browse/SPARK-44574 Project: Spark Issue Type: Su

[jira] [Resolved] (SPARK-44507) SCSC does not depend on AnalysisException

2023-07-27 Thread Rui Wang (Jira)
[ https://issues.apache.org/jira/browse/SPARK-44507?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Rui Wang resolved SPARK-44507. -- Resolution: Won't Fix > SCSC does not depend on AnalysisException > --

[jira] [Created] (SPARK-44507) SCSC does not depend on AnalysisException

2023-07-20 Thread Rui Wang (Jira)
Rui Wang created SPARK-44507: Summary: SCSC does not depend on AnalysisException Key: SPARK-44507 URL: https://issues.apache.org/jira/browse/SPARK-44507 Project: Spark Issue Type: Sub-task

[jira] [Created] (SPARK-44496) Move Interfaces needed by SCSC to sql/api

2023-07-20 Thread Rui Wang (Jira)
Rui Wang created SPARK-44496: Summary: Move Interfaces needed by SCSC to sql/api Key: SPARK-44496 URL: https://issues.apache.org/jira/browse/SPARK-44496 Project: Spark Issue Type: Sub-task

[jira] [Created] (SPARK-44475) Relocate DataType and Parser to sql/api

2023-07-18 Thread Rui Wang (Jira)
Rui Wang created SPARK-44475: Summary: Relocate DataType and Parser to sql/api Key: SPARK-44475 URL: https://issues.apache.org/jira/browse/SPARK-44475 Project: Spark Issue Type: Sub-task

[jira] [Created] (SPARK-44326) Move utils that are used from Scala client to the common modules

2023-07-06 Thread Rui Wang (Jira)
Rui Wang created SPARK-44326: Summary: Move utils that are used from Scala client to the common modules Key: SPARK-44326 URL: https://issues.apache.org/jira/browse/SPARK-44326 Project: Spark Iss

[jira] [Created] (SPARK-44324) Move CaseInsensitiveMap to sql/api

2023-07-06 Thread Rui Wang (Jira)
Rui Wang created SPARK-44324: Summary: Move CaseInsensitiveMap to sql/api Key: SPARK-44324 URL: https://issues.apache.org/jira/browse/SPARK-44324 Project: Spark Issue Type: Sub-task Com

[jira] [Created] (SPARK-44315) Move DefinedByConstructorParams to sql/api

2023-07-05 Thread Rui Wang (Jira)
Rui Wang created SPARK-44315: Summary: Move DefinedByConstructorParams to sql/api Key: SPARK-44315 URL: https://issues.apache.org/jira/browse/SPARK-44315 Project: Spark Issue Type: Sub-task

[jira] [Resolved] (SPARK-44281) Move QueryCompilation error that used by DataType to sql/api as DataTypeErrors

2023-07-05 Thread Rui Wang (Jira)
[ https://issues.apache.org/jira/browse/SPARK-44281?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Rui Wang resolved SPARK-44281. -- Resolution: Fixed > Move QueryCompilation error that used by DataType to sql/api as DataTypeErrors > -

[jira] [Updated] (SPARK-44281) Move QueryCompilation error that used by DataType to sql/api as DataTypeErrors

2023-07-03 Thread Rui Wang (Jira)
[ https://issues.apache.org/jira/browse/SPARK-44281?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Rui Wang updated SPARK-44281: - Summary: Move QueryCompilation error that used by DataType to sql/api as DataTypeErrors (was: Move Quer

[jira] [Created] (SPARK-44281) Move QueryCompilcation error that used by DataType to sql/api as DataTypeErrors

2023-07-03 Thread Rui Wang (Jira)
Rui Wang created SPARK-44281: Summary: Move QueryCompilcation error that used by DataType to sql/api as DataTypeErrors Key: SPARK-44281 URL: https://issues.apache.org/jira/browse/SPARK-44281 Project: Spar

[jira] [Created] (SPARK-44274) Move out util functions used by ArtifactManager to common/utils

2023-07-02 Thread Rui Wang (Jira)
Rui Wang created SPARK-44274: Summary: Move out util functions used by ArtifactManager to common/utils Key: SPARK-44274 URL: https://issues.apache.org/jira/browse/SPARK-44274 Project: Spark Issu

[jira] [Created] (SPARK-44273) Spark Connect Scala Client do not depend on Spark

2023-07-02 Thread Rui Wang (Jira)
Rui Wang created SPARK-44273: Summary: Spark Connect Scala Client do not depend on Spark Key: SPARK-44273 URL: https://issues.apache.org/jira/browse/SPARK-44273 Project: Spark Issue Type: Task

[jira] [Created] (SPARK-44271) Move util functions from DataType to ResolveDefaultColumns

2023-07-02 Thread Rui Wang (Jira)
Rui Wang created SPARK-44271: Summary: Move util functions from DataType to ResolveDefaultColumns Key: SPARK-44271 URL: https://issues.apache.org/jira/browse/SPARK-44271 Project: Spark Issue Type

[jira] [Commented] (SPARK-44261) Move QueryCompilationErrors to sql/api

2023-06-30 Thread Rui Wang (Jira)
[ https://issues.apache.org/jira/browse/SPARK-44261?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17739248#comment-17739248 ] Rui Wang commented on SPARK-44261: -- probably wait a bit for https://github.com/apache/s

[jira] [Commented] (SPARK-44261) Move QueryCompilationErrors to sql/api

2023-06-30 Thread Rui Wang (Jira)
[ https://issues.apache.org/jira/browse/SPARK-44261?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17739247#comment-17739247 ] Rui Wang commented on SPARK-44261: -- I probably need to work on this one. I got a chance

[jira] [Updated] (SPARK-44266) Move Util.truncatedString to sql/api

2023-06-30 Thread Rui Wang (Jira)
[ https://issues.apache.org/jira/browse/SPARK-44266?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Rui Wang updated SPARK-44266: - Summary: Move Util.truncatedString to sql/api (was: Move Util.truncatedString) > Move Util.truncatedSt

[jira] [Created] (SPARK-44266) Move Util.truncatedString

2023-06-30 Thread Rui Wang (Jira)
Rui Wang created SPARK-44266: Summary: Move Util.truncatedString Key: SPARK-44266 URL: https://issues.apache.org/jira/browse/SPARK-44266 Project: Spark Issue Type: Sub-task Components:

[jira] [Resolved] (SPARK-44160) Extract shared code from StructType

2023-06-30 Thread Rui Wang (Jira)
[ https://issues.apache.org/jira/browse/SPARK-44160?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Rui Wang resolved SPARK-44160. -- Resolution: Won't Fix > Extract shared code from StructType > --- > >

[jira] [Commented] (SPARK-42887) Simple DataType interface

2023-06-30 Thread Rui Wang (Jira)
[ https://issues.apache.org/jira/browse/SPARK-42887?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17739245#comment-17739245 ] Rui Wang commented on SPARK-42887: -- [~panbingkun] yes please! any help is very welcome!

[jira] [Created] (SPARK-44258) Move Metadata to sql/api

2023-06-29 Thread Rui Wang (Jira)
Rui Wang created SPARK-44258: Summary: Move Metadata to sql/api Key: SPARK-44258 URL: https://issues.apache.org/jira/browse/SPARK-44258 Project: Spark Issue Type: Sub-task Components: S

[jira] [Created] (SPARK-44255) Relocate StorageLevel to common/utils

2023-06-29 Thread Rui Wang (Jira)
Rui Wang created SPARK-44255: Summary: Relocate StorageLevel to common/utils Key: SPARK-44255 URL: https://issues.apache.org/jira/browse/SPARK-44255 Project: Spark Issue Type: Bug Compo

[jira] [Updated] (SPARK-44255) Relocate StorageLevel to common/utils

2023-06-29 Thread Rui Wang (Jira)
[ https://issues.apache.org/jira/browse/SPARK-44255?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Rui Wang updated SPARK-44255: - Issue Type: Task (was: Bug) > Relocate StorageLevel to common/utils > -

[jira] [Created] (SPARK-44254) Move QueryExecutionErrors to sql/api

2023-06-29 Thread Rui Wang (Jira)
Rui Wang created SPARK-44254: Summary: Move QueryExecutionErrors to sql/api Key: SPARK-44254 URL: https://issues.apache.org/jira/browse/SPARK-44254 Project: Spark Issue Type: Sub-task C

[jira] [Created] (SPARK-44227) Extract SchemaUtils from StructField

2023-06-28 Thread Rui Wang (Jira)
Rui Wang created SPARK-44227: Summary: Extract SchemaUtils from StructField Key: SPARK-44227 URL: https://issues.apache.org/jira/browse/SPARK-44227 Project: Spark Issue Type: Sub-task C

[jira] [Created] (SPARK-44220) Move StringConcat to sql/api

2023-06-27 Thread Rui Wang (Jira)
Rui Wang created SPARK-44220: Summary: Move StringConcat to sql/api Key: SPARK-44220 URL: https://issues.apache.org/jira/browse/SPARK-44220 Project: Spark Issue Type: Sub-task Component

[jira] [Created] (SPARK-44205) Extract catalyst code from DecimalType

2023-06-26 Thread Rui Wang (Jira)
Rui Wang created SPARK-44205: Summary: Extract catalyst code from DecimalType Key: SPARK-44205 URL: https://issues.apache.org/jira/browse/SPARK-44205 Project: Spark Issue Type: Sub-task

[jira] [Created] (SPARK-44164) Extract toAttribute method from StructField to Util class

2023-06-23 Thread Rui Wang (Jira)
Rui Wang created SPARK-44164: Summary: Extract toAttribute method from StructField to Util class Key: SPARK-44164 URL: https://issues.apache.org/jira/browse/SPARK-44164 Project: Spark Issue Type:

[jira] [Updated] (SPARK-44160) Extract shared code from StructType

2023-06-23 Thread Rui Wang (Jira)
[ https://issues.apache.org/jira/browse/SPARK-44160?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Rui Wang updated SPARK-44160: - Description: The StructType has some methods that require CatalystParser and Catalyst expression. We are

[jira] [Created] (SPARK-44160) Extract shared code from StructType

2023-06-23 Thread Rui Wang (Jira)
Rui Wang created SPARK-44160: Summary: Extract shared code from StructType Key: SPARK-44160 URL: https://issues.apache.org/jira/browse/SPARK-44160 Project: Spark Issue Type: Sub-task Co

[jira] [Commented] (SPARK-43891) Support SHOW VIEWS IN . when not is not the current selected catalog

2023-06-20 Thread Rui Wang (Jira)
[ https://issues.apache.org/jira/browse/SPARK-43891?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17735348#comment-17735348 ] Rui Wang commented on SPARK-43891: -- Sorry I am bit busy recently and will follow up on

[jira] [Created] (SPARK-44082) Generate operator does not update reference set properly

2023-06-16 Thread Rui Wang (Jira)
Rui Wang created SPARK-44082: Summary: Generate operator does not update reference set properly Key: SPARK-44082 URL: https://issues.apache.org/jira/browse/SPARK-44082 Project: Spark Issue Type:

[jira] [Created] (SPARK-44030) Move out json and expression private methods from DataType

2023-06-12 Thread Rui Wang (Jira)
Rui Wang created SPARK-44030: Summary: Move out json and expression private methods from DataType Key: SPARK-44030 URL: https://issues.apache.org/jira/browse/SPARK-44030 Project: Spark Issue Type

[jira] [Created] (SPARK-43979) CollectedMetrics should be treated as the same one for self-join

2023-06-05 Thread Rui Wang (Jira)
Rui Wang created SPARK-43979: Summary: CollectedMetrics should be treated as the same one for self-join Key: SPARK-43979 URL: https://issues.apache.org/jira/browse/SPARK-43979 Project: Spark Iss

[jira] [Updated] (SPARK-43920) Create sql/api module

2023-06-01 Thread Rui Wang (Jira)
[ https://issues.apache.org/jira/browse/SPARK-43920?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Rui Wang updated SPARK-43920: - Description: We need a sql/api module to host public API like DataType, Row, etc. This module can be sha

[jira] [Created] (SPARK-43920) Create sql/api module

2023-06-01 Thread Rui Wang (Jira)
Rui Wang created SPARK-43920: Summary: Create sql/api module Key: SPARK-43920 URL: https://issues.apache.org/jira/browse/SPARK-43920 Project: Spark Issue Type: Task Components: Connect,

[jira] [Updated] (SPARK-43919) Extract JSON functionality out of Row

2023-06-01 Thread Rui Wang (Jira)
[ https://issues.apache.org/jira/browse/SPARK-43919?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Rui Wang updated SPARK-43919: - Summary: Extract JSON functionality out of Row (was: Extract JSON functionality to Row) > Extract JSO

[jira] [Created] (SPARK-43919) Extract JSON functionality to Row

2023-06-01 Thread Rui Wang (Jira)
Rui Wang created SPARK-43919: Summary: Extract JSON functionality to Row Key: SPARK-43919 URL: https://issues.apache.org/jira/browse/SPARK-43919 Project: Spark Issue Type: Task Componen

[jira] [Created] (SPARK-43891) Support SHOW VIEWS IN . when not is not the current selected catalog

2023-05-30 Thread Rui Wang (Jira)
Rui Wang created SPARK-43891: Summary: Support SHOW VIEWS IN . when not is not the current selected catalog Key: SPARK-43891 URL: https://issues.apache.org/jira/browse/SPARK-43891 Project: Spark

[jira] [Created] (SPARK-43888) Relocate Logging to common/utils

2023-05-30 Thread Rui Wang (Jira)
Rui Wang created SPARK-43888: Summary: Relocate Logging to common/utils Key: SPARK-43888 URL: https://issues.apache.org/jira/browse/SPARK-43888 Project: Spark Issue Type: Task Component

[jira] [Created] (SPARK-43779) To_date should load the EvalMode in main thread

2023-05-24 Thread Rui Wang (Jira)
Rui Wang created SPARK-43779: Summary: To_date should load the EvalMode in main thread Key: SPARK-43779 URL: https://issues.apache.org/jira/browse/SPARK-43779 Project: Spark Issue Type: Task

[jira] [Updated] (SPARK-43779) ParseToDate should load the EvalMode in main thread

2023-05-24 Thread Rui Wang (Jira)
[ https://issues.apache.org/jira/browse/SPARK-43779?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Rui Wang updated SPARK-43779: - Summary: ParseToDate should load the EvalMode in main thread (was: To_date should load the EvalMode in

[jira] [Commented] (SPARK-43265) Move Error framework to a common utils module

2023-05-11 Thread Rui Wang (Jira)
[ https://issues.apache.org/jira/browse/SPARK-43265?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17721850#comment-17721850 ] Rui Wang commented on SPARK-43265: -- [~LuciferYang] The eventual goal is that Spark Con

[jira] [Created] (SPARK-43431) Spark Connect Scala Client should not expose `collectResult`

2023-05-09 Thread Rui Wang (Jira)
Rui Wang created SPARK-43431: Summary: Spark Connect Scala Client should not expose `collectResult` Key: SPARK-43431 URL: https://issues.apache.org/jira/browse/SPARK-43431 Project: Spark Issue T

[jira] [Created] (SPARK-43428) Move some class utils to common/utils

2023-05-09 Thread Rui Wang (Jira)
Rui Wang created SPARK-43428: Summary: Move some class utils to common/utils Key: SPARK-43428 URL: https://issues.apache.org/jira/browse/SPARK-43428 Project: Spark Issue Type: Sub-task

[jira] [Created] (SPARK-43265) Move Error framework to a common utils module

2023-04-24 Thread Rui Wang (Jira)
Rui Wang created SPARK-43265: Summary: Move Error framework to a common utils module Key: SPARK-43265 URL: https://issues.apache.org/jira/browse/SPARK-43265 Project: Spark Issue Type: Task

[jira] [Updated] (SPARK-43165) Move canWrite to DataTypeUtils

2023-04-17 Thread Rui Wang (Jira)
[ https://issues.apache.org/jira/browse/SPARK-43165?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Rui Wang updated SPARK-43165: - Affects Version/s: 3.5.0 (was: 3.4.0) > Move canWrite to DataTypeUtils >

[jira] [Created] (SPARK-43168) Remove get PhysicalDataType method from Datatype class

2023-04-17 Thread Rui Wang (Jira)
Rui Wang created SPARK-43168: Summary: Remove get PhysicalDataType method from Datatype class Key: SPARK-43168 URL: https://issues.apache.org/jira/browse/SPARK-43168 Project: Spark Issue Type: Su

[jira] [Created] (SPARK-43165) Move canWrite to DataTypeUtils

2023-04-17 Thread Rui Wang (Jira)
Rui Wang created SPARK-43165: Summary: Move canWrite to DataTypeUtils Key: SPARK-43165 URL: https://issues.apache.org/jira/browse/SPARK-43165 Project: Spark Issue Type: Sub-task Compone

[jira] [Created] (SPARK-43130) Move InternalType to PhysicalDataType

2023-04-13 Thread Rui Wang (Jira)
Rui Wang created SPARK-43130: Summary: Move InternalType to PhysicalDataType Key: SPARK-43130 URL: https://issues.apache.org/jira/browse/SPARK-43130 Project: Spark Issue Type: Sub-task

[jira] [Created] (SPARK-43110) Move asIntegral to PhysicalDataType

2023-04-12 Thread Rui Wang (Jira)
Rui Wang created SPARK-43110: Summary: Move asIntegral to PhysicalDataType Key: SPARK-43110 URL: https://issues.apache.org/jira/browse/SPARK-43110 Project: Spark Issue Type: Sub-task Co

[jira] [Created] (SPARK-43103) Move Integral to PhysicalDataType

2023-04-11 Thread Rui Wang (Jira)
Rui Wang created SPARK-43103: Summary: Move Integral to PhysicalDataType Key: SPARK-43103 URL: https://issues.apache.org/jira/browse/SPARK-43103 Project: Spark Issue Type: Sub-task Comp

[jira] [Created] (SPARK-43058) Move Numeric to PhysicalDataType

2023-04-06 Thread Rui Wang (Jira)
Rui Wang created SPARK-43058: Summary: Move Numeric to PhysicalDataType Key: SPARK-43058 URL: https://issues.apache.org/jira/browse/SPARK-43058 Project: Spark Issue Type: Sub-task Compo

[jira] [Created] (SPARK-43019) Move Ordering to PhysicalDataType

2023-04-03 Thread Rui Wang (Jira)
Rui Wang created SPARK-43019: Summary: Move Ordering to PhysicalDataType Key: SPARK-43019 URL: https://issues.apache.org/jira/browse/SPARK-43019 Project: Spark Issue Type: Sub-task Comp

[jira] [Commented] (SPARK-42895) ValueError when invoking any session operations on a stopped Spark session

2023-03-22 Thread Rui Wang (Jira)
[ https://issues.apache.org/jira/browse/SPARK-42895?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17703815#comment-17703815 ] Rui Wang commented on SPARK-42895: -- Of course though it probably need a better error me

[jira] [Commented] (SPARK-42895) ValueError when invoking any session operations on a stopped Spark session

2023-03-22 Thread Rui Wang (Jira)
[ https://issues.apache.org/jira/browse/SPARK-42895?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17703814#comment-17703814 ] Rui Wang commented on SPARK-42895: -- In fact spark.stop() does not stop the remote spark

[jira] [Created] (SPARK-42892) Move sameType and relevant methods out of DataType

2023-03-21 Thread Rui Wang (Jira)
Rui Wang created SPARK-42892: Summary: Move sameType and relevant methods out of DataType Key: SPARK-42892 URL: https://issues.apache.org/jira/browse/SPARK-42892 Project: Spark Issue Type: Sub-ta

[jira] [Created] (SPARK-42887) Simple DataType interface

2023-03-21 Thread Rui Wang (Jira)
Rui Wang created SPARK-42887: Summary: Simple DataType interface Key: SPARK-42887 URL: https://issues.apache.org/jira/browse/SPARK-42887 Project: Spark Issue Type: Task Components: SQL

[jira] [Created] (SPARK-42878) Named Table should support options

2023-03-20 Thread Rui Wang (Jira)
Rui Wang created SPARK-42878: Summary: Named Table should support options Key: SPARK-42878 URL: https://issues.apache.org/jira/browse/SPARK-42878 Project: Spark Issue Type: Task Compone

[jira] [Created] (SPARK-42876) DataType's physicalDataType should be private[sql]

2023-03-20 Thread Rui Wang (Jira)
Rui Wang created SPARK-42876: Summary: DataType's physicalDataType should be private[sql] Key: SPARK-42876 URL: https://issues.apache.org/jira/browse/SPARK-42876 Project: Spark Issue Type: Task

[jira] [Created] (SPARK-42722) Python Connect def schema() should not cache the schema

2023-03-08 Thread Rui Wang (Jira)
Rui Wang created SPARK-42722: Summary: Python Connect def schema() should not cache the schema Key: SPARK-42722 URL: https://issues.apache.org/jira/browse/SPARK-42722 Project: Spark Issue Type:

[jira] [Assigned] (SPARK-42688) Rename Connect proto Request client_id to session_id

2023-03-06 Thread Rui Wang (Jira)
[ https://issues.apache.org/jira/browse/SPARK-42688?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Rui Wang reassigned SPARK-42688: Assignee: (was: Rui Wang) > Rename Connect proto Request client_id to session_id > --

[jira] [Updated] (SPARK-42688) Rename Connect proto Request client_id to session_id

2023-03-06 Thread Rui Wang (Jira)
[ https://issues.apache.org/jira/browse/SPARK-42688?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Rui Wang updated SPARK-42688: - Summary: Rename Connect proto Request client_id to session_id (was: Rename client_id to session_id) >

[jira] [Created] (SPARK-42688) Rename client_id to session_id

2023-03-06 Thread Rui Wang (Jira)
Rui Wang created SPARK-42688: Summary: Rename client_id to session_id Key: SPARK-42688 URL: https://issues.apache.org/jira/browse/SPARK-42688 Project: Spark Issue Type: Task Components:

[jira] [Created] (SPARK-42667) Spark Connect: newSession API

2023-03-03 Thread Rui Wang (Jira)
Rui Wang created SPARK-42667: Summary: Spark Connect: newSession API Key: SPARK-42667 URL: https://issues.apache.org/jira/browse/SPARK-42667 Project: Spark Issue Type: Task Components:

[jira] [Created] (SPARK-42640) Remove stale entries from the excluding rules for CompabilitySuite

2023-03-01 Thread Rui Wang (Jira)
Rui Wang created SPARK-42640: Summary: Remove stale entries from the excluding rules for CompabilitySuite Key: SPARK-42640 URL: https://issues.apache.org/jira/browse/SPARK-42640 Project: Spark I

[jira] [Created] (SPARK-42609) Support Grouping/Grouping_Set

2023-02-27 Thread Rui Wang (Jira)
Rui Wang created SPARK-42609: Summary: Support Grouping/Grouping_Set Key: SPARK-42609 URL: https://issues.apache.org/jira/browse/SPARK-42609 Project: Spark Issue Type: Sub-task Componen

[jira] [Assigned] (SPARK-42542) Support Pivot without providing pivot column values

2023-02-27 Thread Rui Wang (Jira)
[ https://issues.apache.org/jira/browse/SPARK-42542?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Rui Wang reassigned SPARK-42542: Assignee: Rui Wang > Support Pivot without providing pivot column values > --

  1   2   3   4   >