Rui Wang created SPARK-49211:
Summary: V2 Catalog can also support built-in data sources
Key: SPARK-49211
URL: https://issues.apache.org/jira/browse/SPARK-49211
Project: Spark
Issue Type: Improve
[
https://issues.apache.org/jira/browse/SPARK-49152?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Rui Wang updated SPARK-49152:
-
Summary: V2SessionCatalog should use V2Command (was: V2SessionCatalog
should use V2Command when possibl
Rui Wang created SPARK-49152:
Summary: V2SessionCatalog should use V2Command when possible
Key: SPARK-49152
URL: https://issues.apache.org/jira/browse/SPARK-49152
Project: Spark
Issue Type: Impro
Rui Wang created SPARK-49099:
Summary: Refactor CatalogManager.setCurrentNamespace
Key: SPARK-49099
URL: https://issues.apache.org/jira/browse/SPARK-49099
Project: Spark
Issue Type: Improvement
Rui Wang created SPARK-48790:
Summary: Use checkDatasetUnorderly in
DeprecatedDatasetAggregatorSuite
Key: SPARK-48790
URL: https://issues.apache.org/jira/browse/SPARK-48790
Project: Spark
Issue
Rui Wang created SPARK-48773:
Summary: Document config "spark.default.parallelism"
Key: SPARK-48773
URL: https://issues.apache.org/jira/browse/SPARK-48773
Project: Spark
Issue Type: Improvement
Rui Wang created SPARK-48512:
Summary: Refactor Python tests
Key: SPARK-48512
URL: https://issues.apache.org/jira/browse/SPARK-48512
Project: Spark
Issue Type: Sub-task
Components: PySp
Rui Wang created SPARK-48491:
Summary: Refactor HiveWindowFunctionQuerySuite in BeforeAll and
AfterAll
Key: SPARK-48491
URL: https://issues.apache.org/jira/browse/SPARK-48491
Project: Spark
Issu
[
https://issues.apache.org/jira/browse/SPARK-48477?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Rui Wang updated SPARK-48477:
-
Summary: Refactor CollationSuite, CoalesceShufflePartitionsSuite,
SQLExecutionSuite (was: Refactor Coll
Rui Wang created SPARK-48477:
Summary: Refactor CollationSuite, CoalesceShufflePartitionsSuite,
SQLExecutionSuite, HivePlanTest
Key: SPARK-48477
URL: https://issues.apache.org/jira/browse/SPARK-48477
Proj
Rui Wang created SPARK-48464:
Summary: Refactor SQLConfSuite and StatisticsSuite
Key: SPARK-48464
URL: https://issues.apache.org/jira/browse/SPARK-48464
Project: Spark
Issue Type: Sub-task
Rui Wang created SPARK-48462:
Summary: Refactor HiveQuerySuite.scala and HiveTableScanSuite
Key: SPARK-48462
URL: https://issues.apache.org/jira/browse/SPARK-48462
Project: Spark
Issue Type: Sub-
Rui Wang created SPARK-48444:
Summary: Refactor SQLQuerySuite
Key: SPARK-48444
URL: https://issues.apache.org/jira/browse/SPARK-48444
Project: Spark
Issue Type: Sub-task
Components: Tes
Rui Wang created SPARK-48443:
Summary: Use withSQLConf in tests
Key: SPARK-48443
URL: https://issues.apache.org/jira/browse/SPARK-48443
Project: Spark
Issue Type: Improvement
Component
Rui Wang created SPARK-48277:
Summary: Improve error message for
ErrorClassesJsonReader.getErrorMessage
Key: SPARK-48277
URL: https://issues.apache.org/jira/browse/SPARK-48277
Project: Spark
Iss
Rui Wang created SPARK-47176:
Summary: Have a ResolveAllExpressionsUpWithPruning helper function
Key: SPARK-47176
URL: https://issues.apache.org/jira/browse/SPARK-47176
Project: Spark
Issue Type:
Rui Wang created SPARK-46740:
Summary: Only convert to ParquetFileScan for normal Hive Parquet
table
Key: SPARK-46740
URL: https://issues.apache.org/jira/browse/SPARK-46740
Project: Spark
Issue
Rui Wang created SPARK-46610:
Summary: Create table should throw exception when no value for a
key in options
Key: SPARK-46610
URL: https://issues.apache.org/jira/browse/SPARK-46610
Project: Spark
Rui Wang created SPARK-46600:
Summary: Move shared code between SqlConf and SqlApiConf to
another object
Key: SPARK-46600
URL: https://issues.apache.org/jira/browse/SPARK-46600
Project: Spark
Is
[
https://issues.apache.org/jira/browse/SPARK-46448?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Rui Wang updated SPARK-46448:
-
Summary: InlineTable column should be nullable when converted to Decimal
might cause null (was: InlineT
Rui Wang created SPARK-46448:
Summary: InlineTable column should be nullable when converted to
Decimal and overflow
Key: SPARK-46448
URL: https://issues.apache.org/jira/browse/SPARK-46448
Project: Spark
Rui Wang created SPARK-46285:
Summary: Add foreachWithSubqueries
Key: SPARK-46285
URL: https://issues.apache.org/jira/browse/SPARK-46285
Project: Spark
Issue Type: Improvement
Component
Rui Wang created SPARK-46145:
Summary: spark.catalog.listTables does not throw exception when
the table or view is not found
Key: SPARK-46145
URL: https://issues.apache.org/jira/browse/SPARK-46145
Project
Rui Wang created SPARK-45752:
Summary: Unreferenced CTE should all be checked by CheckAnalysis0
Key: SPARK-45752
URL: https://issues.apache.org/jira/browse/SPARK-45752
Project: Spark
Issue Type:
Rui Wang created SPARK-45421:
Summary: Catch AnalysisException over InlineCTE
Key: SPARK-45421
URL: https://issues.apache.org/jira/browse/SPARK-45421
Project: Spark
Issue Type: Task
Com
[
https://issues.apache.org/jira/browse/SPARK-45242?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Rui Wang resolved SPARK-45242.
--
Fix Version/s: 4.0.0
Resolution: Fixed
https://github.com/apache/spark/pull/43010
> Use DataFr
Rui Wang created SPARK-45242:
Summary: Use DataFrame ID to semantically validate CollectMetrics
Key: SPARK-45242
URL: https://issues.apache.org/jira/browse/SPARK-45242
Project: Spark
Issue Type:
[
https://issues.apache.org/jira/browse/SPARK-45012?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Rui Wang updated SPARK-45012:
-
Affects Version/s: 4.0.0
(was: 3.5.0)
> CheckAnalysis should throw inlined pl
Rui Wang created SPARK-45012:
Summary: CheckAnalysis should throw inlined plan in
AnalysisException
Key: SPARK-45012
URL: https://issues.apache.org/jira/browse/SPARK-45012
Project: Spark
Issue T
Rui Wang created SPARK-44921:
Summary: Remove SqlBaseLexer.tokens from codebase
Key: SPARK-44921
URL: https://issues.apache.org/jira/browse/SPARK-44921
Project: Spark
Issue Type: Task
C
[
https://issues.apache.org/jira/browse/SPARK-44258?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Rui Wang resolved SPARK-44258.
--
Resolution: Fixed
> Move Metadata to sql/api
>
>
> Key: SPARK
[
https://issues.apache.org/jira/browse/SPARK-42887?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Rui Wang resolved SPARK-42887.
--
Resolution: Fixed
> Simple DataType interface
> -
>
> Key: SPA
Rui Wang created SPARK-44574:
Summary: Errors that moved into sq/api should also use Analysis
Key: SPARK-44574
URL: https://issues.apache.org/jira/browse/SPARK-44574
Project: Spark
Issue Type: Su
[
https://issues.apache.org/jira/browse/SPARK-44507?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Rui Wang resolved SPARK-44507.
--
Resolution: Won't Fix
> SCSC does not depend on AnalysisException
> --
Rui Wang created SPARK-44507:
Summary: SCSC does not depend on AnalysisException
Key: SPARK-44507
URL: https://issues.apache.org/jira/browse/SPARK-44507
Project: Spark
Issue Type: Sub-task
Rui Wang created SPARK-44496:
Summary: Move Interfaces needed by SCSC to sql/api
Key: SPARK-44496
URL: https://issues.apache.org/jira/browse/SPARK-44496
Project: Spark
Issue Type: Sub-task
Rui Wang created SPARK-44475:
Summary: Relocate DataType and Parser to sql/api
Key: SPARK-44475
URL: https://issues.apache.org/jira/browse/SPARK-44475
Project: Spark
Issue Type: Sub-task
Rui Wang created SPARK-44326:
Summary: Move utils that are used from Scala client to the common
modules
Key: SPARK-44326
URL: https://issues.apache.org/jira/browse/SPARK-44326
Project: Spark
Iss
Rui Wang created SPARK-44324:
Summary: Move CaseInsensitiveMap to sql/api
Key: SPARK-44324
URL: https://issues.apache.org/jira/browse/SPARK-44324
Project: Spark
Issue Type: Sub-task
Com
Rui Wang created SPARK-44315:
Summary: Move DefinedByConstructorParams to sql/api
Key: SPARK-44315
URL: https://issues.apache.org/jira/browse/SPARK-44315
Project: Spark
Issue Type: Sub-task
[
https://issues.apache.org/jira/browse/SPARK-44281?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Rui Wang resolved SPARK-44281.
--
Resolution: Fixed
> Move QueryCompilation error that used by DataType to sql/api as DataTypeErrors
> -
[
https://issues.apache.org/jira/browse/SPARK-44281?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Rui Wang updated SPARK-44281:
-
Summary: Move QueryCompilation error that used by DataType to sql/api as
DataTypeErrors (was: Move Quer
Rui Wang created SPARK-44281:
Summary: Move QueryCompilcation error that used by DataType to
sql/api as DataTypeErrors
Key: SPARK-44281
URL: https://issues.apache.org/jira/browse/SPARK-44281
Project: Spar
Rui Wang created SPARK-44274:
Summary: Move out util functions used by ArtifactManager to
common/utils
Key: SPARK-44274
URL: https://issues.apache.org/jira/browse/SPARK-44274
Project: Spark
Issu
Rui Wang created SPARK-44273:
Summary: Spark Connect Scala Client do not depend on Spark
Key: SPARK-44273
URL: https://issues.apache.org/jira/browse/SPARK-44273
Project: Spark
Issue Type: Task
Rui Wang created SPARK-44271:
Summary: Move util functions from DataType to ResolveDefaultColumns
Key: SPARK-44271
URL: https://issues.apache.org/jira/browse/SPARK-44271
Project: Spark
Issue Type
[
https://issues.apache.org/jira/browse/SPARK-44261?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17739248#comment-17739248
]
Rui Wang commented on SPARK-44261:
--
probably wait a bit for https://github.com/apache/s
[
https://issues.apache.org/jira/browse/SPARK-44261?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17739247#comment-17739247
]
Rui Wang commented on SPARK-44261:
--
I probably need to work on this one. I got a chance
[
https://issues.apache.org/jira/browse/SPARK-44266?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Rui Wang updated SPARK-44266:
-
Summary: Move Util.truncatedString to sql/api (was: Move
Util.truncatedString)
> Move Util.truncatedSt
Rui Wang created SPARK-44266:
Summary: Move Util.truncatedString
Key: SPARK-44266
URL: https://issues.apache.org/jira/browse/SPARK-44266
Project: Spark
Issue Type: Sub-task
Components:
[
https://issues.apache.org/jira/browse/SPARK-44160?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Rui Wang resolved SPARK-44160.
--
Resolution: Won't Fix
> Extract shared code from StructType
> ---
>
>
[
https://issues.apache.org/jira/browse/SPARK-42887?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17739245#comment-17739245
]
Rui Wang commented on SPARK-42887:
--
[~panbingkun] yes please! any help is very welcome!
Rui Wang created SPARK-44258:
Summary: Move Metadata to sql/api
Key: SPARK-44258
URL: https://issues.apache.org/jira/browse/SPARK-44258
Project: Spark
Issue Type: Sub-task
Components: S
Rui Wang created SPARK-44255:
Summary: Relocate StorageLevel to common/utils
Key: SPARK-44255
URL: https://issues.apache.org/jira/browse/SPARK-44255
Project: Spark
Issue Type: Bug
Compo
[
https://issues.apache.org/jira/browse/SPARK-44255?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Rui Wang updated SPARK-44255:
-
Issue Type: Task (was: Bug)
> Relocate StorageLevel to common/utils
> -
Rui Wang created SPARK-44254:
Summary: Move QueryExecutionErrors to sql/api
Key: SPARK-44254
URL: https://issues.apache.org/jira/browse/SPARK-44254
Project: Spark
Issue Type: Sub-task
C
Rui Wang created SPARK-44227:
Summary: Extract SchemaUtils from StructField
Key: SPARK-44227
URL: https://issues.apache.org/jira/browse/SPARK-44227
Project: Spark
Issue Type: Sub-task
C
Rui Wang created SPARK-44220:
Summary: Move StringConcat to sql/api
Key: SPARK-44220
URL: https://issues.apache.org/jira/browse/SPARK-44220
Project: Spark
Issue Type: Sub-task
Component
Rui Wang created SPARK-44205:
Summary: Extract catalyst code from DecimalType
Key: SPARK-44205
URL: https://issues.apache.org/jira/browse/SPARK-44205
Project: Spark
Issue Type: Sub-task
Rui Wang created SPARK-44164:
Summary: Extract toAttribute method from StructField to Util class
Key: SPARK-44164
URL: https://issues.apache.org/jira/browse/SPARK-44164
Project: Spark
Issue Type:
[
https://issues.apache.org/jira/browse/SPARK-44160?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Rui Wang updated SPARK-44160:
-
Description: The StructType has some methods that require CatalystParser
and Catalyst expression. We are
Rui Wang created SPARK-44160:
Summary: Extract shared code from StructType
Key: SPARK-44160
URL: https://issues.apache.org/jira/browse/SPARK-44160
Project: Spark
Issue Type: Sub-task
Co
[
https://issues.apache.org/jira/browse/SPARK-43891?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17735348#comment-17735348
]
Rui Wang commented on SPARK-43891:
--
Sorry I am bit busy recently and will follow up on
Rui Wang created SPARK-44082:
Summary: Generate operator does not update reference set properly
Key: SPARK-44082
URL: https://issues.apache.org/jira/browse/SPARK-44082
Project: Spark
Issue Type:
Rui Wang created SPARK-44030:
Summary: Move out json and expression private methods from DataType
Key: SPARK-44030
URL: https://issues.apache.org/jira/browse/SPARK-44030
Project: Spark
Issue Type
Rui Wang created SPARK-43979:
Summary: CollectedMetrics should be treated as the same one for
self-join
Key: SPARK-43979
URL: https://issues.apache.org/jira/browse/SPARK-43979
Project: Spark
Iss
[
https://issues.apache.org/jira/browse/SPARK-43920?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Rui Wang updated SPARK-43920:
-
Description: We need a sql/api module to host public API like DataType,
Row, etc. This module can be sha
Rui Wang created SPARK-43920:
Summary: Create sql/api module
Key: SPARK-43920
URL: https://issues.apache.org/jira/browse/SPARK-43920
Project: Spark
Issue Type: Task
Components: Connect,
[
https://issues.apache.org/jira/browse/SPARK-43919?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Rui Wang updated SPARK-43919:
-
Summary: Extract JSON functionality out of Row (was: Extract JSON
functionality to Row)
> Extract JSO
Rui Wang created SPARK-43919:
Summary: Extract JSON functionality to Row
Key: SPARK-43919
URL: https://issues.apache.org/jira/browse/SPARK-43919
Project: Spark
Issue Type: Task
Componen
Rui Wang created SPARK-43891:
Summary: Support SHOW VIEWS IN . when not
is not the current selected catalog
Key: SPARK-43891
URL: https://issues.apache.org/jira/browse/SPARK-43891
Project: Spark
Rui Wang created SPARK-43888:
Summary: Relocate Logging to common/utils
Key: SPARK-43888
URL: https://issues.apache.org/jira/browse/SPARK-43888
Project: Spark
Issue Type: Task
Component
Rui Wang created SPARK-43779:
Summary: To_date should load the EvalMode in main thread
Key: SPARK-43779
URL: https://issues.apache.org/jira/browse/SPARK-43779
Project: Spark
Issue Type: Task
[
https://issues.apache.org/jira/browse/SPARK-43779?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Rui Wang updated SPARK-43779:
-
Summary: ParseToDate should load the EvalMode in main thread (was: To_date
should load the EvalMode in
[
https://issues.apache.org/jira/browse/SPARK-43265?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17721850#comment-17721850
]
Rui Wang commented on SPARK-43265:
--
[~LuciferYang]
The eventual goal is that Spark Con
Rui Wang created SPARK-43431:
Summary: Spark Connect Scala Client should not expose
`collectResult`
Key: SPARK-43431
URL: https://issues.apache.org/jira/browse/SPARK-43431
Project: Spark
Issue T
Rui Wang created SPARK-43428:
Summary: Move some class utils to common/utils
Key: SPARK-43428
URL: https://issues.apache.org/jira/browse/SPARK-43428
Project: Spark
Issue Type: Sub-task
Rui Wang created SPARK-43265:
Summary: Move Error framework to a common utils module
Key: SPARK-43265
URL: https://issues.apache.org/jira/browse/SPARK-43265
Project: Spark
Issue Type: Task
[
https://issues.apache.org/jira/browse/SPARK-43165?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Rui Wang updated SPARK-43165:
-
Affects Version/s: 3.5.0
(was: 3.4.0)
> Move canWrite to DataTypeUtils
>
Rui Wang created SPARK-43168:
Summary: Remove get PhysicalDataType method from Datatype class
Key: SPARK-43168
URL: https://issues.apache.org/jira/browse/SPARK-43168
Project: Spark
Issue Type: Su
Rui Wang created SPARK-43165:
Summary: Move canWrite to DataTypeUtils
Key: SPARK-43165
URL: https://issues.apache.org/jira/browse/SPARK-43165
Project: Spark
Issue Type: Sub-task
Compone
Rui Wang created SPARK-43130:
Summary: Move InternalType to PhysicalDataType
Key: SPARK-43130
URL: https://issues.apache.org/jira/browse/SPARK-43130
Project: Spark
Issue Type: Sub-task
Rui Wang created SPARK-43110:
Summary: Move asIntegral to PhysicalDataType
Key: SPARK-43110
URL: https://issues.apache.org/jira/browse/SPARK-43110
Project: Spark
Issue Type: Sub-task
Co
Rui Wang created SPARK-43103:
Summary: Move Integral to PhysicalDataType
Key: SPARK-43103
URL: https://issues.apache.org/jira/browse/SPARK-43103
Project: Spark
Issue Type: Sub-task
Comp
Rui Wang created SPARK-43058:
Summary: Move Numeric to PhysicalDataType
Key: SPARK-43058
URL: https://issues.apache.org/jira/browse/SPARK-43058
Project: Spark
Issue Type: Sub-task
Compo
Rui Wang created SPARK-43019:
Summary: Move Ordering to PhysicalDataType
Key: SPARK-43019
URL: https://issues.apache.org/jira/browse/SPARK-43019
Project: Spark
Issue Type: Sub-task
Comp
[
https://issues.apache.org/jira/browse/SPARK-42895?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17703815#comment-17703815
]
Rui Wang commented on SPARK-42895:
--
Of course though it probably need a better error me
[
https://issues.apache.org/jira/browse/SPARK-42895?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17703814#comment-17703814
]
Rui Wang commented on SPARK-42895:
--
In fact spark.stop() does not stop the remote spark
Rui Wang created SPARK-42892:
Summary: Move sameType and relevant methods out of DataType
Key: SPARK-42892
URL: https://issues.apache.org/jira/browse/SPARK-42892
Project: Spark
Issue Type: Sub-ta
Rui Wang created SPARK-42887:
Summary: Simple DataType interface
Key: SPARK-42887
URL: https://issues.apache.org/jira/browse/SPARK-42887
Project: Spark
Issue Type: Task
Components: SQL
Rui Wang created SPARK-42878:
Summary: Named Table should support options
Key: SPARK-42878
URL: https://issues.apache.org/jira/browse/SPARK-42878
Project: Spark
Issue Type: Task
Compone
Rui Wang created SPARK-42876:
Summary: DataType's physicalDataType should be private[sql]
Key: SPARK-42876
URL: https://issues.apache.org/jira/browse/SPARK-42876
Project: Spark
Issue Type: Task
Rui Wang created SPARK-42722:
Summary: Python Connect def schema() should not cache the schema
Key: SPARK-42722
URL: https://issues.apache.org/jira/browse/SPARK-42722
Project: Spark
Issue Type:
[
https://issues.apache.org/jira/browse/SPARK-42688?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Rui Wang reassigned SPARK-42688:
Assignee: (was: Rui Wang)
> Rename Connect proto Request client_id to session_id
> --
[
https://issues.apache.org/jira/browse/SPARK-42688?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Rui Wang updated SPARK-42688:
-
Summary: Rename Connect proto Request client_id to session_id (was: Rename
client_id to session_id)
>
Rui Wang created SPARK-42688:
Summary: Rename client_id to session_id
Key: SPARK-42688
URL: https://issues.apache.org/jira/browse/SPARK-42688
Project: Spark
Issue Type: Task
Components:
Rui Wang created SPARK-42667:
Summary: Spark Connect: newSession API
Key: SPARK-42667
URL: https://issues.apache.org/jira/browse/SPARK-42667
Project: Spark
Issue Type: Task
Components:
Rui Wang created SPARK-42640:
Summary: Remove stale entries from the excluding rules for
CompabilitySuite
Key: SPARK-42640
URL: https://issues.apache.org/jira/browse/SPARK-42640
Project: Spark
I
Rui Wang created SPARK-42609:
Summary: Support Grouping/Grouping_Set
Key: SPARK-42609
URL: https://issues.apache.org/jira/browse/SPARK-42609
Project: Spark
Issue Type: Sub-task
Componen
[
https://issues.apache.org/jira/browse/SPARK-42542?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Rui Wang reassigned SPARK-42542:
Assignee: Rui Wang
> Support Pivot without providing pivot column values
> --
1 - 100 of 315 matches
Mail list logo