[jira] [Updated] (SPARK-45455) [SQL][JDBC] Improve the rename interface of Postgres Dialect
[ https://issues.apache.org/jira/browse/SPARK-45455?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] 蔡灿材 updated SPARK-45455: Description: Improve the rename interface of pgdialect (was: Improve the rename interface of pgdialect and mysqldialec [MySQL :: MySQL 8.0 Reference Manual :: 13.1.36 RENAME TABLE Statement|https://dev.mysql.com/doc/refman/8.0/en/rename-table.html]) > [SQL][JDBC] Improve the rename interface of Postgres Dialect > > > Key: SPARK-45455 > URL: https://issues.apache.org/jira/browse/SPARK-45455 > Project: Spark > Issue Type: Improvement > Components: SQL >Affects Versions: 3.5.0 >Reporter: 蔡灿材 >Priority: Minor > Labels: pull-request-available > Fix For: 3.5.0 > > > Improve the rename interface of pgdialect -- This message was sent by Atlassian Jira (v8.20.10#820010) - To unsubscribe, e-mail: issues-unsubscr...@spark.apache.org For additional commands, e-mail: issues-h...@spark.apache.org
[jira] [Updated] (SPARK-45458) Convert IllegalArgumentException to SparkIllegalArgumentException in bitwiseExpressions and add some UT
[ https://issues.apache.org/jira/browse/SPARK-45458?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] ASF GitHub Bot updated SPARK-45458: --- Labels: pull-request-available (was: ) > Convert IllegalArgumentException to SparkIllegalArgumentException in > bitwiseExpressions and add some UT > --- > > Key: SPARK-45458 > URL: https://issues.apache.org/jira/browse/SPARK-45458 > Project: Spark > Issue Type: Improvement > Components: SQL >Affects Versions: 4.0.0 >Reporter: BingKun Pan >Priority: Minor > Labels: pull-request-available > -- This message was sent by Atlassian Jira (v8.20.10#820010) - To unsubscribe, e-mail: issues-unsubscr...@spark.apache.org For additional commands, e-mail: issues-h...@spark.apache.org
[jira] [Created] (SPARK-45458) Convert IllegalArgumentException to SparkIllegalArgumentException in bitwiseExpressions and add some UT
BingKun Pan created SPARK-45458: --- Summary: Convert IllegalArgumentException to SparkIllegalArgumentException in bitwiseExpressions and add some UT Key: SPARK-45458 URL: https://issues.apache.org/jira/browse/SPARK-45458 Project: Spark Issue Type: Improvement Components: SQL Affects Versions: 4.0.0 Reporter: BingKun Pan -- This message was sent by Atlassian Jira (v8.20.10#820010) - To unsubscribe, e-mail: issues-unsubscr...@spark.apache.org For additional commands, e-mail: issues-h...@spark.apache.org
[jira] [Updated] (SPARK-45454) Set the table's default owner to current_user
[ https://issues.apache.org/jira/browse/SPARK-45454?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Yuming Wang updated SPARK-45454: Parent: (was: SPARK-30016) Issue Type: Improvement (was: Sub-task) > Set the table's default owner to current_user > - > > Key: SPARK-45454 > URL: https://issues.apache.org/jira/browse/SPARK-45454 > Project: Spark > Issue Type: Improvement > Components: SQL >Affects Versions: 4.0.0 >Reporter: Yuming Wang >Priority: Major > Labels: pull-request-available > -- This message was sent by Atlassian Jira (v8.20.10#820010) - To unsubscribe, e-mail: issues-unsubscr...@spark.apache.org For additional commands, e-mail: issues-h...@spark.apache.org
[jira] [Updated] (SPARK-45454) Set the table's default owner to current_user
[ https://issues.apache.org/jira/browse/SPARK-45454?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Yuming Wang updated SPARK-45454: Summary: Set the table's default owner to current_user (was: Set owner of DS v2 table to CURRENT_USER if it is already set) > Set the table's default owner to current_user > - > > Key: SPARK-45454 > URL: https://issues.apache.org/jira/browse/SPARK-45454 > Project: Spark > Issue Type: Sub-task > Components: SQL >Affects Versions: 4.0.0 >Reporter: Yuming Wang >Priority: Major > Labels: pull-request-available > -- This message was sent by Atlassian Jira (v8.20.10#820010) - To unsubscribe, e-mail: issues-unsubscr...@spark.apache.org For additional commands, e-mail: issues-h...@spark.apache.org
[jira] [Updated] (SPARK-45205) Since version 3.2.0, Spark SQL has taken longer to execute "show paritions",probably because of changes introduced by SPARK-35278
[ https://issues.apache.org/jira/browse/SPARK-45205?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] ASF GitHub Bot updated SPARK-45205: --- Labels: pull-request-available (was: ) > Since version 3.2.0, Spark SQL has taken longer to execute "show > paritions",probably because of changes introduced by SPARK-35278 > -- > > Key: SPARK-45205 > URL: https://issues.apache.org/jira/browse/SPARK-45205 > Project: Spark > Issue Type: Bug > Components: SQL >Affects Versions: 3.2.0 >Reporter: Qiang Yang >Priority: Major > Labels: pull-request-available > > After SPARK-35378 was changed, I noticed that the execution of statements > such as ‘show parititions test' became slower. > The change point is that the execution process changes from > ExecutedCommandEnec to CommandResultExec, but ExecutedCommandExec originally > implemented the following method > override def executeToIterator(): Iterator[InternalRow] = > sideEffectResult.iterator > CommandResultExec is not rewritten, so when the hasNext method is executed, a > job process is created, resulting in increased time-consuming -- This message was sent by Atlassian Jira (v8.20.10#820010) - To unsubscribe, e-mail: issues-unsubscr...@spark.apache.org For additional commands, e-mail: issues-h...@spark.apache.org
[jira] [Updated] (SPARK-42915) Codegen Support for sentences
[ https://issues.apache.org/jira/browse/SPARK-42915?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] ASF GitHub Bot updated SPARK-42915: --- Labels: pull-request-available (was: ) > Codegen Support for sentences > - > > Key: SPARK-42915 > URL: https://issues.apache.org/jira/browse/SPARK-42915 > Project: Spark > Issue Type: Improvement > Components: SQL >Affects Versions: 3.5.0 >Reporter: BingKun Pan >Priority: Minor > Labels: pull-request-available > -- This message was sent by Atlassian Jira (v8.20.10#820010) - To unsubscribe, e-mail: issues-unsubscr...@spark.apache.org For additional commands, e-mail: issues-h...@spark.apache.org
[jira] [Updated] (SPARK-45261) Fix EventLogFileWriters to handle `none` codec case
[ https://issues.apache.org/jira/browse/SPARK-45261?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Dongjoon Hyun updated SPARK-45261: -- Parent: SPARK-44111 Issue Type: Sub-task (was: Improvement) > Fix EventLogFileWriters to handle `none` codec case > --- > > Key: SPARK-45261 > URL: https://issues.apache.org/jira/browse/SPARK-45261 > Project: Spark > Issue Type: Sub-task > Components: Spark Core >Affects Versions: 4.0.0 >Reporter: Dongjoon Hyun >Assignee: Dongjoon Hyun >Priority: Major > Labels: pull-request-available > Fix For: 4.0.0 > > -- This message was sent by Atlassian Jira (v8.20.10#820010) - To unsubscribe, e-mail: issues-unsubscr...@spark.apache.org For additional commands, e-mail: issues-h...@spark.apache.org
[jira] [Updated] (SPARK-45263) Make EventLoggingListenerSuite independent from spark.eventLog.compress conf
[ https://issues.apache.org/jira/browse/SPARK-45263?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Dongjoon Hyun updated SPARK-45263: -- Parent: SPARK-44111 Issue Type: Sub-task (was: Test) > Make EventLoggingListenerSuite independent from spark.eventLog.compress conf > > > Key: SPARK-45263 > URL: https://issues.apache.org/jira/browse/SPARK-45263 > Project: Spark > Issue Type: Sub-task > Components: Spark Core >Affects Versions: 4.0.0 >Reporter: Dongjoon Hyun >Assignee: Dongjoon Hyun >Priority: Minor > Labels: pull-request-available > Fix For: 4.0.0 > > -- This message was sent by Atlassian Jira (v8.20.10#820010) - To unsubscribe, e-mail: issues-unsubscr...@spark.apache.org For additional commands, e-mail: issues-h...@spark.apache.org
[jira] [Updated] (SPARK-45285) Remove deprecated `Runtime.getRuntime.exec(String)` API usage
[ https://issues.apache.org/jira/browse/SPARK-45285?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Dongjoon Hyun updated SPARK-45285: -- Parent: SPARK-43831 Issue Type: Sub-task (was: Improvement) > Remove deprecated `Runtime.getRuntime.exec(String)` API usage > - > > Key: SPARK-45285 > URL: https://issues.apache.org/jira/browse/SPARK-45285 > Project: Spark > Issue Type: Sub-task > Components: Spark Core, Tests >Affects Versions: 4.0.0 >Reporter: Dongjoon Hyun >Assignee: Dongjoon Hyun >Priority: Minor > Labels: pull-request-available > Fix For: 4.0.0 > > -- This message was sent by Atlassian Jira (v8.20.10#820010) - To unsubscribe, e-mail: issues-unsubscr...@spark.apache.org For additional commands, e-mail: issues-h...@spark.apache.org
[jira] [Updated] (SPARK-45288) Remove outdated benchmark result files `jdk1[17]*results.txt`
[ https://issues.apache.org/jira/browse/SPARK-45288?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Dongjoon Hyun updated SPARK-45288: -- Parent: SPARK-43831 Issue Type: Sub-task (was: Test) > Remove outdated benchmark result files `jdk1[17]*results.txt` > - > > Key: SPARK-45288 > URL: https://issues.apache.org/jira/browse/SPARK-45288 > Project: Spark > Issue Type: Sub-task > Components: Tests >Affects Versions: 4.0.0 >Reporter: Dongjoon Hyun >Assignee: Dongjoon Hyun >Priority: Minor > Labels: pull-request-available > Fix For: 4.0.0 > > -- This message was sent by Atlassian Jira (v8.20.10#820010) - To unsubscribe, e-mail: issues-unsubscr...@spark.apache.org For additional commands, e-mail: issues-h...@spark.apache.org
[jira] [Updated] (SPARK-45404) Support AWS_ENDPOINT_URL env variable
[ https://issues.apache.org/jira/browse/SPARK-45404?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Dongjoon Hyun updated SPARK-45404: -- Parent: SPARK-44111 Issue Type: Sub-task (was: Improvement) > Support AWS_ENDPOINT_URL env variable > - > > Key: SPARK-45404 > URL: https://issues.apache.org/jira/browse/SPARK-45404 > Project: Spark > Issue Type: Sub-task > Components: Spark Core >Affects Versions: 4.0.0 >Reporter: Dongjoon Hyun >Assignee: Dongjoon Hyun >Priority: Major > Labels: pull-request-available > Fix For: 4.0.0 > > -- This message was sent by Atlassian Jira (v8.20.10#820010) - To unsubscribe, e-mail: issues-unsubscr...@spark.apache.org For additional commands, e-mail: issues-h...@spark.apache.org
[jira] [Updated] (SPARK-45432) Remove deprecated Hadoop-2 `LocatedFileStatus` constructor
[ https://issues.apache.org/jira/browse/SPARK-45432?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Dongjoon Hyun updated SPARK-45432: -- Parent: SPARK-44111 Issue Type: Sub-task (was: Improvement) > Remove deprecated Hadoop-2 `LocatedFileStatus` constructor > -- > > Key: SPARK-45432 > URL: https://issues.apache.org/jira/browse/SPARK-45432 > Project: Spark > Issue Type: Sub-task > Components: Spark Core >Affects Versions: 4.0.0 >Reporter: Dongjoon Hyun >Assignee: Dongjoon Hyun >Priority: Major > Labels: pull-request-available > Fix For: 4.0.0 > > -- This message was sent by Atlassian Jira (v8.20.10#820010) - To unsubscribe, e-mail: issues-unsubscr...@spark.apache.org For additional commands, e-mail: issues-h...@spark.apache.org
[jira] [Resolved] (SPARK-45452) Improve InMemoryFileIndex to use FileSystem.listFiles API
[ https://issues.apache.org/jira/browse/SPARK-45452?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Dongjoon Hyun resolved SPARK-45452. --- Fix Version/s: 4.0.0 Resolution: Fixed Issue resolved by pull request 43261 [https://github.com/apache/spark/pull/43261] > Improve InMemoryFileIndex to use FileSystem.listFiles API > - > > Key: SPARK-45452 > URL: https://issues.apache.org/jira/browse/SPARK-45452 > Project: Spark > Issue Type: Improvement > Components: SQL >Affects Versions: 4.0.0 >Reporter: Dongjoon Hyun >Assignee: Dongjoon Hyun >Priority: Major > Labels: pull-request-available > Fix For: 4.0.0 > > -- This message was sent by Atlassian Jira (v8.20.10#820010) - To unsubscribe, e-mail: issues-unsubscr...@spark.apache.org For additional commands, e-mail: issues-h...@spark.apache.org
[jira] [Assigned] (SPARK-45452) Improve InMemoryFileIndex to use FileSystem.listFiles API
[ https://issues.apache.org/jira/browse/SPARK-45452?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Dongjoon Hyun reassigned SPARK-45452: - Assignee: Dongjoon Hyun > Improve InMemoryFileIndex to use FileSystem.listFiles API > - > > Key: SPARK-45452 > URL: https://issues.apache.org/jira/browse/SPARK-45452 > Project: Spark > Issue Type: Improvement > Components: SQL >Affects Versions: 4.0.0 >Reporter: Dongjoon Hyun >Assignee: Dongjoon Hyun >Priority: Major > Labels: pull-request-available > -- This message was sent by Atlassian Jira (v8.20.10#820010) - To unsubscribe, e-mail: issues-unsubscr...@spark.apache.org For additional commands, e-mail: issues-h...@spark.apache.org
[jira] [Updated] (SPARK-45452) Improve InMemoryFileIndex to use FileSystem.listFiles API
[ https://issues.apache.org/jira/browse/SPARK-45452?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Dongjoon Hyun updated SPARK-45452: -- Parent: SPARK-44111 Issue Type: Sub-task (was: Improvement) > Improve InMemoryFileIndex to use FileSystem.listFiles API > - > > Key: SPARK-45452 > URL: https://issues.apache.org/jira/browse/SPARK-45452 > Project: Spark > Issue Type: Sub-task > Components: SQL >Affects Versions: 4.0.0 >Reporter: Dongjoon Hyun >Assignee: Dongjoon Hyun >Priority: Major > Labels: pull-request-available > Fix For: 4.0.0 > > -- This message was sent by Atlassian Jira (v8.20.10#820010) - To unsubscribe, e-mail: issues-unsubscr...@spark.apache.org For additional commands, e-mail: issues-h...@spark.apache.org
[jira] [Assigned] (SPARK-45447) Reduce the memory required to start the LocalClusterSparkContext in the mllib module test cases. #43242
[ https://issues.apache.org/jira/browse/SPARK-45447?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Dongjoon Hyun reassigned SPARK-45447: - Assignee: Yang Jie > Reduce the memory required to start the LocalClusterSparkContext in the mllib > module test cases. #43242 > --- > > Key: SPARK-45447 > URL: https://issues.apache.org/jira/browse/SPARK-45447 > Project: Spark > Issue Type: Improvement > Components: MLlib, Tests >Affects Versions: 4.0.0 >Reporter: Yang Jie >Assignee: Yang Jie >Priority: Major > Labels: pull-request-available > -- This message was sent by Atlassian Jira (v8.20.10#820010) - To unsubscribe, e-mail: issues-unsubscr...@spark.apache.org For additional commands, e-mail: issues-h...@spark.apache.org
[jira] [Resolved] (SPARK-45447) Reduce the memory required to start the LocalClusterSparkContext in the mllib module test cases. #43242
[ https://issues.apache.org/jira/browse/SPARK-45447?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Dongjoon Hyun resolved SPARK-45447. --- Fix Version/s: 4.0.0 Resolution: Fixed Issue resolved by pull request 43242 [https://github.com/apache/spark/pull/43242] > Reduce the memory required to start the LocalClusterSparkContext in the mllib > module test cases. #43242 > --- > > Key: SPARK-45447 > URL: https://issues.apache.org/jira/browse/SPARK-45447 > Project: Spark > Issue Type: Improvement > Components: MLlib, Tests >Affects Versions: 4.0.0 >Reporter: Yang Jie >Assignee: Yang Jie >Priority: Major > Labels: pull-request-available > Fix For: 4.0.0 > > -- This message was sent by Atlassian Jira (v8.20.10#820010) - To unsubscribe, e-mail: issues-unsubscr...@spark.apache.org For additional commands, e-mail: issues-h...@spark.apache.org
[jira] [Assigned] (SPARK-45441) Introduce more util functions for PythonWorkerUtils
[ https://issues.apache.org/jira/browse/SPARK-45441?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Dongjoon Hyun reassigned SPARK-45441: - Assignee: Takuya Ueshin > Introduce more util functions for PythonWorkerUtils > --- > > Key: SPARK-45441 > URL: https://issues.apache.org/jira/browse/SPARK-45441 > Project: Spark > Issue Type: Improvement > Components: PySpark >Affects Versions: 4.0.0 >Reporter: Takuya Ueshin >Assignee: Takuya Ueshin >Priority: Major > Labels: pull-request-available > -- This message was sent by Atlassian Jira (v8.20.10#820010) - To unsubscribe, e-mail: issues-unsubscr...@spark.apache.org For additional commands, e-mail: issues-h...@spark.apache.org
[jira] [Resolved] (SPARK-45441) Introduce more util functions for PythonWorkerUtils
[ https://issues.apache.org/jira/browse/SPARK-45441?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Dongjoon Hyun resolved SPARK-45441. --- Fix Version/s: 4.0.0 Resolution: Fixed Issue resolved by pull request 43251 [https://github.com/apache/spark/pull/43251] > Introduce more util functions for PythonWorkerUtils > --- > > Key: SPARK-45441 > URL: https://issues.apache.org/jira/browse/SPARK-45441 > Project: Spark > Issue Type: Improvement > Components: PySpark >Affects Versions: 4.0.0 >Reporter: Takuya Ueshin >Assignee: Takuya Ueshin >Priority: Major > Labels: pull-request-available > Fix For: 4.0.0 > > -- This message was sent by Atlassian Jira (v8.20.10#820010) - To unsubscribe, e-mail: issues-unsubscr...@spark.apache.org For additional commands, e-mail: issues-h...@spark.apache.org
[jira] [Resolved] (SPARK-45239) Reduce default spark.connect.jvmStacktrace.maxSize
[ https://issues.apache.org/jira/browse/SPARK-45239?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Dongjoon Hyun resolved SPARK-45239. --- Fix Version/s: 4.0.0 Resolution: Fixed Issue resolved by pull request 43017 [https://github.com/apache/spark/pull/43017] > Reduce default spark.connect.jvmStacktrace.maxSize > -- > > Key: SPARK-45239 > URL: https://issues.apache.org/jira/browse/SPARK-45239 > Project: Spark > Issue Type: New Feature > Components: Connect >Affects Versions: 3.5.0, 4.0.0 >Reporter: Yihong He >Assignee: Yihong He >Priority: Minor > Labels: pull-request-available > Fix For: 4.0.0 > > -- This message was sent by Atlassian Jira (v8.20.10#820010) - To unsubscribe, e-mail: issues-unsubscr...@spark.apache.org For additional commands, e-mail: issues-h...@spark.apache.org
[jira] [Resolved] (SPARK-45436) DataFrame methods check same session
[ https://issues.apache.org/jira/browse/SPARK-45436?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Dongjoon Hyun resolved SPARK-45436. --- Fix Version/s: 4.0.0 Resolution: Fixed Issue resolved by pull request 43248 [https://github.com/apache/spark/pull/43248] > DataFrame methods check same session > > > Key: SPARK-45436 > URL: https://issues.apache.org/jira/browse/SPARK-45436 > Project: Spark > Issue Type: Improvement > Components: Connect, PySpark >Affects Versions: 4.0.0 >Reporter: Ruifeng Zheng >Assignee: Ruifeng Zheng >Priority: Major > Labels: pull-request-available > Fix For: 4.0.0 > > -- This message was sent by Atlassian Jira (v8.20.10#820010) - To unsubscribe, e-mail: issues-unsubscr...@spark.apache.org For additional commands, e-mail: issues-h...@spark.apache.org
[jira] [Assigned] (SPARK-45436) DataFrame methods check same session
[ https://issues.apache.org/jira/browse/SPARK-45436?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Dongjoon Hyun reassigned SPARK-45436: - Assignee: Ruifeng Zheng > DataFrame methods check same session > > > Key: SPARK-45436 > URL: https://issues.apache.org/jira/browse/SPARK-45436 > Project: Spark > Issue Type: Improvement > Components: Connect, PySpark >Affects Versions: 4.0.0 >Reporter: Ruifeng Zheng >Assignee: Ruifeng Zheng >Priority: Major > Labels: pull-request-available > -- This message was sent by Atlassian Jira (v8.20.10#820010) - To unsubscribe, e-mail: issues-unsubscr...@spark.apache.org For additional commands, e-mail: issues-h...@spark.apache.org
[jira] [Commented] (SPARK-45389) Correct MetaException matching rule on getting partition metadata
[ https://issues.apache.org/jira/browse/SPARK-45389?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17772892#comment-17772892 ] Dongjoon Hyun commented on SPARK-45389: --- This landed at branch-3.5 via [https://github.com/apache/spark/pull/43260] > Correct MetaException matching rule on getting partition metadata > - > > Key: SPARK-45389 > URL: https://issues.apache.org/jira/browse/SPARK-45389 > Project: Spark > Issue Type: Bug > Components: SQL >Affects Versions: 3.3.3 >Reporter: Cheng Pan >Assignee: Cheng Pan >Priority: Major > Labels: pull-request-available > Fix For: 4.0.0, 3.5.1 > > -- This message was sent by Atlassian Jira (v8.20.10#820010) - To unsubscribe, e-mail: issues-unsubscr...@spark.apache.org For additional commands, e-mail: issues-h...@spark.apache.org
[jira] [Updated] (SPARK-45389) Correct MetaException matching rule on getting partition metadata
[ https://issues.apache.org/jira/browse/SPARK-45389?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Dongjoon Hyun updated SPARK-45389: -- Fix Version/s: 3.5.1 > Correct MetaException matching rule on getting partition metadata > - > > Key: SPARK-45389 > URL: https://issues.apache.org/jira/browse/SPARK-45389 > Project: Spark > Issue Type: Bug > Components: SQL >Affects Versions: 3.3.3 >Reporter: Cheng Pan >Assignee: Cheng Pan >Priority: Major > Labels: pull-request-available > Fix For: 4.0.0, 3.5.1 > > -- This message was sent by Atlassian Jira (v8.20.10#820010) - To unsubscribe, e-mail: issues-unsubscr...@spark.apache.org For additional commands, e-mail: issues-h...@spark.apache.org
[jira] [Resolved] (SPARK-45448) Fix imports according to PEP8: pyspark.testing, pyspark.mllib, pyspark.resource and pyspark.streaming
[ https://issues.apache.org/jira/browse/SPARK-45448?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Dongjoon Hyun resolved SPARK-45448. --- Fix Version/s: 4.0.0 Resolution: Fixed Issue resolved by pull request 43256 [https://github.com/apache/spark/pull/43256] > Fix imports according to PEP8: pyspark.testing, pyspark.mllib, > pyspark.resource and pyspark.streaming > - > > Key: SPARK-45448 > URL: https://issues.apache.org/jira/browse/SPARK-45448 > Project: Spark > Issue Type: Improvement > Components: PySpark >Affects Versions: 4.0.0 >Reporter: Hyukjin Kwon >Assignee: Hyukjin Kwon >Priority: Major > Labels: pull-request-available > Fix For: 4.0.0 > > > https://peps.python.org/pep-0008/#imports -- This message was sent by Atlassian Jira (v8.20.10#820010) - To unsubscribe, e-mail: issues-unsubscr...@spark.apache.org For additional commands, e-mail: issues-h...@spark.apache.org
[jira] [Resolved] (SPARK-45446) Fix imports according to PEP8: pyspark.errors and pyspark.ml
[ https://issues.apache.org/jira/browse/SPARK-45446?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Dongjoon Hyun resolved SPARK-45446. --- Fix Version/s: 4.0.0 Resolution: Fixed Issue resolved by pull request 43255 [https://github.com/apache/spark/pull/43255] > Fix imports according to PEP8: pyspark.errors and pyspark.ml > > > Key: SPARK-45446 > URL: https://issues.apache.org/jira/browse/SPARK-45446 > Project: Spark > Issue Type: Improvement > Components: PySpark >Affects Versions: 4.0.0 >Reporter: Hyukjin Kwon >Assignee: Hyukjin Kwon >Priority: Major > Labels: pull-request-available > Fix For: 4.0.0 > > > https://peps.python.org/pep-0008/#imports -- This message was sent by Atlassian Jira (v8.20.10#820010) - To unsubscribe, e-mail: issues-unsubscr...@spark.apache.org For additional commands, e-mail: issues-h...@spark.apache.org
[jira] [Assigned] (SPARK-45444) Upgrade `commons-io` to 1.24.0
[ https://issues.apache.org/jira/browse/SPARK-45444?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Dongjoon Hyun reassigned SPARK-45444: - Assignee: BingKun Pan > Upgrade `commons-io` to 1.24.0 > -- > > Key: SPARK-45444 > URL: https://issues.apache.org/jira/browse/SPARK-45444 > Project: Spark > Issue Type: Improvement > Components: Build >Affects Versions: 4.0.0 >Reporter: BingKun Pan >Assignee: BingKun Pan >Priority: Trivial > Labels: pull-request-available > -- This message was sent by Atlassian Jira (v8.20.10#820010) - To unsubscribe, e-mail: issues-unsubscr...@spark.apache.org For additional commands, e-mail: issues-h...@spark.apache.org
[jira] [Resolved] (SPARK-45444) Upgrade `commons-io` to 1.24.0
[ https://issues.apache.org/jira/browse/SPARK-45444?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Dongjoon Hyun resolved SPARK-45444. --- Fix Version/s: 4.0.0 Resolution: Fixed Issue resolved by pull request 43253 [https://github.com/apache/spark/pull/43253] > Upgrade `commons-io` to 1.24.0 > -- > > Key: SPARK-45444 > URL: https://issues.apache.org/jira/browse/SPARK-45444 > Project: Spark > Issue Type: Improvement > Components: Build >Affects Versions: 4.0.0 >Reporter: BingKun Pan >Assignee: BingKun Pan >Priority: Trivial > Labels: pull-request-available > Fix For: 4.0.0 > > -- This message was sent by Atlassian Jira (v8.20.10#820010) - To unsubscribe, e-mail: issues-unsubscr...@spark.apache.org For additional commands, e-mail: issues-h...@spark.apache.org
[jira] [Assigned] (SPARK-45445) Upgrade snappy to 1.1.10.5
[ https://issues.apache.org/jira/browse/SPARK-45445?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Dongjoon Hyun reassigned SPARK-45445: - Assignee: BingKun Pan > Upgrade snappy to 1.1.10.5 > -- > > Key: SPARK-45445 > URL: https://issues.apache.org/jira/browse/SPARK-45445 > Project: Spark > Issue Type: Improvement > Components: Build >Affects Versions: 4.0.0 >Reporter: BingKun Pan >Assignee: BingKun Pan >Priority: Minor > Labels: pull-request-available > -- This message was sent by Atlassian Jira (v8.20.10#820010) - To unsubscribe, e-mail: issues-unsubscr...@spark.apache.org For additional commands, e-mail: issues-h...@spark.apache.org
[jira] [Resolved] (SPARK-45445) Upgrade snappy to 1.1.10.5
[ https://issues.apache.org/jira/browse/SPARK-45445?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Dongjoon Hyun resolved SPARK-45445. --- Fix Version/s: 4.0.0 Resolution: Fixed Issue resolved by pull request 43254 [https://github.com/apache/spark/pull/43254] > Upgrade snappy to 1.1.10.5 > -- > > Key: SPARK-45445 > URL: https://issues.apache.org/jira/browse/SPARK-45445 > Project: Spark > Issue Type: Improvement > Components: Build >Affects Versions: 4.0.0 >Reporter: BingKun Pan >Assignee: BingKun Pan >Priority: Minor > Labels: pull-request-available > Fix For: 4.0.0 > > -- This message was sent by Atlassian Jira (v8.20.10#820010) - To unsubscribe, e-mail: issues-unsubscr...@spark.apache.org For additional commands, e-mail: issues-h...@spark.apache.org
[jira] [Updated] (SPARK-45457) Surface sc.setLocalProperty() value=NULL param meaning
[ https://issues.apache.org/jira/browse/SPARK-45457?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] ASF GitHub Bot updated SPARK-45457: --- Labels: pull-request-available (was: ) > Surface sc.setLocalProperty() value=NULL param meaning > -- > > Key: SPARK-45457 > URL: https://issues.apache.org/jira/browse/SPARK-45457 > Project: Spark > Issue Type: Improvement > Components: Documentation >Affects Versions: 3.5.0 >Reporter: Khalid Mammadov >Priority: Major > Labels: pull-request-available > > sc.setLocalProperty() has special meaning/feature and when supplied then > removes the property associated to key parameter. It's only mentioned in the > Fair Scheduler section of the documentation. > It would be nice to document that on the API's as well for users. -- This message was sent by Atlassian Jira (v8.20.10#820010) - To unsubscribe, e-mail: issues-unsubscr...@spark.apache.org For additional commands, e-mail: issues-h...@spark.apache.org
[jira] [Commented] (SPARK-44924) Add configurations for FileStreamSource cached files
[ https://issues.apache.org/jira/browse/SPARK-44924?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17772845#comment-17772845 ] Mike K commented on SPARK-44924: User 'ragnarok56' has created a pull request for this issue: https://github.com/apache/spark/pull/42623 > Add configurations for FileStreamSource cached files > > > Key: SPARK-44924 > URL: https://issues.apache.org/jira/browse/SPARK-44924 > Project: Spark > Issue Type: Improvement > Components: Structured Streaming >Affects Versions: 3.1.0 >Reporter: kevin nacios >Priority: Minor > > With https://issues.apache.org/jira/browse/SPARK-30866, caching of listed > files was added for structured streaming to reduce cost of relisting from > filesystem each batch. The settings that drive this are currently hardcoded > and there is no way to change them. > > This impacts some of our workloads where we process large datasets where its > unknown how "heavy" some files are, so a single batch can take a long period > of time. When we set maxFilesPerTrigger to 100k files, a subsequent batch > using the cached max of 10k files is causing the job to take longer since the > cluster is capable of handling the 100k files but is stuck doing 10% of the > workload. The benefit of the caching doesn't outweigh the cost of the > performance on the rest of the job. > > With config settings available for this, we could either absorb some > increased driver memory usage for caching the next 100k files, or opt to > disable caching entirely and just relist files each batch by setting the > cache amount to 0. -- This message was sent by Atlassian Jira (v8.20.10#820010) - To unsubscribe, e-mail: issues-unsubscr...@spark.apache.org For additional commands, e-mail: issues-h...@spark.apache.org
[jira] [Updated] (SPARK-45456) Upgrade maven to 3.9.5
[ https://issues.apache.org/jira/browse/SPARK-45456?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] ASF GitHub Bot updated SPARK-45456: --- Labels: pull-request-available (was: ) > Upgrade maven to 3.9.5 > -- > > Key: SPARK-45456 > URL: https://issues.apache.org/jira/browse/SPARK-45456 > Project: Spark > Issue Type: Improvement > Components: Build >Affects Versions: 4.0.0 >Reporter: Yang Jie >Priority: Minor > Labels: pull-request-available > -- This message was sent by Atlassian Jira (v8.20.10#820010) - To unsubscribe, e-mail: issues-unsubscr...@spark.apache.org For additional commands, e-mail: issues-h...@spark.apache.org
[jira] [Created] (SPARK-45456) Upgrade maven to 3.9.5
Yang Jie created SPARK-45456: Summary: Upgrade maven to 3.9.5 Key: SPARK-45456 URL: https://issues.apache.org/jira/browse/SPARK-45456 Project: Spark Issue Type: Improvement Components: Build Affects Versions: 4.0.0 Reporter: Yang Jie -- This message was sent by Atlassian Jira (v8.20.10#820010) - To unsubscribe, e-mail: issues-unsubscr...@spark.apache.org For additional commands, e-mail: issues-h...@spark.apache.org
[jira] [Updated] (SPARK-45455) [SQL][JDBC] Improve the rename interface of Postgres Dialect
[ https://issues.apache.org/jira/browse/SPARK-45455?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] 蔡灿材 updated SPARK-45455: Summary: [SQL][JDBC] Improve the rename interface of Postgres Dialect (was: [SQL][JDBC] Improve the rename interface of Postgres Dialect and mysql Dialect) > [SQL][JDBC] Improve the rename interface of Postgres Dialect > > > Key: SPARK-45455 > URL: https://issues.apache.org/jira/browse/SPARK-45455 > Project: Spark > Issue Type: Improvement > Components: SQL >Affects Versions: 3.5.0 >Reporter: 蔡灿材 >Priority: Minor > Labels: pull-request-available > Fix For: 3.5.0 > > > Improve the rename interface of pgdialect and mysqldialec > [MySQL :: MySQL 8.0 Reference Manual :: 13.1.36 RENAME TABLE > Statement|https://dev.mysql.com/doc/refman/8.0/en/rename-table.html] -- This message was sent by Atlassian Jira (v8.20.10#820010) - To unsubscribe, e-mail: issues-unsubscr...@spark.apache.org For additional commands, e-mail: issues-h...@spark.apache.org
[jira] [Updated] (SPARK-45455) [SQL][JDBC] Improve the rename interface of Postgres Dialect and mysql Dialect
[ https://issues.apache.org/jira/browse/SPARK-45455?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] 蔡灿材 updated SPARK-45455: Summary: [SQL][JDBC] Improve the rename interface of Postgres Dialect and mysql Dialect (was: [SQL][JDBC] Improve the rename interface of Postgres Dialect) > [SQL][JDBC] Improve the rename interface of Postgres Dialect and mysql Dialect > -- > > Key: SPARK-45455 > URL: https://issues.apache.org/jira/browse/SPARK-45455 > Project: Spark > Issue Type: Improvement > Components: SQL >Affects Versions: 3.5.0 >Reporter: 蔡灿材 >Priority: Minor > Labels: pull-request-available > Fix For: 3.5.0 > > > Improve the rename interface of pgdialect and mysqldialec > [MySQL :: MySQL 8.0 Reference Manual :: 13.1.36 RENAME TABLE > Statement|https://dev.mysql.com/doc/refman/8.0/en/rename-table.html] -- This message was sent by Atlassian Jira (v8.20.10#820010) - To unsubscribe, e-mail: issues-unsubscr...@spark.apache.org For additional commands, e-mail: issues-h...@spark.apache.org
[jira] [Resolved] (SPARK-45453) [Spark SQL][JDBC] Imporve Annotation normalization
[ https://issues.apache.org/jira/browse/SPARK-45453?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] 蔡灿材 resolved SPARK-45453. - Resolution: Fixed > [Spark SQL][JDBC] Imporve Annotation normalization > -- > > Key: SPARK-45453 > URL: https://issues.apache.org/jira/browse/SPARK-45453 > Project: Spark > Issue Type: Improvement > Components: SQL >Affects Versions: 3.5.0 >Reporter: 蔡灿材 >Priority: Trivial > Labels: easyfix, pull-request-available > > Annotation normalization > -- This message was sent by Atlassian Jira (v8.20.10#820010) - To unsubscribe, e-mail: issues-unsubscr...@spark.apache.org For additional commands, e-mail: issues-h...@spark.apache.org
[jira] [Updated] (SPARK-45455) [SQL][JDBC] Improve the rename interface of PostgresDialect
[ https://issues.apache.org/jira/browse/SPARK-45455?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] 蔡灿材 updated SPARK-45455: Summary: [SQL][JDBC] Improve the rename interface of PostgresDialect (was: [SQL][JDBC] Improve the rename interface of pgdialect) > [SQL][JDBC] Improve the rename interface of PostgresDialect > --- > > Key: SPARK-45455 > URL: https://issues.apache.org/jira/browse/SPARK-45455 > Project: Spark > Issue Type: Improvement > Components: SQL >Affects Versions: 3.5.0 >Reporter: 蔡灿材 >Priority: Minor > Labels: pull-request-available > Fix For: 3.5.0 > > > Improve the rename interface of pgdialect and mysqldialec > [MySQL :: MySQL 8.0 Reference Manual :: 13.1.36 RENAME TABLE > Statement|https://dev.mysql.com/doc/refman/8.0/en/rename-table.html] -- This message was sent by Atlassian Jira (v8.20.10#820010) - To unsubscribe, e-mail: issues-unsubscr...@spark.apache.org For additional commands, e-mail: issues-h...@spark.apache.org
[jira] [Updated] (SPARK-45455) [SQL][JDBC] Improve the rename interface of Postgres Dialect
[ https://issues.apache.org/jira/browse/SPARK-45455?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] 蔡灿材 updated SPARK-45455: Summary: [SQL][JDBC] Improve the rename interface of Postgres Dialect (was: [SQL][JDBC] Improve the rename interface of PostgresDialect) > [SQL][JDBC] Improve the rename interface of Postgres Dialect > > > Key: SPARK-45455 > URL: https://issues.apache.org/jira/browse/SPARK-45455 > Project: Spark > Issue Type: Improvement > Components: SQL >Affects Versions: 3.5.0 >Reporter: 蔡灿材 >Priority: Minor > Labels: pull-request-available > Fix For: 3.5.0 > > > Improve the rename interface of pgdialect and mysqldialec > [MySQL :: MySQL 8.0 Reference Manual :: 13.1.36 RENAME TABLE > Statement|https://dev.mysql.com/doc/refman/8.0/en/rename-table.html] -- This message was sent by Atlassian Jira (v8.20.10#820010) - To unsubscribe, e-mail: issues-unsubscr...@spark.apache.org For additional commands, e-mail: issues-h...@spark.apache.org
[jira] [Updated] (SPARK-45455) [SQL][JDBC] Improve the rename interface of pgdialect
[ https://issues.apache.org/jira/browse/SPARK-45455?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] 蔡灿材 updated SPARK-45455: Summary: [SQL][JDBC] Improve the rename interface of pgdialect (was: [SQL][JDBC] Improve the rename interface of pgdialect and mysqldialect) > [SQL][JDBC] Improve the rename interface of pgdialect > - > > Key: SPARK-45455 > URL: https://issues.apache.org/jira/browse/SPARK-45455 > Project: Spark > Issue Type: Improvement > Components: SQL >Affects Versions: 3.5.0 >Reporter: 蔡灿材 >Priority: Minor > Labels: pull-request-available > Fix For: 3.5.0 > > > Improve the rename interface of pgdialect and mysqldialec > [MySQL :: MySQL 8.0 Reference Manual :: 13.1.36 RENAME TABLE > Statement|https://dev.mysql.com/doc/refman/8.0/en/rename-table.html] -- This message was sent by Atlassian Jira (v8.20.10#820010) - To unsubscribe, e-mail: issues-unsubscr...@spark.apache.org For additional commands, e-mail: issues-h...@spark.apache.org
[jira] [Updated] (SPARK-45455) [SQL][JDBC] Improve the rename interface of pgdialect and mysqldialect
[ https://issues.apache.org/jira/browse/SPARK-45455?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] 蔡灿材 updated SPARK-45455: Summary: [SQL][JDBC] Improve the rename interface of pgdialect and mysqldialect (was: Improve the rename interface of pgdialect and mysqldialect) > [SQL][JDBC] Improve the rename interface of pgdialect and mysqldialect > -- > > Key: SPARK-45455 > URL: https://issues.apache.org/jira/browse/SPARK-45455 > Project: Spark > Issue Type: Improvement > Components: SQL >Affects Versions: 3.5.0 >Reporter: 蔡灿材 >Priority: Minor > Labels: pull-request-available > Fix For: 3.5.0 > > > Improve the rename interface of pgdialect and mysqldialec > [MySQL :: MySQL 8.0 Reference Manual :: 13.1.36 RENAME TABLE > Statement|https://dev.mysql.com/doc/refman/8.0/en/rename-table.html] -- This message was sent by Atlassian Jira (v8.20.10#820010) - To unsubscribe, e-mail: issues-unsubscr...@spark.apache.org For additional commands, e-mail: issues-h...@spark.apache.org
[jira] [Updated] (SPARK-45455) Improve the rename interface of pgdialect
[ https://issues.apache.org/jira/browse/SPARK-45455?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] 蔡灿材 updated SPARK-45455: Summary: Improve the rename interface of pgdialect (was: Improve the rename interface of pgdialect and mysqldialec) > Improve the rename interface of pgdialect > -- > > Key: SPARK-45455 > URL: https://issues.apache.org/jira/browse/SPARK-45455 > Project: Spark > Issue Type: Improvement > Components: SQL >Affects Versions: 3.5.0 >Reporter: 蔡灿材 >Priority: Minor > Labels: pull-request-available > Fix For: 3.5.0 > > > Improve the rename interface of pgdialect and mysqldialec > [MySQL :: MySQL 8.0 Reference Manual :: 13.1.36 RENAME TABLE > Statement|https://dev.mysql.com/doc/refman/8.0/en/rename-table.html] -- This message was sent by Atlassian Jira (v8.20.10#820010) - To unsubscribe, e-mail: issues-unsubscr...@spark.apache.org For additional commands, e-mail: issues-h...@spark.apache.org
[jira] [Updated] (SPARK-45455) Improve the rename interface of pgdialect and mysqldialect
[ https://issues.apache.org/jira/browse/SPARK-45455?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] 蔡灿材 updated SPARK-45455: Summary: Improve the rename interface of pgdialect and mysqldialect (was: Improve the rename interface of pgdialect) > Improve the rename interface of pgdialect and mysqldialect > --- > > Key: SPARK-45455 > URL: https://issues.apache.org/jira/browse/SPARK-45455 > Project: Spark > Issue Type: Improvement > Components: SQL >Affects Versions: 3.5.0 >Reporter: 蔡灿材 >Priority: Minor > Labels: pull-request-available > Fix For: 3.5.0 > > > Improve the rename interface of pgdialect and mysqldialec > [MySQL :: MySQL 8.0 Reference Manual :: 13.1.36 RENAME TABLE > Statement|https://dev.mysql.com/doc/refman/8.0/en/rename-table.html] -- This message was sent by Atlassian Jira (v8.20.10#820010) - To unsubscribe, e-mail: issues-unsubscr...@spark.apache.org For additional commands, e-mail: issues-h...@spark.apache.org
[jira] [Updated] (SPARK-45455) Improve the rename interface of pgdialect and mysqldialec
[ https://issues.apache.org/jira/browse/SPARK-45455?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] ASF GitHub Bot updated SPARK-45455: --- Labels: pull-request-available (was: ) > Improve the rename interface of pgdialect and mysqldialec > -- > > Key: SPARK-45455 > URL: https://issues.apache.org/jira/browse/SPARK-45455 > Project: Spark > Issue Type: Improvement > Components: SQL >Affects Versions: 3.5.0 >Reporter: 蔡灿材 >Priority: Minor > Labels: pull-request-available > Fix For: 3.5.0 > > > Improve the rename interface of pgdialect and mysqldialec > [MySQL :: MySQL 8.0 Reference Manual :: 13.1.36 RENAME TABLE > Statement|https://dev.mysql.com/doc/refman/8.0/en/rename-table.html] -- This message was sent by Atlassian Jira (v8.20.10#820010) - To unsubscribe, e-mail: issues-unsubscr...@spark.apache.org For additional commands, e-mail: issues-h...@spark.apache.org
[jira] [Commented] (SPARK-45447) Reduce the memory required to start the LocalClusterSparkContext in the mllib module test cases. #43242
[ https://issues.apache.org/jira/browse/SPARK-45447?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17772806#comment-17772806 ] Nikita Awasthi commented on SPARK-45447: User 'LuciferYang' has created a pull request for this issue: https://github.com/apache/spark/pull/43242 > Reduce the memory required to start the LocalClusterSparkContext in the mllib > module test cases. #43242 > --- > > Key: SPARK-45447 > URL: https://issues.apache.org/jira/browse/SPARK-45447 > Project: Spark > Issue Type: Improvement > Components: MLlib, Tests >Affects Versions: 4.0.0 >Reporter: Yang Jie >Priority: Major > Labels: pull-request-available > -- This message was sent by Atlassian Jira (v8.20.10#820010) - To unsubscribe, e-mail: issues-unsubscr...@spark.apache.org For additional commands, e-mail: issues-h...@spark.apache.org
[jira] [Updated] (SPARK-45447) Reduce the memory required to start the LocalClusterSparkContext in the mllib module test cases. #43242
[ https://issues.apache.org/jira/browse/SPARK-45447?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] ASF GitHub Bot updated SPARK-45447: --- Labels: pull-request-available (was: ) > Reduce the memory required to start the LocalClusterSparkContext in the mllib > module test cases. #43242 > --- > > Key: SPARK-45447 > URL: https://issues.apache.org/jira/browse/SPARK-45447 > Project: Spark > Issue Type: Improvement > Components: MLlib, Tests >Affects Versions: 4.0.0 >Reporter: Yang Jie >Priority: Major > Labels: pull-request-available > -- This message was sent by Atlassian Jira (v8.20.10#820010) - To unsubscribe, e-mail: issues-unsubscr...@spark.apache.org For additional commands, e-mail: issues-h...@spark.apache.org
[jira] [Created] (SPARK-45455) Improve the rename interface of pgdialect and mysqldialec
蔡灿材 created SPARK-45455: --- Summary: Improve the rename interface of pgdialect and mysqldialec Key: SPARK-45455 URL: https://issues.apache.org/jira/browse/SPARK-45455 Project: Spark Issue Type: Improvement Components: SQL Affects Versions: 3.5.0 Reporter: 蔡灿材 Fix For: 3.5.0 Improve the rename interface of pgdialect and mysqldialec [MySQL :: MySQL 8.0 Reference Manual :: 13.1.36 RENAME TABLE Statement|https://dev.mysql.com/doc/refman/8.0/en/rename-table.html] -- This message was sent by Atlassian Jira (v8.20.10#820010) - To unsubscribe, e-mail: issues-unsubscr...@spark.apache.org For additional commands, e-mail: issues-h...@spark.apache.org
[jira] [Updated] (SPARK-45454) Set owner of DS v2 table to CURRENT_USER if it is already set
[ https://issues.apache.org/jira/browse/SPARK-45454?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] ASF GitHub Bot updated SPARK-45454: --- Labels: pull-request-available (was: ) > Set owner of DS v2 table to CURRENT_USER if it is already set > - > > Key: SPARK-45454 > URL: https://issues.apache.org/jira/browse/SPARK-45454 > Project: Spark > Issue Type: Sub-task > Components: SQL >Affects Versions: 4.0.0 >Reporter: Yuming Wang >Priority: Major > Labels: pull-request-available > -- This message was sent by Atlassian Jira (v8.20.10#820010) - To unsubscribe, e-mail: issues-unsubscr...@spark.apache.org For additional commands, e-mail: issues-h...@spark.apache.org
[jira] [Created] (SPARK-45454) Set owner of DS v2 table to CURRENT_USER if it is already set
Yuming Wang created SPARK-45454: --- Summary: Set owner of DS v2 table to CURRENT_USER if it is already set Key: SPARK-45454 URL: https://issues.apache.org/jira/browse/SPARK-45454 Project: Spark Issue Type: Sub-task Components: SQL Affects Versions: 4.0.0 Reporter: Yuming Wang -- This message was sent by Atlassian Jira (v8.20.10#820010) - To unsubscribe, e-mail: issues-unsubscr...@spark.apache.org For additional commands, e-mail: issues-h...@spark.apache.org
[jira] [Updated] (SPARK-45453) [Spark SQL][JDBC] Imporve Annotation normalization
[ https://issues.apache.org/jira/browse/SPARK-45453?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] 蔡灿材 updated SPARK-45453: Summary: [Spark SQL][JDBC] Imporve Annotation normalization (was: [Spark SQL][JDBC] Annotation normalization) > [Spark SQL][JDBC] Imporve Annotation normalization > -- > > Key: SPARK-45453 > URL: https://issues.apache.org/jira/browse/SPARK-45453 > Project: Spark > Issue Type: Improvement > Components: SQL >Affects Versions: 3.5.0 >Reporter: 蔡灿材 >Priority: Trivial > Labels: easyfix, pull-request-available > > Annotation normalization > -- This message was sent by Atlassian Jira (v8.20.10#820010) - To unsubscribe, e-mail: issues-unsubscr...@spark.apache.org For additional commands, e-mail: issues-h...@spark.apache.org
[jira] [Updated] (SPARK-45453) [Spark SQL][JDBC] Annotation normalization
[ https://issues.apache.org/jira/browse/SPARK-45453?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] ASF GitHub Bot updated SPARK-45453: --- Labels: easyfix pull-request-available (was: easyfix) > [Spark SQL][JDBC] Annotation normalization > -- > > Key: SPARK-45453 > URL: https://issues.apache.org/jira/browse/SPARK-45453 > Project: Spark > Issue Type: Improvement > Components: SQL >Affects Versions: 3.5.0 >Reporter: 蔡灿材 >Priority: Trivial > Labels: easyfix, pull-request-available > > Annotation normalization > -- This message was sent by Atlassian Jira (v8.20.10#820010) - To unsubscribe, e-mail: issues-unsubscr...@spark.apache.org For additional commands, e-mail: issues-h...@spark.apache.org
[jira] [Assigned] (SPARK-45452) Improve InMemoryFileIndex to use FileSystem.listFiles API
[ https://issues.apache.org/jira/browse/SPARK-45452?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] ASF GitHub Bot reassigned SPARK-45452: -- Assignee: (was: Apache Spark) > Improve InMemoryFileIndex to use FileSystem.listFiles API > - > > Key: SPARK-45452 > URL: https://issues.apache.org/jira/browse/SPARK-45452 > Project: Spark > Issue Type: Improvement > Components: SQL >Affects Versions: 4.0.0 >Reporter: Dongjoon Hyun >Priority: Major > Labels: pull-request-available > -- This message was sent by Atlassian Jira (v8.20.10#820010) - To unsubscribe, e-mail: issues-unsubscr...@spark.apache.org For additional commands, e-mail: issues-h...@spark.apache.org
[jira] [Updated] (SPARK-45453) [Spark SQL][JDBC] Annotation normalization
[ https://issues.apache.org/jira/browse/SPARK-45453?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] 蔡灿材 updated SPARK-45453: Summary: [Spark SQL][JDBC] Annotation normalization (was: Annotation normalization) > [Spark SQL][JDBC] Annotation normalization > -- > > Key: SPARK-45453 > URL: https://issues.apache.org/jira/browse/SPARK-45453 > Project: Spark > Issue Type: Improvement > Components: SQL >Affects Versions: 3.5.0 >Reporter: 蔡灿材 >Priority: Trivial > Labels: easyfix > > Annotation normalization > -- This message was sent by Atlassian Jira (v8.20.10#820010) - To unsubscribe, e-mail: issues-unsubscr...@spark.apache.org For additional commands, e-mail: issues-h...@spark.apache.org
[jira] [Created] (SPARK-45453) Annotation normalization
蔡灿材 created SPARK-45453: --- Summary: Annotation normalization Key: SPARK-45453 URL: https://issues.apache.org/jira/browse/SPARK-45453 Project: Spark Issue Type: Improvement Components: SQL Affects Versions: 3.5.0 Reporter: 蔡灿材 Annotation normalization -- This message was sent by Atlassian Jira (v8.20.10#820010) - To unsubscribe, e-mail: issues-unsubscr...@spark.apache.org For additional commands, e-mail: issues-h...@spark.apache.org
[jira] [Assigned] (SPARK-45452) Improve InMemoryFileIndex to use FileSystem.listFiles API
[ https://issues.apache.org/jira/browse/SPARK-45452?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] ASF GitHub Bot reassigned SPARK-45452: -- Assignee: Apache Spark > Improve InMemoryFileIndex to use FileSystem.listFiles API > - > > Key: SPARK-45452 > URL: https://issues.apache.org/jira/browse/SPARK-45452 > Project: Spark > Issue Type: Improvement > Components: SQL >Affects Versions: 4.0.0 >Reporter: Dongjoon Hyun >Assignee: Apache Spark >Priority: Major > Labels: pull-request-available > -- This message was sent by Atlassian Jira (v8.20.10#820010) - To unsubscribe, e-mail: issues-unsubscr...@spark.apache.org For additional commands, e-mail: issues-h...@spark.apache.org
[jira] [Assigned] (SPARK-45452) Improve InMemoryFileIndex to use FileSystem.listFiles API
[ https://issues.apache.org/jira/browse/SPARK-45452?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] ASF GitHub Bot reassigned SPARK-45452: -- Assignee: Apache Spark > Improve InMemoryFileIndex to use FileSystem.listFiles API > - > > Key: SPARK-45452 > URL: https://issues.apache.org/jira/browse/SPARK-45452 > Project: Spark > Issue Type: Improvement > Components: SQL >Affects Versions: 4.0.0 >Reporter: Dongjoon Hyun >Assignee: Apache Spark >Priority: Major > Labels: pull-request-available > -- This message was sent by Atlassian Jira (v8.20.10#820010) - To unsubscribe, e-mail: issues-unsubscr...@spark.apache.org For additional commands, e-mail: issues-h...@spark.apache.org
[jira] [Assigned] (SPARK-45452) Improve InMemoryFileIndex to use FileSystem.listFiles API
[ https://issues.apache.org/jira/browse/SPARK-45452?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] ASF GitHub Bot reassigned SPARK-45452: -- Assignee: Apache Spark > Improve InMemoryFileIndex to use FileSystem.listFiles API > - > > Key: SPARK-45452 > URL: https://issues.apache.org/jira/browse/SPARK-45452 > Project: Spark > Issue Type: Improvement > Components: SQL >Affects Versions: 4.0.0 >Reporter: Dongjoon Hyun >Assignee: Apache Spark >Priority: Major > Labels: pull-request-available > -- This message was sent by Atlassian Jira (v8.20.10#820010) - To unsubscribe, e-mail: issues-unsubscr...@spark.apache.org For additional commands, e-mail: issues-h...@spark.apache.org
[jira] [Updated] (SPARK-45452) Improve InMemoryFileIndex to use FileSystem.listFiles API
[ https://issues.apache.org/jira/browse/SPARK-45452?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] ASF GitHub Bot updated SPARK-45452: --- Labels: pull-request-available (was: ) > Improve InMemoryFileIndex to use FileSystem.listFiles API > - > > Key: SPARK-45452 > URL: https://issues.apache.org/jira/browse/SPARK-45452 > Project: Spark > Issue Type: Improvement > Components: SQL >Affects Versions: 4.0.0 >Reporter: Dongjoon Hyun >Priority: Major > Labels: pull-request-available > -- This message was sent by Atlassian Jira (v8.20.10#820010) - To unsubscribe, e-mail: issues-unsubscr...@spark.apache.org For additional commands, e-mail: issues-h...@spark.apache.org
