[jira] [Updated] (SPARK-39653) Remove `ColumnVectorUtils#populate(WritableColumnVector, InternalRow, int) ` method

[ https://issues.apache.org/jira/browse/SPARK-39653?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Yang Jie updated SPARK-39653: - Summary: Remove `ColumnVectorUtils#populate(WritableColumnVector, InternalRow, int) ` method (was:

[jira] [Commented] (SPARK-39654) parameters quotechar and escapechar needs to limite to a char in pyspark pandas read_csv function

[ https://issues.apache.org/jira/browse/SPARK-39654?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17561358#comment-17561358 ] Apache Spark commented on SPARK-39654: -- User 'bzhaoopenstack' has created a pull request for this

[jira] [Assigned] (SPARK-39654) parameters quotechar and escapechar needs to limite to a char in pyspark pandas read_csv function

[ https://issues.apache.org/jira/browse/SPARK-39654?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-39654: Assignee: Apache Spark > parameters quotechar and escapechar needs to limite to a char

[jira] [Assigned] (SPARK-39654) parameters quotechar and escapechar needs to limite to a char in pyspark pandas read_csv function

[ https://issues.apache.org/jira/browse/SPARK-39654?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-39654: Assignee: (was: Apache Spark) > parameters quotechar and escapechar needs to limite

[jira] [Commented] (SPARK-39654) parameters quotechar and escapechar needs to limite to a char in pyspark pandas read_csv function

[ https://issues.apache.org/jira/browse/SPARK-39654?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17561359#comment-17561359 ] Apache Spark commented on SPARK-39654: -- User 'bzhaoopenstack' has created a pull request for this

[jira] [Commented] (SPARK-39608) Upgrade to spark 3.3.0 is causing error "Cannot grow BufferHolder by size -179446840 because the size is negative"

[ https://issues.apache.org/jira/browse/SPARK-39608?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17561380#comment-17561380 ] Qian Sun commented on SPARK-39608: -- Could you share more information? Such as spark application code or

[jira] [Assigned] (SPARK-39503) Add session catalog name for v1 database table and function

[ https://issues.apache.org/jira/browse/SPARK-39503?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Wenchen Fan reassigned SPARK-39503: --- Assignee: XiDuo You > Add session catalog name for v1 database table and function >

[jira] [Commented] (SPARK-39655) Add a config to limit CartesianProductExec's partition number

[ https://issues.apache.org/jira/browse/SPARK-39655?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17561426#comment-17561426 ] Apache Spark commented on SPARK-39655: -- User 'wangyum' has created a pull request for this issue:

[jira] [Assigned] (SPARK-39655) Add a config to limit CartesianProductExec's partition number

[ https://issues.apache.org/jira/browse/SPARK-39655?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-39655: Assignee: Apache Spark > Add a config to limit CartesianProductExec's partition number >

[jira] [Assigned] (SPARK-39655) Add a config to limit CartesianProductExec's partition number

[ https://issues.apache.org/jira/browse/SPARK-39655?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-39655: Assignee: (was: Apache Spark) > Add a config to limit CartesianProductExec's

[jira] [Created] (SPARK-39654) parameters quotechar and escapechar needs to limite to a char in pyspark pandas read_csv function

bo zhao created SPARK-39654: --- Summary: parameters quotechar and escapechar needs to limite to a char in pyspark pandas read_csv function Key: SPARK-39654 URL: https://issues.apache.org/jira/browse/SPARK-39654

[jira] [Created] (SPARK-39655) Add a config to limit CartesianProductExec's partition number

Yuming Wang created SPARK-39655: --- Summary: Add a config to limit CartesianProductExec's partition number Key: SPARK-39655 URL: https://issues.apache.org/jira/browse/SPARK-39655 Project: Spark

[jira] [Commented] (SPARK-39653) Remove `ColumnVectorUtils#populate(WritableColumnVector, InternalRow, int) ` method

[ https://issues.apache.org/jira/browse/SPARK-39653?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17561382#comment-17561382 ] Apache Spark commented on SPARK-39653: -- User 'LuciferYang' has created a pull request for this

[jira] [Assigned] (SPARK-39653) Remove `ColumnVectorUtils#populate(WritableColumnVector, InternalRow, int) ` method

[ https://issues.apache.org/jira/browse/SPARK-39653?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-39653: Assignee: (was: Apache Spark) > Remove

[jira] [Assigned] (SPARK-39653) Remove `ColumnVectorUtils#populate(WritableColumnVector, InternalRow, int) ` method

[ https://issues.apache.org/jira/browse/SPARK-39653?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-39653: Assignee: Apache Spark > Remove `ColumnVectorUtils#populate(WritableColumnVector,

[jira] [Commented] (SPARK-39655) Add a config to limit CartesianProductExec's partition number

[ https://issues.apache.org/jira/browse/SPARK-39655?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17561428#comment-17561428 ] Apache Spark commented on SPARK-39655: -- User 'wangyum' has created a pull request for this issue:

[jira] [Updated] (SPARK-39653) Remove `ColumnVectorUtils#populate`

[ https://issues.apache.org/jira/browse/SPARK-39653?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Yang Jie updated SPARK-39653: - Summary: Remove `ColumnVectorUtils#populate` (was: Move `ColumnVectorUtils#populate` to

[jira] [Created] (SPARK-39653) Move `ColumnVectorUtils#populate` to `ConstantColumnVectorBenchmark`

Yang Jie created SPARK-39653: Summary: Move `ColumnVectorUtils#populate` to `ConstantColumnVectorBenchmark` Key: SPARK-39653 URL: https://issues.apache.org/jira/browse/SPARK-39653 Project: Spark

[jira] [Resolved] (SPARK-39503) Add session catalog name for v1 database table and function

[ https://issues.apache.org/jira/browse/SPARK-39503?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Wenchen Fan resolved SPARK-39503. - Fix Version/s: 3.4.0 Resolution: Fixed Issue resolved by pull request 37021

[jira] [Commented] (SPARK-35223) Add IssueNavigationLink for IDEA

[ https://issues.apache.org/jira/browse/SPARK-35223?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17561411#comment-17561411 ] Apache Spark commented on SPARK-35223: -- User 'cloud-fan' has created a pull request for this issue:

[jira] [Assigned] (SPARK-39627) Unify compileAggregate and compileExpression

[ https://issues.apache.org/jira/browse/SPARK-39627?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-39627: Assignee: Apache Spark > Unify compileAggregate and compileExpression >

[jira] [Assigned] (SPARK-39627) Unify compileAggregate and compileExpression

[ https://issues.apache.org/jira/browse/SPARK-39627?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-39627: Assignee: (was: Apache Spark) > Unify compileAggregate and compileExpression >

[jira] [Commented] (SPARK-39627) Unify compileAggregate and compileExpression

[ https://issues.apache.org/jira/browse/SPARK-39627?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17561423#comment-17561423 ] Apache Spark commented on SPARK-39627: -- User 'beliefer' has created a pull request for this issue:

[jira] [Updated] (SPARK-39650) Streaming Deduplication should not check the schema of "value"

[ https://issues.apache.org/jira/browse/SPARK-39650?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Jungtaek Lim updated SPARK-39650: - Affects Version/s: 3.2.1 3.1.2 > Streaming Deduplication should not

[jira] [Commented] (SPARK-33753) Reduce the memory footprint and gc of the cache (hadoopJobMetadata)

[ https://issues.apache.org/jira/browse/SPARK-33753?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17561327#comment-17561327 ] Apache Spark commented on SPARK-33753: -- User 'mcdull-zhang' has created a pull request for this

[jira] [Updated] (SPARK-39652) For CoalescedRDDBenchmark, the test results using Scala 2.13 are slower than Scala 2.12`, the test results using Scala 2.13 are slower than Scala 2.12

[ https://issues.apache.org/jira/browse/SPARK-39652?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Yang Jie updated SPARK-39652: - Attachment: CoalescedRDDBenchmark-212-results.txt > For CoalescedRDDBenchmark, the test results using

[jira] [Updated] (SPARK-39652) For CoalescedRDDBenchmark, the test results using Scala 2.13 are slower than Scala 2.12`, the test results using Scala 2.13 are slower than Scala 2.12

[ https://issues.apache.org/jira/browse/SPARK-39652?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Yang Jie updated SPARK-39652: - Description: Typical result are as follows:   *2.12.16*     {code:java} OpenJDK 64-Bit Server VM

[jira] [Commented] (SPARK-39564) Expose the information of catalog table to the logical plan in streaming query

[ https://issues.apache.org/jira/browse/SPARK-39564?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17561318#comment-17561318 ] Apache Spark commented on SPARK-39564: -- User 'HeartSaVioR' has created a pull request for this

[jira] [Assigned] (SPARK-39638) Change to use `ConstantColumnVector` to store partition columns in `OrcColumnarBatchReader`

[ https://issues.apache.org/jira/browse/SPARK-39638?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Chao Sun reassigned SPARK-39638: Assignee: Yang Jie > Change to use `ConstantColumnVector` to store partition columns in >

[jira] [Resolved] (SPARK-39638) Change to use `ConstantColumnVector` to store partition columns in `OrcColumnarBatchReader`

[ https://issues.apache.org/jira/browse/SPARK-39638?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Chao Sun resolved SPARK-39638. -- Fix Version/s: 3.4.0 Resolution: Fixed Issue resolved by pull request 37029

[jira] [Updated] (SPARK-39652) For CoalescedRDDBenchmark, the test results using Scala 2.13 are slower than Scala 2.12`, the test results using Scala 2.13 are slower than Scala 2.12

[ https://issues.apache.org/jira/browse/SPARK-39652?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Yang Jie updated SPARK-39652: - Attachment: (was: CoalescedRDDBenchmark-213-results.txt) > For CoalescedRDDBenchmark, the test

[jira] [Updated] (SPARK-39652) For CoalescedRDDBenchmark, the test results using Scala 2.13 are slower than Scala 2.12`, the test results using Scala 2.13 are slower than Scala 2.12

[ https://issues.apache.org/jira/browse/SPARK-39652?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Yang Jie updated SPARK-39652: - Summary: For CoalescedRDDBenchmark, the test results using Scala 2.13 are slower than Scala 2.12`, the

[jira] [Updated] (SPARK-39652) For CoalescedRDDBenchmark, the test results using Scala 2.13 are slower than Scala 2.12`, the test results using Scala 2.13 are slower than Scala 2.12

[ https://issues.apache.org/jira/browse/SPARK-39652?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Yang Jie updated SPARK-39652: - Attachment: CoalescedRDDBenchmark-213-results.txt > For CoalescedRDDBenchmark, the test results using

[jira] [Updated] (SPARK-39652) For CoalescedRDDBenchmark, the test results using Scala 2.13 are slower than Scala 2.12`, the test results using Scala 2.13 are slower than Scala 2.12

[ https://issues.apache.org/jira/browse/SPARK-39652?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Yang Jie updated SPARK-39652: - Description: Typical result are as follows:   *2.12.16*   {code:java} OpenJDK 64-Bit Server VM

[jira] [Updated] (SPARK-39656) Fix wrong namespace in DescribeNamespaceExec

[ https://issues.apache.org/jira/browse/SPARK-39656?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] XiDuo You updated SPARK-39656: -- Priority: Minor (was: Major) > Fix wrong namespace in DescribeNamespaceExec >

[jira] [Created] (SPARK-39656) Fix wrong namespace in DescribeNamespaceExec

XiDuo You created SPARK-39656: - Summary: Fix wrong namespace in DescribeNamespaceExec Key: SPARK-39656 URL: https://issues.apache.org/jira/browse/SPARK-39656 Project: Spark Issue Type:

[jira] [Updated] (SPARK-39656) Fix wrong namespace in DescribeNamespaceExec

[ https://issues.apache.org/jira/browse/SPARK-39656?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] XiDuo You updated SPARK-39656: -- Description: DescribeNamespaceExec should show whole namespace rather than last (was:

[jira] [Commented] (SPARK-35242) Support change catalog default database for spark

[ https://issues.apache.org/jira/browse/SPARK-35242?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17561460#comment-17561460 ] Gabor Roczei commented on SPARK-35242: -- [~hongdongdong], The pull request has been automatically

[jira] [Assigned] (SPARK-39656) Fix wrong namespace in DescribeNamespaceExec

[ https://issues.apache.org/jira/browse/SPARK-39656?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-39656: Assignee: (was: Apache Spark) > Fix wrong namespace in DescribeNamespaceExec >

[jira] [Assigned] (SPARK-39656) Fix wrong namespace in DescribeNamespaceExec

[ https://issues.apache.org/jira/browse/SPARK-39656?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-39656: Assignee: Apache Spark > Fix wrong namespace in DescribeNamespaceExec >

[jira] [Commented] (SPARK-39656) Fix wrong namespace in DescribeNamespaceExec

[ https://issues.apache.org/jira/browse/SPARK-39656?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17561446#comment-17561446 ] Apache Spark commented on SPARK-39656: -- User 'ulysses-you' has created a pull request for this

[jira] [Commented] (SPARK-39656) Fix wrong namespace in DescribeNamespaceExec

[ https://issues.apache.org/jira/browse/SPARK-39656?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17561447#comment-17561447 ] Apache Spark commented on SPARK-39656: -- User 'ulysses-you' has created a pull request for this

[jira] [Commented] (SPARK-39647) Block push fails with java.lang.IllegalArgumentException: Active local dirs list has not been updated by any executor registration even when the NodeManager hasn't bee

[ https://issues.apache.org/jira/browse/SPARK-39647?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17561586#comment-17561586 ] Apache Spark commented on SPARK-39647: -- User 'otterc' has created a pull request for this issue:

[jira] [Assigned] (SPARK-39647) Block push fails with java.lang.IllegalArgumentException: Active local dirs list has not been updated by any executor registration even when the NodeManager hasn't been

[ https://issues.apache.org/jira/browse/SPARK-39647?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-39647: Assignee: Apache Spark > Block push fails with java.lang.IllegalArgumentException:

[jira] [Assigned] (SPARK-39647) Block push fails with java.lang.IllegalArgumentException: Active local dirs list has not been updated by any executor registration even when the NodeManager hasn't been

[ https://issues.apache.org/jira/browse/SPARK-39647?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-39647: Assignee: (was: Apache Spark) > Block push fails with

[jira] [Created] (SPARK-39657) YARN AM client should call the non-static setTokensConf method

Chao Sun created SPARK-39657: Summary: YARN AM client should call the non-static setTokensConf method Key: SPARK-39657 URL: https://issues.apache.org/jira/browse/SPARK-39657 Project: Spark

[jira] [Commented] (SPARK-28516) Data Type Formatting Functions: `to_char`

[ https://issues.apache.org/jira/browse/SPARK-28516?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17561560#comment-17561560 ] Apache Spark commented on SPARK-28516: -- User 'cloud-fan' has created a pull request for this issue:

[jira] [Assigned] (SPARK-39657) YARN AM client should call the non-static setTokensConf method

[ https://issues.apache.org/jira/browse/SPARK-39657?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-39657: Assignee: (was: Apache Spark) > YARN AM client should call the non-static

[jira] [Commented] (SPARK-39657) YARN AM client should call the non-static setTokensConf method

[ https://issues.apache.org/jira/browse/SPARK-39657?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17561559#comment-17561559 ] Apache Spark commented on SPARK-39657: -- User 'sunchao' has created a pull request for this issue:

[jira] [Assigned] (SPARK-39657) YARN AM client should call the non-static setTokensConf method

[ https://issues.apache.org/jira/browse/SPARK-39657?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-39657: Assignee: Apache Spark > YARN AM client should call the non-static setTokensConf method

[jira] [Commented] (SPARK-28516) Data Type Formatting Functions: `to_char`

[ https://issues.apache.org/jira/browse/SPARK-28516?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17561561#comment-17561561 ] Apache Spark commented on SPARK-28516: -- User 'cloud-fan' has created a pull request for this issue:

[jira] [Resolved] (SPARK-39629) Support v2 SHOW FUNCTIONS

[ https://issues.apache.org/jira/browse/SPARK-39629?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Max Gekk resolved SPARK-39629. -- Fix Version/s: 3.4.0 Resolution: Fixed Issue resolved by pull request 37036

[jira] [Assigned] (SPARK-39629) Support v2 SHOW FUNCTIONS

[ https://issues.apache.org/jira/browse/SPARK-39629?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Max Gekk reassigned SPARK-39629: Assignee: Max Gekk > Support v2 SHOW FUNCTIONS > - > >

[jira] [Created] (SPARK-39658) Reconsider exposure of Json4s symbols in public ResourceInformation.toJson API

Josh Rosen created SPARK-39658: -- Summary: Reconsider exposure of Json4s symbols in public ResourceInformation.toJson API Key: SPARK-39658 URL: https://issues.apache.org/jira/browse/SPARK-39658 Project:

[jira] [Assigned] (SPARK-39452) Extend EdgePartition1D with Destination based Strategy

[ https://issues.apache.org/jira/browse/SPARK-39452?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-39452: Assignee: Apache Spark > Extend EdgePartition1D with Destination based Strategy >

[jira] [Assigned] (SPARK-39452) Extend EdgePartition1D with Destination based Strategy

[ https://issues.apache.org/jira/browse/SPARK-39452?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-39452: Assignee: (was: Apache Spark) > Extend EdgePartition1D with Destination based

[jira] [Commented] (SPARK-39452) Extend EdgePartition1D with Destination based Strategy

[ https://issues.apache.org/jira/browse/SPARK-39452?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17561650#comment-17561650 ] Apache Spark commented on SPARK-39452: -- User 'ericsun95' has created a pull request for this issue:

[jira] [Comment Edited] (SPARK-39659) Add environment bin folder to R/Python subprocess PATH

[ https://issues.apache.org/jira/browse/SPARK-39659?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17561655#comment-17561655 ] Willi Raschkowski edited comment on SPARK-39659 at 7/2/22 2:53 AM: ---

[jira] [Comment Edited] (SPARK-39659) Add environment bin folder to R/Python subprocess PATH

[ https://issues.apache.org/jira/browse/SPARK-39659?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17561655#comment-17561655 ] Willi Raschkowski edited comment on SPARK-39659 at 7/2/22 2:53 AM: ---

[jira] [Commented] (SPARK-39659) Add environment bin folder to R/Python subprocess PATH

[ https://issues.apache.org/jira/browse/SPARK-39659?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17561655#comment-17561655 ] Willi Raschkowski commented on SPARK-39659: --- The way we solve this in our fork is by doing

[jira] [Comment Edited] (SPARK-39659) Add environment bin folder to R/Python subprocess PATH

[ https://issues.apache.org/jira/browse/SPARK-39659?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17561655#comment-17561655 ] Willi Raschkowski edited comment on SPARK-39659 at 7/2/22 2:56 AM: ---

[jira] [Comment Edited] (SPARK-39659) Add environment bin folder to R/Python subprocess PATH

[ https://issues.apache.org/jira/browse/SPARK-39659?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17561656#comment-17561656 ] Willi Raschkowski edited comment on SPARK-39659 at 7/2/22 3:06 AM: ---

[jira] [Comment Edited] (SPARK-39659) Add environment bin folder to R/Python subprocess PATH

[ https://issues.apache.org/jira/browse/SPARK-39659?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17561656#comment-17561656 ] Willi Raschkowski edited comment on SPARK-39659 at 7/2/22 3:16 AM: ---

[jira] [Comment Edited] (SPARK-39659) Add environment bin folder to R/Python subprocess PATH

[ https://issues.apache.org/jira/browse/SPARK-39659?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17561656#comment-17561656 ] Willi Raschkowski edited comment on SPARK-39659 at 7/2/22 3:15 AM: ---

[jira] [Commented] (SPARK-39659) Add environment bin folder to R/Python subprocess PATH

[ https://issues.apache.org/jira/browse/SPARK-39659?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17561661#comment-17561661 ] Willi Raschkowski commented on SPARK-39659: --- Another way could be to add a config like

[jira] [Created] (SPARK-39659) Add environment bin folder to R/Python subprocess PATH

Willi Raschkowski created SPARK-39659: - Summary: Add environment bin folder to R/Python subprocess PATH Key: SPARK-39659 URL: https://issues.apache.org/jira/browse/SPARK-39659 Project: Spark

[jira] [Comment Edited] (SPARK-39659) Add environment bin folder to R/Python subprocess PATH

[ https://issues.apache.org/jira/browse/SPARK-39659?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17561656#comment-17561656 ] Willi Raschkowski edited comment on SPARK-39659 at 7/2/22 2:55 AM: ---

[jira] [Commented] (SPARK-39659) Add environment bin folder to R/Python subprocess PATH

[ https://issues.apache.org/jira/browse/SPARK-39659?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17561656#comment-17561656 ] Willi Raschkowski commented on SPARK-39659: --- Alternatively, one could update {{PATH}} to point

[jira] [Comment Edited] (SPARK-39659) Add environment bin folder to R/Python subprocess PATH

[ https://issues.apache.org/jira/browse/SPARK-39659?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17561655#comment-17561655 ] Willi Raschkowski edited comment on SPARK-39659 at 7/2/22 2:54 AM: ---

[jira] [Commented] (SPARK-39659) Add environment bin folder to R/Python subprocess PATH

[ https://issues.apache.org/jira/browse/SPARK-39659?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17561657#comment-17561657 ] Willi Raschkowski commented on SPARK-39659: --- Anyway, wanted to get your thoughts on this. If

[jira] [Comment Edited] (SPARK-39659) Add environment bin folder to R/Python subprocess PATH

[ https://issues.apache.org/jira/browse/SPARK-39659?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17561656#comment-17561656 ] Willi Raschkowski edited comment on SPARK-39659 at 7/2/22 3:08 AM: ---

[jira] [Resolved] (SPARK-39657) YARN AM client should call the non-static setTokensConf method

[ https://issues.apache.org/jira/browse/SPARK-39657?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Dongjoon Hyun resolved SPARK-39657. --- Fix Version/s: 3.3.1 3.4.0 Resolution: Fixed Issue resolved by

[jira] [Assigned] (SPARK-39657) YARN AM client should call the non-static setTokensConf method

[ https://issues.apache.org/jira/browse/SPARK-39657?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Dongjoon Hyun reassigned SPARK-39657: - Assignee: Chao Sun > YARN AM client should call the non-static setTokensConf method >

[jira] [Assigned] (SPARK-39646) Make setCurrentDatabase compatible with 3 layer namespace

[ https://issues.apache.org/jira/browse/SPARK-39646?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Ruifeng Zheng reassigned SPARK-39646: - Assignee: Zach Schuermann > Make setCurrentDatabase compatible with 3 layer namespace

[jira] [Resolved] (SPARK-39646) Make setCurrentDatabase compatible with 3 layer namespace

[ https://issues.apache.org/jira/browse/SPARK-39646?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Ruifeng Zheng resolved SPARK-39646. --- Fix Version/s: 3.4.0 Resolution: Fixed Issue resolved by pull request 36969

[jira] [Updated] (SPARK-39649) [SPARK-39649][PYTHON] Make listDatabases / getDatabase / listColumns / refreshTable in PySpark support 3-layer-namespace

[ https://issues.apache.org/jira/browse/SPARK-39649?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Ruifeng Zheng updated SPARK-39649: -- Summary: [SPARK-39649][PYTHON] Make listDatabases / getDatabase / listColumns / refreshTable

[jira] [Updated] (SPARK-39649) Make listDatabases / getDatabase / listColumns / refreshTable in PySpark support 3-layer-namespace

[ https://issues.apache.org/jira/browse/SPARK-39649?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Ruifeng Zheng updated SPARK-39649: -- Summary: Make listDatabases / getDatabase / listColumns / refreshTable in PySpark support

[jira] [Updated] (SPARK-39652) For CoalescedRDDBenchmark, the test results using Scala 2.13 are slower than Scala 2.12`, the test results using Scala 2.13 are slower than Scala 2.12

[ https://issues.apache.org/jira/browse/SPARK-39652?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Yang Jie updated SPARK-39652: - Description: Typical result are as follows: *2.12.16* {code:java} OpenJDK 64-Bit Server VM