[jira] [Created] (SPARK-44205) Extract catalyst code from DecimalType

2023-06-26 Thread Rui Wang (Jira)
Rui Wang created SPARK-44205: Summary: Extract catalyst code from DecimalType Key: SPARK-44205 URL: https://issues.apache.org/jira/browse/SPARK-44205 Project: Spark Issue Type: Sub-task

[jira] [Resolved] (SPARK-44202) Add JobTag APIs to Java SparkContext

2023-06-26 Thread Hyukjin Kwon (Jira)
[ https://issues.apache.org/jira/browse/SPARK-44202?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Hyukjin Kwon resolved SPARK-44202. -- Fix Version/s: 3.5.0 Resolution: Fixed Issue resolved by pull request 41753

[jira] [Assigned] (SPARK-44202) Add JobTag APIs to Java SparkContext

2023-06-26 Thread Hyukjin Kwon (Jira)
[ https://issues.apache.org/jira/browse/SPARK-44202?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Hyukjin Kwon reassigned SPARK-44202: Assignee: Hyukjin Kwon > Add JobTag APIs to Java SparkContext >

[jira] [Created] (SPARK-44204) Add missing recordHiveCall for getPartitionNames

2023-06-26 Thread Cheng Pan (Jira)
Cheng Pan created SPARK-44204: - Summary: Add missing recordHiveCall for getPartitionNames Key: SPARK-44204 URL: https://issues.apache.org/jira/browse/SPARK-44204 Project: Spark Issue Type: Bug

[jira] [Updated] (SPARK-44203) The obtainDelegationTokens method of HiveDelegationTokenProvider should return nextRenewalDate instead of None

2023-06-26 Thread qingbo jiao (Jira)
[ https://issues.apache.org/jira/browse/SPARK-44203?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] qingbo jiao updated SPARK-44203: Affects Version/s: 3.4.1 (was: 3.5.0) > The obtainDelegationTokens

[jira] [Commented] (SPARK-43999) Data is still fetched even though result was returned

2023-06-26 Thread Jia Fan (Jira)
[ https://issues.apache.org/jira/browse/SPARK-43999?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17737421#comment-17737421 ] Jia Fan commented on SPARK-43999: - https://github.com/apache/spark/pull/41755 > Data is still fetched

[jira] [Created] (SPARK-44203) The obtainDelegationTokens method of HiveDelegationTokenProvider should return nextRenewalDate instead of None

2023-06-26 Thread qingbo jiao (Jira)
qingbo jiao created SPARK-44203: --- Summary: The obtainDelegationTokens method of HiveDelegationTokenProvider should return nextRenewalDate instead of None Key: SPARK-44203 URL:

[jira] [Resolved] (SPARK-44030) Move out json and expression private methods from DataType

2023-06-26 Thread Jira
[ https://issues.apache.org/jira/browse/SPARK-44030?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Herman van Hövell resolved SPARK-44030. --- Fix Version/s: 3.5.0 Resolution: Fixed > Move out json and expression

[jira] [Commented] (SPARK-44191) SparkR test failed with R 4.3.0

2023-06-26 Thread Yang Jie (Jira)
[ https://issues.apache.org/jira/browse/SPARK-44191?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17737419#comment-17737419 ] Yang Jie commented on SPARK-44191: -- [~dongjoon] Thanks for helping to check this. Maybe there is some

[jira] [Resolved] (SPARK-44146) Isolate Spark Connect session/artifacts

2023-06-26 Thread Jira
[ https://issues.apache.org/jira/browse/SPARK-44146?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Herman van Hövell resolved SPARK-44146. --- Fix Version/s: 3.5.0 Resolution: Fixed > Isolate Spark Connect

[jira] [Assigned] (SPARK-44146) Isolate Spark Connect session/artifacts

2023-06-26 Thread Jira
[ https://issues.apache.org/jira/browse/SPARK-44146?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Herman van Hövell reassigned SPARK-44146: - Assignee: Venkata Sai Akhil Gudesa > Isolate Spark Connect session/artifacts >

[jira] [Created] (SPARK-44202) Add JobTag APIs to Java SparkContext

2023-06-26 Thread Hyukjin Kwon (Jira)
Hyukjin Kwon created SPARK-44202: Summary: Add JobTag APIs to Java SparkContext Key: SPARK-44202 URL: https://issues.apache.org/jira/browse/SPARK-44202 Project: Spark Issue Type: Task

[jira] [Updated] (SPARK-44202) Add JobTag APIs to Java SparkContext

2023-06-26 Thread Hyukjin Kwon (Jira)
[ https://issues.apache.org/jira/browse/SPARK-44202?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Hyukjin Kwon updated SPARK-44202: - Description: Add APIs added in https://issues.apache.org/jira/browse/SPARK-43952 to Java:

[jira] [Resolved] (SPARK-44177) Add 'set -eo pipefail' to entrypoint and quote variables

2023-06-26 Thread Yikun Jiang (Jira)
[ https://issues.apache.org/jira/browse/SPARK-44177?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Yikun Jiang resolved SPARK-44177. - Fix Version/s: 4.0.0 Resolution: Fixed Issue resolved by pull request 49

[jira] [Assigned] (SPARK-44177) Add 'set -eo pipefail' to entrypoint and quote variables

2023-06-26 Thread Yikun Jiang (Jira)
[ https://issues.apache.org/jira/browse/SPARK-44177?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Yikun Jiang reassigned SPARK-44177: --- Assignee: Yikun Jiang > Add 'set -eo pipefail' to entrypoint and quote variables >

[jira] [Updated] (SPARK-44177) Add 'set -eo pipefail' to entrypoint and quote variables

2023-06-26 Thread Yikun Jiang (Jira)
[ https://issues.apache.org/jira/browse/SPARK-44177?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Yikun Jiang updated SPARK-44177: Fix Version/s: 3.5.0 (was: 4.0.0) > Add 'set -eo pipefail' to entrypoint

[jira] [Resolved] (SPARK-44176) Change apt to apt-get and remove useless cleanup

2023-06-26 Thread Yikun Jiang (Jira)
[ https://issues.apache.org/jira/browse/SPARK-44176?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Yikun Jiang resolved SPARK-44176. - Fix Version/s: 3.5.0 Resolution: Fixed > Change apt to apt-get and remove useless

[jira] [Assigned] (SPARK-44176) Change apt to apt-get and remove useless cleanup

2023-06-26 Thread Yikun Jiang (Jira)
[ https://issues.apache.org/jira/browse/SPARK-44176?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Yikun Jiang reassigned SPARK-44176: --- Assignee: Yikun Jiang > Change apt to apt-get and remove useless cleanup >

[jira] [Commented] (SPARK-44194) Add JobTag APIs to Pyspark SparkContext

2023-06-26 Thread Hyukjin Kwon (Jira)
[ https://issues.apache.org/jira/browse/SPARK-44194?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17737396#comment-17737396 ] Hyukjin Kwon commented on SPARK-44194: -- I am working on this. > Add JobTag APIs to Pyspark

[jira] [Created] (SPARK-44201) Add support for Streaming Listener in Scala for Spark Connect

2023-06-26 Thread Bo Gao (Jira)
Bo Gao created SPARK-44201: -- Summary: Add support for Streaming Listener in Scala for Spark Connect Key: SPARK-44201 URL: https://issues.apache.org/jira/browse/SPARK-44201 Project: Spark Issue

[jira] [Assigned] (SPARK-44197) Upgrade Hadoop to 3.3.6

2023-06-26 Thread Dongjoon Hyun (Jira)
[ https://issues.apache.org/jira/browse/SPARK-44197?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Dongjoon Hyun reassigned SPARK-44197: - Assignee: Dongjoon Hyun > Upgrade Hadoop to 3.3.6 > --- > >

[jira] [Resolved] (SPARK-44197) Upgrade Hadoop to 3.3.6

2023-06-26 Thread Dongjoon Hyun (Jira)
[ https://issues.apache.org/jira/browse/SPARK-44197?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Dongjoon Hyun resolved SPARK-44197. --- Fix Version/s: 3.5.0 Resolution: Fixed Issue resolved by pull request 41744

[jira] [Assigned] (SPARK-44183) Increate PyArrow minimum version to 4.0.0

2023-06-26 Thread Dongjoon Hyun (Jira)
[ https://issues.apache.org/jira/browse/SPARK-44183?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Dongjoon Hyun reassigned SPARK-44183: - Assignee: Dongjoon Hyun > Increate PyArrow minimum version to 4.0.0 >

[jira] [Resolved] (SPARK-44183) Increate PyArrow minimum version to 4.0.0

2023-06-26 Thread Dongjoon Hyun (Jira)
[ https://issues.apache.org/jira/browse/SPARK-44183?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Dongjoon Hyun resolved SPARK-44183. --- Fix Version/s: 3.5.0 Resolution: Fixed Issue resolved by pull request 41729

[jira] [Created] (SPARK-44200) Support TABLE argument parser rule for TableValuedFunction

2023-06-26 Thread Takuya Ueshin (Jira)
Takuya Ueshin created SPARK-44200: - Summary: Support TABLE argument parser rule for TableValuedFunction Key: SPARK-44200 URL: https://issues.apache.org/jira/browse/SPARK-44200 Project: Spark

[jira] [Assigned] (SPARK-43470) Add operating system ,Java, Python version information to application log

2023-06-26 Thread Dongjoon Hyun (Jira)
[ https://issues.apache.org/jira/browse/SPARK-43470?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Dongjoon Hyun reassigned SPARK-43470: - Assignee: Vinod KC > Add operating system ,Java, Python version information to

[jira] [Resolved] (SPARK-43470) Add operating system ,Java, Python version information to application log

2023-06-26 Thread Dongjoon Hyun (Jira)
[ https://issues.apache.org/jira/browse/SPARK-43470?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Dongjoon Hyun resolved SPARK-43470. --- Fix Version/s: 3.5.0 Resolution: Fixed Issue resolved by pull request 41144

[jira] [Commented] (SPARK-43470) Add operating system ,Java, Python version information to application log

2023-06-26 Thread ci-cassandra.apache.org (Jira)
[ https://issues.apache.org/jira/browse/SPARK-43470?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17737312#comment-17737312 ] ci-cassandra.apache.org commented on SPARK-43470: - User 'vinodkc' has created a pull

[jira] [Created] (SPARK-44199) CacheManager refreshes the fileIndex unnecessarily

2023-06-26 Thread Vihang Karajgaonkar (Jira)
Vihang Karajgaonkar created SPARK-44199: --- Summary: CacheManager refreshes the fileIndex unnecessarily Key: SPARK-44199 URL: https://issues.apache.org/jira/browse/SPARK-44199 Project: Spark

[jira] [Commented] (SPARK-44198) Inconsistent Log Level Setting between Spark Driver and Executors

2023-06-26 Thread Vinod KC (Jira)
[ https://issues.apache.org/jira/browse/SPARK-44198?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17737308#comment-17737308 ] Vinod KC commented on SPARK-44198: -- Raised PR : https://github.com/apache/spark/pull/41746 >

[jira] [Updated] (SPARK-44198) Inconsistent Log Level Setting between Spark Driver and Executors

2023-06-26 Thread Vinod KC (Jira)
[ https://issues.apache.org/jira/browse/SPARK-44198?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Vinod KC updated SPARK-44198: - Description: Currently, the *sc.setLogLevel()* method only sets the log level on the Spark driver,

[jira] [Created] (SPARK-44198) Inconsistent Log Level Setting between Spark Driver and Executors

2023-06-26 Thread Vinod KC (Jira)
Vinod KC created SPARK-44198: Summary: Inconsistent Log Level Setting between Spark Driver and Executors Key: SPARK-44198 URL: https://issues.apache.org/jira/browse/SPARK-44198 Project: Spark

[jira] [Commented] (SPARK-44191) SparkR test failed with R 4.3.0

2023-06-26 Thread Dongjoon Hyun (Jira)
[ https://issues.apache.org/jira/browse/SPARK-44191?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17737301#comment-17737301 ] Dongjoon Hyun commented on SPARK-44191: --- BTW, please note that Github Action Spark R has been

[jira] [Commented] (SPARK-44191) SparkR test failed with R 4.3.0

2023-06-26 Thread Dongjoon Hyun (Jira)
[ https://issues.apache.org/jira/browse/SPARK-44191?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17737299#comment-17737299 ] Dongjoon Hyun commented on SPARK-44191: --- This is tested via SPARK-43447 on May 11. Maybe,

[jira] [Commented] (SPARK-44192) Support R 4.3.1

2023-06-26 Thread Dongjoon Hyun (Jira)
[ https://issues.apache.org/jira/browse/SPARK-44192?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17737295#comment-17737295 ] Dongjoon Hyun commented on SPARK-44192: --- +1. Thank you > Support R 4.3.1 > --- > >

[jira] [Resolved] (SPARK-44026) Update helper methods to create SQLMetric with initial value

2023-06-26 Thread Wenchen Fan (Jira)
[ https://issues.apache.org/jira/browse/SPARK-44026?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Wenchen Fan resolved SPARK-44026. - Fix Version/s: 3.5.0 Resolution: Fixed Issue resolved by pull request 41555

[jira] [Assigned] (SPARK-44026) Update helper methods to create SQLMetric with initial value

2023-06-26 Thread Wenchen Fan (Jira)
[ https://issues.apache.org/jira/browse/SPARK-44026?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Wenchen Fan reassigned SPARK-44026: --- Assignee: Johan Lasperas > Update helper methods to create SQLMetric with initial value >

[jira] [Created] (SPARK-44197) Upgrade Hadoop to 3.3.6

2023-06-26 Thread Dongjoon Hyun (Jira)
Dongjoon Hyun created SPARK-44197: - Summary: Upgrade Hadoop to 3.3.6 Key: SPARK-44197 URL: https://issues.apache.org/jira/browse/SPARK-44197 Project: Spark Issue Type: Improvement

[jira] [Resolved] (SPARK-44188) Remove useless code `resetAllPartitions` in ActiveJob

2023-06-26 Thread Dongjoon Hyun (Jira)
[ https://issues.apache.org/jira/browse/SPARK-44188?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Dongjoon Hyun resolved SPARK-44188. --- Fix Version/s: 3.5.0 Resolution: Fixed Issue resolved by pull request 41737

[jira] [Assigned] (SPARK-44188) Remove useless code `resetAllPartitions` in ActiveJob

2023-06-26 Thread Dongjoon Hyun (Jira)
[ https://issues.apache.org/jira/browse/SPARK-44188?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Dongjoon Hyun reassigned SPARK-44188: - Assignee: Jia Fan > Remove useless code `resetAllPartitions` in ActiveJob >

[jira] [Commented] (SPARK-44165) Exception when reading parquet file with TIME fields

2023-06-26 Thread Jira
[ https://issues.apache.org/jira/browse/SPARK-44165?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17737274#comment-17737274 ] Ramón García Fernández commented on SPARK-44165: Added [pull request

[jira] [Created] (SPARK-44196) Add analyzer support of named arguments for built-in functions

2023-06-26 Thread Richard Yu (Jira)
Richard Yu created SPARK-44196: -- Summary: Add analyzer support of named arguments for built-in functions Key: SPARK-44196 URL: https://issues.apache.org/jira/browse/SPARK-44196 Project: Spark

[jira] [Updated] (SPARK-44193) Implement GRPC exceptions interception for conversion

2023-06-26 Thread Yihong He (Jira)
[ https://issues.apache.org/jira/browse/SPARK-44193?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Yihong He updated SPARK-44193: -- Summary: Implement GRPC exceptions interception for conversion (was: Implement GRPC exceptions

[jira] [Commented] (SPARK-44137) Change handling of iterable objects for on field in joins

2023-06-26 Thread Ignite TC Bot (Jira)
[ https://issues.apache.org/jira/browse/SPARK-44137?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17737266#comment-17737266 ] Ignite TC Bot commented on SPARK-44137: --- User 'jhaberstroh-sharethis' has created a pull request

[jira] [Commented] (SPARK-44082) Generate operator does not update reference set properly

2023-06-26 Thread Ignite TC Bot (Jira)
[ https://issues.apache.org/jira/browse/SPARK-44082?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17737265#comment-17737265 ] Ignite TC Bot commented on SPARK-44082: --- User 'amaliujia' has created a pull request for this

[jira] [Updated] (SPARK-44059) Add named argument support for SQL functions

2023-06-26 Thread Richard Yu (Jira)
[ https://issues.apache.org/jira/browse/SPARK-44059?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Richard Yu updated SPARK-44059: --- Description: Today, there is increasing demand for named argument functions, especially as we

[jira] [Updated] (SPARK-43922) Add named argument support in parser for function call

2023-06-26 Thread Richard Yu (Jira)
[ https://issues.apache.org/jira/browse/SPARK-43922?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Richard Yu updated SPARK-43922: --- Parent: SPARK-44059 Issue Type: Sub-task (was: New Feature) > Add named argument support

[jira] [Resolved] (SPARK-44189) Support positional parameters in sql() by python connect client

2023-06-26 Thread Max Gekk (Jira)
[ https://issues.apache.org/jira/browse/SPARK-44189?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Max Gekk resolved SPARK-44189. -- Fix Version/s: 3.5.0 Resolution: Fixed Issue resolved by pull request 41739

[jira] [Assigned] (SPARK-44189) Support positional parameters in sql() by python connect client

2023-06-26 Thread Max Gekk (Jira)
[ https://issues.apache.org/jira/browse/SPARK-44189?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Max Gekk reassigned SPARK-44189: Assignee: Max Gekk > Support positional parameters in sql() by python connect client >

[jira] [Resolved] (SPARK-44187) Enable benchmark on github to support Java 21

2023-06-26 Thread Dongjoon Hyun (Jira)
[ https://issues.apache.org/jira/browse/SPARK-44187?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Dongjoon Hyun resolved SPARK-44187. --- Fix Version/s: 3.5.0 Resolution: Fixed Issue resolved by pull request 41736

[jira] [Assigned] (SPARK-44187) Enable benchmark on github to support Java 21

2023-06-26 Thread Dongjoon Hyun (Jira)
[ https://issues.apache.org/jira/browse/SPARK-44187?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Dongjoon Hyun reassigned SPARK-44187: - Assignee: BingKun Pan > Enable benchmark on github to support Java 21 >

[jira] [Assigned] (SPARK-44186) Upgrade sbt to 1.9.1

2023-06-26 Thread Dongjoon Hyun (Jira)
[ https://issues.apache.org/jira/browse/SPARK-44186?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Dongjoon Hyun reassigned SPARK-44186: - Assignee: Yang Jie > Upgrade sbt to 1.9.1 > > >

[jira] [Resolved] (SPARK-44186) Upgrade sbt to 1.9.1

2023-06-26 Thread Dongjoon Hyun (Jira)
[ https://issues.apache.org/jira/browse/SPARK-44186?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Dongjoon Hyun resolved SPARK-44186. --- Fix Version/s: 3.5.0 Resolution: Fixed Issue resolved by pull request 41734

[jira] [Resolved] (SPARK-43924) Add misc functions to Scala and Python

2023-06-26 Thread Ruifeng Zheng (Jira)
[ https://issues.apache.org/jira/browse/SPARK-43924?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Ruifeng Zheng resolved SPARK-43924. --- Fix Version/s: 3.5.0 Resolution: Fixed Issue resolved by pull request 41689

[jira] [Assigned] (SPARK-43924) Add misc functions to Scala and Python

2023-06-26 Thread Ruifeng Zheng (Jira)
[ https://issues.apache.org/jira/browse/SPARK-43924?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Ruifeng Zheng reassigned SPARK-43924: - Assignee: BingKun Pan > Add misc functions to Scala and Python >

[jira] [Created] (SPARK-44195) Add JobTag APIs to SparkR SparkContext

2023-06-26 Thread Juliusz Sompolski (Jira)
Juliusz Sompolski created SPARK-44195: - Summary: Add JobTag APIs to SparkR SparkContext Key: SPARK-44195 URL: https://issues.apache.org/jira/browse/SPARK-44195 Project: Spark Issue Type:

[jira] [Created] (SPARK-44194) Add JobTag APIs to Pyspark SparkContext

2023-06-26 Thread Juliusz Sompolski (Jira)
Juliusz Sompolski created SPARK-44194: - Summary: Add JobTag APIs to Pyspark SparkContext Key: SPARK-44194 URL: https://issues.apache.org/jira/browse/SPARK-44194 Project: Spark Issue

[jira] [Created] (SPARK-44193) Implement GRPC exceptions interception

2023-06-26 Thread Yihong He (Jira)
Yihong He created SPARK-44193: - Summary: Implement GRPC exceptions interception Key: SPARK-44193 URL: https://issues.apache.org/jira/browse/SPARK-44193 Project: Spark Issue Type: New Feature

[jira] [Resolved] (SPARK-44164) Extract toAttribute method from StructField to Util class

2023-06-26 Thread Jira
[ https://issues.apache.org/jira/browse/SPARK-44164?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Herman van Hövell resolved SPARK-44164. --- Fix Version/s: 3.5.0 Resolution: Fixed > Extract toAttribute method from

[jira] [Commented] (SPARK-43816) Spark Corrupts Data In-Transit for High Volume (> 20 TB/hr) of Data

2023-06-26 Thread Sai Allu (Jira)
[ https://issues.apache.org/jira/browse/SPARK-43816?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17737171#comment-17737171 ] Sai Allu commented on SPARK-43816: -- Hello [~yumwang], I reached out to your email. Would you mind

[jira] [Commented] (SPARK-30466) remove dependency on jackson-mapper-asl-1.9.13 and jackson-core-asl-1.9.13

2023-06-26 Thread Nicholas Marion (Jira)
[ https://issues.apache.org/jira/browse/SPARK-30466?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17737164#comment-17737164 ] Nicholas Marion commented on SPARK-30466: - Hive 3.x is planned for Spark 4.x; so hopefully that

[jira] [Created] (SPARK-44192) Support R 4.3.1

2023-06-26 Thread Yang Jie (Jira)
Yang Jie created SPARK-44192: Summary: Support R 4.3.1 Key: SPARK-44192 URL: https://issues.apache.org/jira/browse/SPARK-44192 Project: Spark Issue Type: Improvement Components: Build

[jira] [Updated] (SPARK-44191) SparkR test failed with R 4.3.0

2023-06-26 Thread Yang Jie (Jira)
[ https://issues.apache.org/jira/browse/SPARK-44191?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Yang Jie updated SPARK-44191: - Description: run   {code:java} build/sbt package -Psparkr R/install-dev.sh; R/run-tests.sh {code}    

[jira] [Created] (SPARK-44191) SparkR test failed with R 4.3.0

2023-06-26 Thread Yang Jie (Jira)
Yang Jie created SPARK-44191: Summary: SparkR test failed with R 4.3.0 Key: SPARK-44191 URL: https://issues.apache.org/jira/browse/SPARK-44191 Project: Spark Issue Type: Bug

[jira] [Updated] (SPARK-44190) Convert HiveException to SparkException

2023-06-26 Thread BingKun Pan (Jira)
[ https://issues.apache.org/jira/browse/SPARK-44190?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] BingKun Pan updated SPARK-44190: Description: 1.Trigger scenario:

[jira] [Created] (SPARK-44190) Convert HiveException to SparkException

2023-06-26 Thread BingKun Pan (Jira)
BingKun Pan created SPARK-44190: --- Summary: Convert HiveException to SparkException Key: SPARK-44190 URL: https://issues.apache.org/jira/browse/SPARK-44190 Project: Spark Issue Type: Sub-task

[jira] [Comment Edited] (SPARK-43999) Data is still fetched even though result was returned

2023-06-26 Thread Jia Fan (Jira)
[ https://issues.apache.org/jira/browse/SPARK-43999?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17737026#comment-17737026 ] Jia Fan edited comment on SPARK-43999 at 6/26/23 10:50 AM: --- The reason are

[jira] [Assigned] (SPARK-44189) Support positional parameters in sql() by python connect client

2023-06-26 Thread Max Gekk (Jira)
[ https://issues.apache.org/jira/browse/SPARK-44189?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Max Gekk reassigned SPARK-44189: Assignee: (was: Max Gekk) > Support positional parameters in sql() by python connect client

[jira] [Updated] (SPARK-44189) Support positional parameters in sql() by python connect client

2023-06-26 Thread Max Gekk (Jira)
[ https://issues.apache.org/jira/browse/SPARK-44189?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Max Gekk updated SPARK-44189: - Fix Version/s: (was: 3.5.0) > Support positional parameters in sql() by python connect client >

[jira] [Created] (SPARK-44189) Support positional parameters in sql() by python connect client

2023-06-26 Thread Max Gekk (Jira)
Max Gekk created SPARK-44189: Summary: Support positional parameters in sql() by python connect client Key: SPARK-44189 URL: https://issues.apache.org/jira/browse/SPARK-44189 Project: Spark

[jira] [Commented] (SPARK-43999) Data is still fetched even though result was returned

2023-06-26 Thread Jia Fan (Jira)
[ https://issues.apache.org/jira/browse/SPARK-43999?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17737045#comment-17737045 ] Jia Fan commented on SPARK-43999: - > When do you plan to fix this behaviour?   I'm doing this. > Data

[jira] [Commented] (SPARK-43999) Data is still fetched even though result was returned

2023-06-26 Thread Kamil Kliczbor (Jira)
[ https://issues.apache.org/jira/browse/SPARK-43999?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17737041#comment-17737041 ] Kamil Kliczbor commented on SPARK-43999: [~fanjia] , thanks for the feedback. Where do you plan

[jira] [Comment Edited] (SPARK-43999) Data is still fetched even though result was returned

2023-06-26 Thread Kamil Kliczbor (Jira)
[ https://issues.apache.org/jira/browse/SPARK-43999?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17737041#comment-17737041 ] Kamil Kliczbor edited comment on SPARK-43999 at 6/26/23 8:23 AM: -

[jira] [Commented] (SPARK-43999) Data is still fetched even though result was returned

2023-06-26 Thread Jia Fan (Jira)
[ https://issues.apache.org/jira/browse/SPARK-43999?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17737026#comment-17737026 ] Jia Fan commented on SPARK-43999: - The reason are when AQE on, the small empty table alway return faster

[jira] [Created] (SPARK-44188) Remove useless code `resetAllPartitions` in ActiveJob

2023-06-26 Thread Jia Fan (Jira)
Jia Fan created SPARK-44188: --- Summary: Remove useless code `resetAllPartitions` in ActiveJob Key: SPARK-44188 URL: https://issues.apache.org/jira/browse/SPARK-44188 Project: Spark Issue Type:

[jira] [Assigned] (SPARK-44143) Use checkError() to check Exception in *DDL*Suite

2023-06-26 Thread Max Gekk (Jira)
[ https://issues.apache.org/jira/browse/SPARK-44143?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Max Gekk reassigned SPARK-44143: Assignee: BingKun Pan > Use checkError() to check Exception in *DDL*Suite >

[jira] [Resolved] (SPARK-44143) Use checkError() to check Exception in *DDL*Suite

2023-06-26 Thread Max Gekk (Jira)
[ https://issues.apache.org/jira/browse/SPARK-44143?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Max Gekk resolved SPARK-44143. -- Fix Version/s: 3.5.0 Resolution: Fixed Issue resolved by pull request 41699

[jira] [Created] (SPARK-44187) Enable benchmark on github to support Java 21

2023-06-26 Thread BingKun Pan (Jira)
BingKun Pan created SPARK-44187: --- Summary: Enable benchmark on github to support Java 21 Key: SPARK-44187 URL: https://issues.apache.org/jira/browse/SPARK-44187 Project: Spark Issue Type:

[jira] [Commented] (SPARK-44177) Add 'set -eo pipefail' to entrypoint and quote variables

2023-06-26 Thread Yikun Jiang (Jira)
[ https://issues.apache.org/jira/browse/SPARK-44177?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17737004#comment-17737004 ] Yikun Jiang commented on SPARK-44177: - https://github.com/apache/spark-docker/pull/49 Harish Gontu

[jira] [Commented] (SPARK-44176) Change apt to apt-get and remove useless cleanup

2023-06-26 Thread Yikun Jiang (Jira)
[ https://issues.apache.org/jira/browse/SPARK-44176?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17737003#comment-17737003 ] Yikun Jiang commented on SPARK-44176: - https://github.com/apache/spark-docker/pull/47 [~harry] I am

[jira] [Commented] (SPARK-44175) Remove useless lib64 path link in dockerfile

2023-06-26 Thread Yikun Jiang (Jira)
[ https://issues.apache.org/jira/browse/SPARK-44175?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17737002#comment-17737002 ] Yikun Jiang commented on SPARK-44175: - https://github.com/apache/spark-docker/pull/48 [~harry]I'm

[jira] [Created] (SPARK-44186) Upgrade sbt to 1.9.1

2023-06-26 Thread Yang Jie (Jira)
Yang Jie created SPARK-44186: Summary: Upgrade sbt to 1.9.1 Key: SPARK-44186 URL: https://issues.apache.org/jira/browse/SPARK-44186 Project: Spark Issue Type: Improvement Components: