[jira] [Created] (SPARK-44307) Bloom filter is not added for left outer join if the left side table is smaller than broadcast threshold.

2023-07-04 Thread mahesh kumar behera (Jira)
mahesh kumar behera created SPARK-44307: --- Summary: Bloom filter is not added for left outer join if the left side table is smaller than broadcast threshold. Key: SPARK-44307 URL:

[jira] [Commented] (SPARK-44215) Client receives zero number of chunks in merge meta response which doesn't trigger fallback to unmerged blocks

2023-07-04 Thread Chandni Singh (Jira)
[ https://issues.apache.org/jira/browse/SPARK-44215?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17740023#comment-17740023 ] Chandni Singh commented on SPARK-44215: --- PR to backport the change to 3.3

[jira] [Created] (SPARK-44306) Group FileStatus with few RPC calls within Yarn Client

2023-07-04 Thread SHU WANG (Jira)
SHU WANG created SPARK-44306: Summary: Group FileStatus with few RPC calls within Yarn Client Key: SPARK-44306 URL: https://issues.apache.org/jira/browse/SPARK-44306 Project: Spark Issue Type:

[jira] [Commented] (SPARK-44305) Broadcast operation is not required when no parameters are specified

2023-07-04 Thread 7mming7 (Jira)
[ https://issues.apache.org/jira/browse/SPARK-44305?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17740018#comment-17740018 ] 7mming7 commented on SPARK-44305: - cc [~yuming]   > Broadcast operation is not required when no

[jira] [Updated] (SPARK-44305) Broadcast operation is not required when no parameters are specified

2023-07-04 Thread 7mming7 (Jira)
[ https://issues.apache.org/jira/browse/SPARK-44305?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] 7mming7 updated SPARK-44305: Description: The ability introduced by SPARK-14912, we can broadcast the parameters of the data source

[jira] [Updated] (SPARK-44305) Broadcast operation is not required when no parameters are specified

2023-07-04 Thread 7mming7 (Jira)
[ https://issues.apache.org/jira/browse/SPARK-44305?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] 7mming7 updated SPARK-44305: Attachment: image-2023-07-05-11-51-41-708.png > Broadcast operation is not required when no parameters

[jira] [Created] (SPARK-44305) Broadcast operation is not required when no parameters are specified

2023-07-04 Thread 7mming7 (Jira)
7mming7 created SPARK-44305: --- Summary: Broadcast operation is not required when no parameters are specified Key: SPARK-44305 URL: https://issues.apache.org/jira/browse/SPARK-44305 Project: Spark

[jira] [Created] (SPARK-44304) Broadcast operation is not required when no parameters are specified

2023-07-04 Thread 7mming7 (Jira)
7mming7 created SPARK-44304: --- Summary: Broadcast operation is not required when no parameters are specified Key: SPARK-44304 URL: https://issues.apache.org/jira/browse/SPARK-44304 Project: Spark

[jira] [Created] (SPARK-44303) Assign names to the error class _LEGACY_ERROR_TEMP_[2320-2324]

2023-07-04 Thread jiaan.geng (Jira)
jiaan.geng created SPARK-44303: -- Summary: Assign names to the error class _LEGACY_ERROR_TEMP_[2320-2324] Key: SPARK-44303 URL: https://issues.apache.org/jira/browse/SPARK-44303 Project: Spark

[jira] [Resolved] (SPARK-44300) SparkConnectArtifactManager#cleanUpResources deletes all artifacts instead of session-specific artifacts

2023-07-04 Thread Hyukjin Kwon (Jira)
[ https://issues.apache.org/jira/browse/SPARK-44300?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Hyukjin Kwon resolved SPARK-44300. -- Fix Version/s: 3.5.0 Resolution: Fixed Issue resolved by pull request 41854

[jira] [Assigned] (SPARK-44300) SparkConnectArtifactManager#cleanUpResources deletes all artifacts instead of session-specific artifacts

2023-07-04 Thread Hyukjin Kwon (Jira)
[ https://issues.apache.org/jira/browse/SPARK-44300?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Hyukjin Kwon reassigned SPARK-44300: Assignee: Venkata Sai Akhil Gudesa > SparkConnectArtifactManager#cleanUpResources

[jira] [Created] (SPARK-44302) Reenable PySpark test on the daily test of Java 21 after the new arrow version release

2023-07-04 Thread BingKun Pan (Jira)
BingKun Pan created SPARK-44302: --- Summary: Reenable PySpark test on the daily test of Java 21 after the new arrow version release Key: SPARK-44302 URL: https://issues.apache.org/jira/browse/SPARK-44302

[jira] [Assigned] (SPARK-44298) Disable PySpark test on the daily test of Java 21 before the new arrow version release

2023-07-04 Thread Yang Jie (Jira)
[ https://issues.apache.org/jira/browse/SPARK-44298?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Yang Jie reassigned SPARK-44298: Assignee: BingKun Pan > Disable PySpark test on the daily test of Java 21 before the new arrow

[jira] [Resolved] (SPARK-44298) Disable PySpark test on the daily test of Java 21 before the new arrow version release

2023-07-04 Thread Yang Jie (Jira)
[ https://issues.apache.org/jira/browse/SPARK-44298?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Yang Jie resolved SPARK-44298. -- Fix Version/s: 3.5.0 Resolution: Fixed Issue resolved by pull request 41826

[jira] [Commented] (SPARK-43476) Enable SeriesStringTests.test_string_replace for pandas 2.0.0.

2023-07-04 Thread Hyukjin Kwon (Jira)
[ https://issues.apache.org/jira/browse/SPARK-43476?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17739994#comment-17739994 ] Hyukjin Kwon commented on SPARK-43476: -- Reverted at

[jira] [Updated] (SPARK-43476) Enable SeriesStringTests.test_string_replace for pandas 2.0.0.

2023-07-04 Thread Hyukjin Kwon (Jira)
[ https://issues.apache.org/jira/browse/SPARK-43476?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Hyukjin Kwon updated SPARK-43476: - Fix Version/s: (was: 3.5.0) > Enable SeriesStringTests.test_string_replace for pandas

[jira] [Reopened] (SPARK-43476) Enable SeriesStringTests.test_string_replace for pandas 2.0.0.

2023-07-04 Thread Hyukjin Kwon (Jira)
[ https://issues.apache.org/jira/browse/SPARK-43476?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Hyukjin Kwon reopened SPARK-43476: -- Assignee: (was: Haejoon Lee) > Enable SeriesStringTests.test_string_replace for pandas

[jira] [Assigned] (SPARK-44245) pyspark.sql.dataframe doctests can behave differently

2023-07-04 Thread Hyukjin Kwon (Jira)
[ https://issues.apache.org/jira/browse/SPARK-44245?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Hyukjin Kwon reassigned SPARK-44245: Assignee: Alice Sayutina > pyspark.sql.dataframe doctests can behave differently >

[jira] [Resolved] (SPARK-44245) pyspark.sql.dataframe doctests can behave differently

2023-07-04 Thread Hyukjin Kwon (Jira)
[ https://issues.apache.org/jira/browse/SPARK-44245?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Hyukjin Kwon resolved SPARK-44245. -- Fix Version/s: 3.5.0 Resolution: Fixed Issue resolved by pull request 41787

[jira] [Resolved] (SPARK-44215) Client receives zero number of chunks in merge meta response which doesn't trigger fallback to unmerged blocks

2023-07-04 Thread Mridul Muralidharan (Jira)
[ https://issues.apache.org/jira/browse/SPARK-44215?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Mridul Muralidharan resolved SPARK-44215. - Assignee: Chandni Singh Resolution: Fixed > Client receives zero number

[jira] [Updated] (SPARK-44215) Client receives zero number of chunks in merge meta response which doesn't trigger fallback to unmerged blocks

2023-07-04 Thread Mridul Muralidharan (Jira)
[ https://issues.apache.org/jira/browse/SPARK-44215?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Mridul Muralidharan updated SPARK-44215: Fix Version/s: 3.5.0 3.4.2 > Client receives zero number of

[jira] [Resolved] (SPARK-44293) Task failures during custom JAR fetch in executors

2023-07-04 Thread Hyukjin Kwon (Jira)
[ https://issues.apache.org/jira/browse/SPARK-44293?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Hyukjin Kwon resolved SPARK-44293. -- Fix Version/s: 3.5.0 Resolution: Fixed Issue resolved by pull request 41844

[jira] [Assigned] (SPARK-44293) Task failures during custom JAR fetch in executors

2023-07-04 Thread Hyukjin Kwon (Jira)
[ https://issues.apache.org/jira/browse/SPARK-44293?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Hyukjin Kwon reassigned SPARK-44293: Assignee: Venkata Sai Akhil Gudesa > Task failures during custom JAR fetch in executors

[jira] [Assigned] (SPARK-44292) Assign names to the error class _LEGACY_ERROR_TEMP_[2315-2319]

2023-07-04 Thread Max Gekk (Jira)
[ https://issues.apache.org/jira/browse/SPARK-44292?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Max Gekk reassigned SPARK-44292: Assignee: jiaan.geng > Assign names to the error class _LEGACY_ERROR_TEMP_[2315-2319] >

[jira] [Resolved] (SPARK-44292) Assign names to the error class _LEGACY_ERROR_TEMP_[2315-2319]

2023-07-04 Thread Max Gekk (Jira)
[ https://issues.apache.org/jira/browse/SPARK-44292?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Max Gekk resolved SPARK-44292. -- Fix Version/s: 3.5.0 Resolution: Fixed Issue resolved by pull request 41850

[jira] [Commented] (SPARK-44301) Add Support for TPCH Micro Benchmark

2023-07-04 Thread Suraj Naik (Jira)
[ https://issues.apache.org/jira/browse/SPARK-44301?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17739962#comment-17739962 ] Suraj Naik commented on SPARK-44301: I have raised the PR here -

[jira] [Created] (SPARK-44301) Add Support for TPCH Micro Benchmark

2023-07-04 Thread Suraj Naik (Jira)
Suraj Naik created SPARK-44301: -- Summary: Add Support for TPCH Micro Benchmark Key: SPARK-44301 URL: https://issues.apache.org/jira/browse/SPARK-44301 Project: Spark Issue Type: Improvement

[jira] [Resolved] (SPARK-44296) Upgrade dropwizard metrics 4.2.19

2023-07-04 Thread Yang Jie (Jira)
[ https://issues.apache.org/jira/browse/SPARK-44296?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Yang Jie resolved SPARK-44296. -- Fix Version/s: 3.5.0 Resolution: Fixed Issue resolved by pull request 41849

[jira] [Assigned] (SPARK-44296) Upgrade dropwizard metrics 4.2.19

2023-07-04 Thread Yang Jie (Jira)
[ https://issues.apache.org/jira/browse/SPARK-44296?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Yang Jie reassigned SPARK-44296: Assignee: Yang Jie > Upgrade dropwizard metrics 4.2.19 > - > >

[jira] [Resolved] (SPARK-44297) Make `ClassLoaderIsolationSuite` test pass with Scala 2.13

2023-07-04 Thread Yang Jie (Jira)
[ https://issues.apache.org/jira/browse/SPARK-44297?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Yang Jie resolved SPARK-44297. -- Fix Version/s: 3.5.0 Resolution: Fixed Issue resolved by pull request 41852

[jira] [Assigned] (SPARK-44297) Make `ClassLoaderIsolationSuite` test pass with Scala 2.13

2023-07-04 Thread Yang Jie (Jira)
[ https://issues.apache.org/jira/browse/SPARK-44297?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Yang Jie reassigned SPARK-44297: Assignee: Yang Jie > Make `ClassLoaderIsolationSuite` test pass with Scala 2.13 >

[jira] [Updated] (SPARK-44300) SparkConnectArtifactManager#cleanUpResources deletes all artifacts instead of session-specific artifacts

2023-07-04 Thread Venkata Sai Akhil Gudesa (Jira)
[ https://issues.apache.org/jira/browse/SPARK-44300?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Venkata Sai Akhil Gudesa updated SPARK-44300: - Epic Link: SPARK-42554 > SparkConnectArtifactManager#cleanUpResources

[jira] [Created] (SPARK-44300) SparkConnectArtifactManager#cleanUpResources deletes all artifacts instead of session-specific artifacts

2023-07-04 Thread Venkata Sai Akhil Gudesa (Jira)
Venkata Sai Akhil Gudesa created SPARK-44300: Summary: SparkConnectArtifactManager#cleanUpResources deletes all artifacts instead of session-specific artifacts Key: SPARK-44300 URL:

[jira] [Created] (SPARK-44299) Assign names to the error class _LEGACY_ERROR_TEMP_227[4-6,8]

2023-07-04 Thread BingKun Pan (Jira)
BingKun Pan created SPARK-44299: --- Summary: Assign names to the error class _LEGACY_ERROR_TEMP_227[4-6,8] Key: SPARK-44299 URL: https://issues.apache.org/jira/browse/SPARK-44299 Project: Spark

[jira] [Commented] (SPARK-35253) Upgrade Janino from 3.0.16 to 3.1.4

2023-07-04 Thread PJ Fanning (Jira)
[ https://issues.apache.org/jira/browse/SPARK-35253?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17739895#comment-17739895 ] PJ Fanning commented on SPARK-35253: Janino 3.1.10 is out today and resolves

[jira] [Updated] (SPARK-44298) Disable PySpark test on the daily test of Java 21 before the new arrow version release

2023-07-04 Thread BingKun Pan (Jira)
[ https://issues.apache.org/jira/browse/SPARK-44298?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] BingKun Pan updated SPARK-44298: Affects Version/s: 3.5.0 (was: 4.0.0) > Disable PySpark test on the

[jira] [Created] (SPARK-44298) Disable PySpark test on the daily test of Java 21 before the new arrow version release

2023-07-04 Thread BingKun Pan (Jira)
BingKun Pan created SPARK-44298: --- Summary: Disable PySpark test on the daily test of Java 21 before the new arrow version release Key: SPARK-44298 URL: https://issues.apache.org/jira/browse/SPARK-44298

[jira] [Resolved] (SPARK-44295) Upgrade scala-parser-combinators to 2.3

2023-07-04 Thread Hyukjin Kwon (Jira)
[ https://issues.apache.org/jira/browse/SPARK-44295?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Hyukjin Kwon resolved SPARK-44295. -- Fix Version/s: 3.5.0 Resolution: Fixed Issue resolved by pull request 41848

[jira] [Assigned] (SPARK-44295) Upgrade scala-parser-combinators to 2.3

2023-07-04 Thread Hyukjin Kwon (Jira)
[ https://issues.apache.org/jira/browse/SPARK-44295?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Hyukjin Kwon reassigned SPARK-44295: Assignee: Yang Jie > Upgrade scala-parser-combinators to 2.3 >

[jira] [Commented] (SPARK-44297) Make `ClassLoaderIsolationSuite` test pass with Scala 2.13

2023-07-04 Thread ASF GitHub Bot (Jira)
[ https://issues.apache.org/jira/browse/SPARK-44297?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17739861#comment-17739861 ] ASF GitHub Bot commented on SPARK-44297: User 'LuciferYang' has created a pull request for this

[jira] [Updated] (SPARK-44297) Make `ClassLoaderIsolationSuite` test pass with Scala 2.13

2023-07-04 Thread Yang Jie (Jira)
[ https://issues.apache.org/jira/browse/SPARK-44297?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Yang Jie updated SPARK-44297: - Summary: Make `ClassLoaderIsolationSuite` test pass with Scala 2.13 (was: Make

[jira] [Created] (SPARK-44297) Make `ClassLoaderIsolationSuite` pass with Scala 2.13

2023-07-04 Thread Yang Jie (Jira)
Yang Jie created SPARK-44297: Summary: Make `ClassLoaderIsolationSuite` pass with Scala 2.13 Key: SPARK-44297 URL: https://issues.apache.org/jira/browse/SPARK-44297 Project: Spark Issue Type:

[jira] [Commented] (SPARK-44296) Upgrade dropwizard metrics 4.2.19

2023-07-04 Thread ASF GitHub Bot (Jira)
[ https://issues.apache.org/jira/browse/SPARK-44296?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17739857#comment-17739857 ] ASF GitHub Bot commented on SPARK-44296: User 'LuciferYang' has created a pull request for this

[jira] [Commented] (SPARK-44263) Allow ChannelBuilder extensions -- Scala

2023-07-04 Thread ASF GitHub Bot (Jira)
[ https://issues.apache.org/jira/browse/SPARK-44263?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17739853#comment-17739853 ] ASF GitHub Bot commented on SPARK-44263: User 'cdkrot' has created a pull request for this

[jira] [Commented] (SPARK-44292) Assign names to the error class _LEGACY_ERROR_TEMP_[2315-2319]

2023-07-04 Thread ASF GitHub Bot (Jira)
[ https://issues.apache.org/jira/browse/SPARK-44292?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17739852#comment-17739852 ] ASF GitHub Bot commented on SPARK-44292: User 'beliefer' has created a pull request for this

[jira] [Commented] (SPARK-43851) Support LCA in grouping expressions

2023-07-04 Thread ASF GitHub Bot (Jira)
[ https://issues.apache.org/jira/browse/SPARK-43851?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17739851#comment-17739851 ] ASF GitHub Bot commented on SPARK-43851: User 'Hisoka-X' has created a pull request for this

[jira] [Commented] (SPARK-44295) Upgrade scala-parser-combinators to 2.3

2023-07-04 Thread Ignite TC Bot (Jira)
[ https://issues.apache.org/jira/browse/SPARK-44295?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17739838#comment-17739838 ] Ignite TC Bot commented on SPARK-44295: --- User 'LuciferYang' has created a pull request for this

[jira] [Created] (SPARK-44296) Upgrade dropwizard metrics 4.2.19

2023-07-04 Thread Yang Jie (Jira)
Yang Jie created SPARK-44296: Summary: Upgrade dropwizard metrics 4.2.19 Key: SPARK-44296 URL: https://issues.apache.org/jira/browse/SPARK-44296 Project: Spark Issue Type: Improvement

[jira] [Updated] (SPARK-44295) Upgrade scala-parser-combinators to 2.3

2023-07-04 Thread Yang Jie (Jira)
[ https://issues.apache.org/jira/browse/SPARK-44295?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Yang Jie updated SPARK-44295: - Description: [https://github.com/scala/scala-parser-combinators/releases/tag/v2.3.0]   new version:

[jira] [Created] (SPARK-44295) Upgrade scala-parser-combinators to 2.3

2023-07-04 Thread Yang Jie (Jira)
Yang Jie created SPARK-44295: Summary: Upgrade scala-parser-combinators to 2.3 Key: SPARK-44295 URL: https://issues.apache.org/jira/browse/SPARK-44295 Project: Spark Issue Type: Improvement

[jira] [Created] (SPARK-44294) HeapHistogram column shows unexpectedly w/ select-all-box

2023-07-04 Thread Kent Yao (Jira)
Kent Yao created SPARK-44294: Summary: HeapHistogram column shows unexpectedly w/ select-all-box Key: SPARK-44294 URL: https://issues.apache.org/jira/browse/SPARK-44294 Project: Spark Issue

[jira] [Created] (SPARK-44293) Task failures during custom JAR fetch in executors

2023-07-04 Thread Venkata Sai Akhil Gudesa (Jira)
Venkata Sai Akhil Gudesa created SPARK-44293: Summary: Task failures during custom JAR fetch in executors Key: SPARK-44293 URL: https://issues.apache.org/jira/browse/SPARK-44293 Project:

[jira] [Updated] (SPARK-44288) Pass colFamilyOptions correctly for rocksdb state store

2023-07-04 Thread Jungtaek Lim (Jira)
[ https://issues.apache.org/jira/browse/SPARK-44288?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Jungtaek Lim updated SPARK-44288: - Affects Version/s: 3.5.0 (was: 3.4.1) > Pass colFamilyOptions

[jira] [Resolved] (SPARK-44250) Implement classification evaluator

2023-07-04 Thread Weichen Xu (Jira)
[ https://issues.apache.org/jira/browse/SPARK-44250?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Weichen Xu resolved SPARK-44250. Resolution: Done > Implement classification evaluator > -- > >

[jira] [Created] (SPARK-44292) Assign names to the error class _LEGACY_ERROR_TEMP_[2315-2319]

2023-07-04 Thread jiaan.geng (Jira)
jiaan.geng created SPARK-44292: -- Summary: Assign names to the error class _LEGACY_ERROR_TEMP_[2315-2319] Key: SPARK-44292 URL: https://issues.apache.org/jira/browse/SPARK-44292 Project: Spark