[jira] [Resolved] (SPARK-41065) Implement `DataFrame.freqItems ` and `DataFrame.stat.freqItems `

2022-12-31 Thread Ruifeng Zheng (Jira)
[ https://issues.apache.org/jira/browse/SPARK-41065?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Ruifeng Zheng resolved SPARK-41065. --- Fix Version/s: 3.4.0 Resolution: Fixed Issue resolved by pull request 39325

[jira] [Assigned] (SPARK-41659) Enable doctests in pyspark.sql.connect.readwriter

2022-12-31 Thread Apache Spark (Jira)
[ https://issues.apache.org/jira/browse/SPARK-41659?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-41659: Assignee: Apache Spark > Enable doctests in pyspark.sql.connect.readwriter >

[jira] [Assigned] (SPARK-41659) Enable doctests in pyspark.sql.connect.readwriter

2022-12-31 Thread Apache Spark (Jira)
[ https://issues.apache.org/jira/browse/SPARK-41659?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-41659: Assignee: (was: Apache Spark) > Enable doctests in pyspark.sql.connect.readwriter >

[jira] [Commented] (SPARK-41659) Enable doctests in pyspark.sql.connect.readwriter

2022-12-31 Thread Apache Spark (Jira)
[ https://issues.apache.org/jira/browse/SPARK-41659?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17653368#comment-17653368 ] Apache Spark commented on SPARK-41659: -- User 'techaddict' has created a pull request for this

[jira] [Updated] (SPARK-41804) InterpretedUnsafeProjection doesn't properly handle an array of UDTs

2022-12-31 Thread Bruce Robbins (Jira)
[ https://issues.apache.org/jira/browse/SPARK-41804?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Bruce Robbins updated SPARK-41804: -- Description: Reproduction steps: {noformat} // create a file of vector data import

[jira] [Commented] (SPARK-41804) InterpretedUnsafeProjection doesn't properly handle an array of UDTs

2022-12-31 Thread Bruce Robbins (Jira)
[ https://issues.apache.org/jira/browse/SPARK-41804?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17653367#comment-17653367 ] Bruce Robbins commented on SPARK-41804: --- I think I have a handle on what's going on here >

[jira] [Resolved] (SPARK-41676) Protobuf serializer for StreamingQueryData

2022-12-31 Thread Gengliang Wang (Jira)
[ https://issues.apache.org/jira/browse/SPARK-41676?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Gengliang Wang resolved SPARK-41676. Fix Version/s: 3.4.0 Resolution: Fixed Issue resolved by pull request 39233

[jira] [Assigned] (SPARK-41676) Protobuf serializer for StreamingQueryData

2022-12-31 Thread Gengliang Wang (Jira)
[ https://issues.apache.org/jira/browse/SPARK-41676?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Gengliang Wang reassigned SPARK-41676: -- Assignee: Yang Jie > Protobuf serializer for StreamingQueryData >

[jira] [Updated] (SPARK-41804) InterpretedUnsafeProjection doesn't properly handle an array of UDTs

2022-12-31 Thread Bruce Robbins (Jira)
[ https://issues.apache.org/jira/browse/SPARK-41804?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Bruce Robbins updated SPARK-41804: -- Environment: (was: Reproduction steps: {noformat} // create a file of vector data import

[jira] [Updated] (SPARK-41804) InterpretedUnsafeProjection doesn't properly handle an array of UDTs

2022-12-31 Thread Bruce Robbins (Jira)
[ https://issues.apache.org/jira/browse/SPARK-41804?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Bruce Robbins updated SPARK-41804: -- Description: Reproduction steps: {noformat} // create a file of vector data import

[jira] [Created] (SPARK-41804) InterpretedUnsafeProjection doesn't properly handle an array of UDTs

2022-12-31 Thread Bruce Robbins (Jira)
Bruce Robbins created SPARK-41804: - Summary: InterpretedUnsafeProjection doesn't properly handle an array of UDTs Key: SPARK-41804 URL: https://issues.apache.org/jira/browse/SPARK-41804 Project:

[jira] [Commented] (SPARK-41793) Incorrect result for window frames defined by a range clause on large decimals

2022-12-31 Thread Bruce Robbins (Jira)
[ https://issues.apache.org/jira/browse/SPARK-41793?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17653348#comment-17653348 ] Bruce Robbins commented on SPARK-41793: --- [~cloud_fan] [~ulysses] The change in behavior appears

[jira] [Assigned] (SPARK-41802) Upgrade Apache httpcore to 4.4.16

2022-12-31 Thread Dongjoon Hyun (Jira)
[ https://issues.apache.org/jira/browse/SPARK-41802?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Dongjoon Hyun reassigned SPARK-41802: - Assignee: Yang Jie > Upgrade Apache httpcore to 4.4.16 >

[jira] [Resolved] (SPARK-41802) Upgrade Apache httpcore to 4.4.16

2022-12-31 Thread Dongjoon Hyun (Jira)
[ https://issues.apache.org/jira/browse/SPARK-41802?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Dongjoon Hyun resolved SPARK-41802. --- Fix Version/s: 3.4.0 Resolution: Fixed Issue resolved by pull request 39329

[jira] [Commented] (SPARK-41745) SparkSession.createDataFrame does not respect the column names in the row

2022-12-31 Thread Apache Spark (Jira)
[ https://issues.apache.org/jira/browse/SPARK-41745?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17653334#comment-17653334 ] Apache Spark commented on SPARK-41745: -- User 'grundprinzip' has created a pull request for this

[jira] [Commented] (SPARK-41745) SparkSession.createDataFrame does not respect the column names in the row

2022-12-31 Thread Apache Spark (Jira)
[ https://issues.apache.org/jira/browse/SPARK-41745?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17653335#comment-17653335 ] Apache Spark commented on SPARK-41745: -- User 'grundprinzip' has created a pull request for this

[jira] [Commented] (SPARK-41742) Support star in groupBy.agg()

2022-12-31 Thread Apache Spark (Jira)
[ https://issues.apache.org/jira/browse/SPARK-41742?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=1765#comment-1765 ] Apache Spark commented on SPARK-41742: -- User 'grundprinzip' has created a pull request for this

[jira] [Created] (SPARK-41803) log() function variations are missing

2022-12-31 Thread Martin Grund (Jira)
Martin Grund created SPARK-41803: Summary: log() function variations are missing Key: SPARK-41803 URL: https://issues.apache.org/jira/browse/SPARK-41803 Project: Spark Issue Type: Sub-task

[jira] [Assigned] (SPARK-41802) Upgrade Apache httpcore to 4.4.16

2022-12-31 Thread Apache Spark (Jira)
[ https://issues.apache.org/jira/browse/SPARK-41802?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-41802: Assignee: (was: Apache Spark) > Upgrade Apache httpcore to 4.4.16 >

[jira] [Assigned] (SPARK-41802) Upgrade Apache httpcore to 4.4.16

2022-12-31 Thread Apache Spark (Jira)
[ https://issues.apache.org/jira/browse/SPARK-41802?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-41802: Assignee: Apache Spark > Upgrade Apache httpcore to 4.4.16 >

[jira] [Commented] (SPARK-41802) Upgrade Apache httpcore to 4.4.16

2022-12-31 Thread Apache Spark (Jira)
[ https://issues.apache.org/jira/browse/SPARK-41802?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17653326#comment-17653326 ] Apache Spark commented on SPARK-41802: -- User 'LuciferYang' has created a pull request for this

[jira] [Created] (SPARK-41802) Upgrade Apache httpcore to 4.4.16

2022-12-31 Thread Yang Jie (Jira)
Yang Jie created SPARK-41802: Summary: Upgrade Apache httpcore to 4.4.16 Key: SPARK-41802 URL: https://issues.apache.org/jira/browse/SPARK-41802 Project: Spark Issue Type: Improvement

[jira] [Commented] (SPARK-41066) Implement `DataFrame.sampleBy ` and `DataFrame.stat.sampleBy `

2022-12-31 Thread Apache Spark (Jira)
[ https://issues.apache.org/jira/browse/SPARK-41066?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17653308#comment-17653308 ] Apache Spark commented on SPARK-41066: -- User 'zhengruifeng' has created a pull request for this

[jira] [Assigned] (SPARK-41066) Implement `DataFrame.sampleBy ` and `DataFrame.stat.sampleBy `

2022-12-31 Thread Apache Spark (Jira)
[ https://issues.apache.org/jira/browse/SPARK-41066?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-41066: Assignee: Apache Spark (was: Ruifeng Zheng) > Implement `DataFrame.sampleBy ` and

[jira] [Assigned] (SPARK-41066) Implement `DataFrame.sampleBy ` and `DataFrame.stat.sampleBy `

2022-12-31 Thread Apache Spark (Jira)
[ https://issues.apache.org/jira/browse/SPARK-41066?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-41066: Assignee: Ruifeng Zheng (was: Apache Spark) > Implement `DataFrame.sampleBy ` and

[jira] [Commented] (SPARK-41066) Implement `DataFrame.sampleBy ` and `DataFrame.stat.sampleBy `

2022-12-31 Thread Apache Spark (Jira)
[ https://issues.apache.org/jira/browse/SPARK-41066?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17653307#comment-17653307 ] Apache Spark commented on SPARK-41066: -- User 'zhengruifeng' has created a pull request for this

[jira] [Commented] (SPARK-41801) Remove *args: Any, **kwargs: Any for def transpose

2022-12-31 Thread Apache Spark (Jira)
[ https://issues.apache.org/jira/browse/SPARK-41801?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17653303#comment-17653303 ] Apache Spark commented on SPARK-41801: -- User 'bjornjorgensen' has created a pull request for this

[jira] [Assigned] (SPARK-41801) Remove *args: Any, **kwargs: Any for def transpose

2022-12-31 Thread Apache Spark (Jira)
[ https://issues.apache.org/jira/browse/SPARK-41801?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-41801: Assignee: (was: Apache Spark) > Remove *args: Any, **kwargs: Any for def transpose >

[jira] [Assigned] (SPARK-41801) Remove *args: Any, **kwargs: Any for def transpose

2022-12-31 Thread Apache Spark (Jira)
[ https://issues.apache.org/jira/browse/SPARK-41801?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-41801: Assignee: Apache Spark > Remove *args: Any, **kwargs: Any for def transpose >

[jira] [Commented] (SPARK-41801) Remove *args: Any, **kwargs: Any for def transpose

2022-12-31 Thread Apache Spark (Jira)
[ https://issues.apache.org/jira/browse/SPARK-41801?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17653302#comment-17653302 ] Apache Spark commented on SPARK-41801: -- User 'bjornjorgensen' has created a pull request for this

[jira] [Created] (SPARK-41801) Remove *args: Any, **kwargs: Any for def transpose

2022-12-31 Thread Jira
Bjørn Jørgensen created SPARK-41801: --- Summary: Remove *args: Any, **kwargs: Any for def transpose Key: SPARK-41801 URL: https://issues.apache.org/jira/browse/SPARK-41801 Project: Spark

[jira] [Resolved] (SPARK-41798) Upgrade hive-storage-api to 2.8.1

2022-12-31 Thread Dongjoon Hyun (Jira)
[ https://issues.apache.org/jira/browse/SPARK-41798?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Dongjoon Hyun resolved SPARK-41798. --- Fix Version/s: 3.4.0 Resolution: Fixed Issue resolved by pull request 39322

[jira] [Assigned] (SPARK-41798) Upgrade hive-storage-api to 2.8.1

2022-12-31 Thread Dongjoon Hyun (Jira)
[ https://issues.apache.org/jira/browse/SPARK-41798?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Dongjoon Hyun reassigned SPARK-41798: - Assignee: Dongjoon Hyun > Upgrade hive-storage-api to 2.8.1 >

[jira] [Commented] (SPARK-41066) Implement `DataFrame.sampleBy ` and `DataFrame.stat.sampleBy `

2022-12-31 Thread jiaan.geng (Jira)
[ https://issues.apache.org/jira/browse/SPARK-41066?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17653293#comment-17653293 ] jiaan.geng commented on SPARK-41066: I'll try this. > Implement `DataFrame.sampleBy ` and

[jira] (SPARK-41065) Implement `DataFrame.freqItems ` and `DataFrame.stat.freqItems `

2022-12-31 Thread jiaan.geng (Jira)
[ https://issues.apache.org/jira/browse/SPARK-41065 ] jiaan.geng deleted comment on SPARK-41065: was (Author: beliefer): I'll try this. > Implement `DataFrame.freqItems ` and `DataFrame.stat.freqItems ` >

[jira] [Assigned] (SPARK-41800) Upgrade commons-compress to 1.22

2022-12-31 Thread Apache Spark (Jira)
[ https://issues.apache.org/jira/browse/SPARK-41800?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-41800: Assignee: (was: Apache Spark) > Upgrade commons-compress to 1.22 >

[jira] [Commented] (SPARK-41800) Upgrade commons-compress to 1.22

2022-12-31 Thread Apache Spark (Jira)
[ https://issues.apache.org/jira/browse/SPARK-41800?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17653291#comment-17653291 ] Apache Spark commented on SPARK-41800: -- User 'panbingkun' has created a pull request for this

[jira] [Commented] (SPARK-41800) Upgrade commons-compress to 1.22

2022-12-31 Thread Apache Spark (Jira)
[ https://issues.apache.org/jira/browse/SPARK-41800?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17653292#comment-17653292 ] Apache Spark commented on SPARK-41800: -- User 'panbingkun' has created a pull request for this

[jira] [Assigned] (SPARK-41800) Upgrade commons-compress to 1.22

2022-12-31 Thread Apache Spark (Jira)
[ https://issues.apache.org/jira/browse/SPARK-41800?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-41800: Assignee: Apache Spark > Upgrade commons-compress to 1.22 >

[jira] [Created] (SPARK-41800) Upgrade commons-compress to 1.22

2022-12-31 Thread BingKun Pan (Jira)
BingKun Pan created SPARK-41800: --- Summary: Upgrade commons-compress to 1.22 Key: SPARK-41800 URL: https://issues.apache.org/jira/browse/SPARK-41800 Project: Spark Issue Type: Improvement

[jira] [Commented] (SPARK-41065) Implement `DataFrame.freqItems ` and `DataFrame.stat.freqItems `

2022-12-31 Thread Apache Spark (Jira)
[ https://issues.apache.org/jira/browse/SPARK-41065?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17653290#comment-17653290 ] Apache Spark commented on SPARK-41065: -- User 'beliefer' has created a pull request for this issue:

[jira] [Commented] (SPARK-41065) Implement `DataFrame.freqItems ` and `DataFrame.stat.freqItems `

2022-12-31 Thread Apache Spark (Jira)
[ https://issues.apache.org/jira/browse/SPARK-41065?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17653289#comment-17653289 ] Apache Spark commented on SPARK-41065: -- User 'beliefer' has created a pull request for this issue:

[jira] [Assigned] (SPARK-41065) Implement `DataFrame.freqItems ` and `DataFrame.stat.freqItems `

2022-12-31 Thread Apache Spark (Jira)
[ https://issues.apache.org/jira/browse/SPARK-41065?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-41065: Assignee: (was: Apache Spark) > Implement `DataFrame.freqItems ` and

[jira] [Assigned] (SPARK-41065) Implement `DataFrame.freqItems ` and `DataFrame.stat.freqItems `

2022-12-31 Thread Apache Spark (Jira)
[ https://issues.apache.org/jira/browse/SPARK-41065?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-41065: Assignee: Apache Spark > Implement `DataFrame.freqItems ` and `DataFrame.stat.freqItems

[jira] [Assigned] (SPARK-41066) Implement `DataFrame.sampleBy ` and `DataFrame.stat.sampleBy `

2022-12-31 Thread Ruifeng Zheng (Jira)
[ https://issues.apache.org/jira/browse/SPARK-41066?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Ruifeng Zheng reassigned SPARK-41066: - Assignee: Ruifeng Zheng > Implement `DataFrame.sampleBy ` and `DataFrame.stat.sampleBy

[jira] [Assigned] (SPARK-41493) Make csv functions support options

2022-12-31 Thread Apache Spark (Jira)
[ https://issues.apache.org/jira/browse/SPARK-41493?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-41493: Assignee: Ruifeng Zheng (was: Apache Spark) > Make csv functions support options >

[jira] [Assigned] (SPARK-41493) Make csv functions support options

2022-12-31 Thread Apache Spark (Jira)
[ https://issues.apache.org/jira/browse/SPARK-41493?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-41493: Assignee: Apache Spark (was: Ruifeng Zheng) > Make csv functions support options >

[jira] [Commented] (SPARK-41493) Make csv functions support options

2022-12-31 Thread Apache Spark (Jira)
[ https://issues.apache.org/jira/browse/SPARK-41493?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17653282#comment-17653282 ] Apache Spark commented on SPARK-41493: -- User 'zhengruifeng' has created a pull request for this