[jira] [Resolved] (SPARK-46308) Forbid recursive error handling by adding recursion guards

2023-12-18 Thread Hyukjin Kwon (Jira)
[ https://issues.apache.org/jira/browse/SPARK-46308?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Hyukjin Kwon resolved SPARK-46308. -- Fix Version/s: 4.0.0 Resolution: Fixed Issue resolved by pull request 44210

[jira] [Resolved] (SPARK-46386) Improve assertions of observation (pyspark.sql.observation)

2023-12-16 Thread Hyukjin Kwon (Jira)
[ https://issues.apache.org/jira/browse/SPARK-46386?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Hyukjin Kwon resolved SPARK-46386. -- Fix Version/s: 4.0.0 Resolution: Fixed Issue resolved by pull request 44324

[jira] [Resolved] (SPARK-46424) Support PythonSQLMetrics.pythonMetrics

2023-12-16 Thread Hyukjin Kwon (Jira)
[ https://issues.apache.org/jira/browse/SPARK-46424?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Hyukjin Kwon resolved SPARK-46424. -- Fix Version/s: 4.0.0 Resolution: Fixed Issue resolved by pull request 44375

[jira] [Assigned] (SPARK-46424) Support PythonSQLMetrics.pythonMetrics

2023-12-16 Thread Hyukjin Kwon (Jira)
[ https://issues.apache.org/jira/browse/SPARK-46424?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Hyukjin Kwon reassigned SPARK-46424: Assignee: Hyukjin Kwon > Support PythonSQLMetrics.pythonMetrics >

[jira] [Resolved] (SPARK-46427) Change Python Data Source's description to be pretty in explain

2023-12-15 Thread Hyukjin Kwon (Jira)
[ https://issues.apache.org/jira/browse/SPARK-46427?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Hyukjin Kwon resolved SPARK-46427. -- Fix Version/s: 4.0.0 Resolution: Fixed Issue resolved by pull request 44379

[jira] [Assigned] (SPARK-46427) Change Python Data Source's description to be pretty in explain

2023-12-15 Thread Hyukjin Kwon (Jira)
[ https://issues.apache.org/jira/browse/SPARK-46427?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Hyukjin Kwon reassigned SPARK-46427: Assignee: Hyukjin Kwon > Change Python Data Source's description to be pretty in explain

[jira] [Created] (SPARK-46427) Change Python Data Source's description to be pretty in explain

2023-12-15 Thread Hyukjin Kwon (Jira)
Hyukjin Kwon created SPARK-46427: Summary: Change Python Data Source's description to be pretty in explain Key: SPARK-46427 URL: https://issues.apache.org/jira/browse/SPARK-46427 Project: Spark

[jira] [Resolved] (SPARK-46425) Pin the bundler version in CI

2023-12-15 Thread Hyukjin Kwon (Jira)
[ https://issues.apache.org/jira/browse/SPARK-46425?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Hyukjin Kwon resolved SPARK-46425. -- Fix Version/s: 4.0.0 Resolution: Fixed Issue resolved by pull request 44376

[jira] [Assigned] (SPARK-46425) Pin the bundler version in CI

2023-12-15 Thread Hyukjin Kwon (Jira)
[ https://issues.apache.org/jira/browse/SPARK-46425?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Hyukjin Kwon reassigned SPARK-46425: Assignee: Hyukjin Kwon > Pin the bundler version in CI > - >

[jira] [Resolved] (SPARK-46414) Use prependBaseUri to render javascript imports

2023-12-15 Thread Hyukjin Kwon (Jira)
[ https://issues.apache.org/jira/browse/SPARK-46414?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Hyukjin Kwon resolved SPARK-46414. -- Fix Version/s: 4.0.0 Resolution: Fixed Issue resolved by pull request 44363

[jira] [Deleted] (SPARK-46426) Uses sum metrics for number of output length

2023-12-15 Thread Hyukjin Kwon (Jira)
[ https://issues.apache.org/jira/browse/SPARK-46426?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Hyukjin Kwon deleted SPARK-46426: - > Uses sum metrics for number of output length > > >

[jira] [Updated] (SPARK-46426) Uses sum metrics for number of output length

2023-12-15 Thread Hyukjin Kwon (Jira)
[ https://issues.apache.org/jira/browse/SPARK-46426?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Hyukjin Kwon updated SPARK-46426: - Attachment: Screenshot 2023-12-15 at 3.23.09 PM.png > Uses sum metrics for number of output

[jira] [Updated] (SPARK-46426) Uses sum metrics for number of output length

2023-12-15 Thread Hyukjin Kwon (Jira)
[ https://issues.apache.org/jira/browse/SPARK-46426?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Hyukjin Kwon updated SPARK-46426: - Description: screenhot attached. it shouldn't look like bytes > Uses sum metrics for number of

[jira] [Created] (SPARK-46426) Uses sum metrics for number of output length

2023-12-15 Thread Hyukjin Kwon (Jira)
Hyukjin Kwon created SPARK-46426: Summary: Uses sum metrics for number of output length Key: SPARK-46426 URL: https://issues.apache.org/jira/browse/SPARK-46426 Project: Spark Issue Type:

[jira] [Assigned] (SPARK-46423) Refactor Python Data Source instance loading

2023-12-15 Thread Hyukjin Kwon (Jira)
[ https://issues.apache.org/jira/browse/SPARK-46423?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Hyukjin Kwon reassigned SPARK-46423: Assignee: Hyukjin Kwon > Refactor Python Data Source instance loading >

[jira] [Resolved] (SPARK-46423) Refactor Python Data Source instance loading

2023-12-15 Thread Hyukjin Kwon (Jira)
[ https://issues.apache.org/jira/browse/SPARK-46423?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Hyukjin Kwon resolved SPARK-46423. -- Fix Version/s: 4.0.0 Resolution: Fixed Issue resolved by pull request 44374

[jira] [Created] (SPARK-46425) Pin the bundler version in CI

2023-12-15 Thread Hyukjin Kwon (Jira)
Hyukjin Kwon created SPARK-46425: Summary: Pin the bundler version in CI Key: SPARK-46425 URL: https://issues.apache.org/jira/browse/SPARK-46425 Project: Spark Issue Type: Improvement

[jira] [Updated] (SPARK-46424) Support PythonSQLMetrics.pythonMetrics

2023-12-15 Thread Hyukjin Kwon (Jira)
[ https://issues.apache.org/jira/browse/SPARK-46424?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Hyukjin Kwon updated SPARK-46424: - Summary: Support PythonSQLMetrics.pythonMetrics (was: Support PythonSQLMetrics.pythonMetrics

[jira] [Updated] (SPARK-46424) Support PythonSQLMetrics.pythonMetrics via custom metrics API in DSv2

2023-12-15 Thread Hyukjin Kwon (Jira)
[ https://issues.apache.org/jira/browse/SPARK-46424?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Hyukjin Kwon updated SPARK-46424: - Priority: Minor (was: Major) > Support PythonSQLMetrics.pythonMetrics via custom metrics API

[jira] [Created] (SPARK-46424) Support PythonSQLMetrics.pythonMetrics via custom metrics API in DSv2

2023-12-15 Thread Hyukjin Kwon (Jira)
Hyukjin Kwon created SPARK-46424: Summary: Support PythonSQLMetrics.pythonMetrics via custom metrics API in DSv2 Key: SPARK-46424 URL: https://issues.apache.org/jira/browse/SPARK-46424 Project: Spark

[jira] [Assigned] (SPARK-46419) Reorganize `DatetimeIndexTests`: Factor out 3 slow tests

2023-12-15 Thread Hyukjin Kwon (Jira)
[ https://issues.apache.org/jira/browse/SPARK-46419?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Hyukjin Kwon reassigned SPARK-46419: Assignee: Ruifeng Zheng > Reorganize `DatetimeIndexTests`: Factor out 3 slow tests >

[jira] [Resolved] (SPARK-46419) Reorganize `DatetimeIndexTests`: Factor out 3 slow tests

2023-12-15 Thread Hyukjin Kwon (Jira)
[ https://issues.apache.org/jira/browse/SPARK-46419?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Hyukjin Kwon resolved SPARK-46419. -- Fix Version/s: 4.0.0 Resolution: Fixed Issue resolved by pull request 44369

[jira] [Created] (SPARK-46423) Refactor Python Data Source instance loading

2023-12-15 Thread Hyukjin Kwon (Jira)
Hyukjin Kwon created SPARK-46423: Summary: Refactor Python Data Source instance loading Key: SPARK-46423 URL: https://issues.apache.org/jira/browse/SPARK-46423 Project: Spark Issue Type:

[jira] [Assigned] (SPARK-45597) Support creating table using a Python data source in SQL

2023-12-15 Thread Hyukjin Kwon (Jira)
[ https://issues.apache.org/jira/browse/SPARK-45597?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Hyukjin Kwon reassigned SPARK-45597: Assignee: Hyukjin Kwon (was: Allison Wang) > Support creating table using a Python data

[jira] [Assigned] (SPARK-45597) Support creating table using a Python data source in SQL

2023-12-15 Thread Hyukjin Kwon (Jira)
[ https://issues.apache.org/jira/browse/SPARK-45597?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Hyukjin Kwon reassigned SPARK-45597: Assignee: Allison Wang > Support creating table using a Python data source in SQL >

[jira] [Resolved] (SPARK-45597) Support creating table using a Python data source in SQL

2023-12-15 Thread Hyukjin Kwon (Jira)
[ https://issues.apache.org/jira/browse/SPARK-45597?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Hyukjin Kwon resolved SPARK-45597. -- Fix Version/s: 4.0.0 Resolution: Fixed Issue resolved by pull request 44305

[jira] [Resolved] (SPARK-46409) Spark Connect Repl does not work with ClosureCleaner

2023-12-15 Thread Hyukjin Kwon (Jira)
[ https://issues.apache.org/jira/browse/SPARK-46409?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Hyukjin Kwon resolved SPARK-46409. -- Fix Version/s: 4.0.0 Resolution: Fixed Issue resolved by pull request 44360

[jira] [Assigned] (SPARK-46409) Spark Connect Repl does not work with ClosureCleaner

2023-12-15 Thread Hyukjin Kwon (Jira)
[ https://issues.apache.org/jira/browse/SPARK-46409?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Hyukjin Kwon reassigned SPARK-46409: Assignee: Vsevolod Stepanov > Spark Connect Repl does not work with ClosureCleaner >

[jira] [Resolved] (SPARK-46402) Add getMessageParameters and getQueryContext support

2023-12-14 Thread Hyukjin Kwon (Jira)
[ https://issues.apache.org/jira/browse/SPARK-46402?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Hyukjin Kwon resolved SPARK-46402. -- Fix Version/s: 4.0.0 Resolution: Fixed Issue resolved by pull request 44349

[jira] [Assigned] (SPARK-46402) Add getMessageParameters and getQueryContext support

2023-12-14 Thread Hyukjin Kwon (Jira)
[ https://issues.apache.org/jira/browse/SPARK-46402?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Hyukjin Kwon reassigned SPARK-46402: Assignee: Hyukjin Kwon > Add getMessageParameters and getQueryContext support >

[jira] [Created] (SPARK-46402) Add getMessageParameters and getQueryContext support

2023-12-13 Thread Hyukjin Kwon (Jira)
Hyukjin Kwon created SPARK-46402: Summary: Add getMessageParameters and getQueryContext support Key: SPARK-46402 URL: https://issues.apache.org/jira/browse/SPARK-46402 Project: Spark Issue

[jira] [Created] (SPARK-46397) sha2(df.a, 1024) throws a different exception in Spark Connect

2023-12-13 Thread Hyukjin Kwon (Jira)
Hyukjin Kwon created SPARK-46397: Summary: sha2(df.a, 1024) throws a different exception in Spark Connect Key: SPARK-46397 URL: https://issues.apache.org/jira/browse/SPARK-46397 Project: Spark

[jira] [Assigned] (SPARK-46385) Test aggregate functions for groups (pyspark.sql.group)

2023-12-13 Thread Hyukjin Kwon (Jira)
[ https://issues.apache.org/jira/browse/SPARK-46385?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Hyukjin Kwon reassigned SPARK-46385: Assignee: Xinrong Meng > Test aggregate functions for groups (pyspark.sql.group) >

[jira] [Resolved] (SPARK-46385) Test aggregate functions for groups (pyspark.sql.group)

2023-12-13 Thread Hyukjin Kwon (Jira)
[ https://issues.apache.org/jira/browse/SPARK-46385?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Hyukjin Kwon resolved SPARK-46385. -- Fix Version/s: 4.0.0 Resolution: Fixed Issue resolved by pull request 44322

[jira] [Resolved] (SPARK-46153) XML: Add TimestampNTZType support

2023-12-13 Thread Hyukjin Kwon (Jira)
[ https://issues.apache.org/jira/browse/SPARK-46153?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Hyukjin Kwon resolved SPARK-46153. -- Fix Version/s: 4.0.0 Resolution: Fixed Issue resolved by pull request 44329

[jira] [Assigned] (SPARK-46153) XML: Add TimestampNTZType support

2023-12-13 Thread Hyukjin Kwon (Jira)
[ https://issues.apache.org/jira/browse/SPARK-46153?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Hyukjin Kwon reassigned SPARK-46153: Assignee: Sandip Agarwala > XML: Add TimestampNTZType support >

[jira] [Resolved] (SPARK-46379) Reorganize `FrameInterpolateTests`

2023-12-12 Thread Hyukjin Kwon (Jira)
[ https://issues.apache.org/jira/browse/SPARK-46379?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Hyukjin Kwon resolved SPARK-46379. -- Fix Version/s: 4.0.0 Resolution: Fixed Issue resolved by pull request 44313

[jira] [Assigned] (SPARK-46379) Reorganize `FrameInterpolateTests`

2023-12-12 Thread Hyukjin Kwon (Jira)
[ https://issues.apache.org/jira/browse/SPARK-46379?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Hyukjin Kwon reassigned SPARK-46379: Assignee: Ruifeng Zheng > Reorganize `FrameInterpolateTests` >

[jira] [Assigned] (SPARK-46253) Plan Python data source read using mapInArrow

2023-12-12 Thread Hyukjin Kwon (Jira)
[ https://issues.apache.org/jira/browse/SPARK-46253?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Hyukjin Kwon reassigned SPARK-46253: Assignee: Allison Wang > Plan Python data source read using mapInArrow >

[jira] [Resolved] (SPARK-46253) Plan Python data source read using mapInArrow

2023-12-12 Thread Hyukjin Kwon (Jira)
[ https://issues.apache.org/jira/browse/SPARK-46253?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Hyukjin Kwon resolved SPARK-46253. -- Fix Version/s: 4.0.0 Resolution: Fixed Issue resolved by pull request 44170

[jira] [Resolved] (SPARK-46075) Refactor SparkConnectSessionManager to not use guava cache

2023-12-12 Thread Hyukjin Kwon (Jira)
[ https://issues.apache.org/jira/browse/SPARK-46075?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Hyukjin Kwon resolved SPARK-46075. -- Fix Version/s: 4.0.0 Resolution: Fixed Issue resolved by pull request 43985

[jira] [Assigned] (SPARK-46075) Refactor SparkConnectSessionManager to not use guava cache

2023-12-12 Thread Hyukjin Kwon (Jira)
[ https://issues.apache.org/jira/browse/SPARK-46075?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Hyukjin Kwon reassigned SPARK-46075: Assignee: Juliusz Sompolski > Refactor SparkConnectSessionManager to not use guava cache

[jira] [Assigned] (SPARK-46360) Enhance error message debugging with new `getMessage` API

2023-12-11 Thread Hyukjin Kwon (Jira)
[ https://issues.apache.org/jira/browse/SPARK-46360?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Hyukjin Kwon reassigned SPARK-46360: Assignee: Haejoon Lee > Enhance error message debugging with new `getMessage` API >

[jira] [Resolved] (SPARK-46360) Enhance error message debugging with new `getMessage` API

2023-12-11 Thread Hyukjin Kwon (Jira)
[ https://issues.apache.org/jira/browse/SPARK-46360?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Hyukjin Kwon resolved SPARK-46360. -- Fix Version/s: 4.0.0 Resolution: Fixed Issue resolved by pull request 44292

[jira] [Assigned] (SPARK-43427) Unsigned integer types are deserialized as signed numeric equivalents

2023-12-11 Thread Hyukjin Kwon (Jira)
[ https://issues.apache.org/jira/browse/SPARK-43427?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Hyukjin Kwon reassigned SPARK-43427: Assignee: Parth Upadhyay > Unsigned integer types are deserialized as signed numeric

[jira] [Resolved] (SPARK-43427) Unsigned integer types are deserialized as signed numeric equivalents

2023-12-11 Thread Hyukjin Kwon (Jira)
[ https://issues.apache.org/jira/browse/SPARK-43427?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Hyukjin Kwon resolved SPARK-43427. -- Fix Version/s: 4.0.0 Resolution: Fixed Issue resolved by pull request 43773

[jira] [Resolved] (SPARK-46273) Support INSERT INTO/OVERWRITE using DSv2 sources

2023-12-11 Thread Hyukjin Kwon (Jira)
[ https://issues.apache.org/jira/browse/SPARK-46273?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Hyukjin Kwon resolved SPARK-46273. -- Fix Version/s: 4.0.0 Resolution: Fixed Issue resolved by pull request 44213

[jira] [Assigned] (SPARK-46273) Support INSERT INTO/OVERWRITE using DSv2 sources

2023-12-11 Thread Hyukjin Kwon (Jira)
[ https://issues.apache.org/jira/browse/SPARK-46273?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Hyukjin Kwon reassigned SPARK-46273: Assignee: Allison Wang > Support INSERT INTO/OVERWRITE using DSv2 sources >

[jira] [Resolved] (SPARK-46347) Reorganize `RollingTests `

2023-12-11 Thread Hyukjin Kwon (Jira)
[ https://issues.apache.org/jira/browse/SPARK-46347?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Hyukjin Kwon resolved SPARK-46347. -- Fix Version/s: 4.0.0 Resolution: Fixed Issue resolved by pull request 44281

[jira] [Assigned] (SPARK-46347) Reorganize `RollingTests `

2023-12-11 Thread Hyukjin Kwon (Jira)
[ https://issues.apache.org/jira/browse/SPARK-46347?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Hyukjin Kwon reassigned SPARK-46347: Assignee: Ruifeng Zheng > Reorganize `RollingTests ` > -- > >

[jira] [Resolved] (SPARK-46355) XML: Close InputStreamReader on read completion

2023-12-11 Thread Hyukjin Kwon (Jira)
[ https://issues.apache.org/jira/browse/SPARK-46355?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Hyukjin Kwon resolved SPARK-46355. -- Fix Version/s: 4.0.0 Resolution: Fixed Issue resolved by pull request 44287

[jira] [Assigned] (SPARK-46355) XML: Close InputStreamReader on read completion

2023-12-11 Thread Hyukjin Kwon (Jira)
[ https://issues.apache.org/jira/browse/SPARK-46355?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Hyukjin Kwon reassigned SPARK-46355: Assignee: Sandip Agarwala > XML: Close InputStreamReader on read completion >

[jira] [Resolved] (SPARK-46337) Make `CTESubstitution` retain the PLAN_ID_TAG

2023-12-08 Thread Hyukjin Kwon (Jira)
[ https://issues.apache.org/jira/browse/SPARK-46337?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Hyukjin Kwon resolved SPARK-46337. -- Fix Version/s: 4.0.0 Resolution: Fixed Issue resolved by pull request 44268

[jira] [Assigned] (SPARK-46337) Make `CTESubstitution` retain the PLAN_ID_TAG

2023-12-08 Thread Hyukjin Kwon (Jira)
[ https://issues.apache.org/jira/browse/SPARK-46337?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Hyukjin Kwon reassigned SPARK-46337: Assignee: Ruifeng Zheng > Make `CTESubstitution` retain the PLAN_ID_TAG >

[jira] [Resolved] (SPARK-46327) Reorganize `SeriesStringTests`

2023-12-08 Thread Hyukjin Kwon (Jira)
[ https://issues.apache.org/jira/browse/SPARK-46327?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Hyukjin Kwon resolved SPARK-46327. -- Fix Version/s: 4.0.0 Resolution: Fixed Issue resolved by pull request 44257

[jira] [Assigned] (SPARK-46327) Reorganize `SeriesStringTests`

2023-12-08 Thread Hyukjin Kwon (Jira)
[ https://issues.apache.org/jira/browse/SPARK-46327?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Hyukjin Kwon reassigned SPARK-46327: Assignee: Ruifeng Zheng > Reorganize `SeriesStringTests` >

[jira] [Assigned] (SPARK-46326) Test missing cases for functions (pyspark.sql.functions)

2023-12-08 Thread Hyukjin Kwon (Jira)
[ https://issues.apache.org/jira/browse/SPARK-46326?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Hyukjin Kwon reassigned SPARK-46326: Assignee: Hyukjin Kwon > Test missing cases for functions (pyspark.sql.functions) >

[jira] [Resolved] (SPARK-46326) Test missing cases for functions (pyspark.sql.functions)

2023-12-08 Thread Hyukjin Kwon (Jira)
[ https://issues.apache.org/jira/browse/SPARK-46326?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Hyukjin Kwon resolved SPARK-46326. -- Fix Version/s: 4.0.0 Resolution: Fixed Issue resolved by pull request 44256

[jira] [Assigned] (SPARK-46323) Fix the output name of pyspark.sql.functions.now

2023-12-08 Thread Hyukjin Kwon (Jira)
[ https://issues.apache.org/jira/browse/SPARK-46323?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Hyukjin Kwon reassigned SPARK-46323: Assignee: Hyukjin Kwon > Fix the output name of pyspark.sql.functions.now >

[jira] [Resolved] (SPARK-46323) Fix the output name of pyspark.sql.functions.now

2023-12-08 Thread Hyukjin Kwon (Jira)
[ https://issues.apache.org/jira/browse/SPARK-46323?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Hyukjin Kwon resolved SPARK-46323. -- Fix Version/s: 4.0.0 Resolution: Fixed Issue resolved by pull request 44252

[jira] [Resolved] (SPARK-46275) Protobuf: Permissive mode should return null rather than struct with null fields

2023-12-07 Thread Hyukjin Kwon (Jira)
[ https://issues.apache.org/jira/browse/SPARK-46275?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Hyukjin Kwon resolved SPARK-46275. -- Assignee: Raghu Angadi Resolution: Fixed Fixed in

[jira] [Created] (SPARK-46326) Test missing cases for functions (pyspark.sql.functions)

2023-12-07 Thread Hyukjin Kwon (Jira)
Hyukjin Kwon created SPARK-46326: Summary: Test missing cases for functions (pyspark.sql.functions) Key: SPARK-46326 URL: https://issues.apache.org/jira/browse/SPARK-46326 Project: Spark

[jira] [Created] (SPARK-46324) Fix the output name of pyspark.sql.functions.user and session_user

2023-12-07 Thread Hyukjin Kwon (Jira)
Hyukjin Kwon created SPARK-46324: Summary: Fix the output name of pyspark.sql.functions.user and session_user Key: SPARK-46324 URL: https://issues.apache.org/jira/browse/SPARK-46324 Project: Spark

[jira] [Created] (SPARK-46323) Fix the output name of pyspark.sql.functions.now

2023-12-07 Thread Hyukjin Kwon (Jira)
Hyukjin Kwon created SPARK-46323: Summary: Fix the output name of pyspark.sql.functions.now Key: SPARK-46323 URL: https://issues.apache.org/jira/browse/SPARK-46323 Project: Spark Issue Type:

[jira] [Resolved] (SPARK-46317) Test missing cases for SparkSession (pyspark.sql.session)

2023-12-07 Thread Hyukjin Kwon (Jira)
[ https://issues.apache.org/jira/browse/SPARK-46317?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Hyukjin Kwon resolved SPARK-46317. -- Fix Version/s: 4.0.0 Resolution: Fixed Issue resolved by pull request 44247

[jira] [Assigned] (SPARK-46317) Test missing cases for SparkSession (pyspark.sql.session)

2023-12-07 Thread Hyukjin Kwon (Jira)
[ https://issues.apache.org/jira/browse/SPARK-46317?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Hyukjin Kwon reassigned SPARK-46317: Assignee: Hyukjin Kwon > Test missing cases for SparkSession (pyspark.sql.session) >

[jira] [Assigned] (SPARK-46315) Test invalid key for spark.conf.get (pyspark.sql.conf)

2023-12-07 Thread Hyukjin Kwon (Jira)
[ https://issues.apache.org/jira/browse/SPARK-46315?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Hyukjin Kwon reassigned SPARK-46315: Assignee: Hyukjin Kwon > Test invalid key for spark.conf.get (pyspark.sql.conf) >

[jira] [Resolved] (SPARK-46315) Test invalid key for spark.conf.get (pyspark.sql.conf)

2023-12-07 Thread Hyukjin Kwon (Jira)
[ https://issues.apache.org/jira/browse/SPARK-46315?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Hyukjin Kwon resolved SPARK-46315. -- Fix Version/s: 4.0.0 Resolution: Fixed Issue resolved by pull request 44245

[jira] [Assigned] (SPARK-46318) Exclude ported loose_version from the code coverage report

2023-12-07 Thread Hyukjin Kwon (Jira)
[ https://issues.apache.org/jira/browse/SPARK-46318?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Hyukjin Kwon reassigned SPARK-46318: Assignee: Hyukjin Kwon > Exclude ported loose_version from the code coverage report >

[jira] [Resolved] (SPARK-46318) Exclude ported loose_version from the code coverage report

2023-12-07 Thread Hyukjin Kwon (Jira)
[ https://issues.apache.org/jira/browse/SPARK-46318?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Hyukjin Kwon resolved SPARK-46318. -- Fix Version/s: 4.0.0 Resolution: Fixed Issue resolved by pull request 44248

[jira] [Created] (SPARK-46318) Exclude ported loose_version from the code coverage report

2023-12-07 Thread Hyukjin Kwon (Jira)
Hyukjin Kwon created SPARK-46318: Summary: Exclude ported loose_version from the code coverage report Key: SPARK-46318 URL: https://issues.apache.org/jira/browse/SPARK-46318 Project: Spark

[jira] [Created] (SPARK-46317) Test missing cases for SparkSession (pyspark.sql.session)

2023-12-07 Thread Hyukjin Kwon (Jira)
Hyukjin Kwon created SPARK-46317: Summary: Test missing cases for SparkSession (pyspark.sql.session) Key: SPARK-46317 URL: https://issues.apache.org/jira/browse/SPARK-46317 Project: Spark

[jira] [Updated] (SPARK-46315) Test invalid key for spark.conf.get (pyspark.sql.conf)

2023-12-07 Thread Hyukjin Kwon (Jira)
[ https://issues.apache.org/jira/browse/SPARK-46315?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Hyukjin Kwon updated SPARK-46315: - Summary: Test invalid key for spark.conf.get (pyspark.sql.conf) (was: Test invalid value for

[jira] [Created] (SPARK-46315) Test invalid value for spark.conf (pyspark.sql.conf)

2023-12-07 Thread Hyukjin Kwon (Jira)
Hyukjin Kwon created SPARK-46315: Summary: Test invalid value for spark.conf (pyspark.sql.conf) Key: SPARK-46315 URL: https://issues.apache.org/jira/browse/SPARK-46315 Project: Spark Issue

[jira] [Resolved] (SPARK-46300) Test missing test coverage for Column (pyspark.sql.column)

2023-12-06 Thread Hyukjin Kwon (Jira)
[ https://issues.apache.org/jira/browse/SPARK-46300?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Hyukjin Kwon resolved SPARK-46300. -- Fix Version/s: 4.0.0 Resolution: Fixed Issue resolved by pull request 44228

[jira] [Assigned] (SPARK-46300) Test missing test coverage for Column (pyspark.sql.column)

2023-12-06 Thread Hyukjin Kwon (Jira)
[ https://issues.apache.org/jira/browse/SPARK-46300?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Hyukjin Kwon reassigned SPARK-46300: Assignee: Hyukjin Kwon > Test missing test coverage for Column (pyspark.sql.column) >

[jira] [Assigned] (SPARK-46298) Test catalog error classes (pyspark.sql.catalog)

2023-12-06 Thread Hyukjin Kwon (Jira)
[ https://issues.apache.org/jira/browse/SPARK-46298?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Hyukjin Kwon reassigned SPARK-46298: Assignee: Hyukjin Kwon > Test catalog error classes (pyspark.sql.catalog) >

[jira] [Resolved] (SPARK-46298) Test catalog error classes (pyspark.sql.catalog)

2023-12-06 Thread Hyukjin Kwon (Jira)
[ https://issues.apache.org/jira/browse/SPARK-46298?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Hyukjin Kwon resolved SPARK-46298. -- Fix Version/s: 4.0.0 Resolution: Fixed Issue resolved by pull request 44226

[jira] [Resolved] (SPARK-46296) Test captured errors (pyspark.errors.exceptions.captured)

2023-12-06 Thread Hyukjin Kwon (Jira)
[ https://issues.apache.org/jira/browse/SPARK-46296?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Hyukjin Kwon resolved SPARK-46296. -- Fix Version/s: 4.0.0 Resolution: Fixed Issue resolved by pull request 44224

[jira] [Assigned] (SPARK-46296) Test captured errors (pyspark.errors.exceptions.captured)

2023-12-06 Thread Hyukjin Kwon (Jira)
[ https://issues.apache.org/jira/browse/SPARK-46296?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Hyukjin Kwon reassigned SPARK-46296: Assignee: Hyukjin Kwon > Test captured errors (pyspark.errors.exceptions.captured) >

[jira] [Created] (SPARK-46300) Test missing test coverage for Column (pyspark.sql.column)

2023-12-06 Thread Hyukjin Kwon (Jira)
Hyukjin Kwon created SPARK-46300: Summary: Test missing test coverage for Column (pyspark.sql.column) Key: SPARK-46300 URL: https://issues.apache.org/jira/browse/SPARK-46300 Project: Spark

[jira] [Assigned] (SPARK-46297) Exclude generated files from the code coverage report

2023-12-06 Thread Hyukjin Kwon (Jira)
[ https://issues.apache.org/jira/browse/SPARK-46297?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Hyukjin Kwon reassigned SPARK-46297: Assignee: Hyukjin Kwon > Exclude generated files from the code coverage report >

[jira] [Resolved] (SPARK-46297) Exclude generated files from the code coverage report

2023-12-06 Thread Hyukjin Kwon (Jira)
[ https://issues.apache.org/jira/browse/SPARK-46297?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Hyukjin Kwon resolved SPARK-46297. -- Fix Version/s: 4.0.0 Resolution: Fixed Issue resolved by pull request 44225

[jira] [Created] (SPARK-46298) Test catalog error classes (pyspark.sql.catalog)

2023-12-06 Thread Hyukjin Kwon (Jira)
Hyukjin Kwon created SPARK-46298: Summary: Test catalog error classes (pyspark.sql.catalog) Key: SPARK-46298 URL: https://issues.apache.org/jira/browse/SPARK-46298 Project: Spark Issue Type:

[jira] [Updated] (SPARK-46296) Test captured errors (pyspark.errors.exceptions.captured)

2023-12-06 Thread Hyukjin Kwon (Jira)
[ https://issues.apache.org/jira/browse/SPARK-46296?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Hyukjin Kwon updated SPARK-46296: - Summary: Test captured errors (pyspark.errors.exceptions.captured) (was: Test captured errors

[jira] [Created] (SPARK-46297) Exclude generated files from the code coverage report

2023-12-06 Thread Hyukjin Kwon (Jira)
Hyukjin Kwon created SPARK-46297: Summary: Exclude generated files from the code coverage report Key: SPARK-46297 URL: https://issues.apache.org/jira/browse/SPARK-46297 Project: Spark Issue

[jira] [Created] (SPARK-46296) Test captured errors of TestResult (pyspark.errors.exceptions.captured)

2023-12-06 Thread Hyukjin Kwon (Jira)
Hyukjin Kwon created SPARK-46296: Summary: Test captured errors of TestResult (pyspark.errors.exceptions.captured) Key: SPARK-46296 URL: https://issues.apache.org/jira/browse/SPARK-46296 Project:

[jira] [Assigned] (SPARK-46290) Change saveMode to overwrite for DataSourceWriter constructor

2023-12-06 Thread Hyukjin Kwon (Jira)
[ https://issues.apache.org/jira/browse/SPARK-46290?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Hyukjin Kwon reassigned SPARK-46290: Assignee: Allison Wang > Change saveMode to overwrite for DataSourceWriter constructor >

[jira] [Resolved] (SPARK-46290) Change saveMode to overwrite for DataSourceWriter constructor

2023-12-06 Thread Hyukjin Kwon (Jira)
[ https://issues.apache.org/jira/browse/SPARK-46290?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Hyukjin Kwon resolved SPARK-46290. -- Fix Version/s: 4.0.0 Resolution: Fixed Issue resolved by pull request 44216

[jira] [Resolved] (SPARK-46280) Move test_parity_frame_resample and test_parity_series_resample to pyspark.pandas.tests.connect.resample

2023-12-06 Thread Hyukjin Kwon (Jira)
[ https://issues.apache.org/jira/browse/SPARK-46280?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Hyukjin Kwon resolved SPARK-46280. -- Fix Version/s: 4.0.0 Resolution: Fixed Issue resolved by pull request 44199

[jira] [Assigned] (SPARK-46280) Move test_parity_frame_resample and test_parity_series_resample to pyspark.pandas.tests.connect.resample

2023-12-06 Thread Hyukjin Kwon (Jira)
[ https://issues.apache.org/jira/browse/SPARK-46280?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Hyukjin Kwon reassigned SPARK-46280: Assignee: Ruifeng Zheng > Move test_parity_frame_resample and

[jira] [Resolved] (SPARK-46276) Improve test coverage of pyspark utils

2023-12-06 Thread Hyukjin Kwon (Jira)
[ https://issues.apache.org/jira/browse/SPARK-46276?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Hyukjin Kwon resolved SPARK-46276. -- Fix Version/s: 4.0.0 Resolution: Fixed Issue resolved by pull request 44192

[jira] [Assigned] (SPARK-46276) Improve test coverage of pyspark utils

2023-12-06 Thread Hyukjin Kwon (Jira)
[ https://issues.apache.org/jira/browse/SPARK-46276?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Hyukjin Kwon reassigned SPARK-46276: Assignee: Xinrong Meng > Improve test coverage of pyspark utils >

[jira] [Resolved] (SPARK-46260) DataFrame.withColumnsRenamed should respect the dict ordering

2023-12-06 Thread Hyukjin Kwon (Jira)
[ https://issues.apache.org/jira/browse/SPARK-46260?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Hyukjin Kwon resolved SPARK-46260. -- Assignee: Ruifeng Zheng Resolution: Fixed Fixed in

[jira] [Assigned] (SPARK-46213) Add PySparkImportError for error framework

2023-12-06 Thread Hyukjin Kwon (Jira)
[ https://issues.apache.org/jira/browse/SPARK-46213?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Hyukjin Kwon reassigned SPARK-46213: Assignee: Haejoon Lee > Add PySparkImportError for error framework >

[jira] [Resolved] (SPARK-46252) Improve test coverage of memory_profiler.py

2023-12-06 Thread Hyukjin Kwon (Jira)
[ https://issues.apache.org/jira/browse/SPARK-46252?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Hyukjin Kwon resolved SPARK-46252. -- Fix Version/s: 4.0.0 Resolution: Fixed Issue resolved by pull request 44167

[jira] [Resolved] (SPARK-46213) Add PySparkImportError for error framework

2023-12-06 Thread Hyukjin Kwon (Jira)
[ https://issues.apache.org/jira/browse/SPARK-46213?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Hyukjin Kwon resolved SPARK-46213. -- Fix Version/s: 4.0.0 Resolution: Fixed Issue resolved by pull request 44176

[jira] [Resolved] (SPARK-46226) Migrate all remaining RuntimeError into PySpark error framework

2023-12-05 Thread Hyukjin Kwon (Jira)
[ https://issues.apache.org/jira/browse/SPARK-46226?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Hyukjin Kwon resolved SPARK-46226. -- Fix Version/s: 4.0.0 Resolution: Fixed Issue resolved by pull request 44143

[jira] [Assigned] (SPARK-46226) Migrate all remaining RuntimeError into PySpark error framework

2023-12-05 Thread Hyukjin Kwon (Jira)
[ https://issues.apache.org/jira/browse/SPARK-46226?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Hyukjin Kwon reassigned SPARK-46226: Assignee: Haejoon Lee > Migrate all remaining RuntimeError into PySpark error framework

[jira] [Resolved] (SPARK-46044) Improve test coverage of udf.py

2023-12-05 Thread Hyukjin Kwon (Jira)
[ https://issues.apache.org/jira/browse/SPARK-46044?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Hyukjin Kwon resolved SPARK-46044. -- Fix Version/s: 4.0.0 Resolution: Fixed Issue resolved by pull request 43947

<    1   2   3   4   5   6   7   8   9   10   >