[jira] [Updated] (SPARK-47429) Rename errorClass to errorCondition

2024-04-15 Thread Nicholas Chammas (Jira)
[ https://issues.apache.org/jira/browse/SPARK-47429?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Nicholas Chammas updated SPARK-47429: - Description: We've agreed on the parent task to rename {{errorClass}} to align it more

[jira] [Commented] (SPARK-28024) Incorrect numeric values when out of range

2024-04-15 Thread Nicholas Chammas (Jira)
[ https://issues.apache.org/jira/browse/SPARK-28024?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17837292#comment-17837292 ] Nicholas Chammas commented on SPARK-28024: -- [~cloud_fan] - Given the updated descriptions for

[jira] [Updated] (SPARK-28024) Incorrect numeric values when out of range

2024-04-12 Thread Nicholas Chammas (Jira)
[ https://issues.apache.org/jira/browse/SPARK-28024?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Nicholas Chammas updated SPARK-28024: - Description: Spark on {{master}} at commit {{de00ac8a05aedb3a150c8c10f76d1fe5496b1df3}}

[jira] [Updated] (SPARK-28024) Incorrect numeric values when out of range

2024-04-12 Thread Nicholas Chammas (Jira)
[ https://issues.apache.org/jira/browse/SPARK-28024?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Nicholas Chammas updated SPARK-28024: - Description: Spark on {{master}} at commit {{de00ac8a05aedb3a150c8c10f76d1fe5496b1df3}}

[jira] [Commented] (SPARK-28024) Incorrect numeric values when out of range

2024-04-12 Thread Nicholas Chammas (Jira)
[ https://issues.apache.org/jira/browse/SPARK-28024?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17836706#comment-17836706 ] Nicholas Chammas commented on SPARK-28024: -- I've just retried cases 2-4 on master with ANSI

[jira] [Updated] (SPARK-28024) Incorrect numeric values when out of range

2024-04-12 Thread Nicholas Chammas (Jira)
[ https://issues.apache.org/jira/browse/SPARK-28024?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Nicholas Chammas updated SPARK-28024: - Description: As compared to PostgreSQL 16. Case 1: {code:sql} select tinyint(128) *

[jira] [Updated] (SPARK-28024) Incorrect numeric values when out of range

2024-04-12 Thread Nicholas Chammas (Jira)
[ https://issues.apache.org/jira/browse/SPARK-28024?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Nicholas Chammas updated SPARK-28024: - Description: As compared to PostgreSQL 16. Case 1: {code:sql} select tinyint(128) *

[jira] [Updated] (SPARK-28024) Incorrect numeric values when out of range

2024-04-12 Thread Nicholas Chammas (Jira)
[ https://issues.apache.org/jira/browse/SPARK-28024?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Nicholas Chammas updated SPARK-28024: - Description: As compared to PostgreSQL 16. Case 1: {code:sql} select tinyint(128) *

[jira] [Updated] (SPARK-28024) Incorrect numeric values when out of range

2024-04-12 Thread Nicholas Chammas (Jira)
[ https://issues.apache.org/jira/browse/SPARK-28024?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Nicholas Chammas updated SPARK-28024: - Description: As compared to PostgreSQL 16. Case 1: {code:sql} select tinyint(128) *

[jira] [Created] (SPARK-47429) Rename errorClass to errorCondition

2024-03-16 Thread Nicholas Chammas (Jira)
Nicholas Chammas created SPARK-47429: Summary: Rename errorClass to errorCondition Key: SPARK-47429 URL: https://issues.apache.org/jira/browse/SPARK-47429 Project: Spark Issue Type:

[jira] [Commented] (SPARK-46810) Clarify error class terminology

2024-03-05 Thread Nicholas Chammas (Jira)
[ https://issues.apache.org/jira/browse/SPARK-46810?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17823713#comment-17823713 ] Nicholas Chammas commented on SPARK-46810: -- [~cloud_fan], [~LuciferYang], [~beliefer], and

[jira] [Created] (SPARK-47271) Explain importance of statistics on SQL performance tuning page

2024-03-04 Thread Nicholas Chammas (Jira)
Nicholas Chammas created SPARK-47271: Summary: Explain importance of statistics on SQL performance tuning page Key: SPARK-47271 URL: https://issues.apache.org/jira/browse/SPARK-47271 Project:

[jira] [Created] (SPARK-47252) Clarify that pivot may trigger an eager computation

2024-03-02 Thread Nicholas Chammas (Jira)
Nicholas Chammas created SPARK-47252: Summary: Clarify that pivot may trigger an eager computation Key: SPARK-47252 URL: https://issues.apache.org/jira/browse/SPARK-47252 Project: Spark

[jira] [Created] (SPARK-47216) Refine layout of SQL performance tuning page

2024-02-28 Thread Nicholas Chammas (Jira)
Nicholas Chammas created SPARK-47216: Summary: Refine layout of SQL performance tuning page Key: SPARK-47216 URL: https://issues.apache.org/jira/browse/SPARK-47216 Project: Spark Issue

[jira] [Commented] (SPARK-47190) Add support for checkpointing to Spark Connect

2024-02-27 Thread Nicholas Chammas (Jira)
[ https://issues.apache.org/jira/browse/SPARK-47190?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17821286#comment-17821286 ] Nicholas Chammas commented on SPARK-47190: -- [~gurwls223] - Is there some design reason we do

[jira] [Created] (SPARK-47190) Add support for checkpointing to Spark Connect

2024-02-27 Thread Nicholas Chammas (Jira)
Nicholas Chammas created SPARK-47190: Summary: Add support for checkpointing to Spark Connect Key: SPARK-47190 URL: https://issues.apache.org/jira/browse/SPARK-47190 Project: Spark Issue

[jira] [Created] (SPARK-47189) Tweak column error names and text

2024-02-27 Thread Nicholas Chammas (Jira)
Nicholas Chammas created SPARK-47189: Summary: Tweak column error names and text Key: SPARK-47189 URL: https://issues.apache.org/jira/browse/SPARK-47189 Project: Spark Issue Type:

[jira] [Created] (SPARK-47180) Migrate CSV parsing off of Univocity

2024-02-26 Thread Nicholas Chammas (Jira)
Nicholas Chammas created SPARK-47180: Summary: Migrate CSV parsing off of Univocity Key: SPARK-47180 URL: https://issues.apache.org/jira/browse/SPARK-47180 Project: Spark Issue Type:

[jira] [Updated] (SPARK-47082) Out of bounds error message is incorrect

2024-02-17 Thread Nicholas Chammas (Jira)
[ https://issues.apache.org/jira/browse/SPARK-47082?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Nicholas Chammas updated SPARK-47082: - Summary: Out of bounds error message is incorrect (was: Out of bounds error message

[jira] [Created] (SPARK-47082) Out of bounds error message flips the bounds

2024-02-17 Thread Nicholas Chammas (Jira)
Nicholas Chammas created SPARK-47082: Summary: Out of bounds error message flips the bounds Key: SPARK-47082 URL: https://issues.apache.org/jira/browse/SPARK-47082 Project: Spark Issue

[jira] [Resolved] (SPARK-47024) Sum of floats/doubles may be incorrect depending on partitioning

2024-02-12 Thread Nicholas Chammas (Jira)
[ https://issues.apache.org/jira/browse/SPARK-47024?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Nicholas Chammas resolved SPARK-47024. -- Resolution: Not A Problem Resolving this as "Not A Problem". I mean, it _is_ a

[jira] [Updated] (SPARK-47024) Sum of floats/doubles may be incorrect depending on partitioning

2024-02-12 Thread Nicholas Chammas (Jira)
[ https://issues.apache.org/jira/browse/SPARK-47024?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Nicholas Chammas updated SPARK-47024: - Description: I found this problem using

[jira] [Created] (SPARK-47024) Sum is incorrect (exact cause currently unknown)

2024-02-12 Thread Nicholas Chammas (Jira)
Nicholas Chammas created SPARK-47024: Summary: Sum is incorrect (exact cause currently unknown) Key: SPARK-47024 URL: https://issues.apache.org/jira/browse/SPARK-47024 Project: Spark

[jira] [Updated] (SPARK-46992) Inconsistent results with 'sort', 'cache', and AQE.

2024-02-06 Thread Nicholas Chammas (Jira)
[ https://issues.apache.org/jira/browse/SPARK-46992?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Nicholas Chammas updated SPARK-46992: - Labels: correctness (was: ) > Inconsistent results with 'sort', 'cache', and AQE. >

[jira] [Commented] (SPARK-46992) Inconsistent results with 'sort', 'cache', and AQE.

2024-02-06 Thread Nicholas Chammas (Jira)
[ https://issues.apache.org/jira/browse/SPARK-46992?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17814913#comment-17814913 ] Nicholas Chammas commented on SPARK-46992: -- I can confirm the behavior described above is still

[jira] [Commented] (SPARK-46810) Clarify error class terminology

2024-02-05 Thread Nicholas Chammas (Jira)
[ https://issues.apache.org/jira/browse/SPARK-46810?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17814406#comment-17814406 ] Nicholas Chammas commented on SPARK-46810: -- [~cloud_fan], [~LuciferYang], [~beliefer], and

[jira] [Commented] (SPARK-40549) PYSPARK: Observation computes the wrong results when using `corr` function

2024-02-02 Thread Nicholas Chammas (Jira)
[ https://issues.apache.org/jira/browse/SPARK-40549?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17813780#comment-17813780 ] Nicholas Chammas commented on SPARK-40549: -- I think this is just a consequence of floating

[jira] [Commented] (SPARK-45786) Inaccurate Decimal multiplication and division results

2024-02-02 Thread Nicholas Chammas (Jira)
[ https://issues.apache.org/jira/browse/SPARK-45786?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17813766#comment-17813766 ] Nicholas Chammas commented on SPARK-45786: -- [~kazuyukitanimura] - I'm just curious: How did you

[jira] [Commented] (SPARK-38167) CSV parsing error when using escape='"'

2024-02-02 Thread Nicholas Chammas (Jira)
[ https://issues.apache.org/jira/browse/SPARK-38167?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17813741#comment-17813741 ] Nicholas Chammas commented on SPARK-38167: -- [~marnixvandenbroek] - Could you link to the bug

[jira] [Updated] (SPARK-42399) CONV() silently overflows returning wrong results

2024-02-02 Thread Nicholas Chammas (Jira)
[ https://issues.apache.org/jira/browse/SPARK-42399?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Nicholas Chammas updated SPARK-42399: - Affects Version/s: (was: 3.5.0) > CONV() silently overflows returning wrong results

[jira] [Commented] (SPARK-42399) CONV() silently overflows returning wrong results

2024-02-02 Thread Nicholas Chammas (Jira)
[ https://issues.apache.org/jira/browse/SPARK-42399?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17813733#comment-17813733 ] Nicholas Chammas commented on SPARK-42399: -- This issue does indeed appear to be resolved on

[jira] [Updated] (SPARK-42399) CONV() silently overflows returning wrong results

2024-02-02 Thread Nicholas Chammas (Jira)
[ https://issues.apache.org/jira/browse/SPARK-42399?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Nicholas Chammas updated SPARK-42399: - Affects Version/s: 3.5.0 > CONV() silently overflows returning wrong results >

[jira] [Updated] (SPARK-42399) CONV() silently overflows returning wrong results

2024-02-02 Thread Nicholas Chammas (Jira)
[ https://issues.apache.org/jira/browse/SPARK-42399?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Nicholas Chammas updated SPARK-42399: - Labels: correctness pull-request-available (was: pull-request-available) > CONV()

[jira] [Updated] (SPARK-46810) Clarify error class terminology

2024-02-01 Thread Nicholas Chammas (Jira)
[ https://issues.apache.org/jira/browse/SPARK-46810?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Nicholas Chammas updated SPARK-46810: - Description: We use inconsistent terminology when talking about error classes. I'd like

[jira] [Created] (SPARK-46935) Consolidate error documentation

2024-01-31 Thread Nicholas Chammas (Jira)
Nicholas Chammas created SPARK-46935: Summary: Consolidate error documentation Key: SPARK-46935 URL: https://issues.apache.org/jira/browse/SPARK-46935 Project: Spark Issue Type:

[jira] [Updated] (SPARK-46810) Clarify error class terminology

2024-01-31 Thread Nicholas Chammas (Jira)
[ https://issues.apache.org/jira/browse/SPARK-46810?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Nicholas Chammas updated SPARK-46810: - Description: We use inconsistent terminology when talking about error classes. I'd like

[jira] [Updated] (SPARK-46923) Limit width of config tables in documentation and style them consistently

2024-01-30 Thread Nicholas Chammas (Jira)
[ https://issues.apache.org/jira/browse/SPARK-46923?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Nicholas Chammas updated SPARK-46923: - Summary: Limit width of config tables in documentation and style them consistently

[jira] [Created] (SPARK-46923) Style config tables in documentation consistently

2024-01-30 Thread Nicholas Chammas (Jira)
Nicholas Chammas created SPARK-46923: Summary: Style config tables in documentation consistently Key: SPARK-46923 URL: https://issues.apache.org/jira/browse/SPARK-46923 Project: Spark

[jira] [Commented] (SPARK-46810) Clarify error class terminology

2024-01-29 Thread Nicholas Chammas (Jira)
[ https://issues.apache.org/jira/browse/SPARK-46810?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17811923#comment-17811923 ] Nicholas Chammas commented on SPARK-46810: -- I think Option 3 is a good compromise that lets us

[jira] [Created] (SPARK-46894) Move PySpark error conditions into standalone JSON file

2024-01-28 Thread Nicholas Chammas (Jira)
Nicholas Chammas created SPARK-46894: Summary: Move PySpark error conditions into standalone JSON file Key: SPARK-46894 URL: https://issues.apache.org/jira/browse/SPARK-46894 Project: Spark

[jira] [Commented] (SPARK-46810) Clarify error class terminology

2024-01-27 Thread Nicholas Chammas (Jira)
[ https://issues.apache.org/jira/browse/SPARK-46810?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17811627#comment-17811627 ] Nicholas Chammas commented on SPARK-46810: -- Thanks for sharing the relevant quote, [~srielau].

[jira] [Comment Edited] (SPARK-46810) Clarify error class terminology

2024-01-26 Thread Nicholas Chammas (Jira)
[ https://issues.apache.org/jira/browse/SPARK-46810?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17811470#comment-17811470 ] Nicholas Chammas edited comment on SPARK-46810 at 1/27/24 5:00 AM: ---

[jira] [Updated] (SPARK-46810) Clarify error class terminology

2024-01-26 Thread Nicholas Chammas (Jira)
[ https://issues.apache.org/jira/browse/SPARK-46810?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Nicholas Chammas updated SPARK-46810: - Description: We use inconsistent terminology when talking about error classes. I'd like

[jira] [Commented] (SPARK-46810) Clarify error class terminology

2024-01-26 Thread Nicholas Chammas (Jira)
[ https://issues.apache.org/jira/browse/SPARK-46810?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17811470#comment-17811470 ] Nicholas Chammas commented on SPARK-46810: -- [~srielau] - What do you think of the problem and

[jira] [Updated] (SPARK-46810) Clarify error class terminology

2024-01-26 Thread Nicholas Chammas (Jira)
[ https://issues.apache.org/jira/browse/SPARK-46810?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Nicholas Chammas updated SPARK-46810: - Description: We use inconsistent terminology when talking about error classes. I'd like

[jira] [Updated] (SPARK-46810) Clarify error class terminology

2024-01-26 Thread Nicholas Chammas (Jira)
[ https://issues.apache.org/jira/browse/SPARK-46810?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Nicholas Chammas updated SPARK-46810: - Description: We use inconsistent terminology when talking about error classes. I'd like

[jira] [Created] (SPARK-46863) Clean up custom.css

2024-01-25 Thread Nicholas Chammas (Jira)
Nicholas Chammas created SPARK-46863: Summary: Clean up custom.css Key: SPARK-46863 URL: https://issues.apache.org/jira/browse/SPARK-46863 Project: Spark Issue Type: Improvement

[jira] [Created] (SPARK-46825) Build Spark only once when building docs

2024-01-23 Thread Nicholas Chammas (Jira)
Nicholas Chammas created SPARK-46825: Summary: Build Spark only once when building docs Key: SPARK-46825 URL: https://issues.apache.org/jira/browse/SPARK-46825 Project: Spark Issue Type:

[jira] [Created] (SPARK-46819) Port error class data to automation-friendly format

2024-01-23 Thread Nicholas Chammas (Jira)
Nicholas Chammas created SPARK-46819: Summary: Port error class data to automation-friendly format Key: SPARK-46819 URL: https://issues.apache.org/jira/browse/SPARK-46819 Project: Spark

[jira] [Updated] (SPARK-46810) Clarify error class terminology

2024-01-23 Thread Nicholas Chammas (Jira)
[ https://issues.apache.org/jira/browse/SPARK-46810?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Nicholas Chammas updated SPARK-46810: - Description: We use inconsistent terminology when talking about error classes. I'd like

[jira] [Updated] (SPARK-46810) Clarify error class terminology

2024-01-23 Thread Nicholas Chammas (Jira)
[ https://issues.apache.org/jira/browse/SPARK-46810?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Nicholas Chammas updated SPARK-46810: - Description: We use inconsistent terminology when talking about error classes. I'd like

[jira] [Commented] (SPARK-46810) Clarify error class terminology

2024-01-23 Thread Nicholas Chammas (Jira)
[ https://issues.apache.org/jira/browse/SPARK-46810?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17809804#comment-17809804 ] Nicholas Chammas commented on SPARK-46810: -- [~itholic] [~gurwls223] - What do you think? cc

[jira] [Created] (SPARK-46810) Clarify error class terminology

2024-01-23 Thread Nicholas Chammas (Jira)
Nicholas Chammas created SPARK-46810: Summary: Clarify error class terminology Key: SPARK-46810 URL: https://issues.apache.org/jira/browse/SPARK-46810 Project: Spark Issue Type:

[jira] [Created] (SPARK-46807) Include automation notice in SQL error class documents

2024-01-22 Thread Nicholas Chammas (Jira)
Nicholas Chammas created SPARK-46807: Summary: Include automation notice in SQL error class documents Key: SPARK-46807 URL: https://issues.apache.org/jira/browse/SPARK-46807 Project: Spark

[jira] [Created] (SPARK-46775) Fix formatting of Kinesis docs

2024-01-19 Thread Nicholas Chammas (Jira)
Nicholas Chammas created SPARK-46775: Summary: Fix formatting of Kinesis docs Key: SPARK-46775 URL: https://issues.apache.org/jira/browse/SPARK-46775 Project: Spark Issue Type:

[jira] [Created] (SPARK-46764) Reorganize Ruby script to build API docs

2024-01-18 Thread Nicholas Chammas (Jira)
Nicholas Chammas created SPARK-46764: Summary: Reorganize Ruby script to build API docs Key: SPARK-46764 URL: https://issues.apache.org/jira/browse/SPARK-46764 Project: Spark Issue Type:

[jira] [Commented] (SPARK-45599) Percentile can produce a wrong answer if -0.0 and 0.0 are mixed in the dataset

2024-01-15 Thread Nicholas Chammas (Jira)
[ https://issues.apache.org/jira/browse/SPARK-45599?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17806954#comment-17806954 ] Nicholas Chammas commented on SPARK-45599: -- Using

[jira] [Commented] (SPARK-45599) Percentile can produce a wrong answer if -0.0 and 0.0 are mixed in the dataset

2024-01-12 Thread Nicholas Chammas (Jira)
[ https://issues.apache.org/jira/browse/SPARK-45599?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17806150#comment-17806150 ] Nicholas Chammas commented on SPARK-45599: -- cc [~dongjoon] - This is an old correctness bug

[jira] [Updated] (SPARK-45599) Percentile can produce a wrong answer if -0.0 and 0.0 are mixed in the dataset

2024-01-12 Thread Nicholas Chammas (Jira)
[ https://issues.apache.org/jira/browse/SPARK-45599?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Nicholas Chammas updated SPARK-45599: - Labels: correctness (was: data-corruption) > Percentile can produce a wrong answer if

[jira] [Commented] (SPARK-45599) Percentile can produce a wrong answer if -0.0 and 0.0 are mixed in the dataset

2024-01-12 Thread Nicholas Chammas (Jira)
[ https://issues.apache.org/jira/browse/SPARK-45599?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17806148#comment-17806148 ] Nicholas Chammas commented on SPARK-45599: -- I can confirm that this bug is still present on

[jira] [Updated] (SPARK-46395) Assign Spark configs to groups for use in documentation

2024-01-12 Thread Nicholas Chammas (Jira)
[ https://issues.apache.org/jira/browse/SPARK-46395?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Nicholas Chammas updated SPARK-46395: - Summary: Assign Spark configs to groups for use in documentation (was: Automatically

[jira] [Created] (SPARK-46668) Parallelize Sphinx build of Python API docs

2024-01-10 Thread Nicholas Chammas (Jira)
Nicholas Chammas created SPARK-46668: Summary: Parallelize Sphinx build of Python API docs Key: SPARK-46668 URL: https://issues.apache.org/jira/browse/SPARK-46668 Project: Spark Issue

[jira] [Created] (SPARK-46658) Loosen Ruby dependency specs for doc build

2024-01-10 Thread Nicholas Chammas (Jira)
Nicholas Chammas created SPARK-46658: Summary: Loosen Ruby dependency specs for doc build Key: SPARK-46658 URL: https://issues.apache.org/jira/browse/SPARK-46658 Project: Spark Issue

[jira] [Updated] (SPARK-46437) Enable conditional includes in Jekyll documentation

2024-01-08 Thread Nicholas Chammas (Jira)
[ https://issues.apache.org/jira/browse/SPARK-46437?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Nicholas Chammas updated SPARK-46437: - Component/s: (was: SQL) > Enable conditional includes in Jekyll documentation >

[jira] [Updated] (SPARK-46437) Enable conditional includes in Jekyll documentation

2024-01-08 Thread Nicholas Chammas (Jira)
[ https://issues.apache.org/jira/browse/SPARK-46437?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Nicholas Chammas updated SPARK-46437: - Summary: Enable conditional includes in Jekyll documentation (was: Remove unnecessary

[jira] [Created] (SPARK-46626) Bump jekyll version to support Ruby 3.3

2024-01-08 Thread Nicholas Chammas (Jira)
Nicholas Chammas created SPARK-46626: Summary: Bump jekyll version to support Ruby 3.3 Key: SPARK-46626 URL: https://issues.apache.org/jira/browse/SPARK-46626 Project: Spark Issue Type:

[jira] [Updated] (SPARK-46449) Add ability to create databases/schemas via Catalog API

2023-12-30 Thread Nicholas Chammas (Jira)
[ https://issues.apache.org/jira/browse/SPARK-46449?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Nicholas Chammas updated SPARK-46449: - Summary: Add ability to create databases/schemas via Catalog API (was: Add ability to

[jira] [Updated] (SPARK-46449) Add ability to create databases via Catalog API

2023-12-28 Thread Nicholas Chammas (Jira)
[ https://issues.apache.org/jira/browse/SPARK-46449?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Nicholas Chammas updated SPARK-46449: - Description: As of Spark 3.5, the only way to create a database is via SQL. The Catalog

[jira] [Created] (SPARK-46449) Add ability to create databases via Catalog API

2023-12-18 Thread Nicholas Chammas (Jira)
Nicholas Chammas created SPARK-46449: Summary: Add ability to create databases via Catalog API Key: SPARK-46449 URL: https://issues.apache.org/jira/browse/SPARK-46449 Project: Spark

[jira] [Created] (SPARK-46437) Remove unnecessary cruft from SQL built-in functions docs

2023-12-17 Thread Nicholas Chammas (Jira)
Nicholas Chammas created SPARK-46437: Summary: Remove unnecessary cruft from SQL built-in functions docs Key: SPARK-46437 URL: https://issues.apache.org/jira/browse/SPARK-46437 Project: Spark

[jira] [Created] (SPARK-46395) Automatically generate SQL configuration tables for documentation

2023-12-13 Thread Nicholas Chammas (Jira)
Nicholas Chammas created SPARK-46395: Summary: Automatically generate SQL configuration tables for documentation Key: SPARK-46395 URL: https://issues.apache.org/jira/browse/SPARK-46395 Project:

[jira] [Commented] (SPARK-45599) Percentile can produce a wrong answer if -0.0 and 0.0 are mixed in the dataset

2023-12-10 Thread Nicholas Chammas (Jira)
[ https://issues.apache.org/jira/browse/SPARK-45599?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17795162#comment-17795162 ] Nicholas Chammas commented on SPARK-45599: -- Per the [contributing

[jira] [Created] (SPARK-46357) Replace use of setConf with conf.set in docs

2023-12-10 Thread Nicholas Chammas (Jira)
Nicholas Chammas created SPARK-46357: Summary: Replace use of setConf with conf.set in docs Key: SPARK-46357 URL: https://issues.apache.org/jira/browse/SPARK-46357 Project: Spark Issue

[jira] [Commented] (SPARK-37571) decouple amplab jenkins from spark website, builds and tests

2023-12-05 Thread Nicholas Chammas (Jira)
[ https://issues.apache.org/jira/browse/SPARK-37571?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17793347#comment-17793347 ] Nicholas Chammas commented on SPARK-37571: -- Since we've

[jira] [Resolved] (SPARK-37647) Expose percentile function in Scala/Python APIs

2023-12-05 Thread Nicholas Chammas (Jira)
[ https://issues.apache.org/jira/browse/SPARK-37647?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Nicholas Chammas resolved SPARK-37647. -- Resolution: Fixed It looks like this got added as part of Spark 3.5:

[jira] [Commented] (SPARK-45390) Remove `distutils` usage

2023-11-17 Thread Nicholas Chammas (Jira)
[ https://issues.apache.org/jira/browse/SPARK-45390?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17787268#comment-17787268 ] Nicholas Chammas commented on SPARK-45390: -- Ah, are you referring to [PySpark's Python

[jira] [Commented] (SPARK-45390) Remove `distutils` usage

2023-11-15 Thread Nicholas Chammas (Jira)
[ https://issues.apache.org/jira/browse/SPARK-45390?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17786401#comment-17786401 ] Nicholas Chammas commented on SPARK-45390: -- {quote}We don't promise to support all future

[jira] [Commented] (SPARK-31001) Add ability to create a partitioned table via catalog.createTable()

2022-08-31 Thread Nicholas Chammas (Jira)
[ https://issues.apache.org/jira/browse/SPARK-31001?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17598403#comment-17598403 ] Nicholas Chammas commented on SPARK-31001: -- Thanks for sharing these details. This is very

[jira] [Commented] (SPARK-31001) Add ability to create a partitioned table via catalog.createTable()

2022-08-30 Thread Nicholas Chammas (Jira)
[ https://issues.apache.org/jira/browse/SPARK-31001?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17598115#comment-17598115 ] Nicholas Chammas commented on SPARK-31001: -- What's {{{}__partition_columns{}}}? Is that

[jira] [Created] (SPARK-39630) Allow all Reader or Writer settings to be provided as options

2022-06-28 Thread Nicholas Chammas (Jira)
Title: Message Title Nicholas Chammas

[jira] [Created] (SPARK-39582) "Since " docs on array_agg are incorrect

2022-06-24 Thread Nicholas Chammas (Jira)
Nicholas Chammas created SPARK-39582: Summary: "Since " docs on array_agg are incorrect Key: SPARK-39582 URL: https://issues.apache.org/jira/browse/SPARK-39582 Project: Spark Issue Type:

[jira] [Commented] (SPARK-37219) support AS OF syntax

2022-05-16 Thread Nicholas Chammas (Jira)
[ https://issues.apache.org/jira/browse/SPARK-37219?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17537589#comment-17537589 ] Nicholas Chammas commented on SPARK-37219: -- This change will enable not just Delta, but also

[jira] [Updated] (SPARK-31001) Add ability to create a partitioned table via catalog.createTable()

2022-05-10 Thread Nicholas Chammas (Jira)
[ https://issues.apache.org/jira/browse/SPARK-31001?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Nicholas Chammas updated SPARK-31001: - Description: There doesn't appear to be a way to create a partitioned table using the

[jira] [Comment Edited] (SPARK-37222) Max iterations reached in Operator Optimization w/left_anti or left_semi join and nested structures

2022-04-26 Thread Nicholas Chammas (Jira)
[ https://issues.apache.org/jira/browse/SPARK-37222?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17528233#comment-17528233 ] Nicholas Chammas edited comment on SPARK-37222 at 4/26/22 3:44 PM: ---

[jira] [Commented] (SPARK-37222) Max iterations reached in Operator Optimization w/left_anti or left_semi join and nested structures

2022-04-26 Thread Nicholas Chammas (Jira)
[ https://issues.apache.org/jira/browse/SPARK-37222?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17528233#comment-17528233 ] Nicholas Chammas commented on SPARK-37222: -- I've found a helpful log setting that causes Spark

[jira] [Updated] (SPARK-37222) Max iterations reached in Operator Optimization w/left_anti or left_semi join and nested structures

2022-04-26 Thread Nicholas Chammas (Jira)
[ https://issues.apache.org/jira/browse/SPARK-37222?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Nicholas Chammas updated SPARK-37222: - Attachment: plan-log.log > Max iterations reached in Operator Optimization w/left_anti

[jira] [Updated] (SPARK-37696) Optimizer exceeds max iterations

2022-04-25 Thread Nicholas Chammas (Jira)
[ https://issues.apache.org/jira/browse/SPARK-37696?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Nicholas Chammas updated SPARK-37696: - Affects Version/s: 3.2.1 > Optimizer exceeds max iterations >

[jira] [Commented] (SPARK-37222) Max iterations reached in Operator Optimization w/left_anti or left_semi join and nested structures

2022-04-25 Thread Nicholas Chammas (Jira)
[ https://issues.apache.org/jira/browse/SPARK-37222?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17527527#comment-17527527 ] Nicholas Chammas commented on SPARK-37222: -- Thanks for the detailed report, [~ssmith]. I am

[jira] [Updated] (SPARK-37222) Max iterations reached in Operator Optimization w/left_anti or left_semi join and nested structures

2022-04-25 Thread Nicholas Chammas (Jira)
[ https://issues.apache.org/jira/browse/SPARK-37222?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Nicholas Chammas updated SPARK-37222: - Affects Version/s: 3.2.1 > Max iterations reached in Operator Optimization w/left_anti

[jira] [Commented] (SPARK-5997) Increase partition count without performing a shuffle

2021-12-20 Thread Nicholas Chammas (Jira)
[ https://issues.apache.org/jira/browse/SPARK-5997?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17462805#comment-17462805 ] Nicholas Chammas commented on SPARK-5997: - [~tenstriker] - I believe in your case you should be

[jira] (SPARK-5997) Increase partition count without performing a shuffle

2021-12-20 Thread Nicholas Chammas (Jira)
[ https://issues.apache.org/jira/browse/SPARK-5997 ] Nicholas Chammas deleted comment on SPARK-5997: - was (Author: nchammas): [~tenstriker] - I believe in your case you should be able to set {{spark.sql.files.maxRecordsPerFile}} to some

[jira] [Commented] (SPARK-24853) Support Column type for withColumn and withColumnRenamed apis

2021-12-20 Thread Nicholas Chammas (Jira)
[ https://issues.apache.org/jira/browse/SPARK-24853?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17462718#comment-17462718 ] Nicholas Chammas commented on SPARK-24853: -- I would expect something like that to yield an

[jira] [Commented] (SPARK-24853) Support Column type for withColumn and withColumnRenamed apis

2021-12-14 Thread Nicholas Chammas (Jira)
[ https://issues.apache.org/jira/browse/SPARK-24853?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17459601#comment-17459601 ] Nicholas Chammas commented on SPARK-24853: -- Assuming we are talking about the example I

[jira] [Resolved] (SPARK-25150) Joining DataFrames derived from the same source yields confusing/incorrect results

2021-12-14 Thread Nicholas Chammas (Jira)
[ https://issues.apache.org/jira/browse/SPARK-25150?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Nicholas Chammas resolved SPARK-25150. -- Fix Version/s: 3.2.0 Resolution: Fixed It looks like Spark 3.1.2 exhibits a

[jira] [Commented] (SPARK-25150) Joining DataFrames derived from the same source yields confusing/incorrect results

2021-12-14 Thread Nicholas Chammas (Jira)
[ https://issues.apache.org/jira/browse/SPARK-25150?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17459494#comment-17459494 ] Nicholas Chammas commented on SPARK-25150: -- I re-ran my test (described in the issue

[jira] [Commented] (SPARK-24853) Support Column type for withColumn and withColumnRenamed apis

2021-12-14 Thread Nicholas Chammas (Jira)
[ https://issues.apache.org/jira/browse/SPARK-24853?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17459467#comment-17459467 ] Nicholas Chammas commented on SPARK-24853: -- [~hyukjin.kwon] - Are you still opposed to this

[jira] [Resolved] (SPARK-26589) proper `median` method for spark dataframe

2021-12-14 Thread Nicholas Chammas (Jira)
[ https://issues.apache.org/jira/browse/SPARK-26589?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Nicholas Chammas resolved SPARK-26589. -- Resolution: Won't Fix Marking this as "Won't Fix", but I suppose if someone really

[jira] [Commented] (SPARK-26589) proper `median` method for spark dataframe

2021-12-14 Thread Nicholas Chammas (Jira)
[ https://issues.apache.org/jira/browse/SPARK-26589?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17459455#comment-17459455 ] Nicholas Chammas commented on SPARK-26589: -- It looks like making a distributed,

[jira] [Created] (SPARK-37647) Expose percentile function in Scala/Python APIs

2021-12-14 Thread Nicholas Chammas (Jira)
Nicholas Chammas created SPARK-37647: Summary: Expose percentile function in Scala/Python APIs Key: SPARK-37647 URL: https://issues.apache.org/jira/browse/SPARK-37647 Project: Spark

[jira] [Commented] (SPARK-26589) proper `median` method for spark dataframe

2021-12-09 Thread Nicholas Chammas (Jira)
[ https://issues.apache.org/jira/browse/SPARK-26589?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17456860#comment-17456860 ] Nicholas Chammas commented on SPARK-26589: -- That makes sense to me. I've been struggling with

  1   2   3   4   5   6   7   8   9   10   >