[jira] [Commented] (SPARK-41804) InterpretedUnsafeProjection doesn't properly handle an array of UDTs

2022-12-31 Thread Bruce Robbins (Jira)
[ https://issues.apache.org/jira/browse/SPARK-41804?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17653367#comment-17653367 ] Bruce Robbins commented on SPARK-41804: --- I think I have a handle on what's going on here >

[jira] [Updated] (SPARK-41804) InterpretedUnsafeProjection doesn't properly handle an array of UDTs

2022-12-31 Thread Bruce Robbins (Jira)
[ https://issues.apache.org/jira/browse/SPARK-41804?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Bruce Robbins updated SPARK-41804: -- Environment: (was: Reproduction steps: {noformat} // create a file of vector data import

[jira] [Updated] (SPARK-41804) InterpretedUnsafeProjection doesn't properly handle an array of UDTs

2022-12-31 Thread Bruce Robbins (Jira)
[ https://issues.apache.org/jira/browse/SPARK-41804?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Bruce Robbins updated SPARK-41804: -- Description: Reproduction steps: {noformat} // create a file of vector data import

[jira] [Created] (SPARK-41804) InterpretedUnsafeProjection doesn't properly handle an array of UDTs

2022-12-31 Thread Bruce Robbins (Jira)
Bruce Robbins created SPARK-41804: - Summary: InterpretedUnsafeProjection doesn't properly handle an array of UDTs Key: SPARK-41804 URL: https://issues.apache.org/jira/browse/SPARK-41804 Project:

[jira] [Commented] (SPARK-41793) Incorrect result for window frames defined by a range clause on large decimals

2022-12-31 Thread Bruce Robbins (Jira)
[ https://issues.apache.org/jira/browse/SPARK-41793?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17653348#comment-17653348 ] Bruce Robbins commented on SPARK-41793: --- [~cloud_fan] [~ulysses] The change in behavior appears

[jira] [Updated] (SPARK-41535) InterpretedUnsafeProjection and InterpretedMutableProjection can corrupt unsafe buffer when used with calendar interval data

2022-12-17 Thread Bruce Robbins (Jira)
[ https://issues.apache.org/jira/browse/SPARK-41535?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Bruce Robbins updated SPARK-41535: -- Affects Version/s: 3.3.1 > InterpretedUnsafeProjection and InterpretedMutableProjection can

[jira] [Updated] (SPARK-41535) InterpretedUnsafeProjection and InterpretedMutableProjection can corrupt unsafe buffer when used with calendar interval data

2022-12-17 Thread Bruce Robbins (Jira)
[ https://issues.apache.org/jira/browse/SPARK-41535?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Bruce Robbins updated SPARK-41535: -- Affects Version/s: 3.2.3 > InterpretedUnsafeProjection and InterpretedMutableProjection can

[jira] [Commented] (SPARK-41535) InterpretedUnsafeProjection and InterpretedMutableProjection can corrupt unsafe buffer when used with calendar interval data

2022-12-15 Thread Bruce Robbins (Jira)
[ https://issues.apache.org/jira/browse/SPARK-41535?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17648251#comment-17648251 ] Bruce Robbins commented on SPARK-41535: --- I will take a stab at fixing this shortly. >

[jira] [Created] (SPARK-41535) InterpretedUnsafeProjection and InterpretedMutableProjection can corrupt unsafe buffer when used with calendar interval data

2022-12-15 Thread Bruce Robbins (Jira)
Bruce Robbins created SPARK-41535: - Summary: InterpretedUnsafeProjection and InterpretedMutableProjection can corrupt unsafe buffer when used with calendar interval data Key: SPARK-41535 URL:

[jira] [Updated] (SPARK-41452) to_char throws NullPointerException when format is null

2022-12-08 Thread Bruce Robbins (Jira)
[ https://issues.apache.org/jira/browse/SPARK-41452?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Bruce Robbins updated SPARK-41452: -- Description: Example: {noformat} spark-sql> select to_char(454, null); [INTERNAL_ERROR] The

[jira] [Created] (SPARK-41452) to_char throws NullPointerException when format is null

2022-12-08 Thread Bruce Robbins (Jira)
Bruce Robbins created SPARK-41452: - Summary: to_char throws NullPointerException when format is null Key: SPARK-41452 URL: https://issues.apache.org/jira/browse/SPARK-41452 Project: Spark

[jira] [Updated] (SPARK-41395) InterpretedMutableProjection can corrupt unsafe buffer when used with decimal data

2022-12-05 Thread Bruce Robbins (Jira)
[ https://issues.apache.org/jira/browse/SPARK-41395?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Bruce Robbins updated SPARK-41395: -- Description: The following returns the wrong answer: {noformat} set

[jira] [Updated] (SPARK-41395) InterpretedMutableProjection can corrupt unsafe buffer when used with decimal data

2022-12-05 Thread Bruce Robbins (Jira)
[ https://issues.apache.org/jira/browse/SPARK-41395?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Bruce Robbins updated SPARK-41395: -- Affects Version/s: 3.3.1 > InterpretedMutableProjection can corrupt unsafe buffer when used

[jira] [Updated] (SPARK-41395) InterpretedMutableProjection can corrupt unsafe buffer when used with decimal data

2022-12-05 Thread Bruce Robbins (Jira)
[ https://issues.apache.org/jira/browse/SPARK-41395?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Bruce Robbins updated SPARK-41395: -- Affects Version/s: 3.2.3 > InterpretedMutableProjection can corrupt unsafe buffer when used

[jira] [Updated] (SPARK-41395) InterpretedMutableProjection can corrupt unsafe buffer when used with decimal data

2022-12-05 Thread Bruce Robbins (Jira)
[ https://issues.apache.org/jira/browse/SPARK-41395?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Bruce Robbins updated SPARK-41395: -- Description: The following returns the wrong answer: {noformat} set

[jira] [Created] (SPARK-41395) InterpretedMutableProjection can corrupt unsafe buffer when used with decimal data

2022-12-05 Thread Bruce Robbins (Jira)
Bruce Robbins created SPARK-41395: - Summary: InterpretedMutableProjection can corrupt unsafe buffer when used with decimal data Key: SPARK-41395 URL: https://issues.apache.org/jira/browse/SPARK-41395

[jira] [Resolved] (SPARK-41205) Bad error message when try_to_binary called with non-foldable format

2022-11-23 Thread Bruce Robbins (Jira)
[ https://issues.apache.org/jira/browse/SPARK-41205?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Bruce Robbins resolved SPARK-41205. --- Resolution: Duplicate > Bad error message when try_to_binary called with non-foldable

[jira] [Commented] (SPARK-41205) Bad error message when try_to_binary called with non-foldable format

2022-11-23 Thread Bruce Robbins (Jira)
[ https://issues.apache.org/jira/browse/SPARK-41205?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17637882#comment-17637882 ] Bruce Robbins commented on SPARK-41205: --- Fixed by SPARK-41174. > Bad error message when

[jira] [Updated] (SPARK-41205) Bad error message when try_to_binary called with non-foldable format

2022-11-19 Thread Bruce Robbins (Jira)
[ https://issues.apache.org/jira/browse/SPARK-41205?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Bruce Robbins updated SPARK-41205: -- Priority: Minor (was: Major) > Bad error message when try_to_binary called with non-foldable

[jira] [Created] (SPARK-41205) Bad error message when try_to_binary called with non-foldable format

2022-11-19 Thread Bruce Robbins (Jira)
Bruce Robbins created SPARK-41205: - Summary: Bad error message when try_to_binary called with non-foldable format Key: SPARK-41205 URL: https://issues.apache.org/jira/browse/SPARK-41205 Project:

[jira] [Updated] (SPARK-41118) to_number/try_to_number throws NullPointerException when format is null

2022-11-12 Thread Bruce Robbins (Jira)
[ https://issues.apache.org/jira/browse/SPARK-41118?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Bruce Robbins updated SPARK-41118: -- Priority: Minor (was: Major) > to_number/try_to_number throws NullPointerException when

[jira] [Created] (SPARK-41118) to_number/try_to_number throws NullPointerException when format is null

2022-11-12 Thread Bruce Robbins (Jira)
Bruce Robbins created SPARK-41118: - Summary: to_number/try_to_number throws NullPointerException when format is null Key: SPARK-41118 URL: https://issues.apache.org/jira/browse/SPARK-41118 Project:

[jira] [Updated] (SPARK-41035) Incorrect results or NPE when a literal is reused across distinct aggregations

2022-11-07 Thread Bruce Robbins (Jira)
[ https://issues.apache.org/jira/browse/SPARK-41035?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Bruce Robbins updated SPARK-41035: -- Description: This query produces incorrect results: {noformat} select a, count(distinct 100)

[jira] [Commented] (SPARK-41035) Incorrect results or NPE when a literal is reused across distinct aggregations

2022-11-07 Thread Bruce Robbins (Jira)
[ https://issues.apache.org/jira/browse/SPARK-41035?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17630125#comment-17630125 ] Bruce Robbins commented on SPARK-41035: --- This is a bug in {{RewriteDistinctAggregates}}. I will

[jira] [Created] (SPARK-41035) Incorrect results or NPE when a literal is reused across distinct aggregations

2022-11-07 Thread Bruce Robbins (Jira)
Bruce Robbins created SPARK-41035: - Summary: Incorrect results or NPE when a literal is reused across distinct aggregations Key: SPARK-41035 URL: https://issues.apache.org/jira/browse/SPARK-41035

[jira] [Updated] (SPARK-40963) ExtractGenerator sets incorrect nullability in new Project

2022-10-30 Thread Bruce Robbins (Jira)
[ https://issues.apache.org/jira/browse/SPARK-40963?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Bruce Robbins updated SPARK-40963: -- Description: Example: {noformat} select c1, explode(c4) as c5 from ( select c1, array(c3)

[jira] [Updated] (SPARK-40963) ExtractGenerator sets incorrect nullability in new Project

2022-10-30 Thread Bruce Robbins (Jira)
[ https://issues.apache.org/jira/browse/SPARK-40963?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Bruce Robbins updated SPARK-40963: -- Description: Example: {noformat} select c1, explode(c4) as c5 from ( select c1, array(c3)

[jira] [Updated] (SPARK-40963) ExtractGenerator sets incorrect nullability in new Project

2022-10-30 Thread Bruce Robbins (Jira)
[ https://issues.apache.org/jira/browse/SPARK-40963?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Bruce Robbins updated SPARK-40963: -- Description: Example: {noformat} select c1, explode(c4) as c5 from ( select c1, array(c3)

[jira] [Updated] (SPARK-40963) ExtractGenerator sets incorrect nullability in new Project

2022-10-30 Thread Bruce Robbins (Jira)
[ https://issues.apache.org/jira/browse/SPARK-40963?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Bruce Robbins updated SPARK-40963: -- Description: Example: {noformat} select c1, explode(c4) as c5 from ( select c1, array(c3)

[jira] [Updated] (SPARK-40963) ExtractGenerator sets incorrect nullability in new Project

2022-10-30 Thread Bruce Robbins (Jira)
[ https://issues.apache.org/jira/browse/SPARK-40963?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Bruce Robbins updated SPARK-40963: -- Description: Example: {noformat} select c1, explode(c4) as c5 from ( select c1, array(c3)

[jira] [Updated] (SPARK-40963) ExtractGenerator sets incorrect nullability in new Project

2022-10-30 Thread Bruce Robbins (Jira)
[ https://issues.apache.org/jira/browse/SPARK-40963?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Bruce Robbins updated SPARK-40963: -- Summary: ExtractGenerator sets incorrect nullability in new Project (was: containsNull in

[jira] [Updated] (SPARK-40963) containsNull in array type attributes is not updated from child output

2022-10-29 Thread Bruce Robbins (Jira)
[ https://issues.apache.org/jira/browse/SPARK-40963?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Bruce Robbins updated SPARK-40963: -- Description: Example: {noformat} select c1, explode(c4) as c5 from ( select c1, array(c3)

[jira] [Updated] (SPARK-40963) containsNull in array type attributes is not updated from child output

2022-10-28 Thread Bruce Robbins (Jira)
[ https://issues.apache.org/jira/browse/SPARK-40963?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Bruce Robbins updated SPARK-40963: -- Affects Version/s: 3.1.3 > containsNull in array type attributes is not updated from child

[jira] [Updated] (SPARK-40963) containsNull in array type attributes is not updated from child output

2022-10-28 Thread Bruce Robbins (Jira)
[ https://issues.apache.org/jira/browse/SPARK-40963?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Bruce Robbins updated SPARK-40963: -- Affects Version/s: 3.2.2 > containsNull in array type attributes is not updated from child

[jira] [Updated] (SPARK-40963) containsNull in array type attributes is not updated from child output

2022-10-28 Thread Bruce Robbins (Jira)
[ https://issues.apache.org/jira/browse/SPARK-40963?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Bruce Robbins updated SPARK-40963: -- Affects Version/s: 3.3.1 > containsNull in array type attributes is not updated from child

[jira] [Commented] (SPARK-40963) containsNull in array type attributes is not updated from child output

2022-10-28 Thread Bruce Robbins (Jira)
[ https://issues.apache.org/jira/browse/SPARK-40963?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17625955#comment-17625955 ] Bruce Robbins commented on SPARK-40963: --- I'll take a stab at fixing this in the next few days. >

[jira] [Created] (SPARK-40963) containsNull in array type attributes is not updated from child output

2022-10-28 Thread Bruce Robbins (Jira)
Bruce Robbins created SPARK-40963: - Summary: containsNull in array type attributes is not updated from child output Key: SPARK-40963 URL: https://issues.apache.org/jira/browse/SPARK-40963 Project:

[jira] [Comment Edited] (SPARK-40706) IllegalStateException when querying array values inside a nested struct

2022-10-10 Thread Bruce Robbins (Jira)
[ https://issues.apache.org/jira/browse/SPARK-40706?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17614550#comment-17614550 ] Bruce Robbins edited comment on SPARK-40706 at 10/10/22 5:01 PM: - Same

[jira] [Commented] (SPARK-40706) IllegalStateException when querying array values inside a nested struct

2022-10-08 Thread Bruce Robbins (Jira)
[ https://issues.apache.org/jira/browse/SPARK-40706?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17614550#comment-17614550 ] Bruce Robbins commented on SPARK-40706: --- Same as SPARK-39854? At the very least, the suggest

[jira] [Commented] (SPARK-40624) A DECIMAL value with division by 0 errors in DataFrame but evaluates to NULL in SparkSQL

2022-09-30 Thread Bruce Robbins (Jira)
[ https://issues.apache.org/jira/browse/SPARK-40624?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17611803#comment-17611803 ] Bruce Robbins commented on SPARK-40624: --- That's not a Spark API throwing that exception. Instead,

[jira] [Updated] (SPARK-40403) Negative size in error message when unsafe array is too big

2022-09-11 Thread Bruce Robbins (Jira)
[ https://issues.apache.org/jira/browse/SPARK-40403?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Bruce Robbins updated SPARK-40403: -- Description: When initializing an overly large unsafe array via

[jira] [Updated] (SPARK-40403) Negative size in error message when unsafe array is too big

2022-09-11 Thread Bruce Robbins (Jira)
[ https://issues.apache.org/jira/browse/SPARK-40403?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Bruce Robbins updated SPARK-40403: -- Priority: Minor (was: Major) > Negative size in error message when unsafe array is too big >

[jira] [Created] (SPARK-40403) Negative size in error message when unsafe array is too big

2022-09-11 Thread Bruce Robbins (Jira)
Bruce Robbins created SPARK-40403: - Summary: Negative size in error message when unsafe array is too big Key: SPARK-40403 URL: https://issues.apache.org/jira/browse/SPARK-40403 Project: Spark

[jira] [Created] (SPARK-40382) Reduce projections in Expand when multiple distinct aggregations have semantically equivalent children

2022-09-07 Thread Bruce Robbins (Jira)
Bruce Robbins created SPARK-40382: - Summary: Reduce projections in Expand when multiple distinct aggregations have semantically equivalent children Key: SPARK-40382 URL:

[jira] [Updated] (SPARK-40308) str_to_map should accept non-foldable delimiter arguments

2022-09-01 Thread Bruce Robbins (Jira)
[ https://issues.apache.org/jira/browse/SPARK-40308?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Bruce Robbins updated SPARK-40308: -- Description: Currently, str_to_map requires the delimiter arguments to be foldable

[jira] [Updated] (SPARK-40308) str_to_map should accept non-foldable delimiter arguments

2022-09-01 Thread Bruce Robbins (Jira)
[ https://issues.apache.org/jira/browse/SPARK-40308?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Bruce Robbins updated SPARK-40308: -- Summary: str_to_map should accept non-foldable delimiter arguments (was: str_to_map should

[jira] [Created] (SPARK-40308) str_to_map should accept non-foldable delimiter parameters

2022-09-01 Thread Bruce Robbins (Jira)
Bruce Robbins created SPARK-40308: - Summary: str_to_map should accept non-foldable delimiter parameters Key: SPARK-40308 URL: https://issues.apache.org/jira/browse/SPARK-40308 Project: Spark

[jira] [Commented] (SPARK-40152) Codegen compilation error when using split_part

2022-08-19 Thread Bruce Robbins (Jira)
[ https://issues.apache.org/jira/browse/SPARK-40152?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17582045#comment-17582045 ] Bruce Robbins commented on SPARK-40152: --- Seems to be a simple case of missing semicolons. I think

[jira] [Created] (SPARK-40152) Codegen compilation error when using split_part

2022-08-19 Thread Bruce Robbins (Jira)
Bruce Robbins created SPARK-40152: - Summary: Codegen compilation error when using split_part Key: SPARK-40152 URL: https://issues.apache.org/jira/browse/SPARK-40152 Project: Spark Issue

[jira] [Updated] (SPARK-40002) Limit improperly pushed down through window using ntile function

2022-08-08 Thread Bruce Robbins (Jira)
[ https://issues.apache.org/jira/browse/SPARK-40002?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Bruce Robbins updated SPARK-40002: -- Labels: correctness (was: ) > Limit improperly pushed down through window using ntile

[jira] [Updated] (SPARK-40002) Limit improperly pushed down through window using ntile function

2022-08-08 Thread Bruce Robbins (Jira)
[ https://issues.apache.org/jira/browse/SPARK-40002?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Bruce Robbins updated SPARK-40002: -- Summary: Limit improperly pushed down through window using ntile function (was: Limit pushed

[jira] [Created] (SPARK-40002) Limit pushed down through window using ntile function

2022-08-07 Thread Bruce Robbins (Jira)
Bruce Robbins created SPARK-40002: - Summary: Limit pushed down through window using ntile function Key: SPARK-40002 URL: https://issues.apache.org/jira/browse/SPARK-40002 Project: Spark

[jira] [Commented] (SPARK-24914) totalSize is not a good estimate for broadcast joins

2022-08-02 Thread Bruce Robbins (Jira)
[ https://issues.apache.org/jira/browse/SPARK-24914?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17574429#comment-17574429 ] Bruce Robbins commented on SPARK-24914: --- I think it's "in progress" only because there are

[jira] [Comment Edited] (SPARK-24914) totalSize is not a good estimate for broadcast joins

2022-08-02 Thread Bruce Robbins (Jira)
[ https://issues.apache.org/jira/browse/SPARK-24914?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17574412#comment-17574412 ] Bruce Robbins edited comment on SPARK-24914 at 8/2/22 10:02 PM:

[jira] [Commented] (SPARK-24914) totalSize is not a good estimate for broadcast joins

2022-08-02 Thread Bruce Robbins (Jira)
[ https://issues.apache.org/jira/browse/SPARK-24914?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17574412#comment-17574412 ] Bruce Robbins commented on SPARK-24914: --- [~cabral1888] I think there already is a global factor

[jira] [Updated] (SPARK-39184) ArrayIndexOutOfBoundsException for some date/time sequences in some time-zones

2022-07-15 Thread Bruce Robbins (Jira)
[ https://issues.apache.org/jira/browse/SPARK-39184?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Bruce Robbins updated SPARK-39184: -- Affects Version/s: 3.1.3 > ArrayIndexOutOfBoundsException for some date/time sequences in

[jira] [Updated] (SPARK-39782) 3.2.2 Window function doc references TIMESTAMPNTZ

2022-07-14 Thread Bruce Robbins (Jira)
[ https://issues.apache.org/jira/browse/SPARK-39782?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Bruce Robbins updated SPARK-39782: -- Priority: Minor (was: Major) > 3.2.2 Window function doc references TIMESTAMPNTZ >

[jira] [Created] (SPARK-39782) 3.2.2 Window function doc references TIMESTAMPNTZ

2022-07-14 Thread Bruce Robbins (Jira)
Bruce Robbins created SPARK-39782: - Summary: 3.2.2 Window function doc references TIMESTAMPNTZ Key: SPARK-39782 URL: https://issues.apache.org/jira/browse/SPARK-39782 Project: Spark Issue

[jira] [Commented] (SPARK-39536) to_date function is returning incorrect value

2022-06-20 Thread Bruce Robbins (Jira)
[ https://issues.apache.org/jira/browse/SPARK-39536?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17556519#comment-17556519 ] Bruce Robbins commented on SPARK-39536: --- Seems like your date format string ('mm/dd/') is not

[jira] [Resolved] (SPARK-39523) JDBCV2Suite fails with Scala 2.13

2022-06-20 Thread Bruce Robbins (Jira)
[ https://issues.apache.org/jira/browse/SPARK-39523?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Bruce Robbins resolved SPARK-39523. --- Resolution: Fixed > JDBCV2Suite fails with Scala 2.13 > - >

[jira] [Comment Edited] (SPARK-39523) JDBCV2Suite fails with Scala 2.13

2022-06-20 Thread Bruce Robbins (Jira)
[ https://issues.apache.org/jira/browse/SPARK-39523?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17556468#comment-17556468 ] Bruce Robbins edited comment on SPARK-39523 at 6/20/22 5:03 PM: As with

[jira] [Comment Edited] (SPARK-39518) Plan stability test is broken with Scala 2.13

2022-06-20 Thread Bruce Robbins (Jira)
[ https://issues.apache.org/jira/browse/SPARK-39518?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17556433#comment-17556433 ] Bruce Robbins edited comment on SPARK-39518 at 6/20/22 5:02 PM: As with

[jira] [Commented] (SPARK-39523) JDBCV2Suite fails with Scala 2.13

2022-06-20 Thread Bruce Robbins (Jira)
[ https://issues.apache.org/jira/browse/SPARK-39523?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17556468#comment-17556468 ] Bruce Robbins commented on SPARK-39523: --- As with the GeneratorFunctionsSuite and

[jira] [Commented] (SPARK-39518) Plan stability test is broken with Scala 2.13

2022-06-20 Thread Bruce Robbins (Jira)
[ https://issues.apache.org/jira/browse/SPARK-39518?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17556433#comment-17556433 ] Bruce Robbins commented on SPARK-39518: --- As with the GeneratorFunctionsSuite and

[jira] [Comment Edited] (SPARK-39525) AdaptiveQueryExecSuite fails with Scala 2.13

2022-06-20 Thread Bruce Robbins (Jira)
[ https://issues.apache.org/jira/browse/SPARK-39525?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17556429#comment-17556429 ] Bruce Robbins edited comment on SPARK-39525 at 6/20/22 3:36 PM: Just

[jira] [Resolved] (SPARK-39525) AdaptiveQueryExecSuite fails with Scala 2.13

2022-06-20 Thread Bruce Robbins (Jira)
[ https://issues.apache.org/jira/browse/SPARK-39525?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Bruce Robbins resolved SPARK-39525. --- Resolution: Fixed > AdaptiveQueryExecSuite fails with Scala 2.13 >

[jira] [Commented] (SPARK-39525) AdaptiveQueryExecSuite fails with Scala 2.13

2022-06-20 Thread Bruce Robbins (Jira)
[ https://issues.apache.org/jira/browse/SPARK-39525?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17556429#comment-17556429 ] Bruce Robbins commented on SPARK-39525: --- Just like the GeneratorFunctionSuites issue, when I apply

[jira] [Resolved] (SPARK-39524) GeneratorFunctionSuite fails with Scala 2.13

2022-06-20 Thread Bruce Robbins (Jira)
[ https://issues.apache.org/jira/browse/SPARK-39524?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Bruce Robbins resolved SPARK-39524. --- Resolution: Fixed > GeneratorFunctionSuite fails with Scala 2.13 >

[jira] [Comment Edited] (SPARK-39524) GeneratorFunctionSuite fails with Scala 2.13

2022-06-20 Thread Bruce Robbins (Jira)
[ https://issues.apache.org/jira/browse/SPARK-39524?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17556427#comment-17556427 ] Bruce Robbins edited comment on SPARK-39524 at 6/20/22 3:29 PM: When I

[jira] [Commented] (SPARK-39524) GeneratorFunctionSuite fails with Scala 2.13

2022-06-20 Thread Bruce Robbins (Jira)
[ https://issues.apache.org/jira/browse/SPARK-39524?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17556427#comment-17556427 ] Bruce Robbins commented on SPARK-39524: --- When I apply the propose fix for SPARK-39520 ([this

[jira] [Commented] (SPARK-38614) After Spark update, df.show() shows incorrect F.percent_rank results

2022-06-19 Thread Bruce Robbins (Jira)
[ https://issues.apache.org/jira/browse/SPARK-38614?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17556126#comment-17556126 ] Bruce Robbins commented on SPARK-38614: --- Likely caused by

[jira] [Updated] (SPARK-39496) Inline eval path cannot handle null structs

2022-06-18 Thread Bruce Robbins (Jira)
[ https://issues.apache.org/jira/browse/SPARK-39496?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Bruce Robbins updated SPARK-39496: -- Fix Version/s: 3.3.1 (was: 3.3.0) > Inline eval path cannot handle

[jira] [Created] (SPARK-39496) Inline eval path cannot handle null structs

2022-06-16 Thread Bruce Robbins (Jira)
Bruce Robbins created SPARK-39496: - Summary: Inline eval path cannot handle null structs Key: SPARK-39496 URL: https://issues.apache.org/jira/browse/SPARK-39496 Project: Spark Issue Type:

[jira] [Commented] (SPARK-39418) DECODE docs refer to Oracle instead of Spark

2022-06-08 Thread Bruce Robbins (Jira)
[ https://issues.apache.org/jira/browse/SPARK-39418?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17551801#comment-17551801 ] Bruce Robbins commented on SPARK-39418: --- Possibly a dup of SPARK-39286? > DECODE docs refer to

[jira] [Commented] (SPARK-39184) ArrayIndexOutOfBoundsException for some date/time sequences in some time-zones

2022-05-15 Thread Bruce Robbins (Jira)
[ https://issues.apache.org/jira/browse/SPARK-39184?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17537252#comment-17537252 ] Bruce Robbins commented on SPARK-39184: --- Some notes on what is happening. Let's take this small

[jira] [Commented] (SPARK-39184) ArrayIndexOutOfBoundsException for some date/time sequences in some time-zones

2022-05-13 Thread Bruce Robbins (Jira)
[ https://issues.apache.org/jira/browse/SPARK-39184?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17536913#comment-17536913 ] Bruce Robbins commented on SPARK-39184: --- I will take a stab at fixing this when the fix for

[jira] [Created] (SPARK-39184) ArrayIndexOutOfBoundsException for some date/time sequences in some time-zones

2022-05-13 Thread Bruce Robbins (Jira)
Bruce Robbins created SPARK-39184: - Summary: ArrayIndexOutOfBoundsException for some date/time sequences in some time-zones Key: SPARK-39184 URL: https://issues.apache.org/jira/browse/SPARK-39184

[jira] [Commented] (SPARK-37544) sequence over dates with month interval is producing incorrect results

2022-05-13 Thread Bruce Robbins (Jira)
[ https://issues.apache.org/jira/browse/SPARK-37544?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17536865#comment-17536865 ] Bruce Robbins commented on SPARK-37544: --- Reproduction of the bug depends on your time zone. It all

[jira] [Updated] (SPARK-39093) Dividing interval by integral can result in codegen compilation error

2022-05-03 Thread Bruce Robbins (Jira)
[ https://issues.apache.org/jira/browse/SPARK-39093?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Bruce Robbins updated SPARK-39093: -- Affects Version/s: 3.2.1 > Dividing interval by integral can result in codegen compilation

[jira] [Updated] (SPARK-39093) Dividing interval by integral can result in codegen compilation error

2022-05-03 Thread Bruce Robbins (Jira)
[ https://issues.apache.org/jira/browse/SPARK-39093?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Bruce Robbins updated SPARK-39093: -- Affects Version/s: 3.3.0 > Dividing interval by integral can result in codegen compilation

[jira] [Updated] (SPARK-39093) Dividing interval by integral can result in codegen compilation error

2022-05-03 Thread Bruce Robbins (Jira)
[ https://issues.apache.org/jira/browse/SPARK-39093?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Bruce Robbins updated SPARK-39093: -- Description: Assume this data: {noformat} create or replace temp view v1 as select * FROM

[jira] [Created] (SPARK-39093) Dividing interval by integral can result in codegen compilation error

2022-05-03 Thread Bruce Robbins (Jira)
Bruce Robbins created SPARK-39093: - Summary: Dividing interval by integral can result in codegen compilation error Key: SPARK-39093 URL: https://issues.apache.org/jira/browse/SPARK-39093 Project:

[jira] [Updated] (SPARK-39061) Incorrect results or NPE when using Inline function against an array of dynamically created structs

2022-04-28 Thread Bruce Robbins (Jira)
[ https://issues.apache.org/jira/browse/SPARK-39061?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Bruce Robbins updated SPARK-39061: -- Description: The following query returns incorrect results: {noformat} spark-sql> select

[jira] [Updated] (SPARK-39061) Incorrect results or NPE when using Inline function against an array of dynamically created structs

2022-04-28 Thread Bruce Robbins (Jira)
[ https://issues.apache.org/jira/browse/SPARK-39061?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Bruce Robbins updated SPARK-39061: -- Affects Version/s: (was: 3.1.3) > Incorrect results or NPE when using Inline function

[jira] [Comment Edited] (SPARK-39061) Incorrect results or NPE when using Inline function against an array of dynamically created structs

2022-04-28 Thread Bruce Robbins (Jira)
[ https://issues.apache.org/jira/browse/SPARK-39061?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17529702#comment-17529702 ] Bruce Robbins edited comment on SPARK-39061 at 4/29/22 12:33 AM: - Btw,

[jira] [Commented] (SPARK-39061) Incorrect results or NPE when using Inline function against an array of dynamically created structs

2022-04-28 Thread Bruce Robbins (Jira)
[ https://issues.apache.org/jira/browse/SPARK-39061?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17529702#comment-17529702 ] Bruce Robbins commented on SPARK-39061: --- Btw, dataframe example: {noformat} scala> val df =

[jira] [Created] (SPARK-39061) Incorrect results or NPE when using Inline function against an array of dynamically created structs

2022-04-28 Thread Bruce Robbins (Jira)
Bruce Robbins created SPARK-39061: - Summary: Incorrect results or NPE when using Inline function against an array of dynamically created structs Key: SPARK-39061 URL:

[jira] [Created] (SPARK-38990) date_trunc and trunc both fail with format from column in inline table

2022-04-21 Thread Bruce Robbins (Jira)
Bruce Robbins created SPARK-38990: - Summary: date_trunc and trunc both fail with format from column in inline table Key: SPARK-38990 URL: https://issues.apache.org/jira/browse/SPARK-38990 Project:

[jira] [Updated] (SPARK-38868) `assert_true` fails unconditionnaly after `left_outer` joins

2022-04-18 Thread Bruce Robbins (Jira)
[ https://issues.apache.org/jira/browse/SPARK-38868?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Bruce Robbins updated SPARK-38868: -- Component/s: SQL > `assert_true` fails unconditionnaly after `left_outer` joins >

[jira] [Updated] (SPARK-38868) `assert_true` fails unconditionnaly after `left_outer` joins

2022-04-17 Thread Bruce Robbins (Jira)
[ https://issues.apache.org/jira/browse/SPARK-38868?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Bruce Robbins updated SPARK-38868: -- Affects Version/s: 3.3.0 3.4.0 > `assert_true` fails unconditionnaly

[jira] [Commented] (SPARK-38868) `assert_true` fails unconditionnaly after `left_outer` joins

2022-04-16 Thread Bruce Robbins (Jira)
[ https://issues.apache.org/jira/browse/SPARK-38868?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17523197#comment-17523197 ] Bruce Robbins commented on SPARK-38868: --- The issue is in {{EliminateOuterJoin}}. That rule wants

[jira] [Commented] (SPARK-38884) java.util.NoSuchElementException: key not found: numPartitions

2022-04-15 Thread Bruce Robbins (Jira)
[ https://issues.apache.org/jira/browse/SPARK-38884?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17522885#comment-17522885 ] Bruce Robbins commented on SPARK-38884: --- {quote}what`s self-contained reproducer?{quote}

[jira] [Commented] (SPARK-38667) Optimizer generates error when using inner join along with sequence

2022-04-14 Thread Bruce Robbins (Jira)
[ https://issues.apache.org/jira/browse/SPARK-38667?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17522500#comment-17522500 ] Bruce Robbins commented on SPARK-38667: --- Strangely, I cannot reproduce on 3.2.1 (or master). Maybe

[jira] [Commented] (SPARK-38823) Incorrect result of dataset reduceGroups in java

2022-04-13 Thread Bruce Robbins (Jira)
[ https://issues.apache.org/jira/browse/SPARK-38823?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17521894#comment-17521894 ] Bruce Robbins commented on SPARK-38823: --- By the way, here is some code that demos the issue in

[jira] [Updated] (SPARK-38823) Incorrect result of dataset reduceGroups in java

2022-04-12 Thread Bruce Robbins (Jira)
[ https://issues.apache.org/jira/browse/SPARK-38823?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Bruce Robbins updated SPARK-38823: -- Affects Version/s: 3.3.0 > Incorrect result of dataset reduceGroups in java >

[jira] [Updated] (SPARK-38823) Incorrect result of dataset reduceGroups in java

2022-04-12 Thread Bruce Robbins (Jira)
[ https://issues.apache.org/jira/browse/SPARK-38823?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Bruce Robbins updated SPARK-38823: -- Labels: correctness (was: ) > Incorrect result of dataset reduceGroups in java >

[jira] [Commented] (SPARK-38823) Incorrect result of dataset reduceGroups in java

2022-04-12 Thread Bruce Robbins (Jira)
[ https://issues.apache.org/jira/browse/SPARK-38823?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17521414#comment-17521414 ] Bruce Robbins commented on SPARK-38823: --- This appears to be an optimization bug that results in

[jira] [Comment Edited] (SPARK-38790) Unexpected behaviour for "IN" operator in spark when null is involved in array

2022-04-05 Thread Bruce Robbins (Jira)
[ https://issues.apache.org/jira/browse/SPARK-38790?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17517674#comment-17517674 ] Bruce Robbins edited comment on SPARK-38790 at 4/5/22 7:50 PM: --- I think

[jira] [Commented] (SPARK-38790) Unexpected behaviour for "IN" operator in spark when null is involved in array

2022-04-05 Thread Bruce Robbins (Jira)
[ https://issues.apache.org/jira/browse/SPARK-38790?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17517674#comment-17517674 ] Bruce Robbins commented on SPARK-38790: --- I think that might be correct. At least, it matches the

[jira] [Created] (SPARK-38666) Missing aggregate filter checks

2022-03-26 Thread Bruce Robbins (Jira)
Bruce Robbins created SPARK-38666: - Summary: Missing aggregate filter checks Key: SPARK-38666 URL: https://issues.apache.org/jira/browse/SPARK-38666 Project: Spark Issue Type: Bug

<    1   2   3   4   5   >