[jira] [Updated] (SPARK-42450) dataset.where() omit quotes if where IN clause has more than 10 operands
[ https://issues.apache.org/jira/browse/SPARK-42450?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Vadim updated SPARK-42450: -- Description: dataset.where()/filter() omit string quotes if where IN clause has more than 10 operands. With datasourceV1 works as expected. Attached files: java-code.txt, stacktrace.txt, sql.txt - Spark verison 3.3.0 - Scala version 2.12 - DatasourceV2 - Postgres - Postrgres JDBC Driver: 42+ - Java8 was: dataset.where()/filter() omit string quotes if where IN clause has more than 10 operands. With datasourceV1 works as expected. Attached files: java-code.txt, stacktrace.txt - Spark verison 3.3.0 - Scala version 2.12 - DatasourceV2 - Postgres - Postrgres JDBC Driver: 42+ - Java8 *Expected query:* SELECT "flight_id", "flight_no" FROM "bookings"."flights" WHERE ( "flight_no"IN ( '55', '826', '845', '799', '561', '39', '385', '549', '576', '15', '857', '248', '324', '569', '267' ) ) *actual query:* SELECT "flight_id", "flight_no", FROM "bookings"."flights" WHERE ( "flight_no"IN ( 55, 826, 845, 799, 561, 39, 385, 549, 576, 15, 857, 248, 324, 569, 267 ) ) > dataset.where() omit quotes if where IN clause has more than 10 operands > > > Key: SPARK-42450 > URL: https://issues.apache.org/jira/browse/SPARK-42450 > Project: Spark > Issue Type: Bug > Components: SQL >Affects Versions: 3.3.0 >Reporter: Vadim >Priority: Major > Fix For: 3.3.2, 3.4.0 > > Attachments: java-code.txt, sql.txt, stacktrace.txt > > > dataset.where()/filter() omit string quotes if where IN clause has more than > 10 operands. With datasourceV1 works as expected. > Attached files: java-code.txt, stacktrace.txt, sql.txt > - Spark verison 3.3.0 > - Scala version 2.12 > - DatasourceV2 > - Postgres > - Postrgres JDBC Driver: 42+ > - Java8 -- This message was sent by Atlassian Jira (v8.20.10#820010) - To unsubscribe, e-mail: issues-unsubscr...@spark.apache.org For additional commands, e-mail: issues-h...@spark.apache.org
[jira] [Updated] (SPARK-42450) dataset.where() omit quotes if where IN clause has more than 10 operands
[ https://issues.apache.org/jira/browse/SPARK-42450?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Vadim updated SPARK-42450: -- Attachment: sql.txt > dataset.where() omit quotes if where IN clause has more than 10 operands > > > Key: SPARK-42450 > URL: https://issues.apache.org/jira/browse/SPARK-42450 > Project: Spark > Issue Type: Bug > Components: SQL >Affects Versions: 3.3.0 >Reporter: Vadim >Priority: Major > Fix For: 3.3.2, 3.4.0 > > Attachments: java-code.txt, sql.txt, stacktrace.txt > > > dataset.where()/filter() omit string quotes if where IN clause has more than > 10 operands. With datasourceV1 works as expected. > Attached files: java-code.txt, stacktrace.txt, sql.txt > - Spark verison 3.3.0 > - Scala version 2.12 > - DatasourceV2 > - Postgres > - Postrgres JDBC Driver: 42+ > - Java8 -- This message was sent by Atlassian Jira (v8.20.10#820010) - To unsubscribe, e-mail: issues-unsubscr...@spark.apache.org For additional commands, e-mail: issues-h...@spark.apache.org
[jira] [Updated] (SPARK-42450) dataset.where() omit quotes if where IN clause has more than 10 operands
[ https://issues.apache.org/jira/browse/SPARK-42450?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Vadim updated SPARK-42450: -- Description: dataset.where()/filter() omit string quotes if where IN clause has more than 10 operands. With datasourceV1 works as expected. Attached files: java-code.txt, stacktrace.txt - Spark verison 3.3.0 - Scala version 2.12 - DatasourceV2 - Postgres - Postrgres JDBC Driver: 42+ - Java8 *Expected query:* SELECT "flight_id", "flight_no" FROM "bookings"."flights" WHERE ( "flight_no"IN ( '55', '826', '845', '799', '561', '39', '385', '549', '576', '15', '857', '248', '324', '569', '267' ) ) *actual query:* SELECT "flight_id", "flight_no", FROM "bookings"."flights" WHERE ( "flight_no"IN ( 55, 826, 845, 799, 561, 39, 385, 549, 576, 15, 857, 248, 324, 569, 267 ) ) was: dataset.where()/filter() omit string quotes if where IN clause has more than 10 operands. With datasourceV1 works as expected. Attached files: java-code.txt, stacktrace.txt - Spark verison 3.3.0 - Scala version 2.12 - DatasourceV2 - Postgres - Postrgres JDBC Driver: 42+ - Java8 *Expected query:* SELECT "flight_id", "flight_no" FROM "bookings"."flights" WHERE ( "flight_no"IN ( '55', '826', '845', '799', '561', '39', '385', '549', '576', '15', '857', '248', '324', '569', '267' ) ) *actual query:* SELECT "flight_id", "flight_no", FROM "bookings"."flights" WHERE ( "flight_no"IN ( 55, 826, 845, 799, 561, 39, 385, 549, 576, 15, 857, 248, 324, 569, 267 ) ) > dataset.where() omit quotes if where IN clause has more than 10 operands > > > Key: SPARK-42450 > URL: https://issues.apache.org/jira/browse/SPARK-42450 > Project: Spark > Issue Type: Bug > Components: SQL >Affects Versions: 3.3.0 >Reporter: Vadim >Priority: Major > Fix For: 3.3.2, 3.4.0 > > Attachments: java-code.txt, stacktrace.txt > > > dataset.where()/filter() omit string quotes if where IN clause has more than > 10 operands. With datasourceV1 works as expected. > Attached files: java-code.txt, stacktrace.txt > - Spark verison 3.3.0 > - Scala version 2.12 > - DatasourceV2 > - Postgres > - Postrgres JDBC Driver: 42+ > - Java8 > *Expected query:* > SELECT > "flight_id", > "flight_no" > FROM > "bookings"."flights" > WHERE > ( > "flight_no"IN ( > '55', > '826', > '845', > '799', > '561', > '39', > '385', > '549', > '576', > '15', > '857', > '248', > '324', > '569', > '267' > ) > ) > *actual query:* > SELECT > "flight_id", > "flight_no", > FROM > "bookings"."flights" > WHERE > ( > "flight_no"IN ( > 55, > 826, > 845, > 799, > 561, > 39, > 385, > 549, > 576, > 15, > 857, > 248, > 324, > 569, > 267 > ) > ) -- This message was sent by Atlassian Jira (v8.20.10#820010) - To unsubscribe, e-mail: issues-unsubscr...@spark.apache.org For additional commands, e-mail: issues-h...@spark.apache.org
[jira] [Updated] (SPARK-42450) dataset.where() omit quotes if where IN clause has more than 10 operands
[ https://issues.apache.org/jira/browse/SPARK-42450?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Vadim updated SPARK-42450: -- Description: dataset.where()/filter() omit string quotes if where IN clause has more than 10 operands. With datasourceV1 works as expected. Attached files: java-code.txt, stacktrace.txt - Spark verison 3.3.0 - Scala version 2.12 - DatasourceV2 - Postgres - Postrgres JDBC Driver: 42+ - Java8 *Expected query:* SELECT "flight_id", "flight_no" FROM "bookings"."flights" WHERE ( "flight_no"IN ( '55', '826', '845', '799', '561', '39', '385', '549', '576', '15', '857', '248', '324', '569', '267' ) ) *actual query:* SELECT "flight_id", "flight_no", FROM "bookings"."flights" WHERE ( "flight_no"IN ( 55, 826, 845, 799, 561, 39, 385, 549, 576, 15, 857, 248, 324, 569, 267 ) ) was: dataset.where()/filter() omit string quotes if where IN clause has more than 10 operands. With datasourceV1 works as expected. - Spark verison 3.3.0 - Scala version 2.12 - DatasourceV2 - Postgres - Postrgres JDBC Driver: 42+ - Java8 *Expected query:* SELECT "flight_id", "flight_no" FROM "bookings"."flights" WHERE ( "flight_no"IN ( '55', '826', '845', '799', '561', '39', '385', '549', '576', '15', '857', '248', '324', '569', '267' ) ) *actual query:* SELECT "flight_id", "flight_no", FROM "bookings"."flights" WHERE ( "flight_no"IN ( 55, 826, 845, 799, 561, 39, 385, 549, 576, 15, 857, 248, 324, 569, 267 ) ) > dataset.where() omit quotes if where IN clause has more than 10 operands > > > Key: SPARK-42450 > URL: https://issues.apache.org/jira/browse/SPARK-42450 > Project: Spark > Issue Type: Bug > Components: SQL >Affects Versions: 3.3.0 >Reporter: Vadim >Priority: Major > Fix For: 3.3.2, 3.4.0 > > Attachments: java-code.txt, stacktrace.txt > > > dataset.where()/filter() omit string quotes if where IN clause has more than > 10 operands. With datasourceV1 works as expected. > Attached files: java-code.txt, stacktrace.txt > - Spark verison 3.3.0 > - Scala version 2.12 > - DatasourceV2 > - Postgres > - Postrgres JDBC Driver: 42+ > - Java8 > *Expected query:* > SELECT > "flight_id", > "flight_no" > FROM > "bookings"."flights" > WHERE > ( > "flight_no"IN ( > '55', > '826', > '845', > '799', > '561', > '39', > '385', > '549', > '576', > '15', > '857', > '248', > '324', > '569', > '267' > ) > ) > *actual query:* > SELECT > "flight_id", > "flight_no", > FROM > "bookings"."flights" > WHERE > ( > "flight_no"IN ( > 55, > 826, > 845, > 799, > 561, > 39, > 385, > 549, > 576, > 15, > 857, > 248, > 324, > 569, > 267 > ) > ) > > -- This message was sent by Atlassian Jira (v8.20.10#820010) - To unsubscribe, e-mail: issues-unsubscr...@spark.apache.org For additional commands, e-mail: issues-h...@spark.apache.org
[jira] [Updated] (SPARK-42450) dataset.where() omit quotes if where IN clause has more than 10 operands
[ https://issues.apache.org/jira/browse/SPARK-42450?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Vadim updated SPARK-42450: -- Description: dataset.where()/filter() omit string quotes if where IN clause has more than 10 operands. With datasourceV1 works as expected. - Spark verison 3.3.0 - Scala version 2.12 - DatasourceV2 - Postgres - Postrgres JDBC Driver: 42+ - Java8 *Expected query:* SELECT "flight_id", "flight_no" FROM "bookings"."flights" WHERE ( "flight_no"IN ( '55', '826', '845', '799', '561', '39', '385', '549', '576', '15', '857', '248', '324', '569', '267' ) ) *actual query:* SELECT "flight_id", "flight_no", FROM "bookings"."flights" WHERE ( "flight_no"IN ( 55, 826, 845, 799, 561, 39, 385, 549, 576, 15, 857, 248, 324, 569, 267 ) ) was: dataset.where()/filter() omit string quotes if where IN clause has more than 10 operands. With datasourceV1 works as expected. - Spark verison 3.3.0 - Scala version 2.12 - DatasourceV2 - Postgres - Postrgres JDBC Driver: 42+ - Java8 > dataset.where() omit quotes if where IN clause has more than 10 operands > > > Key: SPARK-42450 > URL: https://issues.apache.org/jira/browse/SPARK-42450 > Project: Spark > Issue Type: Bug > Components: SQL >Affects Versions: 3.3.0 >Reporter: Vadim >Priority: Major > Fix For: 3.3.2, 3.4.0 > > Attachments: java-code.txt, stacktrace.txt > > > dataset.where()/filter() omit string quotes if where IN clause has more than > 10 operands. With datasourceV1 works as expected. > - Spark verison 3.3.0 > - Scala version 2.12 > - DatasourceV2 > - Postgres > - Postrgres JDBC Driver: 42+ > - Java8 > *Expected query:* > SELECT > "flight_id", > "flight_no" > FROM > "bookings"."flights" > WHERE > ( > "flight_no"IN ( > '55', > '826', > '845', > '799', > '561', > '39', > '385', > '549', > '576', > '15', > '857', > '248', > '324', > '569', > '267' > ) > ) > *actual query:* > SELECT > "flight_id", > "flight_no", > FROM > "bookings"."flights" > WHERE > ( > "flight_no"IN ( > 55, > 826, > 845, > 799, > 561, > 39, > 385, > 549, > 576, > 15, > 857, > 248, > 324, > 569, > 267 > ) > ) > > -- This message was sent by Atlassian Jira (v8.20.10#820010) - To unsubscribe, e-mail: issues-unsubscr...@spark.apache.org For additional commands, e-mail: issues-h...@spark.apache.org
[jira] [Updated] (SPARK-42450) dataset.where() omit quotes if where IN clause has more than 10 operands
[ https://issues.apache.org/jira/browse/SPARK-42450?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Vadim updated SPARK-42450: -- Attachment: stacktrace.txt > dataset.where() omit quotes if where IN clause has more than 10 operands > > > Key: SPARK-42450 > URL: https://issues.apache.org/jira/browse/SPARK-42450 > Project: Spark > Issue Type: Bug > Components: SQL >Affects Versions: 3.3.0 >Reporter: Vadim >Priority: Major > Fix For: 3.3.2, 3.4.0 > > Attachments: java-code.txt, stacktrace.txt > > > dataset.where()/filter() omit string quotes if where IN clause has more than > 10 operands. With datasourceV1 works as expected. > - Spark verison 3.3.0 > - Scala version 2.12 > - DatasourceV2 > - Postgres > - Postrgres JDBC Driver: 42+ > - Java8 > > -- This message was sent by Atlassian Jira (v8.20.10#820010) - To unsubscribe, e-mail: issues-unsubscr...@spark.apache.org For additional commands, e-mail: issues-h...@spark.apache.org
[jira] [Updated] (SPARK-42450) dataset.where() omit quotes if where IN clause has more than 10 operands
[ https://issues.apache.org/jira/browse/SPARK-42450?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Vadim updated SPARK-42450: -- Attachment: java-code.txt > dataset.where() omit quotes if where IN clause has more than 10 operands > > > Key: SPARK-42450 > URL: https://issues.apache.org/jira/browse/SPARK-42450 > Project: Spark > Issue Type: Bug > Components: SQL >Affects Versions: 3.3.0 >Reporter: Vadim >Priority: Major > Fix For: 3.3.2, 3.4.0 > > Attachments: java-code.txt, stacktrace.txt > > > dataset.where()/filter() omit string quotes if where IN clause has more than > 10 operands. With datasourceV1 works as expected. > - Spark verison 3.3.0 > - Scala version 2.12 > - DatasourceV2 > - Postgres > - Postrgres JDBC Driver: 42+ > - Java8 > > -- This message was sent by Atlassian Jira (v8.20.10#820010) - To unsubscribe, e-mail: issues-unsubscr...@spark.apache.org For additional commands, e-mail: issues-h...@spark.apache.org
[jira] [Created] (SPARK-42450) dataset.where() omit quotes if where IN clause has more than 10 operands
Vadim created SPARK-42450: - Summary: dataset.where() omit quotes if where IN clause has more than 10 operands Key: SPARK-42450 URL: https://issues.apache.org/jira/browse/SPARK-42450 Project: Spark Issue Type: Bug Components: SQL Affects Versions: 3.3.0 Reporter: Vadim Fix For: 3.3.2, 3.4.0 Attachments: java-code.txt, stacktrace.txt dataset.where()/filter() omit string quotes if where IN clause has more than 10 operands. With datasourceV1 works as expected. - Spark verison 3.3.0 - Scala version 2.12 - DatasourceV2 - Postgres - Postrgres JDBC Driver: 42+ - Java8 -- This message was sent by Atlassian Jira (v8.20.10#820010) - To unsubscribe, e-mail: issues-unsubscr...@spark.apache.org For additional commands, e-mail: issues-h...@spark.apache.org
[jira] [Commented] (SPARK-40563) Error at where clause, when sql case executes by else branch
[ https://issues.apache.org/jira/browse/SPARK-40563?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17611409#comment-17611409 ] Vadim commented on SPARK-40563: --- [~Zing] Our respect, thanks for the help! > Error at where clause, when sql case executes by else branch > > > Key: SPARK-40563 > URL: https://issues.apache.org/jira/browse/SPARK-40563 > Project: Spark > Issue Type: Bug > Components: SQL >Affects Versions: 3.3.0 >Reporter: Vadim >Priority: Major > Fix For: 3.3.1 > > Attachments: java-code-example.txt, sql.txt, stack-trace.txt > > > Hello! > The Spark SQL phase optimization failed with an internal error. Please, fill > a bug report in, and provide the full stack trace. > - Spark verison 3.3.0 > - Scala version 2.12 > - DatasourceV2 > - Postgres > - Postrgres JDBC Driver: 42+ > - Java8 > Case: > select > case > when (t_name = 'foo') then 'foo' > else 'default' > end as case_when > from > t > where > case > when (t_name = 'foo') then 'foo' > else 'default' > end *= 'foo'; -> works as expected* > *--* > select > case > when (t_name = 'foo') then 'foo' > else 'default' > end as case_when > from > t > where > case > when (t_name = 'foo') then 'foo' > else 'default' > end *= 'default'; -> query throw ex;* > In where clause when we try find rows by else branch, spark thrown exception: > The Spark SQL phase optimization failed with an internal error. Please, fill > a bug report in, and provide the full stack trace. > Caused by: java.lang.AssertionError: assertion failed > at scala.Predef$.assert(Predef.scala:208) > > org.apache.spark.sql.execution.datasources.v2.PushablePredicate.$anonfun$unapply$1(DataSourceV2Strategy.scala:589) > At debugger def unapply in PushablePredicate.class > when sql case return 'foo' -> function unapply accept: (t_name = 'foo'), as > instance of Predicate > when sql case return 'default' -> function unapply accept: COALESCE(t_name = > 'foo', FALSE) as instance of GeneralScalarExpression and assertation failed > with error > -- This message was sent by Atlassian Jira (v8.20.10#820010) - To unsubscribe, e-mail: issues-unsubscr...@spark.apache.org For additional commands, e-mail: issues-h...@spark.apache.org
[jira] [Updated] (SPARK-40563) Error at where clause, when sql case executes by else branch
[ https://issues.apache.org/jira/browse/SPARK-40563?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Vadim updated SPARK-40563: -- Attachment: java-code-example.txt > Error at where clause, when sql case executes by else branch > > > Key: SPARK-40563 > URL: https://issues.apache.org/jira/browse/SPARK-40563 > Project: Spark > Issue Type: Bug > Components: SQL >Affects Versions: 3.3.0 >Reporter: Vadim >Priority: Major > Fix For: 3.3.0 > > Attachments: java-code-example.txt, sql.txt, stack-trace.txt > > > Hello! > The Spark SQL phase optimization failed with an internal error. Please, fill > a bug report in, and provide the full stack trace. > - Spark verison 3.3.0 > - Scala version 2.12 > - DatasourceV2 > - Postgres > - Postrgres JDBC Driver: 42+ > - Java8 > Case: > select > case > when (t_name = 'foo') then 'foo' > else 'default' > end as case_when > from > t > where > case > when (t_name = 'foo') then 'foo' > else 'default' > end *= 'foo'; -> works as expected* > *--* > select > case > when (t_name = 'foo') then 'foo' > else 'default' > end as case_when > from > t > where > case > when (t_name = 'foo') then 'foo' > else 'default' > end *= 'default'; -> query throw ex;* > In where clause when we try find rows by else branch, spark thrown exception: > The Spark SQL phase optimization failed with an internal error. Please, fill > a bug report in, and provide the full stack trace. > Caused by: java.lang.AssertionError: assertion failed > at scala.Predef$.assert(Predef.scala:208) > > org.apache.spark.sql.execution.datasources.v2.PushablePredicate.$anonfun$unapply$1(DataSourceV2Strategy.scala:589) > At debugger def unapply in PushablePredicate.class > when sql case return 'foo' -> function unapply accept: (t_name = 'foo'), as > instance of Predicate > when sql case return 'default' -> function unapply accept: COALESCE(t_name = > 'foo', FALSE) as instance of GeneralScalarExpression and assertation failed > with error > -- This message was sent by Atlassian Jira (v8.20.10#820010) - To unsubscribe, e-mail: issues-unsubscr...@spark.apache.org For additional commands, e-mail: issues-h...@spark.apache.org
[jira] [Updated] (SPARK-40563) Error at where clause, when sql case executes by else branch
[ https://issues.apache.org/jira/browse/SPARK-40563?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Vadim updated SPARK-40563: -- Attachment: (was: java-code-example.txt) > Error at where clause, when sql case executes by else branch > > > Key: SPARK-40563 > URL: https://issues.apache.org/jira/browse/SPARK-40563 > Project: Spark > Issue Type: Bug > Components: SQL >Affects Versions: 3.3.0 >Reporter: Vadim >Priority: Major > Fix For: 3.3.0 > > Attachments: java-code-example.txt, sql.txt, stack-trace.txt > > > Hello! > The Spark SQL phase optimization failed with an internal error. Please, fill > a bug report in, and provide the full stack trace. > - Spark verison 3.3.0 > - Scala version 2.12 > - DatasourceV2 > - Postgres > - Postrgres JDBC Driver: 42+ > - Java8 > Case: > select > case > when (t_name = 'foo') then 'foo' > else 'default' > end as case_when > from > t > where > case > when (t_name = 'foo') then 'foo' > else 'default' > end *= 'foo'; -> works as expected* > *--* > select > case > when (t_name = 'foo') then 'foo' > else 'default' > end as case_when > from > t > where > case > when (t_name = 'foo') then 'foo' > else 'default' > end *= 'default'; -> query throw ex;* > In where clause when we try find rows by else branch, spark thrown exception: > The Spark SQL phase optimization failed with an internal error. Please, fill > a bug report in, and provide the full stack trace. > Caused by: java.lang.AssertionError: assertion failed > at scala.Predef$.assert(Predef.scala:208) > > org.apache.spark.sql.execution.datasources.v2.PushablePredicate.$anonfun$unapply$1(DataSourceV2Strategy.scala:589) > At debugger def unapply in PushablePredicate.class > when sql case return 'foo' -> function unapply accept: (t_name = 'foo'), as > instance of Predicate > when sql case return 'default' -> function unapply accept: COALESCE(t_name = > 'foo', FALSE) as instance of GeneralScalarExpression and assertation failed > with error > -- This message was sent by Atlassian Jira (v8.20.10#820010) - To unsubscribe, e-mail: issues-unsubscr...@spark.apache.org For additional commands, e-mail: issues-h...@spark.apache.org
[jira] [Updated] (SPARK-40563) Error at where clause, when sql case executes by else branch
[ https://issues.apache.org/jira/browse/SPARK-40563?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Vadim updated SPARK-40563: -- Attachment: sql.txt > Error at where clause, when sql case executes by else branch > > > Key: SPARK-40563 > URL: https://issues.apache.org/jira/browse/SPARK-40563 > Project: Spark > Issue Type: Bug > Components: SQL >Affects Versions: 3.3.0 >Reporter: Vadim >Priority: Major > Fix For: 3.3.0 > > Attachments: java-code-example.txt, sql.txt, stack-trace.txt > > > Hello! > The Spark SQL phase optimization failed with an internal error. Please, fill > a bug report in, and provide the full stack trace. > - Spark verison 3.3.0 > - Scala version 2.12 > - DatasourceV2 > - Postgres > - Postrgres JDBC Driver: 42+ > - Java8 > Case: > select > case > when (t_name = 'foo') then 'foo' > else 'default' > end as case_when > from > t > where > case > when (t_name = 'foo') then 'foo' > else 'default' > end *= 'foo'; -> works as expected* > *--* > select > case > when (t_name = 'foo') then 'foo' > else 'default' > end as case_when > from > t > where > case > when (t_name = 'foo') then 'foo' > else 'default' > end *= 'default'; -> query throw ex;* > In where clause when we try find rows by else branch, spark thrown exception: > The Spark SQL phase optimization failed with an internal error. Please, fill > a bug report in, and provide the full stack trace. > Caused by: java.lang.AssertionError: assertion failed > at scala.Predef$.assert(Predef.scala:208) > > org.apache.spark.sql.execution.datasources.v2.PushablePredicate.$anonfun$unapply$1(DataSourceV2Strategy.scala:589) > At debugger def unapply in PushablePredicate.class > when sql case return 'foo' -> function unapply accept: (t_name = 'foo'), as > instance of Predicate > when sql case return 'default' -> function unapply accept: COALESCE(t_name = > 'foo', FALSE) as instance of GeneralScalarExpression and assertation failed > with error > -- This message was sent by Atlassian Jira (v8.20.10#820010) - To unsubscribe, e-mail: issues-unsubscr...@spark.apache.org For additional commands, e-mail: issues-h...@spark.apache.org
[jira] [Updated] (SPARK-40563) Error at where clause, when sql case executes by else branch
[ https://issues.apache.org/jira/browse/SPARK-40563?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Vadim updated SPARK-40563: -- Description: Hello! The Spark SQL phase optimization failed with an internal error. Please, fill a bug report in, and provide the full stack trace. - Spark verison 3.3.0 - Scala version 2.12 - DatasourceV2 - Postgres - Postrgres JDBC Driver: 42+ - Java8 Case: select case when (t_name = 'foo') then 'foo' else 'default' end as case_when from t where case when (t_name = 'foo') then 'foo' else 'default' end *= 'foo'; -> works as expected* *--* select case when (t_name = 'foo') then 'foo' else 'default' end as case_when from t where case when (t_name = 'foo') then 'foo' else 'default' end *= 'default'; -> query throw ex;* In where clause when we try find rows by else branch, spark thrown exception: The Spark SQL phase optimization failed with an internal error. Please, fill a bug report in, and provide the full stack trace. Caused by: java.lang.AssertionError: assertion failed at scala.Predef$.assert(Predef.scala:208) org.apache.spark.sql.execution.datasources.v2.PushablePredicate.$anonfun$unapply$1(DataSourceV2Strategy.scala:589) At debugger def unapply in PushablePredicate.class when sql case return 'foo' -> function unapply accept: (t_name = 'foo'), as instance of Predicate when sql case return 'default' -> function unapply accept: COALESCE(t_name = 'foo', FALSE) as instance of GeneralScalarExpression and assertation failed with error was: Hello! The Spark SQL phase optimization failed with an internal error. Please, fill a bug report in, and provide the full stack trace. - Spark verison 3.3.0 - Scala version 2.12 - DatasourceV2 - Postgres - Postrgres JDBC Driver: 42+ - Java8 Case: select case when (t_name = 'foo') then 'foo' else 'else_will_throw_ex' end as case_when from t where case when (t_name = 'foo') then 'foo' else 'defualt_name' end *= 'foo'; -> works as expected* *--* select case when (t_name = 'foo') then 'foo' else 'else_will_throw_ex' end as case_when from t where case when (t_name = 'foo') then 'foo' else 'defualt_name' end *= 'defualt_name'; -> query throw ex;* In where clause when we try find rows by else branch, spark thrown exception: The Spark SQL phase optimization failed with an internal error. Please, fill a bug report in, and provide the full stack trace. Caused by: java.lang.AssertionError: assertion failed at scala.Predef$.assert(Predef.scala:208) org.apache.spark.sql.execution.datasources.v2.PushablePredicate.$anonfun$unapply$1(DataSourceV2Strategy.scala:589) At debugger def unapply in PushablePredicate.class when sql case return 'foo' -> function unapply accept: (t_name#1 = foo), as instance of Predicate when sql case return 'else_will_throw_ex' -> function unapply accept: COALESCE(t_name = 'foo', FALSE) as instance of GeneralScalarExpression and assertation failed with error > Error at where clause, when sql case executes by else branch > > > Key: SPARK-40563 > URL: https://issues.apache.org/jira/browse/SPARK-40563 > Project: Spark > Issue Type: Bug > Components: SQL >Affects Versions: 3.3.0 >Reporter: Vadim >Priority: Major > Fix For: 3.3.0 > > Attachments: java-code-example.txt, sql.txt, stack-trace.txt > > > Hello! > The Spark SQL phase optimization failed with an internal error. Please, fill > a bug report in, and provide the full stack trace. > - Spark verison 3.3.0 > - Scala version 2.12 > - DatasourceV2 > - Postgres > - Postrgres JDBC Driver: 42+ > - Java8 > Case: > select > case > when (t_name = 'foo') then 'foo' > else 'default' > end as case_when > from > t > where > case > when (t_name = 'foo') then 'foo' > else 'default' > end *= 'foo'; -> works as expected* > *--* > select > case > when (t_name = 'foo') then 'foo' > else 'default' > end as case_when > from > t > where > case > when (t_name = 'foo') then 'foo' > else 'default' > end *= 'default'; -> query throw ex;* > In where clause when we try find rows by else branch, spark thrown exception: > The Spark SQL phase optimization failed with an internal error. Please, fill > a bug report in, and provide the full stack trace. > Caused by: java.lang.AssertionError: assertion failed > at
[jira] [Updated] (SPARK-40563) Error at where clause, when sql case executes by else branch
[ https://issues.apache.org/jira/browse/SPARK-40563?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Vadim updated SPARK-40563: -- Attachment: (was: sql.txt) > Error at where clause, when sql case executes by else branch > > > Key: SPARK-40563 > URL: https://issues.apache.org/jira/browse/SPARK-40563 > Project: Spark > Issue Type: Bug > Components: SQL >Affects Versions: 3.3.0 >Reporter: Vadim >Priority: Major > Fix For: 3.3.0 > > Attachments: java-code-example.txt, sql.txt, stack-trace.txt > > > Hello! > The Spark SQL phase optimization failed with an internal error. Please, fill > a bug report in, and provide the full stack trace. > - Spark verison 3.3.0 > - Scala version 2.12 > - DatasourceV2 > - Postgres > - Postrgres JDBC Driver: 42+ > - Java8 > Case: > select > case > when (t_name = 'foo') then 'foo' > else 'default' > end as case_when > from > t > where > case > when (t_name = 'foo') then 'foo' > else 'default' > end *= 'foo'; -> works as expected* > *--* > select > case > when (t_name = 'foo') then 'foo' > else 'default' > end as case_when > from > t > where > case > when (t_name = 'foo') then 'foo' > else 'default' > end *= 'default'; -> query throw ex;* > In where clause when we try find rows by else branch, spark thrown exception: > The Spark SQL phase optimization failed with an internal error. Please, fill > a bug report in, and provide the full stack trace. > Caused by: java.lang.AssertionError: assertion failed > at scala.Predef$.assert(Predef.scala:208) > > org.apache.spark.sql.execution.datasources.v2.PushablePredicate.$anonfun$unapply$1(DataSourceV2Strategy.scala:589) > At debugger def unapply in PushablePredicate.class > when sql case return 'foo' -> function unapply accept: (t_name = 'foo'), as > instance of Predicate > when sql case return 'default' -> function unapply accept: COALESCE(t_name = > 'foo', FALSE) as instance of GeneralScalarExpression and assertation failed > with error > -- This message was sent by Atlassian Jira (v8.20.10#820010) - To unsubscribe, e-mail: issues-unsubscr...@spark.apache.org For additional commands, e-mail: issues-h...@spark.apache.org
[jira] [Updated] (SPARK-40563) Error at where clause, when sql case executes by else branch
[ https://issues.apache.org/jira/browse/SPARK-40563?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Vadim updated SPARK-40563: -- Description: Hello! The Spark SQL phase optimization failed with an internal error. Please, fill a bug report in, and provide the full stack trace. - Spark verison 3.3.0 - Scala version 2.12 - DatasourceV2 - Postgres - Postrgres JDBC Driver: 42+ - Java8 Case: select case when (t_name = 'foo') then 'foo' else 'else_will_throw_ex' end as case_when from t where case when (t_name = 'foo') then 'foo' else 'defualt_name' end *= 'foo'; -> works as expected* *--* select case when (t_name = 'foo') then 'foo' else 'else_will_throw_ex' end as case_when from t where case when (t_name = 'foo') then 'foo' else 'defualt_name' end *= 'defualt_name'; -> query throw ex;* In where clause when we try find rows by else branch, spark thrown exception: The Spark SQL phase optimization failed with an internal error. Please, fill a bug report in, and provide the full stack trace. Caused by: java.lang.AssertionError: assertion failed at scala.Predef$.assert(Predef.scala:208) org.apache.spark.sql.execution.datasources.v2.PushablePredicate.$anonfun$unapply$1(DataSourceV2Strategy.scala:589) At debugger def unapply in PushablePredicate.class when sql case return 'foo' -> function unapply accept: (t_name#1 = foo), as instance of Predicate when sql case return 'else_will_throw_ex' -> function unapply accept: COALESCE(t_name = 'foo', FALSE) as instance of GeneralScalarExpression and assertation failed with error was: Hello! The Spark SQL phase optimization failed with an internal error. Please, fill a bug report in, and provide the full stack trace. - Spark verison 3.3.0 - Scala version 2.12 - DatasourceV2 - Postgres - Postrgres JDBC Driver: 42+ - Java8 Case: select case when (t_name = 'foo') then 'foo' else 'else_will_throw_ex' end as case_when from t where case when (t_name = 'foo') then 'foo' else 'else_will_throw_ex' end *= 'foo'; -> works as expected* *--* select case when (t_name = 'foo') then 'foo' else 'else_will_throw_ex' end as case_when from t where case when (t_name = 'foo') then 'foo' else 'else_will_throw_ex' end *= 'else_will_throw_ex'; -> query throw ex;* In where clause when we try find rows by else branch, spark thrown exception: The Spark SQL phase optimization failed with an internal error. Please, fill a bug report in, and provide the full stack trace. Caused by: java.lang.AssertionError: assertion failed at scala.Predef$.assert(Predef.scala:208) org.apache.spark.sql.execution.datasources.v2.PushablePredicate.$anonfun$unapply$1(DataSourceV2Strategy.scala:589) At debugger def unapply in PushablePredicate.class when sql case return 'foo' -> function unapply accept: (t_name#1 = foo), as instance of Predicate when sql case return 'else_will_throw_ex' -> function unapply accept: COALESCE(t_name = 'foo', FALSE) as instance of GeneralScalarExpression and assertation failed with error > Error at where clause, when sql case executes by else branch > > > Key: SPARK-40563 > URL: https://issues.apache.org/jira/browse/SPARK-40563 > Project: Spark > Issue Type: Bug > Components: SQL >Affects Versions: 3.3.0 >Reporter: Vadim >Priority: Major > Fix For: 3.3.0 > > Attachments: java-code-example.txt, sql.txt, stack-trace.txt > > > Hello! > The Spark SQL phase optimization failed with an internal error. Please, fill > a bug report in, and provide the full stack trace. > - Spark verison 3.3.0 > - Scala version 2.12 > - DatasourceV2 > - Postgres > - Postrgres JDBC Driver: 42+ > - Java8 > Case: > select > case > when (t_name = 'foo') then 'foo' > else 'else_will_throw_ex' > end as case_when > from > t > where > case > when (t_name = 'foo') then 'foo' > else 'defualt_name' > end *= 'foo'; -> works as expected* > *--* > select > case > when (t_name = 'foo') then 'foo' > else 'else_will_throw_ex' > end as case_when > from > t > where > case > when (t_name = 'foo') then 'foo' > else 'defualt_name' > end *= 'defualt_name'; -> query throw ex;* > In where clause when we try find rows by else branch, spark thrown exception: > The Spark SQL phase optimization failed with an internal error. Please, fill > a bug report in, and provide the full stack
[jira] [Updated] (SPARK-40563) Error at where clause, when sql case executes by else branch
[ https://issues.apache.org/jira/browse/SPARK-40563?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Vadim updated SPARK-40563: -- Description: Hello! The Spark SQL phase optimization failed with an internal error. Please, fill a bug report in, and provide the full stack trace. - Spark verison 3.3.0 - Scala version 2.12 - DatasourceV2 - Postgres - Postrgres JDBC Driver: 42+ - Java8 Case: select case when (t_name = 'foo') then 'foo' else 'else_will_throw_ex' end as case_when from t where case when (t_name = 'foo') then 'foo' else 'else_will_throw_ex' *end = 'foo'; -> works as expected* select case when (t_name = 'foo') then 'foo' else 'else_will_throw_ex' end as case_when from t where case when (t_name = 'foo') then 'foo' else 'else_will_throw_ex' *end = 'else_will_throw_ex'; -> query throw ex;* In where clause when we try find rows by else branch, spark thrown exception: The Spark SQL phase optimization failed with an internal error. Please, fill a bug report in, and provide the full stack trace. Caused by: java.lang.AssertionError: assertion failed at scala.Predef$.assert(Predef.scala:208) org.apache.spark.sql.execution.datasources.v2.PushablePredicate.$anonfun$unapply$1(DataSourceV2Strategy.scala:589) At debugger def unapply in PushablePredicate.class when sql case return 'foo' -> function unapply accept: (t_name#1 = foo), as instance of Predicate when sql case return 'else_will_throw_ex' -> function unapply accept: COALESCE(t_name = 'foo', FALSE) as instance of GeneralScalarExpression and assertation failed with error was: Hello! The Spark SQL phase optimization failed with an internal error. Please, fill a bug report in, and provide the full stack trace. - Spark verison 3.3.0 - Scala version 2.12 - DatasourceV2 - Postgres - Postrgres JDBC Driver: 42+ - Java8 Case: select case when (t_name = 'foo') then 'foo' else 'else_will_throw_ex' end as case_when from t where case when (t_name = 'foo') then 'foo' else 'else_will_throw_ex' end = 'else_will_throw_ex' In where clause when we try find rows by else branch, spark thrown exception: The Spark SQL phase optimization failed with an internal error. Please, fill a bug report in, and provide the full stack trace. Caused by: java.lang.AssertionError: assertion failed at scala.Predef$.assert(Predef.scala:208) org.apache.spark.sql.execution.datasources.v2.PushablePredicate.$anonfun$unapply$1(DataSourceV2Strategy.scala:589) At debugger def unapply in PushablePredicate.class when sql case return 'foo' -> function unapply accept: (t_name#1 = foo), as instance of Predicate when sql case return 'else_will_throw_ex' -> function unapply accept: COALESCE(t_name = 'foo', FALSE) as instance of GeneralScalarExpression and assertation failed with error > Error at where clause, when sql case executes by else branch > > > Key: SPARK-40563 > URL: https://issues.apache.org/jira/browse/SPARK-40563 > Project: Spark > Issue Type: Bug > Components: SQL >Affects Versions: 3.3.0 >Reporter: Vadim >Priority: Major > Fix For: 3.3.0 > > Attachments: java-code-example.txt, sql.txt, stack-trace.txt > > > Hello! > The Spark SQL phase optimization failed with an internal error. Please, fill > a bug report in, and provide the full stack trace. > - Spark verison 3.3.0 > - Scala version 2.12 > - DatasourceV2 > - Postgres > - Postrgres JDBC Driver: 42+ > - Java8 > Case: > select > case > when (t_name = 'foo') then 'foo' > else 'else_will_throw_ex' > end as case_when > from > t > where > case > when (t_name = 'foo') then 'foo' > else 'else_will_throw_ex' > *end = 'foo'; -> works as expected* > select > case > when (t_name = 'foo') then 'foo' > else 'else_will_throw_ex' > end as case_when > from > t > where > case > when (t_name = 'foo') then 'foo' > else 'else_will_throw_ex' > *end = 'else_will_throw_ex'; -> query throw ex;* > In where clause when we try find rows by else branch, spark thrown exception: > The Spark SQL phase optimization failed with an internal error. Please, fill > a bug report in, and provide the full stack trace. > Caused by: java.lang.AssertionError: assertion failed > at scala.Predef$.assert(Predef.scala:208) > > org.apache.spark.sql.execution.datasources.v2.PushablePredicate.$anonfun$unapply$1(DataSourceV2Strategy.scala:589) > At debugger def unapply in PushablePredicate.class > when sql case return 'foo' -> function unapply accept: (t_name#1 = foo), as > instance of Predicate > when sql case return 'else_will_throw_ex'
[jira] [Updated] (SPARK-40563) Error at where clause, when sql case executes by else branch
[ https://issues.apache.org/jira/browse/SPARK-40563?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Vadim updated SPARK-40563: -- Description: Hello! The Spark SQL phase optimization failed with an internal error. Please, fill a bug report in, and provide the full stack trace. - Spark verison 3.3.0 - Scala version 2.12 - DatasourceV2 - Postgres - Postrgres JDBC Driver: 42+ - Java8 Case: select case when (t_name = 'foo') then 'foo' else 'else_will_throw_ex' end as case_when from t where case when (t_name = 'foo') then 'foo' else 'else_will_throw_ex' end *= 'foo'; -> works as expected* *--* select case when (t_name = 'foo') then 'foo' else 'else_will_throw_ex' end as case_when from t where case when (t_name = 'foo') then 'foo' else 'else_will_throw_ex' end *= 'else_will_throw_ex'; -> query throw ex;* In where clause when we try find rows by else branch, spark thrown exception: The Spark SQL phase optimization failed with an internal error. Please, fill a bug report in, and provide the full stack trace. Caused by: java.lang.AssertionError: assertion failed at scala.Predef$.assert(Predef.scala:208) org.apache.spark.sql.execution.datasources.v2.PushablePredicate.$anonfun$unapply$1(DataSourceV2Strategy.scala:589) At debugger def unapply in PushablePredicate.class when sql case return 'foo' -> function unapply accept: (t_name#1 = foo), as instance of Predicate when sql case return 'else_will_throw_ex' -> function unapply accept: COALESCE(t_name = 'foo', FALSE) as instance of GeneralScalarExpression and assertation failed with error was: Hello! The Spark SQL phase optimization failed with an internal error. Please, fill a bug report in, and provide the full stack trace. - Spark verison 3.3.0 - Scala version 2.12 - DatasourceV2 - Postgres - Postrgres JDBC Driver: 42+ - Java8 Case: select case when (t_name = 'foo') then 'foo' else 'else_will_throw_ex' end as case_when from t where case when (t_name = 'foo') then 'foo' else 'else_will_throw_ex' end *= 'foo'; -> works as expected* select case when (t_name = 'foo') then 'foo' else 'else_will_throw_ex' end as case_when from t where case when (t_name = 'foo') then 'foo' else 'else_will_throw_ex' end *= 'else_will_throw_ex'; -> query throw ex;* In where clause when we try find rows by else branch, spark thrown exception: The Spark SQL phase optimization failed with an internal error. Please, fill a bug report in, and provide the full stack trace. Caused by: java.lang.AssertionError: assertion failed at scala.Predef$.assert(Predef.scala:208) org.apache.spark.sql.execution.datasources.v2.PushablePredicate.$anonfun$unapply$1(DataSourceV2Strategy.scala:589) At debugger def unapply in PushablePredicate.class when sql case return 'foo' -> function unapply accept: (t_name#1 = foo), as instance of Predicate when sql case return 'else_will_throw_ex' -> function unapply accept: COALESCE(t_name = 'foo', FALSE) as instance of GeneralScalarExpression and assertation failed with error > Error at where clause, when sql case executes by else branch > > > Key: SPARK-40563 > URL: https://issues.apache.org/jira/browse/SPARK-40563 > Project: Spark > Issue Type: Bug > Components: SQL >Affects Versions: 3.3.0 >Reporter: Vadim >Priority: Major > Fix For: 3.3.0 > > Attachments: java-code-example.txt, sql.txt, stack-trace.txt > > > Hello! > The Spark SQL phase optimization failed with an internal error. Please, fill > a bug report in, and provide the full stack trace. > - Spark verison 3.3.0 > - Scala version 2.12 > - DatasourceV2 > - Postgres > - Postrgres JDBC Driver: 42+ > - Java8 > Case: > select > case > when (t_name = 'foo') then 'foo' > else 'else_will_throw_ex' > end as case_when > from > t > where > case > when (t_name = 'foo') then 'foo' > else 'else_will_throw_ex' > end *= 'foo'; -> works as expected* > *--* > select > case > when (t_name = 'foo') then 'foo' > else 'else_will_throw_ex' > end as case_when > from > t > where > case > when (t_name = 'foo') then 'foo' > else 'else_will_throw_ex' > end *= 'else_will_throw_ex'; -> query throw ex;* > In where clause when we try find rows by else branch, spark thrown exception: > The Spark SQL phase optimization failed with an internal error. Please, fill > a bug report in, and provide the full stack trace. > Caused by:
[jira] [Updated] (SPARK-40563) Error at where clause, when sql case executes by else branch
[ https://issues.apache.org/jira/browse/SPARK-40563?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Vadim updated SPARK-40563: -- Description: Hello! The Spark SQL phase optimization failed with an internal error. Please, fill a bug report in, and provide the full stack trace. - Spark verison 3.3.0 - Scala version 2.12 - DatasourceV2 - Postgres - Postrgres JDBC Driver: 42+ - Java8 Case: select case when (t_name = 'foo') then 'foo' else 'else_will_throw_ex' end as case_when from t where case when (t_name = 'foo') then 'foo' else 'else_will_throw_ex' end *= 'foo'; -> works as expected* select case when (t_name = 'foo') then 'foo' else 'else_will_throw_ex' end as case_when from t where case when (t_name = 'foo') then 'foo' else 'else_will_throw_ex' end *= 'else_will_throw_ex'; -> query throw ex;* In where clause when we try find rows by else branch, spark thrown exception: The Spark SQL phase optimization failed with an internal error. Please, fill a bug report in, and provide the full stack trace. Caused by: java.lang.AssertionError: assertion failed at scala.Predef$.assert(Predef.scala:208) org.apache.spark.sql.execution.datasources.v2.PushablePredicate.$anonfun$unapply$1(DataSourceV2Strategy.scala:589) At debugger def unapply in PushablePredicate.class when sql case return 'foo' -> function unapply accept: (t_name#1 = foo), as instance of Predicate when sql case return 'else_will_throw_ex' -> function unapply accept: COALESCE(t_name = 'foo', FALSE) as instance of GeneralScalarExpression and assertation failed with error was: Hello! The Spark SQL phase optimization failed with an internal error. Please, fill a bug report in, and provide the full stack trace. - Spark verison 3.3.0 - Scala version 2.12 - DatasourceV2 - Postgres - Postrgres JDBC Driver: 42+ - Java8 Case: select case when (t_name = 'foo') then 'foo' else 'else_will_throw_ex' end as case_when from t where case when (t_name = 'foo') then 'foo' else 'else_will_throw_ex' *end = 'foo'; -> works as expected* select case when (t_name = 'foo') then 'foo' else 'else_will_throw_ex' end as case_when from t where case when (t_name = 'foo') then 'foo' else 'else_will_throw_ex' *end = 'else_will_throw_ex'; -> query throw ex;* In where clause when we try find rows by else branch, spark thrown exception: The Spark SQL phase optimization failed with an internal error. Please, fill a bug report in, and provide the full stack trace. Caused by: java.lang.AssertionError: assertion failed at scala.Predef$.assert(Predef.scala:208) org.apache.spark.sql.execution.datasources.v2.PushablePredicate.$anonfun$unapply$1(DataSourceV2Strategy.scala:589) At debugger def unapply in PushablePredicate.class when sql case return 'foo' -> function unapply accept: (t_name#1 = foo), as instance of Predicate when sql case return 'else_will_throw_ex' -> function unapply accept: COALESCE(t_name = 'foo', FALSE) as instance of GeneralScalarExpression and assertation failed with error > Error at where clause, when sql case executes by else branch > > > Key: SPARK-40563 > URL: https://issues.apache.org/jira/browse/SPARK-40563 > Project: Spark > Issue Type: Bug > Components: SQL >Affects Versions: 3.3.0 >Reporter: Vadim >Priority: Major > Fix For: 3.3.0 > > Attachments: java-code-example.txt, sql.txt, stack-trace.txt > > > Hello! > The Spark SQL phase optimization failed with an internal error. Please, fill > a bug report in, and provide the full stack trace. > - Spark verison 3.3.0 > - Scala version 2.12 > - DatasourceV2 > - Postgres > - Postrgres JDBC Driver: 42+ > - Java8 > Case: > select > case > when (t_name = 'foo') then 'foo' > else 'else_will_throw_ex' > end as case_when > from > t > where > case > when (t_name = 'foo') then 'foo' > else 'else_will_throw_ex' > end *= 'foo'; -> works as expected* > select > case > when (t_name = 'foo') then 'foo' > else 'else_will_throw_ex' > end as case_when > from > t > where > case > when (t_name = 'foo') then 'foo' > else 'else_will_throw_ex' > end *= 'else_will_throw_ex'; -> query throw ex;* > In where clause when we try find rows by else branch, spark thrown exception: > The Spark SQL phase optimization failed with an internal error. Please, fill > a bug report in, and provide the full stack trace. > Caused by: java.lang.AssertionError: assertion failed > at scala.Predef$.assert(Predef.scala:208) > >
[jira] [Updated] (SPARK-40563) Error at where clause, when sql case executes by else branch
[ https://issues.apache.org/jira/browse/SPARK-40563?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Vadim updated SPARK-40563: -- Attachment: (was: sql.txt) > Error at where clause, when sql case executes by else branch > > > Key: SPARK-40563 > URL: https://issues.apache.org/jira/browse/SPARK-40563 > Project: Spark > Issue Type: Bug > Components: SQL >Affects Versions: 3.3.0 >Reporter: Vadim >Priority: Major > Fix For: 3.3.0 > > Attachments: java-code-example.txt, sql.txt, stack-trace.txt > > > Hello! > The Spark SQL phase optimization failed with an internal error. Please, fill > a bug report in, and provide the full stack trace. > - Spark verison 3.3.0 > - Scala version 2.12 > - DatasourceV2 > - Postgres > - Postrgres JDBC Driver: 42+ > - Java8 > Case: > select > case > when (t_name = 'foo') then 'foo' > else 'else_will_throw_ex' > end as case_when > from > t > where > case > when (t_name = 'foo') then 'foo' > else 'else_will_throw_ex' > end = 'else_will_throw_ex' > In where clause when we try find rows by else branch, spark thrown exception: > The Spark SQL phase optimization failed with an internal error. Please, fill > a bug report in, and provide the full stack trace. > Caused by: java.lang.AssertionError: assertion failed > at scala.Predef$.assert(Predef.scala:208) > > org.apache.spark.sql.execution.datasources.v2.PushablePredicate.$anonfun$unapply$1(DataSourceV2Strategy.scala:589) > At debugger def unapply in PushablePredicate.class > when sql case return 'foo' -> function unapply accept: (t_name#1 = foo), as > instance of Predicate > when sql case return 'else_will_throw_ex' -> function unapply accept: > COALESCE(t_name = 'foo', FALSE) as instance of GeneralScalarExpression and > assertation failed with error > -- This message was sent by Atlassian Jira (v8.20.10#820010) - To unsubscribe, e-mail: issues-unsubscr...@spark.apache.org For additional commands, e-mail: issues-h...@spark.apache.org
[jira] [Updated] (SPARK-40563) Error at where clause, when sql case executes by else branch
[ https://issues.apache.org/jira/browse/SPARK-40563?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Vadim updated SPARK-40563: -- Attachment: sql.txt > Error at where clause, when sql case executes by else branch > > > Key: SPARK-40563 > URL: https://issues.apache.org/jira/browse/SPARK-40563 > Project: Spark > Issue Type: Bug > Components: SQL >Affects Versions: 3.3.0 >Reporter: Vadim >Priority: Major > Fix For: 3.3.0 > > Attachments: java-code-example.txt, sql.txt, stack-trace.txt > > > Hello! > The Spark SQL phase optimization failed with an internal error. Please, fill > a bug report in, and provide the full stack trace. > - Spark verison 3.3.0 > - Scala version 2.12 > - DatasourceV2 > - Postgres > - Postrgres JDBC Driver: 42+ > - Java8 > Case: > select > case > when (t_name = 'foo') then 'foo' > else 'else_will_throw_ex' > end as case_when > from > t > where > case > when (t_name = 'foo') then 'foo' > else 'else_will_throw_ex' > end = 'else_will_throw_ex' > In where clause when we try find rows by else branch, spark thrown exception: > The Spark SQL phase optimization failed with an internal error. Please, fill > a bug report in, and provide the full stack trace. > Caused by: java.lang.AssertionError: assertion failed > at scala.Predef$.assert(Predef.scala:208) > > org.apache.spark.sql.execution.datasources.v2.PushablePredicate.$anonfun$unapply$1(DataSourceV2Strategy.scala:589) > At debugger def unapply in PushablePredicate.class > when sql case return 'foo' -> function unapply accept: (t_name#1 = foo), as > instance of Predicate > when sql case return 'else_will_throw_ex' -> function unapply accept: > COALESCE(t_name = 'foo', FALSE) as instance of GeneralScalarExpression and > assertation failed with error > -- This message was sent by Atlassian Jira (v8.20.10#820010) - To unsubscribe, e-mail: issues-unsubscr...@spark.apache.org For additional commands, e-mail: issues-h...@spark.apache.org
[jira] [Updated] (SPARK-40563) Error at where clause, when sql case executes by else branch
[ https://issues.apache.org/jira/browse/SPARK-40563?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Vadim updated SPARK-40563: -- Attachment: java-code-example.txt > Error at where clause, when sql case executes by else branch > > > Key: SPARK-40563 > URL: https://issues.apache.org/jira/browse/SPARK-40563 > Project: Spark > Issue Type: Bug > Components: SQL >Affects Versions: 3.3.0 >Reporter: Vadim >Priority: Major > Fix For: 3.3.0 > > Attachments: java-code-example.txt, sql.txt, stack-trace.txt > > > Hello! > The Spark SQL phase optimization failed with an internal error. Please, fill > a bug report in, and provide the full stack trace. > - Spark verison 3.3.0 > - Scala version 2.12 > - DatasourceV2 > - Postgres > - Postrgres JDBC Driver: 42+ > - Java8 > Case: > select > case > when (t_name = 'foo') then 'foo' > else 'else_will_throw_ex' > end as case_when > from > t > where > case > when (t_name = 'foo') then 'foo' > else 'else_will_throw_ex' > end = 'else_will_throw_ex' > In where clause when we try find rows by else branch, spark thrown exception: > The Spark SQL phase optimization failed with an internal error. Please, fill > a bug report in, and provide the full stack trace. > Caused by: java.lang.AssertionError: assertion failed > at scala.Predef$.assert(Predef.scala:208) > > org.apache.spark.sql.execution.datasources.v2.PushablePredicate.$anonfun$unapply$1(DataSourceV2Strategy.scala:589) > At debugger def unapply in PushablePredicate.class > when sql case return 'foo' -> function unapply accept: (t_name#1 = foo), as > instance of Predicate > when sql case return 'else_will_throw_ex' -> function unapply accept: > COALESCE(t_name = 'foo', FALSE) as instance of GeneralScalarExpression and > assertation failed with error > -- This message was sent by Atlassian Jira (v8.20.10#820010) - To unsubscribe, e-mail: issues-unsubscr...@spark.apache.org For additional commands, e-mail: issues-h...@spark.apache.org
[jira] [Updated] (SPARK-40563) Error at where clause, when sql case executes by else branch
[ https://issues.apache.org/jira/browse/SPARK-40563?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Vadim updated SPARK-40563: -- Description: Hello! The Spark SQL phase optimization failed with an internal error. Please, fill a bug report in, and provide the full stack trace. - Spark verison 3.3.0 - Scala version 2.12 - DatasourceV2 - Postgres - Postrgres JDBC Driver: 42+ - Java8 Case: select case when (t_name = 'foo') then 'foo' else 'else_will_throw_ex' end as case_when from t where case when (t_name = 'foo') then 'foo' else 'else_will_throw_ex' end = 'else_will_throw_ex' In where clause when we try find rows by else branch, spark thrown exception: The Spark SQL phase optimization failed with an internal error. Please, fill a bug report in, and provide the full stack trace. Caused by: java.lang.AssertionError: assertion failed at scala.Predef$.assert(Predef.scala:208) org.apache.spark.sql.execution.datasources.v2.PushablePredicate.$anonfun$unapply$1(DataSourceV2Strategy.scala:589) At debugger def unapply in PushablePredicate.class when sql case return 'foo' -> function unapply accept: (t_name#1 = foo), as instance of Predicate when sql case return 'else_will_throw_ex' -> function unapply accept: COALESCE(t_name = 'foo', FALSE) as instance of GeneralScalarExpression and assertation failed with error was: Hello! The Spark SQL phase optimization failed with an internal error. Please, fill a bug report in, and provide the full stack trace. - Spark verison 3.3.0 - Scala version 2.12 - DatasourceV2 - Postgres - Postrgres JDBC Driver: 42+ - Java8 Case: select case when (t_name = 'foo') then 'foo' else 'else_stmt_failed' end as case_when from t where case when (t_name = 'foo') then 'foo' else 'else_will_throw_ex' end = 'else_will_throw_ex' In where clause when we try find rows by else branch, spark thrown exception: The Spark SQL phase optimization failed with an internal error. Please, fill a bug report in, and provide the full stack trace. Caused by: java.lang.AssertionError: assertion failed at scala.Predef$.assert(Predef.scala:208) org.apache.spark.sql.execution.datasources.v2.PushablePredicate.$anonfun$unapply$1(DataSourceV2Strategy.scala:589) At debugger def unapply in PushablePredicate.class when sql case return 'foo' -> function unapply accept: (t_name#1 = foo), as instance of Predicate when sql case return 'else_will_throw_ex' -> function unapply accept: COALESCE(t_name = 'foo', FALSE) as instance of GeneralScalarExpression and assertation failed with error > Error at where clause, when sql case executes by else branch > > > Key: SPARK-40563 > URL: https://issues.apache.org/jira/browse/SPARK-40563 > Project: Spark > Issue Type: Bug > Components: SQL >Affects Versions: 3.3.0 >Reporter: Vadim >Priority: Major > Fix For: 3.3.0 > > Attachments: java-code-example.txt, sql.txt, stack-trace.txt > > > Hello! > The Spark SQL phase optimization failed with an internal error. Please, fill > a bug report in, and provide the full stack trace. > - Spark verison 3.3.0 > - Scala version 2.12 > - DatasourceV2 > - Postgres > - Postrgres JDBC Driver: 42+ > - Java8 > Case: > select > case > when (t_name = 'foo') then 'foo' > else 'else_will_throw_ex' > end as case_when > from > t > where > case > when (t_name = 'foo') then 'foo' > else 'else_will_throw_ex' > end = 'else_will_throw_ex' > In where clause when we try find rows by else branch, spark thrown exception: > The Spark SQL phase optimization failed with an internal error. Please, fill > a bug report in, and provide the full stack trace. > Caused by: java.lang.AssertionError: assertion failed > at scala.Predef$.assert(Predef.scala:208) > > org.apache.spark.sql.execution.datasources.v2.PushablePredicate.$anonfun$unapply$1(DataSourceV2Strategy.scala:589) > At debugger def unapply in PushablePredicate.class > when sql case return 'foo' -> function unapply accept: (t_name#1 = foo), as > instance of Predicate > when sql case return 'else_will_throw_ex' -> function unapply accept: > COALESCE(t_name = 'foo', FALSE) as instance of GeneralScalarExpression and > assertation failed with error > -- This message was sent by Atlassian Jira (v8.20.10#820010) - To unsubscribe, e-mail: issues-unsubscr...@spark.apache.org For additional commands, e-mail: issues-h...@spark.apache.org
[jira] [Updated] (SPARK-40563) Error at where clause, when sql case executes by else branch
[ https://issues.apache.org/jira/browse/SPARK-40563?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Vadim updated SPARK-40563: -- Attachment: (was: java-code-example.txt) > Error at where clause, when sql case executes by else branch > > > Key: SPARK-40563 > URL: https://issues.apache.org/jira/browse/SPARK-40563 > Project: Spark > Issue Type: Bug > Components: SQL >Affects Versions: 3.3.0 >Reporter: Vadim >Priority: Major > Fix For: 3.3.0 > > Attachments: java-code-example.txt, sql.txt, stack-trace.txt > > > Hello! > The Spark SQL phase optimization failed with an internal error. Please, fill > a bug report in, and provide the full stack trace. > - Spark verison 3.3.0 > - Scala version 2.12 > - DatasourceV2 > - Postgres > - Postrgres JDBC Driver: 42+ > - Java8 > Case: > select > case > when (t_name = 'foo') then 'foo' > else 'else_will_throw_ex' > end as case_when > from > t > where > case > when (t_name = 'foo') then 'foo' > else 'else_will_throw_ex' > end = 'else_will_throw_ex' > In where clause when we try find rows by else branch, spark thrown exception: > The Spark SQL phase optimization failed with an internal error. Please, fill > a bug report in, and provide the full stack trace. > Caused by: java.lang.AssertionError: assertion failed > at scala.Predef$.assert(Predef.scala:208) > > org.apache.spark.sql.execution.datasources.v2.PushablePredicate.$anonfun$unapply$1(DataSourceV2Strategy.scala:589) > At debugger def unapply in PushablePredicate.class > when sql case return 'foo' -> function unapply accept: (t_name#1 = foo), as > instance of Predicate > when sql case return 'else_will_throw_ex' -> function unapply accept: > COALESCE(t_name = 'foo', FALSE) as instance of GeneralScalarExpression and > assertation failed with error > -- This message was sent by Atlassian Jira (v8.20.10#820010) - To unsubscribe, e-mail: issues-unsubscr...@spark.apache.org For additional commands, e-mail: issues-h...@spark.apache.org
[jira] [Updated] (SPARK-40563) Error at where clause, when sql case executes by else branch
[ https://issues.apache.org/jira/browse/SPARK-40563?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Vadim updated SPARK-40563: -- Description: Hello! The Spark SQL phase optimization failed with an internal error. Please, fill a bug report in, and provide the full stack trace. - Spark verison 3.3.0 - Scala version 2.12 - DatasourceV2 - Postgres - Postrgres JDBC Driver: 42+ - Java8 Case: select case when (t_name = 'foo') then 'foo' else 'else_stmt_failed' end as case_when from t where case when (t_name = 'foo') then 'foo' else 'else_will_throw_ex' end = 'else_will_throw_ex' In where clause when we try find rows by else branch, spark thrown exception: The Spark SQL phase optimization failed with an internal error. Please, fill a bug report in, and provide the full stack trace. Caused by: java.lang.AssertionError: assertion failed at scala.Predef$.assert(Predef.scala:208) org.apache.spark.sql.execution.datasources.v2.PushablePredicate.$anonfun$unapply$1(DataSourceV2Strategy.scala:589) At debugger def unapply in PushablePredicate.class when sql case return 'foo' -> function unapply accept: (t_name#1 = foo), as instance of Predicate when sql case return 'else_will_throw_ex' -> function unapply accept: COALESCE(t_name = 'foo', FALSE) as instance of GeneralScalarExpression and assertation failed with error was: Hello! The Spark SQL phase optimization failed with an internal error. Please, fill a bug report in, and provide the full stack trace. - Spark verison 3.3.0 - Scala version 2.12 - DatasourceV2 - Postgres - Postrgres JDBC Driver: 42+ - Java8 Case: select case when (t_name = 'foo') then 'foo' else 'else_stmt_failed' end as case_when from t where case when (t_name = 'foo') then 'foo' else 'else_will_throw_ex' end = 'else_will_throw_ex' In where clause when we try find rows by else branch, spark thrown exception: The Spark SQL phase optimization failed with an internal error. Please, fill a bug report in, and provide the full stack trace. Caused by: java.lang.AssertionError: assertion failed at scala.Predef$.assert(Predef.scala:208) org.apache.spark.sql.execution.datasources.v2.PushablePredicate.$anonfun$unapply$1(DataSourceV2Strategy.scala:589) At debugger def unapply function in PushablePredicate.class when sql case return 'foo' -> function unapply accept: (t_name#1 = foo), as instance of Predicate when sql case return 'else_will_throw_ex' -> function unapply accept: COALESCE(t_name = 'foo', FALSE) as instance of GeneralScalarExpression and assertation failed with error > Error at where clause, when sql case executes by else branch > > > Key: SPARK-40563 > URL: https://issues.apache.org/jira/browse/SPARK-40563 > Project: Spark > Issue Type: Bug > Components: SQL >Affects Versions: 3.3.0 >Reporter: Vadim >Priority: Major > Fix For: 3.3.0 > > Attachments: java-code-example.txt, sql.txt, stack-trace.txt > > > Hello! > The Spark SQL phase optimization failed with an internal error. Please, fill > a bug report in, and provide the full stack trace. > - Spark verison 3.3.0 > - Scala version 2.12 > - DatasourceV2 > - Postgres > - Postrgres JDBC Driver: 42+ > - Java8 > Case: > select > case > when (t_name = 'foo') then 'foo' > else 'else_stmt_failed' > end as case_when > from > t > where > case > when (t_name = 'foo') then 'foo' > else 'else_will_throw_ex' > end = 'else_will_throw_ex' > In where clause when we try find rows by else branch, spark thrown exception: > The Spark SQL phase optimization failed with an internal error. Please, fill > a bug report in, and provide the full stack trace. > Caused by: java.lang.AssertionError: assertion failed > at scala.Predef$.assert(Predef.scala:208) > > org.apache.spark.sql.execution.datasources.v2.PushablePredicate.$anonfun$unapply$1(DataSourceV2Strategy.scala:589) > At debugger def unapply in PushablePredicate.class > when sql case return 'foo' -> function unapply accept: (t_name#1 = foo), as > instance of Predicate > when sql case return 'else_will_throw_ex' -> function unapply accept: > COALESCE(t_name = 'foo', FALSE) as instance of GeneralScalarExpression and > assertation failed with error > -- This message was sent by Atlassian Jira (v8.20.10#820010) - To unsubscribe, e-mail: issues-unsubscr...@spark.apache.org For additional commands, e-mail: issues-h...@spark.apache.org
[jira] [Updated] (SPARK-40563) Error at where clause, when sql case executes by else branch
[ https://issues.apache.org/jira/browse/SPARK-40563?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Vadim updated SPARK-40563: -- Attachment: (was: test.sql) > Error at where clause, when sql case executes by else branch > > > Key: SPARK-40563 > URL: https://issues.apache.org/jira/browse/SPARK-40563 > Project: Spark > Issue Type: Bug > Components: SQL >Affects Versions: 3.3.0 >Reporter: Vadim >Priority: Major > Fix For: 3.3.0 > > Attachments: java-code-example.txt, sql.txt, stack-trace.txt > > > Hello! > The Spark SQL phase optimization failed with an internal error. Please, fill > a bug report in, and provide the full stack trace. > - Spark verison 3.3.0 > - Scala version 2.12 > - DatasourceV2 > - Postgres > - Postrgres JDBC Driver: 42+ > - Java8 > Case: > select > case > when (t_name = 'foo') then 'foo' > else 'else_stmt_failed' > end as case_when > from > t > where > case > when (t_name = 'foo') then 'foo' > else 'else_will_throw_ex' > end = 'else_will_throw_ex' > In where clause when we try find rows by else branch, spark thrown exception: > The Spark SQL phase optimization failed with an internal error. Please, fill > a bug report in, and provide the full stack trace. > Caused by: java.lang.AssertionError: assertion failed > at scala.Predef$.assert(Predef.scala:208) > > org.apache.spark.sql.execution.datasources.v2.PushablePredicate.$anonfun$unapply$1(DataSourceV2Strategy.scala:589) > At debugger def unapply function in PushablePredicate.class > when sql case return 'foo' -> function unapply accept: (t_name#1 = foo), as > instance of Predicate > when sql case return 'else_will_throw_ex' -> function unapply accept: > COALESCE(t_name = 'foo', FALSE) as instance of GeneralScalarExpression and > assertation failed with error > -- This message was sent by Atlassian Jira (v8.20.10#820010) - To unsubscribe, e-mail: issues-unsubscr...@spark.apache.org For additional commands, e-mail: issues-h...@spark.apache.org
[jira] [Updated] (SPARK-40563) Error at where clause, when sql case executes by else branch
[ https://issues.apache.org/jira/browse/SPARK-40563?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Vadim updated SPARK-40563: -- Attachment: java-code-example-1.txt > Error at where clause, when sql case executes by else branch > > > Key: SPARK-40563 > URL: https://issues.apache.org/jira/browse/SPARK-40563 > Project: Spark > Issue Type: Bug > Components: SQL >Affects Versions: 3.3.0 >Reporter: Vadim >Priority: Major > Fix For: 3.3.0 > > Attachments: java-code-example.txt, stack-trace.txt, test.sql > > > Hello! > The Spark SQL phase optimization failed with an internal error. Please, fill > a bug report in, and provide the full stack trace. > - Spark verison 3.3.0 > - Scala version 2.12 > - DatasourceV2 > - Postgres > - Postrgres JDBC Driver: 42+ > - Java8 > Case: > select > case > when (t_name = 'foo') then 'foo' > else 'else_stmt_failed' > end as case_when > from > t > where > case > when (t_name = 'foo') then 'foo' > else 'else_will_throw_ex' > end = 'else_will_throw_ex' > In where clause when we try find rows by else branch, spark thrown exception: > The Spark SQL phase optimization failed with an internal error. Please, fill > a bug report in, and provide the full stack trace. > Caused by: java.lang.AssertionError: assertion failed > at scala.Predef$.assert(Predef.scala:208) > > org.apache.spark.sql.execution.datasources.v2.PushablePredicate.$anonfun$unapply$1(DataSourceV2Strategy.scala:589) > At debugger def unapply function in PushablePredicate.class > when sql case return 'foo' -> function unapply accept: (t_name#1 = foo), as > instance of Predicate > when sql case return 'else_will_throw_ex' -> function unapply accept: > COALESCE(t_name = 'foo', FALSE) as instance of GeneralScalarExpression and > assertation failed with error > -- This message was sent by Atlassian Jira (v8.20.10#820010) - To unsubscribe, e-mail: issues-unsubscr...@spark.apache.org For additional commands, e-mail: issues-h...@spark.apache.org
[jira] [Updated] (SPARK-40563) Error at where clause, when sql case executes by else branch
[ https://issues.apache.org/jira/browse/SPARK-40563?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Vadim updated SPARK-40563: -- Attachment: java-code-example.txt > Error at where clause, when sql case executes by else branch > > > Key: SPARK-40563 > URL: https://issues.apache.org/jira/browse/SPARK-40563 > Project: Spark > Issue Type: Bug > Components: SQL >Affects Versions: 3.3.0 >Reporter: Vadim >Priority: Major > Fix For: 3.3.0 > > Attachments: java-code-example.txt, stack-trace.txt, test.sql > > > Hello! > The Spark SQL phase optimization failed with an internal error. Please, fill > a bug report in, and provide the full stack trace. > - Spark verison 3.3.0 > - Scala version 2.12 > - DatasourceV2 > - Postgres > - Postrgres JDBC Driver: 42+ > - Java8 > Case: > select > case > when (t_name = 'foo') then 'foo' > else 'else_stmt_failed' > end as case_when > from > t > where > case > when (t_name = 'foo') then 'foo' > else 'else_will_throw_ex' > end = 'else_will_throw_ex' > In where clause when we try find rows by else branch, spark thrown exception: > The Spark SQL phase optimization failed with an internal error. Please, fill > a bug report in, and provide the full stack trace. > Caused by: java.lang.AssertionError: assertion failed > at scala.Predef$.assert(Predef.scala:208) > > org.apache.spark.sql.execution.datasources.v2.PushablePredicate.$anonfun$unapply$1(DataSourceV2Strategy.scala:589) > At debugger def unapply function in PushablePredicate.class > when sql case return 'foo' -> function unapply accept: (t_name#1 = foo), as > instance of Predicate > when sql case return 'else_will_throw_ex' -> function unapply accept: > COALESCE(t_name = 'foo', FALSE) as instance of GeneralScalarExpression and > assertation failed with error > -- This message was sent by Atlassian Jira (v8.20.10#820010) - To unsubscribe, e-mail: issues-unsubscr...@spark.apache.org For additional commands, e-mail: issues-h...@spark.apache.org
[jira] [Updated] (SPARK-40563) Error at where clause, when sql case executes by else branch
[ https://issues.apache.org/jira/browse/SPARK-40563?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Vadim updated SPARK-40563: -- Attachment: test.txt > Error at where clause, when sql case executes by else branch > > > Key: SPARK-40563 > URL: https://issues.apache.org/jira/browse/SPARK-40563 > Project: Spark > Issue Type: Bug > Components: SQL >Affects Versions: 3.3.0 >Reporter: Vadim >Priority: Major > Fix For: 3.3.0 > > Attachments: java-code-example.txt, sql.txt, stack-trace.txt > > > Hello! > The Spark SQL phase optimization failed with an internal error. Please, fill > a bug report in, and provide the full stack trace. > - Spark verison 3.3.0 > - Scala version 2.12 > - DatasourceV2 > - Postgres > - Postrgres JDBC Driver: 42+ > - Java8 > Case: > select > case > when (t_name = 'foo') then 'foo' > else 'else_stmt_failed' > end as case_when > from > t > where > case > when (t_name = 'foo') then 'foo' > else 'else_will_throw_ex' > end = 'else_will_throw_ex' > In where clause when we try find rows by else branch, spark thrown exception: > The Spark SQL phase optimization failed with an internal error. Please, fill > a bug report in, and provide the full stack trace. > Caused by: java.lang.AssertionError: assertion failed > at scala.Predef$.assert(Predef.scala:208) > > org.apache.spark.sql.execution.datasources.v2.PushablePredicate.$anonfun$unapply$1(DataSourceV2Strategy.scala:589) > At debugger def unapply function in PushablePredicate.class > when sql case return 'foo' -> function unapply accept: (t_name#1 = foo), as > instance of Predicate > when sql case return 'else_will_throw_ex' -> function unapply accept: > COALESCE(t_name = 'foo', FALSE) as instance of GeneralScalarExpression and > assertation failed with error > -- This message was sent by Atlassian Jira (v8.20.10#820010) - To unsubscribe, e-mail: issues-unsubscr...@spark.apache.org For additional commands, e-mail: issues-h...@spark.apache.org
[jira] [Updated] (SPARK-40563) Error at where clause, when sql case executes by else branch
[ https://issues.apache.org/jira/browse/SPARK-40563?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Vadim updated SPARK-40563: -- Attachment: (was: test.txt) > Error at where clause, when sql case executes by else branch > > > Key: SPARK-40563 > URL: https://issues.apache.org/jira/browse/SPARK-40563 > Project: Spark > Issue Type: Bug > Components: SQL >Affects Versions: 3.3.0 >Reporter: Vadim >Priority: Major > Fix For: 3.3.0 > > Attachments: java-code-example.txt, sql.txt, stack-trace.txt > > > Hello! > The Spark SQL phase optimization failed with an internal error. Please, fill > a bug report in, and provide the full stack trace. > - Spark verison 3.3.0 > - Scala version 2.12 > - DatasourceV2 > - Postgres > - Postrgres JDBC Driver: 42+ > - Java8 > Case: > select > case > when (t_name = 'foo') then 'foo' > else 'else_stmt_failed' > end as case_when > from > t > where > case > when (t_name = 'foo') then 'foo' > else 'else_will_throw_ex' > end = 'else_will_throw_ex' > In where clause when we try find rows by else branch, spark thrown exception: > The Spark SQL phase optimization failed with an internal error. Please, fill > a bug report in, and provide the full stack trace. > Caused by: java.lang.AssertionError: assertion failed > at scala.Predef$.assert(Predef.scala:208) > > org.apache.spark.sql.execution.datasources.v2.PushablePredicate.$anonfun$unapply$1(DataSourceV2Strategy.scala:589) > At debugger def unapply function in PushablePredicate.class > when sql case return 'foo' -> function unapply accept: (t_name#1 = foo), as > instance of Predicate > when sql case return 'else_will_throw_ex' -> function unapply accept: > COALESCE(t_name = 'foo', FALSE) as instance of GeneralScalarExpression and > assertation failed with error > -- This message was sent by Atlassian Jira (v8.20.10#820010) - To unsubscribe, e-mail: issues-unsubscr...@spark.apache.org For additional commands, e-mail: issues-h...@spark.apache.org
[jira] [Updated] (SPARK-40563) Error at where clause, when sql case executes by else branch
[ https://issues.apache.org/jira/browse/SPARK-40563?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Vadim updated SPARK-40563: -- Attachment: sql.txt > Error at where clause, when sql case executes by else branch > > > Key: SPARK-40563 > URL: https://issues.apache.org/jira/browse/SPARK-40563 > Project: Spark > Issue Type: Bug > Components: SQL >Affects Versions: 3.3.0 >Reporter: Vadim >Priority: Major > Fix For: 3.3.0 > > Attachments: java-code-example.txt, sql.txt, stack-trace.txt > > > Hello! > The Spark SQL phase optimization failed with an internal error. Please, fill > a bug report in, and provide the full stack trace. > - Spark verison 3.3.0 > - Scala version 2.12 > - DatasourceV2 > - Postgres > - Postrgres JDBC Driver: 42+ > - Java8 > Case: > select > case > when (t_name = 'foo') then 'foo' > else 'else_stmt_failed' > end as case_when > from > t > where > case > when (t_name = 'foo') then 'foo' > else 'else_will_throw_ex' > end = 'else_will_throw_ex' > In where clause when we try find rows by else branch, spark thrown exception: > The Spark SQL phase optimization failed with an internal error. Please, fill > a bug report in, and provide the full stack trace. > Caused by: java.lang.AssertionError: assertion failed > at scala.Predef$.assert(Predef.scala:208) > > org.apache.spark.sql.execution.datasources.v2.PushablePredicate.$anonfun$unapply$1(DataSourceV2Strategy.scala:589) > At debugger def unapply function in PushablePredicate.class > when sql case return 'foo' -> function unapply accept: (t_name#1 = foo), as > instance of Predicate > when sql case return 'else_will_throw_ex' -> function unapply accept: > COALESCE(t_name = 'foo', FALSE) as instance of GeneralScalarExpression and > assertation failed with error > -- This message was sent by Atlassian Jira (v8.20.10#820010) - To unsubscribe, e-mail: issues-unsubscr...@spark.apache.org For additional commands, e-mail: issues-h...@spark.apache.org
[jira] [Updated] (SPARK-40563) Error at where clause, when sql case executes by else branch
[ https://issues.apache.org/jira/browse/SPARK-40563?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Vadim updated SPARK-40563: -- Attachment: (was: java-code-example-1.txt) > Error at where clause, when sql case executes by else branch > > > Key: SPARK-40563 > URL: https://issues.apache.org/jira/browse/SPARK-40563 > Project: Spark > Issue Type: Bug > Components: SQL >Affects Versions: 3.3.0 >Reporter: Vadim >Priority: Major > Fix For: 3.3.0 > > Attachments: java-code-example.txt, stack-trace.txt, test.sql > > > Hello! > The Spark SQL phase optimization failed with an internal error. Please, fill > a bug report in, and provide the full stack trace. > - Spark verison 3.3.0 > - Scala version 2.12 > - DatasourceV2 > - Postgres > - Postrgres JDBC Driver: 42+ > - Java8 > Case: > select > case > when (t_name = 'foo') then 'foo' > else 'else_stmt_failed' > end as case_when > from > t > where > case > when (t_name = 'foo') then 'foo' > else 'else_will_throw_ex' > end = 'else_will_throw_ex' > In where clause when we try find rows by else branch, spark thrown exception: > The Spark SQL phase optimization failed with an internal error. Please, fill > a bug report in, and provide the full stack trace. > Caused by: java.lang.AssertionError: assertion failed > at scala.Predef$.assert(Predef.scala:208) > > org.apache.spark.sql.execution.datasources.v2.PushablePredicate.$anonfun$unapply$1(DataSourceV2Strategy.scala:589) > At debugger def unapply function in PushablePredicate.class > when sql case return 'foo' -> function unapply accept: (t_name#1 = foo), as > instance of Predicate > when sql case return 'else_will_throw_ex' -> function unapply accept: > COALESCE(t_name = 'foo', FALSE) as instance of GeneralScalarExpression and > assertation failed with error > -- This message was sent by Atlassian Jira (v8.20.10#820010) - To unsubscribe, e-mail: issues-unsubscr...@spark.apache.org For additional commands, e-mail: issues-h...@spark.apache.org
[jira] [Updated] (SPARK-40563) Error at where clause, when sql case executes by else branch
[ https://issues.apache.org/jira/browse/SPARK-40563?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Vadim updated SPARK-40563: -- Attachment: (was: java-code-example.txt) > Error at where clause, when sql case executes by else branch > > > Key: SPARK-40563 > URL: https://issues.apache.org/jira/browse/SPARK-40563 > Project: Spark > Issue Type: Bug > Components: SQL >Affects Versions: 3.3.0 >Reporter: Vadim >Priority: Major > Fix For: 3.3.0 > > Attachments: java-code-example.txt, stack-trace.txt, test.sql > > > Hello! > The Spark SQL phase optimization failed with an internal error. Please, fill > a bug report in, and provide the full stack trace. > - Spark verison 3.3.0 > - Scala version 2.12 > - DatasourceV2 > - Postgres > - Postrgres JDBC Driver: 42+ > - Java8 > Case: > select > case > when (t_name = 'foo') then 'foo' > else 'else_stmt_failed' > end as case_when > from > t > where > case > when (t_name = 'foo') then 'foo' > else 'else_will_throw_ex' > end = 'else_will_throw_ex' > In where clause when we try find rows by else branch, spark thrown exception: > The Spark SQL phase optimization failed with an internal error. Please, fill > a bug report in, and provide the full stack trace. > Caused by: java.lang.AssertionError: assertion failed > at scala.Predef$.assert(Predef.scala:208) > > org.apache.spark.sql.execution.datasources.v2.PushablePredicate.$anonfun$unapply$1(DataSourceV2Strategy.scala:589) > At debugger def unapply function in PushablePredicate.class > when sql case return 'foo' -> function unapply accept: (t_name#1 = foo), as > instance of Predicate > when sql case return 'else_will_throw_ex' -> function unapply accept: > COALESCE(t_name = 'foo', FALSE) as instance of GeneralScalarExpression and > assertation failed with error > -- This message was sent by Atlassian Jira (v8.20.10#820010) - To unsubscribe, e-mail: issues-unsubscr...@spark.apache.org For additional commands, e-mail: issues-h...@spark.apache.org
[jira] [Updated] (SPARK-40563) Error at where clause, when sql case executes by else branch
[ https://issues.apache.org/jira/browse/SPARK-40563?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Vadim updated SPARK-40563: -- Summary: Error at where clause, when sql case executes by else branch (was: Error at where clause, when sql case executes on else branch) > Error at where clause, when sql case executes by else branch > > > Key: SPARK-40563 > URL: https://issues.apache.org/jira/browse/SPARK-40563 > Project: Spark > Issue Type: Bug > Components: SQL >Affects Versions: 3.3.0 >Reporter: Vadim >Priority: Major > Fix For: 3.3.0 > > Attachments: java-code-example.txt, stack-trace.txt, test.sql > > > Hello! > The Spark SQL phase optimization failed with an internal error. Please, fill > a bug report in, and provide the full stack trace. > - Spark verison 3.3.0 > - Scala version 2.12 > - DatasourceV2 > - Postgres > - Postrgres JDBC Driver: 42+ > - Java8 > Case: > select > case > when (t_name = 'foo') then 'foo' > else 'else_stmt_failed' > end as case_when > from > t > where > case > when (t_name = 'foo') then 'foo' > else 'else_will_throw_ex' > end = 'else_will_throw_ex' > In where clause when we try find rows by else branch, spark thrown exception: > The Spark SQL phase optimization failed with an internal error. Please, fill > a bug report in, and provide the full stack trace. > Caused by: java.lang.AssertionError: assertion failed > at scala.Predef$.assert(Predef.scala:208) > > org.apache.spark.sql.execution.datasources.v2.PushablePredicate.$anonfun$unapply$1(DataSourceV2Strategy.scala:589) > At debugger def unapply function in PushablePredicate.class > when sql case return 'foo' -> function unapply accept: (t_name#1 = foo), as > instance of Predicate > when sql case return 'else_will_throw_ex' -> function unapply accept: > COALESCE(t_name = 'foo', FALSE) as instance of GeneralScalarExpression and > assertation failed with error > -- This message was sent by Atlassian Jira (v8.20.10#820010) - To unsubscribe, e-mail: issues-unsubscr...@spark.apache.org For additional commands, e-mail: issues-h...@spark.apache.org
[jira] [Updated] (SPARK-40563) Error at where clause, when sql case executes on else branch
[ https://issues.apache.org/jira/browse/SPARK-40563?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Vadim updated SPARK-40563: -- Description: Hello! The Spark SQL phase optimization failed with an internal error. Please, fill a bug report in, and provide the full stack trace. - Spark verison 3.3.0 - Scala version 2.12 - DatasourceV2 - Postgres - Postrgres JDBC Driver: 42+ - Java8 Case: select case when (t_name = 'foo') then 'foo' else 'else_stmt_failed' end as case_when from t where case when (t_name = 'foo') then 'foo' else 'else_will_throw_ex' end = 'else_will_throw_ex' In where clause when we try find rows by else branch, spark thrown exception: The Spark SQL phase optimization failed with an internal error. Please, fill a bug report in, and provide the full stack trace. Caused by: java.lang.AssertionError: assertion failed at scala.Predef$.assert(Predef.scala:208) org.apache.spark.sql.execution.datasources.v2.PushablePredicate.$anonfun$unapply$1(DataSourceV2Strategy.scala:589) At debugger def unapply function in PushablePredicate.class when sql case return 'foo', function unapply accept: (t_name#1 = foo), as instance of Predicate when sql case return 'else_will_throw_ex': function unapply accept: COALESCE(t_name = 'foo', FALSE) as instance of GeneralScalarExpression and assertation failed with error was: Hello! The Spark SQL phase optimization failed with an internal error. Please, fill a bug report in, and provide the full stack trace. - Spark verison 3.3.0 - Scala version 2.12 - DatasourceV2 - Postgres - Postrgres JDBC Driver: 42+ - Java8 Case: select case when (t_name = 'foo') then 'foo' else 'else_stmt_failed' end as case_when from t where case when (t_name = 'foo') then 'foo' else 'else_will_throw_ex' end = 'else_will_throw_ex' In where clause when we try find rows by else branch, spark thrown exception: The Spark SQL phase optimization failed with an internal error. Please, fill a bug report in, and provide the full stack trace. Caused by: java.lang.AssertionError: assertion failed at scala.Predef$.assert(Predef.scala:208) org.apache.spark.sql.execution.datasources.v2.PushablePredicate.$anonfun$unapply$1(DataSourceV2Strategy.scala:589) At debugger def unapply function in PushablePredicate.class when case return 'foo', function unapply accept: (t_name#1 = foo), as instance of Predicate when case return 'else_will_throw_ex': function unapply accept: COALESCE(t_name = 'foo', FALSE) as instance of GeneralScalarExpression and assertation failed with error > Error at where clause, when sql case executes on else branch > > > Key: SPARK-40563 > URL: https://issues.apache.org/jira/browse/SPARK-40563 > Project: Spark > Issue Type: Bug > Components: SQL >Affects Versions: 3.3.0 >Reporter: Vadim >Priority: Major > Fix For: 3.3.0 > > Attachments: java-code-example.txt, stack-trace.txt, test.sql > > > Hello! > The Spark SQL phase optimization failed with an internal error. Please, fill > a bug report in, and provide the full stack trace. > - Spark verison 3.3.0 > - Scala version 2.12 > - DatasourceV2 > - Postgres > - Postrgres JDBC Driver: 42+ > - Java8 > Case: > select > case > when (t_name = 'foo') then 'foo' > else 'else_stmt_failed' > end as case_when > from > t > where > case > when (t_name = 'foo') then 'foo' > else 'else_will_throw_ex' > end = 'else_will_throw_ex' > In where clause when we try find rows by else branch, spark thrown exception: > The Spark SQL phase optimization failed with an internal error. Please, fill > a bug report in, and provide the full stack trace. > Caused by: java.lang.AssertionError: assertion failed > at scala.Predef$.assert(Predef.scala:208) > > org.apache.spark.sql.execution.datasources.v2.PushablePredicate.$anonfun$unapply$1(DataSourceV2Strategy.scala:589) > At debugger def unapply function in PushablePredicate.class > when sql case return 'foo', function unapply accept: (t_name#1 = foo), as > instance of Predicate > when sql case return 'else_will_throw_ex': function unapply accept: > COALESCE(t_name = 'foo', FALSE) as instance of GeneralScalarExpression and > assertation failed with error > -- This message was sent by Atlassian Jira (v8.20.10#820010) - To unsubscribe, e-mail: issues-unsubscr...@spark.apache.org For additional commands, e-mail: issues-h...@spark.apache.org
[jira] [Updated] (SPARK-40563) Error at where clause, when sql case executes on else branch
[ https://issues.apache.org/jira/browse/SPARK-40563?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Vadim updated SPARK-40563: -- Description: Hello! The Spark SQL phase optimization failed with an internal error. Please, fill a bug report in, and provide the full stack trace. - Spark verison 3.3.0 - Scala version 2.12 - DatasourceV2 - Postgres - Postrgres JDBC Driver: 42+ - Java8 Case: select case when (t_name = 'foo') then 'foo' else 'else_stmt_failed' end as case_when from t where case when (t_name = 'foo') then 'foo' else 'else_will_throw_ex' end = 'else_will_throw_ex' In where clause when we try find rows by else branch, spark thrown exception: The Spark SQL phase optimization failed with an internal error. Please, fill a bug report in, and provide the full stack trace. Caused by: java.lang.AssertionError: assertion failed at scala.Predef$.assert(Predef.scala:208) org.apache.spark.sql.execution.datasources.v2.PushablePredicate.$anonfun$unapply$1(DataSourceV2Strategy.scala:589) At debugger def unapply function in PushablePredicate.class when sql case return 'foo' -> function unapply accept: (t_name#1 = foo), as instance of Predicate when sql case return 'else_will_throw_ex' -> function unapply accept: COALESCE(t_name = 'foo', FALSE) as instance of GeneralScalarExpression and assertation failed with error was: Hello! The Spark SQL phase optimization failed with an internal error. Please, fill a bug report in, and provide the full stack trace. - Spark verison 3.3.0 - Scala version 2.12 - DatasourceV2 - Postgres - Postrgres JDBC Driver: 42+ - Java8 Case: select case when (t_name = 'foo') then 'foo' else 'else_stmt_failed' end as case_when from t where case when (t_name = 'foo') then 'foo' else 'else_will_throw_ex' end = 'else_will_throw_ex' In where clause when we try find rows by else branch, spark thrown exception: The Spark SQL phase optimization failed with an internal error. Please, fill a bug report in, and provide the full stack trace. Caused by: java.lang.AssertionError: assertion failed at scala.Predef$.assert(Predef.scala:208) org.apache.spark.sql.execution.datasources.v2.PushablePredicate.$anonfun$unapply$1(DataSourceV2Strategy.scala:589) At debugger def unapply function in PushablePredicate.class when sql case return 'foo', function unapply accept: (t_name#1 = foo), as instance of Predicate when sql case return 'else_will_throw_ex': function unapply accept: COALESCE(t_name = 'foo', FALSE) as instance of GeneralScalarExpression and assertation failed with error > Error at where clause, when sql case executes on else branch > > > Key: SPARK-40563 > URL: https://issues.apache.org/jira/browse/SPARK-40563 > Project: Spark > Issue Type: Bug > Components: SQL >Affects Versions: 3.3.0 >Reporter: Vadim >Priority: Major > Fix For: 3.3.0 > > Attachments: java-code-example.txt, stack-trace.txt, test.sql > > > Hello! > The Spark SQL phase optimization failed with an internal error. Please, fill > a bug report in, and provide the full stack trace. > - Spark verison 3.3.0 > - Scala version 2.12 > - DatasourceV2 > - Postgres > - Postrgres JDBC Driver: 42+ > - Java8 > Case: > select > case > when (t_name = 'foo') then 'foo' > else 'else_stmt_failed' > end as case_when > from > t > where > case > when (t_name = 'foo') then 'foo' > else 'else_will_throw_ex' > end = 'else_will_throw_ex' > In where clause when we try find rows by else branch, spark thrown exception: > The Spark SQL phase optimization failed with an internal error. Please, fill > a bug report in, and provide the full stack trace. > Caused by: java.lang.AssertionError: assertion failed > at scala.Predef$.assert(Predef.scala:208) > > org.apache.spark.sql.execution.datasources.v2.PushablePredicate.$anonfun$unapply$1(DataSourceV2Strategy.scala:589) > At debugger def unapply function in PushablePredicate.class > when sql case return 'foo' -> function unapply accept: (t_name#1 = foo), as > instance of Predicate > when sql case return 'else_will_throw_ex' -> function unapply accept: > COALESCE(t_name = 'foo', FALSE) as instance of GeneralScalarExpression and > assertation failed with error > -- This message was sent by Atlassian Jira (v8.20.10#820010) - To unsubscribe, e-mail: issues-unsubscr...@spark.apache.org For additional commands, e-mail: issues-h...@spark.apache.org
[jira] [Updated] (SPARK-40563) Error at where clause, when sql case executes on else branch
[ https://issues.apache.org/jira/browse/SPARK-40563?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Vadim updated SPARK-40563: -- Description: Hello! The Spark SQL phase optimization failed with an internal error. Please, fill a bug report in, and provide the full stack trace. - Spark verison 3.3.0 - Scala version 2.12 - DatasourceV2 - Postgres - Postrgres JDBC Driver: 42+ - Java8 Case: select case when (t_name = 'foo') then 'foo' else 'else_stmt_failed' end as case_when from t where case when (t_name = 'foo') then 'foo' else 'else_will_throw_ex' end = 'else_will_throw_ex' In where clause when we try find rows by else branch, spark thrown exception: The Spark SQL phase optimization failed with an internal error. Please, fill a bug report in, and provide the full stack trace. Caused by: java.lang.AssertionError: assertion failed at scala.Predef$.assert(Predef.scala:208) org.apache.spark.sql.execution.datasources.v2.PushablePredicate.$anonfun$unapply$1(DataSourceV2Strategy.scala:589) At debugger def unapply function in PushablePredicate.class when case return 'foo', function unapply accept: (t_name#1 = foo), as instance of Predicate when case return 'else_will_throw_ex': function unapply accept: COALESCE(t_name = 'foo', FALSE) as instance of GeneralScalarExpression and assertation failed with error was: Hello! The Spark SQL phase optimization failed with an internal error. Please, fill a bug report in, and provide the full stack trace. - Spark verison 3.3.0 - Scala version 2.12 - DatasourceV2 - Postgres - Postrgres JDBC Driver: 42+ - Java8 Case: select case when (t_name = 'foo') then 'foo' else 'else_stmt_failed' end as case_when from t where case when (t_name = 'foo') then 'foo' else 'else_will_throw_ex' end = 'else_will_throw_ex' In where clause when we try find rows by else branch, spark thrown exception: The Spark SQL phase optimization failed with an internal error. Please, fill a bug report in, and provide the full stack trace. Caused by: java.lang.AssertionError: assertion failed at scala.Predef$.assert(Predef.scala:208) org.apache.spark.sql.execution.datasources.v2.PushablePredicate.$anonfun$unapply$1(DataSourceV2Strategy.scala:589) At debugger def unapply function in PushablePredicate.class when case return 'foo', function unapply accept: (t_name#1 = foo), as instance of Predicate when case return 'else_will_throw_ex': function unapply accept: COALESCE(t_name = 'foo', FALSE) is instance of GeneralScalarExpression and assertation failed with error > Error at where clause, when sql case executes on else branch > > > Key: SPARK-40563 > URL: https://issues.apache.org/jira/browse/SPARK-40563 > Project: Spark > Issue Type: Bug > Components: SQL >Affects Versions: 3.3.0 >Reporter: Vadim >Priority: Major > Fix For: 3.3.0 > > Attachments: java-code-example.txt, stack-trace.txt, test.sql > > > Hello! > The Spark SQL phase optimization failed with an internal error. Please, fill > a bug report in, and provide the full stack trace. > - Spark verison 3.3.0 > - Scala version 2.12 > - DatasourceV2 > - Postgres > - Postrgres JDBC Driver: 42+ > - Java8 > Case: > select > case > when (t_name = 'foo') then 'foo' > else 'else_stmt_failed' > end as case_when > from > t > where > case > when (t_name = 'foo') then 'foo' > else 'else_will_throw_ex' > end = 'else_will_throw_ex' > In where clause when we try find rows by else branch, spark thrown exception: > The Spark SQL phase optimization failed with an internal error. Please, fill > a bug report in, and provide the full stack trace. > Caused by: java.lang.AssertionError: assertion failed > at scala.Predef$.assert(Predef.scala:208) > > org.apache.spark.sql.execution.datasources.v2.PushablePredicate.$anonfun$unapply$1(DataSourceV2Strategy.scala:589) > At debugger def unapply function in PushablePredicate.class > when case return 'foo', function unapply accept: (t_name#1 = foo), as > instance of Predicate > when case return 'else_will_throw_ex': function unapply accept: > COALESCE(t_name = 'foo', FALSE) as instance of GeneralScalarExpression and > assertation failed with error > -- This message was sent by Atlassian Jira (v8.20.10#820010) - To unsubscribe, e-mail: issues-unsubscr...@spark.apache.org For additional commands, e-mail: issues-h...@spark.apache.org
[jira] [Updated] (SPARK-40563) Error at where clause, when sql case executes on else branch
[ https://issues.apache.org/jira/browse/SPARK-40563?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Vadim updated SPARK-40563: -- Description: Hello! The Spark SQL phase optimization failed with an internal error. Please, fill a bug report in, and provide the full stack trace. - Spark verison 3.3.0 - Scala version 2.12 - DatasourceV2 - Postgres - Postrgres JDBC Driver: 42+ - Java8 Case: select case when (t_name = 'foo') then 'foo' else 'else_stmt_failed' end as case_when from t where case when (t_name = 'foo') then 'foo' else 'else_will_throw_ex' end = 'else_will_throw_ex' In where clause when we try find rows by else branch, spark thrown exception: The Spark SQL phase optimization failed with an internal error. Please, fill a bug report in, and provide the full stack trace. Caused by: java.lang.AssertionError: assertion failed at scala.Predef$.assert(Predef.scala:208) org.apache.spark.sql.execution.datasources.v2.PushablePredicate.$anonfun$unapply$1(DataSourceV2Strategy.scala:589) At debugger def unapply function in PushablePredicate.class when case return 'foo', function unapply accept: (t_name#1 = foo), as instance of Predicate when case return 'else_will_throw_ex': function unapply accept: COALESCE(t_name = 'foo', FALSE) is instance of GeneralScalarExpression and assertation failed with error was: Hello! The Spark SQL phase optimization failed with an internal error. Please, fill a bug report in, and provide the full stack trace. - Spark verison 3.3.0 - Scala version 2.12 - DatasourceV2 - Postgres - Postrgres JDBC Driver: 42+ - Java8 Case: select case when (t_name = 'foo') then 'foo' else 'else_stmt_failed' end as case_when from t where case when (t_name = 'foo') then 'foo' else 'else_will_throw_ex' end = 'else_will_throw_ex' In where clause when we try find rows by else branch, spark thrown exception: The Spark SQL phase optimization failed with an internal error. Please, fill a bug report in, and provide the full stack trace. Caused by: java.lang.AssertionError: assertion failed at scala.Predef$.assert(Predef.scala:208) at org.apache.spark.sql.execution.datasources.v2.PushablePredicate.$anonfun$unapply$1(DataSourceV2Strategy.scala:589) At debugger def unapply function in PushablePredicate.class when case return 'foo', function unapply accept: (t_name#1 = foo), as instance of Predicate when case return 'else_will_throw_ex': function unapply accept: COALESCE(t_name = 'foo', FALSE) is instance of GeneralScalarExpression and assertation failed with error > Error at where clause, when sql case executes on else branch > > > Key: SPARK-40563 > URL: https://issues.apache.org/jira/browse/SPARK-40563 > Project: Spark > Issue Type: Bug > Components: SQL >Affects Versions: 3.3.0 >Reporter: Vadim >Priority: Major > Fix For: 3.3.0 > > Attachments: java-code-example.txt, stack-trace.txt, test.sql > > > Hello! > The Spark SQL phase optimization failed with an internal error. Please, fill > a bug report in, and provide the full stack trace. > - Spark verison 3.3.0 > - Scala version 2.12 > - DatasourceV2 > - Postgres > - Postrgres JDBC Driver: 42+ > - Java8 > Case: > select > case > when (t_name = 'foo') then 'foo' > else 'else_stmt_failed' > end as case_when > from > t > where > case > when (t_name = 'foo') then 'foo' > else 'else_will_throw_ex' > end = 'else_will_throw_ex' > In where clause when we try find rows by else branch, spark thrown exception: > The Spark SQL phase optimization failed with an internal error. Please, fill > a bug report in, and provide the full stack trace. > Caused by: java.lang.AssertionError: assertion failed > at scala.Predef$.assert(Predef.scala:208) > > org.apache.spark.sql.execution.datasources.v2.PushablePredicate.$anonfun$unapply$1(DataSourceV2Strategy.scala:589) > At debugger def unapply function in PushablePredicate.class > when case return 'foo', function unapply accept: (t_name#1 = foo), as > instance of Predicate > when case return 'else_will_throw_ex': function unapply accept: > COALESCE(t_name = 'foo', FALSE) is instance of GeneralScalarExpression and > assertation failed with error > -- This message was sent by Atlassian Jira (v8.20.10#820010) - To unsubscribe, e-mail: issues-unsubscr...@spark.apache.org For additional commands, e-mail: issues-h...@spark.apache.org
[jira] [Updated] (SPARK-40563) Error at where clause, when sql case executes on else branch
[ https://issues.apache.org/jira/browse/SPARK-40563?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Vadim updated SPARK-40563: -- Description: Hello! The Spark SQL phase optimization failed with an internal error. Please, fill a bug report in, and provide the full stack trace. - Spark verison 3.3.0 - Scala version 2.12 - DatasourceV2 - Postgres - Postrgres JDBC Driver: 42+ - Java8 Case: select case when (t_name = 'foo') then 'foo' else 'else_stmt_failed' end as case_when from t where case when (t_name = 'foo') then 'foo' else 'else_will_throw_ex' end = 'else_will_throw_ex' In where clause when we try find rows by else branch, spark thrown exception: The Spark SQL phase optimization failed with an internal error. Please, fill a bug report in, and provide the full stack trace. Caused by: java.lang.AssertionError: assertion failed at scala.Predef$.assert(Predef.scala:208) at org.apache.spark.sql.execution.datasources.v2.PushablePredicate.$anonfun$unapply$1(DataSourceV2Strategy.scala:589) At debugger def unapply function in PushablePredicate.class when case return 'foo', function unapply accept: (t_name#1 = foo), as instance of Predicate when case return 'else_will_throw_ex': function unapply accept: COALESCE(t_name = 'foo', FALSE) is instance of GeneralScalarExpression and assertation failed with error > Error at where clause, when sql case executes on else branch > > > Key: SPARK-40563 > URL: https://issues.apache.org/jira/browse/SPARK-40563 > Project: Spark > Issue Type: Bug > Components: SQL >Affects Versions: 3.3.0 >Reporter: Vadim >Priority: Major > Fix For: 3.3.0 > > Attachments: java-code-example.txt, stack-trace.txt, test.sql > > > Hello! > The Spark SQL phase optimization failed with an internal error. Please, fill > a bug report in, and provide the full stack trace. > - Spark verison 3.3.0 > - Scala version 2.12 > - DatasourceV2 > - Postgres > - Postrgres JDBC Driver: 42+ > - Java8 > Case: > select > case > when (t_name = 'foo') then 'foo' > else 'else_stmt_failed' > end as case_when > from > t > where > case > when (t_name = 'foo') then 'foo' > else 'else_will_throw_ex' > end = 'else_will_throw_ex' > In where clause when we try find rows by else branch, spark thrown exception: > The Spark SQL phase optimization failed with an internal error. Please, fill > a bug report in, and provide the full stack trace. > Caused by: java.lang.AssertionError: assertion failed > at scala.Predef$.assert(Predef.scala:208) > at > org.apache.spark.sql.execution.datasources.v2.PushablePredicate.$anonfun$unapply$1(DataSourceV2Strategy.scala:589) > At debugger def unapply function in PushablePredicate.class > when case return 'foo', function unapply accept: (t_name#1 = foo), as > instance of Predicate > when case return 'else_will_throw_ex': function unapply accept: > COALESCE(t_name = 'foo', FALSE) is instance of GeneralScalarExpression and > assertation failed with error > -- This message was sent by Atlassian Jira (v8.20.10#820010) - To unsubscribe, e-mail: issues-unsubscr...@spark.apache.org For additional commands, e-mail: issues-h...@spark.apache.org
[jira] [Updated] (SPARK-40563) Error at where clause, when sql case executes on else branch
[ https://issues.apache.org/jira/browse/SPARK-40563?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Vadim updated SPARK-40563: -- Attachment: stack-trace.txt > Error at where clause, when sql case executes on else branch > > > Key: SPARK-40563 > URL: https://issues.apache.org/jira/browse/SPARK-40563 > Project: Spark > Issue Type: Bug > Components: SQL >Affects Versions: 3.3.0 >Reporter: Vadim >Priority: Major > Fix For: 3.3.0 > > Attachments: java-code-example.txt, stack-trace.txt, test.sql > > -- This message was sent by Atlassian Jira (v8.20.10#820010) - To unsubscribe, e-mail: issues-unsubscr...@spark.apache.org For additional commands, e-mail: issues-h...@spark.apache.org
[jira] [Updated] (SPARK-40563) Error at where clause, when sql case executes on else branch
[ https://issues.apache.org/jira/browse/SPARK-40563?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Vadim updated SPARK-40563: -- Attachment: java-code-example.txt > Error at where clause, when sql case executes on else branch > > > Key: SPARK-40563 > URL: https://issues.apache.org/jira/browse/SPARK-40563 > Project: Spark > Issue Type: Bug > Components: SQL >Affects Versions: 3.3.0 >Reporter: Vadim >Priority: Major > Fix For: 3.3.0 > > Attachments: java-code-example.txt, test.sql > > -- This message was sent by Atlassian Jira (v8.20.10#820010) - To unsubscribe, e-mail: issues-unsubscr...@spark.apache.org For additional commands, e-mail: issues-h...@spark.apache.org
[jira] [Updated] (SPARK-40563) Error at where clause, when sql case executes on else branch
[ https://issues.apache.org/jira/browse/SPARK-40563?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Vadim updated SPARK-40563: -- Attachment: test.sql > Error at where clause, when sql case executes on else branch > > > Key: SPARK-40563 > URL: https://issues.apache.org/jira/browse/SPARK-40563 > Project: Spark > Issue Type: Bug > Components: SQL >Affects Versions: 3.3.0 >Reporter: Vadim >Priority: Major > Fix For: 3.3.0 > > Attachments: test.sql > > -- This message was sent by Atlassian Jira (v8.20.10#820010) - To unsubscribe, e-mail: issues-unsubscr...@spark.apache.org For additional commands, e-mail: issues-h...@spark.apache.org
[jira] [Created] (SPARK-40563) Error at where clause, when sql case executes on else branch
Vadim created SPARK-40563: - Summary: Error at where clause, when sql case executes on else branch Key: SPARK-40563 URL: https://issues.apache.org/jira/browse/SPARK-40563 Project: Spark Issue Type: Bug Components: SQL Affects Versions: 3.3.0 Reporter: Vadim Fix For: 3.3.0 -- This message was sent by Atlassian Jira (v8.20.10#820010) - To unsubscribe, e-mail: issues-unsubscr...@spark.apache.org For additional commands, e-mail: issues-h...@spark.apache.org
[jira] [Created] (SPARK-24830) Problem with logging on Glassfish
vadim created SPARK-24830: - Summary: Problem with logging on Glassfish Key: SPARK-24830 URL: https://issues.apache.org/jira/browse/SPARK-24830 Project: Spark Issue Type: Bug Components: Spark Core Affects Versions: 2.3.0 Environment: Glassfish 4.1.1, 4.1.2, java 1.8.0_151-b12, Windows 10 or Linux-Fedora 20 Reporter: vadim When driver program is running inside J2EE application (in yarn-client mode) all log messages of Glassfish server are not going into Glassfish log after when Spark application is started. In order to see these messages need to setup log4j in application with spark, so that messages would go into file(log4j.rootLogger=INFO, file). That give the possibility to see that is happening, but it's just workaround. Logs for all other applications, deployed on Glassfish are affected, while these applications should be in the isolated environments. Note: the matter is about "usual" log messages before-after driver program got answers, not about these, which could be originated from the code of tasks executed on workers. -- This message was sent by Atlassian JIRA (v7.6.3#76005) - To unsubscribe, e-mail: issues-unsubscr...@spark.apache.org For additional commands, e-mail: issues-h...@spark.apache.org
[jira] [Commented] (SPARK-21024) CSV parse mode handles Univocity parser exceptions
[
https://issues.apache.org/jira/browse/SPARK-21024?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16492331#comment-16492331
]
Vadim commented on SPARK-21024:
---
Any news regarding this issue?
> CSV parse mode handles Univocity parser exceptions
> --
>
> Key: SPARK-21024
> URL: https://issues.apache.org/jira/browse/SPARK-21024
> Project: Spark
> Issue Type: Improvement
> Components: SQL
>Affects Versions: 2.1.1
>Reporter: Takeshi Yamamuro
>Priority: Minor
>
> The current master cannot skip the illegal records that Univocity parsers:
> This comes from the spark-user mailing list:
> https://www.mail-archive.com/user@spark.apache.org/msg63985.html
> {code}
> scala> Seq("0,1", "0,1,2,3").toDF().write.text("/Users/maropu/Desktop/data")
> scala> val df = spark.read.format("csv").schema("a int, b
> int").option("maxColumns", "3").load("/Users/maropu/Desktop/data")
> scala> df.show
> com.univocity.parsers.common.TextParsingException:
> java.lang.ArrayIndexOutOfBoundsException - 3
> Hint: Number of columns processed may have exceeded limit of 3 columns. Use
> settings.setMaxColumns(int) to define the maximum number of columns your
> input can have
> Ensure your configuration is correct, with delimiters, quotes and escape
> sequences that match the input format you are trying to parse
> Parser Configuration: CsvParserSettings:
> Auto configuration enabled=true
> Autodetect column delimiter=false
> Autodetect quotes=false
> Column reordering enabled=true
> Empty value=null
> Escape unquoted values=false
> ...
> at
> com.univocity.parsers.common.AbstractParser.handleException(AbstractParser.java:339)
> at
> com.univocity.parsers.common.AbstractParser.handleEOF(AbstractParser.java:195)
> at
> com.univocity.parsers.common.AbstractParser.parseLine(AbstractParser.java:544)
> at
> org.apache.spark.sql.execution.datasources.csv.UnivocityParser.parse(UnivocityParser.scala:191)
> at
> org.apache.spark.sql.execution.datasources.csv.UnivocityParser$$anonfun$5.apply(UnivocityParser.scala:308)
> at
> org.apache.spark.sql.execution.datasources.csv.UnivocityParser$$anonfun$5.apply(UnivocityParser.scala:308)
> at
> org.apache.spark.sql.execution.datasources.FailureSafeParser.parse(FailureSafeParser.scala:60)
> at
> org.apache.spark.sql.execution.datasources.csv.UnivocityParser$$anonfun$parseIterator$1.apply(UnivocityParser.scala:312)
> at
> org.apache.spark.sql.execution.datasources.csv.UnivocityParser$$anonfun$parseIterator$1.apply(UnivocityParser.scala:312)
> at scala.collection.Iterator$$anon$12.nextCur(Iterator.scala:434)
> at scala.collection.Iterator$$anon$12.hasNext(Iterator.scala:440)
> at scala.collection.Iterator$$anon$11.hasNext(Iterator.scala:408)
> ...
> {code}
> We could easily fix this like:
> https://github.com/apache/spark/compare/master...maropu:HandleExceptionInParser
--
This message was sent by Atlassian JIRA
(v7.6.3#76005)
-
To unsubscribe, e-mail: issues-unsubscr...@spark.apache.org
For additional commands, e-mail: issues-h...@spark.apache.org
[jira] [Commented] (SPARK-4105) FAILED_TO_UNCOMPRESS(5) errors when fetching shuffle data with sort-based shuffle
[
https://issues.apache.org/jira/browse/SPARK-4105?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15535979#comment-15535979
]
Bezruchko Vadim commented on SPARK-4105:
we had gotten the same behavior but the problem was in not enough physical
memory for executors. We reduced executor's memory and the problem was fixed.
> FAILED_TO_UNCOMPRESS(5) errors when fetching shuffle data with sort-based
> shuffle
> -
>
> Key: SPARK-4105
> URL: https://issues.apache.org/jira/browse/SPARK-4105
> Project: Spark
> Issue Type: Bug
> Components: Shuffle, Spark Core
>Affects Versions: 1.2.0, 1.2.1, 1.3.0, 1.4.1, 1.5.1, 1.6.1
>Reporter: Josh Rosen
>Assignee: Josh Rosen
>Priority: Critical
> Attachments: JavaObjectToSerialize.java,
> SparkFailedToUncompressGenerator.scala
>
>
> We have seen non-deterministic {{FAILED_TO_UNCOMPRESS(5)}} errors during
> shuffle read. Here's a sample stacktrace from an executor:
> {code}
> 14/10/23 18:34:11 ERROR Executor: Exception in task 1747.3 in stage 11.0 (TID
> 33053)
> java.io.IOException: FAILED_TO_UNCOMPRESS(5)
> at org.xerial.snappy.SnappyNative.throw_error(SnappyNative.java:78)
> at org.xerial.snappy.SnappyNative.rawUncompress(Native Method)
> at org.xerial.snappy.Snappy.rawUncompress(Snappy.java:391)
> at org.xerial.snappy.Snappy.uncompress(Snappy.java:427)
> at
> org.xerial.snappy.SnappyInputStream.readFully(SnappyInputStream.java:127)
> at
> org.xerial.snappy.SnappyInputStream.readHeader(SnappyInputStream.java:88)
> at org.xerial.snappy.SnappyInputStream.(SnappyInputStream.java:58)
> at
> org.apache.spark.io.SnappyCompressionCodec.compressedInputStream(CompressionCodec.scala:128)
> at
> org.apache.spark.storage.BlockManager.wrapForCompression(BlockManager.scala:1090)
> at
> org.apache.spark.storage.ShuffleBlockFetcherIterator$$anon$1$$anonfun$onBlockFetchSuccess$1.apply(ShuffleBlockFetcherIterator.scala:116)
> at
> org.apache.spark.storage.ShuffleBlockFetcherIterator$$anon$1$$anonfun$onBlockFetchSuccess$1.apply(ShuffleBlockFetcherIterator.scala:115)
> at
> org.apache.spark.storage.ShuffleBlockFetcherIterator.next(ShuffleBlockFetcherIterator.scala:243)
> at
> org.apache.spark.storage.ShuffleBlockFetcherIterator.next(ShuffleBlockFetcherIterator.scala:52)
> at scala.collection.Iterator$$anon$13.hasNext(Iterator.scala:371)
> at
> org.apache.spark.util.CompletionIterator.hasNext(CompletionIterator.scala:30)
> at
> org.apache.spark.InterruptibleIterator.hasNext(InterruptibleIterator.scala:39)
> at scala.collection.Iterator$$anon$11.hasNext(Iterator.scala:327)
> at scala.collection.Iterator$$anon$11.hasNext(Iterator.scala:327)
> at
> org.apache.spark.util.collection.ExternalAppendOnlyMap.insertAll(ExternalAppendOnlyMap.scala:129)
> at
> org.apache.spark.rdd.CoGroupedRDD$$anonfun$compute$5.apply(CoGroupedRDD.scala:159)
> at
> org.apache.spark.rdd.CoGroupedRDD$$anonfun$compute$5.apply(CoGroupedRDD.scala:158)
> at
> scala.collection.TraversableLike$WithFilter$$anonfun$foreach$1.apply(TraversableLike.scala:772)
> at
> scala.collection.mutable.ResizableArray$class.foreach(ResizableArray.scala:59)
> at scala.collection.mutable.ArrayBuffer.foreach(ArrayBuffer.scala:47)
> at
> scala.collection.TraversableLike$WithFilter.foreach(TraversableLike.scala:771)
> at org.apache.spark.rdd.CoGroupedRDD.compute(CoGroupedRDD.scala:158)
> at org.apache.spark.rdd.RDD.computeOrReadCheckpoint(RDD.scala:262)
> at org.apache.spark.rdd.RDD.iterator(RDD.scala:229)
> at
> org.apache.spark.rdd.MappedValuesRDD.compute(MappedValuesRDD.scala:31)
> at org.apache.spark.rdd.RDD.computeOrReadCheckpoint(RDD.scala:262)
> at org.apache.spark.rdd.RDD.iterator(RDD.scala:229)
> at
> org.apache.spark.rdd.FlatMappedValuesRDD.compute(FlatMappedValuesRDD.scala:31)
> at org.apache.spark.rdd.RDD.computeOrReadCheckpoint(RDD.scala:262)
> at org.apache.spark.rdd.RDD.iterator(RDD.scala:229)
> at org.apache.spark.rdd.MappedRDD.compute(MappedRDD.scala:31)
> at org.apache.spark.rdd.RDD.computeOrReadCheckpoint(RDD.scala:262)
> at org.apache.spark.rdd.RDD.iterator(RDD.scala:229)
> at
> org.apache.spark.scheduler.ShuffleMapTask.runTask(ShuffleMapTask.scala:68)
> at
> org.apache.spark.scheduler.ShuffleMapTask.runTask(ShuffleMapTask.scala:41)
> at org.apache.spark.scheduler.Task.run(Task.scala:56)
> at org.apache.spark.executor.Executor$TaskRunner.run(Executor.scala:181)
> at
> java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1145)
> at
>
