[ https://issues.apache.org/jira/browse/SPARK-42450?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ]
Vadim updated SPARK-42450: -------------------------- Description: dataset.where()/filter() omit string quotes if where IN clause has more than 10 operands. With datasourceV1 works as expected. Attached files: java-code.txt, stacktrace.txt, sql.txt - Spark verison 3.3.0 - Scala version 2.12 - DatasourceV2 - Postgres - Postrgres JDBC Driver: 42+ - Java8 was: dataset.where()/filter() omit string quotes if where IN clause has more than 10 operands. With datasourceV1 works as expected. Attached files: java-code.txt, stacktrace.txt - Spark verison 3.3.0 - Scala version 2.12 - DatasourceV2 - Postgres - Postrgres JDBC Driver: 42+ - Java8 *Expected query:* SELECT "flight_id", "flight_no" FROM "bookings"."flights" WHERE ( "flight_no"IN ( '55', '826', '845', '799', '561', '39', '385', '549', '576', '15', '857', '248', '324', '569', '267' ) ) *actual query:* SELECT "flight_id", "flight_no", FROM "bookings"."flights" WHERE ( "flight_no"IN ( 55, 826, 845, 799, 561, 39, 385, 549, 576, 15, 857, 248, 324, 569, 267 ) ) > dataset.where() omit quotes if where IN clause has more than 10 operands > ------------------------------------------------------------------------ > > Key: SPARK-42450 > URL: https://issues.apache.org/jira/browse/SPARK-42450 > Project: Spark > Issue Type: Bug > Components: SQL > Affects Versions: 3.3.0 > Reporter: Vadim > Priority: Major > Fix For: 3.3.2, 3.4.0 > > Attachments: java-code.txt, sql.txt, stacktrace.txt > > > dataset.where()/filter() omit string quotes if where IN clause has more than > 10 operands. With datasourceV1 works as expected. > Attached files: java-code.txt, stacktrace.txt, sql.txt > - Spark verison 3.3.0 > - Scala version 2.12 > - DatasourceV2 > - Postgres > - Postrgres JDBC Driver: 42+ > - Java8 -- This message was sent by Atlassian Jira (v8.20.10#820010) --------------------------------------------------------------------- To unsubscribe, e-mail: issues-unsubscr...@spark.apache.org For additional commands, e-mail: issues-h...@spark.apache.org