Arvind Krishnan created SPARK-32535: ---------------------------------------
Summary: Query with broadcast hints fail when query has a WITH clause Key: SPARK-32535 URL: https://issues.apache.org/jira/browse/SPARK-32535 Project: Spark Issue Type: Bug Components: Spark Core Affects Versions: 3.0.0 Reporter: Arvind Krishnan If a query has a WITH clause and a query hint (like `BROADCAST`), the query fails In the below code sample, executing `sql2` fails, but `sql1` passes. {code:java} import spark.implicits._ val df = List( ("1", "B", "C"), ("A", "2", "C"), ("A", "B", "3") ).toDF("COL_A", "COL_B", "COL_C") df.createOrReplaceTempView("table1") val df1 = List( ("A", "2", "3"), ("1", "B", "3"), ("1", "2", "C") ).toDF("COL_A", "COL_B", "COL_C") df1.createOrReplaceTempView("table2") val sql1 = "select /*+ BROADCAST(a) */ a.COL_A from table1 a inner join table2 b on a.COL_A = b.COL_A" val sql2 = "with X as (select /*+ BROADCAST(a) */ a.COL_A from table1 a inner join table2 b on a.COL_A = b.COL_A) select X.COL_A from X" val df2 = spark.sql(sql2) println(s"Row Count ${df2.count()}") println("Rows... ") df2.show(false) {code} I tried executing this sample program with spark2.4.0, and both sql statements work -- This message was sent by Atlassian Jira (v8.3.4#803005) --------------------------------------------------------------------- To unsubscribe, e-mail: issues-unsubscr...@spark.apache.org For additional commands, e-mail: issues-h...@spark.apache.org