[ https://issues.apache.org/jira/browse/SPARK-33871?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ]
L. C. Hsieh resolved SPARK-33871. --------------------------------- Resolution: Not A Problem > Cannot access to column after left semi join and left join > ----------------------------------------------------------- > > Key: SPARK-33871 > URL: https://issues.apache.org/jira/browse/SPARK-33871 > Project: Spark > Issue Type: Bug > Components: SQL > Affects Versions: 3.0.0 > Reporter: Evgenii Samusenko > Priority: Minor > > Cannot access to column after left semi join and left join > {code} > val col = "c1" > val df = Seq((1, "a"),(2, "a"),(3, "a"),(4, "a")).toDF(col, "c2") > val df2 = Seq(1).toDF(col) > val semiJoin = df.join(df2, df(col) === df2(col), "left_semi") > val left = df.join(semiJoin, df(col) === semiJoin(col), "left") > left.show > +---+---+----+----+ > | c1| c2| c1| c2| > +---+---+----+----+ > | 1| a| 1| a| > | 2| a|null|null| > | 3| a|null|null| > | 4| a|null|null| > +---+---+----+----+ > left.select(semiJoin(col)) > +---+ > | c1| > +---+ > | 1| > | 2| > | 3| > | 4| > +---+ > left.select(df(col)) > +---+ > | c1| > +---+ > | 1| > | 2| > | 3| > | 4| > +---+ > {code} > > > > -- This message was sent by Atlassian Jira (v8.3.4#803005) --------------------------------------------------------------------- To unsubscribe, e-mail: issues-unsubscr...@spark.apache.org For additional commands, e-mail: issues-h...@spark.apache.org