[
https://issues.apache.org/jira/browse/SPARK-17296?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15446371#comment-15446371
]
Herman van Hovell commented on SPARK-17296:
-------------------------------------------
I think you have found a bug in the parser. Your query produces the following
(unresolved) LogicalPlan:
{noformat}
'Project [unresolvedalias('COUNT(1), None)]
+- 'Join Inner, ('T4.col = 'T1.col)
:- 'Join Inner
: :- 'UnresolvedRelation `test`, T1
: +- 'Join Inner, ('T3.col = 'T1.col)
: :- 'UnresolvedRelation `test`, T2
: +- 'UnresolvedRelation `test`, T3
+- 'UnresolvedRelation `test`, T4
{noformat}
Notice how the the most nested Inner Join references T2 and T3 using a join
condition on T1 (which is an unknown relation for that join).
> Spark SQL: cross join + two joins = BUG
> ---------------------------------------
>
> Key: SPARK-17296
> URL: https://issues.apache.org/jira/browse/SPARK-17296
> Project: Spark
> Issue Type: Bug
> Affects Versions: 2.0.0
> Reporter: Furcy Pin
>
> In spark shell :
> {code}
> CREATE TABLE test (col INT) ;
> INSERT OVERWRITE TABLE test VALUES (1), (2) ;
> SELECT
> COUNT(1)
> FROM test T1
> CROSS JOIN test T2
> JOIN test T3
> ON T3.col = T1.col
> JOIN test T4
> ON T4.col = T1.col
> ;
> {code}
> returns :
> {code}
> Error in query: cannot resolve '`T1.col`' given input columns: [col, col];
> line 6 pos 12
> {code}
> Apparently, this example is minimal (removing the CROSS or one of the JOIN
> causes no issue).
--
This message was sent by Atlassian JIRA
(v6.3.4#6332)
---------------------------------------------------------------------
To unsubscribe, e-mail: [email protected]
For additional commands, e-mail: [email protected]
