[
https://issues.apache.org/jira/browse/SPARK-44233?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Takuya Ueshin updated SPARK-44233:
----------------------------------
Description:
{code:python}
>>> sql("select * from range(8) t, lateral (select * from t) s")
Traceback (most recent call last):
...
pyspark.errors.exceptions.captured.AnalysisException: [TABLE_OR_VIEW_NOT_FOUND]
The table or view `t` cannot be found. Verify the spelling and correctness of
the schema and catalog.
If you did not qualify the name with a schema, verify the current_schema()
output, or qualify the name with the correct schema and catalog.
To tolerate the error on drop use DROP VIEW IF EXISTS or DROP TABLE IF EXISTS.;
line 1 pos 49;
'Project [*]
+- 'LateralJoin lateral-subquery#0 [], Inner
: +- 'SubqueryAlias s
: +- 'Project [*]
: +- 'UnresolvedRelation [t], [], false
+- SubqueryAlias t
+- Range (0, 8, step=1, splits=None){code}
The subquery {{(select * from t)}} seems not looking the outer outer context
and fails to resolve {{t}}.
was:
{code:java}
>>> sql("select * from range(8) t, lateral (select * from t) s")
Traceback (most recent call last):
...
pyspark.errors.exceptions.captured.AnalysisException: [TABLE_OR_VIEW_NOT_FOUND]
The table or view `t` cannot be found. Verify the spelling and correctness of
the schema and catalog.
If you did not qualify the name with a schema, verify the current_schema()
output, or qualify the name with the correct schema and catalog.
To tolerate the error on drop use DROP VIEW IF EXISTS or DROP TABLE IF EXISTS.;
line 1 pos 49;
'Project [*]
+- 'LateralJoin lateral-subquery#0 [], Inner
: +- 'SubqueryAlias s
: +- 'Project [*]
: +- 'UnresolvedRelation [t], [], false
+- SubqueryAlias t
+- Range (0, 8, step=1, splits=None){code}
The subquery (select * from t) seems not looking the outer outer context and
fails to resolve t.
> Support an outer outer context in subquery resolution
> -----------------------------------------------------
>
> Key: SPARK-44233
> URL: https://issues.apache.org/jira/browse/SPARK-44233
> Project: Spark
> Issue Type: Improvement
> Components: SQL
> Affects Versions: 3.5.0
> Reporter: Takuya Ueshin
> Priority: Major
>
> {code:python}
> >>> sql("select * from range(8) t, lateral (select * from t) s")
> Traceback (most recent call last):
> ...
> pyspark.errors.exceptions.captured.AnalysisException:
> [TABLE_OR_VIEW_NOT_FOUND] The table or view `t` cannot be found. Verify the
> spelling and correctness of the schema and catalog.
> If you did not qualify the name with a schema, verify the current_schema()
> output, or qualify the name with the correct schema and catalog.
> To tolerate the error on drop use DROP VIEW IF EXISTS or DROP TABLE IF
> EXISTS.; line 1 pos 49;
> 'Project [*]
> +- 'LateralJoin lateral-subquery#0 [], Inner
> : +- 'SubqueryAlias s
> : +- 'Project [*]
> : +- 'UnresolvedRelation [t], [], false
> +- SubqueryAlias t
> +- Range (0, 8, step=1, splits=None){code}
> The subquery {{(select * from t)}} seems not looking the outer outer context
> and fails to resolve {{t}}.
--
This message was sent by Atlassian Jira
(v8.20.10#820010)
---------------------------------------------------------------------
To unsubscribe, e-mail: [email protected]
For additional commands, e-mail: [email protected]
