[
https://issues.apache.org/jira/browse/SPARK-36971?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17427419#comment-17427419
]
Hyukjin Kwon commented on SPARK-36971:
--------------------------------------
is this an issue in Apache Spark? Doesn't look specific to Apache Spark but DBR
or AWS glue's
> Query files directly with SQL is broken (with Glue)
> ---------------------------------------------------
>
> Key: SPARK-36971
> URL: https://issues.apache.org/jira/browse/SPARK-36971
> Project: Spark
> Issue Type: Bug
> Components: SQL
> Affects Versions: 3.1.2
> Environment: Databricks Runtime 9.1 and 10.0 Beta
> Reporter: Lauri Koobas
> Priority: Major
>
> This is broken in DBR 9.1 (and 10.0 Beta):
> {{ select * from json.`filename`}}
> [https://spark.apache.org/docs/latest/sql-ref-syntax-qry-select-file.html]
> I have tried with JSON and Parquet files.
> The error:
> {color:#FF0000}{{Error in SQL statement: SparkException: Unable to fetch
> tables of db json}}{color}
> Down in the stack trace this also exists:
> {{{color:#FF0000}Caused by: NoSuchObjectException(message:Database json not
> found. (Service: AWSGlue; Status Code: 400; Error Code:
> EntityNotFoundException; ... )){color}}}
--
This message was sent by Atlassian Jira
(v8.3.4#803005)
---------------------------------------------------------------------
To unsubscribe, e-mail: [email protected]
For additional commands, e-mail: [email protected]
