[
https://issues.apache.org/jira/browse/SPARK-56695?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Andreas Chatzistergiou updated SPARK-56695:
-------------------------------------------
Description: There is currently an issue where for path based tables we
would non resolve correctly path based tables that were scanned within a
transaction. Furthermore, we need to add a validation to only allow a single
catalog being used in transactional writes. Mixing path based tables and
catalog based in a single write operation is fine as long as all tables resolve
to the same catalog. (was: There is currently an issue where for path based
tables we would ignore the data source configured catalog when resolving
relations. Furthermore, we need to add a validation to only allow a single
catalog being used in transactional writes. Mixing path based tables and
catalog based in a single write operation is fine as long as all tables resolve
to the same catalog.)
> Resolve Path Based Tables Read in Transactional Writes
> ------------------------------------------------------
>
> Key: SPARK-56695
> URL: https://issues.apache.org/jira/browse/SPARK-56695
> Project: Spark
> Issue Type: Bug
> Components: SQL
> Affects Versions: 4.2.0
> Reporter: Andreas Chatzistergiou
> Priority: Major
>
> There is currently an issue where for path based tables we would non resolve
> correctly path based tables that were scanned within a transaction.
> Furthermore, we need to add a validation to only allow a single catalog being
> used in transactional writes. Mixing path based tables and catalog based in a
> single write operation is fine as long as all tables resolve to the same
> catalog.
--
This message was sent by Atlassian Jira
(v8.20.10#820010)
---------------------------------------------------------------------
To unsubscribe, e-mail: [email protected]
For additional commands, e-mail: [email protected]