[
https://issues.apache.org/jira/browse/SPARK-56695?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Andreas Chatzistergiou updated SPARK-56695:
-------------------------------------------
Description: Currently, path based tables in DSv2 are correctly resolved if
they are the target of a transactional write. This needs to be fixed so path
based tables participating either in reads or writes are correctly resolved.
(was: There is currently an issue where for path based tables we would non
resolve correctly path based tables that were scanned within a transaction.
Furthermore, we need to add a validation to only allow a single catalog being
used in transactional writes. Mixing path based tables and catalog based in a
single write operation is fine as long as all tables resolve to the same
catalog.)
> Resolve Path Based Tables Read in Transactional Writes
> ------------------------------------------------------
>
> Key: SPARK-56695
> URL: https://issues.apache.org/jira/browse/SPARK-56695
> Project: Spark
> Issue Type: Bug
> Components: SQL
> Affects Versions: 4.2.0
> Reporter: Andreas Chatzistergiou
> Priority: Major
> Labels: pull-request-available
>
> Currently, path based tables in DSv2 are correctly resolved if they are the
> target of a transactional write. This needs to be fixed so path based tables
> participating either in reads or writes are correctly resolved.
--
This message was sent by Atlassian Jira
(v8.20.10#820010)
---------------------------------------------------------------------
To unsubscribe, e-mail: [email protected]
For additional commands, e-mail: [email protected]