[ 
https://issues.apache.org/jira/browse/IMPALA-12584?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17798263#comment-17798263
 ] 

ASF subversion and git services commented on IMPALA-12584:
----------------------------------------------------------

Commit bd0ba644e6b8953028f9061e8f457a4ad33154aa in impala's branch 
refs/heads/master from Peter Rozsa
[ https://gitbox.apache.org/repos/asf?p=impala.git;h=bd0ba644e ]

IMPALA-12584: Add backend config to restrict data file locations for Iceberg 
tables

This change adds backend flag 'iceberg_restrict_data_file_location',
when the flag is set to 'true', Impala will raise an error when at least
one data file of an Iceberg table is outside of the table directory.
The default value of the flag is 'false'.

Tests:
 - custom-cluster test added to validate both states of the flag

Change-Id: I60e3d93b5039dc977417e7b097b3d6ddeda52de4
Reviewed-on: http://gerrit.cloudera.org:8080/20786
Reviewed-by: Impala Public Jenkins <[email protected]>
Tested-by: Impala Public Jenkins <[email protected]>


> Add backend config to restrict data file locations for Iceberg tables
> ---------------------------------------------------------------------
>
>                 Key: IMPALA-12584
>                 URL: https://issues.apache.org/jira/browse/IMPALA-12584
>             Project: IMPALA
>          Issue Type: Bug
>            Reporter: Zoltán Borók-Nagy
>            Assignee: Peter Rozsa
>            Priority: Major
>              Labels: impala-iceberg
>
> Similarly to [https://github.com/apache/hive/pull/4910,] Impala should have a 
> backend flag to restrict the data file locations of Iceberg tables.
> If the flag is true, Impala should raise an error for Iceberg tables that 
> have data files outside of the table directory.
> We should not limit the location of metadata files, so they could be placed 
> to a different storage system (e.g. Amazon S3 Express).
> We must also ensure that users cannot create Iceberg tables at arbitrary 
> locations.



--
This message was sent by Atlassian Jira
(v8.20.10#820010)

---------------------------------------------------------------------
To unsubscribe, e-mail: [email protected]
For additional commands, e-mail: [email protected]

Reply via email to