Jason Fehr created IMPALA-12768:
-----------------------------------
Summary: Set iceberg.engine.hive.lock-enabled To false By Default
Key: IMPALA-12768
URL: https://issues.apache.org/jira/browse/IMPALA-12768
Project: IMPALA
Issue Type: Improvement
Components: be
Reporter: Jason Fehr
[Iceberg
documentation|https://iceberg.apache.org/docs/latest/configuration/#hadoop-configuration]
says to set the property "iceberg.engine.hive.lock-enabled
{noformat}
Warn: Setting iceberg.engine.hive.lock-enabled=false will cause HiveCatalog to
commit to tables without using Hive locks. This should only be set to false if
all following conditions are met:
* HIVE-26882 is available on the Hive Metastore server
* All other HiveCatalogs committing to tables that this HiveCatalog commits to
are also on Iceberg 1.3 or later
* All other HiveCatalogs committing to tables that this HiveCatalog commits to
have also disabled Hive locks on commit.
Failing to ensure these conditions risks corrupting the table.
{noformat}
Setting this property to false reduces the possibility of stuck table locks
where the lock in HMS does not get released because the Impala process that
took the lock was ungracefully killed before it released the lock.
--
This message was sent by Atlassian Jira
(v8.20.10#820010)
---------------------------------------------------------------------
To unsubscribe, e-mail: [email protected]
For additional commands, e-mail: [email protected]
