[GitHub] [incubator-iceberg] aokolnychyi commented on issue #734: HIVE: On alter table prevent hive from recursively scanning the complete table dir
aokolnychyi commented on issue #734: HIVE: On alter table prevent hive from recursively scanning the complete table dir URL: https://github.com/apache/incubator-iceberg/pull/734#issuecomment-574184804 @omalley @rdblue @rdsr, any ideas on how to avoid updating stats in HMS 1.2.1? This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. For queries about this service, please contact Infrastructure at: us...@infra.apache.org With regards, Apache Git Services - To unsubscribe, e-mail: issues-unsubscr...@iceberg.apache.org For additional commands, e-mail: issues-h...@iceberg.apache.org
[GitHub] [incubator-iceberg] aokolnychyi commented on issue #734: HIVE: On alter table prevent hive from recursively scanning the complete table dir
aokolnychyi commented on issue #734: HIVE: On alter table prevent hive from recursively scanning the complete table dir URL: https://github.com/apache/incubator-iceberg/pull/734#issuecomment-574143282 @alexey-fin, I overlooked the second if condition in `HiveAlterHandler$alterTable`. Indeed, HMS seems to call `MetaStoreUtils` to update props. It also looks like you are correct and [HIVE-18743](https://jira.apache.org/jira/browse/HIVE-18743) is not fixed in 1.2.1. Will setting `hive.stats.autogather` to false in hive.xml help in 1.2.1? This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. For queries about this service, please contact Infrastructure at: us...@infra.apache.org With regards, Apache Git Services - To unsubscribe, e-mail: issues-unsubscr...@iceberg.apache.org For additional commands, e-mail: issues-h...@iceberg.apache.org
[GitHub] [incubator-iceberg] aokolnychyi commented on issue #734: HIVE: On alter table prevent hive from recursively scanning the complete table dir
aokolnychyi commented on issue #734: HIVE: On alter table prevent hive from recursively scanning the complete table dir URL: https://github.com/apache/incubator-iceberg/pull/734#issuecomment-574049574 @alexey-fin, do you mean [this bug](https://jira.apache.org/jira/browse/HIVE-18743)? @alexey-fin, could you point to code in HMS that triggers a recursive scan on alter table? I did a quick look but didn't find such a case if it's an external table. I do see such calls in alter partition, for example. It also seems that we can set `hive.stats.autogather` to false to prevent stats collection if HMS is used only by Iceberg. This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. For queries about this service, please contact Infrastructure at: us...@infra.apache.org With regards, Apache Git Services - To unsubscribe, e-mail: issues-unsubscr...@iceberg.apache.org For additional commands, e-mail: issues-h...@iceberg.apache.org
