[GitHub] [incubator-iceberg] aokolnychyi commented on issue #734: HIVE: On alter table prevent hive from recursively scanning the complete table dir

2020-01-14 Thread GitBox
aokolnychyi commented on issue #734: HIVE: On alter table prevent hive from 
recursively scanning the complete table dir
URL: https://github.com/apache/incubator-iceberg/pull/734#issuecomment-574184804
 
 
   @omalley @rdblue @rdsr, any ideas on how to avoid updating stats in HMS 
1.2.1?


This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
 
For queries about this service, please contact Infrastructure at:
us...@infra.apache.org


With regards,
Apache Git Services

-
To unsubscribe, e-mail: issues-unsubscr...@iceberg.apache.org
For additional commands, e-mail: issues-h...@iceberg.apache.org



[GitHub] [incubator-iceberg] aokolnychyi commented on issue #734: HIVE: On alter table prevent hive from recursively scanning the complete table dir

2020-01-14 Thread GitBox
aokolnychyi commented on issue #734: HIVE: On alter table prevent hive from 
recursively scanning the complete table dir
URL: https://github.com/apache/incubator-iceberg/pull/734#issuecomment-574143282
 
 
   @alexey-fin, I overlooked the second if condition in 
`HiveAlterHandler$alterTable`. Indeed, HMS seems to call `MetaStoreUtils` to 
update props. 
   
   It also looks like you are correct and 
[HIVE-18743](https://jira.apache.org/jira/browse/HIVE-18743) is not fixed in 
1.2.1. Will setting `hive.stats.autogather` to false in hive.xml help in 1.2.1?


This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
 
For queries about this service, please contact Infrastructure at:
us...@infra.apache.org


With regards,
Apache Git Services

-
To unsubscribe, e-mail: issues-unsubscr...@iceberg.apache.org
For additional commands, e-mail: issues-h...@iceberg.apache.org



[GitHub] [incubator-iceberg] aokolnychyi commented on issue #734: HIVE: On alter table prevent hive from recursively scanning the complete table dir

2020-01-13 Thread GitBox
aokolnychyi commented on issue #734: HIVE: On alter table prevent hive from 
recursively scanning the complete table dir
URL: https://github.com/apache/incubator-iceberg/pull/734#issuecomment-574049574
 
 
   @alexey-fin, do you mean [this 
bug](https://jira.apache.org/jira/browse/HIVE-18743)?
   
   @alexey-fin, could you point to code in HMS that triggers a recursive scan 
on alter table? I did a quick look but didn't find such a case if it's an 
external table. I do see such calls in alter partition, for example.
   
   It also seems that we can set `hive.stats.autogather` to false to prevent 
stats collection if HMS is used only by Iceberg.
   
   


This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
 
For queries about this service, please contact Infrastructure at:
us...@infra.apache.org


With regards,
Apache Git Services

-
To unsubscribe, e-mail: issues-unsubscr...@iceberg.apache.org
For additional commands, e-mail: issues-h...@iceberg.apache.org