[ 
https://issues.apache.org/jira/browse/HIVE-26382?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
 ]

mahesh kumar behera resolved HIVE-26382.
----------------------------------------
    Resolution: Fixed

> Stats generation fails during CTAS for external partitioned table.
> ------------------------------------------------------------------
>
>                 Key: HIVE-26382
>                 URL: https://issues.apache.org/jira/browse/HIVE-26382
>             Project: Hive
>          Issue Type: Bug
>          Components: Hive, HiveServer2
>    Affects Versions: 4.0.0-alpha-1
>            Reporter: mahesh kumar behera
>            Assignee: mahesh kumar behera
>            Priority: Major
>              Labels: pull-request-available
>          Time Spent: 20m
>  Remaining Estimate: 0h
>
> As part of HIVE-25990 manifest file was generated to list out the files to be 
> moved. The files are moved in move task by referring to the manifest file. 
> For partitioned table flow, the move is not done. This prevents the dynamic 
> partition creation as the target path will be empty. As stats task needs the 
> partition information, this causes the stat task to fail.
>  
> {code:java}
> class="metastore.RetryingHMSHandler" level="ERROR" 
> thread="pool-10-thread-144"] MetaException(message:Unable to update Column 
> stats for  ext_par due to: The IN list is empty!)
>  
> org.apache.hadoop.hive.metastore.DirectSqlUpdateStat.updatePartitionColumnStatistics(DirectSqlUpdateStat.java:634)
>  
> org.apache.hadoop.hive.metastore.MetaStoreDirectSql.updatePartitionColumnStatisticsBatch(MetaStoreDirectSql.java:2803)
>  
> org.apache.hadoop.hive.metastore.ObjectStore.updatePartitionColumnStatisticsInBatch(ObjectStore.java:10001)
> sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method) 
> sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:62)
>  
> sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43
>  java.lang.reflect.Method.invoke(Method.java:498)
>  org.apache.hadoop.hive.metastore.RawStoreProxy.invoke(RawStoreProxy.java:97)
> com.sun.proxy.$Proxy33.updatePartitionColumnStatisticsInBatch(Unknown Source)
>  
> org.apache.hadoop.hive.metastore.HiveMetaStore$HMSHandler.updatePartitionColStatsForOneBatch(HiveMetaStore.java:7124)
>  
> org.apache.hadoop.hive.metastore.HiveMetaStore$HMSHandler.updatePartitionColStatsInBatch(HiveMetaStore.java:7109)
>  {code}



--
This message was sent by Atlassian Jira
(v8.20.10#820010)

Reply via email to