[ 
https://issues.apache.org/jira/browse/HIVE-24895?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17303842#comment-17303842
 ] 

Ayush Saxena commented on HIVE-24895:
-------------------------------------

Hey [~anishek]

Have used the existing {{ReplStateLogTask}} for logging this, Have added a 
{{DirCopyEnd}} stage in that. I will update the title to reflect that. 
Regarding why we are using tasks rather than simple {{Log.}} is the external 
copy tasks are submitted and then we proceed with processing other stuff rather 
than holding for them to complete while performing \{{LOAD}}, so using this 
{{ReplStateLogTask}} which can execute  post all {{DirCopyTask}} have been 
executed.

> Add a DataCopyEnd task for external table replication
> -----------------------------------------------------
>
>                 Key: HIVE-24895
>                 URL: https://issues.apache.org/jira/browse/HIVE-24895
>             Project: Hive
>          Issue Type: Improvement
>            Reporter: Ayush Saxena
>            Assignee: Ayush Saxena
>            Priority: Major
>              Labels: pull-request-available
>          Time Spent: 10m
>  Remaining Estimate: 0h
>
> Add a task to mark the end of external table copy.



--
This message was sent by Atlassian Jira
(v8.3.4#803005)

Reply via email to