Vihang Karajgaonkar has posted comments on this change. ( 
http://gerrit.cloudera.org:8080/16308 )

Change subject: IMPALA-4364: Query option to refresh updated partitions
......................................................................


Patch Set 2:

> (1 comment)
 >
 > I think this makes sense at a high level.
 >
 > Are you thinking that we'd want to optimise this further before
 > changing the default?

There is not much we can do here other than fetching only partially filled 
partitions using the API introduced in HIVE-19715. For partitions which are 
found to be updated, we will need to do a full partition fetch. Other than that 
I think we should profile this on a large sized table to identify how much of a 
hit this causes over the regular refresh table command.


--
To view, visit http://gerrit.cloudera.org:8080/16308
To unsubscribe, visit http://gerrit.cloudera.org:8080/settings

Gerrit-Project: Impala-ASF
Gerrit-Branch: master
Gerrit-MessageType: comment
Gerrit-Change-Id: I50e8680509f4eb0712e7bb3de44df5f2952179af
Gerrit-Change-Number: 16308
Gerrit-PatchSet: 2
Gerrit-Owner: Vihang Karajgaonkar <[email protected]>
Gerrit-Reviewer: Impala Public Jenkins <[email protected]>
Gerrit-Reviewer: Quanlong Huang <[email protected]>
Gerrit-Reviewer: Tim Armstrong <[email protected]>
Gerrit-Reviewer: Vihang Karajgaonkar <[email protected]>
Gerrit-Comment-Date: Mon, 10 Aug 2020 21:10:40 +0000
Gerrit-HasComments: No

Reply via email to