[
https://issues.apache.org/jira/browse/IMPALA-9711?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Tim Armstrong updated IMPALA-9711:
----------------------------------
Description:
The parent showed that updating the averaged profile can take a bit of time and
executes on the RPC handler of the fetch RPC. We should consider how to
optimise this.
I think the most impactful change, from the point of view of query latency, is
to apply the profile updates when each instance finishes instead of doing the
computation on the RPC handler.
For IMPALA-9382, we also need the averaged profile to be kept up-to-date when
the profile is accessed, because it will be the only part of the profile that
is exposed to clients.
was:The parent showed that updating the averaged profile can take a bit of
time and executes on the RPC handler of the fetch RPC. We should consider how
to optimise this.
> Incrementally compute averaged profile
> --------------------------------------
>
> Key: IMPALA-9711
> URL: https://issues.apache.org/jira/browse/IMPALA-9711
> Project: IMPALA
> Issue Type: Sub-task
> Reporter: Tim Armstrong
> Priority: Major
>
> The parent showed that updating the averaged profile can take a bit of time
> and executes on the RPC handler of the fetch RPC. We should consider how to
> optimise this.
> I think the most impactful change, from the point of view of query latency,
> is to apply the profile updates when each instance finishes instead of doing
> the computation on the RPC handler.
> For IMPALA-9382, we also need the averaged profile to be kept up-to-date when
> the profile is accessed, because it will be the only part of the profile that
> is exposed to clients.
--
This message was sent by Atlassian Jira
(v8.3.4#803005)
---------------------------------------------------------------------
To unsubscribe, e-mail: [email protected]
For additional commands, e-mail: [email protected]
