[
https://issues.apache.org/jira/browse/IMPALA-10180?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17723968#comment-17723968
]
ASF subversion and git services commented on IMPALA-10180:
----------------------------------------------------------
Commit 21f5a7a6e5c7572c6eebe6a5630a93f6f73a4404 in impala's branch
refs/heads/master from Joe McDonnell
[ https://gitbox.apache.org/repos/asf?p=impala.git;h=21f5a7a6e ]
IMPALA-10180: Add summary stats for client fetch wait time
This adds ClientFetchWaitTimeStats to the runtime profile
to track the min/max/# of samples for ClientFetchWaitTimer.
Here is some sample output:
- ClientFetchWaitTimeStats: (Avg: 161.554ms ; Min: 101.411ms ; Max: 461.728ms ;
Number of samples: 6)
- ClientFetchWaitTimer: 969.326ms
This also fixes the definition of ClientFetchWaitTimer to avoid
including time after end of fetch. When the client is closing
the query, Finalize() gets called. The Finalize() call should
only add extra client wait time if fetch has not completed.
Testing:
- Added test cases in query_test/test_fetch.py with specific
numbers of fetches and verification of the statistics.
- The test cases make use of a new function for parsing
summary stats for timers, and this also gets its own test
case.
Change-Id: I9ca525285e03c7b51b04ac292f7b3531e6178218
Reviewed-on: http://gerrit.cloudera.org:8080/19897
Tested-by: Impala Public Jenkins <[email protected]>
Reviewed-by: Csaba Ringhofer <[email protected]>
> Add average size of fetch requests in runtime profile
> -----------------------------------------------------
>
> Key: IMPALA-10180
> URL: https://issues.apache.org/jira/browse/IMPALA-10180
> Project: IMPALA
> Issue Type: Improvement
> Components: Clients
> Reporter: Sahil Takiar
> Assignee: Joe McDonnell
> Priority: Major
>
> When queries with a high {{ClientFetchWaitTimer}} it would be useful to know
> the average number of rows requested by the client per fetch request. This
> can help determine if setting a higher fetch size would help improve fetch
> performance where the network RTT between the client and Impala is high.
--
This message was sent by Atlassian Jira
(v8.20.10#820010)
---------------------------------------------------------------------
To unsubscribe, e-mail: [email protected]
For additional commands, e-mail: [email protected]
