This is an automated email from the ASF dual-hosted git repository.
bridgetb pushed a commit to branch gh-pages
in repository https://gitbox.apache.org/repos/asf/drill.git
The following commit(s) were added to refs/heads/gh-pages by this push:
new cb54bde edit
cb54bde is described below
commit cb54bde55450ea5abd3602420e3389280f115ffb
Author: Bridget Bevens <[email protected]>
AuthorDate: Fri Apr 19 11:58:20 2019 -0700
edit
---
.../020-query-profiles.md | 63 ++++++++++++++++++----
1 file changed, 54 insertions(+), 9 deletions(-)
diff --git
a/_docs/performance-tuning/identifying-performance-issues/020-query-profiles.md
b/_docs/performance-tuning/identifying-performance-issues/020-query-profiles.md
index 67db9e3..24cabc1 100644
---
a/_docs/performance-tuning/identifying-performance-issues/020-query-profiles.md
+++
b/_docs/performance-tuning/identifying-performance-issues/020-query-profiles.md
@@ -53,16 +53,61 @@ Starting in Drill 1.16, the Drill Web UI displays warning
messages in the query
In addition to the warnings, the Operator Profiles section of the query
profile also displays an icon in the column to indicate which operator is
askew.
The following table lists the warnings, icons, configurable options related to
the warnings, and option descriptions:
+
-| Warning Message
| Icon
| Related Option(s)
|
Description [...]
-|------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------|-----------------------------------------------------------------------------------------------------------------------------------------|-----------------------------------------------------------------------------------------|----------------------------------------------------------------------------
[...]
-| !WARNING: No fragments have made any progress in the last 300 seconds. (See
Last Progress below.)
| None
| drill.exec.http.profile.warning.progress.threshold
| If none of the fragments make any progress within the set
time, a warning [...]
-| !WARNING: Some operators have data spilled to disk. This will result in
performance loss. (See Avg Peak memory and Max Peak Memory below)
|  Look for
the icon in the Avg Peak Memory and Max Peak Memory columns to find the
operators that spilled data to disk. | See [Sort-Based and
Hash-Based Memory Constrained
Operators](https://drill.apache.org/docs/sort-based-and-hash-based-memory-constrai
[...]
-| !WARNING: Some of the operators spent more time waiting for data than
processing it. (See AVG WAIT TIME as compared to Average Process Time for the
operators below.) |  Look
for the icon in the Max Process Time or Max Wait Time columns to locate the
operators that waited or processed too long. |
drill.exec.http.profile.warning.time.skew.min
| Sets the minimum threshold for operators wi [...]
-| See warning for drill.exec.http.profile.warning.time.skew.min
|
| drill.exec.http.profile.warning.time.skew.ratio.process
| Defines the threshold ratio for processing. When the
maxProcessing: [...]
-| See warning for drill.exec.http.profile.warning.time.skew.min
|
| drill.exec.http.profile.warning.time.skew.ratio.wait
| Defines the threshold ratio for waiting. When the
maxWait:avgWait r [...]
-| !WARNING: Some of the SCAN operators spent more time waiting for data than
processing it. (See AVG WAIT TIME as compared to Average Process Time for the
scan operators below.) |  Look for the
icon in the Avg Wait Time or Avg Process Time columns to locate the scan
operators that waited too long. |
drill.exec.http.profile.warning.scan.wait.min
| Sets a minimum threshold ratio for the scan [...]
-
+<style type="text/css">
+.tg {border-collapse:collapse;border-spacing:0;}
+.tg td{font-family:Arial, sans-serif;font-size:12px;padding:10px
5px;border-style:solid;border-width:1px;overflow:hidden;word-break:normal;border-color:black;}
+.tg th{font-family:Arial,
sans-serif;font-size:14px;font-weight:normal;padding:10px
5px;border-style:solid;border-width:1px;overflow:hidden;word-break:normal;border-color:black;}
+.tg
.tg-13we{font-weight:bold;background-color:#c0c0c0;border-color:inherit;text-align:left}
+.tg
.tg-6e8n{font-weight:bold;background-color:#c0c0c0;border-color:inherit;text-align:left;vertical-align:top}
+.tg .tg-xldj{border-color:inherit;text-align:left}
+.tg .tg-0pky{border-color:inherit;text-align:left;vertical-align:top}
+</style>
+<table class="tg">
+ <tr>
+ <th class="tg-13we">Warning Message</th>
+ <th class="tg-13we">Icon</th>
+ <th class="tg-13we">Related Option(s)</th>
+ <th class="tg-6e8n">Description</th>
+ </tr>
+ <tr>
+ <td class="tg-xldj">!WARNING: No fragments have made any progress in the
last 300 seconds. (See Last Progress below.)</td>
+ <td class="tg-xldj">None</td>
+ <td class="tg-xldj">drill.exec.http.profile.warning.progress.threshold</td>
+ <td class="tg-0pky">If none of the fragments make any progress within the
set time, a warning displays. Time is set in seconds. Default is 300 seconds (5
minutes). You can see fragment activity in the Fragment Profiles section of the
query profile. </td>
+ </tr>
+ <tr>
+ <td class="tg-xldj">!WARNING: Some operators have data spilled to disk.
This will result in performance loss. (See Avg Peak memory and Max Peak Memory
below)</td>
+ <td class="tg-xldj"> Look for the icon in the Avg Peak Memory and Max Peak
Memory columns to find the operators that spilled data to disk. </td>
+ <td class="tg-xldj"> See Sort-Based and Hash-Based Memory Constrained
operators for related options.</td>
+ <td class="tg-0pky">Hovering the mouse over the icon reveals the average
number of spills. The higher the value, the greater the degradation.</td>
+ </tr>
+ <tr>
+ <td class="tg-xldj">!WARNING: Some of the operators spent more time
waiting for data than processing it. (See AVG WAIT TIME as compared to Average
Process Time for the operators below.</td>
+ <td class="tg-xldj"> Look for the icon in the Max Process Time or Max Wait
Time columns to locate the operators that waited or processed too long.</td>
+ <td class="tg-xldj"> drill.exec.http.profile.warning.time.skew.min</td>
+ <td class="tg-0pky">Sets the minimum threshold for operators with the
longest processing or waiting fragment. When the slowest fragment hits this
threshold and runs or waits at least 2X (default setting) longer than the
average fragment, the Drill Web UI displays a warning message. Default is 2.
<br> The drill.exec.http.profile.warning.time.skew.ratio.process option sets
the threshold ratio for processing. The
drill.exec.http.profile.warning.time.skew.ratio.wait option sets the thres [...]
+ </tr>
+ <tr>
+ <td class="tg-xldj">See warning for
drill.exec.http.profile.warning.time.skew.min</td>
+ <td class="tg-xldj"> </td>
+ <td class="tg-xldj">
drill.exec.http.profile.warning.time.skew.ratio.process<br> </td>
+ <td class="tg-0pky"> Defines the threshold ratio for processing. When the
maxProcessing:avgProcessing ratio exceeds the defined threshold, the Drill Web
UI displays a skew warning. Default is 2.</td>
+ </tr>
+ <tr>
+ <td class="tg-xldj">See warning for
drill.exec.http.profile.warning.time.skew.min</td>
+ <td class="tg-xldj"> </td>
+ <td
class="tg-xldj"><br> <br> drill.exec.http.profile.warning.time.skew.ratio.wait<br> </td>
+ <td class="tg-0pky"> Defines the threshold ratio for waiting. When the
maxWait:avgWait ratio exceeds the defined threshold, the Drill Web UI displays
a skew warning. Default is 2. </td>
+ </tr>
+ <tr>
+ <td class="tg-xldj"> !WARNING: Some of the SCAN operators spent more time
waiting for data than processing it. (See AVG WAIT TIME as compared to Average
Process Time for the scan operators below.</td>
+ <td class="tg-xldj"> Look for the icon in the Avg Wait Time or Avg Process
Time columns to locate the scan operators that waited too long.</td>
+ <td class="tg-xldj"> drill.exec.http.profile.warning.scan.wait.min</td>
+ <td class="tg-0pky"> Sets a minimum threshold ratio for the scan operator
to wait. When the average wait time exceeds the processing time the Drill Web
UI displays the warning. Default is 60 seconds. </td>
+ </tr>
+</table>
### Configuring Warning Threshold Options
You can configure thresholds for the warnings through configuration options in
the drill-override.conf file, as shown:
