[
https://issues.apache.org/jira/browse/DRILL-5507?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16131363#comment-16131363
]
ASF GitHub Bot commented on DRILL-5507:
---------------------------------------
Github user vrozov commented on a diff in the pull request:
https://github.com/apache/drill/pull/911#discussion_r133838389
--- Diff:
exec/java-exec/src/main/java/org/apache/drill/exec/store/schedule/BlockMapBuilder.java
---
@@ -246,12 +249,16 @@ public EndpointByteMap getEndpointByteMap(FileWork
work) throws IOException {
DrillbitEndpoint endpoint = getDrillBitEndpoint(host);
if (endpoint != null) {
endpointByteMap.add(endpoint, bytes);
- } else {
- logger.info("Failure finding Drillbit running on host {}.
Skipping affinity to that host.", host);
+ } else if (logger.isDebugEnabled()) {
--- End diff --
and `} else if (noDrillbitHosts != null && noDrillbitHosts.add(host)) {
logger.debug(...); }`
> Millions of "Failure finding Drillbit running on host" info messages in
> foreman logs
> ------------------------------------------------------------------------------------
>
> Key: DRILL-5507
> URL: https://issues.apache.org/jira/browse/DRILL-5507
> Project: Apache Drill
> Issue Type: Bug
> Components: Query Planning & Optimization
> Affects Versions: 1.10.0
> Reporter: Veera Naranammalpuram
> Assignee: Timothy Farkas
>
> When foreman tries to execute a query with data files that reside on nodes
> other than the nodes that are running drillbits, there are millions of
> messages in the log files like this:
> 2017-05-10 13:22:10,916 [26eca5b2-a847-b7fe-adff-1685de29bb7a:foreman] INFO
> o.a.d.e.s.schedule.BlockMapBuilder - Failure finding Drillbit running on host
> hostlp0535.mydomain.com. Skipping affinity to that host.
> After 200 MB of these messages, 960K of them and 7 seconds of planning, it
> continues to execute this query. Is there a way to disable / suppress these
> messages? What's causing this? Should this be printed with INFO logging as
> we're seeing or only with DEBUG logging? Is there a way to turn off this
> check? Below is a snippet from foreman logs:
> 2017-05-10 13:22:10,916 [26eca5b2-a847-b7fe-adff-1685de29bb7a:foreman] INFO
> o.a.d.e.s.schedule.BlockMapBuilder - Failure finding Drillbit running on host
> hostlp0535.mydomain.com. Skipping affinity to that host.
> 2017-05-10 13:22:10,923 [26eca5b2-a847-b7fe-adff-1685de29bb7a:foreman] INFO
> o.a.d.e.s.schedule.BlockMapBuilder - Failure finding Drillbit running on host
> hostlp1402.mydomain.com. Skipping affinity to that host.
> 2017-05-10 13:22:10,923 [26eca5b2-a847-b7fe-adff-1685de29bb7a:foreman] INFO
> o.a.d.e.s.schedule.BlockMapBuilder - Failure finding Drillbit running on host
> hostlp0929.mydomain.com. Skipping affinity to that host.
> 2017-05-10 13:22:10,923 [26eca5b2-a847-b7fe-adff-1685de29bb7a:foreman] INFO
> o.a.d.e.s.schedule.BlockMapBuilder - Failure finding Drillbit running on host
> hostlp1098.mydomain.com. Skipping affinity to that host.
> 2017-05-10 13:22:10,923 [26eca5b2-a847-b7fe-adff-1685de29bb7a:foreman] INFO
> o.a.d.e.s.schedule.BlockMapBuilder - Failure finding Drillbit running on host
> hostlp1230.mydomain.com. Skipping affinity to that host.
> 2017-05-10 13:22:10,923 [26eca5b2-a847-b7fe-adff-1685de29bb7a:foreman] INFO
> o.a.d.e.s.schedule.BlockMapBuilder - Failure finding Drillbit running on host
> hostlp1388.mydomain.com. Skipping affinity to that host.
> 2017-05-10 13:22:10,923 [26eca5b2-a847-b7fe-adff-1685de29bb7a:foreman] INFO
> o.a.d.e.s.schedule.BlockMapBuilder - Failure finding Drillbit running on host
> hostlp0535.mydomain.com. Skipping affinity to that host.
> 2017-05-10 13:22:10,923 [26eca5b2-a847-b7fe-adff-1685de29bb7a:foreman] INFO
> o.a.d.e.s.schedule.BlockMapBuilder - Failure finding Drillbit running on host
> hostlp1291.mydomain.com. Skipping affinity to that host.
> The hostname and domain are scrubbed.
--
This message was sent by Atlassian JIRA
(v6.4.14#64029)
