[
https://issues.apache.org/jira/browse/TEZ-3730?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16011630#comment-16011630
]
Siddharth Seth commented on TEZ-3730:
-------------------------------------
[~prasanth_j] - instead of moving to debug altogether, I think it's better to
log this less frequently. Something like every 10/20 buffer changes.
> Lower logging level in UnorderedPartitionedKVWriter
> ---------------------------------------------------
>
> Key: TEZ-3730
> URL: https://issues.apache.org/jira/browse/TEZ-3730
> Project: Apache Tez
> Issue Type: Bug
> Affects Versions: 0.9.0
> Reporter: Prasanth Jayachandran
> Assignee: Prasanth Jayachandran
> Attachments: TEZ-3730.1.patch
>
>
> Observed this in one of recent hive + LLAP query run.
> {code}
> 2017-05-15T17:19:52,852 INFO [TezTR-1509_2280_1_9_4_1
> (1490656001509_2280_1_09_000004_1)] writers.UnorderedPartitionedKVWriter:
> Reducer_17: Moving to next buffer and triggering spill
> 2017-05-15T17:19:53,296 INFO [TezTR-1509_2280_1_9_4_1
> (1490656001509_2280_1_09_000004_1)] writers.UnorderedPartitionedKVWriter:
> Reducer_17: Moving to next buffer and triggering spill
> 2017-05-15T17:19:54,409 INFO [TezTR-1509_2280_1_9_4_1
> (1490656001509_2280_1_09_000004_1)] writers.UnorderedPartitionedKVWriter:
> Reducer_17: Moving to next buffer and triggering spill
> 2017-05-15T17:19:54,945 INFO [TezTR-1509_2280_1_9_4_1
> (1490656001509_2280_1_09_000004_1)] writers.UnorderedPartitionedKVWriter:
> Reducer_17: Moving to next buffer and triggering spill
> 2017-05-15T17:19:55,802 INFO [TezTR-1509_2280_1_9_4_1
> (1490656001509_2280_1_09_000004_1)] writers.UnorderedPartitionedKVWriter:
> Reducer_17: Moving to next buffer and triggering spill
> 2017-05-15T17:19:56,235 INFO [TezTR-1509_2280_1_9_4_1
> (1490656001509_2280_1_09_000004_1)] writers.UnorderedPartitionedKVWriter:
> Reducer_17: Moving to next buffer and triggering spill
> 2017-05-15T17:19:57,056 INFO [TezTR-1509_2280_1_9_4_1
> (1490656001509_2280_1_09_000004_1)] writers.UnorderedPartitionedKVWriter:
> Reducer_17: Moving to next buffer and triggering spill
> 2017-05-15T17:19:57,650 INFO [TezTR-1509_2280_1_9_4_1
> (1490656001509_2280_1_09_000004_1)] writers.UnorderedPartitionedKVWriter:
> Reducer_17: Moving to next buffer and triggering spill
> {code}
> This log line doesn't convey much info. Should lower the level to DEBUG or
> TRACE or remove it altogether.
--
This message was sent by Atlassian JIRA
(v6.3.15#6346)
