[
https://issues.apache.org/jira/browse/TEZ-3730?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Prasanth Jayachandran updated TEZ-3730:
---------------------------------------
Attachment: TEZ-3730.2.patch
If debug logging mode, it logs every time. In non-debug logging, logs every
10th time. Does that work?
> Lower logging level in UnorderedPartitionedKVWriter
> ---------------------------------------------------
>
> Key: TEZ-3730
> URL: https://issues.apache.org/jira/browse/TEZ-3730
> Project: Apache Tez
> Issue Type: Bug
> Affects Versions: 0.9.0
> Reporter: Prasanth Jayachandran
> Assignee: Prasanth Jayachandran
> Attachments: TEZ-3730.1.patch, TEZ-3730.2.patch
>
>
> Observed this in one of recent hive + LLAP query run.
> {code}
> 2017-05-15T17:19:52,852 INFO [TezTR-1509_2280_1_9_4_1
> (1490656001509_2280_1_09_000004_1)] writers.UnorderedPartitionedKVWriter:
> Reducer_17: Moving to next buffer and triggering spill
> 2017-05-15T17:19:53,296 INFO [TezTR-1509_2280_1_9_4_1
> (1490656001509_2280_1_09_000004_1)] writers.UnorderedPartitionedKVWriter:
> Reducer_17: Moving to next buffer and triggering spill
> 2017-05-15T17:19:54,409 INFO [TezTR-1509_2280_1_9_4_1
> (1490656001509_2280_1_09_000004_1)] writers.UnorderedPartitionedKVWriter:
> Reducer_17: Moving to next buffer and triggering spill
> 2017-05-15T17:19:54,945 INFO [TezTR-1509_2280_1_9_4_1
> (1490656001509_2280_1_09_000004_1)] writers.UnorderedPartitionedKVWriter:
> Reducer_17: Moving to next buffer and triggering spill
> 2017-05-15T17:19:55,802 INFO [TezTR-1509_2280_1_9_4_1
> (1490656001509_2280_1_09_000004_1)] writers.UnorderedPartitionedKVWriter:
> Reducer_17: Moving to next buffer and triggering spill
> 2017-05-15T17:19:56,235 INFO [TezTR-1509_2280_1_9_4_1
> (1490656001509_2280_1_09_000004_1)] writers.UnorderedPartitionedKVWriter:
> Reducer_17: Moving to next buffer and triggering spill
> 2017-05-15T17:19:57,056 INFO [TezTR-1509_2280_1_9_4_1
> (1490656001509_2280_1_09_000004_1)] writers.UnorderedPartitionedKVWriter:
> Reducer_17: Moving to next buffer and triggering spill
> 2017-05-15T17:19:57,650 INFO [TezTR-1509_2280_1_9_4_1
> (1490656001509_2280_1_09_000004_1)] writers.UnorderedPartitionedKVWriter:
> Reducer_17: Moving to next buffer and triggering spill
> {code}
> This log line doesn't convey much info. Should lower the level to DEBUG or
> TRACE or remove it altogether.
--
This message was sent by Atlassian JIRA
(v6.3.15#6346)
