[
https://issues.apache.org/jira/browse/CHUKWA-75?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=12694723#action_12694723
]
Mac Yang commented on CHUKWA-75:
--------------------------------
Agree that it does not make sense to remove the whole record, however, instead
of setting the value to 0, it might be better to remove the offending value and
set it to null. It's probably also a good idea to generate a log entry.
As for the NumberFormatException, sounded like there might be a reason for why
it's handled this way. It would be useful to elaborate on this a little so
everyone is on the same page.
> iostat output overflow
> ----------------------
>
> Key: CHUKWA-75
> URL: https://issues.apache.org/jira/browse/CHUKWA-75
> Project: Hadoop Chukwa
> Issue Type: Bug
> Components: Data Processors
> Environment: Redhat 5.1, Java 6
> Reporter: Eric Yang
> Assignee: Eric Yang
> Attachments: CHUKWA-75.patch
>
>
> On older systems, iostat metrics contain random overflow. The plan is the
> put in a filter to remove the overflow in the demux parser to improve the
> data quality.
--
This message is automatically generated by JIRA.
-
You can reply to this email to add a comment to the issue online.