[
https://issues.apache.org/jira/browse/YARN-4053?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15004887#comment-15004887
]
Joep Rottinghuis commented on YARN-4053:
----------------------------------------
In further discussion with [~sjlee0] it may actually be that the current
implementation of the FlowScanner doesn't properly deal with mixed numeric and
non-numeric columns.
Perhaps that is a separate jira to properly deal with that. I think what we may
have to do is to ensure that we normally return any column that is non-numeric
untouched.
Sangjin suggested that perhaps the new methods I mentioned (comparator, and
sum) make sense only for numeric types. That can be more cleanly implemented as
a sub-interface. Then the FlowScanner can determine if the returned converter
is numeric. If so, it can process as is with collapsing values, or else it
would simply leave the cells untouched. That way we could mix numeric and
non-numeric columns in one column family and we avoid having to implement a sum
or a meaningless comparison between unrelated objects.
> Change the way metric values are stored in HBase Storage
> --------------------------------------------------------
>
> Key: YARN-4053
> URL: https://issues.apache.org/jira/browse/YARN-4053
> Project: Hadoop YARN
> Issue Type: Sub-task
> Components: timelineserver
> Affects Versions: YARN-2928
> Reporter: Varun Saxena
> Assignee: Varun Saxena
> Labels: yarn-2928-1st-milestone
> Attachments: YARN-4053-YARN-2928.01.patch,
> YARN-4053-YARN-2928.02.patch, YARN-4053-feature-YARN-2928.03.patch
>
>
> Currently HBase implementation uses GenericObjectMapper to convert and store
> values in backend HBase storage. This converts everything into a string
> representation(ASCII/UTF-8 encoded byte array).
> While this is fine in most cases, it does not quite serve our use case for
> metrics.
> So we need to decide how are we going to encode and decode metric values and
> store them in HBase.
>
--
This message was sent by Atlassian JIRA
(v6.3.4#6332)
