Li Lu commented on YARN-3049:

A little bit more investigation shows that we're using Strings for column 
qualifier type in our HBase interfaces. They are then encoded into byte arrays 
in getColumnQualifier() helper function. Given the fact that we may want to add 
timestamps in column qualifiers, at least we have the following two solutions:
# Have a getColumnQualifier() helper function that works on pre-encoded byte 
# Change the interface of getColumnQualifier() into byte arrays?

Maybe we have some better options, but so far I'm leaning towards the first 
way, although this makes parsing one column family more tricky. 

Meanwhile, I think the problem is beyond the scope of this JIRA (it's more like 
a whole stack fix rather than the reader itself). Therefore I propose to 
address the problem in a separate JIRA and move forward with the current patch. 

Any comments [~sjlee0] [~jrottinghuis] [~vrushalic]? Thanks! 

> [Storage Implementation] Implement storage reader interface to fetch raw data 
> from HBase backend
> ------------------------------------------------------------------------------------------------
>                 Key: YARN-3049
>                 URL: https://issues.apache.org/jira/browse/YARN-3049
>             Project: Hadoop YARN
>          Issue Type: Sub-task
>          Components: timelineserver
>            Reporter: Sangjin Lee
>            Assignee: Zhijie Shen
>         Attachments: YARN-3049-WIP.1.patch, YARN-3049-WIP.2.patch, 
> YARN-3049-WIP.3.patch, YARN-3049-YARN-2928.2.patch, 
> YARN-3049-YARN-2928.3.patch, YARN-3049-YARN-2928.4.patch, 
> YARN-3049-YARN-2928.5.patch, YARN-3049-YARN-2928.6.patch, 
> YARN-3049-YARN-2928.7.patch
> Implement existing ATS queries with the new ATS reader design.

This message was sent by Atlassian JIRA

Reply via email to