[
https://issues.apache.org/jira/browse/HBASE-14366?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14731221#comment-14731221
]
Bhupendra Kumar Jain commented on HBASE-14366:
----------------------------------------------
In case of invalid vis label, actually the current running map or reducer task
will terminate. So I noticed one behavior inconsistency between TsvImportMapper
and TextSortReducer.
TsvImportMapper : one map task handles one tsv line, so one tsv line will be
dropped.
TextSortReducer: one reducer task will handle multiple tsv lines having same
row key (columns with multiple versions), So if any one vis label is invalid,
it will terminate the reducer task. So here all the tsv lines of that row key
will be dropped. But only the line with invalid vis label should be dropped.
I will create a different JIRA to handle this particular inconsistency
scenario.
> NPE in case visibility expression is not present in labels table during
> importtsv run
> -------------------------------------------------------------------------------------
>
> Key: HBASE-14366
> URL: https://issues.apache.org/jira/browse/HBASE-14366
> Project: HBase
> Issue Type: Bug
> Affects Versions: 2.0.0
> Reporter: Y. SREENIVASULU REDDY
> Assignee: Bhupendra Kumar Jain
> Priority: Minor
> Attachments: 0001-HBASE-14366.patch
>
>
> Below exception is shown in logs if visibility expression is not present in
> labels table during importtsv run. Appropriate exception / message should be
> logged for the user to take further action.
> {code}
> WARN [main] org.apache.hadoop.mapred.YarnChild: Exception running child :
> java.lang.NullPointerException
> at
> org.apache.hadoop.hbase.mapreduce.DefaultVisibilityExpressionResolver$1.getLabelOrdinal(DefaultVisibilityExpressionResolver.java:127)
> at
> org.apache.hadoop.hbase.security.visibility.VisibilityUtils.getLabelOrdinals(VisibilityUtils.java:358)
> at
> org.apache.hadoop.hbase.security.visibility.VisibilityUtils.createVisibilityExpTags(VisibilityUtils.java:323)
> at
> org.apache.hadoop.hbase.mapreduce.DefaultVisibilityExpressionResolver.createVisibilityExpTags(DefaultVisibilityExpressionResolver.java:137)
> at
> org.apache.hadoop.hbase.mapreduce.TsvImporterMapper.populatePut(TsvImporterMapper.java:205)
> at
> org.apache.hadoop.hbase.mapreduce.TsvImporterMapper.map(TsvImporterMapper.java:165)
> at
> org.apache.hadoop.hbase.mapreduce.TsvImporterMapper.map(TsvImporterMapper.java:1)
> at org.apache.hadoop.mapreduce.Mapper.run(Mapper.java:146)
> at org.apache.hadoop.mapred.MapTask.runNewMapper(MapTask.java:787)
> {code}
--
This message was sent by Atlassian JIRA
(v6.3.4#6332)
