Ajantha Bhat created CARBONDATA-3054:
----------------------------------------
Summary: Dictionary file cannot be read in S3a with
CarbonDictionaryDecoder.doConsume() codeGen
Key: CARBONDATA-3054
URL: https://issues.apache.org/jira/browse/CARBONDATA-3054
Project: CarbonData
Issue Type: Improvement
Reporter: Ajantha Bhat
Assignee: Ajantha Bhat
problem: In S3a environment, when quiried the data which has dictionary files,
Dictionary file cannot be read in S3a with CarbonDictionaryDecoder.doConsume()
codeGen even though file is present.
cause: CarbonDictionaryDecoder.doConsume() codeGen doesn't set hadoop conf in
thread local variable, only doExecute() sets it.
Hence, when getDictionaryWrapper() called from doConsume() codeGen,
AbstractDictionaryCache.getDictionaryMetaCarbonFile() returns false for
fileExists() operation.
solution:
In CarbonDictionaryDecoder.doConsume() codeGen, set hadoop conf in thread local
variable
--
This message was sent by Atlassian JIRA
(v7.6.3#76005)
