[
https://issues.apache.org/jira/browse/ORC-148?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15900351#comment-15900351
]
Prasanth Jayachandran commented on ORC-148:
-------------------------------------------
This need some more changes in the hive side. The initial report of the issue
was during split generation when thousands of partitions and files are scanned,
this will spit out stacktrace for every stripe. Since this is all happening in
AM, everything goes to single log.
> Move ORC PPD failure messages from WARN to DEBUG level
> ------------------------------------------------------
>
> Key: ORC-148
> URL: https://issues.apache.org/jira/browse/ORC-148
> Project: ORC
> Issue Type: Bug
> Affects Versions: 1.4.0
> Reporter: Prasanth Jayachandran
> Assignee: Prasanth Jayachandran
> Priority: Blocker
>
> Bunch of warn messages about skipping ORC PPD gets printed. This happens for
> every stripe and every row group. Either we should print this once or move
> this to DEBUG level
> {code}
> 2017-02-14T17:42:06,665 WARN [IO-Elevator-Thread-8
> (1484282558103_6753_2_05_000030_2)] impl.RecordReaderImpl:
> IllegalStateException when evaluating predicate. Skipping ORC PPD. Exception:
> Failed to retrieve dynamic value for RS_19_store_ss_store_sk_min StatsType:
> Long PredicateType: null
> 2017-02-14T17:42:06,665 WARN [IO-Elevator-Thread-3
> (1484282558103_6753_2_05_000057_0)] impl.RecordReaderImpl:
> IllegalStateException when evaluating predicate. Skipping ORC PPD. Exception:
> Failed to retrieve dynamic value for RS_19_store_ss_store_sk_min StatsType:
> Long PredicateType: null
> 2017-02-14T17:42:06,665 WARN [IO-Elevator-Thread-8
> (1484282558103_6753_2_05_000030_2)] impl.RecordReaderImpl:
> IllegalStateException when evaluating predicate. Skipping ORC PPD. Exception:
> Failed to retrieve dynamic value for RS_13_item_ss_item_sk_min StatsType:
> Long PredicateType: null
> 2017-02-14T17:42:06,665 WARN [IO-Elevator-Thread-3
> (1484282558103_6753_2_05_000057_0)] impl.RecordReaderImpl:
> IllegalStateException when evaluating predicate. Skipping ORC PPD. Exception:
> Failed to retrieve dynamic value for RS_13_item_ss_item_sk_min StatsType:
> Long PredicateType: null
> 2017-02-14T17:42:06,665 WARN [IO-Elevator-Thread-8
> (1484282558103_6753_2_05_000030_2)] impl.RecordReaderImpl:
> IllegalStateException when evaluating predicate. Skipping ORC PPD. Exception:
> Failed to retrieve dynamic value for RS_19_store_ss_store_sk_min StatsType:
> Long PredicateType: null
> {code}
--
This message was sent by Atlassian JIRA
(v6.3.15#6346)
