[
https://issues.apache.org/jira/browse/HIVE-17834?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Prasanth Jayachandran updated HIVE-17834:
-----------------------------------------
Attachment: HIVE-17834.5.patch
The previous patches added sleep to map tasks to give some time for publishing
SHUFFLE_BYTES and validation of triggers. It looks like TaskCounters are
published only after task completion. There was not much time between last 2
reducers for trigger validation, hence the flakiness.
Introducing some more reduce stages, and slowing down final aggregation so that
previous reduce stage's SHUFFLE_BYTES counter gets published and validated by
the final aggregation completes.
Tested this patch several times on mac and centos (relatively slow) and it
seems to work fine this time. Will try couple more times on precommit before
committing this patch.
> Fix flaky triggers test
> -----------------------
>
> Key: HIVE-17834
> URL: https://issues.apache.org/jira/browse/HIVE-17834
> Project: Hive
> Issue Type: Bug
> Affects Versions: 3.0.0
> Reporter: Prasanth Jayachandran
> Assignee: Prasanth Jayachandran
> Fix For: 3.0.0
>
> Attachments: HIVE-17834.1.patch, HIVE-17834.2.patch,
> HIVE-17834.3.patch, HIVE-17834.4.patch, HIVE-17834.4.patch, HIVE-17834.5.patch
>
>
> https://issues.apache.org/jira/browse/HIVE-12631?focusedCommentId=16209803&page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel#comment-16209803
--
This message was sent by Atlassian JIRA
(v6.4.14#64029)
