[
https://issues.apache.org/jira/browse/HIVE-18690?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16504732#comment-16504732
]
Hive QA commented on HIVE-18690:
--------------------------------
Here are the results of testing the latest attachment:
https://issues.apache.org/jira/secure/attachment/12926572/HIVE-18690.5.patch
{color:green}SUCCESS:{color} +1 due to 2 test(s) being added or modified.
{color:green}SUCCESS:{color} +1 due to 14481 tests passed
Test results:
https://builds.apache.org/job/PreCommit-HIVE-Build/11587/testReport
Console output: https://builds.apache.org/job/PreCommit-HIVE-Build/11587/console
Test logs: http://104.198.109.242/logs/PreCommit-HIVE-Build-11587/
Messages:
{noformat}
Executing org.apache.hive.ptest.execution.TestCheckPhase
Executing org.apache.hive.ptest.execution.PrepPhase
Executing org.apache.hive.ptest.execution.YetusPhase
Executing org.apache.hive.ptest.execution.ExecutionPhase
Executing org.apache.hive.ptest.execution.ReportingPhase
{noformat}
This message is automatically generated.
ATTACHMENT ID: 12926572 - PreCommit-HIVE-Build
> Integrate with Spark OutputMetrics
> ----------------------------------
>
> Key: HIVE-18690
> URL: https://issues.apache.org/jira/browse/HIVE-18690
> Project: Hive
> Issue Type: Sub-task
> Components: Spark
> Reporter: Sahil Takiar
> Assignee: Sahil Takiar
> Priority: Major
> Attachments: HIVE-18690.1.patch, HIVE-18690.2.patch,
> HIVE-18690.3.patch, HIVE-18690.4.patch, HIVE-18690.5.patch
>
>
> Spark has an {{OutputMetrics}} it uses to expose records / bytes written. We
> currently don't integrate with it and the Spark UI shows a blank value for
> output records / bytes. We have our own customer accumulators instead (like
> {{HIVE_RECORDS_OUT}}).
> Spark exposes the {{OutputMetrics}} object inside individual tasks via the
> {{TaskContext.get()}} method. We can use this method to access the
> {{OutputMetrics}} object and update it.
--
This message was sent by Atlassian JIRA
(v7.6.3#76005)
