[
https://issues.apache.org/jira/browse/BEAM-12088?focusedWorklogId=576299&page=com.atlassian.jira.plugin.system.issuetabpanels:worklog-tabpanel#worklog-576299
]
ASF GitHub Bot logged work on BEAM-12088:
-----------------------------------------
Author: ASF GitHub Bot
Created on: 02/Apr/21 20:20
Start Date: 02/Apr/21 20:20
Worklog Time Spent: 10m
Work Description: iemejia opened a new pull request #14417:
URL: https://github.com/apache/beam/pull/14417
This solves a deployment issue for Spark Structured Streaming runner on YARN
and reduces and makes code more consistent among runners.
R: @ibzib
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
For queries about this service, please contact Infrastructure at:
[email protected]
Issue Time Tracking
-------------------
Worklog Id: (was: 576299)
Remaining Estimate: 0h
Time Spent: 10m
> Make file staging uniform among Spark Runners
> ---------------------------------------------
>
> Key: BEAM-12088
> URL: https://issues.apache.org/jira/browse/BEAM-12088
> Project: Beam
> Issue Type: Bug
> Components: runner-spark
> Reporter: Ismaël Mejía
> Assignee: Ismaël Mejía
> Priority: P2
> Fix For: 2.30.0
>
> Time Spent: 10m
> Remaining Estimate: 0h
>
> Both the Spark Classic and Portable runners share the file staging logic, but
> the Structured Streaming runner is using a different logic even if the
> process should in principle be the same. This manifests on issues when trying
> to deploy pipelines via Hadoop YARN with exceptions related to file Staging.
--
This message was sent by Atlassian Jira
(v8.3.4#803005)
