[
https://issues.apache.org/jira/browse/BEAM-12091?focusedWorklogId=581802&page=com.atlassian.jira.plugin.system.issuetabpanels:worklog-tabpanel#worklog-581802
]
ASF GitHub Bot logged work on BEAM-12091:
-----------------------------------------
Author: ASF GitHub Bot
Created on: 13/Apr/21 14:16
Start Date: 13/Apr/21 14:16
Worklog Time Spent: 10m
Work Description: iemejia commented on a change in pull request #14520:
URL: https://github.com/apache/beam/pull/14520#discussion_r612488480
##########
File path:
runners/spark/2/src/main/java/org/apache/beam/runners/spark/structuredstreaming/SparkStructuredStreamingRunner.java
##########
@@ -111,22 +109,8 @@ public static SparkStructuredStreamingRunner create(
* @return A pipeline runner that will execute with specified options.
*/
public static SparkStructuredStreamingRunner fromOptions(PipelineOptions
options) {
- SparkStructuredStreamingPipelineOptions sparkOptions =
Review comment:
We were executing this relatively heavy step twice because we were doing
it in `fromOptions` and in each Spark runner `.run()` method so I removed it
from here and it is now up to the runner to take care of it.
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
For queries about this service, please contact Infrastructure at:
[email protected]
Issue Time Tracking
-------------------
Worklog Id: (was: 581802)
Time Spent: 0.5h (was: 20m)
> Make file staging uniform among runners
> ---------------------------------------
>
> Key: BEAM-12091
> URL: https://issues.apache.org/jira/browse/BEAM-12091
> Project: Beam
> Issue Type: Improvement
> Components: runner-core
> Reporter: Ismaël Mejía
> Assignee: Ismaël Mejía
> Priority: P2
> Fix For: 2.30.0
>
> Time Spent: 0.5h
> Remaining Estimate: 0h
>
--
This message was sent by Atlassian Jira
(v8.3.4#803005)
