[
https://issues.apache.org/jira/browse/BEAM-10670?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17334808#comment-17334808
]
Steve Niemitz commented on BEAM-10670:
--------------------------------------
I'd be a big +1 on changing the default back to the old non-splittable read
implementation.
It seems like a good path forward would be:
* Change default back to the old impl (in 2.30)
* Ask users to begin experimenting with the new SDF based implementation, fix
any performance issues that come up during this period. There's a couple
enumerated in this ticket, and I think there's a few on the mailing list as well
* Once those are ironed out, change the default back to the SDF implementation
> Make non-portable Splittable DoFn the only option when executing Java "Read"
> transforms
> ---------------------------------------------------------------------------------------
>
> Key: BEAM-10670
> URL: https://issues.apache.org/jira/browse/BEAM-10670
> Project: Beam
> Issue Type: Improvement
> Components: sdk-java-core
> Reporter: Luke Cwik
> Assignee: Kenneth Knowles
> Priority: P3
> Labels: Clarified
> Time Spent: 37h 50m
> Remaining Estimate: 0h
>
> All runners seem to be capable of migrating to splittable DoFn for
> non-portable execution except for Dataflow runner v1 which will internalize
> the current primitive read implementation that is shared across runner
> implementations.
--
This message was sent by Atlassian Jira
(v8.3.4#803005)
