[
https://issues.apache.org/jira/browse/BEAM-2026?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15977156#comment-15977156
]
Daniel Halperin commented on BEAM-2026:
---------------------------------------
[~mitar] I think this is a completely reasonable use case. I also think that
the Python {{DirectRunner}} has a variety of command-line flags via pipeline
options that make it faster by turning off various enforcements.
Try it out and let us know how it goes? Which flags are most useful?
> High performance direct runner
> ------------------------------
>
> Key: BEAM-2026
> URL: https://issues.apache.org/jira/browse/BEAM-2026
> Project: Beam
> Issue Type: New Feature
> Components: runner-direct
> Reporter: Mitar
> Assignee: Thomas Groh
>
> In documentation (https://beam.apache.org/documentation/runners/direct/) it
> is written that direct runner does not try to run efficiently, but it serves
> mostly for development and debugging.
> I would suggest that there should be also an efficient direct runner. If Beam
> tries to be an unified programming model, for some smaller tasks I would love
> to implement them in Beam, just to keep the code in the same model, but it
> would be OK to run it as a normal smaller program (maybe inside one Docker
> container), without any distribution across multiple machines. In the future,
> if usage grows, I could then replace underlying runner with something
> distributed.
--
This message was sent by Atlassian JIRA
(v6.3.15#6346)
