[
https://issues.apache.org/jira/browse/BEAM-4636?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16524549#comment-16524549
]
Eduardo Morales commented on BEAM-4636:
---------------------------------------
Yes. I am using flags to set job name and worker binary.
Also, I noticed that time.Now().UnixNano() is used to generate unique staging
paths. I think the clock is at best a monotonically increasing counter. Perhaps
it is better to just use an atomic counter to make it strictly increasing.
> Make beam.Run() (and/or friends) thread-safe.
> ---------------------------------------------
>
> Key: BEAM-4636
> URL: https://issues.apache.org/jira/browse/BEAM-4636
> Project: Beam
> Issue Type: Improvement
> Components: sdk-go
> Reporter: Eduardo Morales
> Assignee: Henning Rohde
> Priority: Minor
>
> It would be nice to be able to launch dataflow pipelines in parallel.
> For example, here is my use case:
> * I consume data produced by my clients/customers.
> * I need to launch a pipeline on an event dispatch.
> * I may receive multiple events, from multiple customers at the same time.
> * Go code could be simpler if synchronization/cooperation wouldn't be needed
> from goroutines handling each customer. In particular, setting options
> through flags is cumbersome.
> * Launching dataflow pipelines serially may not scale if I am able to sign
> up many customers.
--
This message was sent by Atlassian JIRA
(v7.6.3#76005)
