[jira] [Commented] (BEAM-1265) Add streaming support to DirectRunner

[Ahmet Altay (JIRA)]

[ 
https://issues.apache.org/jira/browse/BEAM-1265?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15861542#comment-15861542
 ] 

Ahmet Altay commented on BEAM-1265:
---

Re: Johan

This issue is for adding streaming support to the DirectRunner. The work is 
currently on going.

Our mid term vision is to utilize Fn Api [1] to build a streaming solution. I 
would expect pub/sub to be one of the early IOs we will go with supporting. 

[1] 
https://lists.apache.org/thread.html/f8b145b25a2b42f4e59b1702b40098a305a418d9fcec30d028bcf92c@%3Cdev.beam.apache.org%3E

> Add streaming support to DirectRunner
> -
>
> Key: BEAM-1265
> URL: https://issues.apache.org/jira/browse/BEAM-1265
> Project: Beam
>  Issue Type: New Feature
>  Components: sdk-py
>Reporter: Ahmet Altay
>Assignee: Charles Chen
>
> Continue the work started in https://issues.apache.org/jira/browse/BEAM-428



--
This message was sent by Atlassian JIRA
(v6.3.15#6346)

[jira] [Commented] (BEAM-1265) Add streaming support to DirectRunner

[ASF GitHub Bot (JIRA)]

[ 
https://issues.apache.org/jira/browse/BEAM-1265?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15850278#comment-15850278
 ] 

ASF GitHub Bot commented on BEAM-1265:
--

Github user asfgit closed the pull request at:

https://github.com/apache/beam/pull/1899


> Add streaming support to DirectRunner
> -
>
> Key: BEAM-1265
> URL: https://issues.apache.org/jira/browse/BEAM-1265
> Project: Beam
>  Issue Type: New Feature
>  Components: sdk-py
>Reporter: Ahmet Altay
>Assignee: Charles Chen
>
> Continue the work started in https://issues.apache.org/jira/browse/BEAM-428



--
This message was sent by Atlassian JIRA
(v6.3.15#6346)

[jira] [Commented] (BEAM-1265) Add streaming support to DirectRunner

[ASF GitHub Bot (JIRA)]

[ 
https://issues.apache.org/jira/browse/BEAM-1265?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15849461#comment-15849461
 ] 

ASF GitHub Bot commented on BEAM-1265:
--

Github user aaltay closed the pull request at:

https://github.com/apache/beam/pull/1899


> Add streaming support to DirectRunner
> -
>
> Key: BEAM-1265
> URL: https://issues.apache.org/jira/browse/BEAM-1265
> Project: Beam
>  Issue Type: New Feature
>  Components: sdk-py
>Reporter: Ahmet Altay
>Assignee: Charles Chen
>
> Continue the work started in https://issues.apache.org/jira/browse/BEAM-428



--
This message was sent by Atlassian JIRA
(v6.3.15#6346)

[jira] [Commented] (BEAM-1265) Add streaming support to DirectRunner

[ASF GitHub Bot (JIRA)]

[ 
https://issues.apache.org/jira/browse/BEAM-1265?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15849462#comment-15849462
 ] 

ASF GitHub Bot commented on BEAM-1265:
--

GitHub user aaltay reopened a pull request:

https://github.com/apache/beam/pull/1899

[BEAM-1265] Fail if --streaming option is used

Currently, none of the runners for Python SDK supports streaming. Fail
at pipeline validation time if '--streaming' option is set. This is to
prevent user confusion, until streaming execution is implemented.



You can merge this pull request into a Git repository by running:

$ git pull https://github.com/aaltay/beam str

Alternatively you can review and apply these changes as the patch at:

https://github.com/apache/beam/pull/1899.patch

To close this pull request, make a commit to your master/trunk branch
with (at least) the following in the commit message:

This closes #1899


commit 099b83e78549c53ccb5998ed6218276d4f2d47f2
Author: Ahmet Altay 
Date:   2017-02-02T01:55:54Z

Fail when --streaming option is used.

Currently, none of the runners for Python SDK supports streaming. Fail
at pipeline validation time if '--streaming' option is set. This is to
prevent user confusion, until streaming execution is implemented.




> Add streaming support to DirectRunner
> -
>
> Key: BEAM-1265
> URL: https://issues.apache.org/jira/browse/BEAM-1265
> Project: Beam
>  Issue Type: New Feature
>  Components: sdk-py
>Reporter: Ahmet Altay
>Assignee: Charles Chen
>
> Continue the work started in https://issues.apache.org/jira/browse/BEAM-428



--
This message was sent by Atlassian JIRA
(v6.3.15#6346)

[jira] [Commented] (BEAM-1265) Add streaming support to DirectRunner

[ASF GitHub Bot (JIRA)]

[ 
https://issues.apache.org/jira/browse/BEAM-1265?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15849280#comment-15849280
 ] 

ASF GitHub Bot commented on BEAM-1265:
--

GitHub user aaltay opened a pull request:

https://github.com/apache/beam/pull/1899

[BEAM-1265] Fail if --streaming option is used

Currently, none of the runners for Python SDK supports streaming. Fail
at pipeline validation time if '--streaming' option is set. This is to
prevent user confusion, until streaming execution is implemented.



You can merge this pull request into a Git repository by running:

$ git pull https://github.com/aaltay/beam str

Alternatively you can review and apply these changes as the patch at:

https://github.com/apache/beam/pull/1899.patch

To close this pull request, make a commit to your master/trunk branch
with (at least) the following in the commit message:

This closes #1899


commit 099b83e78549c53ccb5998ed6218276d4f2d47f2
Author: Ahmet Altay 
Date:   2017-02-02T01:55:54Z

Fail when --streaming option is used.

Currently, none of the runners for Python SDK supports streaming. Fail
at pipeline validation time if '--streaming' option is set. This is to
prevent user confusion, until streaming execution is implemented.




> Add streaming support to DirectRunner
> -
>
> Key: BEAM-1265
> URL: https://issues.apache.org/jira/browse/BEAM-1265
> Project: Beam
>  Issue Type: New Feature
>  Components: sdk-py
>Reporter: Ahmet Altay
>Assignee: Charles Chen
>
> Continue the work started in https://issues.apache.org/jira/browse/BEAM-428



--
This message was sent by Atlassian JIRA
(v6.3.15#6346)