[
https://issues.apache.org/jira/browse/BEAM-2687?focusedWorklogId=145608&page=com.atlassian.jira.plugin.system.issuetabpanels:worklog-tabpanel#worklog-145608
]
ASF GitHub Bot logged work on BEAM-2687:
----------------------------------------
Author: ASF GitHub Bot
Created on: 19/Sep/18 09:33
Start Date: 19/Sep/18 09:33
Worklog Time Spent: 10m
Work Description: robertwb commented on a change in pull request #6349:
[BEAM-2687] Implement State over the Fn API
URL: https://github.com/apache/beam/pull/6349#discussion_r218731991
##########
File path: sdks/python/apache_beam/runners/portability/fn_api_runner_test.py
##########
@@ -228,6 +229,29 @@ def cross_product(elem, sides):
pcoll | beam.FlatMap(cross_product, beam.pvalue.AsList(derived)),
equal_to([('a', 'a'), ('a', 'b'), ('b', 'a'), ('b', 'b')]))
+ def test_pardo_state_only(self):
Review comment:
I put these here because it runs them in various modes (directly, over Grpc
with and without multiple threads, over subprocesses). I view the ones in
userstate_test as more user-api-facing ones (though note that those can't be
used here, as they use the streaming test stream and avoid assert_that due to
it being broken in streaming mode on the other direct runner, and instead have
a DoFn that stores things into a list (which of course won't work
cross-process).
So, yes, it'd be nice to unify, but not right now.
(What I'd like to do eventually is expand this suite of tests into a basic
Runner Compatibility Matrix test...)
----------------------------------------------------------------
This is an automated message from the Apache Git Service.
To respond to the message, please log on GitHub and use the
URL above to go to the specific comment.
For queries about this service, please contact Infrastructure at:
[email protected]
Issue Time Tracking
-------------------
Worklog Id: (was: 145608)
Time Spent: 2h (was: 1h 50m)
> Python SDK support for Stateful Processing
> ------------------------------------------
>
> Key: BEAM-2687
> URL: https://issues.apache.org/jira/browse/BEAM-2687
> Project: Beam
> Issue Type: New Feature
> Components: sdk-py-core
> Reporter: Ahmet Altay
> Assignee: Charles Chen
> Priority: Major
> Time Spent: 2h
> Remaining Estimate: 0h
>
> Python SDK should support stateful processing
> (https://beam.apache.org/blog/2017/02/13/stateful-processing.html)
> In the meantime, runner capability matrix should be updated to show the lack
> of this feature
> (https://beam.apache.org/documentation/runners/capability-matrix/)
> Use this as an umbrella issue for all related issues.
--
This message was sent by Atlassian JIRA
(v7.6.3#76005)
