BjornPrime opened a new issue, #24313:
URL: https://github.com/apache/beam/issues/24313
### What happened?
Transient failure encountered when running post-commit tests in GitHub
Actions. See output below.
```
self =
<apache_beam.runners.portability.portable_runner_test.PortableRunnerTestWithSubprocesses
testMethod=test_pardo_state_with_custom_key_coder>
def test_pardo_state_with_custom_key_coder(self):
"""Tests that state requests work correctly when the key coder is an
SDK-specific coder, i.e. non standard coder. This is additionally
enforced
by Java's ProcessBundleDescriptorsTest and by Flink's
ExecutableStageDoFnOperator which detects invalid encoding by checking
for
the correct key group of the encoded key."""
index_state_spec = userstate.CombiningValueStateSpec('index', sum)
# Test params
# Ensure decent amount of elements to serve all partitions
n = 200
duplicates = 1
split = n // (duplicates + 1)
inputs = [(i % split, str(i % split)) for i in range(0, n)]
# Use a DoFn which has to use FastPrimitivesCoder because the type
cannot
# be inferred
class Input(beam.DoFn):
def process(self, impulse):
for i in inputs:
yield i
class AddIndex(beam.DoFn):
def process(self, kv, index=beam.DoFn.StateParam(index_state_spec)):
k, v = kv
index.add(1)
yield k, v, index.read()
expected = [(i % split, str(i % split), i // split + 1)
for i in range(0, n)]
with self.create_pipeline() as p:
assert_that(
p
| beam.Impulse()
| beam.ParDo(Input())
| beam.ParDo(AddIndex()),
> equal_to(expected))
```
```
INFO:apache_beam.runners.portability.local_job_service:Worker: severity:
INFO timestamp { seconds: 1667837893 nanos: 328462600 } message:
"Pipeline_options: {\'job_name\':
\'test_pardo_state_with_custom_key_coder_1667837883.477778\',
\'gcp_oauth_scopes\':
[\'[https://www.googleapis.com/auth/bigquery\](https://www.googleapis.com/auth/bigquery/)',
\'[https://www.googleapis.com/auth/cloud-platform\](https://www.googleapis.com/auth/cloud-platform/)',
\'[https://www.googleapis.com/auth/devstorage.full_control\](https://www.googleapis.com/auth/devstorage.full_control/)',
\'[https://www.googleapis.com/auth/userinfo.email\](https://www.googleapis.com/auth/userinfo.email/)',
\'[https://www.googleapis.com/auth/datastore\](https://www.googleapis.com/auth/datastore/)',
\'[https://www.googleapis.com/auth/spanner.admin\](https://www.googleapis.com/auth/spanner.admin/)',
\'[https://www.googleapis.com/auth/spanner.data\](https://www.googleapis.com/auth/spanner.data/)',
\'[https://www.googleap
is.com/auth/bigquery\](https://www.googleapis.com/auth/bigquery/)',
\'[https://www.googleapis.com/auth/cloud-platform\](https://www.googleapis.com/auth/cloud-platform/)',
\'[https://www.googleapis.com/auth/devstorage.full_control\](https://www.googleapis.com/auth/devstorage.full_control/)',
\'[https://www.googleapis.com/auth/userinfo.email\](https://www.googleapis.com/auth/userinfo.email/)',
\'[https://www.googleapis.com/auth/datastore\](https://www.googleapis.com/auth/datastore/)',
\'[https://www.googleapis.com/auth/spanner.admin\](https://www.googleapis.com/auth/spanner.admin/)',
\'[https://www.googleapis.com/auth/spanner.data\](https://www.googleapis.com/auth/spanner.data/)'],
\'experiments\': [\'state_cache_size=100\',
\'data_buffer_time_limit_ms=1000\', \'beam_fn_api\'], \'sdk_location\':
\'container\', \'job_endpoint\': \'localhost:63832\', \'environment_type\':
\'beam:env:harness_subprocess_python:v1\', \'environment_config\':
\'D:\\\\a\\\\beam\\\\beam\\\\sdks\\\\python\\\\ta
rget\\\\.tox\\\\py37-win\\\\Scripts\\\\python.exe -m
apache_beam.runners.worker.sdk_worker_main\', \'sdk_worker_parallelism\':
\'1\', \'environment_cache_millis\': \'0\'}" log_location:
"D:\\a\\beam\\beam\\sdks\\python\\apache_beam\\runners\\worker\\sdk_worker_main.py:128"
thread: "MainThread"
```
```
FAILED
apache_beam/runners/portability/portable_runner_test.py::PortableRunnerTestWithSubprocesses::test_pardo_state_with_custom_key_coder
```
### Issue Failure
Failure: Test is flaky
### Issue Priority
Priority: 1
### Issue Component
Component: sdk-py-core
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: [email protected]
For queries about this service, please contact Infrastructure at:
[email protected]
