[
https://issues.apache.org/jira/browse/BEAM-8403?focusedWorklogId=329076&page=com.atlassian.jira.plugin.system.issuetabpanels:worklog-tabpanel#worklog-329076
]
ASF GitHub Bot logged work on BEAM-8403:
----------------------------------------
Author: ASF GitHub Bot
Created on: 16/Oct/19 09:34
Start Date: 16/Oct/19 09:34
Worklog Time Spent: 10m
Work Description: mxm commented on issue #9800: [BEAM-8403] Guard request
id generation to prevent concurrent worker access
URL: https://github.com/apache/beam/pull/9800#issuecomment-542616281
Unrelated test failures for both testPy37Gcp and testPython37:
```
ERROR: test_concurrent_requests
(apache_beam.runners.portability.artifact_service_test.ZipFileArtifactServiceTest)
----------------------------------------------------------------------
Traceback (most recent call last):
File
"/home/jenkins/jenkins-slave/workspace/beam_PreCommit_Python_Phrase/src/sdks/python/test-suites/tox/py37/build/srcs/sdks/python/apache_beam/runners/portability/artifact_
service_test.py", line 215, in test_concurrent_requests
_ = list(pool.map(check, range(100)))
File "/usr/lib/python3.7/concurrent/futures/_base.py", line 586, in
result_iterator
yield fs.pop().result()
File "/usr/lib/python3.7/concurrent/futures/_base.py", line 425, in result
return self.__get_result()
File "/usr/lib/python3.7/concurrent/futures/_base.py", line 384, in
__get_result
raise self._exception
File "/usr/lib/python3.7/concurrent/futures/thread.py", line 57, in run
result = self.fn(*self.args, **self.kwargs)
File
"/home/jenkins/jenkins-slave/workspace/beam_PreCommit_Python_Phrase/src/sdks/python/test-suites/tox/py37/build/srcs/sdks/python/apache_beam/runners/portability/artifact_
service_test.py", line 208, in check
self._service, tokens[session(index)], name(index)))
File
"/home/jenkins/jenkins-slave/workspace/beam_PreCommit_Python_Phrase/src/sdks/python/test-suites/tox/py37/build/srcs/sdks/python/apache_beam/runners/portability/artifact_
service_test.py", line 73, in retrieve_artifact
name=name)))
File
"/home/jenkins/jenkins-slave/workspace/beam_PreCommit_Python_Phrase/src/sdks/python/test-suites/tox/py37/build/srcs/sdks/python/apache_beam/runners/portability/artifact_
service_test.py", line 70, in <genexpr>
return b''.join(chunk.data for chunk in retrieval_service.GetArtifact(
File
"/home/jenkins/jenkins-slave/workspace/beam_PreCommit_Python_Phrase/src/sdks/python/test-suites/tox/py37/build/srcs/sdks/python/apache_beam/runners/portability/artifact_
service.py", line 133, in GetArtifact
chunk = fin.read(self._chunk_size)
File "/usr/lib/python3.7/zipfile.py", line 899, in read
data = self._read1(n)
File "/usr/lib/python3.7/zipfile.py", line 989, in _read1
self._update_crc(data)
File "/usr/lib/python3.7/zipfile.py", line 917, in _update_crc
raise BadZipFile("Bad CRC-32 for file %r" % self.name)
zipfile.BadZipFile: Bad CRC-32 for file
'/3b2b55eb92de23535010b7ac80d553ec2d4bae872ac5606bc3042ce9313dff87/763ed77b36bcd01e3c2a2f8e0d615cfe3b1f3ad2d1f93b6948a11b9dd32e6d53'
```
----------------------------------------------------------------
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
For queries about this service, please contact Infrastructure at:
[email protected]
Issue Time Tracking
-------------------
Worklog Id: (was: 329076)
Time Spent: 1h 40m (was: 1.5h)
> Race condition in request id generation of GrpcStateRequestHandler
> ------------------------------------------------------------------
>
> Key: BEAM-8403
> URL: https://issues.apache.org/jira/browse/BEAM-8403
> Project: Beam
> Issue Type: Bug
> Components: sdk-py-harness
> Reporter: Maximilian Michels
> Assignee: Maximilian Michels
> Priority: Major
> Fix For: 2.17.0
>
> Time Spent: 1h 40m
> Remaining Estimate: 0h
>
> There is a race condition in {{GrpcStateRequestHandler}} which surfaced after
> the recent changes to process append/clear state request asynchronously. The
> race condition can occur if multiple Runner workers process a transform with
> state requests with the same SDK Harness. For example, this setup occurs with
> Flink when a TaskManager has multiple task slots and two or more of those
> slots process the same stateful stage against an SDK Harness.
> CC [~robertwb]
--
This message was sent by Atlassian Jira
(v8.3.4#803005)
