[
https://issues.apache.org/jira/browse/BEAM-7014?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17155787#comment-17155787
]
Udi Meiri commented on BEAM-7014:
---------------------------------
I think there might be another edge case:
1. Read 411 bytes <-- self.last_block is updates to pos 0 with 411 bytes
2. Read 0 bytes <-- self.last_block is updated to pos 411 with 0 bytes
3. Seek to pos 0
We could skip updating self.last_block and self.last_block_position in step 2.
> Flake in gcsio.py / filesystemio.py - NotImplementedError: offset: 0, whence: > 0
> -------------------------------------------------------------------------------
>
> Key: BEAM-7014
> URL: https://issues.apache.org/jira/browse/BEAM-7014
> Project: Beam
> Issue Type: Bug
> Components: sdk-py-core
> Reporter: Valentyn Tymofieiev
> Priority: P1
> Labels: beam-fixit, flake
>
> The flake was observed in Precommit Direct Runner IT (wordcount).
> Full log output: https://pastebin.com/raw/DP5J7Uch.
> {noformat}
> Traceback (most recent call last):
> 08:42:57 File
> "/home/jenkins/jenkins-slave/workspace/beam_PostCommit_Python_Verify_PR/src/sdks/python/apache_beam/io/gcp/gcsio.py",
> line 583, in _start_upload
> 08:42:57 self._client.objects.Insert(self._insert_request,
> upload=self._upload)
> 08:42:57 File
> "/home/jenkins/jenkins-slave/workspace/beam_PostCommit_Python_Verify_PR/src/sdks/python/apache_beam/io/gcp/internal/clients/storage/storage_v1_client.py",
> line 1154, in Insert
> 08:42:57 upload=upload, upload_config=upload_config)
> 08:42:57 File
> "/home/jenkins/jenkins-slave/workspace/beam_PostCommit_Python_Verify_PR/src/build/gradleenv/1327086738/local/lib/python2.7/site-packages/apitools/base/py/base_api.py",
> line 715, in _RunMethod
> 08:42:57 http_request, client=self.client)
> 08:42:57 File
> "/home/jenkins/jenkins-slave/workspace/beam_PostCommit_Python_Verify_PR/src/build/gradleenv/1327086738/local/lib/python2.7/site-packages/apitools/base/py/transfer.py",
> line 885, in InitializeUpload
> 08:42:57 return self.StreamInChunks()
> 08:42:57 File
> "/home/jenkins/jenkins-slave/workspace/beam_PostCommit_Python_Verify_PR/src/build/gradleenv/1327086738/local/lib/python2.7/site-packages/apitools/base/py/transfer.py",
> line 997, in StreamInChunks
> 08:42:57 additional_headers=additional_headers)
> 08:42:57 File
> "/home/jenkins/jenkins-slave/workspace/beam_PostCommit_Python_Verify_PR/src/build/gradleenv/1327086738/local/lib/python2.7/site-packages/apitools/base/py/transfer.py",
> line 948, in __StreamMedia
> 08:42:57 self.RefreshResumableUploadState()
> 08:42:57 File
> "/home/jenkins/jenkins-slave/workspace/beam_PostCommit_Python_Verify_PR/src/build/gradleenv/1327086738/local/lib/python2.7/site-packages/apitools/base/py/transfer.py",
> line 850, in RefreshResumableUploadState
> 08:42:57 self.stream.seek(self.progress)
> 08:42:57 File
> "/home/jenkins/jenkins-slave/workspace/beam_PostCommit_Python_Verify_PR/src/sdks/python/apache_beam/io/filesystemio.py",
> line 269, in seek
> 08:42:57 offset, whence, self.position, self.last_position))
> 08:42:57 NotImplementedError: offset: 0, whence: 0, position: 48944, last: 0
> {noformat}
> [~chamikara] Might have context to triage this.
--
This message was sent by Atlassian Jira
(v8.3.4#803005)
