[
https://issues.apache.org/jira/browse/BEAM-6569?focusedWorklogId=194014&page=com.atlassian.jira.plugin.system.issuetabpanels:worklog-tabpanel#worklog-194014
]
ASF GitHub Bot logged work on BEAM-6569:
----------------------------------------
Author: ASF GitHub Bot
Created on: 04/Feb/19 13:38
Start Date: 04/Feb/19 13:38
Worklog Time Spent: 10m
Work Description: RobbeSneyders commented on pull request #7717:
[BEAM-6569] Re-add gcsio_test to py3-gcp test suite
URL: https://github.com/apache/beam/pull/7717
This PR re-adds the gcio_test to the py3-gcp tox suite. This test was
removed in #7691 due to being flaky.
However, the problem here was not a flaky test, but that the test was
included twice in the test suite (see [this
comment](https://github.com/apache/beam/pull/7691#issuecomment-459431122)).
The same mocked object is used twice, which resulted in the iterator being
exhausted during the second test.
In [the
logs](https://builds.apache.org/job/beam_PreCommit_Python_Commit/4034/console)
of one of the runs that flagged this test as flaky, we can see that the test
passed the first time, and failed the second time.
> 12:54:06 test_rename (apache_beam.io.gcp.gcsio_test.TestGCSIO) ... ok
> ...
> 12:54:06 test_rename (apache_beam.io.gcp.gcsio_test.TestGCSIO) ... ERROR
Post-Commit Tests Status (on master branch)
------------------------------------------------------------------------------------------------
Lang | SDK | Apex | Dataflow | Flink | Gearpump | Samza | Spark
--- | --- | --- | --- | --- | --- | --- | ---
Go | [](https://builds.apache.org/job/beam_PostCommit_Go/lastCompletedBuild/)
| --- | --- | --- | --- | --- | ---
Java | [](https://builds.apache.org/job/beam_PostCommit_Java/lastCompletedBuild/)
| [](https://builds.apache.org/job/beam_PostCommit_Java_ValidatesRunner_Apex/lastCompletedBuild/)
| [](https://builds.apache.org/job/beam_PostCommit_Java_ValidatesRunner_Dataflow/lastCompletedBuild/)
| [](https://builds.apache.org/job/beam_PostCommit_Java_ValidatesRunner_Flink/lastCompletedBuild/)<br>[](https://builds.apache.org/job/beam_PostCommit_Java_PVR_Flink_Batch/lastCompletedBuild/)<br>[](https://builds.apache.org/job/beam_PostCommit_Java_PVR_Flink_Streaming/lastCompletedBuild/)
| [](https://builds.apache.org/job/beam_PostCommit_Java_ValidatesRunner_Gearpump/lastCompletedBuild/)
| [](https://builds.apache.org/job/beam_PostCommit_Java_ValidatesRunner_Samza/lastCompletedBuild/)
| [](https://builds.apache.org/job/beam_PostCommit_Java_ValidatesRunner_Spark/lastCompletedBuild/)
Python | [](https://builds.apache.org/job/beam_PostCommit_Python_Verify/lastCompletedBuild/)
| --- | [](https://builds.apache.org/job/beam_PostCommit_Py_VR_Dataflow/lastCompletedBuild/)
</br> [](https://builds.apache.org/job/beam_PostCommit_Py_ValCont/lastCompletedBuild/)
| [](https://builds.apache.org/job/beam_PreCommit_Python_PVR_Flink_Cron/lastCompletedBuild/)
| --- | --- | ---
----------------------------------------------------------------
This is an automated message from the Apache Git Service.
To respond to the message, please log on GitHub and use the
URL above to go to the specific comment.
For queries about this service, please contact Infrastructure at:
[email protected]
Issue Time Tracking
-------------------
Worklog Id: (was: 194014)
Time Spent: 1h 40m (was: 1.5h)
> GCS IO tests are very flaky under Python 3.5
> --------------------------------------------
>
> Key: BEAM-6569
> URL: https://issues.apache.org/jira/browse/BEAM-6569
> Project: Beam
> Issue Type: Sub-task
> Components: sdk-py-core
> Reporter: Valentyn Tymofieiev
> Assignee: Robbe
> Priority: Major
> Time Spent: 1h 40m
> Remaining Estimate: 0h
>
> cc: [~Juta] [~markflyhigh] [~RobbeSneyders]
> Example:
> {noformat}
> apache_beam.io.gcp.gcsio_test.TestGCSIO.test_rename (from nosetests)
> Traceback (most recent call last):
> File
> "/home/jenkins/jenkins-slave/workspace/beam_PreCommit_Python_Commit@2/src/sdks/python/apache_beam/utils/retry.py",
> line 184, in wrapper
> return fun(*args, **kwargs)
> File
> "/home/jenkins/jenkins-slave/workspace/beam_PreCommit_Python_Commit@2/src/sdks/python/apache_beam/io/gcp/gcsio.py",
> line 274, in copy
> response.totalBytesRewritten, response.objectSize, src, dest)
> File "/usr/lib/python3.5/logging/__init__.py", line 1848, in debug
> root.debug(msg, *args, **kwargs)
> File "/usr/lib/python3.5/logging/__init__.py", line 1267, in debug
> self._log(DEBUG, msg, args, **kwargs)
> File "/usr/lib/python3.5/logging/__init__.py", line 1414, in _log
> exc_info, func, extra, sinfo)
> File "/usr/lib/python3.5/logging/__init__.py", line 1384, in makeRecord
> sinfo)
> File "/usr/lib/python3.5/logging/__init__.py", line 248, in __init__
> ct = time.time()
> File
> "/home/jenkins/jenkins-slave/workspace/beam_PreCommit_Python_Commit@2/src/sdks/python/target/.tox/py3-gcp/lib/python3.5/site-packages/mock/mock.py",
> line 1062, in __call__
> return _mock_self._mock_call(*args, **kwargs)
> File
> "/home/jenkins/jenkins-slave/workspace/beam_PreCommit_Python_Commit@2/src/sdks/python/target/.tox/py3-gcp/lib/python3.5/site-packages/mock/mock.py",
> line 1121, in _mock_call
> result = next(effect)
> {noformat}
--
This message was sent by Atlassian JIRA
(v7.6.3#76005)
