See
<https://builds.apache.org/job/beam_PostCommit_Python35/1081/display/redirect?page=changes>
Changes:
[robertwb] [BEAM-8575] Added a unit test that Reshuffle preserves timestamps
------------------------------------------
[...truncated 701.75 KB...]
return fun(*args, **kwargs)
File
"<https://builds.apache.org/job/beam_PostCommit_Python35/ws/src/sdks/python/apache_beam/io/gcp/gcsio.py";,>
line 466, in list_prefix
response = self.client.objects.List(request)
File
"<https://builds.apache.org/job/beam_PostCommit_Python35/ws/src/sdks/python/apache_beam/io/gcp/internal/clients/storage/storage_v1_client.py";,>
line 1182, in List
config, request, global_params=global_params)
File
"<https://builds.apache.org/job/beam_PostCommit_Python35/ws/src/build/gradleenv/1398941889/lib/python3.5/site-packages/apitools/base/py/base_api.py";,>
line 729, in _RunMethod
http, http_request, **opts)
File
"<https://builds.apache.org/job/beam_PostCommit_Python35/ws/src/build/gradleenv/1398941889/lib/python3.5/site-packages/apitools/base/py/http_wrapper.py";,>
line 356, in MakeRequest
max_retry_wait, total_wait_sec))
File
"<https://builds.apache.org/job/beam_PostCommit_Python35/ws/src/sdks/python/apache_beam/io/gcp/gcsio_overrides.py";,>
line 45, in retry_func
return http_wrapper.HandleExceptionsAndRebuildHttpConnections(retry_args)
File
"<https://builds.apache.org/job/beam_PostCommit_Python35/ws/src/build/gradleenv/1398941889/lib/python3.5/site-packages/apitools/base/py/http_wrapper.py";,>
line 290, in HandleExceptionsAndRebuildHttpConnections
retry_args.exc.status >= 500)):
apache_beam.io.gcp.gcsio: INFO: Starting the size estimation of the input
oauth2client.transport: INFO: Attempting refresh to obtain initial access_token
apache_beam.utils.retry: WARNING: Retry with exponential backoff: waiting for
196.78764136465787 seconds before retrying list_prefix because we caught
exception: TypeError: unorderable types: NoneType() >= int()
Traceback for above exception (most recent call last):
File
"<https://builds.apache.org/job/beam_PostCommit_Python35/ws/src/sdks/python/apache_beam/utils/retry.py";,>
line 209, in wrapper
return fun(*args, **kwargs)
File
"<https://builds.apache.org/job/beam_PostCommit_Python35/ws/src/sdks/python/apache_beam/io/gcp/gcsio.py";,>
line 466, in list_prefix
response = self.client.objects.List(request)
File
"<https://builds.apache.org/job/beam_PostCommit_Python35/ws/src/sdks/python/apache_beam/io/gcp/internal/clients/storage/storage_v1_client.py";,>
line 1182, in List
config, request, global_params=global_params)
File
"<https://builds.apache.org/job/beam_PostCommit_Python35/ws/src/build/gradleenv/1398941889/lib/python3.5/site-packages/apitools/base/py/base_api.py";,>
line 729, in _RunMethod
http, http_request, **opts)
File
"<https://builds.apache.org/job/beam_PostCommit_Python35/ws/src/build/gradleenv/1398941889/lib/python3.5/site-packages/apitools/base/py/http_wrapper.py";,>
line 356, in MakeRequest
max_retry_wait, total_wait_sec))
File
"<https://builds.apache.org/job/beam_PostCommit_Python35/ws/src/sdks/python/apache_beam/io/gcp/gcsio_overrides.py";,>
line 45, in retry_func
return http_wrapper.HandleExceptionsAndRebuildHttpConnections(retry_args)
File
"<https://builds.apache.org/job/beam_PostCommit_Python35/ws/src/build/gradleenv/1398941889/lib/python3.5/site-packages/apitools/base/py/http_wrapper.py";,>
line 290, in HandleExceptionsAndRebuildHttpConnections
retry_args.exc.status >= 500)):
apache_beam.io.gcp.gcsio: INFO: Starting the size estimation of the input
oauth2client.transport: INFO: Attempting refresh to obtain initial access_token
apache_beam.utils.retry: WARNING: Retry with exponential backoff: waiting for
9.34351179448884 seconds before retrying delete_files because we caught
exception: apache_beam.io.filesystem.BeamIOError: Delete operation failed with
exceptions
{'gs://temp-storage-for-end-to-end-tests/py-it-cloud/output/1574711753047/results*':
BeamIOError('Match operation failed with exceptions
{\'gs://temp-storage-for-end-to-end-tests/py-it-cloud/output/1574711753047/results*\':
BeamIOError("List operation failed with exceptions
{\'gs://temp-storage-for-end-to-end-tests/py-it-cloud/output/1574711753047/results\':
TypeError(\'unorderable types: NoneType() >= int()\',)}",)}',)}
Traceback for above exception (most recent call last):
File
"<https://builds.apache.org/job/beam_PostCommit_Python35/ws/src/sdks/python/apache_beam/utils/retry.py";,>
line 209, in wrapper
return fun(*args, **kwargs)
File
"<https://builds.apache.org/job/beam_PostCommit_Python35/ws/src/sdks/python/apache_beam/testing/test_utils.py";,>
line 137, in delete_files
FileSystems.delete(file_paths)
File
"<https://builds.apache.org/job/beam_PostCommit_Python35/ws/src/sdks/python/apache_beam/io/filesystems.py";,>
line 318, in delete
return filesystem.delete(paths)
File
"<https://builds.apache.org/job/beam_PostCommit_Python35/ws/src/sdks/python/apache_beam/io/gcp/gcsfilesystem.py";,>
line 328, in delete
raise BeamIOError("Delete operation failed", exceptions)
apache_beam.io.filesystem: DEBUG: Listing files in
'gs://temp-storage-for-end-to-end-tests/py-it-cloud/output/1574711753047/results'
apache_beam.io.filesystem: DEBUG: translate_pattern:
'gs://temp-storage-for-end-to-end-tests/py-it-cloud/output/1574711753047/results*'
->
'gs\\:\\/\\/temp\\-storage\\-for\\-end\\-to\\-end\\-tests\\/py\\-it\\-cloud\\/output\\/1574711753047\\/results[^/\\\\]*'
apache_beam.io.gcp.gcsio: INFO: Starting the size estimation of the input
oauth2client.transport: INFO: Attempting refresh to obtain initial access_token
apache_beam.utils.retry: WARNING: Retry with exponential backoff: waiting for
4.8429837361584225 seconds before retrying list_prefix because we caught
exception: TypeError: unorderable types: NoneType() >= int()
Traceback for above exception (most recent call last):
File
"<https://builds.apache.org/job/beam_PostCommit_Python35/ws/src/sdks/python/apache_beam/utils/retry.py";,>
line 209, in wrapper
return fun(*args, **kwargs)
File
"<https://builds.apache.org/job/beam_PostCommit_Python35/ws/src/sdks/python/apache_beam/io/gcp/gcsio.py";,>
line 466, in list_prefix
response = self.client.objects.List(request)
File
"<https://builds.apache.org/job/beam_PostCommit_Python35/ws/src/sdks/python/apache_beam/io/gcp/internal/clients/storage/storage_v1_client.py";,>
line 1182, in List
config, request, global_params=global_params)
File
"<https://builds.apache.org/job/beam_PostCommit_Python35/ws/src/build/gradleenv/1398941889/lib/python3.5/site-packages/apitools/base/py/base_api.py";,>
line 729, in _RunMethod
http, http_request, **opts)
File
"<https://builds.apache.org/job/beam_PostCommit_Python35/ws/src/build/gradleenv/1398941889/lib/python3.5/site-packages/apitools/base/py/http_wrapper.py";,>
line 356, in MakeRequest
max_retry_wait, total_wait_sec))
File
"<https://builds.apache.org/job/beam_PostCommit_Python35/ws/src/sdks/python/apache_beam/io/gcp/gcsio_overrides.py";,>
line 45, in retry_func
return http_wrapper.HandleExceptionsAndRebuildHttpConnections(retry_args)
File
"<https://builds.apache.org/job/beam_PostCommit_Python35/ws/src/build/gradleenv/1398941889/lib/python3.5/site-packages/apitools/base/py/http_wrapper.py";,>
line 290, in HandleExceptionsAndRebuildHttpConnections
retry_args.exc.status >= 500)):
apache_beam.io.gcp.gcsio: INFO: Starting the size estimation of the input
oauth2client.transport: INFO: Attempting refresh to obtain initial access_token
apache_beam.utils.retry: WARNING: Retry with exponential backoff: waiting for
8.678685986467872 seconds before retrying list_prefix because we caught
exception: TypeError: unorderable types: NoneType() >= int()
Traceback for above exception (most recent call last):
File
"<https://builds.apache.org/job/beam_PostCommit_Python35/ws/src/sdks/python/apache_beam/utils/retry.py";,>
line 209, in wrapper
return fun(*args, **kwargs)
File
"<https://builds.apache.org/job/beam_PostCommit_Python35/ws/src/sdks/python/apache_beam/io/gcp/gcsio.py";,>
line 466, in list_prefix
response = self.client.objects.List(request)
File
"<https://builds.apache.org/job/beam_PostCommit_Python35/ws/src/sdks/python/apache_beam/io/gcp/internal/clients/storage/storage_v1_client.py";,>
line 1182, in List
config, request, global_params=global_params)
File
"<https://builds.apache.org/job/beam_PostCommit_Python35/ws/src/build/gradleenv/1398941889/lib/python3.5/site-packages/apitools/base/py/base_api.py";,>
line 729, in _RunMethod
http, http_request, **opts)
File
"<https://builds.apache.org/job/beam_PostCommit_Python35/ws/src/build/gradleenv/1398941889/lib/python3.5/site-packages/apitools/base/py/http_wrapper.py";,>
line 356, in MakeRequest
max_retry_wait, total_wait_sec))
File
"<https://builds.apache.org/job/beam_PostCommit_Python35/ws/src/sdks/python/apache_beam/io/gcp/gcsio_overrides.py";,>
line 45, in retry_func
return http_wrapper.HandleExceptionsAndRebuildHttpConnections(retry_args)
File
"<https://builds.apache.org/job/beam_PostCommit_Python35/ws/src/build/gradleenv/1398941889/lib/python3.5/site-packages/apitools/base/py/http_wrapper.py";,>
line 290, in HandleExceptionsAndRebuildHttpConnections
retry_args.exc.status >= 500)):
apache_beam.io.gcp.gcsio: INFO: Starting the size estimation of the input
oauth2client.transport: INFO: Attempting refresh to obtain initial access_token
apache_beam.utils.retry: WARNING: Retry with exponential backoff: waiting for
14.394336735562764 seconds before retrying list_prefix because we caught
exception: TypeError: unorderable types: NoneType() >= int()
Traceback for above exception (most recent call last):
File
"<https://builds.apache.org/job/beam_PostCommit_Python35/ws/src/sdks/python/apache_beam/utils/retry.py";,>
line 209, in wrapper
return fun(*args, **kwargs)
File
"<https://builds.apache.org/job/beam_PostCommit_Python35/ws/src/sdks/python/apache_beam/io/gcp/gcsio.py";,>
line 466, in list_prefix
response = self.client.objects.List(request)
File
"<https://builds.apache.org/job/beam_PostCommit_Python35/ws/src/sdks/python/apache_beam/io/gcp/internal/clients/storage/storage_v1_client.py";,>
line 1182, in List
config, request, global_params=global_params)
File
"<https://builds.apache.org/job/beam_PostCommit_Python35/ws/src/build/gradleenv/1398941889/lib/python3.5/site-packages/apitools/base/py/base_api.py";,>
line 729, in _RunMethod
http, http_request, **opts)
File
"<https://builds.apache.org/job/beam_PostCommit_Python35/ws/src/build/gradleenv/1398941889/lib/python3.5/site-packages/apitools/base/py/http_wrapper.py";,>
line 356, in MakeRequest
max_retry_wait, total_wait_sec))
File
"<https://builds.apache.org/job/beam_PostCommit_Python35/ws/src/sdks/python/apache_beam/io/gcp/gcsio_overrides.py";,>
line 45, in retry_func
return http_wrapper.HandleExceptionsAndRebuildHttpConnections(retry_args)
File
"<https://builds.apache.org/job/beam_PostCommit_Python35/ws/src/build/gradleenv/1398941889/lib/python3.5/site-packages/apitools/base/py/http_wrapper.py";,>
line 290, in HandleExceptionsAndRebuildHttpConnections
retry_args.exc.status >= 500)):
apache_beam.io.gcp.gcsio: INFO: Starting the size estimation of the input
oauth2client.transport: INFO: Attempting refresh to obtain initial access_token
apache_beam.utils.retry: WARNING: Retry with exponential backoff: waiting for
20.889962146004994 seconds before retrying list_prefix because we caught
exception: TypeError: unorderable types: NoneType() >= int()
Traceback for above exception (most recent call last):
File
"<https://builds.apache.org/job/beam_PostCommit_Python35/ws/src/sdks/python/apache_beam/utils/retry.py";,>
line 209, in wrapper
return fun(*args, **kwargs)
File
"<https://builds.apache.org/job/beam_PostCommit_Python35/ws/src/sdks/python/apache_beam/io/gcp/gcsio.py";,>
line 466, in list_prefix
response = self.client.objects.List(request)
File
"<https://builds.apache.org/job/beam_PostCommit_Python35/ws/src/sdks/python/apache_beam/io/gcp/internal/clients/storage/storage_v1_client.py";,>
line 1182, in List
config, request, global_params=global_params)
File
"<https://builds.apache.org/job/beam_PostCommit_Python35/ws/src/build/gradleenv/1398941889/lib/python3.5/site-packages/apitools/base/py/base_api.py";,>
line 729, in _RunMethod
http, http_request, **opts)
File
"<https://builds.apache.org/job/beam_PostCommit_Python35/ws/src/build/gradleenv/1398941889/lib/python3.5/site-packages/apitools/base/py/http_wrapper.py";,>
line 356, in MakeRequest
max_retry_wait, total_wait_sec))
File
"<https://builds.apache.org/job/beam_PostCommit_Python35/ws/src/sdks/python/apache_beam/io/gcp/gcsio_overrides.py";,>
line 45, in retry_func
return http_wrapper.HandleExceptionsAndRebuildHttpConnections(retry_args)
File
"<https://builds.apache.org/job/beam_PostCommit_Python35/ws/src/build/gradleenv/1398941889/lib/python3.5/site-packages/apitools/base/py/http_wrapper.py";,>
line 290, in HandleExceptionsAndRebuildHttpConnections
retry_args.exc.status >= 500)):
apache_beam.io.gcp.gcsio: INFO: Starting the size estimation of the input
oauth2client.transport: INFO: Attempting refresh to obtain initial access_token
apache_beam.utils.retry: WARNING: Retry with exponential backoff: waiting for
79.31288185503121 seconds before retrying list_prefix because we caught
exception: TypeError: unorderable types: NoneType() >= int()
Traceback for above exception (most recent call last):
File
"<https://builds.apache.org/job/beam_PostCommit_Python35/ws/src/sdks/python/apache_beam/utils/retry.py";,>
line 209, in wrapper
return fun(*args, **kwargs)
File
"<https://builds.apache.org/job/beam_PostCommit_Python35/ws/src/sdks/python/apache_beam/io/gcp/gcsio.py";,>
line 466, in list_prefix
response = self.client.objects.List(request)
File
"<https://builds.apache.org/job/beam_PostCommit_Python35/ws/src/sdks/python/apache_beam/io/gcp/internal/clients/storage/storage_v1_client.py";,>
line 1182, in List
config, request, global_params=global_params)
File
"<https://builds.apache.org/job/beam_PostCommit_Python35/ws/src/build/gradleenv/1398941889/lib/python3.5/site-packages/apitools/base/py/base_api.py";,>
line 729, in _RunMethod
http, http_request, **opts)
File
"<https://builds.apache.org/job/beam_PostCommit_Python35/ws/src/build/gradleenv/1398941889/lib/python3.5/site-packages/apitools/base/py/http_wrapper.py";,>
line 356, in MakeRequest
max_retry_wait, total_wait_sec))
File
"<https://builds.apache.org/job/beam_PostCommit_Python35/ws/src/sdks/python/apache_beam/io/gcp/gcsio_overrides.py";,>
line 45, in retry_func
return http_wrapper.HandleExceptionsAndRebuildHttpConnections(retry_args)
File
"<https://builds.apache.org/job/beam_PostCommit_Python35/ws/src/build/gradleenv/1398941889/lib/python3.5/site-packages/apitools/base/py/http_wrapper.py";,>
line 290, in HandleExceptionsAndRebuildHttpConnections
retry_args.exc.status >= 500)):
apache_beam.io.gcp.gcsio: INFO: Starting the size estimation of the input
oauth2client.transport: INFO: Attempting refresh to obtain initial access_token
apache_beam.utils.retry: WARNING: Retry with exponential backoff: waiting for
158.1732066188481 seconds before retrying list_prefix because we caught
exception: TypeError: unorderable types: NoneType() >= int()
Traceback for above exception (most recent call last):
File
"<https://builds.apache.org/job/beam_PostCommit_Python35/ws/src/sdks/python/apache_beam/utils/retry.py";,>
line 209, in wrapper
return fun(*args, **kwargs)
File
"<https://builds.apache.org/job/beam_PostCommit_Python35/ws/src/sdks/python/apache_beam/io/gcp/gcsio.py";,>
line 466, in list_prefix
response = self.client.objects.List(request)
File
"<https://builds.apache.org/job/beam_PostCommit_Python35/ws/src/sdks/python/apache_beam/io/gcp/internal/clients/storage/storage_v1_client.py";,>
line 1182, in List
config, request, global_params=global_params)
File
"<https://builds.apache.org/job/beam_PostCommit_Python35/ws/src/build/gradleenv/1398941889/lib/python3.5/site-packages/apitools/base/py/base_api.py";,>
line 729, in _RunMethod
http, http_request, **opts)
File
"<https://builds.apache.org/job/beam_PostCommit_Python35/ws/src/build/gradleenv/1398941889/lib/python3.5/site-packages/apitools/base/py/http_wrapper.py";,>
line 356, in MakeRequest
max_retry_wait, total_wait_sec))
File
"<https://builds.apache.org/job/beam_PostCommit_Python35/ws/src/sdks/python/apache_beam/io/gcp/gcsio_overrides.py";,>
line 45, in retry_func
return http_wrapper.HandleExceptionsAndRebuildHttpConnections(retry_args)
File
"<https://builds.apache.org/job/beam_PostCommit_Python35/ws/src/build/gradleenv/1398941889/lib/python3.5/site-packages/apitools/base/py/http_wrapper.py";,>
line 290, in HandleExceptionsAndRebuildHttpConnections
retry_args.exc.status >= 500)):
apache_beam.io.gcp.gcsio: INFO: Starting the size estimation of the input
oauth2client.transport: INFO: Attempting refresh to obtain initial access_token
apache_beam.utils.retry: WARNING: Retry with exponential backoff: waiting for
178.02096749031904 seconds before retrying list_prefix because we caught
exception: TypeError: unorderable types: NoneType() >= int()
Traceback for above exception (most recent call last):
File
"<https://builds.apache.org/job/beam_PostCommit_Python35/ws/src/sdks/python/apache_beam/utils/retry.py";,>
line 209, in wrapper
return fun(*args, **kwargs)
File
"<https://builds.apache.org/job/beam_PostCommit_Python35/ws/src/sdks/python/apache_beam/io/gcp/gcsio.py";,>
line 466, in list_prefix
response = self.client.objects.List(request)
File
"<https://builds.apache.org/job/beam_PostCommit_Python35/ws/src/sdks/python/apache_beam/io/gcp/internal/clients/storage/storage_v1_client.py";,>
line 1182, in List
config, request, global_params=global_params)
File
"<https://builds.apache.org/job/beam_PostCommit_Python35/ws/src/build/gradleenv/1398941889/lib/python3.5/site-packages/apitools/base/py/base_api.py";,>
line 729, in _RunMethod
http, http_request, **opts)
File
"<https://builds.apache.org/job/beam_PostCommit_Python35/ws/src/build/gradleenv/1398941889/lib/python3.5/site-packages/apitools/base/py/http_wrapper.py";,>
line 356, in MakeRequest
max_retry_wait, total_wait_sec))
File
"<https://builds.apache.org/job/beam_PostCommit_Python35/ws/src/sdks/python/apache_beam/io/gcp/gcsio_overrides.py";,>
line 45, in retry_func
return http_wrapper.HandleExceptionsAndRebuildHttpConnections(retry_args)
File
"<https://builds.apache.org/job/beam_PostCommit_Python35/ws/src/build/gradleenv/1398941889/lib/python3.5/site-packages/apitools/base/py/http_wrapper.py";,>
line 290, in HandleExceptionsAndRebuildHttpConnections
retry_args.exc.status >= 500)):
apache_beam.io.gcp.gcsio: INFO: Starting the size estimation of the input
oauth2client.transport: INFO: Attempting refresh to obtain initial access_token
apache_beam.io.gcp.gcsio: INFO: Finished listing 0 files in 0.0792536735534668
seconds.
--------------------- >> end captured logging << ---------------------
----------------------------------------------------------------------
XML: nosetests-postCommitIT-direct-py35.xml
----------------------------------------------------------------------
XML:
<https://builds.apache.org/job/beam_PostCommit_Python35/ws/src/sdks/python/nosetests.xml>
----------------------------------------------------------------------
Ran 15 tests in 1946.955s
FAILED (errors=15)
> Task :sdks:python:test-suites:direct:py35:postCommitIT FAILED
FAILURE: Build completed with 3 failures.
1: Task failed with an exception.
-----------
* What went wrong:
Execution failed for task
':sdks:python:test-suites:portable:py35:installGcpTest'.
> Process 'command 'sh'' finished with non-zero exit value 1
* Try:
Run with --stacktrace option to get the stack trace. Run with --info or --debug
option to get more log output. Run with --scan to get full insights.
==============================================================================
2: Task failed with an exception.
-----------
* Where:
Build file
'<https://builds.apache.org/job/beam_PostCommit_Python35/ws/src/sdks/python/test-suites/dataflow/py35/build.gradle'>
line: 56
* What went wrong:
Execution failed for task ':sdks:python:test-suites:dataflow:py35:postCommitIT'.
> Process 'command 'sh'' finished with non-zero exit value 1
* Try:
Run with --stacktrace option to get the stack trace. Run with --info or --debug
option to get more log output. Run with --scan to get full insights.
==============================================================================
3: Task failed with an exception.
-----------
* Where:
Build file
'<https://builds.apache.org/job/beam_PostCommit_Python35/ws/src/sdks/python/test-suites/direct/py35/build.gradle'>
line: 51
* What went wrong:
Execution failed for task ':sdks:python:test-suites:direct:py35:postCommitIT'.
> Process 'command 'sh'' finished with non-zero exit value 1
* Try:
Run with --stacktrace option to get the stack trace. Run with --info or --debug
option to get more log output. Run with --scan to get full insights.
==============================================================================
* Get more help at https://help.gradle.org
Deprecated Gradle features were used in this build, making it incompatible with
Gradle 6.0.
Use '--warning-mode all' to show the individual deprecation warnings.
See
https://docs.gradle.org/5.2.1/userguide/command_line_interface.html#sec:command_line_warnings
BUILD FAILED in 33m 46s
80 actionable tasks: 59 executed, 21 from cache
Publishing build scan...
https://gradle.com/s/7cghfhwcnjpxc
Build step 'Invoke Gradle script' changed build result to FAILURE
Build step 'Invoke Gradle script' marked build as failure
---------------------------------------------------------------------
To unsubscribe, e-mail: [email protected]
For additional commands, e-mail: [email protected]
