See
<https://ci-beam.apache.org/job/beam_PostCommit_Py_ValCont/10273/display/redirect>
Changes:
------------------------------------------
[...truncated 339.51 KB...]
if _mswindows:
# Windows accumulates the output in a single blocking
# read() call run on child threads, with the timeout
# being done in a join() on those threads. communicate()
# _after_ kill() is required to collect that and add it
# to the exception.
exc.stdout, exc.stderr = process.communicate()
else:
# POSIX _communicate already populated the output so
# far into the TimeoutExpired exception.
process.wait()
raise
except: # Including KeyboardInterrupt, communicate handled that.
process.kill()
# We don't call process.wait() as .__exit__ does that for us.
raise
retcode = process.poll()
if check and retcode:
> raise CalledProcessError(retcode, process.args,
output=stdout, stderr=stderr)
E subprocess.CalledProcessError: Command '['docker', 'build',
'.', '-t',
'us.gcr.io/apache-beam-testing/jenkins/prebuild_python310_sdk/beam_python_prebuilt_sdk:b3636381-42a8-45f2-ae65-c052e00d582f']'
returned non-zero exit status 1.
/usr/lib/python3.10/subprocess.py:524: CalledProcessError
During handling of the above exception, another exception occurred:
self = <apache_beam.examples.wordcount_it_test.WordCountIT
testMethod=test_wordcount_it_with_prebuilt_sdk_container_local_docker>
@pytest.mark.it_validatescontainer
def test_wordcount_it_with_prebuilt_sdk_container_local_docker(self):
> self._run_wordcount_it(
wordcount.run,
experiment='beam_fn_api',
prebuild_sdk_container_engine='local_docker')
apache_beam/examples/wordcount_it_test.py:99:
_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _
apache_beam/examples/wordcount_it_test.py:153: in _run_wordcount_it
run_wordcount(
apache_beam/examples/wordcount.py:87: in run
with beam.Pipeline(options=pipeline_options) as p:
apache_beam/pipeline.py:600: in __exit__
self.result = self.run()
apache_beam/pipeline.py:553: in run
self._options).run(False)
apache_beam/pipeline.py:577: in run
return self.runner.run_pipeline(self, self._options)
apache_beam/runners/dataflow/test_dataflow_runner.py:53: in run_pipeline
self.result = super().run_pipeline(pipeline, options)
apache_beam/runners/dataflow/dataflow_runner.py:437: in run_pipeline
environments.DockerEnvironment.from_options(options))
apache_beam/transforms/environments.py:340: in from_options
prebuilt_container_image = SdkContainerImageBuilder.build_container_image(
apache_beam/runners/portability/sdk_container_builder.py:140: in
build_container_image
return builder._build()
apache_beam/runners/portability/sdk_container_builder.py:91: in _build
self._invoke_docker_build_and_push(container_image_name)
_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _
self =
<apache_beam.runners.portability.sdk_container_builder._SdkContainerImageLocalBuilder
object at 0x7f451fef5e10>
container_image_name =
'us.gcr.io/apache-beam-testing/jenkins/prebuild_python310_sdk/beam_python_prebuilt_sdk:b3636381-42a8-45f2-ae65-c052e00d582f'
def _invoke_docker_build_and_push(self, container_image_name):
try:
_LOGGER.info("Building sdk container, this may take a few minutes...")
now = time.time()
subprocess.run(['docker', 'build', '.', '-t', container_image_name],
check=True,
cwd=self._temp_src_dir)
except subprocess.CalledProcessError as err:
> raise RuntimeError(
'Failed to build sdk container with local docker, '
'stderr:\n %s.' % err.stderr)
E RuntimeError: Failed to build sdk container with local docker, stderr:
E None.
apache_beam/runners/portability/sdk_container_builder.py:175: RuntimeError
=============================== warnings summary ===============================
../../build/gradleenv/2050596098/lib/python3.10/site-packages/hdfs/config.py:15
../../build/gradleenv/2050596098/lib/python3.10/site-packages/hdfs/config.py:15
<https://ci-beam.apache.org/job/beam_PostCommit_Py_ValCont/ws/src/build/gradleenv/2050596098/lib/python3.10/site-packages/hdfs/config.py>:15:
DeprecationWarning: the imp module is deprecated in favour of importlib and
slated for removal in Python 3.12; see the module's documentation for
alternative uses
from imp import load_source
../../build/gradleenv/2050596098/lib/python3.10/site-packages/google/api_core/operations_v1/abstract_operations_client.py:17
<https://ci-beam.apache.org/job/beam_PostCommit_Py_ValCont/ws/src/build/gradleenv/2050596098/lib/python3.10/site-packages/google/api_core/operations_v1/abstract_operations_client.py>:17:
DeprecationWarning: The distutils package is deprecated and slated for removal
in Python 3.12. Use setuptools or check PEP 632 for potential alternatives
from distutils import util
../../build/gradleenv/2050596098/lib/python3.10/site-packages/tenacity/_asyncio.py:42
<https://ci-beam.apache.org/job/beam_PostCommit_Py_ValCont/ws/src/build/gradleenv/2050596098/lib/python3.10/site-packages/tenacity/_asyncio.py>:42:
DeprecationWarning: "@coroutine" decorator is deprecated since Python 3.8, use
"async def" instead
def call(self, fn, *args, **kwargs):
apache_beam/typehints/pandas_type_compatibility_test.py:67
<https://ci-beam.apache.org/job/beam_PostCommit_Py_ValCont/ws/src/sdks/python/apache_beam/typehints/pandas_type_compatibility_test.py>:67:
FutureWarning: pandas.Int64Index is deprecated and will be removed from pandas
in a future version. Use pandas.Index with the appropriate dtype instead.
}).set_index(pd.Int64Index(range(123, 223), name='an_index')),
apache_beam/typehints/pandas_type_compatibility_test.py:90
<https://ci-beam.apache.org/job/beam_PostCommit_Py_ValCont/ws/src/sdks/python/apache_beam/typehints/pandas_type_compatibility_test.py>:90:
FutureWarning: pandas.Int64Index is deprecated and will be removed from pandas
in a future version. Use pandas.Index with the appropriate dtype instead.
pd.Int64Index(range(123, 223), name='an_index'),
apache_beam/typehints/pandas_type_compatibility_test.py:91
<https://ci-beam.apache.org/job/beam_PostCommit_Py_ValCont/ws/src/sdks/python/apache_beam/typehints/pandas_type_compatibility_test.py>:91:
FutureWarning: pandas.Int64Index is deprecated and will be removed from pandas
in a future version. Use pandas.Index with the appropriate dtype instead.
pd.Int64Index(range(475, 575), name='another_index'),
-- Docs: https://docs.pytest.org/en/stable/how-to/capture-warnings.html
- generated xml file:
<https://ci-beam.apache.org/job/beam_PostCommit_Py_ValCont/ws/src/sdks/python/pytest-beam_python3.10_sdk.xml>
-
=========================== short test summary info ============================
FAILED
apache_beam/examples/wordcount_it_test.py::WordCountIT::test_wordcount_it_with_prebuilt_sdk_container_local_docker
- RuntimeError: Failed to build sdk container with local docker, stderr:
None.
======= 1 failed, 3 passed, 7 skipped, 7 warnings in 1793.21s (0:29:53) ========
cleanup_container
Untagged:
us.gcr.io/apache-beam-testing/jenkins/beam_python3.10_sdk:20230206-105848736237008
Untagged:
us.gcr.io/apache-beam-testing/jenkins/beam_python3.10_sdk@sha256:843a3701b5673d97b8bf12c16b9a6887ec8e8f70b093ce92d8eada8544e16a8f
Deleted: sha256:8cd1eda31458611f3feca950285f480c58949492ebbf493d7cd117d4b0e89c50
Deleted: sha256:9707bc1d05d07ef2267b20c4d74f74fbeb50121d514fd6c3d8504808980fe385
Deleted: sha256:39d6062ba939b5e0f87588303604f6c80eb87fe135d13db06c6f528e24630fe4
Deleted: sha256:56e6bf2d94121bc9e6d8641d08509f1c3fb8683cca52f2637a3c005d2ee1cc44
WARNING: Successfully resolved tag to sha256, but it is recommended to use
sha256 directly.
Digests:
-
us.gcr.io/apache-beam-testing/jenkins/beam_python3.10_sdk@sha256:843a3701b5673d97b8bf12c16b9a6887ec8e8f70b093ce92d8eada8544e16a8f
Associated tags:
- 20230206-105848736237008
Tags:
-
us.gcr.io/apache-beam-testing/jenkins/beam_python3.10_sdk:20230206-105848736237008
Deleted
[us.gcr.io/apache-beam-testing/jenkins/beam_python3.10_sdk:20230206-105848736237008].
Deleted
[us.gcr.io/apache-beam-testing/jenkins/beam_python3.10_sdk@sha256:843a3701b5673d97b8bf12c16b9a6887ec8e8f70b093ce92d8eada8544e16a8f].
Digests:
-
us.gcr.io/apache-beam-testing/jenkins/prebuild_python310_sdk/beam_python_prebuilt_sdk@sha256:20f1a9a3d7e300a2a8416b8c13eb934d71c8dc3745435f79cb041a4fec07b51a
Associated tags:
- 355c1dfb-c076-4d99-83c0-08aad444dc37
Deleted
[us.gcr.io/apache-beam-testing/jenkins/prebuild_python310_sdk/beam_python_prebuilt_sdk:355c1dfb-c076-4d99-83c0-08aad444dc37].
Deleted
[us.gcr.io/apache-beam-testing/jenkins/prebuild_python310_sdk/beam_python_prebuilt_sdk@sha256:20f1a9a3d7e300a2a8416b8c13eb934d71c8dc3745435f79cb041a4fec07b51a].
Removed the container
> Task :sdks:python:test-suites:dataflow:py310:validatesContainer FAILED
> Task :sdks:python:test-suites:dataflow:py38:validatesContainer
cleanup_container
WARNING: Successfully resolved tag to sha256, but it is recommended to use
sha256 directly.
Digests:
-
us.gcr.io/apache-beam-testing/jenkins/beam_python3.8_sdk@sha256:7f950e8f6928dde8fde14bb25341b2498f613d8c2af509c70335b8605eeba027
Associated tags:
- 20230206-110116870849963
Tags:
-
us.gcr.io/apache-beam-testing/jenkins/beam_python3.8_sdk:20230206-110116870849963
Deleted
[us.gcr.io/apache-beam-testing/jenkins/beam_python3.8_sdk:20230206-110116870849963].
Deleted
[us.gcr.io/apache-beam-testing/jenkins/beam_python3.8_sdk@sha256:7f950e8f6928dde8fde14bb25341b2498f613d8c2af509c70335b8605eeba027].
Digests:
-
us.gcr.io/apache-beam-testing/jenkins/prebuild_python38_sdk/beam_python_prebuilt_sdk@sha256:218e1b722975518a66a0871d3aafd643c0c6c988e8eb27f3338a95f5d1619fc0
Associated tags:
- 4300fb7e-2782-485f-b7ac-c1fb3fa60769
Deleted
[us.gcr.io/apache-beam-testing/jenkins/prebuild_python38_sdk/beam_python_prebuilt_sdk:4300fb7e-2782-485f-b7ac-c1fb3fa60769].
Deleted
[us.gcr.io/apache-beam-testing/jenkins/prebuild_python38_sdk/beam_python_prebuilt_sdk@sha256:218e1b722975518a66a0871d3aafd643c0c6c988e8eb27f3338a95f5d1619fc0].
> Task :sdks:python:test-suites:dataflow:py38:validatesContainer FAILED
> Task :sdks:python:test-suites:dataflow:py39:validatesContainer
cleanup_container
WARNING: Successfully resolved tag to sha256, but it is recommended to use
sha256 directly.
Digests:
-
us.gcr.io/apache-beam-testing/jenkins/beam_python3.9_sdk@sha256:a01ab8d50c29469a3c7dd8b96d2924f597b682de389f4561ed5fe38e2985be82
Associated tags:
- 20230206-105940812683697
Tags:
-
us.gcr.io/apache-beam-testing/jenkins/beam_python3.9_sdk:20230206-105940812683697
Deleted
[us.gcr.io/apache-beam-testing/jenkins/beam_python3.9_sdk:20230206-105940812683697].
Deleted
[us.gcr.io/apache-beam-testing/jenkins/beam_python3.9_sdk@sha256:a01ab8d50c29469a3c7dd8b96d2924f597b682de389f4561ed5fe38e2985be82].
Digests:
-
us.gcr.io/apache-beam-testing/jenkins/prebuild_python39_sdk/beam_python_prebuilt_sdk@sha256:ddd34866e6502e022d0ddbcc5968724094de2557a187f80ac543d4e3013ce463
Associated tags:
- a3f629a0-6c8b-46ed-ab99-bfe90d811350
Deleted
[us.gcr.io/apache-beam-testing/jenkins/prebuild_python39_sdk/beam_python_prebuilt_sdk:a3f629a0-6c8b-46ed-ab99-bfe90d811350].
Deleted
[us.gcr.io/apache-beam-testing/jenkins/prebuild_python39_sdk/beam_python_prebuilt_sdk@sha256:ddd34866e6502e022d0ddbcc5968724094de2557a187f80ac543d4e3013ce463].
> Task :sdks:python:test-suites:dataflow:py39:validatesContainer FAILED
FAILURE: Build completed with 4 failures.
1: Task failed with an exception.
-----------
* Where:
Script
'<https://ci-beam.apache.org/job/beam_PostCommit_Py_ValCont/ws/src/sdks/python/test-suites/dataflow/common.gradle'>
line: 331
* What went wrong:
Execution failed for task
':sdks:python:test-suites:dataflow:py37:validatesContainer'.
> Process 'command 'sh'' finished with non-zero exit value 1
* Try:
> Run with --stacktrace option to get the stack trace.
> Run with --info or --debug option to get more log output.
==============================================================================
2: Task failed with an exception.
-----------
* Where:
Script
'<https://ci-beam.apache.org/job/beam_PostCommit_Py_ValCont/ws/src/sdks/python/test-suites/dataflow/common.gradle'>
line: 331
* What went wrong:
Execution failed for task
':sdks:python:test-suites:dataflow:py310:validatesContainer'.
> Process 'command 'sh'' finished with non-zero exit value 1
* Try:
> Run with --stacktrace option to get the stack trace.
> Run with --info or --debug option to get more log output.
==============================================================================
3: Task failed with an exception.
-----------
* Where:
Script
'<https://ci-beam.apache.org/job/beam_PostCommit_Py_ValCont/ws/src/sdks/python/test-suites/dataflow/common.gradle'>
line: 331
* What went wrong:
Execution failed for task
':sdks:python:test-suites:dataflow:py38:validatesContainer'.
> Process 'command 'sh'' finished with non-zero exit value 1
* Try:
> Run with --stacktrace option to get the stack trace.
> Run with --info or --debug option to get more log output.
==============================================================================
4: Task failed with an exception.
-----------
* Where:
Script
'<https://ci-beam.apache.org/job/beam_PostCommit_Py_ValCont/ws/src/sdks/python/test-suites/dataflow/common.gradle'>
line: 331
* What went wrong:
Execution failed for task
':sdks:python:test-suites:dataflow:py39:validatesContainer'.
> Process 'command 'sh'' finished with non-zero exit value 1
* Try:
> Run with --stacktrace option to get the stack trace.
> Run with --info or --debug option to get more log output.
==============================================================================
* Get more help at https://help.gradle.org
Deprecated Gradle features were used in this build, making it incompatible with
Gradle 8.0.
You can use '--warning-mode all' to show the individual deprecation warnings
and determine if they come from your own scripts or plugins.
See
https://docs.gradle.org/7.5.1/userguide/command_line_interface.html#sec:command_line_warnings
BUILD FAILED in 52m 31s
62 actionable tasks: 51 executed, 4 from cache, 7 up-to-date
Publishing build scan...
https://gradle.com/s/b4xdnyyzwntdk
Build step 'Invoke Gradle script' changed build result to FAILURE
Build step 'Invoke Gradle script' marked build as failure
---------------------------------------------------------------------
To unsubscribe, e-mail: [email protected]
For additional commands, e-mail: [email protected]
