See
<https://ci-beam.apache.org/job/beam_PostCommit_Python39/656/display/redirect?page=changes>
Changes:
[noreply] 21730 fix offset resetting (#22450)
[noreply] Bump google.golang.org/api from 0.88.0 to 0.89.0 in /sdks (#22464)
------------------------------------------
[...truncated 24.17 MB...]
INFO apache_beam.utils.subprocess_server:subprocess_server.py:126 INFO:
CHAIN MapPartition (MapPartition at [2]Read from
jdbc/JdbcIO.ReadRows/JdbcIO.Read/{Create.Values, JdbcIO.ReadAll}) -> FlatMap
(FlatMap at ExtractOutput[0]) (13/16)#0 (5576e8faf8a68fa4faeb7de36d5816a9)
switched from INITIALIZING to RUNNING.
INFO apache_beam.utils.subprocess_server:subprocess_server.py:126 Jul 27,
2022 6:20:25 PM org.apache.flink.runtime.metrics.groups.TaskMetricGroup
getOrAddOperator
INFO apache_beam.utils.subprocess_server:subprocess_server.py:126 WARNING:
The operator name MapPartition (MapPartition at [2]Read from
jdbc/JdbcIO.ReadRows/JdbcIO.Read/{Create.Values, JdbcIO.ReadAll}) exceeded the
80 characters length limit and was truncated.
INFO apache_beam.utils.subprocess_server:subprocess_server.py:126 Jul 27,
2022 6:20:25 PM
org.apache.flink.runtime.io.network.partition.SortMergeResultPartition setup
INFO apache_beam.utils.subprocess_server:subprocess_server.py:126 INFO:
Sort-merge partition
9f31e27894669b921e1b88e8cae681ae#15@4bd66547d22a398ce0ecc84a4d89f966
initialized, num sort buffers: 16, num write buffers: 0.
INFO apache_beam.utils.subprocess_server:subprocess_server.py:126 Jul 27,
2022 6:20:25 PM
org.apache.flink.runtime.io.network.partition.SortMergeResultPartition setup
INFO apache_beam.utils.subprocess_server:subprocess_server.py:126 INFO:
Sort-merge partition
2187f060a768aae896d0cc927507bee4#15@4bd66547d22a398ce0ecc84a4d89f966
initialized, num sort buffers: 16, num write buffers: 0.
INFO apache_beam.utils.subprocess_server:subprocess_server.py:126 Jul 27,
2022 6:20:25 PM org.apache.flink.runtime.taskmanager.Task transitionState
INFO apache_beam.utils.subprocess_server:subprocess_server.py:126 INFO:
CHAIN MapPartition (MapPartition at [2]Read from
jdbc/JdbcIO.ReadRows/JdbcIO.Read/{Create.Values, JdbcIO.ReadAll}) -> FlatMap
(FlatMap at ExtractOutput[0]) (16/16)#0 (4bd66547d22a398ce0ecc84a4d89f966)
switched from DEPLOYING to INITIALIZING.
INFO apache_beam.utils.subprocess_server:subprocess_server.py:126 Jul 27,
2022 6:20:25 PM org.apache.flink.runtime.taskmanager.Task transitionState
INFO apache_beam.utils.subprocess_server:subprocess_server.py:126 INFO:
CHAIN MapPartition (MapPartition at [2]Read from
jdbc/JdbcIO.ReadRows/JdbcIO.Read/{Create.Values, JdbcIO.ReadAll}) -> FlatMap
(FlatMap at ExtractOutput[0]) (16/16)#0 (4bd66547d22a398ce0ecc84a4d89f966)
switched from INITIALIZING to RUNNING.
INFO apache_beam.utils.subprocess_server:subprocess_server.py:126 Jul 27,
2022 6:20:25 PM org.apache.flink.runtime.metrics.groups.TaskMetricGroup
getOrAddOperator
INFO apache_beam.utils.subprocess_server:subprocess_server.py:126 WARNING:
The operator name MapPartition (MapPartition at [2]Read from
jdbc/JdbcIO.ReadRows/JdbcIO.Read/{Create.Values, JdbcIO.ReadAll}) exceeded the
80 characters length limit and was truncated.
INFO apache_beam.utils.subprocess_server:subprocess_server.py:126 Jul 27,
2022 6:20:25 PM
org.apache.flink.runtime.io.network.partition.SortMergeResultPartition setup
INFO apache_beam.utils.subprocess_server:subprocess_server.py:126 INFO:
Sort-merge partition
9f31e27894669b921e1b88e8cae681ae#14@4f9ae6db119a1fc47f59d8614bef8ce8
initialized, num sort buffers: 16, num write buffers: 0.
INFO apache_beam.utils.subprocess_server:subprocess_server.py:126 Jul 27,
2022 6:20:25 PM
org.apache.flink.runtime.io.network.partition.SortMergeResultPartition setup
INFO apache_beam.utils.subprocess_server:subprocess_server.py:126 INFO:
Sort-merge partition
9f31e27894669b921e1b88e8cae681ae#13@7c2041ad1d1678258eeab557f7c362b8
initialized, num sort buffers: 16, num write buffers: 0.
INFO apache_beam.utils.subprocess_server:subprocess_server.py:126 Jul 27,
2022 6:20:25 PM
org.apache.flink.runtime.io.network.partition.SortMergeResultPartition setup
INFO apache_beam.utils.subprocess_server:subprocess_server.py:126 INFO:
Sort-merge partition
2187f060a768aae896d0cc927507bee4#14@4f9ae6db119a1fc47f59d8614bef8ce8
initialized, num sort buffers: 16, num write buffers: 0.
INFO apache_beam.utils.subprocess_server:subprocess_server.py:126 Jul 27,
2022 6:20:25 PM
org.apache.flink.runtime.io.network.partition.SortMergeResultPartition setup
INFO apache_beam.utils.subprocess_server:subprocess_server.py:126 INFO:
Sort-merge partition
2187f060a768aae896d0cc927507bee4#13@7c2041ad1d1678258eeab557f7c362b8
initialized, num sort buffers: 16, num write buffers: 0.
INFO apache_beam.utils.subprocess_server:subprocess_server.py:126 Jul 27,
2022 6:20:25 PM org.apache.flink.runtime.taskmanager.Task transitionState
INFO apache_beam.utils.subprocess_server:subprocess_server.py:126 INFO:
CHAIN MapPartition (MapPartition at [2]Read from
jdbc/JdbcIO.ReadRows/JdbcIO.Read/{Create.Values, JdbcIO.ReadAll}) -> FlatMap
(FlatMap at ExtractOutput[0]) (15/16)#0 (4f9ae6db119a1fc47f59d8614bef8ce8)
switched from DEPLOYING to INITIALIZING.
INFO apache_beam.utils.subprocess_server:subprocess_server.py:126 Jul 27,
2022 6:20:25 PM org.apache.flink.runtime.taskmanager.Task transitionState
INFO apache_beam.utils.subprocess_server:subprocess_server.py:126 INFO:
CHAIN MapPartition (MapPartition at [2]Read from
jdbc/JdbcIO.ReadRows/JdbcIO.Read/{Create.Values, JdbcIO.ReadAll}) -> FlatMap
(FlatMap at ExtractOutput[0]) (14/16)#0 (7c2041ad1d1678258eeab557f7c362b8)
switched from DEPLOYING to INITIALIZING.
INFO apache_beam.utils.subprocess_server:subprocess_server.py:126 Jul 27,
2022 6:20:25 PM org.apache.flink.runtime.taskmanager.Task transitionState
INFO apache_beam.utils.subprocess_server:subprocess_server.py:126 INFO:
CHAIN MapPartition (MapPartition at [2]Read from
jdbc/JdbcIO.ReadRows/JdbcIO.Read/{Create.Values, JdbcIO.ReadAll}) -> FlatMap
(FlatMap at ExtractOutput[0]) (15/16)#0 (4f9ae6db119a1fc47f59d8614bef8ce8)
switched from INITIALIZING to RUNNING.
INFO apache_beam.utils.subprocess_server:subprocess_server.py:126 Jul 27,
2022 6:20:25 PM org.apache.flink.runtime.taskmanager.Task transitionState
INFO apache_beam.utils.subprocess_server:subprocess_server.py:126 INFO:
CHAIN MapPartition (MapPartition at [2]Read from
jdbc/JdbcIO.ReadRows/JdbcIO.Read/{Create.Values, JdbcIO.ReadAll}) -> FlatMap
(FlatMap at ExtractOutput[0]) (14/16)#0 (7c2041ad1d1678258eeab557f7c362b8)
switched from INITIALIZING to RUNNING.
INFO apache_beam.utils.subprocess_server:subprocess_server.py:126 Jul 27,
2022 6:20:25 PM org.apache.flink.runtime.metrics.groups.TaskMetricGroup
getOrAddOperator
INFO apache_beam.utils.subprocess_server:subprocess_server.py:126 WARNING:
The operator name MapPartition (MapPartition at [2]Read from
jdbc/JdbcIO.ReadRows/JdbcIO.Read/{Create.Values, JdbcIO.ReadAll}) exceeded the
80 characters length limit and was truncated.
INFO apache_beam.utils.subprocess_server:subprocess_server.py:126 Jul 27,
2022 6:20:25 PM org.apache.flink.runtime.metrics.groups.TaskMetricGroup
getOrAddOperator
INFO apache_beam.utils.subprocess_server:subprocess_server.py:126 WARNING:
The operator name MapPartition (MapPartition at [2]Read from
jdbc/JdbcIO.ReadRows/JdbcIO.Read/{Create.Values, JdbcIO.ReadAll}) exceeded the
80 characters length limit and was truncated.
INFO apache_beam.utils.subprocess_server:subprocess_server.py:126 Jul 27,
2022 6:20:25 PM org.apache.flink.runtime.executiongraph.Execution
transitionState
INFO apache_beam.utils.subprocess_server:subprocess_server.py:126 INFO:
CHAIN MapPartition (MapPartition at [2]Read from
jdbc/JdbcIO.ReadRows/JdbcIO.Read/{Create.Values, JdbcIO.ReadAll}) -> FlatMap
(FlatMap at ExtractOutput[0]) (13/16) (5576e8faf8a68fa4faeb7de36d5816a9)
switched from DEPLOYING to INITIALIZING.
INFO apache_beam.utils.subprocess_server:subprocess_server.py:126 Jul 27,
2022 6:20:25 PM org.apache.flink.runtime.executiongraph.Execution
transitionState
INFO apache_beam.utils.subprocess_server:subprocess_server.py:126 INFO:
CHAIN MapPartition (MapPartition at [2]Read from
jdbc/JdbcIO.ReadRows/JdbcIO.Read/{Create.Values, JdbcIO.ReadAll}) -> FlatMap
(FlatMap at ExtractOutput[0]) (13/16) (5576e8faf8a68fa4faeb7de36d5816a9)
switched from INITIALIZING to RUNNING.
INFO apache_beam.utils.subprocess_server:subprocess_server.py:126 Jul 27,
2022 6:20:25 PM org.apache.flink.runtime.executiongraph.Execution
transitionState
INFO apache_beam.utils.subprocess_server:subprocess_server.py:126 INFO:
CHAIN MapPartition (MapPartition at [2]Read from
jdbc/JdbcIO.ReadRows/JdbcIO.Read/{Create.Values, JdbcIO.ReadAll}) -> FlatMap
(FlatMap at ExtractOutput[0]) (16/16) (4bd66547d22a398ce0ecc84a4d89f966)
switched from DEPLOYING to INITIALIZING.
INFO apache_beam.utils.subprocess_server:subprocess_server.py:126 Jul 27,
2022 6:20:25 PM org.apache.flink.runtime.executiongraph.Execution
transitionState
INFO apache_beam.utils.subprocess_server:subprocess_server.py:126 INFO:
CHAIN MapPartition (MapPartition at [2]Read from
jdbc/JdbcIO.ReadRows/JdbcIO.Read/{Create.Values, JdbcIO.ReadAll}) -> FlatMap
(FlatMap at ExtractOutput[0]) (16/16) (4bd66547d22a398ce0ecc84a4d89f966)
switched from INITIALIZING to RUNNING.
INFO apache_beam.utils.subprocess_server:subprocess_server.py:126 Jul 27,
2022 6:20:25 PM org.apache.flink.runtime.executiongraph.Execution
transitionState
INFO apache_beam.utils.subprocess_server:subprocess_server.py:126 INFO:
CHAIN MapPartition (MapPartition at [2]Read from
jdbc/JdbcIO.ReadRows/JdbcIO.Read/{Create.Values, JdbcIO.ReadAll}) -> FlatMap
(FlatMap at ExtractOutput[0]) (15/16) (4f9ae6db119a1fc47f59d8614bef8ce8)
switched from DEPLOYING to INITIALIZING.
INFO apache_beam.utils.subprocess_server:subprocess_server.py:126 Jul 27,
2022 6:20:25 PM org.apache.flink.runtime.executiongraph.Execution
transitionState
INFO apache_beam.utils.subprocess_server:subprocess_server.py:126 INFO:
CHAIN MapPartition (MapPartition at [2]Read from
jdbc/JdbcIO.ReadRows/JdbcIO.Read/{Create.Values, JdbcIO.ReadAll}) -> FlatMap
(FlatMap at ExtractOutput[0]) (14/16) (7c2041ad1d1678258eeab557f7c362b8)
switched from DEPLOYING to INITIALIZING.
INFO apache_beam.utils.subprocess_server:subprocess_server.py:126 Jul 27,
2022 6:20:25 PM org.apache.flink.runtime.executiongraph.Execution
transitionState
INFO apache_beam.utils.subprocess_server:subprocess_server.py:126 INFO:
CHAIN MapPartition (MapPartition at [2]Read from
jdbc/JdbcIO.ReadRows/JdbcIO.Read/{Create.Values, JdbcIO.ReadAll}) -> FlatMap
(FlatMap at ExtractOutput[0]) (15/16) (4f9ae6db119a1fc47f59d8614bef8ce8)
switched from INITIALIZING to RUNNING.
INFO apache_beam.utils.subprocess_server:subprocess_server.py:126 Jul 27,
2022 6:20:25 PM org.apache.flink.runtime.executiongraph.Execution
transitionState
INFO apache_beam.utils.subprocess_server:subprocess_server.py:126 INFO:
CHAIN MapPartition (MapPartition at [2]Read from
jdbc/JdbcIO.ReadRows/JdbcIO.Read/{Create.Values, JdbcIO.ReadAll}) -> FlatMap
(FlatMap at ExtractOutput[0]) (14/16) (7c2041ad1d1678258eeab557f7c362b8)
switched from INITIALIZING to RUNNING.
INFO apache_beam.utils.subprocess_server:subprocess_server.py:126 Jul 27,
2022 6:20:26 PM org.apache.beam.runners.fnexecution.environment.DockerCommand
runImage
INFO apache_beam.utils.subprocess_server:subprocess_server.py:126 WARNING:
Unable to pull docker image apache/beam_java8_sdk:2.41.0.dev, cause: Received
exit code 1 for command 'docker pull apache/beam_java8_sdk:2.41.0.dev'. stderr:
Error response from daemon: manifest for apache/beam_java8_sdk:2.41.0.dev not
found
> Task :sdks:python:container:py39:docker
[91m apache_beam/coders/stream.c: In function
‘__pyx_f_11apache_beam_6coders_6stream_12OutputStream_write_bigendian_double’:
[0m[91m apache_beam/coders/stream.c:3646:185: warning: dereferencing
type-punned pointer will break strict-aliasing rules [-Wstrict-aliasing]
[0m[91m 3646 | __pyx_t_1 = ((struct
__pyx_vtabstruct_11apache_beam_6coders_6stream_OutputStream
*)__pyx_v_self->__pyx_vtab)->write_bigendian_int64(__pyx_v_self, (((int64_t
*)((char *)(&__pyx_v_d)))[0]), 0); if (unlikely(!__pyx_t_1)) __PYX_ERR(1, 99,
__pyx_L1_error)
[0m[91m |
^
[0m[91m apache_beam/coders/stream.c: In function
‘__pyx_f_11apache_beam_6coders_6stream_11InputStream_read_var_int64’:
[0m[91m apache_beam/coders/stream.c:6785:33: warning: comparison of integer
expressions of different signedness: ‘long int’ and ‘long unsigned int’
[-Wsign-compare]
[0m[91m 6785 | __pyx_t_8 = ((__pyx_v_shift >= ((sizeof(int64_t)) * 8))
!= 0);
[0m[91m | ^~
[0m[91m apache_beam/coders/stream.c:6799:33: warning: comparison of integer
expressions of different signedness: ‘long int’ and ‘long unsigned int’
[-Wsign-compare]
[0m[91m 6799 | __pyx_t_8 = ((__pyx_v_shift >= (((sizeof(int64_t)) * 8)
- 1)) != 0);
[0m[91m | ^~
[0m[91m apache_beam/coders/stream.c: In function
‘__pyx_f_11apache_beam_6coders_6stream_11InputStream_read_bigendian_double’:
[0m[91m apache_beam/coders/stream.c:7492:54: warning: dereferencing
type-punned pointer will break strict-aliasing rules [-Wstrict-aliasing]
[0m[91m 7492 | __pyx_r = (((double *)((char *)(&__pyx_v_as_long)))[0]);
[0m[91m | ^
[0m[91m gcc -pthread -shared
build/temp.linux-x86_64-3.9/apache_beam/coders/stream.o -L/usr/local/lib -o
build/lib.linux-x86_64-3.9/apache_beam/coders/stream.cpython-39-x86_64-linux-gnu.so
[0m[91m building 'apache_beam.runners.worker.statesampler_fast' extension
[0m[91m creating build/temp.linux-x86_64-3.9/apache_beam/runners
[0m[91m creating build/temp.linux-x86_64-3.9/apache_beam/runners/worker
[0m[91m gcc -pthread -Wno-unused-result -Wsign-compare -DNDEBUG -g -fwrapv
-O3 -Wall -fPIC -Iapache_beam/runners/worker -I/usr/local/include/python3.9 -c
apache_beam/runners/worker/statesampler_fast.c -o
build/temp.linux-x86_64-3.9/apache_beam/runners/worker/statesampler_fast.o
[0m[91m gcc -pthread -shared
build/temp.linux-x86_64-3.9/apache_beam/runners/worker/statesampler_fast.o
-L/usr/local/lib -o
build/lib.linux-x86_64-3.9/apache_beam/runners/worker/statesampler_fast.cpython-39-x86_64-linux-gnu.so
[0m[91m building 'apache_beam.transforms.cy_dataflow_distribution_counter'
extension
[0m[91m creating build/temp.linux-x86_64-3.9/apache_beam/transforms
[0m[91m gcc -pthread -Wno-unused-result -Wsign-compare -DNDEBUG -g -fwrapv
-O3 -Wall -fPIC -I/usr/local/include/python3.9 -c
apache_beam/transforms/cy_dataflow_distribution_counter.c -o
build/temp.linux-x86_64-3.9/apache_beam/transforms/cy_dataflow_distribution_counter.o
[0m[91m apache_beam/transforms/cy_dataflow_distribution_counter.c: In
function
‘__pyx_f_11apache_beam_10transforms_32cy_dataflow_distribution_counter_get_log10_round_to_floor’:
[0m[91m apache_beam/transforms/cy_dataflow_distribution_counter.c:1894:35:
warning: comparison of integer expressions of different signedness: ‘int64_t’
{aka ‘long int’} and ‘long long unsigned int’ [-Wsign-compare]
[0m[91m 1894 | __pyx_t_1 = ((__pyx_v_element >=
(__pyx_v_11apache_beam_10transforms_32cy_dataflow_distribution_counter_POWER_TEN[__pyx_v_power]))
!= 0);
[0m[91m | ^~
[0m[91m gcc -pthread -shared
build/temp.linux-x86_64-3.9/apache_beam/transforms/cy_dataflow_distribution_counter.o
-L/usr/local/lib -o
build/lib.linux-x86_64-3.9/apache_beam/transforms/cy_dataflow_distribution_counter.cpython-39-x86_64-linux-gnu.so
[0m[91m building 'apache_beam.coders.coder_impl' extension
[0m[91m gcc -pthread -Wno-unused-result -Wsign-compare -DNDEBUG -g -fwrapv
-O3 -Wall -fPIC -I/usr/local/include/python3.9 -c
apache_beam/coders/coder_impl.c -o
build/temp.linux-x86_64-3.9/apache_beam/coders/coder_impl.o
[0m
> Task :sdks:python:test-suites:direct:py39:torchInferenceTest
Using cached torchvision-0.13.0-cp39-cp39-manylinux1_x86_64.whl (19.1 MB)
Collecting pillow>=8.0.0
Using cached Pillow-9.2.0-cp39-cp39-manylinux_2_28_x86_64.whl (3.2 MB)
Collecting transformers>=4.18.0
Downloading transformers-4.21.0-py3-none-any.whl (4.7 MB)
━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━ 4.7/4.7 MB 35.6 MB/s eta 0:00:00
Requirement already satisfied: typing-extensions in
<https://ci-beam.apache.org/job/beam_PostCommit_Python39/ws/src/build/gradleenv/1398941893/lib/python3.9/site-packages>
(from torch>=1.7.1->-r
<https://ci-beam.apache.org/job/beam_PostCommit_Python39/ws/src/sdks/python/apache_beam/ml/inference/torch_tests_requirements.txt>
(line 18)) (4.3.0)
Requirement already satisfied: numpy in
<https://ci-beam.apache.org/job/beam_PostCommit_Python39/ws/src/build/gradleenv/1398941893/lib/python3.9/site-packages>
(from torchvision>=0.8.2->-r
<https://ci-beam.apache.org/job/beam_PostCommit_Python39/ws/src/sdks/python/apache_beam/ml/inference/torch_tests_requirements.txt>
(line 19)) (1.22.4)
Requirement already satisfied: requests in
<https://ci-beam.apache.org/job/beam_PostCommit_Python39/ws/src/build/gradleenv/1398941893/lib/python3.9/site-packages>
(from torchvision>=0.8.2->-r
<https://ci-beam.apache.org/job/beam_PostCommit_Python39/ws/src/sdks/python/apache_beam/ml/inference/torch_tests_requirements.txt>
(line 19)) (2.28.1)
Requirement already satisfied: packaging>=20.0 in
<https://ci-beam.apache.org/job/beam_PostCommit_Python39/ws/src/build/gradleenv/1398941893/lib/python3.9/site-packages>
(from transformers>=4.18.0->-r
<https://ci-beam.apache.org/job/beam_PostCommit_Python39/ws/src/sdks/python/apache_beam/ml/inference/torch_tests_requirements.txt>
(line 21)) (21.3)
Requirement already satisfied: filelock in
<https://ci-beam.apache.org/job/beam_PostCommit_Python39/ws/src/build/gradleenv/1398941893/lib/python3.9/site-packages>
(from transformers>=4.18.0->-r
<https://ci-beam.apache.org/job/beam_PostCommit_Python39/ws/src/sdks/python/apache_beam/ml/inference/torch_tests_requirements.txt>
(line 21)) (3.7.1)
Collecting regex!=2019.12.17
Using cached
regex-2022.7.25-cp39-cp39-manylinux_2_17_x86_64.manylinux2014_x86_64.whl (765
kB)
Collecting tokenizers!=0.11.3,<0.13,>=0.11.1
Using cached
tokenizers-0.12.1-cp39-cp39-manylinux_2_12_x86_64.manylinux2010_x86_64.whl (6.6
MB)
Collecting huggingface-hub<1.0,>=0.1.0
Using cached huggingface_hub-0.8.1-py3-none-any.whl (101 kB)
Collecting tqdm>=4.27
Using cached tqdm-4.64.0-py2.py3-none-any.whl (78 kB)
Requirement already satisfied: pyyaml>=5.1 in
<https://ci-beam.apache.org/job/beam_PostCommit_Python39/ws/src/build/gradleenv/1398941893/lib/python3.9/site-packages>
(from transformers>=4.18.0->-r
<https://ci-beam.apache.org/job/beam_PostCommit_Python39/ws/src/sdks/python/apache_beam/ml/inference/torch_tests_requirements.txt>
(line 21)) (6.0)
Requirement already satisfied: pyparsing!=3.0.5,>=2.0.2 in
<https://ci-beam.apache.org/job/beam_PostCommit_Python39/ws/src/build/gradleenv/1398941893/lib/python3.9/site-packages>
(from packaging>=20.0->transformers>=4.18.0->-r
<https://ci-beam.apache.org/job/beam_PostCommit_Python39/ws/src/sdks/python/apache_beam/ml/inference/torch_tests_requirements.txt>
(line 21)) (3.0.9)
Requirement already satisfied: charset-normalizer<3,>=2 in
<https://ci-beam.apache.org/job/beam_PostCommit_Python39/ws/src/build/gradleenv/1398941893/lib/python3.9/site-packages>
(from requests->torchvision>=0.8.2->-r
<https://ci-beam.apache.org/job/beam_PostCommit_Python39/ws/src/sdks/python/apache_beam/ml/inference/torch_tests_requirements.txt>
(line 19)) (2.1.0)
Requirement already satisfied: certifi>=2017.4.17 in
<https://ci-beam.apache.org/job/beam_PostCommit_Python39/ws/src/build/gradleenv/1398941893/lib/python3.9/site-packages>
(from requests->torchvision>=0.8.2->-r
<https://ci-beam.apache.org/job/beam_PostCommit_Python39/ws/src/sdks/python/apache_beam/ml/inference/torch_tests_requirements.txt>
(line 19)) (2022.6.15)
Requirement already satisfied: urllib3<1.27,>=1.21.1 in
<https://ci-beam.apache.org/job/beam_PostCommit_Python39/ws/src/build/gradleenv/1398941893/lib/python3.9/site-packages>
(from requests->torchvision>=0.8.2->-r
<https://ci-beam.apache.org/job/beam_PostCommit_Python39/ws/src/sdks/python/apache_beam/ml/inference/torch_tests_requirements.txt>
(line 19)) (1.26.11)
Requirement already satisfied: idna<4,>=2.5 in
<https://ci-beam.apache.org/job/beam_PostCommit_Python39/ws/src/build/gradleenv/1398941893/lib/python3.9/site-packages>
(from requests->torchvision>=0.8.2->-r
<https://ci-beam.apache.org/job/beam_PostCommit_Python39/ws/src/sdks/python/apache_beam/ml/inference/torch_tests_requirements.txt>
(line 19)) (3.3)
Installing collected packages: tokenizers, tqdm, torch, regex, pillow,
torchvision, huggingface-hub, transformers
Successfully installed huggingface-hub-0.8.1 pillow-9.2.0 regex-2022.7.25
tokenizers-0.12.1 torch-1.12.0 torchvision-0.13.0 tqdm-4.64.0
transformers-4.21.0
>>> RUNNING integration tests with pipeline options: --runner=TestDirectRunner
>>> --project=apache-beam-testing --region=us-central1
>>> --staging_location=gs://temp-storage-for-end-to-end-tests/staging-it
>>> --temp_location=gs://temp-storage-for-end-to-end-tests/temp-it
>>> --output=gs://temp-storage-for-end-to-end-tests/py-it-cloud/output
>>> --sdk_location=build/apache-beam.tar.gz
>>> --requirements_file=postcommit_requirements.txt --num_workers=1
>>> --sleep_secs=20
>>> --kms_key_name=projects/apache-beam-testing/locations/global/keyRings/beam-it/cryptoKeys/test
>>>
>>> --dataflow_kms_key=projects/apache-beam-testing/locations/global/keyRings/beam-it/cryptoKeys/test
>>> pytest options: --capture=no --numprocesses=8 --timeout=4500 --color=yes
>>> --log-cli-level=INFO
>>> collect markers: -m=uses_pytorch and it_postcommit
> Task :sdks:python:container:py39:docker FAILED
> Task :sdks:python:test-suites:portable:py39:postCommitPy39IT FAILED
INFO apache_beam.utils.subprocess_server:subprocess_server.py:126 Jul 27,
2022 6:20:55 PM org.apache.flink.runtime.blob.AbstractBlobCache close
INFO apache_beam.utils.subprocess_server:subprocess_server.py:126 INFO:
Shutting down BLOB cache
INFO apache_beam.utils.subprocess_server:subprocess_server.py:126 Jul 27,
2022 6:20:55 PM org.apache.flink.runtime.filecache.FileCache shutdown
INFO apache_beam.utils.subprocess_server:subprocess_server.py:126 INFO:
removed file cache directory
/tmp/flink-dist-cache-10e1af7b-7e9b-4077-af44-93aa6b49ca8c
INFO apache_beam.utils.subprocess_server:subprocess_server.py:126 Jul 27,
2022 6:20:55 PM org.apache.flink.runtime.blob.AbstractBlobCache close
INFO apache_beam.utils.subprocess_server:subprocess_server.py:126 INFO:
Shutting down BLOB cache
INFO apache_beam.utils.subprocess_server:subprocess_server.py:126 Jul 27,
2022 6:20:55 PM org.apache.flink.runtime.io.disk.FileChannelManagerImpl
lambda$getFileCloser$0
INFO apache_beam.utils.subprocess_server:subprocess_server.py:126 INFO:
FileChannelManager removed spill file directory
/tmp/flink-io-79b447ec-1af6-4ecc-96ee-b2b8c4ebd003
INFO apache_beam.utils.subprocess_server:subprocess_server.py:126 Jul 27,
2022 6:20:55 PM
org.apache.flink.runtime.state.TaskExecutorLocalStateStoresManager shutdown
INFO apache_beam.utils.subprocess_server:subprocess_server.py:126 INFO:
Shutting down TaskExecutorLocalStateStoresManager.
Terminated
> Task :sdks:python:test-suites:dataflow:py39:postCommitIT
[gw1] node down: Not properly terminated
[gw1] [31mFAILED[0m
apache_beam/examples/streaming_wordcount_it_test.py::StreamingWordCountIT::test_streaming_wordcount_it
replacing crashed worker gw1
Terminated
Remove shutdown hook failed
java.lang.IllegalStateException: Shutdown in progress
at
java.lang.ApplicationShutdownHooks.remove(ApplicationShutdownHooks.java:82)
at java.lang.Runtime.removeShutdownHook(Runtime.java:239)
at
org.gradle.process.internal.shutdown.ShutdownHooks.removeShutdownHook(ShutdownHooks.java:38)
at
org.gradle.process.internal.DefaultExecHandle.setEndStateInfo(DefaultExecHandle.java:208)
at
org.gradle.process.internal.DefaultExecHandle.aborted(DefaultExecHandle.java:365)
at
org.gradle.process.internal.ExecHandleRunner.completed(ExecHandleRunner.java:108)
at
org.gradle.process.internal.ExecHandleRunner.run(ExecHandleRunner.java:84)
at
org.gradle.internal.operations.CurrentBuildOperationPreservingRunnable.run(CurrentBuildOperationPreservingRunnable.java:42)
at
org.gradle.internal.concurrent.ExecutorPolicy$CatchAndRecordFailures.onExecute(ExecutorPolicy.java:64)
at
org.gradle.internal.concurrent.ManagedExecutorImpl$1.run(ManagedExecutorImpl.java:48)
at
java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1149)
at
java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624)
at java.lang.Thread.run(Thread.java:748)
> Task :sdks:python:test-suites:dataflow:py39:postCommitIT FAILED
Daemon will be stopped at the end of the build after the daemon was no longer
found in the daemon registry
> Task :sdks:python:test-suites:direct:py39:torchInferenceTest FAILED
Remove shutdown hook failed
java.lang.IllegalStateException: Shutdown in progress
at
java.lang.ApplicationShutdownHooks.remove(ApplicationShutdownHooks.java:82)
at java.lang.Runtime.removeShutdownHook(Runtime.java:239)
at
org.gradle.process.internal.shutdown.ShutdownHooks.removeShutdownHook(ShutdownHooks.java:38)
at
org.gradle.process.internal.DefaultExecHandle.setEndStateInfo(DefaultExecHandle.java:208)
at
org.gradle.process.internal.DefaultExecHandle.aborted(DefaultExecHandle.java:365)
at
org.gradle.process.internal.ExecHandleRunner.completed(ExecHandleRunner.java:108)
at
org.gradle.process.internal.ExecHandleRunner.run(ExecHandleRunner.java:84)
at
org.gradle.internal.operations.CurrentBuildOperationPreservingRunnable.run(CurrentBuildOperationPreservingRunnable.java:42)
at
org.gradle.internal.concurrent.ExecutorPolicy$CatchAndRecordFailures.onExecute(ExecutorPolicy.java:64)
at
org.gradle.internal.concurrent.ManagedExecutorImpl$1.run(ManagedExecutorImpl.java:48)
at
java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1149)
at
java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624)
at java.lang.Thread.run(Thread.java:748)
> Task :sdks:python:test-suites:direct:py39:postCommitIT FAILED
Remove shutdown hook failed
java.lang.IllegalStateException: Shutdown in progress
at
java.lang.ApplicationShutdownHooks.remove(ApplicationShutdownHooks.java:82)
at java.lang.Runtime.removeShutdownHook(Runtime.java:239)
at
org.gradle.process.internal.shutdown.ShutdownHooks.removeShutdownHook(ShutdownHooks.java:38)
at
org.gradle.process.internal.DefaultExecHandle.setEndStateInfo(DefaultExecHandle.java:208)
at
org.gradle.process.internal.DefaultExecHandle.failed(DefaultExecHandle.java:369)
at
org.gradle.process.internal.ExecHandleRunner.run(ExecHandleRunner.java:87)
at
org.gradle.internal.operations.CurrentBuildOperationPreservingRunnable.run(CurrentBuildOperationPreservingRunnable.java:42)
at
org.gradle.internal.concurrent.ExecutorPolicy$CatchAndRecordFailures.onExecute(ExecutorPolicy.java:64)
at
org.gradle.internal.concurrent.ManagedExecutorImpl$1.run(ManagedExecutorImpl.java:48)
at
java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1149)
at
java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624)
at java.lang.Thread.run(Thread.java:748)
> Task :sdks:python:test-suites:portable:py39:portableWordCountSparkRunnerBatch
> FAILED
Remove shutdown hook failed
java.lang.IllegalStateException: Shutdown in progress
at
java.lang.ApplicationShutdownHooks.remove(ApplicationShutdownHooks.java:82)
at java.lang.Runtime.removeShutdownHook(Runtime.java:239)
at
org.gradle.process.internal.shutdown.ShutdownHooks.removeShutdownHook(ShutdownHooks.java:38)
at
org.gradle.process.internal.DefaultExecHandle.setEndStateInfo(DefaultExecHandle.java:208)
at
org.gradle.process.internal.DefaultExecHandle.aborted(DefaultExecHandle.java:365)
at
org.gradle.process.internal.ExecHandleRunner.completed(ExecHandleRunner.java:108)
at
org.gradle.process.internal.ExecHandleRunner.run(ExecHandleRunner.java:84)
at
org.gradle.internal.operations.CurrentBuildOperationPreservingRunnable.run(CurrentBuildOperationPreservingRunnable.java:42)
at
org.gradle.internal.concurrent.ExecutorPolicy$CatchAndRecordFailures.onExecute(ExecutorPolicy.java:64)
at
org.gradle.internal.concurrent.ManagedExecutorImpl$1.run(ManagedExecutorImpl.java:48)
at
java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1149)
at
java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624)
at java.lang.Thread.run(Thread.java:748)
The message received from the daemon indicates that the daemon has disappeared.
Build request sent: Build{id=ef063824-8f1b-4ca4-8d8e-b37bf57c6101,
currentDir=<https://ci-beam.apache.org/job/beam_PostCommit_Python39/ws/src}>
Attempting to read last messages from the daemon log...
Daemon pid: 3095052
log file: /home/jenkins/.gradle/daemon/7.4/daemon-3095052.out.log
----- Last 20 lines from daemon log file - daemon-3095052.out.log -----
at
org.gradle.internal.concurrent.ExecutorPolicy$CatchAndRecordFailures.onExecute(ExecutorPolicy.java:64)
at
org.gradle.internal.concurrent.ManagedExecutorImpl$1.run(ManagedExecutorImpl.java:48)
at
java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1149)
at
java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624)
at java.lang.Thread.run(Thread.java:748)
Remove shutdown hook failed
java.lang.IllegalStateException: Shutdown in progress
at
java.lang.ApplicationShutdownHooks.remove(ApplicationShutdownHooks.java:82)
at java.lang.Runtime.removeShutdownHook(Runtime.java:239)
at
org.gradle.process.internal.shutdown.ShutdownHooks.removeShutdownHook(ShutdownHooks.java:38)
at
org.gradle.process.internal.DefaultExecHandle.setEndStateInfo(DefaultExecHandle.java:208)
at
org.gradle.process.internal.DefaultExecHandle.aborted(DefaultExecHandle.java:365)
at
org.gradle.process.internal.ExecHandleRunner.completed(ExecHandleRunner.java:108)
at
org.gradle.process.internal.ExecHandleRunner.run(ExecHandleRunner.java:84)
at
org.gradle.internal.operations.CurrentBuildOperationPreservingRunnable.run(CurrentBuildOperationPreservingRunnable.java:42)
at
org.gradle.internal.concurrent.ExecutorPolicy$CatchAndRecordFailures.onExecute(ExecutorPolicy.java:64)
at
org.gradle.internal.concurrent.ManagedExecutorImpl$1.run(ManagedExecutorImpl.java:48)
at
java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1149)
at
java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624)
at java.lang.Thread.run(Thread.java:748)
----- End of the daemon log -----
FAILURE: Build failed with an exception.
* What went wrong:
Gradle build daemon disappeared unexpectedly (it may have been killed or may
have crashed)
* Try:
> Run with --stacktrace option to get the stack trace.
> Run with --info or --debug option to get more log output.
> Run with --scan to get full insights.
* Get more help at https://help.gradle.org
Build step 'Invoke Gradle script' changed build result to FAILURE
Build step 'Invoke Gradle script' marked build as failure
---------------------------------------------------------------------
To unsubscribe, e-mail: [email protected]
For additional commands, e-mail: [email protected]
