See
<https://ci-beam.apache.org/job/beam_PreCommit_Python_PVR_Flink_Cron/3614/display/redirect?page=changes>
Changes:
[noreply] Add recently added notebooks to readme (#26198)
------------------------------------------
[...truncated 65.98 KB...]
Collecting filelock>=3.0.0
Using cached filelock-3.11.0-py3-none-any.whl (10.0 kB)
Collecting packaging>=14
Using cached packaging-23.0-py3-none-any.whl (42 kB)
Collecting pluggy>=0.12.0
Using cached pluggy-1.0.0-py2.py3-none-any.whl (13 kB)
Collecting py>=1.4.17
Using cached py-1.11.0-py2.py3-none-any.whl (98 kB)
Collecting six>=1.14.0
Using cached six-1.16.0-py2.py3-none-any.whl (11 kB)
Collecting toml>=0.9.4
Using cached toml-0.10.2-py2.py3-none-any.whl (16 kB)
Collecting
virtualenv!=20.0.0,!=20.0.1,!=20.0.2,!=20.0.3,!=20.0.4,!=20.0.5,!=20.0.6,!=20.0.7,>=16.0.0
Using cached virtualenv-20.21.0-py3-none-any.whl (8.7 MB)
Collecting protobuf<5.0dev,>=4.21.6
Using cached protobuf-4.22.1-cp37-abi3-manylinux2014_x86_64.whl (302 kB)
Collecting grpcio>=1.51.3
Using cached
grpcio-1.53.0-cp311-cp311-manylinux_2_17_x86_64.manylinux2014_x86_64.whl (4.9
MB)
Collecting types-protobuf>=3.20.4
Using cached types_protobuf-4.22.0.2-py3-none-any.whl (61 kB)
Collecting platformdirs<4,>=2.4
Using cached platformdirs-3.2.0-py3-none-any.whl (14 kB)
Installing collected packages: types-protobuf, distlib, wheel, toml, six,
setuptools, py, protobuf, pluggy, platformdirs, packaging, numpy, grpcio,
filelock, virtualenv, mypy-protobuf, grpcio-tools, tox
Attempting uninstall: setuptools
Found existing installation: setuptools 65.5.0
Uninstalling setuptools-65.5.0:
Successfully uninstalled setuptools-65.5.0
> Task :sdks:java:container:java8:copyJavaThirdPartyLicenses
> Task :release:go-licenses:java:dockerRun
go: downloading google.golang.org/genproto v0.0.0-20230110181048-76db0878b65f
go: downloading golang.org/x/text v0.7.0
go: added github.com/apache/beam/sdks/v2 v2.46.0
go: added github.com/golang/protobuf v1.5.2
go: added golang.org/x/net v0.5.0
go: added golang.org/x/sys v0.5.0
go: added golang.org/x/text v0.7.0
go: added google.golang.org/genproto v0.0.0-20230110181048-76db0878b65f
go: added google.golang.org/grpc v1.52.3
go: added google.golang.org/protobuf v1.28.1
+ go-licenses save github.com/apache/beam/sdks/v2/java/container
--save_path=/output/licenses
W0410 16:03:07.454318 34 library.go:101] "golang.org/x/sys/unix" contains
non-Go code that can't be inspected for further dependencies:
/go/pkg/mod/golang.org/x/[email protected]/unix/asm_linux_amd64.s
+ go-licenses csv github.com/apache/beam/sdks/v2/java/container
+ tee /output/licenses/list.csv
W0410 16:03:13.467889 74 library.go:101] "golang.org/x/sys/unix" contains
non-Go code that can't be inspected for further dependencies:
/go/pkg/mod/golang.org/x/[email protected]/unix/asm_linux_amd64.s
> Task :sdks:python:setupVirtualenv
Successfully installed distlib-0.3.6 filelock-3.11.0 grpcio-1.53.0
grpcio-tools-1.51.3 mypy-protobuf-3.4.0 numpy-1.24.2 packaging-23.0
platformdirs-3.2.0 pluggy-1.0.0 protobuf-4.22.1 py-1.11.0 setuptools-67.6.1
six-1.16.0 toml-0.10.2 tox-3.20.1 types-protobuf-4.22.0.2 virtualenv-20.21.0
wheel-0.40.0
> Task :sdks:python:test-suites:portable:py311:setupVirtualenv
Successfully installed distlib-0.3.6 filelock-3.11.0 grpcio-1.53.0
grpcio-tools-1.51.3 mypy-protobuf-3.4.0 numpy-1.24.2 packaging-23.0
platformdirs-3.2.0 pluggy-1.0.0 protobuf-4.22.1 py-1.11.0 setuptools-67.6.1
six-1.16.0 toml-0.10.2 tox-3.20.1 types-protobuf-4.22.0.2 virtualenv-20.21.0
wheel-0.40.0
> Task :sdks:java:container:goBuild
/home/jenkins/go/bin/go1.20.2 build -o ./build/target/linux_amd64/boot boot.go
boot_test.go
> Task :sdks:java:container:java8:copySdkHarnessLauncher
Execution optimizations have been disabled for task
':sdks:java:container:java8:copySdkHarnessLauncher' to ensure correctness due
to the following reasons:
- Gradle detected a problem with the following location:
'/home/jenkins/jenkins-slave/workspace/beam_PreCommit_Python_PVR_Flink_Cron/src/sdks/java/container/build/target'.
Reason: Task ':sdks:java:container:java8:copySdkHarnessLauncher' uses this
output of task ':sdks:java:container:downloadCloudProfilerAgent' without
declaring an explicit or implicit dependency. This can lead to incorrect
results being produced, depending on what order the tasks are executed. Please
refer to
https://docs.gradle.org/7.5.1/userguide/validation_problems.html#implicit_dependency
for more details about this problem.
- Gradle detected a problem with the following location:
'/home/jenkins/jenkins-slave/workspace/beam_PreCommit_Python_PVR_Flink_Cron/src/sdks/java/container/build/target'.
Reason: Task ':sdks:java:container:java8:copySdkHarnessLauncher' uses this
output of task ':sdks:java:container:pullLicenses' without declaring an
explicit or implicit dependency. This can lead to incorrect results being
produced, depending on what order the tasks are executed. Please refer to
https://docs.gradle.org/7.5.1/userguide/validation_problems.html#implicit_dependency
for more details about this problem.
> Task :sdks:python:sdist
org/apache/beam/model/interactive/v1/beam_interactive_api.proto:36:1: warning:
Import google/protobuf/timestamp.proto is unused.
Writing mypy to org/apache/beam/model/pipeline/v1/external_transforms_pb2.pyi
Writing mypy to org/apache/beam/model/pipeline/v1/beam_runner_api_pb2.pyi
Writing mypy to org/apache/beam/model/pipeline/v1/standard_window_fns_pb2.pyi
Writing mypy to org/apache/beam/model/pipeline/v1/metrics_pb2.pyi
Writing mypy to org/apache/beam/model/pipeline/v1/endpoints_pb2.pyi
Writing mypy to org/apache/beam/model/pipeline/v1/schema_pb2.pyi
Writing mypy to
org/apache/beam/model/job_management/v1/beam_artifact_api_pb2.pyi
Writing mypy to
org/apache/beam/model/job_management/v1/beam_expansion_api_pb2.pyi
Writing mypy to org/apache/beam/model/job_management/v1/beam_job_api_pb2.pyi
Writing mypy to org/apache/beam/model/fn_execution/v1/beam_provision_api_pb2.pyi
Writing mypy to org/apache/beam/model/fn_execution/v1/beam_fn_api_pb2.pyi
Writing mypy to
org/apache/beam/model/interactive/v1/beam_interactive_api_pb2.pyi
/home/jenkins/jenkins-slave/workspace/beam_PreCommit_Python_PVR_Flink_Cron/src/build/gradleenv/1922375555/lib/python3.8/site-packages/setuptools/dist.py:547:
UserWarning: Normalizing '2.48.0.dev' to '2.48.0.dev0'
warnings.warn(tmpl.format(**locals()))
warning: no files found matching 'README.md'
warning: no files found matching 'NOTICE'
warning: no files found matching 'LICENSE'
warning: no files found matching 'LICENSE.python'
warning: sdist: standard file not found: should have one of README, README.rst,
README.txt, README.md
> Task :release:go-licenses:java:dockerRun
github.com/apache/beam/sdks/v2/go/pkg/beam,https://github.com/apache/beam/blob/sdks/v2.46.0/sdks/go/README.md,Apache-2.0
github.com/apache/beam/sdks/v2/java/container,https://github.com/apache/beam/blob/sdks/v2.46.0/sdks/LICENSE,Apache-2.0
github.com/golang/protobuf,https://github.com/golang/protobuf/blob/v1.5.2/LICENSE,BSD-3-Clause
golang.org/x/net,https://cs.opensource.google/go/x/net/+/v0.5.0:LICENSE,BSD-3-Clause
golang.org/x/sys/unix,https://cs.opensource.google/go/x/sys/+/v0.5.0:LICENSE,BSD-3-Clause
golang.org/x/text,https://cs.opensource.google/go/x/text/+/v0.7.0:LICENSE,BSD-3-Clause
google.golang.org/genproto/googleapis/rpc/status,https://github.com/googleapis/go-genproto/blob/76db0878b65f/LICENSE,Apache-2.0
google.golang.org/grpc,https://github.com/grpc/grpc-go/blob/v1.52.3/LICENSE,Apache-2.0
google.golang.org/protobuf,https://github.com/protocolbuffers/protobuf-go/blob/v1.28.1/LICENSE,BSD-3-Clause
+ chmod -R a+w /output/licenses
> Task :release:go-licenses:java:createLicenses
> Task :sdks:java:container:java8:copyGolangLicenses
> Task :sdks:java:container:java8:dockerPrepare
> Task :runners:flink:1.16:compileJava
> Task :sdks:java:container:java8:docker
#1 [internal] load build definition from Dockerfile
#1 transferring dockerfile: 2.85kB done
#1 DONE 0.0s
#2 [internal] load .dockerignore
#2 transferring context: 2B done
#2 DONE 0.0s
#3 [internal] load metadata for docker.io/library/eclipse-temurin:8
#3 DONE 0.3s
#4 [ 1/18] FROM
docker.io/library/eclipse-temurin:8@sha256:005d3189b2ec1612c3ade6eadabd1935c312f03aa7905cf0528e9d71980ad512
#4 resolve
docker.io/library/eclipse-temurin:8@sha256:005d3189b2ec1612c3ade6eadabd1935c312f03aa7905cf0528e9d71980ad512
0.0s done
#4 CACHED
#5 [internal] load build context
#5 transferring context: 46.74MB 0.4s done
#5 DONE 0.4s
#6 [ 2/18] ADD target/slf4j-api.jar /opt/apache/beam/jars/
#6 DONE 1.2s
#7 [ 3/18] ADD target/slf4j-jdk14.jar /opt/apache/beam/jars/
#7 DONE 0.1s
#8 [ 4/18] ADD target/jcl-over-slf4j.jar /opt/apache/beam/jars/
#8 DONE 0.1s
#9 [ 5/18] ADD target/log4j-over-slf4j.jar /opt/apache/beam/jars/
#9 DONE 0.1s
#10 [ 6/18] ADD target/log4j-to-slf4j.jar /opt/apache/beam/jars/
#10 DONE 0.1s
#11 [ 7/18] ADD target/beam-sdks-java-harness.jar /opt/apache/beam/jars/
#11 DONE 0.1s
#12 [ 8/18] COPY target/jamm.jar target/open-module-agent*.jar
/opt/apache/beam/jars/
#12 DONE 0.1s
#13 [ 9/18] COPY target/linux_amd64/boot /opt/apache/beam/
#13 DONE 0.2s
#14 [10/18] COPY target/LICENSE /opt/apache/beam/
#14 DONE 0.1s
#15 [11/18] COPY target/NOTICE /opt/apache/beam/
#15 DONE 0.1s
#16 [12/18] ADD target/third_party_licenses
/opt/apache/beam/third_party_licenses/
#16 DONE 0.3s
#17 [13/18] COPY target/LICENSE target/options/* /opt/apache/beam/options/
#17 DONE 0.1s
#18 [14/18] RUN rm /opt/apache/beam/options/LICENSE
#18 DONE 0.3s
#19 [15/18] COPY target/LICENSE target/go-licenses/*
/opt/apache/beam/third_party_licenses/golang/
#19 DONE 0.1s
#20 [16/18] RUN rm /opt/apache/beam/third_party_licenses/golang/LICENSE
#20 DONE 0.4s
#21 [17/18] RUN if [ "true" = "false" ] ; then rm -rf
/opt/apache/beam/third_party_licenses ; fi
#21 DONE 0.5s
#22 [18/18] COPY target/profiler/* /opt/google_cloud_profiler/
#22 DONE 0.1s
#23 exporting to image
#23 exporting layers
#23 exporting layers 0.3s done
#23 writing image
sha256:40a663a99483b591febc256278a33dfb9965d65e434e08d7e2ad3d9c145687f3 done
#23 naming to docker.io/apache/beam_java8_sdk:2.48.0.dev done
#23 DONE 0.3s
> Task :runners:flink:1.16:compileJava
Note: Some input files use or override a deprecated API.
Note: Recompile with -Xlint:deprecation for details.
Note: Some input files use unchecked or unsafe operations.
Note: Recompile with -Xlint:unchecked for details.
> Task :runners:flink:1.16:classes
> Task :runners:flink:1.16:jar
> Task :runners:flink:1.16:job-server:compileJava NO-SOURCE
> Task :runners:flink:1.16:job-server:classes UP-TO-DATE
> Task :runners:flink:1.16:job-server:shadowJar FROM-CACHE
> Task :sdks:python:test-suites:portable:py311:flinkCompatibilityMatrixLOOPBACK
[1mflink-runner-test create:
/home/jenkins/jenkins-slave/workspace/beam_PreCommit_Python_PVR_Flink_Cron/src/sdks/python/test-suites/portable/py311/build/srcs/sdks/python/target/.tox-flink-runner-test/flink-runner-test
[0m[1mflink-runner-test installdeps: -rbuild-requirements.txt
[0m[1mflink-runner-test inst:
/home/jenkins/jenkins-slave/workspace/beam_PreCommit_Python_PVR_Flink_Cron/src/sdks/python/test-suites/portable/py311/build/srcs/sdks/python/target/.tox-flink-runner-test/.tmp/package/1/apache-beam.tar.gz
[0m[1mflink-runner-test installed: apache-beam @
file:///home/jenkins/jenkins-slave/workspace/beam_PreCommit_Python_PVR_Flink_Cron/src/sdks/python/test-suites/portable/py311/build/srcs/sdks/python/target/.tox-flink-runner-test/.tmp/package/1/apache-beam.tar.gz,attrs==22.2.0,certifi==2022.12.7,cffi==1.15.1,charset-normalizer==3.1.0,cloudpickle==2.2.1,crcmod==1.7,cryptography==40.0.1,deprecation==2.1.0,dill==0.3.1.1,distlib==0.3.6,dnspython==2.3.0,docker==6.0.1,docopt==0.6.2,execnet==1.9.0,fastavro==1.7.3,fasteners==0.18,freezegun==1.2.2,greenlet==2.0.2,grpcio==1.53.0,grpcio-tools==1.51.3,hdfs==2.7.0,httplib2==0.21.0,hypothesis==6.71.0,idna==3.4,iniconfig==2.0.0,joblib==1.2.0,mock==5.0.1,mypy-protobuf==3.4.0,numpy==1.24.2,objsize==0.6.1,orjson==3.8.10,packaging==23.0,pandas==1.5.3,parameterized==0.8.1,pluggy==1.0.0,proto-plus==1.22.2,protobuf==4.22.1,psycopg2-binary==2.9.6,pyarrow==11.0.0,pycparser==2.21,pydot==1.4.2,PyHamcrest==1.10.1,pymongo==4.3.3,PyMySQL==1.0.3,pyparsing==3.0.9,pytest==7.3.0,pytest-timeout==2.1.0,pytest-xdist==3.2.1,python-dateutil==2.8.2,pytz==2023.3,PyYAML==6.0,regex==2023.3.23,requests==2.28.2,requests-mock==1.10.0,scikit-learn==1.2.2,scipy==1.10.1,six==1.16.0,sortedcontainers==2.4.0,SQLAlchemy==1.4.47,tenacity==8.2.2,testcontainers==3.7.1,threadpoolctl==3.1.0,types-protobuf==4.22.0.2,typing_extensions==4.5.0,urllib3==1.26.15,websocket-client==1.5.1,wrapt==1.15.0,zstandard==0.20.0
[0m[1mflink-runner-test run-test-pre: PYTHONHASHSEED='2318728943'
[0m[1mflink-runner-test run-test-pre: commands[0] | python --version
[0mPython 3.11.2
[1mflink-runner-test run-test-pre: commands[1] | pip --version
[0mpip 23.0.1 from
/home/jenkins/jenkins-slave/workspace/beam_PreCommit_Python_PVR_Flink_Cron/src/sdks/python/test-suites/portable/py311/build/srcs/sdks/python/target/.tox-flink-runner-test/flink-runner-test/lib/python3.11/site-packages/pip
(python 3.11)
[1mflink-runner-test run-test-pre: commands[2] | pip check
[0mNo broken requirements found.
[1mflink-runner-test run-test-pre: commands[3] | bash
/home/jenkins/jenkins-slave/workspace/beam_PreCommit_Python_PVR_Flink_Cron/src/sdks/python/test-suites/portable/py311/build/srcs/sdks/python/scripts/run_tox_cleanup.sh
[0m[1mflink-runner-test run-test: commands[0] | bash
/home/jenkins/jenkins-slave/workspace/beam_PreCommit_Python_PVR_Flink_Cron/src/sdks/python/test-suites/portable/py311/build/srcs/sdks/python/scripts/pytest_validates_runner.sh
flink-runner-test
/home/jenkins/jenkins-slave/workspace/beam_PreCommit_Python_PVR_Flink_Cron/src/sdks/python/test-suites/portable/py311/build/srcs/sdks/python/apache_beam/runners/portability/flink_runner_test.py
'--flink_job_server_jar=/home/jenkins/jenkins-slave/workspace/beam_PreCommit_Python_PVR_Flink_Cron/src/runners/flink/1.16/job-server/build/libs/beam-runners-flink-1.16-job-server-2.48.0-SNAPSHOT.jar
--environment_type=LOOPBACK'
[0m============================= test session starts
==============================
platform linux -- Python 3.11.2, pytest-7.3.0, pluggy-1.0.0
cachedir: target/.tox-flink-runner-test/flink-runner-test/.pytest_cache
rootdir:
/home/jenkins/jenkins-slave/workspace/beam_PreCommit_Python_PVR_Flink_Cron/src/sdks/python/test-suites/portable/py311/build/srcs/sdks/python
configfile: pytest.ini
plugins: hypothesis-6.71.0, xdist-3.2.1, timeout-2.1.0, requests-mock-1.10.0
timeout: 600.0s
timeout method: signal
timeout func_only: False
collected 207 items
apache_beam/runners/portability/flink_runner_test.py ......s...s...ss... [ 9%]
FATAL: command execution failed
java.io.IOException: Backing channel 'apache-beam-jenkins-7' is disconnected.
at
hudson.remoting.RemoteInvocationHandler.channelOrFail(RemoteInvocationHandler.java:215)
at
hudson.remoting.RemoteInvocationHandler.invoke(RemoteInvocationHandler.java:285)
at com.sun.proxy.$Proxy133.isAlive(Unknown Source)
at hudson.Launcher$RemoteLauncher$ProcImpl.isAlive(Launcher.java:1215)
at hudson.Launcher$RemoteLauncher$ProcImpl.join(Launcher.java:1207)
at hudson.Launcher$ProcStarter.join(Launcher.java:524)
at hudson.plugins.gradle.Gradle.perform(Gradle.java:317)
at hudson.tasks.BuildStepMonitor$1.perform(BuildStepMonitor.java:20)
at
hudson.model.AbstractBuild$AbstractBuildExecution.perform(AbstractBuild.java:814)
at hudson.model.Build$BuildExecution.build(Build.java:199)
at hudson.model.Build$BuildExecution.doRun(Build.java:164)
at
hudson.model.AbstractBuild$AbstractBuildExecution.run(AbstractBuild.java:522)
at hudson.model.Run.execute(Run.java:1896)
at hudson.model.FreeStyleBuild.run(FreeStyleBuild.java:44)
at hudson.model.ResourceController.execute(ResourceController.java:101)
at hudson.model.Executor.run(Executor.java:442)
Caused by: java.io.IOException: Pipe closed after 0 cycles
at
org.apache.sshd.common.channel.ChannelPipedInputStream.read(ChannelPipedInputStream.java:126)
at
org.apache.sshd.common.channel.ChannelPipedInputStream.read(ChannelPipedInputStream.java:105)
at
hudson.remoting.FlightRecorderInputStream.read(FlightRecorderInputStream.java:94)
at
hudson.remoting.ChunkedInputStream.readHeader(ChunkedInputStream.java:75)
at
hudson.remoting.ChunkedInputStream.readUntilBreak(ChunkedInputStream.java:105)
at
hudson.remoting.ChunkedCommandTransport.readBlock(ChunkedCommandTransport.java:39)
at
hudson.remoting.AbstractSynchronousByteArrayCommandTransport.read(AbstractSynchronousByteArrayCommandTransport.java:34)
at
hudson.remoting.SynchronousCommandTransport$ReaderThread.run(SynchronousCommandTransport.java:61)
Build step 'Invoke Gradle script' changed build result to FAILURE
Build step 'Invoke Gradle script' marked build as failure
ERROR: apache-beam-jenkins-7 is offline; cannot locate jdk_1.8_latest
---------------------------------------------------------------------
To unsubscribe, e-mail: [email protected]
For additional commands, e-mail: [email protected]
