See 
<https://ci-beam.apache.org/job/beam_PostCommit_Python_VR_Flink/3722/display/redirect?page=changes>

Changes:

[noreply] Fix lint errors from #26170 (#26382)


------------------------------------------
[...truncated 75.87 KB...]
Collecting 
virtualenv!=20.0.0,!=20.0.1,!=20.0.2,!=20.0.3,!=20.0.4,!=20.0.5,!=20.0.6,!=20.0.7,>=16.0.0
 (from tox==3.20.1)
  Using cached virtualenv-20.22.0-py3-none-any.whl (3.2 MB)
Collecting importlib-metadata<3,>=0.12 (from tox==3.20.1)
  Using cached importlib_metadata-2.1.3-py2.py3-none-any.whl (10 kB)
Collecting protobuf<5.0dev,>=4.21.6 (from grpcio-tools==1.53.0->-r 
/home/jenkins/jenkins-slave/workspace/beam_PostCommit_Python_VR_Flink/src/sdks/python/build-requirements.txt
 (line 22))
  Using cached protobuf-4.22.3-cp37-abi3-manylinux2014_x86_64.whl (302 kB)
Collecting grpcio>=1.53.0 (from grpcio-tools==1.53.0->-r 
/home/jenkins/jenkins-slave/workspace/beam_PostCommit_Python_VR_Flink/src/sdks/python/build-requirements.txt
 (line 22))
  Using cached 
grpcio-1.54.0-cp37-cp37m-manylinux_2_17_x86_64.manylinux2014_x86_64.whl (5.1 MB)
Collecting types-protobuf>=3.20.4 (from mypy-protobuf==3.4.0->-r 
/home/jenkins/jenkins-slave/workspace/beam_PostCommit_Python_VR_Flink/src/sdks/python/build-requirements.txt
 (line 23))
  Using cached types_protobuf-4.22.0.2-py3-none-any.whl (61 kB)
Collecting zipp>=0.5 (from importlib-metadata<3,>=0.12->tox==3.20.1)
  Using cached zipp-3.15.0-py3-none-any.whl (6.8 kB)
INFO: pip is looking at multiple versions of virtualenv to determine which 
version is compatible with other requirements. This could take a while.
Collecting 
virtualenv!=20.0.0,!=20.0.1,!=20.0.2,!=20.0.3,!=20.0.4,!=20.0.5,!=20.0.6,!=20.0.7,>=16.0.0
 (from tox==3.20.1)
  Using cached virtualenv-20.21.1-py3-none-any.whl (8.7 MB)
  Using cached virtualenv-20.21.0-py3-none-any.whl (8.7 MB)
  Using cached virtualenv-20.20.0-py3-none-any.whl (8.7 MB)
  Using cached virtualenv-20.19.0-py3-none-any.whl (8.7 MB)
  Using cached virtualenv-20.18.0-py3-none-any.whl (8.7 MB)
  Using cached virtualenv-20.17.1-py3-none-any.whl (8.8 MB)
Collecting platformdirs<3,>=2.4 (from 
virtualenv!=20.0.0,!=20.0.1,!=20.0.2,!=20.0.3,!=20.0.4,!=20.0.5,!=20.0.6,!=20.0.7,>=16.0.0->tox==3.20.1)
  Using cached platformdirs-2.6.2-py3-none-any.whl (14 kB)
Collecting 
virtualenv!=20.0.0,!=20.0.1,!=20.0.2,!=20.0.3,!=20.0.4,!=20.0.5,!=20.0.6,!=20.0.7,>=16.0.0
 (from tox==3.20.1)
  Using cached virtualenv-20.17.0-py3-none-any.whl (8.8 MB)
INFO: pip is looking at multiple versions of virtualenv to determine which 
version is compatible with other requirements. This could take a while.
  Using cached virtualenv-20.16.7-py3-none-any.whl (8.8 MB)
  Using cached virtualenv-20.16.6-py3-none-any.whl (8.8 MB)
  Using cached virtualenv-20.16.5-py3-none-any.whl (8.8 MB)
  Using cached virtualenv-20.16.4-py3-none-any.whl (8.8 MB)
  Using cached virtualenv-20.16.3-py2.py3-none-any.whl (8.8 MB)
INFO: This is taking longer than usual. You might need to provide the 
dependency resolver with stricter constraints to reduce runtime. See 
https://pip.pypa.io/warnings/backtracking for guidance. If you want to abort 
this run, press Ctrl + C.
  Using cached virtualenv-20.16.2-py2.py3-none-any.whl (8.8 MB)
Collecting typing-extensions>=4.4 (from 
platformdirs<3,>=2.4->virtualenv!=20.0.0,!=20.0.1,!=20.0.2,!=20.0.3,!=20.0.4,!=20.0.5,!=20.0.6,!=20.0.7,>=16.0.0->tox==3.20.1)
  Using cached typing_extensions-4.5.0-py3-none-any.whl (27 kB)
Installing collected packages: types-protobuf, distlib, zipp, wheel, 
typing-extensions, toml, six, setuptools, py, protobuf, packaging, numpy, 
grpcio, filelock, platformdirs, mypy-protobuf, importlib-metadata, 
grpcio-tools, virtualenv, pluggy, tox
  Attempting uninstall: setuptools
    Found existing installation: setuptools 47.1.0
    Uninstalling setuptools-47.1.0:
      Successfully uninstalled setuptools-47.1.0

> Task :sdks:java:container:java8:copyJavaThirdPartyLicenses

> Task :release:go-licenses:java:dockerRun
go: added github.com/apache/beam/sdks/v2 v2.46.0
go: added github.com/golang/protobuf v1.5.2
go: added golang.org/x/net v0.5.0
go: added golang.org/x/sys v0.5.0
go: added golang.org/x/text v0.7.0
go: added google.golang.org/genproto v0.0.0-20230110181048-76db0878b65f
go: added google.golang.org/grpc v1.52.3
go: added google.golang.org/protobuf v1.28.1
+ go-licenses save github.com/apache/beam/sdks/v2/java/container 
--save_path=/output/licenses
W0421 16:26:21.693956      40 library.go:101] "golang.org/x/sys/unix" contains 
non-Go code that can't be inspected for further dependencies:
/go/pkg/mod/golang.org/x/[email protected]/unix/asm_linux_amd64.s
+ go-licenses csv github.com/apache/beam/sdks/v2/java/container
+ tee /output/licenses/list.csv
W0421 16:26:26.950944      87 library.go:101] "golang.org/x/sys/unix" contains 
non-Go code that can't be inspected for further dependencies:
/go/pkg/mod/golang.org/x/[email protected]/unix/asm_linux_amd64.s

> Task :sdks:java:container:goBuild
/home/jenkins/go/bin/go1.20.2 build -o ./build/target/linux_amd64/boot boot.go 
boot_test.go pathingjar.go pathingjar_test.go

> Task :sdks:python:setupVirtualenv
Successfully installed distlib-0.3.6 filelock-3.12.0 grpcio-1.54.0 
grpcio-tools-1.53.0 mypy-protobuf-3.4.0 numpy-1.24.2 packaging-23.1 
platformdirs-3.2.0 pluggy-1.0.0 protobuf-4.22.3 py-1.11.0 setuptools-67.7.1 
six-1.16.0 toml-0.10.2 tox-3.20.1 types-protobuf-4.22.0.2 virtualenv-20.22.0 
wheel-0.40.0

> Task :sdks:python:test-suites:portable:py311:setupVirtualenv
Successfully installed distlib-0.3.6 filelock-3.12.0 grpcio-1.54.0 
grpcio-tools-1.53.0 mypy-protobuf-3.4.0 numpy-1.24.2 packaging-23.1 
platformdirs-3.2.0 pluggy-1.0.0 protobuf-4.22.3 py-1.11.0 setuptools-67.7.1 
six-1.16.0 toml-0.10.2 tox-3.20.1 types-protobuf-4.22.0.2 virtualenv-20.22.0 
wheel-0.40.0

> Task :sdks:java:container:java8:copySdkHarnessLauncher
Execution optimizations have been disabled for task 
':sdks:java:container:java8:copySdkHarnessLauncher' to ensure correctness due 
to the following reasons:
  - Gradle detected a problem with the following location: 
'/home/jenkins/jenkins-slave/workspace/beam_PostCommit_Python_VR_Flink/src/sdks/java/container/build/target'.
 Reason: Task ':sdks:java:container:java8:copySdkHarnessLauncher' uses this 
output of task ':sdks:java:container:downloadCloudProfilerAgent' without 
declaring an explicit or implicit dependency. This can lead to incorrect 
results being produced, depending on what order the tasks are executed. Please 
refer to 
https://docs.gradle.org/7.5.1/userguide/validation_problems.html#implicit_dependency
 for more details about this problem.
  - Gradle detected a problem with the following location: 
'/home/jenkins/jenkins-slave/workspace/beam_PostCommit_Python_VR_Flink/src/sdks/java/container/build/target'.
 Reason: Task ':sdks:java:container:java8:copySdkHarnessLauncher' uses this 
output of task ':sdks:java:container:pullLicenses' without declaring an 
explicit or implicit dependency. This can lead to incorrect results being 
produced, depending on what order the tasks are executed. Please refer to 
https://docs.gradle.org/7.5.1/userguide/validation_problems.html#implicit_dependency
 for more details about this problem.

> Task :sdks:python:test-suites:portable:py37:setupVirtualenv
Successfully installed distlib-0.3.6 filelock-3.12.0 grpcio-1.54.0 
grpcio-tools-1.53.0 importlib-metadata-2.1.3 mypy-protobuf-3.4.0 numpy-1.21.6 
packaging-23.1 platformdirs-2.6.2 pluggy-1.0.0 protobuf-4.22.3 py-1.11.0 
setuptools-67.7.1 six-1.16.0 toml-0.10.2 tox-3.20.1 types-protobuf-4.22.0.2 
typing-extensions-4.5.0 virtualenv-20.16.2 wheel-0.40.0 zipp-3.15.0

> Task :release:go-licenses:java:dockerRun
+ chmod -R a+w /output/licenses

> Task :sdks:python:sdist
org/apache/beam/model/interactive/v1/beam_interactive_api.proto:36:1: warning: 
Import google/protobuf/timestamp.proto is unused.
Writing mypy to org/apache/beam/model/pipeline/v1/external_transforms_pb2.pyi
Writing mypy to org/apache/beam/model/pipeline/v1/beam_runner_api_pb2.pyi
Writing mypy to org/apache/beam/model/pipeline/v1/standard_window_fns_pb2.pyi
Writing mypy to org/apache/beam/model/pipeline/v1/metrics_pb2.pyi
Writing mypy to org/apache/beam/model/pipeline/v1/endpoints_pb2.pyi
Writing mypy to org/apache/beam/model/pipeline/v1/schema_pb2.pyi
Writing mypy to 
org/apache/beam/model/job_management/v1/beam_artifact_api_pb2.pyi
Writing mypy to 
org/apache/beam/model/job_management/v1/beam_expansion_api_pb2.pyi
Writing mypy to org/apache/beam/model/job_management/v1/beam_job_api_pb2.pyi
Writing mypy to org/apache/beam/model/fn_execution/v1/beam_provision_api_pb2.pyi
Writing mypy to org/apache/beam/model/fn_execution/v1/beam_fn_api_pb2.pyi
Writing mypy to 
org/apache/beam/model/interactive/v1/beam_interactive_api_pb2.pyi
/home/jenkins/jenkins-slave/workspace/beam_PostCommit_Python_VR_Flink/src/build/gradleenv/1922375555/lib/python3.8/site-packages/setuptools/dist.py:519:
 InformationOnly: Normalizing '2.48.0.dev' to '2.48.0.dev0'
  self.metadata.version = self._normalize_version(
warning: no files found matching 'README.md'
warning: no files found matching 'NOTICE'
warning: no files found matching 'LICENSE'
warning: no files found matching 'LICENSE.python'
warning: sdist: standard file not found: should have one of README, README.rst, 
README.txt, README.md


> Task :release:go-licenses:java:createLicenses
> Task :sdks:java:container:java8:copyGolangLicenses
> Task :runners:flink:1.16:job-server:shadowJar FROM-CACHE
> Task :sdks:java:container:java8:dockerPrepare

> Task :sdks:java:container:java8:docker
#1 [internal] load build definition from Dockerfile
#1 transferring dockerfile: 2.58kB done
#1 DONE 0.0s

#2 [internal] load .dockerignore
#2 transferring context: 2B done
#2 DONE 0.0s

#3 [internal] load metadata for docker.io/library/eclipse-temurin:8
#3 DONE 0.3s

#4 [ 1/16] FROM 
docker.io/library/eclipse-temurin:8@sha256:1f41c45c94ce6b02640030362ebd29eaec22ccc65c3e42f3c28f5edd5ca2aab8
#4 resolve 
docker.io/library/eclipse-temurin:8@sha256:1f41c45c94ce6b02640030362ebd29eaec22ccc65c3e42f3c28f5edd5ca2aab8
 0.0s done
#4 ...

#5 [internal] load build context
#5 transferring context: 46.96MB 0.4s done
#5 DONE 0.4s

#6 [ 2/16] ADD target/slf4j-api.jar /opt/apache/beam/jars/
#6 DONE 2.7s

#4 [ 1/16] FROM 
docker.io/library/eclipse-temurin:8@sha256:1f41c45c94ce6b02640030362ebd29eaec22ccc65c3e42f3c28f5edd5ca2aab8
#4 ...

#7 [ 3/16] ADD target/slf4j-jdk14.jar /opt/apache/beam/jars/
#7 DONE 0.1s

#8 [ 4/16] ADD target/jcl-over-slf4j.jar /opt/apache/beam/jars/
#8 DONE 0.1s

#4 [ 1/16] FROM 
docker.io/library/eclipse-temurin:8@sha256:1f41c45c94ce6b02640030362ebd29eaec22ccc65c3e42f3c28f5edd5ca2aab8
#4 ...

#9 [ 5/16] ADD target/log4j-over-slf4j.jar /opt/apache/beam/jars/
#9 DONE 0.1s

#10 [ 6/16] ADD target/log4j-to-slf4j.jar /opt/apache/beam/jars/
#10 DONE 0.1s

#4 [ 1/16] FROM 
docker.io/library/eclipse-temurin:8@sha256:1f41c45c94ce6b02640030362ebd29eaec22ccc65c3e42f3c28f5edd5ca2aab8
#4 ...

#11 [ 7/16] ADD target/beam-sdks-java-harness.jar /opt/apache/beam/jars/
#11 DONE 0.2s

#12 [ 8/16] COPY target/jamm.jar target/open-module-agent*.jar 
/opt/apache/beam/jars/
#12 DONE 0.2s

#13 [ 9/16] COPY target/linux_amd64/boot /opt/apache/beam/
#13 DONE 0.3s

#14 [10/16] COPY target/LICENSE /opt/apache/beam/
#14 DONE 0.1s

#15 [11/16] COPY target/NOTICE /opt/apache/beam/
#15 DONE 0.1s

#16 [12/16] ADD target/third_party_licenses 
/opt/apache/beam/third_party_licenses/
#16 DONE 0.3s

#17 [13/16] COPY target/LICENSE target/options/* /opt/apache/beam/options/
#17 DONE 0.2s

#18 [14/16] COPY target/go-licenses/* 
/opt/apache/beam/third_party_licenses/golang/
#18 DONE 0.1s

#19 [15/16] RUN if [ "true" = "false" ] ; then     rm -rf 
/opt/apache/beam/third_party_licenses ;    fi
#19 DONE 0.7s

#20 [16/16] COPY target/profiler/* /opt/google_cloud_profiler/
#20 DONE 0.1s

#21 exporting to image
#21 exporting layers
#21 exporting layers 0.3s done
#21 writing image 
sha256:3024b8284dcb44d87e7319e1df3c5466c32c7d3f8d11e67ff97e23ab9ea01a02 done
#21 naming to docker.io/apache/beam_java8_sdk:2.48.0.dev done
#21 DONE 0.3s

#4 [ 1/16] FROM 
docker.io/library/eclipse-temurin:8@sha256:1f41c45c94ce6b02640030362ebd29eaec22ccc65c3e42f3c28f5edd5ca2aab8

> Task :sdks:python:test-suites:portable:py311:flinkCompatibilityMatrixLOOPBACK
flink-runner-test create: 
/home/jenkins/jenkins-slave/workspace/beam_PostCommit_Python_VR_Flink/src/sdks/python/test-suites/portable/py311/build/srcs/sdks/python/target/.tox-flink-runner-test/flink-runner-test
flink-runner-test installdeps: -rbuild-requirements.txt
flink-runner-test inst: 
/home/jenkins/jenkins-slave/workspace/beam_PostCommit_Python_VR_Flink/src/sdks/python/test-suites/portable/py311/build/srcs/sdks/python/target/.tox-flink-runner-test/.tmp/package/1/apache-beam.tar.gz
flink-runner-test installed: apache-beam @ 
file:///home/jenkins/jenkins-slave/workspace/beam_PostCommit_Python_VR_Flink/src/sdks/python/test-suites/portable/py311/build/srcs/sdks/python/target/.tox-flink-runner-test/.tmp/package/1/apache-beam.tar.gz,attrs==23.1.0,certifi==2022.12.7,cffi==1.15.1,charset-normalizer==3.1.0,cloudpickle==2.2.1,crcmod==1.7,cryptography==40.0.2,deprecation==2.1.0,dill==0.3.1.1,distlib==0.3.6,dnspython==2.3.0,docker==6.0.1,docopt==0.6.2,execnet==1.9.0,fastavro==1.7.3,fasteners==0.18,freezegun==1.2.2,greenlet==2.0.2,grpcio==1.54.0,grpcio-tools==1.53.0,hdfs==2.7.0,httplib2==0.21.0,hypothesis==6.72.1,idna==3.4,iniconfig==2.0.0,joblib==1.2.0,mock==5.0.2,mypy-protobuf==3.4.0,numpy==1.24.2,objsize==0.6.1,orjson==3.8.10,packaging==23.1,pandas==1.5.3,parameterized==0.9.0,pluggy==1.0.0,proto-plus==1.22.2,protobuf==4.22.3,psycopg2-binary==2.9.6,pyarrow==11.0.0,pycparser==2.21,pydot==1.4.2,PyHamcrest==2.0.4,pymongo==4.3.3,PyMySQL==1.0.3,pyparsing==3.0.9,pytest==7.3.1,pytest-timeout==2.1.0,pytest-xdist==3.2.1,python-dateutil==2.8.2,pytz==2023.3,PyYAML==6.0,regex==2023.3.23,requests==2.28.2,requests-mock==1.10.0,scikit-learn==1.2.2,scipy==1.10.1,six==1.16.0,sortedcontainers==2.4.0,SQLAlchemy==1.4.47,tenacity==8.2.2,testcontainers==3.7.1,threadpoolctl==3.1.0,types-protobuf==4.22.0.2,typing_extensions==4.5.0,urllib3==1.26.15,websocket-client==1.5.1,wrapt==1.15.0,zstandard==0.21.0
flink-runner-test run-test-pre: PYTHONHASHSEED='3902537025'
flink-runner-test run-test-pre: commands[0] | python --version
Python 3.11.2
flink-runner-test run-test-pre: commands[1] | pip --version
pip 23.0.1 from 
/home/jenkins/jenkins-slave/workspace/beam_PostCommit_Python_VR_Flink/src/sdks/python/test-suites/portable/py311/build/srcs/sdks/python/target/.tox-flink-runner-test/flink-runner-test/lib/python3.11/site-packages/pip
 (python 3.11)
flink-runner-test run-test-pre: commands[2] | pip check
No broken requirements found.
flink-runner-test run-test-pre: commands[3] | bash 
/home/jenkins/jenkins-slave/workspace/beam_PostCommit_Python_VR_Flink/src/sdks/python/test-suites/portable/py311/build/srcs/sdks/python/scripts/run_tox_cleanup.sh
flink-runner-test run-test: commands[0] | bash 
/home/jenkins/jenkins-slave/workspace/beam_PostCommit_Python_VR_Flink/src/sdks/python/test-suites/portable/py311/build/srcs/sdks/python/scripts/pytest_validates_runner.sh
 flink-runner-test 
/home/jenkins/jenkins-slave/workspace/beam_PostCommit_Python_VR_Flink/src/sdks/python/test-suites/portable/py311/build/srcs/sdks/python/apache_beam/runners/portability/flink_runner_test.py
 
'--flink_job_server_jar=/home/jenkins/jenkins-slave/workspace/beam_PostCommit_Python_VR_Flink/src/runners/flink/1.16/job-server/build/libs/beam-runners-flink-1.16-job-server-2.48.0-SNAPSHOT.jar
 --environment_type=LOOPBACK'
============================= test session starts 
==============================
platform linux -- Python 3.11.2, pytest-7.3.1, pluggy-1.0.0
cachedir: target/.tox-flink-runner-test/flink-runner-test/.pytest_cache
rootdir: 
/home/jenkins/jenkins-slave/workspace/beam_PostCommit_Python_VR_Flink/src/sdks/python/test-suites/portable/py311/build/srcs/sdks/python
configfile: pytest.ini
plugins: hypothesis-6.72.1, xdist-3.2.1, timeout-2.1.0, requests-mock-1.10.0
timeout: 600.0s
timeout method: signal
timeout func_only: False
collected 207 items

apache_beam/runners/portability/flink_runner_test.py ......s...s...ss... [  9%]
.........s....s...s..s.......FATAL: command execution failed
java.io.IOException: Backing channel 'apache-beam-jenkins-3' is disconnected.
        at 
hudson.remoting.RemoteInvocationHandler.channelOrFail(RemoteInvocationHandler.java:215)
        at 
hudson.remoting.RemoteInvocationHandler.invoke(RemoteInvocationHandler.java:285)
        at com.sun.proxy.$Proxy135.isAlive(Unknown Source)
        at hudson.Launcher$RemoteLauncher$ProcImpl.isAlive(Launcher.java:1215)
        at hudson.Launcher$RemoteLauncher$ProcImpl.join(Launcher.java:1207)
        at hudson.Launcher$ProcStarter.join(Launcher.java:524)
        at hudson.plugins.gradle.Gradle.perform(Gradle.java:321)
        at hudson.tasks.BuildStepMonitor$1.perform(BuildStepMonitor.java:20)
        at 
hudson.model.AbstractBuild$AbstractBuildExecution.perform(AbstractBuild.java:814)
        at hudson.model.Build$BuildExecution.build(Build.java:199)
        at hudson.model.Build$BuildExecution.doRun(Build.java:164)
        at 
hudson.model.AbstractBuild$AbstractBuildExecution.run(AbstractBuild.java:522)
        at hudson.model.Run.execute(Run.java:1896)
        at hudson.model.FreeStyleBuild.run(FreeStyleBuild.java:44)
        at hudson.model.ResourceController.execute(ResourceController.java:101)
        at hudson.model.Executor.run(Executor.java:442)
Caused by: hudson.remoting.Channel$OrderlyShutdown: Command Close created at
        at hudson.remoting.Channel$CloseCommand.execute(Channel.java:1313)
        at hudson.remoting.Channel$1.handle(Channel.java:606)
        at 
hudson.remoting.SynchronousCommandTransport$ReaderThread.run(SynchronousCommandTransport.java:81)
Caused by: Command Close created at
        at hudson.remoting.Command.<init>(Command.java:70)
        at hudson.remoting.Channel$CloseCommand.<init>(Channel.java:1306)
        at hudson.remoting.Channel$CloseCommand.<init>(Channel.java:1304)
        at hudson.remoting.Channel.close(Channel.java:1480)
        at hudson.remoting.Channel.close(Channel.java:1447)
        at hudson.remoting.Channel$CloseCommand.execute(Channel.java:1312)
        ... 2 more
Build step 'Invoke Gradle script' changed build result to FAILURE
Build step 'Invoke Gradle script' marked build as failure
ERROR: apache-beam-jenkins-3 is offline; cannot locate jdk_1.8_latest

---------------------------------------------------------------------
To unsubscribe, e-mail: [email protected]
For additional commands, e-mail: [email protected]

Reply via email to