See
<https://ci-beam.apache.org/job/beam_PostCommit_XVR_PythonUsingJava_Dataflow/91/display/redirect?page=changes>
Changes:
[Pablo Estrada] Simplify README for new users
[laraschmidt] Fix final allowskew error to properly handle a large allowedSkew
[noreply] [BEAM-13946] Add get_dummies(), a non-deferred column operation on
------------------------------------------
[...truncated 32.01 KB...]
> Task :release:go-licenses:java:docker
> Task :sdks:java:extensions:google-cloud-platform-core:compileJava FROM-CACHE
> Task :sdks:java:extensions:google-cloud-platform-core:classes UP-TO-DATE
> Task :sdks:java:extensions:google-cloud-platform-core:jar
> Task :sdks:java:harness:compileJava FROM-CACHE
> Task :sdks:java:harness:classes UP-TO-DATE
> Task :sdks:java:harness:jar
> Task :sdks:python:setupVirtualenv
Collecting grpcio-tools==1.37.0
Using cached grpcio_tools-1.37.0-cp36-cp36m-manylinux2014_x86_64.whl (2.5 MB)
Collecting mypy-protobuf==1.18
Using cached mypy_protobuf-1.18-py3-none-any.whl (7.3 kB)
> Task :runners:java-fn-execution:compileJava FROM-CACHE
> Task :runners:java-fn-execution:classes UP-TO-DATE
> Task :runners:java-fn-execution:jar
> Task :sdks:java:expansion-service:compileJava FROM-CACHE
> Task :sdks:java:expansion-service:classes UP-TO-DATE
> Task :sdks:java:expansion-service:jar
> Task :sdks:java:testing:expansion-service:compileTestJava FROM-CACHE
> Task :sdks:java:testing:expansion-service:testClasses
> Task :sdks:java:io:kafka:compileJava FROM-CACHE
> Task :sdks:java:io:kafka:classes UP-TO-DATE
> Task :sdks:java:io:kafka:jar
> Task :sdks:python:setupVirtualenv
Collecting distlib==0.3.1
Using cached distlib-0.3.1-py2.py3-none-any.whl (335 kB)
Collecting packaging>=14
Using cached packaging-21.3-py3-none-any.whl (40 kB)
Collecting py>=1.4.17
Using cached py-1.11.0-py2.py3-none-any.whl (98 kB)
Collecting
virtualenv!=20.0.0,!=20.0.1,!=20.0.2,!=20.0.3,!=20.0.4,!=20.0.5,!=20.0.6,!=20.0.7,>=16.0.0
Using cached virtualenv-20.13.1-py2.py3-none-any.whl (8.6 MB)
Collecting filelock>=3.0.0
Using cached filelock-3.4.1-py3-none-any.whl (9.9 kB)
Collecting six>=1.14.0
Using cached six-1.16.0-py2.py3-none-any.whl (11 kB)
Collecting toml>=0.9.4
Using cached toml-0.10.2-py2.py3-none-any.whl (16 kB)
Collecting importlib-metadata<3,>=0.12
Using cached importlib_metadata-2.1.3-py2.py3-none-any.whl (10 kB)
Collecting pluggy>=0.12.0
Using cached pluggy-1.0.0-py2.py3-none-any.whl (13 kB)
> Task :sdks:java:harness:shadowJar FROM-CACHE
> Task :sdks:java:container:generateLicenseReport
> Task :sdks:java:container:java8:copyDockerfileDependencies
> Task :release:go-licenses:java:dockerRun
+ rm -rf '/output/*'
+ export GO111MODULE=off
+ GO111MODULE=off
+ go get github.com/apache/beam/sdks/java/container
> Task :sdks:java:testing:expansion-service:buildTestExpansionServiceJar
> FROM-CACHE
> Task :release:go-licenses:py:dockerRun
+ rm -rf '/output/*'
+ export GO111MODULE=off
+ GO111MODULE=off
+ go get github.com/apache/beam/sdks/python/container
> Task :sdks:python:sdist
/home/jenkins/jenkins-slave/workspace/beam_PostCommit_XVR_PythonUsingJava_Dataflow/src/build/gradleenv/1922375555/lib/python3.6/site-packages/setuptools/dist.py:493:
UserWarning: Normalizing '2.38.0.dev' to '2.38.0.dev0'
warnings.warn(tmpl.format(**locals()))
INFO:gen_protos:Regenerating Python proto definitions (no output files).
INFO:gen_protos:Found protoc_gen_mypy at
/home/jenkins/jenkins-slave/workspace/beam_PostCommit_XVR_PythonUsingJava_Dataflow/src/build/gradleenv/1922375555/bin/protoc-gen-mypy
beam_interactive_api.proto:36:1: warning: Import
google/protobuf/timestamp.proto is unused.
Writing mypy to external_transforms_pb2.pyi
Writing mypy to beam_runner_api_pb2.pyi
Writing mypy to standard_window_fns_pb2.pyi
Writing mypy to metrics_pb2.pyi
Writing mypy to endpoints_pb2.pyi
Writing mypy to schema_pb2.pyi
Writing mypy to beam_artifact_api_pb2.pyi
Writing mypy to beam_expansion_api_pb2.pyi
Writing mypy to beam_job_api_pb2.pyi
Writing mypy to beam_provision_api_pb2.pyi
Writing mypy to beam_fn_api_pb2.pyi
Writing mypy to beam_interactive_api_pb2.pyi
INFO:gen_protos:Writing urn stubs:
/home/jenkins/jenkins-slave/workspace/beam_PostCommit_XVR_PythonUsingJava_Dataflow/src/sdks/python/apache_beam/portability/api/metrics_pb2_urns.py
INFO:gen_protos:Writing urn stubs:
/home/jenkins/jenkins-slave/workspace/beam_PostCommit_XVR_PythonUsingJava_Dataflow/src/sdks/python/apache_beam/portability/api/beam_artifact_api_pb2_urns.py
INFO:gen_protos:Writing urn stubs:
/home/jenkins/jenkins-slave/workspace/beam_PostCommit_XVR_PythonUsingJava_Dataflow/src/sdks/python/apache_beam/portability/api/standard_window_fns_pb2_urns.py
INFO:gen_protos:Writing urn stubs:
/home/jenkins/jenkins-slave/workspace/beam_PostCommit_XVR_PythonUsingJava_Dataflow/src/sdks/python/apache_beam/portability/api/external_transforms_pb2_urns.py
INFO:gen_protos:Writing urn stubs:
/home/jenkins/jenkins-slave/workspace/beam_PostCommit_XVR_PythonUsingJava_Dataflow/src/sdks/python/apache_beam/portability/api/beam_runner_api_pb2_urns.py
warning: no files found matching 'README.md'
warning: no files found matching 'NOTICE'
warning: no files found matching 'LICENSE'
warning: no files found matching 'LICENSE.python'
warning: sdist: standard file not found: should have one of README, README.rst,
README.txt, README.md
> Task :sdks:java:container:pullLicenses
Collecting beautifulsoup4<5.0,>=4.9.0
Using cached beautifulsoup4-4.10.0-py3-none-any.whl (97 kB)
Collecting pyyaml<6.0.0,>=3.12
Using cached PyYAML-5.4.1-cp36-cp36m-manylinux1_x86_64.whl (640 kB)
Collecting tenacity<6.0,>=5.0.2
Using cached tenacity-5.1.5-py2.py3-none-any.whl (34 kB)
Collecting soupsieve>1.2
Using cached soupsieve-2.3.1-py3-none-any.whl (37 kB)
Collecting six>=1.9.0
Using cached six-1.16.0-py2.py3-none-any.whl (11 kB)
Installing collected packages: soupsieve, six, tenacity, pyyaml, beautifulsoup4
Successfully installed beautifulsoup4-4.10.0 pyyaml-5.4.1 six-1.16.0
soupsieve-2.3.1 tenacity-5.1.5
Executing python
/home/jenkins/jenkins-slave/workspace/beam_PostCommit_XVR_PythonUsingJava_Dataflow/src/sdks/java/container/license_scripts/pull_licenses_java.py
--license_index=/home/jenkins/jenkins-slave/workspace/beam_PostCommit_XVR_PythonUsingJava_Dataflow/src/sdks/java/container/build/reports/dependency-license/index.json
--output_dir=/home/jenkins/jenkins-slave/workspace/beam_PostCommit_XVR_PythonUsingJava_Dataflow/src/sdks/java/container/build/target/java_third_party_licenses
--dep_url_yaml=/home/jenkins/jenkins-slave/workspace/beam_PostCommit_XVR_PythonUsingJava_Dataflow/src/sdks/java/container/license_scripts/dep_urls_java.yaml
--manual_license_path=/home/jenkins/jenkins-slave/workspace/beam_PostCommit_XVR_PythonUsingJava_Dataflow/src/sdks/java/container/license_scripts/manual_licenses
INFO:root:Pulling license for 220 dependencies using 16 threads.
INFO:root:Replaced local file URL with
file:///home/jenkins/jenkins-slave/workspace/beam_PostCommit_XVR_PythonUsingJava_Dataflow/src/sdks/java/container/license_scripts/manual_licenses/xz/COPYING
for xz-1.5
> Task :sdks:python:container:py36:copyDockerfileDependencies
> Task :sdks:python:installGcpTest
Processing ./build/apache-beam.tar.gz
Preparing metadata (setup.py): started
Preparing metadata (setup.py): finished with status 'done'
Collecting crcmod<2.0,>=1.7
Using cached crcmod-1.7-cp36-cp36m-linux_x86_64.whl
Collecting orjson<4.0
Using cached orjson-3.6.1-cp36-cp36m-manylinux_2_24_x86_64.whl (233 kB)
Collecting dill<0.3.2,>=0.3.1.1
Using cached dill-0.3.1.1-py3-none-any.whl
Collecting cloudpickle<3,>=2.0.0
Using cached cloudpickle-2.0.0-py3-none-any.whl (25 kB)
Collecting fastavro<2,>=0.23.6
Using cached
fastavro-1.4.7-cp36-cp36m-manylinux_2_17_x86_64.manylinux2014_x86_64.whl (2.3
MB)
Requirement already satisfied: grpcio<2,>=1.29.0 in
/home/jenkins/jenkins-slave/workspace/beam_PostCommit_XVR_PythonUsingJava_Dataflow/src/build/gradleenv/1922375555/lib/python3.6/site-packages
(from apache-beam==2.38.0.dev0) (1.44.0)
Collecting hdfs<3.0.0,>=2.1.0
Using cached hdfs-2.6.0-py3-none-any.whl (33 kB)
Collecting httplib2<0.20.0,>=0.8
Using cached httplib2-0.19.1-py3-none-any.whl (95 kB)
Collecting numpy<1.22.0,>=1.14.3
Using cached numpy-1.19.5-cp36-cp36m-manylinux2010_x86_64.whl (14.8 MB)
Collecting pymongo<4.0.0,>=3.8.0
Using cached
pymongo-3.12.3-cp36-cp36m-manylinux_2_17_x86_64.manylinux2014_x86_64.whl (506
kB)
Collecting oauth2client<5,>=2.0.1
Using cached oauth2client-4.1.3-py2.py3-none-any.whl (98 kB)
Requirement already satisfied: protobuf<4,>=3.12.2 in
/home/jenkins/jenkins-slave/workspace/beam_PostCommit_XVR_PythonUsingJava_Dataflow/src/build/gradleenv/1922375555/lib/python3.6/site-packages
(from apache-beam==2.38.0.dev0) (3.19.4)
> Task :sdks:java:container:pullLicenses
INFO:root:pull_licenses_java.py succeed. It took 10.994812 seconds with 16
threads.
Copying licenses from
/home/jenkins/jenkins-slave/workspace/beam_PostCommit_XVR_PythonUsingJava_Dataflow/src/sdks/java/container/build/target/java_third_party_licenses
to
/home/jenkins/jenkins-slave/workspace/beam_PostCommit_XVR_PythonUsingJava_Dataflow/src/sdks/java/container/build/target/third_party_licenses.
Finished license_scripts.sh
> Task :sdks:java:container:java8:copyJavaThirdPartyLicenses
> Task :release:go-licenses:java:dockerRun
+ go-licenses save github.com/apache/beam/sdks/java/container
--save_path=/output/licenses
> Task :release:go-licenses:py:dockerRun
+ go-licenses save github.com/apache/beam/sdks/python/container
--save_path=/output/licenses
+ tee /output/licenses/list.csv
+ go-licenses csv github.com/apache/beam/sdks/python/container
golang.org/x/sys,https://go.googlesource.com/sys/+/refs/heads/master/LICENSE,BSD-3-Clause
golang.org/x/text,https://go.googlesource.com/text/+/refs/heads/master/LICENSE,BSD-3-Clause
github.com/nightlyone/lockfile,https://github.com/nightlyone/lockfile/blob/master/LICENSE,MIT
github.com/apache/beam/sdks/python/container,https://github.com/apache/beam/blob/master/LICENSE,Apache-2.0
github.com/apache/beam/sdks/go/pkg/beam,https://github.com/apache/beam/blob/master/sdks/go/README.md,Apache-2.0
google.golang.org/grpc,https://github.com/grpc/grpc-go/blob/master/LICENSE,Apache-2.0
github.com/golang/protobuf,https://github.com/golang/protobuf/blob/master/LICENSE,BSD-3-Clause
google.golang.org/genproto/googleapis/rpc/status,https://github.com/googleapis/go-genproto/blob/master/LICENSE,Apache-2.0
golang.org/x/net,https://go.googlesource.com/net/+/refs/heads/master/LICENSE,BSD-3-Clause
google.golang.org/protobuf,https://go.googlesource.com/protobuf/+/refs/heads/master/LICENSE,BSD-3-Clause
+ chmod -R a+w /output/licenses
> Task :release:go-licenses:java:dockerRun
+ go-licenses csv github.com/apache/beam/sdks/java/container
+ tee /output/licenses/list.csv
github.com/golang/protobuf,https://github.com/golang/protobuf/blob/master/LICENSE,BSD-3-Clause
google.golang.org/protobuf,https://go.googlesource.com/protobuf/+/refs/heads/master/LICENSE,BSD-3-Clause
google.golang.org/genproto/googleapis/rpc/status,https://github.com/googleapis/go-genproto/blob/master/LICENSE,Apache-2.0
golang.org/x/sys,https://go.googlesource.com/sys/+/refs/heads/master/LICENSE,BSD-3-Clause
golang.org/x/text,https://go.googlesource.com/text/+/refs/heads/master/LICENSE,BSD-3-Clause
github.com/apache/beam/sdks/java/container,https://github.com/apache/beam/blob/master/LICENSE,Apache-2.0
github.com/apache/beam/sdks/go/pkg/beam,https://github.com/apache/beam/blob/master/sdks/go/README.md,Apache-2.0
google.golang.org/grpc,https://github.com/grpc/grpc-go/blob/master/LICENSE,Apache-2.0
golang.org/x/net,https://go.googlesource.com/net/+/refs/heads/master/LICENSE,BSD-3-Clause
+ chmod -R a+w /output/licenses
> Task :release:go-licenses:java:createLicenses
> Task :sdks:java:container:java8:copyGolangLicenses
> Task :release:go-licenses:py:createLicenses
> Task :sdks:python:container:py36:copyGolangLicenses
> Task :sdks:python:container:py36:dockerPrepare
> Task :sdks:java:container:java8:dockerPrepare
> Task :sdks:python:container:py36:docker
> Task :sdks:java:container:java8:docker
> Task :runners:google-cloud-dataflow-java:buildAndPushDockerJavaContainer
WARNING: `gcloud docker` will not be supported for Docker client versions above
18.03.
As an alternative, use `gcloud auth configure-docker` to configure `docker` to
use `gcloud` as a credential helper, then use `docker` as you would for non-GCR
registries, e.g. `docker pull gcr.io/project-id/my-image`. Add
`--verbosity=error` to silence this warning: `gcloud docker
--verbosity=error -- pull gcr.io/project-id/my-image`.
See:
https://cloud.google.com/container-registry/docs/support/deprecation-notices#gcloud-docker
> Task :runners:google-cloud-dataflow-java:buildAndPushDockerPythonContainer
WARNING: `gcloud docker` will not be supported for Docker client versions above
18.03.
As an alternative, use `gcloud auth configure-docker` to configure `docker` to
use `gcloud` as a credential helper, then use `docker` as you would for non-GCR
registries, e.g. `docker pull gcr.io/project-id/my-image`. Add
`--verbosity=error` to silence this warning: `gcloud docker
--verbosity=error -- pull gcr.io/project-id/my-image`.
See:
https://cloud.google.com/container-registry/docs/support/deprecation-notices#gcloud-docker
> Task :runners:google-cloud-dataflow-java:setupXVR
> Task :runners:google-cloud-dataflow-java:validatesCrossLanguageRunnerSetup
> Task
> :runners:google-cloud-dataflow-java:validatesCrossLanguageRunnerPythonUsingJava
FATAL: command execution failed
java.io.IOException: Backing channel 'apache-beam-jenkins-5' is disconnected.
at
hudson.remoting.RemoteInvocationHandler.channelOrFail(RemoteInvocationHandler.java:216)
at
hudson.remoting.RemoteInvocationHandler.invoke(RemoteInvocationHandler.java:286)
at com.sun.proxy.$Proxy126.isAlive(Unknown Source)
at hudson.Launcher$RemoteLauncher$ProcImpl.isAlive(Launcher.java:1213)
at hudson.Launcher$RemoteLauncher$ProcImpl.join(Launcher.java:1205)
at hudson.Launcher$ProcStarter.join(Launcher.java:522)
at hudson.plugins.gradle.Gradle.perform(Gradle.java:317)
at hudson.tasks.BuildStepMonitor$1.perform(BuildStepMonitor.java:20)
at
hudson.model.AbstractBuild$AbstractBuildExecution.perform(AbstractBuild.java:806)
at hudson.model.Build$BuildExecution.build(Build.java:198)
at hudson.model.Build$BuildExecution.doRun(Build.java:163)
at
hudson.model.AbstractBuild$AbstractBuildExecution.run(AbstractBuild.java:514)
at hudson.model.Run.execute(Run.java:1888)
at hudson.model.FreeStyleBuild.run(FreeStyleBuild.java:43)
at hudson.model.ResourceController.execute(ResourceController.java:99)
at hudson.model.Executor.run(Executor.java:432)
Caused by: java.io.IOException: Unexpected termination of the channel
at
hudson.remoting.SynchronousCommandTransport$ReaderThread.run(SynchronousCommandTransport.java:75)
Caused by: java.io.EOFException
at
java.io.ObjectInputStream$PeekInputStream.readFully(ObjectInputStream.java:2799)
at
java.io.ObjectInputStream$BlockDataInputStream.readShort(ObjectInputStream.java:3274)
at
java.io.ObjectInputStream.readStreamHeader(ObjectInputStream.java:934)
at java.io.ObjectInputStream.<init>(ObjectInputStream.java:396)
at
hudson.remoting.ObjectInputStreamEx.<init>(ObjectInputStreamEx.java:49)
at hudson.remoting.Command.readFrom(Command.java:142)
at hudson.remoting.Command.readFrom(Command.java:128)
at
hudson.remoting.AbstractSynchronousByteArrayCommandTransport.read(AbstractSynchronousByteArrayCommandTransport.java:35)
at
hudson.remoting.SynchronousCommandTransport$ReaderThread.run(SynchronousCommandTransport.java:61)
Build step 'Invoke Gradle script' changed build result to FAILURE
Build step 'Invoke Gradle script' marked build as failure
ERROR: apache-beam-jenkins-5 is offline; cannot locate jdk_1.8_latest
---------------------------------------------------------------------
To unsubscribe, e-mail: [email protected]
For additional commands, e-mail: [email protected]
