See
<https://ci-beam.apache.org/job/beam_PostCommit_XVR_Samza/393/display/redirect?page=changes>
Changes:
[melissapa] [BEAM-11758] Update basics page: Splittable DoFn
[noreply] Change sql.Options to an interface under sqlx. (#15790)
[melissapa] Address review feedback
[noreply] [BEAM-4149] Ensure that we always provide and require the worker id.
[noreply] [BEAM-13098] Fix translation of repeated TableRow fields (#15779)
------------------------------------------
[...truncated 110.76 KB...]
Uninstalling pluggy-1.0.0:
Successfully uninstalled pluggy-1.0.0
Successfully installed apache-beam-2.35.0.dev0 atomicwrites-1.4.0 attrs-21.2.0
avro-python3-1.9.2.1 azure-core-1.19.0 azure-storage-blob-12.9.0 boto3-1.19.4
botocore-1.22.4 cachetools-4.2.4 certifi-2021.10.8 cffi-1.15.0
charset-normalizer-2.0.7 crcmod-1.7 cryptography-35.0.0 dataclasses-0.8
deprecation-2.1.0 dill-0.3.1.1 docker-5.0.3 docopt-0.6.2 execnet-1.9.0
fastavro-1.4.6 fasteners-0.16.3 freezegun-1.1.0 google-api-core-1.31.3
google-apitools-0.5.31 google-auth-1.35.0 google-cloud-bigquery-2.28.1
google-cloud-bigquery-storage-2.9.1 google-cloud-bigtable-1.7.0
google-cloud-core-1.7.2 google-cloud-datastore-1.15.3 google-cloud-dlp-1.0.0
google-cloud-language-1.3.0 google-cloud-pubsub-1.7.0
google-cloud-recommendations-ai-0.2.0 google-cloud-spanner-1.19.1
google-cloud-videointelligence-1.16.1 google-cloud-vision-1.0.0
google-crc32c-1.3.0 google-resumable-media-2.1.0
googleapis-common-protos-1.53.0 greenlet-1.1.2 grpc-google-iam-v1-0.12.3
grpcio-gcp-0.2.2 hdfs-2.6.0 httplib2-0.19.1 idna-3.3 isodate-0.6.0
jmespath-0.10.0 libcst-0.3.21 mock-2.0.0 more-itertools-8.10.0 msrest-0.6.21
mypy-extensions-0.4.3 numpy-1.19.5 oauth2client-4.1.3 oauthlib-3.1.1
orjson-3.6.1 pandas-1.1.5 parameterized-0.7.5 pbr-5.6.0 pluggy-0.13.1
proto-plus-1.19.6 protobuf-3.17.3 psycopg2-binary-2.9.1 pyarrow-5.0.0
pyasn1-0.4.8 pyasn1-modules-0.2.8 pycparser-2.20 pydot-1.4.2 pyhamcrest-1.10.1
pymongo-3.12.1 pyparsing-2.4.7 pytest-4.6.11 pytest-forked-1.3.0
pytest-timeout-1.4.2 pytest-xdist-1.34.0 python-dateutil-2.8.2 pytz-2021.3
pyyaml-5.4.1 requests-2.26.0 requests-mock-1.9.3 requests-oauthlib-1.3.0
rsa-4.7.2 s3transfer-0.5.0 sqlalchemy-1.4.26 tenacity-5.1.5
testcontainers-3.4.2 typing-extensions-3.10.0.2 typing-inspect-0.7.1
urllib3-1.26.7 wcwidth-0.2.5 websocket-client-1.2.1 wrapt-1.13.2
> Task :release:go-licenses:py:dockerRun
+ go-licenses save github.com/apache/beam/sdks/python/container
--save_path=/output/licenses
> Task :release:go-licenses:go:dockerRun
+ go-licenses save github.com/apache/beam/sdks/go/container
--save_path=/output/licenses
> Task :release:go-licenses:java:dockerRun
+ go-licenses save github.com/apache/beam/sdks/java/container
--save_path=/output/licenses
+ go-licenses csv github.com/apache/beam/sdks/java/container
+ tee /output/licenses/list.csv
> Task :release:go-licenses:py:dockerRun
+ go-licenses csv github.com/apache/beam/sdks/python/container
+ tee /output/licenses/list.csv
google.golang.org/protobuf,https://go.googlesource.com/protobuf/+/refs/heads/master/LICENSE,BSD-3-Clause
google.golang.org/genproto/googleapis/rpc/status,https://github.com/googleapis/go-genproto/blob/master/LICENSE,Apache-2.0
golang.org/x/text,https://go.googlesource.com/text/+/refs/heads/master/LICENSE,BSD-3-Clause
github.com/apache/beam/sdks/go/pkg/beam,https://github.com/apache/beam/blob/master/sdks/go/README.md,Apache-2.0
google.golang.org/grpc,https://github.com/grpc/grpc-go/blob/master/LICENSE,Apache-2.0
github.com/golang/protobuf,https://github.com/golang/protobuf/blob/master/LICENSE,BSD-3-Clause
github.com/nightlyone/lockfile,https://github.com/nightlyone/lockfile/blob/master/LICENSE,MIT
github.com/apache/beam/sdks/python/container,https://github.com/apache/beam/blob/master/LICENSE,Apache-2.0
golang.org/x/net,https://go.googlesource.com/net/+/refs/heads/master/LICENSE,BSD-3-Clause
golang.org/x/sys,https://go.googlesource.com/sys/+/refs/heads/master/LICENSE,BSD-3-Clause
+ chmod -R a+w /output/licenses
> Task :release:go-licenses:py:createLicenses
> Task :sdks:python:container:py36:copyGolangLicenses
> Task :release:go-licenses:go:dockerRun
+ go-licenses csv github.com/apache/beam/sdks/go/container
+ tee /output/licenses/list.csv
golang.org/x/text,https://go.googlesource.com/text/+/refs/heads/master/LICENSE,BSD-3-Clause
github.com/apache/beam/sdks/go,https://github.com/apache/beam/blob/master/sdks/go/README.md,Apache-2.0
google.golang.org/grpc,https://github.com/grpc/grpc-go/blob/master/LICENSE,Apache-2.0
golang.org/x/net,https://go.googlesource.com/net/+/refs/heads/master/LICENSE,BSD-3-Clause
github.com/golang/protobuf,https://github.com/golang/protobuf/blob/master/LICENSE,BSD-3-Clause
google.golang.org/protobuf,https://go.googlesource.com/protobuf/+/refs/heads/master/LICENSE,BSD-3-Clause
google.golang.org/genproto/googleapis/rpc/status,https://github.com/googleapis/go-genproto/blob/master/LICENSE,Apache-2.0
golang.org/x/sys,https://go.googlesource.com/sys/+/refs/heads/master/LICENSE,BSD-3-Clause
+ chmod -R a+w /output/licenses
> Task :sdks:python:container:py36:dockerPrepare
> Task :release:go-licenses:java:dockerRun
+ chmod -R a+w /output/licenses
> Task :release:go-licenses:go:createLicenses
> Task :sdks:go:container:copyGolangLicenses
> Task :sdks:go:container:dockerPrepare
> Task :release:go-licenses:java:createLicenses
> Task :sdks:java:container:java8:copyGolangLicenses
> Task :sdks:go:container:docker
Sending build context to Docker daemon 14.21MB
Step 1/11 : FROM debian:buster
---> 2b6f409b1d24
Step 2/11 : MAINTAINER "Apache Beam <[email protected]>"
---> Running in f3c19b4ee6f3
Removing intermediate container f3c19b4ee6f3
---> 9e83828d0d00
Step 3/11 : ARG pull_licenses
---> Running in 7d109cd8862e
Removing intermediate container 7d109cd8862e
---> 53fca09a30f7
Step 4/11 : RUN apt-get update && DEBIAN_FRONTEND=noninteractive apt-get
install -y ca-certificates && rm -rf /var/lib/apt/lists/*
---> Running in 54a51c5d84a8
Get:1 http://deb.debian.org/debian buster InRelease [122 kB]
Get:2 http://security.debian.org/debian-security buster/updates InRelease [65.4
kB]
Get:3 http://deb.debian.org/debian buster-updates InRelease [51.9 kB]
Get:4 http://security.debian.org/debian-security buster/updates/main amd64
Packages [309 kB]
Get:5 http://deb.debian.org/debian buster/main amd64 Packages [7906 kB]
Get:6 http://deb.debian.org/debian buster-updates/main amd64 Packages [15.2 kB]
Fetched 8469 kB in 2s (4941 kB/s)
Reading package lists...
Reading package lists...
Building dependency tree...
Reading state information...
The following additional packages will be installed:
libssl1.1 openssl
The following NEW packages will be installed:
ca-certificates libssl1.1 openssl
0 upgraded, 3 newly installed, 0 to remove and 1 not upgraded.
Need to get 2549 kB of archives.
After this operation, 6084 kB of additional disk space will be used.
Get:1 http://deb.debian.org/debian buster/main amd64 libssl1.1 amd64
1.1.1d-0+deb10u7 [1539 kB]
Get:2 http://deb.debian.org/debian buster/main amd64 openssl amd64
1.1.1d-0+deb10u7 [845 kB]
Get:3 http://deb.debian.org/debian buster/main amd64 ca-certificates all
20200601~deb10u2 [166 kB]
[91mdebconf: delaying package configuration, since apt-utils is not installed
[0mFetched 2549 kB in 0s (23.5 MB/s)
Selecting previously unselected package libssl1.1:amd64.
(Reading database ...
(Reading database ... 5%(Reading database ... 10%(Reading database ...
15%(Reading database ... 20%(Reading database ... 25%(Reading database ...
30%(Reading database ... 35%(Reading database ... 40%(Reading database ...
45%(Reading database ... 50%(Reading database ... 55%(Reading database ...
60%(Reading database ... 65%(Reading database ... 70%(Reading database ... 75%
(Reading database ... 80%
(Reading database ... 85%
(Reading database ... 90%
(Reading database ... 95%
(Reading database ... 100%(Reading database ... 6677 files and directories
currently installed.)
Preparing to unpack .../libssl1.1_1.1.1d-0+deb10u7_amd64.deb ...
Unpacking libssl1.1:amd64 (1.1.1d-0+deb10u7) ...
Selecting previously unselected package openssl.
Preparing to unpack .../openssl_1.1.1d-0+deb10u7_amd64.deb ...
Unpacking openssl (1.1.1d-0+deb10u7) ...
Selecting previously unselected package ca-certificates.
Preparing to unpack .../ca-certificates_20200601~deb10u2_all.deb ...
Unpacking ca-certificates (20200601~deb10u2) ...
Setting up libssl1.1:amd64 (1.1.1d-0+deb10u7) ...
Setting up openssl (1.1.1d-0+deb10u7) ...
Setting up ca-certificates (20200601~deb10u2) ...
Updating certificates in /etc/ssl/certs...
137 added, 0 removed; done.
Processing triggers for libc-bin (2.28-10) ...
Processing triggers for ca-certificates (20200601~deb10u2) ...
Updating certificates in /etc/ssl/certs...
0 added, 0 removed; done.
Running hooks in /etc/ca-certificates/update.d...
done.
Removing intermediate container 54a51c5d84a8
---> 1533bc2ddd73
Step 5/11 : ADD target/linux_amd64/boot /opt/apache/beam/
---> d209c6c4c65f
Step 6/11 : COPY target/LICENSE /opt/apache/beam/
---> 567e26df7c09
Step 7/11 : COPY target/NOTICE /opt/apache/beam/
---> 23afa8372294
Step 8/11 : COPY target/LICENSE target/go-licenses/*
/opt/apache/beam/third_party_licenses/golang/
---> 13e2e6ae4bfc
Step 9/11 : RUN rm /opt/apache/beam/third_party_licenses/golang/LICENSE
---> Running in 684f774d5d34
Removing intermediate container 684f774d5d34
---> bc8f0ab03da2
Step 10/11 : RUN if [ "$pull_licenses" = "false" ] ; then rm -rf
/opt/apache/beam/third_party_licenses ; fi
---> Running in 2741fb4b8db4
Removing intermediate container 2741fb4b8db4
---> b03d7f7289e7
Step 11/11 : ENTRYPOINT ["/opt/apache/beam/boot"]
---> Running in 078e308e5eb7
Removing intermediate container 078e308e5eb7
---> f7b15853f254
Successfully built f7b15853f254
Successfully tagged apache/beam_go_sdk:latest
> Task :sdks:python:container:py36:docker
---> Running in 3a1ff56faf8c
Removing intermediate container 3a1ff56faf8c
---> 0f7acd24b6b6
Step 4/27 : ARG pull_licenses
---> Running in e21eac4956b2
Removing intermediate container e21eac4956b2
---> 8b2b1081b1cb
Step 5/27 : RUN apt-get update && apt-get install -y libsnappy-dev
libyaml-dev ccache && rm -rf /var/lib/apt/lists/*
---> Running in 4e7af1e74f26
Get:1 http://deb.debian.org/debian buster InRelease [122 kB]
Get:2 http://security.debian.org/debian-security buster/updates InRelease [65.4
kB]
Get:3 http://deb.debian.org/debian buster-updates InRelease [51.9 kB]
Get:4 http://security.debian.org/debian-security buster/updates/main amd64
Packages [309 kB]
Get:5 http://deb.debian.org/debian buster/main amd64 Packages [7906 kB]
Get:6 http://deb.debian.org/debian buster-updates/main amd64 Packages [15.2 kB]
Fetched 8469 kB in 2s (4895 kB/s)
Reading package lists...
Reading package lists...
Building dependency tree...
Reading state information...
libyaml-dev is already the newest version (0.2.1-1).
Suggested packages:
distcc | icecc
The following NEW packages will be installed:
ccache libsnappy-dev libsnappy1v5
0 upgraded, 3 newly installed, 0 to remove and 1 not upgraded.
Need to get 203 kB of archives.
After this operation, 514 kB of additional disk space will be used.
Get:1 http://deb.debian.org/debian buster/main amd64 ccache amd64 3.6-1 [156 kB]
Get:2 http://deb.debian.org/debian buster/main amd64 libsnappy1v5 amd64 1.1.7-1
[17.0 kB]
Get:3 http://deb.debian.org/debian buster/main amd64 libsnappy-dev amd64
1.1.7-1 [29.2 kB]
[91mdebconf: delaying package configuration, since apt-utils is not installed
[0mFetched 203 kB in 0s (3327 kB/s)
Selecting previously unselected package ccache.
(Reading database ...
(Reading database ... 5%(Reading database ... 10%(Reading database ...
15%(Reading database ... 20%(Reading database ... 25%(Reading database ...
30%(Reading database ... 35%(Reading database ... 40%(Reading database ...
45%(Reading database ... 50%(Reading database ... 55%(Reading database ...
60%(Reading database ... 65%(Reading database ... 70%
(Reading database ... 75%
(Reading database ... 80%
(Reading database ... 85%
(Reading database ... 90%
(Reading database ... 95%
(Reading database ... 100%(Reading database ... 24613 files and directories
currently installed.)
Preparing to unpack .../ccache_3.6-1_amd64.deb ...
Unpacking ccache (3.6-1) ...
Selecting previously unselected package libsnappy1v5:amd64.
Preparing to unpack .../libsnappy1v5_1.1.7-1_amd64.deb ...
Unpacking libsnappy1v5:amd64 (1.1.7-1) ...
Selecting previously unselected package libsnappy-dev:amd64.
Preparing to unpack .../libsnappy-dev_1.1.7-1_amd64.deb ...
Unpacking libsnappy-dev:amd64 (1.1.7-1) ...
Setting up ccache (3.6-1) ...
Updating symlinks in /usr/lib/ccache ...
Setting up libsnappy1v5:amd64 (1.1.7-1) ...
Setting up libsnappy-dev:amd64 (1.1.7-1) ...
Processing triggers for libc-bin (2.28-10) ...
Removing intermediate container 4e7af1e74f26
---> 5fced1aac854
Step 6/27 : COPY target/base_image_requirements.txt
/tmp/base_image_requirements.txt
---> 9f112bbbc884
Step 7/27 : RUN pip install -r /tmp/base_image_requirements.txt &&
python -c "import nltk; nltk.download('stopwords')" && rm
/root/nltk_data/corpora/stopwords.zip && python -c "from
google.protobuf.internal import api_implementation; assert
api_implementation._default_implementation_type == 'cpp'; print ('Verified fast
protobuf used.')" && rm -rf /root/.cache/pip && rm -rf
/tmp/base_image_requirements.txt
---> Running in 266d32a3fd88
Ignoring pandas: markers 'python_version >= "3.7"' don't match your environment
Collecting avro-python3==1.8.2
Downloading avro-python3-1.8.2.tar.gz (36 kB)
Collecting fastavro==1.0.0.post1
Downloading fastavro-1.0.0.post1-cp36-cp36m-manylinux2014_x86_64.whl (1.4 MB)
Collecting crcmod==1.7
Downloading crcmod-1.7.tar.gz (89 kB)
Collecting dill==0.3.1.1
Downloading dill-0.3.1.1.tar.gz (151 kB)
Collecting future==0.18.2
Downloading future-0.18.2.tar.gz (829 kB)
> Task :runners:samza:job-server:samzaJobServerCleanup
Stopping job server pid: 7463.
FAILURE: Build failed with an exception.
* Where:
Build file
'<https://ci-beam.apache.org/job/beam_PostCommit_XVR_Samza/ws/src/sdks/java/io/synthetic/build.gradle'>
line: 20
* What went wrong:
A problem occurred evaluating project ':sdks:java:io:synthetic'.
> java.util.ConcurrentModificationException (no error message)
* Try:
Run with --stacktrace option to get the stack trace. Run with --info or --debug
option to get more log output. Run with --scan to get full insights.
* Get more help at https://help.gradle.org
Deprecated Gradle features were used in this build, making it incompatible with
Gradle 7.0.
Use '--warning-mode all' to show the individual deprecation warnings.
See
https://docs.gradle.org/6.9.1/userguide/command_line_interface.html#sec:command_line_warnings
BUILD FAILED in 10m 46s
199 actionable tasks: 139 executed, 53 from cache, 7 up-to-date
Publishing build scan...
https://gradle.com/s/crlhstbqsmjn2
Build step 'Invoke Gradle script' changed build result to FAILURE
Build step 'Invoke Gradle script' marked build as failure
---------------------------------------------------------------------
To unsubscribe, e-mail: [email protected]
For additional commands, e-mail: [email protected]