See
<https://ci-beam.apache.org/job/beam_PreCommit_GoPortable_Cron/947/display/redirect>
Changes:
------------------------------------------
[...truncated 228.53 KB...]
---> Running in 79d54425af7c
Removing intermediate container 79d54425af7c
---> 6fc91ca48ed1
Step 16/18 : RUN if [ "${pull_licenses}" = "false" ] ; then rm -rf
/opt/apache/beam/third_party_licenses ; fi
---> Running in 8b6eefb64d6b
Removing intermediate container 8b6eefb64d6b
---> 6432f8018833
Step 17/18 : COPY target/profiler/* /opt/google_cloud_profiler/
---> 89b90eab24ff
Step 18/18 : ENTRYPOINT ["/opt/apache/beam/boot"]
---> Running in 9b050cf2a768
Removing intermediate container 9b050cf2a768
---> 3d93d591d001
Successfully built 3d93d591d001
Successfully tagged apache/beam_java8_sdk:2.35.0.dev
> Task :sdks:java:container:java11:docker
1d2ade66c57e: Pull complete
Digest: sha256:d2118a2aed78004c41277c179441ed86eea5e2b07fd0ac5a029f145208daf1b3
Status: Downloaded newer image for openjdk:11
---> 40eccaa4f420
Step 3/18 : MAINTAINER "Apache Beam <[email protected]>"
---> Running in 08153d07ce9b
Removing intermediate container 08153d07ce9b
---> 19cc285fd6d2
Step 4/18 : ARG pull_licenses
---> Running in e66cd0978232
Removing intermediate container e66cd0978232
---> 79abefbe857b
Step 5/18 : ADD target/slf4j-api.jar /opt/apache/beam/jars/
---> 5be6cb4fd035
Step 6/18 : ADD target/slf4j-jdk14.jar /opt/apache/beam/jars/
---> be04dc4a0e83
Step 7/18 : ADD target/beam-sdks-java-harness.jar /opt/apache/beam/jars/
---> 8cf8ba40786a
Step 8/18 : ADD target/beam-sdks-java-io-kafka.jar /opt/apache/beam/jars/
---> d25651917c46
Step 9/18 : ADD target/kafka-clients.jar /opt/apache/beam/jars/
---> b80a032480b0
Step 10/18 : ADD target/linux_amd64/boot /opt/apache/beam/
> Task :sdks:go:test:ulrValidatesRunner
Obtaining
file://<https://ci-beam.apache.org/job/beam_PreCommit_GoPortable_Cron/ws/src/sdks/python>
Preparing metadata (setup.py): started
Preparing metadata (setup.py): finished with status 'done'
Collecting avro-python3!=1.9.2,<1.10.0,>=1.8.1
Using cached avro_python3-1.9.2.1-py3-none-any.whl
Collecting crcmod<2.0,>=1.7
Using cached crcmod-1.7-cp38-cp38-linux_x86_64.whl
Collecting dill<0.3.2,>=0.3.1.1
Using cached dill-0.3.1.1-py3-none-any.whl
Collecting fastavro<2,>=0.21.4
Using cached
fastavro-1.4.7-cp38-cp38-manylinux_2_17_x86_64.manylinux2014_x86_64.whl (2.6 MB)
Requirement already satisfied: future<1.0.0,>=0.18.2 in
<https://ci-beam.apache.org/job/beam_PreCommit_GoPortable_Cron/ws/src/build/gradleenv/-273006051/lib/python3.8/site-packages>
(from apache-beam==2.35.0.dev0) (0.18.2)
Requirement already satisfied: grpcio<2,>=1.29.0 in
<https://ci-beam.apache.org/job/beam_PreCommit_GoPortable_Cron/ws/src/build/gradleenv/-273006051/lib/python3.8/site-packages>
(from apache-beam==2.35.0.dev0) (1.41.1)
Collecting hdfs<3.0.0,>=2.1.0
Using cached hdfs-2.6.0-py3-none-any.whl (33 kB)
Collecting httplib2<0.20.0,>=0.8
Using cached httplib2-0.19.1-py3-none-any.whl (95 kB)
Collecting numpy<1.21.0,>=1.14.3
Using cached
numpy-1.20.3-cp38-cp38-manylinux_2_12_x86_64.manylinux2010_x86_64.whl (15.4 MB)
Collecting pymongo<4.0.0,>=3.8.0
Using cached
pymongo-3.12.1-cp38-cp38-manylinux_2_17_x86_64.manylinux2014_x86_64.whl (527 kB)
Collecting oauth2client<5,>=2.0.1
Using cached oauth2client-4.1.3-py2.py3-none-any.whl (98 kB)
Requirement already satisfied: protobuf<4,>=3.12.2 in
<https://ci-beam.apache.org/job/beam_PreCommit_GoPortable_Cron/ws/src/build/gradleenv/-273006051/lib/python3.8/site-packages>
(from apache-beam==2.35.0.dev0) (3.19.1)
Collecting pyarrow<6.0.0,>=0.15.1
Using cached pyarrow-5.0.0-cp38-cp38-manylinux2014_x86_64.whl (23.6 MB)
Collecting pydot<2,>=1.2.0
Using cached pydot-1.4.2-py2.py3-none-any.whl (21 kB)
Collecting python-dateutil<3,>=2.8.0
Using cached python_dateutil-2.8.2-py2.py3-none-any.whl (247 kB)
Collecting pytz>=2018.3
Using cached pytz-2021.3-py2.py3-none-any.whl (503 kB)
Collecting requests<3.0.0,>=2.24.0
Using cached requests-2.26.0-py2.py3-none-any.whl (62 kB)
Collecting typing-extensions<4,>=3.7.0
Using cached typing_extensions-3.10.0.2-py3-none-any.whl (26 kB)
Collecting orjson<4.0
Using cached
orjson-3.6.4-cp38-cp38-manylinux_2_17_x86_64.manylinux2014_x86_64.whl (250 kB)
Requirement already satisfied: six>=1.5.2 in
<https://ci-beam.apache.org/job/beam_PreCommit_GoPortable_Cron/ws/src/build/gradleenv/-273006051/lib/python3.8/site-packages>
(from grpcio<2,>=1.29.0->apache-beam==2.35.0.dev0) (1.16.0)
Collecting docopt
Using cached docopt-0.6.2-py2.py3-none-any.whl
Requirement already satisfied: pyparsing<3,>=2.4.2 in
<https://ci-beam.apache.org/job/beam_PreCommit_GoPortable_Cron/ws/src/build/gradleenv/-273006051/lib/python3.8/site-packages>
(from httplib2<0.20.0,>=0.8->apache-beam==2.35.0.dev0) (2.4.7)
Collecting pyasn1-modules>=0.0.5
Using cached pyasn1_modules-0.2.8-py2.py3-none-any.whl (155 kB)
Collecting pyasn1>=0.1.7
Using cached pyasn1-0.4.8-py2.py3-none-any.whl (77 kB)
Collecting rsa>=3.1.4
Using cached rsa-4.7.2-py3-none-any.whl (34 kB)
Collecting charset-normalizer~=2.0.0
Using cached charset_normalizer-2.0.7-py3-none-any.whl (38 kB)
Collecting idna<4,>=2.5
Using cached idna-3.3-py3-none-any.whl (61 kB)
Collecting certifi>=2017.4.17
Using cached certifi-2021.10.8-py2.py3-none-any.whl (149 kB)
Collecting urllib3<1.27,>=1.21.1
Using cached urllib3-1.26.7-py2.py3-none-any.whl (138 kB)
Installing collected packages: urllib3, pyasn1, idna, charset-normalizer,
certifi, rsa, requests, pyasn1-modules, numpy, httplib2, docopt,
typing-extensions, pytz, python-dateutil, pymongo, pydot, pyarrow, orjson,
oauth2client, hdfs, fastavro, dill, crcmod, avro-python3, apache-beam
Running setup.py develop for apache-beam
Successfully installed apache-beam-2.35.0.dev0 avro-python3-1.9.2.1
certifi-2021.10.8 charset-normalizer-2.0.7 crcmod-1.7 dill-0.3.1.1 docopt-0.6.2
fastavro-1.4.7 hdfs-2.6.0 httplib2-0.19.1 idna-3.3 numpy-1.20.3
oauth2client-4.1.3 orjson-3.6.4 pyarrow-5.0.0 pyasn1-0.4.8 pyasn1-modules-0.2.8
pydot-1.4.2 pymongo-3.12.1 python-dateutil-2.8.2 pytz-2021.3 requests-2.26.0
rsa-4.7.2 typing-extensions-3.10.0.2 urllib3-1.26.7
$ TESTS=./test/integration/... ./test/regression
$ RUNNER=portable
$ TIMEOUT=2h
$ SIMULTANEOUS=3
$ GCS_LOCATION=gs://temp-storage-for-end-to-end-tests
$ PROJECT=apache-beam-testing
$ DATAFLOW_PROJECT=apache-beam-testing
$ REGION=us-central1
$ trap exit_background_processes SIGINT SIGTERM EXIT
$ key=--runner
$ case --runner in
$ RUNNER=portable
$ key=--test_expansion_jar
$ case --test_expansion_jar in
$
TEST_EXPANSION_JAR=<https://ci-beam.apache.org/job/beam_PreCommit_GoPortable_Cron/ws/src/sdks/java/testing/expansion-service/build/libs/beam-sdks-java-testing-expansion-service-testExpansionService-2.35.0-SNAPSHOT.jar>
$ cd <https://ci-beam.apache.org/job/beam_PreCommit_GoPortable_Cron/ws/src>
$ test -d sdks/go/test
$ JOB_PORT=60935
$ ENDPOINT=localhost:48785
No endpoint specified; starting a new portable job server on localhost:48785
$ python3 -m apache_beam.runners.portability.local_job_service_main --port 48785
$ JOBSERVER_PID=18608
$ EXPANSION_PORT=60793
$ TEST_EXPANSION_ADDR=localhost:52437
No test expansion address specified; starting a new test expansion server on
localhost:52437
$ java -jar
<https://ci-beam.apache.org/job/beam_PreCommit_GoPortable_Cron/ws/src/sdks/java/testing/expansion-service/build/libs/beam-sdks-java-testing-expansion-service-testExpansionService-2.35.0-SNAPSHOT.jar>
52437
$ TEST_EXPANSION_PID=18650
$ TAG=dev
$ ./gradlew :sdks:go:container:docker -Pdocker-tag=dev
Starting expansion service at localhost:52437
INFO:apache_beam.runners.portability.local_job_service:Grpc server started at
localhost on port 48785
INFO:__main__:Listening for beam jobs on port 48785.
Starting a Gradle Daemon, 4 busy Daemons could not be reused, use --status for
details
Nov 01, 2021 6:06:41 AM org.apache.beam.sdk.expansion.service.ExpansionService
loadRegisteredTransforms
INFO: Registering external transforms: [beam:transforms:xlang:test:cgbk,
beam:transforms:xlang:test:flatten, beam:transforms:xlang:test:prefix,
beam:transforms:xlang:test:multi, beam:transforms:xlang:test:gbk,
beam:transforms:xlang:test:comgl, beam:transforms:xlang:test:compk,
beam:transforms:xlang:count, beam:transforms:xlang:filter_less_than_eq,
beam:transforms:xlang:test:partition, beam:transforms:xlang:test:parquet_write,
beam:transforms:xlang:parquet_read, beam:transforms:xlang:textio_read,
beam:external:java:generate_sequence:v1]
beam:transforms:xlang:test:cgbk:
org.apache.beam.sdk.testing.expansion.TestExpansionService$TestServiceRegistrar$TestCoGroupByKeyTransformProvider@1aafa419
beam:transforms:xlang:test:flatten:
org.apache.beam.sdk.testing.expansion.TestExpansionService$TestServiceRegistrar$TestFlattenTransformProvider@47eaca72
beam:transforms:xlang:test:prefix:
org.apache.beam.sdk.expansion.service.ExpansionService$ExternalTransformRegistrarLoader$1@55141def
beam:transforms:xlang:test:multi:
org.apache.beam.sdk.expansion.service.ExpansionService$ExternalTransformRegistrarLoader$1@55182842
beam:transforms:xlang:test:gbk:
org.apache.beam.sdk.expansion.service.ExpansionService$ExternalTransformRegistrarLoader$1@3270d194
beam:transforms:xlang:test:comgl:
org.apache.beam.sdk.expansion.service.ExpansionService$ExternalTransformRegistrarLoader$1@235834f2
beam:transforms:xlang:test:compk:
org.apache.beam.sdk.expansion.service.ExpansionService$ExternalTransformRegistrarLoader$1@5656be13
beam:transforms:xlang:count:
org.apache.beam.sdk.expansion.service.ExpansionService$ExternalTransformRegistrarLoader$1@4218d6a3
beam:transforms:xlang:filter_less_than_eq:
org.apache.beam.sdk.expansion.service.ExpansionService$ExternalTransformRegistrarLoader$1@76505305
beam:transforms:xlang:test:partition:
org.apache.beam.sdk.expansion.service.ExpansionService$ExternalTransformRegistrarLoader$1@14cd1699
beam:transforms:xlang:test:parquet_write:
org.apache.beam.sdk.expansion.service.ExpansionService$ExternalTransformRegistrarLoader$1@77888435
beam:transforms:xlang:parquet_read:
org.apache.beam.sdk.expansion.service.ExpansionService$ExternalTransformRegistrarLoader$1@73a1e9a9
beam:transforms:xlang:textio_read:
org.apache.beam.sdk.expansion.service.ExpansionService$ExternalTransformRegistrarLoader$1@71d44a3
beam:external:java:generate_sequence:v1:
org.apache.beam.sdk.expansion.service.ExpansionService$ExternalTransformRegistrarLoader$1@7b98f307
> Task :buildSrc:compileJava NO-SOURCE
> Task :buildSrc:compileGroovy UP-TO-DATE
> Task :buildSrc:pluginDescriptors UP-TO-DATE
> Task :buildSrc:processResources UP-TO-DATE
> Task :buildSrc:classes UP-TO-DATE
> Task :buildSrc:jar UP-TO-DATE
> Task :buildSrc:assemble UP-TO-DATE
> Task :buildSrc:spotlessGroovy UP-TO-DATE
> Task :buildSrc:spotlessGroovyCheck UP-TO-DATE
> Task :buildSrc:spotlessGroovyGradle UP-TO-DATE
> Task :buildSrc:spotlessGroovyGradleCheck UP-TO-DATE
> Task :buildSrc:spotlessCheck UP-TO-DATE
> Task :buildSrc:pluginUnderTestMetadata UP-TO-DATE
> Task :buildSrc:compileTestJava NO-SOURCE
> Task :buildSrc:compileTestGroovy NO-SOURCE
> Task :buildSrc:processTestResources NO-SOURCE
> Task :buildSrc:testClasses UP-TO-DATE
> Task :buildSrc:test NO-SOURCE
> Task :buildSrc:validatePlugins UP-TO-DATE
> Task :buildSrc:check UP-TO-DATE
> Task :buildSrc:build UP-TO-DATE
Configuration on demand is an incubating feature.
> Task :sdks:go:container:copyLicenses UP-TO-DATE
> Task :sdks:go:container:dockerClean
> Task :sdks:go:container:goPrepare
Use project GOPATH:
<https://ci-beam.apache.org/job/beam_PreCommit_GoPortable_Cron/ws/src/sdks/go/container/.gogradle/project_gopath>
> Task :sdks:go:container:resolveBuildDependencies SKIPPED
> Task :sdks:go:container:installDependencies SKIPPED
> Task :sdks:go:container:buildLinuxAmd64 UP-TO-DATE
> Task :sdks:go:container:goBuild
> Task :sdks:go:container:skipPullLicenses
> Task :sdks:go:container:dockerPrepare
INFO:__main__:Listening for beam jobs on port 48785.
> Task :sdks:go:container:docker
Deprecated Gradle features were used in this build, making it incompatible with
Gradle 7.0.
Use '--warning-mode all' to show the individual deprecation warnings.
See
https://docs.gradle.org/6.9.1/userguide/command_line_interface.html#sec:command_line_warnings
BUILD SUCCESSFUL in 54s
8 actionable tasks: 6 executed, 2 up-to-date
Publishing build scan...
Publishing build scan failed due to network error
'java.net.SocketTimeoutException: Read timed out' (2 retries remaining)...
Publishing build scan failed due to network error
'java.net.SocketTimeoutException: Read timed out' (1 retry remaining)...
INFO:__main__:Listening for beam jobs on port 48785.
A network error occurred.
If you require assistance with this problem, please report it via
https://gradle.com/help/plugin and include the following information via
copy/paste.
----------
Gradle version: 6.9.1
Plugin version: 3.4.1
Request URL: https://scans-in.gradle.com/scans/publish/gradle/3.4.1/token
Request ID: 5f755bf8-9c4e-40a2-b49c-e48e22da0ea3
Exception: java.net.SocketTimeoutException: Read timed out
----------
$ CONTAINER=apache/beam_go_sdk
$ cd sdks/go
>>> RUNNING portable integration tests with pipeline options: -p 3 -timeout 2h
>>> --runner=portable --project=apache-beam-testing --region=us-central1
>>> --environment_type=DOCKER --environment_config=apache/beam_go_sdk:dev
>>> --staging_location=gs://temp-storage-for-end-to-end-tests/staging-validatesrunner-test
>>>
>>> --temp_location=gs://temp-storage-for-end-to-end-tests/temp-validatesrunner-test
>>> --dataflow_worker_jar= --endpoint=localhost:48785
>>> --test_expansion_addr=localhost:52437
$
./run_validatesrunner_tests.sh: line 399: go: command not found
$ TEST_EXIT_CODE=0
$ cd ../..
$ exit 127
$ exit 127
> Task :sdks:go:test:ulrValidatesRunner FAILED
FAILURE: Build failed with an exception.
* Where:
Build file
'<https://ci-beam.apache.org/job/beam_PreCommit_GoPortable_Cron/ws/src/sdks/go/test/build.gradle'>
line: 185
* What went wrong:
Execution failed for task ':sdks:go:test:ulrValidatesRunner'.
> Process 'command 'sh'' finished with non-zero exit value 127
* Try:
Run with --stacktrace option to get the stack trace. Run with --info or --debug
option to get more log output. Run with --scan to get full insights.
* Get more help at https://help.gradle.org
Deprecated Gradle features were used in this build, making it incompatible with
Gradle 7.0.
Use '--warning-mode all' to show the individual deprecation warnings.
See
https://docs.gradle.org/6.9.1/userguide/command_line_interface.html#sec:command_line_warnings
BUILD FAILED in 5m 47s
109 actionable tasks: 79 executed, 25 from cache, 5 up-to-date
Publishing build scan...
https://gradle.com/s/zyokvsswag63y
Build step 'Invoke Gradle script' changed build result to FAILURE
Build step 'Invoke Gradle script' marked build as failure
---------------------------------------------------------------------
To unsubscribe, e-mail: [email protected]
For additional commands, e-mail: [email protected]
