See
<https://ci-beam.apache.org/job/beam_PreCommit_GoPortable_Cron/893/display/redirect>
Changes:
------------------------------------------
[...truncated 137.65 KB...]
Removing intermediate container a67bc18ed5cc
---> beec29b55183
Step 16/18 : RUN if [ "${pull_licenses}" = "false" ] ; then rm -rf
/opt/apache/beam/third_party_licenses ; fi
---> Running in 2c0462472943
Removing intermediate container 2c0462472943
---> 4740cbd26a01
Step 17/18 : COPY target/profiler/* /opt/google_cloud_profiler/
---> b715202a5758
Step 18/18 : ENTRYPOINT ["/opt/apache/beam/boot"]
> Task :sdks:java:container:java8:docker
---> d39213c7787d
Step 18/18 : ENTRYPOINT ["/opt/apache/beam/boot"]
---> Running in 4cc1ce079546
Removing intermediate container 4cc1ce079546
---> 5ba078ef30b2
> Task :sdks:java:container:java11:docker
---> Running in 4e305c7f11e6
Removing intermediate container 4e305c7f11e6
---> 018eb0321d4e
Successfully built 018eb0321d4e
Successfully tagged apache/beam_java11_sdk:2.35.0.dev
> Task :sdks:go:test:ulrValidatesRunner
Obtaining
file://<https://ci-beam.apache.org/job/beam_PreCommit_GoPortable_Cron/ws/src/sdks/python>
Preparing metadata (setup.py): started
Preparing metadata (setup.py): finished with status 'done'
Collecting avro-python3!=1.9.2,<1.10.0,>=1.8.1
Downloading avro-python3-1.9.2.1.tar.gz (37 kB)
Preparing metadata (setup.py): started
Preparing metadata (setup.py): finished with status 'done'
Collecting crcmod<2.0,>=1.7
Using cached crcmod-1.7.tar.gz (89 kB)
Preparing metadata (setup.py): started
Preparing metadata (setup.py): finished with status 'done'
Collecting dill<0.3.2,>=0.3.1.1
Downloading dill-0.3.1.1.tar.gz (151 kB)
Preparing metadata (setup.py): started
Preparing metadata (setup.py): finished with status 'done'
Collecting fastavro<2,>=0.21.4
Downloading
fastavro-1.4.5-cp38-cp38-manylinux_2_17_x86_64.manylinux2014_x86_64.whl (2.6 MB)
Requirement already satisfied: future<1.0.0,>=0.18.2 in
<https://ci-beam.apache.org/job/beam_PreCommit_GoPortable_Cron/ws/src/build/gradleenv/-273006051/lib/python3.8/site-packages>
(from apache-beam==2.35.0.dev0) (0.18.2)
Requirement already satisfied: grpcio<2,>=1.29.0 in
<https://ci-beam.apache.org/job/beam_PreCommit_GoPortable_Cron/ws/src/build/gradleenv/-273006051/lib/python3.8/site-packages>
(from apache-beam==2.35.0.dev0) (1.41.0)
Collecting hdfs<3.0.0,>=2.1.0
Downloading hdfs-2.6.0-py3-none-any.whl (33 kB)
Collecting httplib2<0.20.0,>=0.8
Downloading httplib2-0.19.1-py3-none-any.whl (95 kB)
Collecting numpy<1.21.0,>=1.14.3
Downloading
numpy-1.20.3-cp38-cp38-manylinux_2_12_x86_64.manylinux2010_x86_64.whl (15.4 MB)
Collecting pymongo<4.0.0,>=3.8.0
Downloading
pymongo-3.12.0-cp38-cp38-manylinux_2_17_x86_64.manylinux2014_x86_64.whl (545 kB)
Collecting oauth2client<5,>=2.0.1
Downloading oauth2client-4.1.3-py2.py3-none-any.whl (98 kB)
Requirement already satisfied: protobuf<4,>=3.12.2 in
<https://ci-beam.apache.org/job/beam_PreCommit_GoPortable_Cron/ws/src/build/gradleenv/-273006051/lib/python3.8/site-packages>
(from apache-beam==2.35.0.dev0) (3.18.1)
Collecting pyarrow<6.0.0,>=0.15.1
Downloading pyarrow-5.0.0-cp38-cp38-manylinux2014_x86_64.whl (23.6 MB)
Collecting pydot<2,>=1.2.0
Downloading pydot-1.4.2-py2.py3-none-any.whl (21 kB)
Collecting python-dateutil<3,>=2.8.0
Downloading python_dateutil-2.8.2-py2.py3-none-any.whl (247 kB)
Collecting pytz>=2018.3
Downloading pytz-2021.3-py2.py3-none-any.whl (503 kB)
Collecting requests<3.0.0,>=2.24.0
Downloading requests-2.26.0-py2.py3-none-any.whl (62 kB)
Collecting typing-extensions<4,>=3.7.0
Downloading typing_extensions-3.10.0.2-py3-none-any.whl (26 kB)
Collecting orjson<4.0
Downloading
orjson-3.6.4-cp38-cp38-manylinux_2_17_x86_64.manylinux2014_x86_64.whl (250 kB)
Requirement already satisfied: six>=1.5.2 in
<https://ci-beam.apache.org/job/beam_PreCommit_GoPortable_Cron/ws/src/build/gradleenv/-273006051/lib/python3.8/site-packages>
(from grpcio<2,>=1.29.0->apache-beam==2.35.0.dev0) (1.16.0)
Collecting docopt
Using cached docopt-0.6.2.tar.gz (25 kB)
Preparing metadata (setup.py): started
Preparing metadata (setup.py): finished with status 'done'
Requirement already satisfied: pyparsing<3,>=2.4.2 in
<https://ci-beam.apache.org/job/beam_PreCommit_GoPortable_Cron/ws/src/build/gradleenv/-273006051/lib/python3.8/site-packages>
(from httplib2<0.20.0,>=0.8->apache-beam==2.35.0.dev0) (2.4.7)
Collecting rsa>=3.1.4
Downloading rsa-4.7.2-py3-none-any.whl (34 kB)
Collecting pyasn1-modules>=0.0.5
Downloading pyasn1_modules-0.2.8-py2.py3-none-any.whl (155 kB)
Collecting pyasn1>=0.1.7
Downloading pyasn1-0.4.8-py2.py3-none-any.whl (77 kB)
Collecting charset-normalizer~=2.0.0
Downloading charset_normalizer-2.0.7-py3-none-any.whl (38 kB)
Collecting certifi>=2017.4.17
Downloading certifi-2021.10.8-py2.py3-none-any.whl (149 kB)
Collecting idna<4,>=2.5
Downloading idna-3.3-py3-none-any.whl (61 kB)
Collecting urllib3<1.27,>=1.21.1
Downloading urllib3-1.26.7-py2.py3-none-any.whl (138 kB)
Building wheels for collected packages: avro-python3, crcmod, dill, docopt
Building wheel for avro-python3 (setup.py): started
Building wheel for avro-python3 (setup.py): finished with status 'done'
Created wheel for avro-python3:
filename=avro_python3-1.9.2.1-py3-none-any.whl size=43512
sha256=89243be81d863ba564f23b7c7e9851b46a1f7e0640e214f575a1246acea79fa7
Stored in directory:
/home/jenkins/.cache/pip/wheels/a5/f2/87/b7c4b9d5915716d94e8bf2e2f3bfbbd73bb5fe2a98677a59cb
Building wheel for crcmod (setup.py): started
Building wheel for crcmod (setup.py): finished with status 'done'
Created wheel for crcmod: filename=crcmod-1.7-cp38-cp38-linux_x86_64.whl
size=30750
sha256=90115eaad5196b008150bfa13bed121df8e06cfe820a54086ff4db7b331a5e0f
Stored in directory:
/home/jenkins/.cache/pip/wheels/ca/5a/02/f3acf982a026f3319fb3e798a8dca2d48fafee7761788562e9
Building wheel for dill (setup.py): started
Building wheel for dill (setup.py): finished with status 'done'
Created wheel for dill: filename=dill-0.3.1.1-py3-none-any.whl size=78546
sha256=0eee1d07dab98b475662b459305413d542fa78a40d92e15ac4dd85abe371dd5b
Stored in directory:
/home/jenkins/.cache/pip/wheels/07/35/78/e9004fa30578734db7f10e7a211605f3f0778d2bdde38a239d
Building wheel for docopt (setup.py): started
Building wheel for docopt (setup.py): finished with status 'done'
Created wheel for docopt: filename=docopt-0.6.2-py2.py3-none-any.whl
size=13724
sha256=9e6560becc49d67973db34eb2b3be533df680b5563921933a1778d935cda9999
Stored in directory:
/home/jenkins/.cache/pip/wheels/56/ea/58/ead137b087d9e326852a851351d1debf4ada529b6ac0ec4e8c
Successfully built avro-python3 crcmod dill docopt
Installing collected packages: urllib3, pyasn1, idna, charset-normalizer,
certifi, rsa, requests, pyasn1-modules, numpy, httplib2, docopt,
typing-extensions, pytz, python-dateutil, pymongo, pydot, pyarrow, orjson,
oauth2client, hdfs, fastavro, dill, crcmod, avro-python3, apache-beam
Running setup.py develop for apache-beam
Successfully installed apache-beam-2.35.0.dev0 avro-python3-1.9.2.1
certifi-2021.10.8 charset-normalizer-2.0.7 crcmod-1.7 dill-0.3.1.1 docopt-0.6.2
fastavro-1.4.5 hdfs-2.6.0 httplib2-0.19.1 idna-3.3 numpy-1.20.3
oauth2client-4.1.3 orjson-3.6.4 pyarrow-5.0.0 pyasn1-0.4.8 pyasn1-modules-0.2.8
pydot-1.4.2 pymongo-3.12.0 python-dateutil-2.8.2 pytz-2021.3 requests-2.26.0
rsa-4.7.2 typing-extensions-3.10.0.2 urllib3-1.26.7
$ TESTS=./test/integration/... ./test/regression
$ RUNNER=portable
$ TIMEOUT=1h
$ SIMULTANEOUS=3
$ GCS_LOCATION=gs://temp-storage-for-end-to-end-tests
$ PROJECT=apache-beam-testing
$ DATAFLOW_PROJECT=apache-beam-testing
$ REGION=us-central1
$ trap exit_background_processes SIGINT SIGTERM EXIT
$ key=--runner
$ case --runner in
$ RUNNER=portable
$ key=--test_expansion_jar
$ case --test_expansion_jar in
$
TEST_EXPANSION_JAR=<https://ci-beam.apache.org/job/beam_PreCommit_GoPortable_Cron/ws/src/sdks/java/testing/expansion-service/build/libs/beam-sdks-java-testing-expansion-service-testExpansionService-2.35.0-SNAPSHOT.jar>
$ cd <https://ci-beam.apache.org/job/beam_PreCommit_GoPortable_Cron/ws/src>
$ test -d sdks/go/test
$ JOB_PORT=55913
$ ENDPOINT=localhost:51887
No endpoint specified; starting a new portable job server on localhost:51887
$ python3 -m apache_beam.runners.portability.local_job_service_main --port 51887
$ JOBSERVER_PID=30997
$ EXPANSION_PORT=57425
$ TEST_EXPANSION_ADDR=localhost:55301
No test expansion address specified; starting a new test expansion server on
localhost:55301
$ java -jar
<https://ci-beam.apache.org/job/beam_PreCommit_GoPortable_Cron/ws/src/sdks/java/testing/expansion-service/build/libs/beam-sdks-java-testing-expansion-service-testExpansionService-2.35.0-SNAPSHOT.jar>
55301
$ TEST_EXPANSION_PID=31018
$ TAG=dev
$ ./gradlew :sdks:go:container:docker -Pdocker-tag=dev
Starting expansion service at localhost:55301
Starting a Gradle Daemon, 4 busy Daemons could not be reused, use --status for
details
Oct 19, 2021 6:32:52 AM org.apache.beam.sdk.expansion.service.ExpansionService
loadRegisteredTransforms
INFO: Registering external transforms: [beam:transforms:xlang:test:cgbk,
beam:transforms:xlang:test:flatten, beam:transforms:xlang:test:prefix,
beam:transforms:xlang:test:multi, beam:transforms:xlang:test:gbk,
beam:transforms:xlang:test:comgl, beam:transforms:xlang:test:compk,
beam:transforms:xlang:count, beam:transforms:xlang:filter_less_than_eq,
beam:transforms:xlang:test:partition, beam:transforms:xlang:test:parquet_write,
beam:transforms:xlang:parquet_read, beam:transforms:xlang:textio_read,
beam:external:java:generate_sequence:v1]
beam:transforms:xlang:test:cgbk:
org.apache.beam.sdk.testing.expansion.TestExpansionService$TestServiceRegistrar$TestCoGroupByKeyTransformProvider@14cd1699
beam:transforms:xlang:test:flatten:
org.apache.beam.sdk.testing.expansion.TestExpansionService$TestServiceRegistrar$TestFlattenTransformProvider@77888435
beam:transforms:xlang:test:prefix:
org.apache.beam.sdk.expansion.service.ExpansionService$ExternalTransformRegistrarLoader$$Lambda$51/883151184@73a1e9a9
beam:transforms:xlang:test:multi:
org.apache.beam.sdk.expansion.service.ExpansionService$ExternalTransformRegistrarLoader$$Lambda$51/883151184@71d44a3
beam:transforms:xlang:test:gbk:
org.apache.beam.sdk.expansion.service.ExpansionService$ExternalTransformRegistrarLoader$$Lambda$51/883151184@7b98f307
beam:transforms:xlang:test:comgl:
org.apache.beam.sdk.expansion.service.ExpansionService$ExternalTransformRegistrarLoader$$Lambda$51/883151184@4802796d
beam:transforms:xlang:test:compk:
org.apache.beam.sdk.expansion.service.ExpansionService$ExternalTransformRegistrarLoader$$Lambda$51/883151184@34123d65
beam:transforms:xlang:count:
org.apache.beam.sdk.expansion.service.ExpansionService$ExternalTransformRegistrarLoader$$Lambda$51/883151184@59474f18
beam:transforms:xlang:filter_less_than_eq:
org.apache.beam.sdk.expansion.service.ExpansionService$ExternalTransformRegistrarLoader$$Lambda$51/883151184@65fb9ffc
beam:transforms:xlang:test:partition:
org.apache.beam.sdk.expansion.service.ExpansionService$ExternalTransformRegistrarLoader$$Lambda$51/883151184@3e694b3f
beam:transforms:xlang:test:parquet_write:
org.apache.beam.sdk.expansion.service.ExpansionService$ExternalTransformRegistrarLoader$$Lambda$51/883151184@1bb5a082
beam:transforms:xlang:parquet_read:
org.apache.beam.sdk.expansion.service.ExpansionService$ExternalTransformRegistrarLoader$$Lambda$51/883151184@78691363
beam:transforms:xlang:textio_read:
org.apache.beam.sdk.expansion.service.ExpansionService$ExternalTransformRegistrarLoader$$Lambda$51/883151184@41d477ed
beam:external:java:generate_sequence:v1:
org.apache.beam.sdk.expansion.service.ExpansionService$ExternalTransformRegistrarLoader$$Lambda$51/883151184@3590fc5b
> Task :buildSrc:compileJava NO-SOURCE
INFO:apache_beam.runners.portability.local_job_service:Grpc server started at
localhost on port 51887
INFO:__main__:Listening for beam jobs on port 51887.
> Task :buildSrc:compileGroovy UP-TO-DATE
> Task :buildSrc:pluginDescriptors UP-TO-DATE
> Task :buildSrc:processResources UP-TO-DATE
> Task :buildSrc:classes UP-TO-DATE
> Task :buildSrc:jar UP-TO-DATE
> Task :buildSrc:assemble UP-TO-DATE
> Task :buildSrc:spotlessGroovy UP-TO-DATE
> Task :buildSrc:spotlessGroovyCheck UP-TO-DATE
> Task :buildSrc:spotlessGroovyGradle UP-TO-DATE
> Task :buildSrc:spotlessGroovyGradleCheck UP-TO-DATE
> Task :buildSrc:spotlessCheck UP-TO-DATE
> Task :buildSrc:pluginUnderTestMetadata UP-TO-DATE
> Task :buildSrc:compileTestJava NO-SOURCE
> Task :buildSrc:compileTestGroovy NO-SOURCE
> Task :buildSrc:processTestResources NO-SOURCE
> Task :buildSrc:testClasses UP-TO-DATE
> Task :buildSrc:test NO-SOURCE
> Task :buildSrc:validatePlugins UP-TO-DATE
> Task :buildSrc:check UP-TO-DATE
> Task :buildSrc:build UP-TO-DATE
Configuration on demand is an incubating feature.
INFO:__main__:Listening for beam jobs on port 51887.
> Task :sdks:go:container:copyLicenses UP-TO-DATE
> Task :sdks:go:container:dockerClean
> Task :sdks:go:container:goPrepare
Use project GOPATH:
<https://ci-beam.apache.org/job/beam_PreCommit_GoPortable_Cron/ws/src/sdks/go/container/.gogradle/project_gopath>
> Task :sdks:go:container:resolveBuildDependencies SKIPPED
> Task :sdks:go:container:installDependencies SKIPPED
> Task :sdks:go:container:buildLinuxAmd64 UP-TO-DATE
> Task :sdks:go:container:goBuild
> Task :sdks:go:container:skipPullLicenses
> Task :sdks:go:container:dockerPrepare
> Task :sdks:go:container:docker
INFO:__main__:Listening for beam jobs on port 51887.
INFO:__main__:Listening for beam jobs on port 51887.
INFO:__main__:Listening for beam jobs on port 51887.
INFO:__main__:Listening for beam jobs on port 51887.
INFO:__main__:Listening for beam jobs on port 51887.
Deprecated Gradle features were used in this build, making it incompatible with
Gradle 7.0.
Use '--warning-mode all' to show the individual deprecation warnings.
See
https://docs.gradle.org/6.9.1/userguide/command_line_interface.html#sec:command_line_warnings
BUILD SUCCESSFUL in 6m 35s
8 actionable tasks: 6 executed, 2 up-to-date
Publishing build scan...
https://gradle.com/s/l3ycvefqxvdf6
$ CONTAINER=apache/beam_go_sdk
$ cd sdks/go
>>> RUNNING portable integration tests with pipeline options: -p 3 -timeout 1h
>>> --runner=portable --project=apache-beam-testing --region=us-central1
>>> --environment_type=DOCKER --environment_config=apache/beam_go_sdk:dev
>>> --staging_location=gs://temp-storage-for-end-to-end-tests/staging-validatesrunner-test
>>>
>>> --temp_location=gs://temp-storage-for-end-to-end-tests/temp-validatesrunner-test
>>> --dataflow_worker_jar= --endpoint=localhost:51887
>>> --test_expansion_addr=localhost:55301
$
./run_validatesrunner_tests.sh: line 399: go: command not found
$ TEST_EXIT_CODE=0
$ cd ../..
$ exit 127
$ exit 127
> Task :sdks:go:test:ulrValidatesRunner FAILED
FAILURE: Build failed with an exception.
* Where:
Build file
'<https://ci-beam.apache.org/job/beam_PreCommit_GoPortable_Cron/ws/src/sdks/go/test/build.gradle'>
line: 171
* What went wrong:
Execution failed for task ':sdks:go:test:ulrValidatesRunner'.
> Process 'command 'sh'' finished with non-zero exit value 127
* Try:
Run with --stacktrace option to get the stack trace. Run with --info or --debug
option to get more log output. Run with --scan to get full insights.
* Get more help at https://help.gradle.org
Deprecated Gradle features were used in this build, making it incompatible with
Gradle 7.0.
Use '--warning-mode all' to show the individual deprecation warnings.
See
https://docs.gradle.org/6.9.1/userguide/command_line_interface.html#sec:command_line_warnings
BUILD FAILED in 24m 0s
109 actionable tasks: 81 executed, 23 from cache, 5 up-to-date
Publishing build scan...
https://gradle.com/s/wdk6g22q55gvq
Build step 'Invoke Gradle script' changed build result to FAILURE
Build step 'Invoke Gradle script' marked build as failure
---------------------------------------------------------------------
To unsubscribe, e-mail: [email protected]
For additional commands, e-mail: [email protected]
