See <https://ci-beam.apache.org/job/beam_PreCommit_GoPortable_Cron/943/display/redirect>
Changes: ------------------------------------------ [...truncated 217.92 KB...] Step 7/11 : COPY target/NOTICE /opt/apache/beam/ ---> bb91bf3d5284 Step 8/11 : COPY target/LICENSE target/go-licenses/* /opt/apache/beam/third_party_licenses/golang/ ---> 639156b88dc8 Step 9/11 : RUN rm /opt/apache/beam/third_party_licenses/golang/LICENSE ---> Running in 69cea715620a Removing intermediate container 69cea715620a ---> 726456ff8230 Step 10/11 : RUN if [ "$pull_licenses" = "false" ] ; then rm -rf /opt/apache/beam/third_party_licenses ; fi ---> Running in 9e8a1f365618 Removing intermediate container 9e8a1f365618 ---> 4f0392325b9d Step 11/11 : ENTRYPOINT ["/opt/apache/beam/boot"] ---> Running in 1c1eb5eb5324 Removing intermediate container 1c1eb5eb5324 ---> d59e92e145a8 Successfully built d59e92e145a8 Successfully tagged apache/beam_go_sdk:latest > Task :sdks:java:container:pullLicenses Copying already-fetched licenses from <https://ci-beam.apache.org/job/beam_PreCommit_GoPortable_Cron/ws/src/sdks/java/container/build/reports/dependency-license> to <https://ci-beam.apache.org/job/beam_PreCommit_GoPortable_Cron/ws/src/sdks/java/container/build/target/java_third_party_licenses> Already using interpreter /usr/bin/python3 Using base prefix '/usr' New python executable in <https://ci-beam.apache.org/job/beam_PreCommit_GoPortable_Cron/ws/src/sdks/java/container/build/virtualenv/bin/python3> Also creating executable in <https://ci-beam.apache.org/job/beam_PreCommit_GoPortable_Cron/ws/src/sdks/java/container/build/virtualenv/bin/python> Installing setuptools, pip, wheel... done. DEPRECATION: Python 3.5 reached the end of its life on September 13th, 2020. Please upgrade your Python as Python 3.5 is no longer maintained. pip 21.0 will drop support for Python 3.5 in January 2021. pip 21.0 will remove support for this functionality. Collecting beautifulsoup4<5.0,>=4.9.0 Using cached beautifulsoup4-4.10.0-py3-none-any.whl (97 kB) Collecting future<1.0.0,>=0.16.0 Using cached future-0.18.2-py3-none-any.whl Collecting pyyaml<6.0.0,>=3.12 Using cached PyYAML-5.3.1-cp35-cp35m-linux_x86_64.whl Collecting tenacity<6.0,>=5.0.2 Using cached tenacity-5.1.5-py2.py3-none-any.whl (34 kB) Collecting soupsieve>1.2 Using cached soupsieve-2.1-py3-none-any.whl (32 kB) Collecting six>=1.9.0 Using cached six-1.16.0-py2.py3-none-any.whl (11 kB) Installing collected packages: soupsieve, six, tenacity, pyyaml, future, beautifulsoup4 Successfully installed beautifulsoup4-4.10.0 future-0.18.2 pyyaml-5.3.1 six-1.16.0 soupsieve-2.1 tenacity-5.1.5 Executing <https://ci-beam.apache.org/job/beam_PreCommit_GoPortable_Cron/ws/src/sdks/java/container/build/virtualenv/bin/python> <https://ci-beam.apache.org/job/beam_PreCommit_GoPortable_Cron/ws/src/sdks/java/container/license_scripts/pull_licenses_java.py> --license_index=<https://ci-beam.apache.org/job/beam_PreCommit_GoPortable_Cron/ws/src/sdks/java/container/build/reports/dependency-license/index.json> --output_dir=<https://ci-beam.apache.org/job/beam_PreCommit_GoPortable_Cron/ws/src/sdks/java/container/build/target/java_third_party_licenses> --dep_url_yaml=<https://ci-beam.apache.org/job/beam_PreCommit_GoPortable_Cron/ws/src/sdks/java/container/license_scripts/dep_urls_java.yaml> INFO:root:Pulling license for 208 dependencies using 16 threads. INFO:root:pull_licenses_java.py succeed. It took 9.025919 seconds with 16 threads. Copying licenses from <https://ci-beam.apache.org/job/beam_PreCommit_GoPortable_Cron/ws/src/sdks/java/container/build/target/java_third_party_licenses> to <https://ci-beam.apache.org/job/beam_PreCommit_GoPortable_Cron/ws/src/sdks/java/container/build/target/third_party_licenses.> Finished license_scripts.sh > Task :sdks:java:container:java11:copyJavaThirdPartyLicenses > Task :sdks:java:container:java8:copyJavaThirdPartyLicenses > Task :sdks:java:container:java8:dockerPrepare > Task :sdks:java:container:java11:dockerPrepare > Task :sdks:java:container:java11:docker > Task :sdks:java:container:java8:docker > Task :sdks:go:test:ulrValidatesRunner Obtaining file://<https://ci-beam.apache.org/job/beam_PreCommit_GoPortable_Cron/ws/src/sdks/python> Preparing metadata (setup.py): started Preparing metadata (setup.py): finished with status 'done' Collecting avro-python3!=1.9.2,<1.10.0,>=1.8.1 Using cached avro_python3-1.9.2.1-py3-none-any.whl Collecting crcmod<2.0,>=1.7 Using cached crcmod-1.7-cp38-cp38-linux_x86_64.whl Collecting dill<0.3.2,>=0.3.1.1 Using cached dill-0.3.1.1-py3-none-any.whl Collecting fastavro<2,>=0.21.4 Using cached fastavro-1.4.7-cp38-cp38-manylinux_2_17_x86_64.manylinux2014_x86_64.whl (2.6 MB) Requirement already satisfied: future<1.0.0,>=0.18.2 in <https://ci-beam.apache.org/job/beam_PreCommit_GoPortable_Cron/ws/src/build/gradleenv/-273006051/lib/python3.8/site-packages> (from apache-beam==2.35.0.dev0) (0.18.2) Requirement already satisfied: grpcio<2,>=1.29.0 in <https://ci-beam.apache.org/job/beam_PreCommit_GoPortable_Cron/ws/src/build/gradleenv/-273006051/lib/python3.8/site-packages> (from apache-beam==2.35.0.dev0) (1.41.1) Collecting hdfs<3.0.0,>=2.1.0 Using cached hdfs-2.6.0-py3-none-any.whl (33 kB) Collecting httplib2<0.20.0,>=0.8 Using cached httplib2-0.19.1-py3-none-any.whl (95 kB) Collecting numpy<1.21.0,>=1.14.3 Using cached numpy-1.20.3-cp38-cp38-manylinux_2_12_x86_64.manylinux2010_x86_64.whl (15.4 MB) Collecting pymongo<4.0.0,>=3.8.0 Using cached pymongo-3.12.1-cp38-cp38-manylinux_2_17_x86_64.manylinux2014_x86_64.whl (527 kB) Collecting oauth2client<5,>=2.0.1 Using cached oauth2client-4.1.3-py2.py3-none-any.whl (98 kB) Requirement already satisfied: protobuf<4,>=3.12.2 in <https://ci-beam.apache.org/job/beam_PreCommit_GoPortable_Cron/ws/src/build/gradleenv/-273006051/lib/python3.8/site-packages> (from apache-beam==2.35.0.dev0) (3.19.1) Collecting pyarrow<6.0.0,>=0.15.1 Using cached pyarrow-5.0.0-cp38-cp38-manylinux2014_x86_64.whl (23.6 MB) Collecting pydot<2,>=1.2.0 Using cached pydot-1.4.2-py2.py3-none-any.whl (21 kB) Collecting python-dateutil<3,>=2.8.0 Using cached python_dateutil-2.8.2-py2.py3-none-any.whl (247 kB) Collecting pytz>=2018.3 Using cached pytz-2021.3-py2.py3-none-any.whl (503 kB) Collecting requests<3.0.0,>=2.24.0 Using cached requests-2.26.0-py2.py3-none-any.whl (62 kB) Collecting typing-extensions<4,>=3.7.0 Using cached typing_extensions-3.10.0.2-py3-none-any.whl (26 kB) Collecting orjson<4.0 Using cached orjson-3.6.4-cp38-cp38-manylinux_2_17_x86_64.manylinux2014_x86_64.whl (250 kB) Requirement already satisfied: six>=1.5.2 in <https://ci-beam.apache.org/job/beam_PreCommit_GoPortable_Cron/ws/src/build/gradleenv/-273006051/lib/python3.8/site-packages> (from grpcio<2,>=1.29.0->apache-beam==2.35.0.dev0) (1.16.0) Collecting docopt Using cached docopt-0.6.2-py2.py3-none-any.whl Requirement already satisfied: pyparsing<3,>=2.4.2 in <https://ci-beam.apache.org/job/beam_PreCommit_GoPortable_Cron/ws/src/build/gradleenv/-273006051/lib/python3.8/site-packages> (from httplib2<0.20.0,>=0.8->apache-beam==2.35.0.dev0) (2.4.7) Collecting pyasn1>=0.1.7 Using cached pyasn1-0.4.8-py2.py3-none-any.whl (77 kB) Collecting pyasn1-modules>=0.0.5 Using cached pyasn1_modules-0.2.8-py2.py3-none-any.whl (155 kB) Collecting rsa>=3.1.4 Using cached rsa-4.7.2-py3-none-any.whl (34 kB) Collecting certifi>=2017.4.17 Using cached certifi-2021.10.8-py2.py3-none-any.whl (149 kB) Collecting charset-normalizer~=2.0.0 Using cached charset_normalizer-2.0.7-py3-none-any.whl (38 kB) Collecting idna<4,>=2.5 Using cached idna-3.3-py3-none-any.whl (61 kB) Collecting urllib3<1.27,>=1.21.1 Using cached urllib3-1.26.7-py2.py3-none-any.whl (138 kB) Installing collected packages: urllib3, pyasn1, idna, charset-normalizer, certifi, rsa, requests, pyasn1-modules, numpy, httplib2, docopt, typing-extensions, pytz, python-dateutil, pymongo, pydot, pyarrow, orjson, oauth2client, hdfs, fastavro, dill, crcmod, avro-python3, apache-beam Running setup.py develop for apache-beam Successfully installed apache-beam-2.35.0.dev0 avro-python3-1.9.2.1 certifi-2021.10.8 charset-normalizer-2.0.7 crcmod-1.7 dill-0.3.1.1 docopt-0.6.2 fastavro-1.4.7 hdfs-2.6.0 httplib2-0.19.1 idna-3.3 numpy-1.20.3 oauth2client-4.1.3 orjson-3.6.4 pyarrow-5.0.0 pyasn1-0.4.8 pyasn1-modules-0.2.8 pydot-1.4.2 pymongo-3.12.1 python-dateutil-2.8.2 pytz-2021.3 requests-2.26.0 rsa-4.7.2 typing-extensions-3.10.0.2 urllib3-1.26.7 $ TESTS=./test/integration/... ./test/regression $ RUNNER=portable $ TIMEOUT=2h $ SIMULTANEOUS=3 $ GCS_LOCATION=gs://temp-storage-for-end-to-end-tests $ PROJECT=apache-beam-testing $ DATAFLOW_PROJECT=apache-beam-testing $ REGION=us-central1 $ trap exit_background_processes SIGINT SIGTERM EXIT $ key=--runner $ case --runner in $ RUNNER=portable $ key=--test_expansion_jar $ case --test_expansion_jar in $ TEST_EXPANSION_JAR=<https://ci-beam.apache.org/job/beam_PreCommit_GoPortable_Cron/ws/src/sdks/java/testing/expansion-service/build/libs/beam-sdks-java-testing-expansion-service-testExpansionService-2.35.0-SNAPSHOT.jar> $ cd <https://ci-beam.apache.org/job/beam_PreCommit_GoPortable_Cron/ws/src> $ test -d sdks/go/test $ JOB_PORT=37897 $ ENDPOINT=localhost:34389 No endpoint specified; starting a new portable job server on localhost:34389 $ python3 -m apache_beam.runners.portability.local_job_service_main --port 34389 $ JOBSERVER_PID=28476 $ EXPANSION_PORT=48061 $ TEST_EXPANSION_ADDR=localhost:54439 No test expansion address specified; starting a new test expansion server on localhost:54439 $ java -jar <https://ci-beam.apache.org/job/beam_PreCommit_GoPortable_Cron/ws/src/sdks/java/testing/expansion-service/build/libs/beam-sdks-java-testing-expansion-service-testExpansionService-2.35.0-SNAPSHOT.jar> 54439 $ TEST_EXPANSION_PID=28485 $ TAG=dev $ ./gradlew :sdks:go:container:docker -Pdocker-tag=dev Starting expansion service at localhost:54439 Starting a Gradle Daemon, 3 busy Daemons could not be reused, use --status for details Oct 31, 2021 6:07:44 AM org.apache.beam.sdk.expansion.service.ExpansionService loadRegisteredTransforms INFO: Registering external transforms: [beam:transforms:xlang:test:cgbk, beam:transforms:xlang:test:flatten, beam:transforms:xlang:test:prefix, beam:transforms:xlang:test:multi, beam:transforms:xlang:test:gbk, beam:transforms:xlang:test:comgl, beam:transforms:xlang:test:compk, beam:transforms:xlang:count, beam:transforms:xlang:filter_less_than_eq, beam:transforms:xlang:test:partition, beam:transforms:xlang:test:parquet_write, beam:transforms:xlang:parquet_read, beam:transforms:xlang:textio_read, beam:external:java:generate_sequence:v1] beam:transforms:xlang:test:cgbk: org.apache.beam.sdk.testing.expansion.TestExpansionService$TestServiceRegistrar$TestCoGroupByKeyTransformProvider@1aafa419 beam:transforms:xlang:test:flatten: org.apache.beam.sdk.testing.expansion.TestExpansionService$TestServiceRegistrar$TestFlattenTransformProvider@47eaca72 beam:transforms:xlang:test:prefix: org.apache.beam.sdk.expansion.service.ExpansionService$ExternalTransformRegistrarLoader$1@55141def beam:transforms:xlang:test:multi: org.apache.beam.sdk.expansion.service.ExpansionService$ExternalTransformRegistrarLoader$1@55182842 beam:transforms:xlang:test:gbk: org.apache.beam.sdk.expansion.service.ExpansionService$ExternalTransformRegistrarLoader$1@3270d194 beam:transforms:xlang:test:comgl: org.apache.beam.sdk.expansion.service.ExpansionService$ExternalTransformRegistrarLoader$1@235834f2 beam:transforms:xlang:test:compk: org.apache.beam.sdk.expansion.service.ExpansionService$ExternalTransformRegistrarLoader$1@5656be13 beam:transforms:xlang:count: org.apache.beam.sdk.expansion.service.ExpansionService$ExternalTransformRegistrarLoader$1@4218d6a3 beam:transforms:xlang:filter_less_than_eq: org.apache.beam.sdk.expansion.service.ExpansionService$ExternalTransformRegistrarLoader$1@76505305 beam:transforms:xlang:test:partition: org.apache.beam.sdk.expansion.service.ExpansionService$ExternalTransformRegistrarLoader$1@14cd1699 beam:transforms:xlang:test:parquet_write: org.apache.beam.sdk.expansion.service.ExpansionService$ExternalTransformRegistrarLoader$1@77888435 beam:transforms:xlang:parquet_read: org.apache.beam.sdk.expansion.service.ExpansionService$ExternalTransformRegistrarLoader$1@73a1e9a9 beam:transforms:xlang:textio_read: org.apache.beam.sdk.expansion.service.ExpansionService$ExternalTransformRegistrarLoader$1@71d44a3 beam:external:java:generate_sequence:v1: org.apache.beam.sdk.expansion.service.ExpansionService$ExternalTransformRegistrarLoader$1@7b98f307 INFO:apache_beam.runners.portability.local_job_service:Grpc server started at localhost on port 34389 INFO:__main__:Listening for beam jobs on port 34389. > Task :buildSrc:compileJava NO-SOURCE > Task :buildSrc:compileGroovy UP-TO-DATE > Task :buildSrc:pluginDescriptors UP-TO-DATE > Task :buildSrc:processResources UP-TO-DATE > Task :buildSrc:classes UP-TO-DATE > Task :buildSrc:jar UP-TO-DATE > Task :buildSrc:assemble UP-TO-DATE > Task :buildSrc:spotlessGroovy UP-TO-DATE > Task :buildSrc:spotlessGroovyCheck UP-TO-DATE > Task :buildSrc:spotlessGroovyGradle UP-TO-DATE > Task :buildSrc:spotlessGroovyGradleCheck UP-TO-DATE > Task :buildSrc:spotlessCheck UP-TO-DATE > Task :buildSrc:pluginUnderTestMetadata UP-TO-DATE > Task :buildSrc:compileTestJava NO-SOURCE > Task :buildSrc:compileTestGroovy NO-SOURCE > Task :buildSrc:processTestResources NO-SOURCE > Task :buildSrc:testClasses UP-TO-DATE > Task :buildSrc:test NO-SOURCE > Task :buildSrc:validatePlugins UP-TO-DATE > Task :buildSrc:check UP-TO-DATE > Task :buildSrc:build UP-TO-DATE Configuration on demand is an incubating feature. > Task :sdks:go:container:copyLicenses UP-TO-DATE > Task :sdks:go:container:dockerClean > Task :sdks:go:container:goPrepare Use project GOPATH: <https://ci-beam.apache.org/job/beam_PreCommit_GoPortable_Cron/ws/src/sdks/go/container/.gogradle/project_gopath> > Task :sdks:go:container:resolveBuildDependencies SKIPPED > Task :sdks:go:container:installDependencies SKIPPED > Task :sdks:go:container:buildLinuxAmd64 UP-TO-DATE > Task :sdks:go:container:goBuild > Task :sdks:go:container:skipPullLicenses > Task :sdks:go:container:dockerPrepare INFO:__main__:Listening for beam jobs on port 34389. > Task :sdks:go:container:docker Deprecated Gradle features were used in this build, making it incompatible with Gradle 7.0. Use '--warning-mode all' to show the individual deprecation warnings. See https://docs.gradle.org/6.9.1/userguide/command_line_interface.html#sec:command_line_warnings BUILD SUCCESSFUL in 1m 1s 8 actionable tasks: 6 executed, 2 up-to-date Publishing build scan... https://gradle.com/s/h2qqh32l3gp6u $ CONTAINER=apache/beam_go_sdk $ cd sdks/go >>> RUNNING portable integration tests with pipeline options: -p 3 -timeout 2h >>> --runner=portable --project=apache-beam-testing --region=us-central1 >>> --environment_type=DOCKER --environment_config=apache/beam_go_sdk:dev >>> --staging_location=gs://temp-storage-for-end-to-end-tests/staging-validatesrunner-test >>> >>> --temp_location=gs://temp-storage-for-end-to-end-tests/temp-validatesrunner-test >>> --dataflow_worker_jar= --endpoint=localhost:34389 >>> --test_expansion_addr=localhost:54439 $ ./run_validatesrunner_tests.sh: line 399: go: command not found $ TEST_EXIT_CODE=0 $ cd ../.. $ exit 127 $ exit 127 > Task :sdks:go:test:ulrValidatesRunner FAILED FAILURE: Build failed with an exception. * Where: Build file '<https://ci-beam.apache.org/job/beam_PreCommit_GoPortable_Cron/ws/src/sdks/go/test/build.gradle'> line: 185 * What went wrong: Execution failed for task ':sdks:go:test:ulrValidatesRunner'. > Process 'command 'sh'' finished with non-zero exit value 127 * Try: Run with --stacktrace option to get the stack trace. Run with --info or --debug option to get more log output. Run with --scan to get full insights. * Get more help at https://help.gradle.org Deprecated Gradle features were used in this build, making it incompatible with Gradle 7.0. Use '--warning-mode all' to show the individual deprecation warnings. See https://docs.gradle.org/6.9.1/userguide/command_line_interface.html#sec:command_line_warnings BUILD FAILED in 6m 29s 109 actionable tasks: 79 executed, 25 from cache, 5 up-to-date Publishing build scan... https://gradle.com/s/xc6jx5dx3v6dw Build step 'Invoke Gradle script' changed build result to FAILURE Build step 'Invoke Gradle script' marked build as failure --------------------------------------------------------------------- To unsubscribe, e-mail: [email protected] For additional commands, e-mail: [email protected]
