See <https://ci-beam.apache.org/job/beam_PreCommit_GoPortable_Cron/941/display/redirect>
Changes: ------------------------------------------ [...truncated 59.79 KB...] Step 6/11 : COPY target/LICENSE /opt/apache/beam/ ---> 0e30e9bb60f7 Step 7/11 : COPY target/NOTICE /opt/apache/beam/ ---> 69f18d3084e8 Step 8/11 : COPY target/LICENSE target/go-licenses/* /opt/apache/beam/third_party_licenses/golang/ ---> aae6229ee922 Step 9/11 : RUN rm /opt/apache/beam/third_party_licenses/golang/LICENSE ---> Running in cde0f1bd0710 Removing intermediate container cde0f1bd0710 ---> f7744d4dfcd5 Step 10/11 : RUN if [ "$pull_licenses" = "false" ] ; then rm -rf /opt/apache/beam/third_party_licenses ; fi ---> Running in ae98d53a600b > Task :sdks:java:container:pullLicenses Copying already-fetched licenses from <https://ci-beam.apache.org/job/beam_PreCommit_GoPortable_Cron/ws/src/sdks/java/container/build/reports/dependency-license> to <https://ci-beam.apache.org/job/beam_PreCommit_GoPortable_Cron/ws/src/sdks/java/container/build/target/java_third_party_licenses> Already using interpreter /usr/bin/python3 Using base prefix '/usr' New python executable in <https://ci-beam.apache.org/job/beam_PreCommit_GoPortable_Cron/ws/src/sdks/java/container/build/virtualenv/bin/python3> Also creating executable in <https://ci-beam.apache.org/job/beam_PreCommit_GoPortable_Cron/ws/src/sdks/java/container/build/virtualenv/bin/python> Installing setuptools, pip, wheel... done. DEPRECATION: Python 3.5 reached the end of its life on September 13th, 2020. Please upgrade your Python as Python 3.5 is no longer maintained. pip 21.0 will drop support for Python 3.5 in January 2021. pip 21.0 will remove support for this functionality. Collecting beautifulsoup4<5.0,>=4.9.0 Using cached beautifulsoup4-4.10.0-py3-none-any.whl (97 kB) Collecting future<1.0.0,>=0.16.0 Using cached future-0.18.2-py3-none-any.whl Collecting pyyaml<6.0.0,>=3.12 Using cached PyYAML-5.3.1-cp35-cp35m-linux_x86_64.whl Collecting tenacity<6.0,>=5.0.2 Using cached tenacity-5.1.5-py2.py3-none-any.whl (34 kB) Collecting soupsieve>1.2 Using cached soupsieve-2.1-py3-none-any.whl (32 kB) Collecting six>=1.9.0 Using cached six-1.16.0-py2.py3-none-any.whl (11 kB) Installing collected packages: soupsieve, six, tenacity, pyyaml, future, beautifulsoup4 Successfully installed beautifulsoup4-4.10.0 future-0.18.2 pyyaml-5.3.1 six-1.16.0 soupsieve-2.1 tenacity-5.1.5 Executing <https://ci-beam.apache.org/job/beam_PreCommit_GoPortable_Cron/ws/src/sdks/java/container/build/virtualenv/bin/python> <https://ci-beam.apache.org/job/beam_PreCommit_GoPortable_Cron/ws/src/sdks/java/container/license_scripts/pull_licenses_java.py> --license_index=<https://ci-beam.apache.org/job/beam_PreCommit_GoPortable_Cron/ws/src/sdks/java/container/build/reports/dependency-license/index.json> --output_dir=<https://ci-beam.apache.org/job/beam_PreCommit_GoPortable_Cron/ws/src/sdks/java/container/build/target/java_third_party_licenses> --dep_url_yaml=<https://ci-beam.apache.org/job/beam_PreCommit_GoPortable_Cron/ws/src/sdks/java/container/license_scripts/dep_urls_java.yaml> INFO:root:Pulling license for 208 dependencies using 16 threads. INFO:root:pull_licenses_java.py succeed. It took 6.476632 seconds with 16 threads. Copying licenses from <https://ci-beam.apache.org/job/beam_PreCommit_GoPortable_Cron/ws/src/sdks/java/container/build/target/java_third_party_licenses> to <https://ci-beam.apache.org/job/beam_PreCommit_GoPortable_Cron/ws/src/sdks/java/container/build/target/third_party_licenses.> Finished license_scripts.sh > Task :sdks:java:container:java11:copyJavaThirdPartyLicenses > Task :sdks:java:container:java8:copyJavaThirdPartyLicenses > Task :sdks:go:container:docker Removing intermediate container ae98d53a600b ---> 29325266432e Step 11/11 : ENTRYPOINT ["/opt/apache/beam/boot"] > Task :sdks:java:container:java8:dockerPrepare > Task :sdks:java:container:java11:dockerPrepare > Task :sdks:java:container:java11:docker > Task :sdks:java:container:java8:docker > Task :sdks:go:test:ulrValidatesRunner Obtaining file://<https://ci-beam.apache.org/job/beam_PreCommit_GoPortable_Cron/ws/src/sdks/python> Preparing metadata (setup.py): started Preparing metadata (setup.py): finished with status 'done' Collecting avro-python3!=1.9.2,<1.10.0,>=1.8.1 Using cached avro_python3-1.9.2.1-py3-none-any.whl Collecting crcmod<2.0,>=1.7 Using cached crcmod-1.7-cp38-cp38-linux_x86_64.whl Collecting dill<0.3.2,>=0.3.1.1 Using cached dill-0.3.1.1-py3-none-any.whl Collecting fastavro<2,>=0.21.4 Using cached fastavro-1.4.7-cp38-cp38-manylinux_2_17_x86_64.manylinux2014_x86_64.whl (2.6 MB) Requirement already satisfied: future<1.0.0,>=0.18.2 in <https://ci-beam.apache.org/job/beam_PreCommit_GoPortable_Cron/ws/src/build/gradleenv/-273006051/lib/python3.8/site-packages> (from apache-beam==2.35.0.dev0) (0.18.2) Requirement already satisfied: grpcio<2,>=1.29.0 in <https://ci-beam.apache.org/job/beam_PreCommit_GoPortable_Cron/ws/src/build/gradleenv/-273006051/lib/python3.8/site-packages> (from apache-beam==2.35.0.dev0) (1.41.1) Collecting hdfs<3.0.0,>=2.1.0 Using cached hdfs-2.6.0-py3-none-any.whl (33 kB) Collecting httplib2<0.20.0,>=0.8 Using cached httplib2-0.19.1-py3-none-any.whl (95 kB) Collecting numpy<1.21.0,>=1.14.3 Using cached numpy-1.20.3-cp38-cp38-manylinux_2_12_x86_64.manylinux2010_x86_64.whl (15.4 MB) Collecting pymongo<4.0.0,>=3.8.0 Using cached pymongo-3.12.1-cp38-cp38-manylinux_2_17_x86_64.manylinux2014_x86_64.whl (527 kB) Collecting oauth2client<5,>=2.0.1 Using cached oauth2client-4.1.3-py2.py3-none-any.whl (98 kB) Requirement already satisfied: protobuf<4,>=3.12.2 in <https://ci-beam.apache.org/job/beam_PreCommit_GoPortable_Cron/ws/src/build/gradleenv/-273006051/lib/python3.8/site-packages> (from apache-beam==2.35.0.dev0) (3.19.1) Collecting pyarrow<6.0.0,>=0.15.1 Using cached pyarrow-5.0.0-cp38-cp38-manylinux2014_x86_64.whl (23.6 MB) Collecting pydot<2,>=1.2.0 Using cached pydot-1.4.2-py2.py3-none-any.whl (21 kB) Collecting python-dateutil<3,>=2.8.0 Using cached python_dateutil-2.8.2-py2.py3-none-any.whl (247 kB) Collecting pytz>=2018.3 Using cached pytz-2021.3-py2.py3-none-any.whl (503 kB) Collecting requests<3.0.0,>=2.24.0 Using cached requests-2.26.0-py2.py3-none-any.whl (62 kB) Collecting typing-extensions<4,>=3.7.0 Using cached typing_extensions-3.10.0.2-py3-none-any.whl (26 kB) Collecting orjson<4.0 Using cached orjson-3.6.4-cp38-cp38-manylinux_2_17_x86_64.manylinux2014_x86_64.whl (250 kB) Requirement already satisfied: six>=1.5.2 in <https://ci-beam.apache.org/job/beam_PreCommit_GoPortable_Cron/ws/src/build/gradleenv/-273006051/lib/python3.8/site-packages> (from grpcio<2,>=1.29.0->apache-beam==2.35.0.dev0) (1.16.0) Collecting docopt Using cached docopt-0.6.2-py2.py3-none-any.whl Requirement already satisfied: pyparsing<3,>=2.4.2 in <https://ci-beam.apache.org/job/beam_PreCommit_GoPortable_Cron/ws/src/build/gradleenv/-273006051/lib/python3.8/site-packages> (from httplib2<0.20.0,>=0.8->apache-beam==2.35.0.dev0) (2.4.7) Collecting pyasn1>=0.1.7 Using cached pyasn1-0.4.8-py2.py3-none-any.whl (77 kB) Collecting pyasn1-modules>=0.0.5 Using cached pyasn1_modules-0.2.8-py2.py3-none-any.whl (155 kB) Collecting rsa>=3.1.4 Using cached rsa-4.7.2-py3-none-any.whl (34 kB) Collecting charset-normalizer~=2.0.0 Using cached charset_normalizer-2.0.7-py3-none-any.whl (38 kB) Collecting urllib3<1.27,>=1.21.1 Using cached urllib3-1.26.7-py2.py3-none-any.whl (138 kB) Collecting idna<4,>=2.5 Using cached idna-3.3-py3-none-any.whl (61 kB) Collecting certifi>=2017.4.17 Using cached certifi-2021.10.8-py2.py3-none-any.whl (149 kB) Installing collected packages: urllib3, pyasn1, idna, charset-normalizer, certifi, rsa, requests, pyasn1-modules, numpy, httplib2, docopt, typing-extensions, pytz, python-dateutil, pymongo, pydot, pyarrow, orjson, oauth2client, hdfs, fastavro, dill, crcmod, avro-python3, apache-beam Running setup.py develop for apache-beam Successfully installed apache-beam-2.35.0.dev0 avro-python3-1.9.2.1 certifi-2021.10.8 charset-normalizer-2.0.7 crcmod-1.7 dill-0.3.1.1 docopt-0.6.2 fastavro-1.4.7 hdfs-2.6.0 httplib2-0.19.1 idna-3.3 numpy-1.20.3 oauth2client-4.1.3 orjson-3.6.4 pyarrow-5.0.0 pyasn1-0.4.8 pyasn1-modules-0.2.8 pydot-1.4.2 pymongo-3.12.1 python-dateutil-2.8.2 pytz-2021.3 requests-2.26.0 rsa-4.7.2 typing-extensions-3.10.0.2 urllib3-1.26.7 $ TESTS=./test/integration/... ./test/regression $ RUNNER=portable $ TIMEOUT=2h $ SIMULTANEOUS=3 $ GCS_LOCATION=gs://temp-storage-for-end-to-end-tests $ PROJECT=apache-beam-testing $ DATAFLOW_PROJECT=apache-beam-testing $ REGION=us-central1 $ trap exit_background_processes SIGINT SIGTERM EXIT $ key=--runner $ case --runner in $ RUNNER=portable $ key=--test_expansion_jar $ case --test_expansion_jar in $ TEST_EXPANSION_JAR=<https://ci-beam.apache.org/job/beam_PreCommit_GoPortable_Cron/ws/src/sdks/java/testing/expansion-service/build/libs/beam-sdks-java-testing-expansion-service-testExpansionService-2.35.0-SNAPSHOT.jar> $ cd <https://ci-beam.apache.org/job/beam_PreCommit_GoPortable_Cron/ws/src> $ test -d sdks/go/test $ JOB_PORT=60349 $ ENDPOINT=localhost:50089 No endpoint specified; starting a new portable job server on localhost:50089 $ python3 -m apache_beam.runners.portability.local_job_service_main --port 50089 $ JOBSERVER_PID=31426 $ EXPANSION_PORT=60513 $ TEST_EXPANSION_ADDR=localhost:59471 No test expansion address specified; starting a new test expansion server on localhost:59471 $ java -jar <https://ci-beam.apache.org/job/beam_PreCommit_GoPortable_Cron/ws/src/sdks/java/testing/expansion-service/build/libs/beam-sdks-java-testing-expansion-service-testExpansionService-2.35.0-SNAPSHOT.jar> 59471 $ TEST_EXPANSION_PID=31434 $ TAG=dev $ ./gradlew :sdks:go:container:docker -Pdocker-tag=dev Starting expansion service at localhost:59471 Starting a Gradle Daemon, 4 busy Daemons could not be reused, use --status for details Oct 30, 2021 6:06:03 PM org.apache.beam.sdk.expansion.service.ExpansionService loadRegisteredTransforms INFO: Registering external transforms: [beam:transforms:xlang:test:cgbk, beam:transforms:xlang:test:flatten, beam:transforms:xlang:test:prefix, beam:transforms:xlang:test:multi, beam:transforms:xlang:test:gbk, beam:transforms:xlang:test:comgl, beam:transforms:xlang:test:compk, beam:transforms:xlang:count, beam:transforms:xlang:filter_less_than_eq, beam:transforms:xlang:test:partition, beam:transforms:xlang:test:parquet_write, beam:transforms:xlang:parquet_read, beam:transforms:xlang:textio_read, beam:external:java:generate_sequence:v1] beam:transforms:xlang:test:cgbk: org.apache.beam.sdk.testing.expansion.TestExpansionService$TestServiceRegistrar$TestCoGroupByKeyTransformProvider@1aafa419 beam:transforms:xlang:test:flatten: org.apache.beam.sdk.testing.expansion.TestExpansionService$TestServiceRegistrar$TestFlattenTransformProvider@47eaca72 beam:transforms:xlang:test:prefix: org.apache.beam.sdk.expansion.service.ExpansionService$ExternalTransformRegistrarLoader$1@55141def beam:transforms:xlang:test:multi: org.apache.beam.sdk.expansion.service.ExpansionService$ExternalTransformRegistrarLoader$1@55182842 beam:transforms:xlang:test:gbk: org.apache.beam.sdk.expansion.service.ExpansionService$ExternalTransformRegistrarLoader$1@3270d194 beam:transforms:xlang:test:comgl: org.apache.beam.sdk.expansion.service.ExpansionService$ExternalTransformRegistrarLoader$1@235834f2 beam:transforms:xlang:test:compk: org.apache.beam.sdk.expansion.service.ExpansionService$ExternalTransformRegistrarLoader$1@5656be13 beam:transforms:xlang:count: org.apache.beam.sdk.expansion.service.ExpansionService$ExternalTransformRegistrarLoader$1@4218d6a3 beam:transforms:xlang:filter_less_than_eq: org.apache.beam.sdk.expansion.service.ExpansionService$ExternalTransformRegistrarLoader$1@76505305 beam:transforms:xlang:test:partition: org.apache.beam.sdk.expansion.service.ExpansionService$ExternalTransformRegistrarLoader$1@14cd1699 beam:transforms:xlang:test:parquet_write: org.apache.beam.sdk.expansion.service.ExpansionService$ExternalTransformRegistrarLoader$1@77888435 beam:transforms:xlang:parquet_read: org.apache.beam.sdk.expansion.service.ExpansionService$ExternalTransformRegistrarLoader$1@73a1e9a9 beam:transforms:xlang:textio_read: org.apache.beam.sdk.expansion.service.ExpansionService$ExternalTransformRegistrarLoader$1@71d44a3 beam:external:java:generate_sequence:v1: org.apache.beam.sdk.expansion.service.ExpansionService$ExternalTransformRegistrarLoader$1@7b98f307 INFO:apache_beam.runners.portability.local_job_service:Grpc server started at localhost on port 50089 INFO:__main__:Listening for beam jobs on port 50089. > Task :buildSrc:compileJava NO-SOURCE > Task :buildSrc:compileGroovy UP-TO-DATE > Task :buildSrc:pluginDescriptors UP-TO-DATE > Task :buildSrc:processResources UP-TO-DATE > Task :buildSrc:classes UP-TO-DATE > Task :buildSrc:jar UP-TO-DATE > Task :buildSrc:assemble UP-TO-DATE > Task :buildSrc:spotlessGroovy UP-TO-DATE > Task :buildSrc:spotlessGroovyCheck UP-TO-DATE > Task :buildSrc:spotlessGroovyGradle UP-TO-DATE > Task :buildSrc:spotlessGroovyGradleCheck UP-TO-DATE > Task :buildSrc:spotlessCheck UP-TO-DATE > Task :buildSrc:pluginUnderTestMetadata UP-TO-DATE > Task :buildSrc:compileTestJava NO-SOURCE > Task :buildSrc:compileTestGroovy NO-SOURCE > Task :buildSrc:processTestResources NO-SOURCE > Task :buildSrc:testClasses UP-TO-DATE > Task :buildSrc:test NO-SOURCE > Task :buildSrc:validatePlugins UP-TO-DATE > Task :buildSrc:check UP-TO-DATE > Task :buildSrc:build UP-TO-DATE Configuration on demand is an incubating feature. > Task :sdks:go:container:copyLicenses UP-TO-DATE > Task :sdks:go:container:dockerClean > Task :sdks:go:container:goPrepare Use project GOPATH: <https://ci-beam.apache.org/job/beam_PreCommit_GoPortable_Cron/ws/src/sdks/go/container/.gogradle/project_gopath> > Task :sdks:go:container:resolveBuildDependencies SKIPPED > Task :sdks:go:container:installDependencies SKIPPED > Task :sdks:go:container:buildLinuxAmd64 UP-TO-DATE > Task :sdks:go:container:goBuild > Task :sdks:go:container:skipPullLicenses > Task :sdks:go:container:dockerPrepare INFO:__main__:Listening for beam jobs on port 50089. > Task :sdks:go:container:docker Deprecated Gradle features were used in this build, making it incompatible with Gradle 7.0. Use '--warning-mode all' to show the individual deprecation warnings. See https://docs.gradle.org/6.9.1/userguide/command_line_interface.html#sec:command_line_warnings BUILD SUCCESSFUL in 41s 8 actionable tasks: 6 executed, 2 up-to-date Publishing build scan... https://gradle.com/s/wj5audhgy6a2s $ CONTAINER=apache/beam_go_sdk $ cd sdks/go >>> RUNNING portable integration tests with pipeline options: -p 3 -timeout 2h >>> --runner=portable --project=apache-beam-testing --region=us-central1 >>> --environment_type=DOCKER --environment_config=apache/beam_go_sdk:dev >>> --staging_location=gs://temp-storage-for-end-to-end-tests/staging-validatesrunner-test >>> >>> --temp_location=gs://temp-storage-for-end-to-end-tests/temp-validatesrunner-test >>> --dataflow_worker_jar= --endpoint=localhost:50089 >>> --test_expansion_addr=localhost:59471 $ ./run_validatesrunner_tests.sh: line 399: go: command not found $ TEST_EXIT_CODE=0 $ cd ../.. $ exit 127 $ exit 127 > Task :sdks:go:test:ulrValidatesRunner FAILED FAILURE: Build failed with an exception. * Where: Build file '<https://ci-beam.apache.org/job/beam_PreCommit_GoPortable_Cron/ws/src/sdks/go/test/build.gradle'> line: 185 * What went wrong: Execution failed for task ':sdks:go:test:ulrValidatesRunner'. > Process 'command 'sh'' finished with non-zero exit value 127 * Try: Run with --stacktrace option to get the stack trace. Run with --info or --debug option to get more log output. Run with --scan to get full insights. * Get more help at https://help.gradle.org Deprecated Gradle features were used in this build, making it incompatible with Gradle 7.0. Use '--warning-mode all' to show the individual deprecation warnings. See https://docs.gradle.org/6.9.1/userguide/command_line_interface.html#sec:command_line_warnings BUILD FAILED in 4m 32s 109 actionable tasks: 79 executed, 25 from cache, 5 up-to-date Publishing build scan... https://gradle.com/s/mm2cedq5s62vu Build step 'Invoke Gradle script' changed build result to FAILURE Build step 'Invoke Gradle script' marked build as failure --------------------------------------------------------------------- To unsubscribe, e-mail: [email protected] For additional commands, e-mail: [email protected]
