See <https://ci-beam.apache.org/job/beam_PostCommit_Go_VR_Spark/5336/display/redirect>
Changes: ------------------------------------------ [...truncated 34.73 KB...] > Task :runners:core-construction-java:classes UP-TO-DATE > Task :runners:core-construction-java:jar > Task :runners:core-java:compileJava FROM-CACHE > Task :runners:core-java:classes UP-TO-DATE > Task :runners:core-java:jar > Task :sdks:java:extensions:google-cloud-platform-core:compileJava FROM-CACHE > Task :sdks:java:extensions:google-cloud-platform-core:classes UP-TO-DATE > Task :sdks:java:extensions:google-cloud-platform-core:jar > Task :sdks:java:harness:compileJava FROM-CACHE > Task :sdks:java:harness:classes UP-TO-DATE > Task :sdks:java:harness:jar > Task :sdks:java:container:generateLicenseReport > Task :sdks:java:container:pullLicenses Copying already-fetched licenses from <https://ci-beam.apache.org/job/beam_PostCommit_Go_VR_Spark/ws/src/sdks/java/container/build/reports/dependency-license> to <https://ci-beam.apache.org/job/beam_PostCommit_Go_VR_Spark/ws/src/sdks/java/container/build/target/java_third_party_licenses> Already using interpreter /usr/bin/python3 Using base prefix '/usr' New python executable in <https://ci-beam.apache.org/job/beam_PostCommit_Go_VR_Spark/ws/src/sdks/java/container/build/virtualenv/bin/python3> Also creating executable in <https://ci-beam.apache.org/job/beam_PostCommit_Go_VR_Spark/ws/src/sdks/java/container/build/virtualenv/bin/python> Installing setuptools, pip, wheel... > Task :sdks:java:harness:shadowJar FROM-CACHE > Task :sdks:java:container:pullLicenses done. DEPRECATION: Python 3.5 reached the end of its life on September 13th, 2020. Please upgrade your Python as Python 3.5 is no longer maintained. pip 21.0 will drop support for Python 3.5 in January 2021. pip 21.0 will remove support for this functionality. Collecting beautifulsoup4<5.0,>=4.9.0 Using cached beautifulsoup4-4.10.0-py3-none-any.whl (97 kB) Collecting future<1.0.0,>=0.16.0 Using cached future-0.18.2-py3-none-any.whl Collecting pyyaml<6.0.0,>=3.12 Using cached PyYAML-5.3.1-cp35-cp35m-linux_x86_64.whl Collecting tenacity<6.0,>=5.0.2 Using cached tenacity-5.1.5-py2.py3-none-any.whl (34 kB) Collecting soupsieve>1.2 Using cached soupsieve-2.1-py3-none-any.whl (32 kB) Collecting six>=1.9.0 Using cached six-1.16.0-py2.py3-none-any.whl (11 kB) Installing collected packages: soupsieve, six, tenacity, pyyaml, future, beautifulsoup4 Successfully installed beautifulsoup4-4.10.0 future-0.18.2 pyyaml-5.3.1 six-1.16.0 soupsieve-2.1 tenacity-5.1.5 Executing <https://ci-beam.apache.org/job/beam_PostCommit_Go_VR_Spark/ws/src/sdks/java/container/build/virtualenv/bin/python> <https://ci-beam.apache.org/job/beam_PostCommit_Go_VR_Spark/ws/src/sdks/java/container/license_scripts/pull_licenses_java.py> --license_index=<https://ci-beam.apache.org/job/beam_PostCommit_Go_VR_Spark/ws/src/sdks/java/container/build/reports/dependency-license/index.json> --output_dir=<https://ci-beam.apache.org/job/beam_PostCommit_Go_VR_Spark/ws/src/sdks/java/container/build/target/java_third_party_licenses> --dep_url_yaml=<https://ci-beam.apache.org/job/beam_PostCommit_Go_VR_Spark/ws/src/sdks/java/container/license_scripts/dep_urls_java.yaml> INFO:root:Pulling license for 208 dependencies using 16 threads. > Task :runners:java-fn-execution:compileJava FROM-CACHE > Task :runners:java-fn-execution:classes UP-TO-DATE > Task :runners:java-fn-execution:jar > Task :sdks:java:expansion-service:compileJava FROM-CACHE > Task :sdks:java:expansion-service:classes UP-TO-DATE > Task :sdks:java:expansion-service:jar > Task :sdks:java:testing:expansion-service:compileTestJava FROM-CACHE > Task :sdks:java:testing:expansion-service:testClasses > Task :sdks:java:io:kafka:compileJava FROM-CACHE > Task :sdks:java:io:kafka:classes UP-TO-DATE > Task :runners:java-job-service:compileJava FROM-CACHE > Task :runners:java-job-service:classes UP-TO-DATE > Task :runners:java-job-service:jar > Task :sdks:java:io:kafka:jar > Task :runners:spark:2:compileJava FROM-CACHE > Task :runners:spark:2:classes > Task :runners:spark:2:jar > Task :runners:spark:2:job-server:compileJava NO-SOURCE > Task :runners:spark:2:job-server:classes UP-TO-DATE > Task :sdks:java:container:java11:copyDockerfileDependencies > Task :sdks:java:container:java8:copyDockerfileDependencies > Task :sdks:java:testing:expansion-service:buildTestExpansionServiceJar > FROM-CACHE > Task :sdks:java:container:pullLicenses INFO:root:pull_licenses_java.py succeed. It took 7.242549 seconds with 16 threads. Copying licenses from <https://ci-beam.apache.org/job/beam_PostCommit_Go_VR_Spark/ws/src/sdks/java/container/build/target/java_third_party_licenses> to <https://ci-beam.apache.org/job/beam_PostCommit_Go_VR_Spark/ws/src/sdks/java/container/build/target/third_party_licenses.> > Task :runners:spark:2:job-server:shadowJar FROM-CACHE > Task :sdks:java:container:pullLicenses Finished license_scripts.sh > Task :sdks:java:container:java11:copyJavaThirdPartyLicenses > Task :sdks:java:container:java8:copyJavaThirdPartyLicenses > Task :release:go-licenses:java:dockerRun + go-licenses save github.com/apache/beam/sdks/java/container --save_path=/output/licenses + go-licenses csv github.com/apache/beam/sdks/java/container + tee /output/licenses/list.csv github.com/apache/beam/sdks/java/container,https://github.com/apache/beam/blob/master/LICENSE,Apache-2.0 github.com/apache/beam/sdks/go/pkg/beam,https://github.com/apache/beam/blob/master/sdks/go/README.md,Apache-2.0 golang.org/x/net,https://go.googlesource.com/net/+/refs/heads/master/LICENSE,BSD-3-Clause google.golang.org/protobuf,https://go.googlesource.com/protobuf/+/refs/heads/master/LICENSE,BSD-3-Clause google.golang.org/grpc,https://github.com/grpc/grpc-go/blob/master/LICENSE,Apache-2.0 github.com/golang/protobuf,https://github.com/golang/protobuf/blob/master/LICENSE,BSD-3-Clause google.golang.org/genproto/googleapis/rpc/status,https://github.com/googleapis/go-genproto/blob/master/LICENSE,Apache-2.0 golang.org/x/sys,https://go.googlesource.com/sys/+/refs/heads/master/LICENSE,BSD-3-Clause golang.org/x/text,https://go.googlesource.com/text/+/refs/heads/master/LICENSE,BSD-3-Clause + chmod -R a+w /output/licenses > Task :release:go-licenses:java:createLicenses > Task :sdks:java:container:java8:copyGolangLicenses > Task :sdks:java:container:java11:copyGolangLicenses > Task :sdks:java:container:java8:dockerPrepare > Task :sdks:java:container:java11:dockerPrepare > Task :sdks:java:container:java11:docker > Task :sdks:java:container:java8:docker > Task :sdks:go:test:sparkValidatesRunner $ TESTS=./test/integration/... ./test/regression $ RUNNER=portable $ TIMEOUT=2h $ SIMULTANEOUS=3 $ GCS_LOCATION=gs://temp-storage-for-end-to-end-tests $ PROJECT=apache-beam-testing $ DATAFLOW_PROJECT=apache-beam-testing $ REGION=us-central1 $ trap exit_background_processes SIGINT SIGTERM EXIT $ key=--runner $ case --runner in $ RUNNER=spark $ key=--spark_job_server_jar $ case --spark_job_server_jar in $ SPARK_JOB_SERVER_JAR=<https://ci-beam.apache.org/job/beam_PostCommit_Go_VR_Spark/ws/src/runners/spark/2/job-server/build/libs/beam-runners-spark-job-server-2.35.0-SNAPSHOT.jar> $ key=--test_expansion_jar $ case --test_expansion_jar in $ TEST_EXPANSION_JAR=<https://ci-beam.apache.org/job/beam_PostCommit_Go_VR_Spark/ws/src/sdks/java/testing/expansion-service/build/libs/beam-sdks-java-testing-expansion-service-testExpansionService-2.35.0-SNAPSHOT.jar> $ cd <https://ci-beam.apache.org/job/beam_PostCommit_Go_VR_Spark/ws/src> $ test -d sdks/go/test $ JOB_PORT=39273 $ ENDPOINT=localhost:48929 No endpoint specified; starting a new spark job server on localhost:48929 $ java -jar <https://ci-beam.apache.org/job/beam_PostCommit_Go_VR_Spark/ws/src/runners/spark/2/job-server/build/libs/beam-runners-spark-job-server-2.35.0-SNAPSHOT.jar> --spark-master-url local --job-port 48929 --expansion-port 0 --artifact-port 0 $ JOBSERVER_PID=16491 $ EXPANSION_PORT=56199 $ TEST_EXPANSION_ADDR=localhost:47171 No test expansion address specified; starting a new test expansion server on localhost:47171 $ java -jar <https://ci-beam.apache.org/job/beam_PostCommit_Go_VR_Spark/ws/src/sdks/java/testing/expansion-service/build/libs/beam-sdks-java-testing-expansion-service-testExpansionService-2.35.0-SNAPSHOT.jar> 47171 $ TEST_EXPANSION_PID=16532 $ SIMULTANEOUS=1 $ TAG=dev $ ./gradlew :sdks:go:container:docker -Pdocker-tag=dev Starting expansion service at localhost:47171 Starting a Gradle Daemon, 4 busy Daemons could not be reused, use --status for details Nov 01, 2021 12:03:47 PM org.apache.beam.sdk.expansion.service.ExpansionService loadRegisteredTransforms INFO: Registering external transforms: [beam:transforms:xlang:test:cgbk, beam:transforms:xlang:test:flatten, beam:transforms:xlang:test:prefix, beam:transforms:xlang:test:multi, beam:transforms:xlang:test:gbk, beam:transforms:xlang:test:comgl, beam:transforms:xlang:test:compk, beam:transforms:xlang:count, beam:transforms:xlang:filter_less_than_eq, beam:transforms:xlang:test:partition, beam:transforms:xlang:test:parquet_write, beam:transforms:xlang:parquet_read, beam:transforms:xlang:textio_read, beam:external:java:generate_sequence:v1] beam:transforms:xlang:test:cgbk: org.apache.beam.sdk.testing.expansion.TestExpansionService$TestServiceRegistrar$TestCoGroupByKeyTransformProvider@1aafa419 beam:transforms:xlang:test:flatten: org.apache.beam.sdk.testing.expansion.TestExpansionService$TestServiceRegistrar$TestFlattenTransformProvider@47eaca72 beam:transforms:xlang:test:prefix: org.apache.beam.sdk.expansion.service.ExpansionService$ExternalTransformRegistrarLoader$1@55141def beam:transforms:xlang:test:multi: org.apache.beam.sdk.expansion.service.ExpansionService$ExternalTransformRegistrarLoader$1@55182842 beam:transforms:xlang:test:gbk: org.apache.beam.sdk.expansion.service.ExpansionService$ExternalTransformRegistrarLoader$1@3270d194 beam:transforms:xlang:test:comgl: org.apache.beam.sdk.expansion.service.ExpansionService$ExternalTransformRegistrarLoader$1@235834f2 beam:transforms:xlang:test:compk: org.apache.beam.sdk.expansion.service.ExpansionService$ExternalTransformRegistrarLoader$1@5656be13 beam:transforms:xlang:count: org.apache.beam.sdk.expansion.service.ExpansionService$ExternalTransformRegistrarLoader$1@4218d6a3 beam:transforms:xlang:filter_less_than_eq: org.apache.beam.sdk.expansion.service.ExpansionService$ExternalTransformRegistrarLoader$1@76505305 beam:transforms:xlang:test:partition: org.apache.beam.sdk.expansion.service.ExpansionService$ExternalTransformRegistrarLoader$1@14cd1699 beam:transforms:xlang:test:parquet_write: org.apache.beam.sdk.expansion.service.ExpansionService$ExternalTransformRegistrarLoader$1@77888435 beam:transforms:xlang:parquet_read: org.apache.beam.sdk.expansion.service.ExpansionService$ExternalTransformRegistrarLoader$1@73a1e9a9 beam:transforms:xlang:textio_read: org.apache.beam.sdk.expansion.service.ExpansionService$ExternalTransformRegistrarLoader$1@71d44a3 beam:external:java:generate_sequence:v1: org.apache.beam.sdk.expansion.service.ExpansionService$ExternalTransformRegistrarLoader$1@7b98f307 21/11/01 12:03:49 INFO org.apache.beam.runners.jobsubmission.JobServerDriver: ArtifactStagingService started on localhost:39185 21/11/01 12:03:49 INFO org.apache.beam.runners.jobsubmission.JobServerDriver: Java ExpansionService started on localhost:35669 21/11/01 12:03:49 INFO org.apache.beam.runners.jobsubmission.JobServerDriver: JobService started on localhost:48929 21/11/01 12:03:49 INFO org.apache.beam.runners.jobsubmission.JobServerDriver: Job server now running, terminate with Ctrl+C > Task :buildSrc:compileJava NO-SOURCE > Task :buildSrc:compileGroovy UP-TO-DATE > Task :buildSrc:pluginDescriptors UP-TO-DATE > Task :buildSrc:processResources UP-TO-DATE > Task :buildSrc:classes UP-TO-DATE > Task :buildSrc:jar UP-TO-DATE > Task :buildSrc:assemble UP-TO-DATE > Task :buildSrc:spotlessGroovy UP-TO-DATE > Task :buildSrc:spotlessGroovyCheck UP-TO-DATE > Task :buildSrc:spotlessGroovyGradle UP-TO-DATE > Task :buildSrc:spotlessGroovyGradleCheck UP-TO-DATE > Task :buildSrc:spotlessCheck UP-TO-DATE > Task :buildSrc:pluginUnderTestMetadata UP-TO-DATE > Task :buildSrc:compileTestJava NO-SOURCE > Task :buildSrc:compileTestGroovy NO-SOURCE > Task :buildSrc:processTestResources NO-SOURCE > Task :buildSrc:testClasses UP-TO-DATE > Task :buildSrc:test NO-SOURCE > Task :buildSrc:validatePlugins UP-TO-DATE > Task :buildSrc:check UP-TO-DATE > Task :buildSrc:build UP-TO-DATE Configuration on demand is an incubating feature. > Task :sdks:go:container:copyLicenses > Task :sdks:go:container:dockerClean UP-TO-DATE > Task :sdks:go:container:goPrepare Use project GOPATH: <https://ci-beam.apache.org/job/beam_PostCommit_Go_VR_Spark/ws/src/sdks/go/container/.gogradle/project_gopath> > Task :sdks:go:container:resolveBuildDependencies SKIPPED > Task :sdks:go:container:installDependencies SKIPPED go: downloading github.com/golang/protobuf v1.5.2 go: downloading google.golang.org/grpc v1.39.0 go: downloading google.golang.org/protobuf v1.27.1 go: downloading google.golang.org/genproto v0.0.0-20210728212813-7823e685a01f go: downloading golang.org/x/net v0.0.0-20210423184538-5f58ad60dda6 go: downloading golang.org/x/sys v0.0.0-20210630005230-0f9fa26af87c go: downloading golang.org/x/text v0.3.6 > Task :sdks:go:container:buildLinuxAmd64 > Task :sdks:go:container:goBuild > Task :sdks:go:container:skipPullLicenses > Task :sdks:go:container:dockerPrepare > Task :sdks:go:container:docker Deprecated Gradle features were used in this build, making it incompatible with Gradle 7.0. Use '--warning-mode all' to show the individual deprecation warnings. See https://docs.gradle.org/6.9.1/userguide/command_line_interface.html#sec:command_line_warnings BUILD SUCCESSFUL in 40s 8 actionable tasks: 7 executed, 1 up-to-date Publishing build scan... Publishing build scan failed due to network error 'java.net.SocketTimeoutException: Read timed out' (2 retries remaining)... https://gradle.com/s/enxh3dk7btv7k $ CONTAINER=apache/beam_go_sdk $ cd sdks/go >>> RUNNING spark integration tests with pipeline options: -p 1 -timeout 2h >>> --runner=spark --project=apache-beam-testing --region=us-central1 >>> --environment_type=DOCKER --environment_config=apache/beam_go_sdk:dev >>> --staging_location=gs://temp-storage-for-end-to-end-tests/staging-validatesrunner-test >>> >>> --temp_location=gs://temp-storage-for-end-to-end-tests/temp-validatesrunner-test >>> --dataflow_worker_jar= --endpoint=localhost:48929 >>> --test_expansion_addr=localhost:47171 $ ./run_validatesrunner_tests.sh: line 399: go: command not found $ TEST_EXIT_CODE=0 $ cd ../.. $ exit 127 $ exit 127 > Task :sdks:go:test:sparkValidatesRunner FAILED FAILURE: Build failed with an exception. * Where: Build file '<https://ci-beam.apache.org/job/beam_PostCommit_Go_VR_Spark/ws/src/sdks/go/test/build.gradle'> line: 151 * What went wrong: Execution failed for task ':sdks:go:test:sparkValidatesRunner'. > Process 'command 'sh'' finished with non-zero exit value 127 * Try: Run with --stacktrace option to get the stack trace. Run with --info or --debug option to get more log output. Run with --scan to get full insights. * Get more help at https://help.gradle.org Deprecated Gradle features were used in this build, making it incompatible with Gradle 7.0. Use '--warning-mode all' to show the individual deprecation warnings. See https://docs.gradle.org/6.9.1/userguide/command_line_interface.html#sec:command_line_warnings BUILD FAILED in 4m 8s 106 actionable tasks: 74 executed, 29 from cache, 3 up-to-date Publishing build scan... https://gradle.com/s/wxuxgisxoj45g Build step 'Invoke Gradle script' changed build result to FAILURE Build step 'Invoke Gradle script' marked build as failure --------------------------------------------------------------------- To unsubscribe, e-mail: [email protected] For additional commands, e-mail: [email protected]
