See <https://ci-beam.apache.org/job/beam_PostCommit_Go/9053/display/redirect?page=changes>
Changes: [Luke Cwik] [BEAM-13015] Migrate bundle processing in the SDK harness to using [Brian Hulette] [BEAM-13099] Copy vendored calcite build for 1.28.0 [Brian Hulette] [BEAM-13099] Modifications for vendor/calcite-1_28_0 build [noreply] [BEAM-13001] DoFn metrics for Go SDK (#15657) ------------------------------------------ [...truncated 33.02 KB...] > Task :runners:google-cloud-dataflow-java:worker:windmill:extractIncludeProto > Task :runners:google-cloud-dataflow-java:worker:windmill:extractProto > Task :runners:google-cloud-dataflow-java:worker:windmill:generateProto > FROM-CACHE > Task :runners:google-cloud-dataflow-java:worker:windmill:compileJava > FROM-CACHE > Task :runners:google-cloud-dataflow-java:worker:windmill:processResources > Task :runners:google-cloud-dataflow-java:worker:windmill:classes > Task :runners:google-cloud-dataflow-java:worker:windmill:shadowJar FROM-CACHE > Task :runners:google-cloud-dataflow-java:worker:compileJava Note: Some input files use or override a deprecated API. Note: Recompile with -Xlint:deprecation for details. Note: Some input files use unchecked or unsafe operations. Note: Recompile with -Xlint:unchecked for details. > Task :runners:google-cloud-dataflow-java:worker:processResources > Task :runners:google-cloud-dataflow-java:worker:classes > Task :runners:google-cloud-dataflow-java:worker:shadowJar > Task :sdks:go:test:goPrepare Use project GOPATH: <https://ci-beam.apache.org/job/beam_PostCommit_Go/ws/src/sdks/go/test/.gogradle/project_gopath> > Task :sdks:go:test:resolveBuildDependencies SKIPPED > Task :sdks:go:test:resolveTestDependencies SKIPPED > Task :sdks:go:test:installDependencies SKIPPED go: downloading github.com/golang/protobuf v1.5.2 go: downloading github.com/google/uuid v1.3.0 go: downloading google.golang.org/grpc v1.39.0 go: downloading google.golang.org/protobuf v1.27.1 go: downloading cloud.google.com/go v0.81.0 go: downloading google.golang.org/api v0.45.0 go: downloading golang.org/x/oauth2 v0.0.0-20210628180205-a41e5a781914 go: downloading golang.org/x/net v0.0.0-20210423184538-5f58ad60dda6 go: downloading google.golang.org/genproto v0.0.0-20210728212813-7823e685a01f go: downloading golang.org/x/sys v0.0.0-20210630005230-0f9fa26af87c go: downloading cloud.google.com/go/storage v1.15.0 go: downloading github.com/googleapis/gax-go/v2 v2.0.5 go: downloading go.opencensus.io v0.23.0 go: downloading golang.org/x/text v0.3.6 go: downloading github.com/golang/groupcache v0.0.0-20210331224755-41bb18bfe9da > Task :sdks:go:test:buildLinuxAmd64 > Task :sdks:go:test:goBuild > Task :sdks:go:test:assemble > Task :sdks:go:test:goVendor UP-TO-DATE > Task :sdks:go:test:goTest Test for github.com/apache/beam/sdks/v2/go/test/integration/wordcount finished, 1 completed, 0 failed. Test for github.com/apache/beam/sdks/v2/go/test/integration/synthetic finished, 2 completed, 0 failed. Test for github.com/apache/beam/sdks/v2/go/test/integration/xlang finished, 8 completed, 0 failed, 8 skipped. Test for github.com/apache/beam/sdks/v2/go/test/regression/coders/fromyaml finished, 31 completed, 0 failed. Test for github.com/apache/beam/sdks/v2/go/test/regression finished, 7 completed, 0 failed. Test for github.com/apache/beam/sdks/v2/go/test/integration/io/xlang/kafka finished, 1 completed, 0 failed, 1 skipped. Test for github.com/apache/beam/sdks/v2/go/test/integration/primitives finished, 24 completed, 0 failed, 14 skipped. > Task :sdks:go:test:goCover > Task :sdks:go:test:goVet > Task :sdks:go:test:gofmt > Task :sdks:go:test:goCheck > Task :sdks:go:test:test UP-TO-DATE > Task :sdks:go:test:check > Task :sdks:go:test:build > Task :goIntegrationTests $ TESTS=./test/integration/... ./test/regression $ RUNNER=portable $ TIMEOUT=2h $ SIMULTANEOUS=3 $ GCS_LOCATION=gs://temp-storage-for-end-to-end-tests $ PROJECT=apache-beam-testing $ DATAFLOW_PROJECT=apache-beam-testing $ REGION=us-central1 $ trap exit_background_processes SIGINT SIGTERM EXIT $ key=--runner $ case --runner in $ RUNNER=dataflow $ cd <https://ci-beam.apache.org/job/beam_PostCommit_Go/ws/src> $ test -d sdks/go/test $ DATAFLOW_WORKER_JAR=<https://ci-beam.apache.org/job/beam_PostCommit_Go/ws/src/runners/google-cloud-dataflow-java/worker/build/libs/beam-runners-google-cloud-dataflow-java-fn-api-worker-2.35.0-SNAPSHOT.jar> Using Dataflow worker jar: <https://ci-beam.apache.org/job/beam_PostCommit_Go/ws/src/runners/google-cloud-dataflow-java/worker/build/libs/beam-runners-google-cloud-dataflow-java-fn-api-worker-2.35.0-SNAPSHOT.jar> $ command -v docker /usr/bin/docker $ docker -v Docker version 18.09.4, build d14af54 $ command -v gcloud /usr/bin/gcloud $ gcloud --version Google Cloud SDK 212.0.0 alpha 2018.08.13 beta 2018.08.13 bq 2.0.34 core 2018.08.13 gsutil 4.33 $ TMPDIR=/tmp/tmp.1VnsO7vzSP $ gcloud_ver=212.0.0 $ TAG=20211030-002016 $ CONTAINER=us.gcr.io/apache-beam-testing/jenkins/beam_go_sdk Using container us.gcr.io/apache-beam-testing/jenkins/beam_go_sdk $ ./gradlew :sdks:go:container:docker -Pdocker-repository-root=us.gcr.io/apache-beam-testing/jenkins -Pdocker-tag=20211030-002016 Starting a Gradle Daemon, 4 busy Daemons could not be reused, use --status for details > Task :buildSrc:compileJava NO-SOURCE > Task :buildSrc:compileGroovy UP-TO-DATE > Task :buildSrc:pluginDescriptors UP-TO-DATE > Task :buildSrc:processResources UP-TO-DATE > Task :buildSrc:classes UP-TO-DATE > Task :buildSrc:jar UP-TO-DATE > Task :buildSrc:assemble UP-TO-DATE > Task :buildSrc:spotlessGroovy UP-TO-DATE > Task :buildSrc:spotlessGroovyCheck UP-TO-DATE > Task :buildSrc:spotlessGroovyGradle UP-TO-DATE > Task :buildSrc:spotlessGroovyGradleCheck UP-TO-DATE > Task :buildSrc:spotlessCheck UP-TO-DATE > Task :buildSrc:pluginUnderTestMetadata UP-TO-DATE > Task :buildSrc:compileTestJava NO-SOURCE > Task :buildSrc:compileTestGroovy NO-SOURCE > Task :buildSrc:processTestResources NO-SOURCE > Task :buildSrc:testClasses UP-TO-DATE > Task :buildSrc:test NO-SOURCE > Task :buildSrc:validatePlugins UP-TO-DATE > Task :buildSrc:check UP-TO-DATE > Task :buildSrc:build UP-TO-DATE Configuration on demand is an incubating feature. > Task :sdks:go:container:copyLicenses > Task :sdks:go:container:dockerClean UP-TO-DATE > Task :sdks:go:container:goPrepare Use project GOPATH: <https://ci-beam.apache.org/job/beam_PostCommit_Go/ws/src/sdks/go/container/.gogradle/project_gopath> > Task :sdks:go:container:resolveBuildDependencies SKIPPED > Task :sdks:go:container:installDependencies SKIPPED go: downloading google.golang.org/grpc v1.39.0 go: downloading github.com/golang/protobuf v1.5.2 go: downloading google.golang.org/protobuf v1.27.1 go: downloading google.golang.org/genproto v0.0.0-20210728212813-7823e685a01f go: downloading golang.org/x/net v0.0.0-20210423184538-5f58ad60dda6 go: downloading golang.org/x/sys v0.0.0-20210630005230-0f9fa26af87c go: downloading golang.org/x/text v0.3.6 > Task :sdks:go:container:buildLinuxAmd64 > Task :sdks:go:container:goBuild > Task :sdks:go:container:skipPullLicenses > Task :sdks:go:container:dockerPrepare > Task :sdks:go:container:docker Deprecated Gradle features were used in this build, making it incompatible with Gradle 7.0. Use '--warning-mode all' to show the individual deprecation warnings. See https://docs.gradle.org/6.9.1/userguide/command_line_interface.html#sec:command_line_warnings BUILD SUCCESSFUL in 49s 8 actionable tasks: 7 executed, 1 up-to-date Publishing build scan... https://gradle.com/s/n26gxpw46npqe $ docker images $ grep 20211030-002016 us.gcr.io/apache-beam-testing/jenkins/beam_go_sdk 20211030-002016 c7794c8d3cfc 1 second ago 136MB $ gcloud docker -- push us.gcr.io/apache-beam-testing/jenkins/beam_go_sdk:20211030-002016 WARNING: `gcloud docker` will not be supported for Docker client versions above 18.03. As an alternative, use `gcloud auth configure-docker` to configure `docker` to use `gcloud` as a credential helper, then use `docker` as you would for non-GCR registries, e.g. `docker pull gcr.io/project-id/my-image`. Add `--verbosity=error` to silence this warning: `gcloud docker --verbosity=error -- pull gcr.io/project-id/my-image`. See: https://cloud.google.com/container-registry/docs/support/deprecation-notices#gcloud-docker The push refers to repository [us.gcr.io/apache-beam-testing/jenkins/beam_go_sdk] 1139434b5975: Preparing ab32b6e1e42c: Preparing 83934f0b7582: Preparing 5a4fd2e32146: Preparing e3128dc3d661: Preparing cffceceb3cf2: Preparing 415b41d8ead9: Preparing 22f8b5520ced: Preparing cffceceb3cf2: Waiting 415b41d8ead9: Waiting 22f8b5520ced: Waiting 1139434b5975: Pushed 5a4fd2e32146: Pushed 83934f0b7582: Pushed ab32b6e1e42c: Pushed e3128dc3d661: Pushed 22f8b5520ced: Layer already exists 415b41d8ead9: Pushed cffceceb3cf2: Pushed 20211030-002016: digest: sha256:8e35692078c2b26ccde878b4747becdd0bfdaf8d684d8ad4fb47eb865778a921 size: 1988 $ cd sdks/go >>> RUNNING dataflow integration tests with pipeline options: -p 3 -timeout 2h >>> --runner=dataflow --project=apache-beam-testing --region=us-central1 >>> --environment_type=DOCKER >>> --environment_config=us.gcr.io/apache-beam-testing/jenkins/beam_go_sdk:20211030-002016 >>> >>> --staging_location=gs://temp-storage-for-end-to-end-tests/staging-validatesrunner-test >>> >>> --temp_location=gs://temp-storage-for-end-to-end-tests/temp-validatesrunner-test >>> >>> --dataflow_worker_jar=<https://ci-beam.apache.org/job/beam_PostCommit_Go/ws/src/runners/google-cloud-dataflow-java/worker/build/libs/beam-runners-google-cloud-dataflow-java-fn-api-worker-2.35.0-SNAPSHOT.jar> >>> --endpoint= $ ./sdks/go/test/run_validatesrunner_tests.sh: line 399: go: command not found $ TEST_EXIT_CODE=0 $ cd ../.. $ docker rmi us.gcr.io/apache-beam-testing/jenkins/beam_go_sdk:20211030-002016 Untagged: us.gcr.io/apache-beam-testing/jenkins/beam_go_sdk:20211030-002016 Untagged: us.gcr.io/apache-beam-testing/jenkins/beam_go_sdk@sha256:8e35692078c2b26ccde878b4747becdd0bfdaf8d684d8ad4fb47eb865778a921 Deleted: sha256:c7794c8d3cfc942d3fd8147df92438a92c8f8cb212c8c8c4c7db16eb3b92f04d Deleted: sha256:a1d1df7febfb0a4ababafc1a5199c384b0ad222ddb1b12fc4de8d8de4b0a5790 Deleted: sha256:b469182bd28e4987bf7b2e7e5c55a6c8836a0b2c1a350e7d7b5eca01fe17c2e3 Deleted: sha256:095867d93605c005f7364380020e4123c7e2c426eeebc2354593b451e51a657e Deleted: sha256:9c000b624a302743f3fe14690396c44b026aa560cab48ac11588cc4d7c8a1037 Deleted: sha256:f4b497fb3c0fdd575fbbdc5a7ce0c9c9137b97470ec39990679be3a1a5589d6e Deleted: sha256:476f09d1fee9163ee0b4884a541cc14cea6b26e2b5bf8f11dd5691c7469fe74d Deleted: sha256:06d873665437ce486fad0748d860c86760b0983b1af844e37c2e0e24c6c27fe3 Deleted: sha256:5951b5d439c6ebcabb9b9691eb8be3cea989c50ab1a4711a34f785f22970abdf Deleted: sha256:489196638a1d176a9fd820fa5fda71b1f91689bcf2c1c1786060b52b753ab07c Deleted: sha256:9db674bcaa0cbf8d33dbd44c2b4e8eabbc2c838e36e15b15670f09ed975e24cf Deleted: sha256:d7d59874078d9f44bc8bdffb73a9a965fe56ffd30f51af61a7363cfc26ebeeff Deleted: sha256:426cf1ce78e12ba9abc095998fa4dc1442d5faa1e5127e2341ac7c30bb0f3b27 Deleted: sha256:a59aa9bdf738592f4872caa627003502b97a7f683a0f71bdab84fe6bc6326f9d Deleted: sha256:85133737af521ff2f30e36a400d0c0b7e6e83e30f13109789ebec83567a168bb Deleted: sha256:bc8f132d5410fe9d96413ffceb987af262abf56385dfb29339d2b8ca25691784 Deleted: sha256:f9e3ca235af8a7523dc8dd1a2d5349ba47ae3b338e3d4437af48c03fa69b52d6 $ gcloud --quiet container images delete us.gcr.io/apache-beam-testing/jenkins/beam_go_sdk:20211030-002016 Digests: - us.gcr.io/apache-beam-testing/jenkins/beam_go_sdk@sha256:8e35692078c2b26ccde878b4747becdd0bfdaf8d684d8ad4fb47eb865778a921 Associated tags: - 20211030-002016 Tags: - us.gcr.io/apache-beam-testing/jenkins/beam_go_sdk:20211030-002016 Deleted [us.gcr.io/apache-beam-testing/jenkins/beam_go_sdk:20211030-002016]. Deleted [us.gcr.io/apache-beam-testing/jenkins/beam_go_sdk@sha256:8e35692078c2b26ccde878b4747becdd0bfdaf8d684d8ad4fb47eb865778a921]. $ rm -rf /tmp/tmp.Gzf0RJDOgl $ exit 127 $ exit 127 > Task :goIntegrationTests FAILED FAILURE: Build failed with an exception. * What went wrong: Execution failed for task ':goIntegrationTests'. > Process 'command 'sh'' finished with non-zero exit value 127 * Try: Run with --stacktrace option to get the stack trace. Run with --info or --debug option to get more log output. Run with --scan to get full insights. * Get more help at https://help.gradle.org Deprecated Gradle features were used in this build, making it incompatible with Gradle 7.0. Use '--warning-mode all' to show the individual deprecation warnings. See https://docs.gradle.org/6.9.1/userguide/command_line_interface.html#sec:command_line_warnings BUILD FAILED in 20m 48s 86 actionable tasks: 79 executed, 7 from cache Publishing build scan... https://gradle.com/s/j7i3sp7hrgepk Build step 'Invoke Gradle script' changed build result to FAILURE Build step 'Invoke Gradle script' marked build as failure --------------------------------------------------------------------- To unsubscribe, e-mail: [email protected] For additional commands, e-mail: [email protected]
