See <https://ci-beam.apache.org/job/beam_PostCommit_Go_VR_Spark/8143/display/redirect>
Changes: ------------------------------------------ [...truncated 56.06 KB...] #16 DONE 0.2s #17 [13/16] COPY target/LICENSE target/options/* /opt/apache/beam/options/ #17 DONE 0.1s #18 [14/16] COPY target/go-licenses/* /opt/apache/beam/third_party_licenses/golang/ #18 DONE 0.1s #19 [15/16] RUN if [ "true" = "false" ] ; then rm -rf /opt/apache/beam/third_party_licenses ; fi #19 DONE 0.3s #20 [16/16] COPY target/profiler/* /opt/google_cloud_profiler/ #20 DONE 0.1s #21 exporting to image #21 exporting layers #21 exporting layers 0.2s done #21 writing image sha256:64c520ab3b2107b72e8101853414af1a33107d153faccbea15ae5cd2a4585b32 done #21 naming to docker.io/apache/beam_java8_sdk:2.52.0.dev done #21 DONE 0.2s > Task :sdks:go:test:sparkValidatesRunner $ CURRENT_DIRECTORY=<https://ci-beam.apache.org/job/beam_PostCommit_Go_VR_Spark/ws/src/sdks/go/test> $ TESTS=./test/integration/... ./test/regression $ RUNNER=portable $ TIMEOUT=3h $ SIMULTANEOUS=3 $ GCS_LOCATION=gs://temp-storage-for-end-to-end-tests $ GCS_SUBFOLDER=test8826 $ PROJECT=apache-beam-testing $ DATAFLOW_PROJECT=apache-beam-testing $ REGION=us-central1 $ trap exit_background_processes SIGINT SIGTERM EXIT $ key=--runner $ case --runner in $ RUNNER=spark $ key=--spark_job_server_jar $ case --spark_job_server_jar in $ SPARK_JOB_SERVER_JAR=<https://ci-beam.apache.org/job/beam_PostCommit_Go_VR_Spark/ws/src/runners/spark/3/job-server/build/libs/beam-runners-spark-3-job-server-2.52.0-SNAPSHOT.jar> $ key=--pipeline_opts $ case --pipeline_opts in $ PIPELINE_OPTS=--expansion_jar=test:<https://ci-beam.apache.org/job/beam_PostCommit_Go_VR_Spark/ws/src/sdks/java/testing/expansion-service/build/libs/beam-sdks-java-testing-expansion-service-testExpansionService-2.52.0-SNAPSHOT.jar> $ cd <https://ci-beam.apache.org/job/beam_PostCommit_Go_VR_Spark/ws/src> $ test -d sdks/go/test $ TMPDIR=/tmp/tmp.YMqXQH013C $ JOB_PORT=42215 $ ENDPOINT=localhost:42695 No endpoint specified; starting a new spark job server on localhost:42695 $ java -jar <https://ci-beam.apache.org/job/beam_PostCommit_Go_VR_Spark/ws/src/runners/spark/3/job-server/build/libs/beam-runners-spark-3-job-server-2.52.0-SNAPSHOT.jar> --spark-master-url local --job-port 42695 --expansion-port 0 --artifact-port 0 $ JOBSERVER_PID=1614141 $ SIMULTANEOUS=1 $ TAG=dev $ ./gradlew :sdks:go:container:docker -Pdocker-tag=dev To honour the JVM settings for this build a single-use Daemon process will be forked. For more on this, please refer to https://docs.gradle.org/8.3/userguide/gradle_daemon.html#sec:disabling_the_daemon in the Gradle documentation. Daemon will be stopped at the end of the build 23/10/10 08:40:26 WARN software.amazon.awssdk.regions.internal.util.EC2MetadataUtils: Unable to retrieve the requested metadata. Configuration on demand is an incubating feature. 23/10/10 08:40:27 INFO org.apache.beam.runners.jobsubmission.JobServerDriver: ArtifactStagingService started on localhost:37377 23/10/10 08:40:27 INFO org.apache.beam.runners.jobsubmission.JobServerDriver: Java ExpansionService started on localhost:37333 23/10/10 08:40:27 INFO org.apache.beam.runners.jobsubmission.JobServerDriver: JobService started on localhost:42695 23/10/10 08:40:27 INFO org.apache.beam.runners.jobsubmission.JobServerDriver: Job server now running, terminate with Ctrl+C Gradle Enterprise plugins resolution: https://plugins.gradle.org/m2 Enforcing Gradle Enterprise: https://ge.apache.org, allowUntrustedServer: false > Task :buildSrc:compileJava NO-SOURCE > Task :buildSrc:compileGroovy UP-TO-DATE > Task :buildSrc:pluginDescriptors UP-TO-DATE > Task :buildSrc:processResources UP-TO-DATE > Task :buildSrc:classes UP-TO-DATE > Task :buildSrc:jar UP-TO-DATE > Configure project :sdks:go:container docker-pull-licenses not set, skipping go-licenses System Go installation: /snap/bin/go is go version go1.16.15 linux/amd64; Preparing to use /home/jenkins/go/bin/go1.21.2 go1.21.2: already downloaded in /home/jenkins/sdk/go1.21.2 GOCMD=/home/jenkins/go/bin/go1.21.2 > Task :sdks:go:container:copyLicenses > Task :sdks:go:container:dockerClean UP-TO-DATE > Task :sdks:go:container:goPrepare UP-TO-DATE > Task :sdks:go:container:goBuild /home/jenkins/go/bin/go1.21.2 build -o ./build/target/linux_amd64/boot boot.go boot_test.go > Task :sdks:go:container:skipPullLicenses > Task :sdks:go:container:dockerPrepare #1 [internal] load build definition from Dockerfile #1 transferring dockerfile: 1.70kB done > Task :sdks:go:container:docker #1 DONE 0.0s #2 [internal] load .dockerignore #2 transferring context: 2B done #2 DONE 0.0s #3 [internal] load metadata for docker.io/library/debian:bullseye #3 DONE 0.5s #4 [1/7] FROM docker.io/library/debian:bullseye@sha256:54d33aaad0bc936a9a40d856764c7bc35c0afaa9cab51f88bb95f6cd8004438d #4 resolve docker.io/library/debian:bullseye@sha256:54d33aaad0bc936a9a40d856764c7bc35c0afaa9cab51f88bb95f6cd8004438d 0.0s done #4 CACHED #5 [internal] load build context #5 transferring context: 22.15MB 0.2s done #5 DONE 0.2s #6 [2/7] RUN apt-get update && DEBIAN_FRONTEND=noninteractive apt-get install -y ca-certificates && rm -rf /var/lib/apt/lists/* #6 0.385 Get:1 http://deb.debian.org/debian bullseye InRelease [116 kB] #6 0.417 Get:2 http://deb.debian.org/debian-security bullseye-security InRelease [48.4 kB] #6 0.429 Get:3 http://deb.debian.org/debian bullseye-updates InRelease [44.1 kB] #6 0.559 Get:4 http://deb.debian.org/debian bullseye/main amd64 Packages [8062 kB] #6 0.682 Get:5 http://deb.debian.org/debian-security bullseye-security/main amd64 Packages [254 kB] #6 0.804 Get:6 http://deb.debian.org/debian bullseye-updates/main amd64 Packages [17.4 kB] #6 1.970 Fetched 8542 kB in 2s (5260 kB/s) #6 1.970 Reading package lists... #6 2.626 Reading package lists... #6 3.236 Building dependency tree... #6 3.388 Reading state information... #6 3.559 The following additional packages will be installed: #6 3.559 openssl #6 3.600 The following NEW packages will be installed: #6 3.601 ca-certificates openssl #6 3.640 0 upgraded, 2 newly installed, 0 to remove and 13 not upgraded. #6 3.640 Need to get 1017 kB of archives. #6 3.640 After this operation, 1897 kB of additional disk space will be used. #6 3.640 Get:1 http://deb.debian.org/debian bullseye/main amd64 openssl amd64 1.1.1w-0+deb11u1 [859 kB] #6 3.697 Get:2 http://deb.debian.org/debian bullseye/main amd64 ca-certificates all 20210119 [158 kB] #6 3.971 debconf: delaying package configuration, since apt-utils is not installed #6 4.001 Fetched 1017 kB in 0s (11.0 MB/s) #6 4.027 Selecting previously unselected package openssl. #6 4.027 (Reading database ... (Reading database ... 5%(Reading database ... 10%(Reading database ... 15%(Reading database ... 20%(Reading database ... 25%(Reading database ... 30%(Reading database ... 35%(Reading database ... 40%(Reading database ... 45%(Reading database ... 50%(Reading database ... 55%(Reading database ... 60%(Reading database ... 65%(Reading database ... 70%(Reading database ... 75%(Reading database ... 80%(Reading database ... 85%(Reading database ... 90%(Reading database ... 95%(Reading database ... 100%(Reading database ... 6664 files and directories currently installed.) #6 4.038 Preparing to unpack .../openssl_1.1.1w-0+deb11u1_amd64.deb ... #6 4.043 Unpacking openssl (1.1.1w-0+deb11u1) ... #6 4.176 Selecting previously unselected package ca-certificates. #6 4.177 Preparing to unpack .../ca-certificates_20210119_all.deb ... #6 4.182 Unpacking ca-certificates (20210119) ... #6 4.268 Setting up openssl (1.1.1w-0+deb11u1) ... #6 4.286 Setting up ca-certificates (20210119) ... #6 5.133 Updating certificates in /etc/ssl/certs... #6 5.940 129 added, 0 removed; done. #6 5.998 Processing triggers for ca-certificates (20210119) ... #6 6.007 Updating certificates in /etc/ssl/certs... #6 6.576 0 added, 0 removed; done. #6 6.576 Running hooks in /etc/ca-certificates/update.d... #6 6.594 done. #6 DONE 7.2s #7 [3/7] ADD target/linux_amd64/boot /opt/apache/beam/ #7 DONE 0.3s #8 [4/7] COPY target/LICENSE /opt/apache/beam/ #8 DONE 0.1s #9 [5/7] COPY target/NOTICE /opt/apache/beam/ #9 DONE 0.1s #10 [6/7] COPY target/go-licenses/* /opt/apache/beam/third_party_licenses/golang/ #10 DONE 0.1s #11 [7/7] RUN if [ "false" = "false" ] ; then rm -rf /opt/apache/beam/third_party_licenses ; fi #11 DONE 0.3s #12 exporting to image #12 exporting layers #12 exporting layers 0.2s done #12 writing image sha256:4f3cc929e57dda822c232dbc8b4497a0aa577137e9c6f633dad509990b52acec done #12 naming to docker.io/apache/beam_go_sdk:dev done #12 DONE 0.2s Deprecated Gradle features were used in this build, making it incompatible with Gradle 9.0. You can use '--warning-mode all' to show the individual deprecation warnings and determine if they come from your own scripts or plugins. For more on this, please refer to https://docs.gradle.org/8.3/userguide/command_line_interface.html#sec:command_line_warnings in the Gradle documentation. BUILD SUCCESSFUL in 21s 10 actionable tasks: 5 executed, 5 up-to-date Publishing build scan... https://ge.apache.org/s/7orz7rn5jpcrs $ CONTAINER=apache/beam_go_sdk $ cd sdks/go >>> RUNNING spark integration tests with pipeline options: -p 1 -v -timeout 3h >>> --runner=spark --project=apache-beam-testing --region=us-central1 >>> --environment_type=DOCKER --environment_config=apache/beam_go_sdk:dev >>> --staging_location=gs://temp-storage-for-end-to-end-tests/staging-validatesrunner-test/test24182 >>> >>> --temp_location=gs://temp-storage-for-end-to-end-tests/temp-validatesrunner-test/test24182 >>> --endpoint=localhost:42695 >>> --expansion_jar=test:<https://ci-beam.apache.org/job/beam_PostCommit_Go_VR_Spark/ws/src/sdks/java/testing/expansion-service/build/libs/beam-sdks-java-testing-expansion-service-testExpansionService-2.52.0-SNAPSHOT.jar> $ System Go installation: /snap/bin/go is go version go1.16.15 linux/amd64; Preparing to use /home/jenkins/go/bin/go1.21.0 go1.21.0: already downloaded in /home/jenkins/sdk/go1.21.0 /home/jenkins/go/bin/go1.21.0 test -v ./test/integration/... ./test/regression -p 1 -v -timeout 3h --runner=spark --project=apache-beam-testing --region=us-central1 --environment_type=DOCKER --environment_config=apache/beam_go_sdk:dev --staging_location=gs://temp-storage-for-end-to-end-tests/staging-validatesrunner-test/test24182 --temp_location=gs://temp-storage-for-end-to-end-tests/temp-validatesrunner-test/test24182 --endpoint=localhost:42695 --expansion_jar=test:<https://ci-beam.apache.org/job/beam_PostCommit_Go_VR_Spark/ws/src/sdks/java/testing/expansion-service/build/libs/beam-sdks-java-testing-expansion-service-testExpansionService-2.52.0-SNAPSHOT.jar> # github.com/apache/beam/sdks/v2/go/test/integration [github.com/apache/beam/sdks/v2/go/test/integration.test] test/integration/integration.go:41:2: "os" imported and not used FAIL github.com/apache/beam/sdks/v2/go/test/integration [build failed] ? github.com/apache/beam/sdks/v2/go/test/integration/internal/containers [no test files] ? github.com/apache/beam/sdks/v2/go/test/integration/internal/jars [no test files] ? github.com/apache/beam/sdks/v2/go/test/integration/internal/ports [no test files] # github.com/apache/beam/sdks/v2/go/test/integration test/integration/integration.go:41:2: "os" imported and not used FAIL github.com/apache/beam/sdks/v2/go/test/integration/io/bigqueryio [build failed] FAIL github.com/apache/beam/sdks/v2/go/test/integration/io/fhirio [build failed] FAIL github.com/apache/beam/sdks/v2/go/test/integration/io/mongodbio [build failed] FAIL github.com/apache/beam/sdks/v2/go/test/integration/io/spannerio [build failed] FAIL github.com/apache/beam/sdks/v2/go/test/integration/io/xlang/bigquery [build failed] FAIL github.com/apache/beam/sdks/v2/go/test/integration/io/xlang/bigtable [build failed] FAIL github.com/apache/beam/sdks/v2/go/test/integration/io/xlang/debezium [build failed] FAIL github.com/apache/beam/sdks/v2/go/test/integration/io/xlang/jdbc [build failed] FAIL github.com/apache/beam/sdks/v2/go/test/integration/io/xlang/kafka [build failed] FAIL github.com/apache/beam/sdks/v2/go/test/integration/primitives [build failed] FAIL github.com/apache/beam/sdks/v2/go/test/integration/synthetic [build failed] FAIL github.com/apache/beam/sdks/v2/go/test/integration/transforms/xlang/dataframe [build failed] FAIL github.com/apache/beam/sdks/v2/go/test/integration/transforms/xlang/inference [build failed] FAIL github.com/apache/beam/sdks/v2/go/test/integration/wordcount [build failed] FAIL github.com/apache/beam/sdks/v2/go/test/integration/xlang [build failed] FAIL github.com/apache/beam/sdks/v2/go/test/regression [build failed] FAIL $ TEST_EXIT_CODE=0 $ cd ../.. $ rm -rf /tmp/tmp.uZpHYTR09T $ exit 1 $ exit 1 > Task :sdks:go:test:sparkValidatesRunner FAILED FAILURE: Build failed with an exception. * Where: Build file '<https://ci-beam.apache.org/job/beam_PostCommit_Go_VR_Spark/ws/src/sdks/go/test/build.gradle'> line: 133 * What went wrong: Execution failed for task ':sdks:go:test:sparkValidatesRunner'. > Process 'command 'sh'' finished with non-zero exit value 1 * Try: > Run with --stacktrace option to get the stack trace. > Run with --info or --debug option to get more log output. > Get more help at https://help.gradle.org. Deprecated Gradle features were used in this build, making it incompatible with Gradle 9.0. You can use '--warning-mode all' to show the individual deprecation warnings and determine if they come from your own scripts or plugins. For more on this, please refer to https://docs.gradle.org/8.3/userguide/command_line_interface.html#sec:command_line_warnings in the Gradle documentation. BUILD FAILED in 1m 25s 116 actionable tasks: 74 executed, 40 from cache, 2 up-to-date Publishing build scan... https://ge.apache.org/s/r2ozk63l6yy26 Build step 'Invoke Gradle script' changed build result to FAILURE Build step 'Invoke Gradle script' marked build as failure --------------------------------------------------------------------- To unsubscribe, e-mail: [email protected] For additional commands, e-mail: [email protected]
