See <https://ci-beam.apache.org/job/beam_PostCommit_Go_VR_Spark/8141/display/redirect>
Changes: ------------------------------------------ [...truncated 58.35 KB...] #18 DONE 0.1s #4 [ 1/16] FROM docker.io/library/eclipse-temurin:8@sha256:5d1b06a9410e41787299b5e4c57a5b868a657f44fc603725ced7f66ddab713e1 #4 ... #19 [15/16] RUN if [ "true" = "false" ] ; then rm -rf /opt/apache/beam/third_party_licenses ; fi #19 DONE 0.5s #20 [16/16] COPY target/profiler/* /opt/google_cloud_profiler/ #20 DONE 0.1s #21 exporting to image #21 exporting layers #21 exporting layers 0.3s done #21 writing image sha256:09c9bc90f56a10b031d2d6415cd7feaad8ca4fd136a7e284c1ac4fddda3b3aeb done #21 naming to docker.io/apache/beam_java8_sdk:2.52.0.dev done #21 DONE 0.3s #4 [ 1/16] FROM docker.io/library/eclipse-temurin:8@sha256:5d1b06a9410e41787299b5e4c57a5b868a657f44fc603725ced7f66ddab713e1 > Task :sdks:go:test:sparkValidatesRunner $ CURRENT_DIRECTORY=<https://ci-beam.apache.org/job/beam_PostCommit_Go_VR_Spark/ws/src/sdks/go/test> $ TESTS=./test/integration/... ./test/regression $ RUNNER=portable $ TIMEOUT=3h $ SIMULTANEOUS=3 $ GCS_LOCATION=gs://temp-storage-for-end-to-end-tests $ GCS_SUBFOLDER=test32724 $ PROJECT=apache-beam-testing $ DATAFLOW_PROJECT=apache-beam-testing $ REGION=us-central1 $ trap exit_background_processes SIGINT SIGTERM EXIT $ key=--runner $ case --runner in $ RUNNER=spark $ key=--spark_job_server_jar $ case --spark_job_server_jar in $ SPARK_JOB_SERVER_JAR=<https://ci-beam.apache.org/job/beam_PostCommit_Go_VR_Spark/ws/src/runners/spark/3/job-server/build/libs/beam-runners-spark-3-job-server-2.52.0-SNAPSHOT.jar> $ key=--pipeline_opts $ case --pipeline_opts in $ PIPELINE_OPTS=--expansion_jar=test:<https://ci-beam.apache.org/job/beam_PostCommit_Go_VR_Spark/ws/src/sdks/java/testing/expansion-service/build/libs/beam-sdks-java-testing-expansion-service-testExpansionService-2.52.0-SNAPSHOT.jar> $ cd <https://ci-beam.apache.org/job/beam_PostCommit_Go_VR_Spark/ws/src> $ test -d sdks/go/test $ TMPDIR=/tmp/tmp.eYVhCUrwfQ $ JOB_PORT=38151 $ ENDPOINT=localhost:33867 No endpoint specified; starting a new spark job server on localhost:33867 $ java -jar <https://ci-beam.apache.org/job/beam_PostCommit_Go_VR_Spark/ws/src/runners/spark/3/job-server/build/libs/beam-runners-spark-3-job-server-2.52.0-SNAPSHOT.jar> --spark-master-url local --job-port 33867 --expansion-port 0 --artifact-port 0 $ JOBSERVER_PID=2355862 $ SIMULTANEOUS=1 $ TAG=dev $ ./gradlew :sdks:go:container:docker -Pdocker-tag=dev To honour the JVM settings for this build a single-use Daemon process will be forked. For more on this, please refer to https://docs.gradle.org/8.3/userguide/gradle_daemon.html#sec:disabling_the_daemon in the Gradle documentation. Daemon will be stopped at the end of the build 23/10/09 20:51:46 WARN software.amazon.awssdk.regions.internal.util.EC2MetadataUtils: Unable to retrieve the requested metadata. Configuration on demand is an incubating feature. 23/10/09 20:51:47 INFO org.apache.beam.runners.jobsubmission.JobServerDriver: ArtifactStagingService started on localhost:38499 23/10/09 20:51:47 INFO org.apache.beam.runners.jobsubmission.JobServerDriver: Java ExpansionService started on localhost:39383 23/10/09 20:51:47 INFO org.apache.beam.runners.jobsubmission.JobServerDriver: JobService started on localhost:33867 23/10/09 20:51:47 INFO org.apache.beam.runners.jobsubmission.JobServerDriver: Job server now running, terminate with Ctrl+C Gradle Enterprise plugins resolution: https://plugins.gradle.org/m2 Enforcing Gradle Enterprise: https://ge.apache.org, allowUntrustedServer: false > Task :buildSrc:compileJava NO-SOURCE > Task :buildSrc:compileGroovy UP-TO-DATE > Task :buildSrc:pluginDescriptors UP-TO-DATE > Task :buildSrc:processResources UP-TO-DATE > Task :buildSrc:classes UP-TO-DATE > Task :buildSrc:jar UP-TO-DATE > Configure project :sdks:go:container docker-pull-licenses not set, skipping go-licenses System Go installation: /snap/bin/go is go version go1.16.15 linux/amd64; Preparing to use /home/jenkins/go/bin/go1.21.2 go1.21.2: already downloaded in /home/jenkins/sdk/go1.21.2 GOCMD=/home/jenkins/go/bin/go1.21.2 > Task :sdks:go:container:copyLicenses > Task :sdks:go:container:dockerClean UP-TO-DATE > Task :sdks:go:container:goPrepare UP-TO-DATE > Task :sdks:go:container:goBuild /home/jenkins/go/bin/go1.21.2 build -o ./build/target/linux_amd64/boot boot.go boot_test.go > Task :sdks:go:container:skipPullLicenses > Task :sdks:go:container:dockerPrepare > Task :sdks:go:container:docker #1 [internal] load build definition from Dockerfile #1 transferring dockerfile: 1.70kB 0.0s done #1 DONE 0.1s #2 [internal] load .dockerignore #2 transferring context: 2B done #2 DONE 0.0s #3 [internal] load metadata for docker.io/library/debian:bullseye #3 DONE 0.4s #4 [1/7] FROM docker.io/library/debian:bullseye@sha256:54d33aaad0bc936a9a40d856764c7bc35c0afaa9cab51f88bb95f6cd8004438d #4 resolve docker.io/library/debian:bullseye@sha256:54d33aaad0bc936a9a40d856764c7bc35c0afaa9cab51f88bb95f6cd8004438d 0.0s done #4 CACHED #5 [internal] load build context #5 transferring context: 22.15MB 0.4s done #5 DONE 0.4s #6 [2/7] RUN apt-get update && DEBIAN_FRONTEND=noninteractive apt-get install -y ca-certificates && rm -rf /var/lib/apt/lists/* #6 0.821 Get:1 http://deb.debian.org/debian bullseye InRelease [116 kB] #6 0.900 Get:2 http://deb.debian.org/debian-security bullseye-security InRelease [48.4 kB] #6 0.932 Get:3 http://deb.debian.org/debian bullseye-updates InRelease [44.1 kB] #6 1.174 Get:4 http://deb.debian.org/debian bullseye/main amd64 Packages [8062 kB] #6 1.428 Get:5 http://deb.debian.org/debian-security bullseye-security/main amd64 Packages [254 kB] #6 1.681 Get:6 http://deb.debian.org/debian bullseye-updates/main amd64 Packages [17.4 kB] #6 3.106 Fetched 8542 kB in 2s (3595 kB/s) #6 3.106 Reading package lists... #6 4.100 Reading package lists... #6 5.104 Building dependency tree... #6 5.359 Reading state information... #6 5.784 The following additional packages will be installed: #6 5.785 openssl #6 5.855 The following NEW packages will be installed: #6 5.858 ca-certificates openssl #6 5.975 0 upgraded, 2 newly installed, 0 to remove and 13 not upgraded. #6 5.975 Need to get 1017 kB of archives. #6 5.975 After this operation, 1897 kB of additional disk space will be used. #6 5.975 Get:1 http://deb.debian.org/debian bullseye/main amd64 openssl amd64 1.1.1w-0+deb11u1 [859 kB] #6 6.149 Get:2 http://deb.debian.org/debian bullseye/main amd64 ca-certificates all 20210119 [158 kB] #6 6.388 debconf: delaying package configuration, since apt-utils is not installed #6 6.441 Fetched 1017 kB in 0s (3706 kB/s) #6 6.484 Selecting previously unselected package openssl. #6 6.484 (Reading database ... (Reading database ... 5%(Reading database ... 10%(Reading database ... 15%(Reading database ... 20%(Reading database ... 25%(Reading database ... 30%(Reading database ... 35%(Reading database ... 40%(Reading database ... 45%(Reading database ... 50%(Reading database ... 55%(Reading database ... 60%(Reading database ... 65%(Reading database ... 70%(Reading database ... 75%(Reading database ... 80%(Reading database ... 85%(Reading database ... 90%(Reading database ... 95%(Reading database ... 100%(Reading database ... 6664 files and directories currently installed.) #6 6.490 Preparing to unpack .../openssl_1.1.1w-0+deb11u1_amd64.deb ... #6 6.499 Unpacking openssl (1.1.1w-0+deb11u1) ... #6 6.652 Selecting previously unselected package ca-certificates. #6 6.654 Preparing to unpack .../ca-certificates_20210119_all.deb ... #6 6.658 Unpacking ca-certificates (20210119) ... #6 6.750 Setting up openssl (1.1.1w-0+deb11u1) ... #6 6.770 Setting up ca-certificates (20210119) ... #6 7.577 Updating certificates in /etc/ssl/certs... #6 8.976 129 added, 0 removed; done. #6 9.036 Processing triggers for ca-certificates (20210119) ... #6 9.052 Updating certificates in /etc/ssl/certs... #6 10.36 0 added, 0 removed; done. #6 10.36 Running hooks in /etc/ca-certificates/update.d... #6 10.36 done. #6 DONE 13.7s #7 [3/7] ADD target/linux_amd64/boot /opt/apache/beam/ #7 DONE 0.4s #8 [4/7] COPY target/LICENSE /opt/apache/beam/ #8 DONE 0.1s #9 [5/7] COPY target/NOTICE /opt/apache/beam/ #9 DONE 0.1s #10 [6/7] COPY target/go-licenses/* /opt/apache/beam/third_party_licenses/golang/ #10 DONE 0.1s #11 [7/7] RUN if [ "false" = "false" ] ; then rm -rf /opt/apache/beam/third_party_licenses ; fi #11 DONE 0.7s #12 exporting to image #12 exporting layers #12 exporting layers 0.2s done #12 writing image sha256:09ddbe6fac1d11b7f8bd60865972cc91a06920675e590a5343875273d0fe414f done #12 naming to docker.io/apache/beam_go_sdk:dev done #12 DONE 0.2s Deprecated Gradle features were used in this build, making it incompatible with Gradle 9.0. You can use '--warning-mode all' to show the individual deprecation warnings and determine if they come from your own scripts or plugins. For more on this, please refer to https://docs.gradle.org/8.3/userguide/command_line_interface.html#sec:command_line_warnings in the Gradle documentation. BUILD SUCCESSFUL in 44s 10 actionable tasks: 5 executed, 5 up-to-date Publishing build scan... https://ge.apache.org/s/jcjbb4y5i5ftq $ CONTAINER=apache/beam_go_sdk $ cd sdks/go >>> RUNNING spark integration tests with pipeline options: -p 1 -v -timeout 3h >>> --runner=spark --project=apache-beam-testing --region=us-central1 >>> --environment_type=DOCKER --environment_config=apache/beam_go_sdk:dev >>> --staging_location=gs://temp-storage-for-end-to-end-tests/staging-validatesrunner-test/test14556 >>> >>> --temp_location=gs://temp-storage-for-end-to-end-tests/temp-validatesrunner-test/test14556 >>> --endpoint=localhost:33867 >>> --expansion_jar=test:<https://ci-beam.apache.org/job/beam_PostCommit_Go_VR_Spark/ws/src/sdks/java/testing/expansion-service/build/libs/beam-sdks-java-testing-expansion-service-testExpansionService-2.52.0-SNAPSHOT.jar> $ System Go installation: /snap/bin/go is go version go1.16.15 linux/amd64; Preparing to use /home/jenkins/go/bin/go1.21.0 go1.21.0: already downloaded in /home/jenkins/sdk/go1.21.0 /home/jenkins/go/bin/go1.21.0 test -v ./test/integration/... ./test/regression -p 1 -v -timeout 3h --runner=spark --project=apache-beam-testing --region=us-central1 --environment_type=DOCKER --environment_config=apache/beam_go_sdk:dev --staging_location=gs://temp-storage-for-end-to-end-tests/staging-validatesrunner-test/test14556 --temp_location=gs://temp-storage-for-end-to-end-tests/temp-validatesrunner-test/test14556 --endpoint=localhost:33867 --expansion_jar=test:<https://ci-beam.apache.org/job/beam_PostCommit_Go_VR_Spark/ws/src/sdks/java/testing/expansion-service/build/libs/beam-sdks-java-testing-expansion-service-testExpansionService-2.52.0-SNAPSHOT.jar> go: downloading cloud.google.com/go/bigquery v1.56.0 # github.com/apache/beam/sdks/v2/go/test/integration [github.com/apache/beam/sdks/v2/go/test/integration.test] test/integration/integration.go:41:2: "os" imported and not used FAIL github.com/apache/beam/sdks/v2/go/test/integration [build failed] ? github.com/apache/beam/sdks/v2/go/test/integration/internal/containers [no test files] ? github.com/apache/beam/sdks/v2/go/test/integration/internal/jars [no test files] ? github.com/apache/beam/sdks/v2/go/test/integration/internal/ports [no test files] # github.com/apache/beam/sdks/v2/go/test/integration test/integration/integration.go:41:2: "os" imported and not used FAIL github.com/apache/beam/sdks/v2/go/test/integration/io/bigqueryio [build failed] FAIL github.com/apache/beam/sdks/v2/go/test/integration/io/fhirio [build failed] FAIL github.com/apache/beam/sdks/v2/go/test/integration/io/mongodbio [build failed] FAIL github.com/apache/beam/sdks/v2/go/test/integration/io/spannerio [build failed] FAIL github.com/apache/beam/sdks/v2/go/test/integration/io/xlang/bigquery [build failed] FAIL github.com/apache/beam/sdks/v2/go/test/integration/io/xlang/bigtable [build failed] FAIL github.com/apache/beam/sdks/v2/go/test/integration/io/xlang/debezium [build failed] FAIL github.com/apache/beam/sdks/v2/go/test/integration/io/xlang/jdbc [build failed] FAIL github.com/apache/beam/sdks/v2/go/test/integration/io/xlang/kafka [build failed] FAIL github.com/apache/beam/sdks/v2/go/test/integration/primitives [build failed] FAIL github.com/apache/beam/sdks/v2/go/test/integration/synthetic [build failed] FAIL github.com/apache/beam/sdks/v2/go/test/integration/transforms/xlang/dataframe [build failed] FAIL github.com/apache/beam/sdks/v2/go/test/integration/transforms/xlang/inference [build failed] FAIL github.com/apache/beam/sdks/v2/go/test/integration/wordcount [build failed] FAIL github.com/apache/beam/sdks/v2/go/test/integration/xlang [build failed] FAIL github.com/apache/beam/sdks/v2/go/test/regression [build failed] FAIL $ TEST_EXIT_CODE=0 $ cd ../.. $ rm -rf /tmp/tmp.llZPfKYfcx $ exit 1 $ exit 1 > Task :sdks:go:test:sparkValidatesRunner FAILED FAILURE: Build failed with an exception. * Where: Build file '<https://ci-beam.apache.org/job/beam_PostCommit_Go_VR_Spark/ws/src/sdks/go/test/build.gradle'> line: 133 * What went wrong: Execution failed for task ':sdks:go:test:sparkValidatesRunner'. > Process 'command 'sh'' finished with non-zero exit value 1 * Try: > Run with --stacktrace option to get the stack trace. > Run with --info or --debug option to get more log output. > Get more help at https://help.gradle.org. Deprecated Gradle features were used in this build, making it incompatible with Gradle 9.0. You can use '--warning-mode all' to show the individual deprecation warnings and determine if they come from your own scripts or plugins. For more on this, please refer to https://docs.gradle.org/8.3/userguide/command_line_interface.html#sec:command_line_warnings in the Gradle documentation. BUILD FAILED in 6m 4s 116 actionable tasks: 75 executed, 39 from cache, 2 up-to-date Publishing build scan... https://ge.apache.org/s/kbfnqpsgicmy2 Build step 'Invoke Gradle script' changed build result to FAILURE Build step 'Invoke Gradle script' marked build as failure --------------------------------------------------------------------- To unsubscribe, e-mail: [email protected] For additional commands, e-mail: [email protected]
