See <https://ci-beam.apache.org/job/beam_PostCommit_Go_VR_Flink/5391/display/redirect?page=changes>
Changes: [noreply] Merge pull request #15753 from [BEAM-13080] Add option in Reshuffle to ------------------------------------------ [...truncated 66.33 KB...] Also creating executable in <https://ci-beam.apache.org/job/beam_PostCommit_Go_VR_Flink/ws/src/sdks/java/container/build/virtualenv/bin/python> Installing setuptools, pip, wheel... done. DEPRECATION: Python 3.5 reached the end of its life on September 13th, 2020. Please upgrade your Python as Python 3.5 is no longer maintained. pip 21.0 will drop support for Python 3.5 in January 2021. pip 21.0 will remove support for this functionality. Collecting beautifulsoup4<5.0,>=4.9.0 Using cached beautifulsoup4-4.10.0-py3-none-any.whl (97 kB) Collecting future<1.0.0,>=0.16.0 Using cached future-0.18.2-py3-none-any.whl Collecting pyyaml<6.0.0,>=3.12 Using cached PyYAML-5.3.1-cp35-cp35m-linux_x86_64.whl Collecting tenacity<6.0,>=5.0.2 Using cached tenacity-5.1.5-py2.py3-none-any.whl (34 kB) Collecting soupsieve>1.2 Using cached soupsieve-2.1-py3-none-any.whl (32 kB) Collecting six>=1.9.0 Using cached six-1.16.0-py2.py3-none-any.whl (11 kB) Installing collected packages: soupsieve, six, tenacity, pyyaml, future, beautifulsoup4 Successfully installed beautifulsoup4-4.10.0 future-0.18.2 pyyaml-5.3.1 six-1.16.0 soupsieve-2.1 tenacity-5.1.5 Executing <https://ci-beam.apache.org/job/beam_PostCommit_Go_VR_Flink/ws/src/sdks/java/container/build/virtualenv/bin/python> <https://ci-beam.apache.org/job/beam_PostCommit_Go_VR_Flink/ws/src/sdks/java/container/license_scripts/pull_licenses_java.py> --license_index=<https://ci-beam.apache.org/job/beam_PostCommit_Go_VR_Flink/ws/src/sdks/java/container/build/reports/dependency-license/index.json> --output_dir=<https://ci-beam.apache.org/job/beam_PostCommit_Go_VR_Flink/ws/src/sdks/java/container/build/target/java_third_party_licenses> --dep_url_yaml=<https://ci-beam.apache.org/job/beam_PostCommit_Go_VR_Flink/ws/src/sdks/java/container/license_scripts/dep_urls_java.yaml> INFO:root:Pulling license for 208 dependencies using 16 threads. INFO:root:pull_licenses_java.py succeed. It took 4.735909 seconds with 16 threads. Copying licenses from <https://ci-beam.apache.org/job/beam_PostCommit_Go_VR_Flink/ws/src/sdks/java/container/build/target/java_third_party_licenses> to <https://ci-beam.apache.org/job/beam_PostCommit_Go_VR_Flink/ws/src/sdks/java/container/build/target/third_party_licenses.> Finished license_scripts.sh > Task :runners:flink:1.13:job-server:shadowJar FROM-CACHE > Task :sdks:java:container:java11:copyJavaThirdPartyLicenses > Task :sdks:java:container:java8:copyJavaThirdPartyLicenses > Task :release:go-licenses:go:dockerRun + go-licenses save github.com/apache/beam/sdks/go/container --save_path=/output/licenses + go-licenses csv github.com/apache/beam/sdks/go/container + tee /output/licenses/list.csv > Task :release:go-licenses:java:dockerRun + go-licenses save github.com/apache/beam/sdks/java/container --save_path=/output/licenses > Task :release:go-licenses:go:dockerRun google.golang.org/protobuf,https://go.googlesource.com/protobuf/+/refs/heads/master/LICENSE,BSD-3-Clause google.golang.org/genproto/googleapis/rpc/status,https://github.com/googleapis/go-genproto/blob/master/LICENSE,Apache-2.0 golang.org/x/sys,https://go.googlesource.com/sys/+/refs/heads/master/LICENSE,BSD-3-Clause golang.org/x/text,https://go.googlesource.com/text/+/refs/heads/master/LICENSE,BSD-3-Clause github.com/apache/beam/sdks/go,https://github.com/apache/beam/blob/master/sdks/go/README.md,Apache-2.0 google.golang.org/grpc,https://github.com/grpc/grpc-go/blob/master/LICENSE,Apache-2.0 golang.org/x/net,https://go.googlesource.com/net/+/refs/heads/master/LICENSE,BSD-3-Clause github.com/golang/protobuf,https://github.com/golang/protobuf/blob/master/LICENSE,BSD-3-Clause + chmod -R a+w /output/licenses > Task :release:go-licenses:go:createLicenses > Task :sdks:go:container:copyGolangLicenses > Task :sdks:go:container:dockerPrepare > Task :release:go-licenses:java:dockerRun + tee /output/licenses/list.csv + go-licenses csv github.com/apache/beam/sdks/java/container + chmod -R a+w /output/licenses > Task :release:go-licenses:java:createLicenses > Task :sdks:java:container:java11:copyGolangLicenses > Task :sdks:java:container:java8:copyGolangLicenses > Task :sdks:go:container:docker 137 added, 0 removed; done. Processing triggers for libc-bin (2.28-10) ... Processing triggers for ca-certificates (20200601~deb10u2) ... Updating certificates in /etc/ssl/certs... > Task :sdks:java:container:java11:dockerPrepare > Task :sdks:java:container:java8:dockerPrepare > Task :sdks:java:container:java11:docker ---> 2ef0c679856e Step 15/18 : RUN rm /opt/apache/beam/third_party_licenses/golang/LICENSE ---> Running in 1faaa9343a2e Removing intermediate container 1faaa9343a2e ---> b73e7aa6d819 Step 16/18 : RUN if [ "${pull_licenses}" = "false" ] ; then rm -rf /opt/apache/beam/third_party_licenses ; fi ---> Running in c9746a2173ea Removing intermediate container c9746a2173ea ---> 3dd4b989b62e Step 17/18 : COPY target/profiler/* /opt/google_cloud_profiler/ ---> b4078a65bdcf Step 18/18 : ENTRYPOINT ["/opt/apache/beam/boot"] ---> Running in e684f36e1eef Removing intermediate container e684f36e1eef ---> ff67d8b09b30 > Task :sdks:java:container:java8:docker ---> Running in 346fb6867522 Removing intermediate container 346fb6867522 ---> 129860ebc471 Step 16/18 : RUN if [ "${pull_licenses}" = "false" ] ; then rm -rf /opt/apache/beam/third_party_licenses ; fi ---> Running in 99b9b75aa4b9 Removing intermediate container 99b9b75aa4b9 ---> 30b4fe79da96 Step 17/18 : COPY target/profiler/* /opt/google_cloud_profiler/ ---> e85c1c618f27 Step 18/18 : ENTRYPOINT ["/opt/apache/beam/boot"] ---> Running in 96db2c1e30ad Removing intermediate container 96db2c1e30ad ---> 8511f05702ca Successfully built 8511f05702ca Successfully tagged apache/beam_java8_sdk:2.35.0.dev > Task :sdks:go:test:flinkValidatesRunner $ TESTS=./test/integration/... ./test/regression $ RUNNER=portable $ TIMEOUT=2h $ SIMULTANEOUS=3 $ GCS_LOCATION=gs://temp-storage-for-end-to-end-tests $ PROJECT=apache-beam-testing $ DATAFLOW_PROJECT=apache-beam-testing $ REGION=us-central1 $ trap exit_background_processes SIGINT SIGTERM EXIT $ key=--runner $ case --runner in $ RUNNER=flink $ key=--flink_job_server_jar $ case --flink_job_server_jar in $ FLINK_JOB_SERVER_JAR=<https://ci-beam.apache.org/job/beam_PostCommit_Go_VR_Flink/ws/src/runners/flink/1.13/job-server/build/libs/beam-runners-flink-1.13-job-server-2.35.0-SNAPSHOT.jar> $ key=--test_expansion_jar $ case --test_expansion_jar in $ TEST_EXPANSION_JAR=<https://ci-beam.apache.org/job/beam_PostCommit_Go_VR_Flink/ws/src/sdks/java/testing/expansion-service/build/libs/beam-sdks-java-testing-expansion-service-testExpansionService-2.35.0-SNAPSHOT.jar> $ cd <https://ci-beam.apache.org/job/beam_PostCommit_Go_VR_Flink/ws/src> $ test -d sdks/go/test $ JOB_PORT=35269 $ ENDPOINT=localhost:57081 No endpoint specified; starting a new flink job server on localhost:57081 $ java -jar <https://ci-beam.apache.org/job/beam_PostCommit_Go_VR_Flink/ws/src/runners/flink/1.13/job-server/build/libs/beam-runners-flink-1.13-job-server-2.35.0-SNAPSHOT.jar> --flink-master [local] --job-port 57081 --expansion-port 0 --artifact-port 0 $ JOBSERVER_PID=14089 $ EXPANSION_PORT=42687 $ TEST_EXPANSION_ADDR=localhost:56565 No test expansion address specified; starting a new test expansion server on localhost:56565 $ java -jar <https://ci-beam.apache.org/job/beam_PostCommit_Go_VR_Flink/ws/src/sdks/java/testing/expansion-service/build/libs/beam-sdks-java-testing-expansion-service-testExpansionService-2.35.0-SNAPSHOT.jar> 56565 $ TEST_EXPANSION_PID=14134 $ SIMULTANEOUS=1 $ TAG=dev $ ./gradlew :sdks:go:container:docker -Pdocker-tag=dev Starting expansion service at localhost:56565 Starting a Gradle Daemon, 4 busy Daemons could not be reused, use --status for details Oct 31, 2021 12:06:05 AM org.apache.beam.sdk.expansion.service.ExpansionService loadRegisteredTransforms beam:transforms:xlang:test:cgbk: org.apache.beam.sdk.testing.expansion.TestExpansionService$TestServiceRegistrar$TestCoGroupByKeyTransformProvider@1aafa419 INFO: Registering external transforms: [beam:transforms:xlang:test:cgbk, beam:transforms:xlang:test:flatten, beam:transforms:xlang:test:prefix, beam:transforms:xlang:test:multi, beam:transforms:xlang:test:gbk, beam:transforms:xlang:test:comgl, beam:transforms:xlang:test:compk, beam:transforms:xlang:count, beam:transforms:xlang:filter_less_than_eq, beam:transforms:xlang:test:partition, beam:transforms:xlang:test:parquet_write, beam:transforms:xlang:parquet_read, beam:transforms:xlang:textio_read, beam:external:java:generate_sequence:v1] beam:transforms:xlang:test:flatten: org.apache.beam.sdk.testing.expansion.TestExpansionService$TestServiceRegistrar$TestFlattenTransformProvider@47eaca72 beam:transforms:xlang:test:prefix: org.apache.beam.sdk.expansion.service.ExpansionService$ExternalTransformRegistrarLoader$1@55141def beam:transforms:xlang:test:multi: org.apache.beam.sdk.expansion.service.ExpansionService$ExternalTransformRegistrarLoader$1@55182842 beam:transforms:xlang:test:gbk: org.apache.beam.sdk.expansion.service.ExpansionService$ExternalTransformRegistrarLoader$1@3270d194 beam:transforms:xlang:test:comgl: org.apache.beam.sdk.expansion.service.ExpansionService$ExternalTransformRegistrarLoader$1@235834f2 beam:transforms:xlang:test:compk: org.apache.beam.sdk.expansion.service.ExpansionService$ExternalTransformRegistrarLoader$1@5656be13 beam:transforms:xlang:count: org.apache.beam.sdk.expansion.service.ExpansionService$ExternalTransformRegistrarLoader$1@4218d6a3 beam:transforms:xlang:filter_less_than_eq: org.apache.beam.sdk.expansion.service.ExpansionService$ExternalTransformRegistrarLoader$1@76505305 beam:transforms:xlang:test:partition: org.apache.beam.sdk.expansion.service.ExpansionService$ExternalTransformRegistrarLoader$1@14cd1699 beam:transforms:xlang:test:parquet_write: org.apache.beam.sdk.expansion.service.ExpansionService$ExternalTransformRegistrarLoader$1@77888435 beam:transforms:xlang:parquet_read: org.apache.beam.sdk.expansion.service.ExpansionService$ExternalTransformRegistrarLoader$1@73a1e9a9 beam:transforms:xlang:textio_read: org.apache.beam.sdk.expansion.service.ExpansionService$ExternalTransformRegistrarLoader$1@71d44a3 beam:external:java:generate_sequence:v1: org.apache.beam.sdk.expansion.service.ExpansionService$ExternalTransformRegistrarLoader$1@7b98f307 Oct 31, 2021 12:06:06 AM org.apache.beam.sdk.io.aws2.s3.DefaultS3ClientBuilderFactory createBuilder INFO: The AWS S3 Beam extension was included in this build, but the awsRegion flag was not specified. If you don't plan to use S3, then ignore this message. Oct 31, 2021 12:06:07 AM org.apache.beam.runners.jobsubmission.JobServerDriver createArtifactStagingService INFO: ArtifactStagingService started on localhost:46783 Oct 31, 2021 12:06:07 AM org.apache.beam.runners.jobsubmission.JobServerDriver createExpansionService INFO: Java ExpansionService started on localhost:34077 Oct 31, 2021 12:06:07 AM org.apache.beam.runners.jobsubmission.JobServerDriver createJobServer INFO: JobService started on localhost:57081 Oct 31, 2021 12:06:07 AM org.apache.beam.runners.jobsubmission.JobServerDriver run INFO: Job server now running, terminate with Ctrl+C > Task :buildSrc:compileJava NO-SOURCE > Task :buildSrc:compileGroovy UP-TO-DATE > Task :buildSrc:pluginDescriptors UP-TO-DATE > Task :buildSrc:processResources UP-TO-DATE > Task :buildSrc:classes UP-TO-DATE > Task :buildSrc:jar UP-TO-DATE > Task :buildSrc:assemble UP-TO-DATE > Task :buildSrc:spotlessGroovy UP-TO-DATE > Task :buildSrc:spotlessGroovyCheck UP-TO-DATE > Task :buildSrc:spotlessGroovyGradle UP-TO-DATE > Task :buildSrc:spotlessGroovyGradleCheck UP-TO-DATE > Task :buildSrc:spotlessCheck UP-TO-DATE > Task :buildSrc:pluginUnderTestMetadata UP-TO-DATE > Task :buildSrc:compileTestJava NO-SOURCE > Task :buildSrc:compileTestGroovy NO-SOURCE > Task :buildSrc:processTestResources NO-SOURCE > Task :buildSrc:testClasses UP-TO-DATE > Task :buildSrc:test NO-SOURCE > Task :buildSrc:validatePlugins UP-TO-DATE > Task :buildSrc:check UP-TO-DATE > Task :buildSrc:build UP-TO-DATE Configuration on demand is an incubating feature. > Task :sdks:go:container:copyLicenses UP-TO-DATE > Task :sdks:go:container:dockerClean > Task :sdks:go:container:goPrepare Use project GOPATH: <https://ci-beam.apache.org/job/beam_PostCommit_Go_VR_Flink/ws/src/sdks/go/container/.gogradle/project_gopath> > Task :sdks:go:container:resolveBuildDependencies SKIPPED > Task :sdks:go:container:installDependencies SKIPPED > Task :sdks:go:container:buildLinuxAmd64 UP-TO-DATE > Task :sdks:go:container:goBuild > Task :sdks:go:container:skipPullLicenses > Task :sdks:go:container:dockerPrepare > Task :sdks:go:container:docker Deprecated Gradle features were used in this build, making it incompatible with Gradle 7.0. Use '--warning-mode all' to show the individual deprecation warnings. See https://docs.gradle.org/6.9.1/userguide/command_line_interface.html#sec:command_line_warnings BUILD SUCCESSFUL in 39s 8 actionable tasks: 6 executed, 2 up-to-date Publishing build scan... https://gradle.com/s/yqhsvygqjcfi2 $ CONTAINER=apache/beam_go_sdk $ cd sdks/go >>> RUNNING flink integration tests with pipeline options: -p 1 -timeout 2h >>> --runner=flink --project=apache-beam-testing --region=us-central1 >>> --environment_type=DOCKER --environment_config=apache/beam_go_sdk:dev >>> --staging_location=gs://temp-storage-for-end-to-end-tests/staging-validatesrunner-test >>> >>> --temp_location=gs://temp-storage-for-end-to-end-tests/temp-validatesrunner-test >>> --dataflow_worker_jar= --endpoint=localhost:57081 >>> --test_expansion_addr=localhost:56565 $ ./run_validatesrunner_tests.sh: line 399: go: command not found $ TEST_EXIT_CODE=0 $ cd ../.. $ exit 127 $ exit 127 > Task :sdks:go:test:flinkValidatesRunner FAILED FAILURE: Build failed with an exception. * Where: Build file '<https://ci-beam.apache.org/job/beam_PostCommit_Go_VR_Flink/ws/src/sdks/go/test/build.gradle'> line: 106 * What went wrong: Execution failed for task ':sdks:go:test:flinkValidatesRunner'. > Process 'command 'sh'' finished with non-zero exit value 127 * Try: Run with --stacktrace option to get the stack trace. Run with --info or --debug option to get more log output. Run with --scan to get full insights. * Get more help at https://help.gradle.org Deprecated Gradle features were used in this build, making it incompatible with Gradle 7.0. Use '--warning-mode all' to show the individual deprecation warnings. See https://docs.gradle.org/6.9.1/userguide/command_line_interface.html#sec:command_line_warnings BUILD FAILED in 6m 14s 164 actionable tasks: 116 executed, 43 from cache, 5 up-to-date Publishing build scan... https://gradle.com/s/kwh2va6sk57pm Build step 'Invoke Gradle script' changed build result to FAILURE Build step 'Invoke Gradle script' marked build as failure --------------------------------------------------------------------- To unsubscribe, e-mail: [email protected] For additional commands, e-mail: [email protected]
