See <https://ci-beam.apache.org/job/beam_PostCommit_XVR_Direct/2171/display/redirect?page=changes>
Changes: [mmack] [BEAM-13243][BEAM-8374] Add support for missing PublishResponse fields [mmack] [adhoc] Run spotlessApply on java examples to fix master [noreply] [BEAM-13628] Update SideInputCache to use full Transform and ------------------------------------------ [...truncated 107.07 KB...] Downloading google_cloud_dlp-3.4.0-py2.py3-none-any.whl (110 kB) Collecting google-cloud-language==1.3.0 Downloading google_cloud_language-1.3.0-py2.py3-none-any.whl (83 kB) Collecting google-cloud-profiler==3.0.6 Downloading google-cloud-profiler-3.0.6.tar.gz (33 kB) Collecting google-cloud-pubsub==2.9.0 Downloading google_cloud_pubsub-2.9.0-py2.py3-none-any.whl (219 kB) Collecting google-cloud-pubsublite==1.2.0 Downloading google_cloud_pubsublite-1.2.0-py2.py3-none-any.whl (252 kB) Collecting google-cloud-recommendations-ai==0.2.0 Downloading google_cloud_recommendations_ai-0.2.0-py2.py3-none-any.whl (180 kB) Collecting google-cloud-spanner==1.19.1 Downloading google_cloud_spanner-1.19.1-py2.py3-none-any.whl (255 kB) Collecting google-cloud-videointelligence==1.16.1 Downloading google_cloud_videointelligence-1.16.1-py2.py3-none-any.whl (183 kB) Collecting google-cloud-vision==1.0.0 Downloading google_cloud_vision-1.0.0-py2.py3-none-any.whl (435 kB) Collecting google-crc32c==1.3.0 Downloading google_crc32c-1.3.0-cp36-cp36m-manylinux_2_12_x86_64.manylinux2010_x86_64.whl (37 kB) Collecting google-pasta==0.2.0 Downloading google_pasta-0.2.0-py3-none-any.whl (57 kB) Collecting google-python-cloud-debugger==2.18 Downloading google_python_cloud_debugger-2.18-cp36-cp36m-manylinux_2_5_x86_64.manylinux1_x86_64.whl (769 kB) Collecting google-resumable-media==2.1.0 Downloading google_resumable_media-2.1.0-py2.py3-none-any.whl (75 kB) Collecting googleapis-common-protos==1.54.0 Downloading googleapis_common_protos-1.54.0-py2.py3-none-any.whl (207 kB) Collecting greenlet==1.1.2 Downloading greenlet-1.1.2-cp36-cp36m-manylinux_2_17_x86_64.manylinux2014_x86_64.whl (147 kB) Collecting grpc-google-iam-v1==0.12.3 Downloading grpc-google-iam-v1-0.12.3.tar.gz (13 kB) Collecting grpcio==1.43.0 Downloading grpcio-1.43.0-cp36-cp36m-manylinux_2_17_x86_64.manylinux2014_x86_64.whl (4.1 MB) Collecting grpcio-gcp==0.2.2 Downloading grpcio_gcp-0.2.2-py2.py3-none-any.whl (9.4 kB) Collecting grpcio-status==1.43.0 Downloading grpcio_status-1.43.0-py3-none-any.whl (10.0 kB) Collecting guppy3==3.1.2 Downloading guppy3-3.1.2-cp36-cp36m-manylinux_2_5_x86_64.manylinux1_x86_64.manylinux_2_12_x86_64.manylinux2010_x86_64.whl (606 kB) Collecting h5py==3.1.0 Downloading h5py-3.1.0-cp36-cp36m-manylinux1_x86_64.whl (4.0 MB) Collecting hdfs==2.6.0 Downloading hdfs-2.6.0-py3-none-any.whl (33 kB) Collecting httplib2==0.19.1 Downloading httplib2-0.19.1-py3-none-any.whl (95 kB) Collecting idna==3.3 Downloading idna-3.3-py3-none-any.whl (61 kB) Collecting importlib-metadata==4.8.3 Downloading importlib_metadata-4.8.3-py3-none-any.whl (17 kB) Collecting joblib==1.1.0 Downloading joblib-1.1.0-py2.py3-none-any.whl (306 kB) Collecting keras==2.6.0 Downloading keras-2.6.0-py2.py3-none-any.whl (1.3 MB) Collecting Keras-Preprocessing==1.1.2 Downloading Keras_Preprocessing-1.1.2-py2.py3-none-any.whl (42 kB) Collecting libcst==0.3.23 Downloading libcst-0.3.23-py3-none-any.whl (517 kB) Collecting Markdown==3.3.6 Downloading Markdown-3.3.6-py3-none-any.whl (97 kB) Collecting mmh3==3.0.0 Downloading mmh3-3.0.0-cp36-cp36m-manylinux2010_x86_64.whl (49 kB) Collecting mock==2.0.0 Downloading mock-2.0.0-py2.py3-none-any.whl (56 kB) Collecting more-itertools==8.12.0 Downloading more_itertools-8.12.0-py3-none-any.whl (54 kB) Collecting mypy-extensions==0.4.3 Downloading mypy_extensions-0.4.3-py2.py3-none-any.whl (4.5 kB) Collecting nltk==3.6.7 Downloading nltk-3.6.7-py3-none-any.whl (1.5 MB) Collecting nose==1.3.7 Downloading nose-1.3.7-py3-none-any.whl (154 kB) Collecting numpy==1.19.5 Downloading numpy-1.19.5-cp36-cp36m-manylinux2010_x86_64.whl (14.8 MB) Collecting oauth2client==4.1.3 Downloading oauth2client-4.1.3-py2.py3-none-any.whl (98 kB) Collecting oauthlib==3.1.1 Downloading oauthlib-3.1.1-py2.py3-none-any.whl (146 kB) Collecting opt-einsum==3.3.0 Downloading opt_einsum-3.3.0-py3-none-any.whl (65 kB) Collecting orjson==3.6.1 Downloading orjson-3.6.1-cp36-cp36m-manylinux_2_24_x86_64.whl (233 kB) Collecting overrides==6.1.0 Downloading overrides-6.1.0-py3-none-any.whl (14 kB) Collecting packaging==21.3 Downloading packaging-21.3-py3-none-any.whl (40 kB) Collecting pandas==1.1.5 Downloading pandas-1.1.5-cp36-cp36m-manylinux1_x86_64.whl (9.5 MB) > Task :sdks:python:test-suites:direct:xlang:validatesCrossLanguageRunnerSetup > Task > :sdks:python:test-suites:direct:xlang:validatesCrossLanguageRunnerGoUsingJava Jan 11, 2022 6:40:29 PM org.apache.beam.sdk.expansion.service.ExpansionService loadRegisteredTransforms INFO: Registering external transforms: [beam:transform:org.apache.beam:kafka_read_with_metadata:v1, beam:transform:org.apache.beam:kafka_read_without_metadata:v1, beam:transform:org.apache.beam:kafka_write:v1, beam:external:java:generate_sequence:v1] go1.16.12: already downloaded in /home/jenkins/sdk/go1.16.12 go1.16.12: already downloaded in /home/jenkins/sdk/go1.16.12 System Go installation: /usr/bin/go is go version go1.16.12 linux/amd64; Preparing to use /home/jenkins/go/bin/go1.16.12 go1.16.12: already downloaded in /home/jenkins/sdk/go1.16.12 /home/jenkins/go/bin/go1.16.12 test -v ./test/integration/xlang ./test/integration/io/xlang/... -p 3 -timeout 2h --runner=portable --project=apache-beam-testing --region=us-central1 --environment_type=DOCKER --environment_config=apache/beam_go_sdk:dev --staging_location=gs://temp-storage-for-end-to-end-tests/staging-validatesrunner-test --temp_location=gs://temp-storage-for-end-to-end-tests/temp-validatesrunner-test --dataflow_worker_jar= --endpoint=localhost:45879 --test_expansion_addr=localhost:33303 --io_expansion_addr=localhost:57459 --kafka_jar=<https://ci-beam.apache.org/job/beam_PostCommit_XVR_Direct/ws/src/sdks/java/testing/kafka-service/build/libs/beam-sdks-java-testing-kafka-service-testKafkaService-2.37.0-SNAPSHOT.jar> === RUN TestAutomatedExpansionService --- PASS: TestAutomatedExpansionService (2.51s) === RUN TestXLang_Prefix --- FAIL: TestXLang_Prefix (0.00s) panic: tried cross-language for beam:transforms:xlang:test:prefix against localhost:33303 and failed expanding external transform expanding transform with ExpansionRequest: components:{pcollections:{key:"n2" value:{unique_name:"n2" coder_id:"c0@nidWJtKbxc" is_bounded:BOUNDED windowing_strategy_id:"w0@nidWJtKbxc"}} windowing_strategies:{key:"w0@nidWJtKbxc" value:{window_fn:{urn:"beam:window_fn:global_windows:v1"} merge_status:NON_MERGING window_coder_id:"c1@nidWJtKbxc" trigger:{default:{}} accumulation_mode:DISCARDING output_time:END_OF_WINDOW closing_behavior:EMIT_IF_NONEMPTY OnTimeBehavior:FIRE_IF_NONEMPTY environment_id:"go"}} coders:{key:"c0@nidWJtKbxc" value:{spec:{urn:"beam:coder:string_utf8:v1"}}} coders:{key:"c1@nidWJtKbxc" value:{spec:{urn:"beam:coder:global_window:v1"}}} environments:{key:"go" value:{}}} transform:{unique_name:"External" spec:{urn:"beam:transforms:xlang:test:prefix" payload:"\n2\n\n\n\x04Data\x1a\x02\x10\x07\x12$1adc2c3d-0e8c-4642-8c37-130fbd2c034f\x12\n\x01\x00\x07prefix_"} inputs:{key:"i0" value:"n2"} environment_id:"go"} namespace:"nidWJtKbxc" expansion failed caused by: rpc error: code = Unavailable desc = connection closed [recovered] panic: tried cross-language for beam:transforms:xlang:test:prefix against localhost:33303 and failed expanding external transform expanding transform with ExpansionRequest: components:{pcollections:{key:"n2" value:{unique_name:"n2" coder_id:"c0@nidWJtKbxc" is_bounded:BOUNDED windowing_strategy_id:"w0@nidWJtKbxc"}} windowing_strategies:{key:"w0@nidWJtKbxc" value:{window_fn:{urn:"beam:window_fn:global_windows:v1"} merge_status:NON_MERGING window_coder_id:"c1@nidWJtKbxc" trigger:{default:{}} accumulation_mode:DISCARDING output_time:END_OF_WINDOW closing_behavior:EMIT_IF_NONEMPTY OnTimeBehavior:FIRE_IF_NONEMPTY environment_id:"go"}} coders:{key:"c0@nidWJtKbxc" value:{spec:{urn:"beam:coder:string_utf8:v1"}}} coders:{key:"c1@nidWJtKbxc" value:{spec:{urn:"beam:coder:global_window:v1"}}} environments:{key:"go" value:{}}} transform:{unique_name:"External" spec:{urn:"beam:transforms:xlang:test:prefix" payload:"\n2\n\n\n\x04Data\x1a\x02\x10\x07\x12$1adc2c3d-0e8c-4642-8c37-130fbd2c034f\x12\n\x01\x00\x07prefix_"} inputs:{key:"i0" value:"n2"} environment_id:"go"} namespace:"nidWJtKbxc" expansion failed caused by: rpc error: code = Unavailable desc = connection closed goroutine 56 [running]: testing.tRunner.func1.2(0xcc53e0, 0xc0000a0cc0) /home/jenkins/sdk/go1.16.12/src/testing/testing.go:1143 +0x332 testing.tRunner.func1(0xc000103080) /home/jenkins/sdk/go1.16.12/src/testing/testing.go:1146 +0x4b6 panic(0xcc53e0, 0xc0000a0cc0) /home/jenkins/sdk/go1.16.12/src/runtime/panic.go:965 +0x1b9 github.com/apache/beam/sdks/v2/go/pkg/beam.CrossLanguage(0xc0001c49e0, 0xc0005484b0, 0xdd4e8c, 0x21, 0xc000130640, 0x40, 0x40, 0x7ffdf969f4be, 0xf, 0xc0001bbc80, ...) <https://ci-beam.apache.org/job/beam_PostCommit_XVR_Direct/ws/src/sdks/go/pkg/beam/xlang.go>:162 +0x1f7 github.com/apache/beam/sdks/v2/go/examples/xlang.Prefix(0xc0001c4920, 0xc0005484b0, 0xdbf17e, 0x7, 0x7ffdf969f4be, 0xf, 0xc0006ecc60, 0x0) <https://ci-beam.apache.org/job/beam_PostCommit_XVR_Direct/ws/src/sdks/go/examples/xlang/transforms.go>:52 +0x3ab github.com/apache/beam/sdks/v2/go/test/integration/xlang.TestXLang_Prefix(0xc000103080) <https://ci-beam.apache.org/job/beam_PostCommit_XVR_Direct/ws/src/sdks/go/test/integration/xlang/xlang_test.go>:124 +0x1d4 testing.tRunner(0xc000103080, 0xdf85d0) /home/jenkins/sdk/go1.16.12/src/testing/testing.go:1193 +0xef created by testing.(*T).Run /home/jenkins/sdk/go1.16.12/src/testing/testing.go:1238 +0x2b3 FAIL github.com/apache/beam/sdks/v2/go/test/integration/xlang 2.568s === RUN TestKafkaIO_BasicReadWrite integration.go:181: Test TestKafkaIO_BasicReadWrite is currently filtered for runner portable --- SKIP: TestKafkaIO_BasicReadWrite (0.00s) PASS ok github.com/apache/beam/sdks/v2/go/test/integration/io/xlang/kafka 3.033s FAIL > Task > :sdks:python:test-suites:direct:xlang:validatesCrossLanguageRunnerGoUsingJava > FAILED > Task > :sdks:python:test-suites:direct:xlang:validatesCrossLanguageRunnerJavaUsingJava > Task > :sdks:python:test-suites:direct:xlang:validatesCrossLanguageRunnerJavaUsingPython > Task > :sdks:python:test-suites:direct:xlang:validatesCrossLanguageRunnerJavaUsingPythonOnly > Task > :sdks:python:test-suites:direct:xlang:validatesCrossLanguageRunnerPythonUsingJava > Task > :sdks:python:test-suites:direct:xlang:validatesCrossLanguageRunnerPythonUsingJava > FAILED > Task > :sdks:python:test-suites:direct:xlang:validatesCrossLanguageRunnerPythonUsingPython > Task > :sdks:python:test-suites:direct:xlang:validatesCrossLanguageRunnerPythonUsingSql > Task > :sdks:python:test-suites:direct:xlang:validatesCrossLanguageRunnerJavaUsingJava org.apache.beam.runners.core.construction.ValidateRunnerXlangTest > combineGloballyTest FAILED org.apache.beam.vendor.grpc.v1p36p0.io.grpc.StatusRuntimeException at ValidateRunnerXlangTest.java:257 java.lang.NullPointerException at ValidateRunnerXlangTest.java:123 org.apache.beam.runners.core.construction.ValidateRunnerXlangTest > partitionTest FAILED org.apache.beam.vendor.grpc.v1p36p0.io.grpc.StatusRuntimeException at ValidateRunnerXlangTest.java:314 java.lang.NullPointerException at ValidateRunnerXlangTest.java:123 org.apache.beam.runners.core.construction.ValidateRunnerXlangTest > coGroupByKeyTest FAILED org.apache.beam.vendor.grpc.v1p36p0.io.grpc.StatusRuntimeException at ValidateRunnerXlangTest.java:230 java.lang.NullPointerException at ValidateRunnerXlangTest.java:123 org.apache.beam.runners.core.construction.ValidateRunnerXlangTest > groupByKeyTest FAILED org.apache.beam.vendor.grpc.v1p36p0.io.grpc.StatusRuntimeException at ValidateRunnerXlangTest.java:198 java.lang.NullPointerException at ValidateRunnerXlangTest.java:123 org.apache.beam.runners.core.construction.ValidateRunnerXlangTest > combinePerKeyTest FAILED org.apache.beam.vendor.grpc.v1p36p0.io.grpc.StatusRuntimeException at ValidateRunnerXlangTest.java:275 java.lang.NullPointerException at ValidateRunnerXlangTest.java:123 org.apache.beam.runners.core.construction.ValidateRunnerXlangTest > flattenTest FAILED org.apache.beam.vendor.grpc.v1p36p0.io.grpc.StatusRuntimeException at ValidateRunnerXlangTest.java:295 java.lang.NullPointerException at ValidateRunnerXlangTest.java:123 org.apache.beam.runners.core.construction.ValidateRunnerXlangTest > singleInputOutputTest FAILED org.apache.beam.vendor.grpc.v1p36p0.io.grpc.StatusRuntimeException at ValidateRunnerXlangTest.java:156 java.lang.NullPointerException at ValidateRunnerXlangTest.java:123 org.apache.beam.runners.core.construction.ValidateRunnerXlangTest > multiInputOutputWithSideInputTest FAILED org.apache.beam.vendor.grpc.v1p36p0.io.grpc.StatusRuntimeException at ValidateRunnerXlangTest.java:178 java.lang.NullPointerException at ValidateRunnerXlangTest.java:123 8 tests completed, 8 failed > Task > :sdks:python:test-suites:direct:xlang:validatesCrossLanguageRunnerJavaUsingJava > FAILED > Task :sdks:python:test-suites:direct:xlang:validatesCrossLanguageRunnerCleanup > Task :sdks:python:test-suites:direct:xlang:fnApiJobServerCleanup FAILURE: Build completed with 3 failures. 1: Task failed with an exception. ----------- * Where: Build file '<https://ci-beam.apache.org/job/beam_PostCommit_XVR_Direct/ws/src/sdks/go/test/build.gradle'> line: 170 * What went wrong: Execution failed for task ':sdks:python:test-suites:direct:xlang:validatesCrossLanguageRunnerGoUsingJava'. > Process 'command 'sh'' finished with non-zero exit value 1 * Try: > Run with --stacktrace option to get the stack trace. > Run with --info or --debug option to get more log output. > Run with --scan to get full insights. ============================================================================== 2: Task failed with an exception. ----------- * What went wrong: Execution failed for task ':sdks:python:test-suites:direct:xlang:validatesCrossLanguageRunnerPythonUsingJava'. > Process 'command 'sh'' finished with non-zero exit value 1 * Try: > Run with --stacktrace option to get the stack trace. > Run with --info or --debug option to get more log output. > Run with --scan to get full insights. ============================================================================== 3: Task failed with an exception. ----------- * What went wrong: Execution failed for task ':sdks:python:test-suites:direct:xlang:validatesCrossLanguageRunnerJavaUsingJava'. > There were failing tests. See the report at: > file://<https://ci-beam.apache.org/job/beam_PostCommit_XVR_Direct/ws/src/sdks/python/test-suites/direct/xlang/build/reports/tests/validatesCrossLanguageRunnerJavaUsingJava/index.html> * Try: > Run with --stacktrace option to get the stack trace. > Run with --info or --debug option to get more log output. > Run with --scan to get full insights. ============================================================================== * Get more help at https://help.gradle.org Deprecated Gradle features were used in this build, making it incompatible with Gradle 8.0. You can use '--warning-mode all' to show the individual deprecation warnings and determine if they come from your own scripts or plugins. See https://docs.gradle.org/7.3.2/userguide/command_line_interface.html#sec:command_line_warnings Execution optimizations have been disabled for 1 invalid unit(s) of work during this build to ensure correctness. Please consult deprecation warnings for more details. BUILD FAILED in 51m 29s 200 actionable tasks: 149 executed, 43 from cache, 8 up-to-date Publishing build scan... https://gradle.com/s/6okwow3iptt4w Build step 'Invoke Gradle script' changed build result to FAILURE Build step 'Invoke Gradle script' marked build as failure --------------------------------------------------------------------- To unsubscribe, e-mail: [email protected] For additional commands, e-mail: [email protected]
