See
<https://ci-beam.apache.org/job/beam_PostCommit_XVR_Direct/3731/display/redirect?page=changes>
Changes:
[noreply] fix doc on bq sxtorage (#25353)
[noreply] [Playground] Fix Test_getRunOrTestCmd on Go 1.20 (#25379)
[noreply] Fix typo - metdata -> metadata (#25399)
[noreply] [prism] Initial commit for READMEs and go.mod (#25404)
[noreply] [prism] Add urns package (#25405)
[noreply] Add Two Counter Metric in BigQuery Write Schema Transform (#25155)
------------------------------------------
[...truncated 1.08 MB...]
type_payload:
"\nD/tmp/artifacts/dnsns-YTF3f6B-OG4FmXLRf2ckHBi4VJnspBZTyIQCz-6Spwk.jar\022@6131777fa07e386e059972d17f67241c18b85499eca41653c88402cfee92a709"
role_urn: "beam:artifact:role:staging_to:v1"
role_payload: "\n5dnsns-YTF3f6B-OG4FmXLRf2ckHBi4VJnspBZTyIQCz-6Spwk.jar"
>
dependencies: <
type_urn: "beam:artifact:type:file:v1"
type_payload:
"\n\203\001/tmp/artifacts/beam-sdks-java-extensions-schemaio-expansion-service-2.46.0-SNAPSHOT-DwH92z8588-gan1rT1S5iR10aHCc63SXaytQurDVluo.jar\022@0f01fddb3f39f3cfa06a7d6b4f54b9891d7468709ceb74976b2b50bab0d596ea"
role_urn: "beam:artifact:role:staging_to:v1"
role_payload:
"\ntbeam-sdks-java-extensions-schemaio-expansion-service-2.46.0-SNAPSHOT-DwH92z8588-gan1rT1S5iR10aHCc63SXaytQurDVluo.jar"
>
>
>
>
root_transform_ids: "e1"
root_transform_ids: "e2"
root_transform_ids: "s1"
2023/02/09 23:43:06 Cross-compiling
<https://ci-beam.apache.org/job/beam_PostCommit_XVR_Direct/ws/src/sdks/go/test/integration/io/xlang/jdbc/jdbc_test.go>
as /tmp/worker-2-1675986186946116987
2023/02/09 23:43:12 Prepared job with id:
go-testjdbcio_postgresreadwrite-421-1eb0479b-13b2-4151-8fa0-66c48e4550b9 and
staging token:
go-testjdbcio_postgresreadwrite-421-1eb0479b-13b2-4151-8fa0-66c48e4550b9
2023/02/09 23:43:13 Staged binary artifact with token:
2023/02/09 23:43:13 Submitted job:
go-testjdbcio_postgresreadwrite-421-1eb0479b-13b2-4151-8fa0-66c48e4550b9
2023/02/09 23:43:13 2023-02-09 23:43:13. (1): Default Python SDK image for
environment is apache/beam_python3.7_sdk:2.46.0.dev
2023/02/09 23:43:13 Job state: STOPPED
2023/02/09 23:43:13 Job state: STARTING
2023/02/09 23:43:13 Job state: RUNNING
2023/02/09 23:43:13 2023-02-09 23:43:13. (2): ==================== <function
annotate_downstream_side_inputs at 0x7fb821dc4e60> ====================
2023/02/09 23:43:13 2023-02-09 23:43:13. (3): ==================== <function
fix_side_input_pcoll_coders at 0x7fb821dc4f80> ====================
2023/02/09 23:43:13 2023-02-09 23:43:13. (4): ==================== <function
pack_combiners at 0x7fb821dc74d0> ====================
2023/02/09 23:43:13 2023-02-09 23:43:13. (5): ==================== <function
lift_combiners at 0x7fb821dc7560> ====================
2023/02/09 23:43:13 2023-02-09 23:43:13. (6): ==================== <function
expand_sdf at 0x7fb821dc7710> ====================
2023/02/09 23:43:13 2023-02-09 23:43:13. (7): ==================== <function
expand_gbk at 0x7fb821dc77a0> ====================
2023/02/09 23:43:13 2023-02-09 23:43:13. (8): ==================== <function
sink_flattens at 0x7fb821dc78c0> ====================
2023/02/09 23:43:13 2023-02-09 23:43:13. (9): ==================== <function
greedily_fuse at 0x7fb821dc7950> ====================
2023/02/09 23:43:13 2023-02-09 23:43:13. (10): ==================== <function
read_to_impulse at 0x7fb821dc79e0> ====================
2023/02/09 23:43:13 2023-02-09 23:43:13. (11): ==================== <function
impulse_to_input at 0x7fb821dc7a70> ====================
2023/02/09 23:43:13 2023-02-09 23:43:13. (12): ==================== <function
sort_stages at 0x7fb821dc7cb0> ====================
2023/02/09 23:43:13 2023-02-09 23:43:13. (13): ==================== <function
add_impulse_to_dangling_transforms at 0x7fb821dc7dd0> ====================
2023/02/09 23:43:13 2023-02-09 23:43:13. (14): ==================== <function
setup_timer_mapping at 0x7fb821dc7c20> ====================
2023/02/09 23:43:13 2023-02-09 23:43:13. (15): ==================== <function
populate_data_channel_coders at 0x7fb821dc7d40> ====================
2023/02/09 23:43:13 2023-02-09 23:43:13. (16): starting control server on port
33009
2023/02/09 23:43:13 2023-02-09 23:43:13. (17): starting data server on port
44757
2023/02/09 23:43:13 2023-02-09 23:43:13. (18): starting state server on port
32813
2023/02/09 23:43:13 2023-02-09 23:43:13. (19): starting logging server on port
41871
2023/02/09 23:43:13 2023-02-09 23:43:13. (20): Created Worker handler
<apache_beam.runners.portability.fn_api_runner.worker_handlers.DockerSdkWorkerHandler
object at 0x7fb820147c90> for environment go (beam:env:docker:v1,
b'\n\x16apache/beam_go_sdk:dev')
2023/02/09 23:43:20 2023-02-09 23:43:20. (21): Attempting to pull image
apache/beam_go_sdk:dev
2023/02/09 23:43:20 2023-02-09 23:43:20. (22): Unable to pull image
apache/beam_go_sdk:dev, defaulting to local image if it exists
2023/02/09 23:43:23 2023-02-09 23:43:23. (23): Waiting for docker to start up.
Current status is running
2023/02/09 23:43:23 2023-02-09 23:43:23. (24): Docker container is running.
container_id =
b'8297414e9ddb2fe24643eaec41f2d837ce49f6f454db6636a8be53fe0d957af4', worker_id
= worker_10
2023/02/09 23:43:24 2023-02-09 23:43:24. (25): Created Worker handler
<apache_beam.runners.portability.fn_api_runner.worker_handlers.DockerSdkWorkerHandler
object at 0x7fb820154310> for environment tMrAXSqvLSbeam:env:docker:v1
(beam:env:docker:v1, b'\n apache/beam_java8_sdk:2.46.0.dev')
2023/02/09 23:43:27 2023-02-09 23:43:27. (26): Attempting to pull image
apache/beam_java8_sdk:2.46.0.dev
2023/02/09 23:43:28 2023-02-09 23:43:28. (27): Unable to pull image
apache/beam_java8_sdk:2.46.0.dev, defaulting to local image if it exists
2023/02/09 23:43:29 2023-02-09 23:43:29. (28): Waiting for docker to start up.
Current status is exited
2023/02/09 23:43:32 2023-02-09 23:43:32. (29): Traceback (most recent call
last):
File
"<https://ci-beam.apache.org/job/beam_PostCommit_XVR_Direct/ws/src/build/gradleenv/1922375555/lib/python3.7/site-packages/apache_beam/runners/portability/local_job_service.py";,>
line 296, in _run_job
self.result = self._invoke_runner()
File
"<https://ci-beam.apache.org/job/beam_PostCommit_XVR_Direct/ws/src/build/gradleenv/1922375555/lib/python3.7/site-packages/apache_beam/runners/portability/local_job_service.py";,>
line 320, in _invoke_runner
self._pipeline_proto, self.pipeline_options())
File
"<https://ci-beam.apache.org/job/beam_PostCommit_XVR_Direct/ws/src/build/gradleenv/1922375555/lib/python3.7/site-packages/apache_beam/runners/portability/fn_api_runner/fn_runner.py";,>
line 222, in run_via_runner_api
return self.run_stages(stage_context, stages)
File
"<https://ci-beam.apache.org/job/beam_PostCommit_XVR_Direct/ws/src/build/gradleenv/1922375555/lib/python3.7/site-packages/apache_beam/runners/portability/fn_api_runner/fn_runner.py";,>
line 428, in run_stages
runner_execution_context.setup()
File
"<https://ci-beam.apache.org/job/beam_PostCommit_XVR_Direct/ws/src/build/gradleenv/1922375555/lib/python3.7/site-packages/apache_beam/runners/portability/fn_api_runner/execution.py";,>
line 811, in setup
self._enqueue_stage_initial_inputs(stage)
File
"<https://ci-beam.apache.org/job/beam_PostCommit_XVR_Direct/ws/src/build/gradleenv/1922375555/lib/python3.7/site-packages/apache_beam/runners/portability/fn_api_runner/execution.py";,>
line 840, in _enqueue_stage_initial_inputs
bundle_manager.data_api_service_descriptor())
File
"<https://ci-beam.apache.org/job/beam_PostCommit_XVR_Direct/ws/src/build/gradleenv/1922375555/lib/python3.7/site-packages/apache_beam/runners/portability/fn_api_runner/execution.py";,>
line 1064, in data_api_service_descriptor
return self.worker_handlers[0].data_api_service_descriptor()
File
"<https://ci-beam.apache.org/job/beam_PostCommit_XVR_Direct/ws/src/build/gradleenv/1922375555/lib/python3.7/site-packages/apache_beam/runners/portability/fn_api_runner/execution.py";,>
line 1057, in worker_handlers
self.stage.environment, self.num_workers))
File
"<https://ci-beam.apache.org/job/beam_PostCommit_XVR_Direct/ws/src/build/gradleenv/1922375555/lib/python3.7/site-packages/apache_beam/runners/portability/fn_api_runner/worker_handlers.py";,>
line 911, in get_worker_handlers
worker_handler.start_worker()
File
"<https://ci-beam.apache.org/job/beam_PostCommit_XVR_Direct/ws/src/build/gradleenv/1922375555/lib/python3.7/site-packages/apache_beam/runners/portability/fn_api_runner/worker_handlers.py";,>
line 802, in start_worker
status.decode('utf-8'))
RuntimeError: SDK failed to start. Final status is exited
2023/02/09 23:43:32 2023-02-09 23:43:32. (30): Error running pipeline.
Traceback (most recent call last):
File
"<https://ci-beam.apache.org/job/beam_PostCommit_XVR_Direct/ws/src/build/gradleenv/1922375555/lib/python3.7/site-packages/apache_beam/runners/portability/local_job_service.py";,>
line 296, in _run_job
self.result = self._invoke_runner()
File
"<https://ci-beam.apache.org/job/beam_PostCommit_XVR_Direct/ws/src/build/gradleenv/1922375555/lib/python3.7/site-packages/apache_beam/runners/portability/local_job_service.py";,>
line 320, in _invoke_runner
self._pipeline_proto, self.pipeline_options())
File
"<https://ci-beam.apache.org/job/beam_PostCommit_XVR_Direct/ws/src/build/gradleenv/1922375555/lib/python3.7/site-packages/apache_beam/runners/portability/fn_api_runner/fn_runner.py";,>
line 222, in run_via_runner_api
return self.run_stages(stage_context, stages)
File
"<https://ci-beam.apache.org/job/beam_PostCommit_XVR_Direct/ws/src/build/gradleenv/1922375555/lib/python3.7/site-packages/apache_beam/runners/portability/fn_api_runner/fn_runner.py";,>
line 428, in run_stages
runner_execution_context.setup()
File
"<https://ci-beam.apache.org/job/beam_PostCommit_XVR_Direct/ws/src/build/gradleenv/1922375555/lib/python3.7/site-packages/apache_beam/runners/portability/fn_api_runner/execution.py";,>
line 811, in setup
self._enqueue_stage_initial_inputs(stage)
File
"<https://ci-beam.apache.org/job/beam_PostCommit_XVR_Direct/ws/src/build/gradleenv/1922375555/lib/python3.7/site-packages/apache_beam/runners/portability/fn_api_runner/execution.py";,>
line 840, in _enqueue_stage_initial_inputs
bundle_manager.data_api_service_descriptor())
File
"<https://ci-beam.apache.org/job/beam_PostCommit_XVR_Direct/ws/src/build/gradleenv/1922375555/lib/python3.7/site-packages/apache_beam/runners/portability/fn_api_runner/execution.py";,>
line 1064, in data_api_service_descriptor
return self.worker_handlers[0].data_api_service_descriptor()
File
"<https://ci-beam.apache.org/job/beam_PostCommit_XVR_Direct/ws/src/build/gradleenv/1922375555/lib/python3.7/site-packages/apache_beam/runners/portability/fn_api_runner/execution.py";,>
line 1057, in worker_handlers
self.stage.environment, self.num_workers))
File
"<https://ci-beam.apache.org/job/beam_PostCommit_XVR_Direct/ws/src/build/gradleenv/1922375555/lib/python3.7/site-packages/apache_beam/runners/portability/fn_api_runner/worker_handlers.py";,>
line 911, in get_worker_handlers
worker_handler.start_worker()
File
"<https://ci-beam.apache.org/job/beam_PostCommit_XVR_Direct/ws/src/build/gradleenv/1922375555/lib/python3.7/site-packages/apache_beam/runners/portability/fn_api_runner/worker_handlers.py";,>
line 802, in start_worker
status.decode('utf-8'))
RuntimeError: SDK failed to start. Final status is exited
2023/02/09 23:43:32 Job state: FAILED
ptest.go:108: Failed to execute job: job
go-testjdbcio_postgresreadwrite-421-1eb0479b-13b2-4151-8fa0-66c48e4550b9 failed
--- FAIL: TestJDBCIO_PostgresReadWrite (32.76s)
FAIL
FAIL github.com/apache/beam/sdks/v2/go/test/integration/io/xlang/jdbc
143.126s
=== RUN TestKafkaIO_BasicReadWrite
integration.go:308: Test TestKafkaIO_BasicReadWrite is currently filtered
for runner portable
--- SKIP: TestKafkaIO_BasicReadWrite (0.00s)
PASS
ok github.com/apache/beam/sdks/v2/go/test/integration/io/xlang/kafka
6.131s
FAIL
> Task
> :sdks:python:test-suites:direct:xlang:validatesCrossLanguageRunnerGoUsingJava
> FAILED
> Task
> :sdks:python:test-suites:direct:xlang:validatesCrossLanguageRunnerJavaUsingPython
org.apache.beam.runners.core.construction.ValidateRunnerXlangTest$CoGroupByKeyTest
> test FAILED
java.lang.RuntimeException at JobServicePipelineResult.java:176
org.apache.beam.runners.core.construction.ValidateRunnerXlangTest$CombineGloballyTest
> test FAILED
java.lang.RuntimeException at JobServicePipelineResult.java:176
org.apache.beam.runners.core.construction.ValidateRunnerXlangTest$CombinePerKeyTest
> test FAILED
java.lang.RuntimeException at JobServicePipelineResult.java:176
org.apache.beam.runners.core.construction.ValidateRunnerXlangTest$FlattenTest >
test FAILED
java.lang.RuntimeException at JobServicePipelineResult.java:176
org.apache.beam.runners.core.construction.ValidateRunnerXlangTest$GroupByKeyTest
> test FAILED
java.lang.RuntimeException at JobServicePipelineResult.java:176
org.apache.beam.runners.core.construction.ValidateRunnerXlangTest$MultiInputOutputWithSideInputTest
> test FAILED
java.lang.RuntimeException at JobServicePipelineResult.java:176
org.apache.beam.runners.core.construction.ValidateRunnerXlangTest$PartitionTest
> test FAILED
java.lang.RuntimeException at JobServicePipelineResult.java:176
org.apache.beam.runners.core.construction.ValidateRunnerXlangTest$PythonDependenciesTest
> test FAILED
java.lang.RuntimeException at JobServicePipelineResult.java:176
org.apache.beam.runners.core.construction.ValidateRunnerXlangTest$SingleInputOutputTest
> test FAILED
java.lang.RuntimeException at JobServicePipelineResult.java:176
INFO:root:Default Python SDK image for environment is
apache/beam_python3.8_sdk:2.44.0
INFO:root:No image given, using default Python SDK image
INFO:root:Default Python SDK image for environment is
apache/beam_python3.8_sdk:2.44.0
INFO:root:Python SDK container image set to "apache/beam_python3.8_sdk:2.44.0"
for Docker environment
INFO:__main__:Listening for expansion requests at 44313
INFO:root:Missing pipeline option (runner). Executing pipeline using the
default runner: DirectRunner.
INFO:__main__:Shutting down expansion service.
INFO:apache_beam.runners.portability.stager:Executing command:
['/home/jenkins/.apache_beam/cache/venvs/py-3.8-beam-2.44.0-743bdccef67087512a7a190820e727aab7bdcb14/bin/python',
'-m', 'pip', 'download', '--dest', '/tmp/dataflow-requirements-cache', '-r',
'/tmp/tmpbe8rqgvn/tmp_requirements.txt', '--exists-action', 'i', '--no-deps',
'--implementation', 'cp', '--abi', 'cp38', '--platform', 'manylinux2014_x86_64']
INFO:root:Default Python SDK image for environment is
apache/beam_python3.8_sdk:2.44.0
INFO:root:No image given, using default Python SDK image
INFO:root:Default Python SDK image for environment is
apache/beam_python3.8_sdk:2.44.0
INFO:root:Python SDK container image set to "apache/beam_python3.8_sdk:2.44.0"
for Docker environment
INFO:__main__:Listening for expansion requests at 40167
INFO:root:Missing pipeline option (runner). Executing pipeline using the
default runner: DirectRunner.
INFO:__main__:Shutting down expansion service.
org.apache.beam.sdk.extensions.python.transforms.DataframeTransformTest >
testDataframeSum FAILED
java.lang.RuntimeException at JobServicePipelineResult.java:176
org.apache.beam.sdk.extensions.python.transforms.PythonMapTest > testPythonMap
FAILED
java.lang.RuntimeException at JobServicePipelineResult.java:176
org.apache.beam.sdk.extensions.python.transforms.PythonMapTest >
testPythonFlatMap FAILED
java.lang.RuntimeException at JobServicePipelineResult.java:176
org.apache.beam.sdk.extensions.python.transforms.RunInferenceTransformTest >
testRunInferenceWithKVs FAILED
java.lang.RuntimeException at JobServicePipelineResult.java:176
org.apache.beam.sdk.extensions.python.transforms.RunInferenceTransformTest >
testRunInference FAILED
java.lang.RuntimeException at JobServicePipelineResult.java:176
16 tests completed, 14 failed
> Task
> :sdks:python:test-suites:direct:xlang:validatesCrossLanguageRunnerJavaUsingPython
> FAILED
> Task
> :sdks:python:test-suites:direct:xlang:validatesCrossLanguageRunnerPythonUsingJava
> Task
> :sdks:python:test-suites:direct:xlang:validatesCrossLanguageRunnerPythonUsingJava
> FAILED
> Task
> :sdks:python:test-suites:direct:xlang:validatesCrossLanguageRunnerPythonUsingSql
> Task
> :sdks:python:test-suites:direct:xlang:validatesCrossLanguageRunnerPythonUsingSql
> FAILED
> Task :sdks:python:test-suites:direct:xlang:fnApiJobServerCleanup
> Task :sdks:python:test-suites:direct:xlang:validatesCrossLanguageRunnerCleanup
FAILURE: Build completed with 4 failures.
1: Task failed with an exception.
-----------
* Where:
Build file
'<https://ci-beam.apache.org/job/beam_PostCommit_XVR_Direct/ws/src/sdks/go/test/build.gradle'>
line: 193
* What went wrong:
Execution failed for task
':sdks:python:test-suites:direct:xlang:validatesCrossLanguageRunnerGoUsingJava'.
> Process 'command 'sh'' finished with non-zero exit value 1
* Try:
> Run with --stacktrace option to get the stack trace.
> Run with --info or --debug option to get more log output.
==============================================================================
2: Task failed with an exception.
-----------
* What went wrong:
Execution failed for task
':sdks:python:test-suites:direct:xlang:validatesCrossLanguageRunnerJavaUsingPython'.
> There were failing tests. See the report at:
> file://<https://ci-beam.apache.org/job/beam_PostCommit_XVR_Direct/ws/src/sdks/python/test-suites/direct/xlang/build/reports/tests/validatesCrossLanguageRunnerJavaUsingPython/index.html>
* Try:
> Run with --stacktrace option to get the stack trace.
> Run with --info or --debug option to get more log output.
==============================================================================
3: Task failed with an exception.
-----------
* What went wrong:
Execution failed for task
':sdks:python:test-suites:direct:xlang:validatesCrossLanguageRunnerPythonUsingJava'.
> Process 'command 'sh'' finished with non-zero exit value 1
* Try:
> Run with --stacktrace option to get the stack trace.
> Run with --info or --debug option to get more log output.
==============================================================================
4: Task failed with an exception.
-----------
* What went wrong:
Execution failed for task
':sdks:python:test-suites:direct:xlang:validatesCrossLanguageRunnerPythonUsingSql'.
> Process 'command 'sh'' finished with non-zero exit value 1
* Try:
> Run with --stacktrace option to get the stack trace.
> Run with --info or --debug option to get more log output.
==============================================================================
* Get more help at https://help.gradle.org
Deprecated Gradle features were used in this build, making it incompatible with
Gradle 8.0.
You can use '--warning-mode all' to show the individual deprecation warnings
and determine if they come from your own scripts or plugins.
See
https://docs.gradle.org/7.5.1/userguide/command_line_interface.html#sec:command_line_warnings
Execution optimizations have been disabled for 1 invalid unit(s) of work during
this build to ensure correctness.
Please consult deprecation warnings for more details.
BUILD FAILED in 32m 20s
248 actionable tasks: 187 executed, 51 from cache, 10 up-to-date
Publishing build scan...
An error occurred creating your build scan.
Please report this problem at https://gradle.com/help, quoting the following
reference code:
ptnl2n3n6awzg
Build step 'Invoke Gradle script' changed build result to FAILURE
Build step 'Invoke Gradle script' marked build as failure
---------------------------------------------------------------------
To unsubscribe, e-mail: [email protected]
For additional commands, e-mail: [email protected]
