See
<https://ci-beam.apache.org/job/beam_PostCommit_XVR_Spark/2990/display/redirect?page=changes>
Changes:
[sergey.kalinin] Initial add for dockerfiles and build scripts
[sergey.kalinin] Initial add for terraform scripts for infra provision
[sergey.kalinin] Add licenses
[sergey.kalinin] Add fixes to docker plugin and also build arg for beam sdk
image
[sergey.kalinin] Remove wrongly added comments
[sergey.kalinin] Add beam playground applications deploy
[sergey.kalinin] Remove wrongly added log file
[sergey.kalinin] Fix syntax
[sergey.kalinin] Added default values
[sergey.kalinin] Add default value to base image
[sergey.kalinin] Added Beam Version as build arg, also changed way of getting
tags for
[sergey.kalinin] Added readme file
[sergey.kalinin] Add workflow to build backend application
[sergey.kalinin] Add license
[sergey.kalinin] Add frontend workflow
[sergey.kalinin] Add license to README and added reader access to bucket
[sergey.kalinin] Remove trailing whitespace
[relax] for existing tables, no need to set a schema
[sergey.kalinin] Remove comment from dockerfile
[noreply] [BEAM-13190] Elide trailing nils (#15920)
[noreply] [BEAM-13052] Increment protobuf version to 3.19.0 (#15883)
[noreply] [BEAM-3304] refactoring trigger package in GoSDK (#15933)
------------------------------------------
[...truncated 652.62 KB...]
key: "go"
value: <
urn: "beam:env:docker:v1"
payload: "\n\026apache/beam_go_sdk:dev"
capabilities: "beam:protocol:progress_reporting:v0"
capabilities: "beam:protocol:multi_core_bundle_processing:v1"
capabilities: "beam:version:sdk_base:go"
capabilities: "beam:coder:bytes:v1"
capabilities: "beam:coder:bool:v1"
capabilities: "beam:coder:varint:v1"
capabilities: "beam:coder:double:v1"
capabilities: "beam:coder:string_utf8:v1"
capabilities: "beam:coder:length_prefix:v1"
capabilities: "beam:coder:kv:v1"
capabilities: "beam:coder:iterable:v1"
capabilities: "beam:coder:state_backed_iterable:v1"
capabilities: "beam:coder:windowed_value:v1"
capabilities: "beam:coder:global_window:v1"
capabilities: "beam:coder:interval_window:v1"
capabilities: "beam:coder:row:v1"
dependencies: <
type_urn: "beam:artifact:type:go_worker_binary:v1"
role_urn: "beam:artifact:role:staging_to:v1"
role_payload: "\n\006worker"
>
>
>
>
root_transform_ids: "s1"
root_transform_ids: "e4"
root_transform_ids: "e5"
root_transform_ids: "s3"
requirements: "beam:requirement:pardo:splittable_dofn:v1"
2021/11/11 00:18:46 Prepared job with id:
go-job-2-1636589926887657737_896e8803-a66c-48f9-8fdf-1a8f887547ff and staging
token: go-job-2-1636589926887657737_896e8803-a66c-48f9-8fdf-1a8f887547ff
2021/11/11 00:18:46 Cross-compiling
<https://ci-beam.apache.org/job/beam_PostCommit_XVR_Spark/ws/src/sdks/go/test/integration/io/xlang/kafka/kafka_test.go>
as /tmp/worker-2-1636589926897115157
2021/11/11 00:18:48 Staged binary artifact with token:
2021/11/11 00:18:48 Submitted job:
go0job0201636589926887657737-jenkins-1111001848-a42c010a_06ebc3ea-266a-4f54-ab29-892f9ec5550f
2021/11/11 00:18:48 Job state: STOPPED
2021/11/11 00:18:48 Job state: STARTING
2021/11/11 00:18:48 Job state: RUNNING
2021/11/11 00:19:16 Job state: DONE
2021/11/11 00:19:16 unknown metric type
2021/11/11 00:19:16 unknown metric type
2021/11/11 00:19:16 unknown metric type
2021/11/11 00:19:16 unknown metric type
2021/11/11 00:19:16 Failed to deduce Step from MonitoringInfo:
urn:"beam:metric:element_count:v1" type:"beam:metrics:sum_int64:v1"
payload:"\x01" labels:{key:"PCOLLECTION"
value:"VzLuvscEUXExternal/KafkaIO.Read/KafkaIO.Read.ReadFromKafkaViaUnbounded/Read(KafkaUnboundedSource)/Create/Read(CreateSource)/ParDo(OutputSingleSource)/ParMultiDo(OutputSingleSource).output/SplitAndSize0"}
2021/11/11 00:19:16 unknown metric type
2021/11/11 00:19:16 Failed to deduce Step from MonitoringInfo:
urn:"beam:metric:element_count:v1" type:"beam:metrics:sum_int64:v1"
payload:"\x01" labels:{key:"PCOLLECTION"
value:"VzLuvscEUXExternal/KafkaIO.Read/KafkaIO.Read.ReadFromKafkaViaUnbounded/Read(KafkaUnboundedSource)/Create/Read(CreateSource)/ParDo(OutputSingleSource)/ParMultiDo(OutputSingleSource).output/PairWithRestriction0"}
2021/11/11 00:19:16 Failed to deduce Step from MonitoringInfo:
urn:"beam:metric:sampled_byte_size:v1"
type:"beam:metrics:distribution_int64:v1" payload:"\x01\x92A\x92A\x92A"
labels:{key:"PCOLLECTION"
value:"VzLuvscEUXExternal/KafkaIO.Read/KafkaIO.Read.ReadFromKafkaViaUnbounded/Read(KafkaUnboundedSource)/Create/Read(CreateSource)/ParDo(OutputSingleSource)/ParMultiDo(OutputSingleSource).output/PairWithRestriction0"}
2021/11/11 00:19:16 Failed to deduce Step from MonitoringInfo:
urn:"beam:metric:sampled_byte_size:v1"
type:"beam:metrics:distribution_int64:v1" payload:"\x01\x9fA\x9fA\x9fA"
labels:{key:"PCOLLECTION"
value:"VzLuvscEUXExternal/KafkaIO.Read/KafkaIO.Read.ReadFromKafkaViaUnbounded/Read(KafkaUnboundedSource)/Create/Read(CreateSource)/ParDo(OutputSingleSource)/ParMultiDo(OutputSingleSource).output/SplitAndSize0"}
2021/11/11 00:19:16 Failed to deduce Step from MonitoringInfo:
urn:"beam:metric:element_count:v1" type:"beam:metrics:sum_int64:v1"
payload:"\x01" labels:{key:"PCOLLECTION"
value:"VzLuvscEUXExternal/KafkaIO.Read/KafkaIO.Read.ReadFromKafkaViaUnbounded/Read(KafkaUnboundedSource)/Create/Read(CreateSource)/ParDo(OutputSingleSource)/ParMultiDo(OutputSingleSource).output/SplitAndSize0"}
2021/11/11 00:19:16 unknown metric type
2021/11/11 00:19:16 Failed to deduce Step from MonitoringInfo:
urn:"beam:metric:sampled_byte_size:v1"
type:"beam:metrics:distribution_int64:v1" payload:"\x01\x9fA\x9fA\x9fA"
labels:{key:"PCOLLECTION"
value:"VzLuvscEUXExternal/KafkaIO.Read/KafkaIO.Read.ReadFromKafkaViaUnbounded/Read(KafkaUnboundedSource)/Create/Read(CreateSource)/ParDo(OutputSingleSource)/ParMultiDo(OutputSingleSource).output/SplitAndSize0"}
2021/11/11 00:19:16 unknown metric type
--- PASS: TestKafkaIO_BasicReadWrite (58.39s)
PASS
ok github.com/apache/beam/sdks/v2/go/test/integration/io/xlang/kafka
61.458s
> Task :runners:spark:2:job-server:validatesCrossLanguageRunnerJavaUsingJava
org.apache.beam.runners.core.construction.ValidateRunnerXlangTest >
combineGloballyTest FAILED
org.apache.beam.vendor.grpc.v1p36p0.io.grpc.StatusRuntimeException at
ValidateRunnerXlangTest.java:257
Caused by:
org.apache.beam.vendor.grpc.v1p36p0.io.netty.channel.AbstractChannel$AnnotatedConnectException
Caused by: java.net.ConnectException at Errors.java:124
java.lang.NullPointerException at ValidateRunnerXlangTest.java:123
org.apache.beam.runners.core.construction.ValidateRunnerXlangTest >
partitionTest FAILED
org.apache.beam.vendor.grpc.v1p36p0.io.grpc.StatusRuntimeException at
ValidateRunnerXlangTest.java:314
Caused by:
org.apache.beam.vendor.grpc.v1p36p0.io.netty.channel.AbstractChannel$AnnotatedConnectException
Caused by: java.net.ConnectException at Errors.java:124
java.lang.NullPointerException at ValidateRunnerXlangTest.java:123
org.apache.beam.runners.core.construction.ValidateRunnerXlangTest >
coGroupByKeyTest FAILED
org.apache.beam.vendor.grpc.v1p36p0.io.grpc.StatusRuntimeException at
ValidateRunnerXlangTest.java:230
Caused by:
org.apache.beam.vendor.grpc.v1p36p0.io.netty.channel.AbstractChannel$AnnotatedConnectException
Caused by: java.net.ConnectException at Errors.java:124
java.lang.NullPointerException at ValidateRunnerXlangTest.java:123
org.apache.beam.runners.core.construction.ValidateRunnerXlangTest >
groupByKeyTest FAILED
org.apache.beam.vendor.grpc.v1p36p0.io.grpc.StatusRuntimeException at
ValidateRunnerXlangTest.java:198
Caused by:
org.apache.beam.vendor.grpc.v1p36p0.io.netty.channel.AbstractChannel$AnnotatedConnectException
Caused by: java.net.ConnectException at Errors.java:124
java.lang.NullPointerException at ValidateRunnerXlangTest.java:123
org.apache.beam.runners.core.construction.ValidateRunnerXlangTest >
combinePerKeyTest FAILED
org.apache.beam.vendor.grpc.v1p36p0.io.grpc.StatusRuntimeException at
ValidateRunnerXlangTest.java:275
Caused by:
org.apache.beam.vendor.grpc.v1p36p0.io.netty.channel.AbstractChannel$AnnotatedConnectException
Caused by: java.net.ConnectException at Errors.java:124
java.lang.NullPointerException at ValidateRunnerXlangTest.java:123
org.apache.beam.runners.core.construction.ValidateRunnerXlangTest > flattenTest
FAILED
org.apache.beam.vendor.grpc.v1p36p0.io.grpc.StatusRuntimeException at
ValidateRunnerXlangTest.java:295
Caused by:
org.apache.beam.vendor.grpc.v1p36p0.io.netty.channel.AbstractChannel$AnnotatedConnectException
Caused by: java.net.ConnectException at Errors.java:124
java.lang.NullPointerException at ValidateRunnerXlangTest.java:123
org.apache.beam.runners.core.construction.ValidateRunnerXlangTest >
singleInputOutputTest FAILED
org.apache.beam.vendor.grpc.v1p36p0.io.grpc.StatusRuntimeException at
ValidateRunnerXlangTest.java:156
Caused by:
org.apache.beam.vendor.grpc.v1p36p0.io.netty.channel.AbstractChannel$AnnotatedConnectException
Caused by: java.net.ConnectException at Errors.java:124
java.lang.NullPointerException at ValidateRunnerXlangTest.java:123
org.apache.beam.runners.core.construction.ValidateRunnerXlangTest >
multiInputOutputWithSideInputTest FAILED
org.apache.beam.vendor.grpc.v1p36p0.io.grpc.StatusRuntimeException at
ValidateRunnerXlangTest.java:178
Caused by:
org.apache.beam.vendor.grpc.v1p36p0.io.netty.channel.AbstractChannel$AnnotatedConnectException
Caused by: java.net.ConnectException at Errors.java:124
java.lang.NullPointerException at ValidateRunnerXlangTest.java:123
8 tests completed, 8 failed
> Task :runners:spark:2:job-server:validatesCrossLanguageRunnerJavaUsingJava
> FAILED
> Task :runners:spark:2:job-server:validatesCrossLanguageRunnerJavaUsingPython
org.apache.beam.runners.core.construction.ValidateRunnerXlangTest >
combineGloballyTest FAILED
org.apache.beam.vendor.grpc.v1p36p0.io.grpc.StatusRuntimeException at
ValidateRunnerXlangTest.java:257
Caused by:
org.apache.beam.vendor.grpc.v1p36p0.io.netty.channel.AbstractChannel$AnnotatedConnectException
Caused by: java.net.ConnectException at Errors.java:124
java.lang.NullPointerException at ValidateRunnerXlangTest.java:123
org.apache.beam.runners.core.construction.ValidateRunnerXlangTest >
partitionTest FAILED
org.apache.beam.vendor.grpc.v1p36p0.io.grpc.StatusRuntimeException at
ValidateRunnerXlangTest.java:314
Caused by:
org.apache.beam.vendor.grpc.v1p36p0.io.netty.channel.AbstractChannel$AnnotatedConnectException
Caused by: java.net.ConnectException at Errors.java:124
java.lang.NullPointerException at ValidateRunnerXlangTest.java:123
org.apache.beam.runners.core.construction.ValidateRunnerXlangTest >
coGroupByKeyTest FAILED
org.apache.beam.vendor.grpc.v1p36p0.io.grpc.StatusRuntimeException at
ValidateRunnerXlangTest.java:230
Caused by:
org.apache.beam.vendor.grpc.v1p36p0.io.netty.channel.AbstractChannel$AnnotatedConnectException
Caused by: java.net.ConnectException at Errors.java:124
java.lang.NullPointerException at ValidateRunnerXlangTest.java:123
org.apache.beam.runners.core.construction.ValidateRunnerXlangTest >
groupByKeyTest FAILED
org.apache.beam.vendor.grpc.v1p36p0.io.grpc.StatusRuntimeException at
ValidateRunnerXlangTest.java:198
Caused by:
org.apache.beam.vendor.grpc.v1p36p0.io.netty.channel.AbstractChannel$AnnotatedConnectException
Caused by: java.net.ConnectException at Errors.java:124
java.lang.NullPointerException at ValidateRunnerXlangTest.java:123
org.apache.beam.runners.core.construction.ValidateRunnerXlangTest >
combinePerKeyTest FAILED
org.apache.beam.vendor.grpc.v1p36p0.io.grpc.StatusRuntimeException at
ValidateRunnerXlangTest.java:275
Caused by:
org.apache.beam.vendor.grpc.v1p36p0.io.netty.channel.AbstractChannel$AnnotatedConnectException
Caused by: java.net.ConnectException at Errors.java:124
java.lang.NullPointerException at ValidateRunnerXlangTest.java:123
org.apache.beam.runners.core.construction.ValidateRunnerXlangTest > flattenTest
FAILED
org.apache.beam.vendor.grpc.v1p36p0.io.grpc.StatusRuntimeException at
ValidateRunnerXlangTest.java:295
Caused by:
org.apache.beam.vendor.grpc.v1p36p0.io.netty.channel.AbstractChannel$AnnotatedConnectException
Caused by: java.net.ConnectException at Errors.java:124
java.lang.NullPointerException at ValidateRunnerXlangTest.java:123
org.apache.beam.runners.core.construction.ValidateRunnerXlangTest >
singleInputOutputTest FAILED
org.apache.beam.vendor.grpc.v1p36p0.io.grpc.StatusRuntimeException at
ValidateRunnerXlangTest.java:156
Caused by:
org.apache.beam.vendor.grpc.v1p36p0.io.netty.channel.AbstractChannel$AnnotatedConnectException
Caused by: java.net.ConnectException at Errors.java:124
java.lang.NullPointerException at ValidateRunnerXlangTest.java:123
org.apache.beam.runners.core.construction.ValidateRunnerXlangTest >
multiInputOutputWithSideInputTest FAILED
org.apache.beam.vendor.grpc.v1p36p0.io.grpc.StatusRuntimeException at
ValidateRunnerXlangTest.java:178
Caused by:
org.apache.beam.vendor.grpc.v1p36p0.io.netty.channel.AbstractChannel$AnnotatedConnectException
Caused by: java.net.ConnectException at Errors.java:124
java.lang.NullPointerException at ValidateRunnerXlangTest.java:123
8 tests completed, 8 failed
> Task :runners:spark:2:job-server:validatesCrossLanguageRunnerJavaUsingPython
> FAILED
> Task
> :runners:spark:2:job-server:validatesCrossLanguageRunnerJavaUsingPythonOnly
org.apache.beam.runners.core.construction.ValidateRunnerXlangTest >
pythonDependenciesTest FAILED
org.apache.beam.vendor.grpc.v1p36p0.io.grpc.StatusRuntimeException at
ValidateRunnerXlangTest.java:338
Caused by:
org.apache.beam.vendor.grpc.v1p36p0.io.netty.channel.AbstractChannel$AnnotatedConnectException
Caused by: java.net.ConnectException at Errors.java:124
java.lang.NullPointerException at ValidateRunnerXlangTest.java:123
1 test completed, 1 failed
> Task
> :runners:spark:2:job-server:validatesCrossLanguageRunnerJavaUsingPythonOnly
> FAILED
> Task :runners:spark:2:job-server:validatesCrossLanguageRunnerPythonUsingJava
> FAILED
> Task
> :runners:spark:2:job-server:validatesCrossLanguageRunnerPythonUsingPython
> FAILED
> Task :runners:spark:2:job-server:validatesCrossLanguageRunnerPythonUsingSql
> Task :runners:spark:2:job-server:validatesCrossLanguageRunnerCleanup
> Task :runners:spark:2:job-server:sparkJobServerCleanup
FAILURE: Build completed with 5 failures.
1: Task failed with an exception.
-----------
* What went wrong:
Execution failed for task
':runners:spark:2:job-server:validatesCrossLanguageRunnerJavaUsingJava'.
> There were failing tests. See the report at:
> file://<https://ci-beam.apache.org/job/beam_PostCommit_XVR_Spark/ws/src/runners/spark/2/job-server/build/reports/tests/validatesCrossLanguageRunnerJavaUsingJava/index.html>
* Try:
Run with --stacktrace option to get the stack trace. Run with --info or --debug
option to get more log output. Run with --scan to get full insights.
==============================================================================
2: Task failed with an exception.
-----------
* What went wrong:
Execution failed for task
':runners:spark:2:job-server:validatesCrossLanguageRunnerJavaUsingPython'.
> There were failing tests. See the report at:
> file://<https://ci-beam.apache.org/job/beam_PostCommit_XVR_Spark/ws/src/runners/spark/2/job-server/build/reports/tests/validatesCrossLanguageRunnerJavaUsingPython/index.html>
* Try:
Run with --stacktrace option to get the stack trace. Run with --info or --debug
option to get more log output. Run with --scan to get full insights.
==============================================================================
3: Task failed with an exception.
-----------
* What went wrong:
Execution failed for task
':runners:spark:2:job-server:validatesCrossLanguageRunnerJavaUsingPythonOnly'.
> There were failing tests. See the report at:
> file://<https://ci-beam.apache.org/job/beam_PostCommit_XVR_Spark/ws/src/runners/spark/2/job-server/build/reports/tests/validatesCrossLanguageRunnerJavaUsingPythonOnly/index.html>
* Try:
Run with --stacktrace option to get the stack trace. Run with --info or --debug
option to get more log output. Run with --scan to get full insights.
==============================================================================
4: Task failed with an exception.
-----------
* What went wrong:
Execution failed for task
':runners:spark:2:job-server:validatesCrossLanguageRunnerPythonUsingJava'.
> Process 'command 'sh'' finished with non-zero exit value 1
* Try:
Run with --stacktrace option to get the stack trace. Run with --info or --debug
option to get more log output. Run with --scan to get full insights.
==============================================================================
5: Task failed with an exception.
-----------
* What went wrong:
Execution failed for task
':runners:spark:2:job-server:validatesCrossLanguageRunnerPythonUsingPython'.
> Process 'command 'sh'' finished with non-zero exit value 1
* Try:
Run with --stacktrace option to get the stack trace. Run with --info or --debug
option to get more log output. Run with --scan to get full insights.
==============================================================================
* Get more help at https://help.gradle.org
Deprecated Gradle features were used in this build, making it incompatible with
Gradle 7.0.
Use '--warning-mode all' to show the individual deprecation warnings.
See
https://docs.gradle.org/6.9.1/userguide/command_line_interface.html#sec:command_line_warnings
BUILD FAILED in 26m 10s
216 actionable tasks: 155 executed, 54 from cache, 7 up-to-date
Publishing build scan...
https://gradle.com/s/vrurh2nryyljs
Build step 'Invoke Gradle script' changed build result to FAILURE
Build step 'Invoke Gradle script' marked build as failure
---------------------------------------------------------------------
To unsubscribe, e-mail: [email protected]
For additional commands, e-mail: [email protected]
