See
<https://ci-beam.apache.org/job/beam_LoadTests_Go_GBK_Flink_Batch/936/display/redirect>
Changes:
------------------------------------------
[...truncated 48.33 KB...]
github.com/apache/beam/sdks/v2/go/pkg/beam/core/runtime/exec.(*invoker).invokeWithOpts(0xc0000b9040,
{0x18d4590?, 0xc00035c040}, {0x0, 0x0, 0x0, 0x0, 0x0}, {0x23c6b90, 0x1, ...},
...)
<https://ci-beam.apache.org/job/beam_LoadTests_Go_GBK_Flink_Batch/ws/src/sdks/go/pkg/beam/core/runtime/exec/fn.go>:297
+0xfec
github.com/apache/beam/sdks/v2/go/pkg/beam/core/runtime/exec.(*ParDo).invokeProcessFn(0xc000323440,
{0x18d4590, 0xc00035c040}, {0x0, 0x0, 0x0, 0x0, 0x0}, {0x23c6b90, 0x1, ...},
...)
<https://ci-beam.apache.org/job/beam_LoadTests_Go_GBK_Flink_Batch/ws/src/sdks/go/pkg/beam/core/runtime/exec/pardo.go>:508
+0x2b5
github.com/apache/beam/sdks/v2/go/pkg/beam/core/runtime/exec.(*ParDo).processSingleWindow(0xc000323440,
0xc000334cf0)
<https://ci-beam.apache.org/job/beam_LoadTests_Go_GBK_Flink_Batch/ws/src/sdks/go/pkg/beam/core/runtime/exec/pardo.go>:194
+0x9b
github.com/apache/beam/sdks/v2/go/pkg/beam/core/runtime/exec.(*ProcessSizedElementsAndRestrictions).ProcessElement(0xc000355180,
{0x18d4590, 0xc000413a40}, 0xc0000ad420, {0x0, 0x0, 0x0})
<https://ci-beam.apache.org/job/beam_LoadTests_Go_GBK_Flink_Batch/ws/src/sdks/go/pkg/beam/core/runtime/exec/sdf.go>:556
+0x63d
github.com/apache/beam/sdks/v2/go/pkg/beam/core/runtime/exec.(*DataSource).Process.func1(0xc0003522b8,
{0xc0002a1340?, 0xc000467f80?})
<https://ci-beam.apache.org/job/beam_LoadTests_Go_GBK_Flink_Batch/ws/src/sdks/go/pkg/beam/core/runtime/exec/datasource.go>:241
+0x21e
github.com/apache/beam/sdks/v2/go/pkg/beam/core/runtime/exec.(*DataSource).process(0xc0003e94a0,
{0x18d4590, 0xc000413a40}, 0xc0002a1630, 0xc0002a1610)
<https://ci-beam.apache.org/job/beam_LoadTests_Go_GBK_Flink_Batch/ws/src/sdks/go/pkg/beam/core/runtime/exec/datasource.go>:147
+0x4f6
github.com/apache/beam/sdks/v2/go/pkg/beam/core/runtime/exec.(*DataSource).Process(0xc0003e94a0,
{0x18d4590, 0xc000413a40})
<https://ci-beam.apache.org/job/beam_LoadTests_Go_GBK_Flink_Batch/ws/src/sdks/go/pkg/beam/core/runtime/exec/datasource.go>:215
+0x226
github.com/apache/beam/sdks/v2/go/pkg/beam/core/runtime/exec.(*Plan).Execute.func2({0x18d4590?,
0xc000413a40?})
<https://ci-beam.apache.org/job/beam_LoadTests_Go_GBK_Flink_Batch/ws/src/sdks/go/pkg/beam/core/runtime/exec/plan.go>:151
+0x42
github.com/apache/beam/sdks/v2/go/pkg/beam/core/runtime/exec.callNoPanic({0x18d4590?,
0xc000413a40?}, 0x415d70?)
<https://ci-beam.apache.org/job/beam_LoadTests_Go_GBK_Flink_Batch/ws/src/sdks/go/pkg/beam/core/runtime/exec/util.go>:62
+0x6c
github.com/apache/beam/sdks/v2/go/pkg/beam/core/runtime/exec.(*Plan).Execute(0xc000334990,
{0x18d4590, 0xc000413a40}, {0x236dd28, 0x1}, {{0x18c63f0?, 0xc00031df80?},
{0x19009d8?, 0xc000331e90?}})
<https://ci-beam.apache.org/job/beam_LoadTests_Go_GBK_Flink_Batch/ws/src/sdks/go/pkg/beam/core/runtime/exec/plan.go>:150
+0x3df
github.com/apache/beam/sdks/v2/go/pkg/beam/core/runtime/harness.(*control).handleInstruction(0xc0003dc000,
{0x18d4478?, 0xc0000f8c90?}, 0xc0002ba0f0)
<https://ci-beam.apache.org/job/beam_LoadTests_Go_GBK_Flink_Batch/ws/src/sdks/go/pkg/beam/core/runtime/harness/harness.go>:408
+0xa53
github.com/apache/beam/sdks/v2/go/pkg/beam/core/runtime/harness.MainWithOptions.func4({0x18d4478?,
0xc0000f8c90?}, 0x0?)
<https://ci-beam.apache.org/job/beam_LoadTests_Go_GBK_Flink_Batch/ws/src/sdks/go/pkg/beam/core/runtime/harness/harness.go>:195
+0x7a
created by
github.com/apache/beam/sdks/v2/go/pkg/beam/core/runtime/harness.MainWithOptions
<https://ci-beam.apache.org/job/beam_LoadTests_Go_GBK_Flink_Batch/ws/src/sdks/go/pkg/beam/core/runtime/harness/harness.go>:213
+0xf1d
at
java.util.concurrent.CompletableFuture.reportGet(CompletableFuture.java:395)
at
java.util.concurrent.CompletableFuture.get(CompletableFuture.java:1999)
at org.apache.beam.sdk.util.MoreFutures.get(MoreFutures.java:61)
at
org.apache.beam.runners.fnexecution.control.SdkHarnessClient$BundleProcessor$ActiveBundle.close(SdkHarnessClient.java:522)
at
org.apache.beam.runners.fnexecution.control.DefaultJobBundleFactory$SimpleStageBundleFactory$1.close(DefaultJobBundleFactory.java:556)
at
org.apache.beam.runners.flink.translation.functions.FlinkExecutableStageFunction.$closeResource(FlinkExecutableStageFunction.java:269)
at
org.apache.beam.runners.flink.translation.functions.FlinkExecutableStageFunction.mapPartition(FlinkExecutableStageFunction.java:269)
at
org.apache.flink.runtime.operators.MapPartitionDriver.run(MapPartitionDriver.java:113)
at org.apache.flink.runtime.operators.BatchTask.run(BatchTask.java:514)
at
org.apache.flink.runtime.operators.BatchTask.invoke(BatchTask.java:357)
at
org.apache.flink.runtime.taskmanager.Task.runWithSystemExitMonitoring(Task.java:948)
at
org.apache.flink.runtime.taskmanager.Task.restoreAndInvoke(Task.java:927)
at org.apache.flink.runtime.taskmanager.Task.doRun(Task.java:741)
at org.apache.flink.runtime.taskmanager.Task.run(Task.java:563)
at java.lang.Thread.run(Thread.java:829)
Caused by: java.lang.RuntimeException: Error received from SDK harness for
instruction 5: process bundle failed for instruction 5 using plan 1-5 : panic:
datamgr.go [{5 fn/write/n4:0}]: error flushing buffer of length 4000000
caused by:
rpc error: code = Unknown desc =
Full error:
while executing Process for Plan[1-5]:
2: DataSink[S[fn/write/n4:0@localhost:38183]]
Coder:W;fn/wire/n4:0<KV;c1<bytes;c0,bytes;c0>>!GWC
3: PCollection[n4] Out:[2]
4: ParDo[load.RuntimeMonitor] Out:[2] Sig: func([]uint8, []uint8, func([]uint8,
[]uint8))
5: PCollection[n3] Out:[4]
6: SDF.ProcessSizedElementsAndRestrictions[synthetic.sourceFn] UID:6 Out:[5]
1: DataSource[S[fn/read/n2/SplitAndSize0:0@localhost:38183], local_output]
Out:6
Coder:W;fn/wire/n2/SplitAndSize0:0<KV;c5/SplitAndSize0<KV;c5/PairWithRestriction0<R;c5[synthetic.SourceConfig],KV;c9<offsetrange.Restriction[offsetrange.Restriction;c6];c7,bool;c8>>,double;DoubleCoder0>>!GWC
caused by:
panic: datamgr.go [{5 fn/write/n4:0}]: error flushing buffer of length 4000000
caused by:
rpc error: code = Unknown desc = goroutine 38 [running]:
runtime/debug.Stack()
/home/jenkins/sdk/go1.20.4/src/runtime/debug/stack.go:24 +0x65
github.com/apache/beam/sdks/v2/go/pkg/beam/core/runtime/exec.callNoPanic.func1()
<https://ci-beam.apache.org/job/beam_LoadTests_Go_GBK_Flink_Batch/ws/src/sdks/go/pkg/beam/core/runtime/exec/util.go>:58
+0xa5
panic({0x14a8b60, 0xc00035c1c0})
/home/jenkins/sdk/go1.20.4/src/runtime/panic.go:884 +0x213
github.com/apache/beam/sdks/v2/go/pkg/beam/register.(*emit2[...]).invoke(0x18d5ca0,
{0xc000da5d08, 0x40a92d?, 0x1?}, {0xc000da5d10?, 0x9, 0x9})
<https://ci-beam.apache.org/job/beam_LoadTests_Go_GBK_Flink_Batch/ws/src/sdks/go/pkg/beam/register/emitter.go>:81
+0x22f
github.com/apache/beam/sdks/v2/go/test/load.(*RuntimeMonitor).ProcessElement(0x13dd380?,
{0xc000da5d08?, 0xc000140860?, 0xc000208000?}, {0xc000da5d10?, 0xc0001408c0?,
0xc00021e000?}, 0xc00016bb00?)
<https://ci-beam.apache.org/job/beam_LoadTests_Go_GBK_Flink_Batch/ws/src/sdks/go/test/load/util.go>:87
+0x39
github.com/apache/beam/sdks/v2/go/pkg/beam/register.registerDoFn3x0StructWrappersAndFuncs[...].func2.1({0xc000da5d10,
0x9, 0x9}, 0x46eb2a)
<https://ci-beam.apache.org/job/beam_LoadTests_Go_GBK_Flink_Batch/ws/src/sdks/go/pkg/beam/register/register.go>:2469
+0x9c
github.com/apache/beam/sdks/v2/go/pkg/beam/register.(*caller3x0[...]).Call3x0(0x46c3a3?,
{0x12d5300?, 0xc000db7428?}, {0x12d5300?, 0xc000db7440?}, {0x13076c0?,
0xc0003522a0?})
<https://ci-beam.apache.org/job/beam_LoadTests_Go_GBK_Flink_Batch/ws/src/sdks/go/pkg/beam/register/register.go>:2458
+0x7f
github.com/apache/beam/sdks/v2/go/pkg/beam/core/runtime/exec.(*invoker).initCall.func4({0x0,
0x0, 0x0, 0x0, 0x0}, {0x23c6b90?, 0x1?, 0x1?}, 0xffdf3b645a1cac09?)
<https://ci-beam.apache.org/job/beam_LoadTests_Go_GBK_Flink_Batch/ws/src/sdks/go/pkg/beam/core/runtime/exec/fn_arity.go>:55
+0x75
github.com/apache/beam/sdks/v2/go/pkg/beam/core/runtime/exec.(*invoker).invokeWithOpts(0xc0000b8a00,
{0x18d4590?, 0xc00035c080}, {0x0, 0x0, 0x0, 0x0, 0x0}, {0x23c6b90, 0x1, ...},
...)
<https://ci-beam.apache.org/job/beam_LoadTests_Go_GBK_Flink_Batch/ws/src/sdks/go/pkg/beam/core/runtime/exec/fn.go>:297
+0xfec
github.com/apache/beam/sdks/v2/go/pkg/beam/core/runtime/exec.(*ParDo).invokeProcessFn(0xc000323200,
{0x18d4590, 0xc00035c080}, {0x0, 0x0, 0x0, 0x0, 0x0}, {0x23c6b90, 0x1, ...},
...)
<https://ci-beam.apache.org/job/beam_LoadTests_Go_GBK_Flink_Batch/ws/src/sdks/go/pkg/beam/core/runtime/exec/pardo.go>:508
+0x2b5
github.com/apache/beam/sdks/v2/go/pkg/beam/core/runtime/exec.(*ParDo).processSingleWindow(0xc000323200,
0xc000db8990)
<https://ci-beam.apache.org/job/beam_LoadTests_Go_GBK_Flink_Batch/ws/src/sdks/go/pkg/beam/core/runtime/exec/pardo.go>:194
+0x9b
github.com/apache/beam/sdks/v2/go/pkg/beam/core/runtime/exec.(*ParDo).processMainInput(0x155?,
0x18d4590?)
<https://ci-beam.apache.org/job/beam_LoadTests_Go_GBK_Flink_Batch/ws/src/sdks/go/pkg/beam/core/runtime/exec/pardo.go>:172
+0x91
github.com/apache/beam/sdks/v2/go/pkg/beam/core/runtime/exec.(*ParDo).ProcessElement(0xc000323200,
{0x18?, 0xc000062400?}, 0xc00047bf28, {0x0, 0x0, 0x0})
<https://ci-beam.apache.org/job/beam_LoadTests_Go_GBK_Flink_Batch/ws/src/sdks/go/pkg/beam/core/runtime/exec/pardo.go>:156
+0x125
github.com/apache/beam/sdks/v2/go/pkg/beam/core/runtime/exec.(*PCollection).ProcessElement(0xc000da5d10?,
{0x18d4590?, 0xc00035c040?}, 0x4214e7?, {0x0?, 0x200?, 0x1c0?})
<https://ci-beam.apache.org/job/beam_LoadTests_Go_GBK_Flink_Batch/ws/src/sdks/go/pkg/beam/core/runtime/exec/pcollection.go>:100
+0x151
github.com/apache/beam/sdks/v2/go/pkg/beam/register.(*emit2[...]).invoke(0x18d5ca0,
{0xc000da5d08, 0xc0002a06e8?, 0x18c27a0?}, {0xc000da5d10?, 0x9, 0x9})
<https://ci-beam.apache.org/job/beam_LoadTests_Go_GBK_Flink_Batch/ws/src/sdks/go/pkg/beam/register/emitter.go>:80
+0x20f
github.com/apache/beam/sdks/v2/go/pkg/beam/io/synthetic.(*sourceFn).ProcessElement(0xc00047da40,
0x7f349f9ad5b8?, {0xbebc200, 0x1, 0x1, 0x9, 0x0, 0x0}, 0xc0003527e0)
<https://ci-beam.apache.org/job/beam_LoadTests_Go_GBK_Flink_Batch/ws/src/sdks/go/pkg/beam/io/synthetic/source.go>:151
+0x123
github.com/apache/beam/sdks/v2/go/pkg/beam/register.registerDoFn3x1StructWrappersAndFuncs[...].func2.1({0xbebc200?,
0x1, 0x1, 0x9, 0x0, 0x0}, 0x0)
<https://ci-beam.apache.org/job/beam_LoadTests_Go_GBK_Flink_Batch/ws/src/sdks/go/pkg/beam/register/register.go>:3382
+0xb0
github.com/apache/beam/sdks/v2/go/pkg/beam/register.(*caller3x1[...]).Call3x1(0x0?,
{0x1584560?, 0xc0003527b0?}, {0x15db1e0?, 0xc0000ffbf0?}, {0x13076c0?,
0xc0003527e0?})
<https://ci-beam.apache.org/job/beam_LoadTests_Go_GBK_Flink_Batch/ws/src/sdks/go/pkg/beam/register/register.go>:3371
+0xb6
github.com/apache/beam/sdks/v2/go/pkg/beam/core/runtime/exec.(*invoker).initCall.func13({0x0,
0x0, 0x0, 0x0, 0x0}, {0x23c6b90, 0x1, 0x1}, 0x7f349f9ad5b8?)
<https://ci-beam.apache.org/job/beam_LoadTests_Go_GBK_Flink_Batch/ws/src/sdks/go/pkg/beam/core/runtime/exec/fn_arity.go>:109
+0xad
github.com/apache/beam/sdks/v2/go/pkg/beam/core/runtime/exec.(*invoker).invokeWithOpts(0xc0000b9040,
{0x18d4590?, 0xc00035c040}, {0x0, 0x0, 0x0, 0x0, 0x0}, {0x23c6b90, 0x1, ...},
...)
<https://ci-beam.apache.org/job/beam_LoadTests_Go_GBK_Flink_Batch/ws/src/sdks/go/pkg/beam/core/runtime/exec/fn.go>:297
+0xfec
github.com/apache/beam/sdks/v2/go/pkg/beam/core/runtime/exec.(*ParDo).invokeProcessFn(0xc000323440,
{0x18d4590, 0xc00035c040}, {0x0, 0x0, 0x0, 0x0, 0x0}, {0x23c6b90, 0x1, ...},
...)
<https://ci-beam.apache.org/job/beam_LoadTests_Go_GBK_Flink_Batch/ws/src/sdks/go/pkg/beam/core/runtime/exec/pardo.go>:508
+0x2b5
github.com/apache/beam/sdks/v2/go/pkg/beam/core/runtime/exec.(*ParDo).processSingleWindow(0xc000323440,
0xc000334cf0)
<https://ci-beam.apache.org/job/beam_LoadTests_Go_GBK_Flink_Batch/ws/src/sdks/go/pkg/beam/core/runtime/exec/pardo.go>:194
+0x9b
github.com/apache/beam/sdks/v2/go/pkg/beam/core/runtime/exec.(*ProcessSizedElementsAndRestrictions).ProcessElement(0xc000355180,
{0x18d4590, 0xc000413a40}, 0xc0000ad420, {0x0, 0x0, 0x0})
<https://ci-beam.apache.org/job/beam_LoadTests_Go_GBK_Flink_Batch/ws/src/sdks/go/pkg/beam/core/runtime/exec/sdf.go>:556
+0x63d
github.com/apache/beam/sdks/v2/go/pkg/beam/core/runtime/exec.(*DataSource).Process.func1(0xc0003522b8,
{0xc0002a1340?, 0xc000467f80?})
<https://ci-beam.apache.org/job/beam_LoadTests_Go_GBK_Flink_Batch/ws/src/sdks/go/pkg/beam/core/runtime/exec/datasource.go>:241
+0x21e
github.com/apache/beam/sdks/v2/go/pkg/beam/core/runtime/exec.(*DataSource).process(0xc0003e94a0,
{0x18d4590, 0xc000413a40}, 0xc0002a1630, 0xc0002a1610)
<https://ci-beam.apache.org/job/beam_LoadTests_Go_GBK_Flink_Batch/ws/src/sdks/go/pkg/beam/core/runtime/exec/datasource.go>:147
+0x4f6
github.com/apache/beam/sdks/v2/go/pkg/beam/core/runtime/exec.(*DataSource).Process(0xc0003e94a0,
{0x18d4590, 0xc000413a40})
<https://ci-beam.apache.org/job/beam_LoadTests_Go_GBK_Flink_Batch/ws/src/sdks/go/pkg/beam/core/runtime/exec/datasource.go>:215
+0x226
github.com/apache/beam/sdks/v2/go/pkg/beam/core/runtime/exec.(*Plan).Execute.func2({0x18d4590?,
0xc000413a40?})
<https://ci-beam.apache.org/job/beam_LoadTests_Go_GBK_Flink_Batch/ws/src/sdks/go/pkg/beam/core/runtime/exec/plan.go>:151
+0x42
github.com/apache/beam/sdks/v2/go/pkg/beam/core/runtime/exec.callNoPanic({0x18d4590?,
0xc000413a40?}, 0x415d70?)
<https://ci-beam.apache.org/job/beam_LoadTests_Go_GBK_Flink_Batch/ws/src/sdks/go/pkg/beam/core/runtime/exec/util.go>:62
+0x6c
github.com/apache/beam/sdks/v2/go/pkg/beam/core/runtime/exec.(*Plan).Execute(0xc000334990,
{0x18d4590, 0xc000413a40}, {0x236dd28, 0x1}, {{0x18c63f0?, 0xc00031df80?},
{0x19009d8?, 0xc000331e90?}})
<https://ci-beam.apache.org/job/beam_LoadTests_Go_GBK_Flink_Batch/ws/src/sdks/go/pkg/beam/core/runtime/exec/plan.go>:150
+0x3df
github.com/apache/beam/sdks/v2/go/pkg/beam/core/runtime/harness.(*control).handleInstruction(0xc0003dc000,
{0x18d4478?, 0xc0000f8c90?}, 0xc0002ba0f0)
<https://ci-beam.apache.org/job/beam_LoadTests_Go_GBK_Flink_Batch/ws/src/sdks/go/pkg/beam/core/runtime/harness/harness.go>:408
+0xa53
github.com/apache/beam/sdks/v2/go/pkg/beam/core/runtime/harness.MainWithOptions.func4({0x18d4478?,
0xc0000f8c90?}, 0x0?)
<https://ci-beam.apache.org/job/beam_LoadTests_Go_GBK_Flink_Batch/ws/src/sdks/go/pkg/beam/core/runtime/harness/harness.go>:195
+0x7a
created by
github.com/apache/beam/sdks/v2/go/pkg/beam/core/runtime/harness.MainWithOptions
<https://ci-beam.apache.org/job/beam_LoadTests_Go_GBK_Flink_Batch/ws/src/sdks/go/pkg/beam/core/runtime/harness/harness.go>:213
+0xf1d
at
org.apache.beam.runners.fnexecution.control.FnApiControlClient$ResponseStreamObserver.onNext(FnApiControlClient.java:180)
at
org.apache.beam.runners.fnexecution.control.FnApiControlClient$ResponseStreamObserver.onNext(FnApiControlClient.java:160)
at
org.apache.beam.vendor.grpc.v1p54p0.io.grpc.stub.ServerCalls$StreamingServerCallHandler$StreamingServerCallListener.onMessage(ServerCalls.java:262)
at
org.apache.beam.vendor.grpc.v1p54p0.io.grpc.ForwardingServerCallListener.onMessage(ForwardingServerCallListener.java:33)
at
org.apache.beam.vendor.grpc.v1p54p0.io.grpc.Contexts$ContextualizedServerCallListener.onMessage(Contexts.java:76)
at
org.apache.beam.vendor.grpc.v1p54p0.io.grpc.internal.ServerCallImpl$ServerStreamListenerImpl.messagesAvailableInternal(ServerCallImpl.java:333)
at
org.apache.beam.vendor.grpc.v1p54p0.io.grpc.internal.ServerCallImpl$ServerStreamListenerImpl.messagesAvailable(ServerCallImpl.java:316)
at
org.apache.beam.vendor.grpc.v1p54p0.io.grpc.internal.ServerImpl$JumpToApplicationThreadServerStreamListener$1MessagesAvailable.runInContext(ServerImpl.java:835)
at
org.apache.beam.vendor.grpc.v1p54p0.io.grpc.internal.ContextRunnable.run(ContextRunnable.java:37)
at
org.apache.beam.vendor.grpc.v1p54p0.io.grpc.internal.SerializingExecutor.run(SerializingExecutor.java:133)
at
java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1128)
at
java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:628)
... 1 more
2023/06/27 08:08:11 (): java.lang.RuntimeException: Error received from SDK
harness for instruction 5: process bundle failed for instruction 5 using plan
1-5 : panic: datamgr.go [{5 fn/write/n4:0}]: error flushing buffer of length
4000000
caused by:
rpc error: code = Unknown desc =
Full error:
while executing Process for Plan[1-5]:
2: DataSink[S[fn/write/n4:0@localhost:38183]]
Coder:W;fn/wire/n4:0<KV;c1<bytes;c0,bytes;c0>>!GWC
3: PCollection[n4] Out:[2]
4: ParDo[load.RuntimeMonitor] Out:[2] Sig: func([]uint8, []uint8, func([]uint8,
[]uint8))
5: PCollection[n3] Out:[4]
6: SDF.ProcessSizedElementsAndRestrictions[synthetic.sourceFn] UID:6 Out:[5]
1: DataSource[S[fn/read/n2/SplitAndSize0:0@localhost:38183], local_output]
Out:6
Coder:W;fn/wire/n2/SplitAndSize0:0<KV;c5/SplitAndSize0<KV;c5/PairWithRestriction0<R;c5[synthetic.SourceConfig],KV;c9<offsetrange.Restriction[offsetrange.Restriction;c6];c7,bool;c8>>,double;DoubleCoder0>>!GWC
caused by:
panic: datamgr.go [{5 fn/write/n4:0}]: error flushing buffer of length 4000000
caused by:
rpc error: code = Unknown desc = goroutine 38 [running]:
runtime/debug.Stack()
/home/jenkins/sdk/go1.20.4/src/runtime/debug/stack.go:24 +0x65
github.com/apache/beam/sdks/v2/go/pkg/beam/core/runtime/exec.callNoPanic.func1()
<https://ci-beam.apache.org/job/beam_LoadTests_Go_GBK_Flink_Batch/ws/src/sdks/go/pkg/beam/core/runtime/exec/util.go>:58
+0xa5
panic({0x14a8b60, 0xc00035c1c0})
/home/jenkins/sdk/go1.20.4/src/runtime/panic.go:884 +0x213
github.com/apache/beam/sdks/v2/go/pkg/beam/register.(*emit2[...]).invoke(0x18d5ca0,
{0xc000da5d08, 0x40a92d?, 0x1?}, {0xc000da5d10?, 0x9, 0x9})
<https://ci-beam.apache.org/job/beam_LoadTests_Go_GBK_Flink_Batch/ws/src/sdks/go/pkg/beam/register/emitter.go>:81
+0x22f
github.com/apache/beam/sdks/v2/go/test/load.(*RuntimeMonitor).ProcessElement(0x13dd380?,
{0xc000da5d08?, 0xc000140860?, 0xc000208000?}, {0xc000da5d10?, 0xc0001408c0?,
0xc00021e000?}, 0xc00016bb00?)
<https://ci-beam.apache.org/job/beam_LoadTests_Go_GBK_Flink_Batch/ws/src/sdks/go/test/load/util.go>:87
+0x39
github.com/apache/beam/sdks/v2/go/pkg/beam/register.registerDoFn3x0StructWrappersAndFuncs[...].func2.1({0xc000da5d10,
0x9, 0x9}, 0x46eb2a)
<https://ci-beam.apache.org/job/beam_LoadTests_Go_GBK_Flink_Batch/ws/src/sdks/go/pkg/beam/register/register.go>:2469
+0x9c
github.com/apache/beam/sdks/v2/go/pkg/beam/register.(*caller3x0[...]).Call3x0(0x46c3a3?,
{0x12d5300?, 0xc000db7428?}, {0x12d5300?, 0xc000db7440?}, {0x13076c0?,
0xc0003522a0?})
<https://ci-beam.apache.org/job/beam_LoadTests_Go_GBK_Flink_Batch/ws/src/sdks/go/pkg/beam/register/register.go>:2458
+0x7f
github.com/apache/beam/sdks/v2/go/pkg/beam/core/runtime/exec.(*invoker).initCall.func4({0x0,
0x0, 0x0, 0x0, 0x0}, {0x23c6b90?, 0x1?, 0x1?}, 0xffdf3b645a1cac09?)
<https://ci-beam.apache.org/job/beam_LoadTests_Go_GBK_Flink_Batch/ws/src/sdks/go/pkg/beam/core/runtime/exec/fn_arity.go>:55
+0x75
github.com/apache/beam/sdks/v2/go/pkg/beam/core/runtime/exec.(*invoker).invokeWithOpts(0xc0000b8a00,
{0x18d4590?, 0xc00035c080}, {0x0, 0x0, 0x0, 0x0, 0x0}, {0x23c6b90, 0x1, ...},
...)
<https://ci-beam.apache.org/job/beam_LoadTests_Go_GBK_Flink_Batch/ws/src/sdks/go/pkg/beam/core/runtime/exec/fn.go>:297
+0xfec
github.com/apache/beam/sdks/v2/go/pkg/beam/core/runtime/exec.(*ParDo).invokeProcessFn(0xc000323200,
{0x18d4590, 0xc00035c080}, {0x0, 0x0, 0x0, 0x0, 0x0}, {0x23c6b90, 0x1, ...},
...)
<https://ci-beam.apache.org/job/beam_LoadTests_Go_GBK_Flink_Batch/ws/src/sdks/go/pkg/beam/core/runtime/exec/pardo.go>:508
+0x2b5
github.com/apache/beam/sdks/v2/go/pkg/beam/core/runtime/exec.(*ParDo).processSingleWindow(0xc000323200,
0xc000db8990)
<https://ci-beam.apache.org/job/beam_LoadTests_Go_GBK_Flink_Batch/ws/src/sdks/go/pkg/beam/core/runtime/exec/pardo.go>:194
+0x9b
github.com/apache/beam/sdks/v2/go/pkg/beam/core/runtime/exec.(*ParDo).processMainInput(0x155?,
0x18d4590?)
<https://ci-beam.apache.org/job/beam_LoadTests_Go_GBK_Flink_Batch/ws/src/sdks/go/pkg/beam/core/runtime/exec/pardo.go>:172
+0x91
github.com/apache/beam/sdks/v2/go/pkg/beam/core/runtime/exec.(*ParDo).ProcessElement(0xc000323200,
{0x18?, 0xc000062400?}, 0xc00047bf28, {0x0, 0x0, 0x0})
<https://ci-beam.apache.org/job/beam_LoadTests_Go_GBK_Flink_Batch/ws/src/sdks/go/pkg/beam/core/runtime/exec/pardo.go>:156
+0x125
github.com/apache/beam/sdks/v2/go/pkg/beam/core/runtime/exec.(*PCollection).ProcessElement(0xc000da5d10?,
{0x18d4590?, 0xc00035c040?}, 0x4214e7?, {0x0?, 0x200?, 0x1c0?})
<https://ci-beam.apache.org/job/beam_LoadTests_Go_GBK_Flink_Batch/ws/src/sdks/go/pkg/beam/core/runtime/exec/pcollection.go>:100
+0x151
github.com/apache/beam/sdks/v2/go/pkg/beam/register.(*emit2[...]).invoke(0x18d5ca0,
{0xc000da5d08, 0xc0002a06e8?, 0x18c27a0?}, {0xc000da5d10?, 0x9, 0x9})
<https://ci-beam.apache.org/job/beam_LoadTests_Go_GBK_Flink_Batch/ws/src/sdks/go/pkg/beam/register/emitter.go>:80
+0x20f
github.com/apache/beam/sdks/v2/go/pkg/beam/io/synthetic.(*sourceFn).ProcessElement(0xc00047da40,
0x7f349f9ad5b8?, {0xbebc200, 0x1, 0x1, 0x9, 0x0, 0x0}, 0xc0003527e0)
<https://ci-beam.apache.org/job/beam_LoadTests_Go_GBK_Flink_Batch/ws/src/sdks/go/pkg/beam/io/synthetic/source.go>:151
+0x123
github.com/apache/beam/sdks/v2/go/pkg/beam/register.registerDoFn3x1StructWrappersAndFuncs[...].func2.1({0xbebc200?,
0x1, 0x1, 0x9, 0x0, 0x0}, 0x0)
<https://ci-beam.apache.org/job/beam_LoadTests_Go_GBK_Flink_Batch/ws/src/sdks/go/pkg/beam/register/register.go>:3382
+0xb0
github.com/apache/beam/sdks/v2/go/pkg/beam/register.(*caller3x1[...]).Call3x1(0x0?,
{0x1584560?, 0xc0003527b0?}, {0x15db1e0?, 0xc0000ffbf0?}, {0x13076c0?,
0xc0003527e0?})
<https://ci-beam.apache.org/job/beam_LoadTests_Go_GBK_Flink_Batch/ws/src/sdks/go/pkg/beam/register/register.go>:3371
+0xb6
github.com/apache/beam/sdks/v2/go/pkg/beam/core/runtime/exec.(*invoker).initCall.func13({0x0,
0x0, 0x0, 0x0, 0x0}, {0x23c6b90, 0x1, 0x1}, 0x7f349f9ad5b8?)
<https://ci-beam.apache.org/job/beam_LoadTests_Go_GBK_Flink_Batch/ws/src/sdks/go/pkg/beam/core/runtime/exec/fn_arity.go>:109
+0xad
github.com/apache/beam/sdks/v2/go/pkg/beam/core/runtime/exec.(*invoker).invokeWithOpts(0xc0000b9040,
{0x18d4590?, 0xc00035c040}, {0x0, 0x0, 0x0, 0x0, 0x0}, {0x23c6b90, 0x1, ...},
...)
<https://ci-beam.apache.org/job/beam_LoadTests_Go_GBK_Flink_Batch/ws/src/sdks/go/pkg/beam/core/runtime/exec/fn.go>:297
+0xfec
github.com/apache/beam/sdks/v2/go/pkg/beam/core/runtime/exec.(*ParDo).invokeProcessFn(0xc000323440,
{0x18d4590, 0xc00035c040}, {0x0, 0x0, 0x0, 0x0, 0x0}, {0x23c6b90, 0x1, ...},
...)
<https://ci-beam.apache.org/job/beam_LoadTests_Go_GBK_Flink_Batch/ws/src/sdks/go/pkg/beam/core/runtime/exec/pardo.go>:508
+0x2b5
github.com/apache/beam/sdks/v2/go/pkg/beam/core/runtime/exec.(*ParDo).processSingleWindow(0xc000323440,
0xc000334cf0)
<https://ci-beam.apache.org/job/beam_LoadTests_Go_GBK_Flink_Batch/ws/src/sdks/go/pkg/beam/core/runtime/exec/pardo.go>:194
+0x9b
github.com/apache/beam/sdks/v2/go/pkg/beam/core/runtime/exec.(*ProcessSizedElementsAndRestrictions).ProcessElement(0xc000355180,
{0x18d4590, 0xc000413a40}, 0xc0000ad420, {0x0, 0x0, 0x0})
<https://ci-beam.apache.org/job/beam_LoadTests_Go_GBK_Flink_Batch/ws/src/sdks/go/pkg/beam/core/runtime/exec/sdf.go>:556
+0x63d
github.com/apache/beam/sdks/v2/go/pkg/beam/core/runtime/exec.(*DataSource).Process.func1(0xc0003522b8,
{0xc0002a1340?, 0xc000467f80?})
<https://ci-beam.apache.org/job/beam_LoadTests_Go_GBK_Flink_Batch/ws/src/sdks/go/pkg/beam/core/runtime/exec/datasource.go>:241
+0x21e
github.com/apache/beam/sdks/v2/go/pkg/beam/core/runtime/exec.(*DataSource).process(0xc0003e94a0,
{0x18d4590, 0xc000413a40}, 0xc0002a1630, 0xc0002a1610)
<https://ci-beam.apache.org/job/beam_LoadTests_Go_GBK_Flink_Batch/ws/src/sdks/go/pkg/beam/core/runtime/exec/datasource.go>:147
+0x4f6
github.com/apache/beam/sdks/v2/go/pkg/beam/core/runtime/exec.(*DataSource).Process(0xc0003e94a0,
{0x18d4590, 0xc000413a40})
<https://ci-beam.apache.org/job/beam_LoadTests_Go_GBK_Flink_Batch/ws/src/sdks/go/pkg/beam/core/runtime/exec/datasource.go>:215
+0x226
github.com/apache/beam/sdks/v2/go/pkg/beam/core/runtime/exec.(*Plan).Execute.func2({0x18d4590?,
0xc000413a40?})
<https://ci-beam.apache.org/job/beam_LoadTests_Go_GBK_Flink_Batch/ws/src/sdks/go/pkg/beam/core/runtime/exec/plan.go>:151
+0x42
github.com/apache/beam/sdks/v2/go/pkg/beam/core/runtime/exec.callNoPanic({0x18d4590?,
0xc000413a40?}, 0x415d70?)
<https://ci-beam.apache.org/job/beam_LoadTests_Go_GBK_Flink_Batch/ws/src/sdks/go/pkg/beam/core/runtime/exec/util.go>:62
+0x6c
github.com/apache/beam/sdks/v2/go/pkg/beam/core/runtime/exec.(*Plan).Execute(0xc000334990,
{0x18d4590, 0xc000413a40}, {0x236dd28, 0x1}, {{0x18c63f0?, 0xc00031df80?},
{0x19009d8?, 0xc000331e90?}})
<https://ci-beam.apache.org/job/beam_LoadTests_Go_GBK_Flink_Batch/ws/src/sdks/go/pkg/beam/core/runtime/exec/plan.go>:150
+0x3df
github.com/apache/beam/sdks/v2/go/pkg/beam/core/runtime/harness.(*control).handleInstruction(0xc0003dc000,
{0x18d4478?, 0xc0000f8c90?}, 0xc0002ba0f0)
<https://ci-beam.apache.org/job/beam_LoadTests_Go_GBK_Flink_Batch/ws/src/sdks/go/pkg/beam/core/runtime/harness/harness.go>:408
+0xa53
github.com/apache/beam/sdks/v2/go/pkg/beam/core/runtime/harness.MainWithOptions.func4({0x18d4478?,
0xc0000f8c90?}, 0x0?)
<https://ci-beam.apache.org/job/beam_LoadTests_Go_GBK_Flink_Batch/ws/src/sdks/go/pkg/beam/core/runtime/harness/harness.go>:195
+0x7a
created by
github.com/apache/beam/sdks/v2/go/pkg/beam/core/runtime/harness.MainWithOptions
<https://ci-beam.apache.org/job/beam_LoadTests_Go_GBK_Flink_Batch/ws/src/sdks/go/pkg/beam/core/runtime/harness/harness.go>:213
+0xf1d
2023/06/27 08:08:11 Job state: FAILED
2023/06/27 08:08:11 Failed to execute job: job
load0tests0go0flink0batch0gbk0100627065408-root-0627080555-e95c3ec4_48fc400c-3731-4e42-add0-6c1cd6e7c1f6
failed
panic: Failed to execute job: job
load0tests0go0flink0batch0gbk0100627065408-root-0627080555-e95c3ec4_48fc400c-3731-4e42-add0-6c1cd6e7c1f6
failed
goroutine 1 [running]:
github.com/apache/beam/sdks/v2/go/pkg/beam/log.Fatalf({0x18d4408,
0xc00004c0c0}, {0x174e8bd?, 0x2419470?}, {0xc0003a5e70?, 0x0?, 0x0?})
<https://ci-beam.apache.org/job/beam_LoadTests_Go_GBK_Flink_Batch/ws/src/sdks/go/pkg/beam/log/log.go>:162
+0x8c
main.main()
<https://ci-beam.apache.org/job/beam_LoadTests_Go_GBK_Flink_Batch/ws/src/sdks/go/test/load/group_by_key/group_by_key.go>:98
+0x3eb
> Task :sdks:go:test:load:run FAILED
FAILURE: Build failed with an exception.
* Where:
Build file
'<https://ci-beam.apache.org/job/beam_LoadTests_Go_GBK_Flink_Batch/ws/src/sdks/go/test/load/build.gradle'>
line: 31
* What went wrong:
Execution failed for task ':sdks:go:test:load:run'.
> Process 'command 'sh'' finished with non-zero exit value 2
* Try:
> Run with --stacktrace option to get the stack trace.
> Run with --info or --debug option to get more log output.
* Get more help at https://help.gradle.org
BUILD FAILED in 2m 55s
12 actionable tasks: 6 executed, 4 from cache, 2 up-to-date
Publishing build scan...
https://ge.apache.org/s/we3slv3iapmpi
Build step 'Invoke Gradle script' changed build result to FAILURE
Build step 'Invoke Gradle script' marked build as failure
---------------------------------------------------------------------
To unsubscribe, e-mail: [email protected]
For additional commands, e-mail: [email protected]
