See
<https://ci-beam.apache.org/job/beam_LoadTests_Go_SideInput_Flink_Batch/701/display/redirect?page=changes>
Changes:
[bulat.safiullin] [Website] change share-your-story link, add text to
ADD_CASE_STUDY.md,
[Robert Bradshaw] Add a portable runner that renders pipelines as a dot graph.
[Robert Bradshaw] Add basic tests for render runner.
[Robert Bradshaw] Add the ability to pass a pipeline proto directly.
[Robert Bradshaw] lint
[mr.malarg] pg_23865 fix selected example at list
[leha] Expand all categories that contain a selected example (#23865)
[Valentyn Tymofieiev] Fix typo.
[Valentyn Tymofieiev] Serve the graph when output file is not specified.
[Valentyn Tymofieiev] Serve the graph when output file is not specified.
[Valentyn Tymofieiev] Fix parsing of standalone protos.
[Valentyn Tymofieiev] Support reading from GCS.
[Valentyn Tymofieiev] Add text logging.
[Valentyn Tymofieiev] fix typo.
[Valentyn Tymofieiev] Some lint and yapf.
[Robert Bradshaw] Fix dot detection logic.
[Robert Bradshaw] fix error detected by lint
[Robert Bradshaw] Make gcs an optional dependency.
[Robert Bradshaw] return rather than sys.exit
[kn1kn1] Fix mvn command to refer the GCP_REGION variable
[Robert Bradshaw] lint
[noreply] Bump github.com/aws/aws-sdk-go-v2/feature/s3/manager in /sdks (#24280)
[noreply] Copy editing the machine learning pages (#24301)
[noreply] TensorRT Custom Inference Function Implementation (#24039)
[noreply] Teach Azure Filesystem to authenticate using DefaultAzureCredential in
[noreply] Apply suggestions from code review
[noreply] Add retry to test connections (#23757)
[Robert Bradshaw] More cleanup, mypy.
[noreply] fixed typo
[noreply] [#24266] Update release candidate script to use -PisRelease (#24269)
[noreply] Golang SpannerIO Implementation (#23285)
[noreply] Add rootCaCertificate option to SplunkIO (#24229)
[noreply] [Playground] Remove example bucket (#24198)
[noreply] Extract Go and Python Beam symbols for Playground (#23378)
[noreply] Dask runner tests action (#24324)
[Robert Bradshaw] lint
------------------------------------------
[...truncated 40.03 KB...]
at
org.apache.flink.runtime.rpc.akka.AkkaRpcActor.handleRpcInvocation(AkkaRpcActor.java:302)
at
org.apache.flink.runtime.rpc.akka.AkkaRpcActor.handleRpcMessage(AkkaRpcActor.java:217)
at
org.apache.flink.runtime.rpc.akka.FencedAkkaRpcActor.handleRpcMessage(FencedAkkaRpcActor.java:78)
at
org.apache.flink.runtime.rpc.akka.AkkaRpcActor.handleMessage(AkkaRpcActor.java:163)
at akka.japi.pf.UnitCaseStatement.apply(CaseStatements.scala:24)
at akka.japi.pf.UnitCaseStatement.apply(CaseStatements.scala:20)
at scala.PartialFunction.applyOrElse(PartialFunction.scala:127)
at scala.PartialFunction.applyOrElse$(PartialFunction.scala:126)
at akka.japi.pf.UnitCaseStatement.applyOrElse(CaseStatements.scala:20)
at scala.PartialFunction$OrElse.applyOrElse(PartialFunction.scala:175)
at scala.PartialFunction$OrElse.applyOrElse(PartialFunction.scala:176)
at scala.PartialFunction$OrElse.applyOrElse(PartialFunction.scala:176)
at akka.actor.Actor.aroundReceive(Actor.scala:537)
at akka.actor.Actor.aroundReceive$(Actor.scala:535)
at akka.actor.AbstractActor.aroundReceive(AbstractActor.scala:220)
at akka.actor.ActorCell.receiveMessage(ActorCell.scala:580)
at akka.actor.ActorCell.invoke(ActorCell.scala:548)
at akka.dispatch.Mailbox.processMailbox(Mailbox.scala:270)
at akka.dispatch.Mailbox.run(Mailbox.scala:231)
at akka.dispatch.Mailbox.exec(Mailbox.scala:243)
at java.util.concurrent.ForkJoinTask.doExec(ForkJoinTask.java:290)
at
java.util.concurrent.ForkJoinPool$WorkQueue.topLevelExec(ForkJoinPool.java:1020)
at java.util.concurrent.ForkJoinPool.scan(ForkJoinPool.java:1656)
at java.util.concurrent.ForkJoinPool.runWorker(ForkJoinPool.java:1594)
at
java.util.concurrent.ForkJoinWorkerThread.run(ForkJoinWorkerThread.java:183)
Caused by: java.util.concurrent.ExecutionException: java.lang.RuntimeException:
Error received from SDK harness for instruction 2: process bundle failed for
instruction 2 using plan 2-2 : panic: broken stream:
StateChannel[localhost:38469].Send(r1): context canceled
caused by:
rpc error: code = Internal desc = unexpected EOF
Full error:
while executing Process for Plan[2-2]:
2: Discard
3: PCollection[n8] Out:[2]
4: ParDo[load.RuntimeMonitor] Out:[3]
5: PCollection[n7] Out:[4]
6: ParDo[main.iterSideInputFn] Out:[5]
1: DataSource[S[fn/read/n6:0@localhost:45253], local_output]
Coder:W;fn/wire/n6:0<KV;c2<bytes;c0,bytes;c0>>!GWC Out:6
caused by:
panic: broken stream: StateChannel[localhost:38469].Send(r1): context canceled
caused by:
rpc error: code = Internal desc = unexpected EOF goroutine 47 [running]:
runtime/debug.Stack()
/home/jenkins/sdk/go1.19.3/src/runtime/debug/stack.go:24 +0x65
github.com/apache/beam/sdks/v2/go/pkg/beam/core/runtime/exec.callNoPanic.func1()
<https://ci-beam.apache.org/job/beam_LoadTests_Go_SideInput_Flink_Batch/ws/src/sdks/go/pkg/beam/core/runtime/exec/util.go>:58
+0xa5
panic({0x122e580, 0xc000268580})
/home/jenkins/sdk/go1.19.3/src/runtime/panic.go:884 +0x212
github.com/apache/beam/sdks/v2/go/pkg/beam/register.(*iter2[...]).invoke(0x18,
0xc0002ed098?, 0xc0002ed0b0)
<https://ci-beam.apache.org/job/beam_LoadTests_Go_SideInput_Flink_Batch/ws/src/sdks/go/pkg/beam/register/iter.go>:103
+0x189
main.(*iterSideInputFn).ProcessElement(0xc000373708, {0xfffba4?, 0x12b1c60?,
0x7f4fc7948598?}, {0x58?, 0x7f4fef72a5b8?, 0x70?}, 0xc0002ec198, 0xc0002ec180)
<https://ci-beam.apache.org/job/beam_LoadTests_Go_SideInput_Flink_Batch/ws/src/sdks/go/test/load/sideinput/sideinput.go>:70
+0xb7
github.com/apache/beam/sdks/v2/go/pkg/beam/register.registerDoFn4x0StructWrappersAndFuncs[...].func2.1({0x226c8a8,
0x0, 0x0}, 0x0, 0x0)
<https://ci-beam.apache.org/job/beam_LoadTests_Go_SideInput_Flink_Batch/ws/src/sdks/go/pkg/beam/register/register.go>:2552
+0xae
github.com/apache/beam/sdks/v2/go/pkg/beam/register.(*caller4x0[...]).Call4x0(0x0?,
{0x12172c0?, 0xc0002ec150?}, {0x12172c0?, 0xc0002ec168?}, {0x12669e0?,
0xc0002ec198?}, {0x1240ba0, 0xc0002ec180})
<https://ci-beam.apache.org/job/beam_LoadTests_Go_SideInput_Flink_Batch/ws/src/sdks/go/pkg/beam/register/register.go>:2541
+0x9e
github.com/apache/beam/sdks/v2/go/pkg/beam/core/runtime/exec.(*invoker).initCall.func5({0x0,
0x0, 0x0, 0xffffffffffffffff, 0xffffffffffffffff}, {0x12172c0?,
0x7f4fc58e1218?, 0x20?}, 0x7f4fef72a5b8?)
<https://ci-beam.apache.org/job/beam_LoadTests_Go_SideInput_Flink_Batch/ws/src/sdks/go/pkg/beam/core/runtime/exec/fn_arity.go>:61
+0x83
github.com/apache/beam/sdks/v2/go/pkg/beam/core/runtime/exec.(*invoker).Invoke(0xc0000032c0,
{0x17f1f70?, 0xc0003e34c0}, {0x0, 0x0, 0x0, 0xffffffffffffffff,
0xffffffffffffffff}, {0x221c140, 0x1, ...}, ...)
<https://ci-beam.apache.org/job/beam_LoadTests_Go_SideInput_Flink_Batch/ws/src/sdks/go/pkg/beam/core/runtime/exec/fn.go>:252
+0xe23
github.com/apache/beam/sdks/v2/go/pkg/beam/core/runtime/exec.(*ParDo).invokeProcessFn(0xc0000c9400,
{0x17f1f70, 0xc0003e34c0}, {0x0, 0x0, 0x0, 0xffffffffffffffff,
0xffffffffffffffff}, {0x221c140, 0x1, ...}, ...)
<https://ci-beam.apache.org/job/beam_LoadTests_Go_SideInput_Flink_Batch/ws/src/sdks/go/pkg/beam/core/runtime/exec/pardo.go>:359
+0x25e
github.com/apache/beam/sdks/v2/go/pkg/beam/core/runtime/exec.(*ParDo).processSingleWindow(0xc0000c9400,
0xc0003c06c0)
<https://ci-beam.apache.org/job/beam_LoadTests_Go_SideInput_Flink_Batch/ws/src/sdks/go/pkg/beam/core/runtime/exec/pardo.go>:178
+0x9b
github.com/apache/beam/sdks/v2/go/pkg/beam/core/runtime/exec.(*ParDo).processMainInput(0xc00011fe30?,
0x17f1f70?)
<https://ci-beam.apache.org/job/beam_LoadTests_Go_SideInput_Flink_Batch/ws/src/sdks/go/pkg/beam/core/runtime/exec/pardo.go>:156
+0x65
github.com/apache/beam/sdks/v2/go/pkg/beam/core/runtime/exec.(*ParDo).ProcessElement(0xc0000c9400,
{0x17c5b80?, 0xc00042b200?}, 0xc00011fd50, {0x0, 0x0, 0x0})
<https://ci-beam.apache.org/job/beam_LoadTests_Go_SideInput_Flink_Batch/ws/src/sdks/go/pkg/beam/core/runtime/exec/pardo.go>:141
+0x125
github.com/apache/beam/sdks/v2/go/pkg/beam/core/runtime/exec.(*DataSource).Process(0xc000002dc0,
{0x17f1f70, 0xc0003e3140})
<https://ci-beam.apache.org/job/beam_LoadTests_Go_SideInput_Flink_Batch/ws/src/sdks/go/pkg/beam/core/runtime/exec/datasource.go>:187
+0x4a8
github.com/apache/beam/sdks/v2/go/pkg/beam/core/runtime/exec.callNoPanic({0x17f1f70?,
0xc0003e3140?}, 0x0?)
<https://ci-beam.apache.org/job/beam_LoadTests_Go_SideInput_Flink_Batch/ws/src/sdks/go/pkg/beam/core/runtime/exec/util.go>:62
+0x6c
github.com/apache/beam/sdks/v2/go/pkg/beam/core/runtime/exec.(*Plan).Execute(0xc0001cbdc0,
{0x17f1f70, 0xc0003e3140}, {0x21d8290, 0x1}, {{0x17d1100?, 0xc0004feff0?},
{0x1853cb8?, 0xc0004ff020?}})
<https://ci-beam.apache.org/job/beam_LoadTests_Go_SideInput_Flink_Batch/ws/src/sdks/go/pkg/beam/core/runtime/exec/plan.go>:129
+0x394
github.com/apache/beam/sdks/v2/go/pkg/beam/core/runtime/harness.(*control).handleInstruction(0xc00026a000,
{0x17f1e58, 0xc00001e2a0}, 0xc000095e00)
<https://ci-beam.apache.org/job/beam_LoadTests_Go_SideInput_Flink_Batch/ws/src/sdks/go/pkg/beam/core/runtime/harness/harness.go>:407
+0xab7
github.com/apache/beam/sdks/v2/go/pkg/beam/core/runtime/harness.Main.func4({0x17f1e58,
0xc00001e2a0}, 0xc000095e00)
<https://ci-beam.apache.org/job/beam_LoadTests_Go_SideInput_Flink_Batch/ws/src/sdks/go/pkg/beam/core/runtime/harness/harness.go>:193
+0x19d
created by github.com/apache/beam/sdks/v2/go/pkg/beam/core/runtime/harness.Main
<https://ci-beam.apache.org/job/beam_LoadTests_Go_SideInput_Flink_Batch/ws/src/sdks/go/pkg/beam/core/runtime/harness/harness.go>:212
+0xfed
at
java.util.concurrent.CompletableFuture.reportGet(CompletableFuture.java:395)
at
java.util.concurrent.CompletableFuture.get(CompletableFuture.java:1999)
at org.apache.beam.sdk.util.MoreFutures.get(MoreFutures.java:61)
at
org.apache.beam.runners.fnexecution.control.SdkHarnessClient$BundleProcessor$ActiveBundle.close(SdkHarnessClient.java:504)
at
org.apache.beam.runners.fnexecution.control.DefaultJobBundleFactory$SimpleStageBundleFactory$1.close(DefaultJobBundleFactory.java:555)
at
org.apache.beam.runners.flink.translation.functions.FlinkExecutableStageFunction.$closeResource(FlinkExecutableStageFunction.java:269)
at
org.apache.beam.runners.flink.translation.functions.FlinkExecutableStageFunction.mapPartition(FlinkExecutableStageFunction.java:269)
at
org.apache.flink.runtime.operators.MapPartitionDriver.run(MapPartitionDriver.java:113)
at org.apache.flink.runtime.operators.BatchTask.run(BatchTask.java:514)
at
org.apache.flink.runtime.operators.BatchTask.invoke(BatchTask.java:357)
at
org.apache.flink.runtime.taskmanager.Task.runWithSystemExitMonitoring(Task.java:948)
at
org.apache.flink.runtime.taskmanager.Task.restoreAndInvoke(Task.java:927)
at org.apache.flink.runtime.taskmanager.Task.doRun(Task.java:741)
at org.apache.flink.runtime.taskmanager.Task.run(Task.java:563)
at java.lang.Thread.run(Thread.java:829)
Caused by: java.lang.RuntimeException: Error received from SDK harness for
instruction 2: process bundle failed for instruction 2 using plan 2-2 : panic:
broken stream: StateChannel[localhost:38469].Send(r1): context canceled
caused by:
rpc error: code = Internal desc = unexpected EOF
Full error:
while executing Process for Plan[2-2]:
2: Discard
3: PCollection[n8] Out:[2]
4: ParDo[load.RuntimeMonitor] Out:[3]
5: PCollection[n7] Out:[4]
6: ParDo[main.iterSideInputFn] Out:[5]
1: DataSource[S[fn/read/n6:0@localhost:45253], local_output]
Coder:W;fn/wire/n6:0<KV;c2<bytes;c0,bytes;c0>>!GWC Out:6
caused by:
panic: broken stream: StateChannel[localhost:38469].Send(r1): context canceled
caused by:
rpc error: code = Internal desc = unexpected EOF goroutine 47 [running]:
runtime/debug.Stack()
/home/jenkins/sdk/go1.19.3/src/runtime/debug/stack.go:24 +0x65
github.com/apache/beam/sdks/v2/go/pkg/beam/core/runtime/exec.callNoPanic.func1()
<https://ci-beam.apache.org/job/beam_LoadTests_Go_SideInput_Flink_Batch/ws/src/sdks/go/pkg/beam/core/runtime/exec/util.go>:58
+0xa5
panic({0x122e580, 0xc000268580})
/home/jenkins/sdk/go1.19.3/src/runtime/panic.go:884 +0x212
github.com/apache/beam/sdks/v2/go/pkg/beam/register.(*iter2[...]).invoke(0x18,
0xc0002ed098?, 0xc0002ed0b0)
<https://ci-beam.apache.org/job/beam_LoadTests_Go_SideInput_Flink_Batch/ws/src/sdks/go/pkg/beam/register/iter.go>:103
+0x189
main.(*iterSideInputFn).ProcessElement(0xc000373708, {0xfffba4?, 0x12b1c60?,
0x7f4fc7948598?}, {0x58?, 0x7f4fef72a5b8?, 0x70?}, 0xc0002ec198, 0xc0002ec180)
<https://ci-beam.apache.org/job/beam_LoadTests_Go_SideInput_Flink_Batch/ws/src/sdks/go/test/load/sideinput/sideinput.go>:70
+0xb7
github.com/apache/beam/sdks/v2/go/pkg/beam/register.registerDoFn4x0StructWrappersAndFuncs[...].func2.1({0x226c8a8,
0x0, 0x0}, 0x0, 0x0)
<https://ci-beam.apache.org/job/beam_LoadTests_Go_SideInput_Flink_Batch/ws/src/sdks/go/pkg/beam/register/register.go>:2552
+0xae
github.com/apache/beam/sdks/v2/go/pkg/beam/register.(*caller4x0[...]).Call4x0(0x0?,
{0x12172c0?, 0xc0002ec150?}, {0x12172c0?, 0xc0002ec168?}, {0x12669e0?,
0xc0002ec198?}, {0x1240ba0, 0xc0002ec180})
<https://ci-beam.apache.org/job/beam_LoadTests_Go_SideInput_Flink_Batch/ws/src/sdks/go/pkg/beam/register/register.go>:2541
+0x9e
github.com/apache/beam/sdks/v2/go/pkg/beam/core/runtime/exec.(*invoker).initCall.func5({0x0,
0x0, 0x0, 0xffffffffffffffff, 0xffffffffffffffff}, {0x12172c0?,
0x7f4fc58e1218?, 0x20?}, 0x7f4fef72a5b8?)
<https://ci-beam.apache.org/job/beam_LoadTests_Go_SideInput_Flink_Batch/ws/src/sdks/go/pkg/beam/core/runtime/exec/fn_arity.go>:61
+0x83
github.com/apache/beam/sdks/v2/go/pkg/beam/core/runtime/exec.(*invoker).Invoke(0xc0000032c0,
{0x17f1f70?, 0xc0003e34c0}, {0x0, 0x0, 0x0, 0xffffffffffffffff,
0xffffffffffffffff}, {0x221c140, 0x1, ...}, ...)
<https://ci-beam.apache.org/job/beam_LoadTests_Go_SideInput_Flink_Batch/ws/src/sdks/go/pkg/beam/core/runtime/exec/fn.go>:252
+0xe23
github.com/apache/beam/sdks/v2/go/pkg/beam/core/runtime/exec.(*ParDo).invokeProcessFn(0xc0000c9400,
{0x17f1f70, 0xc0003e34c0}, {0x0, 0x0, 0x0, 0xffffffffffffffff,
0xffffffffffffffff}, {0x221c140, 0x1, ...}, ...)
<https://ci-beam.apache.org/job/beam_LoadTests_Go_SideInput_Flink_Batch/ws/src/sdks/go/pkg/beam/core/runtime/exec/pardo.go>:359
+0x25e
github.com/apache/beam/sdks/v2/go/pkg/beam/core/runtime/exec.(*ParDo).processSingleWindow(0xc0000c9400,
0xc0003c06c0)
<https://ci-beam.apache.org/job/beam_LoadTests_Go_SideInput_Flink_Batch/ws/src/sdks/go/pkg/beam/core/runtime/exec/pardo.go>:178
+0x9b
github.com/apache/beam/sdks/v2/go/pkg/beam/core/runtime/exec.(*ParDo).processMainInput(0xc00011fe30?,
0x17f1f70?)
<https://ci-beam.apache.org/job/beam_LoadTests_Go_SideInput_Flink_Batch/ws/src/sdks/go/pkg/beam/core/runtime/exec/pardo.go>:156
+0x65
github.com/apache/beam/sdks/v2/go/pkg/beam/core/runtime/exec.(*ParDo).ProcessElement(0xc0000c9400,
{0x17c5b80?, 0xc00042b200?}, 0xc00011fd50, {0x0, 0x0, 0x0})
<https://ci-beam.apache.org/job/beam_LoadTests_Go_SideInput_Flink_Batch/ws/src/sdks/go/pkg/beam/core/runtime/exec/pardo.go>:141
+0x125
github.com/apache/beam/sdks/v2/go/pkg/beam/core/runtime/exec.(*DataSource).Process(0xc000002dc0,
{0x17f1f70, 0xc0003e3140})
<https://ci-beam.apache.org/job/beam_LoadTests_Go_SideInput_Flink_Batch/ws/src/sdks/go/pkg/beam/core/runtime/exec/datasource.go>:187
+0x4a8
github.com/apache/beam/sdks/v2/go/pkg/beam/core/runtime/exec.callNoPanic({0x17f1f70?,
0xc0003e3140?}, 0x0?)
<https://ci-beam.apache.org/job/beam_LoadTests_Go_SideInput_Flink_Batch/ws/src/sdks/go/pkg/beam/core/runtime/exec/util.go>:62
+0x6c
github.com/apache/beam/sdks/v2/go/pkg/beam/core/runtime/exec.(*Plan).Execute(0xc0001cbdc0,
{0x17f1f70, 0xc0003e3140}, {0x21d8290, 0x1}, {{0x17d1100?, 0xc0004feff0?},
{0x1853cb8?, 0xc0004ff020?}})
<https://ci-beam.apache.org/job/beam_LoadTests_Go_SideInput_Flink_Batch/ws/src/sdks/go/pkg/beam/core/runtime/exec/plan.go>:129
+0x394
github.com/apache/beam/sdks/v2/go/pkg/beam/core/runtime/harness.(*control).handleInstruction(0xc00026a000,
{0x17f1e58, 0xc00001e2a0}, 0xc000095e00)
<https://ci-beam.apache.org/job/beam_LoadTests_Go_SideInput_Flink_Batch/ws/src/sdks/go/pkg/beam/core/runtime/harness/harness.go>:407
+0xab7
github.com/apache/beam/sdks/v2/go/pkg/beam/core/runtime/harness.Main.func4({0x17f1e58,
0xc00001e2a0}, 0xc000095e00)
<https://ci-beam.apache.org/job/beam_LoadTests_Go_SideInput_Flink_Batch/ws/src/sdks/go/pkg/beam/core/runtime/harness/harness.go>:193
+0x19d
created by github.com/apache/beam/sdks/v2/go/pkg/beam/core/runtime/harness.Main
<https://ci-beam.apache.org/job/beam_LoadTests_Go_SideInput_Flink_Batch/ws/src/sdks/go/pkg/beam/core/runtime/harness/harness.go>:212
+0xfed
at
org.apache.beam.runners.fnexecution.control.FnApiControlClient$ResponseStreamObserver.onNext(FnApiControlClient.java:180)
at
org.apache.beam.runners.fnexecution.control.FnApiControlClient$ResponseStreamObserver.onNext(FnApiControlClient.java:160)
at
org.apache.beam.vendor.grpc.v1p48p1.io.grpc.stub.ServerCalls$StreamingServerCallHandler$StreamingServerCallListener.onMessage(ServerCalls.java:262)
at
org.apache.beam.vendor.grpc.v1p48p1.io.grpc.ForwardingServerCallListener.onMessage(ForwardingServerCallListener.java:33)
at
org.apache.beam.vendor.grpc.v1p48p1.io.grpc.Contexts$ContextualizedServerCallListener.onMessage(Contexts.java:76)
at
org.apache.beam.vendor.grpc.v1p48p1.io.grpc.internal.ServerCallImpl$ServerStreamListenerImpl.messagesAvailableInternal(ServerCallImpl.java:332)
at
org.apache.beam.vendor.grpc.v1p48p1.io.grpc.internal.ServerCallImpl$ServerStreamListenerImpl.messagesAvailable(ServerCallImpl.java:315)
at
org.apache.beam.vendor.grpc.v1p48p1.io.grpc.internal.ServerImpl$JumpToApplicationThreadServerStreamListener$1MessagesAvailable.runInContext(ServerImpl.java:834)
at
org.apache.beam.vendor.grpc.v1p48p1.io.grpc.internal.ContextRunnable.run(ContextRunnable.java:37)
at
org.apache.beam.vendor.grpc.v1p48p1.io.grpc.internal.SerializingExecutor.run(SerializingExecutor.java:133)
at
java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1128)
at
java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:628)
... 1 more
2022/11/23 12:01:16 (): java.lang.RuntimeException: Error received from SDK
harness for instruction 2: process bundle failed for instruction 2 using plan
2-2 : panic: broken stream: StateChannel[localhost:38469].Send(r1): context
canceled
caused by:
rpc error: code = Internal desc = unexpected EOF
Full error:
while executing Process for Plan[2-2]:
2: Discard
3: PCollection[n8] Out:[2]
4: ParDo[load.RuntimeMonitor] Out:[3]
5: PCollection[n7] Out:[4]
6: ParDo[main.iterSideInputFn] Out:[5]
1: DataSource[S[fn/read/n6:0@localhost:45253], local_output]
Coder:W;fn/wire/n6:0<KV;c2<bytes;c0,bytes;c0>>!GWC Out:6
caused by:
panic: broken stream: StateChannel[localhost:38469].Send(r1): context canceled
caused by:
rpc error: code = Internal desc = unexpected EOF goroutine 47 [running]:
runtime/debug.Stack()
/home/jenkins/sdk/go1.19.3/src/runtime/debug/stack.go:24 +0x65
github.com/apache/beam/sdks/v2/go/pkg/beam/core/runtime/exec.callNoPanic.func1()
<https://ci-beam.apache.org/job/beam_LoadTests_Go_SideInput_Flink_Batch/ws/src/sdks/go/pkg/beam/core/runtime/exec/util.go>:58
+0xa5
panic({0x122e580, 0xc000268580})
/home/jenkins/sdk/go1.19.3/src/runtime/panic.go:884 +0x212
github.com/apache/beam/sdks/v2/go/pkg/beam/register.(*iter2[...]).invoke(0x18,
0xc0002ed098?, 0xc0002ed0b0)
<https://ci-beam.apache.org/job/beam_LoadTests_Go_SideInput_Flink_Batch/ws/src/sdks/go/pkg/beam/register/iter.go>:103
+0x189
main.(*iterSideInputFn).ProcessElement(0xc000373708, {0xfffba4?, 0x12b1c60?,
0x7f4fc7948598?}, {0x58?, 0x7f4fef72a5b8?, 0x70?}, 0xc0002ec198, 0xc0002ec180)
<https://ci-beam.apache.org/job/beam_LoadTests_Go_SideInput_Flink_Batch/ws/src/sdks/go/test/load/sideinput/sideinput.go>:70
+0xb7
github.com/apache/beam/sdks/v2/go/pkg/beam/register.registerDoFn4x0StructWrappersAndFuncs[...].func2.1({0x226c8a8,
0x0, 0x0}, 0x0, 0x0)
<https://ci-beam.apache.org/job/beam_LoadTests_Go_SideInput_Flink_Batch/ws/src/sdks/go/pkg/beam/register/register.go>:2552
+0xae
github.com/apache/beam/sdks/v2/go/pkg/beam/register.(*caller4x0[...]).Call4x0(0x0?,
{0x12172c0?, 0xc0002ec150?}, {0x12172c0?, 0xc0002ec168?}, {0x12669e0?,
0xc0002ec198?}, {0x1240ba0, 0xc0002ec180})
<https://ci-beam.apache.org/job/beam_LoadTests_Go_SideInput_Flink_Batch/ws/src/sdks/go/pkg/beam/register/register.go>:2541
+0x9e
github.com/apache/beam/sdks/v2/go/pkg/beam/core/runtime/exec.(*invoker).initCall.func5({0x0,
0x0, 0x0, 0xffffffffffffffff, 0xffffffffffffffff}, {0x12172c0?,
0x7f4fc58e1218?, 0x20?}, 0x7f4fef72a5b8?)
<https://ci-beam.apache.org/job/beam_LoadTests_Go_SideInput_Flink_Batch/ws/src/sdks/go/pkg/beam/core/runtime/exec/fn_arity.go>:61
+0x83
github.com/apache/beam/sdks/v2/go/pkg/beam/core/runtime/exec.(*invoker).Invoke(0xc0000032c0,
{0x17f1f70?, 0xc0003e34c0}, {0x0, 0x0, 0x0, 0xffffffffffffffff,
0xffffffffffffffff}, {0x221c140, 0x1, ...}, ...)
<https://ci-beam.apache.org/job/beam_LoadTests_Go_SideInput_Flink_Batch/ws/src/sdks/go/pkg/beam/core/runtime/exec/fn.go>:252
+0xe23
github.com/apache/beam/sdks/v2/go/pkg/beam/core/runtime/exec.(*ParDo).invokeProcessFn(0xc0000c9400,
{0x17f1f70, 0xc0003e34c0}, {0x0, 0x0, 0x0, 0xffffffffffffffff,
0xffffffffffffffff}, {0x221c140, 0x1, ...}, ...)
<https://ci-beam.apache.org/job/beam_LoadTests_Go_SideInput_Flink_Batch/ws/src/sdks/go/pkg/beam/core/runtime/exec/pardo.go>:359
+0x25e
github.com/apache/beam/sdks/v2/go/pkg/beam/core/runtime/exec.(*ParDo).processSingleWindow(0xc0000c9400,
0xc0003c06c0)
<https://ci-beam.apache.org/job/beam_LoadTests_Go_SideInput_Flink_Batch/ws/src/sdks/go/pkg/beam/core/runtime/exec/pardo.go>:178
+0x9b
github.com/apache/beam/sdks/v2/go/pkg/beam/core/runtime/exec.(*ParDo).processMainInput(0xc00011fe30?,
0x17f1f70?)
<https://ci-beam.apache.org/job/beam_LoadTests_Go_SideInput_Flink_Batch/ws/src/sdks/go/pkg/beam/core/runtime/exec/pardo.go>:156
+0x65
github.com/apache/beam/sdks/v2/go/pkg/beam/core/runtime/exec.(*ParDo).ProcessElement(0xc0000c9400,
{0x17c5b80?, 0xc00042b200?}, 0xc00011fd50, {0x0, 0x0, 0x0})
<https://ci-beam.apache.org/job/beam_LoadTests_Go_SideInput_Flink_Batch/ws/src/sdks/go/pkg/beam/core/runtime/exec/pardo.go>:141
+0x125
github.com/apache/beam/sdks/v2/go/pkg/beam/core/runtime/exec.(*DataSource).Process(0xc000002dc0,
{0x17f1f70, 0xc0003e3140})
<https://ci-beam.apache.org/job/beam_LoadTests_Go_SideInput_Flink_Batch/ws/src/sdks/go/pkg/beam/core/runtime/exec/datasource.go>:187
+0x4a8
github.com/apache/beam/sdks/v2/go/pkg/beam/core/runtime/exec.callNoPanic({0x17f1f70?,
0xc0003e3140?}, 0x0?)
<https://ci-beam.apache.org/job/beam_LoadTests_Go_SideInput_Flink_Batch/ws/src/sdks/go/pkg/beam/core/runtime/exec/util.go>:62
+0x6c
github.com/apache/beam/sdks/v2/go/pkg/beam/core/runtime/exec.(*Plan).Execute(0xc0001cbdc0,
{0x17f1f70, 0xc0003e3140}, {0x21d8290, 0x1}, {{0x17d1100?, 0xc0004feff0?},
{0x1853cb8?, 0xc0004ff020?}})
<https://ci-beam.apache.org/job/beam_LoadTests_Go_SideInput_Flink_Batch/ws/src/sdks/go/pkg/beam/core/runtime/exec/plan.go>:129
+0x394
github.com/apache/beam/sdks/v2/go/pkg/beam/core/runtime/harness.(*control).handleInstruction(0xc00026a000,
{0x17f1e58, 0xc00001e2a0}, 0xc000095e00)
<https://ci-beam.apache.org/job/beam_LoadTests_Go_SideInput_Flink_Batch/ws/src/sdks/go/pkg/beam/core/runtime/harness/harness.go>:407
+0xab7
github.com/apache/beam/sdks/v2/go/pkg/beam/core/runtime/harness.Main.func4({0x17f1e58,
0xc00001e2a0}, 0xc000095e00)
<https://ci-beam.apache.org/job/beam_LoadTests_Go_SideInput_Flink_Batch/ws/src/sdks/go/pkg/beam/core/runtime/harness/harness.go>:193
+0x19d
created by github.com/apache/beam/sdks/v2/go/pkg/beam/core/runtime/harness.Main
<https://ci-beam.apache.org/job/beam_LoadTests_Go_SideInput_Flink_Batch/ws/src/sdks/go/pkg/beam/core/runtime/harness/harness.go>:212
+0xfed
2022/11/23 12:01:17 Job state: FAILED
2022/11/23 12:01:17 Failed to execute job: job
load0tests0go0flink0batch0sideinput0301123100334-root-1123120006-73b5fcc9_bcfb6719-c6e8-4979-8ee6-af0829bf518f
failed
panic: Failed to execute job: job
load0tests0go0flink0batch0sideinput0301123100334-root-1123120006-73b5fcc9_bcfb6719-c6e8-4979-8ee6-af0829bf518f
failed
goroutine 1 [running]:
github.com/apache/beam/sdks/v2/go/pkg/beam/log.Fatalf({0x17f1de8,
0xc000120000}, {0x16472eb?, 0x226c8a8?}, {0xc0003d9e60?, 0x0?, 0x0?})
<https://ci-beam.apache.org/job/beam_LoadTests_Go_SideInput_Flink_Batch/ws/src/sdks/go/pkg/beam/log/log.go>:153
+0xa5
main.main()
<https://ci-beam.apache.org/job/beam_LoadTests_Go_SideInput_Flink_Batch/ws/src/sdks/go/test/load/sideinput/sideinput.go>:104
+0x439
> Task :sdks:go:test:load:run FAILED
FAILURE: Build failed with an exception.
* Where:
Build file
'<https://ci-beam.apache.org/job/beam_LoadTests_Go_SideInput_Flink_Batch/ws/src/sdks/go/test/load/build.gradle'>
line: 31
* What went wrong:
Execution failed for task ':sdks:go:test:load:run'.
> Process 'command 'sh'' finished with non-zero exit value 2
* Try:
> Run with --stacktrace option to get the stack trace.
> Run with --info or --debug option to get more log output.
* Get more help at https://help.gradle.org
BUILD FAILED in 2m 2s
12 actionable tasks: 6 executed, 4 from cache, 2 up-to-date
Publishing build scan...
https://gradle.com/s/nrejc4rm77p52
Build step 'Invoke Gradle script' changed build result to FAILURE
Build step 'Invoke Gradle script' marked build as failure
---------------------------------------------------------------------
To unsubscribe, e-mail: [email protected]
For additional commands, e-mail: [email protected]
