Tyson Hamilton created BEAM-11493:
-------------------------------------
Summary: Spark test failure:
org.apache.beam.sdk.transforms.GroupByKeyTest$WindowTests.testGroupByKeyAndWindows
Key: BEAM-11493
URL: https://issues.apache.org/jira/browse/BEAM-11493
Project: Beam
Issue Type: Sub-task
Components: runner-spark, test-failures
Reporter: Tyson Hamilton
From:
[https://ci-beam.apache.org/job/beam_PostCommit_Java_PVR_Spark_Streaming/462/testReport/org.apache.beam.sdk.transforms/GroupByKeyTest$WindowTests/testGroupByKeyAndWindows/]
Other:
[https://ci-beam.apache.org/job/beam_PostCommit_Java_PVR_Spark_Streaming/461/testReport/org.apache.beam.sdk.transforms/GroupByKeyTest$WindowTests/testGroupByKeyAndWindows/]
[https://ci-beam.apache.org/job/beam_PostCommit_Java_PVR_Spark_Streaming/460/testReport/org.apache.beam.sdk.transforms/GroupByKeyTest$WindowTests/testGroupByKeyAndWindows/]
{code:java}
Failedorg.apache.beam.sdk.transforms.GroupByKeyTest$WindowTests.testGroupByKeyAndWindowsFailing
for the past 385 builds (Since #78 )Took 39 sec.Error
Messagejava.lang.RuntimeException: The Runner experienced the following error
during execution:
java.lang.RuntimeException: Error received from SDK harness for instruction 9:
org.apache.beam.sdk.util.UserCodeException: java.lang.AssertionError:
GroupByKey.out:
Expected: iterable with items [a KV(<"k1">, <iterable with items [<3>] in any
order>), a KV(<"k1">, <iterable with items [<4>] in any order>), a KV(<"k5">,
<iterable with items [<2147483647>, <-2147483648>] in any order>), a KV(<"k2">,
<iterable with items [<66>] in any order>), a KV(<"k2">, <iterable with items
[<-33>] in any order>), a KV(<"k3">, <iterable with items [<0>] in any order>)]
in any order
but: no item matches: a KV(<"k1">, <iterable with items [<3>] in any
order>), a KV(<"k1">, <iterable with items [<4>] in any order>), a KV(<"k5">,
<iterable with items [<2147483647>, <-2147483648>] in any order>), a KV(<"k2">,
<iterable with items [<66>] in any order>), a KV(<"k2">, <iterable with items
[<-33>] in any order>), a KV(<"k3">, <iterable with items [<0>] in any order>)
in []
at
org.apache.beam.sdk.util.UserCodeException.wrap(UserCodeException.java:39)
at
org.apache.beam.sdk.testing.PAssert$DefaultConcludeFn$DoFnInvoker.invokeProcessElement(Unknown
Source)
at
org.apache.beam.fn.harness.FnApiDoFnRunner.processElementForParDo(FnApiDoFnRunner.java:748)
at
org.apache.beam.fn.harness.data.PCollectionConsumerRegistry$MetricTrackingFnDataReceiver.accept(PCollectionConsumerRegistry.java:222)
at
org.apache.beam.fn.harness.data.PCollectionConsumerRegistry$MetricTrackingFnDataReceiver.accept(PCollectionConsumerRegistry.java:185)
at
org.apache.beam.fn.harness.FnApiDoFnRunner.outputTo(FnApiDoFnRunner.java:1678)
at
org.apache.beam.fn.harness.FnApiDoFnRunner.access$2500(FnApiDoFnRunner.java:139)
at
org.apache.beam.fn.harness.FnApiDoFnRunner$NonWindowObservingProcessBundleContext.outputWithTimestamp(FnApiDoFnRunner.java:2194)
at
org.apache.beam.fn.harness.FnApiDoFnRunner$ProcessBundleContextBase.output(FnApiDoFnRunner.java:2363)
at
org.apache.beam.sdk.testing.PAssert$GroupedValuesCheckerDoFn.processElement(PAssert.java:1444)
at
org.apache.beam.sdk.testing.PAssert$GroupedValuesCheckerDoFn$DoFnInvoker.invokeProcessElement(Unknown
Source)
at
org.apache.beam.fn.harness.FnApiDoFnRunner.processElementForParDo(FnApiDoFnRunner.java:748)
at
org.apache.beam.fn.harness.data.PCollectionConsumerRegistry$MetricTrackingFnDataReceiver.accept(PCollectionConsumerRegistry.java:222)
at
org.apache.beam.fn.harness.data.PCollectionConsumerRegistry$MetricTrackingFnDataReceiver.accept(PCollectionConsumerRegistry.java:185)
at
org.apache.beam.fn.harness.FnApiDoFnRunner.outputTo(FnApiDoFnRunner.java:1678)
at
org.apache.beam.fn.harness.FnApiDoFnRunner.access$2500(FnApiDoFnRunner.java:139)
at
org.apache.beam.fn.harness.FnApiDoFnRunner$NonWindowObservingProcessBundleContext.outputWithTimestamp(FnApiDoFnRunner.java:2194)
at
org.apache.beam.fn.harness.FnApiDoFnRunner$ProcessBundleContextBase.output(FnApiDoFnRunner.java:2363)
at
org.apache.beam.sdk.transforms.DoFnOutputReceivers$WindowedContextOutputReceiver.output(DoFnOutputReceivers.java:78)
at
org.apache.beam.sdk.transforms.MapElements$1.processElement(MapElements.java:142)
at
org.apache.beam.sdk.transforms.MapElements$1$DoFnInvoker.invokeProcessElement(Unknown
Source)
at
org.apache.beam.fn.harness.FnApiDoFnRunner.processElementForParDo(FnApiDoFnRunner.java:748)
at
org.apache.beam.fn.harness.data.PCollectionConsumerRegistry$MetricTrackingFnDataReceiver.accept(PCollectionConsumerRegistry.java:222)
at
org.apache.beam.fn.harness.data.PCollectionConsumerRegistry$MetricTrackingFnDataReceiver.accept(PCollectionConsumerRegistry.java:185)
at
org.apache.beam.fn.harness.FnApiDoFnRunner.outputTo(FnApiDoFnRunner.java:1678)
at
org.apache.beam.fn.harness.FnApiDoFnRunner.access$2500(FnApiDoFnRunner.java:139)
at
org.apache.beam.fn.harness.FnApiDoFnRunner$NonWindowObservingProcessBundleContext.outputWithTimestamp(FnApiDoFnRunner.java:2194)
at
org.apache.beam.fn.harness.FnApiDoFnRunner$ProcessBundleContextBase.output(FnApiDoFnRunner.java:2363)
at
org.apache.beam.sdk.testing.PAssert$ConcatFn.processElement(PAssert.java:1281)
at
org.apache.beam.sdk.testing.PAssert$ConcatFn$DoFnInvoker.invokeProcessElement(Unknown
Source)
at
org.apache.beam.fn.harness.FnApiDoFnRunner.processElementForParDo(FnApiDoFnRunner.java:748)
at
org.apache.beam.fn.harness.data.PCollectionConsumerRegistry$MetricTrackingFnDataReceiver.accept(PCollectionConsumerRegistry.java:222)
at
org.apache.beam.fn.harness.data.PCollectionConsumerRegistry$MetricTrackingFnDataReceiver.accept(PCollectionConsumerRegistry.java:185)
at
org.apache.beam.fn.harness.FnApiDoFnRunner.outputTo(FnApiDoFnRunner.java:1678)
at
org.apache.beam.fn.harness.FnApiDoFnRunner.access$2500(FnApiDoFnRunner.java:139)
at
org.apache.beam.fn.harness.FnApiDoFnRunner$NonWindowObservingProcessBundleContext.outputWithTimestamp(FnApiDoFnRunner.java:2194)
at
org.apache.beam.fn.harness.FnApiDoFnRunner$ProcessBundleContextBase.output(FnApiDoFnRunner.java:2363)
at
org.apache.beam.sdk.transforms.DoFnOutputReceivers$WindowedContextOutputReceiver.output(DoFnOutputReceivers.java:78)
at
org.apache.beam.sdk.transforms.MapElements$1.processElement(MapElements.java:142)
at
org.apache.beam.sdk.transforms.MapElements$1$DoFnInvoker.invokeProcessElement(Unknown
Source)
at
org.apache.beam.fn.harness.FnApiDoFnRunner.processElementForParDo(FnApiDoFnRunner.java:748)
at
org.apache.beam.fn.harness.data.PCollectionConsumerRegistry$MetricTrackingFnDataReceiver.accept(PCollectionConsumerRegistry.java:222)
at
org.apache.beam.fn.harness.data.PCollectionConsumerRegistry$MetricTrackingFnDataReceiver.accept(PCollectionConsumerRegistry.java:185)
at
org.apache.beam.fn.harness.BeamFnDataReadRunner.forwardElementToConsumer(BeamFnDataReadRunner.java:220)
at
org.apache.beam.sdk.fn.data.DecodingFnDataReceiver.accept(DecodingFnDataReceiver.java:43)
at
org.apache.beam.sdk.fn.data.DecodingFnDataReceiver.accept(DecodingFnDataReceiver.java:25)
at
org.apache.beam.fn.harness.data.QueueingBeamFnDataClient.drainAndBlock(QueueingBeamFnDataClient.java:111)
at
org.apache.beam.fn.harness.control.ProcessBundleHandler.processBundle(ProcessBundleHandler.java:304)
at
org.apache.beam.fn.harness.control.BeamFnControlClient.delegateOnInstructionRequestType(BeamFnControlClient.java:173)
at
org.apache.beam.fn.harness.control.BeamFnControlClient.lambda$processInstructionRequests$0(BeamFnControlClient.java:157)
at
java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1149)
at
java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624)
at java.lang.Thread.run(Thread.java:748)
Caused by: java.lang.AssertionError: GroupByKey.out:
Expected: iterable with items [a KV(<"k1">, <iterable with items [<3>] in any
order>), a KV(<"k1">, <iterable with items [<4>] in any order>), a KV(<"k5">,
<iterable with items [<2147483647>, <-2147483648>] in any order>), a KV(<"k2">,
<iterable with items [<66>] in any order>), a KV(<"k2">, <iterable with items
[<-33>] in any order>), a KV(<"k3">, <iterable with items [<0>] in any order>)]
in any order
but: no item matches: a KV(<"k1">, <iterable with items [<3>] in any
order>), a KV(<"k1">, <iterable with items [<4>] in any order>), a KV(<"k5">,
<iterable with items [<2147483647>, <-2147483648>] in any order>), a KV(<"k2">,
<iterable with items [<66>] in any order>), a KV(<"k2">, <iterable with items
[<-33>] in any order>), a KV(<"k3">, <iterable with items [<0>] in any order>)
in []
at
org.apache.beam.sdk.testing.PAssert$PAssertionSite.capture(PAssert.java:174)
at org.apache.beam.sdk.testing.PAssert.that(PAssert.java:416)
at org.apache.beam.sdk.testing.PAssert.that(PAssert.java:408)
at
org.apache.beam.sdk.transforms.GroupByKeyTest$WindowTests.testGroupByKeyAndWindows(GroupByKeyTest.java:509)
at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method)
at
sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:62)
at
sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43)
at java.lang.reflect.Method.invoke(Method.java:498)
at
org.junit.runners.model.FrameworkMethod$1.runReflectiveCall(FrameworkMethod.java:59)
at
org.junit.internal.runners.model.ReflectiveCallable.run(ReflectiveCallable.java:12)
at
org.junit.runners.model.FrameworkMethod.invokeExplosively(FrameworkMethod.java:56)
at
org.junit.internal.runners.statements.InvokeMethod.evaluate(InvokeMethod.java:17)
at
org.apache.beam.sdk.testing.TestPipeline$1.evaluate(TestPipeline.java:322)
at
org.junit.rules.ExpectedException$ExpectedExceptionStatement.evaluate(ExpectedException.java:266)
at org.junit.runners.ParentRunner$3.evaluate(ParentRunner.java:305)
at
org.junit.runners.BlockJUnit4ClassRunner$1.evaluate(BlockJUnit4ClassRunner.java:100)
at org.junit.runners.ParentRunner.runLeaf(ParentRunner.java:365)
at
org.junit.runners.BlockJUnit4ClassRunner.runChild(BlockJUnit4ClassRunner.java:103)
at
org.junit.runners.BlockJUnit4ClassRunner.runChild(BlockJUnit4ClassRunner.java:63)
at org.junit.runners.ParentRunner$4.run(ParentRunner.java:330)
at org.junit.runners.ParentRunner$1.schedule(ParentRunner.java:78)
at org.junit.runners.ParentRunner.runChildren(ParentRunner.java:328)
at org.junit.runners.ParentRunner.access$100(ParentRunner.java:65)
at org.junit.runners.ParentRunner$2.evaluate(ParentRunner.java:292)
at org.junit.runners.ParentRunner$3.evaluate(ParentRunner.java:305)
at org.junit.runners.ParentRunner.run(ParentRunner.java:412)
at org.junit.runners.Suite.runChild(Suite.java:128)
at org.junit.runners.Suite.runChild(Suite.java:27)
at org.junit.runners.ParentRunner$4.run(ParentRunner.java:330)
at org.junit.runners.ParentRunner$1.schedule(ParentRunner.java:78)
at org.junit.runners.ParentRunner.runChildren(ParentRunner.java:328)
at org.junit.runners.ParentRunner.access$100(ParentRunner.java:65)
at org.junit.runners.ParentRunner$2.evaluate(ParentRunner.java:292)
at org.junit.runners.ParentRunner$3.evaluate(ParentRunner.java:305)
at org.junit.runners.ParentRunner.run(ParentRunner.java:412)
at
org.gradle.api.internal.tasks.testing.junit.JUnitTestClassExecutor.runTestClass(JUnitTestClassExecutor.java:110)
at
org.gradle.api.internal.tasks.testing.junit.JUnitTestClassExecutor.execute(JUnitTestClassExecutor.java:58)
at
org.gradle.api.internal.tasks.testing.junit.JUnitTestClassExecutor.execute(JUnitTestClassExecutor.java:38)
at
org.gradle.api.internal.tasks.testing.junit.AbstractJUnitTestClassProcessor.processTestClass(AbstractJUnitTestClassProcessor.java:62)
at
org.gradle.api.internal.tasks.testing.SuiteTestClassProcessor.processTestClass(SuiteTestClassProcessor.java:51)
at sun.reflect.GeneratedMethodAccessor155.invoke(Unknown Source)
at
sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43)
at java.lang.reflect.Method.invoke(Method.java:498)
at
org.gradle.internal.dispatch.ReflectionDispatch.dispatch(ReflectionDispatch.java:36)
at
org.gradle.internal.dispatch.ReflectionDispatch.dispatch(ReflectionDispatch.java:24)
at
org.gradle.internal.dispatch.ContextClassLoaderDispatch.dispatch(ContextClassLoaderDispatch.java:33)
at
org.gradle.internal.dispatch.ProxyDispatchAdapter$DispatchingInvocationHandler.invoke(ProxyDispatchAdapter.java:94)
at com.sun.proxy.$Proxy2.processTestClass(Unknown Source)
at
org.gradle.api.internal.tasks.testing.worker.TestWorker.processTestClass(TestWorker.java:119)
at sun.reflect.GeneratedMethodAccessor154.invoke(Unknown Source)
at
sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43)
at java.lang.reflect.Method.invoke(Method.java:498)
at
org.gradle.internal.dispatch.ReflectionDispatch.dispatch(ReflectionDispatch.java:36)
at
org.gradle.internal.dispatch.ReflectionDispatch.dispatch(ReflectionDispatch.java:24)
at
org.gradle.internal.remote.internal.hub.MessageHubBackedObjectConnection$DispatchWrapper.dispatch(MessageHubBackedObjectConnection.java:182)
at
org.gradle.internal.remote.internal.hub.MessageHubBackedObjectConnection$DispatchWrapper.dispatch(MessageHubBackedObjectConnection.java:164)
at
org.gradle.internal.remote.internal.hub.MessageHub$Handler.run(MessageHub.java:414)
at
org.gradle.internal.concurrent.ExecutorPolicy$CatchAndRecordFailures.onExecute(ExecutorPolicy.java:64)
at
org.gradle.internal.concurrent.ManagedExecutorImpl$1.run(ManagedExecutorImpl.java:48)
at
java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1149)
at
java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624)
at
org.gradle.internal.concurrent.ThreadFactoryImpl$ManagedThreadRunnable.run(ThreadFactoryImpl.java:56)
Caused by: java.lang.AssertionError:
Expected: iterable with items [a KV(<"k1">, <iterable with items [<3>] in any
order>), a KV(<"k1">, <iterable with items [<4>] in any order>), a KV(<"k5">,
<iterable with items [<2147483647>, <-2147483648>] in any order>), a KV(<"k2">,
<iterable with items [<66>] in any order>), a KV(<"k2">, <iterable with items
[<-33>] in any order>), a KV(<"k3">, <iterable with items [<0>] in any order>)]
in any order
but: no item matches: a KV(<"k1">, <iterable with items [<3>] in any
order>), a KV(<"k1">, <iterable with items [<4>] in any order>), a KV(<"k5">,
<iterable with items [<2147483647>, <-2147483648>] in any order>), a KV(<"k2">,
<iterable with items [<66>] in any order>), a KV(<"k2">, <iterable with items
[<-33>] in any order>), a KV(<"k3">, <iterable with items [<0>] in any order>)
in []
at org.hamcrest.MatcherAssert.assertThat(MatcherAssert.java:18)
at org.junit.Assert.assertThat(Assert.java:966)
at org.junit.Assert.assertThat(Assert.java:931)
at
org.apache.beam.sdk.transforms.GroupByKeyTest$ContainsKVs.apply(GroupByKeyTest.java:681)
at
org.apache.beam.sdk.transforms.GroupByKeyTest$ContainsKVs.apply(GroupByKeyTest.java:666)
at org.apache.beam.sdk.testing.PAssert.doChecks(PAssert.java:1477)
at
org.apache.beam.sdk.testing.PAssert$GroupedValuesCheckerDoFn.processElement(PAssert.java:1444)
at
org.apache.beam.sdk.testing.PAssert$GroupedValuesCheckerDoFn$DoFnInvoker.invokeProcessElement(Unknown
Source)
at
org.apache.beam.fn.harness.FnApiDoFnRunner.processElementForParDo(FnApiDoFnRunner.java:748)
at
org.apache.beam.fn.harness.data.PCollectionConsumerRegistry$MetricTrackingFnDataReceiver.accept(PCollectionConsumerRegistry.java:222)
at
org.apache.beam.fn.harness.data.PCollectionConsumerRegistry$MetricTrackingFnDataReceiver.accept(PCollectionConsumerRegistry.java:185)
at
org.apache.beam.fn.harness.FnApiDoFnRunner.outputTo(FnApiDoFnRunner.java:1678)
at
org.apache.beam.fn.harness.FnApiDoFnRunner.access$2500(FnApiDoFnRunner.java:139)
at
org.apache.beam.fn.harness.FnApiDoFnRunner$NonWindowObservingProcessBundleContext.outputWithTimestamp(FnApiDoFnRunner.java:2194)
at
org.apache.beam.fn.harness.FnApiDoFnRunner$ProcessBundleContextBase.output(FnApiDoFnRunner.java:2363)
at
org.apache.beam.sdk.transforms.DoFnOutputReceivers$WindowedContextOutputReceiver.output(DoFnOutputReceivers.java:78)
at
org.apache.beam.sdk.transforms.MapElements$1.processElement(MapElements.java:142)
at
org.apache.beam.sdk.transforms.MapElements$1$DoFnInvoker.invokeProcessElement(Unknown
Source)
at
org.apache.beam.fn.harness.FnApiDoFnRunner.processElementForParDo(FnApiDoFnRunner.java:748)
at
org.apache.beam.fn.harness.data.PCollectionConsumerRegistry$MetricTrackingFnDataReceiver.accept(PCollectionConsumerRegistry.java:222)
at
org.apache.beam.fn.harness.data.PCollectionConsumerRegistry$MetricTrackingFnDataReceiver.accept(PCollectionConsumerRegistry.java:185)
at
org.apache.beam.fn.harness.FnApiDoFnRunner.outputTo(FnApiDoFnRunner.java:1678)
at
org.apache.beam.fn.harness.FnApiDoFnRunner.access$2500(FnApiDoFnRunner.java:139)
at
org.apache.beam.fn.harness.FnApiDoFnRunner$NonWindowObservingProcessBundleContext.outputWithTimestamp(FnApiDoFnRunner.java:2194)
at
org.apache.beam.fn.harness.FnApiDoFnRunner$ProcessBundleContextBase.output(FnApiDoFnRunner.java:2363)
at
org.apache.beam.sdk.testing.PAssert$ConcatFn.processElement(PAssert.java:1281)
at
org.apache.beam.sdk.testing.PAssert$ConcatFn$DoFnInvoker.invokeProcessElement(Unknown
Source)
at
org.apache.beam.fn.harness.FnApiDoFnRunner.processElementForParDo(FnApiDoFnRunner.java:748)
at
org.apache.beam.fn.harness.data.PCollectionConsumerRegistry$MetricTrackingFnDataReceiver.accept(PCollectionConsumerRegistry.java:222)
at
org.apache.beam.fn.harness.data.PCollectionConsumerRegistry$MetricTrackingFnDataReceiver.accept(PCollectionConsumerRegistry.java:185)
at
org.apache.beam.fn.harness.FnApiDoFnRunner.outputTo(FnApiDoFnRunner.java:1678)
at
org.apache.beam.fn.harness.FnApiDoFnRunner.access$2500(FnApiDoFnRunner.java:139)
at
org.apache.beam.fn.harness.FnApiDoFnRunner$NonWindowObservingProcessBundleContext.outputWithTimestamp(FnApiDoFnRunner.java:2194)
at
org.apache.beam.fn.harness.FnApiDoFnRunner$ProcessBundleContextBase.output(FnApiDoFnRunner.java:2363)
at
org.apache.beam.sdk.transforms.DoFnOutputReceivers$WindowedContextOutputReceiver.output(DoFnOutputReceivers.java:78)
at
org.apache.beam.sdk.transforms.MapElements$1.processElement(MapElements.java:142)
at
org.apache.beam.sdk.transforms.MapElements$1$DoFnInvoker.invokeProcessElement(Unknown
Source)
at
org.apache.beam.fn.harness.FnApiDoFnRunner.processElementForParDo(FnApiDoFnRunner.java:748)
at
org.apache.beam.fn.harness.data.PCollectionConsumerRegistry$MetricTrackingFnDataReceiver.accept(PCollectionConsumerRegistry.java:222)
at
org.apache.beam.fn.harness.data.PCollectionConsumerRegistry$MetricTrackingFnDataReceiver.accept(PCollectionConsumerRegistry.java:185)
at
org.apache.beam.fn.harness.BeamFnDataReadRunner.forwardElementToConsumer(BeamFnDataReadRunner.java:220)
at
org.apache.beam.sdk.fn.data.DecodingFnDataReceiver.accept(DecodingFnDataReceiver.java:43)
at
org.apache.beam.sdk.fn.data.DecodingFnDataReceiver.accept(DecodingFnDataReceiver.java:25)
at
org.apache.beam.fn.harness.data.QueueingBeamFnDataClient.drainAndBlock(QueueingBeamFnDataClient.java:111)
at
org.apache.beam.fn.harness.control.ProcessBundleHandler.processBundle(ProcessBundleHandler.java:304)
at
org.apache.beam.fn.harness.control.BeamFnControlClient.delegateOnInstructionRequestType(BeamFnControlClient.java:173)
at
org.apache.beam.fn.harness.control.BeamFnControlClient.lambda$processInstructionRequests$0(BeamFnControlClient.java:157)
at
java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1149)
at
java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624)
at java.lang.Thread.run(Thread.java:748)
Stacktracejava.lang.RuntimeException: The Runner experienced the following
error during execution:
java.lang.RuntimeException: Error received from SDK harness for instruction 9:
org.apache.beam.sdk.util.UserCodeException: java.lang.AssertionError:
GroupByKey.out:
Expected: iterable with items [a KV(<"k1">, <iterable with items [<3>] in any
order>), a KV(<"k1">, <iterable with items [<4>] in any order>), a KV(<"k5">,
<iterable with items [<2147483647>, <-2147483648>] in any order>), a KV(<"k2">,
<iterable with items [<66>] in any order>), a KV(<"k2">, <iterable with items
[<-33>] in any order>), a KV(<"k3">, <iterable with items [<0>] in any order>)]
in any order
but: no item matches: a KV(<"k1">, <iterable with items [<3>] in any
order>), a KV(<"k1">, <iterable with items [<4>] in any order>), a KV(<"k5">,
<iterable with items [<2147483647>, <-2147483648>] in any order>), a KV(<"k2">,
<iterable with items [<66>] in any order>), a KV(<"k2">, <iterable with items
[<-33>] in any order>), a KV(<"k3">, <iterable with items [<0>] in any order>)
in []
at
org.apache.beam.sdk.util.UserCodeException.wrap(UserCodeException.java:39)
at
org.apache.beam.sdk.testing.PAssert$DefaultConcludeFn$DoFnInvoker.invokeProcessElement(Unknown
Source)
at
org.apache.beam.fn.harness.FnApiDoFnRunner.processElementForParDo(FnApiDoFnRunner.java:748)
at
org.apache.beam.fn.harness.data.PCollectionConsumerRegistry$MetricTrackingFnDataReceiver.accept(PCollectionConsumerRegistry.java:222)
at
org.apache.beam.fn.harness.data.PCollectionConsumerRegistry$MetricTrackingFnDataReceiver.accept(PCollectionConsumerRegistry.java:185)
at
org.apache.beam.fn.harness.FnApiDoFnRunner.outputTo(FnApiDoFnRunner.java:1678)
at
org.apache.beam.fn.harness.FnApiDoFnRunner.access$2500(FnApiDoFnRunner.java:139)
at
org.apache.beam.fn.harness.FnApiDoFnRunner$NonWindowObservingProcessBundleContext.outputWithTimestamp(FnApiDoFnRunner.java:2194)
at
org.apache.beam.fn.harness.FnApiDoFnRunner$ProcessBundleContextBase.output(FnApiDoFnRunner.java:2363)
at
org.apache.beam.sdk.testing.PAssert$GroupedValuesCheckerDoFn.processElement(PAssert.java:1444)
at
org.apache.beam.sdk.testing.PAssert$GroupedValuesCheckerDoFn$DoFnInvoker.invokeProcessElement(Unknown
Source)
at
org.apache.beam.fn.harness.FnApiDoFnRunner.processElementForParDo(FnApiDoFnRunner.java:748)
at
org.apache.beam.fn.harness.data.PCollectionConsumerRegistry$MetricTrackingFnDataReceiver.accept(PCollectionConsumerRegistry.java:222)
at
org.apache.beam.fn.harness.data.PCollectionConsumerRegistry$MetricTrackingFnDataReceiver.accept(PCollectionConsumerRegistry.java:185)
at
org.apache.beam.fn.harness.FnApiDoFnRunner.outputTo(FnApiDoFnRunner.java:1678)
at
org.apache.beam.fn.harness.FnApiDoFnRunner.access$2500(FnApiDoFnRunner.java:139)
at
org.apache.beam.fn.harness.FnApiDoFnRunner$NonWindowObservingProcessBundleContext.outputWithTimestamp(FnApiDoFnRunner.java:2194)
at
org.apache.beam.fn.harness.FnApiDoFnRunner$ProcessBundleContextBase.output(FnApiDoFnRunner.java:2363)
at
org.apache.beam.sdk.transforms.DoFnOutputReceivers$WindowedContextOutputReceiver.output(DoFnOutputReceivers.java:78)
at
org.apache.beam.sdk.transforms.MapElements$1.processElement(MapElements.java:142)
at
org.apache.beam.sdk.transforms.MapElements$1$DoFnInvoker.invokeProcessElement(Unknown
Source)
at
org.apache.beam.fn.harness.FnApiDoFnRunner.processElementForParDo(FnApiDoFnRunner.java:748)
at
org.apache.beam.fn.harness.data.PCollectionConsumerRegistry$MetricTrackingFnDataReceiver.accept(PCollectionConsumerRegistry.java:222)
at
org.apache.beam.fn.harness.data.PCollectionConsumerRegistry$MetricTrackingFnDataReceiver.accept(PCollectionConsumerRegistry.java:185)
at
org.apache.beam.fn.harness.FnApiDoFnRunner.outputTo(FnApiDoFnRunner.java:1678)
at
org.apache.beam.fn.harness.FnApiDoFnRunner.access$2500(FnApiDoFnRunner.java:139)
at
org.apache.beam.fn.harness.FnApiDoFnRunner$NonWindowObservingProcessBundleContext.outputWithTimestamp(FnApiDoFnRunner.java:2194)
at
org.apache.beam.fn.harness.FnApiDoFnRunner$ProcessBundleContextBase.output(FnApiDoFnRunner.java:2363)
at
org.apache.beam.sdk.testing.PAssert$ConcatFn.processElement(PAssert.java:1281)
at
org.apache.beam.sdk.testing.PAssert$ConcatFn$DoFnInvoker.invokeProcessElement(Unknown
Source)
at
org.apache.beam.fn.harness.FnApiDoFnRunner.processElementForParDo(FnApiDoFnRunner.java:748)
at
org.apache.beam.fn.harness.data.PCollectionConsumerRegistry$MetricTrackingFnDataReceiver.accept(PCollectionConsumerRegistry.java:222)
at
org.apache.beam.fn.harness.data.PCollectionConsumerRegistry$MetricTrackingFnDataReceiver.accept(PCollectionConsumerRegistry.java:185)
at
org.apache.beam.fn.harness.FnApiDoFnRunner.outputTo(FnApiDoFnRunner.java:1678)
at
org.apache.beam.fn.harness.FnApiDoFnRunner.access$2500(FnApiDoFnRunner.java:139)
at
org.apache.beam.fn.harness.FnApiDoFnRunner$NonWindowObservingProcessBundleContext.outputWithTimestamp(FnApiDoFnRunner.java:2194)
at
org.apache.beam.fn.harness.FnApiDoFnRunner$ProcessBundleContextBase.output(FnApiDoFnRunner.java:2363)
at
org.apache.beam.sdk.transforms.DoFnOutputReceivers$WindowedContextOutputReceiver.output(DoFnOutputReceivers.java:78)
at
org.apache.beam.sdk.transforms.MapElements$1.processElement(MapElements.java:142)
at
org.apache.beam.sdk.transforms.MapElements$1$DoFnInvoker.invokeProcessElement(Unknown
Source)
at
org.apache.beam.fn.harness.FnApiDoFnRunner.processElementForParDo(FnApiDoFnRunner.java:748)
at
org.apache.beam.fn.harness.data.PCollectionConsumerRegistry$MetricTrackingFnDataReceiver.accept(PCollectionConsumerRegistry.java:222)
at
org.apache.beam.fn.harness.data.PCollectionConsumerRegistry$MetricTrackingFnDataReceiver.accept(PCollectionConsumerRegistry.java:185)
at
org.apache.beam.fn.harness.BeamFnDataReadRunner.forwardElementToConsumer(BeamFnDataReadRunner.java:220)
at
org.apache.beam.sdk.fn.data.DecodingFnDataReceiver.accept(DecodingFnDataReceiver.java:43)
at
org.apache.beam.sdk.fn.data.DecodingFnDataReceiver.accept(DecodingFnDataReceiver.java:25)
at
org.apache.beam.fn.harness.data.QueueingBeamFnDataClient.drainAndBlock(QueueingBeamFnDataClient.java:111)
at
org.apache.beam.fn.harness.control.ProcessBundleHandler.processBundle(ProcessBundleHandler.java:304)
at
org.apache.beam.fn.harness.control.BeamFnControlClient.delegateOnInstructionRequestType(BeamFnControlClient.java:173)
at
org.apache.beam.fn.harness.control.BeamFnControlClient.lambda$processInstructionRequests$0(BeamFnControlClient.java:157)
at
java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1149)
at
java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624)
at java.lang.Thread.run(Thread.java:748)
Caused by: java.lang.AssertionError: GroupByKey.out:
Expected: iterable with items [a KV(<"k1">, <iterable with items [<3>] in any
order>), a KV(<"k1">, <iterable with items [<4>] in any order>), a KV(<"k5">,
<iterable with items [<2147483647>, <-2147483648>] in any order>), a KV(<"k2">,
<iterable with items [<66>] in any order>), a KV(<"k2">, <iterable with items
[<-33>] in any order>), a KV(<"k3">, <iterable with items [<0>] in any order>)]
in any order
but: no item matches: a KV(<"k1">, <iterable with items [<3>] in any
order>), a KV(<"k1">, <iterable with items [<4>] in any order>), a KV(<"k5">,
<iterable with items [<2147483647>, <-2147483648>] in any order>), a KV(<"k2">,
<iterable with items [<66>] in any order>), a KV(<"k2">, <iterable with items
[<-33>] in any order>), a KV(<"k3">, <iterable with items [<0>] in any order>)
in []
at
org.apache.beam.sdk.testing.PAssert$PAssertionSite.capture(PAssert.java:174)
at org.apache.beam.sdk.testing.PAssert.that(PAssert.java:416)
at org.apache.beam.sdk.testing.PAssert.that(PAssert.java:408)
at
org.apache.beam.sdk.transforms.GroupByKeyTest$WindowTests.testGroupByKeyAndWindows(GroupByKeyTest.java:509)
at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method)
at
sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:62)
at
sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43)
at java.lang.reflect.Method.invoke(Method.java:498)
at
org.junit.runners.model.FrameworkMethod$1.runReflectiveCall(FrameworkMethod.java:59)
at
org.junit.internal.runners.model.ReflectiveCallable.run(ReflectiveCallable.java:12)
at
org.junit.runners.model.FrameworkMethod.invokeExplosively(FrameworkMethod.java:56)
at
org.junit.internal.runners.statements.InvokeMethod.evaluate(InvokeMethod.java:17)
at
org.apache.beam.sdk.testing.TestPipeline$1.evaluate(TestPipeline.java:322)
at
org.junit.rules.ExpectedException$ExpectedExceptionStatement.evaluate(ExpectedException.java:266)
at org.junit.runners.ParentRunner$3.evaluate(ParentRunner.java:305)
at
org.junit.runners.BlockJUnit4ClassRunner$1.evaluate(BlockJUnit4ClassRunner.java:100)
at org.junit.runners.ParentRunner.runLeaf(ParentRunner.java:365)
at
org.junit.runners.BlockJUnit4ClassRunner.runChild(BlockJUnit4ClassRunner.java:103)
at
org.junit.runners.BlockJUnit4ClassRunner.runChild(BlockJUnit4ClassRunner.java:63)
at org.junit.runners.ParentRunner$4.run(ParentRunner.java:330)
at org.junit.runners.ParentRunner$1.schedule(ParentRunner.java:78)
at org.junit.runners.ParentRunner.runChildren(ParentRunner.java:328)
at org.junit.runners.ParentRunner.access$100(ParentRunner.java:65)
at org.junit.runners.ParentRunner$2.evaluate(ParentRunner.java:292)
at org.junit.runners.ParentRunner$3.evaluate(ParentRunner.java:305)
at org.junit.runners.ParentRunner.run(ParentRunner.java:412)
at org.junit.runners.Suite.runChild(Suite.java:128)
at org.junit.runners.Suite.runChild(Suite.java:27)
at org.junit.runners.ParentRunner$4.run(ParentRunner.java:330)
at org.junit.runners.ParentRunner$1.schedule(ParentRunner.java:78)
at org.junit.runners.ParentRunner.runChildren(ParentRunner.java:328)
at org.junit.runners.ParentRunner.access$100(ParentRunner.java:65)
at org.junit.runners.ParentRunner$2.evaluate(ParentRunner.java:292)
at org.junit.runners.ParentRunner$3.evaluate(ParentRunner.java:305)
at org.junit.runners.ParentRunner.run(ParentRunner.java:412)
at
org.gradle.api.internal.tasks.testing.junit.JUnitTestClassExecutor.runTestClass(JUnitTestClassExecutor.java:110)
at
org.gradle.api.internal.tasks.testing.junit.JUnitTestClassExecutor.execute(JUnitTestClassExecutor.java:58)
at
org.gradle.api.internal.tasks.testing.junit.JUnitTestClassExecutor.execute(JUnitTestClassExecutor.java:38)
at
org.gradle.api.internal.tasks.testing.junit.AbstractJUnitTestClassProcessor.processTestClass(AbstractJUnitTestClassProcessor.java:62)
at
org.gradle.api.internal.tasks.testing.SuiteTestClassProcessor.processTestClass(SuiteTestClassProcessor.java:51)
at sun.reflect.GeneratedMethodAccessor155.invoke(Unknown Source)
at
sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43)
at java.lang.reflect.Method.invoke(Method.java:498)
at
org.gradle.internal.dispatch.ReflectionDispatch.dispatch(ReflectionDispatch.java:36)
at
org.gradle.internal.dispatch.ReflectionDispatch.dispatch(ReflectionDispatch.java:24)
at
org.gradle.internal.dispatch.ContextClassLoaderDispatch.dispatch(ContextClassLoaderDispatch.java:33)
at
org.gradle.internal.dispatch.ProxyDispatchAdapter$DispatchingInvocationHandler.invoke(ProxyDispatchAdapter.java:94)
at com.sun.proxy.$Proxy2.processTestClass(Unknown Source)
at
org.gradle.api.internal.tasks.testing.worker.TestWorker.processTestClass(TestWorker.java:119)
at sun.reflect.GeneratedMethodAccessor154.invoke(Unknown Source)
at
sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43)
at java.lang.reflect.Method.invoke(Method.java:498)
at
org.gradle.internal.dispatch.ReflectionDispatch.dispatch(ReflectionDispatch.java:36)
at
org.gradle.internal.dispatch.ReflectionDispatch.dispatch(ReflectionDispatch.java:24)
at
org.gradle.internal.remote.internal.hub.MessageHubBackedObjectConnection$DispatchWrapper.dispatch(MessageHubBackedObjectConnection.java:182)
at
org.gradle.internal.remote.internal.hub.MessageHubBackedObjectConnection$DispatchWrapper.dispatch(MessageHubBackedObjectConnection.java:164)
at
org.gradle.internal.remote.internal.hub.MessageHub$Handler.run(MessageHub.java:414)
at
org.gradle.internal.concurrent.ExecutorPolicy$CatchAndRecordFailures.onExecute(ExecutorPolicy.java:64)
at
org.gradle.internal.concurrent.ManagedExecutorImpl$1.run(ManagedExecutorImpl.java:48)
at
java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1149)
at
java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624)
at
org.gradle.internal.concurrent.ThreadFactoryImpl$ManagedThreadRunnable.run(ThreadFactoryImpl.java:56)
Caused by: java.lang.AssertionError:
Expected: iterable with items [a KV(<"k1">, <iterable with items [<3>] in any
order>), a KV(<"k1">, <iterable with items [<4>] in any order>), a KV(<"k5">,
<iterable with items [<2147483647>, <-2147483648>] in any order>), a KV(<"k2">,
<iterable with items [<66>] in any order>), a KV(<"k2">, <iterable with items
[<-33>] in any order>), a KV(<"k3">, <iterable with items [<0>] in any order>)]
in any order
but: no item matches: a KV(<"k1">, <iterable with items [<3>] in any
order>), a KV(<"k1">, <iterable with items [<4>] in any order>), a KV(<"k5">,
<iterable with items [<2147483647>, <-2147483648>] in any order>), a KV(<"k2">,
<iterable with items [<66>] in any order>), a KV(<"k2">, <iterable with items
[<-33>] in any order>), a KV(<"k3">, <iterable with items [<0>] in any order>)
in []
at org.hamcrest.MatcherAssert.assertThat(MatcherAssert.java:18)
at org.junit.Assert.assertThat(Assert.java:966)
at org.junit.Assert.assertThat(Assert.java:931)
at
org.apache.beam.sdk.transforms.GroupByKeyTest$ContainsKVs.apply(GroupByKeyTest.java:681)
at
org.apache.beam.sdk.transforms.GroupByKeyTest$ContainsKVs.apply(GroupByKeyTest.java:666)
at org.apache.beam.sdk.testing.PAssert.doChecks(PAssert.java:1477)
at
org.apache.beam.sdk.testing.PAssert$GroupedValuesCheckerDoFn.processElement(PAssert.java:1444)
at
org.apache.beam.sdk.testing.PAssert$GroupedValuesCheckerDoFn$DoFnInvoker.invokeProcessElement(Unknown
Source)
at
org.apache.beam.fn.harness.FnApiDoFnRunner.processElementForParDo(FnApiDoFnRunner.java:748)
at
org.apache.beam.fn.harness.data.PCollectionConsumerRegistry$MetricTrackingFnDataReceiver.accept(PCollectionConsumerRegistry.java:222)
at
org.apache.beam.fn.harness.data.PCollectionConsumerRegistry$MetricTrackingFnDataReceiver.accept(PCollectionConsumerRegistry.java:185)
at
org.apache.beam.fn.harness.FnApiDoFnRunner.outputTo(FnApiDoFnRunner.java:1678)
at
org.apache.beam.fn.harness.FnApiDoFnRunner.access$2500(FnApiDoFnRunner.java:139)
at
org.apache.beam.fn.harness.FnApiDoFnRunner$NonWindowObservingProcessBundleContext.outputWithTimestamp(FnApiDoFnRunner.java:2194)
at
org.apache.beam.fn.harness.FnApiDoFnRunner$ProcessBundleContextBase.output(FnApiDoFnRunner.java:2363)
at
org.apache.beam.sdk.transforms.DoFnOutputReceivers$WindowedContextOutputReceiver.output(DoFnOutputReceivers.java:78)
at
org.apache.beam.sdk.transforms.MapElements$1.processElement(MapElements.java:142)
at
org.apache.beam.sdk.transforms.MapElements$1$DoFnInvoker.invokeProcessElement(Unknown
Source)
at
org.apache.beam.fn.harness.FnApiDoFnRunner.processElementForParDo(FnApiDoFnRunner.java:748)
at
org.apache.beam.fn.harness.data.PCollectionConsumerRegistry$MetricTrackingFnDataReceiver.accept(PCollectionConsumerRegistry.java:222)
at
org.apache.beam.fn.harness.data.PCollectionConsumerRegistry$MetricTrackingFnDataReceiver.accept(PCollectionConsumerRegistry.java:185)
at
org.apache.beam.fn.harness.FnApiDoFnRunner.outputTo(FnApiDoFnRunner.java:1678)
at
org.apache.beam.fn.harness.FnApiDoFnRunner.access$2500(FnApiDoFnRunner.java:139)
at
org.apache.beam.fn.harness.FnApiDoFnRunner$NonWindowObservingProcessBundleContext.outputWithTimestamp(FnApiDoFnRunner.java:2194)
at
org.apache.beam.fn.harness.FnApiDoFnRunner$ProcessBundleContextBase.output(FnApiDoFnRunner.java:2363)
at
org.apache.beam.sdk.testing.PAssert$ConcatFn.processElement(PAssert.java:1281)
at
org.apache.beam.sdk.testing.PAssert$ConcatFn$DoFnInvoker.invokeProcessElement(Unknown
Source)
at
org.apache.beam.fn.harness.FnApiDoFnRunner.processElementForParDo(FnApiDoFnRunner.java:748)
at
org.apache.beam.fn.harness.data.PCollectionConsumerRegistry$MetricTrackingFnDataReceiver.accept(PCollectionConsumerRegistry.java:222)
at
org.apache.beam.fn.harness.data.PCollectionConsumerRegistry$MetricTrackingFnDataReceiver.accept(PCollectionConsumerRegistry.java:185)
at
org.apache.beam.fn.harness.FnApiDoFnRunner.outputTo(FnApiDoFnRunner.java:1678)
at
org.apache.beam.fn.harness.FnApiDoFnRunner.access$2500(FnApiDoFnRunner.java:139)
at
org.apache.beam.fn.harness.FnApiDoFnRunner$NonWindowObservingProcessBundleContext.outputWithTimestamp(FnApiDoFnRunner.java:2194)
at
org.apache.beam.fn.harness.FnApiDoFnRunner$ProcessBundleContextBase.output(FnApiDoFnRunner.java:2363)
at
org.apache.beam.sdk.transforms.DoFnOutputReceivers$WindowedContextOutputReceiver.output(DoFnOutputReceivers.java:78)
at
org.apache.beam.sdk.transforms.MapElements$1.processElement(MapElements.java:142)
at
org.apache.beam.sdk.transforms.MapElements$1$DoFnInvoker.invokeProcessElement(Unknown
Source)
at
org.apache.beam.fn.harness.FnApiDoFnRunner.processElementForParDo(FnApiDoFnRunner.java:748)
at
org.apache.beam.fn.harness.data.PCollectionConsumerRegistry$MetricTrackingFnDataReceiver.accept(PCollectionConsumerRegistry.java:222)
at
org.apache.beam.fn.harness.data.PCollectionConsumerRegistry$MetricTrackingFnDataReceiver.accept(PCollectionConsumerRegistry.java:185)
at
org.apache.beam.fn.harness.BeamFnDataReadRunner.forwardElementToConsumer(BeamFnDataReadRunner.java:220)
at
org.apache.beam.sdk.fn.data.DecodingFnDataReceiver.accept(DecodingFnDataReceiver.java:43)
at
org.apache.beam.sdk.fn.data.DecodingFnDataReceiver.accept(DecodingFnDataReceiver.java:25)
at
org.apache.beam.fn.harness.data.QueueingBeamFnDataClient.drainAndBlock(QueueingBeamFnDataClient.java:111)
at
org.apache.beam.fn.harness.control.ProcessBundleHandler.processBundle(ProcessBundleHandler.java:304)
at
org.apache.beam.fn.harness.control.BeamFnControlClient.delegateOnInstructionRequestType(BeamFnControlClient.java:173)
at
org.apache.beam.fn.harness.control.BeamFnControlClient.lambda$processInstructionRequests$0(BeamFnControlClient.java:157)
at
java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1149)
at
java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624)
at java.lang.Thread.run(Thread.java:748)
at
org.apache.beam.runners.portability.JobServicePipelineResult.propagateErrors(JobServicePipelineResult.java:166)
at
org.apache.beam.runners.portability.JobServicePipelineResult.waitUntilFinish(JobServicePipelineResult.java:111)
at
org.apache.beam.runners.portability.testing.TestPortableRunner.run(TestPortableRunner.java:83)
at org.apache.beam.sdk.Pipeline.run(Pipeline.java:322)
at org.apache.beam.sdk.testing.TestPipeline.run(TestPipeline.java:353)
at org.apache.beam.sdk.testing.TestPipeline.run(TestPipeline.java:334)
at
org.apache.beam.sdk.transforms.GroupByKeyTest$WindowTests.testGroupByKeyAndWindows(GroupByKeyTest.java:527)
at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method)
at
sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:62)
at
sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43)
at java.lang.reflect.Method.invoke(Method.java:498)
at
org.junit.runners.model.FrameworkMethod$1.runReflectiveCall(FrameworkMethod.java:59)
at
org.junit.internal.runners.model.ReflectiveCallable.run(ReflectiveCallable.java:12)
at
org.junit.runners.model.FrameworkMethod.invokeExplosively(FrameworkMethod.java:56)
at
org.junit.internal.runners.statements.InvokeMethod.evaluate(InvokeMethod.java:17)
at
org.apache.beam.sdk.testing.TestPipeline$1.evaluate(TestPipeline.java:322)
at
org.junit.rules.ExpectedException$ExpectedExceptionStatement.evaluate(ExpectedException.java:266)
at org.junit.runners.ParentRunner$3.evaluate(ParentRunner.java:305)
at
org.junit.runners.BlockJUnit4ClassRunner$1.evaluate(BlockJUnit4ClassRunner.java:100)
at org.junit.runners.ParentRunner.runLeaf(ParentRunner.java:365)
at
org.junit.runners.BlockJUnit4ClassRunner.runChild(BlockJUnit4ClassRunner.java:103)
at
org.junit.runners.BlockJUnit4ClassRunner.runChild(BlockJUnit4ClassRunner.java:63)
at org.junit.runners.ParentRunner$4.run(ParentRunner.java:330)
at org.junit.runners.ParentRunner$1.schedule(ParentRunner.java:78)
at org.junit.runners.ParentRunner.runChildren(ParentRunner.java:328)
at org.junit.runners.ParentRunner.access$100(ParentRunner.java:65)
at org.junit.runners.ParentRunner$2.evaluate(ParentRunner.java:292)
at org.junit.runners.ParentRunner$3.evaluate(ParentRunner.java:305)
at org.junit.runners.ParentRunner.run(ParentRunner.java:412)
at org.junit.runners.Suite.runChild(Suite.java:128)
at org.junit.runners.Suite.runChild(Suite.java:27)
at org.junit.runners.ParentRunner$4.run(ParentRunner.java:330)
at org.junit.runners.ParentRunner$1.schedule(ParentRunner.java:78)
at org.junit.runners.ParentRunner.runChildren(ParentRunner.java:328)
at org.junit.runners.ParentRunner.access$100(ParentRunner.java:65)
at org.junit.runners.ParentRunner$2.evaluate(ParentRunner.java:292)
at org.junit.runners.ParentRunner$3.evaluate(ParentRunner.java:305)
at org.junit.runners.ParentRunner.run(ParentRunner.java:412)
at
org.gradle.api.internal.tasks.testing.junit.JUnitTestClassExecutor.runTestClass(JUnitTestClassExecutor.java:110)
at
org.gradle.api.internal.tasks.testing.junit.JUnitTestClassExecutor.execute(JUnitTestClassExecutor.java:58)
at
org.gradle.api.internal.tasks.testing.junit.JUnitTestClassExecutor.execute(JUnitTestClassExecutor.java:38)
at
org.gradle.api.internal.tasks.testing.junit.AbstractJUnitTestClassProcessor.processTestClass(AbstractJUnitTestClassProcessor.java:62)
at
org.gradle.api.internal.tasks.testing.SuiteTestClassProcessor.processTestClass(SuiteTestClassProcessor.java:51)
at sun.reflect.GeneratedMethodAccessor155.invoke(Unknown Source)
at
sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43)
at java.lang.reflect.Method.invoke(Method.java:498)
at
org.gradle.internal.dispatch.ReflectionDispatch.dispatch(ReflectionDispatch.java:36)
at
org.gradle.internal.dispatch.ReflectionDispatch.dispatch(ReflectionDispatch.java:24)
at
org.gradle.internal.dispatch.ContextClassLoaderDispatch.dispatch(ContextClassLoaderDispatch.java:33)
at
org.gradle.internal.dispatch.ProxyDispatchAdapter$DispatchingInvocationHandler.invoke(ProxyDispatchAdapter.java:94)
at com.sun.proxy.$Proxy2.processTestClass(Unknown Source)
at
org.gradle.api.internal.tasks.testing.worker.TestWorker.processTestClass(TestWorker.java:119)
at sun.reflect.GeneratedMethodAccessor154.invoke(Unknown Source)
at
sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43)
at java.lang.reflect.Method.invoke(Method.java:498)
at
org.gradle.internal.dispatch.ReflectionDispatch.dispatch(ReflectionDispatch.java:36)
at
org.gradle.internal.dispatch.ReflectionDispatch.dispatch(ReflectionDispatch.java:24)
at
org.gradle.internal.remote.internal.hub.MessageHubBackedObjectConnection$DispatchWrapper.dispatch(MessageHubBackedObjectConnection.java:182)
at
org.gradle.internal.remote.internal.hub.MessageHubBackedObjectConnection$DispatchWrapper.dispatch(MessageHubBackedObjectConnection.java:164)
at
org.gradle.internal.remote.internal.hub.MessageHub$Handler.run(MessageHub.java:414)
at
org.gradle.internal.concurrent.ExecutorPolicy$CatchAndRecordFailures.onExecute(ExecutorPolicy.java:64)
at
org.gradle.internal.concurrent.ManagedExecutorImpl$1.run(ManagedExecutorImpl.java:48)
at
java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1149)
at
java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624)
at
org.gradle.internal.concurrent.ThreadFactoryImpl$ManagedThreadRunnable.run(ThreadFactoryImpl.java:56)
at java.lang.Thread.run(Thread.java:748)
Standard OutputShutting SDK harness down.
Shutting SDK harness down.
Shutting SDK harness down.
Shutting SDK harness down.
Standard Error20/12/16 00:23:52 INFO
org.apache.beam.runners.jobsubmission.JobServerDriver: ArtifactStagingService
started on localhost:37013
20/12/16 00:23:52 INFO org.apache.beam.runners.jobsubmission.JobServerDriver:
Java ExpansionService started on localhost:46283
20/12/16 00:23:52 INFO org.apache.beam.runners.jobsubmission.JobServerDriver:
JobService started on localhost:35663
20/12/16 00:23:54 INFO org.apache.beam.runners.portability.PortableRunner:
Using job server endpoint: localhost:35663
20/12/16 00:23:54 INFO org.apache.beam.runners.portability.PortableRunner:
PrepareJobResponse: preparation_id:
"groupbykeytest0windowtests0testgroupbykeymergingwindows-jenkins-1216002354-e1e73925_cf9c141c-fda4-4bdf-847f-4394ef42d8ac"
artifact_staging_endpoint {
url: "localhost:37013"
}
staging_session_token:
"groupbykeytest0windowtests0testgroupbykeymergingwindows-jenkins-1216002354-e1e73925_cf9c141c-fda4-4bdf-847f-4394ef42d8ac"
20/12/16 00:23:54 INFO
org.apache.beam.runners.fnexecution.artifact.ArtifactStagingService: Staging
artifacts for
groupbykeytest0windowtests0testgroupbykeymergingwindows-jenkins-1216002354-e1e73925_cf9c141c-fda4-4bdf-847f-4394ef42d8ac.
20/12/16 00:23:54 INFO
org.apache.beam.runners.fnexecution.artifact.ArtifactStagingService: Resolving
artifacts for
groupbykeytest0windowtests0testgroupbykeymergingwindows-jenkins-1216002354-e1e73925_cf9c141c-fda4-4bdf-847f-4394ef42d8ac.EMBEDDED.
20/12/16 00:23:54 INFO
org.apache.beam.runners.fnexecution.artifact.ArtifactStagingService: Getting
313 artifacts for
groupbykeytest0windowtests0testgroupbykeymergingwindows-jenkins-1216002354-e1e73925_cf9c141c-fda4-4bdf-847f-4394ef42d8ac.null.
20/12/16 00:23:55 INFO
org.apache.beam.runners.fnexecution.artifact.ArtifactStagingService: Artifacts
fully staged for
groupbykeytest0windowtests0testgroupbykeymergingwindows-jenkins-1216002354-e1e73925_cf9c141c-fda4-4bdf-847f-4394ef42d8ac.
20/12/16 00:23:55 ERROR
org.apache.beam.vendor.grpc.v1p26p0.io.grpc.internal.ManagedChannelOrphanWrapper:
*~*~*~ Channel ManagedChannelImpl{logId=1410,
target=directaddress:///InProcessServer_202} was not shutdown properly!!! ~*~*~*
Make sure to call shutdown()/shutdownNow() and wait until
awaitTermination() returns true. java.lang.RuntimeException: ManagedChannel
allocation site
at
org.apache.beam.vendor.grpc.v1p26p0.io.grpc.internal.ManagedChannelOrphanWrapper$ManagedChannelReference.<init>(ManagedChannelOrphanWrapper.java:94)
at
org.apache.beam.vendor.grpc.v1p26p0.io.grpc.internal.ManagedChannelOrphanWrapper.<init>(ManagedChannelOrphanWrapper.java:52)
at
org.apache.beam.vendor.grpc.v1p26p0.io.grpc.internal.ManagedChannelOrphanWrapper.<init>(ManagedChannelOrphanWrapper.java:43)
at
org.apache.beam.vendor.grpc.v1p26p0.io.grpc.internal.AbstractManagedChannelImplBuilder.build(AbstractManagedChannelImplBuilder.java:524)
at
org.apache.beam.sdk.fn.channel.ManagedChannelFactory.forDescriptor(ManagedChannelFactory.java:44)
at
org.apache.beam.fn.harness.data.BeamFnDataGrpcClient.lambda$getClientFor$0(BeamFnDataGrpcClient.java:116)
at
java.util.concurrent.ConcurrentHashMap.computeIfAbsent(ConcurrentHashMap.java:1660)
at
org.apache.beam.fn.harness.data.BeamFnDataGrpcClient.getClientFor(BeamFnDataGrpcClient.java:110)
at
org.apache.beam.fn.harness.data.BeamFnDataGrpcClient.send(BeamFnDataGrpcClient.java:101)
at
org.apache.beam.fn.harness.data.QueueingBeamFnDataClient.send(QueueingBeamFnDataClient.java:141)
at
org.apache.beam.fn.harness.BeamFnDataWriteRunner.registerForOutput(BeamFnDataWriteRunner.java:169)
at
org.apache.beam.fn.harness.data.PTransformFunctionRegistry.lambda$register$0(PTransformFunctionRegistry.java:108)
at
org.apache.beam.fn.harness.control.ProcessBundleHandler.processBundle(ProcessBundleHandler.java:301)
at
org.apache.beam.fn.harness.control.BeamFnControlClient.delegateOnInstructionRequestType(BeamFnControlClient.java:173)
at
org.apache.beam.fn.harness.control.BeamFnControlClient.lambda$processInstructionRequests$0(BeamFnControlClient.java:157)
at
java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1149)
at
java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624)
at java.lang.Thread.run(Thread.java:748)
20/12/16 00:23:55 WARN
org.apache.beam.vendor.grpc.v1p26p0.io.grpc.netty.NettyServerHandler: Stream
Error
org.apache.beam.vendor.grpc.v1p26p0.io.netty.handler.codec.http2.Http2Exception$StreamException:
Received DATA frame for an unknown stream 3
at
org.apache.beam.vendor.grpc.v1p26p0.io.netty.handler.codec.http2.Http2Exception.streamError(Http2Exception.java:147)
at
org.apache.beam.vendor.grpc.v1p26p0.io.netty.handler.codec.http2.DefaultHttp2ConnectionDecoder$FrameReadListener.shouldIgnoreHeadersOrDataFrame(DefaultHttp2ConnectionDecoder.java:591)
at
org.apache.beam.vendor.grpc.v1p26p0.io.netty.handler.codec.http2.DefaultHttp2ConnectionDecoder$FrameReadListener.onDataRead(DefaultHttp2ConnectionDecoder.java:239)
at
org.apache.beam.vendor.grpc.v1p26p0.io.netty.handler.codec.http2.Http2InboundFrameLogger$1.onDataRead(Http2InboundFrameLogger.java:48)
at
org.apache.beam.vendor.grpc.v1p26p0.io.netty.handler.codec.http2.DefaultHttp2FrameReader.readDataFrame(DefaultHttp2FrameReader.java:422)
at
org.apache.beam.vendor.grpc.v1p26p0.io.netty.handler.codec.http2.DefaultHttp2FrameReader.processPayloadState(DefaultHttp2FrameReader.java:251)
at
org.apache.beam.vendor.grpc.v1p26p0.io.netty.handler.codec.http2.DefaultHttp2FrameReader.readFrame(DefaultHttp2FrameReader.java:160)
at
org.apache.beam.vendor.grpc.v1p26p0.io.netty.handler.codec.http2.Http2InboundFrameLogger.readFrame(Http2InboundFrameLogger.java:41)
at
org.apache.beam.vendor.grpc.v1p26p0.io.netty.handler.codec.http2.DefaultHttp2ConnectionDecoder.decodeFrame(DefaultHttp2ConnectionDecoder.java:174)
at
org.apache.beam.vendor.grpc.v1p26p0.io.netty.handler.codec.http2.Http2ConnectionHandler$FrameDecoder.decode(Http2ConnectionHandler.java:378)
at
org.apache.beam.vendor.grpc.v1p26p0.io.netty.handler.codec.http2.Http2ConnectionHandler.decode(Http2ConnectionHandler.java:438)
at
org.apache.beam.vendor.grpc.v1p26p0.io.netty.handler.codec.ByteToMessageDecoder.decodeRemovalReentryProtection(ByteToMessageDecoder.java:505)
at
org.apache.beam.vendor.grpc.v1p26p0.io.netty.handler.codec.ByteToMessageDecoder.callDecode(ByteToMessageDecoder.java:444)
at
org.apache.beam.vendor.grpc.v1p26p0.io.netty.handler.codec.ByteToMessageDecoder.channelRead(ByteToMessageDecoder.java:283)
at
org.apache.beam.vendor.grpc.v1p26p0.io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:374)
at
org.apache.beam.vendor.grpc.v1p26p0.io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:360)
at
org.apache.beam.vendor.grpc.v1p26p0.io.netty.channel.AbstractChannelHandlerContext.fireChannelRead(AbstractChannelHandlerContext.java:352)
at
org.apache.beam.vendor.grpc.v1p26p0.io.netty.channel.DefaultChannelPipeline$HeadContext.channelRead(DefaultChannelPipeline.java:1422)
at
org.apache.beam.vendor.grpc.v1p26p0.io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:374)
at
org.apache.beam.vendor.grpc.v1p26p0.io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:360)
at
org.apache.beam.vendor.grpc.v1p26p0.io.netty.channel.DefaultChannelPipeline.fireChannelRead(DefaultChannelPipeline.java:931)
at
org.apache.beam.vendor.grpc.v1p26p0.io.netty.channel.nio.AbstractNioByteChannel$NioByteUnsafe.read(AbstractNioByteChannel.java:163)
at
org.apache.beam.vendor.grpc.v1p26p0.io.netty.channel.nio.NioEventLoop.processSelectedKey(NioEventLoop.java:700)
at
org.apache.beam.vendor.grpc.v1p26p0.io.netty.channel.nio.NioEventLoop.processSelectedKeysOptimized(NioEventLoop.java:635)
at
org.apache.beam.vendor.grpc.v1p26p0.io.netty.channel.nio.NioEventLoop.processSelectedKeys(NioEventLoop.java:552)
at
org.apache.beam.vendor.grpc.v1p26p0.io.netty.channel.nio.NioEventLoop.run(NioEventLoop.java:514)
at
org.apache.beam.vendor.grpc.v1p26p0.io.netty.util.concurrent.SingleThreadEventExecutor$6.run(SingleThreadEventExecutor.java:1044)
at
org.apache.beam.vendor.grpc.v1p26p0.io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74)
at
org.apache.beam.vendor.grpc.v1p26p0.io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30)
at java.lang.Thread.run(Thread.java:748)
20/12/16 00:23:55 INFO org.apache.beam.runners.spark.SparkJobInvoker: Invoking
job
groupbykeytest0windowtests0testgroupbykeymergingwindows-jenkins-1216002354-e1e73925_c39ec542-fe2d-4769-a6f9-d4897fd76c5f
20/12/16 00:23:55 INFO org.apache.beam.runners.jobsubmission.JobInvocation:
Starting job invocation
groupbykeytest0windowtests0testgroupbykeymergingwindows-jenkins-1216002354-e1e73925_c39ec542-fe2d-4769-a6f9-d4897fd76c5f
20/12/16 00:23:55 INFO org.apache.beam.runners.portability.PortableRunner:
RunJobResponse: job_id:
"groupbykeytest0windowtests0testgroupbykeymergingwindows-jenkins-1216002354-e1e73925_c39ec542-fe2d-4769-a6f9-d4897fd76c5f"
20/12/16 00:23:55 INFO org.apache.beam.runners.spark.SparkPipelineRunner: Will
stage 313 files. (Enable logging at DEBUG level to see which files will be
staged.)
20/12/16 00:23:55 INFO
org.apache.beam.runners.spark.translation.SparkContextFactory: Creating a brand
new Spark Context.
20/12/16 00:23:55 INFO org.apache.beam.runners.spark.SparkPipelineRunner:
Running job
groupbykeytest0windowtests0testgroupbykeymergingwindows-jenkins-1216002354-e1e73925_c39ec542-fe2d-4769-a6f9-d4897fd76c5f
on Spark master local[4]
20/12/16 00:23:55 INFO org.apache.beam.runners.spark.SparkPipelineRunner:
Running job
groupbykeytest0windowtests0testgroupbykeymergingwindows-jenkins-1216002354-e1e73925_c39ec542-fe2d-4769-a6f9-d4897fd76c5f
on Spark master local[4]
20/12/16 00:23:55 INFO org.apache.beam.runners.spark.SparkPipelineRunner: Job
groupbykeytest0windowtests0testgroupbykeymergingwindows-jenkins-1216002354-e1e73925_c39ec542-fe2d-4769-a6f9-d4897fd76c5f:
Pipeline translated successfully. Computing outputs
20/12/16 00:23:55 WARN org.apache.spark.streaming.dstream.QueueInputDStream:
queueStream doesn't support checkpointing
20/12/16 00:23:55 WARN org.apache.spark.streaming.dstream.QueueInputDStream:
queueStream doesn't support checkpointing
20/12/16 00:23:55 WARN org.apache.spark.streaming.dstream.QueueInputDStream:
queueStream doesn't support checkpointing
20/12/16 00:23:55 WARN org.apache.spark.streaming.dstream.QueueInputDStream:
queueStream doesn't support checkpointing
20/12/16 00:23:55 WARN org.apache.spark.streaming.dstream.QueueInputDStream:
queueStream doesn't support checkpointing
20/12/16 00:23:56 WARN org.apache.spark.streaming.dstream.QueueInputDStream:
queueStream doesn't support checkpointing
20/12/16 00:23:56 WARN org.apache.spark.streaming.dstream.QueueInputDStream:
queueStream doesn't support checkpointing
20/12/16 00:23:56 WARN org.apache.spark.streaming.dstream.QueueInputDStream:
queueStream doesn't support checkpointing
20/12/16 00:23:56 WARN org.apache.spark.streaming.dstream.QueueInputDStream:
queueStream doesn't support checkpointing
20/12/16 00:23:56 WARN org.apache.spark.streaming.dstream.QueueInputDStream:
queueStream doesn't support checkpointing
20/12/16 00:23:56 WARN org.apache.spark.streaming.dstream.QueueInputDStream:
queueStream doesn't support checkpointing
20/12/16 00:23:56 WARN org.apache.spark.streaming.dstream.QueueInputDStream:
queueStream doesn't support checkpointing
20/12/16 00:23:56 WARN org.apache.spark.streaming.dstream.QueueInputDStream:
queueStream doesn't support checkpointing
20/12/16 00:23:56 WARN org.apache.spark.streaming.dstream.QueueInputDStream:
queueStream doesn't support checkpointing
20/12/16 00:23:56 WARN org.apache.spark.streaming.dstream.QueueInputDStream:
queueStream doesn't support checkpointing
20/12/16 00:23:57 WARN org.apache.spark.streaming.dstream.QueueInputDStream:
queueStream doesn't support checkpointing
20/12/16 00:23:57 WARN org.apache.spark.streaming.dstream.QueueInputDStream:
queueStream doesn't support checkpointing
20/12/16 00:23:57 WARN org.apache.spark.streaming.dstream.QueueInputDStream:
queueStream doesn't support checkpointing
20/12/16 00:23:57 WARN org.apache.spark.streaming.dstream.QueueInputDStream:
queueStream doesn't support checkpointing
20/12/16 00:23:57 WARN org.apache.spark.streaming.dstream.QueueInputDStream:
queueStream doesn't support checkpointing
20/12/16 00:23:57 WARN org.apache.spark.streaming.dstream.QueueInputDStream:
queueStream doesn't support checkpointing
20/12/16 00:23:57 WARN org.apache.spark.streaming.dstream.QueueInputDStream:
queueStream doesn't support checkpointing
20/12/16 00:23:57 WARN org.apache.spark.streaming.dstream.QueueInputDStream:
queueStream doesn't support checkpointing
20/12/16 00:23:57 WARN org.apache.spark.streaming.dstream.QueueInputDStream:
queueStream doesn't support checkpointing
20/12/16 00:23:57 WARN org.apache.spark.streaming.dstream.QueueInputDStream:
queueStream doesn't support checkpointing
20/12/16 00:23:58 WARN org.apache.spark.streaming.dstream.QueueInputDStream:
queueStream doesn't support checkpointing
20/12/16 00:23:58 WARN org.apache.spark.streaming.dstream.QueueInputDStream:
queueStream doesn't support checkpointing
20/12/16 00:23:58 WARN org.apache.spark.streaming.dstream.QueueInputDStream:
queueStream doesn't support checkpointing
20/12/16 00:23:58 WARN org.apache.spark.streaming.dstream.QueueInputDStream:
queueStream doesn't support checkpointing
20/12/16 00:23:58 WARN org.apache.spark.streaming.dstream.QueueInputDStream:
queueStream doesn't support checkpointing
20/12/16 00:23:58 WARN org.apache.spark.streaming.dstream.QueueInputDStream:
queueStream doesn't support checkpointing
20/12/16 00:23:58 WARN org.apache.spark.streaming.dstream.QueueInputDStream:
queueStream doesn't support checkpointing
20/12/16 00:23:58 WARN org.apache.spark.streaming.dstream.QueueInputDStream:
queueStream doesn't support checkpointing
20/12/16 00:23:58 WARN org.apache.spark.streaming.dstream.QueueInputDStream:
queueStream doesn't support checkpointing
20/12/16 00:23:58 WARN org.apache.spark.streaming.dstream.QueueInputDStream:
queueStream doesn't support checkpointing
20/12/16 00:23:59 WARN org.apache.spark.streaming.dstream.QueueInputDStream:
queueStream doesn't support checkpointing
20/12/16 00:23:59 WARN org.apache.spark.streaming.dstream.QueueInputDStream:
queueStream doesn't support checkpointing
20/12/16 00:23:59 WARN org.apache.spark.streaming.dstream.QueueInputDStream:
queueStream doesn't support checkpointing
20/12/16 00:23:59 WARN org.apache.spark.streaming.dstream.QueueInputDStream:
queueStream doesn't support checkpointing
20/12/16 00:23:59 WARN org.apache.spark.streaming.dstream.QueueInputDStream:
queueStream doesn't support checkpointing
20/12/16 00:23:59 WARN org.apache.spark.streaming.dstream.QueueInputDStream:
queueStream doesn't support checkpointing
20/12/16 00:23:59 WARN org.apache.spark.streaming.dstream.QueueInputDStream:
queueStream doesn't support checkpointing
20/12/16 00:23:59 WARN org.apache.spark.streaming.dstream.QueueInputDStream:
queueStream doesn't support checkpointing
20/12/16 00:23:59 WARN org.apache.spark.streaming.dstream.QueueInputDStream:
queueStream doesn't support checkpointing
20/12/16 00:23:59 WARN org.apache.spark.streaming.dstream.QueueInputDStream:
queueStream doesn't support checkpointing
20/12/16 00:24:00 WARN org.apache.spark.streaming.dstream.QueueInputDStream:
queueStream doesn't support checkpointing
20/12/16 00:24:00 WARN org.apache.spark.streaming.dstream.QueueInputDStream:
queueStream doesn't support checkpointing
20/12/16 00:24:00 WARN org.apache.spark.streaming.dstream.QueueInputDStream:
queueStream doesn't support checkpointing
20/12/16 00:24:00 WARN org.apache.spark.streaming.dstream.QueueInputDStream:
queueStream doesn't support checkpointing
20/12/16 00:24:00 WARN org.apache.spark.streaming.dstream.QueueInputDStream:
queueStream doesn't support checkpointing
20/12/16 00:24:00 WARN org.apache.spark.streaming.dstream.QueueInputDStream:
queueStream doesn't support checkpointing
20/12/16 00:24:00 WARN org.apache.spark.streaming.dstream.QueueInputDStream:
queueStream doesn't support checkpointing
20/12/16 00:24:00 WARN org.apache.spark.streaming.dstream.QueueInputDStream:
queueStream doesn't support checkpointing
20/12/16 00:24:00 WARN org.apache.spark.streaming.dstream.QueueInputDStream:
queueStream doesn't support checkpointing
20/12/16 00:24:00 WARN org.apache.spark.streaming.dstream.QueueInputDStream:
queueStream doesn't support checkpointing
20/12/16 00:24:01 WARN org.apache.spark.streaming.dstream.QueueInputDStream:
queueStream doesn't support checkpointing
20/12/16 00:24:01 WARN org.apache.spark.streaming.dstream.QueueInputDStream:
queueStream doesn't support checkpointing
20/12/16 00:24:01 WARN org.apache.spark.streaming.dstream.QueueInputDStream:
queueStream doesn't support checkpointing
20/12/16 00:24:01 WARN org.apache.spark.streaming.dstream.QueueInputDStream:
queueStream doesn't support checkpointing
20/12/16 00:24:01 WARN org.apache.spark.streaming.dstream.QueueInputDStream:
queueStream doesn't support checkpointing
20/12/16 00:24:01 WARN org.apache.spark.streaming.dstream.QueueInputDStream:
queueStream doesn't support checkpointing
20/12/16 00:24:01 WARN org.apache.spark.streaming.dstream.QueueInputDStream:
queueStream doesn't support checkpointing
20/12/16 00:24:01 WARN org.apache.spark.streaming.dstream.QueueInputDStream:
queueStream doesn't support checkpointing
20/12/16 00:24:01 WARN org.apache.spark.streaming.dstream.QueueInputDStream:
queueStream doesn't support checkpointing
20/12/16 00:24:01 WARN org.apache.spark.streaming.dstream.QueueInputDStream:
queueStream doesn't support checkpointing
20/12/16 00:24:01 INFO
org.apache.beam.runners.fnexecution.control.DefaultJobBundleFactory: Closing
environment urn: "EMBEDDED"
capabilities: "beam:coder:bytes:v1"
capabilities: "beam:coder:bool:v1"
capabilities: "beam:coder:varint:v1"
capabilities: "beam:coder:string_utf8:v1"
capabilities: "beam:coder:iterable:v1"
capabilities: "beam:coder:timer:v1"
capabilities: "beam:coder:kv:v1"
capabilities: "beam:coder:length_prefix:v1"
capabilities: "beam:coder:global_window:v1"
capabilities: "beam:coder:interval_window:v1"
capabilities: "beam:coder:windowed_value:v1"
capabilities: "beam:coder:double:v1"
capabilities: "beam:coder:row:v1"
capabilities: "beam:coder:param_windowed_value:v1"
capabilities: "beam:coder:state_backed_iterable:v1"
capabilities: "beam:coder:sharded_key:v1"
capabilities: "beam:protocol:multi_core_bundle_processing:v1"
capabilities: "beam:protocol:progress_reporting:v1"
capabilities: "beam:version:sdk_base:apache/beam_java8_sdk:2.27.0.dev"
capabilities: "beam:transform:sdf_truncate_sized_restrictions:v1"
dependencies {
type_urn: "beam:artifact:type:file:v1"
type_payload:
"\n\244\001/tmp/beam-artifact-staging/90441018f31cfd579397bad8895268284565549414e107c5c9c4e3c2a98ea3b1/1-EMBEDDED-icedtea-sound-Iwne2hzRY_LcFqVV9QV5vKlMjP51hQ-1eOLJzzvtpbI.jar"
role_urn: "beam:artifact:role:staging_to:v1"
role_payload:
"\n=icedtea-sound-Iwne2hzRY_LcFqVV9QV5vKlMjP51hQ-1eOLJzzvtpbI.jar"
}
dependencies {
type_urn: "beam:artifact:type:file:v1"
type_payload:
"\n\236\001/tmp/beam-artifact-staging/90441018f31cfd579397bad8895268284565549414e107c5c9c4e3c2a98ea3b1/2-EMBEDDED-jaccess-GSuLz3csmJu-X9AUZiHTbJqpaMTUV566wbey67oiHdQ.jar"
role_urn: "beam:artifact:role:staging_to:v1"
role_payload: "\n7jaccess-GSuLz3csmJu-X9AUZiHTbJqpaMTUV566wbey67oiHdQ.jar"
}
dependencies {
type_urn: "beam:artifact:type:file:v1"
type_payload:
"\n\241\001/tmp/beam-artifact-staging/90441018f31cfd579397bad8895268284565549414e107c5c9c4e3c2a98ea3b1/3-EMBEDDED-localedata-TEwJCunHd18wxAwBm3LvJNJx12solPe-xMDYaFol2sA.jar"
role_urn: "beam:artifact:role:staging_to:v1"
role_payload: "\n:localedata-TEwJCunHd18wxAwBm3LvJNJx12solPe-xMDYaFol2sA.jar"
}
dependencies {
type_urn: "beam:artifact:type:file:v1"
type_payload:
"\n\236\001/tmp/beam-artifact-staging/90441018f31cfd579397bad8895268284565549414e107c5c9c4e3c2a98ea3b1/4-EMBEDDED-nashorn-SdgMcTpgWcQtx3JL51KmsDXzNAZxettGu89S8K56auc.jar"
role_urn: "beam:artifact:role:staging_to:v1"
role_payload: "\n7nashorn-SdgMcTpgWcQtx3JL51KmsDXzNAZxettGu89S8K56auc.jar"
}
dependencies {
type_urn: "beam:artifact:type:file:v1"
type_payload:
"\n\237\001/tmp/beam-artifact-staging/90441018f31cfd579397bad8895268284565549414e107c5c9c4e3c2a98ea3b1/5-EMBEDDED-cldrdata-OUiyQiNqFFtu58zOPukvi1Butg3ZPuK250n_3RmVExU.jar"
role_urn: "beam:artifact:role:staging_to:v1"
role_payload: "\n8cldrdata-OUiyQiNqFFtu58zOPukvi1Butg3ZPuK250n_3RmVExU.jar"
}
dependencies {
type_urn: "beam:artifact:type:file:v1"
type_payload:
"\n\234\001/tmp/beam-artifact-staging/90441018f31cfd579397bad8895268284565549414e107c5c9c4e3c2a98ea3b1/6-EMBEDDED-dnsns-R-BZtd9v6E5wbD8eGFy7fqsxltVReeEAFsXCJxHGNrw.jar"
role_urn: "beam:artifact:role:staging_to:v1"
role_payload: "\n5dnsns-R-BZtd9v6E5wbD8eGFy7fqsxltVReeEAFsXCJxHGNrw.jar"
}
dependencies {
type_urn: "beam:artifact:type:file:v1"
type_payload:
"\n\244\001/tmp/beam-artifact-staging/90441018f31cfd579397bad8895268284565549414e107c5c9c4e3c2a98ea3b1/7-EMBEDDED-gradle-worker-qf5IiwZXu67peCt-moRUDeA9ftsB4QLMU30y-NdWzC8.jar"
role_urn: "beam:artifact:role:staging_to:v1"
role_payload:
"\n=gradle-worker-qf5IiwZXu67peCt-moRUDeA9ftsB4QLMU30y-NdWzC8.jar"
}
dependencies {
type_urn: "beam:artifact:type:file:v1"
type_payload:
"\n\277\001/tmp/beam-artifact-staging/90441018f31cfd579397bad8895268284565549414e107c5c9c4e3c2a98ea3b1/8-EMBEDDED-beam-runners-spark-2.27.0-SNAPSHOT-tests-VIUwWCUBH9VYrRfgJ3JgkXOH_rL8lwAXCrO3No5eqhs.jar"
role_urn: "beam:artifact:role:staging_to:v1"
role_payload:
"\nXbeam-runners-spark-2.27.0-SNAPSHOT-tests-VIUwWCUBH9VYrRfgJ3JgkXOH_rL8lwAXCrO3No5eqhs.jar"
}
dependencies {
type_urn: "beam:artifact:type:file:v1"
type_payload:
"\n\271\001/tmp/beam-artifact-staging/90441018f31cfd579397bad8895268284565549414e107c5c9c4e3c2a98ea3b1/9-EMBEDDED-beam-runners-spark-2.27.0-SNAPSHOT-roDcluFjvJNigr8KNT1mYws9zKKLnT9KBmLXJGHrakA.jar"
role_urn: "beam:artifact:role:staging_to:v1"
role_payload:
"\nRbeam-runners-spark-2.27.0-SNAPSHOT-roDcluFjvJNigr8KNT1mYws9zKKLnT9KBmLXJGHrakA.jar"
}
dependencies {
type_urn: "beam:artifact:type:file:v1"
type_payload:
"\n\300\001/tmp/beam-artifact-staging/90441018f31cfd579397bad8895268284565549414e107c5c9c4e3c2a98ea3b1/10-EMBEDDED-beam-runners-portability-java-2.27.0-SNAPSHOT-tests-k6rmbO4nQYSnVfGyVKueSIwhszdOeM0Ln-vO"
role_urn: "beam:artifact:role:staging_to:v1"
role_payload:
"\ncbeam-runners-portability-java-2.27.0-SNAPSHOT-tests-k6rmbO4nQYSnVfGyVKueSIwhszdOeM0Ln-vOOb1MPmI.jar"
}
dependencies {
type_urn: "beam:artifact:type:file:v1"
type_payload:
"\n\300\001/tmp/beam-artifact-staging/90441018f31cfd579397bad8895268284565549414e107c5c9c4e3c2a98ea3b1/11-EMBEDDED-beam-runners-portability-java-2.27.0-SNAPSHOT-rnaz2uH7bTuALGVp2OiUkziXEVGgWgkfy2FYrt0Gd4"
role_urn: "beam:artifact:role:staging_to:v1"
role_payload:
"\n]beam-runners-portability-java-2.27.0-SNAPSHOT-rnaz2uH7bTuALGVp2OiUkziXEVGgWgkfy2FYrt0Gd4w.jar"
}
dependencies {
type_urn: "beam:artifact:type:file:v1"
type_payload:
"\n\300\001/tmp/beam-artifact-staging/90441018f31cfd579397bad8895268284565549414e107c5c9c4e3c2a98ea3b1/12-EMBEDDED-beam-sdks-java-harness-2.27.0-SNAPSHOT-unshaded-nYh58N3Io3bOmnY4RSS60khe4fFu_STm-bLYDeed"
role_urn: "beam:artifact:role:staging_to:v1"
role_payload:
"\n_beam-sdks-java-harness-2.27.0-SNAPSHOT-unshaded-nYh58N3Io3bOmnY4RSS60khe4fFu_STm-bLYDeedV84.jar"
}
dependencies {
type_urn: "beam:artifact:type:file:v1"
type_payload:
"\n\276\001/tmp/beam-artifact-staging/90441018f31cfd579397bad8895268284565549414e107c5c9c4e3c2a98ea3b1/13-EMBEDDED-beam-sdks-java-harness-2.27.0-SNAPSHOT-gh6Mx8dlVqTJlqeMiGJpGfwQHxVyXfv71JfZxT9XlAs.jar"
role_urn: "beam:artifact:role:staging_to:v1"
role_payload:
"\nVbeam-sdks-java-harness-2.27.0-SNAPSHOT-gh6Mx8dlVqTJlqeMiGJpGfwQHxVyXfv71JfZxT9XlAs.jar"
}
dependencies {
type_urn: "beam:artifact:type:file:v1"
type_payload:
"\n\300\001/tmp/beam-artifact-staging/90441018f31cfd579397bad8895268284565549414e107c5c9c4e3c2a98ea3b1/14-EMBEDDED-beam-runners-core-java-2.27.0-SNAPSHOT-tests-RDLdZGC6JzZSXd5C3QOfmvw0_5AsazsorSCUoRhjukg"
role_urn: "beam:artifact:role:staging_to:v1"
role_payload:
"\n\\beam-runners-core-java-2.27.0-SNAPSHOT-tests-RDLdZGC6JzZSXd5C3QOfmvw0_5AsazsorSCUoRhjukg.jar"
}
dependencies {
type_urn: "beam:artifact:type:file:v1"
type_payload:
"\n\276\001/tmp/beam-artifact-staging/90441018f31cfd579397bad8895268284565549414e107c5c9c4e3c2a98ea3b1/15-EMBEDDED-beam-runners-core-java-2.27.0-SNAPSHOT-EoJ25ciIZMjsAsXPS5rF9lMtKKNpvgoVfoiRRL_Y070.jar"
role_urn: "beam:artifact:role:staging_to:v1"
role_payload:
"\nVbeam-runners-core-java-2.27.0-SNAPSHOT-EoJ25ciIZMjsAsXPS5rF9lMtKKNpvgoVfoiRRL_Y070.jar"
}
dependencies {
type_urn: "beam:artifact:type:file:v1"
type_payload:
"\n\300\001/tmp/beam-artifact-staging/90441018f31cfd579397bad8895268284565549414e107c5c9c4e3c2a98ea3b1/16-EMBEDDED-beam-runners-java-job-service-2.27.0-SNAPSHOT-uX1c_5frzX2Xl8Dxwhv74l1LtK_tJN0lnW47YmuX_m"
role_urn: "beam:artifact:role:staging_to:v1"
role_payload:
"\n]beam-runners-java-job-service-2.27.0-SNAPSHOT-uX1c_5frzX2Xl8Dxwhv74l1LtK_tJN0lnW47YmuX_mg.jar"
}
dependencies {
type_urn: "beam:artifact:type:file:v1"
type_payload:
"\n\277\001/tmp/beam-artifact-staging/90441018f31cfd579397bad8895268284565549414e107c5c9c4e3c2a98ea3b1/17-EMBEDDED-beam-sdks-java-io-kafka-2.27.0-SNAPSHOT--3tpjyY5fnm6MnYASABrYhNPATm_9NQWNJ5O0OzNd9g.jar"
role_urn: "beam:artifact:role:staging_to:v1"
role_payload:
"\nWbeam-sdks-java-io-kafka-2.27.0-SNAPSHOT--3tpjyY5fnm6MnYASABrYhNPATm_9NQWNJ5O0OzNd9g.jar"
}
dependencies {
type_urn: "beam:artifact:type:file:v1"
type_payload:
"\n\300\001/tmp/beam-artifact-staging/90441018f31cfd579397bad8895268284565549414e107c5c9c4e3c2a98ea3b1/18-EMBEDDED-beam-sdks-java-expansion-service-2.27.0-SNAPSHOT-Pq7-h5rVFSiymvpGKRHg_tR7ri-Pw5Fpm-Oku_A"
role_urn: "beam:artifact:role:staging_to:v1"
role_payload:
"\n`beam-sdks-java-expansion-service-2.27.0-SNAPSHOT-Pq7-h5rVFSiymvpGKRHg_tR7ri-Pw5Fpm-Oku_AFSf0.jar"
}
dependencies {
type_urn: "beam:artifact:type:file:v1"
type_payload:
"\n\300\001/tmp/beam-artifact-staging/90441018f31cfd579397bad8895268284565549414e107c5c9c4e3c2a98ea3b1/19-EMBEDDED-beam-runners-java-fn-execution-2.27.0-SNAPSHOT-F7yo2w8-i6VnpVD9viLcI04VkkboYBM2c7mSZqfHp"
role_urn: "beam:artifact:role:staging_to:v1"
role_payload:
"\n^beam-runners-java-fn-execution-2.27.0-SNAPSHOT-F7yo2w8-i6VnpVD9viLcI04VkkboYBM2c7mSZqfHpLc.jar"
}
dependencies {
type_urn: "beam:artifact:type:file:v1"
type_payload:
"\n\300\001/tmp/beam-artifact-staging/90441018f31cfd579397bad8895268284565549414e107c5c9c4e3c2a98ea3b1/20-EMBEDDED-beam-runners-core-construction-java-2.27.0-SNAPSHOT-CIMmn5THHKVYsTOdd9ZB67FVO6Ru7B_q48Of"
role_urn: "beam:artifact:role:staging_to:v1"
role_payload:
"\ncbeam-runners-core-construction-java-2.27.0-SNAPSHOT-CIMmn5THHKVYsTOdd9ZB67FVO6Ru7B_q48Of6usYPc4.jar"
}
dependencies {
type_urn: "beam:artifact:type:file:v1"
type_payload:
"\n\300\001/tmp/beam-artifact-staging/90441018f31cfd579397bad8895268284565549414e107c5c9c4e3c2a98ea3b1/21-EMBEDDED-beam-runners-core-construction-java-2.27.0-SNAPSHOT-tests-O6I6jZM0kJWyiJHL-qHgPRFSUwXEEj"
role_urn: "beam:artifact:role:staging_to:v1"
role_payload:
"\nibeam-runners-core-construction-java-2.27.0-SNAPSHOT-tests-O6I6jZM0kJWyiJHL-qHgPRFSUwXEEj-oJVNOB4027p4.jar"
}
dependencies {
type_urn: "beam:artifact:type:file:v1"
type_payload:
"\n\300\001/tmp/beam-artifact-staging/90441018f31cfd579397bad8895268284565549414e107c5c9c4e3c2a98ea3b1/22-EMBEDDED-beam-sdks-java-extensions-google-cloud-platform-core-2.27.0-SNAPSHOT-RGTlUSZ9ATn9KQPtZ4Q"
role_urn: "beam:artifact:role:staging_to:v1"
role_payload:
"\ntbeam-sdks-java-extensions-google-cloud-platform-core-2.27.0-SNAPSHOT-RGTlUSZ9ATn9KQPtZ4QuP0pbls8RBTH-gdR-EFJhkYM.jar"
}
dependencies {
type_urn: "beam:artifact:type:file:v1"
type_payload:
"\n\300\001/tmp/beam-artifact-staging/90441018f31cfd579397bad8895268284565549414e107c5c9c4e3c2a98ea3b1/23-EMBEDDED-beam-sdks-java-fn-execution-2.27.0-SNAPSHOT-Pmfe35mZE8zLMJpjz-sptwayCpdMEM8Z04gJSvwMALs."
role_urn: "beam:artifact:role:staging_to:v1"
role_payload:
"\n[beam-sdks-java-fn-execution-2.27.0-SNAPSHOT-Pmfe35mZE8zLMJpjz-sptwayCpdMEM8Z04gJSvwMALs.jar"
}
dependencies {
type_urn: "beam:artifact:type:file:v1"
type_payload:
"\n\300\001/tmp/beam-artifact-staging/90441018f31cfd579397bad8895268284565549414e107c5c9c4e3c2a98ea3b1/24-EMBEDDED-beam-vendor-sdks-java-extensions-protobuf-2.27.0-SNAPSHOT-AYlO4ihGFJdqvbnpluofQsA8Z1QEUN"
role_urn: "beam:artifact:role:staging_to:v1"
role_payload:
"\nibeam-vendor-sdks-java-extensions-protobuf-2.27.0-SNAPSHOT-AYlO4ihGFJdqvbnpluofQsA8Z1QEUN-0HOitHv_f_ww.jar"
}
dependencies {
type_urn: "beam:artifact:type:file:v1"
type_payload:
"\n\300\001/tmp/beam-artifact-staging/90441018f31cfd579397bad8895268284565549414e107c5c9c4e3c2a98ea3b1/25-EMBEDDED-beam-sdks-java-core-2.27.0-SNAPSHOT-tests-FB4KyxowVLZuqUVDK6zQ0kXL6qK9mF6mrJARQCHcw10.ja"
role_urn: "beam:artifact:role:staging_to:v1"
role_payload:
"\nYbeam-sdks-java-core-2.27.0-SNAPSHOT-tests-FB4KyxowVLZuqUVDK6zQ0kXL6qK9mF6mrJARQCHcw10.jar"
}
dependencies {
type_urn: "beam:artifact:type:file:v1"
type_payload:
"\n\273\001/tmp/beam-artifact-staging/90441018f31cfd579397bad8895268284565549414e107c5c9c4e3c2a98ea3b1/26-EMBEDDED-beam-sdks-java-core-2.27.0-SNAPSHOT-67j6-Te-ZgtqwSs0DGJrLghImmKVD_XjwNi86ihXMg4.jar"
role_urn: "beam:artifact:role:staging_to:v1"
role_payload:
"\nSbeam-sdks-java-core-2.27.0-SNAPSHOT-67j6-Te-ZgtqwSs0DGJrLghImmKVD_XjwNi86ihXMg4.jar"
}
dependencies {
type_urn: "beam:artifact:type:file:v1"
type_payload:
"\n\300\001/tmp/beam-artifact-staging/90441018f31cfd579397bad8895268284565549414e107c5c9c4e3c2a98ea3b1/27-EMBEDDED-beam-sdks-java-core-2.27.0-SNAPSHOT-unshaded-KNIM5sbOtV_jFTHGjDVY5vtQSiKkVfEirfcFoGoXPUo"
role_urn: "beam:artifact:role:staging_to:v1"
role_payload:
"\n\\beam-sdks-java-core-2.27.0-SNAPSHOT-unshaded-KNIM5sbOtV_jFTHGjDVY5vtQSiKkVfEirfcFoGoXPUo.jar"
}
dependencies {
type_urn: "beam:artifact:type:file:v1"
type_payload:
"\n\256\001/tmp/beam-artifact-staging/90441018f31cfd579397bad8895268284565549414e107c5c9c4e3c2a98ea3b1/28-EMBEDDED-guava-testlib-25.1-jre-Gs-YhZbSzRrSwEz1JPl5w-hUaJjNF3C9wAfy8mjXtmQ.jar"
role_urn: "beam:artifact:role:staging_to:v1"
role_payload:
"\nFguava-testlib-25.1-jre-Gs-YhZbSzRrSwEz1JPl5w-hUaJjNF3C9wAfy8mjXtmQ.jar"
}
dependencies {
type_urn: "beam:artifact:type:file:v1"
type_payload:
"\n\254\001/tmp/beam-artifact-staging/90441018f31cfd579397bad8895268284565549414e107c5c9c4e3c2a98ea3b1/29-EMBEDDED-spark-sql_2.11-2.4.7-CsTKJqhM5x-U_FGx7jDozW9Fht4c_cDu74ZBnyGX6fw.jar"
role_urn: "beam:artifact:role:staging_to:v1"
role_payload:
"\nDspark-sql_2.11-2.4.7-CsTKJqhM5x-U_FGx7jDozW9Fht4c_cDu74ZBnyGX6fw.jar"
}
dependencies {
type_urn: "beam:artifact:type:file:v1"
type_payload:
"\n\262\001/tmp/beam-artifact-staging/90441018f31cfd579397bad8895268284565549414e107c5c9c4e3c2a98ea3b1/30-EMBEDDED-spark-streaming_2.11-2.4.7-ue_7LAg7Qr813xkNgtQfU9eAIy07ReCHArqpz9Cv0Ew.jar"
role_urn: "beam:artifact:role:staging_to:v1"
role_payload:
"\nJspark-streaming_2.11-2.4.7-ue_7LAg7Qr813xkNgtQfU9eAIy07ReCHArqpz9Cv0Ew.jar"
}
dependencies {
type_urn: "beam:artifact:type:file:v1"
type_payload:
"\n\261\001/tmp/beam-artifact-staging/90441018f31cfd579397bad8895268284565549414e107c5c9c4e3c2a98ea3b1/31-EMBEDDED-spark-catalyst_2.11-2.4.7-HPCOgFf3FaqeYmff418i_Br9I2v89E_YDyEEJizcIU0.jar"
role_urn: "beam:artifact:role:staging_to:v1"
role_payload:
"\nIspark-catalyst_2.11-2.4.7-HPCOgFf3FaqeYmff418i_Br9I2v89E_YDyEEJizcIU0.jar"
}
dependencies {
type_urn: "beam:artifact:type:file:v1"
type_payload:
"\n\255\001/tmp/beam-artifact-staging/90441018f31cfd579397bad8895268284565549414e107c5c9c4e3c2a98ea3b1/32-EMBEDDED-spark-core_2.11-2.4.7-kfYudFrbOp2tu2iliTUL91CGXawNYRvw3hHz-VnbUFI.jar"
role_urn: "beam:artifact:role:staging_to:v1"
role_payload:
"\nEspark-core_2.11-2.4.7-kfYudFrbOp2tu2iliTUL91CGXawNYRvw3hHz-VnbUFI.jar"
}
dependencies {
type_urn: "beam:artifact:type:file:v1"
type_payload:
"\n\254\001/tmp/beam-artifact-staging/90441018f31cfd579397bad8895268284565549414e107c5c9c4e3c2a98ea3b1/33-EMBEDDED-hadoop-client-2.10.1-bZMdxnHBprJoceVSpimHjHyDAlR_8INTS5Ku1LylsAI.jar"
role_urn: "beam:artifact:role:staging_to:v1"
role_payload:
"\nDhadoop-client-2.10.1-bZMdxnHBprJoceVSpimHjHyDAlR_8INTS5Ku1LylsAI.jar"
}
dependencies {
type_urn: "beam:artifact:type:file:v1"
type_payload:
"\n\272\001/tmp/beam-artifact-staging/90441018f31cfd579397bad8895268284565549414e107c5c9c4e3c2a98ea3b1/34-EMBEDDED-hadoop-mapreduce-client-app-2.10.1-NH4nvQw_Czc4M4WzRq2tj6-1cFEdzq5PBdwN4QG4RBE.jar"
role_urn: "beam:artifact:role:staging_to:v1"
role_payload:
"\nRhadoop-mapreduce-client-app-2.10.1-NH4nvQw_Czc4M4WzRq2tj6-1cFEdzq5PBdwN4QG4RBE.jar"
}
dependencies {
type_urn: "beam:artifact:type:file:v1"
type_payload:
"\n\300\001/tmp/beam-artifact-staging/90441018f31cfd579397bad8895268284565549414e107c5c9c4e3c2a98ea3b1/35-EMBEDDED-hadoop-mapreduce-client-jobclient-2.10.1-nfZ_Ocdnp24qWUZ6RM9JQ3wro8n2JRrCanuecVq7Ubg.jar"
role_urn: "beam:artifact:role:staging_to:v1"
role_payload:
"\nXhadoop-mapreduce-client-jobclient-2.10.1-nfZ_Ocdnp24qWUZ6RM9JQ3wro8n2JRrCanuecVq7Ubg.jar"
}
dependencies {
type_urn: "beam:artifact:type:file:v1"
type_payload:
"\n\276\001/tmp/beam-artifact-staging/90441018f31cfd579397bad8895268284565549414e107c5c9c4e3c2a98ea3b1/36-EMBEDDED-hadoop-mapreduce-client-shuffle-2.10.1-UTrRBwBQKG40z_CG64RfISUBsktoZ6cl7KEunywMYfQ.jar"
role_urn: "beam:artifact:role:staging_to:v1"
role_payload:
"\nVhadoop-mapreduce-client-shuffle-2.10.1-UTrRBwBQKG40z_CG64RfISUBsktoZ6cl7KEunywMYfQ.jar"
}
dependencies {
type_urn: "beam:artifact:type:file:v1"
type_payload:
"\n\275\001/tmp/beam-artifact-staging/90441018f31cfd579397bad8895268284565549414e107c5c9c4e3c2a98ea3b1/37-EMBEDDED-hadoop-yarn-server-nodemanager-2.10.1-tgNbEbkCuTUhAYpNN5XJZnAX1iNurbPv99ysUI6cCaU.jar"
role_urn: "beam:artifact:role:staging_to:v1"
role_payload:
"\nUhadoop-yarn-server-nodemanager-2.10.1-tgNbEbkCuTUhAYpNN5XJZnAX1iNurbPv99ysUI6cCaU.jar"
}
dependencies {
type_urn: "beam:artifact:type:file:v1"
type_payload:
"\n\270\001/tmp/beam-artifact-staging/90441018f31cfd579397bad8895268284565549414e107c5c9c4e3c2a98ea3b1/38-EMBEDDED-hadoop-yarn-server-common-2.10.1-pvfLtr8jdHR_M2SpzglErT2BgBRsUdZgeYTk4Kr02IA.jar"
role_urn: "beam:artifact:role:staging_to:v1"
role_payload:
"\nPhadoop-yarn-server-common-2.10.1-pvfLtr8jdHR_M2SpzglErT2BgBRsUdZgeYTk4Kr02IA.jar"
}
dependencies {
type_urn: "beam:artifact:type:file:v1"
type_payload:
"\n\263\001/tmp/beam-artifact-staging/90441018f31cfd579397bad8895268284565549414e107c5c9c4e3c2a98ea3b1/39-EMBEDDED-hadoop-yarn-registry-2.10.1-B1aKWUmtsxIHdlXs15tzO7JVNJbsc72bexiSx6Ta3Ks.jar"
role_urn: "beam:artifact:role:staging_to:v1"
role_payload:
"\nKhadoop-yarn-registry-2.10.1-B1aKWUmtsxIHdlXs15tzO7JVNJbsc72bexiSx6Ta3Ks.jar"
}
dependencies {
type_urn: "beam:artifact:type:file:v1"
type_payload:
"\n\254\001/tmp/beam-artifact-staging/90441018f31cfd579397bad8895268284565549414e107c5c9c4e3c2a98ea3b1/40-EMBEDDED-hadoop-common-2.10.1-ZEwFDVser7F01cLblHm86RovcSyTEEIq5OnleOw1qPI.jar"
role_urn: "beam:artifact:role:staging_to:v1"
role_payload:
"\nDhadoop-common-2.10.1-ZEwFDVser7F01cLblHm86RovcSyTEEIq5OnleOw1qPI.jar"
}
dependencies {
type_urn: "beam:artifact:type:file:v1"
type_payload:
"\n\300\001/tmp/beam-artifact-staging/90441018f31cfd579397bad8895268284565549414e107c5c9c4e3c2a98ea3b1/41-EMBEDDED-google-api-services-cloudresourcemanager-v1-rev20200720-1.30.10-PQqVlsOIu2M59XLbEl59CW6w"
role_urn: "beam:artifact:role:staging_to:v1"
role_payload:
"\nogoogle-api-services-cloudresourcemanager-v1-rev20200720-1.30.10-PQqVlsOIu2M59XLbEl59CW6wNmY5OYy_R71khhZQ8-Y.jar"
}
dependencies {
type_urn: "beam:artifact:type:file:v1"
type_payload:
"\n\243\001/tmp/beam-artifact-staging/90441018f31cfd579397bad8895268284565549414e107c5c9c4e3c2a98ea3b1/42-EMBEDDED-gcsio-2.1.6-DDvpa0BcZtKnPC239b3P0szeJfKpgCbE1tZeDi1fMio.jar"
role_urn: "beam:artifact:role:staging_to:v1"
role_payload: "\n;gcsio-2.1.6-DDvpa0BcZtKnPC239b3P0szeJfKpgCbE1tZeDi1fMio.jar"
}
dependencies {
type_urn: "beam:artifact:type:file:v1"
type_payload:
"\n\242\001/tmp/beam-artifact-staging/90441018f31cfd579397bad8895268284565549414e107c5c9c4e3c2a98ea3b1/43-EMBEDDED-util-2.1.6-284LeJDNfVgny-ddI5wcKbvJN8Ug2xC2tZwCOF_F_pk.jar"
role_urn: "beam:artifact:role:staging_to:v1"
role_payload: "\n:util-2.1.6-284LeJDNfVgny-ddI5wcKbvJN8Ug2xC2tZwCOF_F_pk.jar"
}
dependencies {
type_urn: "beam:artifact:type:file:v1"
type_payload:
"\n\300\001/tmp/beam-artifact-staging/90441018f31cfd579397bad8895268284565549414e107c5c9c4e3c2a98ea3b1/44-EMBEDDED-google-api-services-storage-v1-rev20200611-1.30.10-INrcnpWLWvkN-Mf-ig-ab-lYg9NBuztZDHchm"
role_urn: "beam:artifact:role:staging_to:v1"
role_payload:
"\nbgoogle-api-services-storage-v1-rev20200611-1.30.10-INrcnpWLWvkN-Mf-ig-ab-lYg9NBuztZDHchmNhVCVc.jar"
}
dependencies {
type_urn: "beam:artifact:type:file:v1"
type_payload:
"\n\267\001/tmp/beam-artifact-staging/90441018f31cfd579397bad8895268284565549414e107c5c9c4e3c2a98ea3b1/45-EMBEDDED-google-api-client-java6-1.30.10-m2I4oHqNXjz0pJ-TP3zK5_cofaMLXRJwTHexGAhXg04.jar"
role_urn: "beam:artifact:role:staging_to:v1"
role_payload:
"\nOgoogle-api-client-java6-1.30.10-m2I4oHqNXjz0pJ-TP3zK5_cofaMLXRJwTHexGAhXg04.jar"
}
dependencies {
type_urn: "beam:artifact:type:file:v1"
type_payload:
"\n\272\001/tmp/beam-artifact-staging/90441018f31cfd579397bad8895268284565549414e107c5c9c4e3c2a98ea3b1/46-EMBEDDED-google-api-client-jackson2-1.30.10-VpK9R1T0BTfZBKYo0BYUAFSlh5Bc_I_Q_fdy5_Z9rTc.jar"
role_urn: "beam:artifact:role:staging_to:v1"
role_payload:
"\nRgoogle-api-client-jackson2-1.30.10-VpK9R1T0BTfZBKYo0BYUAFSlh5Bc_I_Q_fdy5_Z9rTc.jar"
}
dependencies {
type_urn: "beam:artifact:type:file:v1"
type_payload:
"\n\300\001/tmp/beam-artifact-staging/90441018f31cfd579397bad8895268284565549414e107c5c9c4e3c2a98ea3b1/47-EMBEDDED-google-api-services-iamcredentials-v1-rev20201022-1.30.10-KY-5cxRydZDW8rX96DEAbTnLjTcfn_"
role_urn: "beam:artifact:role:staging_to:v1"
role_payload:
"\nigoogle-api-services-iamcredentials-v1-rev20201022-1.30.10-KY-5cxRydZDW8rX96DEAbTnLjTcfn_SMGgOAUiNbN38.jar"
}
dependencies {
type_urn: "beam:artifact:type:file:v1"
type_payload:
"\n\261\001/tmp/beam-artifact-staging/90441018f31cfd579397bad8895268284565549414e107c5c9c4e3c2a98ea3b1/48-EMBEDDED-google-api-client-1.30.10-7bDzALb3Oeai2wPM6a7-ITpWzwAmZClXyRvl43ox-lE.jar"
role_urn: "beam:artifact:role:staging_to:v1"
role_payload:
"\nIgoogle-api-client-1.30.10-7bDzALb3Oeai2wPM6a7-ITpWzwAmZClXyRvl43ox-lE.jar"
}
dependencies {
type_urn: "beam:artifact:type:file:v1"
type_payload:
"\n\252\001/tmp/beam-artifact-staging/90441018f31cfd579397bad8895268284565549414e107c5c9c4e3c2a98ea3b1/49-EMBEDDED-hadoop-auth-2.10.1-bQBa26Dmk_izZNA8mb830PpLP5U7UqZ21o0J5W1Zr1Y.jar"
role_urn: "beam:artifact:role:staging_to:v1"
role_payload:
"\nBhadoop-auth-2.10.1-bQBa26Dmk_izZNA8mb830PpLP5U7UqZ21o0J5W1Zr1Y.jar"
}
dependencies {
type_urn: "beam:artifact:type:file:v1"
type_payload:
"\n\256\001/tmp/beam-artifact-staging/90441018f31cfd579397bad8895268284565549414e107c5c9c4e3c2a98ea3b1/50-EMBEDDED-curator-recipes-2.13.0-Ir4FwaPmxe3iLnc3KwjcYxo7k7ZKy39oJTfqZabdugY.jar"
role_urn: "beam:artifact:role:staging_to:v1"
role_payload:
"\nFcurator-recipes-2.13.0-Ir4FwaPmxe3iLnc3KwjcYxo7k7ZKy39oJTfqZabdugY.jar"
}
dependencies {
type_urn: "beam:artifact:type:file:v1"
type_payload:
"\n\260\001/tmp/beam-artifact-staging/90441018f31cfd579397bad8895268284565549414e107c5c9c4e3c2a98ea3b1/51-EMBEDDED-curator-framework-2.13.0-2whOXg_tBUioEo8So-ehXIdclZXnUxbJV41k53N1xKk.jar"
role_urn: "beam:artifact:role:staging_to:v1"
role_payload:
"\nHcurator-framework-2.13.0-2whOXg_tBUioEo8So-ehXIdclZXnUxbJV41k53N1xKk.jar"
}
dependencies {
type_urn: "beam:artifact:type:file:v1"
type_payload:
"\n\255\001/tmp/beam-artifact-staging/90441018f31cfd579397bad8895268284565549414e107c5c9c4e3c2a98ea3b1/52-EMBEDDED-curator-client-2.13.0-YqsiAbW5r2OyFaTmgp2-fVU6CAXPsLGmZfm0nagnDFE.jar"
role_urn: "beam:artifact:role:staging_to:v1"
role_payload:
"\nEcurator-client-2.13.0-YqsiAbW5r2OyFaTmgp2-fVU6CAXPsLGmZfm0nagnDFE.jar"
}
dependencies {
type_urn: "beam:artifact:type:file:v1"
type_payload:
"\n\250\001/tmp/beam-artifact-staging/90441018f31cfd579397bad8895268284565549414e107c5c9c4e3c2a98ea3b1/53-EMBEDDED-grpc-alts-1.32.2--ZC6OnLbAv2d_q5SI7JiYWDRIvoZhuBdpNxqpfNveQA.jar"
role_urn: "beam:artifact:role:staging_to:v1"
role_payload:
"\[email protected]_q5SI7JiYWDRIvoZhuBdpNxqpfNveQA.jar"
}
dependencies {
type_urn: "beam:artifact:type:file:v1"
type_payload:
"\n\276\001/tmp/beam-artifact-staging/90441018f31cfd579397bad8895268284565549414e107c5c9c4e3c2a98ea3b1/54-EMBEDDED-google-auth-library-oauth2-http-0.21.1-Hv_9dSHbDzcIUoTvrY32SZvHv_0XE-98dTdpK601brc.jar"
role_urn: "beam:artifact:role:staging_to:v1"
role_payload:
"\nVgoogle-auth-library-oauth2-http-0.21.1-Hv_9dSHbDzcIUoTvrY32SZvHv_0XE-98dTdpK601brc.jar"
}
dependencies {
type_urn: "beam:artifact:type:file:v1"
type_payload:
"\n\272\001/tmp/beam-artifact-staging/90441018f31cfd579397bad8895268284565549414e107c5c9c4e3c2a98ea3b1/55-EMBEDDED-google-http-client-jackson2-1.36.0-ZBMVy9W29KBp3MjVnmj8_6RywV8JbhGAhe58prLtV0k.jar"
role_urn: "beam:artifact:role:staging_to:v1"
role_payload:
"\nRgoogle-http-client-jackson2-1.36.0-ZBMVy9W29KBp3MjVnmj8_6RywV8JbhGAhe58prLtV0k.jar"
}
dependencies {
type_urn: "beam:artifact:type:file:v1"
type_payload:
"\n\270\001/tmp/beam-artifact-staging/90441018f31cfd579397bad8895268284565549414e107c5c9c4e3c2a98ea3b1/56-EMBEDDED-google-oauth-client-java6-1.31.0-nGYS21dwrwkEoUPYFWsIkA4BWwYgS-D7Dsqi_bA4tdU.jar"
role_urn: "beam:artifact:role:staging_to:v1"
role_payload:
"\nPgoogle-oauth-client-java6-1.31.0-nGYS21dwrwkEoUPYFWsIkA4BWwYgS-D7Dsqi_bA4tdU.jar"
}
dependencies {
type_urn: "beam:artifact:type:file:v1"
type_payload:
"\n\262\001/tmp/beam-artifact-staging/90441018f31cfd579397bad8895268284565549414e107c5c9c4e3c2a98ea3b1/57-EMBEDDED-google-oauth-client-1.31.0-9fiaR9DCEOJ3VPxypLVvfxhohPwMB0pyoLY-Gc52QtA.jar"
role_urn: "beam:artifact:role:staging_to:v1"
role_payload:
"\nJgoogle-oauth-client-1.31.0-9fiaR9DCEOJ3VPxypLVvfxhohPwMB0pyoLY-Gc52QtA.jar"
}
dependencies {
type_urn: "beam:artifact:type:file:v1"
type_payload:
"\n\261\001/tmp/beam-artifact-staging/90441018f31cfd579397bad8895268284565549414e107c5c9c4e3c2a98ea3b1/58-EMBEDDED-google-http-client-1.36.0-FsJUVitseNIt0cjra4WIpHzf3Qfw6ECLJ9kZQss8Jys.jar"
role_urn: "beam:artifact:role:staging_to:v1"
role_payload:
"\nIgoogle-http-client-1.36.0-FsJUVitseNIt0cjra4WIpHzf3Qfw6ECLJ9kZQss8Jys.jar"
}
dependencies {
type_urn: "beam:artifact:type:file:v1"
type_payload:
"\n\254\001/tmp/beam-artifact-staging/90441018f31cfd579397bad8895268284565549414e107c5c9c4e3c2a98ea3b1/59-EMBEDDED-guava-retrying-2.0.0-X2BJpwxsL7VqXzo-E1DOHoU7XGzKugH7-caDXXKslIQ.jar"
role_urn: "beam:artifact:role:staging_to:v1"
role_payload:
"\nDguava-retrying-2.0.0-X2BJpwxsL7VqXzo-E1DOHoU7XGzKugH7-caDXXKslIQ.jar"
}
dependencies {
type_urn: "beam:artifact:type:file:v1"
type_payload:
"\n\250\001/tmp/beam-artifact-staging/90441018f31cfd579397bad8895268284565549414e107c5c9c4e3c2a98ea3b1/60-EMBEDDED-grpc-auth-1.32.2-tXVw3UA6m9k1LDfn19L7hdIL7IdVNGEkn3Nkk5j64u8.jar"
role_urn: "beam:artifact:role:staging_to:v1"
role_payload:
"\n...@grpc-auth-1.32.2-txvw3ua6m9k1ldfn19l7hdil7idvngekn3nkk5j64u8.jar"
}
dependencies {
type_urn: "beam:artifact:type:file:v1"
type_payload:
"\n\252\001/tmp/beam-artifact-staging/90441018f31cfd579397bad8895268284565549414e107c5c9c4e3c2a98ea3b1/61-EMBEDDED-grpc-grpclb-1.32.2-Uhock4UYgrJH4slC6y9BpfjRJ-yrExibTernv194QBY.jar"
role_urn: "beam:artifact:role:staging_to:v1"
role_payload:
"\nBgrpc-grpclb-1.32.2-Uhock4UYgrJH4slC6y9BpfjRJ-yrExibTernv194QBY.jar"
}
dependencies {
type_urn: "beam:artifact:type:file:v1"
type_payload:
"\n\254\001/tmp/beam-artifact-staging/90441018f31cfd579397bad8895268284565549414e107c5c9c4e3c2a98ea3b1/62-EMBEDDED-grpc-protobuf-1.32.2-w0rDphOeaIP11jbfUK-tfnfen4bTXw350rGvZ3nTdbc.jar"
role_urn: "beam:artifact:role:staging_to:v1"
role_payload:
"\nDgrpc-protobuf-1.32.2-w0rDphOeaIP11jbfUK-tfnfen4bTXw350rGvZ3nTdbc.jar"
}
dependencies {
type_urn: "beam:artifact:type:file:v1"
type_payload:
"\n\250\001/tmp/beam-artifact-staging/90441018f31cfd579397bad8895268284565549414e107c5c9c4e3c2a98ea3b1/63-EMBEDDED-grpc-stub-1.32.2-Cb7aepW8MirhWxyDPJZguHRJkvdgmL_KiJ6fUoEdrc4.jar"
role_urn: "beam:artifact:role:staging_to:v1"
role_payload:
"\[email protected]_KiJ6fUoEdrc4.jar"
}
dependencies {
type_urn: "beam:artifact:type:file:v1"
type_payload:
"\n\261\001/tmp/beam-artifact-staging/90441018f31cfd579397bad8895268284565549414e107c5c9c4e3c2a98ea3b1/64-EMBEDDED-protobuf-java-util-3.12.0-FLc01aNq-LufosYgt1sfpMcB58bzXVypTyeuN7Qpc6Y.jar"
role_urn: "beam:artifact:role:staging_to:v1"
role_payload:
"\nIprotobuf-java-util-3.12.0-FLc01aNq-LufosYgt1sfpMcB58bzXVypTyeuN7Qpc6Y.jar"
}
dependencies {
type_urn: "beam:artifact:type:file:v1"
type_payload:
"\n\275\001/tmp/beam-artifact-staging/90441018f31cfd579397bad8895268284565549414e107c5c9c4e3c2a98ea3b1/65-EMBEDDED-hadoop-mapreduce-client-common-2.10.1-arqPLaCkcmvoxvSF4MeqbFyX3yOz_ogFRpeSjWNrQLw.jar"
role_urn: "beam:artifact:role:staging_to:v1"
role_payload:
"\nUhadoop-mapreduce-client-common-2.10.1-arqPLaCkcmvoxvSF4MeqbFyX3yOz_ogFRpeSjWNrQLw.jar"
}
dependencies {
type_urn: "beam:artifact:type:file:v1"
type_payload:
"\n\273\001/tmp/beam-artifact-staging/90441018f31cfd579397bad8895268284565549414e107c5c9c4e3c2a98ea3b1/66-EMBEDDED-hadoop-mapreduce-client-core-2.10.1-ckjKJlrNpYV3610ySwWNAeslfACzE4un8_GEhljgMIg.jar"
role_urn: "beam:artifact:role:staging_to:v1"
role_payload:
"\nShadoop-mapreduce-client-core-2.10.1-ckjKJlrNpYV3610ySwWNAeslfACzE4un8_GEhljgMIg.jar"
}
dependencies {
type_urn: "beam:artifact:type:file:v1"
type_payload:
"\n\261\001/tmp/beam-artifact-staging/90441018f31cfd579397bad8895268284565549414e107c5c9c4e3c2a98ea3b1/67-EMBEDDED-hadoop-yarn-client-2.10.1-XckP92wdceTuH5qxJJ-TW-vPQhD9o8LYZId9vesU7dg.jar"
role_urn: "beam:artifact:role:staging_to:v1"
role_payload:
"\nIhadoop-yarn-client-2.10.1-XckP92wdceTuH5qxJJ-TW-vPQhD9o8LYZId9vesU7dg.jar"
}
dependencies {
type_urn: "beam:artifact:type:file:v1"
type_payload:
"\n\261\001/tmp/beam-artifact-staging/90441018f31cfd579397bad8895268284565549414e107c5c9c4e3c2a98ea3b1/68-EMBEDDED-hadoop-yarn-common-2.10.1-X_vtNq_EbKagW40r3DHgYBR9cgjKnejLGT0YlGVTXeU.jar"
role_urn: "beam:artifact:role:staging_to:v1"
role_payload:
"\nIhadoop-yarn-common-2.10.1-X_vtNq_EbKagW40r3DHgYBR9cgjKnejLGT0YlGVTXeU.jar"
}
dependencies {
type_urn: "beam:artifact:type:file:v1"
type_payload:
"\n\256\001/tmp/beam-artifact-staging/90441018f31cfd579397bad8895268284565549414e107c5c9c4e3c2a98ea3b1/69-EMBEDDED-hadoop-yarn-api-2.10.1-z4MB8y0eZBVIZREunMoTNQtYUZ9Lk7v_qcSa-Uc5fUQ.jar"
role_urn: "beam:artifact:role:staging_to:v1"
role_payload:
"\nFhadoop-yarn-api-2.10.1-z4MB8y0eZBVIZREunMoTNQtYUZ9Lk7v_qcSa-Uc5fUQ.jar"
}
dependencies {
type_urn: "beam:artifact:type:file:v1"
type_payload:
"\n\273\001/tmp/beam-artifact-staging/90441018f31cfd579397bad8895268284565549414e107c5c9c4e3c2a98ea3b1/70-EMBEDDED-opencensus-contrib-http-util-0.24.0-cVUnO7se09R36jPPGde7wLKF_zlfQ7Ka5XZyLPJHAA8.jar"
role_urn: "beam:artifact:role:staging_to:v1"
role_payload:
"\nSopencensus-contrib-http-util-0.24.0-cVUnO7se09R36jPPGde7wLKF_zlfQ7Ka5XZyLPJHAA8.jar"
}
dependencies {
type_urn: "beam:artifact:type:file:v1"
type_payload:
"\n\260\001/tmp/beam-artifact-staging/90441018f31cfd579397bad8895268284565549414e107c5c9c4e3c2a98ea3b1/71-EMBEDDED-grpc-netty-shaded-1.32.2-jwcS3rpu2MJjPpzcnKpvCaKTLneldMIE3K22fEL83vU.jar"
role_urn: "beam:artifact:role:staging_to:v1"
role_payload:
"\nHgrpc-netty-shaded-1.32.2-jwcS3rpu2MJjPpzcnKpvCaKTLneldMIE3K22fEL83vU.jar"
}
dependencies {
type_urn: "beam:artifact:type:file:v1"
type_payload:
"\n\250\001/tmp/beam-artifact-staging/90441018f31cfd579397bad8895268284565549414e107c5c9c4e3c2a98ea3b1/72-EMBEDDED-grpc-core-1.32.2-TKg9cKsQsqYM0qBsD6yBJicAALKToEJNmzzyB5TF7S0.jar"
role_urn: "beam:artifact:role:staging_to:v1"
role_payload:
"\n...@grpc-core-1.32.2-tkg9cksqsqym0qbsd6ybjicaalktoejnmzzyb5tf7s0.jar"
}
dependencies {
type_urn: "beam:artifact:type:file:v1"
type_payload:
"\n\261\001/tmp/beam-artifact-staging/90441018f31cfd579397bad8895268284565549414e107c5c9c4e3c2a98ea3b1/73-EMBEDDED-grpc-protobuf-lite-1.32.2-iJSr-113av7NbF-7whm6vXxOin7zuKEoPRuUP3w-6Vo.jar"
role_urn: "beam:artifact:role:staging_to:v1"
role_payload:
"\nIgrpc-protobuf-lite-1.32.2-iJSr-113av7NbF-7whm6vXxOin7zuKEoPRuUP3w-6Vo.jar"
}
dependencies {
type_urn: "beam:artifact:type:file:v1"
type_payload:
"\n\247\001/tmp/beam-artifact-staging/90441018f31cfd579397bad8895268284565549414e107c5c9c4e3c2a98ea3b1/74-EMBEDDED-grpc-api-1.32.2-dZhDwk9nNuGJqc3If690Sv0UsrGWr3wZ7XBufzXKHhA.jar"
role_urn: "beam:artifact:role:staging_to:v1"
role_payload:
"\n?grpc-api-1.32.2-dZhDwk9nNuGJqc3If690Sv0UsrGWr3wZ7XBufzXKHhA.jar"
}
dependencies {
type_urn: "beam:artifact:type:file:v1"
type_payload:
"\n\246\001/tmp/beam-artifact-staging/90441018f31cfd579397bad8895268284565549414e107c5c9c4e3c2a98ea3b1/75-EMBEDDED-guava-25.1-jre-bbDDokTDl0KcLjYuooN8NiLVtou5UQXTfCHDblvHCr8.jar"
role_urn: "beam:artifact:role:staging_to:v1"
role_payload:
"\n>guava-25.1-jre-bbDDokTDl0KcLjYuooN8NiLVtou5UQXTfCHDblvHCr8.jar"
}
dependencies {
type_urn: "beam:artifact:type:file:v1"
type_payload: "\n\252\
...[truncated 1436288 chars]...
ackingFnDataReceiver.accept(PCollectionConsumerRegistry.java:185)
at
org.apache.beam.fn.harness.FnApiDoFnRunner.outputTo(FnApiDoFnRunner.java:1678)
at
org.apache.beam.fn.harness.FnApiDoFnRunner.access$2500(FnApiDoFnRunner.java:139)
at
org.apache.beam.fn.harness.FnApiDoFnRunner$NonWindowObservingProcessBundleContext.outputWithTimestamp(FnApiDoFnRunner.java:2194)
at
org.apache.beam.fn.harness.FnApiDoFnRunner$ProcessBundleContextBase.output(FnApiDoFnRunner.java:2363)
at
org.apache.beam.sdk.transforms.DoFnOutputReceivers$WindowedContextOutputReceiver.output(DoFnOutputReceivers.java:78)
at
org.apache.beam.sdk.transforms.MapElements$1.processElement(MapElements.java:142)
at
org.apache.beam.sdk.transforms.MapElements$1$DoFnInvoker.invokeProcessElement(Unknown
Source)
at
org.apache.beam.fn.harness.FnApiDoFnRunner.processElementForParDo(FnApiDoFnRunner.java:748)
at
org.apache.beam.fn.harness.data.PCollectionConsumerRegistry$MetricTrackingFnDataReceiver.accept(PCollectionConsumerRegistry.java:222)
at
org.apache.beam.fn.harness.data.PCollectionConsumerRegistry$MetricTrackingFnDataReceiver.accept(PCollectionConsumerRegistry.java:185)
at
org.apache.beam.fn.harness.BeamFnDataReadRunner.forwardElementToConsumer(BeamFnDataReadRunner.java:220)
at
org.apache.beam.sdk.fn.data.DecodingFnDataReceiver.accept(DecodingFnDataReceiver.java:43)
at
org.apache.beam.sdk.fn.data.DecodingFnDataReceiver.accept(DecodingFnDataReceiver.java:25)
at
org.apache.beam.fn.harness.data.QueueingBeamFnDataClient.drainAndBlock(QueueingBeamFnDataClient.java:111)
at
org.apache.beam.fn.harness.control.ProcessBundleHandler.processBundle(ProcessBundleHandler.java:304)
at
org.apache.beam.fn.harness.control.BeamFnControlClient.delegateOnInstructionRequestType(BeamFnControlClient.java:173)
at
org.apache.beam.fn.harness.control.BeamFnControlClient.lambda$processInstructionRequests$0(BeamFnControlClient.java:157)
at
java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1149)
at
java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624)
at java.lang.Thread.run(Thread.java:748)
at
org.apache.beam.runners.spark.SparkPipelineResult.beamExceptionFrom(SparkPipelineResult.java:73)
at
org.apache.beam.runners.spark.SparkPipelineResult.access$000(SparkPipelineResult.java:46)
at
org.apache.beam.runners.spark.SparkPipelineResult$StreamingMode.stop(SparkPipelineResult.java:185)
at
org.apache.beam.runners.spark.SparkPipelineResult.offerNewState(SparkPipelineResult.java:234)
at
org.apache.beam.runners.spark.SparkPipelineResult.waitUntilFinish(SparkPipelineResult.java:103)
at
org.apache.beam.runners.spark.SparkPipelineResult.waitUntilFinish(SparkPipelineResult.java:92)
at
org.apache.beam.runners.spark.SparkPipelineRunner.run(SparkPipelineRunner.java:207)
at
org.apache.beam.runners.jobsubmission.JobInvocation.runPipeline(JobInvocation.java:86)
at
org.apache.beam.vendor.guava.v26_0_jre.com.google.common.util.concurrent.TrustedListenableFutureTask$TrustedFutureInterruptibleTask.runInterruptibly(TrustedListenableFutureTask.java:125)
at
org.apache.beam.vendor.guava.v26_0_jre.com.google.common.util.concurrent.InterruptibleTask.run(InterruptibleTask.java:57)
at
org.apache.beam.vendor.guava.v26_0_jre.com.google.common.util.concurrent.TrustedListenableFutureTask.run(TrustedListenableFutureTask.java:78)
at
java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1149)
at
java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624)
at java.lang.Thread.run(Thread.java:748)
Caused by: java.util.concurrent.ExecutionException: java.lang.RuntimeException:
Error received from SDK harness for instruction 9:
org.apache.beam.sdk.util.UserCodeException: java.lang.AssertionError:
GroupByKey.out:
Expected: iterable with items [a KV(<"k1">, <iterable with items [<3>] in any
order>), a KV(<"k1">, <iterable with items [<4>] in any order>), a KV(<"k5">,
<iterable with items [<2147483647>, <-2147483648>] in any order>), a KV(<"k2">,
<iterable with items [<66>] in any order>), a KV(<"k2">, <iterable with items
[<-33>] in any order>), a KV(<"k3">, <iterable with items [<0>] in any order>)]
in any order
but: no item matches: a KV(<"k1">, <iterable with items [<3>] in any
order>), a KV(<"k1">, <iterable with items [<4>] in any order>), a KV(<"k5">,
<iterable with items [<2147483647>, <-2147483648>] in any order>), a KV(<"k2">,
<iterable with items [<66>] in any order>), a KV(<"k2">, <iterable with items
[<-33>] in any order>), a KV(<"k3">, <iterable with items [<0>] in any order>)
in []
at
org.apache.beam.sdk.util.UserCodeException.wrap(UserCodeException.java:39)
at
org.apache.beam.sdk.testing.PAssert$DefaultConcludeFn$DoFnInvoker.invokeProcessElement(Unknown
Source)
at
org.apache.beam.fn.harness.FnApiDoFnRunner.processElementForParDo(FnApiDoFnRunner.java:748)
at
org.apache.beam.fn.harness.data.PCollectionConsumerRegistry$MetricTrackingFnDataReceiver.accept(PCollectionConsumerRegistry.java:222)
at
org.apache.beam.fn.harness.data.PCollectionConsumerRegistry$MetricTrackingFnDataReceiver.accept(PCollectionConsumerRegistry.java:185)
at
org.apache.beam.fn.harness.FnApiDoFnRunner.outputTo(FnApiDoFnRunner.java:1678)
at
org.apache.beam.fn.harness.FnApiDoFnRunner.access$2500(FnApiDoFnRunner.java:139)
at
org.apache.beam.fn.harness.FnApiDoFnRunner$NonWindowObservingProcessBundleContext.outputWithTimestamp(FnApiDoFnRunner.java:2194)
at
org.apache.beam.fn.harness.FnApiDoFnRunner$ProcessBundleContextBase.output(FnApiDoFnRunner.java:2363)
at
org.apache.beam.sdk.testing.PAssert$GroupedValuesCheckerDoFn.processElement(PAssert.java:1444)
at
org.apache.beam.sdk.testing.PAssert$GroupedValuesCheckerDoFn$DoFnInvoker.invokeProcessElement(Unknown
Source)
at
org.apache.beam.fn.harness.FnApiDoFnRunner.processElementForParDo(FnApiDoFnRunner.java:748)
at
org.apache.beam.fn.harness.data.PCollectionConsumerRegistry$MetricTrackingFnDataReceiver.accept(PCollectionConsumerRegistry.java:222)
at
org.apache.beam.fn.harness.data.PCollectionConsumerRegistry$MetricTrackingFnDataReceiver.accept(PCollectionConsumerRegistry.java:185)
at
org.apache.beam.fn.harness.FnApiDoFnRunner.outputTo(FnApiDoFnRunner.java:1678)
at
org.apache.beam.fn.harness.FnApiDoFnRunner.access$2500(FnApiDoFnRunner.java:139)
at
org.apache.beam.fn.harness.FnApiDoFnRunner$NonWindowObservingProcessBundleContext.outputWithTimestamp(FnApiDoFnRunner.java:2194)
at
org.apache.beam.fn.harness.FnApiDoFnRunner$ProcessBundleContextBase.output(FnApiDoFnRunner.java:2363)
at
org.apache.beam.sdk.transforms.DoFnOutputReceivers$WindowedContextOutputReceiver.output(DoFnOutputReceivers.java:78)
at
org.apache.beam.sdk.transforms.MapElements$1.processElement(MapElements.java:142)
at
org.apache.beam.sdk.transforms.MapElements$1$DoFnInvoker.invokeProcessElement(Unknown
Source)
at
org.apache.beam.fn.harness.FnApiDoFnRunner.processElementForParDo(FnApiDoFnRunner.java:748)
at
org.apache.beam.fn.harness.data.PCollectionConsumerRegistry$MetricTrackingFnDataReceiver.accept(PCollectionConsumerRegistry.java:222)
at
org.apache.beam.fn.harness.data.PCollectionConsumerRegistry$MetricTrackingFnDataReceiver.accept(PCollectionConsumerRegistry.java:185)
at
org.apache.beam.fn.harness.FnApiDoFnRunner.outputTo(FnApiDoFnRunner.java:1678)
at
org.apache.beam.fn.harness.FnApiDoFnRunner.access$2500(FnApiDoFnRunner.java:139)
at
org.apache.beam.fn.harness.FnApiDoFnRunner$NonWindowObservingProcessBundleContext.outputWithTimestamp(FnApiDoFnRunner.java:2194)
at
org.apache.beam.fn.harness.FnApiDoFnRunner$ProcessBundleContextBase.output(FnApiDoFnRunner.java:2363)
at
org.apache.beam.sdk.testing.PAssert$ConcatFn.processElement(PAssert.java:1281)
at
org.apache.beam.sdk.testing.PAssert$ConcatFn$DoFnInvoker.invokeProcessElement(Unknown
Source)
at
org.apache.beam.fn.harness.FnApiDoFnRunner.processElementForParDo(FnApiDoFnRunner.java:748)
at
org.apache.beam.fn.harness.data.PCollectionConsumerRegistry$MetricTrackingFnDataReceiver.accept(PCollectionConsumerRegistry.java:222)
at
org.apache.beam.fn.harness.data.PCollectionConsumerRegistry$MetricTrackingFnDataReceiver.accept(PCollectionConsumerRegistry.java:185)
at
org.apache.beam.fn.harness.FnApiDoFnRunner.outputTo(FnApiDoFnRunner.java:1678)
at
org.apache.beam.fn.harness.FnApiDoFnRunner.access$2500(FnApiDoFnRunner.java:139)
at
org.apache.beam.fn.harness.FnApiDoFnRunner$NonWindowObservingProcessBundleContext.outputWithTimestamp(FnApiDoFnRunner.java:2194)
at
org.apache.beam.fn.harness.FnApiDoFnRunner$ProcessBundleContextBase.output(FnApiDoFnRunner.java:2363)
at
org.apache.beam.sdk.transforms.DoFnOutputReceivers$WindowedContextOutputReceiver.output(DoFnOutputReceivers.java:78)
at
org.apache.beam.sdk.transforms.MapElements$1.processElement(MapElements.java:142)
at
org.apache.beam.sdk.transforms.MapElements$1$DoFnInvoker.invokeProcessElement(Unknown
Source)
at
org.apache.beam.fn.harness.FnApiDoFnRunner.processElementForParDo(FnApiDoFnRunner.java:748)
at
org.apache.beam.fn.harness.data.PCollectionConsumerRegistry$MetricTrackingFnDataReceiver.accept(PCollectionConsumerRegistry.java:222)
at
org.apache.beam.fn.harness.data.PCollectionConsumerRegistry$MetricTrackingFnDataReceiver.accept(PCollectionConsumerRegistry.java:185)
at
org.apache.beam.fn.harness.BeamFnDataReadRunner.forwardElementToConsumer(BeamFnDataReadRunner.java:220)
at
org.apache.beam.sdk.fn.data.DecodingFnDataReceiver.accept(DecodingFnDataReceiver.java:43)
at
org.apache.beam.sdk.fn.data.DecodingFnDataReceiver.accept(DecodingFnDataReceiver.java:25)
at
org.apache.beam.fn.harness.data.QueueingBeamFnDataClient.drainAndBlock(QueueingBeamFnDataClient.java:111)
at
org.apache.beam.fn.harness.control.ProcessBundleHandler.processBundle(ProcessBundleHandler.java:304)
at
org.apache.beam.fn.harness.control.BeamFnControlClient.delegateOnInstructionRequestType(BeamFnControlClient.java:173)
at
org.apache.beam.fn.harness.control.BeamFnControlClient.lambda$processInstructionRequests$0(BeamFnControlClient.java:157)
at
java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1149)
at
java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624)
at java.lang.Thread.run(Thread.java:748)
Caused by: java.lang.AssertionError: GroupByKey.out:
Expected: iterable with items [a KV(<"k1">, <iterable with items [<3>] in any
order>), a KV(<"k1">, <iterable with items [<4>] in any order>), a KV(<"k5">,
<iterable with items [<2147483647>, <-2147483648>] in any order>), a KV(<"k2">,
<iterable with items [<66>] in any order>), a KV(<"k2">, <iterable with items
[<-33>] in any order>), a KV(<"k3">, <iterable with items [<0>] in any order>)]
in any order
but: no item matches: a KV(<"k1">, <iterable with items [<3>] in any
order>), a KV(<"k1">, <iterable with items [<4>] in any order>), a KV(<"k5">,
<iterable with items [<2147483647>, <-2147483648>] in any order>), a KV(<"k2">,
<iterable with items [<66>] in any order>), a KV(<"k2">, <iterable with items
[<-33>] in any order>), a KV(<"k3">, <iterable with items [<0>] in any order>)
in []
at
org.apache.beam.sdk.testing.PAssert$PAssertionSite.capture(PAssert.java:174)
at org.apache.beam.sdk.testing.PAssert.that(PAssert.java:416)
at org.apache.beam.sdk.testing.PAssert.that(PAssert.java:408)
at
org.apache.beam.sdk.transforms.GroupByKeyTest$WindowTests.testGroupByKeyAndWindows(GroupByKeyTest.java:509)
at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method)
at
sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:62)
at
sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43)
at java.lang.reflect.Method.invoke(Method.java:498)
at
org.junit.runners.model.FrameworkMethod$1.runReflectiveCall(FrameworkMethod.java:59)
at
org.junit.internal.runners.model.ReflectiveCallable.run(ReflectiveCallable.java:12)
at
org.junit.runners.model.FrameworkMethod.invokeExplosively(FrameworkMethod.java:56)
at
org.junit.internal.runners.statements.InvokeMethod.evaluate(InvokeMethod.java:17)
at
org.apache.beam.sdk.testing.TestPipeline$1.evaluate(TestPipeline.java:322)
at
org.junit.rules.ExpectedException$ExpectedExceptionStatement.evaluate(ExpectedException.java:266)
at org.junit.runners.ParentRunner$3.evaluate(ParentRunner.java:305)
at
org.junit.runners.BlockJUnit4ClassRunner$1.evaluate(BlockJUnit4ClassRunner.java:100)
at org.junit.runners.ParentRunner.runLeaf(ParentRunner.java:365)
at
org.junit.runners.BlockJUnit4ClassRunner.runChild(BlockJUnit4ClassRunner.java:103)
at
org.junit.runners.BlockJUnit4ClassRunner.runChild(BlockJUnit4ClassRunner.java:63)
at org.junit.runners.ParentRunner$4.run(ParentRunner.java:330)
at org.junit.runners.ParentRunner$1.schedule(ParentRunner.java:78)
at org.junit.runners.ParentRunner.runChildren(ParentRunner.java:328)
at org.junit.runners.ParentRunner.access$100(ParentRunner.java:65)
at org.junit.runners.ParentRunner$2.evaluate(ParentRunner.java:292)
at org.junit.runners.ParentRunner$3.evaluate(ParentRunner.java:305)
at org.junit.runners.ParentRunner.run(ParentRunner.java:412)
at org.junit.runners.Suite.runChild(Suite.java:128)
at org.junit.runners.Suite.runChild(Suite.java:27)
at org.junit.runners.ParentRunner$4.run(ParentRunner.java:330)
at org.junit.runners.ParentRunner$1.schedule(ParentRunner.java:78)
at org.junit.runners.ParentRunner.runChildren(ParentRunner.java:328)
at org.junit.runners.ParentRunner.access$100(ParentRunner.java:65)
at org.junit.runners.ParentRunner$2.evaluate(ParentRunner.java:292)
at org.junit.runners.ParentRunner$3.evaluate(ParentRunner.java:305)
at org.junit.runners.ParentRunner.run(ParentRunner.java:412)
at
org.gradle.api.internal.tasks.testing.junit.JUnitTestClassExecutor.runTestClass(JUnitTestClassExecutor.java:110)
at
org.gradle.api.internal.tasks.testing.junit.JUnitTestClassExecutor.execute(JUnitTestClassExecutor.java:58)
at
org.gradle.api.internal.tasks.testing.junit.JUnitTestClassExecutor.execute(JUnitTestClassExecutor.java:38)
at
org.gradle.api.internal.tasks.testing.junit.AbstractJUnitTestClassProcessor.processTestClass(AbstractJUnitTestClassProcessor.java:62)
at
org.gradle.api.internal.tasks.testing.SuiteTestClassProcessor.processTestClass(SuiteTestClassProcessor.java:51)
at sun.reflect.GeneratedMethodAccessor155.invoke(Unknown Source)
at
sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43)
at java.lang.reflect.Method.invoke(Method.java:498)
at
org.gradle.internal.dispatch.ReflectionDispatch.dispatch(ReflectionDispatch.java:36)
at
org.gradle.internal.dispatch.ReflectionDispatch.dispatch(ReflectionDispatch.java:24)
at
org.gradle.internal.dispatch.ContextClassLoaderDispatch.dispatch(ContextClassLoaderDispatch.java:33)
at
org.gradle.internal.dispatch.ProxyDispatchAdapter$DispatchingInvocationHandler.invoke(ProxyDispatchAdapter.java:94)
at com.sun.proxy.$Proxy2.processTestClass(Unknown Source)
at
org.gradle.api.internal.tasks.testing.worker.TestWorker.processTestClass(TestWorker.java:119)
at sun.reflect.GeneratedMethodAccessor154.invoke(Unknown Source)
at
sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43)
at java.lang.reflect.Method.invoke(Method.java:498)
at
org.gradle.internal.dispatch.ReflectionDispatch.dispatch(ReflectionDispatch.java:36)
at
org.gradle.internal.dispatch.ReflectionDispatch.dispatch(ReflectionDispatch.java:24)
at
org.gradle.internal.remote.internal.hub.MessageHubBackedObjectConnection$DispatchWrapper.dispatch(MessageHubBackedObjectConnection.java:182)
at
org.gradle.internal.remote.internal.hub.MessageHubBackedObjectConnection$DispatchWrapper.dispatch(MessageHubBackedObjectConnection.java:164)
at
org.gradle.internal.remote.internal.hub.MessageHub$Handler.run(MessageHub.java:414)
at
org.gradle.internal.concurrent.ExecutorPolicy$CatchAndRecordFailures.onExecute(ExecutorPolicy.java:64)
at
org.gradle.internal.concurrent.ManagedExecutorImpl$1.run(ManagedExecutorImpl.java:48)
at
java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1149)
at
java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624)
at
org.gradle.internal.concurrent.ThreadFactoryImpl$ManagedThreadRunnable.run(ThreadFactoryImpl.java:56)
Caused by: java.lang.AssertionError:
Expected: iterable with items [a KV(<"k1">, <iterable with items [<3>] in any
order>), a KV(<"k1">, <iterable with items [<4>] in any order>), a KV(<"k5">,
<iterable with items [<2147483647>, <-2147483648>] in any order>), a KV(<"k2">,
<iterable with items [<66>] in any order>), a KV(<"k2">, <iterable with items
[<-33>] in any order>), a KV(<"k3">, <iterable with items [<0>] in any order>)]
in any order
but: no item matches: a KV(<"k1">, <iterable with items [<3>] in any
order>), a KV(<"k1">, <iterable with items [<4>] in any order>), a KV(<"k5">,
<iterable with items [<2147483647>, <-2147483648>] in any order>), a KV(<"k2">,
<iterable with items [<66>] in any order>), a KV(<"k2">, <iterable with items
[<-33>] in any order>), a KV(<"k3">, <iterable with items [<0>] in any order>)
in []
at org.hamcrest.MatcherAssert.assertThat(MatcherAssert.java:18)
at org.junit.Assert.assertThat(Assert.java:966)
at org.junit.Assert.assertThat(Assert.java:931)
at
org.apache.beam.sdk.transforms.GroupByKeyTest$ContainsKVs.apply(GroupByKeyTest.java:681)
at
org.apache.beam.sdk.transforms.GroupByKeyTest$ContainsKVs.apply(GroupByKeyTest.java:666)
at org.apache.beam.sdk.testing.PAssert.doChecks(PAssert.java:1477)
at
org.apache.beam.sdk.testing.PAssert$GroupedValuesCheckerDoFn.processElement(PAssert.java:1444)
at
org.apache.beam.sdk.testing.PAssert$GroupedValuesCheckerDoFn$DoFnInvoker.invokeProcessElement(Unknown
Source)
at
org.apache.beam.fn.harness.FnApiDoFnRunner.processElementForParDo(FnApiDoFnRunner.java:748)
at
org.apache.beam.fn.harness.data.PCollectionConsumerRegistry$MetricTrackingFnDataReceiver.accept(PCollectionConsumerRegistry.java:222)
at
org.apache.beam.fn.harness.data.PCollectionConsumerRegistry$MetricTrackingFnDataReceiver.accept(PCollectionConsumerRegistry.java:185)
at
org.apache.beam.fn.harness.FnApiDoFnRunner.outputTo(FnApiDoFnRunner.java:1678)
at
org.apache.beam.fn.harness.FnApiDoFnRunner.access$2500(FnApiDoFnRunner.java:139)
at
org.apache.beam.fn.harness.FnApiDoFnRunner$NonWindowObservingProcessBundleContext.outputWithTimestamp(FnApiDoFnRunner.java:2194)
at
org.apache.beam.fn.harness.FnApiDoFnRunner$ProcessBundleContextBase.output(FnApiDoFnRunner.java:2363)
at
org.apache.beam.sdk.transforms.DoFnOutputReceivers$WindowedContextOutputReceiver.output(DoFnOutputReceivers.java:78)
at
org.apache.beam.sdk.transforms.MapElements$1.processElement(MapElements.java:142)
at
org.apache.beam.sdk.transforms.MapElements$1$DoFnInvoker.invokeProcessElement(Unknown
Source)
at
org.apache.beam.fn.harness.FnApiDoFnRunner.processElementForParDo(FnApiDoFnRunner.java:748)
at
org.apache.beam.fn.harness.data.PCollectionConsumerRegistry$MetricTrackingFnDataReceiver.accept(PCollectionConsumerRegistry.java:222)
at
org.apache.beam.fn.harness.data.PCollectionConsumerRegistry$MetricTrackingFnDataReceiver.accept(PCollectionConsumerRegistry.java:185)
at
org.apache.beam.fn.harness.FnApiDoFnRunner.outputTo(FnApiDoFnRunner.java:1678)
at
org.apache.beam.fn.harness.FnApiDoFnRunner.access$2500(FnApiDoFnRunner.java:139)
at
org.apache.beam.fn.harness.FnApiDoFnRunner$NonWindowObservingProcessBundleContext.outputWithTimestamp(FnApiDoFnRunner.java:2194)
at
org.apache.beam.fn.harness.FnApiDoFnRunner$ProcessBundleContextBase.output(FnApiDoFnRunner.java:2363)
at
org.apache.beam.sdk.testing.PAssert$ConcatFn.processElement(PAssert.java:1281)
at
org.apache.beam.sdk.testing.PAssert$ConcatFn$DoFnInvoker.invokeProcessElement(Unknown
Source)
at
org.apache.beam.fn.harness.FnApiDoFnRunner.processElementForParDo(FnApiDoFnRunner.java:748)
at
org.apache.beam.fn.harness.data.PCollectionConsumerRegistry$MetricTrackingFnDataReceiver.accept(PCollectionConsumerRegistry.java:222)
at
org.apache.beam.fn.harness.data.PCollectionConsumerRegistry$MetricTrackingFnDataReceiver.accept(PCollectionConsumerRegistry.java:185)
at
org.apache.beam.fn.harness.FnApiDoFnRunner.outputTo(FnApiDoFnRunner.java:1678)
at
org.apache.beam.fn.harness.FnApiDoFnRunner.access$2500(FnApiDoFnRunner.java:139)
at
org.apache.beam.fn.harness.FnApiDoFnRunner$NonWindowObservingProcessBundleContext.outputWithTimestamp(FnApiDoFnRunner.java:2194)
at
org.apache.beam.fn.harness.FnApiDoFnRunner$ProcessBundleContextBase.output(FnApiDoFnRunner.java:2363)
at
org.apache.beam.sdk.transforms.DoFnOutputReceivers$WindowedContextOutputReceiver.output(DoFnOutputReceivers.java:78)
at
org.apache.beam.sdk.transforms.MapElements$1.processElement(MapElements.java:142)
at
org.apache.beam.sdk.transforms.MapElements$1$DoFnInvoker.invokeProcessElement(Unknown
Source)
at
org.apache.beam.fn.harness.FnApiDoFnRunner.processElementForParDo(FnApiDoFnRunner.java:748)
at
org.apache.beam.fn.harness.data.PCollectionConsumerRegistry$MetricTrackingFnDataReceiver.accept(PCollectionConsumerRegistry.java:222)
at
org.apache.beam.fn.harness.data.PCollectionConsumerRegistry$MetricTrackingFnDataReceiver.accept(PCollectionConsumerRegistry.java:185)
at
org.apache.beam.fn.harness.BeamFnDataReadRunner.forwardElementToConsumer(BeamFnDataReadRunner.java:220)
at
org.apache.beam.sdk.fn.data.DecodingFnDataReceiver.accept(DecodingFnDataReceiver.java:43)
at
org.apache.beam.sdk.fn.data.DecodingFnDataReceiver.accept(DecodingFnDataReceiver.java:25)
at
org.apache.beam.fn.harness.data.QueueingBeamFnDataClient.drainAndBlock(QueueingBeamFnDataClient.java:111)
at
org.apache.beam.fn.harness.control.ProcessBundleHandler.processBundle(ProcessBundleHandler.java:304)
at
org.apache.beam.fn.harness.control.BeamFnControlClient.delegateOnInstructionRequestType(BeamFnControlClient.java:173)
at
org.apache.beam.fn.harness.control.BeamFnControlClient.lambda$processInstructionRequests$0(BeamFnControlClient.java:157)
at
java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1149)
at
java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624)
at java.lang.Thread.run(Thread.java:748)
at
java.util.concurrent.CompletableFuture.reportGet(CompletableFuture.java:357)
at
java.util.concurrent.CompletableFuture.get(CompletableFuture.java:1908)
at org.apache.beam.sdk.util.MoreFutures.get(MoreFutures.java:60)
at
org.apache.beam.runners.fnexecution.control.SdkHarnessClient$BundleProcessor$ActiveBundle.close(SdkHarnessClient.java:504)
at
org.apache.beam.runners.fnexecution.control.DefaultJobBundleFactory$SimpleStageBundleFactory$1.close(DefaultJobBundleFactory.java:555)
at
org.apache.beam.runners.spark.translation.SparkExecutableStageFunction.$closeResource(SparkExecutableStageFunction.java:204)
at
org.apache.beam.runners.spark.translation.SparkExecutableStageFunction.processElements(SparkExecutableStageFunction.java:229)
at
org.apache.beam.runners.spark.translation.SparkExecutableStageFunction.call(SparkExecutableStageFunction.java:142)
at
org.apache.beam.runners.spark.translation.SparkExecutableStageFunction.call(SparkExecutableStageFunction.java:80)
at
org.apache.spark.streaming.api.java.JavaDStreamLike$$anonfun$fn$3$1.apply(JavaDStreamLike.scala:192)
at
org.apache.spark.streaming.api.java.JavaDStreamLike$$anonfun$fn$3$1.apply(JavaDStreamLike.scala:192)
at
org.apache.spark.rdd.RDD$$anonfun$mapPartitions$1$$anonfun$apply$23.apply(RDD.scala:823)
at
org.apache.spark.rdd.RDD$$anonfun$mapPartitions$1$$anonfun$apply$23.apply(RDD.scala:823)
at
org.apache.spark.rdd.MapPartitionsRDD.compute(MapPartitionsRDD.scala:52)
at org.apache.spark.rdd.RDD.computeOrReadCheckpoint(RDD.scala:346)
at org.apache.spark.rdd.RDD.iterator(RDD.scala:310)
at
org.apache.spark.rdd.MapPartitionsRDD.compute(MapPartitionsRDD.scala:52)
at org.apache.spark.rdd.RDD.computeOrReadCheckpoint(RDD.scala:346)
at org.apache.spark.rdd.RDD.iterator(RDD.scala:310)
at org.apache.spark.scheduler.ResultTask.runTask(ResultTask.scala:90)
at org.apache.spark.scheduler.Task.run(Task.scala:123)
at
org.apache.spark.executor.Executor$TaskRunner$$anonfun$10.apply(Executor.scala:408)
at org.apache.spark.util.Utils$.tryWithSafeFinally(Utils.scala:1360)
at org.apache.spark.executor.Executor$TaskRunner.run(Executor.scala:414)
... 3 more
Caused by: java.lang.RuntimeException: Error received from SDK harness for
instruction 9: org.apache.beam.sdk.util.UserCodeException:
java.lang.AssertionError: GroupByKey.out:
Expected: iterable with items [a KV(<"k1">, <iterable with items [<3>] in any
order>), a KV(<"k1">, <iterable with items [<4>] in any order>), a KV(<"k5">,
<iterable with items [<2147483647>, <-2147483648>] in any order>), a KV(<"k2">,
<iterable with items [<66>] in any order>), a KV(<"k2">, <iterable with items
[<-33>] in any order>), a KV(<"k3">, <iterable with items [<0>] in any order>)]
in any order
but: no item matches: a KV(<"k1">, <iterable with items [<3>] in any
order>), a KV(<"k1">, <iterable with items [<4>] in any order>), a KV(<"k5">,
<iterable with items [<2147483647>, <-2147483648>] in any order>), a KV(<"k2">,
<iterable with items [<66>] in any order>), a KV(<"k2">, <iterable with items
[<-33>] in any order>), a KV(<"k3">, <iterable with items [<0>] in any order>)
in []
at
org.apache.beam.sdk.util.UserCodeException.wrap(UserCodeException.java:39)
at
org.apache.beam.sdk.testing.PAssert$DefaultConcludeFn$DoFnInvoker.invokeProcessElement(Unknown
Source)
at
org.apache.beam.fn.harness.FnApiDoFnRunner.processElementForParDo(FnApiDoFnRunner.java:748)
at
org.apache.beam.fn.harness.data.PCollectionConsumerRegistry$MetricTrackingFnDataReceiver.accept(PCollectionConsumerRegistry.java:222)
at
org.apache.beam.fn.harness.data.PCollectionConsumerRegistry$MetricTrackingFnDataReceiver.accept(PCollectionConsumerRegistry.java:185)
at
org.apache.beam.fn.harness.FnApiDoFnRunner.outputTo(FnApiDoFnRunner.java:1678)
at
org.apache.beam.fn.harness.FnApiDoFnRunner.access$2500(FnApiDoFnRunner.java:139)
at
org.apache.beam.fn.harness.FnApiDoFnRunner$NonWindowObservingProcessBundleContext.outputWithTimestamp(FnApiDoFnRunner.java:2194)
at
org.apache.beam.fn.harness.FnApiDoFnRunner$ProcessBundleContextBase.output(FnApiDoFnRunner.java:2363)
at
org.apache.beam.sdk.testing.PAssert$GroupedValuesCheckerDoFn.processElement(PAssert.java:1444)
at
org.apache.beam.sdk.testing.PAssert$GroupedValuesCheckerDoFn$DoFnInvoker.invokeProcessElement(Unknown
Source)
at
org.apache.beam.fn.harness.FnApiDoFnRunner.processElementForParDo(FnApiDoFnRunner.java:748)
at
org.apache.beam.fn.harness.data.PCollectionConsumerRegistry$MetricTrackingFnDataReceiver.accept(PCollectionConsumerRegistry.java:222)
at
org.apache.beam.fn.harness.data.PCollectionConsumerRegistry$MetricTrackingFnDataReceiver.accept(PCollectionConsumerRegistry.java:185)
at
org.apache.beam.fn.harness.FnApiDoFnRunner.outputTo(FnApiDoFnRunner.java:1678)
at
org.apache.beam.fn.harness.FnApiDoFnRunner.access$2500(FnApiDoFnRunner.java:139)
at
org.apache.beam.fn.harness.FnApiDoFnRunner$NonWindowObservingProcessBundleContext.outputWithTimestamp(FnApiDoFnRunner.java:2194)
at
org.apache.beam.fn.harness.FnApiDoFnRunner$ProcessBundleContextBase.output(FnApiDoFnRunner.java:2363)
at
org.apache.beam.sdk.transforms.DoFnOutputReceivers$WindowedContextOutputReceiver.output(DoFnOutputReceivers.java:78)
at
org.apache.beam.sdk.transforms.MapElements$1.processElement(MapElements.java:142)
at
org.apache.beam.sdk.transforms.MapElements$1$DoFnInvoker.invokeProcessElement(Unknown
Source)
at
org.apache.beam.fn.harness.FnApiDoFnRunner.processElementForParDo(FnApiDoFnRunner.java:748)
at
org.apache.beam.fn.harness.data.PCollectionConsumerRegistry$MetricTrackingFnDataReceiver.accept(PCollectionConsumerRegistry.java:222)
at
org.apache.beam.fn.harness.data.PCollectionConsumerRegistry$MetricTrackingFnDataReceiver.accept(PCollectionConsumerRegistry.java:185)
at
org.apache.beam.fn.harness.FnApiDoFnRunner.outputTo(FnApiDoFnRunner.java:1678)
at
org.apache.beam.fn.harness.FnApiDoFnRunner.access$2500(FnApiDoFnRunner.java:139)
at
org.apache.beam.fn.harness.FnApiDoFnRunner$NonWindowObservingProcessBundleContext.outputWithTimestamp(FnApiDoFnRunner.java:2194)
at
org.apache.beam.fn.harness.FnApiDoFnRunner$ProcessBundleContextBase.output(FnApiDoFnRunner.java:2363)
at
org.apache.beam.sdk.testing.PAssert$ConcatFn.processElement(PAssert.java:1281)
at
org.apache.beam.sdk.testing.PAssert$ConcatFn$DoFnInvoker.invokeProcessElement(Unknown
Source)
at
org.apache.beam.fn.harness.FnApiDoFnRunner.processElementForParDo(FnApiDoFnRunner.java:748)
at
org.apache.beam.fn.harness.data.PCollectionConsumerRegistry$MetricTrackingFnDataReceiver.accept(PCollectionConsumerRegistry.java:222)
at
org.apache.beam.fn.harness.data.PCollectionConsumerRegistry$MetricTrackingFnDataReceiver.accept(PCollectionConsumerRegistry.java:185)
at
org.apache.beam.fn.harness.FnApiDoFnRunner.outputTo(FnApiDoFnRunner.java:1678)
at
org.apache.beam.fn.harness.FnApiDoFnRunner.access$2500(FnApiDoFnRunner.java:139)
at
org.apache.beam.fn.harness.FnApiDoFnRunner$NonWindowObservingProcessBundleContext.outputWithTimestamp(FnApiDoFnRunner.java:2194)
at
org.apache.beam.fn.harness.FnApiDoFnRunner$ProcessBundleContextBase.output(FnApiDoFnRunner.java:2363)
at
org.apache.beam.sdk.transforms.DoFnOutputReceivers$WindowedContextOutputReceiver.output(DoFnOutputReceivers.java:78)
at
org.apache.beam.sdk.transforms.MapElements$1.processElement(MapElements.java:142)
at
org.apache.beam.sdk.transforms.MapElements$1$DoFnInvoker.invokeProcessElement(Unknown
Source)
at
org.apache.beam.fn.harness.FnApiDoFnRunner.processElementForParDo(FnApiDoFnRunner.java:748)
at
org.apache.beam.fn.harness.data.PCollectionConsumerRegistry$MetricTrackingFnDataReceiver.accept(PCollectionConsumerRegistry.java:222)
at
org.apache.beam.fn.harness.data.PCollectionConsumerRegistry$MetricTrackingFnDataReceiver.accept(PCollectionConsumerRegistry.java:185)
at
org.apache.beam.fn.harness.BeamFnDataReadRunner.forwardElementToConsumer(BeamFnDataReadRunner.java:220)
at
org.apache.beam.sdk.fn.data.DecodingFnDataReceiver.accept(DecodingFnDataReceiver.java:43)
at
org.apache.beam.sdk.fn.data.DecodingFnDataReceiver.accept(DecodingFnDataReceiver.java:25)
at
org.apache.beam.fn.harness.data.QueueingBeamFnDataClient.drainAndBlock(QueueingBeamFnDataClient.java:111)
at
org.apache.beam.fn.harness.control.ProcessBundleHandler.processBundle(ProcessBundleHandler.java:304)
at
org.apache.beam.fn.harness.control.BeamFnControlClient.delegateOnInstructionRequestType(BeamFnControlClient.java:173)
at
org.apache.beam.fn.harness.control.BeamFnControlClient.lambda$processInstructionRequests$0(BeamFnControlClient.java:157)
at
java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1149)
at
java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624)
at java.lang.Thread.run(Thread.java:748)
Caused by: java.lang.AssertionError: GroupByKey.out:
Expected: iterable with items [a KV(<"k1">, <iterable with items [<3>] in any
order>), a KV(<"k1">, <iterable with items [<4>] in any order>), a KV(<"k5">,
<iterable with items [<2147483647>, <-2147483648>] in any order>), a KV(<"k2">,
<iterable with items [<66>] in any order>), a KV(<"k2">, <iterable with items
[<-33>] in any order>), a KV(<"k3">, <iterable with items [<0>] in any order>)]
in any order
but: no item matches: a KV(<"k1">, <iterable with items [<3>] in any
order>), a KV(<"k1">, <iterable with items [<4>] in any order>), a KV(<"k5">,
<iterable with items [<2147483647>, <-2147483648>] in any order>), a KV(<"k2">,
<iterable with items [<66>] in any order>), a KV(<"k2">, <iterable with items
[<-33>] in any order>), a KV(<"k3">, <iterable with items [<0>] in any order>)
in []
at
org.apache.beam.sdk.testing.PAssert$PAssertionSite.capture(PAssert.java:174)
at org.apache.beam.sdk.testing.PAssert.that(PAssert.java:416)
at org.apache.beam.sdk.testing.PAssert.that(PAssert.java:408)
at
org.apache.beam.sdk.transforms.GroupByKeyTest$WindowTests.testGroupByKeyAndWindows(GroupByKeyTest.java:509)
at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method)
at
sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:62)
at
sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43)
at java.lang.reflect.Method.invoke(Method.java:498)
at
org.junit.runners.model.FrameworkMethod$1.runReflectiveCall(FrameworkMethod.java:59)
at
org.junit.internal.runners.model.ReflectiveCallable.run(ReflectiveCallable.java:12)
at
org.junit.runners.model.FrameworkMethod.invokeExplosively(FrameworkMethod.java:56)
at
org.junit.internal.runners.statements.InvokeMethod.evaluate(InvokeMethod.java:17)
at
org.apache.beam.sdk.testing.TestPipeline$1.evaluate(TestPipeline.java:322)
at
org.junit.rules.ExpectedException$ExpectedExceptionStatement.evaluate(ExpectedException.java:266)
at org.junit.runners.ParentRunner$3.evaluate(ParentRunner.java:305)
at
org.junit.runners.BlockJUnit4ClassRunner$1.evaluate(BlockJUnit4ClassRunner.java:100)
at org.junit.runners.ParentRunner.runLeaf(ParentRunner.java:365)
at
org.junit.runners.BlockJUnit4ClassRunner.runChild(BlockJUnit4ClassRunner.java:103)
at
org.junit.runners.BlockJUnit4ClassRunner.runChild(BlockJUnit4ClassRunner.java:63)
at org.junit.runners.ParentRunner$4.run(ParentRunner.java:330)
at org.junit.runners.ParentRunner$1.schedule(ParentRunner.java:78)
at org.junit.runners.ParentRunner.runChildren(ParentRunner.java:328)
at org.junit.runners.ParentRunner.access$100(ParentRunner.java:65)
at org.junit.runners.ParentRunner$2.evaluate(ParentRunner.java:292)
at org.junit.runners.ParentRunner$3.evaluate(ParentRunner.java:305)
at org.junit.runners.ParentRunner.run(ParentRunner.java:412)
at org.junit.runners.Suite.runChild(Suite.java:128)
at org.junit.runners.Suite.runChild(Suite.java:27)
at org.junit.runners.ParentRunner$4.run(ParentRunner.java:330)
at org.junit.runners.ParentRunner$1.schedule(ParentRunner.java:78)
at org.junit.runners.ParentRunner.runChildren(ParentRunner.java:328)
at org.junit.runners.ParentRunner.access$100(ParentRunner.java:65)
at org.junit.runners.ParentRunner$2.evaluate(ParentRunner.java:292)
at org.junit.runners.ParentRunner$3.evaluate(ParentRunner.java:305)
at org.junit.runners.ParentRunner.run(ParentRunner.java:412)
at
org.gradle.api.internal.tasks.testing.junit.JUnitTestClassExecutor.runTestClass(JUnitTestClassExecutor.java:110)
at
org.gradle.api.internal.tasks.testing.junit.JUnitTestClassExecutor.execute(JUnitTestClassExecutor.java:58)
at
org.gradle.api.internal.tasks.testing.junit.JUnitTestClassExecutor.execute(JUnitTestClassExecutor.java:38)
at
org.gradle.api.internal.tasks.testing.junit.AbstractJUnitTestClassProcessor.processTestClass(AbstractJUnitTestClassProcessor.java:62)
at
org.gradle.api.internal.tasks.testing.SuiteTestClassProcessor.processTestClass(SuiteTestClassProcessor.java:51)
at sun.reflect.GeneratedMethodAccessor155.invoke(Unknown Source)
at
sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43)
at java.lang.reflect.Method.invoke(Method.java:498)
at
org.gradle.internal.dispatch.ReflectionDispatch.dispatch(ReflectionDispatch.java:36)
at
org.gradle.internal.dispatch.ReflectionDispatch.dispatch(ReflectionDispatch.java:24)
at
org.gradle.internal.dispatch.ContextClassLoaderDispatch.dispatch(ContextClassLoaderDispatch.java:33)
at
org.gradle.internal.dispatch.ProxyDispatchAdapter$DispatchingInvocationHandler.invoke(ProxyDispatchAdapter.java:94)
at com.sun.proxy.$Proxy2.processTestClass(Unknown Source)
at
org.gradle.api.internal.tasks.testing.worker.TestWorker.processTestClass(TestWorker.java:119)
at sun.reflect.GeneratedMethodAccessor154.invoke(Unknown Source)
at
sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43)
at java.lang.reflect.Method.invoke(Method.java:498)
at
org.gradle.internal.dispatch.ReflectionDispatch.dispatch(ReflectionDispatch.java:36)
at
org.gradle.internal.dispatch.ReflectionDispatch.dispatch(ReflectionDispatch.java:24)
at
org.gradle.internal.remote.internal.hub.MessageHubBackedObjectConnection$DispatchWrapper.dispatch(MessageHubBackedObjectConnection.java:182)
at
org.gradle.internal.remote.internal.hub.MessageHubBackedObjectConnection$DispatchWrapper.dispatch(MessageHubBackedObjectConnection.java:164)
at
org.gradle.internal.remote.internal.hub.MessageHub$Handler.run(MessageHub.java:414)
at
org.gradle.internal.concurrent.ExecutorPolicy$CatchAndRecordFailures.onExecute(ExecutorPolicy.java:64)
at
org.gradle.internal.concurrent.ManagedExecutorImpl$1.run(ManagedExecutorImpl.java:48)
at
java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1149)
at
java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624)
at
org.gradle.internal.concurrent.ThreadFactoryImpl$ManagedThreadRunnable.run(ThreadFactoryImpl.java:56)
Caused by: java.lang.AssertionError:
Expected: iterable with items [a KV(<"k1">, <iterable with items [<3>] in any
order>), a KV(<"k1">, <iterable with items [<4>] in any order>), a KV(<"k5">,
<iterable with items [<2147483647>, <-2147483648>] in any order>), a KV(<"k2">,
<iterable with items [<66>] in any order>), a KV(<"k2">, <iterable with items
[<-33>] in any order>), a KV(<"k3">, <iterable with items [<0>] in any order>)]
in any order
but: no item matches: a KV(<"k1">, <iterable with items [<3>] in any
order>), a KV(<"k1">, <iterable with items [<4>] in any order>), a KV(<"k5">,
<iterable with items [<2147483647>, <-2147483648>] in any order>), a KV(<"k2">,
<iterable with items [<66>] in any order>), a KV(<"k2">, <iterable with items
[<-33>] in any order>), a KV(<"k3">, <iterable with items [<0>] in any order>)
in []
at org.hamcrest.MatcherAssert.assertThat(MatcherAssert.java:18)
at org.junit.Assert.assertThat(Assert.java:966)
at org.junit.Assert.assertThat(Assert.java:931)
at
org.apache.beam.sdk.transforms.GroupByKeyTest$ContainsKVs.apply(GroupByKeyTest.java:681)
at
org.apache.beam.sdk.transforms.GroupByKeyTest$ContainsKVs.apply(GroupByKeyTest.java:666)
at org.apache.beam.sdk.testing.PAssert.doChecks(PAssert.java:1477)
at
org.apache.beam.sdk.testing.PAssert$GroupedValuesCheckerDoFn.processElement(PAssert.java:1444)
at
org.apache.beam.sdk.testing.PAssert$GroupedValuesCheckerDoFn$DoFnInvoker.invokeProcessElement(Unknown
Source)
at
org.apache.beam.fn.harness.FnApiDoFnRunner.processElementForParDo(FnApiDoFnRunner.java:748)
at
org.apache.beam.fn.harness.data.PCollectionConsumerRegistry$MetricTrackingFnDataReceiver.accept(PCollectionConsumerRegistry.java:222)
at
org.apache.beam.fn.harness.data.PCollectionConsumerRegistry$MetricTrackingFnDataReceiver.accept(PCollectionConsumerRegistry.java:185)
at
org.apache.beam.fn.harness.FnApiDoFnRunner.outputTo(FnApiDoFnRunner.java:1678)
at
org.apache.beam.fn.harness.FnApiDoFnRunner.access$2500(FnApiDoFnRunner.java:139)
at
org.apache.beam.fn.harness.FnApiDoFnRunner$NonWindowObservingProcessBundleContext.outputWithTimestamp(FnApiDoFnRunner.java:2194)
at
org.apache.beam.fn.harness.FnApiDoFnRunner$ProcessBundleContextBase.output(FnApiDoFnRunner.java:2363)
at
org.apache.beam.sdk.transforms.DoFnOutputReceivers$WindowedContextOutputReceiver.output(DoFnOutputReceivers.java:78)
at
org.apache.beam.sdk.transforms.MapElements$1.processElement(MapElements.java:142)
at
org.apache.beam.sdk.transforms.MapElements$1$DoFnInvoker.invokeProcessElement(Unknown
Source)
at
org.apache.beam.fn.harness.FnApiDoFnRunner.processElementForParDo(FnApiDoFnRunner.java:748)
at
org.apache.beam.fn.harness.data.PCollectionConsumerRegistry$MetricTrackingFnDataReceiver.accept(PCollectionConsumerRegistry.java:222)
at
org.apache.beam.fn.harness.data.PCollectionConsumerRegistry$MetricTrackingFnDataReceiver.accept(PCollectionConsumerRegistry.java:185)
at
org.apache.beam.fn.harness.FnApiDoFnRunner.outputTo(FnApiDoFnRunner.java:1678)
at
org.apache.beam.fn.harness.FnApiDoFnRunner.access$2500(FnApiDoFnRunner.java:139)
at
org.apache.beam.fn.harness.FnApiDoFnRunner$NonWindowObservingProcessBundleContext.outputWithTimestamp(FnApiDoFnRunner.java:2194)
at
org.apache.beam.fn.harness.FnApiDoFnRunner$ProcessBundleContextBase.output(FnApiDoFnRunner.java:2363)
at
org.apache.beam.sdk.testing.PAssert$ConcatFn.processElement(PAssert.java:1281)
at
org.apache.beam.sdk.testing.PAssert$ConcatFn$DoFnInvoker.invokeProcessElement(Unknown
Source)
at
org.apache.beam.fn.harness.FnApiDoFnRunner.processElementForParDo(FnApiDoFnRunner.java:748)
at
org.apache.beam.fn.harness.data.PCollectionConsumerRegistry$MetricTrackingFnDataReceiver.accept(PCollectionConsumerRegistry.java:222)
at
org.apache.beam.fn.harness.data.PCollectionConsumerRegistry$MetricTrackingFnDataReceiver.accept(PCollectionConsumerRegistry.java:185)
at
org.apache.beam.fn.harness.FnApiDoFnRunner.outputTo(FnApiDoFnRunner.java:1678)
at
org.apache.beam.fn.harness.FnApiDoFnRunner.access$2500(FnApiDoFnRunner.java:139)
at
org.apache.beam.fn.harness.FnApiDoFnRunner$NonWindowObservingProcessBundleContext.outputWithTimestamp(FnApiDoFnRunner.java:2194)
at
org.apache.beam.fn.harness.FnApiDoFnRunner$ProcessBundleContextBase.output(FnApiDoFnRunner.java:2363)
at
org.apache.beam.sdk.transforms.DoFnOutputReceivers$WindowedContextOutputReceiver.output(DoFnOutputReceivers.java:78)
at
org.apache.beam.sdk.transforms.MapElements$1.processElement(MapElements.java:142)
at
org.apache.beam.sdk.transforms.MapElements$1$DoFnInvoker.invokeProcessElement(Unknown
Source)
at
org.apache.beam.fn.harness.FnApiDoFnRunner.processElementForParDo(FnApiDoFnRunner.java:748)
at
org.apache.beam.fn.harness.data.PCollectionConsumerRegistry$MetricTrackingFnDataReceiver.accept(PCollectionConsumerRegistry.java:222)
at
org.apache.beam.fn.harness.data.PCollectionConsumerRegistry$MetricTrackingFnDataReceiver.accept(PCollectionConsumerRegistry.java:185)
at
org.apache.beam.fn.harness.BeamFnDataReadRunner.forwardElementToConsumer(BeamFnDataReadRunner.java:220)
at
org.apache.beam.sdk.fn.data.DecodingFnDataReceiver.accept(DecodingFnDataReceiver.java:43)
at
org.apache.beam.sdk.fn.data.DecodingFnDataReceiver.accept(DecodingFnDataReceiver.java:25)
at
org.apache.beam.fn.harness.data.QueueingBeamFnDataClient.drainAndBlock(QueueingBeamFnDataClient.java:111)
at
org.apache.beam.fn.harness.control.ProcessBundleHandler.processBundle(ProcessBundleHandler.java:304)
at
org.apache.beam.fn.harness.control.BeamFnControlClient.delegateOnInstructionRequestType(BeamFnControlClient.java:173)
at
org.apache.beam.fn.harness.control.BeamFnControlClient.lambda$processInstructionRequests$0(BeamFnControlClient.java:157)
at
java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1149)
at
java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624)
at java.lang.Thread.run(Thread.java:748)
at
org.apache.beam.runners.fnexecution.control.FnApiControlClient$ResponseStreamObserver.onNext(FnApiControlClient.java:180)
at
org.apache.beam.runners.fnexecution.control.FnApiControlClient$ResponseStreamObserver.onNext(FnApiControlClient.java:160)
at
org.apache.beam.vendor.grpc.v1p26p0.io.grpc.stub.ServerCalls$StreamingServerCallHandler$StreamingServerCallListener.onMessage(ServerCalls.java:251)
at
org.apache.beam.vendor.grpc.v1p26p0.io.grpc.ForwardingServerCallListener.onMessage(ForwardingServerCallListener.java:33)
at
org.apache.beam.vendor.grpc.v1p26p0.io.grpc.Contexts$ContextualizedServerCallListener.onMessage(Contexts.java:76)
at
org.apache.beam.vendor.grpc.v1p26p0.io.grpc.internal.ServerCallImpl$ServerStreamListenerImpl.messagesAvailableInternal(ServerCallImpl.java:309)
at
org.apache.beam.vendor.grpc.v1p26p0.io.grpc.internal.ServerCallImpl$ServerStreamListenerImpl.messagesAvailable(ServerCallImpl.java:292)
at
org.apache.beam.vendor.grpc.v1p26p0.io.grpc.internal.ServerImpl$JumpToApplicationThreadServerStreamListener$1MessagesAvailable.runInContext(ServerImpl.java:782)
at
org.apache.beam.vendor.grpc.v1p26p0.io.grpc.internal.ContextRunnable.run(ContextRunnable.java:37)
at
org.apache.beam.vendor.grpc.v1p26p0.io.grpc.internal.SerializingExecutor.run(SerializingExecutor.java:123)
... 3 more
20/12/16 00:26:04 ERROR
org.apache.beam.runners.jobsubmission.InMemoryJobService: Encountered
Unexpected Exception for Invocation
groupbykeytest0windowtests0testgroupbykeyandwindows-jenkins-1216002528-d5b81086_599764e1-6ce3-46d3-94e2-c0fb65b20631
java.lang.IllegalStateException: Stream is already completed, no further calls
are allowed
at
org.apache.beam.vendor.grpc.v1p26p0.com.google.common.base.Preconditions.checkState(Preconditions.java:511)
at
org.apache.beam.vendor.grpc.v1p26p0.io.grpc.stub.ServerCalls$ServerCallStreamObserverImpl.onNext(ServerCalls.java:346)
at
org.apache.beam.sdk.fn.stream.SynchronizedStreamObserver.onNext(SynchronizedStreamObserver.java:46)
at
org.apache.beam.runners.jobsubmission.InMemoryJobService.lambda$getMessageStream$2(InMemoryJobService.java:434)
at
org.apache.beam.runners.jobsubmission.JobInvocation.addStateListener(JobInvocation.java:218)
at
org.apache.beam.runners.jobsubmission.InMemoryJobService.getMessageStream(InMemoryJobService.java:450)
at
org.apache.beam.model.jobmanagement.v1.JobServiceGrpc$MethodHandlers.invoke(JobServiceGrpc.java:985)
at
org.apache.beam.vendor.grpc.v1p26p0.io.grpc.stub.ServerCalls$UnaryServerCallHandler$UnaryServerCallListener.onHalfClose(ServerCalls.java:172)
at
org.apache.beam.vendor.grpc.v1p26p0.io.grpc.PartialForwardingServerCallListener.onHalfClose(PartialForwardingServerCallListener.java:35)
at
org.apache.beam.vendor.grpc.v1p26p0.io.grpc.ForwardingServerCallListener.onHalfClose(ForwardingServerCallListener.java:23)
at
org.apache.beam.vendor.grpc.v1p26p0.io.grpc.ForwardingServerCallListener$SimpleForwardingServerCallListener.onHalfClose(ForwardingServerCallListener.java:40)
at
org.apache.beam.vendor.grpc.v1p26p0.io.grpc.Contexts$ContextualizedServerCallListener.onHalfClose(Contexts.java:86)
at
org.apache.beam.vendor.grpc.v1p26p0.io.grpc.internal.ServerCallImpl$ServerStreamListenerImpl.halfClosed(ServerCallImpl.java:331)
at
org.apache.beam.vendor.grpc.v1p26p0.io.grpc.internal.ServerImpl$JumpToApplicationThreadServerStreamListener$1HalfClosed.runInContext(ServerImpl.java:817)
at
org.apache.beam.vendor.grpc.v1p26p0.io.grpc.internal.ContextRunnable.run(ContextRunnable.java:37)
at
org.apache.beam.vendor.grpc.v1p26p0.io.grpc.internal.SerializingExecutor.run(SerializingExecutor.java:123)
at
java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1149)
at
java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624)
at java.lang.Thread.run(Thread.java:748)
20/12/16 00:26:04 INFO
org.apache.beam.runners.jobsubmission.InMemoryJobService: Getting job metrics
for
groupbykeytest0windowtests0testgroupbykeyandwindows-jenkins-1216002528-d5b81086_599764e1-6ce3-46d3-94e2-c0fb65b20631
Dec 16, 2020 12:26:04 AM
org.apache.beam.vendor.grpc.v1p26p0.io.grpc.internal.SerializingExecutor run
SEVERE: Exception while executing runnable
org.apache.beam.vendor.grpc.v1p26p0.io.grpc.internal.ServerImpl$JumpToApplicationThreadServerStreamListener$1HalfClosed@260ae8b7
java.lang.IllegalStateException: call already closed
at
org.apache.beam.vendor.grpc.v1p26p0.com.google.common.base.Preconditions.checkState(Preconditions.java:511)
at
org.apache.beam.vendor.grpc.v1p26p0.io.grpc.internal.ServerCallImpl.closeInternal(ServerCallImpl.java:209)
at
org.apache.beam.vendor.grpc.v1p26p0.io.grpc.internal.ServerCallImpl.close(ServerCallImpl.java:202)
at
org.apache.beam.vendor.grpc.v1p26p0.io.grpc.stub.ServerCalls$ServerCallStreamObserverImpl.onError(ServerCalls.java:360)
at
org.apache.beam.runners.jobsubmission.InMemoryJobService.getMessageStream(InMemoryJobService.java:458)
at
org.apache.beam.model.jobmanagement.v1.JobServiceGrpc$MethodHandlers.invoke(JobServiceGrpc.java:985)
at
org.apache.beam.vendor.grpc.v1p26p0.io.grpc.stub.ServerCalls$UnaryServerCallHandler$UnaryServerCallListener.onHalfClose(ServerCalls.java:172)
at
org.apache.beam.vendor.grpc.v1p26p0.io.grpc.PartialForwardingServerCallListener.onHalfClose(PartialForwardingServerCallListener.java:35)
at
org.apache.beam.vendor.grpc.v1p26p0.io.grpc.ForwardingServerCallListener.onHalfClose(ForwardingServerCallListener.java:23)
at
org.apache.beam.vendor.grpc.v1p26p0.io.grpc.ForwardingServerCallListener$SimpleForwardingServerCallListener.onHalfClose(ForwardingServerCallListener.java:40)
at
org.apache.beam.vendor.grpc.v1p26p0.io.grpc.Contexts$ContextualizedServerCallListener.onHalfClose(Contexts.java:86)
at
org.apache.beam.vendor.grpc.v1p26p0.io.grpc.internal.ServerCallImpl$ServerStreamListenerImpl.halfClosed(ServerCallImpl.java:331)
at
org.apache.beam.vendor.grpc.v1p26p0.io.grpc.internal.ServerImpl$JumpToApplicationThreadServerStreamListener$1HalfClosed.runInContext(ServerImpl.java:817)
at
org.apache.beam.vendor.grpc.v1p26p0.io.grpc.internal.ContextRunnable.run(ContextRunnable.java:37)
at
org.apache.beam.vendor.grpc.v1p26p0.io.grpc.internal.SerializingExecutor.run(SerializingExecutor.java:123)
at
java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1149)
at
java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624)
at java.lang.Thread.run(Thread.java:748)
20/12/16 00:26:04 INFO
org.apache.beam.runners.jobsubmission.InMemoryJobService: Finished getting job
metrics for
groupbykeytest0windowtests0testgroupbykeyandwindows-jenkins-1216002528-d5b81086_599764e1-6ce3-46d3-94e2-c0fb65b20631
20/12/16 00:26:04 INFO org.apache.beam.runners.jobsubmission.JobServerDriver:
JobServer stopped on localhost:39743
20/12/16 00:26:04 INFO org.apache.beam.runners.jobsubmission.JobServerDriver:
ArtifactStagingServer stopped on localhost:44419
20/12/16 00:26:04 INFO org.apache.beam.runners.jobsubmission.JobServerDriver:
Expansion stopped on localhost:37655
{code}
--
This message was sent by Atlassian Jira
(v8.3.4#803005)
