See
<https://builds.apache.org/job/beam_PostCommit_Java_Nexmark_Dataflow/835/display/redirect?page=changes>
Changes:
[ccy] Support multiple versions of snappy for tfrecordio
------------------------------------------
[...truncated 563.94 KB...]
INFO: 2018-10-27T00:23:59.508Z: Executing operation
Query7/Combine.GloballyAsSingletonView/Combine.globally(MaxLong)/Combine.perKeyWithFanout(MaxLong)/PreCombineHot/GroupByKey/Close
Oct 27, 2018 12:24:00 AM
org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-10-27T00:23:59.613Z: Executing operation
Query7/Combine.GloballyAsSingletonView/Combine.globally(MaxLong)/Combine.perKeyWithFanout(MaxLong)/PreCombineHot/GroupByKey/Read+Query7/Combine.GloballyAsSingletonView/Combine.globally(MaxLong)/Combine.perKeyWithFanout(MaxLong)/PreCombineHot/Combine.GroupedValues+Query7/Combine.GloballyAsSingletonView/Combine.globally(MaxLong)/Combine.perKeyWithFanout(MaxLong)/PreCombineHot/Combine.GroupedValues/Extract+Query7/Combine.GloballyAsSingletonView/Combine.globally(MaxLong)/Combine.perKeyWithFanout(MaxLong)/StripNonce/Map+Query7/Combine.GloballyAsSingletonView/Combine.globally(MaxLong)/Combine.perKeyWithFanout(MaxLong)/Window.Remerge/Identity/Map+Query7/Combine.GloballyAsSingletonView/Combine.globally(MaxLong)/Combine.perKeyWithFanout(MaxLong)/PostCombine/GroupByKey+Query7/Combine.GloballyAsSingletonView/Combine.globally(MaxLong)/Combine.perKeyWithFanout(MaxLong)/PostCombine/Combine.GroupedValues/Partial+Query7/Combine.GloballyAsSingletonView/Combine.globally(MaxLong)/Combine.perKeyWithFanout(MaxLong)/PostCombine/GroupByKey/Reify+Query7/Combine.GloballyAsSingletonView/Combine.globally(MaxLong)/Combine.perKeyWithFanout(MaxLong)/PostCombine/GroupByKey/Write
Oct 27, 2018 12:24:02 AM
org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-10-27T00:24:01.301Z: Executing operation
Query7/Combine.GloballyAsSingletonView/Combine.globally(MaxLong)/Combine.perKeyWithFanout(MaxLong)/PostCombine/GroupByKey/Close
Oct 27, 2018 12:24:02 AM
org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-10-27T00:24:01.388Z: Executing operation
Query7/Combine.GloballyAsSingletonView/Combine.globally(MaxLong)/Combine.perKeyWithFanout(MaxLong)/PostCombine/GroupByKey/Read+Query7/Combine.GloballyAsSingletonView/Combine.globally(MaxLong)/Combine.perKeyWithFanout(MaxLong)/PostCombine/Combine.GroupedValues+Query7/Combine.GloballyAsSingletonView/Combine.globally(MaxLong)/Combine.perKeyWithFanout(MaxLong)/PostCombine/Combine.GroupedValues/Extract+Query7/Combine.GloballyAsSingletonView/Combine.globally(MaxLong)/Values/Values/Map+Query7/Combine.GloballyAsSingletonView/BatchViewOverrides.GroupByWindowHashAsKeyAndWindowAsSortKey/ParDo(UseWindowHashAsKeyAndWindowAsSortKey)+Query7/Combine.GloballyAsSingletonView/BatchViewOverrides.GroupByWindowHashAsKeyAndWindowAsSortKey/BatchViewOverrides.GroupByKeyAndSortValuesOnly/Write
Oct 27, 2018 12:24:02 AM
org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-10-27T00:24:00.080Z: Executing operation
Query5/Count.PerElement/Combine.perKey(Count)/GroupByKey/Close
Oct 27, 2018 12:24:02 AM
org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-10-27T00:24:00.163Z: Executing operation
Query5/Count.PerElement/Combine.perKey(Count)/GroupByKey/Read+Query5/Count.PerElement/Combine.perKey(Count)/Combine.GroupedValues+Query5/Query5.ToSingletons+Query5/Combine.globally(Anonymous)/WithKeys/AddKeys/Map+Query5/Combine.globally(Anonymous)/Combine.perKeyWithFanout(Anonymous)/AddNonce+Query5/Combine.globally(Anonymous)/Combine.perKeyWithFanout(Anonymous)/PrepareCold/Map+Query5/Combine.globally(Anonymous)/Combine.perKeyWithFanout(Anonymous)/PostCombine/GroupByKey/Reify+Query5/Combine.globally(Anonymous)/Combine.perKeyWithFanout(Anonymous)/PostCombine/GroupByKey/Write+Query5/Combine.globally(Anonymous)/Combine.perKeyWithFanout(Anonymous)/PreCombineHot/GroupByKey/Reify+Query5/Combine.globally(Anonymous)/Combine.perKeyWithFanout(Anonymous)/PreCombineHot/GroupByKey/Write
Oct 27, 2018 12:24:03 AM
org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-10-27T00:24:02.918Z: Executing operation
Query7/Combine.GloballyAsSingletonView/BatchViewOverrides.GroupByWindowHashAsKeyAndWindowAsSortKey/BatchViewOverrides.GroupByKeyAndSortValuesOnly/Close
Oct 27, 2018 12:24:03 AM
org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-10-27T00:24:03.012Z: Executing operation
Query7/Combine.GloballyAsSingletonView/BatchViewOverrides.GroupByWindowHashAsKeyAndWindowAsSortKey/BatchViewOverrides.GroupByKeyAndSortValuesOnly/Read+Query7/Combine.GloballyAsSingletonView/ParDo(IsmRecordForSingularValuePerWindow)
Oct 27, 2018 12:24:08 AM
org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-10-27T00:24:06.287Z: Executing operation
Query7/Combine.GloballyAsSingletonView/CreateDataflowView
Oct 27, 2018 12:24:08 AM
org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-10-27T00:24:06.538Z: Executing operation
Query7/Query7.Select+Query7/Query7.Forget+Query7/Query7.Debug+Query7/Query7.Stamp+Query7.Format+Query7.DevNull
Oct 27, 2018 12:24:14 AM
org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-10-27T00:24:14.684Z: Executing operation
Query10/Query10.GroupByKey/Close
Oct 27, 2018 12:24:15 AM
org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-10-27T00:24:13.500Z: Executing operation
Query6/Combine.perKey(MovingMeanSellingPrice)/GroupByKey/Close
Oct 27, 2018 12:24:15 AM
org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-10-27T00:24:13.620Z: Executing operation
Query6/Combine.perKey(MovingMeanSellingPrice)/GroupByKey/Read+Query6/Combine.perKey(MovingMeanSellingPrice)/Combine.GroupedValues+Query6/Combine.perKey(MovingMeanSellingPrice)/Combine.GroupedValues/Extract+Query6/Query6.Select+Query6/Query6.Forget+Query6/Query6.Debug+Query6/Query6.Stamp+Query6.Format+Query6.DevNull
Oct 27, 2018 12:24:17 AM
org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-10-27T00:24:16.050Z: Cleaning up.
Oct 27, 2018 12:24:17 AM
org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-10-27T00:24:16.150Z: Stopping worker pool...
Oct 27, 2018 12:24:17 AM
org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-10-27T00:24:14.933Z: Executing operation
Query10/Query10.GroupByKey/Read+Query10/Query10.GroupByKey/GroupByWindow+Query10/Query10.CheckForLateEvents+Query10/Query10.UploadEvents+Query10/Query10.WindowLogFiles/Window.Assign+Query10/Query10.GroupByKey2/Reify+Query10/Query10.GroupByKey2/Write
Oct 27, 2018 12:24:19 AM
org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-10-27T00:24:18.532Z: Executing operation
Query5/Combine.globally(Anonymous)/Combine.perKeyWithFanout(Anonymous)/PreCombineHot/GroupByKey/Close
Oct 27, 2018 12:24:19 AM
org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-10-27T00:24:18.646Z: Executing operation
Query5/Combine.globally(Anonymous)/Combine.perKeyWithFanout(Anonymous)/PreCombineHot/GroupByKey/Read+Query5/Combine.globally(Anonymous)/Combine.perKeyWithFanout(Anonymous)/PreCombineHot/Combine.GroupedValues+Query5/Combine.globally(Anonymous)/Combine.perKeyWithFanout(Anonymous)/StripNonce/Map+Query5/Combine.globally(Anonymous)/Combine.perKeyWithFanout(Anonymous)/Window.Remerge/Identity/Map+Query5/Combine.globally(Anonymous)/Combine.perKeyWithFanout(Anonymous)/PostCombine/GroupByKey/Reify+Query5/Combine.globally(Anonymous)/Combine.perKeyWithFanout(Anonymous)/PostCombine/GroupByKey/Write
Oct 27, 2018 12:24:23 AM
org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-10-27T00:24:22.279Z: Executing operation
Query11/Count.PerElement/Combine.perKey(Count)/GroupByKey/Close
Oct 27, 2018 12:24:23 AM
org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-10-27T00:24:22.463Z: Executing operation
Query11/Count.PerElement/Combine.perKey(Count)/GroupByKey/Read+Query11/Count.PerElement/Combine.perKey(Count)/Combine.GroupedValues+Query11/Query11.ToResult+Query11/Query11.Forget+Query11/Query11.Debug+Query11/Query11.Stamp+Query11.Format+Query11.DevNull
Oct 27, 2018 12:24:23 AM
org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-10-27T00:24:21.992Z: Executing operation
Query4/Query4.WinningBids/CoGroupByKey/GBK/Close
Oct 27, 2018 12:24:23 AM
org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-10-27T00:24:22.100Z: Executing operation
Query4/Query4.WinningBids/CoGroupByKey/GBK/Read+Query4/Query4.WinningBids/CoGroupByKey/GBK/GroupByWindow+Query4/Query4.WinningBids/CoGroupByKey/ConstructCoGbkResultFn+Query4/Query4.WinningBids/Query4.WinningBids.Join+Query4/Query4.WinningBidsMonitor+Query4/Query4.Rekey+Query4/Window.Into()/Window.Assign+Query4/Combine.perKeyWithFanout(Mean)/AddNonce+Query4/Combine.perKeyWithFanout(Mean)/PrepareCold/Map+Query4/Combine.perKeyWithFanout(Mean)/PostCombine/GroupByKey/Reify+Query4/Combine.perKeyWithFanout(Mean)/PostCombine/GroupByKey/Write+Query4/Combine.perKeyWithFanout(Mean)/PreCombineHot/GroupByKey/Reify+Query4/Combine.perKeyWithFanout(Mean)/PreCombineHot/GroupByKey/Write
Oct 27, 2018 12:24:25 AM
org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-10-27T00:24:24.326Z: Executing operation
Query9/Query9/CoGroupByKey/GBK/Close
Oct 27, 2018 12:24:25 AM
org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-10-27T00:24:24.414Z: Executing operation
Query9/Query9/CoGroupByKey/GBK/Read+Query9/Query9/CoGroupByKey/GBK/GroupByWindow+Query9/Query9/CoGroupByKey/ConstructCoGbkResultFn+Query9/Query9/Query9.Join+Query9/Query9.Forget+Query9/Query9.Debug+Query9/Query9.Stamp+Query9.Format+Query9.DevNull
Oct 27, 2018 12:24:26 AM
org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-10-27T00:24:26.277Z: Executing operation
Query5/Combine.globally(Anonymous)/Combine.perKeyWithFanout(Anonymous)/PostCombine/GroupByKey/Close
Oct 27, 2018 12:24:26 AM
org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-10-27T00:24:26.385Z: Executing operation
Query5/Combine.globally(Anonymous)/Combine.perKeyWithFanout(Anonymous)/PostCombine/GroupByKey/Read+Query5/Combine.globally(Anonymous)/Combine.perKeyWithFanout(Anonymous)/PostCombine/Combine.GroupedValues+Query5/Combine.globally(Anonymous)/Values/Values/Map+Query5/Query5.Select+Query5/Query5.Forget+Query5/Query5.Debug+Query5/Query5.Stamp+Query5.Format+Query5.DevNull
Oct 27, 2018 12:24:29 AM
org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-10-27T00:24:28.076Z: Cleaning up.
Oct 27, 2018 12:24:29 AM
org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-10-27T00:24:28.172Z: Stopping worker pool...
Oct 27, 2018 12:24:33 AM
org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-10-27T00:24:32.856Z: Executing operation
Query8/CoGroupByKey/GBK/Close
Oct 27, 2018 12:24:33 AM
org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-10-27T00:24:32.964Z: Executing operation
Query8/CoGroupByKey/GBK/Read+Query8/CoGroupByKey/GBK/GroupByWindow+Query8/CoGroupByKey/ConstructCoGbkResultFn+Query8/Query8.Select+Query8/Query8.Forget+Query8/Query8.Debug+Query8/Query8.Stamp+Query8.Format+Query8.DevNull
Oct 27, 2018 12:24:34 AM
org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-10-27T00:24:33.832Z: Cleaning up.
Oct 27, 2018 12:24:34 AM
org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-10-27T00:24:33.936Z: Stopping worker pool...
Oct 27, 2018 12:24:38 AM
org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-10-27T00:24:38.167Z: Executing operation
Query4/Combine.perKeyWithFanout(Mean)/PreCombineHot/GroupByKey/Close
Oct 27, 2018 12:24:38 AM
org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-10-27T00:24:38.258Z: Executing operation
Query4/Combine.perKeyWithFanout(Mean)/PreCombineHot/GroupByKey/Read+Query4/Combine.perKeyWithFanout(Mean)/PreCombineHot/Combine.GroupedValues+Query4/Combine.perKeyWithFanout(Mean)/StripNonce/Map+Query4/Combine.perKeyWithFanout(Mean)/Window.Remerge/Identity/Map+Query4/Combine.perKeyWithFanout(Mean)/PostCombine/GroupByKey/Reify+Query4/Combine.perKeyWithFanout(Mean)/PostCombine/GroupByKey/Write
Oct 27, 2018 12:24:40 AM
org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-10-27T00:24:39.736Z: Executing operation
Query4/Combine.perKeyWithFanout(Mean)/PostCombine/GroupByKey/Close
Oct 27, 2018 12:24:40 AM
org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-10-27T00:24:39.834Z: Executing operation
Query4/Combine.perKeyWithFanout(Mean)/PostCombine/GroupByKey/Read+Query4/Combine.perKeyWithFanout(Mean)/PostCombine/Combine.GroupedValues+Query4/Query4.Project+Query4/Query4.Forget+Query4/Query4.Debug+Query4/Query4.Stamp+Query4.Format+Query4.DevNull
Oct 27, 2018 12:24:41 AM
org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-10-27T00:24:41.290Z: Cleaning up.
Oct 27, 2018 12:24:42 AM
org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-10-27T00:24:41.913Z: Cleaning up.
Oct 27, 2018 12:24:42 AM
org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-10-27T00:24:42.010Z: Stopping worker pool...
Oct 27, 2018 12:24:42 AM
org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-10-27T00:24:41.412Z: Stopping worker pool...
Oct 27, 2018 12:24:43 AM
org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-10-27T00:24:41.726Z: Cleaning up.
Oct 27, 2018 12:24:43 AM
org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-10-27T00:24:41.839Z: Stopping worker pool...
Oct 27, 2018 12:24:43 AM
org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-10-27T00:24:41.551Z: Cleaning up.
Oct 27, 2018 12:24:43 AM
org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-10-27T00:24:41.652Z: Stopping worker pool...
Oct 27, 2018 12:24:47 AM
org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-10-27T00:24:46.337Z: Executing operation
Query3/CoGroupByKey/GBK/Close
Oct 27, 2018 12:24:47 AM
org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-10-27T00:24:46.448Z: Executing operation
Query3/CoGroupByKey/GBK/Read+Query3/CoGroupByKey/GBK/GroupByWindow+Query3/CoGroupByKey/ConstructCoGbkResultFn+Query3/Query3.Join/BatchStatefulParDoOverrides.GbkBeforeStatefulParDo/ReifyWindows+Query3/Query3.Join/BatchStatefulParDoOverrides.GbkBeforeStatefulParDo/PartitionKeys/Write
Oct 27, 2018 12:24:50 AM
org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-10-27T00:24:49.630Z: Executing operation
Query10/Query10.GroupByKey2/Close
Oct 27, 2018 12:24:50 AM
org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-10-27T00:24:49.744Z: Executing operation
Query10/Query10.GroupByKey2/Read+Query10/Query10.GroupByKey2/GroupByWindow+Query10/Query10.Index+Query10/Query10.Forget+Query10/Query10.Debug+Query10/Query10.Stamp+Query10.Format+Query10.DevNull
Oct 27, 2018 12:24:50 AM
org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-10-27T00:24:50.720Z: Cleaning up.
Oct 27, 2018 12:24:50 AM
org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-10-27T00:24:50.813Z: Stopping worker pool...
Oct 27, 2018 12:24:51 AM
org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-10-27T00:24:51.768Z: Executing operation
Query3/Query3.Join/BatchStatefulParDoOverrides.GbkBeforeStatefulParDo/PartitionKeys/Close
Oct 27, 2018 12:24:51 AM
org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-10-27T00:24:51.878Z: Executing operation
Query3/Query3.Join/BatchStatefulParDoOverrides.GbkBeforeStatefulParDo/PartitionKeys/Read+Query3/Query3.Join/ParDo(BatchStateful)+Query3/Query3.Project+Query3/Query3.Forget+Query3/Query3.Debug+Query3/Query3.Stamp+Query3.Format+Query3.DevNull
Oct 27, 2018 12:24:56 AM
org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-10-27T00:24:56.047Z: Cleaning up.
Oct 27, 2018 12:24:56 AM
org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-10-27T00:24:56.152Z: Stopping worker pool...
Oct 27, 2018 12:25:33 AM org.apache.beam.runners.dataflow.DataflowPipelineJob
waitUntilFinish
2018-10-27T00:25:33.715Z Waiting for main pipeline to 'finish'
WARNING: No terminal state was returned. State value RUNNING
Oct 27, 2018 12:25:33 AM org.apache.beam.runners.dataflow.DataflowPipelineJob
waitUntilFinish
2018-10-27T00:25:33.717Z Waiting for main pipeline to 'finish'
WARNING: No terminal state was returned. State value RUNNING
2018-10-27T00:25:33.744Z RUNNING Query7
2018-10-27T00:25:33.747Z RUNNING Query11
Oct 27, 2018 12:25:33 AM org.apache.beam.runners.dataflow.DataflowPipelineJob
waitUntilFinish
2018-10-27T00:25:33.769Z Waiting for main pipeline to 'finish'
WARNING: No terminal state was returned. State value RUNNING
2018-10-27T00:25:33.806Z RUNNING Query10
Oct 27, 2018 12:25:33 AM org.apache.beam.runners.dataflow.DataflowPipelineJob
waitUntilFinish
2018-10-27T00:25:33.844Z Waiting for main pipeline to 'finish'
WARNING: No terminal state was returned. State value RUNNING
Oct 27, 2018 12:25:34 AM org.apache.beam.runners.dataflow.DataflowPipelineJob
waitUntilFinish
2018-10-27T00:25:34.138Z Waiting for main pipeline to 'finish'
WARNING: No terminal state was returned. State value RUNNING
2018-10-27T00:25:34.138Z RUNNING Query1
==========================================================================================
Run started 2018-10-27T00:21:21.399Z and ran for PT252.461S
Default configuration:
Exception in thread "main"
{"debug":true,"query":0,"sourceType":"DIRECT","sinkType":"DEVNULL","exportSummaryToBigQuery":false,"pubSubMode":"COMBINED","numEvents":100000,"numEventGenerators":100,"rateShape":"SINE","firstEventRate":10000,"nextEventRate":10000,"rateUnit":"PER_SECOND","ratePeriodSec":600,"preloadSeconds":0,"streamTimeout":240,"isRateLimited":false,"useWallclockEventTime":false,"avgPersonByteSize":200,"avgAuctionByteSize":500,"avgBidByteSize":100,"hotAuctionRatio":2,"hotSellersRatio":4,"hotBiddersRatio":4,"windowSizeSec":10,"windowPeriodSec":5,"watermarkHoldbackSec":0,"numInFlightAuctions":100,"numActivePeople":1000,"coderStrategy":"HAND","cpuDelayMs":0,"diskBusyBytes":0,"auctionSkip":123,"fanout":5,"maxAuctionsWaitingTime":600,"occasionalDelaySec":3,"probDelayedEvent":0.1,"maxLogEvents":100000,"usePubsubPublishTime":false,"outOfOrderGroupSize":1}
Configurations:
Conf Description
0000 query:0; exportSummaryToBigQuery:true; numEvents:10000000
java.lang.RuntimeException: java.lang.NoClassDefFoundError:
org/apache/beam/repackaged/beam_sdks_java_test_utils/com/google/common/collect/Iterables
0001 query:1; exportSummaryToBigQuery:true; numEvents:10000000
at org.apache.beam.sdk.nexmark.Main.runAll(Main.java:144)
at org.apache.beam.sdk.nexmark.Main.main(Main.java:477)
0002 query:2; exportSummaryToBigQuery:true; numEvents:10000000
0003 query:3; exportSummaryToBigQuery:true; numEvents:10000000
0004 query:4; exportSummaryToBigQuery:true; numEvents:1000000
0005 query:5; exportSummaryToBigQuery:true; numEvents:10000000
0006 query:6; exportSummaryToBigQuery:true; numEvents:1000000
0007 query:7; exportSummaryToBigQuery:true; numEvents:10000000
0008 query:8; exportSummaryToBigQuery:true; numEvents:10000000
0009 query:9; exportSummaryToBigQuery:true; numEvents:1000000
0010 query:10; exportSummaryToBigQuery:true; numEvents:10000000
0011 query:11; exportSummaryToBigQuery:true; numEvents:10000000
0012 query:12; exportSummaryToBigQuery:true; numEvents:10000000
Performance:
Conf Runtime(sec) (Baseline) Events(/sec) (Baseline) Results
(Baseline)
0000 *** not run ***
0001 *** not run ***
0002 *** not run ***
0003 *** not run ***
0004 *** not run ***
0005 *** not run ***
0006 *** not run ***
0007 *** not run ***
0008 *** not run ***
0009 *** not run ***
0010 *** not run ***
0011 *** not run ***
0012 *** not run ***
==========================================================================================
Caused by: java.lang.NoClassDefFoundError:
org/apache/beam/repackaged/beam_sdks_java_test_utils/com/google/common/collect/Iterables
at
org.apache.beam.sdk.testutils.metrics.MetricsReader.checkIfMetricResultIsUnique(MetricsReader.java:128)
at
org.apache.beam.sdk.testutils.metrics.MetricsReader.getCounterMetric(MetricsReader.java:65)
at
org.apache.beam.sdk.nexmark.NexmarkLauncher.currentPerf(NexmarkLauncher.java:250)
at
org.apache.beam.sdk.nexmark.NexmarkLauncher.monitor(NexmarkLauncher.java:435)
at
org.apache.beam.sdk.nexmark.NexmarkLauncher.run(NexmarkLauncher.java:1156)
at org.apache.beam.sdk.nexmark.Main$Run.call(Main.java:108)
at org.apache.beam.sdk.nexmark.Main$Run.call(Main.java:96)
at java.util.concurrent.FutureTask.run(FutureTask.java:266)
at
java.util.concurrent.Executors$RunnableAdapter.call(Executors.java:511)
at java.util.concurrent.FutureTask.run(FutureTask.java:266)
at
java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1149)
at
java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624)
at java.lang.Thread.run(Thread.java:748)
Caused by: java.lang.ClassNotFoundException:
org.apache.beam.repackaged.beam_sdks_java_test_utils.com.google.common.collect.Iterables
at java.net.URLClassLoader.findClass(URLClassLoader.java:381)
at java.lang.ClassLoader.loadClass(ClassLoader.java:424)
at sun.misc.Launcher$AppClassLoader.loadClass(Launcher.java:349)
at java.lang.ClassLoader.loadClass(ClassLoader.java:357)
... 13 more
2018-10-27T00:25:34.163Z RUNNING Query6
Oct 27, 2018 12:25:34 AM org.apache.beam.runners.dataflow.DataflowPipelineJob
waitUntilFinish
2018-10-27T00:25:34.192Z Waiting for main pipeline to 'finish'
WARNING: No terminal state was returned. State value RUNNING
2018-10-27T00:25:34.230Z RUNNING Query2
Oct 27, 2018 12:25:38 AM org.apache.beam.runners.dataflow.DataflowPipelineJob
waitUntilFinish
2018-10-27T00:25:38.491Z Waiting for main pipeline to 'finish'
WARNING: No terminal state was returned. State value RUNNING
2018-10-27T00:25:38.518Z RUNNING Query8
Oct 27, 2018 12:25:39 AM org.apache.beam.runners.dataflow.DataflowPipelineJob
waitUntilFinish
2018-10-27T00:25:39.359Z Waiting for main pipeline to 'finish'
WARNING: No terminal state was returned. State value RUNNING
2018-10-27T00:25:39.384Z RUNNING Query12
Oct 27, 2018 12:25:40 AM org.apache.beam.runners.dataflow.DataflowPipelineJob
waitUntilFinish
2018-10-27T00:25:40.698Z Waiting for main pipeline to 'finish'
WARNING: No terminal state was returned. State value RUNNING
2018-10-27T00:25:40.736Z RUNNING Query4
Oct 27, 2018 12:25:42 AM org.apache.beam.runners.dataflow.DataflowPipelineJob
waitUntilFinish
2018-10-27T00:25:42.868Z Waiting for main pipeline to 'finish'
WARNING: No terminal state was returned. State value RUNNING
2018-10-27T00:25:42.910Z RUNNING Query5
Oct 27, 2018 12:25:44 AM org.apache.beam.runners.dataflow.DataflowPipelineJob
waitUntilFinish
2018-10-27T00:25:44.149Z Waiting for main pipeline to 'finish'
WARNING: No terminal state was returned. State value RUNNING
2018-10-27T00:25:44.179Z RUNNING Query0
Oct 27, 2018 12:25:44 AM org.apache.beam.runners.dataflow.DataflowPipelineJob
waitUntilFinish
2018-10-27T00:25:44.526Z Waiting for main pipeline to 'finish'
WARNING: No terminal state was returned. State value RUNNING
2018-10-27T00:25:44.551Z RUNNING Query9
Oct 27, 2018 12:25:49 AM org.apache.beam.runners.dataflow.DataflowPipelineJob
waitUntilFinish
2018-10-27T00:25:49.707Z Waiting for main pipeline to 'finish'
WARNING: No terminal state was returned. State value RUNNING
2018-10-27T00:25:49.742Z RUNNING Query3
> Task :beam-sdks-java-nexmark:run FAILED
:beam-sdks-java-nexmark:run (Thread[Task worker for ':' Thread 6,5,main])
completed. Took 4 mins 29.189 secs.
FAILURE: Build failed with an exception.
* What went wrong:
Execution failed for task ':beam-sdks-java-nexmark:run'.
> Process 'command '/usr/local/asfpackages/java/jdk1.8.0_172/bin/java''
> finished with non-zero exit value 1
* Try:
Run with --stacktrace option to get the stack trace. Run with --debug option to
get more log output. Run with --scan to get full insights.
* Get more help at https://help.gradle.org
Deprecated Gradle features were used in this build, making it incompatible with
Gradle 5.0.
Use '--warning-mode all' to show the individual deprecation warnings.
See
https://docs.gradle.org/4.10.2/userguide/command_line_interface.html#sec:command_line_warnings
BUILD FAILED in 7m 39s
68 actionable tasks: 64 executed, 4 from cache
Publishing build scan...
https://gradle.com/s/uq2fq3rpip2ny
Build step 'Invoke Gradle script' changed build result to FAILURE
Build step 'Invoke Gradle script' marked build as failure
---------------------------------------------------------------------
To unsubscribe, e-mail: builds-unsubscr...@beam.apache.org
For additional commands, e-mail: builds-h...@beam.apache.org
