See 
<https://builds.apache.org/job/beam_PostCommit_Java_Nexmark_Dataflow/827/display/redirect?page=changes>

Changes:

[lukasz.gajowy] [BEAM-5716] Move nexmark to "testing" directory in java sdk

[lukasz.gajowy] [BEAM-5716] Move load-tests code to "testing" directory in java 
sdk

[lukasz.gajowy] [BEAM-5716] Create module for testing utils

[lukasz.gajowy] [BEAM-5716] Extract MetricReader class, test it and use in 
Nexmark code

[lukasz.gajowy] [BEAM-5355] Use MetricsReader in GroupByKeyLoadTest

------------------------------------------
[...truncated 634.01 KB...]
INFO: 2018-10-26T13:10:14.573Z: Executing operation 
Query8/CoGroupByKey/GBK/Close
Oct 26, 2018 1:10:15 PM 
org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-10-26T13:10:14.753Z: Executing operation 
Query8/CoGroupByKey/GBK/Read+Query8/CoGroupByKey/GBK/GroupByWindow+Query8/CoGroupByKey/ConstructCoGbkResultFn+Query8/Query8.Select+Query8/Query8.Forget+Query8/Query8.Debug+Query8/Query8.Stamp+Query8.Format+Query8.DevNull
Oct 26, 2018 1:10:16 PM 
org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-10-26T13:10:14.167Z: Cleaning up.
Oct 26, 2018 1:10:16 PM 
org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-10-26T13:10:14.334Z: Stopping worker pool...
Oct 26, 2018 1:10:21 PM 
org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-10-26T13:10:20.797Z: Cleaning up.
Oct 26, 2018 1:10:21 PM 
org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-10-26T13:10:20.966Z: Stopping worker pool...
Oct 26, 2018 1:10:25 PM 
org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-10-26T13:10:24.884Z: Cleaning up.
Oct 26, 2018 1:10:25 PM 
org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-10-26T13:10:25.036Z: Stopping worker pool...
Oct 26, 2018 1:10:26 PM 
org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-10-26T13:10:24.963Z: Executing operation 
Query11/Count.PerElement/Combine.perKey(Count)/GroupByKey/Close
Oct 26, 2018 1:10:26 PM 
org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-10-26T13:10:25.050Z: Executing operation 
Query11/Count.PerElement/Combine.perKey(Count)/GroupByKey/Read+Query11/Count.PerElement/Combine.perKey(Count)/Combine.GroupedValues+Query11/Query11.ToResult+Query11/Query11.Forget+Query11/Query11.Debug+Query11/Query11.Stamp+Query11.Format+Query11.DevNull
Oct 26, 2018 1:10:33 PM 
org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-10-26T13:10:32.012Z: Executing operation 
Query7/Combine.GloballyAsSingletonView/Combine.globally(MaxLong)/Combine.perKeyWithFanout(MaxLong)/PreCombineHot/GroupByKey/Close
Oct 26, 2018 1:10:33 PM 
org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-10-26T13:10:32.110Z: Executing operation 
Query7/Combine.GloballyAsSingletonView/Combine.globally(MaxLong)/Combine.perKeyWithFanout(MaxLong)/PreCombineHot/GroupByKey/Read+Query7/Combine.GloballyAsSingletonView/Combine.globally(MaxLong)/Combine.perKeyWithFanout(MaxLong)/PreCombineHot/Combine.GroupedValues+Query7/Combine.GloballyAsSingletonView/Combine.globally(MaxLong)/Combine.perKeyWithFanout(MaxLong)/PreCombineHot/Combine.GroupedValues/Extract+Query7/Combine.GloballyAsSingletonView/Combine.globally(MaxLong)/Combine.perKeyWithFanout(MaxLong)/StripNonce/Map+Query7/Combine.GloballyAsSingletonView/Combine.globally(MaxLong)/Combine.perKeyWithFanout(MaxLong)/Window.Remerge/Identity/Map+Query7/Combine.GloballyAsSingletonView/Combine.globally(MaxLong)/Combine.perKeyWithFanout(MaxLong)/PostCombine/GroupByKey+Query7/Combine.GloballyAsSingletonView/Combine.globally(MaxLong)/Combine.perKeyWithFanout(MaxLong)/PostCombine/Combine.GroupedValues/Partial+Query7/Combine.GloballyAsSingletonView/Combine.globally(MaxLong)/Combine.perKeyWithFanout(MaxLong)/PostCombine/GroupByKey/Reify+Query7/Combine.GloballyAsSingletonView/Combine.globally(MaxLong)/Combine.perKeyWithFanout(MaxLong)/PostCombine/GroupByKey/Write
Oct 26, 2018 1:10:33 PM 
org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-10-26T13:10:30.999Z: Cleaning up.
Oct 26, 2018 1:10:33 PM 
org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-10-26T13:10:31.101Z: Stopping worker pool...
Oct 26, 2018 1:10:34 PM 
org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-10-26T13:10:32.002Z: Executing operation 
Query4/Query4.WinningBids/CoGroupByKey/GBK/Close
Oct 26, 2018 1:10:34 PM 
org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-10-26T13:10:32.109Z: Executing operation 
Query4/Query4.WinningBids/CoGroupByKey/GBK/Read+Query4/Query4.WinningBids/CoGroupByKey/GBK/GroupByWindow+Query4/Query4.WinningBids/CoGroupByKey/ConstructCoGbkResultFn+Query4/Query4.WinningBids/Query4.WinningBids.Join+Query4/Query4.WinningBidsMonitor+Query4/Query4.Rekey+Query4/Window.Into()/Window.Assign+Query4/Combine.perKeyWithFanout(Mean)/AddNonce+Query4/Combine.perKeyWithFanout(Mean)/PrepareCold/Map+Query4/Combine.perKeyWithFanout(Mean)/PostCombine/GroupByKey/Reify+Query4/Combine.perKeyWithFanout(Mean)/PostCombine/GroupByKey/Write+Query4/Combine.perKeyWithFanout(Mean)/PreCombineHot/GroupByKey/Reify+Query4/Combine.perKeyWithFanout(Mean)/PreCombineHot/GroupByKey/Write
Oct 26, 2018 1:10:34 PM 
org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-10-26T13:10:33.680Z: Executing operation 
Query7/Combine.GloballyAsSingletonView/Combine.globally(MaxLong)/Combine.perKeyWithFanout(MaxLong)/PostCombine/GroupByKey/Close
Oct 26, 2018 1:10:34 PM 
org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-10-26T13:10:33.786Z: Executing operation 
Query7/Combine.GloballyAsSingletonView/Combine.globally(MaxLong)/Combine.perKeyWithFanout(MaxLong)/PostCombine/GroupByKey/Read+Query7/Combine.GloballyAsSingletonView/Combine.globally(MaxLong)/Combine.perKeyWithFanout(MaxLong)/PostCombine/Combine.GroupedValues+Query7/Combine.GloballyAsSingletonView/Combine.globally(MaxLong)/Combine.perKeyWithFanout(MaxLong)/PostCombine/Combine.GroupedValues/Extract+Query7/Combine.GloballyAsSingletonView/Combine.globally(MaxLong)/Values/Values/Map+Query7/Combine.GloballyAsSingletonView/BatchViewOverrides.GroupByWindowHashAsKeyAndWindowAsSortKey/ParDo(UseWindowHashAsKeyAndWindowAsSortKey)+Query7/Combine.GloballyAsSingletonView/BatchViewOverrides.GroupByWindowHashAsKeyAndWindowAsSortKey/BatchViewOverrides.GroupByKeyAndSortValuesOnly/Write
Oct 26, 2018 1:10:36 PM 
org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-10-26T13:10:35.502Z: Executing operation 
Query6/Query6.WinningBids/CoGroupByKey/GBK/Close
Oct 26, 2018 1:10:36 PM 
org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-10-26T13:10:35.591Z: Executing operation 
Query6/Query6.WinningBids/CoGroupByKey/GBK/Read+Query6/Query6.WinningBids/CoGroupByKey/GBK/GroupByWindow+Query6/Query6.WinningBids/CoGroupByKey/ConstructCoGbkResultFn+Query6/Query6.WinningBids/Query6.WinningBids.Join+Query6/Query6.Rekey+Query6/Window.Into()/Window.Assign+Query6/Combine.perKey(MovingMeanSellingPrice)/GroupByKey+Query6/Combine.perKey(MovingMeanSellingPrice)/Combine.GroupedValues/Partial+Query6/Combine.perKey(MovingMeanSellingPrice)/GroupByKey/Reify+Query6/Combine.perKey(MovingMeanSellingPrice)/GroupByKey/Write
Oct 26, 2018 1:10:37 PM 
org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-10-26T13:10:35.050Z: Executing operation 
Query7/Combine.GloballyAsSingletonView/BatchViewOverrides.GroupByWindowHashAsKeyAndWindowAsSortKey/BatchViewOverrides.GroupByKeyAndSortValuesOnly/Close
Oct 26, 2018 1:10:37 PM 
org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-10-26T13:10:35.160Z: Executing operation 
Query7/Combine.GloballyAsSingletonView/BatchViewOverrides.GroupByWindowHashAsKeyAndWindowAsSortKey/BatchViewOverrides.GroupByKeyAndSortValuesOnly/Read+Query7/Combine.GloballyAsSingletonView/ParDo(IsmRecordForSingularValuePerWindow)
Oct 26, 2018 1:10:41 PM 
org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-10-26T13:10:39.691Z: Executing operation 
Query7/Combine.GloballyAsSingletonView/CreateDataflowView
Oct 26, 2018 1:10:41 PM 
org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-10-26T13:10:39.911Z: Executing operation 
Query7/Query7.Select+Query7/Query7.Forget+Query7/Query7.Debug+Query7/Query7.Stamp+Query7.Format+Query7.DevNull
Oct 26, 2018 1:10:41 PM 
org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-10-26T13:10:41.543Z: Executing operation 
Query3/CoGroupByKey/GBK/Close
Oct 26, 2018 1:10:41 PM 
org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-10-26T13:10:41.630Z: Executing operation 
Query3/CoGroupByKey/GBK/Read+Query3/CoGroupByKey/GBK/GroupByWindow+Query3/CoGroupByKey/ConstructCoGbkResultFn+Query3/Query3.Join/BatchStatefulParDoOverrides.GbkBeforeStatefulParDo/ReifyWindows+Query3/Query3.Join/BatchStatefulParDoOverrides.GbkBeforeStatefulParDo/PartitionKeys/Write
Oct 26, 2018 1:10:45 PM 
org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-10-26T13:10:43.889Z: Cleaning up.
Oct 26, 2018 1:10:45 PM 
org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-10-26T13:10:43.973Z: Stopping worker pool...
Oct 26, 2018 1:10:49 PM 
org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-10-26T13:10:47.767Z: Executing operation 
Query3/Query3.Join/BatchStatefulParDoOverrides.GbkBeforeStatefulParDo/PartitionKeys/Close
Oct 26, 2018 1:10:49 PM 
org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-10-26T13:10:47.876Z: Executing operation 
Query3/Query3.Join/BatchStatefulParDoOverrides.GbkBeforeStatefulParDo/PartitionKeys/Read+Query3/Query3.Join/ParDo(BatchStateful)+Query3/Query3.Project+Query3/Query3.Forget+Query3/Query3.Debug+Query3/Query3.Stamp+Query3.Format+Query3.DevNull
Oct 26, 2018 1:10:50 PM 
org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-10-26T13:10:48.725Z: Executing operation 
Query4/Combine.perKeyWithFanout(Mean)/PreCombineHot/GroupByKey/Close
Oct 26, 2018 1:10:50 PM 
org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-10-26T13:10:48.836Z: Executing operation 
Query4/Combine.perKeyWithFanout(Mean)/PreCombineHot/GroupByKey/Read+Query4/Combine.perKeyWithFanout(Mean)/PreCombineHot/Combine.GroupedValues+Query4/Combine.perKeyWithFanout(Mean)/StripNonce/Map+Query4/Combine.perKeyWithFanout(Mean)/Window.Remerge/Identity/Map+Query4/Combine.perKeyWithFanout(Mean)/PostCombine/GroupByKey/Reify+Query4/Combine.perKeyWithFanout(Mean)/PostCombine/GroupByKey/Write
Oct 26, 2018 1:10:51 PM 
org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-10-26T13:10:51.354Z: Executing operation 
Query6/Combine.perKey(MovingMeanSellingPrice)/GroupByKey/Close
Oct 26, 2018 1:10:51 PM 
org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-10-26T13:10:50.333Z: Executing operation 
Query4/Combine.perKeyWithFanout(Mean)/PostCombine/GroupByKey/Close
Oct 26, 2018 1:10:51 PM 
org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-10-26T13:10:50.431Z: Executing operation 
Query4/Combine.perKeyWithFanout(Mean)/PostCombine/GroupByKey/Read+Query4/Combine.perKeyWithFanout(Mean)/PostCombine/Combine.GroupedValues+Query4/Query4.Project+Query4/Query4.Forget+Query4/Query4.Debug+Query4/Query4.Stamp+Query4.Format+Query4.DevNull
Oct 26, 2018 1:10:53 PM 
org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-10-26T13:10:52.933Z: Cleaning up.
Oct 26, 2018 1:10:53 PM 
org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-10-26T13:10:53.041Z: Stopping worker pool...
Oct 26, 2018 1:10:53 PM 
org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-10-26T13:10:51.456Z: Executing operation 
Query6/Combine.perKey(MovingMeanSellingPrice)/GroupByKey/Read+Query6/Combine.perKey(MovingMeanSellingPrice)/Combine.GroupedValues+Query6/Combine.perKey(MovingMeanSellingPrice)/Combine.GroupedValues/Extract+Query6/Query6.Select+Query6/Query6.Forget+Query6/Query6.Debug+Query6/Query6.Stamp+Query6.Format+Query6.DevNull
Oct 26, 2018 1:10:54 PM 
org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-10-26T13:10:52.252Z: Cleaning up.
Oct 26, 2018 1:10:54 PM 
org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-10-26T13:10:52.349Z: Stopping worker pool...
Oct 26, 2018 1:10:55 PM 
org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-10-26T13:10:54.526Z: Cleaning up.
Oct 26, 2018 1:10:55 PM 
org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-10-26T13:10:54.639Z: Stopping worker pool...
Oct 26, 2018 1:10:57 PM 
org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-10-26T13:10:56.506Z: Executing operation 
Query5/Count.PerElement/Combine.perKey(Count)/GroupByKey/Close
Oct 26, 2018 1:10:57 PM 
org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-10-26T13:10:56.599Z: Executing operation 
Query5/Count.PerElement/Combine.perKey(Count)/GroupByKey/Read+Query5/Count.PerElement/Combine.perKey(Count)/Combine.GroupedValues+Query5/Query5.ToSingletons+Query5/Combine.globally(Anonymous)/WithKeys/AddKeys/Map+Query5/Combine.globally(Anonymous)/Combine.perKeyWithFanout(Anonymous)/AddNonce+Query5/Combine.globally(Anonymous)/Combine.perKeyWithFanout(Anonymous)/PrepareCold/Map+Query5/Combine.globally(Anonymous)/Combine.perKeyWithFanout(Anonymous)/PostCombine/GroupByKey/Reify+Query5/Combine.globally(Anonymous)/Combine.perKeyWithFanout(Anonymous)/PostCombine/GroupByKey/Write+Query5/Combine.globally(Anonymous)/Combine.perKeyWithFanout(Anonymous)/PreCombineHot/GroupByKey/Reify+Query5/Combine.globally(Anonymous)/Combine.perKeyWithFanout(Anonymous)/PreCombineHot/GroupByKey/Write
Oct 26, 2018 1:11:07 PM 
org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-10-26T13:11:07.534Z: Cleaning up.
Oct 26, 2018 1:11:07 PM 
org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-10-26T13:11:07.636Z: Stopping worker pool...
Oct 26, 2018 1:11:16 PM 
org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-10-26T13:11:14.723Z: Executing operation 
Query5/Combine.globally(Anonymous)/Combine.perKeyWithFanout(Anonymous)/PreCombineHot/GroupByKey/Close
Oct 26, 2018 1:11:16 PM 
org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-10-26T13:11:14.811Z: Executing operation 
Query5/Combine.globally(Anonymous)/Combine.perKeyWithFanout(Anonymous)/PreCombineHot/GroupByKey/Read+Query5/Combine.globally(Anonymous)/Combine.perKeyWithFanout(Anonymous)/PreCombineHot/Combine.GroupedValues+Query5/Combine.globally(Anonymous)/Combine.perKeyWithFanout(Anonymous)/StripNonce/Map+Query5/Combine.globally(Anonymous)/Combine.perKeyWithFanout(Anonymous)/Window.Remerge/Identity/Map+Query5/Combine.globally(Anonymous)/Combine.perKeyWithFanout(Anonymous)/PostCombine/GroupByKey/Reify+Query5/Combine.globally(Anonymous)/Combine.perKeyWithFanout(Anonymous)/PostCombine/GroupByKey/Write
Oct 26, 2018 1:11:20 PM 
org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-10-26T13:11:19.155Z: Executing operation 
Query5/Combine.globally(Anonymous)/Combine.perKeyWithFanout(Anonymous)/PostCombine/GroupByKey/Close
Oct 26, 2018 1:11:20 PM 
org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-10-26T13:11:19.277Z: Executing operation 
Query5/Combine.globally(Anonymous)/Combine.perKeyWithFanout(Anonymous)/PostCombine/GroupByKey/Read+Query5/Combine.globally(Anonymous)/Combine.perKeyWithFanout(Anonymous)/PostCombine/Combine.GroupedValues+Query5/Combine.globally(Anonymous)/Values/Values/Map+Query5/Query5.Select+Query5/Query5.Forget+Query5/Query5.Debug+Query5/Query5.Stamp+Query5.Format+Query5.DevNull
Oct 26, 2018 1:11:21 PM 
org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-10-26T13:11:21.627Z: Cleaning up.
Oct 26, 2018 1:11:21 PM 
org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-10-26T13:11:21.738Z: Stopping worker pool...
Oct 26, 2018 1:11:24 PM 
org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-10-26T13:11:22.963Z: Executing operation 
Query10/Query10.GroupByKey/Close
Oct 26, 2018 1:11:24 PM 
org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-10-26T13:11:23.057Z: Executing operation 
Query10/Query10.GroupByKey/Read+Query10/Query10.GroupByKey/GroupByWindow+Query10/Query10.CheckForLateEvents+Query10/Query10.UploadEvents+Query10/Query10.WindowLogFiles/Window.Assign+Query10/Query10.GroupByKey2/Reify+Query10/Query10.GroupByKey2/Write
Oct 26, 2018 1:11:57 PM org.apache.beam.runners.dataflow.DataflowPipelineJob 
waitUntilFinish
2018-10-26T13:11:57.329Z Waiting for main pipeline to 'finish'
WARNING: No terminal state was returned. State value RUNNING
Oct 26, 2018 1:11:57 PM org.apache.beam.runners.dataflow.DataflowPipelineJob 
waitUntilFinish
2018-10-26T13:11:57.347Z Waiting for main pipeline to 'finish'
WARNING: No terminal state was returned. State value RUNNING
Oct 26, 2018 1:11:57 PM org.apache.beam.runners.dataflow.DataflowPipelineJob 
waitUntilFinish
2018-10-26T13:11:57.349Z Waiting for main pipeline to 'finish'
WARNING: No terminal state was returned. State value RUNNING
2018-10-26T13:11:57.358Z RUNNING Query10
2018-10-26T13:11:57.381Z RUNNING Query4
2018-10-26T13:11:57.390Z RUNNING Query2

==========================================================================================
Run started 2018-10-26T13:07:44.449Z and ran for PT253.075S

Exception in thread "main" Default configuration:
java.lang.RuntimeException: java.lang.NoClassDefFoundError: 
org/apache/beam/repackaged/beam_sdks_java_test_utils/com/google/common/collect/Iterables
        at org.apache.beam.sdk.nexmark.Main.runAll(Main.java:144)
        at org.apache.beam.sdk.nexmark.Main.main(Main.java:477)
{"debug":true,"query":0,"sourceType":"DIRECT","sinkType":"DEVNULL","exportSummaryToBigQuery":false,"pubSubMode":"COMBINED","numEvents":100000,"numEventGenerators":100,"rateShape":"SINE","firstEventRate":10000,"nextEventRate":10000,"rateUnit":"PER_SECOND","ratePeriodSec":600,"preloadSeconds":0,"streamTimeout":240,"isRateLimited":false,"useWallclockEventTime":false,"avgPersonByteSize":200,"avgAuctionByteSize":500,"avgBidByteSize":100,"hotAuctionRatio":2,"hotSellersRatio":4,"hotBiddersRatio":4,"windowSizeSec":10,"windowPeriodSec":5,"watermarkHoldbackSec":0,"numInFlightAuctions":100,"numActivePeople":1000,"coderStrategy":"HAND","cpuDelayMs":0,"diskBusyBytes":0,"auctionSkip":123,"fanout":5,"maxAuctionsWaitingTime":600,"occasionalDelaySec":3,"probDelayedEvent":0.1,"maxLogEvents":100000,"usePubsubPublishTime":false,"outOfOrderGroupSize":1}

Configurations:
  Conf  Description
  0000  query:0; exportSummaryToBigQuery:true; numEvents:10000000
  0001  query:1; exportSummaryToBigQuery:true; numEvents:10000000
  0002  query:2; exportSummaryToBigQuery:true; numEvents:10000000
  0003  query:3; exportSummaryToBigQuery:true; numEvents:10000000
  0004  query:4; exportSummaryToBigQuery:true; numEvents:1000000
  0005  query:5; exportSummaryToBigQuery:true; numEvents:10000000
  0006  query:6; exportSummaryToBigQuery:true; numEvents:1000000
  0007  query:7; exportSummaryToBigQuery:true; numEvents:10000000
  0008  query:8; exportSummaryToBigQuery:true; numEvents:10000000
  0009  query:9; exportSummaryToBigQuery:true; numEvents:1000000
  0010  query:10; exportSummaryToBigQuery:true; numEvents:10000000
  0011  query:11; exportSummaryToBigQuery:true; numEvents:10000000
  0012  query:12; exportSummaryToBigQuery:true; numEvents:10000000

Performance:
  Conf  Runtime(sec)    (Baseline)  Events(/sec)    (Baseline)       Results    
(Baseline)
  0000  *** not run ***
  0001  *** not run ***
  0002  *** not run ***
  0003  *** not run ***
  0004  *** not run ***
  0005  *** not run ***
  0006  *** not run ***
  0007  *** not run ***
  0008  *** not run ***
  0009  *** not run ***
  0010  *** not run ***
  0011  *** not run ***
  0012  *** not run ***
==========================================================================================

Caused by: java.lang.NoClassDefFoundError: 
org/apache/beam/repackaged/beam_sdks_java_test_utils/com/google/common/collect/Iterables
        at 
org.apache.beam.sdk.testutils.metrics.MetricsReader.checkIfMetricResultIsUnique(MetricsReader.java:128)
        at 
org.apache.beam.sdk.testutils.metrics.MetricsReader.getCounterMetric(MetricsReader.java:65)
        at 
org.apache.beam.sdk.nexmark.NexmarkLauncher.currentPerf(NexmarkLauncher.java:250)
        at 
org.apache.beam.sdk.nexmark.NexmarkLauncher.monitor(NexmarkLauncher.java:435)
        at 
org.apache.beam.sdk.nexmark.NexmarkLauncher.run(NexmarkLauncher.java:1156)
        at org.apache.beam.sdk.nexmark.Main$Run.call(Main.java:108)
        at org.apache.beam.sdk.nexmark.Main$Run.call(Main.java:96)
        at java.util.concurrent.FutureTask.run(FutureTask.java:266)
        at 
java.util.concurrent.Executors$RunnableAdapter.call(Executors.java:511)
        at java.util.concurrent.FutureTask.run(FutureTask.java:266)
        at 
java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1149)
        at 
java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624)
        at java.lang.Thread.run(Thread.java:748)
Caused by: java.lang.ClassNotFoundException: 
org.apache.beam.repackaged.beam_sdks_java_test_utils.com.google.common.collect.Iterables
        at java.net.URLClassLoader.findClass(URLClassLoader.java:381)
        at java.lang.ClassLoader.loadClass(ClassLoader.java:424)
        at sun.misc.Launcher$AppClassLoader.loadClass(Launcher.java:349)
        at java.lang.ClassLoader.loadClass(ClassLoader.java:357)
        ... 13 more
Oct 26, 2018 1:11:57 PM org.apache.beam.runners.dataflow.DataflowPipelineJob 
waitUntilFinish
2018-10-26T13:11:57.835Z Waiting for main pipeline to 'finish'
WARNING: No terminal state was returned. State value RUNNING
2018-10-26T13:11:57.875Z RUNNING Query9
Oct 26, 2018 1:12:01 PM org.apache.beam.runners.dataflow.DataflowPipelineJob 
waitUntilFinish
2018-10-26T13:12:01.675Z Waiting for main pipeline to 'finish'
WARNING: No terminal state was returned. State value RUNNING
2018-10-26T13:12:01.702Z RUNNING Query5
Oct 26, 2018 1:12:04 PM org.apache.beam.runners.dataflow.DataflowPipelineJob 
waitUntilFinish
2018-10-26T13:12:04.540Z Waiting for main pipeline to 'finish'
WARNING: No terminal state was returned. State value RUNNING
2018-10-26T13:12:04.578Z RUNNING Query0
Oct 26, 2018 1:12:04 PM org.apache.beam.runners.dataflow.DataflowPipelineJob 
waitUntilFinish
2018-10-26T13:12:04.890Z Waiting for main pipeline to 'finish'
WARNING: No terminal state was returned. State value RUNNING
2018-10-26T13:12:04.923Z RUNNING Query7
Oct 26, 2018 1:12:05 PM org.apache.beam.runners.dataflow.DataflowPipelineJob 
waitUntilFinish
2018-10-26T13:12:05.655Z Waiting for main pipeline to 'finish'
WARNING: No terminal state was returned. State value RUNNING
2018-10-26T13:12:05.691Z RUNNING Query6
Oct 26, 2018 1:12:08 PM org.apache.beam.runners.dataflow.DataflowPipelineJob 
waitUntilFinish
WARNING: No terminal state was returned. State value RUNNING
2018-10-26T13:12:08.799Z Waiting for main pipeline to 'finish'
2018-10-26T13:12:08.829Z RUNNING Query3
Oct 26, 2018 1:12:09 PM org.apache.beam.runners.dataflow.DataflowPipelineJob 
waitUntilFinish
2018-10-26T13:12:09.031Z Waiting for main pipeline to 'finish'
WARNING: No terminal state was returned. State value RUNNING
2018-10-26T13:12:09.066Z RUNNING Query1
Oct 26, 2018 1:12:09 PM org.apache.beam.runners.dataflow.DataflowPipelineJob 
waitUntilFinish
2018-10-26T13:12:09.889Z Waiting for main pipeline to 'finish'
WARNING: No terminal state was returned. State value RUNNING
2018-10-26T13:12:09.927Z RUNNING Query8
Oct 26, 2018 1:12:10 PM org.apache.beam.runners.dataflow.DataflowPipelineJob 
waitUntilFinish
2018-10-26T13:12:10.481Z Waiting for main pipeline to 'finish'
WARNING: No terminal state was returned. State value RUNNING
2018-10-26T13:12:10.512Z RUNNING Query11
Oct 26, 2018 1:12:11 PM org.apache.beam.runners.dataflow.DataflowPipelineJob 
waitUntilFinish
2018-10-26T13:12:11.213Z Waiting for main pipeline to 'finish'
WARNING: No terminal state was returned. State value RUNNING
2018-10-26T13:12:11.247Z RUNNING Query12

> Task :beam-sdks-java-nexmark:run FAILED
:beam-sdks-java-nexmark:run (Thread[Daemon worker,5,main]) completed. Took 4 
mins 27.704 secs.

FAILURE: Build failed with an exception.

* What went wrong:
Execution failed for task ':beam-sdks-java-nexmark:run'.
> Process 'command '/usr/local/asfpackages/java/jdk1.8.0_172/bin/java'' 
> finished with non-zero exit value 1

* Try:
Run with --stacktrace option to get the stack trace. Run with --debug option to 
get more log output. Run with --scan to get full insights.

* Get more help at https://help.gradle.org

Deprecated Gradle features were used in this build, making it incompatible with 
Gradle 5.0.
Use '--warning-mode all' to show the individual deprecation warnings.
See 
https://docs.gradle.org/4.10.2/userguide/command_line_interface.html#sec:command_line_warnings

BUILD FAILED in 7m 29s
68 actionable tasks: 64 executed, 4 from cache

Publishing build scan...
https://gradle.com/s/fnfc33q3iv7xo

Build step 'Invoke Gradle script' changed build result to FAILURE
Build step 'Invoke Gradle script' marked build as failure

---------------------------------------------------------------------
To unsubscribe, e-mail: builds-unsubscr...@beam.apache.org
For additional commands, e-mail: builds-h...@beam.apache.org

Reply via email to