See
<https://ci-beam.apache.org/job/beam_PostCommit_Java_Nexmark_Dataflow/10719/display/redirect>
Changes:
------------------------------------------
[...truncated 1.46 MB...]
2023-10-07T02:42:26.717Z RUNNING BoundedSideInputJoin (waiting for shutdown)
Oct 07, 2023 2:42:26 AM org.apache.beam.sdk.testutils.metrics.MetricsReader
getCounterMetric
SEVERE: Failed to get metric event.elements, from namespace
BoundedSideInputJoin.Events
Oct 07, 2023 2:42:26 AM org.apache.beam.sdk.testutils.metrics.MetricsReader
getCounterMetric
SEVERE: Failed to get metric event.bytes, from namespace
BoundedSideInputJoin.Events
Oct 07, 2023 2:42:26 AM org.apache.beam.sdk.testutils.metrics.MetricsReader
getCounterMetric
SEVERE: Failed to get metric result.elements, from namespace
BoundedSideInputJoin.Results
Oct 07, 2023 2:42:27 AM org.apache.beam.sdk.testutils.metrics.MetricsReader
getCounterMetric
SEVERE: Failed to get metric result.bytes, from namespace
BoundedSideInputJoin.Results
2023-10-07T02:42:27.281Z 0 samples not enough to calculate steady-state event
rate
2023-10-07T02:42:27.282Z no activity
2023-10-07T02:42:42.324Z RUNNING BoundedSideInputJoin (waiting for shutdown)
Oct 07, 2023 2:42:42 AM org.apache.beam.sdk.testutils.metrics.MetricsReader
getCounterMetric
SEVERE: Failed to get metric event.elements, from namespace
BoundedSideInputJoin.Events
Oct 07, 2023 2:42:42 AM org.apache.beam.sdk.testutils.metrics.MetricsReader
getCounterMetric
SEVERE: Failed to get metric event.bytes, from namespace
BoundedSideInputJoin.Events
Oct 07, 2023 2:42:42 AM org.apache.beam.sdk.testutils.metrics.MetricsReader
getCounterMetric
SEVERE: Failed to get metric result.elements, from namespace
BoundedSideInputJoin.Results
Oct 07, 2023 2:42:42 AM org.apache.beam.sdk.testutils.metrics.MetricsReader
getCounterMetric
SEVERE: Failed to get metric result.bytes, from namespace
BoundedSideInputJoin.Results
2023-10-07T02:42:42.892Z 0 samples not enough to calculate steady-state event
rate
2023-10-07T02:42:42.892Z no activity
2023-10-07T02:42:57.934Z RUNNING BoundedSideInputJoin (waiting for shutdown)
Oct 07, 2023 2:42:57 AM org.apache.beam.sdk.testutils.metrics.MetricsReader
getCounterMetric
SEVERE: Failed to get metric event.elements, from namespace
BoundedSideInputJoin.Events
Oct 07, 2023 2:42:58 AM org.apache.beam.sdk.testutils.metrics.MetricsReader
getCounterMetric
SEVERE: Failed to get metric event.bytes, from namespace
BoundedSideInputJoin.Events
Oct 07, 2023 2:42:58 AM org.apache.beam.sdk.testutils.metrics.MetricsReader
getCounterMetric
SEVERE: Failed to get metric result.elements, from namespace
BoundedSideInputJoin.Results
Oct 07, 2023 2:42:58 AM org.apache.beam.sdk.testutils.metrics.MetricsReader
getCounterMetric
SEVERE: Failed to get metric result.bytes, from namespace
BoundedSideInputJoin.Results
2023-10-07T02:42:58.505Z 0 samples not enough to calculate steady-state event
rate
2023-10-07T02:42:58.506Z no activity
2023-10-07T02:43:13.602Z RUNNING BoundedSideInputJoin (waiting for shutdown)
Oct 07, 2023 2:43:13 AM org.apache.beam.sdk.testutils.metrics.MetricsReader
getCounterMetric
SEVERE: Failed to get metric event.elements, from namespace
BoundedSideInputJoin.Events
Oct 07, 2023 2:43:13 AM org.apache.beam.sdk.testutils.metrics.MetricsReader
getCounterMetric
SEVERE: Failed to get metric event.bytes, from namespace
BoundedSideInputJoin.Events
Oct 07, 2023 2:43:14 AM org.apache.beam.sdk.testutils.metrics.MetricsReader
getCounterMetric
SEVERE: Failed to get metric result.elements, from namespace
BoundedSideInputJoin.Results
Oct 07, 2023 2:43:14 AM org.apache.beam.sdk.testutils.metrics.MetricsReader
getCounterMetric
SEVERE: Failed to get metric result.bytes, from namespace
BoundedSideInputJoin.Results
2023-10-07T02:43:14.635Z 0 samples not enough to calculate steady-state event
rate
2023-10-07T02:43:14.635Z no activity
2023-10-07T02:43:29.694Z RUNNING BoundedSideInputJoin (waiting for shutdown)
Oct 07, 2023 2:43:29 AM org.apache.beam.sdk.testutils.metrics.MetricsReader
getCounterMetric
SEVERE: Failed to get metric event.elements, from namespace
BoundedSideInputJoin.Events
Oct 07, 2023 2:43:29 AM org.apache.beam.sdk.testutils.metrics.MetricsReader
getCounterMetric
SEVERE: Failed to get metric event.bytes, from namespace
BoundedSideInputJoin.Events
Oct 07, 2023 2:43:30 AM org.apache.beam.sdk.testutils.metrics.MetricsReader
getCounterMetric
SEVERE: Failed to get metric result.elements, from namespace
BoundedSideInputJoin.Results
Oct 07, 2023 2:43:30 AM org.apache.beam.sdk.testutils.metrics.MetricsReader
getCounterMetric
SEVERE: Failed to get metric result.bytes, from namespace
BoundedSideInputJoin.Results
2023-10-07T02:43:30.330Z 0 samples not enough to calculate steady-state event
rate
2023-10-07T02:43:30.330Z no activity
2023-10-07T02:43:45.381Z RUNNING BoundedSideInputJoin (waiting for shutdown)
Oct 07, 2023 2:43:45 AM org.apache.beam.sdk.testutils.metrics.MetricsReader
getCounterMetric
SEVERE: Failed to get metric event.elements, from namespace
BoundedSideInputJoin.Events
Oct 07, 2023 2:43:45 AM org.apache.beam.sdk.testutils.metrics.MetricsReader
getCounterMetric
SEVERE: Failed to get metric event.bytes, from namespace
BoundedSideInputJoin.Events
Oct 07, 2023 2:43:45 AM org.apache.beam.sdk.testutils.metrics.MetricsReader
getCounterMetric
SEVERE: Failed to get metric result.elements, from namespace
BoundedSideInputJoin.Results
Oct 07, 2023 2:43:45 AM org.apache.beam.sdk.testutils.metrics.MetricsReader
getCounterMetric
SEVERE: Failed to get metric result.bytes, from namespace
BoundedSideInputJoin.Results
2023-10-07T02:43:46.189Z 0 samples not enough to calculate steady-state event
rate
2023-10-07T02:43:46.190Z no activity
2023-10-07T02:44:01.229Z RUNNING BoundedSideInputJoin (waiting for shutdown)
Oct 07, 2023 2:44:01 AM org.apache.beam.sdk.testutils.metrics.MetricsReader
getCounterMetric
SEVERE: Failed to get metric event.elements, from namespace
BoundedSideInputJoin.Events
Oct 07, 2023 2:44:01 AM org.apache.beam.sdk.testutils.metrics.MetricsReader
getCounterMetric
SEVERE: Failed to get metric event.bytes, from namespace
BoundedSideInputJoin.Events
Oct 07, 2023 2:44:01 AM org.apache.beam.sdk.testutils.metrics.MetricsReader
getCounterMetric
SEVERE: Failed to get metric result.elements, from namespace
BoundedSideInputJoin.Results
Oct 07, 2023 2:44:01 AM org.apache.beam.sdk.testutils.metrics.MetricsReader
getCounterMetric
SEVERE: Failed to get metric result.bytes, from namespace
BoundedSideInputJoin.Results
2023-10-07T02:44:01.980Z 0 samples not enough to calculate steady-state event
rate
2023-10-07T02:44:01.980Z no activity
2023-10-07T02:44:17.028Z RUNNING BoundedSideInputJoin (waiting for shutdown)
Oct 07, 2023 2:44:17 AM org.apache.beam.sdk.testutils.metrics.MetricsReader
getCounterMetric
SEVERE: Failed to get metric event.elements, from namespace
BoundedSideInputJoin.Events
Oct 07, 2023 2:44:17 AM org.apache.beam.sdk.testutils.metrics.MetricsReader
getCounterMetric
SEVERE: Failed to get metric event.bytes, from namespace
BoundedSideInputJoin.Events
Oct 07, 2023 2:44:17 AM org.apache.beam.sdk.testutils.metrics.MetricsReader
getCounterMetric
SEVERE: Failed to get metric result.elements, from namespace
BoundedSideInputJoin.Results
Oct 07, 2023 2:44:17 AM org.apache.beam.sdk.testutils.metrics.MetricsReader
getCounterMetric
SEVERE: Failed to get metric result.bytes, from namespace
BoundedSideInputJoin.Results
2023-10-07T02:44:17.618Z 0 samples not enough to calculate steady-state event
rate
2023-10-07T02:44:17.618Z no activity
2023-10-07T02:44:32.667Z RUNNING BoundedSideInputJoin (waiting for shutdown)
Oct 07, 2023 2:44:32 AM org.apache.beam.sdk.testutils.metrics.MetricsReader
getCounterMetric
SEVERE: Failed to get metric event.elements, from namespace
BoundedSideInputJoin.Events
Oct 07, 2023 2:44:32 AM org.apache.beam.sdk.testutils.metrics.MetricsReader
getCounterMetric
SEVERE: Failed to get metric event.bytes, from namespace
BoundedSideInputJoin.Events
Oct 07, 2023 2:44:32 AM org.apache.beam.sdk.testutils.metrics.MetricsReader
getCounterMetric
SEVERE: Failed to get metric result.elements, from namespace
BoundedSideInputJoin.Results
Oct 07, 2023 2:44:32 AM org.apache.beam.sdk.testutils.metrics.MetricsReader
getCounterMetric
SEVERE: Failed to get metric result.bytes, from namespace
BoundedSideInputJoin.Results
2023-10-07T02:44:33.173Z 0 samples not enough to calculate steady-state event
rate
2023-10-07T02:44:33.174Z no activity
2023-10-07T02:44:48.212Z RUNNING BoundedSideInputJoin (waiting for shutdown)
Oct 07, 2023 2:44:48 AM org.apache.beam.sdk.testutils.metrics.MetricsReader
getCounterMetric
SEVERE: Failed to get metric event.elements, from namespace
BoundedSideInputJoin.Events
Oct 07, 2023 2:44:48 AM org.apache.beam.sdk.testutils.metrics.MetricsReader
getCounterMetric
SEVERE: Failed to get metric event.bytes, from namespace
BoundedSideInputJoin.Events
Oct 07, 2023 2:44:48 AM org.apache.beam.sdk.testutils.metrics.MetricsReader
getCounterMetric
SEVERE: Failed to get metric result.elements, from namespace
BoundedSideInputJoin.Results
Oct 07, 2023 2:44:48 AM org.apache.beam.sdk.testutils.metrics.MetricsReader
getCounterMetric
SEVERE: Failed to get metric result.bytes, from namespace
BoundedSideInputJoin.Results
2023-10-07T02:44:48.820Z 0 samples not enough to calculate steady-state event
rate
2023-10-07T02:44:48.820Z no activity
2023-10-07T02:45:03.865Z CANCELLED BoundedSideInputJoin (waiting for shutdown)
Oct 07, 2023 2:45:03 AM org.apache.beam.sdk.testutils.metrics.MetricsReader
getCounterMetric
SEVERE: Failed to get metric event.elements, from namespace
BoundedSideInputJoin.Events
Oct 07, 2023 2:45:03 AM org.apache.beam.sdk.testutils.metrics.MetricsReader
getCounterMetric
SEVERE: Failed to get metric event.bytes, from namespace
BoundedSideInputJoin.Events
Oct 07, 2023 2:45:03 AM org.apache.beam.sdk.testutils.metrics.MetricsReader
getCounterMetric
SEVERE: Failed to get metric result.elements, from namespace
BoundedSideInputJoin.Results
Oct 07, 2023 2:45:03 AM org.apache.beam.sdk.testutils.metrics.MetricsReader
getCounterMetric
SEVERE: Failed to get metric result.bytes, from namespace
BoundedSideInputJoin.Results
2023-10-07T02:45:03.909Z 0 samples not enough to calculate steady-state event
rate
==========================================================================================
Run started 2023-10-07T01:37:29.443Z and ran for PT4054.466S
Default configuration:
{"debug":true,"query":null,"sourceType":"DIRECT","generateEventFilePathPrefix":null,"sinkType":"DEVNULL","exportSummaryToBigQuery":false,"pubSubMode":"COMBINED","pubsubMessageSerializationMethod":"CODER","sideInputType":"DIRECT","sideInputRowCount":500,"sideInputNumShards":3,"sideInputUrl":null,"sessionGap":600000,"numEvents":100000,"numEventGenerators":100,"rateShape":"SINE","firstEventRate":10000,"nextEventRate":10000,"rateUnit":"PER_SECOND","ratePeriodSec":600,"preloadSeconds":0,"streamTimeout":240,"isRateLimited":false,"useWallclockEventTime":false,"avgPersonByteSize":200,"avgAuctionByteSize":500,"avgBidByteSize":100,"hotAuctionRatio":2,"hotSellersRatio":4,"hotBiddersRatio":4,"windowSizeSec":10,"windowPeriodSec":5,"watermarkHoldbackSec":0,"numInFlightAuctions":100,"numActivePeople":1000,"coderStrategy":"HAND","cpuDelayMs":0,"diskBusyBytes":0,"auctionSkip":123,"fanout":5,"maxAuctionsWaitingTime":600,"occasionalDelaySec":3,"probDelayedEvent":0.1,"maxLogEvents":100000,"usePubsubPublishTime":false,"outOfOrderGroupSize":1,"numKeyBuckets":20000,"pardoCPUFactor":1.0}
Configurations:
Conf Description
0000 query:PASSTHROUGH; exportSummaryToBigQuery:true; numEvents:10000000
0001 query:CURRENCY_CONVERSION; exportSummaryToBigQuery:true;
numEvents:10000000
0002 query:SELECTION; exportSummaryToBigQuery:true; numEvents:10000000
0003 query:LOCAL_ITEM_SUGGESTION; exportSummaryToBigQuery:true;
numEvents:10000000
0004 query:AVERAGE_PRICE_FOR_CATEGORY; exportSummaryToBigQuery:true;
numEvents:1000000
0005 query:HOT_ITEMS; exportSummaryToBigQuery:true; numEvents:10000000
0006 query:AVERAGE_SELLING_PRICE_BY_SELLER; exportSummaryToBigQuery:true;
numEvents:1000000
0007 query:HIGHEST_BID; exportSummaryToBigQuery:true; numEvents:10000000
0008 query:MONITOR_NEW_USERS; exportSummaryToBigQuery:true;
numEvents:10000000
0009 query:WINNING_BIDS; exportSummaryToBigQuery:true; numEvents:1000000
0010 query:LOG_TO_SHARDED_FILES; exportSummaryToBigQuery:true;
numEvents:10000000
0011 query:USER_SESSIONS; exportSummaryToBigQuery:true; numEvents:10000000
0012 query:PROCESSING_TIME_WINDOWS; exportSummaryToBigQuery:true;
numEvents:10000000
0013 query:PORTABILITY_BATCH; exportSummaryToBigQuery:true;
numEvents:10000000
0014 query:RESHUFFLE; exportSummaryToBigQuery:true; numEvents:10000000
0015 query:BOUNDED_SIDE_INPUT_JOIN; exportSummaryToBigQuery:true;
numEvents:10000000
0016 query:SESSION_SIDE_INPUT_JOIN; exportSummaryToBigQuery:true;
numEvents:10000000
Performance:
Conf Runtime(sec) (Baseline) Events(/sec) (Baseline) Results
(Baseline)
0000 52.4 190938.1 10000000
0001 14.3 699105.1 9200000
0002 8.7 1151410.5 83527
0003 17.8 562968.0 59507
0004 44.4 22501.7 140
0005 86.3 115931.3 4567
0006 26.6 37596.8 14314
0007 44.7 223894.0 100
0008 32.0 312070.9 92833
0009 26.7 37508.0 32548
0010 92.6 107996.0 100
0011 133.6 74871.0 1839657
0012 74.0 135226.5 567856
0013 *** not run ***
0014 62.0 161199.3 10000000
0015 -1.0 -1.0 -1
*** Cancelling streaming job since it appeared stuck for 60 min. ***
0016 116.2 86051.9 9200000
==========================================================================================
==========================================================================================
Run started 2023-10-07T01:37:29.443Z and ran for PT4054.719S
Default configuration:
{"debug":true,"query":null,"sourceType":"DIRECT","generateEventFilePathPrefix":null,"sinkType":"DEVNULL","exportSummaryToBigQuery":false,"pubSubMode":"COMBINED","pubsubMessageSerializationMethod":"CODER","sideInputType":"DIRECT","sideInputRowCount":500,"sideInputNumShards":3,"sideInputUrl":null,"sessionGap":600000,"numEvents":100000,"numEventGenerators":100,"rateShape":"SINE","firstEventRate":10000,"nextEventRate":10000,"rateUnit":"PER_SECOND","ratePeriodSec":600,"preloadSeconds":0,"streamTimeout":240,"isRateLimited":false,"useWallclockEventTime":false,"avgPersonByteSize":200,"avgAuctionByteSize":500,"avgBidByteSize":100,"hotAuctionRatio":2,"hotSellersRatio":4,"hotBiddersRatio":4,"windowSizeSec":10,"windowPeriodSec":5,"watermarkHoldbackSec":0,"numInFlightAuctions":100,"numActivePeople":1000,"coderStrategy":"HAND","cpuDelayMs":0,"diskBusyBytes":0,"auctionSkip":123,"fanout":5,"maxAuctionsWaitingTime":600,"occasionalDelaySec":3,"probDelayedEvent":0.1,"maxLogEvents":100000,"usePubsubPublishTime":false,"outOfOrderGroupSize":1,"numKeyBuckets":20000,"pardoCPUFactor":1.0}
Configurations:
Conf Description
0000 query:PASSTHROUGH; exportSummaryToBigQuery:true; numEvents:10000000
0001 query:CURRENCY_CONVERSION; exportSummaryToBigQuery:true;
numEvents:10000000
0002 query:SELECTION; exportSummaryToBigQuery:true; numEvents:10000000
0003 query:LOCAL_ITEM_SUGGESTION; exportSummaryToBigQuery:true;
numEvents:10000000
0004 query:AVERAGE_PRICE_FOR_CATEGORY; exportSummaryToBigQuery:true;
numEvents:1000000
0005 query:HOT_ITEMS; exportSummaryToBigQuery:true; numEvents:10000000
0006 query:AVERAGE_SELLING_PRICE_BY_SELLER; exportSummaryToBigQuery:true;
numEvents:1000000
0007 query:HIGHEST_BID; exportSummaryToBigQuery:true; numEvents:10000000
0008 query:MONITOR_NEW_USERS; exportSummaryToBigQuery:true;
numEvents:10000000
0009 query:WINNING_BIDS; exportSummaryToBigQuery:true; numEvents:1000000
0010 query:LOG_TO_SHARDED_FILES; exportSummaryToBigQuery:true;
numEvents:10000000
0011 query:USER_SESSIONS; exportSummaryToBigQuery:true; numEvents:10000000
0012 query:PROCESSING_TIME_WINDOWS; exportSummaryToBigQuery:true;
numEvents:10000000
0013 query:PORTABILITY_BATCH; exportSummaryToBigQuery:true;
numEvents:10000000
0014 query:RESHUFFLE; exportSummaryToBigQuery:true; numEvents:10000000
0015 query:BOUNDED_SIDE_INPUT_JOIN; exportSummaryToBigQuery:true;
numEvents:10000000
0016 query:SESSION_SIDE_INPUT_JOIN; exportSummaryToBigQuery:true;
numEvents:10000000
Performance:
Conf Runtime(sec) (Baseline) Events(/sec) (Baseline) Results
(Baseline)
0000 52.4 190938.1 10000000
0001 14.3 699105.1 9200000
0002 8.7 1151410.5 83527
0003 17.8 562968.0 59507
0004 44.4 22501.7 140
0005 86.3 115931.3 4567
0006 26.6 37596.8 14314
0007 44.7 223894.0 100
0008 32.0 312070.9 92833
0009 26.7 37508.0 32548
0010 92.6 107996.0 100
0011 133.6 74871.0 1839657
0012 74.0 135226.5 567856
0013 *** not run ***
0014 62.0 161199.3 10000000
0015 -1.0 -1.0 -1
*** Cancelling streaming job since it appeared stuck for 60 min. ***
0016 116.2 86051.9 9200000
==========================================================================================
Exception in thread "main" java.lang.RuntimeException: Execution was not
successful
at org.apache.beam.sdk.nexmark.Main.runAll(Main.java:169)
at org.apache.beam.sdk.nexmark.Main.main(Main.java:441)
> Task :sdks:java:testing:nexmark:run FAILED
FAILURE: Build failed with an exception.
* What went wrong:
Execution failed for task ':sdks:java:testing:nexmark:run'.
> Process 'command '/usr/lib/jvm/java-8-openjdk-amd64/bin/java'' finished with
> non-zero exit value 1
* Try:
> Run with --stacktrace option to get the stack trace.
> Run with --info or --debug option to get more log output.
> Get more help at https://help.gradle.org.
Deprecated Gradle features were used in this build, making it incompatible with
Gradle 9.0.
You can use '--warning-mode all' to show the individual deprecation warnings
and determine if they come from your own scripts or plugins.
For more on this, please refer to
https://docs.gradle.org/8.3/userguide/command_line_interface.html#sec:command_line_warnings
in the Gradle documentation.
BUILD FAILED in 1h 8m 3s
130 actionable tasks: 2 executed, 128 up-to-date
Publishing build scan...
https://ge.apache.org/s/p4qoyk4m52ro6
Build step 'Invoke Gradle script' changed build result to FAILURE
Build step 'Invoke Gradle script' marked build as failure
---------------------------------------------------------------------
To unsubscribe, e-mail: [email protected]
For additional commands, e-mail: [email protected]
