See
<https://ci-beam.apache.org/job/beam_PostCommit_Java_Nexmark_Dataflow_V2_Java11/1323/display/redirect>
Changes:
------------------------------------------
[...truncated 709.17 KB...]
2022-04-23T19:52:34.288Z 6 samples not enough to calculate steady-state event
rate
2022-04-23T19:52:34.288Z no activity
2022-04-23T19:52:49.337Z RUNNING Query7 (waiting for shutdown)
2022-04-23T19:52:50.775Z 6 samples not enough to calculate steady-state event
rate
2022-04-23T19:52:50.775Z no activity
2022-04-23T19:53:05.808Z RUNNING Query7 (waiting for shutdown)
2022-04-23T19:53:07.251Z 6 samples not enough to calculate steady-state event
rate
2022-04-23T19:53:07.251Z no activity
2022-04-23T19:53:22.297Z RUNNING Query7 (waiting for shutdown)
2022-04-23T19:53:23.948Z 6 samples not enough to calculate steady-state event
rate
2022-04-23T19:53:23.948Z no activity
2022-04-23T19:53:38.977Z RUNNING Query7 (waiting for shutdown)
2022-04-23T19:53:39.957Z 6 samples not enough to calculate steady-state event
rate
2022-04-23T19:53:39.958Z no activity
2022-04-23T19:53:54.997Z RUNNING Query7 (waiting for shutdown)
2022-04-23T19:53:55.950Z 6 samples not enough to calculate steady-state event
rate
2022-04-23T19:53:55.950Z no activity
2022-04-23T19:54:10.989Z RUNNING Query7 (waiting for shutdown)
2022-04-23T19:54:11.816Z 6 samples not enough to calculate steady-state event
rate
2022-04-23T19:54:11.816Z no activity
2022-04-23T19:54:26.853Z RUNNING Query7 (waiting for shutdown)
2022-04-23T19:54:27.656Z 6 samples not enough to calculate steady-state event
rate
2022-04-23T19:54:27.656Z no activity
2022-04-23T19:54:42.696Z RUNNING Query7 (waiting for shutdown)
2022-04-23T19:54:43.639Z 6 samples not enough to calculate steady-state event
rate
2022-04-23T19:54:43.639Z no activity
2022-04-23T19:54:58.676Z RUNNING Query7 (waiting for shutdown)
2022-04-23T19:54:59.587Z 6 samples not enough to calculate steady-state event
rate
2022-04-23T19:54:59.587Z no activity
2022-04-23T19:55:14.629Z RUNNING Query7 (waiting for shutdown)
2022-04-23T19:55:15.536Z 6 samples not enough to calculate steady-state event
rate
2022-04-23T19:55:15.536Z no activity
2022-04-23T19:55:30.581Z RUNNING Query7 (waiting for shutdown)
2022-04-23T19:55:31.540Z 6 samples not enough to calculate steady-state event
rate
2022-04-23T19:55:31.540Z no activity
2022-04-23T19:55:46.576Z RUNNING Query7 (waiting for shutdown)
2022-04-23T19:55:47.515Z 6 samples not enough to calculate steady-state event
rate
2022-04-23T19:55:47.515Z no activity
2022-04-23T19:56:02.554Z RUNNING Query7 (waiting for shutdown)
2022-04-23T19:56:03.387Z 6 samples not enough to calculate steady-state event
rate
2022-04-23T19:56:03.387Z no activity
2022-04-23T19:56:18.429Z RUNNING Query7 (waiting for shutdown)
2022-04-23T19:56:19.294Z 6 samples not enough to calculate steady-state event
rate
2022-04-23T19:56:19.294Z no activity
2022-04-23T19:56:34.325Z RUNNING Query7 (waiting for shutdown)
2022-04-23T19:56:35.655Z 6 samples not enough to calculate steady-state event
rate
2022-04-23T19:56:35.655Z no activity
2022-04-23T19:56:50.691Z RUNNING Query7 (waiting for shutdown)
2022-04-23T19:56:55.736Z 6 samples not enough to calculate steady-state event
rate
2022-04-23T19:56:55.736Z no activity
2022-04-23T19:57:11.032Z RUNNING Query7 (waiting for shutdown)
2022-04-23T19:57:11.924Z 6 samples not enough to calculate steady-state event
rate
2022-04-23T19:57:11.924Z no activity
2022-04-23T19:57:26.988Z RUNNING Query7 (waiting for shutdown)
2022-04-23T19:57:28.687Z 6 samples not enough to calculate steady-state event
rate
2022-04-23T19:57:28.687Z no activity
2022-04-23T19:57:43.725Z RUNNING Query7 (waiting for shutdown)
2022-04-23T19:57:45.071Z 6 samples not enough to calculate steady-state event
rate
2022-04-23T19:57:45.071Z no activity
2022-04-23T19:58:00.178Z RUNNING Query7 (waiting for shutdown)
2022-04-23T19:58:01.625Z 6 samples not enough to calculate steady-state event
rate
2022-04-23T19:58:01.625Z no activity
2022-04-23T19:58:16.676Z RUNNING Query7 (waiting for shutdown)
2022-04-23T19:58:18.571Z 6 samples not enough to calculate steady-state event
rate
2022-04-23T19:58:18.571Z no activity
2022-04-23T19:58:33.609Z RUNNING Query7 (waiting for shutdown)
2022-04-23T19:58:35.089Z 6 samples not enough to calculate steady-state event
rate
2022-04-23T19:58:35.089Z no activity
2022-04-23T19:58:50.201Z RUNNING Query7 (waiting for shutdown)
2022-04-23T19:58:51.825Z 6 samples not enough to calculate steady-state event
rate
2022-04-23T19:58:51.825Z no activity
2022-04-23T19:59:06.866Z RUNNING Query7 (waiting for shutdown)
2022-04-23T19:59:08.002Z 6 samples not enough to calculate steady-state event
rate
2022-04-23T19:59:08.002Z no activity
2022-04-23T19:59:23.032Z RUNNING Query7 (waiting for shutdown)
2022-04-23T19:59:24.076Z 6 samples not enough to calculate steady-state event
rate
2022-04-23T19:59:24.076Z no activity
2022-04-23T19:59:39.121Z RUNNING Query7 (waiting for shutdown)
2022-04-23T19:59:41.223Z 6 samples not enough to calculate steady-state event
rate
2022-04-23T19:59:41.223Z no activity
2022-04-23T19:59:56.265Z RUNNING Query7 (waiting for shutdown)
2022-04-23T19:59:57.053Z 6 samples not enough to calculate steady-state event
rate
2022-04-23T19:59:57.053Z no activity
2022-04-23T20:00:12.099Z RUNNING Query7 (waiting for shutdown)
2022-04-23T20:00:12.956Z 6 samples not enough to calculate steady-state event
rate
2022-04-23T20:00:12.956Z no activity
2022-04-23T20:00:27.999Z RUNNING Query7 (waiting for shutdown)
2022-04-23T20:00:29.015Z 6 samples not enough to calculate steady-state event
rate
2022-04-23T20:00:29.015Z no activity
2022-04-23T20:00:44.063Z RUNNING Query7 (waiting for shutdown)
2022-04-23T20:00:44.963Z 6 samples not enough to calculate steady-state event
rate
2022-04-23T20:00:44.963Z no activity
2022-04-23T20:00:59.993Z RUNNING Query7 (waiting for shutdown)
2022-04-23T20:01:01.135Z 6 samples not enough to calculate steady-state event
rate
2022-04-23T20:01:01.135Z no activity
2022-04-23T20:01:16.213Z RUNNING Query7 (waiting for shutdown)
2022-04-23T20:01:17.000Z 6 samples not enough to calculate steady-state event
rate
2022-04-23T20:01:17.000Z no activity
2022-04-23T20:01:32.064Z RUNNING Query7 (waiting for shutdown)
2022-04-23T20:01:32.967Z 6 samples not enough to calculate steady-state event
rate
2022-04-23T20:01:32.967Z no activity
2022-04-23T20:01:48.016Z CANCELLED Query7 (waiting for shutdown)
2022-04-23T20:01:48.070Z 6 samples not enough to calculate steady-state event
rate
==========================================================================================
Run started 2022-04-23T16:31:23.234Z and ran for PT12624.837S
Default configuration:
{"debug":true,"query":null,"sourceType":"DIRECT","generateEventFilePathPrefix":null,"sinkType":"DEVNULL","exportSummaryToBigQuery":false,"pubSubMode":"COMBINED","pubsubMessageSerializationMethod":"CODER","sideInputType":"DIRECT","sideInputRowCount":500,"sideInputNumShards":3,"sideInputUrl":null,"sessionGap":600000,"numEvents":100000,"numEventGenerators":100,"rateShape":"SINE","firstEventRate":10000,"nextEventRate":10000,"rateUnit":"PER_SECOND","ratePeriodSec":600,"preloadSeconds":0,"streamTimeout":240,"isRateLimited":false,"useWallclockEventTime":false,"avgPersonByteSize":200,"avgAuctionByteSize":500,"avgBidByteSize":100,"hotAuctionRatio":2,"hotSellersRatio":4,"hotBiddersRatio":4,"windowSizeSec":10,"windowPeriodSec":5,"watermarkHoldbackSec":0,"numInFlightAuctions":100,"numActivePeople":1000,"coderStrategy":"HAND","cpuDelayMs":0,"diskBusyBytes":0,"auctionSkip":123,"fanout":5,"maxAuctionsWaitingTime":600,"occasionalDelaySec":3,"probDelayedEvent":0.1,"maxLogEvents":100000,"usePubsubPublishTime":false,"outOfOrderGroupSize":1,"numKeyBuckets":20000,"pardoCPUFactor":1.0}
Configurations:
Conf Description
0000 query:PASSTHROUGH; numEvents:10000000
0001 query:CURRENCY_CONVERSION; numEvents:10000000
0002 query:SELECTION; numEvents:10000000
0003 query:LOCAL_ITEM_SUGGESTION; numEvents:10000000
0004 query:AVERAGE_PRICE_FOR_CATEGORY; numEvents:1000000
0005 query:HOT_ITEMS; numEvents:10000000
0006 query:AVERAGE_SELLING_PRICE_BY_SELLER; numEvents:1000000
0007 query:HIGHEST_BID; numEvents:10000000
0008 query:MONITOR_NEW_USERS; numEvents:10000000
0009 query:WINNING_BIDS; numEvents:1000000
0010 query:LOG_TO_SHARDED_FILES; numEvents:10000000
0011 query:USER_SESSIONS; numEvents:10000000
0012 query:PROCESSING_TIME_WINDOWS; numEvents:10000000
0013 query:PORTABILITY_BATCH; numEvents:10000000
0014 query:RESHUFFLE; numEvents:10000000
0015 query:BOUNDED_SIDE_INPUT_JOIN; numEvents:10000000
0016 query:SESSION_SIDE_INPUT_JOIN; numEvents:10000000
Performance:
Conf Runtime(sec) (Baseline) Events(/sec) (Baseline) Results
(Baseline)
0000 44.0 227427.8 10000000
0001 34.3 291911.1 9200000
0002 30.5 327976.4 83527
0003 49.0 203985.9 59507
0004 *** not run ***
0005 232.6 42989.7 4567
0006 *** not run ***
0007 177.2 56442.3 100
*** Job was unexpectedly cancelled ***
0008 66.2 151082.5 92833
0009 *** not run ***
0010 94.1 106312.9 100
0011 179.4 55754.7 1839657
0012 109.4 91417.7 393072
0013 *** not run ***
0014 100.9 99094.3 10000000
0015 *** not run ***
0016 *** not run ***
==========================================================================================
==========================================================================================
Run started 2022-04-23T16:31:23.234Z and ran for PT12625.068S
Default configuration:
{"debug":true,"query":null,"sourceType":"DIRECT","generateEventFilePathPrefix":null,"sinkType":"DEVNULL","exportSummaryToBigQuery":false,"pubSubMode":"COMBINED","pubsubMessageSerializationMethod":"CODER","sideInputType":"DIRECT","sideInputRowCount":500,"sideInputNumShards":3,"sideInputUrl":null,"sessionGap":600000,"numEvents":100000,"numEventGenerators":100,"rateShape":"SINE","firstEventRate":10000,"nextEventRate":10000,"rateUnit":"PER_SECOND","ratePeriodSec":600,"preloadSeconds":0,"streamTimeout":240,"isRateLimited":false,"useWallclockEventTime":false,"avgPersonByteSize":200,"avgAuctionByteSize":500,"avgBidByteSize":100,"hotAuctionRatio":2,"hotSellersRatio":4,"hotBiddersRatio":4,"windowSizeSec":10,"windowPeriodSec":5,"watermarkHoldbackSec":0,"numInFlightAuctions":100,"numActivePeople":1000,"coderStrategy":"HAND","cpuDelayMs":0,"diskBusyBytes":0,"auctionSkip":123,"fanout":5,"maxAuctionsWaitingTime":600,"occasionalDelaySec":3,"probDelayedEvent":0.1,"maxLogEvents":100000,"usePubsubPublishTime":false,"outOfOrderGroupSize":1,"numKeyBuckets":20000,"pardoCPUFactor":1.0}
Configurations:
Conf Description
0000 query:PASSTHROUGH; numEvents:10000000
0001 query:CURRENCY_CONVERSION; numEvents:10000000
0002 query:SELECTION; numEvents:10000000
0003 query:LOCAL_ITEM_SUGGESTION; numEvents:10000000
0004 query:AVERAGE_PRICE_FOR_CATEGORY; numEvents:1000000
0005 query:HOT_ITEMS; numEvents:10000000
0006 query:AVERAGE_SELLING_PRICE_BY_SELLER; numEvents:1000000
0007 query:HIGHEST_BID; numEvents:10000000
0008 query:MONITOR_NEW_USERS; numEvents:10000000
0009 query:WINNING_BIDS; numEvents:1000000
0010 query:LOG_TO_SHARDED_FILES; numEvents:10000000
0011 query:USER_SESSIONS; numEvents:10000000
0012 query:PROCESSING_TIME_WINDOWS; numEvents:10000000
0013 query:PORTABILITY_BATCH; numEvents:10000000
0014 query:RESHUFFLE; numEvents:10000000
0015 query:BOUNDED_SIDE_INPUT_JOIN; numEvents:10000000
0016 query:SESSION_SIDE_INPUT_JOIN; numEvents:10000000
Performance:
Conf Runtime(sec) (Baseline) Events(/sec) (Baseline) Results
(Baseline)
0000 44.0 227427.8 10000000
0001 34.3 291911.1 9200000
0002 30.5 327976.4 83527
0003 49.0 203985.9 59507
0004 *** not run ***
0005 232.6 42989.7 4567
0006 *** not run ***
0007 177.2 56442.3 100
*** Job was unexpectedly cancelled ***
0008 66.2 151082.5 92833
0009 *** not run ***
0010 94.1 106312.9 100
0011 179.4 55754.7 1839657
0012 109.4 91417.7 393072
0013 *** not run ***
0014 100.9 99094.3 10000000
0015 *** not run ***
0016 *** not run ***
==========================================================================================
Exception in thread "main" java.lang.RuntimeException: Execution was not
successful
at org.apache.beam.sdk.nexmark.Main.runAll(Main.java:176)
at org.apache.beam.sdk.nexmark.Main.main(Main.java:467)
> Task :sdks:java:testing:nexmark:run FAILED
> Task :runners:google-cloud-dataflow-java:cleanUpDockerJavaImages
Untagged: us.gcr.io/apache-beam-testing/java-postcommit-it/java:20220423163046
Untagged:
us.gcr.io/apache-beam-testing/java-postcommit-it/java@sha256:52f4698faf04d71b377557ab828c1ac840c2342f371684ef7828c62c2cc45821
Tag: [us.gcr.io/apache-beam-testing/java-postcommit-it/java:20220423163046]
- referencing digest:
[us.gcr.io/apache-beam-testing/java-postcommit-it/java@sha256:52f4698faf04d71b377557ab828c1ac840c2342f371684ef7828c62c2cc45821]
Deleted [[us.gcr.io/apache-beam-testing/java-postcommit-it/java:20220423163046]
(referencing
[us.gcr.io/apache-beam-testing/java-postcommit-it/java@sha256:52f4698faf04d71b377557ab828c1ac840c2342f371684ef7828c62c2cc45821])].
Removing untagged image
us.gcr.io/apache-beam-testing/java-postcommit-it/java@sha256:52f4698faf04d71b377557ab828c1ac840c2342f371684ef7828c62c2cc45821
Digests:
-
us.gcr.io/apache-beam-testing/java-postcommit-it/java@sha256:52f4698faf04d71b377557ab828c1ac840c2342f371684ef7828c62c2cc45821
Deleted
[us.gcr.io/apache-beam-testing/java-postcommit-it/java@sha256:52f4698faf04d71b377557ab828c1ac840c2342f371684ef7828c62c2cc45821].
FAILURE: Build failed with an exception.
* What went wrong:
Execution failed for task ':sdks:java:testing:nexmark:run'.
> Process 'command '/usr/lib/jvm/java-8-openjdk-amd64/bin/java'' finished with
> non-zero exit value 1
* Try:
> Run with --stacktrace option to get the stack trace.
> Run with --info or --debug option to get more log output.
> Run with --scan to get full insights.
* Get more help at https://help.gradle.org
Deprecated Gradle features were used in this build, making it incompatible with
Gradle 8.0.
You can use '--warning-mode all' to show the individual deprecation warnings
and determine if they come from your own scripts or plugins.
See
https://docs.gradle.org/7.4/userguide/command_line_interface.html#sec:command_line_warnings
Execution optimizations have been disabled for 1 invalid unit(s) of work during
this build to ensure correctness.
Please consult deprecation warnings for more details.
BUILD FAILED in 3h 31m 11s
131 actionable tasks: 9 executed, 122 up-to-date
Publishing build scan...
https://gradle.com/s/uahrp4wyrqxb4
Build step 'Invoke Gradle script' changed build result to FAILURE
Build step 'Invoke Gradle script' marked build as failure
---------------------------------------------------------------------
To unsubscribe, e-mail: [email protected]
For additional commands, e-mail: [email protected]