See
<https://ci-beam.apache.org/job/beam_PostCommit_Java_Nexmark_Dataflow_V2/1865/display/redirect>
Changes:
------------------------------------------
[...truncated 716.98 KB...]
2022-09-05T23:57:27.845Z no activity
2022-09-05T23:57:42.882Z RUNNING Query7 (waiting for shutdown)
2022-09-05T23:57:43.633Z 3 samples not enough to calculate steady-state event
rate
2022-09-05T23:57:43.633Z no activity
2022-09-05T23:57:58.674Z RUNNING Query7 (waiting for shutdown)
2022-09-05T23:57:59.441Z 3 samples not enough to calculate steady-state event
rate
2022-09-05T23:57:59.441Z no activity
2022-09-05T23:58:14.471Z RUNNING Query7 (waiting for shutdown)
2022-09-05T23:58:15.205Z 3 samples not enough to calculate steady-state event
rate
2022-09-05T23:58:15.205Z no activity
2022-09-05T23:58:30.241Z RUNNING Query7 (waiting for shutdown)
2022-09-05T23:58:30.995Z 3 samples not enough to calculate steady-state event
rate
2022-09-05T23:58:30.995Z no activity
2022-09-05T23:58:46.030Z RUNNING Query7 (waiting for shutdown)
2022-09-05T23:58:46.779Z 3 samples not enough to calculate steady-state event
rate
2022-09-05T23:58:46.780Z no activity
2022-09-05T23:59:01.854Z RUNNING Query7 (waiting for shutdown)
2022-09-05T23:59:02.578Z 3 samples not enough to calculate steady-state event
rate
2022-09-05T23:59:02.578Z no activity
2022-09-05T23:59:17.611Z RUNNING Query7 (waiting for shutdown)
2022-09-05T23:59:18.442Z 3 samples not enough to calculate steady-state event
rate
2022-09-05T23:59:18.442Z no activity
2022-09-05T23:59:33.478Z RUNNING Query7 (waiting for shutdown)
2022-09-05T23:59:34.259Z 3 samples not enough to calculate steady-state event
rate
2022-09-05T23:59:34.259Z no activity
2022-09-05T23:59:49.295Z RUNNING Query7 (waiting for shutdown)
2022-09-05T23:59:50.076Z 3 samples not enough to calculate steady-state event
rate
2022-09-05T23:59:50.076Z no activity
2022-09-06T00:00:05.116Z RUNNING Query7 (waiting for shutdown)
2022-09-06T00:00:06.041Z 3 samples not enough to calculate steady-state event
rate
2022-09-06T00:00:06.041Z no activity
2022-09-06T00:00:21.073Z RUNNING Query7 (waiting for shutdown)
2022-09-06T00:00:21.960Z 3 samples not enough to calculate steady-state event
rate
2022-09-06T00:00:21.960Z no activity
2022-09-06T00:00:37.000Z RUNNING Query7 (waiting for shutdown)
2022-09-06T00:00:37.949Z 3 samples not enough to calculate steady-state event
rate
2022-09-06T00:00:37.949Z no activity
2022-09-06T00:00:53.030Z RUNNING Query7 (waiting for shutdown)
2022-09-06T00:00:53.885Z 3 samples not enough to calculate steady-state event
rate
2022-09-06T00:00:53.886Z no activity
2022-09-06T00:01:08.927Z RUNNING Query7 (waiting for shutdown)
2022-09-06T00:01:09.654Z 3 samples not enough to calculate steady-state event
rate
2022-09-06T00:01:09.655Z no activity
2022-09-06T00:01:24.696Z RUNNING Query7 (waiting for shutdown)
2022-09-06T00:01:25.397Z 3 samples not enough to calculate steady-state event
rate
2022-09-06T00:01:25.397Z no activity
2022-09-06T00:01:40.461Z RUNNING Query7 (waiting for shutdown)
2022-09-06T00:01:41.292Z 3 samples not enough to calculate steady-state event
rate
2022-09-06T00:01:41.293Z no activity
2022-09-06T00:01:56.321Z RUNNING Query7 (waiting for shutdown)
2022-09-06T00:01:57.044Z 3 samples not enough to calculate steady-state event
rate
2022-09-06T00:01:57.044Z no activity
2022-09-06T00:02:12.076Z RUNNING Query7 (waiting for shutdown)
2022-09-06T00:02:12.836Z 3 samples not enough to calculate steady-state event
rate
2022-09-06T00:02:12.836Z no activity
2022-09-06T00:02:27.893Z RUNNING Query7 (waiting for shutdown)
2022-09-06T00:02:28.676Z 3 samples not enough to calculate steady-state event
rate
2022-09-06T00:02:28.676Z no activity
2022-09-06T00:02:43.719Z RUNNING Query7 (waiting for shutdown)
2022-09-06T00:02:44.386Z 3 samples not enough to calculate steady-state event
rate
2022-09-06T00:02:44.386Z no activity
2022-09-06T00:02:59.413Z RUNNING Query7 (waiting for shutdown)
2022-09-06T00:03:00.168Z 3 samples not enough to calculate steady-state event
rate
2022-09-06T00:03:00.168Z no activity
2022-09-06T00:03:15.232Z RUNNING Query7 (waiting for shutdown)
2022-09-06T00:03:16.041Z 3 samples not enough to calculate steady-state event
rate
2022-09-06T00:03:16.041Z no activity
2022-09-06T00:03:31.089Z CANCELLED Query7 (waiting for shutdown)
2022-09-06T00:03:31.122Z 3 samples not enough to calculate steady-state event
rate
==========================================================================================
Run started 2022-09-05T20:41:00.743Z and ran for PT12150.380S
Default configuration:
{"debug":true,"query":null,"sourceType":"DIRECT","generateEventFilePathPrefix":null,"sinkType":"DEVNULL","exportSummaryToBigQuery":false,"pubSubMode":"COMBINED","pubsubMessageSerializationMethod":"CODER","sideInputType":"DIRECT","sideInputRowCount":500,"sideInputNumShards":3,"sideInputUrl":null,"sessionGap":600000,"numEvents":100000,"numEventGenerators":100,"rateShape":"SINE","firstEventRate":10000,"nextEventRate":10000,"rateUnit":"PER_SECOND","ratePeriodSec":600,"preloadSeconds":0,"streamTimeout":240,"isRateLimited":false,"useWallclockEventTime":false,"avgPersonByteSize":200,"avgAuctionByteSize":500,"avgBidByteSize":100,"hotAuctionRatio":2,"hotSellersRatio":4,"hotBiddersRatio":4,"windowSizeSec":10,"windowPeriodSec":5,"watermarkHoldbackSec":0,"numInFlightAuctions":100,"numActivePeople":1000,"coderStrategy":"HAND","cpuDelayMs":0,"diskBusyBytes":0,"auctionSkip":123,"fanout":5,"maxAuctionsWaitingTime":600,"occasionalDelaySec":3,"probDelayedEvent":0.1,"maxLogEvents":100000,"usePubsubPublishTime":false,"outOfOrderGroupSize":1,"numKeyBuckets":20000,"pardoCPUFactor":1.0}
Configurations:
Conf Description
0000 query:PASSTHROUGH; numEvents:10000000
0001 query:CURRENCY_CONVERSION; numEvents:10000000
0002 query:SELECTION; numEvents:10000000
0003 query:LOCAL_ITEM_SUGGESTION; numEvents:10000000
0004 query:AVERAGE_PRICE_FOR_CATEGORY; numEvents:1000000
0005 query:HOT_ITEMS; numEvents:10000000
0006 query:AVERAGE_SELLING_PRICE_BY_SELLER; numEvents:1000000
0007 query:HIGHEST_BID; numEvents:10000000
0008 query:MONITOR_NEW_USERS; numEvents:10000000
0009 query:WINNING_BIDS; numEvents:1000000
0010 query:LOG_TO_SHARDED_FILES; numEvents:10000000
0011 query:USER_SESSIONS; numEvents:10000000
0012 query:PROCESSING_TIME_WINDOWS; numEvents:10000000
0013 query:PORTABILITY_BATCH; numEvents:10000000
0014 query:RESHUFFLE; numEvents:10000000
0015 query:BOUNDED_SIDE_INPUT_JOIN; numEvents:10000000
0016 query:SESSION_SIDE_INPUT_JOIN; numEvents:10000000
Performance:
Conf Runtime(sec) (Baseline) Events(/sec) (Baseline) Results
(Baseline)
0000 53.6 186626.4 10000000
0001 20.6 485319.1 9200000
0002 20.8 480492.0 83527
0003 34.6 289226.3 59507
0004 *** not run ***
0005 231.4 43213.3 4567
0006 *** not run ***
0007 120.7 82848.0 100
*** Job was unexpectedly cancelled ***
0008 51.6 193652.1 92833
0009 *** not run ***
0010 75.9 131689.8 100
0011 160.8 62199.9 1839657
0012 88.9 112518.8 331595
0013 *** not run ***
0014 82.2 121636.7 10000000
0015 *** not run ***
0016 *** not run ***
==========================================================================================
==========================================================================================
Run started 2022-09-05T20:41:00.743Z and ran for PT12150.601S
Default configuration:
{"debug":true,"query":null,"sourceType":"DIRECT","generateEventFilePathPrefix":null,"sinkType":"DEVNULL","exportSummaryToBigQuery":false,"pubSubMode":"COMBINED","pubsubMessageSerializationMethod":"CODER","sideInputType":"DIRECT","sideInputRowCount":500,"sideInputNumShards":3,"sideInputUrl":null,"sessionGap":600000,"numEvents":100000,"numEventGenerators":100,"rateShape":"SINE","firstEventRate":10000,"nextEventRate":10000,"rateUnit":"PER_SECOND","ratePeriodSec":600,"preloadSeconds":0,"streamTimeout":240,"isRateLimited":false,"useWallclockEventTime":false,"avgPersonByteSize":200,"avgAuctionByteSize":500,"avgBidByteSize":100,"hotAuctionRatio":2,"hotSellersRatio":4,"hotBiddersRatio":4,"windowSizeSec":10,"windowPeriodSec":5,"watermarkHoldbackSec":0,"numInFlightAuctions":100,"numActivePeople":1000,"coderStrategy":"HAND","cpuDelayMs":0,"diskBusyBytes":0,"auctionSkip":123,"fanout":5,"maxAuctionsWaitingTime":600,"occasionalDelaySec":3,"probDelayedEvent":0.1,"maxLogEvents":100000,"usePubsubPublishTime":false,"outOfOrderGroupSize":1,"numKeyBuckets":20000,"pardoCPUFactor":1.0}
Configurations:
Conf Description
0000 query:PASSTHROUGH; numEvents:10000000
0001 query:CURRENCY_CONVERSION; numEvents:10000000
0002 query:SELECTION; numEvents:10000000
0003 query:LOCAL_ITEM_SUGGESTION; numEvents:10000000
0004 query:AVERAGE_PRICE_FOR_CATEGORY; numEvents:1000000
0005 query:HOT_ITEMS; numEvents:10000000
0006 query:AVERAGE_SELLING_PRICE_BY_SELLER; numEvents:1000000
0007 query:HIGHEST_BID; numEvents:10000000
0008 query:MONITOR_NEW_USERS; numEvents:10000000
0009 query:WINNING_BIDS; numEvents:1000000
0010 query:LOG_TO_SHARDED_FILES; numEvents:10000000
0011 query:USER_SESSIONS; numEvents:10000000
0012 query:PROCESSING_TIME_WINDOWS; numEvents:10000000
0013 query:PORTABILITY_BATCH; numEvents:10000000
0014 query:RESHUFFLE; numEvents:10000000
0015 query:BOUNDED_SIDE_INPUT_JOIN; numEvents:10000000
0016 query:SESSION_SIDE_INPUT_JOIN; numEvents:10000000
Performance:
Conf Runtime(sec) (Baseline) Events(/sec) (Baseline) Results
(Baseline)
0000 53.6 186626.4 10000000
0001 20.6 485319.1 9200000
0002 20.8 480492.0 83527
0003 34.6 289226.3 59507
0004 *** not run ***
0005 231.4 43213.3 4567
0006 *** not run ***
0007 120.7 82848.0 100
*** Job was unexpectedly cancelled ***
0008 51.6 193652.1 92833
0009 *** not run ***
0010 75.9 131689.8 100
0011 160.8 62199.9 1839657
0012 88.9 112518.8 331595
0013 *** not run ***
0014 82.2 121636.7 10000000
0015 *** not run ***
0016 *** not run ***
==========================================================================================
Exception in thread "main" java.lang.RuntimeException: Execution was not
successful
at org.apache.beam.sdk.nexmark.Main.runAll(Main.java:169)
at org.apache.beam.sdk.nexmark.Main.main(Main.java:441)
> Task :sdks:java:testing:nexmark:run FAILED
> Task :runners:google-cloud-dataflow-java:cleanUpDockerJavaImages
Untagged: us.gcr.io/apache-beam-testing/java-postcommit-it/java:20220905204029
Untagged:
us.gcr.io/apache-beam-testing/java-postcommit-it/java@sha256:61b38cc2c48adf4534eba07c5ccceb726a7c00e46591c1e7e3513185d72c1445
Deleted: sha256:ddc708d31c8fb8c93dcba22274bbd96de987cec98c824784f553e28221bc729c
Deleted: sha256:d1c598cec1274b7e7dfc717f791a5dca7d73a570f37c1ef6bbd28833be31ba49
Deleted: sha256:e8d42e7ee3159d610926c0fada0a8c6a21c67ae02f27d0eedde7197dd4c176fe
Deleted: sha256:a3d6cd679334e7ed2b3152fad1032bb7e6e600a52132a49ec2bfa40e8840b612
Deleted: sha256:4aee70f4794f2f96e6adbaf40d35b15431dcae704846c4d86ab077908106b139
Deleted: sha256:1aab6382e2e6278f794b9c6e3d1f39382d16b3a934ba1f19e0d1e9085d18f078
Deleted: sha256:9eec201f5e1a7129cf8a12f29376c259c38f0da080bcaa12cc76e240b44420c4
Deleted: sha256:17e140447aab471cc8e2e79667a270fd8f7a5e9060c407ce0744b826fb6c7651
Deleted: sha256:97386588f5e133c173f2df88802442c2a594fa7c34313099f19b263aa4fdd371
Deleted: sha256:4a6e4c60a536665b25101d93ea891f4b4439255aeab669fcaa4c6cf1db14df2b
Deleted: sha256:11d021874db4249720f9dd99fe0e2ba7c03149eb4b8b0ce3e4fced44b8a04c7c
Deleted: sha256:b0bbc2686fa5cf3c53f16715fe74f544f2f4cef7e2205cd905943cbd48fcd471
Deleted: sha256:95f8ef81fa33b07b8dce7a5226613d950b629d69c4bc5a9debac7c8457873861
Deleted: sha256:cbd708bc6cd456e20605799ffe121dd138dff043d25b7e2549162b95cb3f89c8
Deleted: sha256:0cf753134d2281cff0ad88a57d144385799e868757ac214150a1eb288e3fb82c
Deleted: sha256:b88b7111e4f752003dcfc8763189452ce29aabafed0947ee8a7d0a4b1e4c9619
Deleted: sha256:45a26d7a60ba156e63ffa832d174dfe5546f331b34f1fa6af16d6d215448112e
Deleted: sha256:71d1e286355151776a914239348f5fb9a3ec8d7d8e56cf0f62b44cbf8036f22e
Deleted: sha256:5459fb9d0edbf7b972dfe1383312d4881cfe5a2dd7e03d86398b38c900412823
Deleted: sha256:30fa142ec29563ef9f28990918d400cd77dc9e4f6cf10716561caf30aedc6e98
Deleted: sha256:252653b4e7782fac6d4234aad1ae75ce8e9b01fc7167b0343c8f610fcf454e15
Deleted: sha256:c4b65f35f3d85bf02ed90b035a1f73ee09cd9fc69586d684702ffda42dd93875
Deleted: sha256:a206ba3eb1d5ba05afccb2ef91f5e7716e59aa6dcf342e4e92b802978d293c12
Deleted: sha256:78527676352ea92637d229e63c85bb85e0b43706fdf9e1bc3091f9a232a590b6
Deleted: sha256:c78b8b6496ed02ccae4c1987b648a28c7ff79968775db25846630610cc5f7884
Deleted: sha256:72db0dec3363c4e2e2a77b185d8f13995b0bcf62a2bcd8334810c8aa155e2053
Deleted: sha256:5932879de5258f7ee2630c8cc0de132ebd8ccb9ebc337731f3b43d787196a782
Deleted: sha256:6f8ab54ed84504fead2a50e5a1d966cb064779c24003963298bd62f5464989e4
Deleted: sha256:f7d3620ba1cdc424dbfcdc71b64201a37cc7cda72d6dde1a03915bf3fd2c1610
Deleted: sha256:9b2f24e93240137449208039adc2d7141f0f0230b6d1e5d3dd48e05c0dbb6ea2
Deleted: sha256:d8af2834a7a7c27f0dbaf5f4e6805a204c3b69d117dc563fc1dfca938429d43e
Deleted: sha256:8808ccfc42c7920195849cf583fada2558d4b727250e37a3b7f432d8c9c99e66
Deleted: sha256:53ca2f13aa80c344d15f18bf0c9a9341643f86c9685a370ab509cf2c5324bfdb
Deleted: sha256:a3857a66d566675966f7eed751608bf16f0221a80ee5997e7c83ca9bed9e17d7
Tag: [us.gcr.io/apache-beam-testing/java-postcommit-it/java:20220905204029]
- referencing digest:
[us.gcr.io/apache-beam-testing/java-postcommit-it/java@sha256:61b38cc2c48adf4534eba07c5ccceb726a7c00e46591c1e7e3513185d72c1445]
Deleted [[us.gcr.io/apache-beam-testing/java-postcommit-it/java:20220905204029]
(referencing
[us.gcr.io/apache-beam-testing/java-postcommit-it/java@sha256:61b38cc2c48adf4534eba07c5ccceb726a7c00e46591c1e7e3513185d72c1445])].
Removing untagged image
us.gcr.io/apache-beam-testing/java-postcommit-it/java@sha256:61b38cc2c48adf4534eba07c5ccceb726a7c00e46591c1e7e3513185d72c1445
Digests:
-
us.gcr.io/apache-beam-testing/java-postcommit-it/java@sha256:61b38cc2c48adf4534eba07c5ccceb726a7c00e46591c1e7e3513185d72c1445
Deleted
[us.gcr.io/apache-beam-testing/java-postcommit-it/java@sha256:61b38cc2c48adf4534eba07c5ccceb726a7c00e46591c1e7e3513185d72c1445].
FAILURE: Build failed with an exception.
* What went wrong:
Execution failed for task ':sdks:java:testing:nexmark:run'.
> Process 'command '/usr/lib/jvm/java-8-openjdk-amd64/bin/java'' finished with
> non-zero exit value 1
* Try:
> Run with --stacktrace option to get the stack trace.
> Run with --info or --debug option to get more log output.
> Run with --scan to get full insights.
* Get more help at https://help.gradle.org
Deprecated Gradle features were used in this build, making it incompatible with
Gradle 8.0.
You can use '--warning-mode all' to show the individual deprecation warnings
and determine if they come from your own scripts or plugins.
See
https://docs.gradle.org/7.4/userguide/command_line_interface.html#sec:command_line_warnings
Execution optimizations have been disabled for 1 invalid unit(s) of work during
this build to ensure correctness.
Please consult deprecation warnings for more details.
BUILD FAILED in 3h 23m 11s
131 actionable tasks: 9 executed, 122 up-to-date
Publishing build scan...
https://gradle.com/s/p5e2hax73ht5c
Build step 'Invoke Gradle script' changed build result to FAILURE
Build step 'Invoke Gradle script' marked build as failure
---------------------------------------------------------------------
To unsubscribe, e-mail: [email protected]
For additional commands, e-mail: [email protected]