See
<https://ci-beam.apache.org/job/beam_PostCommit_Java_Nexmark_Dataflow_V2/1414/display/redirect>
Changes:
------------------------------------------
[...truncated 710.40 KB...]
2022-05-15T23:55:52.403Z no activity
2022-05-15T23:56:07.452Z RUNNING Query7 (waiting for shutdown)
2022-05-15T23:56:08.412Z sample of 78.7 sec not long enough to calculate
steady-state event rate
2022-05-15T23:56:08.412Z no activity
2022-05-15T23:56:23.465Z RUNNING Query7 (waiting for shutdown)
2022-05-15T23:56:24.388Z sample of 78.7 sec not long enough to calculate
steady-state event rate
2022-05-15T23:56:24.388Z no activity
2022-05-15T23:56:39.439Z RUNNING Query7 (waiting for shutdown)
2022-05-15T23:56:40.367Z sample of 78.7 sec not long enough to calculate
steady-state event rate
2022-05-15T23:56:40.367Z no activity
2022-05-15T23:56:55.401Z RUNNING Query7 (waiting for shutdown)
2022-05-15T23:56:56.266Z sample of 78.7 sec not long enough to calculate
steady-state event rate
2022-05-15T23:56:56.266Z no activity
2022-05-15T23:57:11.315Z RUNNING Query7 (waiting for shutdown)
2022-05-15T23:57:12.262Z sample of 78.7 sec not long enough to calculate
steady-state event rate
2022-05-15T23:57:12.262Z no activity
2022-05-15T23:57:27.299Z RUNNING Query7 (waiting for shutdown)
2022-05-15T23:57:28.224Z sample of 78.7 sec not long enough to calculate
steady-state event rate
2022-05-15T23:57:28.224Z no activity
2022-05-15T23:57:43.269Z RUNNING Query7 (waiting for shutdown)
2022-05-15T23:57:44.162Z sample of 78.7 sec not long enough to calculate
steady-state event rate
2022-05-15T23:57:44.162Z no activity
2022-05-15T23:57:59.209Z RUNNING Query7 (waiting for shutdown)
2022-05-15T23:58:00.120Z sample of 78.7 sec not long enough to calculate
steady-state event rate
2022-05-15T23:58:00.120Z no activity
2022-05-15T23:58:15.182Z RUNNING Query7 (waiting for shutdown)
2022-05-15T23:58:16.018Z sample of 78.7 sec not long enough to calculate
steady-state event rate
2022-05-15T23:58:16.018Z no activity
2022-05-15T23:58:31.063Z RUNNING Query7 (waiting for shutdown)
2022-05-15T23:58:32.022Z sample of 78.7 sec not long enough to calculate
steady-state event rate
2022-05-15T23:58:32.022Z no activity
2022-05-15T23:58:47.083Z RUNNING Query7 (waiting for shutdown)
2022-05-15T23:58:48.052Z sample of 78.7 sec not long enough to calculate
steady-state event rate
2022-05-15T23:58:48.052Z no activity
2022-05-15T23:59:03.116Z RUNNING Query7 (waiting for shutdown)
2022-05-15T23:59:03.964Z sample of 78.7 sec not long enough to calculate
steady-state event rate
2022-05-15T23:59:03.964Z no activity
2022-05-15T23:59:19.017Z RUNNING Query7 (waiting for shutdown)
2022-05-15T23:59:19.981Z sample of 78.7 sec not long enough to calculate
steady-state event rate
2022-05-15T23:59:19.981Z no activity
2022-05-15T23:59:35.014Z RUNNING Query7 (waiting for shutdown)
2022-05-15T23:59:35.929Z sample of 78.7 sec not long enough to calculate
steady-state event rate
2022-05-15T23:59:35.929Z no activity
2022-05-15T23:59:50.977Z RUNNING Query7 (waiting for shutdown)
2022-05-15T23:59:51.787Z sample of 78.7 sec not long enough to calculate
steady-state event rate
2022-05-15T23:59:51.788Z no activity
2022-05-16T00:00:06.841Z RUNNING Query7 (waiting for shutdown)
2022-05-16T00:00:07.890Z sample of 78.7 sec not long enough to calculate
steady-state event rate
2022-05-16T00:00:07.890Z no activity
2022-05-16T00:00:22.952Z RUNNING Query7 (waiting for shutdown)
2022-05-16T00:00:24.006Z sample of 78.7 sec not long enough to calculate
steady-state event rate
2022-05-16T00:00:24.006Z no activity
2022-05-16T00:00:39.060Z RUNNING Query7 (waiting for shutdown)
2022-05-16T00:00:39.987Z sample of 78.7 sec not long enough to calculate
steady-state event rate
2022-05-16T00:00:39.987Z no activity
2022-05-16T00:00:55.024Z RUNNING Query7 (waiting for shutdown)
2022-05-16T00:00:55.857Z sample of 78.7 sec not long enough to calculate
steady-state event rate
2022-05-16T00:00:55.858Z no activity
2022-05-16T00:01:10.949Z RUNNING Query7 (waiting for shutdown)
2022-05-16T00:01:11.877Z sample of 78.7 sec not long enough to calculate
steady-state event rate
2022-05-16T00:01:11.877Z no activity
2022-05-16T00:01:26.957Z RUNNING Query7 (waiting for shutdown)
2022-05-16T00:01:27.770Z sample of 78.7 sec not long enough to calculate
steady-state event rate
2022-05-16T00:01:27.771Z no activity
2022-05-16T00:01:42.844Z RUNNING Query7 (waiting for shutdown)
2022-05-16T00:01:43.774Z sample of 78.7 sec not long enough to calculate
steady-state event rate
2022-05-16T00:01:43.774Z no activity
2022-05-16T00:01:58.812Z CANCELLED Query7 (waiting for shutdown)
2022-05-16T00:01:58.849Z sample of 78.7 sec not long enough to calculate
steady-state event rate
==========================================================================================
Run started 2022-05-15T20:40:33.290Z and ran for PT12085.560S
Default configuration:
{"debug":true,"query":null,"sourceType":"DIRECT","generateEventFilePathPrefix":null,"sinkType":"DEVNULL","exportSummaryToBigQuery":false,"pubSubMode":"COMBINED","pubsubMessageSerializationMethod":"CODER","sideInputType":"DIRECT","sideInputRowCount":500,"sideInputNumShards":3,"sideInputUrl":null,"sessionGap":600000,"numEvents":100000,"numEventGenerators":100,"rateShape":"SINE","firstEventRate":10000,"nextEventRate":10000,"rateUnit":"PER_SECOND","ratePeriodSec":600,"preloadSeconds":0,"streamTimeout":240,"isRateLimited":false,"useWallclockEventTime":false,"avgPersonByteSize":200,"avgAuctionByteSize":500,"avgBidByteSize":100,"hotAuctionRatio":2,"hotSellersRatio":4,"hotBiddersRatio":4,"windowSizeSec":10,"windowPeriodSec":5,"watermarkHoldbackSec":0,"numInFlightAuctions":100,"numActivePeople":1000,"coderStrategy":"HAND","cpuDelayMs":0,"diskBusyBytes":0,"auctionSkip":123,"fanout":5,"maxAuctionsWaitingTime":600,"occasionalDelaySec":3,"probDelayedEvent":0.1,"maxLogEvents":100000,"usePubsubPublishTime":false,"outOfOrderGroupSize":1,"numKeyBuckets":20000,"pardoCPUFactor":1.0}
Configurations:
Conf Description
0000 query:PASSTHROUGH; numEvents:10000000
0001 query:CURRENCY_CONVERSION; numEvents:10000000
0002 query:SELECTION; numEvents:10000000
0003 query:LOCAL_ITEM_SUGGESTION; numEvents:10000000
0004 query:AVERAGE_PRICE_FOR_CATEGORY; numEvents:1000000
0005 query:HOT_ITEMS; numEvents:10000000
0006 query:AVERAGE_SELLING_PRICE_BY_SELLER; numEvents:1000000
0007 query:HIGHEST_BID; numEvents:10000000
0008 query:MONITOR_NEW_USERS; numEvents:10000000
0009 query:WINNING_BIDS; numEvents:1000000
0010 query:LOG_TO_SHARDED_FILES; numEvents:10000000
0011 query:USER_SESSIONS; numEvents:10000000
0012 query:PROCESSING_TIME_WINDOWS; numEvents:10000000
0013 query:PORTABILITY_BATCH; numEvents:10000000
0014 query:RESHUFFLE; numEvents:10000000
0015 query:BOUNDED_SIDE_INPUT_JOIN; numEvents:10000000
0016 query:SESSION_SIDE_INPUT_JOIN; numEvents:10000000
Performance:
Conf Runtime(sec) (Baseline) Events(/sec) (Baseline) Results
(Baseline)
0000 44.6 224149.9 10000000
0001 33.7 296349.0 9200000
0002 29.1 343926.3 83527
0003 51.3 194874.8 59507
0004 *** not run ***
0005 212.9 46975.7 4567
0006 *** not run ***
0007 287.0 34847.9 100
*** Job was unexpectedly cancelled ***
0008 89.3 111920.7 92833
0009 *** not run ***
0010 90.6 110435.0 100
0011 189.3 52815.3 1839657
0012 82.9 120620.0 330934
0013 *** not run ***
0014 93.7 106766.9 10000000
0015 *** not run ***
0016 *** not run ***
==========================================================================================
==========================================================================================
Run started 2022-05-15T20:40:33.290Z and ran for PT12085.821S
Default configuration:
{"debug":true,"query":null,"sourceType":"DIRECT","generateEventFilePathPrefix":null,"sinkType":"DEVNULL","exportSummaryToBigQuery":false,"pubSubMode":"COMBINED","pubsubMessageSerializationMethod":"CODER","sideInputType":"DIRECT","sideInputRowCount":500,"sideInputNumShards":3,"sideInputUrl":null,"sessionGap":600000,"numEvents":100000,"numEventGenerators":100,"rateShape":"SINE","firstEventRate":10000,"nextEventRate":10000,"rateUnit":"PER_SECOND","ratePeriodSec":600,"preloadSeconds":0,"streamTimeout":240,"isRateLimited":false,"useWallclockEventTime":false,"avgPersonByteSize":200,"avgAuctionByteSize":500,"avgBidByteSize":100,"hotAuctionRatio":2,"hotSellersRatio":4,"hotBiddersRatio":4,"windowSizeSec":10,"windowPeriodSec":5,"watermarkHoldbackSec":0,"numInFlightAuctions":100,"numActivePeople":1000,"coderStrategy":"HAND","cpuDelayMs":0,"diskBusyBytes":0,"auctionSkip":123,"fanout":5,"maxAuctionsWaitingTime":600,"occasionalDelaySec":3,"probDelayedEvent":0.1,"maxLogEvents":100000,"usePubsubPublishTime":false,"outOfOrderGroupSize":1,"numKeyBuckets":20000,"pardoCPUFactor":1.0}
Configurations:
Conf Description
0000 query:PASSTHROUGH; numEvents:10000000
0001 query:CURRENCY_CONVERSION; numEvents:10000000
0002 query:SELECTION; numEvents:10000000
0003 query:LOCAL_ITEM_SUGGESTION; numEvents:10000000
0004 query:AVERAGE_PRICE_FOR_CATEGORY; numEvents:1000000
0005 query:HOT_ITEMS; numEvents:10000000
0006 query:AVERAGE_SELLING_PRICE_BY_SELLER; numEvents:1000000
0007 query:HIGHEST_BID; numEvents:10000000
0008 query:MONITOR_NEW_USERS; numEvents:10000000
0009 query:WINNING_BIDS; numEvents:1000000
0010 query:LOG_TO_SHARDED_FILES; numEvents:10000000
0011 query:USER_SESSIONS; numEvents:10000000
0012 query:PROCESSING_TIME_WINDOWS; numEvents:10000000
0013 query:PORTABILITY_BATCH; numEvents:10000000
0014 query:RESHUFFLE; numEvents:10000000
0015 query:BOUNDED_SIDE_INPUT_JOIN; numEvents:10000000
0016 query:SESSION_SIDE_INPUT_JOIN; numEvents:10000000
Performance:
Conf Runtime(sec) (Baseline) Events(/sec) (Baseline) Results
(Baseline)
0000 44.6 224149.9 10000000
0001 33.7 296349.0 9200000
0002 29.1 343926.3 83527
0003 51.3 194874.8 59507
0004 *** not run ***
0005 212.9 46975.7 4567
0006 *** not run ***
0007 287.0 34847.9 100
*** Job was unexpectedly cancelled ***
0008 89.3 111920.7 92833
0009 *** not run ***
0010 90.6 110435.0 100
0011 189.3 52815.3 1839657
0012 82.9 120620.0 330934
0013 *** not run ***
0014 93.7 106766.9 10000000
0015 *** not run ***
0016 *** not run ***
==========================================================================================
Exception in thread "main" java.lang.RuntimeException: Execution was not
successful
at org.apache.beam.sdk.nexmark.Main.runAll(Main.java:176)
at org.apache.beam.sdk.nexmark.Main.main(Main.java:467)
> Task :sdks:java:testing:nexmark:run FAILED
> Task :runners:google-cloud-dataflow-java:cleanUpDockerJavaImages
Untagged: us.gcr.io/apache-beam-testing/java-postcommit-it/java:20220515203951
Untagged:
us.gcr.io/apache-beam-testing/java-postcommit-it/java@sha256:cd23966cac13b7ba90a25730604149121ffc42a5e26698b4a42990ab676b1c3f
Deleted: sha256:88a5275506b4da8629f0e9ecf06b3e6f96bb8885222fba377a3fb2d55d13aa62
Deleted: sha256:73b6b68af37cb682051fb4c07def8393736caaab3ee978f1940d99f8d19a4871
Deleted: sha256:21de677839c34d2bd4da978adf2f7a7797ff6845402a4027a8596acb2db8e4f1
Deleted: sha256:2342efca676e1109871afe9eb59163300fb934d0580f5431119608f6b8e184bc
Deleted: sha256:4b4f365cd1452cc1064f9e5f5ed444e6f182a52d1fca00efb48552e4b048f305
Deleted: sha256:2ddc9e28461e6672ff8b2f86074b21db5b910fcb206a286e2d775e270930efd0
Deleted: sha256:c91dcc3470d37de6a44e885a51ddc130b744cf9713e66e63bc7018abd4638e55
Deleted: sha256:9e84de4547dac70f4c2e1bd7b95a0ab69c7d07268a44fc672c439e9fec783bbf
Deleted: sha256:fc5dd3e163316c75aae5a8e1d6f2fa94640a6b33cf1e95580561f87b10e72bc9
Deleted: sha256:133ff896406b21b9387e7cfbb279939920ca2801f01a6f2414f784bb73bd471b
Deleted: sha256:02464b515b52a386a6d84c43ab5b6db5903633bb243a7d96d5896c2ba5a4a2d1
Deleted: sha256:9b4f6d6af2d5f56aac4cf83492e2f23a3819cb4791985a5c5108e6090f14e11a
Deleted: sha256:e8737abf03c81954616a4c5de88f6535fb4d27faee81ae9cef5a9337d51adb5c
Deleted: sha256:2e2275bcbc6746f2fbfd2d8dab7c124e4e1d1bcc398e2cebe6d398cd43a02296
Deleted: sha256:8385c8517212e2c64b82080e1b744d47cf7e73f6c6b094553625828630c01596
Deleted: sha256:4ed381e8915ea2c8d732b3bca3e2d59641772eb06fa2a618568c7f7cfcd906d6
Deleted: sha256:0519e514c274a1790a015e6f94a1048cc86765c96311086d4a06d2ae8e80d878
Deleted: sha256:ce778b3678e023b1d154021b5ed5e9f546bf5fae5b78288e46797e0278bc30cc
Deleted: sha256:297c9d0353042b4fb4e511e037e47e56d792d371c42c18e29b0aaa9aacea87b0
Deleted: sha256:f26cc1d67d62ab09a2a6856cbdb078b9df13f89277771bccdbeb8732eae2f95e
Deleted: sha256:56fa27180bfe663c395bfea2c7140e3c9fb9a5fe8d9af308956f7bcb94d9e113
Deleted: sha256:d30c29d4bb67841ef2f0442f236e8bb2f5a27dd1f6b10688428be7e81e5b9bd7
Deleted: sha256:bd071b486aef8adb2cce5a0cc46a9888e814abae4f9799753b79df51a26ddeda
Deleted: sha256:60451df7acafbec56c96fa7c6c5525106cffd06e18ef9e8e0c5b988941696814
Deleted: sha256:bfd05cbe88847cc7b34385d6cb30105ff0f942c5eec61a37a80f311adfef691a
Deleted: sha256:1dcd5d2ee498f05ea593bec71ebc0a0b7995050d76333044b2c348cdfea85936
Deleted: sha256:04b2fcffb2af3c0b8b1031e99272e89c8badff340b98c33f789848da4dbf14a0
Deleted: sha256:8e50213270bec7dd9dab817633078ac7d9e49bde2e7f25709a4461b00e5add0a
Deleted: sha256:3e830b9c5daf3d31afee822a6c46d4896aec2cc66a6307a1332050b1209035f6
Deleted: sha256:67ca5552a75447d6e4453679f47f4e53b37a6ccd5570481061927bf1b32a6dbd
Deleted: sha256:a0380616d18321f90f62bf81cd010e575598437ff2038c190bb09291197cb74c
Deleted: sha256:90006cc5f887492028f9d20d38ccd5c7022f1396b3250332664d7ac7d386d608
Deleted: sha256:5736ddfa92eb5f4523f5358b8cd47adec33cbfe342e30c242085689f83722b1a
Deleted: sha256:9897f6fb7214d9a9f00fe4d20f0c4b20761607067604cb535c7847a6c42cbdc2
Tag: [us.gcr.io/apache-beam-testing/java-postcommit-it/java:20220515203951]
- referencing digest:
[us.gcr.io/apache-beam-testing/java-postcommit-it/java@sha256:cd23966cac13b7ba90a25730604149121ffc42a5e26698b4a42990ab676b1c3f]
Deleted [[us.gcr.io/apache-beam-testing/java-postcommit-it/java:20220515203951]
(referencing
[us.gcr.io/apache-beam-testing/java-postcommit-it/java@sha256:cd23966cac13b7ba90a25730604149121ffc42a5e26698b4a42990ab676b1c3f])].
Removing untagged image
us.gcr.io/apache-beam-testing/java-postcommit-it/java@sha256:cd23966cac13b7ba90a25730604149121ffc42a5e26698b4a42990ab676b1c3f
Digests:
-
us.gcr.io/apache-beam-testing/java-postcommit-it/java@sha256:cd23966cac13b7ba90a25730604149121ffc42a5e26698b4a42990ab676b1c3f
Deleted
[us.gcr.io/apache-beam-testing/java-postcommit-it/java@sha256:cd23966cac13b7ba90a25730604149121ffc42a5e26698b4a42990ab676b1c3f].
FAILURE: Build failed with an exception.
* What went wrong:
Execution failed for task ':sdks:java:testing:nexmark:run'.
> Process 'command '/usr/lib/jvm/java-8-openjdk-amd64/bin/java'' finished with
> non-zero exit value 1
* Try:
> Run with --stacktrace option to get the stack trace.
> Run with --info or --debug option to get more log output.
> Run with --scan to get full insights.
* Get more help at https://help.gradle.org
Deprecated Gradle features were used in this build, making it incompatible with
Gradle 8.0.
You can use '--warning-mode all' to show the individual deprecation warnings
and determine if they come from your own scripts or plugins.
See
https://docs.gradle.org/7.4/userguide/command_line_interface.html#sec:command_line_warnings
Execution optimizations have been disabled for 1 invalid unit(s) of work during
this build to ensure correctness.
Please consult deprecation warnings for more details.
BUILD FAILED in 3h 22m 19s
131 actionable tasks: 9 executed, 122 up-to-date
Publishing build scan...
https://gradle.com/s/v5sjrv35cvet6
Build step 'Invoke Gradle script' changed build result to FAILURE
Build step 'Invoke Gradle script' marked build as failure
---------------------------------------------------------------------
To unsubscribe, e-mail: [email protected]
For additional commands, e-mail: [email protected]
