See
<https://ci-beam.apache.org/job/beam_PostCommit_Java_Nexmark_Dataflow_V2/1262/display/redirect?page=changes>
Changes:
[noreply] Update python beam-master container image. (#17313)
------------------------------------------
[...truncated 704.09 KB...]
2022-04-08T11:55:45.169Z no activity
2022-04-08T11:56:00.231Z RUNNING Query7 (waiting for shutdown)
2022-04-08T11:56:01.021Z 4 samples not enough to calculate steady-state event
rate
2022-04-08T11:56:01.022Z no activity
2022-04-08T11:56:16.069Z RUNNING Query7 (waiting for shutdown)
2022-04-08T11:56:16.978Z 4 samples not enough to calculate steady-state event
rate
2022-04-08T11:56:16.978Z no activity
2022-04-08T11:56:32.028Z RUNNING Query7 (waiting for shutdown)
2022-04-08T11:56:32.789Z 4 samples not enough to calculate steady-state event
rate
2022-04-08T11:56:32.789Z no activity
2022-04-08T11:56:47.821Z RUNNING Query7 (waiting for shutdown)
2022-04-08T11:56:48.571Z 4 samples not enough to calculate steady-state event
rate
2022-04-08T11:56:48.571Z no activity
2022-04-08T11:57:03.635Z RUNNING Query7 (waiting for shutdown)
2022-04-08T11:57:04.374Z 4 samples not enough to calculate steady-state event
rate
2022-04-08T11:57:04.374Z no activity
2022-04-08T11:57:19.413Z RUNNING Query7 (waiting for shutdown)
2022-04-08T11:57:20.182Z 4 samples not enough to calculate steady-state event
rate
2022-04-08T11:57:20.182Z no activity
2022-04-08T11:57:35.247Z RUNNING Query7 (waiting for shutdown)
2022-04-08T11:57:35.932Z 4 samples not enough to calculate steady-state event
rate
2022-04-08T11:57:35.932Z no activity
2022-04-08T11:57:50.980Z RUNNING Query7 (waiting for shutdown)
2022-04-08T11:57:51.844Z 4 samples not enough to calculate steady-state event
rate
2022-04-08T11:57:51.844Z no activity
2022-04-08T11:58:06.883Z RUNNING Query7 (waiting for shutdown)
2022-04-08T11:58:07.639Z 4 samples not enough to calculate steady-state event
rate
2022-04-08T11:58:07.639Z no activity
2022-04-08T11:58:22.673Z RUNNING Query7 (waiting for shutdown)
2022-04-08T11:58:23.444Z 4 samples not enough to calculate steady-state event
rate
2022-04-08T11:58:23.445Z no activity
2022-04-08T11:58:38.547Z RUNNING Query7 (waiting for shutdown)
2022-04-08T11:58:39.326Z 4 samples not enough to calculate steady-state event
rate
2022-04-08T11:58:39.326Z no activity
2022-04-08T11:58:54.362Z RUNNING Query7 (waiting for shutdown)
2022-04-08T11:58:55.077Z 4 samples not enough to calculate steady-state event
rate
2022-04-08T11:58:55.077Z no activity
2022-04-08T11:59:10.141Z RUNNING Query7 (waiting for shutdown)
2022-04-08T11:59:10.954Z 4 samples not enough to calculate steady-state event
rate
2022-04-08T11:59:10.954Z no activity
2022-04-08T11:59:25.983Z RUNNING Query7 (waiting for shutdown)
2022-04-08T11:59:26.820Z 4 samples not enough to calculate steady-state event
rate
2022-04-08T11:59:26.820Z no activity
2022-04-08T11:59:41.863Z RUNNING Query7 (waiting for shutdown)
2022-04-08T11:59:42.685Z 4 samples not enough to calculate steady-state event
rate
2022-04-08T11:59:42.685Z no activity
2022-04-08T11:59:57.718Z RUNNING Query7 (waiting for shutdown)
2022-04-08T11:59:58.494Z 4 samples not enough to calculate steady-state event
rate
2022-04-08T11:59:58.494Z no activity
2022-04-08T12:00:13.536Z RUNNING Query7 (waiting for shutdown)
2022-04-08T12:00:14.320Z 4 samples not enough to calculate steady-state event
rate
2022-04-08T12:00:14.320Z no activity
2022-04-08T12:00:29.355Z RUNNING Query7 (waiting for shutdown)
2022-04-08T12:00:30.090Z 4 samples not enough to calculate steady-state event
rate
2022-04-08T12:00:30.091Z no activity
2022-04-08T12:00:45.129Z RUNNING Query7 (waiting for shutdown)
2022-04-08T12:00:50.171Z 4 samples not enough to calculate steady-state event
rate
2022-04-08T12:00:50.171Z no activity
2022-04-08T12:01:05.249Z RUNNING Query7 (waiting for shutdown)
2022-04-08T12:01:06.625Z 4 samples not enough to calculate steady-state event
rate
2022-04-08T12:01:06.625Z no activity
2022-04-08T12:01:21.658Z RUNNING Query7 (waiting for shutdown)
2022-04-08T12:01:22.461Z 4 samples not enough to calculate steady-state event
rate
2022-04-08T12:01:22.461Z no activity
2022-04-08T12:01:37.507Z RUNNING Query7 (waiting for shutdown)
2022-04-08T12:01:38.214Z 4 samples not enough to calculate steady-state event
rate
2022-04-08T12:01:38.214Z no activity
2022-04-08T12:01:53.271Z CANCELLED Query7 (waiting for shutdown)
2022-04-08T12:01:53.317Z 4 samples not enough to calculate steady-state event
rate
==========================================================================================
Run started 2022-04-08T08:39:29.903Z and ran for PT12143.415S
Default configuration:
{"debug":true,"query":null,"sourceType":"DIRECT","generateEventFilePathPrefix":null,"sinkType":"DEVNULL","exportSummaryToBigQuery":false,"pubSubMode":"COMBINED","pubsubMessageSerializationMethod":"CODER","sideInputType":"DIRECT","sideInputRowCount":500,"sideInputNumShards":3,"sideInputUrl":null,"sessionGap":600000,"numEvents":100000,"numEventGenerators":100,"rateShape":"SINE","firstEventRate":10000,"nextEventRate":10000,"rateUnit":"PER_SECOND","ratePeriodSec":600,"preloadSeconds":0,"streamTimeout":240,"isRateLimited":false,"useWallclockEventTime":false,"avgPersonByteSize":200,"avgAuctionByteSize":500,"avgBidByteSize":100,"hotAuctionRatio":2,"hotSellersRatio":4,"hotBiddersRatio":4,"windowSizeSec":10,"windowPeriodSec":5,"watermarkHoldbackSec":0,"numInFlightAuctions":100,"numActivePeople":1000,"coderStrategy":"HAND","cpuDelayMs":0,"diskBusyBytes":0,"auctionSkip":123,"fanout":5,"maxAuctionsWaitingTime":600,"occasionalDelaySec":3,"probDelayedEvent":0.1,"maxLogEvents":100000,"usePubsubPublishTime":false,"outOfOrderGroupSize":1,"numKeyBuckets":20000,"pardoCPUFactor":1.0}
Configurations:
Conf Description
0000 query:PASSTHROUGH; numEvents:10000000
0001 query:CURRENCY_CONVERSION; numEvents:10000000
0002 query:SELECTION; numEvents:10000000
0003 query:LOCAL_ITEM_SUGGESTION; numEvents:10000000
0004 query:AVERAGE_PRICE_FOR_CATEGORY; numEvents:1000000
0005 query:HOT_ITEMS; numEvents:10000000
0006 query:AVERAGE_SELLING_PRICE_BY_SELLER; numEvents:1000000
0007 query:HIGHEST_BID; numEvents:10000000
0008 query:MONITOR_NEW_USERS; numEvents:10000000
0009 query:WINNING_BIDS; numEvents:1000000
0010 query:LOG_TO_SHARDED_FILES; numEvents:10000000
0011 query:USER_SESSIONS; numEvents:10000000
0012 query:PROCESSING_TIME_WINDOWS; numEvents:10000000
0013 query:PORTABILITY_BATCH; numEvents:10000000
0014 query:RESHUFFLE; numEvents:10000000
0015 query:BOUNDED_SIDE_INPUT_JOIN; numEvents:10000000
0016 query:SESSION_SIDE_INPUT_JOIN; numEvents:10000000
Performance:
Conf Runtime(sec) (Baseline) Events(/sec) (Baseline) Results
(Baseline)
0000 30.8 324696.4 10000000
0001 34.7 287844.3 9200000
0002 24.4 409064.9 83527
0003 39.0 256324.8 59507
0004 *** not run ***
0005 214.8 46544.3 4567
0006 *** not run ***
0007 139.9 71504.2 89
*** Job was unexpectedly cancelled ***
0008 61.9 161647.5 92833
0009 *** not run ***
0010 102.4 97645.8 100
0011 181.4 55128.3 1839657
0012 80.8 123767.0 323169
0013 *** not run ***
0014 83.8 119395.9 10000000
0015 *** not run ***
0016 *** not run ***
==========================================================================================
==========================================================================================
Run started 2022-04-08T08:39:29.903Z and ran for PT12143.656S
Default configuration:
{"debug":true,"query":null,"sourceType":"DIRECT","generateEventFilePathPrefix":null,"sinkType":"DEVNULL","exportSummaryToBigQuery":false,"pubSubMode":"COMBINED","pubsubMessageSerializationMethod":"CODER","sideInputType":"DIRECT","sideInputRowCount":500,"sideInputNumShards":3,"sideInputUrl":null,"sessionGap":600000,"numEvents":100000,"numEventGenerators":100,"rateShape":"SINE","firstEventRate":10000,"nextEventRate":10000,"rateUnit":"PER_SECOND","ratePeriodSec":600,"preloadSeconds":0,"streamTimeout":240,"isRateLimited":false,"useWallclockEventTime":false,"avgPersonByteSize":200,"avgAuctionByteSize":500,"avgBidByteSize":100,"hotAuctionRatio":2,"hotSellersRatio":4,"hotBiddersRatio":4,"windowSizeSec":10,"windowPeriodSec":5,"watermarkHoldbackSec":0,"numInFlightAuctions":100,"numActivePeople":1000,"coderStrategy":"HAND","cpuDelayMs":0,"diskBusyBytes":0,"auctionSkip":123,"fanout":5,"maxAuctionsWaitingTime":600,"occasionalDelaySec":3,"probDelayedEvent":0.1,"maxLogEvents":100000,"usePubsubPublishTime":false,"outOfOrderGroupSize":1,"numKeyBuckets":20000,"pardoCPUFactor":1.0}
Configurations:
Conf Description
0000 query:PASSTHROUGH; numEvents:10000000
0001 query:CURRENCY_CONVERSION; numEvents:10000000
0002 query:SELECTION; numEvents:10000000
0003 query:LOCAL_ITEM_SUGGESTION; numEvents:10000000
0004 query:AVERAGE_PRICE_FOR_CATEGORY; numEvents:1000000
0005 query:HOT_ITEMS; numEvents:10000000
0006 query:AVERAGE_SELLING_PRICE_BY_SELLER; numEvents:1000000
0007 query:HIGHEST_BID; numEvents:10000000
0008 query:MONITOR_NEW_USERS; numEvents:10000000
0009 query:WINNING_BIDS; numEvents:1000000
0010 query:LOG_TO_SHARDED_FILES; numEvents:10000000
0011 query:USER_SESSIONS; numEvents:10000000
0012 query:PROCESSING_TIME_WINDOWS; numEvents:10000000
0013 query:PORTABILITY_BATCH; numEvents:10000000
0014 query:RESHUFFLE; numEvents:10000000
0015 query:BOUNDED_SIDE_INPUT_JOIN; numEvents:10000000
0016 query:SESSION_SIDE_INPUT_JOIN; numEvents:10000000
Performance:
Conf Runtime(sec) (Baseline) Events(/sec) (Baseline) Results
(Baseline)
0000 30.8 324696.4 10000000
0001 34.7 287844.3 9200000
0002 24.4 409064.9 83527
0003 39.0 256324.8 59507
0004 *** not run ***
0005 214.8 46544.3 4567
0006 *** not run ***
0007 139.9 71504.2 89
*** Job was unexpectedly cancelled ***
0008 61.9 161647.5 92833
0009 *** not run ***
0010 102.4 97645.8 100
0011 181.4 55128.3 1839657
0012 80.8 123767.0 323169
0013 *** not run ***
0014 83.8 119395.9 10000000
0015 *** not run ***
0016 *** not run ***
==========================================================================================
Exception in thread "main" java.lang.RuntimeException: Execution was not
successful
at org.apache.beam.sdk.nexmark.Main.runAll(Main.java:176)
at org.apache.beam.sdk.nexmark.Main.main(Main.java:467)
> Task :sdks:java:testing:nexmark:run FAILED
> Task :runners:google-cloud-dataflow-java:cleanUpDockerJavaImages
Untagged: us.gcr.io/apache-beam-testing/java-postcommit-it/java:20220408083852
Untagged:
us.gcr.io/apache-beam-testing/java-postcommit-it/java@sha256:0b12583fb5b4e1046be77ab82837de868bc49b4e8ba96028e4b46b4b69467abf
Deleted: sha256:efc999b96c8eed74fc1e67d1978d7aae7f00056b79a24c9bdcde868daeb66358
Deleted: sha256:842d4ab6c66857b04557515b12b1fbe4925614c3d6c21d251fd73e01240a755e
Deleted: sha256:de285fb91e2cf04706980bc90228d687bdb8258d43a99c13f7fe044b96e73028
Deleted: sha256:4764d7f0e9d299fc3a01fd818330c9ddb6ad8acd8123de972dbde80e4083e566
Deleted: sha256:2654f1a3dec83d87d61156288eaf139548070c3007919186d5dd447902f18fa4
Deleted: sha256:67244c46e9dd3e62ad2941f5214a94bdc788bafc3711e5a33e569039e2f46755
Deleted: sha256:b2d3f0034d2b6a17256e4d23a97f54c73fc5a2f2b410262e1c0f99dae1ffeb8f
Deleted: sha256:7dacb1f0dbe38b1f77723cc1560c517cf8aeda388356186e7ae3abd55c722dbb
Deleted: sha256:47f3822e84d5ed9cdf3904375a86addc1f05806c1d47a40a251f03a549357337
Deleted: sha256:56ecd613d049745de10e180a61dbe8aa78ea45cabad7399b7e5ccda73fdda046
Deleted: sha256:303a9d1f5dbaf319586adadfe93239085bc3a633444d9c75de95c439cb8f1192
Deleted: sha256:713516a7f5cb0a866f19bc66d24f264bd3ce882d00f934256433a052c7b7c73d
Deleted: sha256:05d2a7b4bfcbe36185c2ad8a954c366b4ddb62e331849c8046bccd46ec271607
Deleted: sha256:935890cdf2560f7726f5e4eff3210e4040dcb5f6fda3e27bfef63c133117986a
Deleted: sha256:c01961a50f2cf2464af202d561d235a23f47a75c615cad7f371bc6de49eb384e
Deleted: sha256:0c2bb13d789a3758b318f03467ffa01d73a08fb5339dc23f364dad2b9b94bb33
Deleted: sha256:3c29f4b9026b83377f83afddf1e7e7bf8a22c6c1e0861d1a97dd9b196acaff7d
Deleted: sha256:2c203d56d29c7aadd32fb197504ceab353fba042246f17589aba99e338d38636
Deleted: sha256:20354a4945337e15b337a26465acbb19d7da29738f06b3a7ed79464d9178a564
Deleted: sha256:902cbf55fdf09a4a8306eec57e75b8670a1e4dfbb9d3929e2862ce02280a1136
Deleted: sha256:501091ec83e2a2d0d399d34414475f21b08a50fd4b2813470d96921863a373b1
Deleted: sha256:4241d9b9c837f5f5eea65faa80c5acdd1df4a35f230610e3c4a182c8ede620f9
Deleted: sha256:397c63ca109940788b2b048f3d310ea2e76817f63378c542828480e3792bce40
Deleted: sha256:b314dcabeb427ea8fd7a2ac5c23ceb41910104aa6958b69ab5181801410f9b7a
Deleted: sha256:799e39025953ee1fa8b960021c458f01eaefdd548cc6e3aab9f277fae492d2fb
Deleted: sha256:c0ba3c41f0560f2e13133cf43e56b4810f2ab6416423bc0c3f7df252d1eae5e7
Deleted: sha256:42b2b40361b269b49262275d6643fda4f24486aed0a9554cce591c52b3293292
Deleted: sha256:3cda5d98306e32aea61350fddd5d27802929c4631b97f85a4fc282a799cdcbc5
Deleted: sha256:ef289bb5938c7e1c66dba69ae517d041aab0ff6445d70b446be6e646186244f0
Deleted: sha256:0dd71651e608298b1e564f3834cf0b10aa0415047a05e50b2a03ce274c1cfdf5
Deleted: sha256:59906b4f2bd62f836746ece188d0c7fb5d37d5c0446f594eb6e0106e5d7536fb
Deleted: sha256:7a3467a5fac733d875627d322dea97f1a6b0bf64e84a5996cded102ce946a394
Deleted: sha256:7a1c9ca576e19e0d6f867bd884cf29c331449f205dd65d84bd1062075d3aacc6
Deleted: sha256:02bd285ced63d40f615832fd4a3472643b67d4a179012be75cbe68df06147a45
Tag: [us.gcr.io/apache-beam-testing/java-postcommit-it/java:20220408083852]
- referencing digest:
[us.gcr.io/apache-beam-testing/java-postcommit-it/java@sha256:0b12583fb5b4e1046be77ab82837de868bc49b4e8ba96028e4b46b4b69467abf]
Deleted [[us.gcr.io/apache-beam-testing/java-postcommit-it/java:20220408083852]
(referencing
[us.gcr.io/apache-beam-testing/java-postcommit-it/java@sha256:0b12583fb5b4e1046be77ab82837de868bc49b4e8ba96028e4b46b4b69467abf])].
Removing untagged image
us.gcr.io/apache-beam-testing/java-postcommit-it/java@sha256:0b12583fb5b4e1046be77ab82837de868bc49b4e8ba96028e4b46b4b69467abf
Digests:
-
us.gcr.io/apache-beam-testing/java-postcommit-it/java@sha256:0b12583fb5b4e1046be77ab82837de868bc49b4e8ba96028e4b46b4b69467abf
Deleted
[us.gcr.io/apache-beam-testing/java-postcommit-it/java@sha256:0b12583fb5b4e1046be77ab82837de868bc49b4e8ba96028e4b46b4b69467abf].
FAILURE: Build failed with an exception.
* What went wrong:
Execution failed for task ':sdks:java:testing:nexmark:run'.
> Process 'command '/usr/lib/jvm/java-8-openjdk-amd64/bin/java'' finished with
> non-zero exit value 1
* Try:
> Run with --stacktrace option to get the stack trace.
> Run with --info or --debug option to get more log output.
> Run with --scan to get full insights.
* Get more help at https://help.gradle.org
Deprecated Gradle features were used in this build, making it incompatible with
Gradle 8.0.
You can use '--warning-mode all' to show the individual deprecation warnings
and determine if they come from your own scripts or plugins.
See
https://docs.gradle.org/7.3.2/userguide/command_line_interface.html#sec:command_line_warnings
Execution optimizations have been disabled for 1 invalid unit(s) of work during
this build to ensure correctness.
Please consult deprecation warnings for more details.
BUILD FAILED in 3h 23m 10s
131 actionable tasks: 9 executed, 122 up-to-date
Publishing build scan...
https://gradle.com/s/dmooanzrjscys
Build step 'Invoke Gradle script' changed build result to FAILURE
Build step 'Invoke Gradle script' marked build as failure
---------------------------------------------------------------------
To unsubscribe, e-mail: [email protected]
For additional commands, e-mail: [email protected]
