See
<https://ci-beam.apache.org/job/beam_PostCommit_Java_Nexmark_Dataflow_V2/1821/display/redirect?page=changes>
Changes:
[noreply] [Website] add Python to KinesisIO in connectors #22845 (#22841)
[noreply] Combining state integration test (#22846)
[noreply] Small lint fixes (#22890)
------------------------------------------
[...truncated 727.64 KB...]
2022-08-25T23:57:45.177Z no activity
2022-08-25T23:58:00.219Z RUNNING Query7 (waiting for shutdown)
2022-08-25T23:58:01.179Z 4 samples not enough to calculate steady-state event
rate
2022-08-25T23:58:01.180Z no activity
2022-08-25T23:58:16.240Z RUNNING Query7 (waiting for shutdown)
2022-08-25T23:58:17.278Z 4 samples not enough to calculate steady-state event
rate
2022-08-25T23:58:17.278Z no activity
2022-08-25T23:58:32.332Z RUNNING Query7 (waiting for shutdown)
2022-08-25T23:58:33.450Z 4 samples not enough to calculate steady-state event
rate
2022-08-25T23:58:33.450Z no activity
2022-08-25T23:58:48.495Z RUNNING Query7 (waiting for shutdown)
2022-08-25T23:58:49.536Z 4 samples not enough to calculate steady-state event
rate
2022-08-25T23:58:49.536Z no activity
2022-08-25T23:59:04.603Z RUNNING Query7 (waiting for shutdown)
2022-08-25T23:59:05.651Z 4 samples not enough to calculate steady-state event
rate
2022-08-25T23:59:05.651Z no activity
2022-08-25T23:59:20.692Z RUNNING Query7 (waiting for shutdown)
2022-08-25T23:59:21.766Z 4 samples not enough to calculate steady-state event
rate
2022-08-25T23:59:21.766Z no activity
2022-08-25T23:59:36.824Z RUNNING Query7 (waiting for shutdown)
2022-08-25T23:59:37.794Z 4 samples not enough to calculate steady-state event
rate
2022-08-25T23:59:37.794Z no activity
2022-08-25T23:59:52.854Z RUNNING Query7 (waiting for shutdown)
2022-08-25T23:59:53.773Z 4 samples not enough to calculate steady-state event
rate
2022-08-25T23:59:53.773Z no activity
2022-08-26T00:00:08.812Z RUNNING Query7 (waiting for shutdown)
2022-08-26T00:00:09.891Z 4 samples not enough to calculate steady-state event
rate
2022-08-26T00:00:09.892Z no activity
2022-08-26T00:00:24.971Z RUNNING Query7 (waiting for shutdown)
2022-08-26T00:00:26.179Z 4 samples not enough to calculate steady-state event
rate
2022-08-26T00:00:26.179Z no activity
2022-08-26T00:00:41.217Z RUNNING Query7 (waiting for shutdown)
2022-08-26T00:00:42.307Z 4 samples not enough to calculate steady-state event
rate
2022-08-26T00:00:42.308Z no activity
2022-08-26T00:00:57.383Z RUNNING Query7 (waiting for shutdown)
2022-08-26T00:00:58.567Z 4 samples not enough to calculate steady-state event
rate
2022-08-26T00:00:58.568Z no activity
2022-08-26T00:01:13.678Z RUNNING Query7 (waiting for shutdown)
2022-08-26T00:01:14.669Z 4 samples not enough to calculate steady-state event
rate
2022-08-26T00:01:14.669Z no activity
2022-08-26T00:01:29.712Z RUNNING Query7 (waiting for shutdown)
2022-08-26T00:01:30.726Z 4 samples not enough to calculate steady-state event
rate
2022-08-26T00:01:30.726Z no activity
2022-08-26T00:01:45.792Z RUNNING Query7 (waiting for shutdown)
2022-08-26T00:01:47.030Z 4 samples not enough to calculate steady-state event
rate
2022-08-26T00:01:47.030Z no activity
2022-08-26T00:02:02.156Z RUNNING Query7 (waiting for shutdown)
2022-08-26T00:02:03.153Z 4 samples not enough to calculate steady-state event
rate
2022-08-26T00:02:03.153Z no activity
2022-08-26T00:02:18.194Z RUNNING Query7 (waiting for shutdown)
2022-08-26T00:02:19.289Z 4 samples not enough to calculate steady-state event
rate
2022-08-26T00:02:19.289Z no activity
2022-08-26T00:02:34.331Z RUNNING Query7 (waiting for shutdown)
2022-08-26T00:02:35.398Z 4 samples not enough to calculate steady-state event
rate
2022-08-26T00:02:35.398Z no activity
2022-08-26T00:02:50.490Z RUNNING Query7 (waiting for shutdown)
2022-08-26T00:02:51.504Z 4 samples not enough to calculate steady-state event
rate
2022-08-26T00:02:51.504Z no activity
2022-08-26T00:03:06.546Z RUNNING Query7 (waiting for shutdown)
2022-08-26T00:03:07.586Z 4 samples not enough to calculate steady-state event
rate
2022-08-26T00:03:07.586Z no activity
2022-08-26T00:03:22.627Z RUNNING Query7 (waiting for shutdown)
2022-08-26T00:03:23.781Z 4 samples not enough to calculate steady-state event
rate
2022-08-26T00:03:23.781Z no activity
2022-08-26T00:03:38.822Z RUNNING Query7 (waiting for shutdown)
2022-08-26T00:03:40.116Z 4 samples not enough to calculate steady-state event
rate
2022-08-26T00:03:40.116Z no activity
2022-08-26T00:03:55.164Z CANCELLED Query7 (waiting for shutdown)
2022-08-26T00:03:55.237Z 4 samples not enough to calculate steady-state event
rate
==========================================================================================
Run started 2022-08-25T20:42:11.296Z and ran for PT12103.941S
Default configuration:
{"debug":true,"query":null,"sourceType":"DIRECT","generateEventFilePathPrefix":null,"sinkType":"DEVNULL","exportSummaryToBigQuery":false,"pubSubMode":"COMBINED","pubsubMessageSerializationMethod":"CODER","sideInputType":"DIRECT","sideInputRowCount":500,"sideInputNumShards":3,"sideInputUrl":null,"sessionGap":600000,"numEvents":100000,"numEventGenerators":100,"rateShape":"SINE","firstEventRate":10000,"nextEventRate":10000,"rateUnit":"PER_SECOND","ratePeriodSec":600,"preloadSeconds":0,"streamTimeout":240,"isRateLimited":false,"useWallclockEventTime":false,"avgPersonByteSize":200,"avgAuctionByteSize":500,"avgBidByteSize":100,"hotAuctionRatio":2,"hotSellersRatio":4,"hotBiddersRatio":4,"windowSizeSec":10,"windowPeriodSec":5,"watermarkHoldbackSec":0,"numInFlightAuctions":100,"numActivePeople":1000,"coderStrategy":"HAND","cpuDelayMs":0,"diskBusyBytes":0,"auctionSkip":123,"fanout":5,"maxAuctionsWaitingTime":600,"occasionalDelaySec":3,"probDelayedEvent":0.1,"maxLogEvents":100000,"usePubsubPublishTime":false,"outOfOrderGroupSize":1,"numKeyBuckets":20000,"pardoCPUFactor":1.0}
Configurations:
Conf Description
0000 query:PASSTHROUGH; numEvents:10000000
0001 query:CURRENCY_CONVERSION; numEvents:10000000
0002 query:SELECTION; numEvents:10000000
0003 query:LOCAL_ITEM_SUGGESTION; numEvents:10000000
0004 query:AVERAGE_PRICE_FOR_CATEGORY; numEvents:1000000
0005 query:HOT_ITEMS; numEvents:10000000
0006 query:AVERAGE_SELLING_PRICE_BY_SELLER; numEvents:1000000
0007 query:HIGHEST_BID; numEvents:10000000
0008 query:MONITOR_NEW_USERS; numEvents:10000000
0009 query:WINNING_BIDS; numEvents:1000000
0010 query:LOG_TO_SHARDED_FILES; numEvents:10000000
0011 query:USER_SESSIONS; numEvents:10000000
0012 query:PROCESSING_TIME_WINDOWS; numEvents:10000000
0013 query:PORTABILITY_BATCH; numEvents:10000000
0014 query:RESHUFFLE; numEvents:10000000
0015 query:BOUNDED_SIDE_INPUT_JOIN; numEvents:10000000
0016 query:SESSION_SIDE_INPUT_JOIN; numEvents:10000000
Performance:
Conf Runtime(sec) (Baseline) Events(/sec) (Baseline) Results
(Baseline)
0000 54.1 184880.5 10000000
0001 45.1 234865.5 9748932
0002 21.8 459706.7 83527
0003 54.7 182858.8 59507
0004 *** not run ***
0005 233.2 42873.4 4567
0006 *** not run ***
0007 159.9 62538.3 96
*** Job was unexpectedly cancelled ***
0008 63.7 156934.1 92833
0009 *** not run ***
0010 106.7 93703.1 100
0011 181.0 55245.9 1839657
0012 79.5 125727.6 330982
0013 *** not run ***
0014 96.0 104218.8 10000000
0015 *** not run ***
0016 *** not run ***
==========================================================================================
==========================================================================================
Run started 2022-08-25T20:42:11.296Z and ran for PT12104.314S
Default configuration:
{"debug":true,"query":null,"sourceType":"DIRECT","generateEventFilePathPrefix":null,"sinkType":"DEVNULL","exportSummaryToBigQuery":false,"pubSubMode":"COMBINED","pubsubMessageSerializationMethod":"CODER","sideInputType":"DIRECT","sideInputRowCount":500,"sideInputNumShards":3,"sideInputUrl":null,"sessionGap":600000,"numEvents":100000,"numEventGenerators":100,"rateShape":"SINE","firstEventRate":10000,"nextEventRate":10000,"rateUnit":"PER_SECOND","ratePeriodSec":600,"preloadSeconds":0,"streamTimeout":240,"isRateLimited":false,"useWallclockEventTime":false,"avgPersonByteSize":200,"avgAuctionByteSize":500,"avgBidByteSize":100,"hotAuctionRatio":2,"hotSellersRatio":4,"hotBiddersRatio":4,"windowSizeSec":10,"windowPeriodSec":5,"watermarkHoldbackSec":0,"numInFlightAuctions":100,"numActivePeople":1000,"coderStrategy":"HAND","cpuDelayMs":0,"diskBusyBytes":0,"auctionSkip":123,"fanout":5,"maxAuctionsWaitingTime":600,"occasionalDelaySec":3,"probDelayedEvent":0.1,"maxLogEvents":100000,"usePubsubPublishTime":false,"outOfOrderGroupSize":1,"numKeyBuckets":20000,"pardoCPUFactor":1.0}
Configurations:
Conf Description
0000 query:PASSTHROUGH; numEvents:10000000
0001 query:CURRENCY_CONVERSION; numEvents:10000000
0002 query:SELECTION; numEvents:10000000
0003 query:LOCAL_ITEM_SUGGESTION; numEvents:10000000
0004 query:AVERAGE_PRICE_FOR_CATEGORY; numEvents:1000000
0005 query:HOT_ITEMS; numEvents:10000000
0006 query:AVERAGE_SELLING_PRICE_BY_SELLER; numEvents:1000000
0007 query:HIGHEST_BID; numEvents:10000000
0008 query:MONITOR_NEW_USERS; numEvents:10000000
0009 query:WINNING_BIDS; numEvents:1000000
0010 query:LOG_TO_SHARDED_FILES; numEvents:10000000
0011 query:USER_SESSIONS; numEvents:10000000
0012 query:PROCESSING_TIME_WINDOWS; numEvents:10000000
0013 query:PORTABILITY_BATCH; numEvents:10000000
0014 query:RESHUFFLE; numEvents:10000000
0015 query:BOUNDED_SIDE_INPUT_JOIN; numEvents:10000000
0016 query:SESSION_SIDE_INPUT_JOIN; numEvents:10000000
Performance:
Conf Runtime(sec) (Baseline) Events(/sec) (Baseline) Results
(Baseline)
0000 54.1 184880.5 10000000
0001 45.1 234865.5 9748932
0002 21.8 459706.7 83527
0003 54.7 182858.8 59507
0004 *** not run ***
0005 233.2 42873.4 4567
0006 *** not run ***
0007 159.9 62538.3 96
*** Job was unexpectedly cancelled ***
0008 63.7 156934.1 92833
0009 *** not run ***
0010 106.7 93703.1 100
0011 181.0 55245.9 1839657
0012 79.5 125727.6 330982
0013 *** not run ***
0014 96.0 104218.8 10000000
0015 *** not run ***
0016 *** not run ***
==========================================================================================
Exception in thread "main" java.lang.RuntimeException: Execution was not
successful
at org.apache.beam.sdk.nexmark.Main.runAll(Main.java:176)
at org.apache.beam.sdk.nexmark.Main.main(Main.java:467)
> Task :sdks:java:testing:nexmark:run FAILED
> Task :runners:google-cloud-dataflow-java:cleanUpDockerJavaImages
Untagged: us.gcr.io/apache-beam-testing/java-postcommit-it/java:20220825204027
Untagged:
us.gcr.io/apache-beam-testing/java-postcommit-it/java@sha256:6ab35eae61d642848c66b71091176a472375eaee771850783630192b5cb891c2
Deleted: sha256:ad4171f55326b097678bfd33646192a427c6cd925134e5434c15d6e76ffafcb9
Deleted: sha256:e9998dea537160a04077b9f84ff9290337e54811667a69411eee1d3bf07325be
Deleted: sha256:c5765dc1dfe62a2cd56d9fbb7bfd1c71ba0a7393d860d3179d8d61b8ee60c1fb
Deleted: sha256:1c89081aea014a8f45f935f629d240f1f9730518d64da2de33a0343053ecd5d6
Deleted: sha256:29f73bb23010202c814bd646169b8091fc5a7392583262a5b9e36bd9ae8c0ee9
Deleted: sha256:f1594d77ee1574329e008b479de0dcde483f3f6f4dac97c64a64cd3f477e11ab
Deleted: sha256:150bf606517e4f79003fedb6cecea27322608cddfe49f6269b4cf7809c445062
Deleted: sha256:26bdb53915cdb43df73b876dc7907fb82abc99991db80281ccc1bfb5518b401e
Deleted: sha256:bea55c9e9b79f5738b1d79bd0cfa8d19e615a1328034e9d16b5bec7605b4cf83
Deleted: sha256:a65e165ca35b9f5fc306efa78d559dc199261a11f275c0465dc8e73886d9f0ae
Deleted: sha256:0dd952ae9ee99b20bda9f323469bca5e863300ce3c1a38172f08061b3f654da4
Deleted: sha256:bed8c50589e4dc48cb00aaeecc2a433c399ec1d4f639430b4a0c2ba3094046c9
Deleted: sha256:fae56346162a231afb445119647717e38a7e92a2b39bd0f99801256a1b2dab35
Deleted: sha256:43a3f33571ba02f1a943aceedcb6c41b8b1086447a5597c1dd07b41c9fd13d18
Deleted: sha256:5e40391fecbd3510481915121eba3a9f7dc1df375bb51ef7a49f02674b43450e
Deleted: sha256:a3cd29d8edf48b548780434facf1c70dcf929684a8dc02234ed7408333812bf9
Deleted: sha256:302d2550f47f0200271bfb6601189cd4cabbbc25fc5d097ceb7a83cbe09bdb70
Deleted: sha256:4e87162f2e3afb032adccd6da723c6c63feedf902406e4a100b67775b68d381b
Deleted: sha256:78b1b1ca4a45486dbf2ef164a5ef2cfb58252f18324464fb80daa951223cecd3
Deleted: sha256:98baae13b65724a23ae8ccd874ecabedcbd0377bbcce4f8ce5e907d7c44e0fce
Deleted: sha256:4653e26c286c9298c8b2a0fbb5270f0e6871eaa47e524f984dbed3e6b05514bb
Deleted: sha256:9dcc83e3e0031ebc639c0ce162301408025b0027605e6c14dd4c78250077233c
Deleted: sha256:0753198ea20f7ca36662ca03d3b29dcb9f9324a67ebf876f42c8d17f61ffd40a
Deleted: sha256:2082e9883fcf7c5d665af3667ad1aa726f9a1f3a8fcdd2db17917d68f7a709fa
Deleted: sha256:eff7dd0a1f3494cfdc5dc127e724f16466a520717a2b16b87e46e10ee5147628
Deleted: sha256:9386c67f71385f23c87f638f78fa4a4ed475a66cb1d331736cb9b4c738b26c6a
Deleted: sha256:8c69cc77a4f051044656647c97c01154b87c063779db148086bf958ff0e0e6ee
Deleted: sha256:10b5d019e8ca8689ff45e42384ac1f8e9a0534d76324e540fc615f073e7d8b53
Deleted: sha256:e83731942b0c5c7674763669c9bf7ca3fe8c088e5031d328eb6f0a1170bebcb6
Deleted: sha256:378dcde8b313407f524185e5837e74d32a6157143555931414f0af67ff87761f
Deleted: sha256:421b7cf83cdd7e1a9c6e3677d355928f6800be5e64824cda28760bab1b2c22f0
Deleted: sha256:b11601cc43550ae372dffa74925bff79f8646a898166279a4744cd16e9568825
Deleted: sha256:c72cd79ff6362d2fcfd65f1418e0070d2d5b041ac2d97d857890a37e380696ad
Deleted: sha256:7517b512a983ffcc2e249ea725b23697f5470c00e57c0f7a4bd8d27b0721f611
Tag: [us.gcr.io/apache-beam-testing/java-postcommit-it/java:20220825204027]
- referencing digest:
[us.gcr.io/apache-beam-testing/java-postcommit-it/java@sha256:6ab35eae61d642848c66b71091176a472375eaee771850783630192b5cb891c2]
Deleted [[us.gcr.io/apache-beam-testing/java-postcommit-it/java:20220825204027]
(referencing
[us.gcr.io/apache-beam-testing/java-postcommit-it/java@sha256:6ab35eae61d642848c66b71091176a472375eaee771850783630192b5cb891c2])].
Removing untagged image
us.gcr.io/apache-beam-testing/java-postcommit-it/java@sha256:6ab35eae61d642848c66b71091176a472375eaee771850783630192b5cb891c2
Digests:
-
us.gcr.io/apache-beam-testing/java-postcommit-it/java@sha256:6ab35eae61d642848c66b71091176a472375eaee771850783630192b5cb891c2
Deleted
[us.gcr.io/apache-beam-testing/java-postcommit-it/java@sha256:6ab35eae61d642848c66b71091176a472375eaee771850783630192b5cb891c2].
FAILURE: Build failed with an exception.
* What went wrong:
Execution failed for task ':sdks:java:testing:nexmark:run'.
> Process 'command '/usr/lib/jvm/java-8-openjdk-amd64/bin/java'' finished with
> non-zero exit value 1
* Try:
> Run with --stacktrace option to get the stack trace.
> Run with --info or --debug option to get more log output.
> Run with --scan to get full insights.
* Get more help at https://help.gradle.org
Deprecated Gradle features were used in this build, making it incompatible with
Gradle 8.0.
You can use '--warning-mode all' to show the individual deprecation warnings
and determine if they come from your own scripts or plugins.
See
https://docs.gradle.org/7.4/userguide/command_line_interface.html#sec:command_line_warnings
Execution optimizations have been disabled for 1 invalid unit(s) of work during
this build to ensure correctness.
Please consult deprecation warnings for more details.
BUILD FAILED in 3h 23m 40s
131 actionable tasks: 9 executed, 122 up-to-date
Publishing build scan...
https://gradle.com/s/xsjdytwn7qv2c
Build step 'Invoke Gradle script' changed build result to FAILURE
Build step 'Invoke Gradle script' marked build as failure
---------------------------------------------------------------------
To unsubscribe, e-mail: [email protected]
For additional commands, e-mail: [email protected]
