See
<https://ci-beam.apache.org/job/beam_PostCommit_Java_Nexmark_Dataflow_V2/2035/display/redirect?page=changes>
Changes:
[Alexey Romanenko] [TPC-DS] Use "nonpartitioned" input for Jenkins jobs
[noreply] Update scopes to match the existing set and update test to clear
------------------------------------------
[...truncated 735.87 KB...]
2022-10-18T11:57:16.145Z 3 samples not enough to calculate steady-state event
rate
2022-10-18T11:57:16.145Z no activity
2022-10-18T11:57:31.206Z RUNNING Query7 (waiting for shutdown)
2022-10-18T11:57:32.099Z 3 samples not enough to calculate steady-state event
rate
2022-10-18T11:57:32.099Z no activity
2022-10-18T11:57:47.144Z RUNNING Query7 (waiting for shutdown)
2022-10-18T11:57:47.845Z 3 samples not enough to calculate steady-state event
rate
2022-10-18T11:57:47.846Z no activity
2022-10-18T11:58:02.894Z RUNNING Query7 (waiting for shutdown)
2022-10-18T11:58:03.722Z 3 samples not enough to calculate steady-state event
rate
2022-10-18T11:58:03.722Z no activity
2022-10-18T11:58:18.779Z RUNNING Query7 (waiting for shutdown)
2022-10-18T11:58:19.550Z 3 samples not enough to calculate steady-state event
rate
2022-10-18T11:58:19.550Z no activity
2022-10-18T11:58:34.709Z RUNNING Query7 (waiting for shutdown)
2022-10-18T11:58:35.546Z 3 samples not enough to calculate steady-state event
rate
2022-10-18T11:58:35.546Z no activity
2022-10-18T11:58:50.595Z RUNNING Query7 (waiting for shutdown)
2022-10-18T11:58:51.357Z 3 samples not enough to calculate steady-state event
rate
2022-10-18T11:58:51.357Z no activity
2022-10-18T11:59:06.414Z RUNNING Query7 (waiting for shutdown)
2022-10-18T11:59:07.257Z 3 samples not enough to calculate steady-state event
rate
2022-10-18T11:59:07.257Z no activity
2022-10-18T11:59:22.301Z RUNNING Query7 (waiting for shutdown)
2022-10-18T11:59:23.378Z 3 samples not enough to calculate steady-state event
rate
2022-10-18T11:59:23.378Z no activity
2022-10-18T11:59:38.428Z RUNNING Query7 (waiting for shutdown)
2022-10-18T11:59:39.175Z 3 samples not enough to calculate steady-state event
rate
2022-10-18T11:59:39.175Z no activity
2022-10-18T11:59:54.224Z RUNNING Query7 (waiting for shutdown)
2022-10-18T11:59:54.948Z 3 samples not enough to calculate steady-state event
rate
2022-10-18T11:59:54.948Z no activity
2022-10-18T12:00:09.999Z RUNNING Query7 (waiting for shutdown)
2022-10-18T12:00:10.825Z 3 samples not enough to calculate steady-state event
rate
2022-10-18T12:00:10.825Z no activity
2022-10-18T12:00:25.880Z RUNNING Query7 (waiting for shutdown)
2022-10-18T12:00:26.651Z 3 samples not enough to calculate steady-state event
rate
2022-10-18T12:00:26.651Z no activity
2022-10-18T12:00:41.696Z RUNNING Query7 (waiting for shutdown)
2022-10-18T12:00:42.458Z 3 samples not enough to calculate steady-state event
rate
2022-10-18T12:00:42.458Z no activity
2022-10-18T12:00:57.511Z RUNNING Query7 (waiting for shutdown)
2022-10-18T12:00:58.309Z 3 samples not enough to calculate steady-state event
rate
2022-10-18T12:00:58.309Z no activity
2022-10-18T12:01:13.356Z RUNNING Query7 (waiting for shutdown)
2022-10-18T12:01:14.049Z 3 samples not enough to calculate steady-state event
rate
2022-10-18T12:01:14.049Z no activity
2022-10-18T12:01:29.099Z RUNNING Query7 (waiting for shutdown)
2022-10-18T12:01:29.876Z 3 samples not enough to calculate steady-state event
rate
2022-10-18T12:01:29.876Z no activity
2022-10-18T12:01:44.914Z RUNNING Query7 (waiting for shutdown)
2022-10-18T12:01:45.594Z 3 samples not enough to calculate steady-state event
rate
2022-10-18T12:01:45.594Z no activity
2022-10-18T12:02:00.641Z RUNNING Query7 (waiting for shutdown)
2022-10-18T12:02:01.775Z 3 samples not enough to calculate steady-state event
rate
2022-10-18T12:02:01.775Z no activity
2022-10-18T12:02:16.830Z RUNNING Query7 (waiting for shutdown)
2022-10-18T12:02:17.551Z 3 samples not enough to calculate steady-state event
rate
2022-10-18T12:02:17.551Z no activity
2022-10-18T12:02:32.593Z RUNNING Query7 (waiting for shutdown)
2022-10-18T12:02:33.329Z 3 samples not enough to calculate steady-state event
rate
2022-10-18T12:02:33.329Z no activity
2022-10-18T12:02:48.368Z RUNNING Query7 (waiting for shutdown)
2022-10-18T12:02:49.033Z 3 samples not enough to calculate steady-state event
rate
2022-10-18T12:02:49.033Z no activity
2022-10-18T12:03:04.092Z RUNNING Query7 (waiting for shutdown)
2022-10-18T12:03:04.511Z 3 samples not enough to calculate steady-state event
rate
2022-10-18T12:03:04.511Z no activity
2022-10-18T12:03:19.511Z CANCELLED Query7 (waiting for shutdown)
2022-10-18T12:03:19.512Z 3 samples not enough to calculate steady-state event
rate
==========================================================================================
Run started 2022-10-18T08:41:43.976Z and ran for PT12095.536S
Default configuration:
{"debug":true,"query":null,"sourceType":"DIRECT","generateEventFilePathPrefix":null,"sinkType":"DEVNULL","exportSummaryToBigQuery":false,"pubSubMode":"COMBINED","pubsubMessageSerializationMethod":"CODER","sideInputType":"DIRECT","sideInputRowCount":500,"sideInputNumShards":3,"sideInputUrl":null,"sessionGap":600000,"numEvents":100000,"numEventGenerators":100,"rateShape":"SINE","firstEventRate":10000,"nextEventRate":10000,"rateUnit":"PER_SECOND","ratePeriodSec":600,"preloadSeconds":0,"streamTimeout":240,"isRateLimited":false,"useWallclockEventTime":false,"avgPersonByteSize":200,"avgAuctionByteSize":500,"avgBidByteSize":100,"hotAuctionRatio":2,"hotSellersRatio":4,"hotBiddersRatio":4,"windowSizeSec":10,"windowPeriodSec":5,"watermarkHoldbackSec":0,"numInFlightAuctions":100,"numActivePeople":1000,"coderStrategy":"HAND","cpuDelayMs":0,"diskBusyBytes":0,"auctionSkip":123,"fanout":5,"maxAuctionsWaitingTime":600,"occasionalDelaySec":3,"probDelayedEvent":0.1,"maxLogEvents":100000,"usePubsubPublishTime":false,"outOfOrderGroupSize":1,"numKeyBuckets":20000,"pardoCPUFactor":1.0}
Configurations:
Conf Description
0000 query:PASSTHROUGH; numEvents:10000000
0001 query:CURRENCY_CONVERSION; numEvents:10000000
0002 query:SELECTION; numEvents:10000000
0003 query:LOCAL_ITEM_SUGGESTION; numEvents:10000000
0004 query:AVERAGE_PRICE_FOR_CATEGORY; numEvents:1000000
0005 query:HOT_ITEMS; numEvents:10000000
0006 query:AVERAGE_SELLING_PRICE_BY_SELLER; numEvents:1000000
0007 query:HIGHEST_BID; numEvents:10000000
0008 query:MONITOR_NEW_USERS; numEvents:10000000
0009 query:WINNING_BIDS; numEvents:1000000
0010 query:LOG_TO_SHARDED_FILES; numEvents:10000000
0011 query:USER_SESSIONS; numEvents:10000000
0012 query:PROCESSING_TIME_WINDOWS; numEvents:10000000
0013 query:PORTABILITY_BATCH; numEvents:10000000
0014 query:RESHUFFLE; numEvents:10000000
0015 query:BOUNDED_SIDE_INPUT_JOIN; numEvents:10000000
0016 query:SESSION_SIDE_INPUT_JOIN; numEvents:10000000
Performance:
Conf Runtime(sec) (Baseline) Events(/sec) (Baseline) Results
(Baseline)
0000 44.8 223219.3 10000000
0001 40.3 248157.4 9200000
0002 19.1 523149.4 83527
0003 50.8 196738.1 59507
0004 *** not run ***
0005 266.8 37486.9 4567
0006 *** not run ***
0007 204.8 48825.3 91
*** Job was unexpectedly cancelled ***
0008 62.1 160914.0 92833
0009 *** not run ***
0010 96.6 103520.7 100
0011 168.8 59253.3 1839657
0012 100.4 99642.3 321477
0013 *** not run ***
0014 176.1 56775.6 10000000
0015 *** not run ***
0016 *** not run ***
==========================================================================================
==========================================================================================
Run started 2022-10-18T08:41:43.976Z and ran for PT12095.823S
Default configuration:
{"debug":true,"query":null,"sourceType":"DIRECT","generateEventFilePathPrefix":null,"sinkType":"DEVNULL","exportSummaryToBigQuery":false,"pubSubMode":"COMBINED","pubsubMessageSerializationMethod":"CODER","sideInputType":"DIRECT","sideInputRowCount":500,"sideInputNumShards":3,"sideInputUrl":null,"sessionGap":600000,"numEvents":100000,"numEventGenerators":100,"rateShape":"SINE","firstEventRate":10000,"nextEventRate":10000,"rateUnit":"PER_SECOND","ratePeriodSec":600,"preloadSeconds":0,"streamTimeout":240,"isRateLimited":false,"useWallclockEventTime":false,"avgPersonByteSize":200,"avgAuctionByteSize":500,"avgBidByteSize":100,"hotAuctionRatio":2,"hotSellersRatio":4,"hotBiddersRatio":4,"windowSizeSec":10,"windowPeriodSec":5,"watermarkHoldbackSec":0,"numInFlightAuctions":100,"numActivePeople":1000,"coderStrategy":"HAND","cpuDelayMs":0,"diskBusyBytes":0,"auctionSkip":123,"fanout":5,"maxAuctionsWaitingTime":600,"occasionalDelaySec":3,"probDelayedEvent":0.1,"maxLogEvents":100000,"usePubsubPublishTime":false,"outOfOrderGroupSize":1,"numKeyBuckets":20000,"pardoCPUFactor":1.0}
Configurations:
Conf Description
0000 query:PASSTHROUGH; numEvents:10000000
0001 query:CURRENCY_CONVERSION; numEvents:10000000
0002 query:SELECTION; numEvents:10000000
0003 query:LOCAL_ITEM_SUGGESTION; numEvents:10000000
0004 query:AVERAGE_PRICE_FOR_CATEGORY; numEvents:1000000
0005 query:HOT_ITEMS; numEvents:10000000
0006 query:AVERAGE_SELLING_PRICE_BY_SELLER; numEvents:1000000
0007 query:HIGHEST_BID; numEvents:10000000
0008 query:MONITOR_NEW_USERS; numEvents:10000000
0009 query:WINNING_BIDS; numEvents:1000000
0010 query:LOG_TO_SHARDED_FILES; numEvents:10000000
0011 query:USER_SESSIONS; numEvents:10000000
0012 query:PROCESSING_TIME_WINDOWS; numEvents:10000000
0013 query:PORTABILITY_BATCH; numEvents:10000000
0014 query:RESHUFFLE; numEvents:10000000
0015 query:BOUNDED_SIDE_INPUT_JOIN; numEvents:10000000
0016 query:SESSION_SIDE_INPUT_JOIN; numEvents:10000000
Performance:
Conf Runtime(sec) (Baseline) Events(/sec) (Baseline) Results
(Baseline)
0000 44.8 223219.3 10000000
0001 40.3 248157.4 9200000
0002 19.1 523149.4 83527
0003 50.8 196738.1 59507
0004 *** not run ***
0005 266.8 37486.9 4567
0006 *** not run ***
0007 204.8 48825.3 91
*** Job was unexpectedly cancelled ***
0008 62.1 160914.0 92833
0009 *** not run ***
0010 96.6 103520.7 100
0011 168.8 59253.3 1839657
0012 100.4 99642.3 321477
0013 *** not run ***
0014 176.1 56775.6 10000000
0015 *** not run ***
0016 *** not run ***
==========================================================================================
Exception in thread "main" java.lang.RuntimeException: Execution was not
successful
at org.apache.beam.sdk.nexmark.Main.runAll(Main.java:169)
at org.apache.beam.sdk.nexmark.Main.main(Main.java:441)
> Task :sdks:java:testing:nexmark:run FAILED
> Task :runners:google-cloud-dataflow-java:cleanUpDockerJavaImages
Untagged: us.gcr.io/apache-beam-testing/java-postcommit-it/java:20221018084104
Untagged:
us.gcr.io/apache-beam-testing/java-postcommit-it/java@sha256:15e312d0cfe3a9fb68379f04ff58d69d9a8931f37ec4ff83ebc85db1169a9dec
Deleted: sha256:f65b7c65d993f57e41fb4b7009ef85b0bf30f6b3ccc6a2a9ce312285ab9b1013
Deleted: sha256:bf8600b6a508fc39544de9281fb5931d25a7e31c79093fd712ced0b48fa106fc
Deleted: sha256:96fac6aba1723734ad6d1015f16b438ebca775cfd7d452a95db8cc6a44daf40b
Deleted: sha256:ca4e045eb2becf2f554182c051bb646e93382b008d5de31cc2f112146eed50a5
Deleted: sha256:17e08d1f9dad034bc4cb0b6b8a16639f40cc489747f25873b399c350c046027c
Deleted: sha256:84fad29f8788f876c45a15f0ca4db07cf3910a802555a5560a86968000aa81e4
Deleted: sha256:11868ed55a9f5fb16db86605ea74ed84fe73d1b9f12af9079469af00f068cf80
Deleted: sha256:d035136264927a851ce5787c42a9beea23e3bc13429090940c6b41090c85e350
Deleted: sha256:f81e0d400c7a321fd73245cb1c57470342992dab911933636f9bc649f721897a
Deleted: sha256:0382da952f4d999f8b42cda0109603121eb6dfbf079c9310f9c090ef1d4685bf
Deleted: sha256:78320a79b7357c44ee5800dc38c34711915d22e4ff23504140cf4e6e16c6d13f
Deleted: sha256:6c76aa22c5be79d303ab0d5dd6a02b50489e0157a22541ed5ca4689880ad161d
Deleted: sha256:48f39a07ac90c0b2de5c844e00d0f26c4ab30f7c1e7f917a497ff0eec6d7dd8f
Deleted: sha256:17263fd8e0269e62ae15774e7597d7c6e68c48c71f007be2770fa83e6a9edeb6
Deleted: sha256:aa9764403727ec4a9a520dda4ef409be5a12d11f6214d19ea2814d5c66b83709
Deleted: sha256:53993c3278c7455d9042c017514f2eea443c92c3f199ad0644967d138cee760e
Deleted: sha256:dc2d5200d5da815285451026ec8410c9643a492db2e407c21ae49dfd31962cce
Deleted: sha256:3b6f02bc4cc9cfd5a69ef0e9f07c383d0e2fa2cb92c8a69f4fe7f414cde7f832
Deleted: sha256:bd778a94fee773884a46be312b07290c69b796a74acadbaf92aa6a06efc5ae71
Deleted: sha256:a5806866ea5923d918f5e377fadd29810f606951accc41cfa51301abf4ebc26c
Deleted: sha256:9eb92ecb2430d9e4a0e35f1d8b7f062abe70f9441dfde798a3fa397eb7c04d1c
Deleted: sha256:fcef71f0eb43f1a0bc02f0acc3b368df892e597912d4263bc25ad3884b95f7fe
Deleted: sha256:c8f44409e8d46ed8d81c626985481c889cac3664b4b6bb570304906702bf2bfe
Deleted: sha256:ac1661e18ab9bfdd48079e3cdc0a69335c4ee92a1ea9e56995e530b2af14fbaa
Deleted: sha256:a7c12bd2b723fcbafb615bae126ee8832812d36dcfa19963e303856b5fe7d4d4
Deleted: sha256:c102c79676e8022b20e2af6e8d115971fb47b3ac19083725f5695406b602977f
Deleted: sha256:e2c94686165805bdddc7943c2f011d83dea376172b52a16692f2f552aea56a18
Deleted: sha256:a77a44cbb890bf0b8e780f66510742ef6c2e86a9da6369d8854e8ce73f95a767
Deleted: sha256:d86921c850bc23053d186aac0db4194c749fd7c61bfbcc0f9a91463ec34cb65b
Deleted: sha256:c2d716dafbb08a018ad873e7feb7be65a261e932baa465340ec0773e36a6063e
Deleted: sha256:838e180d8086edee73a80ce8cd7a4d64e7bb31173d3d1cc1f50a84d641006fcd
Deleted: sha256:e60fe2b69faa5a61005ca4c8638339dbda4de197695438cd7140cb6b9d76997b
Deleted: sha256:d8763c95877308462f52a1ddf0cb7a705a8817cf78b0292f304fe9538a9b0956
Deleted: sha256:1f25a85b6dae27574ad0518dbf7c2a6019243a016e5b6db7a15923298dab2560
Tag: [us.gcr.io/apache-beam-testing/java-postcommit-it/java:20221018084104]
- referencing digest:
[us.gcr.io/apache-beam-testing/java-postcommit-it/java@sha256:15e312d0cfe3a9fb68379f04ff58d69d9a8931f37ec4ff83ebc85db1169a9dec]
Deleted [[us.gcr.io/apache-beam-testing/java-postcommit-it/java:20221018084104]
(referencing
[us.gcr.io/apache-beam-testing/java-postcommit-it/java@sha256:15e312d0cfe3a9fb68379f04ff58d69d9a8931f37ec4ff83ebc85db1169a9dec])].
Removing untagged image
us.gcr.io/apache-beam-testing/java-postcommit-it/java@sha256:15e312d0cfe3a9fb68379f04ff58d69d9a8931f37ec4ff83ebc85db1169a9dec
Digests:
-
us.gcr.io/apache-beam-testing/java-postcommit-it/java@sha256:15e312d0cfe3a9fb68379f04ff58d69d9a8931f37ec4ff83ebc85db1169a9dec
Deleted
[us.gcr.io/apache-beam-testing/java-postcommit-it/java@sha256:15e312d0cfe3a9fb68379f04ff58d69d9a8931f37ec4ff83ebc85db1169a9dec].
FAILURE: Build failed with an exception.
* What went wrong:
Execution failed for task ':sdks:java:testing:nexmark:run'.
> Process 'command '/usr/lib/jvm/java-8-openjdk-amd64/bin/java'' finished with
> non-zero exit value 1
* Try:
> Run with --stacktrace option to get the stack trace.
> Run with --info or --debug option to get more log output.
* Get more help at https://help.gradle.org
Deprecated Gradle features were used in this build, making it incompatible with
Gradle 8.0.
You can use '--warning-mode all' to show the individual deprecation warnings
and determine if they come from your own scripts or plugins.
See
https://docs.gradle.org/7.5.1/userguide/command_line_interface.html#sec:command_line_warnings
Execution optimizations have been disabled for 1 invalid unit(s) of work during
this build to ensure correctness.
Please consult deprecation warnings for more details.
BUILD FAILED in 3h 22m 29s
131 actionable tasks: 9 executed, 122 up-to-date
Publishing build scan...
https://gradle.com/s/6ywlbnjay6xbu
Build step 'Invoke Gradle script' changed build result to FAILURE
Build step 'Invoke Gradle script' marked build as failure
---------------------------------------------------------------------
To unsubscribe, e-mail: [email protected]
For additional commands, e-mail: [email protected]
