See
<https://ci-beam.apache.org/job/beam_PostCommit_Java_Nexmark_Dataflow_V2/1432/display/redirect?page=changes>
Changes:
[noreply] Remove unused validation configurations. (#17705)
------------------------------------------
[...truncated 277.61 KB...]
SEVERE: Failed to get metric result.elements, from namespace Query11.Results
May 20, 2022 8:39:26 AM org.apache.beam.sdk.testutils.metrics.MetricsReader
getCounterMetric
SEVERE: Failed to get metric result.bytes, from namespace Query11.Results
2022-05-20T08:39:27.135Z no activity
2022-05-20T08:39:42.170Z RUNNING Query11
May 20, 2022 8:39:42 AM org.apache.beam.sdk.testutils.metrics.MetricsReader
getCounterMetric
SEVERE: Failed to get metric result.elements, from namespace Query11.Results
May 20, 2022 8:39:42 AM org.apache.beam.sdk.testutils.metrics.MetricsReader
getCounterMetric
SEVERE: Failed to get metric result.bytes, from namespace Query11.Results
2022-05-20T08:39:42.947Z no activity
2022-05-20T08:39:57.982Z RUNNING Query11
May 20, 2022 8:39:58 AM org.apache.beam.sdk.testutils.metrics.MetricsReader
getCounterMetric
SEVERE: Failed to get metric result.elements, from namespace Query11.Results
May 20, 2022 8:39:58 AM org.apache.beam.sdk.testutils.metrics.MetricsReader
getCounterMetric
SEVERE: Failed to get metric result.bytes, from namespace Query11.Results
2022-05-20T08:39:58.810Z no activity
2022-05-20T08:40:13.848Z RUNNING Query11
May 20, 2022 8:40:14 AM org.apache.beam.sdk.testutils.metrics.MetricsReader
getCounterMetric
SEVERE: Failed to get metric result.elements, from namespace Query11.Results
May 20, 2022 8:40:14 AM org.apache.beam.sdk.testutils.metrics.MetricsReader
getCounterMetric
SEVERE: Failed to get metric result.bytes, from namespace Query11.Results
2022-05-20T08:40:14.958Z no activity
2022-05-20T08:40:30.001Z RUNNING Query11
May 20, 2022 8:40:30 AM org.apache.beam.sdk.testutils.metrics.MetricsReader
getCounterMetric
SEVERE: Failed to get metric result.elements, from namespace Query11.Results
May 20, 2022 8:40:30 AM org.apache.beam.sdk.testutils.metrics.MetricsReader
getCounterMetric
SEVERE: Failed to get metric result.bytes, from namespace Query11.Results
2022-05-20T08:40:30.678Z no activity
2022-05-20T08:40:45.723Z RUNNING Query11
May 20, 2022 8:40:46 AM org.apache.beam.sdk.testutils.metrics.MetricsReader
getCounterMetric
SEVERE: Failed to get metric result.elements, from namespace Query11.Results
May 20, 2022 8:40:46 AM org.apache.beam.sdk.testutils.metrics.MetricsReader
getCounterMetric
SEVERE: Failed to get metric result.bytes, from namespace Query11.Results
2022-05-20T08:40:46.906Z no activity
2022-05-20T08:41:01.948Z RUNNING Query11
May 20, 2022 8:41:02 AM org.apache.beam.sdk.testutils.metrics.MetricsReader
getCounterMetric
SEVERE: Failed to get metric result.elements, from namespace Query11.Results
May 20, 2022 8:41:02 AM org.apache.beam.sdk.testutils.metrics.MetricsReader
getCounterMetric
SEVERE: Failed to get metric result.bytes, from namespace Query11.Results
2022-05-20T08:41:03.138Z no activity
2022-05-20T08:41:18.164Z RUNNING Query11
May 20, 2022 8:41:18 AM org.apache.beam.sdk.testutils.metrics.MetricsReader
getCounterMetric
SEVERE: Failed to get metric result.elements, from namespace Query11.Results
May 20, 2022 8:41:18 AM org.apache.beam.sdk.testutils.metrics.MetricsReader
getCounterMetric
SEVERE: Failed to get metric result.bytes, from namespace Query11.Results
2022-05-20T08:41:18.892Z no activity
2022-05-20T08:41:33.926Z RUNNING Query11
May 20, 2022 8:41:34 AM org.apache.beam.sdk.testutils.metrics.MetricsReader
getCounterMetric
SEVERE: Failed to get metric result.elements, from namespace Query11.Results
May 20, 2022 8:41:34 AM org.apache.beam.sdk.testutils.metrics.MetricsReader
getCounterMetric
SEVERE: Failed to get metric result.bytes, from namespace Query11.Results
2022-05-20T08:41:34.628Z no activity
2022-05-20T08:41:49.668Z RUNNING Query11
May 20, 2022 8:41:50 AM org.apache.beam.sdk.testutils.metrics.MetricsReader
getCounterMetric
SEVERE: Failed to get metric result.elements, from namespace Query11.Results
May 20, 2022 8:41:50 AM org.apache.beam.sdk.testutils.metrics.MetricsReader
getCounterMetric
SEVERE: Failed to get metric result.bytes, from namespace Query11.Results
2022-05-20T08:41:50.388Z no activity
2022-05-20T08:42:05.429Z RUNNING Query11
May 20, 2022 8:42:05 AM org.apache.beam.sdk.testutils.metrics.MetricsReader
getCounterMetric
SEVERE: Failed to get metric result.elements, from namespace Query11.Results
May 20, 2022 8:42:05 AM org.apache.beam.sdk.testutils.metrics.MetricsReader
getCounterMetric
SEVERE: Failed to get metric result.bytes, from namespace Query11.Results
2022-05-20T08:42:06.233Z no activity
2022-05-20T08:42:21.272Z FAILED Query11
May 20, 2022 8:42:21 AM org.apache.beam.sdk.testutils.metrics.MetricsReader
getCounterMetric
SEVERE: Failed to get metric result.elements, from namespace Query11.Results
May 20, 2022 8:42:21 AM org.apache.beam.sdk.testutils.metrics.MetricsReader
getCounterMetric
SEVERE: Failed to get metric result.bytes, from namespace Query11.Results
==========================================================================================
Run started 2022-05-20T08:34:22.621Z and ran for PT478.708S
Default configuration:
{"debug":true,"query":null,"sourceType":"DIRECT","generateEventFilePathPrefix":null,"sinkType":"DEVNULL","exportSummaryToBigQuery":false,"pubSubMode":"COMBINED","pubsubMessageSerializationMethod":"CODER","sideInputType":"DIRECT","sideInputRowCount":500,"sideInputNumShards":3,"sideInputUrl":null,"sessionGap":600000,"numEvents":100000,"numEventGenerators":100,"rateShape":"SINE","firstEventRate":10000,"nextEventRate":10000,"rateUnit":"PER_SECOND","ratePeriodSec":600,"preloadSeconds":0,"streamTimeout":240,"isRateLimited":false,"useWallclockEventTime":false,"avgPersonByteSize":200,"avgAuctionByteSize":500,"avgBidByteSize":100,"hotAuctionRatio":2,"hotSellersRatio":4,"hotBiddersRatio":4,"windowSizeSec":10,"windowPeriodSec":5,"watermarkHoldbackSec":0,"numInFlightAuctions":100,"numActivePeople":1000,"coderStrategy":"HAND","cpuDelayMs":0,"diskBusyBytes":0,"auctionSkip":123,"fanout":5,"maxAuctionsWaitingTime":600,"occasionalDelaySec":3,"probDelayedEvent":0.1,"maxLogEvents":100000,"usePubsubPublishTime":false,"outOfOrderGroupSize":1,"numKeyBuckets":20000,"pardoCPUFactor":1.0}
Configurations:
Conf Description
0000 query:PASSTHROUGH; numEvents:10000000
0001 query:CURRENCY_CONVERSION; numEvents:10000000
0002 query:SELECTION; numEvents:10000000
0003 query:LOCAL_ITEM_SUGGESTION; numEvents:10000000
0004 query:AVERAGE_PRICE_FOR_CATEGORY; numEvents:1000000
0005 query:HOT_ITEMS; numEvents:10000000
0006 query:AVERAGE_SELLING_PRICE_BY_SELLER; numEvents:1000000
0007 query:HIGHEST_BID; numEvents:10000000
0008 query:MONITOR_NEW_USERS; numEvents:10000000
0009 query:WINNING_BIDS; numEvents:1000000
0010 query:LOG_TO_SHARDED_FILES; numEvents:10000000
0011 query:USER_SESSIONS; numEvents:10000000
0012 query:PROCESSING_TIME_WINDOWS; numEvents:10000000
0013 query:PORTABILITY_BATCH; numEvents:10000000
0014 query:RESHUFFLE; numEvents:10000000
0015 query:BOUNDED_SIDE_INPUT_JOIN; numEvents:10000000
0016 query:SESSION_SIDE_INPUT_JOIN; numEvents:10000000
Performance:
Conf Runtime(sec) (Baseline) Events(/sec) (Baseline) Results
(Baseline)
0000 23.2 430978.8 10000000
0001 17.7 564206.7 9200000
0002 9.0 1110987.7 83527
0003 *** not run ***
0004 *** not run ***
0005 38.3 261355.9 4567
0006 *** not run ***
0007 *** not run ***
0008 26.6 376378.5 92833
0009 *** not run ***
0010 48.0 208303.0 100
0011 30.1 331895.1 -1
*** Job was unexpectedly updated ***
0012 18.2 550933.8 199929
0013 44.3 225881.5 10000000
0014 52.5 190596.0 10000000
0015 *** not run ***
0016 *** not run ***
==========================================================================================
==========================================================================================
Run started 2022-05-20T08:34:22.621Z and ran for PT478.977S
Default configuration:
{"debug":true,"query":null,"sourceType":"DIRECT","generateEventFilePathPrefix":null,"sinkType":"DEVNULL","exportSummaryToBigQuery":false,"pubSubMode":"COMBINED","pubsubMessageSerializationMethod":"CODER","sideInputType":"DIRECT","sideInputRowCount":500,"sideInputNumShards":3,"sideInputUrl":null,"sessionGap":600000,"numEvents":100000,"numEventGenerators":100,"rateShape":"SINE","firstEventRate":10000,"nextEventRate":10000,"rateUnit":"PER_SECOND","ratePeriodSec":600,"preloadSeconds":0,"streamTimeout":240,"isRateLimited":false,"useWallclockEventTime":false,"avgPersonByteSize":200,"avgAuctionByteSize":500,"avgBidByteSize":100,"hotAuctionRatio":2,"hotSellersRatio":4,"hotBiddersRatio":4,"windowSizeSec":10,"windowPeriodSec":5,"watermarkHoldbackSec":0,"numInFlightAuctions":100,"numActivePeople":1000,"coderStrategy":"HAND","cpuDelayMs":0,"diskBusyBytes":0,"auctionSkip":123,"fanout":5,"maxAuctionsWaitingTime":600,"occasionalDelaySec":3,"probDelayedEvent":0.1,"maxLogEvents":100000,"usePubsubPublishTime":false,"outOfOrderGroupSize":1,"numKeyBuckets":20000,"pardoCPUFactor":1.0}
Configurations:
Conf Description
0000 query:PASSTHROUGH; numEvents:10000000
0001 query:CURRENCY_CONVERSION; numEvents:10000000
0002 query:SELECTION; numEvents:10000000
0003 query:LOCAL_ITEM_SUGGESTION; numEvents:10000000
0004 query:AVERAGE_PRICE_FOR_CATEGORY; numEvents:1000000
0005 query:HOT_ITEMS; numEvents:10000000
0006 query:AVERAGE_SELLING_PRICE_BY_SELLER; numEvents:1000000
0007 query:HIGHEST_BID; numEvents:10000000
0008 query:MONITOR_NEW_USERS; numEvents:10000000
0009 query:WINNING_BIDS; numEvents:1000000
0010 query:LOG_TO_SHARDED_FILES; numEvents:10000000
0011 query:USER_SESSIONS; numEvents:10000000
0012 query:PROCESSING_TIME_WINDOWS; numEvents:10000000
0013 query:PORTABILITY_BATCH; numEvents:10000000
0014 query:RESHUFFLE; numEvents:10000000
0015 query:BOUNDED_SIDE_INPUT_JOIN; numEvents:10000000
0016 query:SESSION_SIDE_INPUT_JOIN; numEvents:10000000
Performance:
Conf Runtime(sec) (Baseline) Events(/sec) (Baseline) Results
(Baseline)
0000 23.2 430978.8 10000000
0001 17.7 564206.7 9200000
0002 9.0 1110987.7 83527
0003 *** not run ***
0004 *** not run ***
0005 38.3 261355.9 4567
0006 *** not run ***
0007 *** not run ***
0008 26.6 376378.5 92833
0009 *** not run ***
0010 48.0 208303.0 100
0011 30.1 331895.1 -1
*** Job was unexpectedly updated ***
0012 18.2 550933.8 199929
0013 44.3 225881.5 10000000
0014 52.5 190596.0 10000000
0015 *** not run ***
0016 *** not run ***
==========================================================================================
Exception in thread "main" java.lang.RuntimeException: Execution was not
successful
at org.apache.beam.sdk.nexmark.Main.runAll(Main.java:176)
at org.apache.beam.sdk.nexmark.Main.main(Main.java:467)
> Task :sdks:java:testing:nexmark:run FAILED
> Task :runners:google-cloud-dataflow-java:cleanUpDockerJavaImages
Untagged: us.gcr.io/apache-beam-testing/java-postcommit-it/java:20220520083235
Untagged:
us.gcr.io/apache-beam-testing/java-postcommit-it/java@sha256:29b9cf62c8bf98879a204539239e76b9ad7bf6e8a4a077e66230ee036eb50d5d
Deleted: sha256:55e859265595babcbd1f45c2d83fb59924454fb635ab8812c93577f058647da4
Deleted: sha256:711b84129633be9489a5401c04d51efe63d624ea299cd6c73fbfb383a30c221d
Deleted: sha256:66b212cea3babe051abc83e0eb6285e4cd42d93ad43c6070b487dbc2d65ef132
Deleted: sha256:b0854b3854b5debdac44ca205361cf09e2d331cb17d4f649c88af90b04ddafe8
Deleted: sha256:506d0797086f5d57fc8cfb5fbb16e91cb04490da50053eb5f17757dcac0f968b
Deleted: sha256:fd408c019c95b908595fc0b6efa1995435d094cfa80bf5ace148948ebc3174c5
Deleted: sha256:c870ef769c375f955d01d3ad99a9f952c122f410ec68700aff7b2f775645707e
Deleted: sha256:1da69bb5bd83e6d4fa5380908dcd77589569526773ad0fabc77ae7fe684128f6
Deleted: sha256:2838a555a48bd73d93f0648c047a0450dadef522789ef20f7394ed6c2878cdc5
Deleted: sha256:1a2d3d3c001061639b75a9109226397416036775789fe8e07fc15f8407caf9db
Deleted: sha256:5630230e4e494462f37492e06bcd472bc71188b46162f975c8b1b807eeb9d58f
Deleted: sha256:8b8b1343d97073381e8822a8bd55addc0550cda2b8d7165f7c7116d511a0ac52
Deleted: sha256:1ac54e66e8eb767b0e467d5872234600dcc7acd3e118d063765c8e80703e2a39
Deleted: sha256:6cab69299abc713b2a23adc0c42fccb9c2bf3c10b7a1f13e66f0a12e5266ed74
Deleted: sha256:85ba7eb7c666779ce578341bdf10ff472ce013399abd703e7f9a9a6611388767
Deleted: sha256:58c82ebff5d7490a64aebd33047514d4a88354fce034fc90c523e5fa1adb2173
Deleted: sha256:e77bf85a47773f46dbbbd748ee5c8f9a22f12b8cf4edd735722c08e5d482b6d8
Deleted: sha256:d3d04faade45baed2313d603a48d552a6670eea1e2a3e4560b95bd53d8c51563
Deleted: sha256:71c7098dc2a1f163a1c329e7379e1e04ecbafaec4ae74ed192fdd28c6cdd8046
Deleted: sha256:c2277c4687ae4df2c5e7a4c627215faab808b57129bbf344b3d4738f4f4410cf
Deleted: sha256:d2cf009fa484160e4bb89015a1a3d305e6ecb8172b08520bfb8a2dbf50a9f387
Deleted: sha256:9f9d9414541289c6b6238b4f1a4ad954f6a7bd3141602456daa00eb36d27abe8
Deleted: sha256:c1ea95feeaf377d9d4c460326b50bb9beebb7e9f9f67fda531f24604d6d33d30
Deleted: sha256:788b2b739c573f03ddc227038969918e819613006ca544efe8146e40f57cee2f
Deleted: sha256:b9141ae9713e8226c674d4c56661e5d3440eae270836e722a2d8010bdc278a51
Deleted: sha256:f42df6e51db42e97ca5e684eabea11a6844e55bfcf9e3cb4037965428cb49eca
Deleted: sha256:f971df418abf018fa5a817a1340793e2f8fad4200efd09316ce1db81791daa29
Deleted: sha256:0ca06be0271faaeffc27452d075be6ec35b49d35cdb212f6757d915de20f03d7
Deleted: sha256:f0fe45b4180db93a28ac0c2966951ebeb79ffc64a7e3da39ab23f04ed3a0c133
Deleted: sha256:7ad71ceaa35365afdf11c920c796fe63f388f939a38de959ad9dd2017d889a85
Deleted: sha256:0e6f5ae11f3b308865c1b1cb357b795767b82526e072a2aaf185e6e711ce6bcd
Deleted: sha256:8af31fda35876bac7609a88854e955b1b648d224136ce6966a568cd132214611
Deleted: sha256:59e2b615adc9904e0bc4a3a176f2ccd1d6300c17f526cdf80e0b33618f7febe9
Deleted: sha256:e9ae435a780a59cef68ca5ca5333c3d0e34f4161f7eff114086093a43425f825
Tag: [us.gcr.io/apache-beam-testing/java-postcommit-it/java:20220520083235]
- referencing digest:
[us.gcr.io/apache-beam-testing/java-postcommit-it/java@sha256:29b9cf62c8bf98879a204539239e76b9ad7bf6e8a4a077e66230ee036eb50d5d]
Deleted [[us.gcr.io/apache-beam-testing/java-postcommit-it/java:20220520083235]
(referencing
[us.gcr.io/apache-beam-testing/java-postcommit-it/java@sha256:29b9cf62c8bf98879a204539239e76b9ad7bf6e8a4a077e66230ee036eb50d5d])].
Removing untagged image
us.gcr.io/apache-beam-testing/java-postcommit-it/java@sha256:29b9cf62c8bf98879a204539239e76b9ad7bf6e8a4a077e66230ee036eb50d5d
Digests:
-
us.gcr.io/apache-beam-testing/java-postcommit-it/java@sha256:29b9cf62c8bf98879a204539239e76b9ad7bf6e8a4a077e66230ee036eb50d5d
Deleted
[us.gcr.io/apache-beam-testing/java-postcommit-it/java@sha256:29b9cf62c8bf98879a204539239e76b9ad7bf6e8a4a077e66230ee036eb50d5d].
FAILURE: Build failed with an exception.
* What went wrong:
Execution failed for task ':sdks:java:testing:nexmark:run'.
> Process 'command '/usr/lib/jvm/java-8-openjdk-amd64/bin/java'' finished with
> non-zero exit value 1
* Try:
> Run with --stacktrace option to get the stack trace.
> Run with --info or --debug option to get more log output.
> Run with --scan to get full insights.
* Get more help at https://help.gradle.org
Deprecated Gradle features were used in this build, making it incompatible with
Gradle 8.0.
You can use '--warning-mode all' to show the individual deprecation warnings
and determine if they come from your own scripts or plugins.
See
https://docs.gradle.org/7.4/userguide/command_line_interface.html#sec:command_line_warnings
Execution optimizations have been disabled for 1 invalid unit(s) of work during
this build to ensure correctness.
Please consult deprecation warnings for more details.
BUILD FAILED in 10m 8s
136 actionable tasks: 91 executed, 41 from cache, 4 up-to-date
Publishing build scan...
https://gradle.com/s/a7w2o5qmtdrko
Build step 'Invoke Gradle script' changed build result to FAILURE
Build step 'Invoke Gradle script' marked build as failure
---------------------------------------------------------------------
To unsubscribe, e-mail: [email protected]
For additional commands, e-mail: [email protected]