See
<https://ci-beam.apache.org/job/beam_PostCommit_Java_Nexmark_Dataflow_V2/601/display/redirect?page=changes>
Changes:
[noreply] Merge pull request #15761 from [BEAM-13008] Create gradle tasks for
the
------------------------------------------
[...truncated 670.05 KB...]
SEVERE: Failed to get metric fatal, from namespace Query7
2021-10-21T19:17:36.116Z WARNING: streaming query appears to have been stuck
for 57 min.
2021-10-21T19:17:36.116Z no activity
2021-10-21T19:17:51.173Z RUNNING Query7
2021-10-21T19:17:51.966Z 8 samples not enough to calculate steady-state event
rate
Oct 21, 2021 7:17:52 PM org.apache.beam.sdk.testutils.metrics.MetricsReader
getCounterMetric
SEVERE: Failed to get metric fatal, from namespace Query7
2021-10-21T19:17:52.033Z WARNING: streaming query appears to have been stuck
for 57 min.
2021-10-21T19:17:52.033Z no activity
2021-10-21T19:18:07.065Z RUNNING Query7
2021-10-21T19:18:07.817Z 8 samples not enough to calculate steady-state event
rate
Oct 21, 2021 7:18:07 PM org.apache.beam.sdk.testutils.metrics.MetricsReader
getCounterMetric
SEVERE: Failed to get metric fatal, from namespace Query7
2021-10-21T19:18:07.897Z WARNING: streaming query appears to have been stuck
for 57 min.
2021-10-21T19:18:07.897Z no activity
2021-10-21T19:18:22.938Z RUNNING Query7
2021-10-21T19:18:23.873Z 8 samples not enough to calculate steady-state event
rate
Oct 21, 2021 7:18:23 PM org.apache.beam.sdk.testutils.metrics.MetricsReader
getCounterMetric
SEVERE: Failed to get metric fatal, from namespace Query7
2021-10-21T19:18:23.938Z WARNING: streaming query appears to have been stuck
for 57 min.
2021-10-21T19:18:23.938Z no activity
2021-10-21T19:18:38.991Z RUNNING Query7
2021-10-21T19:18:39.746Z 8 samples not enough to calculate steady-state event
rate
Oct 21, 2021 7:18:39 PM org.apache.beam.sdk.testutils.metrics.MetricsReader
getCounterMetric
2021-10-21T19:18:39.836Z WARNING: streaming query appears to have been stuck
for 58 min.
SEVERE: Failed to get metric fatal, from namespace Query7
2021-10-21T19:18:39.836Z no activity
2021-10-21T19:18:54.891Z RUNNING Query7
2021-10-21T19:18:55.708Z 8 samples not enough to calculate steady-state event
rate
Oct 21, 2021 7:18:55 PM org.apache.beam.sdk.testutils.metrics.MetricsReader
getCounterMetric
2021-10-21T19:18:55.797Z WARNING: streaming query appears to have been stuck
for 58 min.
2021-10-21T19:18:55.797Z no activity
SEVERE: Failed to get metric fatal, from namespace Query7
2021-10-21T19:19:10.844Z RUNNING Query7
2021-10-21T19:19:11.903Z 8 samples not enough to calculate steady-state event
rate
Oct 21, 2021 7:19:11 PM org.apache.beam.sdk.testutils.metrics.MetricsReader
getCounterMetric
SEVERE: Failed to get metric fatal, from namespace Query7
2021-10-21T19:19:11.981Z WARNING: streaming query appears to have been stuck
for 58 min.
2021-10-21T19:19:11.981Z no activity
2021-10-21T19:19:27.039Z RUNNING Query7
2021-10-21T19:19:27.814Z 8 samples not enough to calculate steady-state event
rate
Oct 21, 2021 7:19:27 PM org.apache.beam.sdk.testutils.metrics.MetricsReader
getCounterMetric
2021-10-21T19:19:27.891Z WARNING: streaming query appears to have been stuck
for 58 min.
2021-10-21T19:19:27.891Z no activity
SEVERE: Failed to get metric fatal, from namespace Query7
2021-10-21T19:19:42.929Z RUNNING Query7
2021-10-21T19:19:43.757Z 8 samples not enough to calculate steady-state event
rate
Oct 21, 2021 7:19:43 PM org.apache.beam.sdk.testutils.metrics.MetricsReader
getCounterMetric
SEVERE: Failed to get metric fatal, from namespace Query7
2021-10-21T19:19:43.838Z WARNING: streaming query appears to have been stuck
for 59 min.
2021-10-21T19:19:43.838Z no activity
2021-10-21T19:19:58.873Z RUNNING Query7
2021-10-21T19:19:59.598Z 8 samples not enough to calculate steady-state event
rate
Oct 21, 2021 7:19:59 PM org.apache.beam.sdk.testutils.metrics.MetricsReader
getCounterMetric
2021-10-21T19:19:59.679Z WARNING: streaming query appears to have been stuck
for 59 min.
SEVERE: Failed to get metric fatal, from namespace Query7
2021-10-21T19:19:59.679Z no activity
2021-10-21T19:20:14.719Z RUNNING Query7
2021-10-21T19:20:15.561Z 8 samples not enough to calculate steady-state event
rate
Oct 21, 2021 7:20:15 PM org.apache.beam.sdk.testutils.metrics.MetricsReader
getCounterMetric
SEVERE: Failed to get metric fatal, from namespace Query7
2021-10-21T19:20:15.637Z WARNING: streaming query appears to have been stuck
for 59 min.
2021-10-21T19:20:15.637Z no activity
2021-10-21T19:20:30.672Z RUNNING Query7
2021-10-21T19:20:31.480Z 8 samples not enough to calculate steady-state event
rate
Oct 21, 2021 7:20:31 PM org.apache.beam.sdk.testutils.metrics.MetricsReader
getCounterMetric
2021-10-21T19:20:31.566Z ERROR: streaming query appears to have been stuck for
60 minutes, cancelling job.
SEVERE: Failed to get metric fatal, from namespace Query7
2021-10-21T19:20:31.603Z no activity
2021-10-21T19:20:46.636Z RUNNING Query7 (waiting for shutdown)
2021-10-21T19:20:47.420Z 8 samples not enough to calculate steady-state event
rate
2021-10-21T19:20:47.420Z no activity
2021-10-21T19:21:02.462Z RUNNING Query7 (waiting for shutdown)
2021-10-21T19:21:03.302Z 8 samples not enough to calculate steady-state event
rate
2021-10-21T19:21:03.302Z no activity
2021-10-21T19:21:18.345Z RUNNING Query7 (waiting for shutdown)
2021-10-21T19:21:19.236Z 8 samples not enough to calculate steady-state event
rate
2021-10-21T19:21:19.236Z no activity
2021-10-21T19:21:34.271Z RUNNING Query7 (waiting for shutdown)
2021-10-21T19:21:34.942Z 8 samples not enough to calculate steady-state event
rate
2021-10-21T19:21:34.942Z no activity
2021-10-21T19:21:49.972Z RUNNING Query7 (waiting for shutdown)
2021-10-21T19:21:50.692Z 8 samples not enough to calculate steady-state event
rate
2021-10-21T19:21:50.692Z no activity
2021-10-21T19:22:05.726Z RUNNING Query7 (waiting for shutdown)
2021-10-21T19:22:06.392Z 8 samples not enough to calculate steady-state event
rate
2021-10-21T19:22:06.392Z no activity
2021-10-21T19:22:21.425Z RUNNING Query7 (waiting for shutdown)
2021-10-21T19:22:22.056Z 8 samples not enough to calculate steady-state event
rate
2021-10-21T19:22:22.056Z no activity
2021-10-21T19:22:37.104Z RUNNING Query7 (waiting for shutdown)
2021-10-21T19:22:37.816Z 8 samples not enough to calculate steady-state event
rate
2021-10-21T19:22:37.817Z no activity
2021-10-21T19:22:52.853Z RUNNING Query7 (waiting for shutdown)
2021-10-21T19:22:53.551Z 8 samples not enough to calculate steady-state event
rate
2021-10-21T19:22:53.551Z no activity
2021-10-21T19:23:08.590Z CANCELLED Query7 (waiting for shutdown)
2021-10-21T19:23:08.625Z 8 samples not enough to calculate steady-state event
rate
==========================================================================================
Run started 2021-10-21T18:13:16.573Z and ran for PT4192.052S
Default configuration:
{"debug":true,"query":null,"sourceType":"DIRECT","generateEventFilePathPrefix":null,"sinkType":"DEVNULL","exportSummaryToBigQuery":false,"pubSubMode":"COMBINED","pubsubMessageSerializationMethod":"CODER","sideInputType":"DIRECT","sideInputRowCount":500,"sideInputNumShards":3,"sideInputUrl":null,"sessionGap":600000,"numEvents":100000,"numEventGenerators":100,"rateShape":"SINE","firstEventRate":10000,"nextEventRate":10000,"rateUnit":"PER_SECOND","ratePeriodSec":600,"preloadSeconds":0,"streamTimeout":240,"isRateLimited":false,"useWallclockEventTime":false,"avgPersonByteSize":200,"avgAuctionByteSize":500,"avgBidByteSize":100,"hotAuctionRatio":2,"hotSellersRatio":4,"hotBiddersRatio":4,"windowSizeSec":10,"windowPeriodSec":5,"watermarkHoldbackSec":0,"numInFlightAuctions":100,"numActivePeople":1000,"coderStrategy":"HAND","cpuDelayMs":0,"diskBusyBytes":0,"auctionSkip":123,"fanout":5,"maxAuctionsWaitingTime":600,"occasionalDelaySec":3,"probDelayedEvent":0.1,"maxLogEvents":100000,"usePubsubPublishTime":false,"outOfOrderGroupSize":1,"numKeyBuckets":20000,"pardoCPUFactor":1.0}
Configurations:
Conf Description
0000 query:PASSTHROUGH; numEvents:10000000
0001 query:CURRENCY_CONVERSION; numEvents:10000000
0002 query:SELECTION; numEvents:10000000
0003 query:LOCAL_ITEM_SUGGESTION; numEvents:10000000
0004 query:AVERAGE_PRICE_FOR_CATEGORY; numEvents:1000000
0005 query:HOT_ITEMS; numEvents:10000000
0006 query:AVERAGE_SELLING_PRICE_BY_SELLER; numEvents:1000000
0007 query:HIGHEST_BID; numEvents:10000000
0008 query:MONITOR_NEW_USERS; numEvents:10000000
0009 query:WINNING_BIDS; numEvents:1000000
0010 query:LOG_TO_SHARDED_FILES; numEvents:10000000
0011 query:USER_SESSIONS; numEvents:10000000
0012 query:PROCESSING_TIME_WINDOWS; numEvents:10000000
0013 query:PORTABILITY_BATCH; numEvents:10000000
0014 query:BOUNDED_SIDE_INPUT_JOIN; numEvents:10000000
0015 query:SESSION_SIDE_INPUT_JOIN; numEvents:10000000
Performance:
Conf Runtime(sec) (Baseline) Events(/sec) (Baseline) Results
(Baseline)
0000 33.9 195061.3 6607897
0001 26.3 253770.8 6142018
0002 20.0 440161.1 72076
0003 74.8 129737.7 57672
0004 *** not run ***
0005 435.5 22765.1 4516
0006 *** not run ***
0007 242.4 40911.7 100
*** Cancelling streaming job since it appeared stuck for 60 min. ***
0008 103.5 94785.4 91251
0009 *** not run ***
0010 89.2 111042.4 100
0011 513.5 19145.1 1808596
0012 132.4 72879.9 316776
0013 *** not run ***
0014 *** not run ***
0015 *** not run ***
==========================================================================================
==========================================================================================
Run started 2021-10-21T18:13:16.573Z and ran for PT4192.283S
Default configuration:
{"debug":true,"query":null,"sourceType":"DIRECT","generateEventFilePathPrefix":null,"sinkType":"DEVNULL","exportSummaryToBigQuery":false,"pubSubMode":"COMBINED","pubsubMessageSerializationMethod":"CODER","sideInputType":"DIRECT","sideInputRowCount":500,"sideInputNumShards":3,"sideInputUrl":null,"sessionGap":600000,"numEvents":100000,"numEventGenerators":100,"rateShape":"SINE","firstEventRate":10000,"nextEventRate":10000,"rateUnit":"PER_SECOND","ratePeriodSec":600,"preloadSeconds":0,"streamTimeout":240,"isRateLimited":false,"useWallclockEventTime":false,"avgPersonByteSize":200,"avgAuctionByteSize":500,"avgBidByteSize":100,"hotAuctionRatio":2,"hotSellersRatio":4,"hotBiddersRatio":4,"windowSizeSec":10,"windowPeriodSec":5,"watermarkHoldbackSec":0,"numInFlightAuctions":100,"numActivePeople":1000,"coderStrategy":"HAND","cpuDelayMs":0,"diskBusyBytes":0,"auctionSkip":123,"fanout":5,"maxAuctionsWaitingTime":600,"occasionalDelaySec":3,"probDelayedEvent":0.1,"maxLogEvents":100000,"usePubsubPublishTime":false,"outOfOrderGroupSize":1,"numKeyBuckets":20000,"pardoCPUFactor":1.0}
Configurations:
Conf Description
0000 query:PASSTHROUGH; numEvents:10000000
0001 query:CURRENCY_CONVERSION; numEvents:10000000
0002 query:SELECTION; numEvents:10000000
0003 query:LOCAL_ITEM_SUGGESTION; numEvents:10000000
0004 query:AVERAGE_PRICE_FOR_CATEGORY; numEvents:1000000
0005 query:HOT_ITEMS; numEvents:10000000
0006 query:AVERAGE_SELLING_PRICE_BY_SELLER; numEvents:1000000
0007 query:HIGHEST_BID; numEvents:10000000
0008 query:MONITOR_NEW_USERS; numEvents:10000000
0009 query:WINNING_BIDS; numEvents:1000000
0010 query:LOG_TO_SHARDED_FILES; numEvents:10000000
0011 query:USER_SESSIONS; numEvents:10000000
0012 query:PROCESSING_TIME_WINDOWS; numEvents:10000000
0013 query:PORTABILITY_BATCH; numEvents:10000000
0014 query:BOUNDED_SIDE_INPUT_JOIN; numEvents:10000000
0015 query:SESSION_SIDE_INPUT_JOIN; numEvents:10000000
Performance:
Conf Runtime(sec) (Baseline) Events(/sec) (Baseline) Results
(Baseline)
0000 33.9 195061.3 6607897
0001 26.3 253770.8 6142018
0002 20.0 440161.1 72076
0003 74.8 129737.7 57672
0004 *** not run ***
0005 435.5 22765.1 4516
0006 *** not run ***
0007 242.4 40911.7 100
*** Cancelling streaming job since it appeared stuck for 60 min. ***
0008 103.5 94785.4 91251
0009 *** not run ***
0010 89.2 111042.4 100
0011 513.5 19145.1 1808596
0012 132.4 72879.9 316776
0013 *** not run ***
0014 *** not run ***
0015 *** not run ***
==========================================================================================
Exception in thread "main" java.lang.RuntimeException: Execution was not
successful
at org.apache.beam.sdk.nexmark.Main.runAll(Main.java:186)
at org.apache.beam.sdk.nexmark.Main.main(Main.java:495)
> Task :sdks:java:testing:nexmark:run FAILED
> Task :runners:google-cloud-dataflow-java:cleanUpDockerImages
Untagged: us.gcr.io/apache-beam-testing/java-postcommit-it/java:20211021181240
Untagged:
us.gcr.io/apache-beam-testing/java-postcommit-it/java@sha256:073786ce2d330482ab1a223abe779858823a9ec15bf3aee0e08f5dd583bf72b2
Deleted: sha256:450cacfabcc1927583127518c697e72ff98eddac9936599c8b68ed76194f0cdd
Deleted: sha256:08a6d57473adf8169d2371b53e7b9a1f73e3d3ef50f6809e26696a7003dc5232
Deleted: sha256:a3872e0ba7ccb0895eacc63270228fa64f3744f91ee4a5ebd4166ed19dd02cda
Deleted: sha256:68e0cf124b4bb69b8d7f1ef93dac2bcbcd164c4b80d244756ba75818257a7984
Deleted: sha256:1b82ee6a04bd112208f9bf31caf4306ce2cb628f26468a40048dad1cce542d9c
Deleted: sha256:9b06160c5fc9245522f59cc8ede5e0253ba18264dc01f478a667d0f98d4c2a04
Deleted: sha256:b4d6ef7d80c9a3136f5d0b9ec851effc789320e55f215ce649635cee2c12c7d3
Deleted: sha256:9129b7070726e8593f4113139a7b547c278102110254e55173702080c90f0758
Deleted: sha256:10e15980e3f29d5b424a1e05a04d9f62ad764bd321fb0e5b9c1ca91bf9489581
Deleted: sha256:f3a78b27761a27d7497e3a7b19a38e91707c65e80bcb8dddf834c33fc2f844d4
Deleted: sha256:4918a623cd59ad213c7439b7dc033e2069ec0d89da72cbae753ab0c18253fe48
Deleted: sha256:4e8d802b597f4f9cc99d5c65065fc67e0de6513ed59189be6e3f55e38e74dc5f
Deleted: sha256:26e28169054d03eff1bf431964fcc891045c5d7cbb29736133cb20c1d86e78f8
Deleted: sha256:005e4872cb73d8d7a8594ef14d3b3c88c38a8f11cd52b5dc5677c1004dfb328d
Deleted: sha256:8e588b02afbbbd5fb56e2f1b3a4b859c3587144276377d22334c2356d5839fdf
Deleted: sha256:edb76ff3ed074ef4796c793c47f5c0cb0c0799e4a50587aac5c27726d8e5915f
Tag: [us.gcr.io/apache-beam-testing/java-postcommit-it/java:20211021181240]
- referencing digest:
[us.gcr.io/apache-beam-testing/java-postcommit-it/java@sha256:073786ce2d330482ab1a223abe779858823a9ec15bf3aee0e08f5dd583bf72b2]
Deleted [[us.gcr.io/apache-beam-testing/java-postcommit-it/java:20211021181240]
(referencing
[us.gcr.io/apache-beam-testing/java-postcommit-it/java@sha256:073786ce2d330482ab1a223abe779858823a9ec15bf3aee0e08f5dd583bf72b2])].
Removing untagged image
us.gcr.io/apache-beam-testing/java-postcommit-it/java@sha256:073786ce2d330482ab1a223abe779858823a9ec15bf3aee0e08f5dd583bf72b2
Digests:
-
us.gcr.io/apache-beam-testing/java-postcommit-it/java@sha256:073786ce2d330482ab1a223abe779858823a9ec15bf3aee0e08f5dd583bf72b2
Deleted
[us.gcr.io/apache-beam-testing/java-postcommit-it/java@sha256:073786ce2d330482ab1a223abe779858823a9ec15bf3aee0e08f5dd583bf72b2].
FAILURE: Build failed with an exception.
* What went wrong:
Execution failed for task ':sdks:java:testing:nexmark:run'.
> Process 'command '/usr/lib/jvm/java-8-openjdk-amd64/bin/java'' finished with
> non-zero exit value 1
* Try:
Run with --stacktrace option to get the stack trace. Run with --info or --debug
option to get more log output. Run with --scan to get full insights.
* Get more help at https://help.gradle.org
Deprecated Gradle features were used in this build, making it incompatible with
Gradle 7.0.
Use '--warning-mode all' to show the individual deprecation warnings.
See
https://docs.gradle.org/6.9.1/userguide/command_line_interface.html#sec:command_line_warnings
BUILD FAILED in 1h 10m 34s
123 actionable tasks: 10 executed, 113 up-to-date
Publishing build scan...
https://gradle.com/s/6mduz6ak2rchs
Build step 'Invoke Gradle script' changed build result to FAILURE
Build step 'Invoke Gradle script' marked build as failure
---------------------------------------------------------------------
To unsubscribe, e-mail: [email protected]
For additional commands, e-mail: [email protected]
