See
<https://ci-beam.apache.org/job/beam_PostCommit_Java_Nexmark_Dataflow_V2/561/display/redirect?page=changes>
Changes:
[rogelio.hernandez] [BEAM-12371][BEAM-12373] Fixed page navigation
------------------------------------------
[...truncated 678.72 KB...]
SEVERE: Failed to get metric fatal, from namespace Query7
2021-10-11T19:19:55.681Z WARNING: streaming query appears to have been stuck
for 57 min.
2021-10-11T19:19:55.681Z no activity
2021-10-11T19:20:10.707Z RUNNING Query7
2021-10-11T19:20:11.401Z sample of 31.5 sec not long enough to calculate
steady-state event rate
Oct 11, 2021 7:20:11 PM org.apache.beam.sdk.testutils.metrics.MetricsReader
getCounterMetric
SEVERE: Failed to get metric fatal, from namespace Query7
2021-10-11T19:20:11.462Z WARNING: streaming query appears to have been stuck
for 57 min.
2021-10-11T19:20:11.462Z no activity
2021-10-11T19:20:26.491Z RUNNING Query7
2021-10-11T19:20:27.113Z sample of 31.5 sec not long enough to calculate
steady-state event rate
Oct 11, 2021 7:20:27 PM org.apache.beam.sdk.testutils.metrics.MetricsReader
getCounterMetric
SEVERE: Failed to get metric fatal, from namespace Query7
2021-10-11T19:20:27.178Z WARNING: streaming query appears to have been stuck
for 57 min.
2021-10-11T19:20:27.178Z no activity
2021-10-11T19:20:42.224Z RUNNING Query7
2021-10-11T19:20:43.085Z sample of 31.5 sec not long enough to calculate
steady-state event rate
Oct 11, 2021 7:20:43 PM org.apache.beam.sdk.testutils.metrics.MetricsReader
getCounterMetric
SEVERE: Failed to get metric fatal, from namespace Query7
2021-10-11T19:20:43.145Z WARNING: streaming query appears to have been stuck
for 57 min.
2021-10-11T19:20:43.145Z no activity
2021-10-11T19:20:58.174Z RUNNING Query7
2021-10-11T19:20:58.822Z sample of 31.5 sec not long enough to calculate
steady-state event rate
Oct 11, 2021 7:20:58 PM org.apache.beam.sdk.testutils.metrics.MetricsReader
getCounterMetric
SEVERE: Failed to get metric fatal, from namespace Query7
2021-10-11T19:20:58.875Z WARNING: streaming query appears to have been stuck
for 58 min.
2021-10-11T19:20:58.875Z no activity
2021-10-11T19:21:13.932Z RUNNING Query7
2021-10-11T19:21:14.571Z sample of 31.5 sec not long enough to calculate
steady-state event rate
Oct 11, 2021 7:21:14 PM org.apache.beam.sdk.testutils.metrics.MetricsReader
getCounterMetric
SEVERE: Failed to get metric fatal, from namespace Query7
2021-10-11T19:21:14.637Z WARNING: streaming query appears to have been stuck
for 58 min.
2021-10-11T19:21:14.637Z no activity
2021-10-11T19:21:29.681Z RUNNING Query7
2021-10-11T19:21:30.321Z sample of 31.5 sec not long enough to calculate
steady-state event rate
Oct 11, 2021 7:21:30 PM org.apache.beam.sdk.testutils.metrics.MetricsReader
getCounterMetric
SEVERE: Failed to get metric fatal, from namespace Query7
2021-10-11T19:21:30.382Z WARNING: streaming query appears to have been stuck
for 58 min.
2021-10-11T19:21:30.382Z no activity
2021-10-11T19:21:45.436Z RUNNING Query7
2021-10-11T19:21:45.989Z sample of 31.5 sec not long enough to calculate
steady-state event rate
Oct 11, 2021 7:21:46 PM org.apache.beam.sdk.testutils.metrics.MetricsReader
getCounterMetric
SEVERE: Failed to get metric fatal, from namespace Query7
2021-10-11T19:21:46.038Z WARNING: streaming query appears to have been stuck
for 59 min.
2021-10-11T19:21:46.038Z no activity
2021-10-11T19:22:01.090Z RUNNING Query7
2021-10-11T19:22:01.859Z sample of 31.5 sec not long enough to calculate
steady-state event rate
Oct 11, 2021 7:22:01 PM org.apache.beam.sdk.testutils.metrics.MetricsReader
getCounterMetric
SEVERE: Failed to get metric fatal, from namespace Query7
2021-10-11T19:22:01.914Z WARNING: streaming query appears to have been stuck
for 59 min.
2021-10-11T19:22:01.915Z no activity
2021-10-11T19:22:16.943Z RUNNING Query7
2021-10-11T19:22:17.758Z sample of 31.5 sec not long enough to calculate
steady-state event rate
Oct 11, 2021 7:22:17 PM org.apache.beam.sdk.testutils.metrics.MetricsReader
getCounterMetric
2021-10-11T19:22:17.843Z WARNING: streaming query appears to have been stuck
for 59 min.
2021-10-11T19:22:17.843Z no activity
SEVERE: Failed to get metric fatal, from namespace Query7
2021-10-11T19:22:32.873Z RUNNING Query7
2021-10-11T19:22:33.472Z sample of 31.5 sec not long enough to calculate
steady-state event rate
Oct 11, 2021 7:22:33 PM org.apache.beam.sdk.testutils.metrics.MetricsReader
getCounterMetric
SEVERE: Failed to get metric fatal, from namespace Query7
2021-10-11T19:22:33.525Z WARNING: streaming query appears to have been stuck
for 59 min.
2021-10-11T19:22:33.525Z no activity
2021-10-11T19:22:48.575Z RUNNING Query7
2021-10-11T19:22:49.529Z sample of 31.5 sec not long enough to calculate
steady-state event rate
Oct 11, 2021 7:22:49 PM org.apache.beam.sdk.testutils.metrics.MetricsReader
getCounterMetric
SEVERE: Failed to get metric fatal, from namespace Query7
2021-10-11T19:22:49.593Z ERROR: streaming query appears to have been stuck for
60 minutes, cancelling job.
2021-10-11T19:22:49.622Z no activity
2021-10-11T19:23:04.711Z RUNNING Query7 (waiting for shutdown)
2021-10-11T19:23:05.231Z sample of 31.5 sec not long enough to calculate
steady-state event rate
2021-10-11T19:23:05.232Z no activity
2021-10-11T19:23:20.289Z RUNNING Query7 (waiting for shutdown)
2021-10-11T19:23:20.969Z sample of 31.5 sec not long enough to calculate
steady-state event rate
2021-10-11T19:23:20.969Z no activity
2021-10-11T19:23:36.029Z RUNNING Query7 (waiting for shutdown)
2021-10-11T19:23:36.712Z sample of 31.5 sec not long enough to calculate
steady-state event rate
2021-10-11T19:23:36.713Z no activity
2021-10-11T19:23:51.740Z RUNNING Query7 (waiting for shutdown)
2021-10-11T19:23:52.488Z sample of 31.5 sec not long enough to calculate
steady-state event rate
2021-10-11T19:23:52.488Z no activity
2021-10-11T19:24:07.544Z RUNNING Query7 (waiting for shutdown)
2021-10-11T19:24:08.215Z sample of 31.5 sec not long enough to calculate
steady-state event rate
2021-10-11T19:24:08.215Z no activity
2021-10-11T19:24:23.241Z RUNNING Query7 (waiting for shutdown)
2021-10-11T19:24:23.792Z sample of 31.5 sec not long enough to calculate
steady-state event rate
2021-10-11T19:24:23.792Z no activity
2021-10-11T19:24:38.855Z RUNNING Query7 (waiting for shutdown)
2021-10-11T19:24:39.469Z sample of 31.5 sec not long enough to calculate
steady-state event rate
2021-10-11T19:24:39.469Z no activity
2021-10-11T19:24:54.530Z RUNNING Query7 (waiting for shutdown)
2021-10-11T19:24:55.203Z sample of 31.5 sec not long enough to calculate
steady-state event rate
2021-10-11T19:24:55.203Z no activity
2021-10-11T19:25:10.272Z RUNNING Query7 (waiting for shutdown)
2021-10-11T19:25:11.082Z sample of 31.5 sec not long enough to calculate
steady-state event rate
2021-10-11T19:25:11.082Z no activity
2021-10-11T19:25:26.115Z CANCELLED Query7 (waiting for shutdown)
2021-10-11T19:25:26.145Z sample of 31.5 sec not long enough to calculate
steady-state event rate
==========================================================================================
Run started 2021-10-11T18:14:29.854Z and ran for PT4256.291S
Default configuration:
{"debug":true,"query":null,"sourceType":"DIRECT","generateEventFilePathPrefix":null,"sinkType":"DEVNULL","exportSummaryToBigQuery":false,"pubSubMode":"COMBINED","pubsubMessageSerializationMethod":"CODER","sideInputType":"DIRECT","sideInputRowCount":500,"sideInputNumShards":3,"sideInputUrl":null,"sessionGap":600000,"numEvents":100000,"numEventGenerators":100,"rateShape":"SINE","firstEventRate":10000,"nextEventRate":10000,"rateUnit":"PER_SECOND","ratePeriodSec":600,"preloadSeconds":0,"streamTimeout":240,"isRateLimited":false,"useWallclockEventTime":false,"avgPersonByteSize":200,"avgAuctionByteSize":500,"avgBidByteSize":100,"hotAuctionRatio":2,"hotSellersRatio":4,"hotBiddersRatio":4,"windowSizeSec":10,"windowPeriodSec":5,"watermarkHoldbackSec":0,"numInFlightAuctions":100,"numActivePeople":1000,"coderStrategy":"HAND","cpuDelayMs":0,"diskBusyBytes":0,"auctionSkip":123,"fanout":5,"maxAuctionsWaitingTime":600,"occasionalDelaySec":3,"probDelayedEvent":0.1,"maxLogEvents":100000,"usePubsubPublishTime":false,"outOfOrderGroupSize":1,"numKeyBuckets":20000,"pardoCPUFactor":1.0}
Configurations:
Conf Description
0000 query:PASSTHROUGH; numEvents:10000000
0001 query:CURRENCY_CONVERSION; numEvents:10000000
0002 query:SELECTION; numEvents:10000000
0003 query:LOCAL_ITEM_SUGGESTION; numEvents:10000000
0004 query:AVERAGE_PRICE_FOR_CATEGORY; numEvents:1000000
0005 query:HOT_ITEMS; numEvents:10000000
0006 query:AVERAGE_SELLING_PRICE_BY_SELLER; numEvents:1000000
0007 query:HIGHEST_BID; numEvents:10000000
0008 query:MONITOR_NEW_USERS; numEvents:10000000
0009 query:WINNING_BIDS; numEvents:1000000
0010 query:LOG_TO_SHARDED_FILES; numEvents:10000000
0011 query:USER_SESSIONS; numEvents:10000000
0012 query:PROCESSING_TIME_WINDOWS; numEvents:10000000
0013 query:PORTABILITY_BATCH; numEvents:10000000
0014 query:BOUNDED_SIDE_INPUT_JOIN; numEvents:10000000
0015 query:SESSION_SIDE_INPUT_JOIN; numEvents:10000000
Performance:
Conf Runtime(sec) (Baseline) Events(/sec) (Baseline) Results
(Baseline)
0000 28.4 230180.2 6544254
0001 27.6 293053.9 7443078
0002 17.3 540709.8 79580
0003 77.7 126638.7 58387
0004 *** not run ***
0005 466.9 21002.3 4484
0006 *** not run ***
0007 282.9 35283.6 100
*** Cancelling streaming job since it appeared stuck for 60 min. ***
0008 148.9 66081.3 91339
0009 *** not run ***
0010 99.6 91501.2 100
0011 483.4 19042.3 1693363
0012 118.5 83532.4 277484
0013 *** not run ***
0014 *** not run ***
0015 *** not run ***
==========================================================================================
==========================================================================================
Run started 2021-10-11T18:14:29.854Z and ran for PT4256.513S
Default configuration:
{"debug":true,"query":null,"sourceType":"DIRECT","generateEventFilePathPrefix":null,"sinkType":"DEVNULL","exportSummaryToBigQuery":false,"pubSubMode":"COMBINED","pubsubMessageSerializationMethod":"CODER","sideInputType":"DIRECT","sideInputRowCount":500,"sideInputNumShards":3,"sideInputUrl":null,"sessionGap":600000,"numEvents":100000,"numEventGenerators":100,"rateShape":"SINE","firstEventRate":10000,"nextEventRate":10000,"rateUnit":"PER_SECOND","ratePeriodSec":600,"preloadSeconds":0,"streamTimeout":240,"isRateLimited":false,"useWallclockEventTime":false,"avgPersonByteSize":200,"avgAuctionByteSize":500,"avgBidByteSize":100,"hotAuctionRatio":2,"hotSellersRatio":4,"hotBiddersRatio":4,"windowSizeSec":10,"windowPeriodSec":5,"watermarkHoldbackSec":0,"numInFlightAuctions":100,"numActivePeople":1000,"coderStrategy":"HAND","cpuDelayMs":0,"diskBusyBytes":0,"auctionSkip":123,"fanout":5,"maxAuctionsWaitingTime":600,"occasionalDelaySec":3,"probDelayedEvent":0.1,"maxLogEvents":100000,"usePubsubPublishTime":false,"outOfOrderGroupSize":1,"numKeyBuckets":20000,"pardoCPUFactor":1.0}
Configurations:
Conf Description
0000 query:PASSTHROUGH; numEvents:10000000
0001 query:CURRENCY_CONVERSION; numEvents:10000000
0002 query:SELECTION; numEvents:10000000
0003 query:LOCAL_ITEM_SUGGESTION; numEvents:10000000
0004 query:AVERAGE_PRICE_FOR_CATEGORY; numEvents:1000000
0005 query:HOT_ITEMS; numEvents:10000000
0006 query:AVERAGE_SELLING_PRICE_BY_SELLER; numEvents:1000000
0007 query:HIGHEST_BID; numEvents:10000000
0008 query:MONITOR_NEW_USERS; numEvents:10000000
0009 query:WINNING_BIDS; numEvents:1000000
0010 query:LOG_TO_SHARDED_FILES; numEvents:10000000
0011 query:USER_SESSIONS; numEvents:10000000
0012 query:PROCESSING_TIME_WINDOWS; numEvents:10000000
0013 query:PORTABILITY_BATCH; numEvents:10000000
0014 query:BOUNDED_SIDE_INPUT_JOIN; numEvents:10000000
0015 query:SESSION_SIDE_INPUT_JOIN; numEvents:10000000
Performance:
Conf Runtime(sec) (Baseline) Events(/sec) (Baseline) Results
(Baseline)
0000 28.4 230180.2 6544254
0001 27.6 293053.9 7443078
0002 17.3 540709.8 79580
0003 77.7 126638.7 58387
0004 *** not run ***
0005 466.9 21002.3 4484
0006 *** not run ***
0007 282.9 35283.6 100
*** Cancelling streaming job since it appeared stuck for 60 min. ***
0008 148.9 66081.3 91339
0009 *** not run ***
0010 99.6 91501.2 100
0011 483.4 19042.3 1693363
0012 118.5 83532.4 277484
0013 *** not run ***
0014 *** not run ***
0015 *** not run ***
==========================================================================================
Exception in thread "main" java.lang.RuntimeException: Execution was not
successful
at org.apache.beam.sdk.nexmark.Main.runAll(Main.java:186)
at org.apache.beam.sdk.nexmark.Main.main(Main.java:495)
> Task :sdks:java:testing:nexmark:run FAILED
> Task :runners:google-cloud-dataflow-java:cleanUpDockerImages
Untagged: us.gcr.io/apache-beam-testing/java-postcommit-it/java:20211011181333
Untagged:
us.gcr.io/apache-beam-testing/java-postcommit-it/java@sha256:f0008c305190f0a2082e6b37db23f62a0793f89ed0151763e0594cfce6ef9775
Deleted: sha256:9b3a592e7c43a9af6e669e113c0f37adc409cd3926d363632104181ffc3db4eb
Deleted: sha256:b331e36ad7bbdc6a4ceb26385255c84cae48afa48c0e591550000bc13350d7df
Deleted: sha256:0e32f525f24204984e6e01a5f63ef17f0cf00be4b6426ee4ffe70552ef7c8510
Deleted: sha256:1afbd210425f507db9ee232339fd3e8b5bb88862291ede6d8bb125a11464994d
Deleted: sha256:6aebc97cd6147a1d22f14c874c939338778f3f41ff03835e7aab82ae82a5ea95
Deleted: sha256:5daabed159d2ec387d54d3806a59bea0147bf9b21b393843aa793b3c8ffc19cd
Deleted: sha256:58eaecb48f27c5ffb4540b7f5854f27c129d2ca6942165d271dfd5de3fd54566
Deleted: sha256:b40fffaa5602c2710974fefefe1f39c6700a298e706823176454b3e760f6f42e
Deleted: sha256:8caddcff281a485b3fa5e37c80abe361d0cb9bf1998a35b475e36717c4a44cdd
Deleted: sha256:71f703503daeaff4f950bfc348bb550dd504f47d3cc4033698e09f6c9aa1a39a
Deleted: sha256:194b30725481fa84abf548bcd86888d3195f7da8f642a0cc2d6b15473152d086
Deleted: sha256:f3fcc6d01f10df7be4285d063955b7a78f1f96e4b9e47d095fb51fc65a1b3629
Deleted: sha256:c09d767d85d222776ce6668301c1dc058485230f99d318c5cccc559a7e0a8beb
Deleted: sha256:3d3f5613a6d7448176bb2872f7d84164fa97586d3018229834706822a5122994
Deleted: sha256:38584d6c5e874af6d45a454d24d505694b8bcb1044b858f0fab32fcbd8b7926c
Deleted: sha256:d8203d7c056aef97b11cf3d7ae33c33e6260c1e786d7df974d18dff66f0bd847
Tag: [us.gcr.io/apache-beam-testing/java-postcommit-it/java:20211011181333]
- referencing digest:
[us.gcr.io/apache-beam-testing/java-postcommit-it/java@sha256:f0008c305190f0a2082e6b37db23f62a0793f89ed0151763e0594cfce6ef9775]
Deleted [[us.gcr.io/apache-beam-testing/java-postcommit-it/java:20211011181333]
(referencing
[us.gcr.io/apache-beam-testing/java-postcommit-it/java@sha256:f0008c305190f0a2082e6b37db23f62a0793f89ed0151763e0594cfce6ef9775])].
Removing untagged image
us.gcr.io/apache-beam-testing/java-postcommit-it/java@sha256:f0008c305190f0a2082e6b37db23f62a0793f89ed0151763e0594cfce6ef9775
Digests:
-
us.gcr.io/apache-beam-testing/java-postcommit-it/java@sha256:f0008c305190f0a2082e6b37db23f62a0793f89ed0151763e0594cfce6ef9775
Deleted
[us.gcr.io/apache-beam-testing/java-postcommit-it/java@sha256:f0008c305190f0a2082e6b37db23f62a0793f89ed0151763e0594cfce6ef9775].
FAILURE: Build failed with an exception.
* What went wrong:
Execution failed for task ':sdks:java:testing:nexmark:run'.
> Process 'command '/usr/lib/jvm/java-8-openjdk-amd64/bin/java'' finished with
> non-zero exit value 1
* Try:
Run with --stacktrace option to get the stack trace. Run with --info or --debug
option to get more log output. Run with --scan to get full insights.
* Get more help at https://help.gradle.org
Deprecated Gradle features were used in this build, making it incompatible with
Gradle 7.0.
Use '--warning-mode all' to show the individual deprecation warnings.
See
https://docs.gradle.org/6.9.1/userguide/command_line_interface.html#sec:command_line_warnings
BUILD FAILED in 1h 12m 1s
123 actionable tasks: 10 executed, 113 up-to-date
Publishing build scan...
https://gradle.com/s/j32iu524mbw5g
Build step 'Invoke Gradle script' changed build result to FAILURE
Build step 'Invoke Gradle script' marked build as failure
---------------------------------------------------------------------
To unsubscribe, e-mail: [email protected]
For additional commands, e-mail: [email protected]
