See
<https://ci-beam.apache.org/job/beam_PostCommit_Java_Nexmark_Dataflow_V2_Java11/592/display/redirect>
Changes:
------------------------------------------
[...truncated 660.41 KB...]
2021-10-19T13:18:00.784Z RUNNING Query7
2021-10-19T13:18:01.577Z sample of 63.2 sec not long enough to calculate
steady-state event rate
Oct 19, 2021 1:18:01 PM org.apache.beam.sdk.testutils.metrics.MetricsReader
getCounterMetric
2021-10-19T13:18:01.683Z WARNING: streaming query appears to have been stuck
for 57 min.
SEVERE: Failed to get metric fatal, from namespace Query7
2021-10-19T13:18:01.683Z no activity
2021-10-19T13:18:16.734Z RUNNING Query7
2021-10-19T13:18:17.427Z sample of 63.2 sec not long enough to calculate
steady-state event rate
Oct 19, 2021 1:18:17 PM org.apache.beam.sdk.testutils.metrics.MetricsReader
getCounterMetric
2021-10-19T13:18:17.504Z WARNING: streaming query appears to have been stuck
for 58 min.
SEVERE: Failed to get metric fatal, from namespace Query7
2021-10-19T13:18:17.504Z no activity
2021-10-19T13:18:32.545Z RUNNING Query7
2021-10-19T13:18:33.195Z sample of 63.2 sec not long enough to calculate
steady-state event rate
Oct 19, 2021 1:18:33 PM org.apache.beam.sdk.testutils.metrics.MetricsReader
getCounterMetric
SEVERE: Failed to get metric fatal, from namespace Query7
2021-10-19T13:18:33.261Z WARNING: streaming query appears to have been stuck
for 58 min.
2021-10-19T13:18:33.261Z no activity
2021-10-19T13:18:48.295Z RUNNING Query7
2021-10-19T13:18:48.977Z sample of 63.2 sec not long enough to calculate
steady-state event rate
Oct 19, 2021 1:18:49 PM org.apache.beam.sdk.testutils.metrics.MetricsReader
getCounterMetric
SEVERE: Failed to get metric fatal, from namespace Query7
2021-10-19T13:18:49.034Z WARNING: streaming query appears to have been stuck
for 58 min.
2021-10-19T13:18:49.034Z no activity
2021-10-19T13:19:04.072Z RUNNING Query7
2021-10-19T13:19:04.879Z sample of 63.2 sec not long enough to calculate
steady-state event rate
Oct 19, 2021 1:19:04 PM org.apache.beam.sdk.testutils.metrics.MetricsReader
getCounterMetric
2021-10-19T13:19:04.944Z WARNING: streaming query appears to have been stuck
for 59 min.
2021-10-19T13:19:04.944Z no activity
SEVERE: Failed to get metric fatal, from namespace Query7
2021-10-19T13:19:19.977Z RUNNING Query7
2021-10-19T13:19:20.828Z sample of 63.2 sec not long enough to calculate
steady-state event rate
Oct 19, 2021 1:19:20 PM org.apache.beam.sdk.testutils.metrics.MetricsReader
getCounterMetric
SEVERE: Failed to get metric fatal, from namespace Query7
2021-10-19T13:19:20.889Z WARNING: streaming query appears to have been stuck
for 59 min.
2021-10-19T13:19:20.889Z no activity
2021-10-19T13:19:35.919Z RUNNING Query7
2021-10-19T13:19:36.606Z sample of 63.2 sec not long enough to calculate
steady-state event rate
Oct 19, 2021 1:19:36 PM org.apache.beam.sdk.testutils.metrics.MetricsReader
getCounterMetric
SEVERE: Failed to get metric fatal, from namespace Query7
2021-10-19T13:19:36.674Z WARNING: streaming query appears to have been stuck
for 59 min.
2021-10-19T13:19:36.674Z no activity
2021-10-19T13:19:51.713Z RUNNING Query7
2021-10-19T13:19:52.406Z sample of 63.2 sec not long enough to calculate
steady-state event rate
2021-10-19T13:19:52.458Z WARNING: streaming query appears to have been stuck
for 59 min.
Oct 19, 2021 1:19:52 PM org.apache.beam.sdk.testutils.metrics.MetricsReader
getCounterMetric
2021-10-19T13:19:52.458Z SEVERE: Failed to get metric fatal, from namespace
Query7
no activity
2021-10-19T13:20:07.489Z RUNNING Query7
2021-10-19T13:20:08.276Z sample of 63.2 sec not long enough to calculate
steady-state event rate
Oct 19, 2021 1:20:08 PM org.apache.beam.sdk.testutils.metrics.MetricsReader
getCounterMetric
2021-10-19T13:20:08.355Z ERROR: streaming query appears to have been stuck for
60 minutes, cancelling job.
SEVERE: Failed to get metric fatal, from namespace Query7
2021-10-19T13:20:08.395Z no activity
2021-10-19T13:20:23.426Z RUNNING Query7 (waiting for shutdown)
2021-10-19T13:20:24.167Z sample of 63.2 sec not long enough to calculate
steady-state event rate
2021-10-19T13:20:24.167Z no activity
2021-10-19T13:20:39.200Z RUNNING Query7 (waiting for shutdown)
2021-10-19T13:20:39.954Z sample of 63.2 sec not long enough to calculate
steady-state event rate
2021-10-19T13:20:39.954Z no activity
2021-10-19T13:20:54.982Z RUNNING Query7 (waiting for shutdown)
2021-10-19T13:20:55.622Z sample of 63.2 sec not long enough to calculate
steady-state event rate
2021-10-19T13:20:55.622Z no activity
2021-10-19T13:21:10.647Z RUNNING Query7 (waiting for shutdown)
2021-10-19T13:21:11.349Z sample of 63.2 sec not long enough to calculate
steady-state event rate
2021-10-19T13:21:11.349Z no activity
2021-10-19T13:21:26.381Z RUNNING Query7 (waiting for shutdown)
2021-10-19T13:21:27.013Z sample of 63.2 sec not long enough to calculate
steady-state event rate
2021-10-19T13:21:27.013Z no activity
2021-10-19T13:21:42.061Z RUNNING Query7 (waiting for shutdown)
2021-10-19T13:21:42.657Z sample of 63.2 sec not long enough to calculate
steady-state event rate
2021-10-19T13:21:42.657Z no activity
2021-10-19T13:21:57.687Z RUNNING Query7 (waiting for shutdown)
2021-10-19T13:21:58.388Z sample of 63.2 sec not long enough to calculate
steady-state event rate
2021-10-19T13:21:58.388Z no activity
2021-10-19T13:22:13.430Z RUNNING Query7 (waiting for shutdown)
2021-10-19T13:22:14.159Z sample of 63.2 sec not long enough to calculate
steady-state event rate
2021-10-19T13:22:14.159Z no activity
2021-10-19T13:22:29.300Z RUNNING Query7 (waiting for shutdown)
2021-10-19T13:22:30.001Z sample of 63.2 sec not long enough to calculate
steady-state event rate
2021-10-19T13:22:30.001Z no activity
2021-10-19T13:22:45.045Z RUNNING Query7 (waiting for shutdown)
2021-10-19T13:22:45.638Z sample of 63.2 sec not long enough to calculate
steady-state event rate
2021-10-19T13:22:45.638Z no activity
2021-10-19T13:23:00.680Z CANCELLED Query7 (waiting for shutdown)
2021-10-19T13:23:00.722Z sample of 63.2 sec not long enough to calculate
steady-state event rate
==========================================================================================
Run started 2021-10-19T12:11:27.337Z and ran for PT4293.386S
Default configuration:
{"debug":true,"query":null,"sourceType":"DIRECT","generateEventFilePathPrefix":null,"sinkType":"DEVNULL","exportSummaryToBigQuery":false,"pubSubMode":"COMBINED","pubsubMessageSerializationMethod":"CODER","sideInputType":"DIRECT","sideInputRowCount":500,"sideInputNumShards":3,"sideInputUrl":null,"sessionGap":600000,"numEvents":100000,"numEventGenerators":100,"rateShape":"SINE","firstEventRate":10000,"nextEventRate":10000,"rateUnit":"PER_SECOND","ratePeriodSec":600,"preloadSeconds":0,"streamTimeout":240,"isRateLimited":false,"useWallclockEventTime":false,"avgPersonByteSize":200,"avgAuctionByteSize":500,"avgBidByteSize":100,"hotAuctionRatio":2,"hotSellersRatio":4,"hotBiddersRatio":4,"windowSizeSec":10,"windowPeriodSec":5,"watermarkHoldbackSec":0,"numInFlightAuctions":100,"numActivePeople":1000,"coderStrategy":"HAND","cpuDelayMs":0,"diskBusyBytes":0,"auctionSkip":123,"fanout":5,"maxAuctionsWaitingTime":600,"occasionalDelaySec":3,"probDelayedEvent":0.1,"maxLogEvents":100000,"usePubsubPublishTime":false,"outOfOrderGroupSize":1,"numKeyBuckets":20000,"pardoCPUFactor":1.0}
Configurations:
Conf Description
0000 query:PASSTHROUGH; numEvents:10000000
0001 query:CURRENCY_CONVERSION; numEvents:10000000
0002 query:SELECTION; numEvents:10000000
0003 query:LOCAL_ITEM_SUGGESTION; numEvents:10000000
0004 query:AVERAGE_PRICE_FOR_CATEGORY; numEvents:1000000
0005 query:HOT_ITEMS; numEvents:10000000
0006 query:AVERAGE_SELLING_PRICE_BY_SELLER; numEvents:1000000
0007 query:HIGHEST_BID; numEvents:10000000
0008 query:MONITOR_NEW_USERS; numEvents:10000000
0009 query:WINNING_BIDS; numEvents:1000000
0010 query:LOG_TO_SHARDED_FILES; numEvents:10000000
0011 query:USER_SESSIONS; numEvents:10000000
0012 query:PROCESSING_TIME_WINDOWS; numEvents:10000000
0013 query:PORTABILITY_BATCH; numEvents:10000000
0014 query:BOUNDED_SIDE_INPUT_JOIN; numEvents:10000000
0015 query:SESSION_SIDE_INPUT_JOIN; numEvents:10000000
Performance:
Conf Runtime(sec) (Baseline) Events(/sec) (Baseline) Results
(Baseline)
0000 34.3 168014.2 5767591
0001 26.7 274138.3 6728575
0002 17.4 489400.0 73705
0003 82.1 121833.8 59507
0004 *** not run ***
0005 363.0 27548.0 4567
0006 *** not run ***
0007 285.8 33954.4 100
*** Cancelling streaming job since it appeared stuck for 60 min. ***
0008 94.9 104013.6 91490
0009 *** not run ***
0010 82.0 106549.2 100
0011 368.8 26870.4 1822877
0012 153.4 59970.4 350122
0013 *** not run ***
0014 *** not run ***
0015 *** not run ***
==========================================================================================
==========================================================================================
Run started 2021-10-19T12:11:27.337Z and ran for PT4293.606S
Default configuration:
{"debug":true,"query":null,"sourceType":"DIRECT","generateEventFilePathPrefix":null,"sinkType":"DEVNULL","exportSummaryToBigQuery":false,"pubSubMode":"COMBINED","pubsubMessageSerializationMethod":"CODER","sideInputType":"DIRECT","sideInputRowCount":500,"sideInputNumShards":3,"sideInputUrl":null,"sessionGap":600000,"numEvents":100000,"numEventGenerators":100,"rateShape":"SINE","firstEventRate":10000,"nextEventRate":10000,"rateUnit":"PER_SECOND","ratePeriodSec":600,"preloadSeconds":0,"streamTimeout":240,"isRateLimited":false,"useWallclockEventTime":false,"avgPersonByteSize":200,"avgAuctionByteSize":500,"avgBidByteSize":100,"hotAuctionRatio":2,"hotSellersRatio":4,"hotBiddersRatio":4,"windowSizeSec":10,"windowPeriodSec":5,"watermarkHoldbackSec":0,"numInFlightAuctions":100,"numActivePeople":1000,"coderStrategy":"HAND","cpuDelayMs":0,"diskBusyBytes":0,"auctionSkip":123,"fanout":5,"maxAuctionsWaitingTime":600,"occasionalDelaySec":3,"probDelayedEvent":0.1,"maxLogEvents":100000,"usePubsubPublishTime":false,"outOfOrderGroupSize":1,"numKeyBuckets":20000,"pardoCPUFactor":1.0}
Configurations:
Conf Description
0000 query:PASSTHROUGH; numEvents:10000000
0001 query:CURRENCY_CONVERSION; numEvents:10000000
0002 query:SELECTION; numEvents:10000000
0003 query:LOCAL_ITEM_SUGGESTION; numEvents:10000000
0004 query:AVERAGE_PRICE_FOR_CATEGORY; numEvents:1000000
0005 query:HOT_ITEMS; numEvents:10000000
0006 query:AVERAGE_SELLING_PRICE_BY_SELLER; numEvents:1000000
0007 query:HIGHEST_BID; numEvents:10000000
0008 query:MONITOR_NEW_USERS; numEvents:10000000
0009 query:WINNING_BIDS; numEvents:1000000
0010 query:LOG_TO_SHARDED_FILES; numEvents:10000000
0011 query:USER_SESSIONS; numEvents:10000000
0012 query:PROCESSING_TIME_WINDOWS; numEvents:10000000
0013 query:PORTABILITY_BATCH; numEvents:10000000
0014 query:BOUNDED_SIDE_INPUT_JOIN; numEvents:10000000
0015 query:SESSION_SIDE_INPUT_JOIN; numEvents:10000000
Performance:
Conf Runtime(sec) (Baseline) Events(/sec) (Baseline) Results
(Baseline)
0000 34.3 168014.2 5767591
0001 26.7 274138.3 6728575
0002 17.4 489400.0 73705
0003 82.1 121833.8 59507
0004 *** not run ***
0005 363.0 27548.0 4567
0006 *** not run ***
0007 285.8 33954.4 100
*** Cancelling streaming job since it appeared stuck for 60 min. ***
0008 94.9 104013.6 91490
0009 *** not run ***
0010 82.0 106549.2 100
0011 368.8 26870.4 1822877
0012 153.4 59970.4 350122
0013 *** not run ***
0014 *** not run ***
0015 *** not run ***
==========================================================================================
Exception in thread "main" java.lang.RuntimeException: Execution was not
successful
at org.apache.beam.sdk.nexmark.Main.runAll(Main.java:186)
at org.apache.beam.sdk.nexmark.Main.main(Main.java:495)
> Task :sdks:java:testing:nexmark:run FAILED
> Task :runners:google-cloud-dataflow-java:cleanUpDockerImages
Untagged: us.gcr.io/apache-beam-testing/java-postcommit-it/java:20211019121024
Untagged:
us.gcr.io/apache-beam-testing/java-postcommit-it/java@sha256:db5488b66a73ca632ef2e9071f1171ee608203e620b6972543b1c1a35511bade
Deleted: sha256:200eef67462d865ff70d06ffdaa19662de994f7a736523ec991a0b12c8da5cca
Deleted: sha256:5e841f611733575f81101d4b46145f3e9be759e53621989035841b5a2c5ac5ab
Deleted: sha256:8e554295593dd4c438e28b51152ef29f86a4c3723290a5f76bf751214a74d9aa
Deleted: sha256:869505c26759217c7fefdaa57964117651022e70268e8786de9a559ea88d8de6
Deleted: sha256:427f657056aab4a6350d7160755161af51e64009f64d7f3134682de0149aaa69
Deleted: sha256:99801c8ab28fe1c7ae700866948d9ab682e191d51f35e43545b4964dccb1323f
Deleted: sha256:debde6c5f8defabf41dbbf6283b334cac402754da40a929a4187409fb319e1dc
Deleted: sha256:24b96c0e8d1cf6a79117e5ccb7575f5ee8c66e0e1fb19b2d18bf04551e354e9a
Deleted: sha256:06b1e981d80d35176b61fbd6382d9865bf68e441d6f1cba5d8ac92c9577e5f96
Deleted: sha256:5dec9d2789dcca81d9fae084ccb0db82be8ea3e83374a13e17386e1d073978e3
Deleted: sha256:5bd045d33192800dd456e411830f870793bc233120c101fc3dd8c31deb002c3b
Deleted: sha256:cd1e38702bcc0ac764750d6da9872a6eb07e14ad9926916c8d975114885aa6be
Deleted: sha256:5b67c9853e29f26a416088acbc405d9323b3c144a8c6d1a9989c15a8441b8704
Deleted: sha256:c993f013d4551de726891530726bdf9dd90d2717fe1284b12d65850a8cc8c9f3
Deleted: sha256:da69bb39cb2a96f746866aecf71a84e4350cb31b20e1ae263df4ab6b6b85449d
Deleted: sha256:505bc3196d15cf6f35f833c203de0c46c2de26cc685a5a266ae641128af58043
Deleted: sha256:ff8168d6fc33b88620cafc41da7f59890ad91a93220fd97de36a377a98b3165e
Deleted: sha256:271c83ccaedce55b171744b0c097cdeeb2377bb50395b5fb0bf04798840bf6a9
Deleted: sha256:621835890adfd4b3c2af2395253174a775533fc009fbfdb68053ac702fbe97aa
Deleted: sha256:6e9655d59d5b8efa9e4ccee72ad40706d260d6adc3856a2b119f4a58e3870890
Deleted: sha256:8a49b0c3153119f0bc5acf576c3359a5083a18f393903de2eb6cdb996694cd46
Deleted: sha256:b6911a9b5d283db564dac6bcd8e780cf2df31f452b167a865965400772446446
Deleted: sha256:23182f5597a1301fa41e7ed308e7cb6efd7ba2e1e71f3a9c2ef18448f99080a8
Deleted: sha256:edae5ac1528fb138c1d6380b504736c211638af4e62262bb3c0684ebd2f28e45
Deleted: sha256:14daa281ad9fc0c0879595741a3d8aacf6a139c72196ca926aff678744dd068b
Deleted: sha256:699f960d8925200a335540327ad13654513400a0264096b46d10fe26a7d0da64
Deleted: sha256:677eb8707454841d0d8af5ebadceb5d85bbc18f27d29073e9945f992f29723b1
Deleted: sha256:1d3aa0837efa1092db5bae3afe73619a4b167ad171fb0ea21bae112d093c772a
Tag: [us.gcr.io/apache-beam-testing/java-postcommit-it/java:20211019121024]
- referencing digest:
[us.gcr.io/apache-beam-testing/java-postcommit-it/java@sha256:db5488b66a73ca632ef2e9071f1171ee608203e620b6972543b1c1a35511bade]
Deleted [[us.gcr.io/apache-beam-testing/java-postcommit-it/java:20211019121024]
(referencing
[us.gcr.io/apache-beam-testing/java-postcommit-it/java@sha256:db5488b66a73ca632ef2e9071f1171ee608203e620b6972543b1c1a35511bade])].
Removing untagged image
us.gcr.io/apache-beam-testing/java-postcommit-it/java@sha256:db5488b66a73ca632ef2e9071f1171ee608203e620b6972543b1c1a35511bade
Digests:
-
us.gcr.io/apache-beam-testing/java-postcommit-it/java@sha256:db5488b66a73ca632ef2e9071f1171ee608203e620b6972543b1c1a35511bade
Deleted
[us.gcr.io/apache-beam-testing/java-postcommit-it/java@sha256:db5488b66a73ca632ef2e9071f1171ee608203e620b6972543b1c1a35511bade].
FAILURE: Build failed with an exception.
* What went wrong:
Execution failed for task ':sdks:java:testing:nexmark:run'.
> Process 'command '/usr/lib/jvm/java-8-openjdk-amd64/bin/java'' finished with
> non-zero exit value 1
* Try:
Run with --stacktrace option to get the stack trace. Run with --info or --debug
option to get more log output. Run with --scan to get full insights.
* Get more help at https://help.gradle.org
Deprecated Gradle features were used in this build, making it incompatible with
Gradle 7.0.
Use '--warning-mode all' to show the individual deprecation warnings.
See
https://docs.gradle.org/6.9.1/userguide/command_line_interface.html#sec:command_line_warnings
BUILD FAILED in 1h 12m 47s
123 actionable tasks: 10 executed, 113 up-to-date
Publishing build scan...
https://gradle.com/s/wiptm5onbirlo
Build step 'Invoke Gradle script' changed build result to FAILURE
Build step 'Invoke Gradle script' marked build as failure
---------------------------------------------------------------------
To unsubscribe, e-mail: [email protected]
For additional commands, e-mail: [email protected]
