See
<https://ci-beam.apache.org/job/beam_PostCommit_Java_Nexmark_Dataflow_V2/538/display/redirect?page=changes>
Changes:
[noreply] Merge pull request #15614 from [BEAM-12953] [Playground] Create
protobuf
[noreply] [BEAM-11831] Parially Revert "[BEAM-11805] Replace user-agent for
[kawaigin] [BEAM-10708] Enable submit beam_sql built jobs to Dataflow
------------------------------------------
[...truncated 680.55 KB...]
SEVERE: Failed to get metric fatal, from namespace Query7
2021-10-06T01:42:15.789Z WARNING: streaming query appears to have been stuck
for 57 min.
2021-10-06T01:42:15.789Z no activity
2021-10-06T01:42:30.816Z RUNNING Query7
2021-10-06T01:42:31.375Z sample of 63.9 sec not long enough to calculate
steady-state event rate
Oct 06, 2021 1:42:31 AM org.apache.beam.sdk.testutils.metrics.MetricsReader
getCounterMetric
SEVERE: Failed to get metric fatal, from namespace Query7
2021-10-06T01:42:31.433Z WARNING: streaming query appears to have been stuck
for 58 min.
2021-10-06T01:42:31.434Z no activity
2021-10-06T01:42:46.463Z RUNNING Query7
2021-10-06T01:42:47.099Z sample of 63.9 sec not long enough to calculate
steady-state event rate
Oct 06, 2021 1:42:47 AM org.apache.beam.sdk.testutils.metrics.MetricsReader
getCounterMetric
SEVERE: Failed to get metric fatal, from namespace Query7
2021-10-06T01:42:47.156Z WARNING: streaming query appears to have been stuck
for 58 min.
2021-10-06T01:42:47.156Z no activity
2021-10-06T01:43:02.196Z RUNNING Query7
2021-10-06T01:43:03.199Z sample of 63.9 sec not long enough to calculate
steady-state event rate
Oct 06, 2021 1:43:03 AM org.apache.beam.sdk.testutils.metrics.MetricsReader
getCounterMetric
2021-10-06T01:43:03.257Z WARNING: streaming query appears to have been stuck
for 58 min.
SEVERE: Failed to get metric fatal, from namespace Query7
2021-10-06T01:43:03.258Z no activity
2021-10-06T01:43:18.288Z RUNNING Query7
2021-10-06T01:43:18.828Z sample of 63.9 sec not long enough to calculate
steady-state event rate
Oct 06, 2021 1:43:18 AM org.apache.beam.sdk.testutils.metrics.MetricsReader
getCounterMetric
SEVERE: Failed to get metric fatal, from namespace Query7
2021-10-06T01:43:18.890Z WARNING: streaming query appears to have been stuck
for 58 min.
2021-10-06T01:43:18.890Z no activity
2021-10-06T01:43:33.923Z RUNNING Query7
2021-10-06T01:43:34.497Z sample of 63.9 sec not long enough to calculate
steady-state event rate
Oct 06, 2021 1:43:34 AM org.apache.beam.sdk.testutils.metrics.MetricsReader
getCounterMetric
SEVERE: Failed to get metric fatal, from namespace Query7
2021-10-06T01:43:34.542Z WARNING: streaming query appears to have been stuck
for 59 min.
2021-10-06T01:43:34.542Z no activity
2021-10-06T01:43:49.573Z RUNNING Query7
2021-10-06T01:43:50.348Z sample of 63.9 sec not long enough to calculate
steady-state event rate
Oct 06, 2021 1:43:50 AM org.apache.beam.sdk.testutils.metrics.MetricsReader
getCounterMetric
SEVERE: Failed to get metric fatal, from namespace Query7
2021-10-06T01:43:50.408Z WARNING: streaming query appears to have been stuck
for 59 min.
2021-10-06T01:43:50.408Z no activity
2021-10-06T01:44:05.459Z RUNNING Query7
2021-10-06T01:44:06.108Z sample of 63.9 sec not long enough to calculate
steady-state event rate
Oct 06, 2021 1:44:06 AM org.apache.beam.sdk.testutils.metrics.MetricsReader
getCounterMetric
SEVERE: Failed to get metric fatal, from namespace Query7
2021-10-06T01:44:06.172Z WARNING: streaming query appears to have been stuck
for 59 min.
2021-10-06T01:44:06.173Z no activity
2021-10-06T01:44:21.205Z RUNNING Query7
2021-10-06T01:44:21.795Z sample of 63.9 sec not long enough to calculate
steady-state event rate
Oct 06, 2021 1:44:21 AM org.apache.beam.sdk.testutils.metrics.MetricsReader
getCounterMetric
SEVERE: Failed to get metric fatal, from namespace Query7
2021-10-06T01:44:21.882Z WARNING: streaming query appears to have been stuck
for 59 min.
2021-10-06T01:44:21.882Z no activity
2021-10-06T01:44:36.923Z RUNNING Query7
2021-10-06T01:44:37.545Z sample of 63.9 sec not long enough to calculate
steady-state event rate
Oct 06, 2021 1:44:37 AM org.apache.beam.sdk.testutils.metrics.MetricsReader
getCounterMetric
SEVERE: Failed to get metric fatal, from namespace Query7
2021-10-06T01:44:37.754Z ERROR: streaming query appears to have been stuck for
60 minutes, cancelling job.
2021-10-06T01:44:37.792Z no activity
2021-10-06T01:44:52.822Z RUNNING Query7 (waiting for shutdown)
2021-10-06T01:44:53.420Z sample of 63.9 sec not long enough to calculate
steady-state event rate
2021-10-06T01:44:53.420Z no activity
2021-10-06T01:45:08.449Z RUNNING Query7 (waiting for shutdown)
2021-10-06T01:45:09.183Z sample of 63.9 sec not long enough to calculate
steady-state event rate
2021-10-06T01:45:09.183Z no activity
2021-10-06T01:45:24.228Z RUNNING Query7 (waiting for shutdown)
2021-10-06T01:45:24.921Z sample of 63.9 sec not long enough to calculate
steady-state event rate
2021-10-06T01:45:24.921Z no activity
2021-10-06T01:45:39.947Z RUNNING Query7 (waiting for shutdown)
2021-10-06T01:45:40.560Z sample of 63.9 sec not long enough to calculate
steady-state event rate
2021-10-06T01:45:40.560Z no activity
2021-10-06T01:45:55.593Z RUNNING Query7 (waiting for shutdown)
2021-10-06T01:45:56.270Z sample of 63.9 sec not long enough to calculate
steady-state event rate
2021-10-06T01:45:56.271Z no activity
2021-10-06T01:46:11.306Z RUNNING Query7 (waiting for shutdown)
2021-10-06T01:46:12.034Z sample of 63.9 sec not long enough to calculate
steady-state event rate
2021-10-06T01:46:12.035Z no activity
2021-10-06T01:46:27.063Z RUNNING Query7 (waiting for shutdown)
2021-10-06T01:46:27.657Z sample of 63.9 sec not long enough to calculate
steady-state event rate
2021-10-06T01:46:27.658Z no activity
2021-10-06T01:46:42.707Z RUNNING Query7 (waiting for shutdown)
2021-10-06T01:46:43.290Z sample of 63.9 sec not long enough to calculate
steady-state event rate
2021-10-06T01:46:43.290Z no activity
2021-10-06T01:46:58.319Z RUNNING Query7 (waiting for shutdown)
2021-10-06T01:46:58.870Z sample of 63.9 sec not long enough to calculate
steady-state event rate
2021-10-06T01:46:58.870Z no activity
2021-10-06T01:47:13.906Z CANCELLED Query7 (waiting for shutdown)
2021-10-06T01:47:13.937Z sample of 63.9 sec not long enough to calculate
steady-state event rate
==========================================================================================
Run started 2021-10-06T00:33:43.742Z and ran for PT4410.195S
Default configuration:
{"debug":true,"query":null,"sourceType":"DIRECT","generateEventFilePathPrefix":null,"sinkType":"DEVNULL","exportSummaryToBigQuery":false,"pubSubMode":"COMBINED","pubsubMessageSerializationMethod":"CODER","sideInputType":"DIRECT","sideInputRowCount":500,"sideInputNumShards":3,"sideInputUrl":null,"sessionGap":600000,"numEvents":100000,"numEventGenerators":100,"rateShape":"SINE","firstEventRate":10000,"nextEventRate":10000,"rateUnit":"PER_SECOND","ratePeriodSec":600,"preloadSeconds":0,"streamTimeout":240,"isRateLimited":false,"useWallclockEventTime":false,"avgPersonByteSize":200,"avgAuctionByteSize":500,"avgBidByteSize":100,"hotAuctionRatio":2,"hotSellersRatio":4,"hotBiddersRatio":4,"windowSizeSec":10,"windowPeriodSec":5,"watermarkHoldbackSec":0,"numInFlightAuctions":100,"numActivePeople":1000,"coderStrategy":"HAND","cpuDelayMs":0,"diskBusyBytes":0,"auctionSkip":123,"fanout":5,"maxAuctionsWaitingTime":600,"occasionalDelaySec":3,"probDelayedEvent":0.1,"maxLogEvents":100000,"usePubsubPublishTime":false,"outOfOrderGroupSize":1,"numKeyBuckets":20000,"pardoCPUFactor":1.0}
Configurations:
Conf Description
0000 query:PASSTHROUGH; numEvents:10000000
0001 query:CURRENCY_CONVERSION; numEvents:10000000
0002 query:SELECTION; numEvents:10000000
0003 query:LOCAL_ITEM_SUGGESTION; numEvents:10000000
0004 query:AVERAGE_PRICE_FOR_CATEGORY; numEvents:1000000
0005 query:HOT_ITEMS; numEvents:10000000
0006 query:AVERAGE_SELLING_PRICE_BY_SELLER; numEvents:1000000
0007 query:HIGHEST_BID; numEvents:10000000
0008 query:MONITOR_NEW_USERS; numEvents:10000000
0009 query:WINNING_BIDS; numEvents:1000000
0010 query:LOG_TO_SHARDED_FILES; numEvents:10000000
0011 query:USER_SESSIONS; numEvents:10000000
0012 query:PROCESSING_TIME_WINDOWS; numEvents:10000000
0013 query:PORTABILITY_BATCH; numEvents:10000000
0014 query:BOUNDED_SIDE_INPUT_JOIN; numEvents:10000000
0015 query:SESSION_SIDE_INPUT_JOIN; numEvents:10000000
Performance:
Conf Runtime(sec) (Baseline) Events(/sec) (Baseline) Results
(Baseline)
0000 36.1 206890.3 7476396
0001 24.3 334510.7 7484427
0002 20.3 466538.8 76807
0003 78.9 122633.5 57553
0004 *** not run ***
0005 417.7 23941.8 4567
0006 *** not run ***
0007 345.8 28709.1 100
*** Cancelling streaming job since it appeared stuck for 60 min. ***
0008 101.8 98265.6 92833
0009 *** not run ***
0010 114.1 87291.2 100
0011 473.0 20785.3 1808687
0012 133.9 74702.7 314779
0013 *** not run ***
0014 *** not run ***
0015 *** not run ***
==========================================================================================
==========================================================================================
Run started 2021-10-06T00:33:43.742Z and ran for PT4410.413S
Default configuration:
{"debug":true,"query":null,"sourceType":"DIRECT","generateEventFilePathPrefix":null,"sinkType":"DEVNULL","exportSummaryToBigQuery":false,"pubSubMode":"COMBINED","pubsubMessageSerializationMethod":"CODER","sideInputType":"DIRECT","sideInputRowCount":500,"sideInputNumShards":3,"sideInputUrl":null,"sessionGap":600000,"numEvents":100000,"numEventGenerators":100,"rateShape":"SINE","firstEventRate":10000,"nextEventRate":10000,"rateUnit":"PER_SECOND","ratePeriodSec":600,"preloadSeconds":0,"streamTimeout":240,"isRateLimited":false,"useWallclockEventTime":false,"avgPersonByteSize":200,"avgAuctionByteSize":500,"avgBidByteSize":100,"hotAuctionRatio":2,"hotSellersRatio":4,"hotBiddersRatio":4,"windowSizeSec":10,"windowPeriodSec":5,"watermarkHoldbackSec":0,"numInFlightAuctions":100,"numActivePeople":1000,"coderStrategy":"HAND","cpuDelayMs":0,"diskBusyBytes":0,"auctionSkip":123,"fanout":5,"maxAuctionsWaitingTime":600,"occasionalDelaySec":3,"probDelayedEvent":0.1,"maxLogEvents":100000,"usePubsubPublishTime":false,"outOfOrderGroupSize":1,"numKeyBuckets":20000,"pardoCPUFactor":1.0}
Configurations:
Conf Description
0000 query:PASSTHROUGH; numEvents:10000000
0001 query:CURRENCY_CONVERSION; numEvents:10000000
0002 query:SELECTION; numEvents:10000000
0003 query:LOCAL_ITEM_SUGGESTION; numEvents:10000000
0004 query:AVERAGE_PRICE_FOR_CATEGORY; numEvents:1000000
0005 query:HOT_ITEMS; numEvents:10000000
0006 query:AVERAGE_SELLING_PRICE_BY_SELLER; numEvents:1000000
0007 query:HIGHEST_BID; numEvents:10000000
0008 query:MONITOR_NEW_USERS; numEvents:10000000
0009 query:WINNING_BIDS; numEvents:1000000
0010 query:LOG_TO_SHARDED_FILES; numEvents:10000000
0011 query:USER_SESSIONS; numEvents:10000000
0012 query:PROCESSING_TIME_WINDOWS; numEvents:10000000
0013 query:PORTABILITY_BATCH; numEvents:10000000
0014 query:BOUNDED_SIDE_INPUT_JOIN; numEvents:10000000
0015 query:SESSION_SIDE_INPUT_JOIN; numEvents:10000000
Performance:
Conf Runtime(sec) (Baseline) Events(/sec) (Baseline) Results
(Baseline)
0000 36.1 206890.3 7476396
0001 24.3 334510.7 7484427
0002 20.3 466538.8 76807
0003 78.9 122633.5 57553
0004 *** not run ***
0005 417.7 23941.8 4567
0006 *** not run ***
0007 345.8 28709.1 100
*** Cancelling streaming job since it appeared stuck for 60 min. ***
0008 101.8 98265.6 92833
0009 *** not run ***
0010 114.1 87291.2 100
0011 473.0 20785.3 1808687
0012 133.9 74702.7 314779
0013 *** not run ***
0014 *** not run ***
0015 *** not run ***
==========================================================================================
Exception in thread "main" java.lang.RuntimeException: Execution was not
successful
at org.apache.beam.sdk.nexmark.Main.runAll(Main.java:186)
at org.apache.beam.sdk.nexmark.Main.main(Main.java:495)
> Task :sdks:java:testing:nexmark:run FAILED
> Task :runners:google-cloud-dataflow-java:cleanUpDockerImages
Untagged: us.gcr.io/apache-beam-testing/java-postcommit-it/java:20211006003150
Untagged:
us.gcr.io/apache-beam-testing/java-postcommit-it/java@sha256:90cdb76932a521bf1f6af0845d5dcb60b297793b09d64baf79832cf9ae4b51eb
Deleted: sha256:7bb4e42a9226c65f1f28af39999112423493f321c5fa2a1071faa19ff835c95d
Deleted: sha256:d82ee9e5574f0cb739b3e4e6f7345f827ecdb5254ef69d051e2602389212707b
Deleted: sha256:4a801b54a767c587a1368147f80cbc3f18e2b44233e8268c3b0b402734fed001
Deleted: sha256:2ad376ebb6d14d40dc95b7b6c34c20a2065af14d579890ad0bb48c661461e17f
Deleted: sha256:c2c1de987719f5fb7b728a2d797dd527fc084aaa27894b35092162e4d394fae7
Deleted: sha256:db4612d84533f0724dc00c630775de56594cc3ce3a4bf1f82b9c635170677dc6
Deleted: sha256:b4f58df04a6bc87122c4d2dde7cfa63dfe4e5ab53e1e789c93ff0f67ffeb377e
Deleted: sha256:f575c3ab515b81b6369b1b7e4827c6643d30f91527072d98e7843e9350754894
Deleted: sha256:67fc28c396ffca20ce41f575d94962bbe1c9f2fe16cc7fe2e1cd07510470d572
Deleted: sha256:65a7310bca1cf023109c233722225741b230d848fab73a5d3589c62997eae4e1
Deleted: sha256:ab89e688bda5ac591a90bf0a876faec80d5249a3f92ec1c36911326fad9eefc9
Deleted: sha256:d5fe302bb540c2598afb953e51d7d92539125a77463ffa76df5e57c38f8282db
Deleted: sha256:610bcadd2e1f961ca99c140cd15182f69f55d1dc7b4d168c2902ab25336bc9c8
Deleted: sha256:02c5588787d8ceb7a688f326427e23a042db655f08d73d82b19cbde02fb5cc0a
Deleted: sha256:781268e2f23f762d36edf0be9fca6d8247357730a15db990fa647246665ad036
Deleted: sha256:8b8528a641b1268220cc95e1e394211442f61f9c6b770d98f97e95e38e62b871
Deleted: sha256:fa6d7a60530631246d07919d75a48f070a6b17519f9bd45dee03b2119ddec266
Deleted: sha256:f0ccdd89b5cc3907a903cdeed70dcd11aac2330af2b36721a35be7a677d1b476
Deleted: sha256:b7c512d6d96988bf240ef443dce3383b7ae75f5e3f02d0ab2b6d2f8f05da2c2b
Deleted: sha256:8cf0388e2cd99f7f1738b5bb5b5aa8fd4ae535a659520034c4611fe823d3fe1c
Deleted: sha256:ab795220fcd83732c9348aea8011ca02f923b47833e8659bc108af226f7e27b0
Deleted: sha256:57e034696e3e084c4549b010760dc135ed4e10372c5c69d5519a6112dbc195a1
Deleted: sha256:28d44ac7639b620a0ca10a901a22e8a4e469fa682284f331492f6bfa6039eec2
Deleted: sha256:dbce8c941c8ca71c105e6de328a65c0e99726ef09997edf052760b52608957e1
Deleted: sha256:6ca8c0dddc6a42732b5eb46a7178873f37e500e8f996f133d8aaf9770d9f6b8c
Deleted: sha256:68093872858805a99a53892fbba3195114da5da9fdabb404de2e8d7b3a9443ca
Deleted: sha256:ac97fe91ee9ad49edecdc5402b1d193aacec381bb143709254a287a39901f90c
Deleted: sha256:21d0bf254e802d7bfcb1b6ef65d5ce28050633f42d82d6fe4ceb5f47f76392bc
Tag: [us.gcr.io/apache-beam-testing/java-postcommit-it/java:20211006003150]
- referencing digest:
[us.gcr.io/apache-beam-testing/java-postcommit-it/java@sha256:90cdb76932a521bf1f6af0845d5dcb60b297793b09d64baf79832cf9ae4b51eb]
Deleted [[us.gcr.io/apache-beam-testing/java-postcommit-it/java:20211006003150]
(referencing
[us.gcr.io/apache-beam-testing/java-postcommit-it/java@sha256:90cdb76932a521bf1f6af0845d5dcb60b297793b09d64baf79832cf9ae4b51eb])].
Removing untagged image
us.gcr.io/apache-beam-testing/java-postcommit-it/java@sha256:90cdb76932a521bf1f6af0845d5dcb60b297793b09d64baf79832cf9ae4b51eb
Digests:
-
us.gcr.io/apache-beam-testing/java-postcommit-it/java@sha256:90cdb76932a521bf1f6af0845d5dcb60b297793b09d64baf79832cf9ae4b51eb
Deleted
[us.gcr.io/apache-beam-testing/java-postcommit-it/java@sha256:90cdb76932a521bf1f6af0845d5dcb60b297793b09d64baf79832cf9ae4b51eb].
FAILURE: Build failed with an exception.
* What went wrong:
Execution failed for task ':sdks:java:testing:nexmark:run'.
> Process 'command '/usr/lib/jvm/java-8-openjdk-amd64/bin/java'' finished with
> non-zero exit value 1
* Try:
Run with --stacktrace option to get the stack trace. Run with --info or --debug
option to get more log output. Run with --scan to get full insights.
* Get more help at https://help.gradle.org
Deprecated Gradle features were used in this build, making it incompatible with
Gradle 7.0.
Use '--warning-mode all' to show the individual deprecation warnings.
See
https://docs.gradle.org/6.9.1/userguide/command_line_interface.html#sec:command_line_warnings
BUILD FAILED in 1h 15m 48s
123 actionable tasks: 10 executed, 113 up-to-date
Publishing build scan...
https://gradle.com/s/r2knukyqlywyg
Build step 'Invoke Gradle script' changed build result to FAILURE
Build step 'Invoke Gradle script' marked build as failure
---------------------------------------------------------------------
To unsubscribe, e-mail: [email protected]
For additional commands, e-mail: [email protected]
