See
<https://ci-beam.apache.org/job/beam_PostCommit_Java_Nexmark_Dataflow_V2_Java11/7/display/redirect?page=changes>
Changes:
[noreply] [BEAM-7372] cleanup py2 and py35 codepath from apache_beam/typehints
[noreply] [BEAM-11227] Upgrade vendored gRPC to 1.36.0 with test fix (#14833)
------------------------------------------
[...truncated 1.08 MB...]
2021-05-20T08:48:49.584Z RUNNING SqlQuery7
2021-05-20T08:48:50.600Z revising events/sec from 2624.4 to 4467.4
May 20, 2021 8:48:50 AM org.apache.beam.sdk.testutils.metrics.MetricsReader
getCounterMetric
2021-05-20T08:48:50.685Z WARNING: streaming query appears to have been stuck
for 57 min.
SEVERE: Failed to get metric fatal, from namespace SqlQuery7
2021-05-20T08:48:50.686Z no activity
2021-05-20T08:49:05.737Z RUNNING SqlQuery7
2021-05-20T08:49:06.663Z revising events/sec from 2624.4 to 4467.4
May 20, 2021 8:49:06 AM org.apache.beam.sdk.testutils.metrics.MetricsReader
getCounterMetric
2021-05-20T08:49:06.768Z WARNING: streaming query appears to have been stuck
for 57 min.
2021-05-20T08:49:06.768Z no activity
SEVERE: Failed to get metric fatal, from namespace SqlQuery7
2021-05-20T08:49:21.809Z RUNNING SqlQuery7
2021-05-20T08:49:22.835Z revising events/sec from 2624.4 to 4467.4
May 20, 2021 8:49:22 AM org.apache.beam.sdk.testutils.metrics.MetricsReader
getCounterMetric
SEVERE: Failed to get metric fatal, from namespace SqlQuery7
2021-05-20T08:49:22.935Z WARNING: streaming query appears to have been stuck
for 57 min.
2021-05-20T08:49:22.935Z no activity
2021-05-20T08:49:38.012Z RUNNING SqlQuery7
2021-05-20T08:49:39.063Z revising events/sec from 2624.4 to 4467.4
May 20, 2021 8:49:39 AM org.apache.beam.sdk.testutils.metrics.MetricsReader
getCounterMetric
2021-05-20T08:49:39.236Z WARNING: streaming query appears to have been stuck
for 58 min.
2021-05-20T08:49:39.236Z no activity
SEVERE: Failed to get metric fatal, from namespace SqlQuery7
2021-05-20T08:49:54.276Z RUNNING SqlQuery7
2021-05-20T08:49:55.281Z revising events/sec from 2624.4 to 4467.4
2021-05-20T08:49:55.358Z WARNING: streaming query appears to have been stuck
for 58 min.
2021-05-20T08:49:55.358Z no activity
May 20, 2021 8:49:55 AM org.apache.beam.sdk.testutils.metrics.MetricsReader
getCounterMetric
SEVERE: Failed to get metric fatal, from namespace SqlQuery7
2021-05-20T08:50:10.482Z RUNNING SqlQuery7
2021-05-20T08:50:11.419Z revising events/sec from 2624.4 to 4467.4
May 20, 2021 8:50:11 AM org.apache.beam.sdk.testutils.metrics.MetricsReader
getCounterMetric
2021-05-20T08:50:11.716Z WARNING: streaming query appears to have been stuck
for 58 min.
SEVERE: Failed to get metric fatal, from namespace SqlQuery7
2021-05-20T08:50:11.716Z no activity
2021-05-20T08:50:26.767Z RUNNING SqlQuery7
2021-05-20T08:50:27.740Z revising events/sec from 2624.4 to 4467.4
May 20, 2021 8:50:27 AM org.apache.beam.sdk.testutils.metrics.MetricsReader
getCounterMetric
SEVERE: Failed to get metric fatal, from namespace SqlQuery7
2021-05-20T08:50:27.836Z WARNING: streaming query appears to have been stuck
for 58 min.
2021-05-20T08:50:27.836Z no activity
2021-05-20T08:50:43.003Z RUNNING SqlQuery7
2021-05-20T08:50:43.972Z revising events/sec from 2624.4 to 4467.4
May 20, 2021 8:50:44 AM org.apache.beam.sdk.testutils.metrics.MetricsReader
getCounterMetric
2021-05-20T08:50:44.160Z WARNING: streaming query appears to have been stuck
for 59 min.
SEVERE: Failed to get metric fatal, from namespace SqlQuery7
2021-05-20T08:50:44.160Z no activity
2021-05-20T08:50:59.279Z RUNNING SqlQuery7
2021-05-20T08:51:00.336Z revising events/sec from 2624.4 to 4467.4
May 20, 2021 8:51:00 AM org.apache.beam.sdk.testutils.metrics.MetricsReader
getCounterMetric
2021-05-20T08:51:00.492Z WARNING: streaming query appears to have been stuck
for 59 min.
SEVERE: Failed to get metric fatal, from namespace SqlQuery7
2021-05-20T08:51:00.492Z no activity
2021-05-20T08:51:15.616Z RUNNING SqlQuery7
2021-05-20T08:51:16.553Z revising events/sec from 2624.4 to 4467.4
May 20, 2021 8:51:16 AM org.apache.beam.sdk.testutils.metrics.MetricsReader
getCounterMetric
SEVERE: Failed to get metric fatal, from namespace SqlQuery7
2021-05-20T08:51:16.635Z WARNING: streaming query appears to have been stuck
for 59 min.
2021-05-20T08:51:16.635Z no activity
2021-05-20T08:51:31.695Z RUNNING SqlQuery7
2021-05-20T08:51:33.975Z revising events/sec from 2624.4 to 4467.4
May 20, 2021 8:51:34 AM org.apache.beam.sdk.testutils.metrics.MetricsReader
getCounterMetric
2021-05-20T08:51:34.043Z WARNING: streaming query appears to have been stuck
for 59 min.
SEVERE: Failed to get metric fatal, from namespace SqlQuery7
2021-05-20T08:51:34.043Z no activity
2021-05-20T08:51:49.082Z RUNNING SqlQuery7
2021-05-20T08:51:50.415Z revising events/sec from 2624.4 to 4467.4
May 20, 2021 8:51:50 AM org.apache.beam.sdk.testutils.metrics.MetricsReader
getCounterMetric
2021-05-20T08:51:50.531Z ERROR: streaming query appears to have been stuck for
60 minutes, cancelling job.
SEVERE: Failed to get metric fatal, from namespace SqlQuery7
2021-05-20T08:51:50.577Z no activity
2021-05-20T08:52:05.629Z RUNNING SqlQuery7 (waiting for shutdown)
2021-05-20T08:52:06.889Z revising events/sec from 2624.4 to 4467.4
2021-05-20T08:52:06.889Z no activity
2021-05-20T08:52:21.931Z RUNNING SqlQuery7 (waiting for shutdown)
2021-05-20T08:52:22.776Z revising events/sec from 2624.4 to 4467.4
2021-05-20T08:52:22.776Z no activity
2021-05-20T08:52:37.821Z RUNNING SqlQuery7 (waiting for shutdown)
2021-05-20T08:52:38.867Z revising events/sec from 2624.4 to 4467.4
2021-05-20T08:52:38.867Z no activity
2021-05-20T08:52:53.918Z RUNNING SqlQuery7 (waiting for shutdown)
2021-05-20T08:52:54.479Z revising events/sec from 2624.4 to 4467.4
2021-05-20T08:52:54.479Z no activity
2021-05-20T08:53:09.479Z CANCELLED SqlQuery7 (waiting for shutdown)
2021-05-20T08:53:09.479Z revising events/sec from 2624.4 to 4467.4
==========================================================================================
Run started 2021-05-20T06:47:01.686Z and ran for PT7567.794S
Default configuration:
{"debug":true,"query":null,"sourceType":"DIRECT","generateEventFilePathPrefix":null,"sinkType":"DEVNULL","exportSummaryToBigQuery":false,"pubSubMode":"COMBINED","pubsubMessageSerializationMethod":"CODER","sideInputType":"DIRECT","sideInputRowCount":500,"sideInputNumShards":3,"sideInputUrl":null,"sessionGap":600000,"numEvents":100000,"numEventGenerators":100,"rateShape":"SINE","firstEventRate":10000,"nextEventRate":10000,"rateUnit":"PER_SECOND","ratePeriodSec":600,"preloadSeconds":0,"streamTimeout":240,"isRateLimited":false,"useWallclockEventTime":false,"avgPersonByteSize":200,"avgAuctionByteSize":500,"avgBidByteSize":100,"hotAuctionRatio":2,"hotSellersRatio":4,"hotBiddersRatio":4,"windowSizeSec":10,"windowPeriodSec":5,"watermarkHoldbackSec":0,"numInFlightAuctions":100,"numActivePeople":1000,"coderStrategy":"HAND","cpuDelayMs":0,"diskBusyBytes":0,"auctionSkip":123,"fanout":5,"maxAuctionsWaitingTime":600,"occasionalDelaySec":3,"probDelayedEvent":0.1,"maxLogEvents":100000,"usePubsubPublishTime":false,"outOfOrderGroupSize":1,"numKeyBuckets":20000,"pardoCPUFactor":1.0}
Configurations:
Conf Description
0000 query:PASSTHROUGH; numEvents:10000000
0001 query:CURRENCY_CONVERSION; numEvents:10000000
0002 query:SELECTION; numEvents:10000000
0003 query:LOCAL_ITEM_SUGGESTION; numEvents:10000000
0004 query:AVERAGE_PRICE_FOR_CATEGORY; numEvents:1000000
0005 query:HOT_ITEMS; numEvents:10000000
0006 query:AVERAGE_SELLING_PRICE_BY_SELLER; numEvents:1000000
0007 query:HIGHEST_BID; numEvents:10000000
0008 query:MONITOR_NEW_USERS; numEvents:10000000
0009 query:WINNING_BIDS; numEvents:1000000
0010 query:LOG_TO_SHARDED_FILES; numEvents:10000000
0011 query:USER_SESSIONS; numEvents:10000000
0012 query:PROCESSING_TIME_WINDOWS; numEvents:10000000
0013 query:PORTABILITY_BATCH; numEvents:10000000
0014 query:BOUNDED_SIDE_INPUT_JOIN; numEvents:10000000
0015 query:SESSION_SIDE_INPUT_JOIN; numEvents:10000000
Performance:
Conf Runtime(sec) (Baseline) Events(/sec) (Baseline) Results
(Baseline)
0000 36.9 222771.7 7552775
0001 37.2 243045.4 8311926
0002 15.8 503469.1 64533
0003 117.5 84294.1 8975
0004 *** not run ***
0005 *** not run ***
0006 *** not run ***
0007 3696.6 4467.4 2
*** Cancelling streaming job since it appeared stuck for 60 min. ***
0008 *** not run ***
0009 *** not run ***
0010 *** not run ***
0011 *** not run ***
0012 *** not run ***
0013 *** not run ***
0014 *** not run ***
0015 *** not run ***
==========================================================================================
==========================================================================================
Run started 2021-05-20T06:47:01.686Z and ran for PT7567.979S
Default configuration:
{"debug":true,"query":null,"sourceType":"DIRECT","generateEventFilePathPrefix":null,"sinkType":"DEVNULL","exportSummaryToBigQuery":false,"pubSubMode":"COMBINED","pubsubMessageSerializationMethod":"CODER","sideInputType":"DIRECT","sideInputRowCount":500,"sideInputNumShards":3,"sideInputUrl":null,"sessionGap":600000,"numEvents":100000,"numEventGenerators":100,"rateShape":"SINE","firstEventRate":10000,"nextEventRate":10000,"rateUnit":"PER_SECOND","ratePeriodSec":600,"preloadSeconds":0,"streamTimeout":240,"isRateLimited":false,"useWallclockEventTime":false,"avgPersonByteSize":200,"avgAuctionByteSize":500,"avgBidByteSize":100,"hotAuctionRatio":2,"hotSellersRatio":4,"hotBiddersRatio":4,"windowSizeSec":10,"windowPeriodSec":5,"watermarkHoldbackSec":0,"numInFlightAuctions":100,"numActivePeople":1000,"coderStrategy":"HAND","cpuDelayMs":0,"diskBusyBytes":0,"auctionSkip":123,"fanout":5,"maxAuctionsWaitingTime":600,"occasionalDelaySec":3,"probDelayedEvent":0.1,"maxLogEvents":100000,"usePubsubPublishTime":false,"outOfOrderGroupSize":1,"numKeyBuckets":20000,"pardoCPUFactor":1.0}
Configurations:
Conf Description
0000 query:PASSTHROUGH; numEvents:10000000
0001 query:CURRENCY_CONVERSION; numEvents:10000000
0002 query:SELECTION; numEvents:10000000
0003 query:LOCAL_ITEM_SUGGESTION; numEvents:10000000
0004 query:AVERAGE_PRICE_FOR_CATEGORY; numEvents:1000000
0005 query:HOT_ITEMS; numEvents:10000000
0006 query:AVERAGE_SELLING_PRICE_BY_SELLER; numEvents:1000000
0007 query:HIGHEST_BID; numEvents:10000000
0008 query:MONITOR_NEW_USERS; numEvents:10000000
0009 query:WINNING_BIDS; numEvents:1000000
0010 query:LOG_TO_SHARDED_FILES; numEvents:10000000
0011 query:USER_SESSIONS; numEvents:10000000
0012 query:PROCESSING_TIME_WINDOWS; numEvents:10000000
0013 query:PORTABILITY_BATCH; numEvents:10000000
0014 query:BOUNDED_SIDE_INPUT_JOIN; numEvents:10000000
0015 query:SESSION_SIDE_INPUT_JOIN; numEvents:10000000
Performance:
Conf Runtime(sec) (Baseline) Events(/sec) (Baseline) Results
(Baseline)
0000 36.9 222771.7 7552775
0001 37.2 243045.4 8311926
0002 15.8 503469.1 64533
0003 117.5 84294.1 8975
0004 *** not run ***
0005 *** not run ***
0006 *** not run ***
0007 3696.6 4467.4 2
*** Cancelling streaming job since it appeared stuck for 60 min. ***
0008 *** not run ***
0009 *** not run ***
0010 *** not run ***
0011 *** not run ***
0012 *** not run ***
0013 *** not run ***
0014 *** not run ***
0015 *** not run ***
==========================================================================================
Exception in thread "main" java.lang.RuntimeException: Execution was not
successful
at org.apache.beam.sdk.nexmark.Main.runAll(Main.java:186)
at org.apache.beam.sdk.nexmark.Main.main(Main.java:495)
> Task :sdks:java:testing:nexmark:runJava11 FAILED
> Task :runners:google-cloud-dataflow-java:cleanUpDockerImages
Untagged: us.gcr.io/apache-beam-testing/java-postcommit-it/java:20210520064624
Untagged:
us.gcr.io/apache-beam-testing/java-postcommit-it/java@sha256:247412838fb64f27bea236905bc616c01b013bdeb1cf82a618b07f5902048930
Deleted: sha256:3161a0bf66072c7374aabd93e5961ab1a04f0ede2628c43104378ce5093c29a2
Deleted: sha256:516d7405c2eb00d84f0ff0bee5490d7fda198150cddbb5e018c3211476d38293
Deleted: sha256:20b27b603253a548cc08ccf868c3b182dc4d395f096aee0de86ba3f8ff8fe513
Deleted: sha256:4a8fbf4022cc351d12b14e69fcc83861fd633a41132f8b838afa876d28fe3628
Deleted: sha256:d41671837e8e8f79e30abb558cfd9776b624e3693c832f1f1263b4a94c5ea064
Deleted: sha256:2a84c6c373e891ff0410f4c3dec6ad991887a0a2b420cdffd119f48c8a062650
Deleted: sha256:9ccc6154cb56de0b8cd3e4865273d639ebe685329728a133b60fbe17d279f875
Deleted: sha256:5eed89faaa8142dd22c741d919ff3585a5ca046b1e5595b2b52e1e5e25e31286
Deleted: sha256:40d16f267dd654df6981c03bd0ddeff027eb95f9b7f0ae0430f2204f76ad27a8
Deleted: sha256:1ab8b4a7a783c8d30a0cc42f24ef59a7682588f1a19cf05f407e1e5a1be1df6c
Deleted: sha256:2a7289be75197baa49cb90f350e908aee76c79c734b5c518a719604d95439a7d
Deleted: sha256:c3f82ad315c64643f3d4e5025405722847311cfd4cc7a808beaaeb3794d0c099
Deleted: sha256:7f932da62e02df6ffe9a70d11326b767bb108883278f9436f678cb3d667b44fb
Deleted: sha256:8eb167028d16dc69af99044cea98a8474f09cdea16831ecb3e0e98157b8f0304
Deleted: sha256:4179ac424c608bc1df92d99e829243aa6e15839ffd188aa1242639c14fffc0a0
Deleted: sha256:6ddb55cafddd42e487e467e77928d7fb7811e13f1d11d3efdf3c6a5886955c32
Deleted: sha256:eede50c4790745e7a0eb59803fa991d25372b419437428f0e423f9aba1cd2785
Deleted: sha256:a495a9ed55fd5ec98c68632f8dcbf89136209d4003510ae6fa6f67fc9d375eff
Deleted: sha256:bb74d025418844c20a7e7a11137dd0d42f882c04ec2b7615584cfcb7c8110c57
Deleted: sha256:2661a4041c06d8acd9a7776967343c1a2d281b5b73fb26e6d159bb52680f84d4
Deleted: sha256:abe40b2efd12f97f7985a98abd632d3a649306902b605dd487a4518e55b1a38d
Deleted: sha256:02102d90ce8b7b58c693e624f1f7e8f72447f76530fd23711acd6374eac59040
Deleted: sha256:8f624a7f52b0356042937d9c208c9fb2eeb60f629f43a6239063d046df542095
Deleted: sha256:5e19b4b4fee4c953c0d8903d99caf03fd27335a66e5ef41844ab59595d4740b3
Deleted: sha256:861c89a6c221b2f4ce4f0ec3f23b2d804ff22f02e6103c6583fc7deca88b0717
Deleted: sha256:c8ca0d7227bfbb3257ede6ed1895e79ee89191967ec38740658580d1ad9a0e06
Deleted: sha256:72ece144700036469b0e1d1917d51265a2b3f3cec2b28c8166356b5b0dc80aeb
Deleted: sha256:af8b883b653c8d5d905563db11e8bd7706842e691fb1a06564db995a01738bb3
Digests:
-
us.gcr.io/apache-beam-testing/java-postcommit-it/java@sha256:247412838fb64f27bea236905bc616c01b013bdeb1cf82a618b07f5902048930
Associated tags:
- 20210520064624
Tags:
- us.gcr.io/apache-beam-testing/java-postcommit-it/java:20210520064624
Deleted [us.gcr.io/apache-beam-testing/java-postcommit-it/java:20210520064624].
Deleted
[us.gcr.io/apache-beam-testing/java-postcommit-it/java@sha256:247412838fb64f27bea236905bc616c01b013bdeb1cf82a618b07f5902048930].
FAILURE: Build failed with an exception.
* What went wrong:
Execution failed for task ':sdks:java:testing:nexmark:runJava11'.
> Process 'command '/usr/lib/jvm/java-11-openjdk-amd64/bin/java'' finished with
> non-zero exit value 1
* Try:
Run with --stacktrace option to get the stack trace. Run with --info or --debug
option to get more log output. Run with --scan to get full insights.
* Get more help at https://help.gradle.org
Deprecated Gradle features were used in this build, making it incompatible with
Gradle 7.0.
Use '--warning-mode all' to show the individual deprecation warnings.
See
https://docs.gradle.org/6.8.3/userguide/command_line_interface.html#sec:command_line_warnings
BUILD FAILED in 2h 6m 50s
126 actionable tasks: 14 executed, 112 up-to-date
Publishing build scan...
https://gradle.com/s/ogbiotfr3t53w
Build step 'Invoke Gradle script' changed build result to FAILURE
Build step 'Invoke Gradle script' marked build as failure
---------------------------------------------------------------------
To unsubscribe, e-mail: [email protected]
For additional commands, e-mail: [email protected]
