See
<https://ci-beam.apache.org/job/beam_PostCommit_Java_Nexmark_Dataflow_V2/305/display/redirect>
Changes:
------------------------------------------
[...truncated 2.92 MB...]
Aug 08, 2021 7:28:59 PM org.apache.beam.sdk.testutils.metrics.MetricsReader
getCounterMetric
SEVERE: Failed to get metric result.bytes, from namespace Query12.Results
2021-08-08T19:28:59.071Z 0 samples not enough to calculate steady-state event
rate
==========================================================================================
Run started 2021-08-08T18:21:54.289Z and ran for PT4024.782S
Default configuration:
{"debug":true,"query":null,"sourceType":"DIRECT","generateEventFilePathPrefix":null,"sinkType":"DEVNULL","exportSummaryToBigQuery":false,"pubSubMode":"COMBINED","pubsubMessageSerializationMethod":"CODER","sideInputType":"DIRECT","sideInputRowCount":500,"sideInputNumShards":3,"sideInputUrl":null,"sessionGap":600000,"numEvents":100000,"numEventGenerators":100,"rateShape":"SINE","firstEventRate":10000,"nextEventRate":10000,"rateUnit":"PER_SECOND","ratePeriodSec":600,"preloadSeconds":0,"streamTimeout":240,"isRateLimited":false,"useWallclockEventTime":false,"avgPersonByteSize":200,"avgAuctionByteSize":500,"avgBidByteSize":100,"hotAuctionRatio":2,"hotSellersRatio":4,"hotBiddersRatio":4,"windowSizeSec":10,"windowPeriodSec":5,"watermarkHoldbackSec":0,"numInFlightAuctions":100,"numActivePeople":1000,"coderStrategy":"HAND","cpuDelayMs":0,"diskBusyBytes":0,"auctionSkip":123,"fanout":5,"maxAuctionsWaitingTime":600,"occasionalDelaySec":3,"probDelayedEvent":0.1,"maxLogEvents":100000,"usePubsubPublishTime":false,"outOfOrderGroupSize":1,"numKeyBuckets":20000,"pardoCPUFactor":1.0}
Configurations:
Conf Description
0000 query:PASSTHROUGH; numEvents:10000000
0001 query:CURRENCY_CONVERSION; numEvents:10000000
0002 query:SELECTION; numEvents:10000000
0003 query:LOCAL_ITEM_SUGGESTION; numEvents:10000000
0004 query:AVERAGE_PRICE_FOR_CATEGORY; numEvents:1000000
0005 query:HOT_ITEMS; numEvents:10000000
0006 query:AVERAGE_SELLING_PRICE_BY_SELLER; numEvents:1000000
0007 query:HIGHEST_BID; numEvents:10000000
0008 query:MONITOR_NEW_USERS; numEvents:10000000
0009 query:WINNING_BIDS; numEvents:1000000
0010 query:LOG_TO_SHARDED_FILES; numEvents:10000000
0011 query:USER_SESSIONS; numEvents:10000000
0012 query:PROCESSING_TIME_WINDOWS; numEvents:10000000
0013 query:PORTABILITY_BATCH; numEvents:10000000
0014 query:BOUNDED_SIDE_INPUT_JOIN; numEvents:10000000
0015 query:SESSION_SIDE_INPUT_JOIN; numEvents:10000000
Performance:
Conf Runtime(sec) (Baseline) Events(/sec) (Baseline) Results
(Baseline)
0000 -1.0 -1.0 -1
*** Cancelling streaming job since it appeared stuck for 60 min. ***
0001 -1.0 -1.0 -1
*** Cancelling streaming job since it appeared stuck for 60 min. ***
0002 -1.0 -1.0 -1
*** Cancelling streaming job since it appeared stuck for 60 min. ***
0003 -1.0 -1.0 -1
*** Cancelling streaming job since it appeared stuck for 60 min. ***
0004 *** not run ***
0005 -1.0 -1.0 -1
*** Cancelling streaming job since it appeared stuck for 60 min. ***
0006 *** not run ***
0007 -1.0 -1.0 -1
*** Cancelling streaming job since it appeared stuck for 60 min. ***
0008 -1.0 -1.0 -1
*** Cancelling streaming job since it appeared stuck for 60 min. ***
0009 *** not run ***
0010 *** not run ***
0011 -1.0 -1.0 -1
*** Cancelling streaming job since it appeared stuck for 60 min. ***
0012 -1.0 -1.0 -1
*** Cancelling streaming job since it appeared stuck for 60 min. ***
0013 *** not run ***
0014 *** not run ***
0015 *** not run ***
==========================================================================================
2021-08-08T19:28:59.661Z CANCELLED Query10 (waiting for shutdown)
Aug 08, 2021 7:28:59 PM org.apache.beam.sdk.testutils.metrics.MetricsReader
getCounterMetric
SEVERE: Failed to get metric event.elements, from namespace Query10.Events
Aug 08, 2021 7:28:59 PM org.apache.beam.sdk.testutils.metrics.MetricsReader
getCounterMetric
SEVERE: Failed to get metric event.bytes, from namespace Query10.Events
Aug 08, 2021 7:28:59 PM org.apache.beam.sdk.testutils.metrics.MetricsReader
getCounterMetric
SEVERE: Failed to get metric result.elements, from namespace Query10.Results
Aug 08, 2021 7:28:59 PM org.apache.beam.sdk.testutils.metrics.MetricsReader
getCounterMetric
SEVERE: Failed to get metric result.bytes, from namespace Query10.Results
2021-08-08T19:28:59.681Z 0 samples not enough to calculate steady-state event
rate
==========================================================================================
Run started 2021-08-08T18:21:54.289Z and ran for PT4025.392S
Default configuration:
{"debug":true,"query":null,"sourceType":"DIRECT","generateEventFilePathPrefix":null,"sinkType":"DEVNULL","exportSummaryToBigQuery":false,"pubSubMode":"COMBINED","pubsubMessageSerializationMethod":"CODER","sideInputType":"DIRECT","sideInputRowCount":500,"sideInputNumShards":3,"sideInputUrl":null,"sessionGap":600000,"numEvents":100000,"numEventGenerators":100,"rateShape":"SINE","firstEventRate":10000,"nextEventRate":10000,"rateUnit":"PER_SECOND","ratePeriodSec":600,"preloadSeconds":0,"streamTimeout":240,"isRateLimited":false,"useWallclockEventTime":false,"avgPersonByteSize":200,"avgAuctionByteSize":500,"avgBidByteSize":100,"hotAuctionRatio":2,"hotSellersRatio":4,"hotBiddersRatio":4,"windowSizeSec":10,"windowPeriodSec":5,"watermarkHoldbackSec":0,"numInFlightAuctions":100,"numActivePeople":1000,"coderStrategy":"HAND","cpuDelayMs":0,"diskBusyBytes":0,"auctionSkip":123,"fanout":5,"maxAuctionsWaitingTime":600,"occasionalDelaySec":3,"probDelayedEvent":0.1,"maxLogEvents":100000,"usePubsubPublishTime":false,"outOfOrderGroupSize":1,"numKeyBuckets":20000,"pardoCPUFactor":1.0}
Configurations:
Conf Description
0000 query:PASSTHROUGH; numEvents:10000000
0001 query:CURRENCY_CONVERSION; numEvents:10000000
0002 query:SELECTION; numEvents:10000000
0003 query:LOCAL_ITEM_SUGGESTION; numEvents:10000000
0004 query:AVERAGE_PRICE_FOR_CATEGORY; numEvents:1000000
0005 query:HOT_ITEMS; numEvents:10000000
0006 query:AVERAGE_SELLING_PRICE_BY_SELLER; numEvents:1000000
0007 query:HIGHEST_BID; numEvents:10000000
0008 query:MONITOR_NEW_USERS; numEvents:10000000
0009 query:WINNING_BIDS; numEvents:1000000
0010 query:LOG_TO_SHARDED_FILES; numEvents:10000000
0011 query:USER_SESSIONS; numEvents:10000000
0012 query:PROCESSING_TIME_WINDOWS; numEvents:10000000
0013 query:PORTABILITY_BATCH; numEvents:10000000
0014 query:BOUNDED_SIDE_INPUT_JOIN; numEvents:10000000
0015 query:SESSION_SIDE_INPUT_JOIN; numEvents:10000000
Performance:
Conf Runtime(sec) (Baseline) Events(/sec) (Baseline) Results
(Baseline)
0000 -1.0 -1.0 -1
*** Cancelling streaming job since it appeared stuck for 60 min. ***
0001 -1.0 -1.0 -1
*** Cancelling streaming job since it appeared stuck for 60 min. ***
0002 -1.0 -1.0 -1
*** Cancelling streaming job since it appeared stuck for 60 min. ***
0003 -1.0 -1.0 -1
*** Cancelling streaming job since it appeared stuck for 60 min. ***
0004 *** not run ***
0005 -1.0 -1.0 -1
*** Cancelling streaming job since it appeared stuck for 60 min. ***
0006 *** not run ***
0007 -1.0 -1.0 -1
*** Cancelling streaming job since it appeared stuck for 60 min. ***
0008 -1.0 -1.0 -1
*** Cancelling streaming job since it appeared stuck for 60 min. ***
0009 *** not run ***
0010 -1.0 -1.0 -1
*** Cancelling streaming job since it appeared stuck for 60 min. ***
0011 -1.0 -1.0 -1
*** Cancelling streaming job since it appeared stuck for 60 min. ***
0012 -1.0 -1.0 -1
*** Cancelling streaming job since it appeared stuck for 60 min. ***
0013 *** not run ***
0014 *** not run ***
0015 *** not run ***
==========================================================================================
==========================================================================================
Run started 2021-08-08T18:21:54.289Z and ran for PT4025.624S
Default configuration:
{"debug":true,"query":null,"sourceType":"DIRECT","generateEventFilePathPrefix":null,"sinkType":"DEVNULL","exportSummaryToBigQuery":false,"pubSubMode":"COMBINED","pubsubMessageSerializationMethod":"CODER","sideInputType":"DIRECT","sideInputRowCount":500,"sideInputNumShards":3,"sideInputUrl":null,"sessionGap":600000,"numEvents":100000,"numEventGenerators":100,"rateShape":"SINE","firstEventRate":10000,"nextEventRate":10000,"rateUnit":"PER_SECOND","ratePeriodSec":600,"preloadSeconds":0,"streamTimeout":240,"isRateLimited":false,"useWallclockEventTime":false,"avgPersonByteSize":200,"avgAuctionByteSize":500,"avgBidByteSize":100,"hotAuctionRatio":2,"hotSellersRatio":4,"hotBiddersRatio":4,"windowSizeSec":10,"windowPeriodSec":5,"watermarkHoldbackSec":0,"numInFlightAuctions":100,"numActivePeople":1000,"coderStrategy":"HAND","cpuDelayMs":0,"diskBusyBytes":0,"auctionSkip":123,"fanout":5,"maxAuctionsWaitingTime":600,"occasionalDelaySec":3,"probDelayedEvent":0.1,"maxLogEvents":100000,"usePubsubPublishTime":false,"outOfOrderGroupSize":1,"numKeyBuckets":20000,"pardoCPUFactor":1.0}
Configurations:
Conf Description
0000 query:PASSTHROUGH; numEvents:10000000
0001 query:CURRENCY_CONVERSION; numEvents:10000000
0002 query:SELECTION; numEvents:10000000
0003 query:LOCAL_ITEM_SUGGESTION; numEvents:10000000
0004 query:AVERAGE_PRICE_FOR_CATEGORY; numEvents:1000000
0005 query:HOT_ITEMS; numEvents:10000000
0006 query:AVERAGE_SELLING_PRICE_BY_SELLER; numEvents:1000000
0007 query:HIGHEST_BID; numEvents:10000000
0008 query:MONITOR_NEW_USERS; numEvents:10000000
0009 query:WINNING_BIDS; numEvents:1000000
0010 query:LOG_TO_SHARDED_FILES; numEvents:10000000
0011 query:USER_SESSIONS; numEvents:10000000
0012 query:PROCESSING_TIME_WINDOWS; numEvents:10000000
0013 query:PORTABILITY_BATCH; numEvents:10000000
0014 query:BOUNDED_SIDE_INPUT_JOIN; numEvents:10000000
0015 query:SESSION_SIDE_INPUT_JOIN; numEvents:10000000
Performance:
Conf Runtime(sec) (Baseline) Events(/sec) (Baseline) Results
(Baseline)
0000 -1.0 -1.0 -1
*** Cancelling streaming job since it appeared stuck for 60 min. ***
0001 -1.0 -1.0 -1
*** Cancelling streaming job since it appeared stuck for 60 min. ***
0002 -1.0 -1.0 -1
*** Cancelling streaming job since it appeared stuck for 60 min. ***
0003 -1.0 -1.0 -1
*** Cancelling streaming job since it appeared stuck for 60 min. ***
0004 *** not run ***
0005 -1.0 -1.0 -1
*** Cancelling streaming job since it appeared stuck for 60 min. ***
0006 *** not run ***
0007 -1.0 -1.0 -1
*** Cancelling streaming job since it appeared stuck for 60 min. ***
0008 -1.0 -1.0 -1
*** Cancelling streaming job since it appeared stuck for 60 min. ***
0009 *** not run ***
0010 -1.0 -1.0 -1
*** Cancelling streaming job since it appeared stuck for 60 min. ***
0011 -1.0 -1.0 -1
*** Cancelling streaming job since it appeared stuck for 60 min. ***
0012 -1.0 -1.0 -1
*** Cancelling streaming job since it appeared stuck for 60 min. ***
0013 *** not run ***
0014 *** not run ***
0015 *** not run ***
==========================================================================================
Exception in thread "main" java.lang.RuntimeException: Execution was not
successful
at org.apache.beam.sdk.nexmark.Main.runAll(Main.java:186)
at org.apache.beam.sdk.nexmark.Main.main(Main.java:495)
> Task :sdks:java:testing:nexmark:run FAILED
> Task :runners:google-cloud-dataflow-java:cleanUpDockerImages
Untagged: us.gcr.io/apache-beam-testing/java-postcommit-it/java:20210808182102
Untagged:
us.gcr.io/apache-beam-testing/java-postcommit-it/java@sha256:5913f6c1c7c139bb8f337c4edd1fa435a127b88c0f4deda3e125c600247bd9d7
Deleted: sha256:bf8854f5f21b06aea013374018805c778b7a2d1a9d793d7ce5647d8366c44d4c
Deleted: sha256:af732e75954479262536eabb479b3093131f26910038d500f4e5d43cefca5be8
Deleted: sha256:84d8729eed49743c1f5710db969579578e834f0b0569e2f0ea7fbe44095c46ff
Deleted: sha256:ba67e0af8e06402235b65f5a9c060f70a45c78ab2a8e56e2c268879456a5863b
Deleted: sha256:dbf498dee9fac3d594d72c5fa90a5e7a2f8e6a8fe8ea0201082d1e473e093ea6
Deleted: sha256:95c8c744815d858d1a4c94f19afae4200df7c2adf6dbb326ba886f23c5478bdb
Deleted: sha256:393f3c3ac36efba467204d17dae7b4f3b1c6c557431cf344773afd62e11e281b
Deleted: sha256:5fae9940453b3024c7385bc1375c7b6eb6f752d9ff988850a841d2284c15c073
Deleted: sha256:4514bac5774146b077e395b80893ca5d59de16cc1974979a4a0e6d24095b64fa
Deleted: sha256:1ca9a7d1531d0ab0fe50da6cf6ffeec89264546ef8e2b218c8f98a9ae076155a
Deleted: sha256:30b9451b3859087de1913b5cee7a4374765286cb4550bd4e5ef94c029619ded0
Deleted: sha256:703992f6ce24e2792cc292a9175000c8b98ef566e491d1c10fdfa887945a6fcf
Deleted: sha256:04bd2897ac3edc984174e72b8bdff4f10ccaca1687ce92836b7699e0f854a39e
Deleted: sha256:9268c4810663b02839953bbffcee5b8b842b5f88ebb10fc67e2d413d02bc4ad6
Deleted: sha256:f5f1a75e05c3366d3258ed6b1aaabdcac36f10172c95d36ef85b5af7c13adcbd
Deleted: sha256:bbd78f827c47812e23723f33a0bade494892e6227e5ae8d8fa759d346f988550
Deleted: sha256:af8c186a003948d9d37bd8364576edac072d7b1fb5c1d9d79dc318d5774b034a
Deleted: sha256:813d015701e9e2377fe0b59a93d44158baca75158a4cbbb729b4bf319d35a604
Deleted: sha256:5ba219ffe1f0d4f80639bb2917453a0a74377b2b633ce2f29eb503f7ff7368ba
Deleted: sha256:e6bbb0b591c95652e33a4ef13aef05421ba2b9ab6eb5eb44cde0df4663208191
Deleted: sha256:ead433b8c7ff6142ec8947ddd96921ba9c96f7ed11f8b61a5f3652a724887ad7
Deleted: sha256:0ee8b6b913e4cb431e4c5a69d664970229b5f9adec6a97790ee87f07472e0d59
Deleted: sha256:01e37553d74d3017280a6de1663d61671a928d9493bdd1c1211d34df5a48e287
Deleted: sha256:c30de3302144baf02182f03e41fcae0338ee00bd7fb89799c385e1648434d652
Deleted: sha256:7a739aa18c936df4d77232090585c1e8818f2e0e023cd7731ce7ddf57eeed196
Deleted: sha256:694961f841ad591f8dd6f2384ce528e8748dda52ec07ccf30c31fab4a165882c
Deleted: sha256:a36a7cab6f3d97bc2728918516a38a19b309d2746d9e91688de2546a70f2957f
Deleted: sha256:f58968f146f835f0994f8cb9cabd93f270160d947ce869b6460c32dd1ce6f0c5
Tag: [us.gcr.io/apache-beam-testing/java-postcommit-it/java:20210808182102]
- referencing digest:
[us.gcr.io/apache-beam-testing/java-postcommit-it/java@sha256:5913f6c1c7c139bb8f337c4edd1fa435a127b88c0f4deda3e125c600247bd9d7]
Deleted [[us.gcr.io/apache-beam-testing/java-postcommit-it/java:20210808182102]
(referencing
[us.gcr.io/apache-beam-testing/java-postcommit-it/java@sha256:5913f6c1c7c139bb8f337c4edd1fa435a127b88c0f4deda3e125c600247bd9d7])].
Removing untagged image
us.gcr.io/apache-beam-testing/java-postcommit-it/java@sha256:5913f6c1c7c139bb8f337c4edd1fa435a127b88c0f4deda3e125c600247bd9d7
Digests:
-
us.gcr.io/apache-beam-testing/java-postcommit-it/java@sha256:5913f6c1c7c139bb8f337c4edd1fa435a127b88c0f4deda3e125c600247bd9d7
Deleted
[us.gcr.io/apache-beam-testing/java-postcommit-it/java@sha256:5913f6c1c7c139bb8f337c4edd1fa435a127b88c0f4deda3e125c600247bd9d7].
FAILURE: Build failed with an exception.
* What went wrong:
Execution failed for task ':sdks:java:testing:nexmark:run'.
> Process 'command '/usr/lib/jvm/java-8-openjdk-amd64/bin/java'' finished with
> non-zero exit value 1
* Try:
Run with --stacktrace option to get the stack trace. Run with --info or --debug
option to get more log output. Run with --scan to get full insights.
* Get more help at https://help.gradle.org
Deprecated Gradle features were used in this build, making it incompatible with
Gradle 7.0.
Use '--warning-mode all' to show the individual deprecation warnings.
See
https://docs.gradle.org/6.8.3/userguide/command_line_interface.html#sec:command_line_warnings
BUILD FAILED in 1h 8m 2s
129 actionable tasks: 15 executed, 114 up-to-date
Publishing build scan...
https://gradle.com/s/tgksy6ahsjgeq
Build step 'Invoke Gradle script' changed build result to FAILURE
Build step 'Invoke Gradle script' marked build as failure
---------------------------------------------------------------------
To unsubscribe, e-mail: [email protected]
For additional commands, e-mail: [email protected]
