See
<https://ci-beam.apache.org/job/beam_PostCommit_Java_Nexmark_Dataflow_V2_Java11/548/display/redirect>
Changes:
------------------------------------------
[...truncated 2.93 MB...]
Conf Description
0000 query:PASSTHROUGH; numEvents:10000000
0001 query:CURRENCY_CONVERSION; numEvents:10000000
0002 query:SELECTION; numEvents:10000000
0003 query:LOCAL_ITEM_SUGGESTION; numEvents:10000000
0004 query:AVERAGE_PRICE_FOR_CATEGORY; numEvents:1000000
0005 query:HOT_ITEMS; numEvents:10000000
0006 query:AVERAGE_SELLING_PRICE_BY_SELLER; numEvents:1000000
0007 query:HIGHEST_BID; numEvents:10000000
0008 query:MONITOR_NEW_USERS; numEvents:10000000
0009 query:WINNING_BIDS; numEvents:1000000
0010 query:LOG_TO_SHARDED_FILES; numEvents:10000000
0011 query:USER_SESSIONS; numEvents:10000000
0012 query:PROCESSING_TIME_WINDOWS; numEvents:10000000
0013 query:PORTABILITY_BATCH; numEvents:10000000
0014 query:BOUNDED_SIDE_INPUT_JOIN; numEvents:10000000
0015 query:SESSION_SIDE_INPUT_JOIN; numEvents:10000000
Performance:
Conf Runtime(sec) (Baseline) Events(/sec) (Baseline) Results
(Baseline)
0000 -1.0 -1.0 -1
*** Cancelling streaming job since it appeared stuck for 60 min. ***
0001 -1.0 -1.0 -1
*** Cancelling streaming job since it appeared stuck for 60 min. ***
0002 -1.0 -1.0 -1
*** Cancelling streaming job since it appeared stuck for 60 min. ***
0003 -1.0 -1.0 -1
*** Cancelling streaming job since it appeared stuck for 60 min. ***
0004 *** not run ***
0005 -1.0 -1.0 -1
*** Cancelling streaming job since it appeared stuck for 60 min. ***
0006 *** not run ***
0007 -1.0 -1.0 -1
*** Cancelling streaming job since it appeared stuck for 60 min. ***
0008 -1.0 -1.0 -1
*** Cancelling streaming job since it appeared stuck for 60 min. ***
0009 *** not run ***
0010 -1.0 -1.0 -1
*** Cancelling streaming job since it appeared stuck for 60 min. ***
0011 -1.0 -1.0 -1
*** Cancelling streaming job since it appeared stuck for 60 min. ***
0012 *** not run ***
0013 *** not run ***
0014 *** not run ***
0015 *** not run ***
==========================================================================================
2021-10-08T13:18:36.896Z RUNNING Query12 (waiting for shutdown)
Oct 08, 2021 1:18:36 PM org.apache.beam.sdk.testutils.metrics.MetricsReader
getCounterMetric
SEVERE: Failed to get metric event.elements, from namespace Query12.Events
Oct 08, 2021 1:18:36 PM org.apache.beam.sdk.testutils.metrics.MetricsReader
getCounterMetric
SEVERE: Failed to get metric event.bytes, from namespace Query12.Events
Oct 08, 2021 1:18:37 PM org.apache.beam.sdk.testutils.metrics.MetricsReader
getCounterMetric
SEVERE: Failed to get metric result.elements, from namespace Query12.Results
Oct 08, 2021 1:18:37 PM org.apache.beam.sdk.testutils.metrics.MetricsReader
getCounterMetric
SEVERE: Failed to get metric result.bytes, from namespace Query12.Results
2021-10-08T13:18:37.354Z 0 samples not enough to calculate steady-state event
rate
2021-10-08T13:18:37.354Z no activity
2021-10-08T13:18:52.390Z CANCELLED Query12 (waiting for shutdown)
Oct 08, 2021 1:18:52 PM org.apache.beam.sdk.testutils.metrics.MetricsReader
getCounterMetric
SEVERE: Failed to get metric event.elements, from namespace Query12.Events
Oct 08, 2021 1:18:52 PM org.apache.beam.sdk.testutils.metrics.MetricsReader
getCounterMetric
SEVERE: Failed to get metric event.bytes, from namespace Query12.Events
Oct 08, 2021 1:18:52 PM org.apache.beam.sdk.testutils.metrics.MetricsReader
getCounterMetric
SEVERE: Failed to get metric result.elements, from namespace Query12.Results
Oct 08, 2021 1:18:52 PM org.apache.beam.sdk.testutils.metrics.MetricsReader
getCounterMetric
SEVERE: Failed to get metric result.bytes, from namespace Query12.Results
2021-10-08T13:18:52.410Z 0 samples not enough to calculate steady-state event
rate
==========================================================================================
Run started 2021-10-08T12:11:02.739Z and ran for PT4069.671S
Default configuration:
{"debug":true,"query":null,"sourceType":"DIRECT","generateEventFilePathPrefix":null,"sinkType":"DEVNULL","exportSummaryToBigQuery":false,"pubSubMode":"COMBINED","pubsubMessageSerializationMethod":"CODER","sideInputType":"DIRECT","sideInputRowCount":500,"sideInputNumShards":3,"sideInputUrl":null,"sessionGap":600000,"numEvents":100000,"numEventGenerators":100,"rateShape":"SINE","firstEventRate":10000,"nextEventRate":10000,"rateUnit":"PER_SECOND","ratePeriodSec":600,"preloadSeconds":0,"streamTimeout":240,"isRateLimited":false,"useWallclockEventTime":false,"avgPersonByteSize":200,"avgAuctionByteSize":500,"avgBidByteSize":100,"hotAuctionRatio":2,"hotSellersRatio":4,"hotBiddersRatio":4,"windowSizeSec":10,"windowPeriodSec":5,"watermarkHoldbackSec":0,"numInFlightAuctions":100,"numActivePeople":1000,"coderStrategy":"HAND","cpuDelayMs":0,"diskBusyBytes":0,"auctionSkip":123,"fanout":5,"maxAuctionsWaitingTime":600,"occasionalDelaySec":3,"probDelayedEvent":0.1,"maxLogEvents":100000,"usePubsubPublishTime":false,"outOfOrderGroupSize":1,"numKeyBuckets":20000,"pardoCPUFactor":1.0}
Configurations:
Conf Description
0000 query:PASSTHROUGH; numEvents:10000000
0001 query:CURRENCY_CONVERSION; numEvents:10000000
0002 query:SELECTION; numEvents:10000000
0003 query:LOCAL_ITEM_SUGGESTION; numEvents:10000000
0004 query:AVERAGE_PRICE_FOR_CATEGORY; numEvents:1000000
0005 query:HOT_ITEMS; numEvents:10000000
0006 query:AVERAGE_SELLING_PRICE_BY_SELLER; numEvents:1000000
0007 query:HIGHEST_BID; numEvents:10000000
0008 query:MONITOR_NEW_USERS; numEvents:10000000
0009 query:WINNING_BIDS; numEvents:1000000
0010 query:LOG_TO_SHARDED_FILES; numEvents:10000000
0011 query:USER_SESSIONS; numEvents:10000000
0012 query:PROCESSING_TIME_WINDOWS; numEvents:10000000
0013 query:PORTABILITY_BATCH; numEvents:10000000
0014 query:BOUNDED_SIDE_INPUT_JOIN; numEvents:10000000
0015 query:SESSION_SIDE_INPUT_JOIN; numEvents:10000000
Performance:
Conf Runtime(sec) (Baseline) Events(/sec) (Baseline) Results
(Baseline)
0000 -1.0 -1.0 -1
*** Cancelling streaming job since it appeared stuck for 60 min. ***
0001 -1.0 -1.0 -1
*** Cancelling streaming job since it appeared stuck for 60 min. ***
0002 -1.0 -1.0 -1
*** Cancelling streaming job since it appeared stuck for 60 min. ***
0003 -1.0 -1.0 -1
*** Cancelling streaming job since it appeared stuck for 60 min. ***
0004 *** not run ***
0005 -1.0 -1.0 -1
*** Cancelling streaming job since it appeared stuck for 60 min. ***
0006 *** not run ***
0007 -1.0 -1.0 -1
*** Cancelling streaming job since it appeared stuck for 60 min. ***
0008 -1.0 -1.0 -1
*** Cancelling streaming job since it appeared stuck for 60 min. ***
0009 *** not run ***
0010 -1.0 -1.0 -1
*** Cancelling streaming job since it appeared stuck for 60 min. ***
0011 -1.0 -1.0 -1
*** Cancelling streaming job since it appeared stuck for 60 min. ***
0012 -1.0 -1.0 -1
*** Cancelling streaming job since it appeared stuck for 60 min. ***
0013 *** not run ***
0014 *** not run ***
0015 *** not run ***
==========================================================================================
==========================================================================================
Run started 2021-10-08T12:11:02.739Z and ran for PT4069.879S
Default configuration:
{"debug":true,"query":null,"sourceType":"DIRECT","generateEventFilePathPrefix":null,"sinkType":"DEVNULL","exportSummaryToBigQuery":false,"pubSubMode":"COMBINED","pubsubMessageSerializationMethod":"CODER","sideInputType":"DIRECT","sideInputRowCount":500,"sideInputNumShards":3,"sideInputUrl":null,"sessionGap":600000,"numEvents":100000,"numEventGenerators":100,"rateShape":"SINE","firstEventRate":10000,"nextEventRate":10000,"rateUnit":"PER_SECOND","ratePeriodSec":600,"preloadSeconds":0,"streamTimeout":240,"isRateLimited":false,"useWallclockEventTime":false,"avgPersonByteSize":200,"avgAuctionByteSize":500,"avgBidByteSize":100,"hotAuctionRatio":2,"hotSellersRatio":4,"hotBiddersRatio":4,"windowSizeSec":10,"windowPeriodSec":5,"watermarkHoldbackSec":0,"numInFlightAuctions":100,"numActivePeople":1000,"coderStrategy":"HAND","cpuDelayMs":0,"diskBusyBytes":0,"auctionSkip":123,"fanout":5,"maxAuctionsWaitingTime":600,"occasionalDelaySec":3,"probDelayedEvent":0.1,"maxLogEvents":100000,"usePubsubPublishTime":false,"outOfOrderGroupSize":1,"numKeyBuckets":20000,"pardoCPUFactor":1.0}
Configurations:
Conf Description
0000 query:PASSTHROUGH; numEvents:10000000
0001 query:CURRENCY_CONVERSION; numEvents:10000000
0002 query:SELECTION; numEvents:10000000
0003 query:LOCAL_ITEM_SUGGESTION; numEvents:10000000
0004 query:AVERAGE_PRICE_FOR_CATEGORY; numEvents:1000000
0005 query:HOT_ITEMS; numEvents:10000000
0006 query:AVERAGE_SELLING_PRICE_BY_SELLER; numEvents:1000000
0007 query:HIGHEST_BID; numEvents:10000000
0008 query:MONITOR_NEW_USERS; numEvents:10000000
0009 query:WINNING_BIDS; numEvents:1000000
0010 query:LOG_TO_SHARDED_FILES; numEvents:10000000
0011 query:USER_SESSIONS; numEvents:10000000
0012 query:PROCESSING_TIME_WINDOWS; numEvents:10000000
0013 query:PORTABILITY_BATCH; numEvents:10000000
0014 query:BOUNDED_SIDE_INPUT_JOIN; numEvents:10000000
0015 query:SESSION_SIDE_INPUT_JOIN; numEvents:10000000
Performance:
Conf Runtime(sec) (Baseline) Events(/sec) (Baseline) Results
(Baseline)
0000 -1.0 -1.0 -1
*** Cancelling streaming job since it appeared stuck for 60 min. ***
0001 -1.0 -1.0 -1
*** Cancelling streaming job since it appeared stuck for 60 min. ***
0002 -1.0 -1.0 -1
*** Cancelling streaming job since it appeared stuck for 60 min. ***
0003 -1.0 -1.0 -1
*** Cancelling streaming job since it appeared stuck for 60 min. ***
0004 *** not run ***
0005 -1.0 -1.0 -1
*** Cancelling streaming job since it appeared stuck for 60 min. ***
0006 *** not run ***
0007 -1.0 -1.0 -1
*** Cancelling streaming job since it appeared stuck for 60 min. ***
0008 -1.0 -1.0 -1
*** Cancelling streaming job since it appeared stuck for 60 min. ***
0009 *** not run ***
0010 -1.0 -1.0 -1
*** Cancelling streaming job since it appeared stuck for 60 min. ***
0011 -1.0 -1.0 -1
*** Cancelling streaming job since it appeared stuck for 60 min. ***
0012 -1.0 -1.0 -1
*** Cancelling streaming job since it appeared stuck for 60 min. ***
0013 *** not run ***
0014 *** not run ***
0015 *** not run ***
==========================================================================================
Exception in thread "main" java.lang.RuntimeException: Execution was not
successful
at org.apache.beam.sdk.nexmark.Main.runAll(Main.java:186)
at org.apache.beam.sdk.nexmark.Main.main(Main.java:495)
> Task :sdks:java:testing:nexmark:run FAILED
> Task :runners:google-cloud-dataflow-java:cleanUpDockerImages
Untagged: us.gcr.io/apache-beam-testing/java-postcommit-it/java:20211008121032
Untagged:
us.gcr.io/apache-beam-testing/java-postcommit-it/java@sha256:a11ca55216504c00f3bbf6ccb4ec110a9c1e3255686b75980af3365000eb32ef
Deleted: sha256:0b441d2e8b898fa495b8ca69ec50e776dfe0b1563ecc9d92f302203a93b107dc
Deleted: sha256:34bf80251d5f9cb4b2420fb931b54bacf4ae16fe860bda9f3951d1ec31fea5c5
Deleted: sha256:950d19f5e941eaef8ce3421c75c8c976ca4622cdf9c6644449356f71a656fc47
Deleted: sha256:d3c020c6d4f444a805c174b9864a96799e0419e64afb7d0541cb5b312d742214
Deleted: sha256:6eb01782d68a505eacabade19c3bb14fe2be752561166e0455db1de12f3ba559
Deleted: sha256:43ef8c2568cd644ad70719a6ba13f8bc554ef2cf44e08e6fbe21311e5bea1228
Deleted: sha256:fbb124b2f3003d9c70540c592c4ae4bdbd436d3b4f8a293c30d00a759270344e
Deleted: sha256:7082c2645e50346cd00932ed7b3594581203761270926c81d528ed6f4a02b7aa
Deleted: sha256:20f4d5797bfdb938171120f2f9123bad8fa110fb38444f472b3166a51f69a248
Deleted: sha256:c089d6dde9bfc2f2a6c04fac6510ea7baa4a0cbcfe4fef5e296bfbab2333d138
Deleted: sha256:a6902ad1a89fe9ce76942c8e484c42644cd40f4de38af5100a1b6acbe64a7ae0
Deleted: sha256:df22a4d8b4da8b5d918efa8bbc281621e0f1c1cbe9bafe38e0cf21fede4fa9c3
Deleted: sha256:6b79dbdea9bdc7d424be1a43141396f08c3b984b2e92c59ee6400a5a01c4acc5
Deleted: sha256:5c91f45e1d8234587d0ed2b55547af863f6c4f28b4cabca609b9bedf3918ba4f
Deleted: sha256:ff19d7e7d36f08db148195b60f443444a05c4862f79d97d93eeac20e8dc0bfd6
Deleted: sha256:897275e05822e5e5702d7d18350b0eb01530f12bda90d9af19e14b0a02ad1220
Deleted: sha256:005d741872fabbb644d777d31209ad879207944e03f3cb5d7735871dcbb513a5
Deleted: sha256:6018834f65441df266c22e94619acc2f97a1ac25cfa381f097ebb041f9d0236c
Deleted: sha256:089868bda24a32c1e3fc41f77b5613f6837af54dedf757507b9a0ed4e0b65edb
Deleted: sha256:e260afdb96080104126bf91d0f1e238c8eb0aeb6c69ab9f514f7c11f40530947
Deleted: sha256:0774d2278a2d4da476510de2ac1b7a4443742c6470f959cc3c4f2c714b4de941
Deleted: sha256:f97c8c0963b4015819934a14cf698996497bc03136c73b7c78f0e3e186d9f006
Deleted: sha256:f2426c31718733157fa933ee460a85fa4f51555e575df0d919ac8ae41b4277a1
Deleted: sha256:04333d6ee0a3c02c58ab20c0edada664577d0a8f1caf4fdc12660503e2ef519f
Deleted: sha256:fcc981a1975fb494cf21c9e1d31d12c452b290fe17d57a9f9706b02584cb706d
Deleted: sha256:7ab746e6a5c87c3c7a62c6c63867ccdc6f83e82fb490a25dd3ed9c0fffd10c89
Deleted: sha256:2d1d9f55a5e6359dcdfc83c7596e3d155d0cc40998d1de0828dcf5824ac7dc0d
Deleted: sha256:5c74d9d5266ac49def6ec6fd232c2ac7cce8c776e6edf2e56a7ba44f8ecf2c92
Tag: [us.gcr.io/apache-beam-testing/java-postcommit-it/java:20211008121032]
- referencing digest:
[us.gcr.io/apache-beam-testing/java-postcommit-it/java@sha256:a11ca55216504c00f3bbf6ccb4ec110a9c1e3255686b75980af3365000eb32ef]
Deleted [[us.gcr.io/apache-beam-testing/java-postcommit-it/java:20211008121032]
(referencing
[us.gcr.io/apache-beam-testing/java-postcommit-it/java@sha256:a11ca55216504c00f3bbf6ccb4ec110a9c1e3255686b75980af3365000eb32ef])].
Removing untagged image
us.gcr.io/apache-beam-testing/java-postcommit-it/java@sha256:a11ca55216504c00f3bbf6ccb4ec110a9c1e3255686b75980af3365000eb32ef
Digests:
-
us.gcr.io/apache-beam-testing/java-postcommit-it/java@sha256:a11ca55216504c00f3bbf6ccb4ec110a9c1e3255686b75980af3365000eb32ef
Deleted
[us.gcr.io/apache-beam-testing/java-postcommit-it/java@sha256:a11ca55216504c00f3bbf6ccb4ec110a9c1e3255686b75980af3365000eb32ef].
FAILURE: Build failed with an exception.
* What went wrong:
Execution failed for task ':sdks:java:testing:nexmark:run'.
> Process 'command '/usr/lib/jvm/java-8-openjdk-amd64/bin/java'' finished with
> non-zero exit value 1
* Try:
Run with --stacktrace option to get the stack trace. Run with --info or --debug
option to get more log output. Run with --scan to get full insights.
* Get more help at https://help.gradle.org
Deprecated Gradle features were used in this build, making it incompatible with
Gradle 7.0.
Use '--warning-mode all' to show the individual deprecation warnings.
See
https://docs.gradle.org/6.9.1/userguide/command_line_interface.html#sec:command_line_warnings
BUILD FAILED in 1h 8m 25s
123 actionable tasks: 10 executed, 113 up-to-date
Publishing build scan...
https://gradle.com/s/7i77fvexxazdk
Build step 'Invoke Gradle script' changed build result to FAILURE
Build step 'Invoke Gradle script' marked build as failure
---------------------------------------------------------------------
To unsubscribe, e-mail: [email protected]
For additional commands, e-mail: [email protected]
