See
<https://ci-beam.apache.org/job/beam_PostCommit_Java_Nexmark_Dataflow_V2/267/display/redirect?page=changes>
Changes:
[noreply] [BEAM-12675] Fix issue with language switcher on hadoop page (#15243)
------------------------------------------
[...truncated 2.92 MB...]
Jul 30, 2021 7:50:41 AM org.apache.beam.sdk.testutils.metrics.MetricsReader
getCounterMetric
SEVERE: Failed to get metric result.bytes, from namespace Query2.Results
2021-07-30T07:50:41.072Z 0 samples not enough to calculate steady-state event
rate
==========================================================================================
Run started 2021-07-30T06:42:35.207Z and ran for PT4085.865S
Default configuration:
{"debug":true,"query":null,"sourceType":"DIRECT","generateEventFilePathPrefix":null,"sinkType":"DEVNULL","exportSummaryToBigQuery":false,"pubSubMode":"COMBINED","pubsubMessageSerializationMethod":"CODER","sideInputType":"DIRECT","sideInputRowCount":500,"sideInputNumShards":3,"sideInputUrl":null,"sessionGap":600000,"numEvents":100000,"numEventGenerators":100,"rateShape":"SINE","firstEventRate":10000,"nextEventRate":10000,"rateUnit":"PER_SECOND","ratePeriodSec":600,"preloadSeconds":0,"streamTimeout":240,"isRateLimited":false,"useWallclockEventTime":false,"avgPersonByteSize":200,"avgAuctionByteSize":500,"avgBidByteSize":100,"hotAuctionRatio":2,"hotSellersRatio":4,"hotBiddersRatio":4,"windowSizeSec":10,"windowPeriodSec":5,"watermarkHoldbackSec":0,"numInFlightAuctions":100,"numActivePeople":1000,"coderStrategy":"HAND","cpuDelayMs":0,"diskBusyBytes":0,"auctionSkip":123,"fanout":5,"maxAuctionsWaitingTime":600,"occasionalDelaySec":3,"probDelayedEvent":0.1,"maxLogEvents":100000,"usePubsubPublishTime":false,"outOfOrderGroupSize":1,"numKeyBuckets":20000,"pardoCPUFactor":1.0}
Configurations:
Conf Description
0000 query:PASSTHROUGH; numEvents:10000000
0001 query:CURRENCY_CONVERSION; numEvents:10000000
0002 query:SELECTION; numEvents:10000000
0003 query:LOCAL_ITEM_SUGGESTION; numEvents:10000000
0004 query:AVERAGE_PRICE_FOR_CATEGORY; numEvents:1000000
0005 query:HOT_ITEMS; numEvents:10000000
0006 query:AVERAGE_SELLING_PRICE_BY_SELLER; numEvents:1000000
0007 query:HIGHEST_BID; numEvents:10000000
0008 query:MONITOR_NEW_USERS; numEvents:10000000
0009 query:WINNING_BIDS; numEvents:1000000
0010 query:LOG_TO_SHARDED_FILES; numEvents:10000000
0011 query:USER_SESSIONS; numEvents:10000000
0012 query:PROCESSING_TIME_WINDOWS; numEvents:10000000
0013 query:PORTABILITY_BATCH; numEvents:10000000
0014 query:BOUNDED_SIDE_INPUT_JOIN; numEvents:10000000
0015 query:SESSION_SIDE_INPUT_JOIN; numEvents:10000000
Performance:
Conf Runtime(sec) (Baseline) Events(/sec) (Baseline) Results
(Baseline)
0000 -1.0 -1.0 -1
*** Cancelling streaming job since it appeared stuck for 60 min. ***
0001 *** not run ***
0002 -1.0 -1.0 -1
*** Cancelling streaming job since it appeared stuck for 60 min. ***
0003 -1.0 -1.0 -1
*** Cancelling streaming job since it appeared stuck for 60 min. ***
0004 *** not run ***
0005 -1.0 -1.0 -1
*** Cancelling streaming job since it appeared stuck for 60 min. ***
0006 *** not run ***
0007 -1.0 -1.0 -1
*** Cancelling streaming job since it appeared stuck for 60 min. ***
0008 -1.0 -1.0 -1
*** Cancelling streaming job since it appeared stuck for 60 min. ***
0009 *** not run ***
0010 -1.0 -1.0 -1
*** Cancelling streaming job since it appeared stuck for 60 min. ***
0011 -1.0 -1.0 -1
*** Cancelling streaming job since it appeared stuck for 60 min. ***
0012 -1.0 -1.0 -1
*** Cancelling streaming job since it appeared stuck for 60 min. ***
0013 *** not run ***
0014 *** not run ***
0015 *** not run ***
==========================================================================================
2021-07-30T07:50:41.731Z CANCELLED Query1 (waiting for shutdown)
Jul 30, 2021 7:50:41 AM org.apache.beam.sdk.testutils.metrics.MetricsReader
getCounterMetric
SEVERE: Failed to get metric event.elements, from namespace Query1.Events
Jul 30, 2021 7:50:41 AM org.apache.beam.sdk.testutils.metrics.MetricsReader
getCounterMetric
SEVERE: Failed to get metric event.bytes, from namespace Query1.Events
Jul 30, 2021 7:50:41 AM org.apache.beam.sdk.testutils.metrics.MetricsReader
getCounterMetric
SEVERE: Failed to get metric result.elements, from namespace Query1.Results
Jul 30, 2021 7:50:41 AM org.apache.beam.sdk.testutils.metrics.MetricsReader
getCounterMetric
SEVERE: Failed to get metric result.bytes, from namespace Query1.Results
2021-07-30T07:50:41.746Z 0 samples not enough to calculate steady-state event
rate
==========================================================================================
Run started 2021-07-30T06:42:35.207Z and ran for PT4086.539S
Default configuration:
{"debug":true,"query":null,"sourceType":"DIRECT","generateEventFilePathPrefix":null,"sinkType":"DEVNULL","exportSummaryToBigQuery":false,"pubSubMode":"COMBINED","pubsubMessageSerializationMethod":"CODER","sideInputType":"DIRECT","sideInputRowCount":500,"sideInputNumShards":3,"sideInputUrl":null,"sessionGap":600000,"numEvents":100000,"numEventGenerators":100,"rateShape":"SINE","firstEventRate":10000,"nextEventRate":10000,"rateUnit":"PER_SECOND","ratePeriodSec":600,"preloadSeconds":0,"streamTimeout":240,"isRateLimited":false,"useWallclockEventTime":false,"avgPersonByteSize":200,"avgAuctionByteSize":500,"avgBidByteSize":100,"hotAuctionRatio":2,"hotSellersRatio":4,"hotBiddersRatio":4,"windowSizeSec":10,"windowPeriodSec":5,"watermarkHoldbackSec":0,"numInFlightAuctions":100,"numActivePeople":1000,"coderStrategy":"HAND","cpuDelayMs":0,"diskBusyBytes":0,"auctionSkip":123,"fanout":5,"maxAuctionsWaitingTime":600,"occasionalDelaySec":3,"probDelayedEvent":0.1,"maxLogEvents":100000,"usePubsubPublishTime":false,"outOfOrderGroupSize":1,"numKeyBuckets":20000,"pardoCPUFactor":1.0}
Configurations:
Conf Description
0000 query:PASSTHROUGH; numEvents:10000000
0001 query:CURRENCY_CONVERSION; numEvents:10000000
0002 query:SELECTION; numEvents:10000000
0003 query:LOCAL_ITEM_SUGGESTION; numEvents:10000000
0004 query:AVERAGE_PRICE_FOR_CATEGORY; numEvents:1000000
0005 query:HOT_ITEMS; numEvents:10000000
0006 query:AVERAGE_SELLING_PRICE_BY_SELLER; numEvents:1000000
0007 query:HIGHEST_BID; numEvents:10000000
0008 query:MONITOR_NEW_USERS; numEvents:10000000
0009 query:WINNING_BIDS; numEvents:1000000
0010 query:LOG_TO_SHARDED_FILES; numEvents:10000000
0011 query:USER_SESSIONS; numEvents:10000000
0012 query:PROCESSING_TIME_WINDOWS; numEvents:10000000
0013 query:PORTABILITY_BATCH; numEvents:10000000
0014 query:BOUNDED_SIDE_INPUT_JOIN; numEvents:10000000
0015 query:SESSION_SIDE_INPUT_JOIN; numEvents:10000000
Performance:
Conf Runtime(sec) (Baseline) Events(/sec) (Baseline) Results
(Baseline)
0000 -1.0 -1.0 -1
*** Cancelling streaming job since it appeared stuck for 60 min. ***
0001 -1.0 -1.0 -1
*** Cancelling streaming job since it appeared stuck for 60 min. ***
0002 -1.0 -1.0 -1
*** Cancelling streaming job since it appeared stuck for 60 min. ***
0003 -1.0 -1.0 -1
*** Cancelling streaming job since it appeared stuck for 60 min. ***
0004 *** not run ***
0005 -1.0 -1.0 -1
*** Cancelling streaming job since it appeared stuck for 60 min. ***
0006 *** not run ***
0007 -1.0 -1.0 -1
*** Cancelling streaming job since it appeared stuck for 60 min. ***
0008 -1.0 -1.0 -1
*** Cancelling streaming job since it appeared stuck for 60 min. ***
0009 *** not run ***
0010 -1.0 -1.0 -1
*** Cancelling streaming job since it appeared stuck for 60 min. ***
0011 -1.0 -1.0 -1
*** Cancelling streaming job since it appeared stuck for 60 min. ***
0012 -1.0 -1.0 -1
*** Cancelling streaming job since it appeared stuck for 60 min. ***
0013 *** not run ***
0014 *** not run ***
0015 *** not run ***
==========================================================================================
==========================================================================================
Run started 2021-07-30T06:42:35.207Z and ran for PT4086.742S
Default configuration:
{"debug":true,"query":null,"sourceType":"DIRECT","generateEventFilePathPrefix":null,"sinkType":"DEVNULL","exportSummaryToBigQuery":false,"pubSubMode":"COMBINED","pubsubMessageSerializationMethod":"CODER","sideInputType":"DIRECT","sideInputRowCount":500,"sideInputNumShards":3,"sideInputUrl":null,"sessionGap":600000,"numEvents":100000,"numEventGenerators":100,"rateShape":"SINE","firstEventRate":10000,"nextEventRate":10000,"rateUnit":"PER_SECOND","ratePeriodSec":600,"preloadSeconds":0,"streamTimeout":240,"isRateLimited":false,"useWallclockEventTime":false,"avgPersonByteSize":200,"avgAuctionByteSize":500,"avgBidByteSize":100,"hotAuctionRatio":2,"hotSellersRatio":4,"hotBiddersRatio":4,"windowSizeSec":10,"windowPeriodSec":5,"watermarkHoldbackSec":0,"numInFlightAuctions":100,"numActivePeople":1000,"coderStrategy":"HAND","cpuDelayMs":0,"diskBusyBytes":0,"auctionSkip":123,"fanout":5,"maxAuctionsWaitingTime":600,"occasionalDelaySec":3,"probDelayedEvent":0.1,"maxLogEvents":100000,"usePubsubPublishTime":false,"outOfOrderGroupSize":1,"numKeyBuckets":20000,"pardoCPUFactor":1.0}
Configurations:
Conf Description
0000 query:PASSTHROUGH; numEvents:10000000
0001 query:CURRENCY_CONVERSION; numEvents:10000000
0002 query:SELECTION; numEvents:10000000
0003 query:LOCAL_ITEM_SUGGESTION; numEvents:10000000
0004 query:AVERAGE_PRICE_FOR_CATEGORY; numEvents:1000000
0005 query:HOT_ITEMS; numEvents:10000000
0006 query:AVERAGE_SELLING_PRICE_BY_SELLER; numEvents:1000000
0007 query:HIGHEST_BID; numEvents:10000000
0008 query:MONITOR_NEW_USERS; numEvents:10000000
0009 query:WINNING_BIDS; numEvents:1000000
0010 query:LOG_TO_SHARDED_FILES; numEvents:10000000
0011 query:USER_SESSIONS; numEvents:10000000
0012 query:PROCESSING_TIME_WINDOWS; numEvents:10000000
0013 query:PORTABILITY_BATCH; numEvents:10000000
0014 query:BOUNDED_SIDE_INPUT_JOIN; numEvents:10000000
0015 query:SESSION_SIDE_INPUT_JOIN; numEvents:10000000
Performance:
Conf Runtime(sec) (Baseline) Events(/sec) (Baseline) Results
(Baseline)
0000 -1.0 -1.0 -1
*** Cancelling streaming job since it appeared stuck for 60 min. ***
0001 -1.0 -1.0 -1
*** Cancelling streaming job since it appeared stuck for 60 min. ***
0002 -1.0 -1.0 -1
*** Cancelling streaming job since it appeared stuck for 60 min. ***
0003 -1.0 -1.0 -1
*** Cancelling streaming job since it appeared stuck for 60 min. ***
0004 *** not run ***
0005 -1.0 -1.0 -1
*** Cancelling streaming job since it appeared stuck for 60 min. ***
0006 *** not run ***
0007 -1.0 -1.0 -1
*** Cancelling streaming job since it appeared stuck for 60 min. ***
0008 -1.0 -1.0 -1
*** Cancelling streaming job since it appeared stuck for 60 min. ***
0009 *** not run ***
0010 -1.0 -1.0 -1
*** Cancelling streaming job since it appeared stuck for 60 min. ***
0011 -1.0 -1.0 -1
*** Cancelling streaming job since it appeared stuck for 60 min. ***
0012 -1.0 -1.0 -1
*** Cancelling streaming job since it appeared stuck for 60 min. ***
0013 *** not run ***
0014 *** not run ***
0015 *** not run ***
==========================================================================================
Exception in thread "main" java.lang.RuntimeException: Execution was not
successful
at org.apache.beam.sdk.nexmark.Main.runAll(Main.java:186)
at org.apache.beam.sdk.nexmark.Main.main(Main.java:495)
> Task :sdks:java:testing:nexmark:run FAILED
> Task :runners:google-cloud-dataflow-java:cleanUpDockerImages
Untagged: us.gcr.io/apache-beam-testing/java-postcommit-it/java:20210730064033
Untagged:
us.gcr.io/apache-beam-testing/java-postcommit-it/java@sha256:ee7d1940c87e2a2ce88caa5ef6e8b45b0ccedc3794fb58ec1fc912aa8bb0e3d1
Deleted: sha256:e803c88c7dfbf68acb64a73197a231dc7b52717190ccda45a11f9aa4ef14f0c9
Deleted: sha256:d5f08e1c30a570b0d5c239b473e7cc94ef09a57c0c379178db6b78b551d7bb4d
Deleted: sha256:eb1480a527267e4ff107dabb25468a783a1d99acc8eccb26a8b1dc75ccd86d6d
Deleted: sha256:2c10eac3a61af0c2bfc28fb57a58f12c2f593d515f875f390e7f7de5ca89f926
Deleted: sha256:eae54beb0f1509bbbc685ee579f6243dd1ce92019d2c8dfb5450178438578610
Deleted: sha256:bb6499fce426617d1535fa8a04177ad083a3107689acb0b942ad7979c79a37ac
Deleted: sha256:67bff33678e18854ceb0d1fb4f41e4cecfa194c48ab148533e2524d3bbf5e4ce
Deleted: sha256:b5c4759ffcf454e6ca41c6f6ad1c8bc1bc2dd9b02719438e5182e40be0da38be
Deleted: sha256:dd96a9588a4734bef7cedf29a579c86033c445b6bc5d3fa6d2fe3a0775a8318c
Deleted: sha256:324614ec77d1e775935d296f0a003594d4d2b2137985e35d68604e8c67be98fa
Deleted: sha256:f73ea1523fb177590c456c45aa82c76b36dc09e7445592bcbd377a56bed03e6b
Deleted: sha256:dd2c5f1f4f0b42f522ff435ca3419404a05a836d3d07ae36f78314b669f3960c
Deleted: sha256:5721df9518007a56d4ac9f65445dab4d873b0893b1d1dd4a613fc1835c2ccc17
Deleted: sha256:d9fa4c747f3b41fb52e59dec268a044f5aa63815ea8bd52117acf57a01617331
Deleted: sha256:797cfdb51036b03eab606e113c4a4263eaa5df39843bfcd4391fc0904b855951
Deleted: sha256:013ea1a5f2b3bdb6d0a7877e35ca08a6d0bd8fb4f1537ed7fbca508cc9d5bbcb
Deleted: sha256:9403fdef8521fc3b8ffc17a356c225d04c91706779adfbcd1a964496b16a7bc8
Deleted: sha256:cf11eac2ed18e5334f0528dd10f9e7dfd97b7bc48e197afea46721bf046402b0
Deleted: sha256:9a9847006b512c885cec9b808caa73e2a9e7b96e17637dfcdbf282a3fcbcb46c
Deleted: sha256:2bb642dce327508d6cf61639dc0a34ae9c269f8fce18d7d9d24ec854dc7e25c5
Deleted: sha256:9ee0c764733d21158b903767065a7eb42edce175aa4c09858a8af64f5be65b1f
Deleted: sha256:a4251f77c8df958964e1233fd9e3503b7972317354dbec8fbed5466020b60ba4
Deleted: sha256:05d1a127a2b9dcbf380a3daa7d8f3a967cea199964570b9f91bee332287f387e
Deleted: sha256:a24343949d696a7b52adcd5277bf85b3188afdb21fa1a3c95ae7b9c1e07e58a5
Deleted: sha256:313bcc5c0b2181ac834f5067aefc1ee6fbc72a5fdd22aa27559db79779209350
Deleted: sha256:4c85881c6055595d4cc2f64c5a0be1824958c86f02d269ef305b33985a550624
Deleted: sha256:e4d208f06826830b3cf3d7012fa6592a991df95b15b38d9ed9b52f3c8ac41577
Deleted: sha256:8b1d2cea4026437cec3aef916cfbf98fd8ced54fd1a3e0acbf616536704197f2
Tag: [us.gcr.io/apache-beam-testing/java-postcommit-it/java:20210730064033]
- referencing digest:
[us.gcr.io/apache-beam-testing/java-postcommit-it/java@sha256:ee7d1940c87e2a2ce88caa5ef6e8b45b0ccedc3794fb58ec1fc912aa8bb0e3d1]
Deleted [[us.gcr.io/apache-beam-testing/java-postcommit-it/java:20210730064033]
(referencing
[us.gcr.io/apache-beam-testing/java-postcommit-it/java@sha256:ee7d1940c87e2a2ce88caa5ef6e8b45b0ccedc3794fb58ec1fc912aa8bb0e3d1])].
Removing untagged image
us.gcr.io/apache-beam-testing/java-postcommit-it/java@sha256:ee7d1940c87e2a2ce88caa5ef6e8b45b0ccedc3794fb58ec1fc912aa8bb0e3d1
Digests:
-
us.gcr.io/apache-beam-testing/java-postcommit-it/java@sha256:ee7d1940c87e2a2ce88caa5ef6e8b45b0ccedc3794fb58ec1fc912aa8bb0e3d1
Deleted
[us.gcr.io/apache-beam-testing/java-postcommit-it/java@sha256:ee7d1940c87e2a2ce88caa5ef6e8b45b0ccedc3794fb58ec1fc912aa8bb0e3d1].
FAILURE: Build failed with an exception.
* What went wrong:
Execution failed for task ':sdks:java:testing:nexmark:run'.
> Process 'command '/usr/lib/jvm/java-8-openjdk-amd64/bin/java'' finished with
> non-zero exit value 1
* Try:
Run with --stacktrace option to get the stack trace. Run with --info or --debug
option to get more log output. Run with --scan to get full insights.
* Get more help at https://help.gradle.org
Deprecated Gradle features were used in this build, making it incompatible with
Gradle 7.0.
Use '--warning-mode all' to show the individual deprecation warnings.
See
https://docs.gradle.org/6.8.3/userguide/command_line_interface.html#sec:command_line_warnings
BUILD FAILED in 1h 10m 23s
129 actionable tasks: 15 executed, 114 up-to-date
Publishing build scan...
https://gradle.com/s/7kqngg52dysok
Build step 'Invoke Gradle script' changed build result to FAILURE
Build step 'Invoke Gradle script' marked build as failure
---------------------------------------------------------------------
To unsubscribe, e-mail: [email protected]
For additional commands, e-mail: [email protected]
