See
<https://ci-beam.apache.org/job/beam_PostCommit_Java_Nexmark_Dataflow_V2/441/display/redirect>
Changes:
------------------------------------------
[...truncated 151.03 KB...]
Sep 11, 2021 6:06:55 PM org.apache.beam.sdk.testutils.metrics.MetricsReader
getCounterMetric
SEVERE: Failed to get metric result.elements, from namespace Query5.Results
Sep 11, 2021 6:06:55 PM org.apache.beam.sdk.testutils.metrics.MetricsReader
getCounterMetric
SEVERE: Failed to get metric result.bytes, from namespace Query5.Results
==========================================================================================
Run started 2021-09-11T18:05:48.035Z and ran for PT67.437S
Default configuration:
{"debug":true,"query":null,"sourceType":"DIRECT","generateEventFilePathPrefix":null,"sinkType":"DEVNULL","exportSummaryToBigQuery":false,"pubSubMode":"COMBINED","pubsubMessageSerializationMethod":"CODER","sideInputType":"DIRECT","sideInputRowCount":500,"sideInputNumShards":3,"sideInputUrl":null,"sessionGap":600000,"numEvents":100000,"numEventGenerators":100,"rateShape":"SINE","firstEventRate":10000,"nextEventRate":10000,"rateUnit":"PER_SECOND","ratePeriodSec":600,"preloadSeconds":0,"streamTimeout":240,"isRateLimited":false,"useWallclockEventTime":false,"avgPersonByteSize":200,"avgAuctionByteSize":500,"avgBidByteSize":100,"hotAuctionRatio":2,"hotSellersRatio":4,"hotBiddersRatio":4,"windowSizeSec":10,"windowPeriodSec":5,"watermarkHoldbackSec":0,"numInFlightAuctions":100,"numActivePeople":1000,"coderStrategy":"HAND","cpuDelayMs":0,"diskBusyBytes":0,"auctionSkip":123,"fanout":5,"maxAuctionsWaitingTime":600,"occasionalDelaySec":3,"probDelayedEvent":0.1,"maxLogEvents":100000,"usePubsubPublishTime":false,"outOfOrderGroupSize":1,"numKeyBuckets":20000,"pardoCPUFactor":1.0}
Configurations:
Conf Description
0000 query:PASSTHROUGH; numEvents:10000000
0001 query:CURRENCY_CONVERSION; numEvents:10000000
0002 query:SELECTION; numEvents:10000000
0003 query:LOCAL_ITEM_SUGGESTION; numEvents:10000000
0004 query:AVERAGE_PRICE_FOR_CATEGORY; numEvents:1000000
0005 query:HOT_ITEMS; numEvents:10000000
0006 query:AVERAGE_SELLING_PRICE_BY_SELLER; numEvents:1000000
0007 query:HIGHEST_BID; numEvents:10000000
0008 query:MONITOR_NEW_USERS; numEvents:10000000
0009 query:WINNING_BIDS; numEvents:1000000
0010 query:LOG_TO_SHARDED_FILES; numEvents:10000000
0011 query:USER_SESSIONS; numEvents:10000000
0012 query:PROCESSING_TIME_WINDOWS; numEvents:10000000
0013 query:PORTABILITY_BATCH; numEvents:10000000
0014 query:BOUNDED_SIDE_INPUT_JOIN; numEvents:10000000
0015 query:SESSION_SIDE_INPUT_JOIN; numEvents:10000000
Performance:
Conf Runtime(sec) (Baseline) Events(/sec) (Baseline) Results
(Baseline)
0000 -1.0 -1.0 -1
*** Job was unexpectedly updated ***
0001 -1.0 -1.0 -1
*** Job was unexpectedly updated ***
0002 -1.0 -1.0 -1
*** Job was unexpectedly updated ***
0003 *** not run ***
0004 *** not run ***
0005 -1.0 -1.0 -1
*** Job was unexpectedly updated ***
0006 *** not run ***
0007 *** not run ***
0008 -1.0 -1.0 -1
*** Job was unexpectedly updated ***
0009 *** not run ***
0010 -1.0 -1.0 -1
*** Job was unexpectedly updated ***
0011 -1.0 -1.0 -1
*** Job was unexpectedly updated ***
0012 *** not run ***
0013 -1.0 -1.0 -1
*** Job was unexpectedly updated ***
0014 *** not run ***
0015 *** not run ***
==========================================================================================
Sep 11, 2021 6:06:55 PM org.apache.beam.runners.dataflow.DataflowPipelineJob
logTerminalState
INFO: Job 2021-09-11_11_06_39-6475348714149366571 failed with status FAILED.
2021-09-11T18:06:55.600Z Waiting for main pipeline to 'finish'
2021-09-11T18:06:55.601Z FAILED Query12
Sep 11, 2021 6:06:55 PM org.apache.beam.sdk.testutils.metrics.MetricsReader
getCounterMetric
SEVERE: Failed to get metric event.elements, from namespace Query12.Events
Sep 11, 2021 6:06:55 PM org.apache.beam.sdk.testutils.metrics.MetricsReader
getCounterMetric
SEVERE: Failed to get metric event.bytes, from namespace Query12.Events
Sep 11, 2021 6:06:55 PM org.apache.beam.sdk.testutils.metrics.MetricsReader
getCounterMetric
SEVERE: Failed to get metric result.elements, from namespace Query12.Results
Sep 11, 2021 6:06:55 PM org.apache.beam.sdk.testutils.metrics.MetricsReader
getCounterMetric
SEVERE: Failed to get metric result.bytes, from namespace Query12.Results
==========================================================================================
Run started 2021-09-11T18:05:48.035Z and ran for PT67.588S
Default configuration:
{"debug":true,"query":null,"sourceType":"DIRECT","generateEventFilePathPrefix":null,"sinkType":"DEVNULL","exportSummaryToBigQuery":false,"pubSubMode":"COMBINED","pubsubMessageSerializationMethod":"CODER","sideInputType":"DIRECT","sideInputRowCount":500,"sideInputNumShards":3,"sideInputUrl":null,"sessionGap":600000,"numEvents":100000,"numEventGenerators":100,"rateShape":"SINE","firstEventRate":10000,"nextEventRate":10000,"rateUnit":"PER_SECOND","ratePeriodSec":600,"preloadSeconds":0,"streamTimeout":240,"isRateLimited":false,"useWallclockEventTime":false,"avgPersonByteSize":200,"avgAuctionByteSize":500,"avgBidByteSize":100,"hotAuctionRatio":2,"hotSellersRatio":4,"hotBiddersRatio":4,"windowSizeSec":10,"windowPeriodSec":5,"watermarkHoldbackSec":0,"numInFlightAuctions":100,"numActivePeople":1000,"coderStrategy":"HAND","cpuDelayMs":0,"diskBusyBytes":0,"auctionSkip":123,"fanout":5,"maxAuctionsWaitingTime":600,"occasionalDelaySec":3,"probDelayedEvent":0.1,"maxLogEvents":100000,"usePubsubPublishTime":false,"outOfOrderGroupSize":1,"numKeyBuckets":20000,"pardoCPUFactor":1.0}
Configurations:
Conf Description
0000 query:PASSTHROUGH; numEvents:10000000
0001 query:CURRENCY_CONVERSION; numEvents:10000000
0002 query:SELECTION; numEvents:10000000
0003 query:LOCAL_ITEM_SUGGESTION; numEvents:10000000
0004 query:AVERAGE_PRICE_FOR_CATEGORY; numEvents:1000000
0005 query:HOT_ITEMS; numEvents:10000000
0006 query:AVERAGE_SELLING_PRICE_BY_SELLER; numEvents:1000000
0007 query:HIGHEST_BID; numEvents:10000000
0008 query:MONITOR_NEW_USERS; numEvents:10000000
0009 query:WINNING_BIDS; numEvents:1000000
0010 query:LOG_TO_SHARDED_FILES; numEvents:10000000
0011 query:USER_SESSIONS; numEvents:10000000
0012 query:PROCESSING_TIME_WINDOWS; numEvents:10000000
0013 query:PORTABILITY_BATCH; numEvents:10000000
0014 query:BOUNDED_SIDE_INPUT_JOIN; numEvents:10000000
0015 query:SESSION_SIDE_INPUT_JOIN; numEvents:10000000
Performance:
Conf Runtime(sec) (Baseline) Events(/sec) (Baseline) Results
(Baseline)
0000 -1.0 -1.0 -1
*** Job was unexpectedly updated ***
0001 -1.0 -1.0 -1
*** Job was unexpectedly updated ***
0002 -1.0 -1.0 -1
*** Job was unexpectedly updated ***
0003 *** not run ***
0004 *** not run ***
0005 -1.0 -1.0 -1
*** Job was unexpectedly updated ***
0006 *** not run ***
0007 *** not run ***
0008 -1.0 -1.0 -1
*** Job was unexpectedly updated ***
0009 *** not run ***
0010 -1.0 -1.0 -1
*** Job was unexpectedly updated ***
0011 -1.0 -1.0 -1
*** Job was unexpectedly updated ***
0012 -1.0 -1.0 -1
*** Job was unexpectedly updated ***
0013 -1.0 -1.0 -1
*** Job was unexpectedly updated ***
0014 *** not run ***
0015 *** not run ***
==========================================================================================
==========================================================================================
Run started 2021-09-11T18:05:48.035Z and ran for PT68.435S
Default configuration:
{"debug":true,"query":null,"sourceType":"DIRECT","generateEventFilePathPrefix":null,"sinkType":"DEVNULL","exportSummaryToBigQuery":false,"pubSubMode":"COMBINED","pubsubMessageSerializationMethod":"CODER","sideInputType":"DIRECT","sideInputRowCount":500,"sideInputNumShards":3,"sideInputUrl":null,"sessionGap":600000,"numEvents":100000,"numEventGenerators":100,"rateShape":"SINE","firstEventRate":10000,"nextEventRate":10000,"rateUnit":"PER_SECOND","ratePeriodSec":600,"preloadSeconds":0,"streamTimeout":240,"isRateLimited":false,"useWallclockEventTime":false,"avgPersonByteSize":200,"avgAuctionByteSize":500,"avgBidByteSize":100,"hotAuctionRatio":2,"hotSellersRatio":4,"hotBiddersRatio":4,"windowSizeSec":10,"windowPeriodSec":5,"watermarkHoldbackSec":0,"numInFlightAuctions":100,"numActivePeople":1000,"coderStrategy":"HAND","cpuDelayMs":0,"diskBusyBytes":0,"auctionSkip":123,"fanout":5,"maxAuctionsWaitingTime":600,"occasionalDelaySec":3,"probDelayedEvent":0.1,"maxLogEvents":100000,"usePubsubPublishTime":false,"outOfOrderGroupSize":1,"numKeyBuckets":20000,"pardoCPUFactor":1.0}
Configurations:
Conf Description
0000 query:PASSTHROUGH; numEvents:10000000
0001 query:CURRENCY_CONVERSION; numEvents:10000000
0002 query:SELECTION; numEvents:10000000
0003 query:LOCAL_ITEM_SUGGESTION; numEvents:10000000
0004 query:AVERAGE_PRICE_FOR_CATEGORY; numEvents:1000000
0005 query:HOT_ITEMS; numEvents:10000000
0006 query:AVERAGE_SELLING_PRICE_BY_SELLER; numEvents:1000000
0007 query:HIGHEST_BID; numEvents:10000000
0008 query:MONITOR_NEW_USERS; numEvents:10000000
0009 query:WINNING_BIDS; numEvents:1000000
0010 query:LOG_TO_SHARDED_FILES; numEvents:10000000
0011 query:USER_SESSIONS; numEvents:10000000
0012 query:PROCESSING_TIME_WINDOWS; numEvents:10000000
0013 query:PORTABILITY_BATCH; numEvents:10000000
0014 query:BOUNDED_SIDE_INPUT_JOIN; numEvents:10000000
0015 query:SESSION_SIDE_INPUT_JOIN; numEvents:10000000
Performance:
Conf Runtime(sec) (Baseline) Events(/sec) (Baseline) Results
(Baseline)
0000 -1.0 -1.0 -1
*** Job was unexpectedly updated ***
0001 -1.0 -1.0 -1
*** Job was unexpectedly updated ***
0002 -1.0 -1.0 -1
*** Job was unexpectedly updated ***
0003 *** not run ***
0004 *** not run ***
0005 -1.0 -1.0 -1
*** Job was unexpectedly updated ***
0006 *** not run ***
0007 *** not run ***
0008 -1.0 -1.0 -1
*** Job was unexpectedly updated ***
0009 *** not run ***
0010 -1.0 -1.0 -1
*** Job was unexpectedly updated ***
0011 -1.0 -1.0 -1
*** Job was unexpectedly updated ***
0012 -1.0 -1.0 -1
*** Job was unexpectedly updated ***
0013 -1.0 -1.0 -1
*** Job was unexpectedly updated ***
0014 *** not run ***
0015 *** not run ***
==========================================================================================
Exception in thread "main" java.lang.RuntimeException: Execution was not
successful
at org.apache.beam.sdk.nexmark.Main.runAll(Main.java:186)
at org.apache.beam.sdk.nexmark.Main.main(Main.java:495)
> Task :sdks:java:testing:nexmark:run FAILED
> Task :runners:google-cloud-dataflow-java:cleanUpDockerImages
Untagged: us.gcr.io/apache-beam-testing/java-postcommit-it/java:20210911180105
Untagged:
us.gcr.io/apache-beam-testing/java-postcommit-it/java@sha256:0a402adfc0f7469ebca76bdfbfe74ead08bbcf05b4e29f8780d67c5b58c494de
Deleted: sha256:901dbcce5b79da6c3298c06a8fbf4c5b1869d16a32bb3fd136e436e2370c1d94
Deleted: sha256:52fb874e76990a7b01d315a03e5e29be4fb9a212b5579be57e0daccc75fdf435
Deleted: sha256:124d46d14e104a0a7c8a9f27f830c5e895e94ca677860911f126ed7bb559be4a
Deleted: sha256:016aacab980ebc286eb98e82417fd9597e3ccfb975bae12f5f431562a7815566
Deleted: sha256:b6090639d2f2c91d61352c4284f7dfdcc62e423115c69c4190a7291161c8464e
Deleted: sha256:edd9f95837213dd48c3c0db9872b75e109cda5a0caf2c1522f047308b3ec52cc
Deleted: sha256:2c38139a76bd4ac72b4bf9a2238f0546570cbffa0ebfc84fe5eec5b9e362c9ea
Deleted: sha256:065ad7dfebd96fbaef064511a01c84db42a287aa3c220b2ea1ab69e2a7dfc77b
Deleted: sha256:056c0bc637ca7a1bc1b1326c1be186827d7b472ab60cd0c41984eab80ca1727b
Deleted: sha256:07966905147ab4450d17cd937da20b62812edb2ce1b6f4577d38b5134220bc33
Deleted: sha256:e144c967848667a1521dd7ff4a2e29a35096e5ebcdfbea6051ca16a6d9293c74
Deleted: sha256:47e8aae5c1944735cb5a65b485b0834ee6cd55a196070df1307fcdbd03fc2e1e
Deleted: sha256:75b13de804078edcec795bcddcbc0828de078e8cb538e50696942d40a1435af5
Deleted: sha256:54a6da4c003fdaa7d7512ab847e402f59399aea2b00b1bff580ba7fc324dd2c8
Deleted: sha256:5d73fe1178ab63baf6e3d6ff0dae6ec9e5ba38cc5f1e70958ccbce210fdc91a4
Deleted: sha256:97f266807f30104e5cb21c5a5fdce49ecb243b29235d6f61633cf94b0fe81af3
Deleted: sha256:3dc2910031a658820c5a0fbf8ed4331798dbf615b50e5d958bf912f96072af08
Deleted: sha256:107c387d16b1551c7a2c95fbe86c3d0ba8b675df6a8381accf8734526027500c
Deleted: sha256:d879252fff1b59c0f52bc83fadf70bdcb46478cdb1776d6d629d9c210fa0258f
Deleted: sha256:21eaea33dbb041934cca0d09f3d93de82cbc58c3b88c5cb7bdea70f8648566be
Deleted: sha256:397e524711650e37914ba3c6f9bf77f37fec7cd34cd09d3b6b4cb3ebacfb11fb
Deleted: sha256:ba19c48b84920d8e0a4f8a120197650bde341d40f6887d8a855979dcaffb5055
Deleted: sha256:ef148e74ea51480b70ab3e43605cf4c1c5caaf7977bddfd00bba6922f9b6a329
Deleted: sha256:8ef60ed509d1187908e4222db60c1eba7b0346c216b51e0804ffd35d2041bf3e
Deleted: sha256:11cac360db207eb7e30503d97789cc5b2b19c0f58ac9af41e890c8d5c91f05eb
Deleted: sha256:0788647b3d8292b16afd2e375e9028658d1220549520965a148e524b30b05cf8
Deleted: sha256:cc63cab53bc0e7e201c1e533d6513a50fcb5acaeb79a5b51a71f2ddd5863f368
Deleted: sha256:211383a6d233d5c05ab74387f81a7809b0241881c38980ef1ea2a76b778486ae
Tag: [us.gcr.io/apache-beam-testing/java-postcommit-it/java:20210911180105]
- referencing digest:
[us.gcr.io/apache-beam-testing/java-postcommit-it/java@sha256:0a402adfc0f7469ebca76bdfbfe74ead08bbcf05b4e29f8780d67c5b58c494de]
Deleted [[us.gcr.io/apache-beam-testing/java-postcommit-it/java:20210911180105]
(referencing
[us.gcr.io/apache-beam-testing/java-postcommit-it/java@sha256:0a402adfc0f7469ebca76bdfbfe74ead08bbcf05b4e29f8780d67c5b58c494de])].
Removing untagged image
us.gcr.io/apache-beam-testing/java-postcommit-it/java@sha256:0a402adfc0f7469ebca76bdfbfe74ead08bbcf05b4e29f8780d67c5b58c494de
Digests:
-
us.gcr.io/apache-beam-testing/java-postcommit-it/java@sha256:0a402adfc0f7469ebca76bdfbfe74ead08bbcf05b4e29f8780d67c5b58c494de
Deleted
[us.gcr.io/apache-beam-testing/java-postcommit-it/java@sha256:0a402adfc0f7469ebca76bdfbfe74ead08bbcf05b4e29f8780d67c5b58c494de].
FAILURE: Build failed with an exception.
* What went wrong:
Execution failed for task ':sdks:java:testing:nexmark:run'.
> Process 'command '/usr/lib/jvm/java-8-openjdk-amd64/bin/java'' finished with
> non-zero exit value 1
* Try:
Run with --stacktrace option to get the stack trace. Run with --info or --debug
option to get more log output. Run with --scan to get full insights.
* Get more help at https://help.gradle.org
Deprecated Gradle features were used in this build, making it incompatible with
Gradle 7.0.
Use '--warning-mode all' to show the individual deprecation warnings.
See
https://docs.gradle.org/6.8.3/userguide/command_line_interface.html#sec:command_line_warnings
BUILD FAILED in 6m 34s
128 actionable tasks: 89 executed, 37 from cache, 2 up-to-date
Publishing build scan...
https://gradle.com/s/atsvawlgzwz4w
Build step 'Invoke Gradle script' changed build result to FAILURE
Build step 'Invoke Gradle script' marked build as failure
---------------------------------------------------------------------
To unsubscribe, e-mail: [email protected]
For additional commands, e-mail: [email protected]
