See
<https://ci-beam.apache.org/job/beam_PostCommit_Java_Nexmark_Dataflow_V2/449/display/redirect?page=changes>
Changes:
[rohde.samuel] [BEAM-12842] Add timestamp to test work item to deflake
[suztomo] [BEAM-12873] HL7v2IO: to leave schematizedData null, not empty
------------------------------------------
[...truncated 152.42 KB...]
Sep 13, 2021 6:08:10 PM org.apache.beam.sdk.testutils.metrics.MetricsReader
getCounterMetric
SEVERE: Failed to get metric result.elements, from namespace Query13.Results
Sep 13, 2021 6:08:10 PM org.apache.beam.sdk.testutils.metrics.MetricsReader
getCounterMetric
SEVERE: Failed to get metric result.bytes, from namespace Query13.Results
==========================================================================================
Run started 2021-09-13T18:06:50.159Z and ran for PT80.437S
Default configuration:
{"debug":true,"query":null,"sourceType":"DIRECT","generateEventFilePathPrefix":null,"sinkType":"DEVNULL","exportSummaryToBigQuery":false,"pubSubMode":"COMBINED","pubsubMessageSerializationMethod":"CODER","sideInputType":"DIRECT","sideInputRowCount":500,"sideInputNumShards":3,"sideInputUrl":null,"sessionGap":600000,"numEvents":100000,"numEventGenerators":100,"rateShape":"SINE","firstEventRate":10000,"nextEventRate":10000,"rateUnit":"PER_SECOND","ratePeriodSec":600,"preloadSeconds":0,"streamTimeout":240,"isRateLimited":false,"useWallclockEventTime":false,"avgPersonByteSize":200,"avgAuctionByteSize":500,"avgBidByteSize":100,"hotAuctionRatio":2,"hotSellersRatio":4,"hotBiddersRatio":4,"windowSizeSec":10,"windowPeriodSec":5,"watermarkHoldbackSec":0,"numInFlightAuctions":100,"numActivePeople":1000,"coderStrategy":"HAND","cpuDelayMs":0,"diskBusyBytes":0,"auctionSkip":123,"fanout":5,"maxAuctionsWaitingTime":600,"occasionalDelaySec":3,"probDelayedEvent":0.1,"maxLogEvents":100000,"usePubsubPublishTime":false,"outOfOrderGroupSize":1,"numKeyBuckets":20000,"pardoCPUFactor":1.0}
Configurations:
Conf Description
0000 query:PASSTHROUGH; numEvents:10000000
0001 query:CURRENCY_CONVERSION; numEvents:10000000
0002 query:SELECTION; numEvents:10000000
0003 query:LOCAL_ITEM_SUGGESTION; numEvents:10000000
0004 query:AVERAGE_PRICE_FOR_CATEGORY; numEvents:1000000
0005 query:HOT_ITEMS; numEvents:10000000
0006 query:AVERAGE_SELLING_PRICE_BY_SELLER; numEvents:1000000
0007 query:HIGHEST_BID; numEvents:10000000
0008 query:MONITOR_NEW_USERS; numEvents:10000000
0009 query:WINNING_BIDS; numEvents:1000000
0010 query:LOG_TO_SHARDED_FILES; numEvents:10000000
0011 query:USER_SESSIONS; numEvents:10000000
0012 query:PROCESSING_TIME_WINDOWS; numEvents:10000000
0013 query:PORTABILITY_BATCH; numEvents:10000000
0014 query:BOUNDED_SIDE_INPUT_JOIN; numEvents:10000000
0015 query:SESSION_SIDE_INPUT_JOIN; numEvents:10000000
Performance:
Conf Runtime(sec) (Baseline) Events(/sec) (Baseline) Results
(Baseline)
0000 -1.0 -1.0 -1
*** Job was unexpectedly updated ***
0001 -1.0 -1.0 -1
*** Job was unexpectedly updated ***
0002 -1.0 -1.0 -1
*** Job was unexpectedly updated ***
0003 *** not run ***
0004 *** not run ***
0005 *** not run ***
0006 *** not run ***
0007 *** not run ***
0008 -1.0 -1.0 -1
*** Job was unexpectedly updated ***
0009 *** not run ***
0010 -1.0 -1.0 -1
*** Job was unexpectedly updated ***
0011 -1.0 -1.0 -1
*** Job was unexpectedly updated ***
0012 -1.0 -1.0 -1
*** Job was unexpectedly updated ***
0013 -1.0 -1.0 -1
*** Job was unexpectedly updated ***
0014 *** not run ***
0015 *** not run ***
==========================================================================================
Sep 13, 2021 6:08:12 PM org.apache.beam.runners.dataflow.DataflowPipelineJob
logTerminalState
INFO: Job 2021-09-13_11_07_51-15510978477917696210 failed with status FAILED.
2021-09-13T18:08:12.470Z Waiting for main pipeline to 'finish'
2021-09-13T18:08:12.470Z FAILED Query5
Sep 13, 2021 6:08:12 PM org.apache.beam.sdk.testutils.metrics.MetricsReader
getCounterMetric
SEVERE: Failed to get metric event.elements, from namespace Query5.Events
==========================================================================================
Run started 2021-09-13T18:06:50.159Z and ran for PT82.331S
Default configuration:
{"debug":true,"query":null,"sourceType":"DIRECT","generateEventFilePathPrefix":null,"sinkType":"DEVNULL","exportSummaryToBigQuery":false,"pubSubMode":"COMBINED","pubsubMessageSerializationMethod":"CODER","sideInputType":"DIRECT","sideInputRowCount":500,"sideInputNumShards":3,"sideInputUrl":null,"sessionGap":600000,"numEvents":100000,"numEventGenerators":100,"rateShape":"SINE","firstEventRate":10000,"nextEventRate":10000,"rateUnit":"PER_SECOND","ratePeriodSec":600,"preloadSeconds":0,"streamTimeout":240,"isRateLimited":false,"useWallclockEventTime":false,"avgPersonByteSize":200,"avgAuctionByteSize":500,"avgBidByteSize":100,"hotAuctionRatio":2,"hotSellersRatio":4,"hotBiddersRatio":4,"windowSizeSec":10,"windowPeriodSec":5,"watermarkHoldbackSec":0,"numInFlightAuctions":100,"numActivePeople":1000,"coderStrategy":"HAND","cpuDelayMs":0,"diskBusyBytes":0,"auctionSkip":123,"fanout":5,"maxAuctionsWaitingTime":600,"occasionalDelaySec":3,"probDelayedEvent":0.1,"maxLogEvents":100000,"usePubsubPublishTime":false,"outOfOrderGroupSize":1,"numKeyBuckets":20000,"pardoCPUFactor":1.0}
Configurations:
Conf Description
0000 query:PASSTHROUGH; numEvents:10000000
0001 query:CURRENCY_CONVERSION; numEvents:10000000
0002 query:SELECTION; numEvents:10000000
0003 query:LOCAL_ITEM_SUGGESTION; numEvents:10000000
0004 query:AVERAGE_PRICE_FOR_CATEGORY; numEvents:1000000
0005 query:HOT_ITEMS; numEvents:10000000
0006 query:AVERAGE_SELLING_PRICE_BY_SELLER; numEvents:1000000
0007 query:HIGHEST_BID; numEvents:10000000
0008 query:MONITOR_NEW_USERS; numEvents:10000000
0009 query:WINNING_BIDS; numEvents:1000000
0010 query:LOG_TO_SHARDED_FILES; numEvents:10000000
0011 query:USER_SESSIONS; numEvents:10000000
0012 query:PROCESSING_TIME_WINDOWS; numEvents:10000000
0013 query:PORTABILITY_BATCH; numEvents:10000000
0014 query:BOUNDED_SIDE_INPUT_JOIN; numEvents:10000000
0015 query:SESSION_SIDE_INPUT_JOIN; numEvents:10000000
Performance:
Conf Runtime(sec) (Baseline) Events(/sec) (Baseline) Results
(Baseline)
0000 -1.0 -1.0 -1
*** Job was unexpectedly updated ***
0001 -1.0 -1.0 -1
*** Job was unexpectedly updated ***
0002 -1.0 -1.0 -1
*** Job was unexpectedly updated ***
0003 *** not run ***
0004 *** not run ***
0005 -1.0 -1.0 -1
*** Job was unexpectedly updated ***
0006 *** not run ***
0007 *** not run ***
0008 -1.0 -1.0 -1
*** Job was unexpectedly updated ***
0009 *** not run ***
0010 -1.0 -1.0 -1
*** Job was unexpectedly updated ***
0011 -1.0 -1.0 -1
*** Job was unexpectedly updated ***
0012 -1.0 -1.0 -1
*** Job was unexpectedly updated ***
0013 -1.0 -1.0 -1
*** Job was unexpectedly updated ***
0014 *** not run ***
0015 *** not run ***
==========================================================================================
Sep 13, 2021 6:08:12 PM org.apache.beam.sdk.testutils.metrics.MetricsReader
getCounterMetric
SEVERE: Failed to get metric event.bytes, from namespace Query5.Events
Sep 13, 2021 6:08:12 PM org.apache.beam.sdk.testutils.metrics.MetricsReader
getCounterMetric
SEVERE: Failed to get metric result.elements, from namespace Query5.Results
Sep 13, 2021 6:08:12 PM org.apache.beam.sdk.testutils.metrics.MetricsReader
getCounterMetric
SEVERE: Failed to get metric result.bytes, from namespace Query5.Results
==========================================================================================
Run started 2021-09-13T18:06:50.159Z and ran for PT84.561S
Default configuration:
{"debug":true,"query":null,"sourceType":"DIRECT","generateEventFilePathPrefix":null,"sinkType":"DEVNULL","exportSummaryToBigQuery":false,"pubSubMode":"COMBINED","pubsubMessageSerializationMethod":"CODER","sideInputType":"DIRECT","sideInputRowCount":500,"sideInputNumShards":3,"sideInputUrl":null,"sessionGap":600000,"numEvents":100000,"numEventGenerators":100,"rateShape":"SINE","firstEventRate":10000,"nextEventRate":10000,"rateUnit":"PER_SECOND","ratePeriodSec":600,"preloadSeconds":0,"streamTimeout":240,"isRateLimited":false,"useWallclockEventTime":false,"avgPersonByteSize":200,"avgAuctionByteSize":500,"avgBidByteSize":100,"hotAuctionRatio":2,"hotSellersRatio":4,"hotBiddersRatio":4,"windowSizeSec":10,"windowPeriodSec":5,"watermarkHoldbackSec":0,"numInFlightAuctions":100,"numActivePeople":1000,"coderStrategy":"HAND","cpuDelayMs":0,"diskBusyBytes":0,"auctionSkip":123,"fanout":5,"maxAuctionsWaitingTime":600,"occasionalDelaySec":3,"probDelayedEvent":0.1,"maxLogEvents":100000,"usePubsubPublishTime":false,"outOfOrderGroupSize":1,"numKeyBuckets":20000,"pardoCPUFactor":1.0}
Configurations:
Conf Description
0000 query:PASSTHROUGH; numEvents:10000000
0001 query:CURRENCY_CONVERSION; numEvents:10000000
0002 query:SELECTION; numEvents:10000000
0003 query:LOCAL_ITEM_SUGGESTION; numEvents:10000000
0004 query:AVERAGE_PRICE_FOR_CATEGORY; numEvents:1000000
0005 query:HOT_ITEMS; numEvents:10000000
0006 query:AVERAGE_SELLING_PRICE_BY_SELLER; numEvents:1000000
0007 query:HIGHEST_BID; numEvents:10000000
0008 query:MONITOR_NEW_USERS; numEvents:10000000
0009 query:WINNING_BIDS; numEvents:1000000
0010 query:LOG_TO_SHARDED_FILES; numEvents:10000000
0011 query:USER_SESSIONS; numEvents:10000000
0012 query:PROCESSING_TIME_WINDOWS; numEvents:10000000
0013 query:PORTABILITY_BATCH; numEvents:10000000
0014 query:BOUNDED_SIDE_INPUT_JOIN; numEvents:10000000
0015 query:SESSION_SIDE_INPUT_JOIN; numEvents:10000000
Performance:
Conf Runtime(sec) (Baseline) Events(/sec) (Baseline) Results
(Baseline)
0000 -1.0 -1.0 -1
*** Job was unexpectedly updated ***
0001 -1.0 -1.0 -1
*** Job was unexpectedly updated ***
0002 -1.0 -1.0 -1
*** Job was unexpectedly updated ***
0003 *** not run ***
0004 *** not run ***
0005 -1.0 -1.0 -1
*** Job was unexpectedly updated ***
0006 *** not run ***
0007 *** not run ***
0008 -1.0 -1.0 -1
*** Job was unexpectedly updated ***
0009 *** not run ***
0010 -1.0 -1.0 -1
*** Job was unexpectedly updated ***
0011 -1.0 -1.0 -1
*** Job was unexpectedly updated ***
0012 -1.0 -1.0 -1
*** Job was unexpectedly updated ***
0013 -1.0 -1.0 -1
*** Job was unexpectedly updated ***
0014 *** not run ***
0015 *** not run ***
==========================================================================================
Exception in thread "main" java.lang.RuntimeException: Execution was not
successful
at org.apache.beam.sdk.nexmark.Main.runAll(Main.java:186)
at org.apache.beam.sdk.nexmark.Main.main(Main.java:495)
> Task :sdks:java:testing:nexmark:run FAILED
> Task :runners:google-cloud-dataflow-java:cleanUpDockerImages
Untagged: us.gcr.io/apache-beam-testing/java-postcommit-it/java:20210913180112
Untagged:
us.gcr.io/apache-beam-testing/java-postcommit-it/java@sha256:ce51133e6fee5d1d8371275f97c37cc80f8071b375a23540856d9850264e2544
Deleted: sha256:6055db809f98945a0c46776036387dc4a42271770bbac8086c1060493f198953
Deleted: sha256:973dd74fa817c1706e7f31344527ea10a25b2a52ca8ec39e3d9309a4ecbd0390
Deleted: sha256:f3884fc9bdf1179c64ef27a0b4db05a6c109d086f0de184a22e3138b33ce79f3
Deleted: sha256:2783884487c78dc9782b28bbd3966974baf9a3c1f1671551e08a97fb5f97f9f2
Deleted: sha256:f2ea32bc1ca495407dc47245d955b52c58436379b6890c6476ec7373b368da45
Deleted: sha256:fee5fb7817ea93481d6408f415ec5764c306ca54d253688c6f1f5cee6812d89b
Deleted: sha256:6c2f0c1616e0398c84dd2671dda97005d06c8514da4f6e22c425040e4cd4ad40
Deleted: sha256:9a4a5775da33a022723438b3c2922406b6a7f969337834650be6d58e6c80ede4
Deleted: sha256:c4d6e6518d7fb075f4973034be8b524755b1db16f41c88f917b0baee8263eed3
Deleted: sha256:9b19401c52b275676da3b889c36f6347fd34448b4693a6a0d6d99dd958e1eb64
Deleted: sha256:c3d12009a6765566cf94be64512e9185c0426e47f2e682789c662adcd38226c4
Deleted: sha256:2bb2a44aa6e005e0cc3f65b9cd929ad8a91284a5c491c65545635161aa1eb0f1
Deleted: sha256:244e02a980f3a5eb09930522ccacfb20eb052e6ff50da8a8886dcbc6cf0686fd
Deleted: sha256:2540593ced715980379a281ba637b900ea16c726934f6658ec4d12dbe72fcc65
Deleted: sha256:032b6422adbaaefce99fc4c643486ccbfeaacb9ef0db05629f5bfde906aaa9b8
Deleted: sha256:99c27eb7c2d4ca6338c29be026e779e0aa3b9d73335ac6476652a2c4b8cca7b1
Deleted: sha256:63ced1bdcabb98773f2643f223ea0aa83b8cf8e4a42830bb1fbf7e769eada48e
Deleted: sha256:005335b22a372d5d30843336944f9d9cd7e2de496a3b4c9de8de811bac4a686a
Deleted: sha256:0385bbaa1785d0fded209ac694392655b9aa85676736783558e9538f34889ebe
Deleted: sha256:07b9f2c5df04f5df8739b37bce4c955e1987e3912d6a7af048c4ad5b1d3cd33b
Deleted: sha256:f308c3ff8cf2fe1648dc223e7fd0356f35a0c4fefe60817c492e8a62ed3e4da0
Deleted: sha256:9a2d20a05f819b78a2422397198ab9e604b00fc87997255bac525c7ee95f8f38
Deleted: sha256:e183fdb0ffe1e630ca849784bfb3b705e7737cf9be0b161a32f044dc2038fec8
Deleted: sha256:722409f758f8581ab3f679da79b0d9307bd678fe3bece36e4a9339b75eda5351
Deleted: sha256:a06ecb1254244ec9f37a9b296407b867e84f816bdba3999bdee77cf102d00dba
Deleted: sha256:9d60b7a1d03ff0591aa1f8dcb2ea36de37ecee35b9f2824c90712f8b47f452e2
Deleted: sha256:f69a5c0c1e965b47a2baec0cf0dc7c2c108d570cea31b544aeaf7edaf0549c6f
Deleted: sha256:0257570b81e6c78fad597d188a2fabae13fac6b2c28705d891d34320fdd68280
Tag: [us.gcr.io/apache-beam-testing/java-postcommit-it/java:20210913180112]
- referencing digest:
[us.gcr.io/apache-beam-testing/java-postcommit-it/java@sha256:ce51133e6fee5d1d8371275f97c37cc80f8071b375a23540856d9850264e2544]
Deleted [[us.gcr.io/apache-beam-testing/java-postcommit-it/java:20210913180112]
(referencing
[us.gcr.io/apache-beam-testing/java-postcommit-it/java@sha256:ce51133e6fee5d1d8371275f97c37cc80f8071b375a23540856d9850264e2544])].
Removing untagged image
us.gcr.io/apache-beam-testing/java-postcommit-it/java@sha256:ce51133e6fee5d1d8371275f97c37cc80f8071b375a23540856d9850264e2544
Digests:
-
us.gcr.io/apache-beam-testing/java-postcommit-it/java@sha256:ce51133e6fee5d1d8371275f97c37cc80f8071b375a23540856d9850264e2544
Deleted
[us.gcr.io/apache-beam-testing/java-postcommit-it/java@sha256:ce51133e6fee5d1d8371275f97c37cc80f8071b375a23540856d9850264e2544].
FAILURE: Build failed with an exception.
* What went wrong:
Execution failed for task ':sdks:java:testing:nexmark:run'.
> Process 'command '/usr/lib/jvm/java-8-openjdk-amd64/bin/java'' finished with
> non-zero exit value 1
* Try:
Run with --stacktrace option to get the stack trace. Run with --info or --debug
option to get more log output. Run with --scan to get full insights.
* Get more help at https://help.gradle.org
Deprecated Gradle features were used in this build, making it incompatible with
Gradle 7.0.
Use '--warning-mode all' to show the individual deprecation warnings.
See
https://docs.gradle.org/6.8.3/userguide/command_line_interface.html#sec:command_line_warnings
BUILD FAILED in 7m 58s
128 actionable tasks: 89 executed, 37 from cache, 2 up-to-date
Publishing build scan...
https://gradle.com/s/qtnthcvvkw7h4
Build step 'Invoke Gradle script' changed build result to FAILURE
Build step 'Invoke Gradle script' marked build as failure
---------------------------------------------------------------------
To unsubscribe, e-mail: [email protected]
For additional commands, e-mail: [email protected]
