See
<https://ci-beam.apache.org/job/beam_PostCommit_Java_Nexmark_Dataflow_V2/475/display/redirect>
Changes:
------------------------------------------
[...truncated 254.07 KB...]
2021-09-20T06:11:57.887Z DONE Query11
==========================================================================================
Run started 2021-09-20T06:05:30.512Z and ran for PT387.410S
Default configuration:
{"debug":true,"query":null,"sourceType":"DIRECT","generateEventFilePathPrefix":null,"sinkType":"DEVNULL","exportSummaryToBigQuery":false,"pubSubMode":"COMBINED","pubsubMessageSerializationMethod":"CODER","sideInputType":"DIRECT","sideInputRowCount":500,"sideInputNumShards":3,"sideInputUrl":null,"sessionGap":600000,"numEvents":100000,"numEventGenerators":100,"rateShape":"SINE","firstEventRate":10000,"nextEventRate":10000,"rateUnit":"PER_SECOND","ratePeriodSec":600,"preloadSeconds":0,"streamTimeout":240,"isRateLimited":false,"useWallclockEventTime":false,"avgPersonByteSize":200,"avgAuctionByteSize":500,"avgBidByteSize":100,"hotAuctionRatio":2,"hotSellersRatio":4,"hotBiddersRatio":4,"windowSizeSec":10,"windowPeriodSec":5,"watermarkHoldbackSec":0,"numInFlightAuctions":100,"numActivePeople":1000,"coderStrategy":"HAND","cpuDelayMs":0,"diskBusyBytes":0,"auctionSkip":123,"fanout":5,"maxAuctionsWaitingTime":600,"occasionalDelaySec":3,"probDelayedEvent":0.1,"maxLogEvents":100000,"usePubsubPublishTime":false,"outOfOrderGroupSize":1,"numKeyBuckets":20000,"pardoCPUFactor":1.0}
Configurations:
Conf Description
0000 query:PASSTHROUGH; numEvents:10000000
0001 query:CURRENCY_CONVERSION; numEvents:10000000
0002 query:SELECTION; numEvents:10000000
0003 query:LOCAL_ITEM_SUGGESTION; numEvents:10000000
0004 query:AVERAGE_PRICE_FOR_CATEGORY; numEvents:1000000
0005 query:HOT_ITEMS; numEvents:10000000
0006 query:AVERAGE_SELLING_PRICE_BY_SELLER; numEvents:1000000
0007 query:HIGHEST_BID; numEvents:10000000
0008 query:MONITOR_NEW_USERS; numEvents:10000000
0009 query:WINNING_BIDS; numEvents:1000000
0010 query:LOG_TO_SHARDED_FILES; numEvents:10000000
0011 query:USER_SESSIONS; numEvents:10000000
0012 query:PROCESSING_TIME_WINDOWS; numEvents:10000000
0013 query:PORTABILITY_BATCH; numEvents:10000000
0014 query:BOUNDED_SIDE_INPUT_JOIN; numEvents:10000000
0015 query:SESSION_SIDE_INPUT_JOIN; numEvents:10000000
Performance:
Conf Runtime(sec) (Baseline) Events(/sec) (Baseline) Results
(Baseline)
0000 25.8 387702.1 10000000
0001 22.6 442067.1 9200000
0002 11.4 876577.8 83527
0003 *** not run ***
0004 *** not run ***
0005 *** not run ***
0006 *** not run ***
0007 *** not run ***
0008 17.4 573624.7 92833
0009 *** not run ***
0010 *** not run ***
0011 37.1 269251.5 1839657
0012 15.9 630318.3 199929
0013 46.7 213912.9 10000000
0014 *** not run ***
0015 *** not run ***
==========================================================================================
2021-09-20T06:11:57.981Z DONE Query10
==========================================================================================
Run started 2021-09-20T06:05:30.512Z and ran for PT387.498S
Default configuration:
{"debug":true,"query":null,"sourceType":"DIRECT","generateEventFilePathPrefix":null,"sinkType":"DEVNULL","exportSummaryToBigQuery":false,"pubSubMode":"COMBINED","pubsubMessageSerializationMethod":"CODER","sideInputType":"DIRECT","sideInputRowCount":500,"sideInputNumShards":3,"sideInputUrl":null,"sessionGap":600000,"numEvents":100000,"numEventGenerators":100,"rateShape":"SINE","firstEventRate":10000,"nextEventRate":10000,"rateUnit":"PER_SECOND","ratePeriodSec":600,"preloadSeconds":0,"streamTimeout":240,"isRateLimited":false,"useWallclockEventTime":false,"avgPersonByteSize":200,"avgAuctionByteSize":500,"avgBidByteSize":100,"hotAuctionRatio":2,"hotSellersRatio":4,"hotBiddersRatio":4,"windowSizeSec":10,"windowPeriodSec":5,"watermarkHoldbackSec":0,"numInFlightAuctions":100,"numActivePeople":1000,"coderStrategy":"HAND","cpuDelayMs":0,"diskBusyBytes":0,"auctionSkip":123,"fanout":5,"maxAuctionsWaitingTime":600,"occasionalDelaySec":3,"probDelayedEvent":0.1,"maxLogEvents":100000,"usePubsubPublishTime":false,"outOfOrderGroupSize":1,"numKeyBuckets":20000,"pardoCPUFactor":1.0}
Configurations:
Conf Description
0000 query:PASSTHROUGH; numEvents:10000000
0001 query:CURRENCY_CONVERSION; numEvents:10000000
0002 query:SELECTION; numEvents:10000000
0003 query:LOCAL_ITEM_SUGGESTION; numEvents:10000000
0004 query:AVERAGE_PRICE_FOR_CATEGORY; numEvents:1000000
0005 query:HOT_ITEMS; numEvents:10000000
0006 query:AVERAGE_SELLING_PRICE_BY_SELLER; numEvents:1000000
0007 query:HIGHEST_BID; numEvents:10000000
0008 query:MONITOR_NEW_USERS; numEvents:10000000
0009 query:WINNING_BIDS; numEvents:1000000
0010 query:LOG_TO_SHARDED_FILES; numEvents:10000000
0011 query:USER_SESSIONS; numEvents:10000000
0012 query:PROCESSING_TIME_WINDOWS; numEvents:10000000
0013 query:PORTABILITY_BATCH; numEvents:10000000
0014 query:BOUNDED_SIDE_INPUT_JOIN; numEvents:10000000
0015 query:SESSION_SIDE_INPUT_JOIN; numEvents:10000000
Performance:
Conf Runtime(sec) (Baseline) Events(/sec) (Baseline) Results
(Baseline)
0000 25.8 387702.1 10000000
0001 22.6 442067.1 9200000
0002 11.4 876577.8 83527
0003 *** not run ***
0004 *** not run ***
0005 *** not run ***
0006 *** not run ***
0007 *** not run ***
0008 17.4 573624.7 92833
0009 *** not run ***
0010 52.9 189161.1 100
0011 37.1 269251.5 1839657
0012 15.9 630318.3 199929
0013 46.7 213912.9 10000000
0014 *** not run ***
0015 *** not run ***
==========================================================================================
2021-09-20T06:11:58.237Z DONE Query5
==========================================================================================
Run started 2021-09-20T06:05:30.512Z and ran for PT387.752S
Default configuration:
{"debug":true,"query":null,"sourceType":"DIRECT","generateEventFilePathPrefix":null,"sinkType":"DEVNULL","exportSummaryToBigQuery":false,"pubSubMode":"COMBINED","pubsubMessageSerializationMethod":"CODER","sideInputType":"DIRECT","sideInputRowCount":500,"sideInputNumShards":3,"sideInputUrl":null,"sessionGap":600000,"numEvents":100000,"numEventGenerators":100,"rateShape":"SINE","firstEventRate":10000,"nextEventRate":10000,"rateUnit":"PER_SECOND","ratePeriodSec":600,"preloadSeconds":0,"streamTimeout":240,"isRateLimited":false,"useWallclockEventTime":false,"avgPersonByteSize":200,"avgAuctionByteSize":500,"avgBidByteSize":100,"hotAuctionRatio":2,"hotSellersRatio":4,"hotBiddersRatio":4,"windowSizeSec":10,"windowPeriodSec":5,"watermarkHoldbackSec":0,"numInFlightAuctions":100,"numActivePeople":1000,"coderStrategy":"HAND","cpuDelayMs":0,"diskBusyBytes":0,"auctionSkip":123,"fanout":5,"maxAuctionsWaitingTime":600,"occasionalDelaySec":3,"probDelayedEvent":0.1,"maxLogEvents":100000,"usePubsubPublishTime":false,"outOfOrderGroupSize":1,"numKeyBuckets":20000,"pardoCPUFactor":1.0}
Configurations:
Conf Description
0000 query:PASSTHROUGH; numEvents:10000000
0001 query:CURRENCY_CONVERSION; numEvents:10000000
0002 query:SELECTION; numEvents:10000000
0003 query:LOCAL_ITEM_SUGGESTION; numEvents:10000000
0004 query:AVERAGE_PRICE_FOR_CATEGORY; numEvents:1000000
0005 query:HOT_ITEMS; numEvents:10000000
0006 query:AVERAGE_SELLING_PRICE_BY_SELLER; numEvents:1000000
0007 query:HIGHEST_BID; numEvents:10000000
0008 query:MONITOR_NEW_USERS; numEvents:10000000
0009 query:WINNING_BIDS; numEvents:1000000
0010 query:LOG_TO_SHARDED_FILES; numEvents:10000000
0011 query:USER_SESSIONS; numEvents:10000000
0012 query:PROCESSING_TIME_WINDOWS; numEvents:10000000
0013 query:PORTABILITY_BATCH; numEvents:10000000
0014 query:BOUNDED_SIDE_INPUT_JOIN; numEvents:10000000
0015 query:SESSION_SIDE_INPUT_JOIN; numEvents:10000000
Performance:
Conf Runtime(sec) (Baseline) Events(/sec) (Baseline) Results
(Baseline)
0000 25.8 387702.1 10000000
0001 22.6 442067.1 9200000
0002 11.4 876577.8 83527
0003 *** not run ***
0004 *** not run ***
0005 29.0 344720.6 4567
0006 *** not run ***
0007 *** not run ***
0008 17.4 573624.7 92833
0009 *** not run ***
0010 52.9 189161.1 100
0011 37.1 269251.5 1839657
0012 15.9 630318.3 199929
0013 46.7 213912.9 10000000
0014 *** not run ***
0015 *** not run ***
==========================================================================================
==========================================================================================
Run started 2021-09-20T06:05:30.512Z and ran for PT388.015S
Default configuration:
{"debug":true,"query":null,"sourceType":"DIRECT","generateEventFilePathPrefix":null,"sinkType":"DEVNULL","exportSummaryToBigQuery":false,"pubSubMode":"COMBINED","pubsubMessageSerializationMethod":"CODER","sideInputType":"DIRECT","sideInputRowCount":500,"sideInputNumShards":3,"sideInputUrl":null,"sessionGap":600000,"numEvents":100000,"numEventGenerators":100,"rateShape":"SINE","firstEventRate":10000,"nextEventRate":10000,"rateUnit":"PER_SECOND","ratePeriodSec":600,"preloadSeconds":0,"streamTimeout":240,"isRateLimited":false,"useWallclockEventTime":false,"avgPersonByteSize":200,"avgAuctionByteSize":500,"avgBidByteSize":100,"hotAuctionRatio":2,"hotSellersRatio":4,"hotBiddersRatio":4,"windowSizeSec":10,"windowPeriodSec":5,"watermarkHoldbackSec":0,"numInFlightAuctions":100,"numActivePeople":1000,"coderStrategy":"HAND","cpuDelayMs":0,"diskBusyBytes":0,"auctionSkip":123,"fanout":5,"maxAuctionsWaitingTime":600,"occasionalDelaySec":3,"probDelayedEvent":0.1,"maxLogEvents":100000,"usePubsubPublishTime":false,"outOfOrderGroupSize":1,"numKeyBuckets":20000,"pardoCPUFactor":1.0}
Configurations:
Conf Description
0000 query:PASSTHROUGH; numEvents:10000000
0001 query:CURRENCY_CONVERSION; numEvents:10000000
0002 query:SELECTION; numEvents:10000000
0003 query:LOCAL_ITEM_SUGGESTION; numEvents:10000000
0004 query:AVERAGE_PRICE_FOR_CATEGORY; numEvents:1000000
0005 query:HOT_ITEMS; numEvents:10000000
0006 query:AVERAGE_SELLING_PRICE_BY_SELLER; numEvents:1000000
0007 query:HIGHEST_BID; numEvents:10000000
0008 query:MONITOR_NEW_USERS; numEvents:10000000
0009 query:WINNING_BIDS; numEvents:1000000
0010 query:LOG_TO_SHARDED_FILES; numEvents:10000000
0011 query:USER_SESSIONS; numEvents:10000000
0012 query:PROCESSING_TIME_WINDOWS; numEvents:10000000
0013 query:PORTABILITY_BATCH; numEvents:10000000
0014 query:BOUNDED_SIDE_INPUT_JOIN; numEvents:10000000
0015 query:SESSION_SIDE_INPUT_JOIN; numEvents:10000000
Performance:
Conf Runtime(sec) (Baseline) Events(/sec) (Baseline) Results
(Baseline)
0000 25.8 387702.1 10000000
0001 22.6 442067.1 9200000
0002 11.4 876577.8 83527
0003 *** not run ***
0004 *** not run ***
0005 29.0 344720.6 4567
0006 *** not run ***
0007 *** not run ***
0008 17.4 573624.7 92833
0009 *** not run ***
0010 52.9 189161.1 100
0011 37.1 269251.5 1839657
0012 15.9 630318.3 199929
0013 46.7 213912.9 10000000
0014 *** not run ***
0015 *** not run ***
==========================================================================================
> Task :runners:google-cloud-dataflow-java:cleanUpDockerImages
Untagged: us.gcr.io/apache-beam-testing/java-postcommit-it/java:20210920060115
Untagged:
us.gcr.io/apache-beam-testing/java-postcommit-it/java@sha256:140a9e517c720fe78052ec02a9da2db3c16da749f2775b0bbd1514a0d0066b0f
Deleted: sha256:757d58197f308498a7403183a476fadd5162baa794b3163096e06c0d1ae7f6a8
Deleted: sha256:c8745bf1fed3420ad7a90c175daf7830c5e9e9137f8353f12587a0c149412060
Deleted: sha256:6d027d8511d72a5725855376a115fdf2b530460a40180dd3bdee828e82eada40
Deleted: sha256:bce0c4d4597747e85180fc03100852827478ecf6a2ebba9a3079011d47125ae0
Deleted: sha256:c652cc1ba356291953be2bd84ee46272465f4273a4391bf6af54a039c9cbae61
Deleted: sha256:55cb14213c97638ab44a22727cd6911149651b4cc282d32b5d2eb37beeab483e
Deleted: sha256:fff4d553c117043116d84008a293f609d1c24601af2f4e7adc92842842434ff1
Deleted: sha256:d8d0bb0f1e931d4e62e24f36193b7e4daf3381aba6a1667cbb9934d2f8800097
Deleted: sha256:935ecd7ebf8a8c5ffc5a75e8140cad0354d3ce9d6e418616afc6d7dbcf2593f2
Deleted: sha256:c7fac1db61c972aecdf43914ecec814981f1c76bd0739a494c1a50a6cf2061d7
Deleted: sha256:c8de20dc723fb2176763e2518d3f419b1adff57a0c8c97fcc32fb1b0059d71d1
Deleted: sha256:a1618da14a5fda290e7142de4bcb8881e9e9a31bcc2d44a010b044051f751653
Deleted: sha256:0d78a80f257743286aaede483109c3b2adc8de01a68f2f702ce59ef60df9873a
Deleted: sha256:cba783331a4c73db7f9a6115be927bdbce6e6930d7116f80d97b387bf547bf41
Deleted: sha256:038d3e887ca31575e13423587b140c2ab237feae9e4bfcdc70920ace0c221dc3
Deleted: sha256:6e0e40b4160877f739e352124615c1db239b8cfd70dd2e3b17d90b9794e2162c
Deleted: sha256:3c9299f80f8b001c3046bcc9c8c6c77bc7e56e83943abe2899a4e1155824f898
Deleted: sha256:21555f13b944653d2431749baa0b7ae19617c80e07cb7661a31141c25b89c45c
Deleted: sha256:7e53b9354688c78710c63aadd70ce773ee84e1324e9031c6e20e5e63a3fa78fe
Deleted: sha256:813a4b8f68d5b2d0b467d53a8ad2352e5943730ed33c8db9a94f4c5beb69852a
Deleted: sha256:cbab55babb91bba2e3f701b35268e72caaed3a5b94d3523679e82b25c4c75512
Deleted: sha256:cfc84d147b06dd070683410247f07b5b042d0a365a5dbad717b82b722dd3cd2a
Deleted: sha256:73d0407f24919e5e18976932ab874ad9a51196ea44947eee7b2b55701532a85b
Deleted: sha256:0dd4470c626aba03c5b85e9ae02166c1a1f8f171968cce1394f4b0babfe23a8d
Deleted: sha256:1078e41402a2ae768e1437d40cb3f5667e92b0c5ce2b5755d2d726e15a8d3a79
Deleted: sha256:f97e17c32fd3a85cfbe85095818843ba23b8cca2666b2607b48eb932b155a9c4
Deleted: sha256:a020c374d2b77456625110d9daeed7c6443fd1291786490aa40ac8d1f649ff79
Deleted: sha256:4ec013cc908833a45925646ed28e5688a798e6c8178c258b752d2abb9a401697
ERROR: (gcloud.container.images.untag) Image could not be found:
[us.gcr.io/apache-beam-testing/java-postcommit-it/java:20210920060115]
> Task :runners:google-cloud-dataflow-java:cleanUpDockerImages FAILED
FAILURE: Build failed with an exception.
* Where:
Build file
'<https://ci-beam.apache.org/job/beam_PostCommit_Java_Nexmark_Dataflow_V2/ws/src/runners/google-cloud-dataflow-java/build.gradle'>
line: 279
* What went wrong:
Execution failed for task
':runners:google-cloud-dataflow-java:cleanUpDockerImages'.
> Process 'command 'gcloud'' finished with non-zero exit value 1
* Try:
Run with --stacktrace option to get the stack trace. Run with --info or --debug
option to get more log output. Run with --scan to get full insights.
* Get more help at https://help.gradle.org
Deprecated Gradle features were used in this build, making it incompatible with
Gradle 7.0.
Use '--warning-mode all' to show the individual deprecation warnings.
See
https://docs.gradle.org/6.9.1/userguide/command_line_interface.html#sec:command_line_warnings
BUILD FAILED in 11m 22s
128 actionable tasks: 89 executed, 37 from cache, 2 up-to-date
Publishing build scan...
https://gradle.com/s/dfgkq7es7l2oy
Build step 'Invoke Gradle script' changed build result to FAILURE
Build step 'Invoke Gradle script' marked build as failure
---------------------------------------------------------------------
To unsubscribe, e-mail: [email protected]
For additional commands, e-mail: [email protected]
