See
<https://ci-beam.apache.org/job/beam_PostCommit_Java_Nexmark_Dataflow_V2_Java17/15/display/redirect>
Changes:
------------------------------------------
[...truncated 252.44 KB...]
2021-12-20T06:13:06.098Z DONE Query11
==========================================================================================
Run started 2021-12-20T06:06:37.101Z and ran for PT389.025S
Default configuration:
{"debug":true,"query":null,"sourceType":"DIRECT","generateEventFilePathPrefix":null,"sinkType":"DEVNULL","exportSummaryToBigQuery":false,"pubSubMode":"COMBINED","pubsubMessageSerializationMethod":"CODER","sideInputType":"DIRECT","sideInputRowCount":500,"sideInputNumShards":3,"sideInputUrl":null,"sessionGap":600000,"numEvents":100000,"numEventGenerators":100,"rateShape":"SINE","firstEventRate":10000,"nextEventRate":10000,"rateUnit":"PER_SECOND","ratePeriodSec":600,"preloadSeconds":0,"streamTimeout":240,"isRateLimited":false,"useWallclockEventTime":false,"avgPersonByteSize":200,"avgAuctionByteSize":500,"avgBidByteSize":100,"hotAuctionRatio":2,"hotSellersRatio":4,"hotBiddersRatio":4,"windowSizeSec":10,"windowPeriodSec":5,"watermarkHoldbackSec":0,"numInFlightAuctions":100,"numActivePeople":1000,"coderStrategy":"HAND","cpuDelayMs":0,"diskBusyBytes":0,"auctionSkip":123,"fanout":5,"maxAuctionsWaitingTime":600,"occasionalDelaySec":3,"probDelayedEvent":0.1,"maxLogEvents":100000,"usePubsubPublishTime":false,"outOfOrderGroupSize":1,"numKeyBuckets":20000,"pardoCPUFactor":1.0}
Configurations:
Conf Description
0000 query:PASSTHROUGH; numEvents:10000000
0001 query:CURRENCY_CONVERSION; numEvents:10000000
0002 query:SELECTION; numEvents:10000000
0003 query:LOCAL_ITEM_SUGGESTION; numEvents:10000000
0004 query:AVERAGE_PRICE_FOR_CATEGORY; numEvents:1000000
0005 query:HOT_ITEMS; numEvents:10000000
0006 query:AVERAGE_SELLING_PRICE_BY_SELLER; numEvents:1000000
0007 query:HIGHEST_BID; numEvents:10000000
0008 query:MONITOR_NEW_USERS; numEvents:10000000
0009 query:WINNING_BIDS; numEvents:1000000
0010 query:LOG_TO_SHARDED_FILES; numEvents:10000000
0011 query:USER_SESSIONS; numEvents:10000000
0012 query:PROCESSING_TIME_WINDOWS; numEvents:10000000
0013 query:PORTABILITY_BATCH; numEvents:10000000
0014 query:BOUNDED_SIDE_INPUT_JOIN; numEvents:10000000
0015 query:SESSION_SIDE_INPUT_JOIN; numEvents:10000000
Performance:
Conf Runtime(sec) (Baseline) Events(/sec) (Baseline) Results
(Baseline)
0000 23.9 419058.8 10000000
0001 16.0 625234.5 9200000
0002 14.3 697204.2 83527
0003 *** not run ***
0004 *** not run ***
0005 *** not run ***
0006 *** not run ***
0007 *** not run ***
0008 18.6 538039.4 92833
0009 *** not run ***
0010 *** not run ***
0011 40.6 246487.6 1839657
0012 14.0 716537.7 199929
0013 43.9 227723.0 10000000
0014 *** not run ***
0015 *** not run ***
==========================================================================================
2021-12-20T06:13:06.555Z RUNNING Query10
2021-12-20T06:13:07.129Z DONE Query5
==========================================================================================
Run started 2021-12-20T06:06:37.101Z and ran for PT390.059S
Default configuration:
{"debug":true,"query":null,"sourceType":"DIRECT","generateEventFilePathPrefix":null,"sinkType":"DEVNULL","exportSummaryToBigQuery":false,"pubSubMode":"COMBINED","pubsubMessageSerializationMethod":"CODER","sideInputType":"DIRECT","sideInputRowCount":500,"sideInputNumShards":3,"sideInputUrl":null,"sessionGap":600000,"numEvents":100000,"numEventGenerators":100,"rateShape":"SINE","firstEventRate":10000,"nextEventRate":10000,"rateUnit":"PER_SECOND","ratePeriodSec":600,"preloadSeconds":0,"streamTimeout":240,"isRateLimited":false,"useWallclockEventTime":false,"avgPersonByteSize":200,"avgAuctionByteSize":500,"avgBidByteSize":100,"hotAuctionRatio":2,"hotSellersRatio":4,"hotBiddersRatio":4,"windowSizeSec":10,"windowPeriodSec":5,"watermarkHoldbackSec":0,"numInFlightAuctions":100,"numActivePeople":1000,"coderStrategy":"HAND","cpuDelayMs":0,"diskBusyBytes":0,"auctionSkip":123,"fanout":5,"maxAuctionsWaitingTime":600,"occasionalDelaySec":3,"probDelayedEvent":0.1,"maxLogEvents":100000,"usePubsubPublishTime":false,"outOfOrderGroupSize":1,"numKeyBuckets":20000,"pardoCPUFactor":1.0}
Configurations:
Conf Description
0000 query:PASSTHROUGH; numEvents:10000000
0001 query:CURRENCY_CONVERSION; numEvents:10000000
0002 query:SELECTION; numEvents:10000000
0003 query:LOCAL_ITEM_SUGGESTION; numEvents:10000000
0004 query:AVERAGE_PRICE_FOR_CATEGORY; numEvents:1000000
0005 query:HOT_ITEMS; numEvents:10000000
0006 query:AVERAGE_SELLING_PRICE_BY_SELLER; numEvents:1000000
0007 query:HIGHEST_BID; numEvents:10000000
0008 query:MONITOR_NEW_USERS; numEvents:10000000
0009 query:WINNING_BIDS; numEvents:1000000
0010 query:LOG_TO_SHARDED_FILES; numEvents:10000000
0011 query:USER_SESSIONS; numEvents:10000000
0012 query:PROCESSING_TIME_WINDOWS; numEvents:10000000
0013 query:PORTABILITY_BATCH; numEvents:10000000
0014 query:BOUNDED_SIDE_INPUT_JOIN; numEvents:10000000
0015 query:SESSION_SIDE_INPUT_JOIN; numEvents:10000000
Performance:
Conf Runtime(sec) (Baseline) Events(/sec) (Baseline) Results
(Baseline)
0000 23.9 419058.8 10000000
0001 16.0 625234.5 9200000
0002 14.3 697204.2 83527
0003 *** not run ***
0004 *** not run ***
0005 35.4 282310.4 4567
0006 *** not run ***
0007 *** not run ***
0008 18.6 538039.4 92833
0009 *** not run ***
0010 *** not run ***
0011 40.6 246487.6 1839657
0012 14.0 716537.7 199929
0013 43.9 227723.0 10000000
0014 *** not run ***
0015 *** not run ***
==========================================================================================
2021-12-20T06:13:07.923Z no activity
2021-12-20T06:13:22.955Z DONE Query10
==========================================================================================
Run started 2021-12-20T06:06:37.101Z and ran for PT405.884S
Default configuration:
{"debug":true,"query":null,"sourceType":"DIRECT","generateEventFilePathPrefix":null,"sinkType":"DEVNULL","exportSummaryToBigQuery":false,"pubSubMode":"COMBINED","pubsubMessageSerializationMethod":"CODER","sideInputType":"DIRECT","sideInputRowCount":500,"sideInputNumShards":3,"sideInputUrl":null,"sessionGap":600000,"numEvents":100000,"numEventGenerators":100,"rateShape":"SINE","firstEventRate":10000,"nextEventRate":10000,"rateUnit":"PER_SECOND","ratePeriodSec":600,"preloadSeconds":0,"streamTimeout":240,"isRateLimited":false,"useWallclockEventTime":false,"avgPersonByteSize":200,"avgAuctionByteSize":500,"avgBidByteSize":100,"hotAuctionRatio":2,"hotSellersRatio":4,"hotBiddersRatio":4,"windowSizeSec":10,"windowPeriodSec":5,"watermarkHoldbackSec":0,"numInFlightAuctions":100,"numActivePeople":1000,"coderStrategy":"HAND","cpuDelayMs":0,"diskBusyBytes":0,"auctionSkip":123,"fanout":5,"maxAuctionsWaitingTime":600,"occasionalDelaySec":3,"probDelayedEvent":0.1,"maxLogEvents":100000,"usePubsubPublishTime":false,"outOfOrderGroupSize":1,"numKeyBuckets":20000,"pardoCPUFactor":1.0}
Configurations:
Conf Description
0000 query:PASSTHROUGH; numEvents:10000000
0001 query:CURRENCY_CONVERSION; numEvents:10000000
0002 query:SELECTION; numEvents:10000000
0003 query:LOCAL_ITEM_SUGGESTION; numEvents:10000000
0004 query:AVERAGE_PRICE_FOR_CATEGORY; numEvents:1000000
0005 query:HOT_ITEMS; numEvents:10000000
0006 query:AVERAGE_SELLING_PRICE_BY_SELLER; numEvents:1000000
0007 query:HIGHEST_BID; numEvents:10000000
0008 query:MONITOR_NEW_USERS; numEvents:10000000
0009 query:WINNING_BIDS; numEvents:1000000
0010 query:LOG_TO_SHARDED_FILES; numEvents:10000000
0011 query:USER_SESSIONS; numEvents:10000000
0012 query:PROCESSING_TIME_WINDOWS; numEvents:10000000
0013 query:PORTABILITY_BATCH; numEvents:10000000
0014 query:BOUNDED_SIDE_INPUT_JOIN; numEvents:10000000
0015 query:SESSION_SIDE_INPUT_JOIN; numEvents:10000000
Performance:
Conf Runtime(sec) (Baseline) Events(/sec) (Baseline) Results
(Baseline)
0000 23.9 419058.8 10000000
0001 16.0 625234.5 9200000
0002 14.3 697204.2 83527
0003 *** not run ***
0004 *** not run ***
0005 35.4 282310.4 4567
0006 *** not run ***
0007 *** not run ***
0008 18.6 538039.4 92833
0009 *** not run ***
0010 52.5 190414.5 100
0011 40.6 246487.6 1839657
0012 14.0 716537.7 199929
0013 43.9 227723.0 10000000
0014 *** not run ***
0015 *** not run ***
==========================================================================================
==========================================================================================
Run started 2021-12-20T06:06:37.101Z and ran for PT406.138S
Default configuration:
{"debug":true,"query":null,"sourceType":"DIRECT","generateEventFilePathPrefix":null,"sinkType":"DEVNULL","exportSummaryToBigQuery":false,"pubSubMode":"COMBINED","pubsubMessageSerializationMethod":"CODER","sideInputType":"DIRECT","sideInputRowCount":500,"sideInputNumShards":3,"sideInputUrl":null,"sessionGap":600000,"numEvents":100000,"numEventGenerators":100,"rateShape":"SINE","firstEventRate":10000,"nextEventRate":10000,"rateUnit":"PER_SECOND","ratePeriodSec":600,"preloadSeconds":0,"streamTimeout":240,"isRateLimited":false,"useWallclockEventTime":false,"avgPersonByteSize":200,"avgAuctionByteSize":500,"avgBidByteSize":100,"hotAuctionRatio":2,"hotSellersRatio":4,"hotBiddersRatio":4,"windowSizeSec":10,"windowPeriodSec":5,"watermarkHoldbackSec":0,"numInFlightAuctions":100,"numActivePeople":1000,"coderStrategy":"HAND","cpuDelayMs":0,"diskBusyBytes":0,"auctionSkip":123,"fanout":5,"maxAuctionsWaitingTime":600,"occasionalDelaySec":3,"probDelayedEvent":0.1,"maxLogEvents":100000,"usePubsubPublishTime":false,"outOfOrderGroupSize":1,"numKeyBuckets":20000,"pardoCPUFactor":1.0}
Configurations:
Conf Description
0000 query:PASSTHROUGH; numEvents:10000000
0001 query:CURRENCY_CONVERSION; numEvents:10000000
0002 query:SELECTION; numEvents:10000000
0003 query:LOCAL_ITEM_SUGGESTION; numEvents:10000000
0004 query:AVERAGE_PRICE_FOR_CATEGORY; numEvents:1000000
0005 query:HOT_ITEMS; numEvents:10000000
0006 query:AVERAGE_SELLING_PRICE_BY_SELLER; numEvents:1000000
0007 query:HIGHEST_BID; numEvents:10000000
0008 query:MONITOR_NEW_USERS; numEvents:10000000
0009 query:WINNING_BIDS; numEvents:1000000
0010 query:LOG_TO_SHARDED_FILES; numEvents:10000000
0011 query:USER_SESSIONS; numEvents:10000000
0012 query:PROCESSING_TIME_WINDOWS; numEvents:10000000
0013 query:PORTABILITY_BATCH; numEvents:10000000
0014 query:BOUNDED_SIDE_INPUT_JOIN; numEvents:10000000
0015 query:SESSION_SIDE_INPUT_JOIN; numEvents:10000000
Performance:
Conf Runtime(sec) (Baseline) Events(/sec) (Baseline) Results
(Baseline)
0000 23.9 419058.8 10000000
0001 16.0 625234.5 9200000
0002 14.3 697204.2 83527
0003 *** not run ***
0004 *** not run ***
0005 35.4 282310.4 4567
0006 *** not run ***
0007 *** not run ***
0008 18.6 538039.4 92833
0009 *** not run ***
0010 52.5 190414.5 100
0011 40.6 246487.6 1839657
0012 14.0 716537.7 199929
0013 43.9 227723.0 10000000
0014 *** not run ***
0015 *** not run ***
==========================================================================================
> Task :runners:google-cloud-dataflow-java:cleanUpDockerImages FAILED
Untagged: us.gcr.io/apache-beam-testing/java-postcommit-it/java:20211220060119
Untagged:
us.gcr.io/apache-beam-testing/java-postcommit-it/java@sha256:9636eb0c1def48f79b18718d6fa329527dad533b4698275c2246f52841312edc
Deleted: sha256:619ab957687246c37cd0147195cff797031e1975a7d15e26a13391ee3d22b0a3
Deleted: sha256:11d1c37c40585a2d1865230e4c4d9d36316fab79e2e368ca16f9b5220394f745
Deleted: sha256:82fbd8ad0b33c0fe337b52e0dc58dc414d4238a3e5992e82f5df84116bf478be
Deleted: sha256:fe54238ed6c563e29738a7674f155fcf491354f84eace6181b72c00deec27cce
Deleted: sha256:ca3189e51791d0f18e607733eaf54d03ff818f812d675fc3f582d34e5a5ec7eb
Deleted: sha256:f41306da3a1685695616a4507d50f1b0e13b7061a3f149752391b6689cb2c858
Deleted: sha256:11912a709b03889001b3e88227f23e49f45e5dd0144a6655af733a4c140a0817
Deleted: sha256:0f853bb6a1ab7f2a6e7f8e0b2e7fdbe31e0cc51d1e8d84a3122a6fd0f1ab9867
Deleted: sha256:c231431ddf437816a81468e10961ce3996309b7d6dda9b8ff16fde7ba94519dc
Deleted: sha256:807a7a17079d1acaf17dfd6530d82857958b583e67cb9704fecc35f54575d12e
Deleted: sha256:9ff6a6685e3672fa02b9d79be4977f8d4ad7fa72f621c58b23663c3b19ef1d66
Deleted: sha256:50701401a995866fe59caf5acad3be0c1d7ed06fa0f41a7feb772dc900fba08d
Deleted: sha256:d38d3039da2615604d535730c0f0307c0e83bfaf3861ce2598f75cdc4b9bd2d5
Deleted: sha256:7a6030fefa3b72fa4e6329a6ee5a2492c699fc7daf3356de180e0fb5ea60ef3c
Deleted: sha256:3f92da29ba1b03542f3ccb0da97b35c34a9160d1e26e921f97d0f1ed5eb6314f
Deleted: sha256:c8b9a9411e41035efb44e36e67745b601b248aded7cba3245782c3843e838e6e
Deleted: sha256:2a9ed0ab9d61fc0466f4f3bb0a42b209cdb5bafede70431af46ccc08fd2272d2
Deleted: sha256:657fa3d624ab9a6b334d91e20400468f16bc7bb08c3ed7a8fd58dab45843e02f
Deleted: sha256:9f4b6b26cf497e5a2483dd2a65fcab01d491b656908bc45ae0604d25a2e92515
Deleted: sha256:990bbecbabb7201d0edd6796e3673db84afefdce9a4b0df880a4ed424215bca8
Deleted: sha256:0ac1b43ff78b5ee2dfa5f140a4bacb9cee44a7ff4c423384b2842d0a90bda972
Deleted: sha256:7181a245c970ae9d916e865e1ed9ab2c4ef976d9ab5390f031b10fac89422bf9
Deleted: sha256:03a57295197b759b7f4c71b36fc3bc5059d57ea75e6f7c364c80b4cb5eabfcc2
Deleted: sha256:68d682304f4256cec4add320ff00178bee48686739efef5d2ff8f255d980b903
Deleted: sha256:e2a028f342d8c33789d49dc1710976ea69dcfa7f2133a23d3db1156c75d23389
Deleted: sha256:359a514f457834a57f53f38f18b906818dade352e02608d0b236be26bb61d834
Deleted: sha256:cbb45f7d61b858771f64eadc89303c60f9d91f2c320b070b305ad1cd32504199
Deleted: sha256:834beee1e7c77a51885defe02d6f47775cda1d364772ee198ad632992e7dbdb3
ERROR: (gcloud.container.images.untag) Image could not be found:
[us.gcr.io/apache-beam-testing/java-postcommit-it/java:20211220060119]
FAILURE: Build failed with an exception.
* Where:
Build file
'<https://ci-beam.apache.org/job/beam_PostCommit_Java_Nexmark_Dataflow_V2_Java17/ws/src/runners/google-cloud-dataflow-java/build.gradle'>
line: 278
* What went wrong:
Execution failed for task
':runners:google-cloud-dataflow-java:cleanUpDockerImages'.
> Process 'command 'gcloud'' finished with non-zero exit value 1
* Try:
Run with --stacktrace option to get the stack trace. Run with --info or --debug
option to get more log output. Run with --scan to get full insights.
* Get more help at https://help.gradle.org
Deprecated Gradle features were used in this build, making it incompatible with
Gradle 7.0.
Use '--warning-mode all' to show the individual deprecation warnings.
See
https://docs.gradle.org/6.9.1/userguide/command_line_interface.html#sec:command_line_warnings
BUILD FAILED in 12m 52s
128 actionable tasks: 89 executed, 37 from cache, 2 up-to-date
Publishing build scan...
https://gradle.com/s/xb2ket4xorzee
Build step 'Invoke Gradle script' changed build result to FAILURE
Build step 'Invoke Gradle script' marked build as failure
---------------------------------------------------------------------
To unsubscribe, e-mail: [email protected]
For additional commands, e-mail: [email protected]
