See
<https://ci-beam.apache.org/job/beam_PostCommit_Java_Nexmark_Dataflow_V2/315/display/redirect>
Changes:
------------------------------------------
[...truncated 271.33 KB...]
0001 query:CURRENCY_CONVERSION; numEvents:10000000
0002 query:SELECTION; numEvents:10000000
0003 query:LOCAL_ITEM_SUGGESTION; numEvents:10000000
0004 query:AVERAGE_PRICE_FOR_CATEGORY; numEvents:1000000
0005 query:HOT_ITEMS; numEvents:10000000
0006 query:AVERAGE_SELLING_PRICE_BY_SELLER; numEvents:1000000
0007 query:HIGHEST_BID; numEvents:10000000
0008 query:MONITOR_NEW_USERS; numEvents:10000000
0009 query:WINNING_BIDS; numEvents:1000000
0010 query:LOG_TO_SHARDED_FILES; numEvents:10000000
0011 query:USER_SESSIONS; numEvents:10000000
0012 query:PROCESSING_TIME_WINDOWS; numEvents:10000000
0013 query:PORTABILITY_BATCH; numEvents:10000000
0014 query:BOUNDED_SIDE_INPUT_JOIN; numEvents:10000000
0015 query:SESSION_SIDE_INPUT_JOIN; numEvents:10000000
Performance:
Conf Runtime(sec) (Baseline) Events(/sec) (Baseline) Results
(Baseline)
0000 32.9 303739.0 10000000
0001 25.8 387581.9 9200000
0002 17.4 575473.3 83527
0003 *** not run ***
0004 *** not run ***
0005 38.9 257201.6 4567
0006 *** not run ***
0007 *** not run ***
0008 24.9 401961.6 92833
0009 *** not run ***
0010 57.1 175223.4 100
0011 *** not run ***
0012 *** not run ***
0013 62.3 160433.8 10000000
0014 *** not run ***
0015 *** not run ***
==========================================================================================
==========================================================================================
Run started 2021-08-11T06:11:32.569Z and ran for PT359.027S
Default configuration:
{"debug":true,"query":null,"sourceType":"DIRECT","generateEventFilePathPrefix":null,"sinkType":"DEVNULL","exportSummaryToBigQuery":false,"pubSubMode":"COMBINED","pubsubMessageSerializationMethod":"CODER","sideInputType":"DIRECT","sideInputRowCount":500,"sideInputNumShards":3,"sideInputUrl":null,"sessionGap":600000,"numEvents":100000,"numEventGenerators":100,"rateShape":"SINE","firstEventRate":10000,"nextEventRate":10000,"rateUnit":"PER_SECOND","ratePeriodSec":600,"preloadSeconds":0,"streamTimeout":240,"isRateLimited":false,"useWallclockEventTime":false,"avgPersonByteSize":200,"avgAuctionByteSize":500,"avgBidByteSize":100,"hotAuctionRatio":2,"hotSellersRatio":4,"hotBiddersRatio":4,"windowSizeSec":10,"windowPeriodSec":5,"watermarkHoldbackSec":0,"numInFlightAuctions":100,"numActivePeople":1000,"coderStrategy":"HAND","cpuDelayMs":0,"diskBusyBytes":0,"auctionSkip":123,"fanout":5,"maxAuctionsWaitingTime":600,"occasionalDelaySec":3,"probDelayedEvent":0.1,"maxLogEvents":100000,"usePubsubPublishTime":false,"outOfOrderGroupSize":1,"numKeyBuckets":20000,"pardoCPUFactor":1.0}
Configurations:
Conf Description
0000 query:PASSTHROUGH; numEvents:10000000
0001 query:CURRENCY_CONVERSION; numEvents:10000000
0002 query:SELECTION; numEvents:10000000
0003 query:LOCAL_ITEM_SUGGESTION; numEvents:10000000
0004 query:AVERAGE_PRICE_FOR_CATEGORY; numEvents:1000000
0005 query:HOT_ITEMS; numEvents:10000000
0006 query:AVERAGE_SELLING_PRICE_BY_SELLER; numEvents:1000000
0007 query:HIGHEST_BID; numEvents:10000000
0008 query:MONITOR_NEW_USERS; numEvents:10000000
0009 query:WINNING_BIDS; numEvents:1000000
0010 query:LOG_TO_SHARDED_FILES; numEvents:10000000
0011 query:USER_SESSIONS; numEvents:10000000
0012 query:PROCESSING_TIME_WINDOWS; numEvents:10000000
0013 query:PORTABILITY_BATCH; numEvents:10000000
0014 query:BOUNDED_SIDE_INPUT_JOIN; numEvents:10000000
0015 query:SESSION_SIDE_INPUT_JOIN; numEvents:10000000
Performance:
Conf Runtime(sec) (Baseline) Events(/sec) (Baseline) Results
(Baseline)
0000 32.9 303739.0 10000000
0001 25.8 387581.9 9200000
0002 17.4 575473.3 83527
0003 *** not run ***
0004 *** not run ***
0005 38.9 257201.6 4567
0006 *** not run ***
0007 *** not run ***
0008 24.9 401961.6 92833
0009 *** not run ***
0010 57.1 175223.4 100
0011 *** not run ***
0012 24.9 402220.3 199929
0013 62.3 160433.8 10000000
0014 *** not run ***
0015 *** not run ***
==========================================================================================
2021-08-11T06:17:31.603Z DONE Query11
==========================================================================================
Run started 2021-08-11T06:11:32.569Z and ran for PT359.080S
Default configuration:
{"debug":true,"query":null,"sourceType":"DIRECT","generateEventFilePathPrefix":null,"sinkType":"DEVNULL","exportSummaryToBigQuery":false,"pubSubMode":"COMBINED","pubsubMessageSerializationMethod":"CODER","sideInputType":"DIRECT","sideInputRowCount":500,"sideInputNumShards":3,"sideInputUrl":null,"sessionGap":600000,"numEvents":100000,"numEventGenerators":100,"rateShape":"SINE","firstEventRate":10000,"nextEventRate":10000,"rateUnit":"PER_SECOND","ratePeriodSec":600,"preloadSeconds":0,"streamTimeout":240,"isRateLimited":false,"useWallclockEventTime":false,"avgPersonByteSize":200,"avgAuctionByteSize":500,"avgBidByteSize":100,"hotAuctionRatio":2,"hotSellersRatio":4,"hotBiddersRatio":4,"windowSizeSec":10,"windowPeriodSec":5,"watermarkHoldbackSec":0,"numInFlightAuctions":100,"numActivePeople":1000,"coderStrategy":"HAND","cpuDelayMs":0,"diskBusyBytes":0,"auctionSkip":123,"fanout":5,"maxAuctionsWaitingTime":600,"occasionalDelaySec":3,"probDelayedEvent":0.1,"maxLogEvents":100000,"usePubsubPublishTime":false,"outOfOrderGroupSize":1,"numKeyBuckets":20000,"pardoCPUFactor":1.0}
Configurations:
Conf Description
0000 query:PASSTHROUGH; numEvents:10000000
0001 query:CURRENCY_CONVERSION; numEvents:10000000
0002 query:SELECTION; numEvents:10000000
0003 query:LOCAL_ITEM_SUGGESTION; numEvents:10000000
0004 query:AVERAGE_PRICE_FOR_CATEGORY; numEvents:1000000
0005 query:HOT_ITEMS; numEvents:10000000
0006 query:AVERAGE_SELLING_PRICE_BY_SELLER; numEvents:1000000
0007 query:HIGHEST_BID; numEvents:10000000
0008 query:MONITOR_NEW_USERS; numEvents:10000000
0009 query:WINNING_BIDS; numEvents:1000000
0010 query:LOG_TO_SHARDED_FILES; numEvents:10000000
0011 query:USER_SESSIONS; numEvents:10000000
0012 query:PROCESSING_TIME_WINDOWS; numEvents:10000000
0013 query:PORTABILITY_BATCH; numEvents:10000000
0014 query:BOUNDED_SIDE_INPUT_JOIN; numEvents:10000000
0015 query:SESSION_SIDE_INPUT_JOIN; numEvents:10000000
Performance:
Conf Runtime(sec) (Baseline) Events(/sec) (Baseline) Results
(Baseline)
0000 32.9 303739.0 10000000
0001 25.8 387581.9 9200000
0002 17.4 575473.3 83527
0003 *** not run ***
0004 *** not run ***
0005 38.9 257201.6 4567
0006 *** not run ***
0007 *** not run ***
0008 24.9 401961.6 92833
0009 *** not run ***
0010 57.1 175223.4 100
0011 43.5 229906.2 1839657
0012 24.9 402220.3 199929
0013 62.3 160433.8 10000000
0014 *** not run ***
0015 *** not run ***
==========================================================================================
==========================================================================================
Run started 2021-08-11T06:11:32.569Z and ran for PT359.579S
Default configuration:
{"debug":true,"query":null,"sourceType":"DIRECT","generateEventFilePathPrefix":null,"sinkType":"DEVNULL","exportSummaryToBigQuery":false,"pubSubMode":"COMBINED","pubsubMessageSerializationMethod":"CODER","sideInputType":"DIRECT","sideInputRowCount":500,"sideInputNumShards":3,"sideInputUrl":null,"sessionGap":600000,"numEvents":100000,"numEventGenerators":100,"rateShape":"SINE","firstEventRate":10000,"nextEventRate":10000,"rateUnit":"PER_SECOND","ratePeriodSec":600,"preloadSeconds":0,"streamTimeout":240,"isRateLimited":false,"useWallclockEventTime":false,"avgPersonByteSize":200,"avgAuctionByteSize":500,"avgBidByteSize":100,"hotAuctionRatio":2,"hotSellersRatio":4,"hotBiddersRatio":4,"windowSizeSec":10,"windowPeriodSec":5,"watermarkHoldbackSec":0,"numInFlightAuctions":100,"numActivePeople":1000,"coderStrategy":"HAND","cpuDelayMs":0,"diskBusyBytes":0,"auctionSkip":123,"fanout":5,"maxAuctionsWaitingTime":600,"occasionalDelaySec":3,"probDelayedEvent":0.1,"maxLogEvents":100000,"usePubsubPublishTime":false,"outOfOrderGroupSize":1,"numKeyBuckets":20000,"pardoCPUFactor":1.0}
Configurations:
Conf Description
0000 query:PASSTHROUGH; numEvents:10000000
0001 query:CURRENCY_CONVERSION; numEvents:10000000
0002 query:SELECTION; numEvents:10000000
0003 query:LOCAL_ITEM_SUGGESTION; numEvents:10000000
0004 query:AVERAGE_PRICE_FOR_CATEGORY; numEvents:1000000
0005 query:HOT_ITEMS; numEvents:10000000
0006 query:AVERAGE_SELLING_PRICE_BY_SELLER; numEvents:1000000
0007 query:HIGHEST_BID; numEvents:10000000
0008 query:MONITOR_NEW_USERS; numEvents:10000000
0009 query:WINNING_BIDS; numEvents:1000000
0010 query:LOG_TO_SHARDED_FILES; numEvents:10000000
0011 query:USER_SESSIONS; numEvents:10000000
0012 query:PROCESSING_TIME_WINDOWS; numEvents:10000000
0013 query:PORTABILITY_BATCH; numEvents:10000000
0014 query:BOUNDED_SIDE_INPUT_JOIN; numEvents:10000000
0015 query:SESSION_SIDE_INPUT_JOIN; numEvents:10000000
Performance:
Conf Runtime(sec) (Baseline) Events(/sec) (Baseline) Results
(Baseline)
0000 32.9 303739.0 10000000
0001 25.8 387581.9 9200000
0002 17.4 575473.3 83527
0003 *** not run ***
0004 *** not run ***
0005 38.9 257201.6 4567
0006 *** not run ***
0007 *** not run ***
0008 24.9 401961.6 92833
0009 *** not run ***
0010 57.1 175223.4 100
0011 43.5 229906.2 1839657
0012 24.9 402220.3 199929
0013 62.3 160433.8 10000000
0014 *** not run ***
0015 *** not run ***
==========================================================================================
> Task :runners:google-cloud-dataflow-java:cleanUpDockerImages
Untagged: us.gcr.io/apache-beam-testing/java-postcommit-it/java:20210811060101
Untagged:
us.gcr.io/apache-beam-testing/java-postcommit-it/java@sha256:cfe1641c7a2af10d63e571e6256b78f8f9e179948ff5e6dea1b8da6a5601f799
Deleted: sha256:7aede60644e18118303c12f33f6890856443f016d995b473a1a1ee7b23ce5e7b
Deleted: sha256:b654cc5c21de77588bec1b44b66bddf64975297a1fa86c4bdca87f977508b25b
Deleted: sha256:60080bcb104dbf3d49291c65093cb7193c022983bceda28724b04eda12149950
Deleted: sha256:99833e7094c70d261a6892852fc68368c86505a63e4a3d0c2ff8ccb846a989ed
Deleted: sha256:18631494e9505866ac6f822b225ae645fec124d1ed7afe38826b69fa7c2a486f
Deleted: sha256:300f165fb01c80a151e8cdd9ddfc4b73c31aeeac4d23c811d8dcfc8c647e2534
Deleted: sha256:c334ed430bfe4c28e7ad6bda91a795317c1c6e5521f72272040c734751b1a7ab
Deleted: sha256:303f499c372632c9d507810fa8eb4f1032061a956555cddadf20aa985eae183c
Deleted: sha256:7924342ff141876e4833033521a07d96adfc13b1e9584f9e46eb057c5cbada7c
Deleted: sha256:72e848fc5524d0d206bf0200501c60db1a10d042769a71806d3fdb1f8593f7e8
Deleted: sha256:e1c59fbdfab5d9496583aa464881785f441bc01bb97c2bfbdce1bebb0f19649f
Deleted: sha256:b5ffbd3ab67c04c16ae540da3f30f181d4ab5c5095bb69350fbf3a08cd07aab3
Deleted: sha256:de4e6ccb14d9456a2bc7ef5a7d622461d138fa1874accfab5e7991224b5d7551
Deleted: sha256:c03baf7e2b30fd42a47a072778d29c231d570a453f183bba937f3b5822659ad1
Deleted: sha256:3d92df1158011d6a526abfe222085c1be5d4dd167147619f817a33d38971b25d
Deleted: sha256:e8495b5461d0008dadc71c2276d5b60ca363f40506f27a2fa51470d9d3f9225c
Deleted: sha256:769ce823fbf2938e4d17507f8ab25fa86ed048da647070f087d1d702f01f6f19
Deleted: sha256:9e8ea32f3a7bd84c4d9080990c7894eb0c66657e34c6e592a2ceb40b0e0ad825
Deleted: sha256:e480dba26cc470cbd6e90fa98f1464da1faa774b1eafbb43af76fe9e6f446719
Deleted: sha256:4e5b398de352a44221e4b5cc1e8ca05100ed0674de495d2d1c66227f7aa6e2c4
Deleted: sha256:6851a3361220c96b468176d13b9a433a133de7c1e0165199b6f38b304fb6374e
Deleted: sha256:bbe77031a70be43c906753f72d61df21d5f2f2a3ccedf5f34cdd4183112c600b
Deleted: sha256:9a165f5d26762c00d9ddcf2b5db4f5526bb416d6ce0a621f22606642852e01ce
Deleted: sha256:c40bf50edb1445693d12b4aa600baea3f9405df2285b28bb3d78ce2e3d93356c
Deleted: sha256:fe6933fb99241bbf098a76ee5cc2da58d4c82b24ca60c61788ba854fb011d131
Deleted: sha256:74dfb05c51ecedef64d112a330420870a7f0a7c94385768a282bb1f17c5701ff
Deleted: sha256:b13e98f03b9ba2f065caba9dc3b4af62bf30dc3202bff66a251ab7b1a92ee582
Deleted: sha256:6dc004a5fd7a284cdd2c72897ba886497040fce4bcb30c092b5581274ab84ce9
Tag: [us.gcr.io/apache-beam-testing/java-postcommit-it/java:20210811060101]
- referencing digest:
[us.gcr.io/apache-beam-testing/java-postcommit-it/java@sha256:cfe1641c7a2af10d63e571e6256b78f8f9e179948ff5e6dea1b8da6a5601f799]
Deleted [[us.gcr.io/apache-beam-testing/java-postcommit-it/java:20210811060101]
(referencing
[us.gcr.io/apache-beam-testing/java-postcommit-it/java@sha256:cfe1641c7a2af10d63e571e6256b78f8f9e179948ff5e6dea1b8da6a5601f799])].
Removing untagged image
us.gcr.io/apache-beam-testing/java-postcommit-it/java@sha256:cfe1641c7a2af10d63e571e6256b78f8f9e179948ff5e6dea1b8da6a5601f799
Digests:
-
us.gcr.io/apache-beam-testing/java-postcommit-it/java@sha256:cfe1641c7a2af10d63e571e6256b78f8f9e179948ff5e6dea1b8da6a5601f799
Deleted
[us.gcr.io/apache-beam-testing/java-postcommit-it/java@sha256:cfe1641c7a2af10d63e571e6256b78f8f9e179948ff5e6dea1b8da6a5601f799].
Removing untagged image
us.gcr.io/apache-beam-testing/java-postcommit-it/java@sha256:7cc90c69104f9ccf8cd8161d5158f7bca958ba35adc6426632d036998452fca5
Digests:
-
us.gcr.io/apache-beam-testing/java-postcommit-it/java@sha256:7cc90c69104f9ccf8cd8161d5158f7bca958ba35adc6426632d036998452fca5
ERROR: (gcloud.container.images.delete) Not found: response: {'status': '404',
'content-length': '168', 'x-xss-protection': '0', 'transfer-encoding':
'chunked', 'server': 'Docker Registry', '-content-encoding': 'gzip',
'docker-distribution-api-version': 'registry/2.0', 'cache-control': 'private',
'date': 'Wed, 11 Aug 2021 06:17:40 GMT', 'x-frame-options': 'SAMEORIGIN',
'content-type': 'application/json'}
Failed to compute blob liveness for manifest:
'sha256:7cc90c69104f9ccf8cd8161d5158f7bca958ba35adc6426632d036998452fca5': None
> Task :runners:google-cloud-dataflow-java:cleanUpDockerImages FAILED
FAILURE: Build failed with an exception.
* Where:
Build file
'<https://ci-beam.apache.org/job/beam_PostCommit_Java_Nexmark_Dataflow_V2/ws/src/runners/google-cloud-dataflow-java/build.gradle'>
line: 282
* What went wrong:
Execution failed for task
':runners:google-cloud-dataflow-java:cleanUpDockerImages'.
> Process 'command './scripts/cleanup_untagged_gcr_images.sh'' finished with
> non-zero exit value 1
* Try:
Run with --stacktrace option to get the stack trace. Run with --info or --debug
option to get more log output. Run with --scan to get full insights.
* Get more help at https://help.gradle.org
Deprecated Gradle features were used in this build, making it incompatible with
Gradle 7.0.
Use '--warning-mode all' to show the individual deprecation warnings.
See
https://docs.gradle.org/6.8.3/userguide/command_line_interface.html#sec:command_line_warnings
BUILD FAILED in 17m 11s
134 actionable tasks: 95 executed, 37 from cache, 2 up-to-date
Publishing build scan...
https://gradle.com/s/yrabmcllpnl4g
Build step 'Invoke Gradle script' changed build result to FAILURE
Build step 'Invoke Gradle script' marked build as failure
---------------------------------------------------------------------
To unsubscribe, e-mail: [email protected]
For additional commands, e-mail: [email protected]
