See
<https://ci-beam.apache.org/job/beam_PostCommit_Java_Nexmark_Dataflow_V2/809/display/redirect>
Changes:
------------------------------------------
[...truncated 253.22 KB...]
0004 query:AVERAGE_PRICE_FOR_CATEGORY; numEvents:1000000
0005 query:HOT_ITEMS; numEvents:10000000
0006 query:AVERAGE_SELLING_PRICE_BY_SELLER; numEvents:1000000
0007 query:HIGHEST_BID; numEvents:10000000
0008 query:MONITOR_NEW_USERS; numEvents:10000000
0009 query:WINNING_BIDS; numEvents:1000000
0010 query:LOG_TO_SHARDED_FILES; numEvents:10000000
0011 query:USER_SESSIONS; numEvents:10000000
0012 query:PROCESSING_TIME_WINDOWS; numEvents:10000000
0013 query:PORTABILITY_BATCH; numEvents:10000000
0014 query:BOUNDED_SIDE_INPUT_JOIN; numEvents:10000000
0015 query:SESSION_SIDE_INPUT_JOIN; numEvents:10000000
Performance:
Conf Runtime(sec) (Baseline) Events(/sec) (Baseline) Results
(Baseline)
0000 25.8 388108.4 10000000
0001 20.7 484097.4 9200000
0002 10.6 942684.8 83527
0003 *** not run ***
0004 *** not run ***
0005 30.4 328525.9 4567
0006 *** not run ***
0007 *** not run ***
0008 19.6 510516.6 92833
0009 *** not run ***
0010 *** not run ***
0011 39.2 255330.0 1839657
0012 16.8 596587.5 199929
0013 *** not run ***
0014 *** not run ***
0015 *** not run ***
==========================================================================================
2021-12-12T18:12:06.751Z DONE Query10
==========================================================================================
Run started 2021-12-12T18:04:56.794Z and ran for PT430.004S
Default configuration:
{"debug":true,"query":null,"sourceType":"DIRECT","generateEventFilePathPrefix":null,"sinkType":"DEVNULL","exportSummaryToBigQuery":false,"pubSubMode":"COMBINED","pubsubMessageSerializationMethod":"CODER","sideInputType":"DIRECT","sideInputRowCount":500,"sideInputNumShards":3,"sideInputUrl":null,"sessionGap":600000,"numEvents":100000,"numEventGenerators":100,"rateShape":"SINE","firstEventRate":10000,"nextEventRate":10000,"rateUnit":"PER_SECOND","ratePeriodSec":600,"preloadSeconds":0,"streamTimeout":240,"isRateLimited":false,"useWallclockEventTime":false,"avgPersonByteSize":200,"avgAuctionByteSize":500,"avgBidByteSize":100,"hotAuctionRatio":2,"hotSellersRatio":4,"hotBiddersRatio":4,"windowSizeSec":10,"windowPeriodSec":5,"watermarkHoldbackSec":0,"numInFlightAuctions":100,"numActivePeople":1000,"coderStrategy":"HAND","cpuDelayMs":0,"diskBusyBytes":0,"auctionSkip":123,"fanout":5,"maxAuctionsWaitingTime":600,"occasionalDelaySec":3,"probDelayedEvent":0.1,"maxLogEvents":100000,"usePubsubPublishTime":false,"outOfOrderGroupSize":1,"numKeyBuckets":20000,"pardoCPUFactor":1.0}
Configurations:
Conf Description
0000 query:PASSTHROUGH; numEvents:10000000
0001 query:CURRENCY_CONVERSION; numEvents:10000000
0002 query:SELECTION; numEvents:10000000
0003 query:LOCAL_ITEM_SUGGESTION; numEvents:10000000
0004 query:AVERAGE_PRICE_FOR_CATEGORY; numEvents:1000000
0005 query:HOT_ITEMS; numEvents:10000000
0006 query:AVERAGE_SELLING_PRICE_BY_SELLER; numEvents:1000000
0007 query:HIGHEST_BID; numEvents:10000000
0008 query:MONITOR_NEW_USERS; numEvents:10000000
0009 query:WINNING_BIDS; numEvents:1000000
0010 query:LOG_TO_SHARDED_FILES; numEvents:10000000
0011 query:USER_SESSIONS; numEvents:10000000
0012 query:PROCESSING_TIME_WINDOWS; numEvents:10000000
0013 query:PORTABILITY_BATCH; numEvents:10000000
0014 query:BOUNDED_SIDE_INPUT_JOIN; numEvents:10000000
0015 query:SESSION_SIDE_INPUT_JOIN; numEvents:10000000
Performance:
Conf Runtime(sec) (Baseline) Events(/sec) (Baseline) Results
(Baseline)
0000 25.8 388108.4 10000000
0001 20.7 484097.4 9200000
0002 10.6 942684.8 83527
0003 *** not run ***
0004 *** not run ***
0005 30.4 328525.9 4567
0006 *** not run ***
0007 *** not run ***
0008 19.6 510516.6 92833
0009 *** not run ***
0010 52.7 189746.1 100
0011 39.2 255330.0 1839657
0012 16.8 596587.5 199929
0013 *** not run ***
0014 *** not run ***
0015 *** not run ***
==========================================================================================
2021-12-12T18:12:08.681Z RUNNING Query13
2021-12-12T18:12:09.248Z no activity
2021-12-12T18:12:24.281Z DONE Query13
==========================================================================================
Run started 2021-12-12T18:04:56.794Z and ran for PT447.545S
Default configuration:
{"debug":true,"query":null,"sourceType":"DIRECT","generateEventFilePathPrefix":null,"sinkType":"DEVNULL","exportSummaryToBigQuery":false,"pubSubMode":"COMBINED","pubsubMessageSerializationMethod":"CODER","sideInputType":"DIRECT","sideInputRowCount":500,"sideInputNumShards":3,"sideInputUrl":null,"sessionGap":600000,"numEvents":100000,"numEventGenerators":100,"rateShape":"SINE","firstEventRate":10000,"nextEventRate":10000,"rateUnit":"PER_SECOND","ratePeriodSec":600,"preloadSeconds":0,"streamTimeout":240,"isRateLimited":false,"useWallclockEventTime":false,"avgPersonByteSize":200,"avgAuctionByteSize":500,"avgBidByteSize":100,"hotAuctionRatio":2,"hotSellersRatio":4,"hotBiddersRatio":4,"windowSizeSec":10,"windowPeriodSec":5,"watermarkHoldbackSec":0,"numInFlightAuctions":100,"numActivePeople":1000,"coderStrategy":"HAND","cpuDelayMs":0,"diskBusyBytes":0,"auctionSkip":123,"fanout":5,"maxAuctionsWaitingTime":600,"occasionalDelaySec":3,"probDelayedEvent":0.1,"maxLogEvents":100000,"usePubsubPublishTime":false,"outOfOrderGroupSize":1,"numKeyBuckets":20000,"pardoCPUFactor":1.0}
Configurations:
Conf Description
0000 query:PASSTHROUGH; numEvents:10000000
0001 query:CURRENCY_CONVERSION; numEvents:10000000
0002 query:SELECTION; numEvents:10000000
0003 query:LOCAL_ITEM_SUGGESTION; numEvents:10000000
0004 query:AVERAGE_PRICE_FOR_CATEGORY; numEvents:1000000
0005 query:HOT_ITEMS; numEvents:10000000
0006 query:AVERAGE_SELLING_PRICE_BY_SELLER; numEvents:1000000
0007 query:HIGHEST_BID; numEvents:10000000
0008 query:MONITOR_NEW_USERS; numEvents:10000000
0009 query:WINNING_BIDS; numEvents:1000000
0010 query:LOG_TO_SHARDED_FILES; numEvents:10000000
0011 query:USER_SESSIONS; numEvents:10000000
0012 query:PROCESSING_TIME_WINDOWS; numEvents:10000000
0013 query:PORTABILITY_BATCH; numEvents:10000000
0014 query:BOUNDED_SIDE_INPUT_JOIN; numEvents:10000000
0015 query:SESSION_SIDE_INPUT_JOIN; numEvents:10000000
Performance:
Conf Runtime(sec) (Baseline) Events(/sec) (Baseline) Results
(Baseline)
0000 25.8 388108.4 10000000
0001 20.7 484097.4 9200000
0002 10.6 942684.8 83527
0003 *** not run ***
0004 *** not run ***
0005 30.4 328525.9 4567
0006 *** not run ***
0007 *** not run ***
0008 19.6 510516.6 92833
0009 *** not run ***
0010 52.7 189746.1 100
0011 39.2 255330.0 1839657
0012 16.8 596587.5 199929
0013 49.9 200481.2 10000000
0014 *** not run ***
0015 *** not run ***
==========================================================================================
==========================================================================================
Run started 2021-12-12T18:04:56.794Z and ran for PT447.826S
Default configuration:
{"debug":true,"query":null,"sourceType":"DIRECT","generateEventFilePathPrefix":null,"sinkType":"DEVNULL","exportSummaryToBigQuery":false,"pubSubMode":"COMBINED","pubsubMessageSerializationMethod":"CODER","sideInputType":"DIRECT","sideInputRowCount":500,"sideInputNumShards":3,"sideInputUrl":null,"sessionGap":600000,"numEvents":100000,"numEventGenerators":100,"rateShape":"SINE","firstEventRate":10000,"nextEventRate":10000,"rateUnit":"PER_SECOND","ratePeriodSec":600,"preloadSeconds":0,"streamTimeout":240,"isRateLimited":false,"useWallclockEventTime":false,"avgPersonByteSize":200,"avgAuctionByteSize":500,"avgBidByteSize":100,"hotAuctionRatio":2,"hotSellersRatio":4,"hotBiddersRatio":4,"windowSizeSec":10,"windowPeriodSec":5,"watermarkHoldbackSec":0,"numInFlightAuctions":100,"numActivePeople":1000,"coderStrategy":"HAND","cpuDelayMs":0,"diskBusyBytes":0,"auctionSkip":123,"fanout":5,"maxAuctionsWaitingTime":600,"occasionalDelaySec":3,"probDelayedEvent":0.1,"maxLogEvents":100000,"usePubsubPublishTime":false,"outOfOrderGroupSize":1,"numKeyBuckets":20000,"pardoCPUFactor":1.0}
Configurations:
Conf Description
0000 query:PASSTHROUGH; numEvents:10000000
0001 query:CURRENCY_CONVERSION; numEvents:10000000
0002 query:SELECTION; numEvents:10000000
0003 query:LOCAL_ITEM_SUGGESTION; numEvents:10000000
0004 query:AVERAGE_PRICE_FOR_CATEGORY; numEvents:1000000
0005 query:HOT_ITEMS; numEvents:10000000
0006 query:AVERAGE_SELLING_PRICE_BY_SELLER; numEvents:1000000
0007 query:HIGHEST_BID; numEvents:10000000
0008 query:MONITOR_NEW_USERS; numEvents:10000000
0009 query:WINNING_BIDS; numEvents:1000000
0010 query:LOG_TO_SHARDED_FILES; numEvents:10000000
0011 query:USER_SESSIONS; numEvents:10000000
0012 query:PROCESSING_TIME_WINDOWS; numEvents:10000000
0013 query:PORTABILITY_BATCH; numEvents:10000000
0014 query:BOUNDED_SIDE_INPUT_JOIN; numEvents:10000000
0015 query:SESSION_SIDE_INPUT_JOIN; numEvents:10000000
Performance:
Conf Runtime(sec) (Baseline) Events(/sec) (Baseline) Results
(Baseline)
0000 25.8 388108.4 10000000
0001 20.7 484097.4 9200000
0002 10.6 942684.8 83527
0003 *** not run ***
0004 *** not run ***
0005 30.4 328525.9 4567
0006 *** not run ***
0007 *** not run ***
0008 19.6 510516.6 92833
0009 *** not run ***
0010 52.7 189746.1 100
0011 39.2 255330.0 1839657
0012 16.8 596587.5 199929
0013 49.9 200481.2 10000000
0014 *** not run ***
0015 *** not run ***
==========================================================================================
> Task :runners:google-cloud-dataflow-java:cleanUpDockerImages
Untagged: us.gcr.io/apache-beam-testing/java-postcommit-it/java:20211212180054
Untagged:
us.gcr.io/apache-beam-testing/java-postcommit-it/java@sha256:371cddc2c4f3c88f2cb499761734a77d0ef948df1d57c1ce967be0f476e0e782
Deleted: sha256:23fdfb1be17823addea53f27f74f8386789bfae9c214750010f81440278138d0
Deleted: sha256:713dd2f88a6ee7fbdf22699b3d6e4cea1259406aa9a9bd79b040fc690d1335f7
Deleted: sha256:82f2abfd4a5f289d7bbb34ce5f078f296ba8f27da32f5ea93866085969353866
Deleted: sha256:55ea6caebd69cd8e81e4594ce5ee6d8903782b395f2573c7c790733913b12a13
Deleted: sha256:dca38cbf7709d9ef0a11ff6e9a5aab8a430459db16b3adc16a186f0846d8c4f6
Deleted: sha256:cf3e42b9573bb60eb96fb20bed73348c29d9deb85d74f41f05ce3eac2d6070b7
Deleted: sha256:287614dda1dcbf2abe7ae84351c34b1f8cb1e3249ece0f53f2b825e64079a699
Deleted: sha256:2ab31bd1a25062deec4b71f6c2aec1d1587bd6bd28e19f9298a846ca3a940aa3
Deleted: sha256:7ba6bbafe83060e69d2757b1e7130c5967e8c8123d1dca3386ecfc3982500272
Deleted: sha256:5f386a808f417d9630b275a9459f9822990d95df6e89d07083ddcc7c3da66894
Deleted: sha256:f49bd71f55a60ead1479075136f5c1e89fb20eaeebdc19867702e64edeb689dd
Deleted: sha256:e15936747a43a3ab0162b000ef1f2467d64b48cf486b482d60cb865c7a2aa651
Deleted: sha256:909c93cd81adab76d68cbf39358b63a39c663ab7353ba4e18d09f0deaae61371
Deleted: sha256:159e66eece92b43b8f0a058f34696c8f7a4ecfcdb888b6a754c7ff25d9534d88
Deleted: sha256:a389352bb3b53950f951995179c143a29ec319862351063b000396ca50173578
Deleted: sha256:200650e41255b7a0e113e5dec004ebfb6a72496c16f9f77d48495e3697528ae6
Deleted: sha256:97d4c6ba20a35a4ab4e287c19e2b7675775e8fc69db90e551749911d02855155
Deleted: sha256:074f3aa1fa9ab211f182651798dc6c3b7b0d03bf81e1b50d619e2041aaf80737
Deleted: sha256:523295af23275b91de01ef36d6c55b5f1648dccdcfa4276e0d35c773f44b51ef
Deleted: sha256:7ca23083e32caaa4fd2877d679f1f83ea2051ca5395f808ee4a15e827419c2ff
Deleted: sha256:b082763214f2980145f7ac2a63b808f62f15ebbc5a3d5bba9120461a3cfcb97e
Deleted: sha256:08a4128bd34186a722725a62dc6531753ea768e196bc5fc4415e31aaf884064a
Deleted: sha256:7f981d496f51d033e6bff91dd4f84934c16ef11ba66a0b88b2410c262274d4cb
Deleted: sha256:8eeaf8aec5136dca4e2283971780aa84348a2a4ae070dbc38b0e3318c99f5618
Deleted: sha256:32e362d975a86f62b72ce71bb438c5b97e742f8fc4219754cf73b86997008d13
Deleted: sha256:6cc7168e1b48d6052fb9370e143ae3d78b3a8cbe0fc663d6d66a028b5f856e66
Deleted: sha256:6683ec269e1bd719b95fc70dc5a0cd5dd34630da1292d844d7df3611b3fe5003
Deleted: sha256:e12ade919cc83bbb0860d07284f96c23cf6dd8ed00c4d956b657ba69af93f0d3
Tag: [us.gcr.io/apache-beam-testing/java-postcommit-it/java:20211212180054]
- referencing digest:
[us.gcr.io/apache-beam-testing/java-postcommit-it/java@sha256:fc0fdfa63b07a5d7f95cf1aaeec2d5904c5db5856707d5f90c8cdd501c97f08f]
Deleted [[us.gcr.io/apache-beam-testing/java-postcommit-it/java:20211212180054]
(referencing
[us.gcr.io/apache-beam-testing/java-postcommit-it/java@sha256:fc0fdfa63b07a5d7f95cf1aaeec2d5904c5db5856707d5f90c8cdd501c97f08f])].
Removing untagged image
us.gcr.io/apache-beam-testing/java-postcommit-it/java@sha256:fc0fdfa63b07a5d7f95cf1aaeec2d5904c5db5856707d5f90c8cdd501c97f08f
Digests:
-
us.gcr.io/apache-beam-testing/java-postcommit-it/java@sha256:fc0fdfa63b07a5d7f95cf1aaeec2d5904c5db5856707d5f90c8cdd501c97f08f
Deleted
[us.gcr.io/apache-beam-testing/java-postcommit-it/java@sha256:fc0fdfa63b07a5d7f95cf1aaeec2d5904c5db5856707d5f90c8cdd501c97f08f].
Removing untagged image
us.gcr.io/apache-beam-testing/java-postcommit-it/java@sha256:5af7bb2f208760372d6932284090858b47a5420446f4460596209802951f78b9
Digests:
-
us.gcr.io/apache-beam-testing/java-postcommit-it/java@sha256:5af7bb2f208760372d6932284090858b47a5420446f4460596209802951f78b9
ERROR: (gcloud.container.images.delete) Not found: response: {'status': '404',
'content-length': '168', 'x-xss-protection': '0', 'transfer-encoding':
'chunked', 'server': 'Docker Registry', '-content-encoding': 'gzip',
'docker-distribution-api-version': 'registry/2.0', 'cache-control': 'private',
'date': 'Sun, 12 Dec 2021 18:12:29 GMT', 'x-frame-options': 'SAMEORIGIN',
'content-type': 'application/json'}
Failed to compute blob liveness for manifest:
'sha256:5af7bb2f208760372d6932284090858b47a5420446f4460596209802951f78b9': None
> Task :runners:google-cloud-dataflow-java:cleanUpDockerImages FAILED
FAILURE: Build failed with an exception.
* Where:
Build file
'<https://ci-beam.apache.org/job/beam_PostCommit_Java_Nexmark_Dataflow_V2/ws/src/runners/google-cloud-dataflow-java/build.gradle'>
line: 281
* What went wrong:
Execution failed for task
':runners:google-cloud-dataflow-java:cleanUpDockerImages'.
> Process 'command './scripts/cleanup_untagged_gcr_images.sh'' finished with
> non-zero exit value 1
* Try:
Run with --stacktrace option to get the stack trace. Run with --info or --debug
option to get more log output. Run with --scan to get full insights.
* Get more help at https://help.gradle.org
Deprecated Gradle features were used in this build, making it incompatible with
Gradle 7.0.
Use '--warning-mode all' to show the individual deprecation warnings.
See
https://docs.gradle.org/6.9.1/userguide/command_line_interface.html#sec:command_line_warnings
BUILD FAILED in 12m 4s
128 actionable tasks: 89 executed, 37 from cache, 2 up-to-date
Publishing build scan...
https://gradle.com/s/tpcsmob6hstxm
Build step 'Invoke Gradle script' changed build result to FAILURE
Build step 'Invoke Gradle script' marked build as failure
---------------------------------------------------------------------
To unsubscribe, e-mail: [email protected]
For additional commands, e-mail: [email protected]
