See
<https://ci-beam.apache.org/job/beam_PostCommit_Java_Nexmark_Dataflow_V2/636/display/redirect>
Changes:
------------------------------------------
[...truncated 252.81 KB...]
2021-10-30T12:12:18.677Z DONE Query5
==========================================================================================
Run started 2021-10-30T12:05:49.294Z and ran for PT389.409S
Default configuration:
{"debug":true,"query":null,"sourceType":"DIRECT","generateEventFilePathPrefix":null,"sinkType":"DEVNULL","exportSummaryToBigQuery":false,"pubSubMode":"COMBINED","pubsubMessageSerializationMethod":"CODER","sideInputType":"DIRECT","sideInputRowCount":500,"sideInputNumShards":3,"sideInputUrl":null,"sessionGap":600000,"numEvents":100000,"numEventGenerators":100,"rateShape":"SINE","firstEventRate":10000,"nextEventRate":10000,"rateUnit":"PER_SECOND","ratePeriodSec":600,"preloadSeconds":0,"streamTimeout":240,"isRateLimited":false,"useWallclockEventTime":false,"avgPersonByteSize":200,"avgAuctionByteSize":500,"avgBidByteSize":100,"hotAuctionRatio":2,"hotSellersRatio":4,"hotBiddersRatio":4,"windowSizeSec":10,"windowPeriodSec":5,"watermarkHoldbackSec":0,"numInFlightAuctions":100,"numActivePeople":1000,"coderStrategy":"HAND","cpuDelayMs":0,"diskBusyBytes":0,"auctionSkip":123,"fanout":5,"maxAuctionsWaitingTime":600,"occasionalDelaySec":3,"probDelayedEvent":0.1,"maxLogEvents":100000,"usePubsubPublishTime":false,"outOfOrderGroupSize":1,"numKeyBuckets":20000,"pardoCPUFactor":1.0}
Configurations:
Conf Description
0000 query:PASSTHROUGH; numEvents:10000000
0001 query:CURRENCY_CONVERSION; numEvents:10000000
0002 query:SELECTION; numEvents:10000000
0003 query:LOCAL_ITEM_SUGGESTION; numEvents:10000000
0004 query:AVERAGE_PRICE_FOR_CATEGORY; numEvents:1000000
0005 query:HOT_ITEMS; numEvents:10000000
0006 query:AVERAGE_SELLING_PRICE_BY_SELLER; numEvents:1000000
0007 query:HIGHEST_BID; numEvents:10000000
0008 query:MONITOR_NEW_USERS; numEvents:10000000
0009 query:WINNING_BIDS; numEvents:1000000
0010 query:LOG_TO_SHARDED_FILES; numEvents:10000000
0011 query:USER_SESSIONS; numEvents:10000000
0012 query:PROCESSING_TIME_WINDOWS; numEvents:10000000
0013 query:PORTABILITY_BATCH; numEvents:10000000
0014 query:BOUNDED_SIDE_INPUT_JOIN; numEvents:10000000
0015 query:SESSION_SIDE_INPUT_JOIN; numEvents:10000000
Performance:
Conf Runtime(sec) (Baseline) Events(/sec) (Baseline) Results
(Baseline)
0000 23.4 427076.7 10000000
0001 17.5 570320.5 9200000
0002 11.7 857338.8 83527
0003 *** not run ***
0004 *** not run ***
0005 27.7 361154.2 4567
0006 *** not run ***
0007 *** not run ***
0008 17.4 574151.7 92833
0009 *** not run ***
0010 *** not run ***
0011 *** not run ***
0012 14.0 716486.4 199929
0013 45.7 219005.3 10000000
0014 *** not run ***
0015 *** not run ***
==========================================================================================
2021-10-30T12:12:18.711Z DONE Query11
==========================================================================================
Run started 2021-10-30T12:05:49.294Z and ran for PT389.462S
Default configuration:
{"debug":true,"query":null,"sourceType":"DIRECT","generateEventFilePathPrefix":null,"sinkType":"DEVNULL","exportSummaryToBigQuery":false,"pubSubMode":"COMBINED","pubsubMessageSerializationMethod":"CODER","sideInputType":"DIRECT","sideInputRowCount":500,"sideInputNumShards":3,"sideInputUrl":null,"sessionGap":600000,"numEvents":100000,"numEventGenerators":100,"rateShape":"SINE","firstEventRate":10000,"nextEventRate":10000,"rateUnit":"PER_SECOND","ratePeriodSec":600,"preloadSeconds":0,"streamTimeout":240,"isRateLimited":false,"useWallclockEventTime":false,"avgPersonByteSize":200,"avgAuctionByteSize":500,"avgBidByteSize":100,"hotAuctionRatio":2,"hotSellersRatio":4,"hotBiddersRatio":4,"windowSizeSec":10,"windowPeriodSec":5,"watermarkHoldbackSec":0,"numInFlightAuctions":100,"numActivePeople":1000,"coderStrategy":"HAND","cpuDelayMs":0,"diskBusyBytes":0,"auctionSkip":123,"fanout":5,"maxAuctionsWaitingTime":600,"occasionalDelaySec":3,"probDelayedEvent":0.1,"maxLogEvents":100000,"usePubsubPublishTime":false,"outOfOrderGroupSize":1,"numKeyBuckets":20000,"pardoCPUFactor":1.0}
Configurations:
Conf Description
0000 query:PASSTHROUGH; numEvents:10000000
0001 query:CURRENCY_CONVERSION; numEvents:10000000
0002 query:SELECTION; numEvents:10000000
0003 query:LOCAL_ITEM_SUGGESTION; numEvents:10000000
0004 query:AVERAGE_PRICE_FOR_CATEGORY; numEvents:1000000
0005 query:HOT_ITEMS; numEvents:10000000
0006 query:AVERAGE_SELLING_PRICE_BY_SELLER; numEvents:1000000
0007 query:HIGHEST_BID; numEvents:10000000
0008 query:MONITOR_NEW_USERS; numEvents:10000000
0009 query:WINNING_BIDS; numEvents:1000000
0010 query:LOG_TO_SHARDED_FILES; numEvents:10000000
0011 query:USER_SESSIONS; numEvents:10000000
0012 query:PROCESSING_TIME_WINDOWS; numEvents:10000000
0013 query:PORTABILITY_BATCH; numEvents:10000000
0014 query:BOUNDED_SIDE_INPUT_JOIN; numEvents:10000000
0015 query:SESSION_SIDE_INPUT_JOIN; numEvents:10000000
Performance:
Conf Runtime(sec) (Baseline) Events(/sec) (Baseline) Results
(Baseline)
0000 23.4 427076.7 10000000
0001 17.5 570320.5 9200000
0002 11.7 857338.8 83527
0003 *** not run ***
0004 *** not run ***
0005 27.7 361154.2 4567
0006 *** not run ***
0007 *** not run ***
0008 17.4 574151.7 92833
0009 *** not run ***
0010 *** not run ***
0011 41.7 239946.3 1839657
0012 14.0 716486.4 199929
0013 45.7 219005.3 10000000
0014 *** not run ***
0015 *** not run ***
==========================================================================================
2021-10-30T12:12:18.781Z RUNNING Query10
2021-10-30T12:12:18.990Z no activity
2021-10-30T12:12:33.990Z DONE Query10
==========================================================================================
Run started 2021-10-30T12:05:49.294Z and ran for PT404.697S
Default configuration:
{"debug":true,"query":null,"sourceType":"DIRECT","generateEventFilePathPrefix":null,"sinkType":"DEVNULL","exportSummaryToBigQuery":false,"pubSubMode":"COMBINED","pubsubMessageSerializationMethod":"CODER","sideInputType":"DIRECT","sideInputRowCount":500,"sideInputNumShards":3,"sideInputUrl":null,"sessionGap":600000,"numEvents":100000,"numEventGenerators":100,"rateShape":"SINE","firstEventRate":10000,"nextEventRate":10000,"rateUnit":"PER_SECOND","ratePeriodSec":600,"preloadSeconds":0,"streamTimeout":240,"isRateLimited":false,"useWallclockEventTime":false,"avgPersonByteSize":200,"avgAuctionByteSize":500,"avgBidByteSize":100,"hotAuctionRatio":2,"hotSellersRatio":4,"hotBiddersRatio":4,"windowSizeSec":10,"windowPeriodSec":5,"watermarkHoldbackSec":0,"numInFlightAuctions":100,"numActivePeople":1000,"coderStrategy":"HAND","cpuDelayMs":0,"diskBusyBytes":0,"auctionSkip":123,"fanout":5,"maxAuctionsWaitingTime":600,"occasionalDelaySec":3,"probDelayedEvent":0.1,"maxLogEvents":100000,"usePubsubPublishTime":false,"outOfOrderGroupSize":1,"numKeyBuckets":20000,"pardoCPUFactor":1.0}
Configurations:
Conf Description
0000 query:PASSTHROUGH; numEvents:10000000
0001 query:CURRENCY_CONVERSION; numEvents:10000000
0002 query:SELECTION; numEvents:10000000
0003 query:LOCAL_ITEM_SUGGESTION; numEvents:10000000
0004 query:AVERAGE_PRICE_FOR_CATEGORY; numEvents:1000000
0005 query:HOT_ITEMS; numEvents:10000000
0006 query:AVERAGE_SELLING_PRICE_BY_SELLER; numEvents:1000000
0007 query:HIGHEST_BID; numEvents:10000000
0008 query:MONITOR_NEW_USERS; numEvents:10000000
0009 query:WINNING_BIDS; numEvents:1000000
0010 query:LOG_TO_SHARDED_FILES; numEvents:10000000
0011 query:USER_SESSIONS; numEvents:10000000
0012 query:PROCESSING_TIME_WINDOWS; numEvents:10000000
0013 query:PORTABILITY_BATCH; numEvents:10000000
0014 query:BOUNDED_SIDE_INPUT_JOIN; numEvents:10000000
0015 query:SESSION_SIDE_INPUT_JOIN; numEvents:10000000
Performance:
Conf Runtime(sec) (Baseline) Events(/sec) (Baseline) Results
(Baseline)
0000 23.4 427076.7 10000000
0001 17.5 570320.5 9200000
0002 11.7 857338.8 83527
0003 *** not run ***
0004 *** not run ***
0005 27.7 361154.2 4567
0006 *** not run ***
0007 *** not run ***
0008 17.4 574151.7 92833
0009 *** not run ***
0010 48.0 208541.9 100
0011 41.7 239946.3 1839657
0012 14.0 716486.4 199929
0013 45.7 219005.3 10000000
0014 *** not run ***
0015 *** not run ***
==========================================================================================
==========================================================================================
Run started 2021-10-30T12:05:49.294Z and ran for PT405.093S
Default configuration:
{"debug":true,"query":null,"sourceType":"DIRECT","generateEventFilePathPrefix":null,"sinkType":"DEVNULL","exportSummaryToBigQuery":false,"pubSubMode":"COMBINED","pubsubMessageSerializationMethod":"CODER","sideInputType":"DIRECT","sideInputRowCount":500,"sideInputNumShards":3,"sideInputUrl":null,"sessionGap":600000,"numEvents":100000,"numEventGenerators":100,"rateShape":"SINE","firstEventRate":10000,"nextEventRate":10000,"rateUnit":"PER_SECOND","ratePeriodSec":600,"preloadSeconds":0,"streamTimeout":240,"isRateLimited":false,"useWallclockEventTime":false,"avgPersonByteSize":200,"avgAuctionByteSize":500,"avgBidByteSize":100,"hotAuctionRatio":2,"hotSellersRatio":4,"hotBiddersRatio":4,"windowSizeSec":10,"windowPeriodSec":5,"watermarkHoldbackSec":0,"numInFlightAuctions":100,"numActivePeople":1000,"coderStrategy":"HAND","cpuDelayMs":0,"diskBusyBytes":0,"auctionSkip":123,"fanout":5,"maxAuctionsWaitingTime":600,"occasionalDelaySec":3,"probDelayedEvent":0.1,"maxLogEvents":100000,"usePubsubPublishTime":false,"outOfOrderGroupSize":1,"numKeyBuckets":20000,"pardoCPUFactor":1.0}
Configurations:
Conf Description
0000 query:PASSTHROUGH; numEvents:10000000
0001 query:CURRENCY_CONVERSION; numEvents:10000000
0002 query:SELECTION; numEvents:10000000
0003 query:LOCAL_ITEM_SUGGESTION; numEvents:10000000
0004 query:AVERAGE_PRICE_FOR_CATEGORY; numEvents:1000000
0005 query:HOT_ITEMS; numEvents:10000000
0006 query:AVERAGE_SELLING_PRICE_BY_SELLER; numEvents:1000000
0007 query:HIGHEST_BID; numEvents:10000000
0008 query:MONITOR_NEW_USERS; numEvents:10000000
0009 query:WINNING_BIDS; numEvents:1000000
0010 query:LOG_TO_SHARDED_FILES; numEvents:10000000
0011 query:USER_SESSIONS; numEvents:10000000
0012 query:PROCESSING_TIME_WINDOWS; numEvents:10000000
0013 query:PORTABILITY_BATCH; numEvents:10000000
0014 query:BOUNDED_SIDE_INPUT_JOIN; numEvents:10000000
0015 query:SESSION_SIDE_INPUT_JOIN; numEvents:10000000
Performance:
Conf Runtime(sec) (Baseline) Events(/sec) (Baseline) Results
(Baseline)
0000 23.4 427076.7 10000000
0001 17.5 570320.5 9200000
0002 11.7 857338.8 83527
0003 *** not run ***
0004 *** not run ***
0005 27.7 361154.2 4567
0006 *** not run ***
0007 *** not run ***
0008 17.4 574151.7 92833
0009 *** not run ***
0010 48.0 208541.9 100
0011 41.7 239946.3 1839657
0012 14.0 716486.4 199929
0013 45.7 219005.3 10000000
0014 *** not run ***
0015 *** not run ***
==========================================================================================
> Task :runners:google-cloud-dataflow-java:cleanUpDockerImages FAILED
Untagged: us.gcr.io/apache-beam-testing/java-postcommit-it/java:20211030120109
Untagged:
us.gcr.io/apache-beam-testing/java-postcommit-it/java@sha256:6bcf733c53beb5a567ac001c644da4bdf612d8fea7b9c12fdfa09c70bad73399
Deleted: sha256:b77e51fc4797335373e516e717f3326f141784495c39c177bdcc0fb226f73208
Deleted: sha256:ad8b4b066dd9a0b7f84d02f49f0741cdd7fe681774aad62b529bb8eff11617b9
Deleted: sha256:644e831e11e7069784c36de511a91ccf10e86006817f854957934ea8322179ec
Deleted: sha256:113d8145c58fcb6eafd6b357462fcdda32ae8b7ac873c2d90c41710e5a176fc9
Deleted: sha256:a8f2ff731693d80ae10c79aedb359a1b4546a085e388a09fae1e85145526c16b
Deleted: sha256:423fc71da17f1492ce1aebcaf5968f5aeed9f19ad055eaf0630ea18260891b62
Deleted: sha256:d2543c79c41a70530ffc0f21ec3d569815292cf10716fb1d4e4e604384ddf7ff
Deleted: sha256:8a3d9ddc3b6e035b385660661ab1e5fc8a6cd3c0c5b86f81ba1661f2aa9c2433
Deleted: sha256:3cde8594097f015b67ca68995df95736cd345df9435833af7708e82b080caad1
Deleted: sha256:45ab959b14e341c30fa34956add11c8e032d185d67deb20199879a587f9f9292
Deleted: sha256:09ab8a90e79024326e48f15bdc2380ce4c68dfed06288f886c1a86784bd034a6
Deleted: sha256:834dfaf0fe06b9167c7a1e00516af0f23a9696ad9ea14303abb5f58ebefecbe5
Deleted: sha256:7f084be8250314b1eda7851c5cc8191d724cdef34b863b74fa150f5180f859b5
Deleted: sha256:fd61ed1518799cfbdf70e490e2d83c9df92c3f7790265ad7745ce7928091eddb
Deleted: sha256:7911908e223ed1614ed8173bfe00e68f4946b68e20225be51df123959555c21b
Deleted: sha256:2beefba5ab9ea5c323cddd7aea2ae832c438a868a9d8a7b8efa9a0f1ae76f7b2
Deleted: sha256:4f2b26789fdb6d40687163177e03ca3f5e1d04fcf5d3857d82c5b29431f3ea56
Deleted: sha256:3c2bbd122b1ffd1bcdd8a2d1972f3927116e564898c0f5b9c2ed3b69aa10a9dd
Deleted: sha256:f9cbbdd0dc7a8591927042bab328143f6fa56b18b87e37f83812d8a91f7d4afb
Deleted: sha256:04e986b139194b7f5a7048345cdf2de6481da9b26970b90bbad41c25c60101d1
Deleted: sha256:677e7fc6c45d334b7b15a9b11fa67d104415a7f82f4de7915cee1f6988006b3b
Deleted: sha256:050c8bb49034497b6c2abc6640655ab4246c4d8d0cb27ca7a513492d3e0c1ac8
Deleted: sha256:269c78b277844204d8b71c6cc117df797864578eddca574d8963a635992ede11
Deleted: sha256:07dc8d63fbfc97aafe866764c18d893d9b7de12b9508fb265335857594352e09
Deleted: sha256:c3315a5212145649e1d4bb593e8ab85b6b4d875d9ee13d7e63275653a0ebb026
Deleted: sha256:8900f4021049acc87f1def2490b1c2c86a63c075e006ad54fdd5cda3f3c1c6ed
Deleted: sha256:31440d606dc8a1b87a049ae6b04947b78f7adae4bcaefe40d0963bc3f4d249b2
Deleted: sha256:547d94614103adde997923e8e07b09d0808684dc6d274dfd58e568c0b0440675
ERROR: (gcloud.container.images.untag) Image could not be found:
[us.gcr.io/apache-beam-testing/java-postcommit-it/java:20211030120109]
FAILURE: Build failed with an exception.
* Where:
Build file
'<https://ci-beam.apache.org/job/beam_PostCommit_Java_Nexmark_Dataflow_V2/ws/src/runners/google-cloud-dataflow-java/build.gradle'>
line: 278
* What went wrong:
Execution failed for task
':runners:google-cloud-dataflow-java:cleanUpDockerImages'.
> Process 'command 'gcloud'' finished with non-zero exit value 1
* Try:
Run with --stacktrace option to get the stack trace. Run with --info or --debug
option to get more log output. Run with --scan to get full insights.
* Get more help at https://help.gradle.org
Deprecated Gradle features were used in this build, making it incompatible with
Gradle 7.0.
Use '--warning-mode all' to show the individual deprecation warnings.
See
https://docs.gradle.org/6.9.1/userguide/command_line_interface.html#sec:command_line_warnings
BUILD FAILED in 12m 7s
128 actionable tasks: 90 executed, 36 from cache, 2 up-to-date
Publishing build scan...
https://gradle.com/s/5gwotd7lnf3pg
Build step 'Invoke Gradle script' changed build result to FAILURE
Build step 'Invoke Gradle script' marked build as failure
---------------------------------------------------------------------
To unsubscribe, e-mail: [email protected]
For additional commands, e-mail: [email protected]
