See
<https://ci-beam.apache.org/job/beam_PostCommit_Java_Nexmark_Dataflow_V2/855/display/redirect?page=changes>
Changes:
[noreply] [BEAM-13490] Bump log4j version to 2.17.0 (#16276)
------------------------------------------
[...truncated 246.22 KB...]
0001 query:CURRENCY_CONVERSION; numEvents:10000000
0002 query:SELECTION; numEvents:10000000
0003 query:LOCAL_ITEM_SUGGESTION; numEvents:10000000
0004 query:AVERAGE_PRICE_FOR_CATEGORY; numEvents:1000000
0005 query:HOT_ITEMS; numEvents:10000000
0006 query:AVERAGE_SELLING_PRICE_BY_SELLER; numEvents:1000000
0007 query:HIGHEST_BID; numEvents:10000000
0008 query:MONITOR_NEW_USERS; numEvents:10000000
0009 query:WINNING_BIDS; numEvents:1000000
0010 query:LOG_TO_SHARDED_FILES; numEvents:10000000
0011 query:USER_SESSIONS; numEvents:10000000
0012 query:PROCESSING_TIME_WINDOWS; numEvents:10000000
0013 query:PORTABILITY_BATCH; numEvents:10000000
0014 query:BOUNDED_SIDE_INPUT_JOIN; numEvents:10000000
0015 query:SESSION_SIDE_INPUT_JOIN; numEvents:10000000
Performance:
Conf Runtime(sec) (Baseline) Events(/sec) (Baseline) Results
(Baseline)
0000 23.9 417903.0 10000000
0001 *** not run ***
0002 11.2 894934.7 83527
0003 *** not run ***
0004 *** not run ***
0005 *** not run ***
0006 *** not run ***
0007 *** not run ***
0008 18.7 535934.4 92833
0009 *** not run ***
0010 46.9 213124.2 100
0011 38.2 261752.7 1839657
0012 15.8 632031.3 199929
0013 41.1 243037.0 10000000
0014 *** not run ***
0015 *** not run ***
==========================================================================================
2021-12-24T06:16:40.547Z RUNNING Query1
2021-12-24T06:16:40.761Z RUNNING Query5
2021-12-24T06:16:41.109Z no activity
2021-12-24T06:16:41.384Z no activity
2021-12-24T06:16:56.143Z DONE Query1
==========================================================================================
Run started 2021-12-24T06:10:44.833Z and ran for PT371.341S
Default configuration:
{"debug":true,"query":null,"sourceType":"DIRECT","generateEventFilePathPrefix":null,"sinkType":"DEVNULL","exportSummaryToBigQuery":false,"pubSubMode":"COMBINED","pubsubMessageSerializationMethod":"CODER","sideInputType":"DIRECT","sideInputRowCount":500,"sideInputNumShards":3,"sideInputUrl":null,"sessionGap":600000,"numEvents":100000,"numEventGenerators":100,"rateShape":"SINE","firstEventRate":10000,"nextEventRate":10000,"rateUnit":"PER_SECOND","ratePeriodSec":600,"preloadSeconds":0,"streamTimeout":240,"isRateLimited":false,"useWallclockEventTime":false,"avgPersonByteSize":200,"avgAuctionByteSize":500,"avgBidByteSize":100,"hotAuctionRatio":2,"hotSellersRatio":4,"hotBiddersRatio":4,"windowSizeSec":10,"windowPeriodSec":5,"watermarkHoldbackSec":0,"numInFlightAuctions":100,"numActivePeople":1000,"coderStrategy":"HAND","cpuDelayMs":0,"diskBusyBytes":0,"auctionSkip":123,"fanout":5,"maxAuctionsWaitingTime":600,"occasionalDelaySec":3,"probDelayedEvent":0.1,"maxLogEvents":100000,"usePubsubPublishTime":false,"outOfOrderGroupSize":1,"numKeyBuckets":20000,"pardoCPUFactor":1.0}
Configurations:
Conf Description
0000 query:PASSTHROUGH; numEvents:10000000
0001 query:CURRENCY_CONVERSION; numEvents:10000000
0002 query:SELECTION; numEvents:10000000
0003 query:LOCAL_ITEM_SUGGESTION; numEvents:10000000
0004 query:AVERAGE_PRICE_FOR_CATEGORY; numEvents:1000000
0005 query:HOT_ITEMS; numEvents:10000000
0006 query:AVERAGE_SELLING_PRICE_BY_SELLER; numEvents:1000000
0007 query:HIGHEST_BID; numEvents:10000000
0008 query:MONITOR_NEW_USERS; numEvents:10000000
0009 query:WINNING_BIDS; numEvents:1000000
0010 query:LOG_TO_SHARDED_FILES; numEvents:10000000
0011 query:USER_SESSIONS; numEvents:10000000
0012 query:PROCESSING_TIME_WINDOWS; numEvents:10000000
0013 query:PORTABILITY_BATCH; numEvents:10000000
0014 query:BOUNDED_SIDE_INPUT_JOIN; numEvents:10000000
0015 query:SESSION_SIDE_INPUT_JOIN; numEvents:10000000
Performance:
Conf Runtime(sec) (Baseline) Events(/sec) (Baseline) Results
(Baseline)
0000 23.9 417903.0 10000000
0001 17.0 589309.9 9200000
0002 11.2 894934.7 83527
0003 *** not run ***
0004 *** not run ***
0005 *** not run ***
0006 *** not run ***
0007 *** not run ***
0008 18.7 535934.4 92833
0009 *** not run ***
0010 46.9 213124.2 100
0011 38.2 261752.7 1839657
0012 15.8 632031.3 199929
0013 41.1 243037.0 10000000
0014 *** not run ***
0015 *** not run ***
==========================================================================================
2021-12-24T06:16:56.411Z DONE Query5
==========================================================================================
Run started 2021-12-24T06:10:44.833Z and ran for PT371.602S
Default configuration:
{"debug":true,"query":null,"sourceType":"DIRECT","generateEventFilePathPrefix":null,"sinkType":"DEVNULL","exportSummaryToBigQuery":false,"pubSubMode":"COMBINED","pubsubMessageSerializationMethod":"CODER","sideInputType":"DIRECT","sideInputRowCount":500,"sideInputNumShards":3,"sideInputUrl":null,"sessionGap":600000,"numEvents":100000,"numEventGenerators":100,"rateShape":"SINE","firstEventRate":10000,"nextEventRate":10000,"rateUnit":"PER_SECOND","ratePeriodSec":600,"preloadSeconds":0,"streamTimeout":240,"isRateLimited":false,"useWallclockEventTime":false,"avgPersonByteSize":200,"avgAuctionByteSize":500,"avgBidByteSize":100,"hotAuctionRatio":2,"hotSellersRatio":4,"hotBiddersRatio":4,"windowSizeSec":10,"windowPeriodSec":5,"watermarkHoldbackSec":0,"numInFlightAuctions":100,"numActivePeople":1000,"coderStrategy":"HAND","cpuDelayMs":0,"diskBusyBytes":0,"auctionSkip":123,"fanout":5,"maxAuctionsWaitingTime":600,"occasionalDelaySec":3,"probDelayedEvent":0.1,"maxLogEvents":100000,"usePubsubPublishTime":false,"outOfOrderGroupSize":1,"numKeyBuckets":20000,"pardoCPUFactor":1.0}
Configurations:
Conf Description
0000 query:PASSTHROUGH; numEvents:10000000
0001 query:CURRENCY_CONVERSION; numEvents:10000000
0002 query:SELECTION; numEvents:10000000
0003 query:LOCAL_ITEM_SUGGESTION; numEvents:10000000
0004 query:AVERAGE_PRICE_FOR_CATEGORY; numEvents:1000000
0005 query:HOT_ITEMS; numEvents:10000000
0006 query:AVERAGE_SELLING_PRICE_BY_SELLER; numEvents:1000000
0007 query:HIGHEST_BID; numEvents:10000000
0008 query:MONITOR_NEW_USERS; numEvents:10000000
0009 query:WINNING_BIDS; numEvents:1000000
0010 query:LOG_TO_SHARDED_FILES; numEvents:10000000
0011 query:USER_SESSIONS; numEvents:10000000
0012 query:PROCESSING_TIME_WINDOWS; numEvents:10000000
0013 query:PORTABILITY_BATCH; numEvents:10000000
0014 query:BOUNDED_SIDE_INPUT_JOIN; numEvents:10000000
0015 query:SESSION_SIDE_INPUT_JOIN; numEvents:10000000
Performance:
Conf Runtime(sec) (Baseline) Events(/sec) (Baseline) Results
(Baseline)
0000 23.9 417903.0 10000000
0001 17.0 589309.9 9200000
0002 11.2 894934.7 83527
0003 *** not run ***
0004 *** not run ***
0005 28.5 351333.3 4567
0006 *** not run ***
0007 *** not run ***
0008 18.7 535934.4 92833
0009 *** not run ***
0010 46.9 213124.2 100
0011 38.2 261752.7 1839657
0012 15.8 632031.3 199929
0013 41.1 243037.0 10000000
0014 *** not run ***
0015 *** not run ***
==========================================================================================
==========================================================================================
Run started 2021-12-24T06:10:44.833Z and ran for PT371.843S
Default configuration:
{"debug":true,"query":null,"sourceType":"DIRECT","generateEventFilePathPrefix":null,"sinkType":"DEVNULL","exportSummaryToBigQuery":false,"pubSubMode":"COMBINED","pubsubMessageSerializationMethod":"CODER","sideInputType":"DIRECT","sideInputRowCount":500,"sideInputNumShards":3,"sideInputUrl":null,"sessionGap":600000,"numEvents":100000,"numEventGenerators":100,"rateShape":"SINE","firstEventRate":10000,"nextEventRate":10000,"rateUnit":"PER_SECOND","ratePeriodSec":600,"preloadSeconds":0,"streamTimeout":240,"isRateLimited":false,"useWallclockEventTime":false,"avgPersonByteSize":200,"avgAuctionByteSize":500,"avgBidByteSize":100,"hotAuctionRatio":2,"hotSellersRatio":4,"hotBiddersRatio":4,"windowSizeSec":10,"windowPeriodSec":5,"watermarkHoldbackSec":0,"numInFlightAuctions":100,"numActivePeople":1000,"coderStrategy":"HAND","cpuDelayMs":0,"diskBusyBytes":0,"auctionSkip":123,"fanout":5,"maxAuctionsWaitingTime":600,"occasionalDelaySec":3,"probDelayedEvent":0.1,"maxLogEvents":100000,"usePubsubPublishTime":false,"outOfOrderGroupSize":1,"numKeyBuckets":20000,"pardoCPUFactor":1.0}
Configurations:
Conf Description
0000 query:PASSTHROUGH; numEvents:10000000
0001 query:CURRENCY_CONVERSION; numEvents:10000000
0002 query:SELECTION; numEvents:10000000
0003 query:LOCAL_ITEM_SUGGESTION; numEvents:10000000
0004 query:AVERAGE_PRICE_FOR_CATEGORY; numEvents:1000000
0005 query:HOT_ITEMS; numEvents:10000000
0006 query:AVERAGE_SELLING_PRICE_BY_SELLER; numEvents:1000000
0007 query:HIGHEST_BID; numEvents:10000000
0008 query:MONITOR_NEW_USERS; numEvents:10000000
0009 query:WINNING_BIDS; numEvents:1000000
0010 query:LOG_TO_SHARDED_FILES; numEvents:10000000
0011 query:USER_SESSIONS; numEvents:10000000
0012 query:PROCESSING_TIME_WINDOWS; numEvents:10000000
0013 query:PORTABILITY_BATCH; numEvents:10000000
0014 query:BOUNDED_SIDE_INPUT_JOIN; numEvents:10000000
0015 query:SESSION_SIDE_INPUT_JOIN; numEvents:10000000
Performance:
Conf Runtime(sec) (Baseline) Events(/sec) (Baseline) Results
(Baseline)
0000 23.9 417903.0 10000000
0001 17.0 589309.9 9200000
0002 11.2 894934.7 83527
0003 *** not run ***
0004 *** not run ***
0005 28.5 351333.3 4567
0006 *** not run ***
0007 *** not run ***
0008 18.7 535934.4 92833
0009 *** not run ***
0010 46.9 213124.2 100
0011 38.2 261752.7 1839657
0012 15.8 632031.3 199929
0013 41.1 243037.0 10000000
0014 *** not run ***
0015 *** not run ***
==========================================================================================
> Task :runners:google-cloud-dataflow-java:cleanUpDockerImages
Untagged: us.gcr.io/apache-beam-testing/java-postcommit-it/java:20211224060117
Untagged:
us.gcr.io/apache-beam-testing/java-postcommit-it/java@sha256:22f134a76026e4eb3d8b35d7b9ceb81dae979b6bbc4cb5a6f9edbf8079353dd5
Deleted: sha256:73c4c60b6e0baa4381a11a2710f656090cead1918fed48f27e845456ab012bf8
Deleted: sha256:8ba106b87e84b8bcbf103370554b197edcfe6cfd050a756b5ded2116dafc6b5d
Deleted: sha256:26d1b6c61b1286c4f670ccab69169a7ad9a96b3b45bc1a165b40d4d0d0bb46cb
Deleted: sha256:c023006583d30b034462cb08f8132ca8bd026b0e4cb1074d120dbb9a191e10f3
Deleted: sha256:238284bd062ab4cce960e6ce6e1427a8ca215c8af9d68b232339830b7effbc11
Deleted: sha256:005d2ad9a4650d05d5d220f6a8cf087e2015ea07119e0922a02ce862be00e8d4
Deleted: sha256:07bae885ec3f69e2c3ef7e61784721621f18a3205c66c7e3a764a7415e28e10b
Deleted: sha256:f65f121df0c04f09254c638b73b8a1510afbcd8833d597cc39ccdfb9079d5840
Deleted: sha256:b5aa1d7fb915e05f61a472fc73ea52a9a4498e5efaf8b3cd742433a42f015fcd
Deleted: sha256:c03d1cb7d33d60fe20ca8c36f76fa92561e1b84c8eb057f5553803f2fdb5b5e7
Deleted: sha256:f188fbbd5552118c47ccf8d22b2de3c4f48a223c7ea95e9f1381206fee941744
Deleted: sha256:5831e76c5ce797b5dd070ad02b1c1af334bdb9c2847da26c66b9d9f9786bebc8
Deleted: sha256:6799912ebfba578375f344cc95f46211d005dee440d278c7cd34af03e40fb803
Deleted: sha256:e61a8dab1c369880e060fdcc793c45d978f1ffdd40f64a72ea4ba264ffbe917e
Deleted: sha256:89b645383329c4be88f80cf2faa0bf769b5da799d925b5d27712df84f637c96e
Deleted: sha256:4acd849fd983016a1d7a4e8ba6e8353f111987cea4b2ebed50edb25806f3e212
Deleted: sha256:a0de8ae1d70c0fc76bdfed12f0aaf238227568b1cc85b12f6d478b5f56444728
Deleted: sha256:59721703aa64beb30bcd7d389dafe8d95f18a920d94243b03ed5e8b0bd0b41e5
Deleted: sha256:4360fd0613e0602b33e3f88df46578cd9195c0a80e193d680eca627d61685913
Deleted: sha256:a54c87e62a75c0edc2e421146b07643459472259a88c50ff8dab4e68c6fa0fd8
Deleted: sha256:7d42fe9628a77d8edb4f16a2d98ca84f0033ab7810045df8155345e1fd0ead96
Deleted: sha256:7a1c3260561410bd630add2d34963a60f7ee59ebd319c9ad1f62da115cd73550
Deleted: sha256:f96d471381547b5a1076741f3a803dfb7e7c86d37f548746ca729e7d8fa23fbe
Deleted: sha256:9853ea04e7052672e377867c01d23a1f396b8f2010b2df7a0a6368d25d4bff21
Deleted: sha256:380769164711ebdc149eb71b01a308458dea83b90e77235deb6efdbea384ad8c
Deleted: sha256:a2e63b105cae61e14c20b6588165324bff3d646fd3cb48fa4a63384eae48f1d5
Deleted: sha256:6e0aed207092743fbca87ecb7bccb66ae5340d1f7b0d7e82a5674733cce04c34
Deleted: sha256:7c2bb473a3948fd4a5b8d611c13078bc04bf1d185a04963a3ac681706468a740
ERROR: (gcloud.container.images.untag) Image could not be found:
[us.gcr.io/apache-beam-testing/java-postcommit-it/java:20211224060117]
> Task :runners:google-cloud-dataflow-java:cleanUpDockerImages FAILED
FAILURE: Build failed with an exception.
* Where:
Build file
'<https://ci-beam.apache.org/job/beam_PostCommit_Java_Nexmark_Dataflow_V2/ws/src/runners/google-cloud-dataflow-java/build.gradle'>
line: 278
* What went wrong:
Execution failed for task
':runners:google-cloud-dataflow-java:cleanUpDockerImages'.
> Process 'command 'gcloud'' finished with non-zero exit value 1
* Try:
> Run with --stacktrace option to get the stack trace.
> Run with --info or --debug option to get more log output.
> Run with --scan to get full insights.
* Get more help at https://help.gradle.org
Deprecated Gradle features were used in this build, making it incompatible with
Gradle 8.0.
You can use '--warning-mode all' to show the individual deprecation warnings
and determine if they come from your own scripts or plugins.
See
https://docs.gradle.org/7.3.2/userguide/command_line_interface.html#sec:command_line_warnings
Execution optimizations have been disabled for 1 invalid unit(s) of work during
this build to ensure correctness.
Please consult deprecation warnings for more details.
BUILD FAILED in 16m 33s
109 actionable tasks: 64 executed, 41 from cache, 4 up-to-date
Publishing build scan...
https://gradle.com/s/yze2allvianbi
Build step 'Invoke Gradle script' changed build result to FAILURE
Build step 'Invoke Gradle script' marked build as failure
---------------------------------------------------------------------
To unsubscribe, e-mail: [email protected]
For additional commands, e-mail: [email protected]
