See
<https://ci-beam.apache.org/job/beam_PostCommit_Java_Nexmark_Dataflow_V2/852/display/redirect?page=changes>
Changes:
[arietis27] [BEAM-13517] Unable to write nulls to columns with logical types
------------------------------------------
[...truncated 245.42 KB...]
==========================================================================================
Run started 2021-12-23T12:05:34.327Z and ran for PT404.951S
Default configuration:
{"debug":true,"query":null,"sourceType":"DIRECT","generateEventFilePathPrefix":null,"sinkType":"DEVNULL","exportSummaryToBigQuery":false,"pubSubMode":"COMBINED","pubsubMessageSerializationMethod":"CODER","sideInputType":"DIRECT","sideInputRowCount":500,"sideInputNumShards":3,"sideInputUrl":null,"sessionGap":600000,"numEvents":100000,"numEventGenerators":100,"rateShape":"SINE","firstEventRate":10000,"nextEventRate":10000,"rateUnit":"PER_SECOND","ratePeriodSec":600,"preloadSeconds":0,"streamTimeout":240,"isRateLimited":false,"useWallclockEventTime":false,"avgPersonByteSize":200,"avgAuctionByteSize":500,"avgBidByteSize":100,"hotAuctionRatio":2,"hotSellersRatio":4,"hotBiddersRatio":4,"windowSizeSec":10,"windowPeriodSec":5,"watermarkHoldbackSec":0,"numInFlightAuctions":100,"numActivePeople":1000,"coderStrategy":"HAND","cpuDelayMs":0,"diskBusyBytes":0,"auctionSkip":123,"fanout":5,"maxAuctionsWaitingTime":600,"occasionalDelaySec":3,"probDelayedEvent":0.1,"maxLogEvents":100000,"usePubsubPublishTime":false,"outOfOrderGroupSize":1,"numKeyBuckets":20000,"pardoCPUFactor":1.0}
Configurations:
Conf Description
0000 query:PASSTHROUGH; numEvents:10000000
0001 query:CURRENCY_CONVERSION; numEvents:10000000
0002 query:SELECTION; numEvents:10000000
0003 query:LOCAL_ITEM_SUGGESTION; numEvents:10000000
0004 query:AVERAGE_PRICE_FOR_CATEGORY; numEvents:1000000
0005 query:HOT_ITEMS; numEvents:10000000
0006 query:AVERAGE_SELLING_PRICE_BY_SELLER; numEvents:1000000
0007 query:HIGHEST_BID; numEvents:10000000
0008 query:MONITOR_NEW_USERS; numEvents:10000000
0009 query:WINNING_BIDS; numEvents:1000000
0010 query:LOG_TO_SHARDED_FILES; numEvents:10000000
0011 query:USER_SESSIONS; numEvents:10000000
0012 query:PROCESSING_TIME_WINDOWS; numEvents:10000000
0013 query:PORTABILITY_BATCH; numEvents:10000000
0014 query:BOUNDED_SIDE_INPUT_JOIN; numEvents:10000000
0015 query:SESSION_SIDE_INPUT_JOIN; numEvents:10000000
Performance:
Conf Runtime(sec) (Baseline) Events(/sec) (Baseline) Results
(Baseline)
0000 24.5 407547.8 10000000
0001 19.9 501705.8 9200000
0002 12.5 801731.7 83527
0003 *** not run ***
0004 *** not run ***
0005 30.1 332060.4 4567
0006 *** not run ***
0007 *** not run ***
0008 18.0 556514.0 92833
0009 *** not run ***
0010 41.6 240159.5 100
0011 *** not run ***
0012 14.7 679209.4 199929
0013 *** not run ***
0014 *** not run ***
0015 *** not run ***
==========================================================================================
2021-12-23T12:12:19.363Z no activity
2021-12-23T12:12:19.848Z no activity
2021-12-23T12:12:35.184Z RUNNING Query13
2021-12-23T12:12:35.227Z DONE Query11
==========================================================================================
Run started 2021-12-23T12:05:34.327Z and ran for PT420.923S
Default configuration:
{"debug":true,"query":null,"sourceType":"DIRECT","generateEventFilePathPrefix":null,"sinkType":"DEVNULL","exportSummaryToBigQuery":false,"pubSubMode":"COMBINED","pubsubMessageSerializationMethod":"CODER","sideInputType":"DIRECT","sideInputRowCount":500,"sideInputNumShards":3,"sideInputUrl":null,"sessionGap":600000,"numEvents":100000,"numEventGenerators":100,"rateShape":"SINE","firstEventRate":10000,"nextEventRate":10000,"rateUnit":"PER_SECOND","ratePeriodSec":600,"preloadSeconds":0,"streamTimeout":240,"isRateLimited":false,"useWallclockEventTime":false,"avgPersonByteSize":200,"avgAuctionByteSize":500,"avgBidByteSize":100,"hotAuctionRatio":2,"hotSellersRatio":4,"hotBiddersRatio":4,"windowSizeSec":10,"windowPeriodSec":5,"watermarkHoldbackSec":0,"numInFlightAuctions":100,"numActivePeople":1000,"coderStrategy":"HAND","cpuDelayMs":0,"diskBusyBytes":0,"auctionSkip":123,"fanout":5,"maxAuctionsWaitingTime":600,"occasionalDelaySec":3,"probDelayedEvent":0.1,"maxLogEvents":100000,"usePubsubPublishTime":false,"outOfOrderGroupSize":1,"numKeyBuckets":20000,"pardoCPUFactor":1.0}
Configurations:
Conf Description
0000 query:PASSTHROUGH; numEvents:10000000
0001 query:CURRENCY_CONVERSION; numEvents:10000000
0002 query:SELECTION; numEvents:10000000
0003 query:LOCAL_ITEM_SUGGESTION; numEvents:10000000
0004 query:AVERAGE_PRICE_FOR_CATEGORY; numEvents:1000000
0005 query:HOT_ITEMS; numEvents:10000000
0006 query:AVERAGE_SELLING_PRICE_BY_SELLER; numEvents:1000000
0007 query:HIGHEST_BID; numEvents:10000000
0008 query:MONITOR_NEW_USERS; numEvents:10000000
0009 query:WINNING_BIDS; numEvents:1000000
0010 query:LOG_TO_SHARDED_FILES; numEvents:10000000
0011 query:USER_SESSIONS; numEvents:10000000
0012 query:PROCESSING_TIME_WINDOWS; numEvents:10000000
0013 query:PORTABILITY_BATCH; numEvents:10000000
0014 query:BOUNDED_SIDE_INPUT_JOIN; numEvents:10000000
0015 query:SESSION_SIDE_INPUT_JOIN; numEvents:10000000
Performance:
Conf Runtime(sec) (Baseline) Events(/sec) (Baseline) Results
(Baseline)
0000 24.5 407547.8 10000000
0001 19.9 501705.8 9200000
0002 12.5 801731.7 83527
0003 *** not run ***
0004 *** not run ***
0005 30.1 332060.4 4567
0006 *** not run ***
0007 *** not run ***
0008 18.0 556514.0 92833
0009 *** not run ***
0010 41.6 240159.5 100
0011 37.7 265421.0 1839657
0012 14.7 679209.4 199929
0013 *** not run ***
0014 *** not run ***
0015 *** not run ***
==========================================================================================
2021-12-23T12:12:36.125Z no activity
2021-12-23T12:12:51.163Z DONE Query13
==========================================================================================
Run started 2021-12-23T12:05:34.327Z and ran for PT436.860S
Default configuration:
{"debug":true,"query":null,"sourceType":"DIRECT","generateEventFilePathPrefix":null,"sinkType":"DEVNULL","exportSummaryToBigQuery":false,"pubSubMode":"COMBINED","pubsubMessageSerializationMethod":"CODER","sideInputType":"DIRECT","sideInputRowCount":500,"sideInputNumShards":3,"sideInputUrl":null,"sessionGap":600000,"numEvents":100000,"numEventGenerators":100,"rateShape":"SINE","firstEventRate":10000,"nextEventRate":10000,"rateUnit":"PER_SECOND","ratePeriodSec":600,"preloadSeconds":0,"streamTimeout":240,"isRateLimited":false,"useWallclockEventTime":false,"avgPersonByteSize":200,"avgAuctionByteSize":500,"avgBidByteSize":100,"hotAuctionRatio":2,"hotSellersRatio":4,"hotBiddersRatio":4,"windowSizeSec":10,"windowPeriodSec":5,"watermarkHoldbackSec":0,"numInFlightAuctions":100,"numActivePeople":1000,"coderStrategy":"HAND","cpuDelayMs":0,"diskBusyBytes":0,"auctionSkip":123,"fanout":5,"maxAuctionsWaitingTime":600,"occasionalDelaySec":3,"probDelayedEvent":0.1,"maxLogEvents":100000,"usePubsubPublishTime":false,"outOfOrderGroupSize":1,"numKeyBuckets":20000,"pardoCPUFactor":1.0}
Configurations:
Conf Description
0000 query:PASSTHROUGH; numEvents:10000000
0001 query:CURRENCY_CONVERSION; numEvents:10000000
0002 query:SELECTION; numEvents:10000000
0003 query:LOCAL_ITEM_SUGGESTION; numEvents:10000000
0004 query:AVERAGE_PRICE_FOR_CATEGORY; numEvents:1000000
0005 query:HOT_ITEMS; numEvents:10000000
0006 query:AVERAGE_SELLING_PRICE_BY_SELLER; numEvents:1000000
0007 query:HIGHEST_BID; numEvents:10000000
0008 query:MONITOR_NEW_USERS; numEvents:10000000
0009 query:WINNING_BIDS; numEvents:1000000
0010 query:LOG_TO_SHARDED_FILES; numEvents:10000000
0011 query:USER_SESSIONS; numEvents:10000000
0012 query:PROCESSING_TIME_WINDOWS; numEvents:10000000
0013 query:PORTABILITY_BATCH; numEvents:10000000
0014 query:BOUNDED_SIDE_INPUT_JOIN; numEvents:10000000
0015 query:SESSION_SIDE_INPUT_JOIN; numEvents:10000000
Performance:
Conf Runtime(sec) (Baseline) Events(/sec) (Baseline) Results
(Baseline)
0000 24.5 407547.8 10000000
0001 19.9 501705.8 9200000
0002 12.5 801731.7 83527
0003 *** not run ***
0004 *** not run ***
0005 30.1 332060.4 4567
0006 *** not run ***
0007 *** not run ***
0008 18.0 556514.0 92833
0009 *** not run ***
0010 41.6 240159.5 100
0011 37.7 265421.0 1839657
0012 14.7 679209.4 199929
0013 43.7 229047.8 10000000
0014 *** not run ***
0015 *** not run ***
==========================================================================================
==========================================================================================
Run started 2021-12-23T12:05:34.327Z and ran for PT437.065S
Default configuration:
{"debug":true,"query":null,"sourceType":"DIRECT","generateEventFilePathPrefix":null,"sinkType":"DEVNULL","exportSummaryToBigQuery":false,"pubSubMode":"COMBINED","pubsubMessageSerializationMethod":"CODER","sideInputType":"DIRECT","sideInputRowCount":500,"sideInputNumShards":3,"sideInputUrl":null,"sessionGap":600000,"numEvents":100000,"numEventGenerators":100,"rateShape":"SINE","firstEventRate":10000,"nextEventRate":10000,"rateUnit":"PER_SECOND","ratePeriodSec":600,"preloadSeconds":0,"streamTimeout":240,"isRateLimited":false,"useWallclockEventTime":false,"avgPersonByteSize":200,"avgAuctionByteSize":500,"avgBidByteSize":100,"hotAuctionRatio":2,"hotSellersRatio":4,"hotBiddersRatio":4,"windowSizeSec":10,"windowPeriodSec":5,"watermarkHoldbackSec":0,"numInFlightAuctions":100,"numActivePeople":1000,"coderStrategy":"HAND","cpuDelayMs":0,"diskBusyBytes":0,"auctionSkip":123,"fanout":5,"maxAuctionsWaitingTime":600,"occasionalDelaySec":3,"probDelayedEvent":0.1,"maxLogEvents":100000,"usePubsubPublishTime":false,"outOfOrderGroupSize":1,"numKeyBuckets":20000,"pardoCPUFactor":1.0}
Configurations:
Conf Description
0000 query:PASSTHROUGH; numEvents:10000000
0001 query:CURRENCY_CONVERSION; numEvents:10000000
0002 query:SELECTION; numEvents:10000000
0003 query:LOCAL_ITEM_SUGGESTION; numEvents:10000000
0004 query:AVERAGE_PRICE_FOR_CATEGORY; numEvents:1000000
0005 query:HOT_ITEMS; numEvents:10000000
0006 query:AVERAGE_SELLING_PRICE_BY_SELLER; numEvents:1000000
0007 query:HIGHEST_BID; numEvents:10000000
0008 query:MONITOR_NEW_USERS; numEvents:10000000
0009 query:WINNING_BIDS; numEvents:1000000
0010 query:LOG_TO_SHARDED_FILES; numEvents:10000000
0011 query:USER_SESSIONS; numEvents:10000000
0012 query:PROCESSING_TIME_WINDOWS; numEvents:10000000
0013 query:PORTABILITY_BATCH; numEvents:10000000
0014 query:BOUNDED_SIDE_INPUT_JOIN; numEvents:10000000
0015 query:SESSION_SIDE_INPUT_JOIN; numEvents:10000000
Performance:
Conf Runtime(sec) (Baseline) Events(/sec) (Baseline) Results
(Baseline)
0000 24.5 407547.8 10000000
0001 19.9 501705.8 9200000
0002 12.5 801731.7 83527
0003 *** not run ***
0004 *** not run ***
0005 30.1 332060.4 4567
0006 *** not run ***
0007 *** not run ***
0008 18.0 556514.0 92833
0009 *** not run ***
0010 41.6 240159.5 100
0011 37.7 265421.0 1839657
0012 14.7 679209.4 199929
0013 43.7 229047.8 10000000
0014 *** not run ***
0015 *** not run ***
==========================================================================================
> Task :runners:google-cloud-dataflow-java:cleanUpDockerImages FAILED
Untagged: us.gcr.io/apache-beam-testing/java-postcommit-it/java:20211223120101
Untagged:
us.gcr.io/apache-beam-testing/java-postcommit-it/java@sha256:aced5bff59971961478f317c154db501b129a525bbe17716d32417199e019bb2
Deleted: sha256:7e5dfe2296c71d5d0423324c9e9e8ed21bb2ee21afc6048a29c84dcc3c7b31d2
Deleted: sha256:fabf1e78e775cc2aa7622b70a34e94399894d37349d0c2c28086b3324186616d
Deleted: sha256:1002c0919afa499db0b91307fbb20b30b3eb3b79b91cbacad14939203a202640
Deleted: sha256:63fcacefdec916758d46b3dda42b007395e940125f3d36595a164cc9887209a6
Deleted: sha256:84922d820bde81b63d5ad71daaa1a562ea1d8dce375e29811e13161d2591fabe
Deleted: sha256:d8eda39d0457b8d8f21749405da73bfb4ab5d60d30b30f39ddf1359b74d1b09b
Deleted: sha256:b5b5025b6402aa3df0bb3f61c5857820e1489db146f3988934d0618d8908db46
Deleted: sha256:2b27d3066be8281465b1062ee730c394173f8776b4b56f9afae681e409e539b7
Deleted: sha256:154ca3280f4ee5448679c0469138acc67ee89fe1c8c8c1eda86a43c31e7944ab
Deleted: sha256:c54f8fdb2fa954f1c4eaa7b61c288b0344133f713f9e5ae1130b44a5fe98b4b4
Deleted: sha256:c185444e6686be8aa4044c504e547093ff9b28e81ab3078c4a388db82b53eb22
Deleted: sha256:d3b64ab896e37ff9dd361eecfc8d4719cb1b51090c5b6ad0a33b83768c603f9b
Deleted: sha256:364834025237210d1c00d7f2bc6c67ec9052f7ebd6e57f637e332c881c6bd9fe
Deleted: sha256:154b8e512df43320b84b43ed43682a6de1b4f085ee316e34b622f60f6241d684
Deleted: sha256:b3146538f2e7b4ac3a13f7b291648da3ccfff39851c05d017b1fcef4e404b31e
Deleted: sha256:621ef784cca10dd6e72018526dbba398ec1a906354e219266acfea2b51d7fba1
Deleted: sha256:17c5f12d6d2908aa45a17568daeabd653c210b9e6613a81d843ce1ca3f37dc96
Deleted: sha256:8c1eade520c554e31c79a0c9dcaa52e397ee37882c162bd213ce735f17899462
Deleted: sha256:d038c0ddd036293d5d31f6a16ca97cc0f7b4372dd87e51512725a901882efa9c
Deleted: sha256:2f8989ff2ded59a991784d5d4aaf31fc3c52e126a93ec0cab1450366aed78dab
Deleted: sha256:675cea3e2119e59ef68c46f2c5f63a14f2ff5e6bd8e311cfc55e37a8d094f888
Deleted: sha256:6f609c09d6c8de5ee1d8dccc4ab0f8e55c0f42f4840e7ee61a2dbd1f144e7f95
Deleted: sha256:3ba5c04a7ad0c5d7b0b7e45d70a092ff1236abd1da382466c4adbe69201d315b
Deleted: sha256:cbbfe5f8b35ba8a2ef7554813f8d2e915049419cae9b94b7fce4658ba1855001
Deleted: sha256:dd6226848c94f8688a9e771e94f5576dd22c58c43b9ffb026a168c0c219483cf
Deleted: sha256:6a572dcd6ea2b70f54abe7adc4e7d28313ef3be475660388787b1a5c6472a9e4
Deleted: sha256:0be6e7f64892c2896679c4c55f288056f4a4cd98625f3f317bcabe8f44a84411
Deleted: sha256:83102b29c08e02ded30066e7fff8b128a801743fe815066f052cedc4a3b0a5ca
ERROR: (gcloud.container.images.untag) Image could not be found:
[us.gcr.io/apache-beam-testing/java-postcommit-it/java:20211223120101]
FAILURE: Build failed with an exception.
* Where:
Build file
'<https://ci-beam.apache.org/job/beam_PostCommit_Java_Nexmark_Dataflow_V2/ws/src/runners/google-cloud-dataflow-java/build.gradle'>
line: 278
* What went wrong:
Execution failed for task
':runners:google-cloud-dataflow-java:cleanUpDockerImages'.
> Process 'command 'gcloud'' finished with non-zero exit value 1
* Try:
Run with --stacktrace option to get the stack trace. Run with --info or --debug
option to get more log output. Run with --scan to get full insights.
* Get more help at https://help.gradle.org
Deprecated Gradle features were used in this build, making it incompatible with
Gradle 7.0.
Use '--warning-mode all' to show the individual deprecation warnings.
See
https://docs.gradle.org/6.9.1/userguide/command_line_interface.html#sec:command_line_warnings
BUILD FAILED in 12m 24s
99 actionable tasks: 60 executed, 37 from cache, 2 up-to-date
Publishing build scan...
https://gradle.com/s/fzkubywmjnggu
Build step 'Invoke Gradle script' changed build result to FAILURE
Build step 'Invoke Gradle script' marked build as failure
---------------------------------------------------------------------
To unsubscribe, e-mail: [email protected]
For additional commands, e-mail: [email protected]