See <https://ci-beam.apache.org/job/beam_PostCommit_Java_Nexmark_Dataflow/7726/display/redirect>
Changes: ------------------------------------------ [...truncated 247.80 KB...] INFO: 2021-09-13T12:03:45.692Z: Worker configuration: e2-standard-2 in us-central1-c. Sep 13, 2021 12:03:46 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process SEVERE: 2021-09-13T12:03:46.517Z: Workflow failed. Causes: Project apache-beam-testing has insufficient quota(s) to execute this workflow with 1 instances in region us-central1. Quota summary (required/available): 1/24385 instances, 2/0 CPUs, 25/183691 disk GB, 0/2397 SSD disk GB, 1/288 instance groups, 1/291 managed instance groups, 1/517 instance templates, 1/614 in-use IP addresses. Please see https://cloud.google.com/compute/docs/resource-quotas about requesting more quota. Sep 13, 2021 12:03:46 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process INFO: 2021-09-13T12:03:46.581Z: Cleaning up. Sep 13, 2021 12:03:46 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process INFO: 2021-09-13T12:03:46.632Z: Worker pool stopped. Sep 13, 2021 12:03:48 PM org.apache.beam.runners.dataflow.DataflowPipelineJob logTerminalState INFO: Job 2021-09-13_05_03_15-6943279362546021343 failed with status FAILED. 2021-09-13T12:03:48.096Z Waiting for main pipeline to 'finish' 2021-09-13T12:03:48.097Z FAILED Query5 Sep 13, 2021 12:03:48 PM org.apache.beam.sdk.testutils.metrics.MetricsReader getCounterMetric SEVERE: Failed to get metric event.elements, from namespace Query5.Events Sep 13, 2021 12:03:48 PM org.apache.beam.sdk.testutils.metrics.MetricsReader getCounterMetric SEVERE: Failed to get metric event.bytes, from namespace Query5.Events Sep 13, 2021 12:03:48 PM org.apache.beam.sdk.testutils.metrics.MetricsReader getCounterMetric SEVERE: Failed to get metric result.elements, from namespace Query5.Results Sep 13, 2021 12:03:48 PM org.apache.beam.sdk.testutils.metrics.MetricsReader getCounterMetric SEVERE: Failed to get metric result.bytes, from namespace Query5.Results ========================================================================================== Run started 2021-09-13T12:02:35.433Z and ran for PT72.681S Default configuration: {"debug":true,"query":null,"sourceType":"DIRECT","generateEventFilePathPrefix":null,"sinkType":"DEVNULL","exportSummaryToBigQuery":false,"pubSubMode":"COMBINED","pubsubMessageSerializationMethod":"CODER","sideInputType":"DIRECT","sideInputRowCount":500,"sideInputNumShards":3,"sideInputUrl":null,"sessionGap":600000,"numEvents":100000,"numEventGenerators":100,"rateShape":"SINE","firstEventRate":10000,"nextEventRate":10000,"rateUnit":"PER_SECOND","ratePeriodSec":600,"preloadSeconds":0,"streamTimeout":240,"isRateLimited":false,"useWallclockEventTime":false,"avgPersonByteSize":200,"avgAuctionByteSize":500,"avgBidByteSize":100,"hotAuctionRatio":2,"hotSellersRatio":4,"hotBiddersRatio":4,"windowSizeSec":10,"windowPeriodSec":5,"watermarkHoldbackSec":0,"numInFlightAuctions":100,"numActivePeople":1000,"coderStrategy":"HAND","cpuDelayMs":0,"diskBusyBytes":0,"auctionSkip":123,"fanout":5,"maxAuctionsWaitingTime":600,"occasionalDelaySec":3,"probDelayedEvent":0.1,"maxLogEvents":100000,"usePubsubPublishTime":false,"outOfOrderGroupSize":1,"numKeyBuckets":20000,"pardoCPUFactor":1.0} Configurations: Conf Description 0000 query:PASSTHROUGH; exportSummaryToBigQuery:true; numEvents:10000000 0001 query:CURRENCY_CONVERSION; exportSummaryToBigQuery:true; numEvents:10000000 0002 query:SELECTION; exportSummaryToBigQuery:true; numEvents:10000000 0003 query:LOCAL_ITEM_SUGGESTION; exportSummaryToBigQuery:true; numEvents:10000000 0004 query:AVERAGE_PRICE_FOR_CATEGORY; exportSummaryToBigQuery:true; numEvents:1000000 0005 query:HOT_ITEMS; exportSummaryToBigQuery:true; numEvents:10000000 0006 query:AVERAGE_SELLING_PRICE_BY_SELLER; exportSummaryToBigQuery:true; numEvents:1000000 0007 query:HIGHEST_BID; exportSummaryToBigQuery:true; numEvents:10000000 0008 query:MONITOR_NEW_USERS; exportSummaryToBigQuery:true; numEvents:10000000 0009 query:WINNING_BIDS; exportSummaryToBigQuery:true; numEvents:1000000 0010 query:LOG_TO_SHARDED_FILES; exportSummaryToBigQuery:true; numEvents:10000000 0011 query:USER_SESSIONS; exportSummaryToBigQuery:true; numEvents:10000000 0012 query:PROCESSING_TIME_WINDOWS; exportSummaryToBigQuery:true; numEvents:10000000 0013 query:PORTABILITY_BATCH; exportSummaryToBigQuery:true; numEvents:10000000 0014 query:BOUNDED_SIDE_INPUT_JOIN; exportSummaryToBigQuery:true; numEvents:10000000 0015 query:SESSION_SIDE_INPUT_JOIN; exportSummaryToBigQuery:true; numEvents:10000000 Performance: Conf Runtime(sec) (Baseline) Events(/sec) (Baseline) Results (Baseline) 0000 -1.0 -1.0 -1 *** Job was unexpectedly updated *** 0001 -1.0 -1.0 -1 *** Job was unexpectedly updated *** 0002 -1.0 -1.0 -1 *** Job was unexpectedly updated *** 0003 -1.0 -1.0 -1 *** Job was unexpectedly updated *** 0004 -1.0 -1.0 -1 *** Job was unexpectedly updated *** 0005 -1.0 -1.0 -1 *** Job was unexpectedly updated *** 0006 -1.0 -1.0 -1 *** Job was unexpectedly updated *** 0007 -1.0 -1.0 -1 *** Job was unexpectedly updated *** 0008 -1.0 -1.0 -1 *** Job was unexpectedly updated *** 0009 -1.0 -1.0 -1 *** Job was unexpectedly updated *** 0010 *** not run *** 0011 -1.0 -1.0 -1 *** Job was unexpectedly updated *** 0012 -1.0 -1.0 -1 *** Job was unexpectedly updated *** 0013 -1.0 -1.0 -1 *** Job was unexpectedly updated *** 0014 -1.0 -1.0 -1 *** Job was unexpectedly updated *** 0015 -1.0 -1.0 -1 *** Job was unexpectedly updated *** ========================================================================================== Sep 13, 2021 12:03:49 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process INFO: 2021-09-13T12:03:47.831Z: Your project already contains 100 Dataflow-created metric descriptors, so new user metrics of the form custom.googleapis.com/* will not be created. However, all user metrics are also available in the metric dataflow.googleapis.com/job/user_counter. If you rely on the custom metrics, you can delete old / unused metric descriptors. See https://developers.google.com/apis-explorer/#p/monitoring/v3/monitoring.projects.metricDescriptors.list and https://developers.google.com/apis-explorer/#p/monitoring/v3/monitoring.projects.metricDescriptors.delete Sep 13, 2021 12:03:52 PM org.apache.beam.runners.dataflow.DataflowPipelineJob logTerminalState 2021-09-13T12:03:52.092Z INFO: Job 2021-09-13_05_03_15-1022443572616909820 failed with status FAILED. Waiting for main pipeline to 'finish' 2021-09-13T12:03:52.092Z FAILED Query10 Sep 13, 2021 12:03:52 PM org.apache.beam.sdk.testutils.metrics.MetricsReader getCounterMetric SEVERE: Failed to get metric event.elements, from namespace Query10.Events Sep 13, 2021 12:03:52 PM org.apache.beam.sdk.testutils.metrics.MetricsReader getCounterMetric SEVERE: Failed to get metric event.bytes, from namespace Query10.Events Sep 13, 2021 12:03:52 PM org.apache.beam.sdk.testutils.metrics.MetricsReader getCounterMetric SEVERE: Failed to get metric result.elements, from namespace Query10.Results Sep 13, 2021 12:03:52 PM org.apache.beam.sdk.testutils.metrics.MetricsReader getCounterMetric SEVERE: Failed to get metric result.bytes, from namespace Query10.Results ========================================================================================== Run started 2021-09-13T12:02:35.433Z and ran for PT76.679S Default configuration: {"debug":true,"query":null,"sourceType":"DIRECT","generateEventFilePathPrefix":null,"sinkType":"DEVNULL","exportSummaryToBigQuery":false,"pubSubMode":"COMBINED","pubsubMessageSerializationMethod":"CODER","sideInputType":"DIRECT","sideInputRowCount":500,"sideInputNumShards":3,"sideInputUrl":null,"sessionGap":600000,"numEvents":100000,"numEventGenerators":100,"rateShape":"SINE","firstEventRate":10000,"nextEventRate":10000,"rateUnit":"PER_SECOND","ratePeriodSec":600,"preloadSeconds":0,"streamTimeout":240,"isRateLimited":false,"useWallclockEventTime":false,"avgPersonByteSize":200,"avgAuctionByteSize":500,"avgBidByteSize":100,"hotAuctionRatio":2,"hotSellersRatio":4,"hotBiddersRatio":4,"windowSizeSec":10,"windowPeriodSec":5,"watermarkHoldbackSec":0,"numInFlightAuctions":100,"numActivePeople":1000,"coderStrategy":"HAND","cpuDelayMs":0,"diskBusyBytes":0,"auctionSkip":123,"fanout":5,"maxAuctionsWaitingTime":600,"occasionalDelaySec":3,"probDelayedEvent":0.1,"maxLogEvents":100000,"usePubsubPublishTime":false,"outOfOrderGroupSize":1,"numKeyBuckets":20000,"pardoCPUFactor":1.0} Configurations: Conf Description 0000 query:PASSTHROUGH; exportSummaryToBigQuery:true; numEvents:10000000 0001 query:CURRENCY_CONVERSION; exportSummaryToBigQuery:true; numEvents:10000000 0002 query:SELECTION; exportSummaryToBigQuery:true; numEvents:10000000 0003 query:LOCAL_ITEM_SUGGESTION; exportSummaryToBigQuery:true; numEvents:10000000 0004 query:AVERAGE_PRICE_FOR_CATEGORY; exportSummaryToBigQuery:true; numEvents:1000000 0005 query:HOT_ITEMS; exportSummaryToBigQuery:true; numEvents:10000000 0006 query:AVERAGE_SELLING_PRICE_BY_SELLER; exportSummaryToBigQuery:true; numEvents:1000000 0007 query:HIGHEST_BID; exportSummaryToBigQuery:true; numEvents:10000000 0008 query:MONITOR_NEW_USERS; exportSummaryToBigQuery:true; numEvents:10000000 0009 query:WINNING_BIDS; exportSummaryToBigQuery:true; numEvents:1000000 0010 query:LOG_TO_SHARDED_FILES; exportSummaryToBigQuery:true; numEvents:10000000 0011 query:USER_SESSIONS; exportSummaryToBigQuery:true; numEvents:10000000 0012 query:PROCESSING_TIME_WINDOWS; exportSummaryToBigQuery:true; numEvents:10000000 0013 query:PORTABILITY_BATCH; exportSummaryToBigQuery:true; numEvents:10000000 0014 query:BOUNDED_SIDE_INPUT_JOIN; exportSummaryToBigQuery:true; numEvents:10000000 0015 query:SESSION_SIDE_INPUT_JOIN; exportSummaryToBigQuery:true; numEvents:10000000 Performance: Conf Runtime(sec) (Baseline) Events(/sec) (Baseline) Results (Baseline) 0000 -1.0 -1.0 -1 *** Job was unexpectedly updated *** 0001 -1.0 -1.0 -1 *** Job was unexpectedly updated *** 0002 -1.0 -1.0 -1 *** Job was unexpectedly updated *** 0003 -1.0 -1.0 -1 *** Job was unexpectedly updated *** 0004 -1.0 -1.0 -1 *** Job was unexpectedly updated *** 0005 -1.0 -1.0 -1 *** Job was unexpectedly updated *** 0006 -1.0 -1.0 -1 *** Job was unexpectedly updated *** 0007 -1.0 -1.0 -1 *** Job was unexpectedly updated *** 0008 -1.0 -1.0 -1 *** Job was unexpectedly updated *** 0009 -1.0 -1.0 -1 *** Job was unexpectedly updated *** 0010 -1.0 -1.0 -1 *** Job was unexpectedly updated *** 0011 -1.0 -1.0 -1 *** Job was unexpectedly updated *** 0012 -1.0 -1.0 -1 *** Job was unexpectedly updated *** 0013 -1.0 -1.0 -1 *** Job was unexpectedly updated *** 0014 -1.0 -1.0 -1 *** Job was unexpectedly updated *** 0015 -1.0 -1.0 -1 *** Job was unexpectedly updated *** ========================================================================================== ========================================================================================== Run started 2021-09-13T12:02:35.433Z and ran for PT81.694S Default configuration: {"debug":true,"query":null,"sourceType":"DIRECT","generateEventFilePathPrefix":null,"sinkType":"DEVNULL","exportSummaryToBigQuery":false,"pubSubMode":"COMBINED","pubsubMessageSerializationMethod":"CODER","sideInputType":"DIRECT","sideInputRowCount":500,"sideInputNumShards":3,"sideInputUrl":null,"sessionGap":600000,"numEvents":100000,"numEventGenerators":100,"rateShape":"SINE","firstEventRate":10000,"nextEventRate":10000,"rateUnit":"PER_SECOND","ratePeriodSec":600,"preloadSeconds":0,"streamTimeout":240,"isRateLimited":false,"useWallclockEventTime":false,"avgPersonByteSize":200,"avgAuctionByteSize":500,"avgBidByteSize":100,"hotAuctionRatio":2,"hotSellersRatio":4,"hotBiddersRatio":4,"windowSizeSec":10,"windowPeriodSec":5,"watermarkHoldbackSec":0,"numInFlightAuctions":100,"numActivePeople":1000,"coderStrategy":"HAND","cpuDelayMs":0,"diskBusyBytes":0,"auctionSkip":123,"fanout":5,"maxAuctionsWaitingTime":600,"occasionalDelaySec":3,"probDelayedEvent":0.1,"maxLogEvents":100000,"usePubsubPublishTime":false,"outOfOrderGroupSize":1,"numKeyBuckets":20000,"pardoCPUFactor":1.0} Configurations: Conf Description 0000 query:PASSTHROUGH; exportSummaryToBigQuery:true; numEvents:10000000 0001 query:CURRENCY_CONVERSION; exportSummaryToBigQuery:true; numEvents:10000000 0002 query:SELECTION; exportSummaryToBigQuery:true; numEvents:10000000 0003 query:LOCAL_ITEM_SUGGESTION; exportSummaryToBigQuery:true; numEvents:10000000 0004 query:AVERAGE_PRICE_FOR_CATEGORY; exportSummaryToBigQuery:true; numEvents:1000000 0005 query:HOT_ITEMS; exportSummaryToBigQuery:true; numEvents:10000000 0006 query:AVERAGE_SELLING_PRICE_BY_SELLER; exportSummaryToBigQuery:true; numEvents:1000000 0007 query:HIGHEST_BID; exportSummaryToBigQuery:true; numEvents:10000000 0008 query:MONITOR_NEW_USERS; exportSummaryToBigQuery:true; numEvents:10000000 0009 query:WINNING_BIDS; exportSummaryToBigQuery:true; numEvents:1000000 0010 query:LOG_TO_SHARDED_FILES; exportSummaryToBigQuery:true; numEvents:10000000 0011 query:USER_SESSIONS; exportSummaryToBigQuery:true; numEvents:10000000 0012 query:PROCESSING_TIME_WINDOWS; exportSummaryToBigQuery:true; numEvents:10000000 0013 query:PORTABILITY_BATCH; exportSummaryToBigQuery:true; numEvents:10000000 0014 query:BOUNDED_SIDE_INPUT_JOIN; exportSummaryToBigQuery:true; numEvents:10000000 0015 query:SESSION_SIDE_INPUT_JOIN; exportSummaryToBigQuery:true; numEvents:10000000 Performance: Conf Runtime(sec) (Baseline) Events(/sec) (Baseline) Results (Baseline) 0000 -1.0 -1.0 -1 *** Job was unexpectedly updated *** 0001 -1.0 -1.0 -1 *** Job was unexpectedly updated *** 0002 -1.0 -1.0 -1 *** Job was unexpectedly updated *** 0003 -1.0 -1.0 -1 *** Job was unexpectedly updated *** 0004 -1.0 -1.0 -1 *** Job was unexpectedly updated *** 0005 -1.0 -1.0 -1 *** Job was unexpectedly updated *** 0006 -1.0 -1.0 -1 *** Job was unexpectedly updated *** 0007 -1.0 -1.0 -1 *** Job was unexpectedly updated *** 0008 -1.0 -1.0 -1 *** Job was unexpectedly updated *** 0009 -1.0 -1.0 -1 *** Job was unexpectedly updated *** 0010 -1.0 -1.0 -1 *** Job was unexpectedly updated *** 0011 -1.0 -1.0 -1 *** Job was unexpectedly updated *** 0012 -1.0 -1.0 -1 *** Job was unexpectedly updated *** 0013 -1.0 -1.0 -1 *** Job was unexpectedly updated *** 0014 -1.0 -1.0 -1 *** Job was unexpectedly updated *** 0015 -1.0 -1.0 -1 *** Job was unexpectedly updated *** ========================================================================================== Exception in thread "main" java.lang.RuntimeException: Execution was not successful at org.apache.beam.sdk.nexmark.Main.runAll(Main.java:186) at org.apache.beam.sdk.nexmark.Main.main(Main.java:495) > Task :sdks:java:testing:nexmark:run FAILED FAILURE: Build failed with an exception. * What went wrong: Execution failed for task ':sdks:java:testing:nexmark:run'. > Process 'command '/usr/lib/jvm/java-8-openjdk-amd64/bin/java'' finished with > non-zero exit value 1 * Try: Run with --stacktrace option to get the stack trace. Run with --info or --debug option to get more log output. Run with --scan to get full insights. * Get more help at https://help.gradle.org Deprecated Gradle features were used in this build, making it incompatible with Gradle 7.0. Use '--warning-mode all' to show the individual deprecation warnings. See https://docs.gradle.org/6.8.3/userguide/command_line_interface.html#sec:command_line_warnings BUILD FAILED in 3m 32s 117 actionable tasks: 75 executed, 42 from cache Publishing build scan... https://gradle.com/s/5xgp432q34ley Build step 'Invoke Gradle script' changed build result to FAILURE Build step 'Invoke Gradle script' marked build as failure --------------------------------------------------------------------- To unsubscribe, e-mail: [email protected] For additional commands, e-mail: [email protected]
