See <https://builds.apache.org/job/beam_PostCommit_Java_Nexmark_Dataflow/1271/display/redirect?page=changes>
Changes: [iemejia] [BEAM-6079] Add ability for CassandraIO to delete data [iemejia] [BEAM-6079] Fix access level and clean up generics issues ------------------------------------------ [...truncated 907.84 KB...] Please see https://cloud.google.com/compute/docs/resource-quotas about requesting more quota. Dec 10, 2018 4:41:11 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process INFO: 2018-12-10T16:40:58.782Z: Cleaning up. Dec 10, 2018 4:41:11 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process INFO: 2018-12-10T16:40:58.807Z: Worker pool stopped. Dec 10, 2018 4:41:11 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process INFO: 2018-12-10T16:40:58.819Z: Stopping worker pool... Dec 10, 2018 4:41:11 PM org.apache.beam.runners.dataflow.DataflowPipelineJob waitUntilFinish INFO: Job 2018-12-10_08_40_52-8393314278240096618 failed with status FAILED. 2018-12-10T16:41:11.198Z Waiting for main pipeline to 'finish' 2018-12-10T16:41:11.198Z FAILED Query11 Dec 10, 2018 4:41:11 PM org.apache.beam.sdk.testutils.metrics.MetricsReader getCounterMetric SEVERE: Failed to get metric event.elements, from namespace Query11.Events Dec 10, 2018 4:41:11 PM org.apache.beam.sdk.testutils.metrics.MetricsReader getCounterMetric SEVERE: Failed to get metric event.bytes, from namespace Query11.Events Dec 10, 2018 4:41:11 PM org.apache.beam.sdk.testutils.metrics.MetricsReader getCounterMetric SEVERE: Failed to get metric result.elements, from namespace Query11.Results Dec 10, 2018 4:41:11 PM org.apache.beam.sdk.testutils.metrics.MetricsReader getCounterMetric SEVERE: Failed to get metric result.bytes, from namespace Query11.Results 2018-12-10T16:41:11.226Z 0 samples not enough to calculate steady-state event rate Dec 10, 2018 4:41:11 PM org.apache.beam.sdk.testutils.metrics.MetricsReader getCounterMetric SEVERE: Failed to get metric fatal, from namespace Query11 ========================================================================================== Run started 2018-12-10T16:40:44.769Z and ran for PT26.458S Default configuration: {"debug":true,"query":null,"sourceType":"DIRECT","sinkType":"DEVNULL","exportSummaryToBigQuery":false,"pubSubMode":"COMBINED","sideInputType":"DIRECT","sideInputRowCount":500,"sideInputNumShards":3,"sideInputUrl":null,"numEvents":100000,"numEventGenerators":100,"rateShape":"SINE","firstEventRate":10000,"nextEventRate":10000,"rateUnit":"PER_SECOND","ratePeriodSec":600,"preloadSeconds":0,"streamTimeout":240,"isRateLimited":false,"useWallclockEventTime":false,"avgPersonByteSize":200,"avgAuctionByteSize":500,"avgBidByteSize":100,"hotAuctionRatio":2,"hotSellersRatio":4,"hotBiddersRatio":4,"windowSizeSec":10,"windowPeriodSec":5,"watermarkHoldbackSec":0,"numInFlightAuctions":100,"numActivePeople":1000,"coderStrategy":"HAND","cpuDelayMs":0,"diskBusyBytes":0,"auctionSkip":123,"fanout":5,"maxAuctionsWaitingTime":600,"occasionalDelaySec":3,"probDelayedEvent":0.1,"maxLogEvents":100000,"usePubsubPublishTime":false,"outOfOrderGroupSize":1} Configurations: Conf Description 0000 query:PASSTHROUGH; exportSummaryToBigQuery:true; numEvents:10000000 0001 query:CURRENCY_CONVERSION; exportSummaryToBigQuery:true; numEvents:10000000 0002 query:SELECTION; exportSummaryToBigQuery:true; numEvents:10000000 0003 query:LOCAL_ITEM_SUGGESTION; exportSummaryToBigQuery:true; numEvents:10000000 0004 query:AVERAGE_PRICE_FOR_CATEGORY; exportSummaryToBigQuery:true; numEvents:1000000 0005 query:HOT_ITEMS; exportSummaryToBigQuery:true; numEvents:10000000 0006 query:AVERAGE_SELLING_PRICE_BY_SELLER; exportSummaryToBigQuery:true; numEvents:1000000 0007 query:HIGHEST_BID; exportSummaryToBigQuery:true; numEvents:10000000 0008 query:MONITOR_NEW_USERS; exportSummaryToBigQuery:true; numEvents:10000000 0009 query:WINNING_BIDS; exportSummaryToBigQuery:true; numEvents:1000000 0010 query:LOG_TO_SHARDED_FILES; exportSummaryToBigQuery:true; numEvents:10000000 0011 query:USER_SESSIONS; exportSummaryToBigQuery:true; numEvents:10000000 0012 query:PROCESSING_TIME_WINDOWS; exportSummaryToBigQuery:true; numEvents:10000000 0013 query:BOUNDED_SIDE_INPUT_JOIN; exportSummaryToBigQuery:true; numEvents:10000000 Performance: Conf Runtime(sec) (Baseline) Events(/sec) (Baseline) Results (Baseline) 0000 -1.0 -1.0 -1 *** Job was unexpectedly updated *** 0001 -1.0 -1.0 -1 *** Job was unexpectedly updated *** 0002 -1.0 -1.0 -1 *** Job was unexpectedly updated *** 0003 -1.0 -1.0 -1 *** Job was unexpectedly updated *** 0004 -1.0 -1.0 -1 *** Job was unexpectedly updated *** 0005 -1.0 -1.0 -1 *** Job was unexpectedly updated *** 0006 -1.0 -1.0 -1 *** Job was unexpectedly updated *** 0007 -1.0 -1.0 -1 *** Job was unexpectedly updated *** 0008 -1.0 -1.0 -1 *** Job was unexpectedly updated *** 0009 -1.0 -1.0 -1 *** Job was unexpectedly updated *** 0010 -1.0 -1.0 -1 *** Job was unexpectedly updated *** 0011 -1.0 -1.0 -1 *** Job was unexpectedly updated *** 0012 -1.0 -1.0 -1 *** Job was unexpectedly updated *** 0013 *** not run *** ========================================================================================== Dec 10, 2018 4:41:11 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process INFO: 2018-12-10T16:40:54.857Z: Checking permissions granted to controller Service Account. Dec 10, 2018 4:41:11 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process INFO: 2018-12-10T16:40:58.721Z: Worker configuration: n1-standard-4 in us-central1-b. Dec 10, 2018 4:41:11 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process SEVERE: 2018-12-10T16:40:59.152Z: Workflow failed. Causes: Project apache-beam-testing has insufficient quota(s) to execute this workflow with 4 instances in region us-central1. Quota summary (required/available): 4/6994 instances, 16/1 CPUs, 1720/71341 disk GB, 0/4046 SSD disk GB, 1/241 instance groups, 1/240 managed instance groups, 1/213 instance templates, 4/248 in-use IP addresses. Please see https://cloud.google.com/compute/docs/resource-quotas about requesting more quota. Dec 10, 2018 4:41:11 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process INFO: 2018-12-10T16:40:59.206Z: Cleaning up. 2018-12-10T16:41:11.276Z Waiting for main pipeline to 'finish' Dec 10, 2018 4:41:11 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process 2018-12-10T16:41:11.276Z FAILED BoundedSideInputJoin INFO: 2018-12-10T16:40:59.283Z: Worker pool stopped. Dec 10, 2018 4:41:11 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process INFO: 2018-12-10T16:40:59.315Z: Stopping worker pool... Dec 10, 2018 4:41:11 PM org.apache.beam.runners.dataflow.DataflowPipelineJob waitUntilFinish INFO: Job 2018-12-10_08_40_52-6291440814240041223 failed with status FAILED. Dec 10, 2018 4:41:11 PM org.apache.beam.sdk.testutils.metrics.MetricsReader getCounterMetric SEVERE: Failed to get metric event.elements, from namespace BoundedSideInputJoin.Events Dec 10, 2018 4:41:11 PM org.apache.beam.sdk.testutils.metrics.MetricsReader getCounterMetric SEVERE: Failed to get metric event.bytes, from namespace BoundedSideInputJoin.Events Dec 10, 2018 4:41:11 PM org.apache.beam.sdk.testutils.metrics.MetricsReader getCounterMetric SEVERE: Failed to get metric result.elements, from namespace BoundedSideInputJoin.Results Dec 10, 2018 4:41:11 PM org.apache.beam.sdk.testutils.metrics.MetricsReader getCounterMetric SEVERE: Failed to get metric result.bytes, from namespace BoundedSideInputJoin.Results 2018-12-10T16:41:11.306Z 0 samples not enough to calculate steady-state event rate Dec 10, 2018 4:41:11 PM org.apache.beam.sdk.testutils.metrics.MetricsReader getCounterMetric SEVERE: Failed to get metric fatal, from namespace BoundedSideInputJoin ========================================================================================== Run started 2018-12-10T16:40:44.769Z and ran for PT26.537S Default configuration: {"debug":true,"query":null,"sourceType":"DIRECT","sinkType":"DEVNULL","exportSummaryToBigQuery":false,"pubSubMode":"COMBINED","sideInputType":"DIRECT","sideInputRowCount":500,"sideInputNumShards":3,"sideInputUrl":null,"numEvents":100000,"numEventGenerators":100,"rateShape":"SINE","firstEventRate":10000,"nextEventRate":10000,"rateUnit":"PER_SECOND","ratePeriodSec":600,"preloadSeconds":0,"streamTimeout":240,"isRateLimited":false,"useWallclockEventTime":false,"avgPersonByteSize":200,"avgAuctionByteSize":500,"avgBidByteSize":100,"hotAuctionRatio":2,"hotSellersRatio":4,"hotBiddersRatio":4,"windowSizeSec":10,"windowPeriodSec":5,"watermarkHoldbackSec":0,"numInFlightAuctions":100,"numActivePeople":1000,"coderStrategy":"HAND","cpuDelayMs":0,"diskBusyBytes":0,"auctionSkip":123,"fanout":5,"maxAuctionsWaitingTime":600,"occasionalDelaySec":3,"probDelayedEvent":0.1,"maxLogEvents":100000,"usePubsubPublishTime":false,"outOfOrderGroupSize":1} Configurations: Conf Description 0000 query:PASSTHROUGH; exportSummaryToBigQuery:true; numEvents:10000000 0001 query:CURRENCY_CONVERSION; exportSummaryToBigQuery:true; numEvents:10000000 0002 query:SELECTION; exportSummaryToBigQuery:true; numEvents:10000000 0003 query:LOCAL_ITEM_SUGGESTION; exportSummaryToBigQuery:true; numEvents:10000000 0004 query:AVERAGE_PRICE_FOR_CATEGORY; exportSummaryToBigQuery:true; numEvents:1000000 0005 query:HOT_ITEMS; exportSummaryToBigQuery:true; numEvents:10000000 0006 query:AVERAGE_SELLING_PRICE_BY_SELLER; exportSummaryToBigQuery:true; numEvents:1000000 0007 query:HIGHEST_BID; exportSummaryToBigQuery:true; numEvents:10000000 0008 query:MONITOR_NEW_USERS; exportSummaryToBigQuery:true; numEvents:10000000 0009 query:WINNING_BIDS; exportSummaryToBigQuery:true; numEvents:1000000 0010 query:LOG_TO_SHARDED_FILES; exportSummaryToBigQuery:true; numEvents:10000000 0011 query:USER_SESSIONS; exportSummaryToBigQuery:true; numEvents:10000000 0012 query:PROCESSING_TIME_WINDOWS; exportSummaryToBigQuery:true; numEvents:10000000 0013 query:BOUNDED_SIDE_INPUT_JOIN; exportSummaryToBigQuery:true; numEvents:10000000 Performance: Conf Runtime(sec) (Baseline) Events(/sec) (Baseline) Results (Baseline) 0000 -1.0 -1.0 -1 *** Job was unexpectedly updated *** 0001 -1.0 -1.0 -1 *** Job was unexpectedly updated *** 0002 -1.0 -1.0 -1 *** Job was unexpectedly updated *** 0003 -1.0 -1.0 -1 *** Job was unexpectedly updated *** 0004 -1.0 -1.0 -1 *** Job was unexpectedly updated *** 0005 -1.0 -1.0 -1 *** Job was unexpectedly updated *** 0006 -1.0 -1.0 -1 *** Job was unexpectedly updated *** 0007 -1.0 -1.0 -1 *** Job was unexpectedly updated *** 0008 -1.0 -1.0 -1 *** Job was unexpectedly updated *** 0009 -1.0 -1.0 -1 *** Job was unexpectedly updated *** 0010 -1.0 -1.0 -1 *** Job was unexpectedly updated *** 0011 -1.0 -1.0 -1 *** Job was unexpectedly updated *** 0012 -1.0 -1.0 -1 *** Job was unexpectedly updated *** 0013 -1.0 -1.0 -1 *** Job was unexpectedly updated *** ========================================================================================== ========================================================================================== Run started 2018-12-10T16:40:44.769Z and ran for PT29.754S Default configuration: {"debug":true,"query":null,"sourceType":"DIRECT","sinkType":"DEVNULL","exportSummaryToBigQuery":false,"pubSubMode":"COMBINED","sideInputType":"DIRECT","sideInputRowCount":500,"sideInputNumShards":3,"sideInputUrl":null,"numEvents":100000,"numEventGenerators":100,"rateShape":"SINE","firstEventRate":10000,"nextEventRate":10000,"rateUnit":"PER_SECOND","ratePeriodSec":600,"preloadSeconds":0,"streamTimeout":240,"isRateLimited":false,"useWallclockEventTime":false,"avgPersonByteSize":200,"avgAuctionByteSize":500,"avgBidByteSize":100,"hotAuctionRatio":2,"hotSellersRatio":4,"hotBiddersRatio":4,"windowSizeSec":10,"windowPeriodSec":5,"watermarkHoldbackSec":0,"numInFlightAuctions":100,"numActivePeople":1000,"coderStrategy":"HAND","cpuDelayMs":0,"diskBusyBytes":0,"auctionSkip":123,"fanout":5,"maxAuctionsWaitingTime":600,"occasionalDelaySec":3,"probDelayedEvent":0.1,"maxLogEvents":100000,"usePubsubPublishTime":false,"outOfOrderGroupSize":1} Configurations: Conf Description 0000 query:PASSTHROUGH; exportSummaryToBigQuery:true; numEvents:10000000 0001 query:CURRENCY_CONVERSION; exportSummaryToBigQuery:true; numEvents:10000000 0002 query:SELECTION; exportSummaryToBigQuery:true; numEvents:10000000 0003 query:LOCAL_ITEM_SUGGESTION; exportSummaryToBigQuery:true; numEvents:10000000 0004 query:AVERAGE_PRICE_FOR_CATEGORY; exportSummaryToBigQuery:true; numEvents:1000000 0005 query:HOT_ITEMS; exportSummaryToBigQuery:true; numEvents:10000000 0006 query:AVERAGE_SELLING_PRICE_BY_SELLER; exportSummaryToBigQuery:true; numEvents:1000000 0007 query:HIGHEST_BID; exportSummaryToBigQuery:true; numEvents:10000000 0008 query:MONITOR_NEW_USERS; exportSummaryToBigQuery:true; numEvents:10000000 0009 query:WINNING_BIDS; exportSummaryToBigQuery:true; numEvents:1000000 0010 query:LOG_TO_SHARDED_FILES; exportSummaryToBigQuery:true; numEvents:10000000 0011 query:USER_SESSIONS; exportSummaryToBigQuery:true; numEvents:10000000 0012 query:PROCESSING_TIME_WINDOWS; exportSummaryToBigQuery:true; numEvents:10000000 0013 query:BOUNDED_SIDE_INPUT_JOIN; exportSummaryToBigQuery:true; numEvents:10000000 Performance: Conf Runtime(sec) (Baseline) Events(/sec) (Baseline) Results (Baseline) Exception in thread "main" 0000 -1.0 -1.0 -1 *** Job was unexpectedly updated *** 0001 -1.0 -1.0 -1 *** Job was unexpectedly updated *** 0002 -1.0 -1.0 -1 *** Job was unexpectedly updated *** 0003 -1.0 -1.0 -1 *** Job was unexpectedly updated *** 0004 -1.0 -1.0 -1 *** Job was unexpectedly updated *** 0005 -1.0 -1.0 -1 *** Job was unexpectedly updated *** 0006 -1.0 -1.0 -1 *** Job was unexpectedly updated *** 0007 -1.0 -1.0 -1 *** Job was unexpectedly updated *** 0008 -1.0 -1.0 -1 *** Job was unexpectedly updated *** 0009 -1.0 -1.0 -1 *** Job was unexpectedly updated *** 0010 -1.0 -1.0 -1 *** Job was unexpectedly updated *** java.lang.RuntimeException: Execution was not successful 0011 -1.0 -1.0 -1 at org.apache.beam.sdk.nexmark.Main.runAll(Main.java:169) *** Job was unexpectedly updated *** at org.apache.beam.sdk.nexmark.Main.main(Main.java:414) 0012 -1.0 -1.0 -1 *** Job was unexpectedly updated *** 0013 -1.0 -1.0 -1 *** Job was unexpectedly updated *** ========================================================================================== > Task :beam-sdks-java-nexmark:run FAILED :beam-sdks-java-nexmark:run (Thread[Task worker for ':',5,main]) completed. Took 31.297 secs. FAILURE: Build failed with an exception. * What went wrong: Execution failed for task ':beam-sdks-java-nexmark:run'. > Process 'command '/usr/local/asfpackages/java/jdk1.8.0_191/bin/java'' > finished with non-zero exit value 1 * Try: Run with --stacktrace option to get the stack trace. Run with --debug option to get more log output. Run with --scan to get full insights. * Get more help at https://help.gradle.org Deprecated Gradle features were used in this build, making it incompatible with Gradle 5.0. Use '--warning-mode all' to show the individual deprecation warnings. See https://docs.gradle.org/4.10.2/userguide/command_line_interface.html#sec:command_line_warnings BUILD FAILED in 44s 75 actionable tasks: 2 executed, 73 up-to-date Publishing build scan... https://gradle.com/s/a7dg7cdiysln4 Build step 'Invoke Gradle script' changed build result to FAILURE Build step 'Invoke Gradle script' marked build as failure --------------------------------------------------------------------- To unsubscribe, e-mail: [email protected] For additional commands, e-mail: [email protected]
