See <https://ci-beam.apache.org/job/beam_PostCommit_Java_Nexmark_Dataflow_V2/434/display/redirect?page=changes>
Changes: [noreply] Fix broken 'differences from pandas' link [noreply] Added GroupBy row in Aggregation table. [Luke Cwik] [BEAM-12769] Fix typo in test class name, CLass -> Class [Etienne Chauchot] [BEAM-5172] Temporary ignore testSplit and testSizes tests waiting for a [samuelw] [BEAM-12740] Remove matching to filter files when renaming gcs files in [noreply] [BEAM-3304] Helper functions for triggers (#15430) ------------------------------------------ [...truncated 246.18 KB...] INFO: 2021-09-10T00:20:12.952Z: Cleaning up. Sep 10, 2021 12:20:13 AM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process INFO: 2021-09-10T00:20:13.075Z: Stopping **** pool... Sep 10, 2021 12:20:45 AM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process INFO: 2021-09-10T00:20:44.573Z: Finished operation Query13/Query13/GroupByKey/Read+Query13/Query13/ExpandIterable/ParMultiDo(Anonymous)+Query13/Query13/Query13.Serialize/ParMultiDo(Anonymous)+Query13/Query13.Debug/ParMultiDo(Monitor)+Query13/Query13.Stamp/ParMultiDo(Anonymous)+Query13.Format/ParMultiDo(Anonymous)+Query13.DevNull/ParMultiDo(Anonymous) Sep 10, 2021 12:20:45 AM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process WARNING: 2021-09-10T00:20:44.932Z: Project apache-beam-testing has insufficient quota(s) to execute this workflow with 1 instances in region us-central1. Quota summary (required/available): 1/19498 instances, 2/0 CPUs, 25/249166 disk GB, 0/2397 SSD disk GB, 1/264 instance groups, 1/267 managed instance groups, 1/493 instance templates, 1/727 in-use IP addresses. Please see https://cloud.google.com/compute/docs/resource-quotas about requesting more quota. Sep 10, 2021 12:20:45 AM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process INFO: 2021-09-10T00:20:44.974Z: Cleaning up. Sep 10, 2021 12:20:45 AM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process INFO: 2021-09-10T00:20:45.074Z: Stopping **** pool... Sep 10, 2021 12:21:24 AM org.apache.beam.runners.dataflow.DataflowPipelineJob waitUntilFinish 2021-09-10T00:21:24.041Z Waiting for main pipeline to 'finish' WARNING: No terminal state was returned within allotted timeout. State value RUNNING 2021-09-10T00:21:24.078Z RUNNING Query2 Sep 10, 2021 12:21:24 AM org.apache.beam.runners.dataflow.DataflowPipelineJob waitUntilFinish WARNING: No terminal state was returned within allotted timeout. State value RUNNING 2021-09-10T00:21:24.526Z Waiting for main pipeline to 'finish' 2021-09-10T00:21:24.650Z RUNNING Query13 2021-09-10T00:21:25.457Z new perf {"snapshots":null,"runtimeSec":19.975,"numEvents":10000000,"eventsPerSec":500625.7822277847,"eventBytesPerSec":6.425856806007509E7,"numResults":83527,"resultsPerSec":4181.576971214017,"resultBytesPerSec":66905.23153942428,"startupDelaySec":-93.347,"processingDelaySec":0.358,"shutdownDelaySec":73.372,"timeDilation":50.0595744680851,"errors":null,"jobId":null} 2021-09-10T00:21:26.300Z new perf {"snapshots":null,"runtimeSec":68.439,"numEvents":10000000,"eventsPerSec":146115.5189292655,"eventBytesPerSec":1.875487510045442E7,"numResults":10000000,"resultsPerSec":146115.5189292655,"resultBytesPerSec":1.875487510045442E7,"startupDelaySec":-108.432,"processingDelaySec":31.213,"shutdownDelaySec":39.993,"timeDilation":-1.0,"errors":null,"jobId":null} 2021-09-10T00:21:40.508Z RUNNING Query2 2021-09-10T00:21:41.384Z RUNNING Query13 2021-09-10T00:21:41.606Z no activity 2021-09-10T00:21:42.432Z no activity 2021-09-10T00:21:56.684Z RUNNING Query2 2021-09-10T00:21:57.596Z RUNNING Query13 2021-09-10T00:21:57.835Z no activity 2021-09-10T00:21:58.296Z no activity 2021-09-10T00:22:13.052Z RUNNING Query2 2021-09-10T00:22:13.371Z RUNNING Query13 2021-09-10T00:22:13.961Z no activity 2021-09-10T00:22:14.386Z no activity 2021-09-10T00:22:28.991Z RUNNING Query2 2021-09-10T00:22:29.428Z RUNNING Query13 2021-09-10T00:22:30.179Z no activity 2021-09-10T00:22:30.295Z no activity 2021-09-10T00:22:45.280Z DONE Query2 2021-09-10T00:22:45.352Z RUNNING Query13 ========================================================================================== Run started 2021-09-10T00:16:24.114Z and ran for PT381.299S Default configuration: {"debug":true,"query":null,"sourceType":"DIRECT","generateEventFilePathPrefix":null,"sinkType":"DEVNULL","exportSummaryToBigQuery":false,"pubSubMode":"COMBINED","pubsubMessageSerializationMethod":"CODER","sideInputType":"DIRECT","sideInputRowCount":500,"sideInputNumShards":3,"sideInputUrl":null,"sessionGap":600000,"numEvents":100000,"numEventGenerators":100,"rateShape":"SINE","firstEventRate":10000,"nextEventRate":10000,"rateUnit":"PER_SECOND","ratePeriodSec":600,"preloadSeconds":0,"streamTimeout":240,"isRateLimited":false,"useWallclockEventTime":false,"avgPersonByteSize":200,"avgAuctionByteSize":500,"avgBidByteSize":100,"hotAuctionRatio":2,"hotSellersRatio":4,"hotBiddersRatio":4,"windowSizeSec":10,"windowPeriodSec":5,"watermarkHoldbackSec":0,"numInFlightAuctions":100,"numActivePeople":1000,"coderStrategy":"HAND","cpuDelayMs":0,"diskBusyBytes":0,"auctionSkip":123,"fanout":5,"maxAuctionsWaitingTime":600,"occasionalDelaySec":3,"probDelayedEvent":0.1,"maxLogEvents":100000,"usePubsubPublishTime":false,"outOfOrderGroupSize":1,"numKeyBuckets":20000,"pardoCPUFactor":1.0} Configurations: Conf Description 0000 query:PASSTHROUGH; numEvents:10000000 0001 query:CURRENCY_CONVERSION; numEvents:10000000 0002 query:SELECTION; numEvents:10000000 0003 query:LOCAL_ITEM_SUGGESTION; numEvents:10000000 0004 query:AVERAGE_PRICE_FOR_CATEGORY; numEvents:1000000 0005 query:HOT_ITEMS; numEvents:10000000 0006 query:AVERAGE_SELLING_PRICE_BY_SELLER; numEvents:1000000 0007 query:HIGHEST_BID; numEvents:10000000 0008 query:MONITOR_NEW_USERS; numEvents:10000000 0009 query:WINNING_BIDS; numEvents:1000000 0010 query:LOG_TO_SHARDED_FILES; numEvents:10000000 0011 query:USER_SESSIONS; numEvents:10000000 0012 query:PROCESSING_TIME_WINDOWS; numEvents:10000000 0013 query:PORTABILITY_BATCH; numEvents:10000000 0014 query:BOUNDED_SIDE_INPUT_JOIN; numEvents:10000000 0015 query:SESSION_SIDE_INPUT_JOIN; numEvents:10000000 Performance: Conf Runtime(sec) (Baseline) Events(/sec) (Baseline) Results (Baseline) 0000 -1.0 -1.0 -1 *** Job was unexpectedly updated *** 0001 -1.0 -1.0 -1 *** Job was unexpectedly updated *** 0002 20.0 500625.8 83527 0003 *** not run *** 0004 *** not run *** 0005 -1.0 -1.0 -1 *** Job was unexpectedly updated *** 0006 *** not run *** 0007 *** not run *** 0008 -1.0 -1.0 -1 *** Job was unexpectedly updated *** 0009 *** not run *** 0010 -1.0 -1.0 -1 *** Job was unexpectedly updated *** 0011 -1.0 -1.0 -1 *** Job was unexpectedly updated *** 0012 -1.0 -1.0 -1 *** Job was unexpectedly updated *** 0013 *** not run *** 0014 *** not run *** 0015 *** not run *** ========================================================================================== 2021-09-10T00:22:46.269Z no activity 2021-09-10T00:23:01.324Z RUNNING Query13 2021-09-10T00:23:02.108Z no activity 2021-09-10T00:23:17.196Z RUNNING Query13 2021-09-10T00:23:18.658Z no activity 2021-09-10T00:23:33.709Z RUNNING Query13 2021-09-10T00:23:34.718Z no activity 2021-09-10T00:23:49.765Z DONE Query13 ========================================================================================== Run started 2021-09-10T00:16:24.114Z and ran for PT445.696S Default configuration: {"debug":true,"query":null,"sourceType":"DIRECT","generateEventFilePathPrefix":null,"sinkType":"DEVNULL","exportSummaryToBigQuery":false,"pubSubMode":"COMBINED","pubsubMessageSerializationMethod":"CODER","sideInputType":"DIRECT","sideInputRowCount":500,"sideInputNumShards":3,"sideInputUrl":null,"sessionGap":600000,"numEvents":100000,"numEventGenerators":100,"rateShape":"SINE","firstEventRate":10000,"nextEventRate":10000,"rateUnit":"PER_SECOND","ratePeriodSec":600,"preloadSeconds":0,"streamTimeout":240,"isRateLimited":false,"useWallclockEventTime":false,"avgPersonByteSize":200,"avgAuctionByteSize":500,"avgBidByteSize":100,"hotAuctionRatio":2,"hotSellersRatio":4,"hotBiddersRatio":4,"windowSizeSec":10,"windowPeriodSec":5,"watermarkHoldbackSec":0,"numInFlightAuctions":100,"numActivePeople":1000,"coderStrategy":"HAND","cpuDelayMs":0,"diskBusyBytes":0,"auctionSkip":123,"fanout":5,"maxAuctionsWaitingTime":600,"occasionalDelaySec":3,"probDelayedEvent":0.1,"maxLogEvents":100000,"usePubsubPublishTime":false,"outOfOrderGroupSize":1,"numKeyBuckets":20000,"pardoCPUFactor":1.0} Configurations: Conf Description 0000 query:PASSTHROUGH; numEvents:10000000 0001 query:CURRENCY_CONVERSION; numEvents:10000000 0002 query:SELECTION; numEvents:10000000 0003 query:LOCAL_ITEM_SUGGESTION; numEvents:10000000 0004 query:AVERAGE_PRICE_FOR_CATEGORY; numEvents:1000000 0005 query:HOT_ITEMS; numEvents:10000000 0006 query:AVERAGE_SELLING_PRICE_BY_SELLER; numEvents:1000000 0007 query:HIGHEST_BID; numEvents:10000000 0008 query:MONITOR_NEW_USERS; numEvents:10000000 0009 query:WINNING_BIDS; numEvents:1000000 0010 query:LOG_TO_SHARDED_FILES; numEvents:10000000 0011 query:USER_SESSIONS; numEvents:10000000 0012 query:PROCESSING_TIME_WINDOWS; numEvents:10000000 0013 query:PORTABILITY_BATCH; numEvents:10000000 0014 query:BOUNDED_SIDE_INPUT_JOIN; numEvents:10000000 0015 query:SESSION_SIDE_INPUT_JOIN; numEvents:10000000 Performance: Conf Runtime(sec) (Baseline) Events(/sec) (Baseline) Results (Baseline) 0000 -1.0 -1.0 -1 *** Job was unexpectedly updated *** 0001 -1.0 -1.0 -1 *** Job was unexpectedly updated *** 0002 20.0 500625.8 83527 0003 *** not run *** 0004 *** not run *** 0005 -1.0 -1.0 -1 *** Job was unexpectedly updated *** 0006 *** not run *** 0007 *** not run *** 0008 -1.0 -1.0 -1 *** Job was unexpectedly updated *** 0009 *** not run *** 0010 -1.0 -1.0 -1 *** Job was unexpectedly updated *** 0011 -1.0 -1.0 -1 *** Job was unexpectedly updated *** 0012 -1.0 -1.0 -1 *** Job was unexpectedly updated *** 0013 68.4 146115.5 10000000 0014 *** not run *** 0015 *** not run *** ========================================================================================== ========================================================================================== Run started 2021-09-10T00:16:24.114Z and ran for PT446.044S Default configuration: {"debug":true,"query":null,"sourceType":"DIRECT","generateEventFilePathPrefix":null,"sinkType":"DEVNULL","exportSummaryToBigQuery":false,"pubSubMode":"COMBINED","pubsubMessageSerializationMethod":"CODER","sideInputType":"DIRECT","sideInputRowCount":500,"sideInputNumShards":3,"sideInputUrl":null,"sessionGap":600000,"numEvents":100000,"numEventGenerators":100,"rateShape":"SINE","firstEventRate":10000,"nextEventRate":10000,"rateUnit":"PER_SECOND","ratePeriodSec":600,"preloadSeconds":0,"streamTimeout":240,"isRateLimited":false,"useWallclockEventTime":false,"avgPersonByteSize":200,"avgAuctionByteSize":500,"avgBidByteSize":100,"hotAuctionRatio":2,"hotSellersRatio":4,"hotBiddersRatio":4,"windowSizeSec":10,"windowPeriodSec":5,"watermarkHoldbackSec":0,"numInFlightAuctions":100,"numActivePeople":1000,"coderStrategy":"HAND","cpuDelayMs":0,"diskBusyBytes":0,"auctionSkip":123,"fanout":5,"maxAuctionsWaitingTime":600,"occasionalDelaySec":3,"probDelayedEvent":0.1,"maxLogEvents":100000,"usePubsubPublishTime":false,"outOfOrderGroupSize":1,"numKeyBuckets":20000,"pardoCPUFactor":1.0} Configurations: Conf Description 0000 query:PASSTHROUGH; numEvents:10000000 0001 query:CURRENCY_CONVERSION; numEvents:10000000 0002 query:SELECTION; numEvents:10000000 0003 query:LOCAL_ITEM_SUGGESTION; numEvents:10000000 0004 query:AVERAGE_PRICE_FOR_CATEGORY; numEvents:1000000 0005 query:HOT_ITEMS; numEvents:10000000 0006 query:AVERAGE_SELLING_PRICE_BY_SELLER; numEvents:1000000 0007 query:HIGHEST_BID; numEvents:10000000 0008 query:MONITOR_NEW_USERS; numEvents:10000000 0009 query:WINNING_BIDS; numEvents:1000000 0010 query:LOG_TO_SHARDED_FILES; numEvents:10000000 0011 query:USER_SESSIONS; numEvents:10000000 0012 query:PROCESSING_TIME_WINDOWS; numEvents:10000000 0013 query:PORTABILITY_BATCH; numEvents:10000000 0014 query:BOUNDED_SIDE_INPUT_JOIN; numEvents:10000000 0015 query:SESSION_SIDE_INPUT_JOIN; numEvents:10000000 Performance: Conf Runtime(sec) (Baseline) Events(/sec) (Baseline) Results (Baseline) 0000 -1.0 -1.0 -1 *** Job was unexpectedly updated *** 0001 -1.0 -1.0 -1 *** Job was unexpectedly updated *** 0002 20.0 500625.8 83527 0003 *** not run *** 0004 *** not run *** 0005 -1.0 -1.0 -1 *** Job was unexpectedly updated *** 0006 *** not run *** 0007 *** not run *** 0008 -1.0 -1.0 -1 *** Job was unexpectedly updated *** 0009 *** not run *** 0010 -1.0 -1.0 -1 *** Job was unexpectedly updated *** 0011 -1.0 -1.0 -1 *** Job was unexpectedly updated *** 0012 -1.0 -1.0 -1 *** Job was unexpectedly updated *** 0013 68.4 146115.5 10000000 0014 *** not run *** 0015 *** not run *** ========================================================================================== Exception in thread "main" java.lang.RuntimeException: Execution was not successful at org.apache.beam.sdk.nexmark.Main.runAll(Main.java:186) at org.apache.beam.sdk.nexmark.Main.main(Main.java:495) > Task :sdks:java:testing:nexmark:run FAILED > Task :runners:google-cloud-dataflow-java:cleanUpDockerImages Untagged: us.gcr.io/apache-beam-testing/java-postcommit-it/java:20210910000124 Untagged: us.gcr.io/apache-beam-testing/java-postcommit-it/java@sha256:d21dfaa8e2670cf601b05d36193560f9d15ad044d6941a51125965f23d7ef776 Tag: [us.gcr.io/apache-beam-testing/java-postcommit-it/java:20210910000124] - referencing digest: [us.gcr.io/apache-beam-testing/java-postcommit-it/java@sha256:d21dfaa8e2670cf601b05d36193560f9d15ad044d6941a51125965f23d7ef776] Deleted [[us.gcr.io/apache-beam-testing/java-postcommit-it/java:20210910000124] (referencing [us.gcr.io/apache-beam-testing/java-postcommit-it/java@sha256:d21dfaa8e2670cf601b05d36193560f9d15ad044d6941a51125965f23d7ef776])]. Removing untagged image us.gcr.io/apache-beam-testing/java-postcommit-it/java@sha256:d21dfaa8e2670cf601b05d36193560f9d15ad044d6941a51125965f23d7ef776 Digests: - us.gcr.io/apache-beam-testing/java-postcommit-it/java@sha256:d21dfaa8e2670cf601b05d36193560f9d15ad044d6941a51125965f23d7ef776 Deleted [us.gcr.io/apache-beam-testing/java-postcommit-it/java@sha256:d21dfaa8e2670cf601b05d36193560f9d15ad044d6941a51125965f23d7ef776]. FAILURE: Build failed with an exception. * What went wrong: Execution failed for task ':sdks:java:testing:nexmark:run'. > Process 'command '/usr/lib/jvm/java-8-openjdk-amd64/bin/java'' finished with > non-zero exit value 1 * Try: Run with --stacktrace option to get the stack trace. Run with --info or --debug option to get more log output. Run with --scan to get full insights. * Get more help at https://help.gradle.org Deprecated Gradle features were used in this build, making it incompatible with Gradle 7.0. Use '--warning-mode all' to show the individual deprecation warnings. See https://docs.gradle.org/6.8.3/userguide/command_line_interface.html#sec:command_line_warnings BUILD FAILED in 23m 20s 128 actionable tasks: 96 executed, 30 from cache, 2 up-to-date Publishing build scan... https://gradle.com/s/ork4xsexfrrhg Build step 'Invoke Gradle script' changed build result to FAILURE Build step 'Invoke Gradle script' marked build as failure --------------------------------------------------------------------- To unsubscribe, e-mail: [email protected] For additional commands, e-mail: [email protected]
