See
<https://ci-beam.apache.org/job/beam_PostCommit_Java_Nexmark_Dataflow_V2/75/display/redirect?page=changes>
Changes:
[noreply] Update tensorflow to the latest version
[noreply] Update grpcio
[noreply] Add license info for keras-nightly package.
------------------------------------------
[...truncated 662.48 KB...]
Jun 10, 2021 1:21:51 PM org.apache.beam.sdk.testutils.metrics.MetricsReader
getCounterMetric
2021-06-10T13:21:51.642Z WARNING: streaming query appears to have been stuck
for 55 min.
2021-06-10T13:21:51.642Z no activity
SEVERE: Failed to get metric fatal, from namespace Query3
2021-06-10T13:22:06.695Z RUNNING Query3
2021-06-10T13:22:07.409Z 6 samples not enough to calculate steady-state event
rate
Jun 10, 2021 1:22:07 PM org.apache.beam.sdk.testutils.metrics.MetricsReader
getCounterMetric
SEVERE: Failed to get metric fatal, from namespace Query3
2021-06-10T13:22:07.473Z WARNING: streaming query appears to have been stuck
for 56 min.
2021-06-10T13:22:07.473Z no activity
2021-06-10T13:22:22.522Z RUNNING Query3
2021-06-10T13:22:23.263Z 6 samples not enough to calculate steady-state event
rate
Jun 10, 2021 1:22:23 PM org.apache.beam.sdk.testutils.metrics.MetricsReader
getCounterMetric
SEVERE: Failed to get metric fatal, from namespace Query3
2021-06-10T13:22:23.329Z WARNING: streaming query appears to have been stuck
for 56 min.
2021-06-10T13:22:23.329Z no activity
2021-06-10T13:22:38.364Z RUNNING Query3
2021-06-10T13:22:39.076Z 6 samples not enough to calculate steady-state event
rate
Jun 10, 2021 1:22:39 PM org.apache.beam.sdk.testutils.metrics.MetricsReader
getCounterMetric
SEVERE: Failed to get metric fatal, from namespace Query3
2021-06-10T13:22:39.143Z WARNING: streaming query appears to have been stuck
for 56 min.
2021-06-10T13:22:39.143Z no activity
2021-06-10T13:22:54.178Z RUNNING Query3
2021-06-10T13:22:54.884Z 6 samples not enough to calculate steady-state event
rate
Jun 10, 2021 1:22:54 PM org.apache.beam.sdk.testutils.metrics.MetricsReader
getCounterMetric
2021-06-10T13:22:54.961Z WARNING: streaming query appears to have been stuck
for 56 min.
SEVERE: Failed to get metric fatal, from namespace Query3
2021-06-10T13:22:54.961Z no activity
2021-06-10T13:23:10.022Z RUNNING Query3
2021-06-10T13:23:10.736Z 6 samples not enough to calculate steady-state event
rate
Jun 10, 2021 1:23:10 PM org.apache.beam.sdk.testutils.metrics.MetricsReader
getCounterMetric
2021-06-10T13:23:10.806Z WARNING: streaming query appears to have been stuck
for 57 min.
SEVERE: Failed to get metric fatal, from namespace Query3
2021-06-10T13:23:10.806Z no activity
2021-06-10T13:23:25.850Z RUNNING Query3
2021-06-10T13:23:26.613Z 6 samples not enough to calculate steady-state event
rate
Jun 10, 2021 1:23:26 PM org.apache.beam.sdk.testutils.metrics.MetricsReader
getCounterMetric
2021-06-10T13:23:26.676Z WARNING: streaming query appears to have been stuck
for 57 min.
2021-06-10T13:23:26.676Z no activity
SEVERE: Failed to get metric fatal, from namespace Query3
2021-06-10T13:23:41.704Z RUNNING Query3
2021-06-10T13:23:42.395Z 6 samples not enough to calculate steady-state event
rate
Jun 10, 2021 1:23:42 PM org.apache.beam.sdk.testutils.metrics.MetricsReader
getCounterMetric
2021-06-10T13:23:42.448Z WARNING: streaming query appears to have been stuck
for 57 min.
2021-06-10T13:23:42.448Z no activity
SEVERE: Failed to get metric fatal, from namespace Query3
2021-06-10T13:23:57.484Z RUNNING Query3
2021-06-10T13:23:58.253Z 6 samples not enough to calculate steady-state event
rate
Jun 10, 2021 1:23:58 PM org.apache.beam.sdk.testutils.metrics.MetricsReader
getCounterMetric
2021-06-10T13:23:58.372Z WARNING: streaming query appears to have been stuck
for 57 min.
2021-06-10T13:23:58.372Z no activity
SEVERE: Failed to get metric fatal, from namespace Query3
2021-06-10T13:24:13.404Z RUNNING Query3
2021-06-10T13:24:14.078Z 6 samples not enough to calculate steady-state event
rate
Jun 10, 2021 1:24:14 PM org.apache.beam.sdk.testutils.metrics.MetricsReader
getCounterMetric
SEVERE: Failed to get metric fatal, from namespace Query3
2021-06-10T13:24:14.141Z WARNING: streaming query appears to have been stuck
for 58 min.
2021-06-10T13:24:14.141Z no activity
2021-06-10T13:24:29.188Z RUNNING Query3
2021-06-10T13:24:29.886Z 6 samples not enough to calculate steady-state event
rate
Jun 10, 2021 1:24:29 PM org.apache.beam.sdk.testutils.metrics.MetricsReader
getCounterMetric
SEVERE: Failed to get metric fatal, from namespace Query3
2021-06-10T13:24:29.971Z WARNING: streaming query appears to have been stuck
for 58 min.
2021-06-10T13:24:29.971Z no activity
2021-06-10T13:24:45.004Z RUNNING Query3
2021-06-10T13:24:45.645Z 6 samples not enough to calculate steady-state event
rate
Jun 10, 2021 1:24:45 PM org.apache.beam.sdk.testutils.metrics.MetricsReader
getCounterMetric
SEVERE: Failed to get metric fatal, from namespace Query3
2021-06-10T13:24:45.746Z WARNING: streaming query appears to have been stuck
for 58 min.
2021-06-10T13:24:45.746Z no activity
2021-06-10T13:25:00.789Z RUNNING Query3
2021-06-10T13:25:01.548Z 6 samples not enough to calculate steady-state event
rate
Jun 10, 2021 1:25:01 PM org.apache.beam.sdk.testutils.metrics.MetricsReader
getCounterMetric
2021-06-10T13:25:01.595Z WARNING: streaming query appears to have been stuck
for 59 min.
2021-06-10T13:25:01.595Z no activity
SEVERE: Failed to get metric fatal, from namespace Query3
2021-06-10T13:25:16.627Z RUNNING Query3
2021-06-10T13:25:17.447Z 6 samples not enough to calculate steady-state event
rate
Jun 10, 2021 1:25:17 PM org.apache.beam.sdk.testutils.metrics.MetricsReader
getCounterMetric
2021-06-10T13:25:17.517Z WARNING: streaming query appears to have been stuck
for 59 min.
SEVERE: Failed to get metric fatal, from namespace Query3
2021-06-10T13:25:17.517Z no activity
2021-06-10T13:25:32.558Z RUNNING Query3
2021-06-10T13:25:33.250Z 6 samples not enough to calculate steady-state event
rate
Jun 10, 2021 1:25:33 PM org.apache.beam.sdk.testutils.metrics.MetricsReader
getCounterMetric
SEVERE: Failed to get metric fatal, from namespace Query3
2021-06-10T13:25:33.311Z WARNING: streaming query appears to have been stuck
for 59 min.
2021-06-10T13:25:33.311Z no activity
2021-06-10T13:25:48.346Z RUNNING Query3
2021-06-10T13:25:49.034Z 6 samples not enough to calculate steady-state event
rate
Jun 10, 2021 1:25:49 PM org.apache.beam.sdk.testutils.metrics.MetricsReader
getCounterMetric
2021-06-10T13:25:49.107Z WARNING: streaming query appears to have been stuck
for 59 min.
SEVERE: Failed to get metric fatal, from namespace Query3
2021-06-10T13:25:49.107Z no activity
2021-06-10T13:26:04.155Z RUNNING Query3
2021-06-10T13:26:04.827Z 6 samples not enough to calculate steady-state event
rate
Jun 10, 2021 1:26:04 PM org.apache.beam.sdk.testutils.metrics.MetricsReader
getCounterMetric
2021-06-10T13:26:04.887Z ERROR: streaming query appears to have been stuck for
60 minutes, cancelling job.
SEVERE: Failed to get metric fatal, from namespace Query3
2021-06-10T13:26:04.929Z no activity
2021-06-10T13:26:19.963Z RUNNING Query3 (waiting for shutdown)
2021-06-10T13:26:20.611Z 6 samples not enough to calculate steady-state event
rate
2021-06-10T13:26:20.611Z no activity
2021-06-10T13:26:35.668Z RUNNING Query3 (waiting for shutdown)
2021-06-10T13:26:36.288Z 6 samples not enough to calculate steady-state event
rate
2021-06-10T13:26:36.288Z no activity
2021-06-10T13:26:51.321Z RUNNING Query3 (waiting for shutdown)
2021-06-10T13:26:51.905Z 6 samples not enough to calculate steady-state event
rate
2021-06-10T13:26:51.905Z no activity
2021-06-10T13:27:06.956Z RUNNING Query3 (waiting for shutdown)
2021-06-10T13:27:07.583Z 6 samples not enough to calculate steady-state event
rate
2021-06-10T13:27:07.583Z no activity
2021-06-10T13:27:22.626Z CANCELLED Query3 (waiting for shutdown)
2021-06-10T13:27:22.656Z 6 samples not enough to calculate steady-state event
rate
==========================================================================================
Run started 2021-06-10T12:20:06.601Z and ran for PT4036.055S
Default configuration:
{"debug":true,"query":null,"sourceType":"DIRECT","generateEventFilePathPrefix":null,"sinkType":"DEVNULL","exportSummaryToBigQuery":false,"pubSubMode":"COMBINED","pubsubMessageSerializationMethod":"CODER","sideInputType":"DIRECT","sideInputRowCount":500,"sideInputNumShards":3,"sideInputUrl":null,"sessionGap":600000,"numEvents":100000,"numEventGenerators":100,"rateShape":"SINE","firstEventRate":10000,"nextEventRate":10000,"rateUnit":"PER_SECOND","ratePeriodSec":600,"preloadSeconds":0,"streamTimeout":240,"isRateLimited":false,"useWallclockEventTime":false,"avgPersonByteSize":200,"avgAuctionByteSize":500,"avgBidByteSize":100,"hotAuctionRatio":2,"hotSellersRatio":4,"hotBiddersRatio":4,"windowSizeSec":10,"windowPeriodSec":5,"watermarkHoldbackSec":0,"numInFlightAuctions":100,"numActivePeople":1000,"coderStrategy":"HAND","cpuDelayMs":0,"diskBusyBytes":0,"auctionSkip":123,"fanout":5,"maxAuctionsWaitingTime":600,"occasionalDelaySec":3,"probDelayedEvent":0.1,"maxLogEvents":100000,"usePubsubPublishTime":false,"outOfOrderGroupSize":1,"numKeyBuckets":20000,"pardoCPUFactor":1.0}
Configurations:
Conf Description
0000 query:PASSTHROUGH; numEvents:10000000
0001 query:CURRENCY_CONVERSION; numEvents:10000000
0002 query:SELECTION; numEvents:10000000
0003 query:LOCAL_ITEM_SUGGESTION; numEvents:10000000
0004 query:AVERAGE_PRICE_FOR_CATEGORY; numEvents:1000000
0005 query:HOT_ITEMS; numEvents:10000000
0006 query:AVERAGE_SELLING_PRICE_BY_SELLER; numEvents:1000000
0007 query:HIGHEST_BID; numEvents:10000000
0008 query:MONITOR_NEW_USERS; numEvents:10000000
0009 query:WINNING_BIDS; numEvents:1000000
0010 query:LOG_TO_SHARDED_FILES; numEvents:10000000
0011 query:USER_SESSIONS; numEvents:10000000
0012 query:PROCESSING_TIME_WINDOWS; numEvents:10000000
0013 query:PORTABILITY_BATCH; numEvents:10000000
0014 query:BOUNDED_SIDE_INPUT_JOIN; numEvents:10000000
0015 query:SESSION_SIDE_INPUT_JOIN; numEvents:10000000
Performance:
Conf Runtime(sec) (Baseline) Events(/sec) (Baseline) Results
(Baseline)
0000 34.8 237176.3 8252313
0001 27.3 303571.4 7623073
0002 20.9 435842.7 76784
0003 78.3 100896.6 30318
*** Cancelling streaming job since it appeared stuck for 60 min. ***
0004 *** not run ***
0005 593.0 16424.4 4471
0006 *** not run ***
0007 287.6 34768.6 100
0008 164.9 60055.2 92038
0009 *** not run ***
0010 149.5 66898.1 100
0011 836.1 11844.0 1821884
0012 195.8 50667.7 309854
0013 *** not run ***
0014 *** not run ***
0015 *** not run ***
==========================================================================================
==========================================================================================
Run started 2021-06-10T12:20:06.601Z and ran for PT4036.243S
Default configuration:
{"debug":true,"query":null,"sourceType":"DIRECT","generateEventFilePathPrefix":null,"sinkType":"DEVNULL","exportSummaryToBigQuery":false,"pubSubMode":"COMBINED","pubsubMessageSerializationMethod":"CODER","sideInputType":"DIRECT","sideInputRowCount":500,"sideInputNumShards":3,"sideInputUrl":null,"sessionGap":600000,"numEvents":100000,"numEventGenerators":100,"rateShape":"SINE","firstEventRate":10000,"nextEventRate":10000,"rateUnit":"PER_SECOND","ratePeriodSec":600,"preloadSeconds":0,"streamTimeout":240,"isRateLimited":false,"useWallclockEventTime":false,"avgPersonByteSize":200,"avgAuctionByteSize":500,"avgBidByteSize":100,"hotAuctionRatio":2,"hotSellersRatio":4,"hotBiddersRatio":4,"windowSizeSec":10,"windowPeriodSec":5,"watermarkHoldbackSec":0,"numInFlightAuctions":100,"numActivePeople":1000,"coderStrategy":"HAND","cpuDelayMs":0,"diskBusyBytes":0,"auctionSkip":123,"fanout":5,"maxAuctionsWaitingTime":600,"occasionalDelaySec":3,"probDelayedEvent":0.1,"maxLogEvents":100000,"usePubsubPublishTime":false,"outOfOrderGroupSize":1,"numKeyBuckets":20000,"pardoCPUFactor":1.0}
Configurations:
Conf Description
0000 query:PASSTHROUGH; numEvents:10000000
0001 query:CURRENCY_CONVERSION; numEvents:10000000
0002 query:SELECTION; numEvents:10000000
0003 query:LOCAL_ITEM_SUGGESTION; numEvents:10000000
0004 query:AVERAGE_PRICE_FOR_CATEGORY; numEvents:1000000
0005 query:HOT_ITEMS; numEvents:10000000
0006 query:AVERAGE_SELLING_PRICE_BY_SELLER; numEvents:1000000
0007 query:HIGHEST_BID; numEvents:10000000
0008 query:MONITOR_NEW_USERS; numEvents:10000000
0009 query:WINNING_BIDS; numEvents:1000000
0010 query:LOG_TO_SHARDED_FILES; numEvents:10000000
0011 query:USER_SESSIONS; numEvents:10000000
0012 query:PROCESSING_TIME_WINDOWS; numEvents:10000000
0013 query:PORTABILITY_BATCH; numEvents:10000000
0014 query:BOUNDED_SIDE_INPUT_JOIN; numEvents:10000000
0015 query:SESSION_SIDE_INPUT_JOIN; numEvents:10000000
Performance:
Conf Runtime(sec) (Baseline) Events(/sec) (Baseline) Results
(Baseline)
0000 34.8 237176.3 8252313
0001 27.3 303571.4 7623073
0002 20.9 435842.7 76784
0003 78.3 100896.6 30318
*** Cancelling streaming job since it appeared stuck for 60 min. ***
0004 *** not run ***
0005 593.0 16424.4 4471
0006 *** not run ***
0007 287.6 34768.6 100
0008 164.9 60055.2 92038
0009 *** not run ***
0010 149.5 66898.1 100
0011 836.1 11844.0 1821884
0012 195.8 50667.7 309854
0013 *** not run ***
0014 *** not run ***
0015 *** not run ***
==========================================================================================
Exception in thread "main" java.lang.RuntimeException: Execution was not
successful
at org.apache.beam.sdk.nexmark.Main.runAll(Main.java:186)
at org.apache.beam.sdk.nexmark.Main.main(Main.java:495)
> Task :sdks:java:testing:nexmark:run FAILED
> Task :runners:google-cloud-dataflow-java:cleanUpDockerImages
Untagged: us.gcr.io/apache-beam-testing/java-postcommit-it/java:20210610121920
Untagged:
us.gcr.io/apache-beam-testing/java-postcommit-it/java@sha256:d378e7240b6c145349d35895cb64d047792e3f57d0e810091828b7fb44662751
Digests:
-
us.gcr.io/apache-beam-testing/java-postcommit-it/java@sha256:d378e7240b6c145349d35895cb64d047792e3f57d0e810091828b7fb44662751
Associated tags:
- 20210610121920
Tags:
- us.gcr.io/apache-beam-testing/java-postcommit-it/java:20210610121920
Deleted [us.gcr.io/apache-beam-testing/java-postcommit-it/java:20210610121920].
Deleted
[us.gcr.io/apache-beam-testing/java-postcommit-it/java@sha256:d378e7240b6c145349d35895cb64d047792e3f57d0e810091828b7fb44662751].
FAILURE: Build failed with an exception.
* What went wrong:
Execution failed for task ':sdks:java:testing:nexmark:run'.
> Process 'command '/usr/lib/jvm/java-8-openjdk-amd64/bin/java'' finished with
> non-zero exit value 1
* Try:
Run with --stacktrace option to get the stack trace. Run with --info or --debug
option to get more log output. Run with --scan to get full insights.
* Get more help at https://help.gradle.org
Deprecated Gradle features were used in this build, making it incompatible with
Gradle 7.0.
Use '--warning-mode all' to show the individual deprecation warnings.
See
https://docs.gradle.org/6.8.3/userguide/command_line_interface.html#sec:command_line_warnings
BUILD FAILED in 1h 8m 12s
126 actionable tasks: 15 executed, 111 up-to-date
Publishing build scan...
https://gradle.com/s/jg3cvsboizxra
Build step 'Invoke Gradle script' changed build result to FAILURE
Build step 'Invoke Gradle script' marked build as failure
---------------------------------------------------------------------
To unsubscribe, e-mail: [email protected]
For additional commands, e-mail: [email protected]
