See
<https://ci-beam.apache.org/job/beam_PostCommit_Java_Nexmark_Dataflow_V2/549/display/redirect?page=changes>
Changes:
[noreply] fixing test link
[noreply] fix linter issues
------------------------------------------
[...truncated 800.75 KB...]
2021-10-08T19:22:06.831Z no activity
2021-10-08T19:22:21.864Z RUNNING Query7
2021-10-08T19:22:22.662Z sample of 47.5 sec not long enough to calculate
steady-state event rate
Oct 08, 2021 7:22:22 PM org.apache.beam.sdk.testutils.metrics.MetricsReader
getCounterMetric
2021-10-08T19:22:22.713Z WARNING: streaming query appears to have been stuck
for 56 min.
SEVERE: Failed to get metric fatal, from namespace Query7
2021-10-08T19:22:22.713Z no activity
2021-10-08T19:22:37.755Z RUNNING Query7
2021-10-08T19:22:38.516Z sample of 47.5 sec not long enough to calculate
steady-state event rate
Oct 08, 2021 7:22:38 PM org.apache.beam.sdk.testutils.metrics.MetricsReader
getCounterMetric
2021-10-08T19:22:38.592Z WARNING: streaming query appears to have been stuck
for 57 min.
2021-10-08T19:22:38.592Z no activity
SEVERE: Failed to get metric fatal, from namespace Query7
2021-10-08T19:22:53.622Z RUNNING Query7
2021-10-08T19:22:54.298Z sample of 47.5 sec not long enough to calculate
steady-state event rate
Oct 08, 2021 7:22:54 PM org.apache.beam.sdk.testutils.metrics.MetricsReader
getCounterMetric
SEVERE: Failed to get metric fatal, from namespace Query7
2021-10-08T19:22:54.366Z WARNING: streaming query appears to have been stuck
for 57 min.
2021-10-08T19:22:54.366Z no activity
2021-10-08T19:23:09.408Z RUNNING Query7
2021-10-08T19:23:10.060Z sample of 47.5 sec not long enough to calculate
steady-state event rate
Oct 08, 2021 7:23:10 PM org.apache.beam.sdk.testutils.metrics.MetricsReader
getCounterMetric
2021-10-08T19:23:10.152Z WARNING: streaming query appears to have been stuck
for 57 min.
SEVERE: Failed to get metric fatal, from namespace Query7
2021-10-08T19:23:10.152Z no activity
2021-10-08T19:23:25.177Z RUNNING Query7
2021-10-08T19:23:25.799Z sample of 47.5 sec not long enough to calculate
steady-state event rate
Oct 08, 2021 7:23:25 PM org.apache.beam.sdk.testutils.metrics.MetricsReader
getCounterMetric
2021-10-08T19:23:25.863Z WARNING: streaming query appears to have been stuck
for 57 min.
SEVERE: Failed to get metric fatal, from namespace Query7
2021-10-08T19:23:25.863Z no activity
2021-10-08T19:23:40.911Z RUNNING Query7
2021-10-08T19:23:41.621Z sample of 47.5 sec not long enough to calculate
steady-state event rate
Oct 08, 2021 7:23:41 PM org.apache.beam.sdk.testutils.metrics.MetricsReader
getCounterMetric
2021-10-08T19:23:41.685Z WARNING: streaming query appears to have been stuck
for 58 min.
2021-10-08T19:23:41.685Z no activity
SEVERE: Failed to get metric fatal, from namespace Query7
2021-10-08T19:23:56.720Z RUNNING Query7
2021-10-08T19:23:57.395Z sample of 47.5 sec not long enough to calculate
steady-state event rate
Oct 08, 2021 7:23:57 PM org.apache.beam.sdk.testutils.metrics.MetricsReader
getCounterMetric
SEVERE: Failed to get metric fatal, from namespace Query7
2021-10-08T19:23:57.455Z WARNING: streaming query appears to have been stuck
for 58 min.
2021-10-08T19:23:57.456Z no activity
2021-10-08T19:24:12.530Z RUNNING Query7
2021-10-08T19:24:13.155Z sample of 47.5 sec not long enough to calculate
steady-state event rate
Oct 08, 2021 7:24:13 PM org.apache.beam.sdk.testutils.metrics.MetricsReader
getCounterMetric
SEVERE: Failed to get metric fatal, from namespace Query7
2021-10-08T19:24:13.214Z WARNING: streaming query appears to have been stuck
for 58 min.
2021-10-08T19:24:13.215Z no activity
2021-10-08T19:24:28.243Z RUNNING Query7
2021-10-08T19:24:28.808Z sample of 47.5 sec not long enough to calculate
steady-state event rate
Oct 08, 2021 7:24:28 PM org.apache.beam.sdk.testutils.metrics.MetricsReader
getCounterMetric
2021-10-08T19:24:28.870Z WARNING: streaming query appears to have been stuck
for 58 min.
SEVERE: Failed to get metric fatal, from namespace Query7
2021-10-08T19:24:28.870Z no activity
2021-10-08T19:24:43.918Z RUNNING Query7
2021-10-08T19:24:44.564Z sample of 47.5 sec not long enough to calculate
steady-state event rate
Oct 08, 2021 7:24:44 PM org.apache.beam.sdk.testutils.metrics.MetricsReader
getCounterMetric
2021-10-08T19:24:44.637Z WARNING: streaming query appears to have been stuck
for 59 min.
2021-10-08T19:24:44.637Z no activity
SEVERE: Failed to get metric fatal, from namespace Query7
2021-10-08T19:24:59.664Z RUNNING Query7
2021-10-08T19:25:00.245Z sample of 47.5 sec not long enough to calculate
steady-state event rate
Oct 08, 2021 7:25:00 PM org.apache.beam.sdk.testutils.metrics.MetricsReader
getCounterMetric
2021-10-08T19:25:00.297Z WARNING: streaming query appears to have been stuck
for 59 min.
SEVERE: Failed to get metric fatal, from namespace Query7
2021-10-08T19:25:00.297Z no activity
2021-10-08T19:25:15.327Z RUNNING Query7
2021-10-08T19:25:15.953Z sample of 47.5 sec not long enough to calculate
steady-state event rate
Oct 08, 2021 7:25:16 PM org.apache.beam.sdk.testutils.metrics.MetricsReader
getCounterMetric
SEVERE: Failed to get metric fatal, from namespace Query7
2021-10-08T19:25:16.019Z WARNING: streaming query appears to have been stuck
for 59 min.
2021-10-08T19:25:16.019Z no activity
2021-10-08T19:25:31.046Z RUNNING Query7
2021-10-08T19:25:31.723Z sample of 47.5 sec not long enough to calculate
steady-state event rate
Oct 08, 2021 7:25:31 PM org.apache.beam.sdk.testutils.metrics.MetricsReader
getCounterMetric
2021-10-08T19:25:31.793Z WARNING: streaming query appears to have been stuck
for 59 min.
SEVERE: Failed to get metric fatal, from namespace Query7
2021-10-08T19:25:31.793Z no activity
2021-10-08T19:25:46.834Z RUNNING Query7
2021-10-08T19:25:47.425Z sample of 47.5 sec not long enough to calculate
steady-state event rate
Oct 08, 2021 7:25:47 PM org.apache.beam.sdk.testutils.metrics.MetricsReader
getCounterMetric
2021-10-08T19:25:47.504Z ERROR: streaming query appears to have been stuck for
60 minutes, cancelling job.
SEVERE: Failed to get metric fatal, from namespace Query7
2021-10-08T19:25:47.536Z no activity
2021-10-08T19:26:02.678Z RUNNING Query7 (waiting for shutdown)
2021-10-08T19:26:03.367Z sample of 47.5 sec not long enough to calculate
steady-state event rate
2021-10-08T19:26:03.367Z no activity
2021-10-08T19:26:18.396Z RUNNING Query7 (waiting for shutdown)
2021-10-08T19:26:19.017Z sample of 47.5 sec not long enough to calculate
steady-state event rate
2021-10-08T19:26:19.017Z no activity
2021-10-08T19:26:34.042Z RUNNING Query7 (waiting for shutdown)
2021-10-08T19:26:34.663Z sample of 47.5 sec not long enough to calculate
steady-state event rate
2021-10-08T19:26:34.663Z no activity
2021-10-08T19:26:49.695Z RUNNING Query7 (waiting for shutdown)
2021-10-08T19:26:50.305Z sample of 47.5 sec not long enough to calculate
steady-state event rate
2021-10-08T19:26:50.305Z no activity
2021-10-08T19:27:05.341Z RUNNING Query7 (waiting for shutdown)
2021-10-08T19:27:05.870Z sample of 47.5 sec not long enough to calculate
steady-state event rate
2021-10-08T19:27:05.870Z no activity
2021-10-08T19:27:20.897Z RUNNING Query7 (waiting for shutdown)
2021-10-08T19:27:21.634Z sample of 47.5 sec not long enough to calculate
steady-state event rate
2021-10-08T19:27:21.634Z no activity
2021-10-08T19:27:36.657Z RUNNING Query7 (waiting for shutdown)
2021-10-08T19:27:37.269Z sample of 47.5 sec not long enough to calculate
steady-state event rate
2021-10-08T19:27:37.269Z no activity
2021-10-08T19:27:52.298Z RUNNING Query7 (waiting for shutdown)
2021-10-08T19:27:52.879Z sample of 47.5 sec not long enough to calculate
steady-state event rate
2021-10-08T19:27:52.879Z no activity
2021-10-08T19:28:07.906Z RUNNING Query7 (waiting for shutdown)
2021-10-08T19:28:08.488Z sample of 47.5 sec not long enough to calculate
steady-state event rate
2021-10-08T19:28:08.489Z no activity
2021-10-08T19:28:23.524Z CANCELLED Query7 (waiting for shutdown)
2021-10-08T19:28:23.562Z sample of 47.5 sec not long enough to calculate
steady-state event rate
==========================================================================================
Run started 2021-10-08T18:13:30.482Z and ran for PT4493.080S
Default configuration:
{"debug":true,"query":null,"sourceType":"DIRECT","generateEventFilePathPrefix":null,"sinkType":"DEVNULL","exportSummaryToBigQuery":false,"pubSubMode":"COMBINED","pubsubMessageSerializationMethod":"CODER","sideInputType":"DIRECT","sideInputRowCount":500,"sideInputNumShards":3,"sideInputUrl":null,"sessionGap":600000,"numEvents":100000,"numEventGenerators":100,"rateShape":"SINE","firstEventRate":10000,"nextEventRate":10000,"rateUnit":"PER_SECOND","ratePeriodSec":600,"preloadSeconds":0,"streamTimeout":240,"isRateLimited":false,"useWallclockEventTime":false,"avgPersonByteSize":200,"avgAuctionByteSize":500,"avgBidByteSize":100,"hotAuctionRatio":2,"hotSellersRatio":4,"hotBiddersRatio":4,"windowSizeSec":10,"windowPeriodSec":5,"watermarkHoldbackSec":0,"numInFlightAuctions":100,"numActivePeople":1000,"coderStrategy":"HAND","cpuDelayMs":0,"diskBusyBytes":0,"auctionSkip":123,"fanout":5,"maxAuctionsWaitingTime":600,"occasionalDelaySec":3,"probDelayedEvent":0.1,"maxLogEvents":100000,"usePubsubPublishTime":false,"outOfOrderGroupSize":1,"numKeyBuckets":20000,"pardoCPUFactor":1.0}
Configurations:
Conf Description
0000 query:PASSTHROUGH; numEvents:10000000
0001 query:CURRENCY_CONVERSION; numEvents:10000000
0002 query:SELECTION; numEvents:10000000
0003 query:LOCAL_ITEM_SUGGESTION; numEvents:10000000
0004 query:AVERAGE_PRICE_FOR_CATEGORY; numEvents:1000000
0005 query:HOT_ITEMS; numEvents:10000000
0006 query:AVERAGE_SELLING_PRICE_BY_SELLER; numEvents:1000000
0007 query:HIGHEST_BID; numEvents:10000000
0008 query:MONITOR_NEW_USERS; numEvents:10000000
0009 query:WINNING_BIDS; numEvents:1000000
0010 query:LOG_TO_SHARDED_FILES; numEvents:10000000
0011 query:USER_SESSIONS; numEvents:10000000
0012 query:PROCESSING_TIME_WINDOWS; numEvents:10000000
0013 query:PORTABILITY_BATCH; numEvents:10000000
0014 query:BOUNDED_SIDE_INPUT_JOIN; numEvents:10000000
0015 query:SESSION_SIDE_INPUT_JOIN; numEvents:10000000
Performance:
Conf Runtime(sec) (Baseline) Events(/sec) (Baseline) Results
(Baseline)
0000 29.7 236617.8 7016191
0001 24.8 283437.9 6456163
0002 18.6 484665.4 73214
0003 71.6 137503.4 58435
0004 *** not run ***
0005 474.6 20974.4 4542
0006 *** not run ***
0007 312.3 31482.3 100
*** Cancelling streaming job since it appeared stuck for 60 min. ***
0008 104.4 94874.3 92021
0009 *** not run ***
0010 110.3 88904.1 100
0011 503.8 19325.9 1791099
0012 135.8 73664.3 301203
0013 *** not run ***
0014 *** not run ***
0015 *** not run ***
==========================================================================================
==========================================================================================
Run started 2021-10-08T18:13:30.482Z and ran for PT4493.271S
Default configuration:
{"debug":true,"query":null,"sourceType":"DIRECT","generateEventFilePathPrefix":null,"sinkType":"DEVNULL","exportSummaryToBigQuery":false,"pubSubMode":"COMBINED","pubsubMessageSerializationMethod":"CODER","sideInputType":"DIRECT","sideInputRowCount":500,"sideInputNumShards":3,"sideInputUrl":null,"sessionGap":600000,"numEvents":100000,"numEventGenerators":100,"rateShape":"SINE","firstEventRate":10000,"nextEventRate":10000,"rateUnit":"PER_SECOND","ratePeriodSec":600,"preloadSeconds":0,"streamTimeout":240,"isRateLimited":false,"useWallclockEventTime":false,"avgPersonByteSize":200,"avgAuctionByteSize":500,"avgBidByteSize":100,"hotAuctionRatio":2,"hotSellersRatio":4,"hotBiddersRatio":4,"windowSizeSec":10,"windowPeriodSec":5,"watermarkHoldbackSec":0,"numInFlightAuctions":100,"numActivePeople":1000,"coderStrategy":"HAND","cpuDelayMs":0,"diskBusyBytes":0,"auctionSkip":123,"fanout":5,"maxAuctionsWaitingTime":600,"occasionalDelaySec":3,"probDelayedEvent":0.1,"maxLogEvents":100000,"usePubsubPublishTime":false,"outOfOrderGroupSize":1,"numKeyBuckets":20000,"pardoCPUFactor":1.0}
Configurations:
Conf Description
0000 query:PASSTHROUGH; numEvents:10000000
0001 query:CURRENCY_CONVERSION; numEvents:10000000
0002 query:SELECTION; numEvents:10000000
0003 query:LOCAL_ITEM_SUGGESTION; numEvents:10000000
0004 query:AVERAGE_PRICE_FOR_CATEGORY; numEvents:1000000
0005 query:HOT_ITEMS; numEvents:10000000
0006 query:AVERAGE_SELLING_PRICE_BY_SELLER; numEvents:1000000
0007 query:HIGHEST_BID; numEvents:10000000
0008 query:MONITOR_NEW_USERS; numEvents:10000000
0009 query:WINNING_BIDS; numEvents:1000000
0010 query:LOG_TO_SHARDED_FILES; numEvents:10000000
0011 query:USER_SESSIONS; numEvents:10000000
0012 query:PROCESSING_TIME_WINDOWS; numEvents:10000000
0013 query:PORTABILITY_BATCH; numEvents:10000000
0014 query:BOUNDED_SIDE_INPUT_JOIN; numEvents:10000000
0015 query:SESSION_SIDE_INPUT_JOIN; numEvents:10000000
Performance:
Conf Runtime(sec) (Baseline) Events(/sec) (Baseline) Results
(Baseline)
0000 29.7 236617.8 7016191
0001 24.8 283437.9 6456163
0002 18.6 484665.4 73214
0003 71.6 137503.4 58435
0004 *** not run ***
0005 474.6 20974.4 4542
0006 *** not run ***
0007 312.3 31482.3 100
*** Cancelling streaming job since it appeared stuck for 60 min. ***
0008 104.4 94874.3 92021
0009 *** not run ***
0010 110.3 88904.1 100
0011 503.8 19325.9 1791099
0012 135.8 73664.3 301203
0013 *** not run ***
0014 *** not run ***
0015 *** not run ***
==========================================================================================
Exception in thread "main" java.lang.RuntimeException: Execution was not
successful
at org.apache.beam.sdk.nexmark.Main.runAll(Main.java:186)
at org.apache.beam.sdk.nexmark.Main.main(Main.java:495)
> Task :sdks:java:testing:nexmark:run FAILED
> Task :runners:google-cloud-dataflow-java:cleanUpDockerImages
Untagged: us.gcr.io/apache-beam-testing/java-postcommit-it/java:20211008181248
Untagged:
us.gcr.io/apache-beam-testing/java-postcommit-it/java@sha256:508609d3ffde7fcb958ca3eb1388ba093838123e7384e7f15ee8fd5717b8d35d
Tag: [us.gcr.io/apache-beam-testing/java-postcommit-it/java:20211008181248]
- referencing digest:
[us.gcr.io/apache-beam-testing/java-postcommit-it/java@sha256:508609d3ffde7fcb958ca3eb1388ba093838123e7384e7f15ee8fd5717b8d35d]
Deleted [[us.gcr.io/apache-beam-testing/java-postcommit-it/java:20211008181248]
(referencing
[us.gcr.io/apache-beam-testing/java-postcommit-it/java@sha256:508609d3ffde7fcb958ca3eb1388ba093838123e7384e7f15ee8fd5717b8d35d])].
Removing untagged image
us.gcr.io/apache-beam-testing/java-postcommit-it/java@sha256:508609d3ffde7fcb958ca3eb1388ba093838123e7384e7f15ee8fd5717b8d35d
Digests:
-
us.gcr.io/apache-beam-testing/java-postcommit-it/java@sha256:508609d3ffde7fcb958ca3eb1388ba093838123e7384e7f15ee8fd5717b8d35d
Deleted
[us.gcr.io/apache-beam-testing/java-postcommit-it/java@sha256:508609d3ffde7fcb958ca3eb1388ba093838123e7384e7f15ee8fd5717b8d35d].
FAILURE: Build failed with an exception.
* What went wrong:
Execution failed for task ':sdks:java:testing:nexmark:run'.
> Process 'command '/usr/lib/jvm/java-8-openjdk-amd64/bin/java'' finished with
> non-zero exit value 1
* Try:
Run with --stacktrace option to get the stack trace. Run with --info or --debug
option to get more log output. Run with --scan to get full insights.
* Get more help at https://help.gradle.org
Deprecated Gradle features were used in this build, making it incompatible with
Gradle 7.0.
Use '--warning-mode all' to show the individual deprecation warnings.
See
https://docs.gradle.org/6.9.1/userguide/command_line_interface.html#sec:command_line_warnings
BUILD FAILED in 1h 15m 40s
123 actionable tasks: 10 executed, 113 up-to-date
Publishing build scan...
https://gradle.com/s/k3727zc2ole7q
Build step 'Invoke Gradle script' changed build result to FAILURE
Build step 'Invoke Gradle script' marked build as failure
---------------------------------------------------------------------
To unsubscribe, e-mail: [email protected]
For additional commands, e-mail: [email protected]
