See
<https://ci-beam.apache.org/job/beam_PostCommit_Java_Nexmark_Dataflow_V2/583/display/redirect>
Changes:
------------------------------------------
[...truncated 658.73 KB...]
2021-10-17T07:19:23.399Z RUNNING Query7
2021-10-17T07:19:24.040Z 7 samples not enough to calculate steady-state event
rate
Oct 17, 2021 7:19:24 AM org.apache.beam.sdk.testutils.metrics.MetricsReader
getCounterMetric
SEVERE: Failed to get metric fatal, from namespace Query7
2021-10-17T07:19:24.102Z WARNING: streaming query appears to have been stuck
for 57 min.
2021-10-17T07:19:24.102Z no activity
2021-10-17T07:19:39.146Z RUNNING Query7
2021-10-17T07:19:39.813Z 7 samples not enough to calculate steady-state event
rate
2021-10-17T07:19:39.923Z WARNING: streaming query appears to have been stuck
for 57 min.
Oct 17, 2021 7:19:39 AM org.apache.beam.sdk.testutils.metrics.MetricsReader
getCounterMetric
SEVERE: Failed to get metric fatal, from namespace Query7
2021-10-17T07:19:39.924Z no activity
2021-10-17T07:19:54.965Z RUNNING Query7
2021-10-17T07:19:55.612Z 7 samples not enough to calculate steady-state event
rate
Oct 17, 2021 7:19:55 AM org.apache.beam.sdk.testutils.metrics.MetricsReader
getCounterMetric
SEVERE: Failed to get metric fatal, from namespace Query7
2021-10-17T07:19:55.672Z WARNING: streaming query appears to have been stuck
for 58 min.
2021-10-17T07:19:55.673Z no activity
2021-10-17T07:20:10.712Z RUNNING Query7
2021-10-17T07:20:11.360Z 7 samples not enough to calculate steady-state event
rate
Oct 17, 2021 7:20:11 AM org.apache.beam.sdk.testutils.metrics.MetricsReader
getCounterMetric
SEVERE: Failed to get metric fatal, from namespace Query7
2021-10-17T07:20:11.421Z WARNING: streaming query appears to have been stuck
for 58 min.
2021-10-17T07:20:11.421Z no activity
2021-10-17T07:20:26.504Z RUNNING Query7
2021-10-17T07:20:27.145Z 7 samples not enough to calculate steady-state event
rate
Oct 17, 2021 7:20:27 AM org.apache.beam.sdk.testutils.metrics.MetricsReader
getCounterMetric
SEVERE: Failed to get metric fatal, from namespace Query7
2021-10-17T07:20:27.193Z WARNING: streaming query appears to have been stuck
for 58 min.
2021-10-17T07:20:27.193Z no activity
2021-10-17T07:20:42.260Z RUNNING Query7
2021-10-17T07:20:42.942Z 7 samples not enough to calculate steady-state event
rate
Oct 17, 2021 7:20:43 AM org.apache.beam.sdk.testutils.metrics.MetricsReader
getCounterMetric
SEVERE: Failed to get metric fatal, from namespace Query7
2021-10-17T07:20:43.000Z WARNING: streaming query appears to have been stuck
for 58 min.
2021-10-17T07:20:43.001Z no activity
2021-10-17T07:20:58.032Z RUNNING Query7
2021-10-17T07:20:58.707Z 7 samples not enough to calculate steady-state event
rate
Oct 17, 2021 7:20:58 AM org.apache.beam.sdk.testutils.metrics.MetricsReader
getCounterMetric
2021-10-17T07:20:58.760Z WARNING: streaming query appears to have been stuck
for 59 min.
SEVERE: Failed to get metric fatal, from namespace Query7
2021-10-17T07:20:58.760Z no activity
2021-10-17T07:21:13.816Z RUNNING Query7
2021-10-17T07:21:14.428Z 7 samples not enough to calculate steady-state event
rate
Oct 17, 2021 7:21:14 AM org.apache.beam.sdk.testutils.metrics.MetricsReader
getCounterMetric
2021-10-17T07:21:14.494Z WARNING: streaming query appears to have been stuck
for 59 min.
SEVERE: Failed to get metric fatal, from namespace Query7
2021-10-17T07:21:14.494Z no activity
2021-10-17T07:21:29.524Z RUNNING Query7
2021-10-17T07:21:30.110Z 7 samples not enough to calculate steady-state event
rate
Oct 17, 2021 7:21:30 AM org.apache.beam.sdk.testutils.metrics.MetricsReader
getCounterMetric
SEVERE: Failed to get metric fatal, from namespace Query7
2021-10-17T07:21:30.189Z WARNING: streaming query appears to have been stuck
for 59 min.
2021-10-17T07:21:30.189Z no activity
2021-10-17T07:21:45.234Z RUNNING Query7
2021-10-17T07:21:45.858Z 7 samples not enough to calculate steady-state event
rate
Oct 17, 2021 7:21:45 AM org.apache.beam.sdk.testutils.metrics.MetricsReader
getCounterMetric
2021-10-17T07:21:45.939Z WARNING: streaming query appears to have been stuck
for 59 min.
SEVERE: Failed to get metric fatal, from namespace Query7
2021-10-17T07:21:45.939Z no activity
2021-10-17T07:22:00.977Z RUNNING Query7
2021-10-17T07:22:01.619Z 7 samples not enough to calculate steady-state event
rate
Oct 17, 2021 7:22:01 AM org.apache.beam.sdk.testutils.metrics.MetricsReader
getCounterMetric
2021-10-17T07:22:01.677Z ERROR: streaming query appears to have been stuck for
60 minutes, cancelling job.
SEVERE: Failed to get metric fatal, from namespace Query7
2021-10-17T07:22:01.716Z no activity
2021-10-17T07:22:16.754Z RUNNING Query7 (waiting for shutdown)
2021-10-17T07:22:17.341Z 7 samples not enough to calculate steady-state event
rate
2021-10-17T07:22:17.341Z no activity
2021-10-17T07:22:32.394Z RUNNING Query7 (waiting for shutdown)
2021-10-17T07:22:33.018Z 7 samples not enough to calculate steady-state event
rate
2021-10-17T07:22:33.018Z no activity
2021-10-17T07:22:48.053Z RUNNING Query7 (waiting for shutdown)
2021-10-17T07:22:48.707Z 7 samples not enough to calculate steady-state event
rate
2021-10-17T07:22:48.707Z no activity
2021-10-17T07:23:03.772Z RUNNING Query7 (waiting for shutdown)
2021-10-17T07:23:05.113Z 7 samples not enough to calculate steady-state event
rate
2021-10-17T07:23:05.113Z no activity
2021-10-17T07:23:20.180Z RUNNING Query7 (waiting for shutdown)
2021-10-17T07:23:20.839Z 7 samples not enough to calculate steady-state event
rate
2021-10-17T07:23:20.839Z no activity
2021-10-17T07:23:35.888Z RUNNING Query7 (waiting for shutdown)
2021-10-17T07:23:36.600Z 7 samples not enough to calculate steady-state event
rate
2021-10-17T07:23:36.600Z no activity
2021-10-17T07:23:51.667Z RUNNING Query7 (waiting for shutdown)
2021-10-17T07:23:52.317Z 7 samples not enough to calculate steady-state event
rate
2021-10-17T07:23:52.318Z no activity
2021-10-17T07:24:07.347Z RUNNING Query7 (waiting for shutdown)
2021-10-17T07:24:07.977Z 7 samples not enough to calculate steady-state event
rate
2021-10-17T07:24:07.977Z no activity
2021-10-17T07:24:23.028Z RUNNING Query7 (waiting for shutdown)
2021-10-17T07:24:23.686Z 7 samples not enough to calculate steady-state event
rate
2021-10-17T07:24:23.686Z no activity
2021-10-17T07:24:38.716Z RUNNING Query7 (waiting for shutdown)
2021-10-17T07:24:39.306Z 7 samples not enough to calculate steady-state event
rate
2021-10-17T07:24:39.306Z no activity
2021-10-17T07:24:54.349Z CANCELLED Query7 (waiting for shutdown)
2021-10-17T07:24:54.387Z 7 samples not enough to calculate steady-state event
rate
==========================================================================================
Run started 2021-10-17T06:15:26.899Z and ran for PT4167.489S
Default configuration:
{"debug":true,"query":null,"sourceType":"DIRECT","generateEventFilePathPrefix":null,"sinkType":"DEVNULL","exportSummaryToBigQuery":false,"pubSubMode":"COMBINED","pubsubMessageSerializationMethod":"CODER","sideInputType":"DIRECT","sideInputRowCount":500,"sideInputNumShards":3,"sideInputUrl":null,"sessionGap":600000,"numEvents":100000,"numEventGenerators":100,"rateShape":"SINE","firstEventRate":10000,"nextEventRate":10000,"rateUnit":"PER_SECOND","ratePeriodSec":600,"preloadSeconds":0,"streamTimeout":240,"isRateLimited":false,"useWallclockEventTime":false,"avgPersonByteSize":200,"avgAuctionByteSize":500,"avgBidByteSize":100,"hotAuctionRatio":2,"hotSellersRatio":4,"hotBiddersRatio":4,"windowSizeSec":10,"windowPeriodSec":5,"watermarkHoldbackSec":0,"numInFlightAuctions":100,"numActivePeople":1000,"coderStrategy":"HAND","cpuDelayMs":0,"diskBusyBytes":0,"auctionSkip":123,"fanout":5,"maxAuctionsWaitingTime":600,"occasionalDelaySec":3,"probDelayedEvent":0.1,"maxLogEvents":100000,"usePubsubPublishTime":false,"outOfOrderGroupSize":1,"numKeyBuckets":20000,"pardoCPUFactor":1.0}
Configurations:
Conf Description
0000 query:PASSTHROUGH; numEvents:10000000
0001 query:CURRENCY_CONVERSION; numEvents:10000000
0002 query:SELECTION; numEvents:10000000
0003 query:LOCAL_ITEM_SUGGESTION; numEvents:10000000
0004 query:AVERAGE_PRICE_FOR_CATEGORY; numEvents:1000000
0005 query:HOT_ITEMS; numEvents:10000000
0006 query:AVERAGE_SELLING_PRICE_BY_SELLER; numEvents:1000000
0007 query:HIGHEST_BID; numEvents:10000000
0008 query:MONITOR_NEW_USERS; numEvents:10000000
0009 query:WINNING_BIDS; numEvents:1000000
0010 query:LOG_TO_SHARDED_FILES; numEvents:10000000
0011 query:USER_SESSIONS; numEvents:10000000
0012 query:PROCESSING_TIME_WINDOWS; numEvents:10000000
0013 query:PORTABILITY_BATCH; numEvents:10000000
0014 query:BOUNDED_SIDE_INPUT_JOIN; numEvents:10000000
0015 query:SESSION_SIDE_INPUT_JOIN; numEvents:10000000
Performance:
Conf Runtime(sec) (Baseline) Events(/sec) (Baseline) Results
(Baseline)
0000 30.9 182245.2 5629009
0001 26.6 307747.4 7518417
0002 18.5 481252.7 68518
0003 73.0 131398.1 56865
0004 *** not run ***
0005 429.3 23262.5 4563
0006 *** not run ***
0007 171.5 57885.0 97
*** Cancelling streaming job since it appeared stuck for 60 min. ***
0008 107.2 92679.0 92273
0009 *** not run ***
0010 94.7 105566.4 100
0011 365.0 26212.2 1761576
0012 140.3 70429.9 357543
0013 *** not run ***
0014 *** not run ***
0015 *** not run ***
==========================================================================================
==========================================================================================
Run started 2021-10-17T06:15:26.899Z and ran for PT4167.734S
Default configuration:
{"debug":true,"query":null,"sourceType":"DIRECT","generateEventFilePathPrefix":null,"sinkType":"DEVNULL","exportSummaryToBigQuery":false,"pubSubMode":"COMBINED","pubsubMessageSerializationMethod":"CODER","sideInputType":"DIRECT","sideInputRowCount":500,"sideInputNumShards":3,"sideInputUrl":null,"sessionGap":600000,"numEvents":100000,"numEventGenerators":100,"rateShape":"SINE","firstEventRate":10000,"nextEventRate":10000,"rateUnit":"PER_SECOND","ratePeriodSec":600,"preloadSeconds":0,"streamTimeout":240,"isRateLimited":false,"useWallclockEventTime":false,"avgPersonByteSize":200,"avgAuctionByteSize":500,"avgBidByteSize":100,"hotAuctionRatio":2,"hotSellersRatio":4,"hotBiddersRatio":4,"windowSizeSec":10,"windowPeriodSec":5,"watermarkHoldbackSec":0,"numInFlightAuctions":100,"numActivePeople":1000,"coderStrategy":"HAND","cpuDelayMs":0,"diskBusyBytes":0,"auctionSkip":123,"fanout":5,"maxAuctionsWaitingTime":600,"occasionalDelaySec":3,"probDelayedEvent":0.1,"maxLogEvents":100000,"usePubsubPublishTime":false,"outOfOrderGroupSize":1,"numKeyBuckets":20000,"pardoCPUFactor":1.0}
Configurations:
Conf Description
0000 query:PASSTHROUGH; numEvents:10000000
0001 query:CURRENCY_CONVERSION; numEvents:10000000
0002 query:SELECTION; numEvents:10000000
0003 query:LOCAL_ITEM_SUGGESTION; numEvents:10000000
0004 query:AVERAGE_PRICE_FOR_CATEGORY; numEvents:1000000
0005 query:HOT_ITEMS; numEvents:10000000
0006 query:AVERAGE_SELLING_PRICE_BY_SELLER; numEvents:1000000
0007 query:HIGHEST_BID; numEvents:10000000
0008 query:MONITOR_NEW_USERS; numEvents:10000000
0009 query:WINNING_BIDS; numEvents:1000000
0010 query:LOG_TO_SHARDED_FILES; numEvents:10000000
0011 query:USER_SESSIONS; numEvents:10000000
0012 query:PROCESSING_TIME_WINDOWS; numEvents:10000000
0013 query:PORTABILITY_BATCH; numEvents:10000000
0014 query:BOUNDED_SIDE_INPUT_JOIN; numEvents:10000000
0015 query:SESSION_SIDE_INPUT_JOIN; numEvents:10000000
Performance:
Conf Runtime(sec) (Baseline) Events(/sec) (Baseline) Results
(Baseline)
0000 30.9 182245.2 5629009
0001 26.6 307747.4 7518417
0002 18.5 481252.7 68518
0003 73.0 131398.1 56865
0004 *** not run ***
0005 429.3 23262.5 4563
0006 *** not run ***
0007 171.5 57885.0 97
*** Cancelling streaming job since it appeared stuck for 60 min. ***
0008 107.2 92679.0 92273
0009 *** not run ***
0010 94.7 105566.4 100
0011 365.0 26212.2 1761576
0012 140.3 70429.9 357543
0013 *** not run ***
0014 *** not run ***
0015 *** not run ***
==========================================================================================
Exception in thread "main" java.lang.RuntimeException: Execution was not
successful
at org.apache.beam.sdk.nexmark.Main.runAll(Main.java:186)
at org.apache.beam.sdk.nexmark.Main.main(Main.java:495)
> Task :sdks:java:testing:nexmark:run FAILED
> Task :runners:google-cloud-dataflow-java:cleanUpDockerImages
Untagged: us.gcr.io/apache-beam-testing/java-postcommit-it/java:20211017061429
Untagged:
us.gcr.io/apache-beam-testing/java-postcommit-it/java@sha256:083e7a3f30660380ab40a414ed8d91e5ee50c4226176b796834dfc7aaf98d1db
Deleted: sha256:7c0eeed3d22c4045ca6c44030531098f75456044dca4e550c4b55482cec9bdce
Deleted: sha256:9ac0179a557668aac820dbc50dbd2b26a898b7eaa9d2dd81360d02d25412c82b
Deleted: sha256:d208046b292eca33c60925213dfb5145336eb36513ef9c58c7a120dc128def86
Deleted: sha256:4f83b15e586d0e7a3a5926a1d986a42761142e5f963a935cf1b8a857e6bfe99b
Deleted: sha256:4376199383f1523e7147b77a644abad3de9d37bab2c6ea959e56ed9eb1f67f0c
Deleted: sha256:fc612b4b0af09f196197846ebf27a4b64e4ecb70cde5fc8e8301c1d64dd4f448
Deleted: sha256:4cf0c268058f9f9a0fa0b71bf3de9f80c262d7513a94098266a4c7929f8386f4
Deleted: sha256:fe435ddd05d0406de44244a986279d7d2a9a1c5250919014b8bbd7fdd21f2251
Deleted: sha256:c25dcaf02202bd762760d663e82b0cc2cf2401131c8196eca8fee60b7aa254e9
Deleted: sha256:9b34e6d92ca847e961ccff3683d7bb08ebdee6f0470842ae8610475a0ed0178a
Deleted: sha256:c686c7eed035a3dbf9b782874fc80b275553152961d8b1af46a855664c8e5d15
Deleted: sha256:3d949cae1dc7cf0d7bbda44da98cde2c79807aead31204260c3fc63e4f3401e6
Deleted: sha256:d6dda41f59306fa0358494ac14192c42f4c42bce96ea635c605e79ffd3f8aea3
Deleted: sha256:5b1db67487de963e94750e8e5f1c82d1b3cc6d58f6b13cec33ddbf28689b5277
Deleted: sha256:2b441ad9b6a6db529c3a7fbec387e45ffa31a70074d183924f43851c512bcc6e
Deleted: sha256:6a7eba722e6fb65dd0a7e7f72883e162580e99c844286a3f0dafb3f0cc7048c4
Tag: [us.gcr.io/apache-beam-testing/java-postcommit-it/java:20211017061429]
- referencing digest:
[us.gcr.io/apache-beam-testing/java-postcommit-it/java@sha256:083e7a3f30660380ab40a414ed8d91e5ee50c4226176b796834dfc7aaf98d1db]
Deleted [[us.gcr.io/apache-beam-testing/java-postcommit-it/java:20211017061429]
(referencing
[us.gcr.io/apache-beam-testing/java-postcommit-it/java@sha256:083e7a3f30660380ab40a414ed8d91e5ee50c4226176b796834dfc7aaf98d1db])].
Removing untagged image
us.gcr.io/apache-beam-testing/java-postcommit-it/java@sha256:083e7a3f30660380ab40a414ed8d91e5ee50c4226176b796834dfc7aaf98d1db
Digests:
-
us.gcr.io/apache-beam-testing/java-postcommit-it/java@sha256:083e7a3f30660380ab40a414ed8d91e5ee50c4226176b796834dfc7aaf98d1db
Deleted
[us.gcr.io/apache-beam-testing/java-postcommit-it/java@sha256:083e7a3f30660380ab40a414ed8d91e5ee50c4226176b796834dfc7aaf98d1db].
FAILURE: Build failed with an exception.
* What went wrong:
Execution failed for task ':sdks:java:testing:nexmark:run'.
> Process 'command '/usr/lib/jvm/java-8-openjdk-amd64/bin/java'' finished with
> non-zero exit value 1
* Try:
Run with --stacktrace option to get the stack trace. Run with --info or --debug
option to get more log output. Run with --scan to get full insights.
* Get more help at https://help.gradle.org
Deprecated Gradle features were used in this build, making it incompatible with
Gradle 7.0.
Use '--warning-mode all' to show the individual deprecation warnings.
See
https://docs.gradle.org/6.9.1/userguide/command_line_interface.html#sec:command_line_warnings
BUILD FAILED in 1h 10m 31s
123 actionable tasks: 10 executed, 113 up-to-date
Publishing build scan...
https://gradle.com/s/y3ughvg2xsgwa
Build step 'Invoke Gradle script' changed build result to FAILURE
Build step 'Invoke Gradle script' marked build as failure
---------------------------------------------------------------------
To unsubscribe, e-mail: [email protected]
For additional commands, e-mail: [email protected]
