See
<https://ci-beam.apache.org/job/beam_PostCommit_Java_Nexmark_Flink/7556/display/redirect>
Changes:
------------------------------------------
[...truncated 16.00 MB...]
"type": "beam:metrics:sum_int64:v1",
"payload": "4M4F",
"labels": {
"NAMESPACE": "SessionSideInputJoin",
"NAME": "records",
"PTRANSFORM": "SessionSideInputJoin.Format/ParMultiDo(Anonymous)"
}
}]
}
}
Aug 21, 2021 12:30:26 PM
org.apache.flink.runtime.resourcemanager.ResourceManager
closeJobManagerConnection
INFO: Disconnect job manager
a53065802b23ff996be19264bf314fc4@akka://flink/user/rpc/jobmanager_63 for job
2741604930618d9de523497a8a1c0d0e from the resource manager.
Aug 21, 2021 12:30:26 PM
org.apache.flink.runtime.taskexecutor.slot.TaskSlotTableImpl freeSlotInternal
INFO: Free slot TaskSlot(index:4, state:ALLOCATED, resource profile:
ResourceProfile{taskHeapMemory=64.000gb (68719476736 bytes),
taskOffHeapMemory=64.000gb (68719476736 bytes), managedMemory=8.000mb (8388608
bytes), networkMemory=4.000mb (4194304 bytes)}, allocationId:
b5c0c7d66b382351aa21aa9fdba50707, jobId: 2741604930618d9de523497a8a1c0d0e).
Aug 21, 2021 12:30:26 PM
org.apache.flink.runtime.taskexecutor.slot.TaskSlotTableImpl freeSlotInternal
INFO: Free slot TaskSlot(index:13, state:ALLOCATED, resource profile:
ResourceProfile{taskHeapMemory=64.000gb (68719476736 bytes),
taskOffHeapMemory=64.000gb (68719476736 bytes), managedMemory=8.000mb (8388608
bytes), networkMemory=4.000mb (4194304 bytes)}, allocationId:
ebd66f8dbc5c630b92cd369ec0831f5f, jobId: 2741604930618d9de523497a8a1c0d0e).
Aug 21, 2021 12:30:26 PM
org.apache.flink.runtime.taskexecutor.slot.TaskSlotTableImpl freeSlotInternal
INFO: Free slot TaskSlot(index:1, state:ALLOCATED, resource profile:
ResourceProfile{taskHeapMemory=64.000gb (68719476736 bytes),
taskOffHeapMemory=64.000gb (68719476736 bytes), managedMemory=8.000mb (8388608
bytes), networkMemory=4.000mb (4194304 bytes)}, allocationId:
0356025c608387724e4359df2e710692, jobId: 2741604930618d9de523497a8a1c0d0e).
Aug 21, 2021 12:30:26 PM
org.apache.flink.runtime.taskexecutor.slot.TaskSlotTableImpl freeSlotInternal
INFO: Free slot TaskSlot(index:15, state:ALLOCATED, resource profile:
ResourceProfile{taskHeapMemory=64.000gb (68719476736 bytes),
taskOffHeapMemory=64.000gb (68719476736 bytes), managedMemory=8.000mb (8388608
bytes), networkMemory=4.000mb (4194304 bytes)}, allocationId:
20965073138798e96e3ca4ccfc82b7bf, jobId: 2741604930618d9de523497a8a1c0d0e).
Aug 21, 2021 12:30:26 PM
org.apache.flink.runtime.taskexecutor.slot.TaskSlotTableImpl freeSlotInternal
INFO: Free slot TaskSlot(index:5, state:ALLOCATED, resource profile:
ResourceProfile{taskHeapMemory=64.000gb (68719476736 bytes),
taskOffHeapMemory=64.000gb (68719476736 bytes), managedMemory=8.000mb (8388608
bytes), networkMemory=4.000mb (4194304 bytes)}, allocationId:
0f5fa3455c87ebe19f744f55c7e112b7, jobId: 2741604930618d9de523497a8a1c0d0e).
Aug 21, 2021 12:30:26 PM
org.apache.flink.runtime.taskexecutor.slot.TaskSlotTableImpl freeSlotInternal
INFO: Free slot TaskSlot(index:2, state:ALLOCATED, resource profile:
ResourceProfile{taskHeapMemory=64.000gb (68719476736 bytes),
taskOffHeapMemory=64.000gb (68719476736 bytes), managedMemory=8.000mb (8388608
bytes), networkMemory=4.000mb (4194304 bytes)}, allocationId:
2c57e009859192aa0321ba9f80eb6cfd, jobId: 2741604930618d9de523497a8a1c0d0e).
2021-08-21T12:30:26.513Z Waiting for main pipeline to 'finish'
2021-08-21T12:30:26.513Z DONE SessionSideInputJoin
Aug 21, 2021 12:30:26 PM
org.apache.flink.runtime.taskexecutor.slot.TaskSlotTableImpl freeSlotInternal
INFO: Free slot TaskSlot(index:11, state:ALLOCATED, resource profile:
ResourceProfile{taskHeapMemory=64.000gb (68719476736 bytes),
taskOffHeapMemory=64.000gb (68719476736 bytes), managedMemory=8.000mb (8388608
bytes), networkMemory=4.000mb (4194304 bytes)}, allocationId:
dba42f6a64d5fd0972891b9fdbb6c47f, jobId: 2741604930618d9de523497a8a1c0d0e).
Aug 21, 2021 12:30:26 PM
org.apache.flink.runtime.taskexecutor.slot.TaskSlotTableImpl freeSlotInternal
INFO: Free slot TaskSlot(index:8, state:ALLOCATED, resource profile:
ResourceProfile{taskHeapMemory=64.000gb (68719476736 bytes),
taskOffHeapMemory=64.000gb (68719476736 bytes), managedMemory=8.000mb (8388608
bytes), networkMemory=4.000mb (4194304 bytes)}, allocationId:
46b3ebe6543d84765082944d4374fc74, jobId: 2741604930618d9de523497a8a1c0d0e).
==========================================================================================
Run started 2021-08-21T12:30:05.723Z and ran for PT20.790S
Default configuration:
{"debug":true,"query":null,"sourceType":"DIRECT","generateEventFilePathPrefix":null,"sinkType":"DEVNULL","exportSummaryToBigQuery":false,"pubSubMode":"COMBINED","pubsubMessageSerializationMethod":"CODER","sideInputType":"DIRECT","sideInputRowCount":500,"sideInputNumShards":3,"sideInputUrl":null,"sessionGap":600000,"numEvents":100000,"numEventGenerators":100,"rateShape":"SINE","firstEventRate":10000,"nextEventRate":10000,"rateUnit":"PER_SECOND","ratePeriodSec":600,"preloadSeconds":0,"streamTimeout":240,"isRateLimited":false,"useWallclockEventTime":false,"avgPersonByteSize":200,"avgAuctionByteSize":500,"avgBidByteSize":100,"hotAuctionRatio":2,"hotSellersRatio":4,"hotBiddersRatio":4,"windowSizeSec":10,"windowPeriodSec":5,"watermarkHoldbackSec":0,"numInFlightAuctions":100,"numActivePeople":1000,"coderStrategy":"HAND","cpuDelayMs":0,"diskBusyBytes":0,"auctionSkip":123,"fanout":5,"maxAuctionsWaitingTime":600,"occasionalDelaySec":3,"probDelayedEvent":0.1,"maxLogEvents":100000,"usePubsubPublishTime":false,"outOfOrderGroupSize":1,"numKeyBuckets":20000,"pardoCPUFactor":1.0}
Configurations:
Conf Description
0000 query:PASSTHROUGH; exportSummaryToBigQuery:true; streamTimeout:60
0001 query:CURRENCY_CONVERSION; exportSummaryToBigQuery:true;
streamTimeout:60
0002 query:SELECTION; exportSummaryToBigQuery:true; streamTimeout:60
0003 query:LOCAL_ITEM_SUGGESTION; exportSummaryToBigQuery:true;
streamTimeout:60
0004 query:AVERAGE_PRICE_FOR_CATEGORY; exportSummaryToBigQuery:true;
numEvents:10000; streamTimeout:60
0005 query:HOT_ITEMS; exportSummaryToBigQuery:true; streamTimeout:60
0006 query:AVERAGE_SELLING_PRICE_BY_SELLER; exportSummaryToBigQuery:true;
numEvents:10000; streamTimeout:60
0007 query:HIGHEST_BID; exportSummaryToBigQuery:true; streamTimeout:60
0008 query:MONITOR_NEW_USERS; exportSummaryToBigQuery:true; streamTimeout:60
0009 query:WINNING_BIDS; exportSummaryToBigQuery:true; numEvents:10000;
streamTimeout:60
0010 query:LOG_TO_SHARDED_FILES; exportSummaryToBigQuery:true;
streamTimeout:60
0011 query:USER_SESSIONS; exportSummaryToBigQuery:true; streamTimeout:60
0012 query:PROCESSING_TIME_WINDOWS; exportSummaryToBigQuery:true;
streamTimeout:60
0013 query:PORTABILITY_BATCH; exportSummaryToBigQuery:true; streamTimeout:60
0014 query:BOUNDED_SIDE_INPUT_JOIN; exportSummaryToBigQuery:true;
streamTimeout:60
0015 query:SESSION_SIDE_INPUT_JOIN; exportSummaryToBigQuery:true;
streamTimeout:60
Performance:
Conf Runtime(sec) (Baseline) Events(/sec) (Baseline) Results
(Baseline)
0000 1.2 80840.7 100000
0001 0.3 342465.8 92000
0002 0.1 763358.8 351
0003 1.1 90252.7 580
0004 0.9 11013.2 40
0005 0.7 136986.3 12
0006 0.6 15873.0 103
0007 0.5 183150.2 1
0008 0.4 230946.9 6000
0009 0.3 39840.6 298
0010 0.6 165837.5 1
0011 0.3 355871.9 1919
0012 0.2 602409.6 1919
0013 0.4 238663.5 100000
0014 0.4 243309.0 92000
0015 0.5 204499.0 92000
==========================================================================================
Aug 21, 2021 12:30:26 PM
org.apache.flink.runtime.taskexecutor.slot.TaskSlotTableImpl freeSlotInternal
INFO: Free slot TaskSlot(index:9, state:ALLOCATED, resource profile:
ResourceProfile{taskHeapMemory=64.000gb (68719476736 bytes),
taskOffHeapMemory=64.000gb (68719476736 bytes), managedMemory=8.000mb (8388608
bytes), networkMemory=4.000mb (4194304 bytes)}, allocationId:
4bcde4389010e903771edea2675844f3, jobId: 2741604930618d9de523497a8a1c0d0e).
Aug 21, 2021 12:30:26 PM
org.apache.flink.runtime.taskexecutor.slot.TaskSlotTableImpl freeSlotInternal
INFO: Free slot TaskSlot(index:10, state:ALLOCATED, resource profile:
ResourceProfile{taskHeapMemory=64.000gb (68719476736 bytes),
taskOffHeapMemory=64.000gb (68719476736 bytes), managedMemory=8.000mb (8388608
bytes), networkMemory=4.000mb (4194304 bytes)}, allocationId:
c0a68aabfb35657d2205017c65107238, jobId: 2741604930618d9de523497a8a1c0d0e).
Aug 21, 2021 12:30:26 PM
org.apache.flink.runtime.taskexecutor.slot.TaskSlotTableImpl freeSlotInternal
INFO: Free slot TaskSlot(index:14, state:ALLOCATED, resource profile:
ResourceProfile{taskHeapMemory=64.000gb (68719476736 bytes),
taskOffHeapMemory=64.000gb (68719476736 bytes), managedMemory=8.000mb (8388608
bytes), networkMemory=4.000mb (4194304 bytes)}, allocationId:
c052977e4b1d21d7e5f2374c53bc1790, jobId: 2741604930618d9de523497a8a1c0d0e).
Aug 21, 2021 12:30:26 PM
org.apache.flink.runtime.taskexecutor.slot.TaskSlotTableImpl freeSlotInternal
INFO: Free slot TaskSlot(index:3, state:ALLOCATED, resource profile:
ResourceProfile{taskHeapMemory=64.000gb (68719476736 bytes),
taskOffHeapMemory=64.000gb (68719476736 bytes), managedMemory=8.000mb (8388608
bytes), networkMemory=4.000mb (4194304 bytes)}, allocationId:
4a542c2c664c59f8c7ce9c90e68429c1, jobId: 2741604930618d9de523497a8a1c0d0e).
Aug 21, 2021 12:30:26 PM
org.apache.flink.runtime.taskexecutor.TaskExecutor$JobLeaderListenerImpl
jobManagerLostLeadership
INFO: JobManager for job 2741604930618d9de523497a8a1c0d0e with leader id
a53065802b23ff996be19264bf314fc4 lost leadership.
Aug 21, 2021 12:30:26 PM
org.apache.flink.runtime.taskexecutor.slot.TaskSlotTableImpl freeSlotInternal
INFO: Free slot TaskSlot(index:6, state:ALLOCATED, resource profile:
ResourceProfile{taskHeapMemory=64.000gb (68719476736 bytes),
taskOffHeapMemory=64.000gb (68719476736 bytes), managedMemory=8.000mb (8388608
bytes), networkMemory=4.000mb (4194304 bytes)}, allocationId:
981e4111a818fd2f0dee8d26c378323f, jobId: 2741604930618d9de523497a8a1c0d0e).
Aug 21, 2021 12:30:26 PM
org.apache.flink.runtime.taskexecutor.slot.TaskSlotTableImpl freeSlotInternal
INFO: Free slot TaskSlot(index:7, state:ALLOCATED, resource profile:
ResourceProfile{taskHeapMemory=64.000gb (68719476736 bytes),
taskOffHeapMemory=64.000gb (68719476736 bytes), managedMemory=8.000mb (8388608
bytes), networkMemory=4.000mb (4194304 bytes)}, allocationId:
b18db8a3c1b0307ea958880b0a99ae93, jobId: 2741604930618d9de523497a8a1c0d0e).
Aug 21, 2021 12:30:26 PM
org.apache.flink.runtime.taskexecutor.slot.TaskSlotTableImpl freeSlotInternal
INFO: Free slot TaskSlot(index:12, state:ALLOCATED, resource profile:
ResourceProfile{taskHeapMemory=64.000gb (68719476736 bytes),
taskOffHeapMemory=64.000gb (68719476736 bytes), managedMemory=8.000mb (8388608
bytes), networkMemory=4.000mb (4194304 bytes)}, allocationId:
1ee294733ce1f53ee6153bf645543363, jobId: 2741604930618d9de523497a8a1c0d0e).
Aug 21, 2021 12:30:26 PM org.apache.flink.runtime.webmonitor.WebMonitorEndpoint
lambda$shutDownInternal$5
INFO: Removing cache directory /tmp/flink-web-ui
Aug 21, 2021 12:30:26 PM org.apache.flink.runtime.rest.RestServerEndpoint
lambda$closeAsync$1
INFO: Shut down complete.
Aug 21, 2021 12:30:26 PM
org.apache.flink.runtime.resourcemanager.ResourceManager deregisterApplication
INFO: Shut down cluster because application is in CANCELED, diagnostics
DispatcherResourceManagerComponent has been closed..
Aug 21, 2021 12:30:26 PM
org.apache.flink.runtime.entrypoint.component.DispatcherResourceManagerComponent
closeAsyncInternal
INFO: Closing components.
Aug 21, 2021 12:30:26 PM
org.apache.flink.runtime.dispatcher.runner.AbstractDispatcherLeaderProcess
closeInternal
INFO: Stopping SessionDispatcherLeaderProcess.
Aug 21, 2021 12:30:26 PM org.apache.flink.runtime.dispatcher.Dispatcher onStop
INFO: Stopping dispatcher akka://flink/user/rpc/dispatcher_62.
Aug 21, 2021 12:30:26 PM
org.apache.flink.runtime.resourcemanager.slotmanager.DeclarativeSlotManager
close
INFO: Closing the slot manager.
Aug 21, 2021 12:30:26 PM org.apache.flink.runtime.dispatcher.Dispatcher
terminateRunningJobs
INFO: Stopping all currently running jobs of dispatcher
akka://flink/user/rpc/dispatcher_62.
Aug 21, 2021 12:30:26 PM
org.apache.flink.runtime.resourcemanager.slotmanager.DeclarativeSlotManager
suspend
INFO: Suspending the slot manager.
Aug 21, 2021 12:30:26 PM org.apache.flink.runtime.dispatcher.Dispatcher
lambda$onStop$0
INFO: Stopped dispatcher akka://flink/user/rpc/dispatcher_62.
Aug 21, 2021 12:30:26 PM
org.apache.flink.runtime.taskexecutor.DefaultJobLeaderService stop
INFO: Stop job leader service.
Aug 21, 2021 12:30:26 PM
org.apache.flink.runtime.state.TaskExecutorLocalStateStoresManager shutdown
INFO: Shutting down TaskExecutorLocalStateStoresManager.
Aug 21, 2021 12:30:26 PM
org.apache.flink.runtime.io.disk.FileChannelManagerImpl lambda$getFileCloser$0
INFO: FileChannelManager removed spill file directory
/tmp/flink-io-b45204ce-e6ff-40ad-b70d-9c565fe83449
Aug 21, 2021 12:30:26 PM
org.apache.flink.runtime.io.network.NettyShuffleEnvironment close
INFO: Shutting down the network environment and its components.
Aug 21, 2021 12:30:26 PM
org.apache.flink.runtime.io.disk.FileChannelManagerImpl lambda$getFileCloser$0
INFO: FileChannelManager removed spill file directory
/tmp/flink-netty-shuffle-2c57ea24-f65a-4133-9409-812771c565e7
Aug 21, 2021 12:30:26 PM org.apache.flink.runtime.taskexecutor.KvStateService
shutdown
INFO: Shutting down the kvState service and its components.
Aug 21, 2021 12:30:26 PM
org.apache.flink.runtime.taskexecutor.DefaultJobLeaderService stop
INFO: Stop job leader service.
Aug 21, 2021 12:30:26 PM org.apache.flink.runtime.filecache.FileCache shutdown
INFO: removed file cache directory
/tmp/flink-dist-cache-4abe3437-5221-4d83-a67e-30e29960a06f
Aug 21, 2021 12:30:26 PM org.apache.flink.runtime.taskexecutor.TaskExecutor
handleOnStopException
INFO: Stopped TaskExecutor akka://flink/user/rpc/taskmanager_60.
Aug 21, 2021 12:30:26 PM org.apache.flink.runtime.rpc.akka.AkkaRpcService
stopService
INFO: Stopping Akka RPC service.
Aug 21, 2021 12:30:26 PM org.apache.flink.runtime.rpc.akka.AkkaRpcService
stopService
INFO: Stopping Akka RPC service.
Aug 21, 2021 12:30:26 PM org.apache.flink.runtime.rpc.akka.AkkaRpcService
lambda$stopService$7
INFO: Stopped Akka RPC service.
Aug 21, 2021 12:30:26 PM org.apache.flink.runtime.blob.AbstractBlobCache close
INFO: Shutting down BLOB cache
Aug 21, 2021 12:30:26 PM org.apache.flink.runtime.blob.AbstractBlobCache close
INFO: Shutting down BLOB cache
Aug 21, 2021 12:30:26 PM org.apache.flink.runtime.blob.BlobServer close
INFO: Stopped BLOB server at 0.0.0.0:35971
Aug 21, 2021 12:30:26 PM org.apache.flink.runtime.rpc.akka.AkkaRpcService
lambda$stopService$7
INFO: Stopped Akka RPC service.
==========================================================================================
Run started 2021-08-21T12:30:05.723Z and ran for PT28.085S
Default configuration:
{"debug":true,"query":null,"sourceType":"DIRECT","generateEventFilePathPrefix":null,"sinkType":"DEVNULL","exportSummaryToBigQuery":false,"pubSubMode":"COMBINED","pubsubMessageSerializationMethod":"CODER","sideInputType":"DIRECT","sideInputRowCount":500,"sideInputNumShards":3,"sideInputUrl":null,"sessionGap":600000,"numEvents":100000,"numEventGenerators":100,"rateShape":"SINE","firstEventRate":10000,"nextEventRate":10000,"rateUnit":"PER_SECOND","ratePeriodSec":600,"preloadSeconds":0,"streamTimeout":240,"isRateLimited":false,"useWallclockEventTime":false,"avgPersonByteSize":200,"avgAuctionByteSize":500,"avgBidByteSize":100,"hotAuctionRatio":2,"hotSellersRatio":4,"hotBiddersRatio":4,"windowSizeSec":10,"windowPeriodSec":5,"watermarkHoldbackSec":0,"numInFlightAuctions":100,"numActivePeople":1000,"coderStrategy":"HAND","cpuDelayMs":0,"diskBusyBytes":0,"auctionSkip":123,"fanout":5,"maxAuctionsWaitingTime":600,"occasionalDelaySec":3,"probDelayedEvent":0.1,"maxLogEvents":100000,"usePubsubPublishTime":false,"outOfOrderGroupSize":1,"numKeyBuckets":20000,"pardoCPUFactor":1.0}
Configurations:
Conf Description
0000 query:PASSTHROUGH; exportSummaryToBigQuery:true; streamTimeout:60
0001 query:CURRENCY_CONVERSION; exportSummaryToBigQuery:true;
streamTimeout:60
0002 query:SELECTION; exportSummaryToBigQuery:true; streamTimeout:60
0003 query:LOCAL_ITEM_SUGGESTION; exportSummaryToBigQuery:true;
streamTimeout:60
0004 query:AVERAGE_PRICE_FOR_CATEGORY; exportSummaryToBigQuery:true;
numEvents:10000; streamTimeout:60
0005 query:HOT_ITEMS; exportSummaryToBigQuery:true; streamTimeout:60
0006 query:AVERAGE_SELLING_PRICE_BY_SELLER; exportSummaryToBigQuery:true;
numEvents:10000; streamTimeout:60
0007 query:HIGHEST_BID; exportSummaryToBigQuery:true; streamTimeout:60
0008 query:MONITOR_NEW_USERS; exportSummaryToBigQuery:true; streamTimeout:60
0009 query:WINNING_BIDS; exportSummaryToBigQuery:true; numEvents:10000;
streamTimeout:60
0010 query:LOG_TO_SHARDED_FILES; exportSummaryToBigQuery:true;
streamTimeout:60
0011 query:USER_SESSIONS; exportSummaryToBigQuery:true; streamTimeout:60
0012 query:PROCESSING_TIME_WINDOWS; exportSummaryToBigQuery:true;
streamTimeout:60
0013 query:PORTABILITY_BATCH; exportSummaryToBigQuery:true; streamTimeout:60
0014 query:BOUNDED_SIDE_INPUT_JOIN; exportSummaryToBigQuery:true;
streamTimeout:60
0015 query:SESSION_SIDE_INPUT_JOIN; exportSummaryToBigQuery:true;
streamTimeout:60
Performance:
Conf Runtime(sec) (Baseline) Events(/sec) (Baseline) Results
(Baseline)
0000 1.2 80840.7 100000
0001 0.3 342465.8 92000
0002 0.1 763358.8 351
0003 1.1 90252.7 580
0004 0.9 11013.2 40
0005 0.7 136986.3 12
0006 0.6 15873.0 103
0007 0.5 183150.2 1
0008 0.4 230946.9 6000
0009 0.3 39840.6 298
0010 0.6 165837.5 1
Exception in thread "main" 0011 0.3 355871.9
1919
0012 0.2 602409.6 1919
0013 0.4 238663.5 100000
0014 0.4 243309.0 92000
0015 0.5 204499.0 92000
==========================================================================================
com.google.cloud.bigquery.BigQueryException: A load-shedding retryable
throttled error could not be retried due to Extensible Stubs retrying limits
(see go/stubs-retries). (old status: RPC::STREAM_BROKEN: Connection to server
broken (OnChannelError))
at
com.google.cloud.bigquery.spi.v2.HttpBigQueryRpc.translate(HttpBigQueryRpc.java:115)
at
com.google.cloud.bigquery.spi.v2.HttpBigQueryRpc.insertAll(HttpBigQueryRpc.java:494)
at
com.google.cloud.bigquery.BigQueryImpl.insertAll(BigQueryImpl.java:1036)
at
org.apache.beam.sdk.testutils.publishing.BigQueryClient.insertAll(BigQueryClient.java:123)
at
org.apache.beam.sdk.testutils.publishing.BigQueryClient.insertRow(BigQueryClient.java:98)
at
org.apache.beam.sdk.testutils.publishing.BigQueryClient.insertRow(BigQueryClient.java:89)
at
org.apache.beam.sdk.testutils.publishing.BigQueryResultsPublisher.publish(BigQueryResultsPublisher.java:47)
at org.apache.beam.sdk.nexmark.Main.savePerfsToBigQuery(Main.java:203)
at org.apache.beam.sdk.nexmark.Main.runAll(Main.java:164)
at org.apache.beam.sdk.nexmark.Main.main(Main.java:495)
Caused by: com.google.api.client.googleapis.json.GoogleJsonResponseException:
500 Internal Server Error
POST
https://www.googleapis.com/bigquery/v2/projects/apache-beam-testing/datasets/nexmark/tables/nexmark_4_FlinkRunner_batch/insertAll?prettyPrint=false
{
"code" : 500,
"errors" : [ {
"domain" : "global",
"message" : "A load-shedding retryable throttled error could not be retried
due to Extensible Stubs retrying limits (see go/stubs-retries). (old status:
RPC::STREAM_BROKEN: Connection to server broken (OnChannelError))",
"reason" : "backendError"
} ],
"message" : "A load-shedding retryable throttled error could not be retried
due to Extensible Stubs retrying limits (see go/stubs-retries). (old status:
RPC::STREAM_BROKEN: Connection to server broken (OnChannelError))",
"status" : "INTERNAL"
}
at
com.google.api.client.googleapis.json.GoogleJsonResponseException.from(GoogleJsonResponseException.java:146)
at
com.google.api.client.googleapis.services.json.AbstractGoogleJsonClientRequest.newExceptionOnError(AbstractGoogleJsonClientRequest.java:118)
at
com.google.api.client.googleapis.services.json.AbstractGoogleJsonClientRequest.newExceptionOnError(AbstractGoogleJsonClientRequest.java:37)
at
com.google.api.client.googleapis.services.AbstractGoogleClientRequest$1.interceptResponse(AbstractGoogleClientRequest.java:428)
at com.google.api.client.http.HttpRequest.execute(HttpRequest.java:1111)
at
com.google.api.client.googleapis.services.AbstractGoogleClientRequest.executeUnparsed(AbstractGoogleClientRequest.java:514)
at
com.google.api.client.googleapis.services.AbstractGoogleClientRequest.executeUnparsed(AbstractGoogleClientRequest.java:455)
at
com.google.api.client.googleapis.services.AbstractGoogleClientRequest.execute(AbstractGoogleClientRequest.java:565)
at
com.google.cloud.bigquery.spi.v2.HttpBigQueryRpc.insertAll(HttpBigQueryRpc.java:492)
... 8 more
> Task :sdks:java:testing:nexmark:run FAILED
FAILURE: Build failed with an exception.
* What went wrong:
Execution failed for task ':sdks:java:testing:nexmark:run'.
> Process 'command '/usr/lib/jvm/java-8-openjdk-amd64/bin/java'' finished with
> non-zero exit value 1
* Try:
Run with --stacktrace option to get the stack trace. Run with --info or --debug
option to get more log output. Run with --scan to get full insights.
* Get more help at https://help.gradle.org
Deprecated Gradle features were used in this build, making it incompatible with
Gradle 7.0.
Use '--warning-mode all' to show the individual deprecation warnings.
See
https://docs.gradle.org/6.8.3/userguide/command_line_interface.html#sec:command_line_warnings
BUILD FAILED in 54s
115 actionable tasks: 76 executed, 39 from cache
Publishing build scan...
https://gradle.com/s/tfwmlbr6tdlbo
Build step 'Invoke Gradle script' changed build result to FAILURE
Build step 'Invoke Gradle script' marked build as failure
---------------------------------------------------------------------
To unsubscribe, e-mail: [email protected]
For additional commands, e-mail: [email protected]
