See
<https://builds.apache.org/job/beam_PerformanceTests_Spark/1547/display/redirect?page=changes>
Changes:
[ccy] Use utcnow() in determining credential refresh time
[chamikara] Revert "[BEAM-2264] Credentials were not being reused between GCS
calls"
[amyrvold] [BEAM-3989] Delete unused pipeline jobs
[sidhom] [BEAM-3249] Add missing gradle artifact ids
[wcn] Add godoc for exported methods.
------------------------------------------
[...truncated 89.95 KB...]
'apache-beam-testing:bqjob_r50f9b11bfb7cff6_000001628e73bd19_1': Invalid schema
update. Field timestamp has changed type from TIMESTAMP to FLOAT
STDERR:
/usr/lib/google-cloud-sdk/platform/bq/third_party/oauth2client/contrib/gce.py:73:
UserWarning: You have requested explicit scopes to be used with a GCE service
account.
Using this argument will have no effect on the actual scopes for tokens
requested. These scopes are set at VM instance creation time and
can't be overridden in the request.
warnings.warn(_SCOPES_WARNING)
Upload complete.Waiting on bqjob_r50f9b11bfb7cff6_000001628e73bd19_1 ... (0s)
Current status: RUNNING
Waiting on
bqjob_r50f9b11bfb7cff6_000001628e73bd19_1 ... (0s) Current status: DONE
2018-04-04 02:19:34,335 070335a1 MainThread INFO Retrying exception running
IssueRetryableCommand: Command returned a non-zero exit code.
2018-04-04 02:19:57,298 070335a1 MainThread INFO Running: bq load
--autodetect --source_format=NEWLINE_DELIMITED_JSON
beam_performance.pkb_results
<https://builds.apache.org/job/beam_PerformanceTests_Spark/ws/runs/070335a1/perfkit-bq-pubf4yUh9.json>
2018-04-04 02:19:59,448 070335a1 MainThread INFO Ran: {bq load --autodetect
--source_format=NEWLINE_DELIMITED_JSON beam_performance.pkb_results
<https://builds.apache.org/job/beam_PerformanceTests_Spark/ws/runs/070335a1/perfkit-bq-pubf4yUh9.json}>
ReturnCode:1
STDOUT:
BigQuery error in load operation: Error processing job
'apache-beam-testing:bqjob_r5e25412f356e1fe1_000001628e741f42_1': Invalid schema
update. Field timestamp has changed type from TIMESTAMP to FLOAT
STDERR:
/usr/lib/google-cloud-sdk/platform/bq/third_party/oauth2client/contrib/gce.py:73:
UserWarning: You have requested explicit scopes to be used with a GCE service
account.
Using this argument will have no effect on the actual scopes for tokens
requested. These scopes are set at VM instance creation time and
can't be overridden in the request.
warnings.warn(_SCOPES_WARNING)
Upload complete.Waiting on bqjob_r5e25412f356e1fe1_000001628e741f42_1 ... (0s)
Current status: RUNNING
Waiting on
bqjob_r5e25412f356e1fe1_000001628e741f42_1 ... (0s) Current status: DONE
2018-04-04 02:19:59,449 070335a1 MainThread INFO Retrying exception running
IssueRetryableCommand: Command returned a non-zero exit code.
2018-04-04 02:20:18,809 070335a1 MainThread INFO Running: bq load
--autodetect --source_format=NEWLINE_DELIMITED_JSON
beam_performance.pkb_results
<https://builds.apache.org/job/beam_PerformanceTests_Spark/ws/runs/070335a1/perfkit-bq-pubf4yUh9.json>
2018-04-04 02:20:20,947 070335a1 MainThread INFO Ran: {bq load --autodetect
--source_format=NEWLINE_DELIMITED_JSON beam_performance.pkb_results
<https://builds.apache.org/job/beam_PerformanceTests_Spark/ws/runs/070335a1/perfkit-bq-pubf4yUh9.json}>
ReturnCode:1
STDOUT:
BigQuery error in load operation: Error processing job
'apache-beam-testing:bqjob_r5a8a85589577f295_000001628e74739f_1': Invalid schema
update. Field timestamp has changed type from TIMESTAMP to FLOAT
STDERR:
/usr/lib/google-cloud-sdk/platform/bq/third_party/oauth2client/contrib/gce.py:73:
UserWarning: You have requested explicit scopes to be used with a GCE service
account.
Using this argument will have no effect on the actual scopes for tokens
requested. These scopes are set at VM instance creation time and
can't be overridden in the request.
warnings.warn(_SCOPES_WARNING)
Upload complete.Waiting on bqjob_r5a8a85589577f295_000001628e74739f_1 ... (0s)
Current status: RUNNING
Waiting on
bqjob_r5a8a85589577f295_000001628e74739f_1 ... (0s) Current status: DONE
2018-04-04 02:20:20,947 070335a1 MainThread INFO Retrying exception running
IssueRetryableCommand: Command returned a non-zero exit code.
2018-04-04 02:20:49,479 070335a1 MainThread INFO Running: bq load
--autodetect --source_format=NEWLINE_DELIMITED_JSON
beam_performance.pkb_results
<https://builds.apache.org/job/beam_PerformanceTests_Spark/ws/runs/070335a1/perfkit-bq-pubf4yUh9.json>
2018-04-04 02:20:51,851 070335a1 MainThread INFO Ran: {bq load --autodetect
--source_format=NEWLINE_DELIMITED_JSON beam_performance.pkb_results
<https://builds.apache.org/job/beam_PerformanceTests_Spark/ws/runs/070335a1/perfkit-bq-pubf4yUh9.json}>
ReturnCode:1
STDOUT:
BigQuery error in load operation: Error processing job
'apache-beam-testing:bqjob_r151e3dee0ac8b195_000001628e74eb0f_1': Invalid schema
update. Field timestamp has changed type from TIMESTAMP to FLOAT
STDERR:
/usr/lib/google-cloud-sdk/platform/bq/third_party/oauth2client/contrib/gce.py:73:
UserWarning: You have requested explicit scopes to be used with a GCE service
account.
Using this argument will have no effect on the actual scopes for tokens
requested. These scopes are set at VM instance creation time and
can't be overridden in the request.
warnings.warn(_SCOPES_WARNING)
Upload complete.Waiting on bqjob_r151e3dee0ac8b195_000001628e74eb0f_1 ... (0s)
Current status: RUNNING
Waiting on
bqjob_r151e3dee0ac8b195_000001628e74eb0f_1 ... (0s) Current status: DONE
2018-04-04 02:20:51,851 070335a1 MainThread INFO Retrying exception running
IssueRetryableCommand: Command returned a non-zero exit code.
2018-04-04 02:21:17,105 070335a1 MainThread INFO Running: bq load
--autodetect --source_format=NEWLINE_DELIMITED_JSON
beam_performance.pkb_results
<https://builds.apache.org/job/beam_PerformanceTests_Spark/ws/runs/070335a1/perfkit-bq-pubf4yUh9.json>
2018-04-04 02:21:19,595 070335a1 MainThread INFO Ran: {bq load --autodetect
--source_format=NEWLINE_DELIMITED_JSON beam_performance.pkb_results
<https://builds.apache.org/job/beam_PerformanceTests_Spark/ws/runs/070335a1/perfkit-bq-pubf4yUh9.json}>
ReturnCode:1
STDOUT:
BigQuery error in load operation: Error processing job
'apache-beam-testing:bqjob_r197ed499869c0594_000001628e755700_1': Invalid schema
update. Field timestamp has changed type from TIMESTAMP to FLOAT
STDERR:
/usr/lib/google-cloud-sdk/platform/bq/third_party/oauth2client/contrib/gce.py:73:
UserWarning: You have requested explicit scopes to be used with a GCE service
account.
Using this argument will have no effect on the actual scopes for tokens
requested. These scopes are set at VM instance creation time and
can't be overridden in the request.
warnings.warn(_SCOPES_WARNING)
Upload complete.Waiting on bqjob_r197ed499869c0594_000001628e755700_1 ... (0s)
Current status: RUNNING
Waiting on
bqjob_r197ed499869c0594_000001628e755700_1 ... (0s) Current status: DONE
2018-04-04 02:21:19,596 070335a1 MainThread INFO Retrying exception running
IssueRetryableCommand: Command returned a non-zero exit code.
2018-04-04 02:21:41,043 070335a1 MainThread INFO Running: bq load
--autodetect --source_format=NEWLINE_DELIMITED_JSON
beam_performance.pkb_results
<https://builds.apache.org/job/beam_PerformanceTests_Spark/ws/runs/070335a1/perfkit-bq-pubf4yUh9.json>
2018-04-04 02:21:43,351 070335a1 MainThread INFO Ran: {bq load --autodetect
--source_format=NEWLINE_DELIMITED_JSON beam_performance.pkb_results
<https://builds.apache.org/job/beam_PerformanceTests_Spark/ws/runs/070335a1/perfkit-bq-pubf4yUh9.json}>
ReturnCode:1
STDOUT:
BigQuery error in load operation: Error processing job
'apache-beam-testing:bqjob_r56aed161dd17a75b_000001628e75b4a2_1': Invalid schema
update. Field timestamp has changed type from TIMESTAMP to FLOAT
STDERR:
/usr/lib/google-cloud-sdk/platform/bq/third_party/oauth2client/contrib/gce.py:73:
UserWarning: You have requested explicit scopes to be used with a GCE service
account.
Using this argument will have no effect on the actual scopes for tokens
requested. These scopes are set at VM instance creation time and
can't be overridden in the request.
warnings.warn(_SCOPES_WARNING)
Upload complete.Waiting on bqjob_r56aed161dd17a75b_000001628e75b4a2_1 ... (0s)
Current status: RUNNING
Waiting on
bqjob_r56aed161dd17a75b_000001628e75b4a2_1 ... (0s) Current status: DONE
2018-04-04 02:21:43,351 070335a1 MainThread INFO Retrying exception running
IssueRetryableCommand: Command returned a non-zero exit code.
2018-04-04 02:21:59,801 070335a1 MainThread INFO Running: bq load
--autodetect --source_format=NEWLINE_DELIMITED_JSON
beam_performance.pkb_results
<https://builds.apache.org/job/beam_PerformanceTests_Spark/ws/runs/070335a1/perfkit-bq-pubf4yUh9.json>
2018-04-04 02:22:02,222 070335a1 MainThread INFO Ran: {bq load --autodetect
--source_format=NEWLINE_DELIMITED_JSON beam_performance.pkb_results
<https://builds.apache.org/job/beam_PerformanceTests_Spark/ws/runs/070335a1/perfkit-bq-pubf4yUh9.json}>
ReturnCode:1
STDOUT:
BigQuery error in load operation: Error processing job
'apache-beam-testing:bqjob_r4965f2dc1c188b37_000001628e75fe0a_1': Invalid schema
update. Field timestamp has changed type from TIMESTAMP to FLOAT
STDERR:
/usr/lib/google-cloud-sdk/platform/bq/third_party/oauth2client/contrib/gce.py:73:
UserWarning: You have requested explicit scopes to be used with a GCE service
account.
Using this argument will have no effect on the actual scopes for tokens
requested. These scopes are set at VM instance creation time and
can't be overridden in the request.
warnings.warn(_SCOPES_WARNING)
Upload complete.Waiting on bqjob_r4965f2dc1c188b37_000001628e75fe0a_1 ... (0s)
Current status: RUNNING
Waiting on
bqjob_r4965f2dc1c188b37_000001628e75fe0a_1 ... (0s) Current status: DONE
2018-04-04 02:22:02,222 070335a1 MainThread INFO Retrying exception running
IssueRetryableCommand: Command returned a non-zero exit code.
2018-04-04 02:22:27,348 070335a1 MainThread INFO Running: bq load
--autodetect --source_format=NEWLINE_DELIMITED_JSON
beam_performance.pkb_results
<https://builds.apache.org/job/beam_PerformanceTests_Spark/ws/runs/070335a1/perfkit-bq-pubf4yUh9.json>
2018-04-04 02:22:29,458 070335a1 MainThread INFO Ran: {bq load --autodetect
--source_format=NEWLINE_DELIMITED_JSON beam_performance.pkb_results
<https://builds.apache.org/job/beam_PerformanceTests_Spark/ws/runs/070335a1/perfkit-bq-pubf4yUh9.json}>
ReturnCode:1
STDOUT:
BigQuery error in load operation: Error processing job
'apache-beam-testing:bqjob_r27ffcff402ec688_000001628e766970_1': Invalid schema
update. Field timestamp has changed type from TIMESTAMP to FLOAT
STDERR:
/usr/lib/google-cloud-sdk/platform/bq/third_party/oauth2client/contrib/gce.py:73:
UserWarning: You have requested explicit scopes to be used with a GCE service
account.
Using this argument will have no effect on the actual scopes for tokens
requested. These scopes are set at VM instance creation time and
can't be overridden in the request.
warnings.warn(_SCOPES_WARNING)
Upload complete.Waiting on bqjob_r27ffcff402ec688_000001628e766970_1 ... (0s)
Current status: RUNNING
Waiting on
bqjob_r27ffcff402ec688_000001628e766970_1 ... (0s) Current status: DONE
2018-04-04 02:22:29,459 070335a1 MainThread INFO Retrying exception running
IssueRetryableCommand: Command returned a non-zero exit code.
2018-04-04 02:22:59,391 070335a1 MainThread INFO Running: bq load
--autodetect --source_format=NEWLINE_DELIMITED_JSON
beam_performance.pkb_results
<https://builds.apache.org/job/beam_PerformanceTests_Spark/ws/runs/070335a1/perfkit-bq-pubf4yUh9.json>
2018-04-04 02:23:01,935 070335a1 MainThread INFO Ran: {bq load --autodetect
--source_format=NEWLINE_DELIMITED_JSON beam_performance.pkb_results
<https://builds.apache.org/job/beam_PerformanceTests_Spark/ws/runs/070335a1/perfkit-bq-pubf4yUh9.json}>
ReturnCode:1
STDOUT:
BigQuery error in load operation: Error processing job
'apache-beam-testing:bqjob_r51739d3eec3b91fa_000001628e76e78d_1': Invalid schema
update. Field timestamp has changed type from TIMESTAMP to FLOAT
STDERR:
/usr/lib/google-cloud-sdk/platform/bq/third_party/oauth2client/contrib/gce.py:73:
UserWarning: You have requested explicit scopes to be used with a GCE service
account.
Using this argument will have no effect on the actual scopes for tokens
requested. These scopes are set at VM instance creation time and
can't be overridden in the request.
warnings.warn(_SCOPES_WARNING)
Upload complete.Waiting on bqjob_r51739d3eec3b91fa_000001628e76e78d_1 ... (0s)
Current status: RUNNING
Waiting on
bqjob_r51739d3eec3b91fa_000001628e76e78d_1 ... (0s) Current status: DONE
2018-04-04 02:23:01,935 070335a1 MainThread INFO Retrying exception running
IssueRetryableCommand: Command returned a non-zero exit code.
2018-04-04 02:23:28,395 070335a1 MainThread INFO Running: bq load
--autodetect --source_format=NEWLINE_DELIMITED_JSON
beam_performance.pkb_results
<https://builds.apache.org/job/beam_PerformanceTests_Spark/ws/runs/070335a1/perfkit-bq-pubf4yUh9.json>
2018-04-04 02:23:30,932 070335a1 MainThread INFO Ran: {bq load --autodetect
--source_format=NEWLINE_DELIMITED_JSON beam_performance.pkb_results
<https://builds.apache.org/job/beam_PerformanceTests_Spark/ws/runs/070335a1/perfkit-bq-pubf4yUh9.json}>
ReturnCode:1
STDOUT:
BigQuery error in load operation: Error processing job
'apache-beam-testing:bqjob_r604b1753317771bf_000001628e775805_1': Invalid schema
update. Field timestamp has changed type from TIMESTAMP to FLOAT
STDERR:
/usr/lib/google-cloud-sdk/platform/bq/third_party/oauth2client/contrib/gce.py:73:
UserWarning: You have requested explicit scopes to be used with a GCE service
account.
Using this argument will have no effect on the actual scopes for tokens
requested. These scopes are set at VM instance creation time and
can't be overridden in the request.
warnings.warn(_SCOPES_WARNING)
Upload complete.Waiting on bqjob_r604b1753317771bf_000001628e775805_1 ... (0s)
Current status: RUNNING
Waiting on
bqjob_r604b1753317771bf_000001628e775805_1 ... (0s) Current status: DONE
2018-04-04 02:23:30,933 070335a1 MainThread INFO Retrying exception running
IssueRetryableCommand: Command returned a non-zero exit code.
2018-04-04 02:24:00,510 070335a1 MainThread INFO Running: bq load
--autodetect --source_format=NEWLINE_DELIMITED_JSON
beam_performance.pkb_results
<https://builds.apache.org/job/beam_PerformanceTests_Spark/ws/runs/070335a1/perfkit-bq-pubf4yUh9.json>
2018-04-04 02:24:02,979 070335a1 MainThread INFO Ran: {bq load --autodetect
--source_format=NEWLINE_DELIMITED_JSON beam_performance.pkb_results
<https://builds.apache.org/job/beam_PerformanceTests_Spark/ws/runs/070335a1/perfkit-bq-pubf4yUh9.json}>
ReturnCode:1
STDOUT:
BigQuery error in load operation: Error processing job
'apache-beam-testing:bqjob_r1545c508b2400510_000001628e77d567_1': Invalid schema
update. Field timestamp has changed type from TIMESTAMP to FLOAT
STDERR:
/usr/lib/google-cloud-sdk/platform/bq/third_party/oauth2client/contrib/gce.py:73:
UserWarning: You have requested explicit scopes to be used with a GCE service
account.
Using this argument will have no effect on the actual scopes for tokens
requested. These scopes are set at VM instance creation time and
can't be overridden in the request.
warnings.warn(_SCOPES_WARNING)
Upload complete.Waiting on bqjob_r1545c508b2400510_000001628e77d567_1 ... (0s)
Current status: RUNNING
Waiting on
bqjob_r1545c508b2400510_000001628e77d567_1 ... (0s) Current status: DONE
2018-04-04 02:24:02,979 070335a1 MainThread INFO Retrying exception running
IssueRetryableCommand: Command returned a non-zero exit code.
2018-04-04 02:24:30,376 070335a1 MainThread INFO Running: bq load
--autodetect --source_format=NEWLINE_DELIMITED_JSON
beam_performance.pkb_results
<https://builds.apache.org/job/beam_PerformanceTests_Spark/ws/runs/070335a1/perfkit-bq-pubf4yUh9.json>
2018-04-04 02:24:32,640 070335a1 MainThread INFO Ran: {bq load --autodetect
--source_format=NEWLINE_DELIMITED_JSON beam_performance.pkb_results
<https://builds.apache.org/job/beam_PerformanceTests_Spark/ws/runs/070335a1/perfkit-bq-pubf4yUh9.json}>
ReturnCode:1
STDOUT:
BigQuery error in load operation: Error processing job
'apache-beam-testing:bqjob_r1fc579d47373b011_000001628e784a1c_1': Invalid schema
update. Field timestamp has changed type from TIMESTAMP to FLOAT
STDERR:
/usr/lib/google-cloud-sdk/platform/bq/third_party/oauth2client/contrib/gce.py:73:
UserWarning: You have requested explicit scopes to be used with a GCE service
account.
Using this argument will have no effect on the actual scopes for tokens
requested. These scopes are set at VM instance creation time and
can't be overridden in the request.
warnings.warn(_SCOPES_WARNING)
Upload complete.Waiting on bqjob_r1fc579d47373b011_000001628e784a1c_1 ... (0s)
Current status: RUNNING
Waiting on
bqjob_r1fc579d47373b011_000001628e784a1c_1 ... (0s) Current status: DONE
2018-04-04 02:24:32,641 070335a1 MainThread INFO Retrying exception running
IssueRetryableCommand: Command returned a non-zero exit code.
2018-04-04 02:24:53,204 070335a1 MainThread INFO Running: bq load
--autodetect --source_format=NEWLINE_DELIMITED_JSON
beam_performance.pkb_results
<https://builds.apache.org/job/beam_PerformanceTests_Spark/ws/runs/070335a1/perfkit-bq-pubf4yUh9.json>
2018-04-04 02:24:55,419 070335a1 MainThread INFO Ran: {bq load --autodetect
--source_format=NEWLINE_DELIMITED_JSON beam_performance.pkb_results
<https://builds.apache.org/job/beam_PerformanceTests_Spark/ws/runs/070335a1/perfkit-bq-pubf4yUh9.json}>
ReturnCode:1
STDOUT:
BigQuery error in load operation: Error processing job
'apache-beam-testing:bqjob_r7e00eb65d8e411ea_000001628e78a346_1': Invalid schema
update. Field timestamp has changed type from TIMESTAMP to FLOAT
STDERR:
/usr/lib/google-cloud-sdk/platform/bq/third_party/oauth2client/contrib/gce.py:73:
UserWarning: You have requested explicit scopes to be used with a GCE service
account.
Using this argument will have no effect on the actual scopes for tokens
requested. These scopes are set at VM instance creation time and
can't be overridden in the request.
warnings.warn(_SCOPES_WARNING)
Upload complete.Waiting on bqjob_r7e00eb65d8e411ea_000001628e78a346_1 ... (0s)
Current status: RUNNING
Waiting on
bqjob_r7e00eb65d8e411ea_000001628e78a346_1 ... (0s) Current status: DONE
2018-04-04 02:24:55,420 070335a1 MainThread INFO Retrying exception running
IssueRetryableCommand: Command returned a non-zero exit code.
2018-04-04 02:25:20,791 070335a1 MainThread INFO Running: bq load
--autodetect --source_format=NEWLINE_DELIMITED_JSON
beam_performance.pkb_results
<https://builds.apache.org/job/beam_PerformanceTests_Spark/ws/runs/070335a1/perfkit-bq-pubf4yUh9.json>
2018-04-04 02:25:22,896 070335a1 MainThread INFO Ran: {bq load --autodetect
--source_format=NEWLINE_DELIMITED_JSON beam_performance.pkb_results
<https://builds.apache.org/job/beam_PerformanceTests_Spark/ws/runs/070335a1/perfkit-bq-pubf4yUh9.json}>
ReturnCode:1
STDOUT:
BigQuery error in load operation: Error processing job
'apache-beam-testing:bqjob_r52e90f0190f58937_000001628e790f10_1': Invalid schema
update. Field timestamp has changed type from TIMESTAMP to FLOAT
STDERR:
/usr/lib/google-cloud-sdk/platform/bq/third_party/oauth2client/contrib/gce.py:73:
UserWarning: You have requested explicit scopes to be used with a GCE service
account.
Using this argument will have no effect on the actual scopes for tokens
requested. These scopes are set at VM instance creation time and
can't be overridden in the request.
warnings.warn(_SCOPES_WARNING)
Upload complete.Waiting on bqjob_r52e90f0190f58937_000001628e790f10_1 ... (0s)
Current status: RUNNING
Waiting on
bqjob_r52e90f0190f58937_000001628e790f10_1 ... (0s) Current status: DONE
Traceback (most recent call last):
File "PerfKitBenchmarker/pkb.py", line 21, in <module>
sys.exit(Main())
File
"<https://builds.apache.org/job/beam_PerformanceTests_Spark/ws/PerfKitBenchmarker/perfkitbenchmarker/pkb.py";,>
line 952, in Main
return RunBenchmarks()
File
"<https://builds.apache.org/job/beam_PerformanceTests_Spark/ws/PerfKitBenchmarker/perfkitbenchmarker/pkb.py";,>
line 879, in RunBenchmarks
collector.PublishSamples()
File
"<https://builds.apache.org/job/beam_PerformanceTests_Spark/ws/PerfKitBenchmarker/perfkitbenchmarker/publisher.py";,>
line 886, in PublishSamples
publisher.PublishSamples(self.samples)
File
"<https://builds.apache.org/job/beam_PerformanceTests_Spark/ws/PerfKitBenchmarker/perfkitbenchmarker/publisher.py";,>
line 538, in PublishSamples
vm_util.IssueRetryableCommand(load_cmd)
File
"<https://builds.apache.org/job/beam_PerformanceTests_Spark/ws/PerfKitBenchmarker/perfkitbenchmarker/vm_util.py";,>
line 249, in WrappedFunction
return f(*args, **kwargs)
File
"<https://builds.apache.org/job/beam_PerformanceTests_Spark/ws/PerfKitBenchmarker/perfkitbenchmarker/vm_util.py";,>
line 387, in IssueRetryableCommand
'Command returned a non-zero exit code.\n')
perfkitbenchmarker.errors.CalledProcessException: Command returned a non-zero
exit code.
Build step 'Execute shell' marked build as failure
