See
<https://builds.apache.org/job/beam_PerformanceTests_Spark/1549/display/redirect?page=changes>
Changes:
[iemejia] [BEAM-3875] Update Spark runner to use Spark version 2.3.0
------------------------------------------
[...truncated 86.54 KB...]
'apache-beam-testing:bqjob_r282687f643630146_000001629098a873_1': Invalid schema
update. Field timestamp has changed type from TIMESTAMP to FLOAT
STDERR:
/usr/lib/google-cloud-sdk/platform/bq/third_party/oauth2client/contrib/gce.py:73:
UserWarning: You have requested explicit scopes to be used with a GCE service
account.
Using this argument will have no effect on the actual scopes for tokens
requested. These scopes are set at VM instance creation time and
can't be overridden in the request.
warnings.warn(_SCOPES_WARNING)
Upload complete.Waiting on bqjob_r282687f643630146_000001629098a873_1 ... (0s)
Current status: RUNNING
Waiting on
bqjob_r282687f643630146_000001629098a873_1 ... (0s) Current status: DONE
2018-04-04 12:19:08,634 41357cae MainThread INFO Retrying exception running
IssueRetryableCommand: Command returned a non-zero exit code.
2018-04-04 12:19:32,733 41357cae MainThread INFO Running: bq load
--autodetect --source_format=NEWLINE_DELIMITED_JSON
beam_performance.pkb_results
<https://builds.apache.org/job/beam_PerformanceTests_Spark/ws/runs/41357cae/perfkit-bq-pubj4r7X0.json>
2018-04-04 12:19:36,112 41357cae MainThread INFO Ran: {bq load --autodetect
--source_format=NEWLINE_DELIMITED_JSON beam_performance.pkb_results
<https://builds.apache.org/job/beam_PerformanceTests_Spark/ws/runs/41357cae/perfkit-bq-pubj4r7X0.json}>
ReturnCode:1
STDOUT:
BigQuery error in load operation: Error processing job
'apache-beam-testing:bqjob_rcdde4025798bb7_00000162909910c7_1': Invalid schema
update. Field timestamp has changed type from TIMESTAMP to FLOAT
STDERR:
/usr/lib/google-cloud-sdk/platform/bq/third_party/oauth2client/contrib/gce.py:73:
UserWarning: You have requested explicit scopes to be used with a GCE service
account.
Using this argument will have no effect on the actual scopes for tokens
requested. These scopes are set at VM instance creation time and
can't be overridden in the request.
warnings.warn(_SCOPES_WARNING)
Upload complete.Waiting on bqjob_rcdde4025798bb7_00000162909910c7_1 ... (0s)
Current status: RUNNING
Waiting on bqjob_rcdde4025798bb7_00000162909910c7_1
... (1s) Current status: RUNNING
Waiting on
bqjob_rcdde4025798bb7_00000162909910c7_1 ... (1s) Current status: DONE
2018-04-04 12:19:36,113 41357cae MainThread INFO Retrying exception running
IssueRetryableCommand: Command returned a non-zero exit code.
2018-04-04 12:19:59,965 41357cae MainThread INFO Running: bq load
--autodetect --source_format=NEWLINE_DELIMITED_JSON
beam_performance.pkb_results
<https://builds.apache.org/job/beam_PerformanceTests_Spark/ws/runs/41357cae/perfkit-bq-pubj4r7X0.json>
2018-04-04 12:20:02,310 41357cae MainThread INFO Ran: {bq load --autodetect
--source_format=NEWLINE_DELIMITED_JSON beam_performance.pkb_results
<https://builds.apache.org/job/beam_PerformanceTests_Spark/ws/runs/41357cae/perfkit-bq-pubj4r7X0.json}>
ReturnCode:1
STDOUT:
BigQuery error in load operation: Error processing job
'apache-beam-testing:bqjob_r55e52f7f80ae0417_0000016290997aef_1': Invalid schema
update. Field timestamp has changed type from TIMESTAMP to FLOAT
STDERR:
/usr/lib/google-cloud-sdk/platform/bq/third_party/oauth2client/contrib/gce.py:73:
UserWarning: You have requested explicit scopes to be used with a GCE service
account.
Using this argument will have no effect on the actual scopes for tokens
requested. These scopes are set at VM instance creation time and
can't be overridden in the request.
warnings.warn(_SCOPES_WARNING)
Upload complete.Waiting on bqjob_r55e52f7f80ae0417_0000016290997aef_1 ... (0s)
Current status: RUNNING
Waiting on
bqjob_r55e52f7f80ae0417_0000016290997aef_1 ... (0s) Current status: DONE
2018-04-04 12:20:02,310 41357cae MainThread INFO Retrying exception running
IssueRetryableCommand: Command returned a non-zero exit code.
2018-04-04 12:20:17,913 41357cae MainThread INFO Running: bq load
--autodetect --source_format=NEWLINE_DELIMITED_JSON
beam_performance.pkb_results
<https://builds.apache.org/job/beam_PerformanceTests_Spark/ws/runs/41357cae/perfkit-bq-pubj4r7X0.json>
2018-04-04 12:20:20,494 41357cae MainThread INFO Ran: {bq load --autodetect
--source_format=NEWLINE_DELIMITED_JSON beam_performance.pkb_results
<https://builds.apache.org/job/beam_PerformanceTests_Spark/ws/runs/41357cae/perfkit-bq-pubj4r7X0.json}>
ReturnCode:1
STDOUT:
BigQuery error in load operation: Error processing job
'apache-beam-testing:bqjob_r4c6edc8314af2772_000001629099c10a_1': Invalid schema
update. Field timestamp has changed type from TIMESTAMP to FLOAT
STDERR:
/usr/lib/google-cloud-sdk/platform/bq/third_party/oauth2client/contrib/gce.py:73:
UserWarning: You have requested explicit scopes to be used with a GCE service
account.
Using this argument will have no effect on the actual scopes for tokens
requested. These scopes are set at VM instance creation time and
can't be overridden in the request.
warnings.warn(_SCOPES_WARNING)
Upload complete.Waiting on bqjob_r4c6edc8314af2772_000001629099c10a_1 ... (0s)
Current status: RUNNING
Waiting on
bqjob_r4c6edc8314af2772_000001629099c10a_1 ... (0s) Current status: DONE
2018-04-04 12:20:20,495 41357cae MainThread INFO Retrying exception running
IssueRetryableCommand: Command returned a non-zero exit code.
2018-04-04 12:20:49,376 41357cae MainThread INFO Running: bq load
--autodetect --source_format=NEWLINE_DELIMITED_JSON
beam_performance.pkb_results
<https://builds.apache.org/job/beam_PerformanceTests_Spark/ws/runs/41357cae/perfkit-bq-pubj4r7X0.json>
2018-04-04 12:20:52,801 41357cae MainThread INFO Ran: {bq load --autodetect
--source_format=NEWLINE_DELIMITED_JSON beam_performance.pkb_results
<https://builds.apache.org/job/beam_PerformanceTests_Spark/ws/runs/41357cae/perfkit-bq-pubj4r7X0.json}>
ReturnCode:1
STDOUT:
BigQuery error in load operation: Error processing job
'apache-beam-testing:bqjob_r1b592066449f0f77_00000162909a3fca_1': Invalid schema
update. Field timestamp has changed type from TIMESTAMP to FLOAT
STDERR:
/usr/lib/google-cloud-sdk/platform/bq/third_party/oauth2client/contrib/gce.py:73:
UserWarning: You have requested explicit scopes to be used with a GCE service
account.
Using this argument will have no effect on the actual scopes for tokens
requested. These scopes are set at VM instance creation time and
can't be overridden in the request.
warnings.warn(_SCOPES_WARNING)
Upload complete.Waiting on bqjob_r1b592066449f0f77_00000162909a3fca_1 ... (0s)
Current status: RUNNING
Waiting on
bqjob_r1b592066449f0f77_00000162909a3fca_1 ... (0s) Current status: DONE
2018-04-04 12:20:52,801 41357cae MainThread INFO Retrying exception running
IssueRetryableCommand: Command returned a non-zero exit code.
2018-04-04 12:21:19,034 41357cae MainThread INFO Running: bq load
--autodetect --source_format=NEWLINE_DELIMITED_JSON
beam_performance.pkb_results
<https://builds.apache.org/job/beam_PerformanceTests_Spark/ws/runs/41357cae/perfkit-bq-pubj4r7X0.json>
2018-04-04 12:21:21,485 41357cae MainThread INFO Ran: {bq load --autodetect
--source_format=NEWLINE_DELIMITED_JSON beam_performance.pkb_results
<https://builds.apache.org/job/beam_PerformanceTests_Spark/ws/runs/41357cae/perfkit-bq-pubj4r7X0.json}>
ReturnCode:1
STDOUT:
BigQuery error in load operation: Error processing job
'apache-beam-testing:bqjob_r28695f6120373943_00000162909aaff5_1': Invalid schema
update. Field timestamp has changed type from TIMESTAMP to FLOAT
STDERR:
/usr/lib/google-cloud-sdk/platform/bq/third_party/oauth2client/contrib/gce.py:73:
UserWarning: You have requested explicit scopes to be used with a GCE service
account.
Using this argument will have no effect on the actual scopes for tokens
requested. These scopes are set at VM instance creation time and
can't be overridden in the request.
warnings.warn(_SCOPES_WARNING)
Upload complete.Waiting on bqjob_r28695f6120373943_00000162909aaff5_1 ... (0s)
Current status: RUNNING
Waiting on
bqjob_r28695f6120373943_00000162909aaff5_1 ... (0s) Current status: DONE
2018-04-04 12:21:21,486 41357cae MainThread INFO Retrying exception running
IssueRetryableCommand: Command returned a non-zero exit code.
2018-04-04 12:21:47,847 41357cae MainThread INFO Running: bq load
--autodetect --source_format=NEWLINE_DELIMITED_JSON
beam_performance.pkb_results
<https://builds.apache.org/job/beam_PerformanceTests_Spark/ws/runs/41357cae/perfkit-bq-pubj4r7X0.json>
2018-04-04 12:21:52,764 41357cae MainThread INFO Ran: {bq load --autodetect
--source_format=NEWLINE_DELIMITED_JSON beam_performance.pkb_results
<https://builds.apache.org/job/beam_PerformanceTests_Spark/ws/runs/41357cae/perfkit-bq-pubj4r7X0.json}>
ReturnCode:1
STDOUT:
BigQuery error in load operation: Error processing job
'apache-beam-testing:bqjob_r4ded490da6295750_00000162909b20c3_1': Invalid schema
update. Field timestamp has changed type from TIMESTAMP to FLOAT
STDERR:
/usr/lib/google-cloud-sdk/platform/bq/third_party/oauth2client/contrib/gce.py:73:
UserWarning: You have requested explicit scopes to be used with a GCE service
account.
Using this argument will have no effect on the actual scopes for tokens
requested. These scopes are set at VM instance creation time and
can't be overridden in the request.
warnings.warn(_SCOPES_WARNING)
Upload complete.Waiting on bqjob_r4ded490da6295750_00000162909b20c3_1 ... (0s)
Current status: RUNNING
Waiting on
bqjob_r4ded490da6295750_00000162909b20c3_1 ... (1s) Current status: RUNNING
Waiting on bqjob_r4ded490da6295750_00000162909b20c3_1 ... (2s) Current status:
RUNNING
Waiting on bqjob_r4ded490da6295750_00000162909b20c3_1 ... (2s)
Current status: DONE
2018-04-04 12:21:52,764 41357cae MainThread INFO Retrying exception running
IssueRetryableCommand: Command returned a non-zero exit code.
2018-04-04 12:22:08,665 41357cae MainThread INFO Running: bq load
--autodetect --source_format=NEWLINE_DELIMITED_JSON
beam_performance.pkb_results
<https://builds.apache.org/job/beam_PerformanceTests_Spark/ws/runs/41357cae/perfkit-bq-pubj4r7X0.json>
2018-04-04 12:22:12,344 41357cae MainThread INFO Ran: {bq load --autodetect
--source_format=NEWLINE_DELIMITED_JSON beam_performance.pkb_results
<https://builds.apache.org/job/beam_PerformanceTests_Spark/ws/runs/41357cae/perfkit-bq-pubj4r7X0.json}>
ReturnCode:1
STDOUT:
BigQuery error in load operation: Error processing job
'apache-beam-testing:bqjob_r5aeade55fd2c606_00000162909b75c0_1': Invalid schema
update. Field timestamp has changed type from TIMESTAMP to FLOAT
STDERR:
/usr/lib/google-cloud-sdk/platform/bq/third_party/oauth2client/contrib/gce.py:73:
UserWarning: You have requested explicit scopes to be used with a GCE service
account.
Using this argument will have no effect on the actual scopes for tokens
requested. These scopes are set at VM instance creation time and
can't be overridden in the request.
warnings.warn(_SCOPES_WARNING)
Upload complete.Waiting on bqjob_r5aeade55fd2c606_00000162909b75c0_1 ... (0s)
Current status: RUNNING
Waiting on
bqjob_r5aeade55fd2c606_00000162909b75c0_1 ... (0s) Current status: DONE
2018-04-04 12:22:12,344 41357cae MainThread INFO Retrying exception running
IssueRetryableCommand: Command returned a non-zero exit code.
2018-04-04 12:22:38,568 41357cae MainThread INFO Running: bq load
--autodetect --source_format=NEWLINE_DELIMITED_JSON
beam_performance.pkb_results
<https://builds.apache.org/job/beam_PerformanceTests_Spark/ws/runs/41357cae/perfkit-bq-pubj4r7X0.json>
2018-04-04 12:22:41,128 41357cae MainThread INFO Ran: {bq load --autodetect
--source_format=NEWLINE_DELIMITED_JSON beam_performance.pkb_results
<https://builds.apache.org/job/beam_PerformanceTests_Spark/ws/runs/41357cae/perfkit-bq-pubj4r7X0.json}>
ReturnCode:1
STDOUT:
BigQuery error in load operation: Error processing job
'apache-beam-testing:bqjob_r6935f2dadb0f7444_00000162909be68f_1': Invalid schema
update. Field timestamp has changed type from TIMESTAMP to FLOAT
STDERR:
/usr/lib/google-cloud-sdk/platform/bq/third_party/oauth2client/contrib/gce.py:73:
UserWarning: You have requested explicit scopes to be used with a GCE service
account.
Using this argument will have no effect on the actual scopes for tokens
requested. These scopes are set at VM instance creation time and
can't be overridden in the request.
warnings.warn(_SCOPES_WARNING)
Upload complete.Waiting on bqjob_r6935f2dadb0f7444_00000162909be68f_1 ... (0s)
Current status: RUNNING
Waiting on
bqjob_r6935f2dadb0f7444_00000162909be68f_1 ... (0s) Current status: DONE
2018-04-04 12:22:41,128 41357cae MainThread INFO Retrying exception running
IssueRetryableCommand: Command returned a non-zero exit code.
2018-04-04 12:23:05,841 41357cae MainThread INFO Running: bq load
--autodetect --source_format=NEWLINE_DELIMITED_JSON
beam_performance.pkb_results
<https://builds.apache.org/job/beam_PerformanceTests_Spark/ws/runs/41357cae/perfkit-bq-pubj4r7X0.json>
2018-04-04 12:23:08,392 41357cae MainThread INFO Ran: {bq load --autodetect
--source_format=NEWLINE_DELIMITED_JSON beam_performance.pkb_results
<https://builds.apache.org/job/beam_PerformanceTests_Spark/ws/runs/41357cae/perfkit-bq-pubj4r7X0.json}>
ReturnCode:1
STDOUT:
BigQuery error in load operation: Error processing job
'apache-beam-testing:bqjob_r6530bd8ec4b3e054_00000162909c5111_1': Invalid schema
update. Field timestamp has changed type from TIMESTAMP to FLOAT
STDERR:
/usr/lib/google-cloud-sdk/platform/bq/third_party/oauth2client/contrib/gce.py:73:
UserWarning: You have requested explicit scopes to be used with a GCE service
account.
Using this argument will have no effect on the actual scopes for tokens
requested. These scopes are set at VM instance creation time and
can't be overridden in the request.
warnings.warn(_SCOPES_WARNING)
Upload complete.Waiting on bqjob_r6530bd8ec4b3e054_00000162909c5111_1 ... (0s)
Current status: RUNNING
Waiting on
bqjob_r6530bd8ec4b3e054_00000162909c5111_1 ... (0s) Current status: DONE
2018-04-04 12:23:08,393 41357cae MainThread INFO Retrying exception running
IssueRetryableCommand: Command returned a non-zero exit code.
2018-04-04 12:23:32,162 41357cae MainThread INFO Running: bq load
--autodetect --source_format=NEWLINE_DELIMITED_JSON
beam_performance.pkb_results
<https://builds.apache.org/job/beam_PerformanceTests_Spark/ws/runs/41357cae/perfkit-bq-pubj4r7X0.json>
2018-04-04 12:23:34,697 41357cae MainThread INFO Ran: {bq load --autodetect
--source_format=NEWLINE_DELIMITED_JSON beam_performance.pkb_results
<https://builds.apache.org/job/beam_PerformanceTests_Spark/ws/runs/41357cae/perfkit-bq-pubj4r7X0.json}>
ReturnCode:1
STDOUT:
BigQuery error in load operation: Error processing job
'apache-beam-testing:bqjob_r474966c5dc4254cb_00000162909cb7c9_1': Invalid schema
update. Field timestamp has changed type from TIMESTAMP to FLOAT
STDERR:
/usr/lib/google-cloud-sdk/platform/bq/third_party/oauth2client/contrib/gce.py:73:
UserWarning: You have requested explicit scopes to be used with a GCE service
account.
Using this argument will have no effect on the actual scopes for tokens
requested. These scopes are set at VM instance creation time and
can't be overridden in the request.
warnings.warn(_SCOPES_WARNING)
Upload complete.Waiting on bqjob_r474966c5dc4254cb_00000162909cb7c9_1 ... (0s)
Current status: RUNNING
Waiting on
bqjob_r474966c5dc4254cb_00000162909cb7c9_1 ... (0s) Current status: DONE
2018-04-04 12:23:34,697 41357cae MainThread INFO Retrying exception running
IssueRetryableCommand: Command returned a non-zero exit code.
2018-04-04 12:24:02,081 41357cae MainThread INFO Running: bq load
--autodetect --source_format=NEWLINE_DELIMITED_JSON
beam_performance.pkb_results
<https://builds.apache.org/job/beam_PerformanceTests_Spark/ws/runs/41357cae/perfkit-bq-pubj4r7X0.json>
2018-04-04 12:24:05,143 41357cae MainThread INFO Ran: {bq load --autodetect
--source_format=NEWLINE_DELIMITED_JSON beam_performance.pkb_results
<https://builds.apache.org/job/beam_PerformanceTests_Spark/ws/runs/41357cae/perfkit-bq-pubj4r7X0.json}>
ReturnCode:1
STDOUT:
BigQuery error in load operation: Error processing job
'apache-beam-testing:bqjob_r35a4770cbf4c7dd7_00000162909d2d00_1': Invalid schema
update. Field timestamp has changed type from TIMESTAMP to FLOAT
STDERR:
/usr/lib/google-cloud-sdk/platform/bq/third_party/oauth2client/contrib/gce.py:73:
UserWarning: You have requested explicit scopes to be used with a GCE service
account.
Using this argument will have no effect on the actual scopes for tokens
requested. These scopes are set at VM instance creation time and
can't be overridden in the request.
warnings.warn(_SCOPES_WARNING)
Upload complete.Waiting on bqjob_r35a4770cbf4c7dd7_00000162909d2d00_1 ... (0s)
Current status: RUNNING
Waiting on
bqjob_r35a4770cbf4c7dd7_00000162909d2d00_1 ... (0s) Current status: DONE
2018-04-04 12:24:05,143 41357cae MainThread INFO Retrying exception running
IssueRetryableCommand: Command returned a non-zero exit code.
2018-04-04 12:24:27,934 41357cae MainThread INFO Running: bq load
--autodetect --source_format=NEWLINE_DELIMITED_JSON
beam_performance.pkb_results
<https://builds.apache.org/job/beam_PerformanceTests_Spark/ws/runs/41357cae/perfkit-bq-pubj4r7X0.json>
2018-04-04 12:24:30,474 41357cae MainThread INFO Ran: {bq load --autodetect
--source_format=NEWLINE_DELIMITED_JSON beam_performance.pkb_results
<https://builds.apache.org/job/beam_PerformanceTests_Spark/ws/runs/41357cae/perfkit-bq-pubj4r7X0.json}>
ReturnCode:1
STDOUT:
BigQuery error in load operation: Error processing job
'apache-beam-testing:bqjob_r681dba7072e360a6_00000162909d91cb_1': Invalid schema
update. Field timestamp has changed type from TIMESTAMP to FLOAT
STDERR:
/usr/lib/google-cloud-sdk/platform/bq/third_party/oauth2client/contrib/gce.py:73:
UserWarning: You have requested explicit scopes to be used with a GCE service
account.
Using this argument will have no effect on the actual scopes for tokens
requested. These scopes are set at VM instance creation time and
can't be overridden in the request.
warnings.warn(_SCOPES_WARNING)
Upload complete.Waiting on bqjob_r681dba7072e360a6_00000162909d91cb_1 ... (0s)
Current status: RUNNING
Waiting on
bqjob_r681dba7072e360a6_00000162909d91cb_1 ... (0s) Current status: DONE
2018-04-04 12:24:30,474 41357cae MainThread INFO Retrying exception running
IssueRetryableCommand: Command returned a non-zero exit code.
2018-04-04 12:24:58,617 41357cae MainThread INFO Running: bq load
--autodetect --source_format=NEWLINE_DELIMITED_JSON
beam_performance.pkb_results
<https://builds.apache.org/job/beam_PerformanceTests_Spark/ws/runs/41357cae/perfkit-bq-pubj4r7X0.json>
2018-04-04 12:25:01,102 41357cae MainThread INFO Ran: {bq load --autodetect
--source_format=NEWLINE_DELIMITED_JSON beam_performance.pkb_results
<https://builds.apache.org/job/beam_PerformanceTests_Spark/ws/runs/41357cae/perfkit-bq-pubj4r7X0.json}>
ReturnCode:1
STDOUT:
BigQuery error in load operation: Error processing job
'apache-beam-testing:bqjob_r1f3f511fccc2666f_00000162909e0944_1': Invalid schema
update. Field timestamp has changed type from TIMESTAMP to FLOAT
STDERR:
/usr/lib/google-cloud-sdk/platform/bq/third_party/oauth2client/contrib/gce.py:73:
UserWarning: You have requested explicit scopes to be used with a GCE service
account.
Using this argument will have no effect on the actual scopes for tokens
requested. These scopes are set at VM instance creation time and
can't be overridden in the request.
warnings.warn(_SCOPES_WARNING)
Upload complete.Waiting on bqjob_r1f3f511fccc2666f_00000162909e0944_1 ... (0s)
Current status: RUNNING
Waiting on
bqjob_r1f3f511fccc2666f_00000162909e0944_1 ... (0s) Current status: DONE
Traceback (most recent call last):
File "PerfKitBenchmarker/pkb.py", line 21, in <module>
sys.exit(Main())
File
"<https://builds.apache.org/job/beam_PerformanceTests_Spark/ws/PerfKitBenchmarker/perfkitbenchmarker/pkb.py";,>
line 952, in Main
return RunBenchmarks()
File
"<https://builds.apache.org/job/beam_PerformanceTests_Spark/ws/PerfKitBenchmarker/perfkitbenchmarker/pkb.py";,>
line 879, in RunBenchmarks
collector.PublishSamples()
File
"<https://builds.apache.org/job/beam_PerformanceTests_Spark/ws/PerfKitBenchmarker/perfkitbenchmarker/publisher.py";,>
line 886, in PublishSamples
publisher.PublishSamples(self.samples)
File
"<https://builds.apache.org/job/beam_PerformanceTests_Spark/ws/PerfKitBenchmarker/perfkitbenchmarker/publisher.py";,>
line 538, in PublishSamples
vm_util.IssueRetryableCommand(load_cmd)
File
"<https://builds.apache.org/job/beam_PerformanceTests_Spark/ws/PerfKitBenchmarker/perfkitbenchmarker/vm_util.py";,>
line 249, in WrappedFunction
return f(*args, **kwargs)
File
"<https://builds.apache.org/job/beam_PerformanceTests_Spark/ws/PerfKitBenchmarker/perfkitbenchmarker/vm_util.py";,>
line 387, in IssueRetryableCommand
'Command returned a non-zero exit code.\n')
perfkitbenchmarker.errors.CalledProcessException: Command returned a non-zero
exit code.
Build step 'Execute shell' marked build as failure
