See
<https://builds.apache.org/job/beam_PerformanceTests_Spark/1582/display/redirect?page=changes>
Changes:
[shoyer] [BEAM-3956] Preserve stacktraces for Python exceptions
[XuMingmin] KafkaIO : fix a typo in method name. (#5106)
------------------------------------------
[...truncated 89.92 KB...]
'apache-beam-testing:bqjob_r44a211605ba50a70_00000162bb1c112d_1': Invalid schema
update. Field timestamp has changed type from TIMESTAMP to FLOAT
STDERR:
/usr/lib/google-cloud-sdk/platform/bq/third_party/oauth2client/contrib/gce.py:73:
UserWarning: You have requested explicit scopes to be used with a GCE service
account.
Using this argument will have no effect on the actual scopes for tokens
requested. These scopes are set at VM instance creation time and
can't be overridden in the request.
warnings.warn(_SCOPES_WARNING)
Upload complete.Waiting on bqjob_r44a211605ba50a70_00000162bb1c112d_1 ... (0s)
Current status: RUNNING
Waiting on
bqjob_r44a211605ba50a70_00000162bb1c112d_1 ... (0s) Current status: DONE
2018-04-12 18:26:43,647 c004ee49 MainThread INFO Retrying exception running
IssueRetryableCommand: Command returned a non-zero exit code.
2018-04-12 18:27:11,681 c004ee49 MainThread INFO Running: bq load
--autodetect --source_format=NEWLINE_DELIMITED_JSON
beam_performance.pkb_results
<https://builds.apache.org/job/beam_PerformanceTests_Spark/ws/runs/c004ee49/perfkit-bq-pubcExWsv.json>
2018-04-12 18:27:13,935 c004ee49 MainThread INFO Ran: {bq load --autodetect
--source_format=NEWLINE_DELIMITED_JSON beam_performance.pkb_results
<https://builds.apache.org/job/beam_PerformanceTests_Spark/ws/runs/c004ee49/perfkit-bq-pubcExWsv.json}>
ReturnCode:1
STDOUT:
BigQuery error in load operation: Error processing job
'apache-beam-testing:bqjob_r55730b9a544aa5f_00000162bb1c8856_1': Invalid schema
update. Field timestamp has changed type from TIMESTAMP to FLOAT
STDERR:
/usr/lib/google-cloud-sdk/platform/bq/third_party/oauth2client/contrib/gce.py:73:
UserWarning: You have requested explicit scopes to be used with a GCE service
account.
Using this argument will have no effect on the actual scopes for tokens
requested. These scopes are set at VM instance creation time and
can't be overridden in the request.
warnings.warn(_SCOPES_WARNING)
Upload complete.Waiting on bqjob_r55730b9a544aa5f_00000162bb1c8856_1 ... (0s)
Current status: RUNNING
Waiting on
bqjob_r55730b9a544aa5f_00000162bb1c8856_1 ... (0s) Current status: DONE
2018-04-12 18:27:13,936 c004ee49 MainThread INFO Retrying exception running
IssueRetryableCommand: Command returned a non-zero exit code.
2018-04-12 18:27:38,280 c004ee49 MainThread INFO Running: bq load
--autodetect --source_format=NEWLINE_DELIMITED_JSON
beam_performance.pkb_results
<https://builds.apache.org/job/beam_PerformanceTests_Spark/ws/runs/c004ee49/perfkit-bq-pubcExWsv.json>
2018-04-12 18:27:41,192 c004ee49 MainThread INFO Ran: {bq load --autodetect
--source_format=NEWLINE_DELIMITED_JSON beam_performance.pkb_results
<https://builds.apache.org/job/beam_PerformanceTests_Spark/ws/runs/c004ee49/perfkit-bq-pubcExWsv.json}>
ReturnCode:1
STDOUT:
BigQuery error in load operation: Error processing job
'apache-beam-testing:bqjob_r4e2052996ecf0424_00000162bb1cf001_1': Invalid schema
update. Field timestamp has changed type from TIMESTAMP to FLOAT
STDERR:
/usr/lib/google-cloud-sdk/platform/bq/third_party/oauth2client/contrib/gce.py:73:
UserWarning: You have requested explicit scopes to be used with a GCE service
account.
Using this argument will have no effect on the actual scopes for tokens
requested. These scopes are set at VM instance creation time and
can't be overridden in the request.
warnings.warn(_SCOPES_WARNING)
Upload complete.Waiting on bqjob_r4e2052996ecf0424_00000162bb1cf001_1 ... (0s)
Current status: RUNNING
Waiting on
bqjob_r4e2052996ecf0424_00000162bb1cf001_1 ... (0s) Current status: DONE
2018-04-12 18:27:41,192 c004ee49 MainThread INFO Retrying exception running
IssueRetryableCommand: Command returned a non-zero exit code.
2018-04-12 18:28:05,179 c004ee49 MainThread INFO Running: bq load
--autodetect --source_format=NEWLINE_DELIMITED_JSON
beam_performance.pkb_results
<https://builds.apache.org/job/beam_PerformanceTests_Spark/ws/runs/c004ee49/perfkit-bq-pubcExWsv.json>
2018-04-12 18:28:07,912 c004ee49 MainThread INFO Ran: {bq load --autodetect
--source_format=NEWLINE_DELIMITED_JSON beam_performance.pkb_results
<https://builds.apache.org/job/beam_PerformanceTests_Spark/ws/runs/c004ee49/perfkit-bq-pubcExWsv.json}>
ReturnCode:1
STDOUT:
BigQuery error in load operation: Error processing job
'apache-beam-testing:bqjob_r91aaff6c14cb4be_00000162bb1d5944_1': Invalid schema
update. Field timestamp has changed type from TIMESTAMP to FLOAT
STDERR:
/usr/lib/google-cloud-sdk/platform/bq/third_party/oauth2client/contrib/gce.py:73:
UserWarning: You have requested explicit scopes to be used with a GCE service
account.
Using this argument will have no effect on the actual scopes for tokens
requested. These scopes are set at VM instance creation time and
can't be overridden in the request.
warnings.warn(_SCOPES_WARNING)
Upload complete.Waiting on bqjob_r91aaff6c14cb4be_00000162bb1d5944_1 ... (0s)
Current status: RUNNING
Waiting on
bqjob_r91aaff6c14cb4be_00000162bb1d5944_1 ... (0s) Current status: DONE
2018-04-12 18:28:07,913 c004ee49 MainThread INFO Retrying exception running
IssueRetryableCommand: Command returned a non-zero exit code.
2018-04-12 18:28:27,491 c004ee49 MainThread INFO Running: bq load
--autodetect --source_format=NEWLINE_DELIMITED_JSON
beam_performance.pkb_results
<https://builds.apache.org/job/beam_PerformanceTests_Spark/ws/runs/c004ee49/perfkit-bq-pubcExWsv.json>
2018-04-12 18:28:30,934 c004ee49 MainThread INFO Ran: {bq load --autodetect
--source_format=NEWLINE_DELIMITED_JSON beam_performance.pkb_results
<https://builds.apache.org/job/beam_PerformanceTests_Spark/ws/runs/c004ee49/perfkit-bq-pubcExWsv.json}>
ReturnCode:1
STDOUT:
BigQuery error in load operation: Error processing job
'apache-beam-testing:bqjob_r6bb33aed9f7e77f7_00000162bb1db069_1': Invalid schema
update. Field timestamp has changed type from TIMESTAMP to FLOAT
STDERR:
/usr/lib/google-cloud-sdk/platform/bq/third_party/oauth2client/contrib/gce.py:73:
UserWarning: You have requested explicit scopes to be used with a GCE service
account.
Using this argument will have no effect on the actual scopes for tokens
requested. These scopes are set at VM instance creation time and
can't be overridden in the request.
warnings.warn(_SCOPES_WARNING)
Upload complete.Waiting on bqjob_r6bb33aed9f7e77f7_00000162bb1db069_1 ... (0s)
Current status: RUNNING
Waiting on
bqjob_r6bb33aed9f7e77f7_00000162bb1db069_1 ... (0s) Current status: DONE
2018-04-12 18:28:30,934 c004ee49 MainThread INFO Retrying exception running
IssueRetryableCommand: Command returned a non-zero exit code.
2018-04-12 18:28:59,741 c004ee49 MainThread INFO Running: bq load
--autodetect --source_format=NEWLINE_DELIMITED_JSON
beam_performance.pkb_results
<https://builds.apache.org/job/beam_PerformanceTests_Spark/ws/runs/c004ee49/perfkit-bq-pubcExWsv.json>
2018-04-12 18:29:02,418 c004ee49 MainThread INFO Ran: {bq load --autodetect
--source_format=NEWLINE_DELIMITED_JSON beam_performance.pkb_results
<https://builds.apache.org/job/beam_PerformanceTests_Spark/ws/runs/c004ee49/perfkit-bq-pubcExWsv.json}>
ReturnCode:1
STDOUT:
BigQuery error in load operation: Error processing job
'apache-beam-testing:bqjob_r2792ca5655f1f134_00000162bb1e2ed2_1': Invalid schema
update. Field timestamp has changed type from TIMESTAMP to FLOAT
STDERR:
/usr/lib/google-cloud-sdk/platform/bq/third_party/oauth2client/contrib/gce.py:73:
UserWarning: You have requested explicit scopes to be used with a GCE service
account.
Using this argument will have no effect on the actual scopes for tokens
requested. These scopes are set at VM instance creation time and
can't be overridden in the request.
warnings.warn(_SCOPES_WARNING)
Upload complete.Waiting on bqjob_r2792ca5655f1f134_00000162bb1e2ed2_1 ... (0s)
Current status: RUNNING
Waiting on
bqjob_r2792ca5655f1f134_00000162bb1e2ed2_1 ... (0s) Current status: DONE
2018-04-12 18:29:02,418 c004ee49 MainThread INFO Retrying exception running
IssueRetryableCommand: Command returned a non-zero exit code.
2018-04-12 18:29:18,196 c004ee49 MainThread INFO Running: bq load
--autodetect --source_format=NEWLINE_DELIMITED_JSON
beam_performance.pkb_results
<https://builds.apache.org/job/beam_PerformanceTests_Spark/ws/runs/c004ee49/perfkit-bq-pubcExWsv.json>
2018-04-12 18:29:20,684 c004ee49 MainThread INFO Ran: {bq load --autodetect
--source_format=NEWLINE_DELIMITED_JSON beam_performance.pkb_results
<https://builds.apache.org/job/beam_PerformanceTests_Spark/ws/runs/c004ee49/perfkit-bq-pubcExWsv.json}>
ReturnCode:1
STDOUT:
BigQuery error in load operation: Error processing job
'apache-beam-testing:bqjob_rab7335d177b28c3_00000162bb1e76b4_1': Invalid schema
update. Field timestamp has changed type from TIMESTAMP to FLOAT
STDERR:
/usr/lib/google-cloud-sdk/platform/bq/third_party/oauth2client/contrib/gce.py:73:
UserWarning: You have requested explicit scopes to be used with a GCE service
account.
Using this argument will have no effect on the actual scopes for tokens
requested. These scopes are set at VM instance creation time and
can't be overridden in the request.
warnings.warn(_SCOPES_WARNING)
Upload complete.Waiting on bqjob_rab7335d177b28c3_00000162bb1e76b4_1 ... (0s)
Current status: RUNNING
Waiting on
bqjob_rab7335d177b28c3_00000162bb1e76b4_1 ... (0s) Current status: DONE
2018-04-12 18:29:20,684 c004ee49 MainThread INFO Retrying exception running
IssueRetryableCommand: Command returned a non-zero exit code.
2018-04-12 18:29:46,225 c004ee49 MainThread INFO Running: bq load
--autodetect --source_format=NEWLINE_DELIMITED_JSON
beam_performance.pkb_results
<https://builds.apache.org/job/beam_PerformanceTests_Spark/ws/runs/c004ee49/perfkit-bq-pubcExWsv.json>
2018-04-12 18:29:48,552 c004ee49 MainThread INFO Ran: {bq load --autodetect
--source_format=NEWLINE_DELIMITED_JSON beam_performance.pkb_results
<https://builds.apache.org/job/beam_PerformanceTests_Spark/ws/runs/c004ee49/perfkit-bq-pubcExWsv.json}>
ReturnCode:1
STDOUT:
BigQuery error in load operation: Error processing job
'apache-beam-testing:bqjob_r2701f072645a2a6a_00000162bb1ee3e9_1': Invalid schema
update. Field timestamp has changed type from TIMESTAMP to FLOAT
STDERR:
/usr/lib/google-cloud-sdk/platform/bq/third_party/oauth2client/contrib/gce.py:73:
UserWarning: You have requested explicit scopes to be used with a GCE service
account.
Using this argument will have no effect on the actual scopes for tokens
requested. These scopes are set at VM instance creation time and
can't be overridden in the request.
warnings.warn(_SCOPES_WARNING)
Upload complete.Waiting on bqjob_r2701f072645a2a6a_00000162bb1ee3e9_1 ... (0s)
Current status: RUNNING
Waiting on
bqjob_r2701f072645a2a6a_00000162bb1ee3e9_1 ... (0s) Current status: DONE
2018-04-12 18:29:48,553 c004ee49 MainThread INFO Retrying exception running
IssueRetryableCommand: Command returned a non-zero exit code.
2018-04-12 18:30:17,853 c004ee49 MainThread INFO Running: bq load
--autodetect --source_format=NEWLINE_DELIMITED_JSON
beam_performance.pkb_results
<https://builds.apache.org/job/beam_PerformanceTests_Spark/ws/runs/c004ee49/perfkit-bq-pubcExWsv.json>
2018-04-12 18:30:20,308 c004ee49 MainThread INFO Ran: {bq load --autodetect
--source_format=NEWLINE_DELIMITED_JSON beam_performance.pkb_results
<https://builds.apache.org/job/beam_PerformanceTests_Spark/ws/runs/c004ee49/perfkit-bq-pubcExWsv.json}>
ReturnCode:1
STDOUT:
BigQuery error in load operation: Error processing job
'apache-beam-testing:bqjob_r2a8743a5dc534ad2_00000162bb1f5f85_1': Invalid schema
update. Field timestamp has changed type from TIMESTAMP to FLOAT
STDERR:
/usr/lib/google-cloud-sdk/platform/bq/third_party/oauth2client/contrib/gce.py:73:
UserWarning: You have requested explicit scopes to be used with a GCE service
account.
Using this argument will have no effect on the actual scopes for tokens
requested. These scopes are set at VM instance creation time and
can't be overridden in the request.
warnings.warn(_SCOPES_WARNING)
Upload complete.Waiting on bqjob_r2a8743a5dc534ad2_00000162bb1f5f85_1 ... (0s)
Current status: RUNNING
Waiting on
bqjob_r2a8743a5dc534ad2_00000162bb1f5f85_1 ... (0s) Current status: DONE
2018-04-12 18:30:20,308 c004ee49 MainThread INFO Retrying exception running
IssueRetryableCommand: Command returned a non-zero exit code.
2018-04-12 18:30:38,354 c004ee49 MainThread INFO Running: bq load
--autodetect --source_format=NEWLINE_DELIMITED_JSON
beam_performance.pkb_results
<https://builds.apache.org/job/beam_PerformanceTests_Spark/ws/runs/c004ee49/perfkit-bq-pubcExWsv.json>
2018-04-12 18:30:40,860 c004ee49 MainThread INFO Ran: {bq load --autodetect
--source_format=NEWLINE_DELIMITED_JSON beam_performance.pkb_results
<https://builds.apache.org/job/beam_PerformanceTests_Spark/ws/runs/c004ee49/perfkit-bq-pubcExWsv.json}>
ReturnCode:1
STDOUT:
BigQuery error in load operation: Error processing job
'apache-beam-testing:bqjob_r29a5705f8ec5ac43_00000162bb1faf9f_1': Invalid schema
update. Field timestamp has changed type from TIMESTAMP to FLOAT
STDERR:
/usr/lib/google-cloud-sdk/platform/bq/third_party/oauth2client/contrib/gce.py:73:
UserWarning: You have requested explicit scopes to be used with a GCE service
account.
Using this argument will have no effect on the actual scopes for tokens
requested. These scopes are set at VM instance creation time and
can't be overridden in the request.
warnings.warn(_SCOPES_WARNING)
Upload complete.Waiting on bqjob_r29a5705f8ec5ac43_00000162bb1faf9f_1 ... (0s)
Current status: RUNNING
Waiting on
bqjob_r29a5705f8ec5ac43_00000162bb1faf9f_1 ... (0s) Current status: DONE
2018-04-12 18:30:40,861 c004ee49 MainThread INFO Retrying exception running
IssueRetryableCommand: Command returned a non-zero exit code.
2018-04-12 18:31:10,749 c004ee49 MainThread INFO Running: bq load
--autodetect --source_format=NEWLINE_DELIMITED_JSON
beam_performance.pkb_results
<https://builds.apache.org/job/beam_PerformanceTests_Spark/ws/runs/c004ee49/perfkit-bq-pubcExWsv.json>
2018-04-12 18:31:13,423 c004ee49 MainThread INFO Ran: {bq load --autodetect
--source_format=NEWLINE_DELIMITED_JSON beam_performance.pkb_results
<https://builds.apache.org/job/beam_PerformanceTests_Spark/ws/runs/c004ee49/perfkit-bq-pubcExWsv.json}>
ReturnCode:1
STDOUT:
BigQuery error in load operation: Error processing job
'apache-beam-testing:bqjob_r29e190de6042ad3f_00000162bb202e20_1': Invalid schema
update. Field timestamp has changed type from TIMESTAMP to FLOAT
STDERR:
/usr/lib/google-cloud-sdk/platform/bq/third_party/oauth2client/contrib/gce.py:73:
UserWarning: You have requested explicit scopes to be used with a GCE service
account.
Using this argument will have no effect on the actual scopes for tokens
requested. These scopes are set at VM instance creation time and
can't be overridden in the request.
warnings.warn(_SCOPES_WARNING)
Upload complete.Waiting on bqjob_r29e190de6042ad3f_00000162bb202e20_1 ... (0s)
Current status: RUNNING
Waiting on
bqjob_r29e190de6042ad3f_00000162bb202e20_1 ... (0s) Current status: DONE
2018-04-12 18:31:13,424 c004ee49 MainThread INFO Retrying exception running
IssueRetryableCommand: Command returned a non-zero exit code.
2018-04-12 18:31:35,931 c004ee49 MainThread INFO Running: bq load
--autodetect --source_format=NEWLINE_DELIMITED_JSON
beam_performance.pkb_results
<https://builds.apache.org/job/beam_PerformanceTests_Spark/ws/runs/c004ee49/perfkit-bq-pubcExWsv.json>
2018-04-12 18:31:38,498 c004ee49 MainThread INFO Ran: {bq load --autodetect
--source_format=NEWLINE_DELIMITED_JSON beam_performance.pkb_results
<https://builds.apache.org/job/beam_PerformanceTests_Spark/ws/runs/c004ee49/perfkit-bq-pubcExWsv.json}>
ReturnCode:1
STDOUT:
BigQuery error in load operation: Error processing job
'apache-beam-testing:bqjob_r1d59c29fef0cb04c_00000162bb209050_1': Invalid schema
update. Field timestamp has changed type from TIMESTAMP to FLOAT
STDERR:
/usr/lib/google-cloud-sdk/platform/bq/third_party/oauth2client/contrib/gce.py:73:
UserWarning: You have requested explicit scopes to be used with a GCE service
account.
Using this argument will have no effect on the actual scopes for tokens
requested. These scopes are set at VM instance creation time and
can't be overridden in the request.
warnings.warn(_SCOPES_WARNING)
Upload complete.Waiting on bqjob_r1d59c29fef0cb04c_00000162bb209050_1 ... (0s)
Current status: RUNNING
Waiting on
bqjob_r1d59c29fef0cb04c_00000162bb209050_1 ... (0s) Current status: DONE
2018-04-12 18:31:38,498 c004ee49 MainThread INFO Retrying exception running
IssueRetryableCommand: Command returned a non-zero exit code.
2018-04-12 18:31:58,840 c004ee49 MainThread INFO Running: bq load
--autodetect --source_format=NEWLINE_DELIMITED_JSON
beam_performance.pkb_results
<https://builds.apache.org/job/beam_PerformanceTests_Spark/ws/runs/c004ee49/perfkit-bq-pubcExWsv.json>
2018-04-12 18:32:01,254 c004ee49 MainThread INFO Ran: {bq load --autodetect
--source_format=NEWLINE_DELIMITED_JSON beam_performance.pkb_results
<https://builds.apache.org/job/beam_PerformanceTests_Spark/ws/runs/c004ee49/perfkit-bq-pubcExWsv.json}>
ReturnCode:1
STDOUT:
BigQuery error in load operation: Error processing job
'apache-beam-testing:bqjob_r5b5300456da7d939_00000162bb20e9e7_1': Invalid schema
update. Field timestamp has changed type from TIMESTAMP to FLOAT
STDERR:
/usr/lib/google-cloud-sdk/platform/bq/third_party/oauth2client/contrib/gce.py:73:
UserWarning: You have requested explicit scopes to be used with a GCE service
account.
Using this argument will have no effect on the actual scopes for tokens
requested. These scopes are set at VM instance creation time and
can't be overridden in the request.
warnings.warn(_SCOPES_WARNING)
Upload complete.Waiting on bqjob_r5b5300456da7d939_00000162bb20e9e7_1 ... (0s)
Current status: RUNNING
Waiting on
bqjob_r5b5300456da7d939_00000162bb20e9e7_1 ... (0s) Current status: DONE
2018-04-12 18:32:01,254 c004ee49 MainThread INFO Retrying exception running
IssueRetryableCommand: Command returned a non-zero exit code.
2018-04-12 18:32:16,465 c004ee49 MainThread INFO Running: bq load
--autodetect --source_format=NEWLINE_DELIMITED_JSON
beam_performance.pkb_results
<https://builds.apache.org/job/beam_PerformanceTests_Spark/ws/runs/c004ee49/perfkit-bq-pubcExWsv.json>
2018-04-12 18:32:19,368 c004ee49 MainThread INFO Ran: {bq load --autodetect
--source_format=NEWLINE_DELIMITED_JSON beam_performance.pkb_results
<https://builds.apache.org/job/beam_PerformanceTests_Spark/ws/runs/c004ee49/perfkit-bq-pubcExWsv.json}>
ReturnCode:1
STDOUT:
BigQuery error in load operation: Error processing job
'apache-beam-testing:bqjob_r7f293d1a2fdeedc8_00000162bb212efb_1': Invalid schema
update. Field timestamp has changed type from TIMESTAMP to FLOAT
STDERR:
/usr/lib/google-cloud-sdk/platform/bq/third_party/oauth2client/contrib/gce.py:73:
UserWarning: You have requested explicit scopes to be used with a GCE service
account.
Using this argument will have no effect on the actual scopes for tokens
requested. These scopes are set at VM instance creation time and
can't be overridden in the request.
warnings.warn(_SCOPES_WARNING)
Upload complete.Waiting on bqjob_r7f293d1a2fdeedc8_00000162bb212efb_1 ... (0s)
Current status: RUNNING
Waiting on
bqjob_r7f293d1a2fdeedc8_00000162bb212efb_1 ... (0s) Current status: DONE
Traceback (most recent call last):
File "PerfKitBenchmarker/pkb.py", line 21, in <module>
sys.exit(Main())
File
"<https://builds.apache.org/job/beam_PerformanceTests_Spark/ws/PerfKitBenchmarker/perfkitbenchmarker/pkb.py";,>
line 951, in Main
return RunBenchmarks()
File
"<https://builds.apache.org/job/beam_PerformanceTests_Spark/ws/PerfKitBenchmarker/perfkitbenchmarker/pkb.py";,>
line 878, in RunBenchmarks
collector.PublishSamples()
File
"<https://builds.apache.org/job/beam_PerformanceTests_Spark/ws/PerfKitBenchmarker/perfkitbenchmarker/publisher.py";,>
line 927, in PublishSamples
publisher.PublishSamples(self.samples)
File
"<https://builds.apache.org/job/beam_PerformanceTests_Spark/ws/PerfKitBenchmarker/perfkitbenchmarker/publisher.py";,>
line 538, in PublishSamples
vm_util.IssueRetryableCommand(load_cmd)
File
"<https://builds.apache.org/job/beam_PerformanceTests_Spark/ws/PerfKitBenchmarker/perfkitbenchmarker/vm_util.py";,>
line 249, in WrappedFunction
return f(*args, **kwargs)
File
"<https://builds.apache.org/job/beam_PerformanceTests_Spark/ws/PerfKitBenchmarker/perfkitbenchmarker/vm_util.py";,>
line 387, in IssueRetryableCommand
'Command returned a non-zero exit code.\n')
perfkitbenchmarker.errors.CalledProcessException: Command returned a non-zero
exit code.
Build step 'Execute shell' marked build as failure
