See
<https://builds.apache.org/job/beam_PerformanceTests_Spark/1557/display/redirect?page=changes>
Changes:
[herohde] [BEAM-3250] Migrate Dataflow ValidatesRunner test to Gradle
[herohde] CR: use 4 forks in Dataflow test
[herohde] [BEAM-3250] Migrate Spark ValidatesRunner tests to Gradle
------------------------------------------
[...truncated 90.54 KB...]
'apache-beam-testing:bqjob_r2b6a7ab9ca9c3430_000001629ae56cee_1': Invalid schema
update. Field timestamp has changed type from TIMESTAMP to FLOAT
STDERR:
/usr/lib/google-cloud-sdk/platform/bq/third_party/oauth2client/contrib/gce.py:73:
UserWarning: You have requested explicit scopes to be used with a GCE service
account.
Using this argument will have no effect on the actual scopes for tokens
requested. These scopes are set at VM instance creation time and
can't be overridden in the request.
warnings.warn(_SCOPES_WARNING)
Upload complete.Waiting on bqjob_r2b6a7ab9ca9c3430_000001629ae56cee_1 ... (0s)
Current status: RUNNING
Waiting on
bqjob_r2b6a7ab9ca9c3430_000001629ae56cee_1 ... (0s) Current status: DONE
2018-04-06 12:19:11,586 0edd048f MainThread INFO Retrying exception running
IssueRetryableCommand: Command returned a non-zero exit code.
2018-04-06 12:19:40,068 0edd048f MainThread INFO Running: bq load
--autodetect --source_format=NEWLINE_DELIMITED_JSON
beam_performance.pkb_results
<https://builds.apache.org/job/beam_PerformanceTests_Spark/ws/runs/0edd048f/perfkit-bq-pub8jRyXw.json>
2018-04-06 12:19:42,239 0edd048f MainThread INFO Ran: {bq load --autodetect
--source_format=NEWLINE_DELIMITED_JSON beam_performance.pkb_results
<https://builds.apache.org/job/beam_PerformanceTests_Spark/ws/runs/0edd048f/perfkit-bq-pub8jRyXw.json}>
ReturnCode:1
STDOUT:
BigQuery error in load operation: Error processing job
'apache-beam-testing:bqjob_r102c23fa88121b40_000001629ae5e530_1': Invalid schema
update. Field timestamp has changed type from TIMESTAMP to FLOAT
STDERR:
/usr/lib/google-cloud-sdk/platform/bq/third_party/oauth2client/contrib/gce.py:73:
UserWarning: You have requested explicit scopes to be used with a GCE service
account.
Using this argument will have no effect on the actual scopes for tokens
requested. These scopes are set at VM instance creation time and
can't be overridden in the request.
warnings.warn(_SCOPES_WARNING)
Upload complete.Waiting on bqjob_r102c23fa88121b40_000001629ae5e530_1 ... (0s)
Current status: RUNNING
Waiting on
bqjob_r102c23fa88121b40_000001629ae5e530_1 ... (0s) Current status: DONE
2018-04-06 12:19:42,240 0edd048f MainThread INFO Retrying exception running
IssueRetryableCommand: Command returned a non-zero exit code.
2018-04-06 12:20:10,684 0edd048f MainThread INFO Running: bq load
--autodetect --source_format=NEWLINE_DELIMITED_JSON
beam_performance.pkb_results
<https://builds.apache.org/job/beam_PerformanceTests_Spark/ws/runs/0edd048f/perfkit-bq-pub8jRyXw.json>
2018-04-06 12:20:12,976 0edd048f MainThread INFO Ran: {bq load --autodetect
--source_format=NEWLINE_DELIMITED_JSON beam_performance.pkb_results
<https://builds.apache.org/job/beam_PerformanceTests_Spark/ws/runs/0edd048f/perfkit-bq-pub8jRyXw.json}>
ReturnCode:1
STDOUT:
BigQuery error in load operation: Error processing job
'apache-beam-testing:bqjob_r77f4db16871466f_000001629ae65cc6_1': Invalid schema
update. Field timestamp has changed type from TIMESTAMP to FLOAT
STDERR:
/usr/lib/google-cloud-sdk/platform/bq/third_party/oauth2client/contrib/gce.py:73:
UserWarning: You have requested explicit scopes to be used with a GCE service
account.
Using this argument will have no effect on the actual scopes for tokens
requested. These scopes are set at VM instance creation time and
can't be overridden in the request.
warnings.warn(_SCOPES_WARNING)
Upload complete.Waiting on bqjob_r77f4db16871466f_000001629ae65cc6_1 ... (0s)
Current status: RUNNING
Waiting on
bqjob_r77f4db16871466f_000001629ae65cc6_1 ... (0s) Current status: DONE
2018-04-06 12:20:12,976 0edd048f MainThread INFO Retrying exception running
IssueRetryableCommand: Command returned a non-zero exit code.
2018-04-06 12:20:38,068 0edd048f MainThread INFO Running: bq load
--autodetect --source_format=NEWLINE_DELIMITED_JSON
beam_performance.pkb_results
<https://builds.apache.org/job/beam_PerformanceTests_Spark/ws/runs/0edd048f/perfkit-bq-pub8jRyXw.json>
2018-04-06 12:20:40,157 0edd048f MainThread INFO Ran: {bq load --autodetect
--source_format=NEWLINE_DELIMITED_JSON beam_performance.pkb_results
<https://builds.apache.org/job/beam_PerformanceTests_Spark/ws/runs/0edd048f/perfkit-bq-pub8jRyXw.json}>
ReturnCode:1
STDOUT:
BigQuery error in load operation: Error processing job
'apache-beam-testing:bqjob_r6ba3b8751af485f6_000001629ae6c77d_1': Invalid schema
update. Field timestamp has changed type from TIMESTAMP to FLOAT
STDERR:
/usr/lib/google-cloud-sdk/platform/bq/third_party/oauth2client/contrib/gce.py:73:
UserWarning: You have requested explicit scopes to be used with a GCE service
account.
Using this argument will have no effect on the actual scopes for tokens
requested. These scopes are set at VM instance creation time and
can't be overridden in the request.
warnings.warn(_SCOPES_WARNING)
Upload complete.Waiting on bqjob_r6ba3b8751af485f6_000001629ae6c77d_1 ... (0s)
Current status: RUNNING
Waiting on
bqjob_r6ba3b8751af485f6_000001629ae6c77d_1 ... (0s) Current status: DONE
2018-04-06 12:20:40,158 0edd048f MainThread INFO Retrying exception running
IssueRetryableCommand: Command returned a non-zero exit code.
2018-04-06 12:21:01,916 0edd048f MainThread INFO Running: bq load
--autodetect --source_format=NEWLINE_DELIMITED_JSON
beam_performance.pkb_results
<https://builds.apache.org/job/beam_PerformanceTests_Spark/ws/runs/0edd048f/perfkit-bq-pub8jRyXw.json>
2018-04-06 12:21:04,354 0edd048f MainThread INFO Ran: {bq load --autodetect
--source_format=NEWLINE_DELIMITED_JSON beam_performance.pkb_results
<https://builds.apache.org/job/beam_PerformanceTests_Spark/ws/runs/0edd048f/perfkit-bq-pub8jRyXw.json}>
ReturnCode:1
STDOUT:
BigQuery error in load operation: Error processing job
'apache-beam-testing:bqjob_r87be6be04dbb286_000001629ae72550_1': Invalid schema
update. Field timestamp has changed type from TIMESTAMP to FLOAT
STDERR:
/usr/lib/google-cloud-sdk/platform/bq/third_party/oauth2client/contrib/gce.py:73:
UserWarning: You have requested explicit scopes to be used with a GCE service
account.
Using this argument will have no effect on the actual scopes for tokens
requested. These scopes are set at VM instance creation time and
can't be overridden in the request.
warnings.warn(_SCOPES_WARNING)
Upload complete.Waiting on bqjob_r87be6be04dbb286_000001629ae72550_1 ... (0s)
Current status: RUNNING
Waiting on
bqjob_r87be6be04dbb286_000001629ae72550_1 ... (0s) Current status: DONE
2018-04-06 12:21:04,355 0edd048f MainThread INFO Retrying exception running
IssueRetryableCommand: Command returned a non-zero exit code.
2018-04-06 12:21:26,614 0edd048f MainThread INFO Running: bq load
--autodetect --source_format=NEWLINE_DELIMITED_JSON
beam_performance.pkb_results
<https://builds.apache.org/job/beam_PerformanceTests_Spark/ws/runs/0edd048f/perfkit-bq-pub8jRyXw.json>
2018-04-06 12:21:28,838 0edd048f MainThread INFO Ran: {bq load --autodetect
--source_format=NEWLINE_DELIMITED_JSON beam_performance.pkb_results
<https://builds.apache.org/job/beam_PerformanceTests_Spark/ws/runs/0edd048f/perfkit-bq-pub8jRyXw.json}>
ReturnCode:1
STDOUT:
BigQuery error in load operation: Error processing job
'apache-beam-testing:bqjob_r7303e119db82c75d_000001629ae7850d_1': Invalid schema
update. Field timestamp has changed type from TIMESTAMP to FLOAT
STDERR:
/usr/lib/google-cloud-sdk/platform/bq/third_party/oauth2client/contrib/gce.py:73:
UserWarning: You have requested explicit scopes to be used with a GCE service
account.
Using this argument will have no effect on the actual scopes for tokens
requested. These scopes are set at VM instance creation time and
can't be overridden in the request.
warnings.warn(_SCOPES_WARNING)
Upload complete.Waiting on bqjob_r7303e119db82c75d_000001629ae7850d_1 ... (0s)
Current status: RUNNING
Waiting on
bqjob_r7303e119db82c75d_000001629ae7850d_1 ... (0s) Current status: DONE
2018-04-06 12:21:28,841 0edd048f MainThread INFO Retrying exception running
IssueRetryableCommand: Command returned a non-zero exit code.
2018-04-06 12:21:54,627 0edd048f MainThread INFO Running: bq load
--autodetect --source_format=NEWLINE_DELIMITED_JSON
beam_performance.pkb_results
<https://builds.apache.org/job/beam_PerformanceTests_Spark/ws/runs/0edd048f/perfkit-bq-pub8jRyXw.json>
2018-04-06 12:21:56,717 0edd048f MainThread INFO Ran: {bq load --autodetect
--source_format=NEWLINE_DELIMITED_JSON beam_performance.pkb_results
<https://builds.apache.org/job/beam_PerformanceTests_Spark/ws/runs/0edd048f/perfkit-bq-pub8jRyXw.json}>
ReturnCode:1
STDOUT:
BigQuery error in load operation: Error processing job
'apache-beam-testing:bqjob_r4f8fc8d0d3969fb6_000001629ae7f27f_1': Invalid schema
update. Field timestamp has changed type from TIMESTAMP to FLOAT
STDERR:
/usr/lib/google-cloud-sdk/platform/bq/third_party/oauth2client/contrib/gce.py:73:
UserWarning: You have requested explicit scopes to be used with a GCE service
account.
Using this argument will have no effect on the actual scopes for tokens
requested. These scopes are set at VM instance creation time and
can't be overridden in the request.
warnings.warn(_SCOPES_WARNING)
Upload complete.Waiting on bqjob_r4f8fc8d0d3969fb6_000001629ae7f27f_1 ... (0s)
Current status: RUNNING
Waiting on
bqjob_r4f8fc8d0d3969fb6_000001629ae7f27f_1 ... (0s) Current status: DONE
2018-04-06 12:21:56,717 0edd048f MainThread INFO Retrying exception running
IssueRetryableCommand: Command returned a non-zero exit code.
2018-04-06 12:22:22,189 0edd048f MainThread INFO Running: bq load
--autodetect --source_format=NEWLINE_DELIMITED_JSON
beam_performance.pkb_results
<https://builds.apache.org/job/beam_PerformanceTests_Spark/ws/runs/0edd048f/perfkit-bq-pub8jRyXw.json>
2018-04-06 12:22:25,328 0edd048f MainThread INFO Ran: {bq load --autodetect
--source_format=NEWLINE_DELIMITED_JSON beam_performance.pkb_results
<https://builds.apache.org/job/beam_PerformanceTests_Spark/ws/runs/0edd048f/perfkit-bq-pub8jRyXw.json}>
ReturnCode:1
STDOUT:
BigQuery error in load operation: Error processing job
'apache-beam-testing:bqjob_r2f8260c8bfced761_000001629ae86230_1': Invalid schema
update. Field timestamp has changed type from TIMESTAMP to FLOAT
STDERR:
/usr/lib/google-cloud-sdk/platform/bq/third_party/oauth2client/contrib/gce.py:73:
UserWarning: You have requested explicit scopes to be used with a GCE service
account.
Using this argument will have no effect on the actual scopes for tokens
requested. These scopes are set at VM instance creation time and
can't be overridden in the request.
warnings.warn(_SCOPES_WARNING)
Upload complete.Waiting on bqjob_r2f8260c8bfced761_000001629ae86230_1 ... (0s)
Current status: RUNNING
Waiting on
bqjob_r2f8260c8bfced761_000001629ae86230_1 ... (0s) Current status: DONE
2018-04-06 12:22:25,328 0edd048f MainThread INFO Retrying exception running
IssueRetryableCommand: Command returned a non-zero exit code.
2018-04-06 12:22:44,803 0edd048f MainThread INFO Running: bq load
--autodetect --source_format=NEWLINE_DELIMITED_JSON
beam_performance.pkb_results
<https://builds.apache.org/job/beam_PerformanceTests_Spark/ws/runs/0edd048f/perfkit-bq-pub8jRyXw.json>
2018-04-06 12:22:47,118 0edd048f MainThread INFO Ran: {bq load --autodetect
--source_format=NEWLINE_DELIMITED_JSON beam_performance.pkb_results
<https://builds.apache.org/job/beam_PerformanceTests_Spark/ws/runs/0edd048f/perfkit-bq-pub8jRyXw.json}>
ReturnCode:1
STDOUT:
BigQuery error in load operation: Error processing job
'apache-beam-testing:bqjob_r5ce80fdcf410e872_000001629ae8b678_1': Invalid schema
update. Field timestamp has changed type from TIMESTAMP to FLOAT
STDERR:
/usr/lib/google-cloud-sdk/platform/bq/third_party/oauth2client/contrib/gce.py:73:
UserWarning: You have requested explicit scopes to be used with a GCE service
account.
Using this argument will have no effect on the actual scopes for tokens
requested. These scopes are set at VM instance creation time and
can't be overridden in the request.
warnings.warn(_SCOPES_WARNING)
Upload complete.Waiting on bqjob_r5ce80fdcf410e872_000001629ae8b678_1 ... (0s)
Current status: RUNNING
Waiting on
bqjob_r5ce80fdcf410e872_000001629ae8b678_1 ... (0s) Current status: DONE
2018-04-06 12:22:47,119 0edd048f MainThread INFO Retrying exception running
IssueRetryableCommand: Command returned a non-zero exit code.
2018-04-06 12:23:09,068 0edd048f MainThread INFO Running: bq load
--autodetect --source_format=NEWLINE_DELIMITED_JSON
beam_performance.pkb_results
<https://builds.apache.org/job/beam_PerformanceTests_Spark/ws/runs/0edd048f/perfkit-bq-pub8jRyXw.json>
2018-04-06 12:23:11,110 0edd048f MainThread INFO Ran: {bq load --autodetect
--source_format=NEWLINE_DELIMITED_JSON beam_performance.pkb_results
<https://builds.apache.org/job/beam_PerformanceTests_Spark/ws/runs/0edd048f/perfkit-bq-pub8jRyXw.json}>
ReturnCode:1
STDOUT:
BigQuery error in load operation: Error processing job
'apache-beam-testing:bqjob_r3c35e056bfb50207_000001629ae9154f_1': Invalid schema
update. Field timestamp has changed type from TIMESTAMP to FLOAT
STDERR:
/usr/lib/google-cloud-sdk/platform/bq/third_party/oauth2client/contrib/gce.py:73:
UserWarning: You have requested explicit scopes to be used with a GCE service
account.
Using this argument will have no effect on the actual scopes for tokens
requested. These scopes are set at VM instance creation time and
can't be overridden in the request.
warnings.warn(_SCOPES_WARNING)
Upload complete.Waiting on bqjob_r3c35e056bfb50207_000001629ae9154f_1 ... (0s)
Current status: RUNNING
Waiting on
bqjob_r3c35e056bfb50207_000001629ae9154f_1 ... (0s) Current status: DONE
2018-04-06 12:23:11,111 0edd048f MainThread INFO Retrying exception running
IssueRetryableCommand: Command returned a non-zero exit code.
2018-04-06 12:23:33,736 0edd048f MainThread INFO Running: bq load
--autodetect --source_format=NEWLINE_DELIMITED_JSON
beam_performance.pkb_results
<https://builds.apache.org/job/beam_PerformanceTests_Spark/ws/runs/0edd048f/perfkit-bq-pub8jRyXw.json>
2018-04-06 12:23:36,128 0edd048f MainThread INFO Ran: {bq load --autodetect
--source_format=NEWLINE_DELIMITED_JSON beam_performance.pkb_results
<https://builds.apache.org/job/beam_PerformanceTests_Spark/ws/runs/0edd048f/perfkit-bq-pub8jRyXw.json}>
ReturnCode:1
STDOUT:
BigQuery error in load operation: Error processing job
'apache-beam-testing:bqjob_r6ef30a0a4b382d7f_000001629ae9763d_1': Invalid schema
update. Field timestamp has changed type from TIMESTAMP to FLOAT
STDERR:
/usr/lib/google-cloud-sdk/platform/bq/third_party/oauth2client/contrib/gce.py:73:
UserWarning: You have requested explicit scopes to be used with a GCE service
account.
Using this argument will have no effect on the actual scopes for tokens
requested. These scopes are set at VM instance creation time and
can't be overridden in the request.
warnings.warn(_SCOPES_WARNING)
Upload complete.Waiting on bqjob_r6ef30a0a4b382d7f_000001629ae9763d_1 ... (0s)
Current status: RUNNING
Waiting on
bqjob_r6ef30a0a4b382d7f_000001629ae9763d_1 ... (0s) Current status: DONE
2018-04-06 12:23:36,129 0edd048f MainThread INFO Retrying exception running
IssueRetryableCommand: Command returned a non-zero exit code.
2018-04-06 12:24:03,411 0edd048f MainThread INFO Running: bq load
--autodetect --source_format=NEWLINE_DELIMITED_JSON
beam_performance.pkb_results
<https://builds.apache.org/job/beam_PerformanceTests_Spark/ws/runs/0edd048f/perfkit-bq-pub8jRyXw.json>
2018-04-06 12:24:05,720 0edd048f MainThread INFO Ran: {bq load --autodetect
--source_format=NEWLINE_DELIMITED_JSON beam_performance.pkb_results
<https://builds.apache.org/job/beam_PerformanceTests_Spark/ws/runs/0edd048f/perfkit-bq-pub8jRyXw.json}>
ReturnCode:1
STDOUT:
BigQuery error in load operation: Error processing job
'apache-beam-testing:bqjob_r3cd9a103579597e_000001629ae9e9c1_1': Invalid schema
update. Field timestamp has changed type from TIMESTAMP to FLOAT
STDERR:
/usr/lib/google-cloud-sdk/platform/bq/third_party/oauth2client/contrib/gce.py:73:
UserWarning: You have requested explicit scopes to be used with a GCE service
account.
Using this argument will have no effect on the actual scopes for tokens
requested. These scopes are set at VM instance creation time and
can't be overridden in the request.
warnings.warn(_SCOPES_WARNING)
Upload complete.Waiting on bqjob_r3cd9a103579597e_000001629ae9e9c1_1 ... (0s)
Current status: RUNNING
Waiting on
bqjob_r3cd9a103579597e_000001629ae9e9c1_1 ... (0s) Current status: DONE
2018-04-06 12:24:05,721 0edd048f MainThread INFO Retrying exception running
IssueRetryableCommand: Command returned a non-zero exit code.
2018-04-06 12:24:32,528 0edd048f MainThread INFO Running: bq load
--autodetect --source_format=NEWLINE_DELIMITED_JSON
beam_performance.pkb_results
<https://builds.apache.org/job/beam_PerformanceTests_Spark/ws/runs/0edd048f/perfkit-bq-pub8jRyXw.json>
2018-04-06 12:24:34,742 0edd048f MainThread INFO Ran: {bq load --autodetect
--source_format=NEWLINE_DELIMITED_JSON beam_performance.pkb_results
<https://builds.apache.org/job/beam_PerformanceTests_Spark/ws/runs/0edd048f/perfkit-bq-pub8jRyXw.json}>
ReturnCode:1
STDOUT:
BigQuery error in load operation: Error processing job
'apache-beam-testing:bqjob_r43b697d22b1fb9c6_000001629aea5b50_1': Invalid schema
update. Field timestamp has changed type from TIMESTAMP to FLOAT
STDERR:
/usr/lib/google-cloud-sdk/platform/bq/third_party/oauth2client/contrib/gce.py:73:
UserWarning: You have requested explicit scopes to be used with a GCE service
account.
Using this argument will have no effect on the actual scopes for tokens
requested. These scopes are set at VM instance creation time and
can't be overridden in the request.
warnings.warn(_SCOPES_WARNING)
Upload complete.Waiting on bqjob_r43b697d22b1fb9c6_000001629aea5b50_1 ... (0s)
Current status: RUNNING
Waiting on
bqjob_r43b697d22b1fb9c6_000001629aea5b50_1 ... (0s) Current status: DONE
2018-04-06 12:24:34,742 0edd048f MainThread INFO Retrying exception running
IssueRetryableCommand: Command returned a non-zero exit code.
2018-04-06 12:25:00,888 0edd048f MainThread INFO Running: bq load
--autodetect --source_format=NEWLINE_DELIMITED_JSON
beam_performance.pkb_results
<https://builds.apache.org/job/beam_PerformanceTests_Spark/ws/runs/0edd048f/perfkit-bq-pub8jRyXw.json>
2018-04-06 12:25:03,196 0edd048f MainThread INFO Ran: {bq load --autodetect
--source_format=NEWLINE_DELIMITED_JSON beam_performance.pkb_results
<https://builds.apache.org/job/beam_PerformanceTests_Spark/ws/runs/0edd048f/perfkit-bq-pub8jRyXw.json}>
ReturnCode:1
STDOUT:
BigQuery error in load operation: Error processing job
'apache-beam-testing:bqjob_r54cfb3911ecc261_000001629aeaca9d_1': Invalid schema
update. Field timestamp has changed type from TIMESTAMP to FLOAT
STDERR:
/usr/lib/google-cloud-sdk/platform/bq/third_party/oauth2client/contrib/gce.py:73:
UserWarning: You have requested explicit scopes to be used with a GCE service
account.
Using this argument will have no effect on the actual scopes for tokens
requested. These scopes are set at VM instance creation time and
can't be overridden in the request.
warnings.warn(_SCOPES_WARNING)
Upload complete.Waiting on bqjob_r54cfb3911ecc261_000001629aeaca9d_1 ... (0s)
Current status: RUNNING
Waiting on
bqjob_r54cfb3911ecc261_000001629aeaca9d_1 ... (0s) Current status: DONE
Traceback (most recent call last):
File "PerfKitBenchmarker/pkb.py", line 21, in <module>
sys.exit(Main())
File
"<https://builds.apache.org/job/beam_PerformanceTests_Spark/ws/PerfKitBenchmarker/perfkitbenchmarker/pkb.py";,>
line 952, in Main
return RunBenchmarks()
File
"<https://builds.apache.org/job/beam_PerformanceTests_Spark/ws/PerfKitBenchmarker/perfkitbenchmarker/pkb.py";,>
line 879, in RunBenchmarks
collector.PublishSamples()
File
"<https://builds.apache.org/job/beam_PerformanceTests_Spark/ws/PerfKitBenchmarker/perfkitbenchmarker/publisher.py";,>
line 927, in PublishSamples
publisher.PublishSamples(self.samples)
File
"<https://builds.apache.org/job/beam_PerformanceTests_Spark/ws/PerfKitBenchmarker/perfkitbenchmarker/publisher.py";,>
line 538, in PublishSamples
vm_util.IssueRetryableCommand(load_cmd)
File
"<https://builds.apache.org/job/beam_PerformanceTests_Spark/ws/PerfKitBenchmarker/perfkitbenchmarker/vm_util.py";,>
line 249, in WrappedFunction
return f(*args, **kwargs)
File
"<https://builds.apache.org/job/beam_PerformanceTests_Spark/ws/PerfKitBenchmarker/perfkitbenchmarker/vm_util.py";,>
line 387, in IssueRetryableCommand
'Command returned a non-zero exit code.\n')
perfkitbenchmarker.errors.CalledProcessException: Command returned a non-zero
exit code.
Build step 'Execute shell' marked build as failure
