See <https://builds.apache.org/job/beam_PerformanceTests_Spark/1549/display/redirect?page=changes>
Changes: [iemejia] [BEAM-3875] Update Spark runner to use Spark version 2.3.0 ------------------------------------------ [...truncated 86.54 KB...] 'apache-beam-testing:bqjob_r282687f643630146_000001629098a873_1': Invalid schema update. Field timestamp has changed type from TIMESTAMP to FLOAT STDERR: /usr/lib/google-cloud-sdk/platform/bq/third_party/oauth2client/contrib/gce.py:73: UserWarning: You have requested explicit scopes to be used with a GCE service account. Using this argument will have no effect on the actual scopes for tokens requested. These scopes are set at VM instance creation time and can't be overridden in the request. warnings.warn(_SCOPES_WARNING) Upload complete.Waiting on bqjob_r282687f643630146_000001629098a873_1 ... (0s) Current status: RUNNING Waiting on bqjob_r282687f643630146_000001629098a873_1 ... (0s) Current status: DONE 2018-04-04 12:19:08,634 41357cae MainThread INFO Retrying exception running IssueRetryableCommand: Command returned a non-zero exit code. 2018-04-04 12:19:32,733 41357cae MainThread INFO Running: bq load --autodetect --source_format=NEWLINE_DELIMITED_JSON beam_performance.pkb_results <https://builds.apache.org/job/beam_PerformanceTests_Spark/ws/runs/41357cae/perfkit-bq-pubj4r7X0.json> 2018-04-04 12:19:36,112 41357cae MainThread INFO Ran: {bq load --autodetect --source_format=NEWLINE_DELIMITED_JSON beam_performance.pkb_results <https://builds.apache.org/job/beam_PerformanceTests_Spark/ws/runs/41357cae/perfkit-bq-pubj4r7X0.json}> ReturnCode:1 STDOUT: BigQuery error in load operation: Error processing job 'apache-beam-testing:bqjob_rcdde4025798bb7_00000162909910c7_1': Invalid schema update. Field timestamp has changed type from TIMESTAMP to FLOAT STDERR: /usr/lib/google-cloud-sdk/platform/bq/third_party/oauth2client/contrib/gce.py:73: UserWarning: You have requested explicit scopes to be used with a GCE service account. Using this argument will have no effect on the actual scopes for tokens requested. These scopes are set at VM instance creation time and can't be overridden in the request. warnings.warn(_SCOPES_WARNING) Upload complete.Waiting on bqjob_rcdde4025798bb7_00000162909910c7_1 ... (0s) Current status: RUNNING Waiting on bqjob_rcdde4025798bb7_00000162909910c7_1 ... (1s) Current status: RUNNING Waiting on bqjob_rcdde4025798bb7_00000162909910c7_1 ... (1s) Current status: DONE 2018-04-04 12:19:36,113 41357cae MainThread INFO Retrying exception running IssueRetryableCommand: Command returned a non-zero exit code. 2018-04-04 12:19:59,965 41357cae MainThread INFO Running: bq load --autodetect --source_format=NEWLINE_DELIMITED_JSON beam_performance.pkb_results <https://builds.apache.org/job/beam_PerformanceTests_Spark/ws/runs/41357cae/perfkit-bq-pubj4r7X0.json> 2018-04-04 12:20:02,310 41357cae MainThread INFO Ran: {bq load --autodetect --source_format=NEWLINE_DELIMITED_JSON beam_performance.pkb_results <https://builds.apache.org/job/beam_PerformanceTests_Spark/ws/runs/41357cae/perfkit-bq-pubj4r7X0.json}> ReturnCode:1 STDOUT: BigQuery error in load operation: Error processing job 'apache-beam-testing:bqjob_r55e52f7f80ae0417_0000016290997aef_1': Invalid schema update. Field timestamp has changed type from TIMESTAMP to FLOAT STDERR: /usr/lib/google-cloud-sdk/platform/bq/third_party/oauth2client/contrib/gce.py:73: UserWarning: You have requested explicit scopes to be used with a GCE service account. Using this argument will have no effect on the actual scopes for tokens requested. These scopes are set at VM instance creation time and can't be overridden in the request. warnings.warn(_SCOPES_WARNING) Upload complete.Waiting on bqjob_r55e52f7f80ae0417_0000016290997aef_1 ... (0s) Current status: RUNNING Waiting on bqjob_r55e52f7f80ae0417_0000016290997aef_1 ... (0s) Current status: DONE 2018-04-04 12:20:02,310 41357cae MainThread INFO Retrying exception running IssueRetryableCommand: Command returned a non-zero exit code. 2018-04-04 12:20:17,913 41357cae MainThread INFO Running: bq load --autodetect --source_format=NEWLINE_DELIMITED_JSON beam_performance.pkb_results <https://builds.apache.org/job/beam_PerformanceTests_Spark/ws/runs/41357cae/perfkit-bq-pubj4r7X0.json> 2018-04-04 12:20:20,494 41357cae MainThread INFO Ran: {bq load --autodetect --source_format=NEWLINE_DELIMITED_JSON beam_performance.pkb_results <https://builds.apache.org/job/beam_PerformanceTests_Spark/ws/runs/41357cae/perfkit-bq-pubj4r7X0.json}> ReturnCode:1 STDOUT: BigQuery error in load operation: Error processing job 'apache-beam-testing:bqjob_r4c6edc8314af2772_000001629099c10a_1': Invalid schema update. Field timestamp has changed type from TIMESTAMP to FLOAT STDERR: /usr/lib/google-cloud-sdk/platform/bq/third_party/oauth2client/contrib/gce.py:73: UserWarning: You have requested explicit scopes to be used with a GCE service account. Using this argument will have no effect on the actual scopes for tokens requested. These scopes are set at VM instance creation time and can't be overridden in the request. warnings.warn(_SCOPES_WARNING) Upload complete.Waiting on bqjob_r4c6edc8314af2772_000001629099c10a_1 ... (0s) Current status: RUNNING Waiting on bqjob_r4c6edc8314af2772_000001629099c10a_1 ... (0s) Current status: DONE 2018-04-04 12:20:20,495 41357cae MainThread INFO Retrying exception running IssueRetryableCommand: Command returned a non-zero exit code. 2018-04-04 12:20:49,376 41357cae MainThread INFO Running: bq load --autodetect --source_format=NEWLINE_DELIMITED_JSON beam_performance.pkb_results <https://builds.apache.org/job/beam_PerformanceTests_Spark/ws/runs/41357cae/perfkit-bq-pubj4r7X0.json> 2018-04-04 12:20:52,801 41357cae MainThread INFO Ran: {bq load --autodetect --source_format=NEWLINE_DELIMITED_JSON beam_performance.pkb_results <https://builds.apache.org/job/beam_PerformanceTests_Spark/ws/runs/41357cae/perfkit-bq-pubj4r7X0.json}> ReturnCode:1 STDOUT: BigQuery error in load operation: Error processing job 'apache-beam-testing:bqjob_r1b592066449f0f77_00000162909a3fca_1': Invalid schema update. Field timestamp has changed type from TIMESTAMP to FLOAT STDERR: /usr/lib/google-cloud-sdk/platform/bq/third_party/oauth2client/contrib/gce.py:73: UserWarning: You have requested explicit scopes to be used with a GCE service account. Using this argument will have no effect on the actual scopes for tokens requested. These scopes are set at VM instance creation time and can't be overridden in the request. warnings.warn(_SCOPES_WARNING) Upload complete.Waiting on bqjob_r1b592066449f0f77_00000162909a3fca_1 ... (0s) Current status: RUNNING Waiting on bqjob_r1b592066449f0f77_00000162909a3fca_1 ... (0s) Current status: DONE 2018-04-04 12:20:52,801 41357cae MainThread INFO Retrying exception running IssueRetryableCommand: Command returned a non-zero exit code. 2018-04-04 12:21:19,034 41357cae MainThread INFO Running: bq load --autodetect --source_format=NEWLINE_DELIMITED_JSON beam_performance.pkb_results <https://builds.apache.org/job/beam_PerformanceTests_Spark/ws/runs/41357cae/perfkit-bq-pubj4r7X0.json> 2018-04-04 12:21:21,485 41357cae MainThread INFO Ran: {bq load --autodetect --source_format=NEWLINE_DELIMITED_JSON beam_performance.pkb_results <https://builds.apache.org/job/beam_PerformanceTests_Spark/ws/runs/41357cae/perfkit-bq-pubj4r7X0.json}> ReturnCode:1 STDOUT: BigQuery error in load operation: Error processing job 'apache-beam-testing:bqjob_r28695f6120373943_00000162909aaff5_1': Invalid schema update. Field timestamp has changed type from TIMESTAMP to FLOAT STDERR: /usr/lib/google-cloud-sdk/platform/bq/third_party/oauth2client/contrib/gce.py:73: UserWarning: You have requested explicit scopes to be used with a GCE service account. Using this argument will have no effect on the actual scopes for tokens requested. These scopes are set at VM instance creation time and can't be overridden in the request. warnings.warn(_SCOPES_WARNING) Upload complete.Waiting on bqjob_r28695f6120373943_00000162909aaff5_1 ... (0s) Current status: RUNNING Waiting on bqjob_r28695f6120373943_00000162909aaff5_1 ... (0s) Current status: DONE 2018-04-04 12:21:21,486 41357cae MainThread INFO Retrying exception running IssueRetryableCommand: Command returned a non-zero exit code. 2018-04-04 12:21:47,847 41357cae MainThread INFO Running: bq load --autodetect --source_format=NEWLINE_DELIMITED_JSON beam_performance.pkb_results <https://builds.apache.org/job/beam_PerformanceTests_Spark/ws/runs/41357cae/perfkit-bq-pubj4r7X0.json> 2018-04-04 12:21:52,764 41357cae MainThread INFO Ran: {bq load --autodetect --source_format=NEWLINE_DELIMITED_JSON beam_performance.pkb_results <https://builds.apache.org/job/beam_PerformanceTests_Spark/ws/runs/41357cae/perfkit-bq-pubj4r7X0.json}> ReturnCode:1 STDOUT: BigQuery error in load operation: Error processing job 'apache-beam-testing:bqjob_r4ded490da6295750_00000162909b20c3_1': Invalid schema update. Field timestamp has changed type from TIMESTAMP to FLOAT STDERR: /usr/lib/google-cloud-sdk/platform/bq/third_party/oauth2client/contrib/gce.py:73: UserWarning: You have requested explicit scopes to be used with a GCE service account. Using this argument will have no effect on the actual scopes for tokens requested. These scopes are set at VM instance creation time and can't be overridden in the request. warnings.warn(_SCOPES_WARNING) Upload complete.Waiting on bqjob_r4ded490da6295750_00000162909b20c3_1 ... (0s) Current status: RUNNING Waiting on bqjob_r4ded490da6295750_00000162909b20c3_1 ... (1s) Current status: RUNNING Waiting on bqjob_r4ded490da6295750_00000162909b20c3_1 ... (2s) Current status: RUNNING Waiting on bqjob_r4ded490da6295750_00000162909b20c3_1 ... (2s) Current status: DONE 2018-04-04 12:21:52,764 41357cae MainThread INFO Retrying exception running IssueRetryableCommand: Command returned a non-zero exit code. 2018-04-04 12:22:08,665 41357cae MainThread INFO Running: bq load --autodetect --source_format=NEWLINE_DELIMITED_JSON beam_performance.pkb_results <https://builds.apache.org/job/beam_PerformanceTests_Spark/ws/runs/41357cae/perfkit-bq-pubj4r7X0.json> 2018-04-04 12:22:12,344 41357cae MainThread INFO Ran: {bq load --autodetect --source_format=NEWLINE_DELIMITED_JSON beam_performance.pkb_results <https://builds.apache.org/job/beam_PerformanceTests_Spark/ws/runs/41357cae/perfkit-bq-pubj4r7X0.json}> ReturnCode:1 STDOUT: BigQuery error in load operation: Error processing job 'apache-beam-testing:bqjob_r5aeade55fd2c606_00000162909b75c0_1': Invalid schema update. Field timestamp has changed type from TIMESTAMP to FLOAT STDERR: /usr/lib/google-cloud-sdk/platform/bq/third_party/oauth2client/contrib/gce.py:73: UserWarning: You have requested explicit scopes to be used with a GCE service account. Using this argument will have no effect on the actual scopes for tokens requested. These scopes are set at VM instance creation time and can't be overridden in the request. warnings.warn(_SCOPES_WARNING) Upload complete.Waiting on bqjob_r5aeade55fd2c606_00000162909b75c0_1 ... (0s) Current status: RUNNING Waiting on bqjob_r5aeade55fd2c606_00000162909b75c0_1 ... (0s) Current status: DONE 2018-04-04 12:22:12,344 41357cae MainThread INFO Retrying exception running IssueRetryableCommand: Command returned a non-zero exit code. 2018-04-04 12:22:38,568 41357cae MainThread INFO Running: bq load --autodetect --source_format=NEWLINE_DELIMITED_JSON beam_performance.pkb_results <https://builds.apache.org/job/beam_PerformanceTests_Spark/ws/runs/41357cae/perfkit-bq-pubj4r7X0.json> 2018-04-04 12:22:41,128 41357cae MainThread INFO Ran: {bq load --autodetect --source_format=NEWLINE_DELIMITED_JSON beam_performance.pkb_results <https://builds.apache.org/job/beam_PerformanceTests_Spark/ws/runs/41357cae/perfkit-bq-pubj4r7X0.json}> ReturnCode:1 STDOUT: BigQuery error in load operation: Error processing job 'apache-beam-testing:bqjob_r6935f2dadb0f7444_00000162909be68f_1': Invalid schema update. Field timestamp has changed type from TIMESTAMP to FLOAT STDERR: /usr/lib/google-cloud-sdk/platform/bq/third_party/oauth2client/contrib/gce.py:73: UserWarning: You have requested explicit scopes to be used with a GCE service account. Using this argument will have no effect on the actual scopes for tokens requested. These scopes are set at VM instance creation time and can't be overridden in the request. warnings.warn(_SCOPES_WARNING) Upload complete.Waiting on bqjob_r6935f2dadb0f7444_00000162909be68f_1 ... (0s) Current status: RUNNING Waiting on bqjob_r6935f2dadb0f7444_00000162909be68f_1 ... (0s) Current status: DONE 2018-04-04 12:22:41,128 41357cae MainThread INFO Retrying exception running IssueRetryableCommand: Command returned a non-zero exit code. 2018-04-04 12:23:05,841 41357cae MainThread INFO Running: bq load --autodetect --source_format=NEWLINE_DELIMITED_JSON beam_performance.pkb_results <https://builds.apache.org/job/beam_PerformanceTests_Spark/ws/runs/41357cae/perfkit-bq-pubj4r7X0.json> 2018-04-04 12:23:08,392 41357cae MainThread INFO Ran: {bq load --autodetect --source_format=NEWLINE_DELIMITED_JSON beam_performance.pkb_results <https://builds.apache.org/job/beam_PerformanceTests_Spark/ws/runs/41357cae/perfkit-bq-pubj4r7X0.json}> ReturnCode:1 STDOUT: BigQuery error in load operation: Error processing job 'apache-beam-testing:bqjob_r6530bd8ec4b3e054_00000162909c5111_1': Invalid schema update. Field timestamp has changed type from TIMESTAMP to FLOAT STDERR: /usr/lib/google-cloud-sdk/platform/bq/third_party/oauth2client/contrib/gce.py:73: UserWarning: You have requested explicit scopes to be used with a GCE service account. Using this argument will have no effect on the actual scopes for tokens requested. These scopes are set at VM instance creation time and can't be overridden in the request. warnings.warn(_SCOPES_WARNING) Upload complete.Waiting on bqjob_r6530bd8ec4b3e054_00000162909c5111_1 ... (0s) Current status: RUNNING Waiting on bqjob_r6530bd8ec4b3e054_00000162909c5111_1 ... (0s) Current status: DONE 2018-04-04 12:23:08,393 41357cae MainThread INFO Retrying exception running IssueRetryableCommand: Command returned a non-zero exit code. 2018-04-04 12:23:32,162 41357cae MainThread INFO Running: bq load --autodetect --source_format=NEWLINE_DELIMITED_JSON beam_performance.pkb_results <https://builds.apache.org/job/beam_PerformanceTests_Spark/ws/runs/41357cae/perfkit-bq-pubj4r7X0.json> 2018-04-04 12:23:34,697 41357cae MainThread INFO Ran: {bq load --autodetect --source_format=NEWLINE_DELIMITED_JSON beam_performance.pkb_results <https://builds.apache.org/job/beam_PerformanceTests_Spark/ws/runs/41357cae/perfkit-bq-pubj4r7X0.json}> ReturnCode:1 STDOUT: BigQuery error in load operation: Error processing job 'apache-beam-testing:bqjob_r474966c5dc4254cb_00000162909cb7c9_1': Invalid schema update. Field timestamp has changed type from TIMESTAMP to FLOAT STDERR: /usr/lib/google-cloud-sdk/platform/bq/third_party/oauth2client/contrib/gce.py:73: UserWarning: You have requested explicit scopes to be used with a GCE service account. Using this argument will have no effect on the actual scopes for tokens requested. These scopes are set at VM instance creation time and can't be overridden in the request. warnings.warn(_SCOPES_WARNING) Upload complete.Waiting on bqjob_r474966c5dc4254cb_00000162909cb7c9_1 ... (0s) Current status: RUNNING Waiting on bqjob_r474966c5dc4254cb_00000162909cb7c9_1 ... (0s) Current status: DONE 2018-04-04 12:23:34,697 41357cae MainThread INFO Retrying exception running IssueRetryableCommand: Command returned a non-zero exit code. 2018-04-04 12:24:02,081 41357cae MainThread INFO Running: bq load --autodetect --source_format=NEWLINE_DELIMITED_JSON beam_performance.pkb_results <https://builds.apache.org/job/beam_PerformanceTests_Spark/ws/runs/41357cae/perfkit-bq-pubj4r7X0.json> 2018-04-04 12:24:05,143 41357cae MainThread INFO Ran: {bq load --autodetect --source_format=NEWLINE_DELIMITED_JSON beam_performance.pkb_results <https://builds.apache.org/job/beam_PerformanceTests_Spark/ws/runs/41357cae/perfkit-bq-pubj4r7X0.json}> ReturnCode:1 STDOUT: BigQuery error in load operation: Error processing job 'apache-beam-testing:bqjob_r35a4770cbf4c7dd7_00000162909d2d00_1': Invalid schema update. Field timestamp has changed type from TIMESTAMP to FLOAT STDERR: /usr/lib/google-cloud-sdk/platform/bq/third_party/oauth2client/contrib/gce.py:73: UserWarning: You have requested explicit scopes to be used with a GCE service account. Using this argument will have no effect on the actual scopes for tokens requested. These scopes are set at VM instance creation time and can't be overridden in the request. warnings.warn(_SCOPES_WARNING) Upload complete.Waiting on bqjob_r35a4770cbf4c7dd7_00000162909d2d00_1 ... (0s) Current status: RUNNING Waiting on bqjob_r35a4770cbf4c7dd7_00000162909d2d00_1 ... (0s) Current status: DONE 2018-04-04 12:24:05,143 41357cae MainThread INFO Retrying exception running IssueRetryableCommand: Command returned a non-zero exit code. 2018-04-04 12:24:27,934 41357cae MainThread INFO Running: bq load --autodetect --source_format=NEWLINE_DELIMITED_JSON beam_performance.pkb_results <https://builds.apache.org/job/beam_PerformanceTests_Spark/ws/runs/41357cae/perfkit-bq-pubj4r7X0.json> 2018-04-04 12:24:30,474 41357cae MainThread INFO Ran: {bq load --autodetect --source_format=NEWLINE_DELIMITED_JSON beam_performance.pkb_results <https://builds.apache.org/job/beam_PerformanceTests_Spark/ws/runs/41357cae/perfkit-bq-pubj4r7X0.json}> ReturnCode:1 STDOUT: BigQuery error in load operation: Error processing job 'apache-beam-testing:bqjob_r681dba7072e360a6_00000162909d91cb_1': Invalid schema update. Field timestamp has changed type from TIMESTAMP to FLOAT STDERR: /usr/lib/google-cloud-sdk/platform/bq/third_party/oauth2client/contrib/gce.py:73: UserWarning: You have requested explicit scopes to be used with a GCE service account. Using this argument will have no effect on the actual scopes for tokens requested. These scopes are set at VM instance creation time and can't be overridden in the request. warnings.warn(_SCOPES_WARNING) Upload complete.Waiting on bqjob_r681dba7072e360a6_00000162909d91cb_1 ... (0s) Current status: RUNNING Waiting on bqjob_r681dba7072e360a6_00000162909d91cb_1 ... (0s) Current status: DONE 2018-04-04 12:24:30,474 41357cae MainThread INFO Retrying exception running IssueRetryableCommand: Command returned a non-zero exit code. 2018-04-04 12:24:58,617 41357cae MainThread INFO Running: bq load --autodetect --source_format=NEWLINE_DELIMITED_JSON beam_performance.pkb_results <https://builds.apache.org/job/beam_PerformanceTests_Spark/ws/runs/41357cae/perfkit-bq-pubj4r7X0.json> 2018-04-04 12:25:01,102 41357cae MainThread INFO Ran: {bq load --autodetect --source_format=NEWLINE_DELIMITED_JSON beam_performance.pkb_results <https://builds.apache.org/job/beam_PerformanceTests_Spark/ws/runs/41357cae/perfkit-bq-pubj4r7X0.json}> ReturnCode:1 STDOUT: BigQuery error in load operation: Error processing job 'apache-beam-testing:bqjob_r1f3f511fccc2666f_00000162909e0944_1': Invalid schema update. Field timestamp has changed type from TIMESTAMP to FLOAT STDERR: /usr/lib/google-cloud-sdk/platform/bq/third_party/oauth2client/contrib/gce.py:73: UserWarning: You have requested explicit scopes to be used with a GCE service account. Using this argument will have no effect on the actual scopes for tokens requested. These scopes are set at VM instance creation time and can't be overridden in the request. warnings.warn(_SCOPES_WARNING) Upload complete.Waiting on bqjob_r1f3f511fccc2666f_00000162909e0944_1 ... (0s) Current status: RUNNING Waiting on bqjob_r1f3f511fccc2666f_00000162909e0944_1 ... (0s) Current status: DONE Traceback (most recent call last): File "PerfKitBenchmarker/pkb.py", line 21, in <module> sys.exit(Main()) File "<https://builds.apache.org/job/beam_PerformanceTests_Spark/ws/PerfKitBenchmarker/perfkitbenchmarker/pkb.py",> line 952, in Main return RunBenchmarks() File "<https://builds.apache.org/job/beam_PerformanceTests_Spark/ws/PerfKitBenchmarker/perfkitbenchmarker/pkb.py",> line 879, in RunBenchmarks collector.PublishSamples() File "<https://builds.apache.org/job/beam_PerformanceTests_Spark/ws/PerfKitBenchmarker/perfkitbenchmarker/publisher.py",> line 886, in PublishSamples publisher.PublishSamples(self.samples) File "<https://builds.apache.org/job/beam_PerformanceTests_Spark/ws/PerfKitBenchmarker/perfkitbenchmarker/publisher.py",> line 538, in PublishSamples vm_util.IssueRetryableCommand(load_cmd) File "<https://builds.apache.org/job/beam_PerformanceTests_Spark/ws/PerfKitBenchmarker/perfkitbenchmarker/vm_util.py",> line 249, in WrappedFunction return f(*args, **kwargs) File "<https://builds.apache.org/job/beam_PerformanceTests_Spark/ws/PerfKitBenchmarker/perfkitbenchmarker/vm_util.py",> line 387, in IssueRetryableCommand 'Command returned a non-zero exit code.\n') perfkitbenchmarker.errors.CalledProcessException: Command returned a non-zero exit code. Build step 'Execute shell' marked build as failure