See <https://builds.apache.org/job/beam_PerformanceTests_Spark/1517/display/redirect?page=changes>
Changes: [iemejia] [BEAM-3931] Remove commons-text dependency from Spark runner ------------------------------------------ [...truncated 93.87 KB...] 'apache-beam-testing:bqjob_r56402e1693c796a5_000001626766130e_1': Invalid schema update. Field timestamp has changed type from TIMESTAMP to FLOAT STDERR: /usr/lib/google-cloud-sdk/platform/bq/third_party/oauth2client/contrib/gce.py:73: UserWarning: You have requested explicit scopes to be used with a GCE service account. Using this argument will have no effect on the actual scopes for tokens requested. These scopes are set at VM instance creation time and can't be overridden in the request. warnings.warn(_SCOPES_WARNING) 2018-03-27 12:19:28,199 7dd6eb10 MainThread INFO Retrying exception running IssueRetryableCommand: Command returned a non-zero exit code. 2018-03-27 12:19:56,638 7dd6eb10 MainThread INFO Running: bq load --autodetect --source_format=NEWLINE_DELIMITED_JSON beam_performance.pkb_results <https://builds.apache.org/job/beam_PerformanceTests_Spark/ws/runs/7dd6eb10/perfkit-bq-pubc_oPzv.json> 2018-03-27 12:19:58,867 7dd6eb10 MainThread INFO Ran: {bq load --autodetect --source_format=NEWLINE_DELIMITED_JSON beam_performance.pkb_results <https://builds.apache.org/job/beam_PerformanceTests_Spark/ws/runs/7dd6eb10/perfkit-bq-pubc_oPzv.json}> ReturnCode:1 STDOUT: Upload complete. Waiting on bqjob_r154ff2fddfe10d26_0000016267668dca_1 ... (0s) Current status: RUNNING Waiting on bqjob_r154ff2fddfe10d26_0000016267668dca_1 ... (0s) Current status: DONE BigQuery error in load operation: Error processing job 'apache-beam-testing:bqjob_r154ff2fddfe10d26_0000016267668dca_1': Invalid schema update. Field timestamp has changed type from TIMESTAMP to FLOAT STDERR: /usr/lib/google-cloud-sdk/platform/bq/third_party/oauth2client/contrib/gce.py:73: UserWarning: You have requested explicit scopes to be used with a GCE service account. Using this argument will have no effect on the actual scopes for tokens requested. These scopes are set at VM instance creation time and can't be overridden in the request. warnings.warn(_SCOPES_WARNING) 2018-03-27 12:19:58,867 7dd6eb10 MainThread INFO Retrying exception running IssueRetryableCommand: Command returned a non-zero exit code. 2018-03-27 12:20:18,402 7dd6eb10 MainThread INFO Running: bq load --autodetect --source_format=NEWLINE_DELIMITED_JSON beam_performance.pkb_results <https://builds.apache.org/job/beam_PerformanceTests_Spark/ws/runs/7dd6eb10/perfkit-bq-pubc_oPzv.json> 2018-03-27 12:20:21,163 7dd6eb10 MainThread INFO Ran: {bq load --autodetect --source_format=NEWLINE_DELIMITED_JSON beam_performance.pkb_results <https://builds.apache.org/job/beam_PerformanceTests_Spark/ws/runs/7dd6eb10/perfkit-bq-pubc_oPzv.json}> ReturnCode:1 STDOUT: Upload complete. Waiting on bqjob_r2669fc8a2a1fa764_000001626766e401_1 ... (0s) Current status: RUNNING Waiting on bqjob_r2669fc8a2a1fa764_000001626766e401_1 ... (0s) Current status: DONE BigQuery error in load operation: Error processing job 'apache-beam-testing:bqjob_r2669fc8a2a1fa764_000001626766e401_1': Invalid schema update. Field timestamp has changed type from TIMESTAMP to FLOAT STDERR: /usr/lib/google-cloud-sdk/platform/bq/third_party/oauth2client/contrib/gce.py:73: UserWarning: You have requested explicit scopes to be used with a GCE service account. Using this argument will have no effect on the actual scopes for tokens requested. These scopes are set at VM instance creation time and can't be overridden in the request. warnings.warn(_SCOPES_WARNING) 2018-03-27 12:20:21,164 7dd6eb10 MainThread INFO Retrying exception running IssueRetryableCommand: Command returned a non-zero exit code. 2018-03-27 12:20:50,302 7dd6eb10 MainThread INFO Running: bq load --autodetect --source_format=NEWLINE_DELIMITED_JSON beam_performance.pkb_results <https://builds.apache.org/job/beam_PerformanceTests_Spark/ws/runs/7dd6eb10/perfkit-bq-pubc_oPzv.json> 2018-03-27 12:20:52,946 7dd6eb10 MainThread INFO Ran: {bq load --autodetect --source_format=NEWLINE_DELIMITED_JSON beam_performance.pkb_results <https://builds.apache.org/job/beam_PerformanceTests_Spark/ws/runs/7dd6eb10/perfkit-bq-pubc_oPzv.json}> ReturnCode:1 STDOUT: Upload complete. Waiting on bqjob_r4fbdb1976276e18f_0000016267675f6e_1 ... (0s) Current status: RUNNING Waiting on bqjob_r4fbdb1976276e18f_0000016267675f6e_1 ... (0s) Current status: DONE BigQuery error in load operation: Error processing job 'apache-beam-testing:bqjob_r4fbdb1976276e18f_0000016267675f6e_1': Invalid schema update. Field timestamp has changed type from TIMESTAMP to FLOAT STDERR: /usr/lib/google-cloud-sdk/platform/bq/third_party/oauth2client/contrib/gce.py:73: UserWarning: You have requested explicit scopes to be used with a GCE service account. Using this argument will have no effect on the actual scopes for tokens requested. These scopes are set at VM instance creation time and can't be overridden in the request. warnings.warn(_SCOPES_WARNING) 2018-03-27 12:20:52,947 7dd6eb10 MainThread INFO Retrying exception running IssueRetryableCommand: Command returned a non-zero exit code. 2018-03-27 12:21:09,746 7dd6eb10 MainThread INFO Running: bq load --autodetect --source_format=NEWLINE_DELIMITED_JSON beam_performance.pkb_results <https://builds.apache.org/job/beam_PerformanceTests_Spark/ws/runs/7dd6eb10/perfkit-bq-pubc_oPzv.json> 2018-03-27 12:21:12,519 7dd6eb10 MainThread INFO Ran: {bq load --autodetect --source_format=NEWLINE_DELIMITED_JSON beam_performance.pkb_results <https://builds.apache.org/job/beam_PerformanceTests_Spark/ws/runs/7dd6eb10/perfkit-bq-pubc_oPzv.json}> ReturnCode:1 STDOUT: Upload complete. Waiting on bqjob_r4fb81094e674f936_000001626767ab5b_1 ... (0s) Current status: RUNNING Waiting on bqjob_r4fb81094e674f936_000001626767ab5b_1 ... (0s) Current status: DONE BigQuery error in load operation: Error processing job 'apache-beam-testing:bqjob_r4fb81094e674f936_000001626767ab5b_1': Invalid schema update. Field timestamp has changed type from TIMESTAMP to FLOAT STDERR: /usr/lib/google-cloud-sdk/platform/bq/third_party/oauth2client/contrib/gce.py:73: UserWarning: You have requested explicit scopes to be used with a GCE service account. Using this argument will have no effect on the actual scopes for tokens requested. These scopes are set at VM instance creation time and can't be overridden in the request. warnings.warn(_SCOPES_WARNING) 2018-03-27 12:21:12,519 7dd6eb10 MainThread INFO Retrying exception running IssueRetryableCommand: Command returned a non-zero exit code. 2018-03-27 12:21:29,587 7dd6eb10 MainThread INFO Running: bq load --autodetect --source_format=NEWLINE_DELIMITED_JSON beam_performance.pkb_results <https://builds.apache.org/job/beam_PerformanceTests_Spark/ws/runs/7dd6eb10/perfkit-bq-pubc_oPzv.json> 2018-03-27 12:21:31,869 7dd6eb10 MainThread INFO Ran: {bq load --autodetect --source_format=NEWLINE_DELIMITED_JSON beam_performance.pkb_results <https://builds.apache.org/job/beam_PerformanceTests_Spark/ws/runs/7dd6eb10/perfkit-bq-pubc_oPzv.json}> ReturnCode:1 STDOUT: Upload complete. Waiting on bqjob_r700fccf067bbfb2c_000001626767f8d5_1 ... (0s) Current status: RUNNING Waiting on bqjob_r700fccf067bbfb2c_000001626767f8d5_1 ... (0s) Current status: DONE BigQuery error in load operation: Error processing job 'apache-beam-testing:bqjob_r700fccf067bbfb2c_000001626767f8d5_1': Invalid schema update. Field timestamp has changed type from TIMESTAMP to FLOAT STDERR: /usr/lib/google-cloud-sdk/platform/bq/third_party/oauth2client/contrib/gce.py:73: UserWarning: You have requested explicit scopes to be used with a GCE service account. Using this argument will have no effect on the actual scopes for tokens requested. These scopes are set at VM instance creation time and can't be overridden in the request. warnings.warn(_SCOPES_WARNING) 2018-03-27 12:21:31,869 7dd6eb10 MainThread INFO Retrying exception running IssueRetryableCommand: Command returned a non-zero exit code. 2018-03-27 12:21:52,550 7dd6eb10 MainThread INFO Running: bq load --autodetect --source_format=NEWLINE_DELIMITED_JSON beam_performance.pkb_results <https://builds.apache.org/job/beam_PerformanceTests_Spark/ws/runs/7dd6eb10/perfkit-bq-pubc_oPzv.json> 2018-03-27 12:21:54,863 7dd6eb10 MainThread INFO Ran: {bq load --autodetect --source_format=NEWLINE_DELIMITED_JSON beam_performance.pkb_results <https://builds.apache.org/job/beam_PerformanceTests_Spark/ws/runs/7dd6eb10/perfkit-bq-pubc_oPzv.json}> ReturnCode:1 STDOUT: Upload complete. Waiting on bqjob_rd37f9cc74724daf_0000016267685289_1 ... (0s) Current status: RUNNING Waiting on bqjob_rd37f9cc74724daf_0000016267685289_1 ... (0s) Current status: DONE BigQuery error in load operation: Error processing job 'apache-beam-testing:bqjob_rd37f9cc74724daf_0000016267685289_1': Invalid schema update. Field timestamp has changed type from TIMESTAMP to FLOAT STDERR: /usr/lib/google-cloud-sdk/platform/bq/third_party/oauth2client/contrib/gce.py:73: UserWarning: You have requested explicit scopes to be used with a GCE service account. Using this argument will have no effect on the actual scopes for tokens requested. These scopes are set at VM instance creation time and can't be overridden in the request. warnings.warn(_SCOPES_WARNING) 2018-03-27 12:21:54,863 7dd6eb10 MainThread INFO Retrying exception running IssueRetryableCommand: Command returned a non-zero exit code. 2018-03-27 12:22:11,418 7dd6eb10 MainThread INFO Running: bq load --autodetect --source_format=NEWLINE_DELIMITED_JSON beam_performance.pkb_results <https://builds.apache.org/job/beam_PerformanceTests_Spark/ws/runs/7dd6eb10/perfkit-bq-pubc_oPzv.json> 2018-03-27 12:22:13,863 7dd6eb10 MainThread INFO Ran: {bq load --autodetect --source_format=NEWLINE_DELIMITED_JSON beam_performance.pkb_results <https://builds.apache.org/job/beam_PerformanceTests_Spark/ws/runs/7dd6eb10/perfkit-bq-pubc_oPzv.json}> ReturnCode:1 STDOUT: Upload complete. Waiting on bqjob_r767917e153eae3a7_0000016267689c94_1 ... (0s) Current status: RUNNING Waiting on bqjob_r767917e153eae3a7_0000016267689c94_1 ... (0s) Current status: DONE BigQuery error in load operation: Error processing job 'apache-beam-testing:bqjob_r767917e153eae3a7_0000016267689c94_1': Invalid schema update. Field timestamp has changed type from TIMESTAMP to FLOAT STDERR: /usr/lib/google-cloud-sdk/platform/bq/third_party/oauth2client/contrib/gce.py:73: UserWarning: You have requested explicit scopes to be used with a GCE service account. Using this argument will have no effect on the actual scopes for tokens requested. These scopes are set at VM instance creation time and can't be overridden in the request. warnings.warn(_SCOPES_WARNING) 2018-03-27 12:22:13,864 7dd6eb10 MainThread INFO Retrying exception running IssueRetryableCommand: Command returned a non-zero exit code. 2018-03-27 12:22:42,315 7dd6eb10 MainThread INFO Running: bq load --autodetect --source_format=NEWLINE_DELIMITED_JSON beam_performance.pkb_results <https://builds.apache.org/job/beam_PerformanceTests_Spark/ws/runs/7dd6eb10/perfkit-bq-pubc_oPzv.json> 2018-03-27 12:22:44,685 7dd6eb10 MainThread INFO Ran: {bq load --autodetect --source_format=NEWLINE_DELIMITED_JSON beam_performance.pkb_results <https://builds.apache.org/job/beam_PerformanceTests_Spark/ws/runs/7dd6eb10/perfkit-bq-pubc_oPzv.json}> ReturnCode:1 STDOUT: Upload complete. Waiting on bqjob_r172c75378e5a3296_0000016267691512_1 ... (0s) Current status: RUNNING Waiting on bqjob_r172c75378e5a3296_0000016267691512_1 ... (0s) Current status: DONE BigQuery error in load operation: Error processing job 'apache-beam-testing:bqjob_r172c75378e5a3296_0000016267691512_1': Invalid schema update. Field timestamp has changed type from TIMESTAMP to FLOAT STDERR: /usr/lib/google-cloud-sdk/platform/bq/third_party/oauth2client/contrib/gce.py:73: UserWarning: You have requested explicit scopes to be used with a GCE service account. Using this argument will have no effect on the actual scopes for tokens requested. These scopes are set at VM instance creation time and can't be overridden in the request. warnings.warn(_SCOPES_WARNING) 2018-03-27 12:22:44,685 7dd6eb10 MainThread INFO Retrying exception running IssueRetryableCommand: Command returned a non-zero exit code. 2018-03-27 12:23:06,243 7dd6eb10 MainThread INFO Running: bq load --autodetect --source_format=NEWLINE_DELIMITED_JSON beam_performance.pkb_results <https://builds.apache.org/job/beam_PerformanceTests_Spark/ws/runs/7dd6eb10/perfkit-bq-pubc_oPzv.json> 2018-03-27 12:23:08,371 7dd6eb10 MainThread INFO Ran: {bq load --autodetect --source_format=NEWLINE_DELIMITED_JSON beam_performance.pkb_results <https://builds.apache.org/job/beam_PerformanceTests_Spark/ws/runs/7dd6eb10/perfkit-bq-pubc_oPzv.json}> ReturnCode:1 STDOUT: Upload complete. Waiting on bqjob_r21c6b33b4e420789_0000016267697254_1 ... (0s) Current status: RUNNING Waiting on bqjob_r21c6b33b4e420789_0000016267697254_1 ... (0s) Current status: DONE BigQuery error in load operation: Error processing job 'apache-beam-testing:bqjob_r21c6b33b4e420789_0000016267697254_1': Invalid schema update. Field timestamp has changed type from TIMESTAMP to FLOAT STDERR: /usr/lib/google-cloud-sdk/platform/bq/third_party/oauth2client/contrib/gce.py:73: UserWarning: You have requested explicit scopes to be used with a GCE service account. Using this argument will have no effect on the actual scopes for tokens requested. These scopes are set at VM instance creation time and can't be overridden in the request. warnings.warn(_SCOPES_WARNING) 2018-03-27 12:23:08,372 7dd6eb10 MainThread INFO Retrying exception running IssueRetryableCommand: Command returned a non-zero exit code. 2018-03-27 12:23:25,934 7dd6eb10 MainThread INFO Running: bq load --autodetect --source_format=NEWLINE_DELIMITED_JSON beam_performance.pkb_results <https://builds.apache.org/job/beam_PerformanceTests_Spark/ws/runs/7dd6eb10/perfkit-bq-pubc_oPzv.json> 2018-03-27 12:23:28,259 7dd6eb10 MainThread INFO Ran: {bq load --autodetect --source_format=NEWLINE_DELIMITED_JSON beam_performance.pkb_results <https://builds.apache.org/job/beam_PerformanceTests_Spark/ws/runs/7dd6eb10/perfkit-bq-pubc_oPzv.json}> ReturnCode:1 STDOUT: Upload complete. Waiting on bqjob_r2bc0f1db4d805a90_000001626769bf7c_1 ... (0s) Current status: RUNNING Waiting on bqjob_r2bc0f1db4d805a90_000001626769bf7c_1 ... (0s) Current status: DONE BigQuery error in load operation: Error processing job 'apache-beam-testing:bqjob_r2bc0f1db4d805a90_000001626769bf7c_1': Invalid schema update. Field timestamp has changed type from TIMESTAMP to FLOAT STDERR: /usr/lib/google-cloud-sdk/platform/bq/third_party/oauth2client/contrib/gce.py:73: UserWarning: You have requested explicit scopes to be used with a GCE service account. Using this argument will have no effect on the actual scopes for tokens requested. These scopes are set at VM instance creation time and can't be overridden in the request. warnings.warn(_SCOPES_WARNING) 2018-03-27 12:23:28,259 7dd6eb10 MainThread INFO Retrying exception running IssueRetryableCommand: Command returned a non-zero exit code. 2018-03-27 12:23:57,778 7dd6eb10 MainThread INFO Running: bq load --autodetect --source_format=NEWLINE_DELIMITED_JSON beam_performance.pkb_results <https://builds.apache.org/job/beam_PerformanceTests_Spark/ws/runs/7dd6eb10/perfkit-bq-pubc_oPzv.json> 2018-03-27 12:24:00,034 7dd6eb10 MainThread INFO Ran: {bq load --autodetect --source_format=NEWLINE_DELIMITED_JSON beam_performance.pkb_results <https://builds.apache.org/job/beam_PerformanceTests_Spark/ws/runs/7dd6eb10/perfkit-bq-pubc_oPzv.json}> ReturnCode:1 STDOUT: Upload complete. Waiting on bqjob_r406d18226d17dbad_00000162676a3bf7_1 ... (0s) Current status: RUNNING Waiting on bqjob_r406d18226d17dbad_00000162676a3bf7_1 ... (0s) Current status: DONE BigQuery error in load operation: Error processing job 'apache-beam-testing:bqjob_r406d18226d17dbad_00000162676a3bf7_1': Invalid schema update. Field timestamp has changed type from TIMESTAMP to FLOAT STDERR: /usr/lib/google-cloud-sdk/platform/bq/third_party/oauth2client/contrib/gce.py:73: UserWarning: You have requested explicit scopes to be used with a GCE service account. Using this argument will have no effect on the actual scopes for tokens requested. These scopes are set at VM instance creation time and can't be overridden in the request. warnings.warn(_SCOPES_WARNING) 2018-03-27 12:24:00,035 7dd6eb10 MainThread INFO Retrying exception running IssueRetryableCommand: Command returned a non-zero exit code. 2018-03-27 12:24:24,946 7dd6eb10 MainThread INFO Running: bq load --autodetect --source_format=NEWLINE_DELIMITED_JSON beam_performance.pkb_results <https://builds.apache.org/job/beam_PerformanceTests_Spark/ws/runs/7dd6eb10/perfkit-bq-pubc_oPzv.json> 2018-03-27 12:24:27,744 7dd6eb10 MainThread INFO Ran: {bq load --autodetect --source_format=NEWLINE_DELIMITED_JSON beam_performance.pkb_results <https://builds.apache.org/job/beam_PerformanceTests_Spark/ws/runs/7dd6eb10/perfkit-bq-pubc_oPzv.json}> ReturnCode:1 STDOUT: Upload complete. Waiting on bqjob_r3d241671228edcb7_00000162676aa77b_1 ... (0s) Current status: RUNNING Waiting on bqjob_r3d241671228edcb7_00000162676aa77b_1 ... (0s) Current status: DONE BigQuery error in load operation: Error processing job 'apache-beam-testing:bqjob_r3d241671228edcb7_00000162676aa77b_1': Invalid schema update. Field timestamp has changed type from TIMESTAMP to FLOAT STDERR: /usr/lib/google-cloud-sdk/platform/bq/third_party/oauth2client/contrib/gce.py:73: UserWarning: You have requested explicit scopes to be used with a GCE service account. Using this argument will have no effect on the actual scopes for tokens requested. These scopes are set at VM instance creation time and can't be overridden in the request. warnings.warn(_SCOPES_WARNING) 2018-03-27 12:24:27,744 7dd6eb10 MainThread INFO Retrying exception running IssueRetryableCommand: Command returned a non-zero exit code. 2018-03-27 12:24:44,394 7dd6eb10 MainThread INFO Running: bq load --autodetect --source_format=NEWLINE_DELIMITED_JSON beam_performance.pkb_results <https://builds.apache.org/job/beam_PerformanceTests_Spark/ws/runs/7dd6eb10/perfkit-bq-pubc_oPzv.json> 2018-03-27 12:24:46,794 7dd6eb10 MainThread INFO Ran: {bq load --autodetect --source_format=NEWLINE_DELIMITED_JSON beam_performance.pkb_results <https://builds.apache.org/job/beam_PerformanceTests_Spark/ws/runs/7dd6eb10/perfkit-bq-pubc_oPzv.json}> ReturnCode:1 STDOUT: Upload complete. Waiting on bqjob_r145dc081db06e9ac_00000162676af2be_1 ... (0s) Current status: RUNNING Waiting on bqjob_r145dc081db06e9ac_00000162676af2be_1 ... (0s) Current status: DONE BigQuery error in load operation: Error processing job 'apache-beam-testing:bqjob_r145dc081db06e9ac_00000162676af2be_1': Invalid schema update. Field timestamp has changed type from TIMESTAMP to FLOAT STDERR: /usr/lib/google-cloud-sdk/platform/bq/third_party/oauth2client/contrib/gce.py:73: UserWarning: You have requested explicit scopes to be used with a GCE service account. Using this argument will have no effect on the actual scopes for tokens requested. These scopes are set at VM instance creation time and can't be overridden in the request. warnings.warn(_SCOPES_WARNING) Traceback (most recent call last): File "PerfKitBenchmarker/pkb.py", line 21, in <module> sys.exit(Main()) File "<https://builds.apache.org/job/beam_PerformanceTests_Spark/ws/PerfKitBenchmarker/perfkitbenchmarker/pkb.py";,> line 952, in Main return RunBenchmarks() File "<https://builds.apache.org/job/beam_PerformanceTests_Spark/ws/PerfKitBenchmarker/perfkitbenchmarker/pkb.py";,> line 879, in RunBenchmarks collector.PublishSamples() File "<https://builds.apache.org/job/beam_PerformanceTests_Spark/ws/PerfKitBenchmarker/perfkitbenchmarker/publisher.py";,> line 886, in PublishSamples publisher.PublishSamples(self.samples) File "<https://builds.apache.org/job/beam_PerformanceTests_Spark/ws/PerfKitBenchmarker/perfkitbenchmarker/publisher.py";,> line 538, in PublishSamples vm_util.IssueRetryableCommand(load_cmd) File "<https://builds.apache.org/job/beam_PerformanceTests_Spark/ws/PerfKitBenchmarker/perfkitbenchmarker/vm_util.py";,> line 249, in WrappedFunction return f(*args, **kwargs) File "<https://builds.apache.org/job/beam_PerformanceTests_Spark/ws/PerfKitBenchmarker/perfkitbenchmarker/vm_util.py";,> line 387, in IssueRetryableCommand 'Command returned a non-zero exit code.\n') perfkitbenchmarker.errors.CalledProcessException: Command returned a non-zero exit code. Build step 'Execute shell' marked build as failure
