See <https://builds.apache.org/job/beam_PerformanceTests_Spark/1386/display/redirect?page=changes>
Changes: [luke_zhu] Revert invalid use of io.StringIO in utils/profiler.py [kirpichov] A relative directory should be applied (if specified) even when using a ------------------------------------------ [...truncated 98.30 KB...] 'apache-beam-testing:bqjob_r6827e81f7652e574_00000161bc2b1689_1': Invalid schema update. Field timestamp has changed type from TIMESTAMP to FLOAT STDERR: /usr/lib/google-cloud-sdk/platform/bq/third_party/oauth2client/contrib/gce.py:73: UserWarning: You have requested explicit scopes to be used with a GCE service account. Using this argument will have no effect on the actual scopes for tokens requested. These scopes are set at VM instance creation time and can't be overridden in the request. warnings.warn(_SCOPES_WARNING) 2018-02-22 06:19:57,744 7abea485 MainThread INFO Retrying exception running IssueRetryableCommand: Command returned a non-zero exit code. 2018-02-22 06:20:21,141 7abea485 MainThread INFO Running: bq load --autodetect --source_format=NEWLINE_DELIMITED_JSON beam_performance.pkb_results <https://builds.apache.org/job/beam_PerformanceTests_Spark/ws/runs/7abea485/perfkit-bq-pubAfxxqN.json> 2018-02-22 06:20:23,363 7abea485 MainThread INFO Ran: {bq load --autodetect --source_format=NEWLINE_DELIMITED_JSON beam_performance.pkb_results <https://builds.apache.org/job/beam_PerformanceTests_Spark/ws/runs/7abea485/perfkit-bq-pubAfxxqN.json}> ReturnCode:1, WallTime:0:02.21s, CPU:0.25s, MaxMemory:25168kb STDOUT: Upload complete. Waiting on bqjob_r5a1bcde381f5abf_00000161bc2b7a1b_1 ... (0s) Current status: RUNNING Waiting on bqjob_r5a1bcde381f5abf_00000161bc2b7a1b_1 ... (0s) Current status: DONE BigQuery error in load operation: Error processing job 'apache-beam-testing:bqjob_r5a1bcde381f5abf_00000161bc2b7a1b_1': Invalid schema update. Field timestamp has changed type from TIMESTAMP to FLOAT STDERR: /usr/lib/google-cloud-sdk/platform/bq/third_party/oauth2client/contrib/gce.py:73: UserWarning: You have requested explicit scopes to be used with a GCE service account. Using this argument will have no effect on the actual scopes for tokens requested. These scopes are set at VM instance creation time and can't be overridden in the request. warnings.warn(_SCOPES_WARNING) 2018-02-22 06:20:23,364 7abea485 MainThread INFO Retrying exception running IssueRetryableCommand: Command returned a non-zero exit code. 2018-02-22 06:20:45,574 7abea485 MainThread INFO Running: bq load --autodetect --source_format=NEWLINE_DELIMITED_JSON beam_performance.pkb_results <https://builds.apache.org/job/beam_PerformanceTests_Spark/ws/runs/7abea485/perfkit-bq-pubAfxxqN.json> 2018-02-22 06:20:47,897 7abea485 MainThread INFO Ran: {bq load --autodetect --source_format=NEWLINE_DELIMITED_JSON beam_performance.pkb_results <https://builds.apache.org/job/beam_PerformanceTests_Spark/ws/runs/7abea485/perfkit-bq-pubAfxxqN.json}> ReturnCode:1, WallTime:0:02.31s, CPU:0.25s, MaxMemory:25168kb STDOUT: Upload complete. Waiting on bqjob_r3b7e3b5ed86ff735_00000161bc2bd988_1 ... (0s) Current status: RUNNING Waiting on bqjob_r3b7e3b5ed86ff735_00000161bc2bd988_1 ... (0s) Current status: DONE BigQuery error in load operation: Error processing job 'apache-beam-testing:bqjob_r3b7e3b5ed86ff735_00000161bc2bd988_1': Invalid schema update. Field timestamp has changed type from TIMESTAMP to FLOAT STDERR: /usr/lib/google-cloud-sdk/platform/bq/third_party/oauth2client/contrib/gce.py:73: UserWarning: You have requested explicit scopes to be used with a GCE service account. Using this argument will have no effect on the actual scopes for tokens requested. These scopes are set at VM instance creation time and can't be overridden in the request. warnings.warn(_SCOPES_WARNING) 2018-02-22 06:20:47,898 7abea485 MainThread INFO Retrying exception running IssueRetryableCommand: Command returned a non-zero exit code. 2018-02-22 06:21:04,070 7abea485 MainThread INFO Running: bq load --autodetect --source_format=NEWLINE_DELIMITED_JSON beam_performance.pkb_results <https://builds.apache.org/job/beam_PerformanceTests_Spark/ws/runs/7abea485/perfkit-bq-pubAfxxqN.json> 2018-02-22 06:21:06,375 7abea485 MainThread INFO Ran: {bq load --autodetect --source_format=NEWLINE_DELIMITED_JSON beam_performance.pkb_results <https://builds.apache.org/job/beam_PerformanceTests_Spark/ws/runs/7abea485/perfkit-bq-pubAfxxqN.json}> ReturnCode:1, WallTime:0:02.30s, CPU:0.24s, MaxMemory:25164kb STDOUT: Upload complete. Waiting on bqjob_r7818a3f4679216bc_00000161bc2c21c9_1 ... (0s) Current status: RUNNING Waiting on bqjob_r7818a3f4679216bc_00000161bc2c21c9_1 ... (0s) Current status: DONE BigQuery error in load operation: Error processing job 'apache-beam-testing:bqjob_r7818a3f4679216bc_00000161bc2c21c9_1': Invalid schema update. Field timestamp has changed type from TIMESTAMP to FLOAT STDERR: /usr/lib/google-cloud-sdk/platform/bq/third_party/oauth2client/contrib/gce.py:73: UserWarning: You have requested explicit scopes to be used with a GCE service account. Using this argument will have no effect on the actual scopes for tokens requested. These scopes are set at VM instance creation time and can't be overridden in the request. warnings.warn(_SCOPES_WARNING) 2018-02-22 06:21:06,376 7abea485 MainThread INFO Retrying exception running IssueRetryableCommand: Command returned a non-zero exit code. 2018-02-22 06:21:23,623 7abea485 MainThread INFO Running: bq load --autodetect --source_format=NEWLINE_DELIMITED_JSON beam_performance.pkb_results <https://builds.apache.org/job/beam_PerformanceTests_Spark/ws/runs/7abea485/perfkit-bq-pubAfxxqN.json> 2018-02-22 06:21:26,063 7abea485 MainThread INFO Ran: {bq load --autodetect --source_format=NEWLINE_DELIMITED_JSON beam_performance.pkb_results <https://builds.apache.org/job/beam_PerformanceTests_Spark/ws/runs/7abea485/perfkit-bq-pubAfxxqN.json}> ReturnCode:1, WallTime:0:02.43s, CPU:0.24s, MaxMemory:25400kb STDOUT: Upload complete. Waiting on bqjob_r18314c3451e56ea_00000161bc2c6e30_1 ... (0s) Current status: RUNNING Waiting on bqjob_r18314c3451e56ea_00000161bc2c6e30_1 ... (0s) Current status: DONE BigQuery error in load operation: Error processing job 'apache-beam-testing:bqjob_r18314c3451e56ea_00000161bc2c6e30_1': Invalid schema update. Field timestamp has changed type from TIMESTAMP to FLOAT STDERR: /usr/lib/google-cloud-sdk/platform/bq/third_party/oauth2client/contrib/gce.py:73: UserWarning: You have requested explicit scopes to be used with a GCE service account. Using this argument will have no effect on the actual scopes for tokens requested. These scopes are set at VM instance creation time and can't be overridden in the request. warnings.warn(_SCOPES_WARNING) 2018-02-22 06:21:26,063 7abea485 MainThread INFO Retrying exception running IssueRetryableCommand: Command returned a non-zero exit code. 2018-02-22 06:21:45,926 7abea485 MainThread INFO Running: bq load --autodetect --source_format=NEWLINE_DELIMITED_JSON beam_performance.pkb_results <https://builds.apache.org/job/beam_PerformanceTests_Spark/ws/runs/7abea485/perfkit-bq-pubAfxxqN.json> 2018-02-22 06:21:48,309 7abea485 MainThread INFO Ran: {bq load --autodetect --source_format=NEWLINE_DELIMITED_JSON beam_performance.pkb_results <https://builds.apache.org/job/beam_PerformanceTests_Spark/ws/runs/7abea485/perfkit-bq-pubAfxxqN.json}> ReturnCode:1, WallTime:0:02.37s, CPU:0.26s, MaxMemory:25424kb STDOUT: Upload complete. Waiting on bqjob_r625f3b5e30f6eb5b_00000161bc2cc54c_1 ... (0s) Current status: RUNNING Waiting on bqjob_r625f3b5e30f6eb5b_00000161bc2cc54c_1 ... (0s) Current status: DONE BigQuery error in load operation: Error processing job 'apache-beam-testing:bqjob_r625f3b5e30f6eb5b_00000161bc2cc54c_1': Invalid schema update. Field timestamp has changed type from TIMESTAMP to FLOAT STDERR: /usr/lib/google-cloud-sdk/platform/bq/third_party/oauth2client/contrib/gce.py:73: UserWarning: You have requested explicit scopes to be used with a GCE service account. Using this argument will have no effect on the actual scopes for tokens requested. These scopes are set at VM instance creation time and can't be overridden in the request. warnings.warn(_SCOPES_WARNING) 2018-02-22 06:21:48,309 7abea485 MainThread INFO Retrying exception running IssueRetryableCommand: Command returned a non-zero exit code. 2018-02-22 06:22:11,987 7abea485 MainThread INFO Running: bq load --autodetect --source_format=NEWLINE_DELIMITED_JSON beam_performance.pkb_results <https://builds.apache.org/job/beam_PerformanceTests_Spark/ws/runs/7abea485/perfkit-bq-pubAfxxqN.json> 2018-02-22 06:22:14,534 7abea485 MainThread INFO Ran: {bq load --autodetect --source_format=NEWLINE_DELIMITED_JSON beam_performance.pkb_results <https://builds.apache.org/job/beam_PerformanceTests_Spark/ws/runs/7abea485/perfkit-bq-pubAfxxqN.json}> ReturnCode:1, WallTime:0:02.54s, CPU:0.23s, MaxMemory:25468kb STDOUT: Upload complete. Waiting on bqjob_r56473b0d25e6290c_00000161bc2d2b14_1 ... (0s) Current status: RUNNING Waiting on bqjob_r56473b0d25e6290c_00000161bc2d2b14_1 ... (0s) Current status: DONE BigQuery error in load operation: Error processing job 'apache-beam-testing:bqjob_r56473b0d25e6290c_00000161bc2d2b14_1': Invalid schema update. Field timestamp has changed type from TIMESTAMP to FLOAT STDERR: /usr/lib/google-cloud-sdk/platform/bq/third_party/oauth2client/contrib/gce.py:73: UserWarning: You have requested explicit scopes to be used with a GCE service account. Using this argument will have no effect on the actual scopes for tokens requested. These scopes are set at VM instance creation time and can't be overridden in the request. warnings.warn(_SCOPES_WARNING) 2018-02-22 06:22:14,535 7abea485 MainThread INFO Retrying exception running IssueRetryableCommand: Command returned a non-zero exit code. 2018-02-22 06:22:30,258 7abea485 MainThread INFO Running: bq load --autodetect --source_format=NEWLINE_DELIMITED_JSON beam_performance.pkb_results <https://builds.apache.org/job/beam_PerformanceTests_Spark/ws/runs/7abea485/perfkit-bq-pubAfxxqN.json> 2018-02-22 06:22:32,493 7abea485 MainThread INFO Ran: {bq load --autodetect --source_format=NEWLINE_DELIMITED_JSON beam_performance.pkb_results <https://builds.apache.org/job/beam_PerformanceTests_Spark/ws/runs/7abea485/perfkit-bq-pubAfxxqN.json}> ReturnCode:1, WallTime:0:02.23s, CPU:0.22s, MaxMemory:25244kb STDOUT: Upload complete. Waiting on bqjob_r6f5539c95ad7e710_00000161bc2d726d_1 ... (0s) Current status: RUNNING Waiting on bqjob_r6f5539c95ad7e710_00000161bc2d726d_1 ... (0s) Current status: DONE BigQuery error in load operation: Error processing job 'apache-beam-testing:bqjob_r6f5539c95ad7e710_00000161bc2d726d_1': Invalid schema update. Field timestamp has changed type from TIMESTAMP to FLOAT STDERR: /usr/lib/google-cloud-sdk/platform/bq/third_party/oauth2client/contrib/gce.py:73: UserWarning: You have requested explicit scopes to be used with a GCE service account. Using this argument will have no effect on the actual scopes for tokens requested. These scopes are set at VM instance creation time and can't be overridden in the request. warnings.warn(_SCOPES_WARNING) 2018-02-22 06:22:32,494 7abea485 MainThread INFO Retrying exception running IssueRetryableCommand: Command returned a non-zero exit code. 2018-02-22 06:22:56,622 7abea485 MainThread INFO Running: bq load --autodetect --source_format=NEWLINE_DELIMITED_JSON beam_performance.pkb_results <https://builds.apache.org/job/beam_PerformanceTests_Spark/ws/runs/7abea485/perfkit-bq-pubAfxxqN.json> 2018-02-22 06:22:58,770 7abea485 MainThread INFO Ran: {bq load --autodetect --source_format=NEWLINE_DELIMITED_JSON beam_performance.pkb_results <https://builds.apache.org/job/beam_PerformanceTests_Spark/ws/runs/7abea485/perfkit-bq-pubAfxxqN.json}> ReturnCode:1, WallTime:0:02.14s, CPU:0.25s, MaxMemory:25436kb STDOUT: Upload complete. Waiting on bqjob_r3da29583ad0f65b4_00000161bc2dd96d_1 ... (0s) Current status: RUNNING Waiting on bqjob_r3da29583ad0f65b4_00000161bc2dd96d_1 ... (0s) Current status: DONE BigQuery error in load operation: Error processing job 'apache-beam-testing:bqjob_r3da29583ad0f65b4_00000161bc2dd96d_1': Invalid schema update. Field timestamp has changed type from TIMESTAMP to FLOAT STDERR: /usr/lib/google-cloud-sdk/platform/bq/third_party/oauth2client/contrib/gce.py:73: UserWarning: You have requested explicit scopes to be used with a GCE service account. Using this argument will have no effect on the actual scopes for tokens requested. These scopes are set at VM instance creation time and can't be overridden in the request. warnings.warn(_SCOPES_WARNING) 2018-02-22 06:22:58,770 7abea485 MainThread INFO Retrying exception running IssueRetryableCommand: Command returned a non-zero exit code. 2018-02-22 06:23:21,962 7abea485 MainThread INFO Running: bq load --autodetect --source_format=NEWLINE_DELIMITED_JSON beam_performance.pkb_results <https://builds.apache.org/job/beam_PerformanceTests_Spark/ws/runs/7abea485/perfkit-bq-pubAfxxqN.json> 2018-02-22 06:23:24,262 7abea485 MainThread INFO Ran: {bq load --autodetect --source_format=NEWLINE_DELIMITED_JSON beam_performance.pkb_results <https://builds.apache.org/job/beam_PerformanceTests_Spark/ws/runs/7abea485/perfkit-bq-pubAfxxqN.json}> ReturnCode:1, WallTime:0:02.29s, CPU:0.24s, MaxMemory:25208kb STDOUT: Upload complete. Waiting on bqjob_r5949b3ab62b9a843_00000161bc2e3c7b_1 ... (0s) Current status: RUNNING Waiting on bqjob_r5949b3ab62b9a843_00000161bc2e3c7b_1 ... (0s) Current status: DONE BigQuery error in load operation: Error processing job 'apache-beam-testing:bqjob_r5949b3ab62b9a843_00000161bc2e3c7b_1': Invalid schema update. Field timestamp has changed type from TIMESTAMP to FLOAT STDERR: /usr/lib/google-cloud-sdk/platform/bq/third_party/oauth2client/contrib/gce.py:73: UserWarning: You have requested explicit scopes to be used with a GCE service account. Using this argument will have no effect on the actual scopes for tokens requested. These scopes are set at VM instance creation time and can't be overridden in the request. warnings.warn(_SCOPES_WARNING) 2018-02-22 06:23:24,262 7abea485 MainThread INFO Retrying exception running IssueRetryableCommand: Command returned a non-zero exit code. 2018-02-22 06:23:43,156 7abea485 MainThread INFO Running: bq load --autodetect --source_format=NEWLINE_DELIMITED_JSON beam_performance.pkb_results <https://builds.apache.org/job/beam_PerformanceTests_Spark/ws/runs/7abea485/perfkit-bq-pubAfxxqN.json> 2018-02-22 06:23:45,311 7abea485 MainThread INFO Ran: {bq load --autodetect --source_format=NEWLINE_DELIMITED_JSON beam_performance.pkb_results <https://builds.apache.org/job/beam_PerformanceTests_Spark/ws/runs/7abea485/perfkit-bq-pubAfxxqN.json}> ReturnCode:1, WallTime:0:02.15s, CPU:0.24s, MaxMemory:25440kb STDOUT: Upload complete. Waiting on bqjob_r25e18e1ff190c1c2_00000161bc2e8f39_1 ... (0s) Current status: RUNNING Waiting on bqjob_r25e18e1ff190c1c2_00000161bc2e8f39_1 ... (0s) Current status: DONE BigQuery error in load operation: Error processing job 'apache-beam-testing:bqjob_r25e18e1ff190c1c2_00000161bc2e8f39_1': Invalid schema update. Field timestamp has changed type from TIMESTAMP to FLOAT STDERR: /usr/lib/google-cloud-sdk/platform/bq/third_party/oauth2client/contrib/gce.py:73: UserWarning: You have requested explicit scopes to be used with a GCE service account. Using this argument will have no effect on the actual scopes for tokens requested. These scopes are set at VM instance creation time and can't be overridden in the request. warnings.warn(_SCOPES_WARNING) 2018-02-22 06:23:45,312 7abea485 MainThread INFO Retrying exception running IssueRetryableCommand: Command returned a non-zero exit code. 2018-02-22 06:24:00,351 7abea485 MainThread INFO Running: bq load --autodetect --source_format=NEWLINE_DELIMITED_JSON beam_performance.pkb_results <https://builds.apache.org/job/beam_PerformanceTests_Spark/ws/runs/7abea485/perfkit-bq-pubAfxxqN.json> 2018-02-22 06:24:02,752 7abea485 MainThread INFO Ran: {bq load --autodetect --source_format=NEWLINE_DELIMITED_JSON beam_performance.pkb_results <https://builds.apache.org/job/beam_PerformanceTests_Spark/ws/runs/7abea485/perfkit-bq-pubAfxxqN.json}> ReturnCode:1, WallTime:0:02.39s, CPU:0.24s, MaxMemory:25440kb STDOUT: Upload complete. Waiting on bqjob_r4d8fcd6dd0596251_00000161bc2ed26c_1 ... (0s) Current status: RUNNING Waiting on bqjob_r4d8fcd6dd0596251_00000161bc2ed26c_1 ... (0s) Current status: DONE BigQuery error in load operation: Error processing job 'apache-beam-testing:bqjob_r4d8fcd6dd0596251_00000161bc2ed26c_1': Invalid schema update. Field timestamp has changed type from TIMESTAMP to FLOAT STDERR: /usr/lib/google-cloud-sdk/platform/bq/third_party/oauth2client/contrib/gce.py:73: UserWarning: You have requested explicit scopes to be used with a GCE service account. Using this argument will have no effect on the actual scopes for tokens requested. These scopes are set at VM instance creation time and can't be overridden in the request. warnings.warn(_SCOPES_WARNING) 2018-02-22 06:24:02,753 7abea485 MainThread INFO Retrying exception running IssueRetryableCommand: Command returned a non-zero exit code. 2018-02-22 06:24:32,474 7abea485 MainThread INFO Running: bq load --autodetect --source_format=NEWLINE_DELIMITED_JSON beam_performance.pkb_results <https://builds.apache.org/job/beam_PerformanceTests_Spark/ws/runs/7abea485/perfkit-bq-pubAfxxqN.json> 2018-02-22 06:24:34,790 7abea485 MainThread INFO Ran: {bq load --autodetect --source_format=NEWLINE_DELIMITED_JSON beam_performance.pkb_results <https://builds.apache.org/job/beam_PerformanceTests_Spark/ws/runs/7abea485/perfkit-bq-pubAfxxqN.json}> ReturnCode:1, WallTime:0:02.31s, CPU:0.24s, MaxMemory:25436kb STDOUT: Upload complete. Waiting on bqjob_r44b0abfed6dbc02f_00000161bc2f4fe5_1 ... (0s) Current status: RUNNING Waiting on bqjob_r44b0abfed6dbc02f_00000161bc2f4fe5_1 ... (0s) Current status: DONE BigQuery error in load operation: Error processing job 'apache-beam-testing:bqjob_r44b0abfed6dbc02f_00000161bc2f4fe5_1': Invalid schema update. Field timestamp has changed type from TIMESTAMP to FLOAT STDERR: /usr/lib/google-cloud-sdk/platform/bq/third_party/oauth2client/contrib/gce.py:73: UserWarning: You have requested explicit scopes to be used with a GCE service account. Using this argument will have no effect on the actual scopes for tokens requested. These scopes are set at VM instance creation time and can't be overridden in the request. warnings.warn(_SCOPES_WARNING) 2018-02-22 06:24:34,791 7abea485 MainThread INFO Retrying exception running IssueRetryableCommand: Command returned a non-zero exit code. 2018-02-22 06:24:50,337 7abea485 MainThread INFO Running: bq load --autodetect --source_format=NEWLINE_DELIMITED_JSON beam_performance.pkb_results <https://builds.apache.org/job/beam_PerformanceTests_Spark/ws/runs/7abea485/perfkit-bq-pubAfxxqN.json> 2018-02-22 06:24:52,401 7abea485 MainThread INFO Ran: {bq load --autodetect --source_format=NEWLINE_DELIMITED_JSON beam_performance.pkb_results <https://builds.apache.org/job/beam_PerformanceTests_Spark/ws/runs/7abea485/perfkit-bq-pubAfxxqN.json}> ReturnCode:1, WallTime:0:02.05s, CPU:0.22s, MaxMemory:25204kb STDOUT: Upload complete. Waiting on bqjob_r2f3a5961eb33449a_00000161bc2f95a6_1 ... (0s) Current status: RUNNING Waiting on bqjob_r2f3a5961eb33449a_00000161bc2f95a6_1 ... (0s) Current status: DONE BigQuery error in load operation: Error processing job 'apache-beam-testing:bqjob_r2f3a5961eb33449a_00000161bc2f95a6_1': Invalid schema update. Field timestamp has changed type from TIMESTAMP to FLOAT STDERR: /usr/lib/google-cloud-sdk/platform/bq/third_party/oauth2client/contrib/gce.py:73: UserWarning: You have requested explicit scopes to be used with a GCE service account. Using this argument will have no effect on the actual scopes for tokens requested. These scopes are set at VM instance creation time and can't be overridden in the request. warnings.warn(_SCOPES_WARNING) Traceback (most recent call last): File "PerfKitBenchmarker/pkb.py", line 21, in <module> sys.exit(Main()) File "<https://builds.apache.org/job/beam_PerformanceTests_Spark/ws/PerfKitBenchmarker/perfkitbenchmarker/pkb.py";,> line 926, in Main return RunBenchmarks() File "<https://builds.apache.org/job/beam_PerformanceTests_Spark/ws/PerfKitBenchmarker/perfkitbenchmarker/pkb.py";,> line 853, in RunBenchmarks collector.PublishSamples() File "<https://builds.apache.org/job/beam_PerformanceTests_Spark/ws/PerfKitBenchmarker/perfkitbenchmarker/publisher.py";,> line 886, in PublishSamples publisher.PublishSamples(self.samples) File "<https://builds.apache.org/job/beam_PerformanceTests_Spark/ws/PerfKitBenchmarker/perfkitbenchmarker/publisher.py";,> line 538, in PublishSamples vm_util.IssueRetryableCommand(load_cmd) File "<https://builds.apache.org/job/beam_PerformanceTests_Spark/ws/PerfKitBenchmarker/perfkitbenchmarker/vm_util.py";,> line 247, in WrappedFunction return f(*args, **kwargs) File "<https://builds.apache.org/job/beam_PerformanceTests_Spark/ws/PerfKitBenchmarker/perfkitbenchmarker/vm_util.py";,> line 383, in IssueRetryableCommand 'Command returned a non-zero exit code.\n') perfkitbenchmarker.errors.CalledProcessException: Command returned a non-zero exit code. Build step 'Execute shell' marked build as failure
