See <https://builds.apache.org/job/beam_PerformanceTests_Spark/1543/display/redirect?page=changes>
Changes: [ehudm] Upgrade virtualenv and tox in Jenkins machines. [aaltay] [BEAM-3818] Add support for streaming side inputs in the DirectRunner ------------------------------------------ [...truncated 90.66 KB...] 'apache-beam-testing:bqjob_r7df7734e54a01a94_00000162895a467b_1': Invalid schema update. Field timestamp has changed type from TIMESTAMP to FLOAT STDERR: /usr/lib/google-cloud-sdk/platform/bq/third_party/oauth2client/contrib/gce.py:73: UserWarning: You have requested explicit scopes to be used with a GCE service account. Using this argument will have no effect on the actual scopes for tokens requested. These scopes are set at VM instance creation time and can't be overridden in the request. warnings.warn(_SCOPES_WARNING) 2018-04-03 02:33:39,406 6e2f6227 MainThread INFO Retrying exception running IssueRetryableCommand: Command returned a non-zero exit code. 2018-04-03 02:34:06,035 6e2f6227 MainThread INFO Running: bq load --autodetect --source_format=NEWLINE_DELIMITED_JSON beam_performance.pkb_results <https://builds.apache.org/job/beam_PerformanceTests_Spark/ws/runs/6e2f6227/perfkit-bq-pub3_biby.json> 2018-04-03 02:34:08,113 6e2f6227 MainThread INFO Ran: {bq load --autodetect --source_format=NEWLINE_DELIMITED_JSON beam_performance.pkb_results <https://builds.apache.org/job/beam_PerformanceTests_Spark/ws/runs/6e2f6227/perfkit-bq-pub3_biby.json}> ReturnCode:1 STDOUT: Upload complete. Waiting on bqjob_r6dfc151e44228425_00000162895ab660_1 ... (0s) Current status: RUNNING Waiting on bqjob_r6dfc151e44228425_00000162895ab660_1 ... (0s) Current status: DONE BigQuery error in load operation: Error processing job 'apache-beam-testing:bqjob_r6dfc151e44228425_00000162895ab660_1': Invalid schema update. Field timestamp has changed type from TIMESTAMP to FLOAT STDERR: /usr/lib/google-cloud-sdk/platform/bq/third_party/oauth2client/contrib/gce.py:73: UserWarning: You have requested explicit scopes to be used with a GCE service account. Using this argument will have no effect on the actual scopes for tokens requested. These scopes are set at VM instance creation time and can't be overridden in the request. warnings.warn(_SCOPES_WARNING) 2018-04-03 02:34:08,114 6e2f6227 MainThread INFO Retrying exception running IssueRetryableCommand: Command returned a non-zero exit code. 2018-04-03 02:34:29,607 6e2f6227 MainThread INFO Running: bq load --autodetect --source_format=NEWLINE_DELIMITED_JSON beam_performance.pkb_results <https://builds.apache.org/job/beam_PerformanceTests_Spark/ws/runs/6e2f6227/perfkit-bq-pub3_biby.json> 2018-04-03 02:34:31,754 6e2f6227 MainThread INFO Ran: {bq load --autodetect --source_format=NEWLINE_DELIMITED_JSON beam_performance.pkb_results <https://builds.apache.org/job/beam_PerformanceTests_Spark/ws/runs/6e2f6227/perfkit-bq-pub3_biby.json}> ReturnCode:1 STDOUT: Upload complete. Waiting on bqjob_r4389eabd60bb2121_00000162895b1273_1 ... (0s) Current status: RUNNING Waiting on bqjob_r4389eabd60bb2121_00000162895b1273_1 ... (0s) Current status: DONE BigQuery error in load operation: Error processing job 'apache-beam-testing:bqjob_r4389eabd60bb2121_00000162895b1273_1': Invalid schema update. Field timestamp has changed type from TIMESTAMP to FLOAT STDERR: /usr/lib/google-cloud-sdk/platform/bq/third_party/oauth2client/contrib/gce.py:73: UserWarning: You have requested explicit scopes to be used with a GCE service account. Using this argument will have no effect on the actual scopes for tokens requested. These scopes are set at VM instance creation time and can't be overridden in the request. warnings.warn(_SCOPES_WARNING) 2018-04-03 02:34:31,755 6e2f6227 MainThread INFO Retrying exception running IssueRetryableCommand: Command returned a non-zero exit code. 2018-04-03 02:34:58,512 6e2f6227 MainThread INFO Running: bq load --autodetect --source_format=NEWLINE_DELIMITED_JSON beam_performance.pkb_results <https://builds.apache.org/job/beam_PerformanceTests_Spark/ws/runs/6e2f6227/perfkit-bq-pub3_biby.json> 2018-04-03 02:35:00,636 6e2f6227 MainThread INFO Ran: {bq load --autodetect --source_format=NEWLINE_DELIMITED_JSON beam_performance.pkb_results <https://builds.apache.org/job/beam_PerformanceTests_Spark/ws/runs/6e2f6227/perfkit-bq-pub3_biby.json}> ReturnCode:1 STDOUT: Upload complete. Waiting on bqjob_r341418976c99657a_00000162895b835c_1 ... (0s) Current status: RUNNING Waiting on bqjob_r341418976c99657a_00000162895b835c_1 ... (0s) Current status: DONE BigQuery error in load operation: Error processing job 'apache-beam-testing:bqjob_r341418976c99657a_00000162895b835c_1': Invalid schema update. Field timestamp has changed type from TIMESTAMP to FLOAT STDERR: /usr/lib/google-cloud-sdk/platform/bq/third_party/oauth2client/contrib/gce.py:73: UserWarning: You have requested explicit scopes to be used with a GCE service account. Using this argument will have no effect on the actual scopes for tokens requested. These scopes are set at VM instance creation time and can't be overridden in the request. warnings.warn(_SCOPES_WARNING) 2018-04-03 02:35:00,636 6e2f6227 MainThread INFO Retrying exception running IssueRetryableCommand: Command returned a non-zero exit code. 2018-04-03 02:35:28,299 6e2f6227 MainThread INFO Running: bq load --autodetect --source_format=NEWLINE_DELIMITED_JSON beam_performance.pkb_results <https://builds.apache.org/job/beam_PerformanceTests_Spark/ws/runs/6e2f6227/perfkit-bq-pub3_biby.json> 2018-04-03 02:35:30,410 6e2f6227 MainThread INFO Ran: {bq load --autodetect --source_format=NEWLINE_DELIMITED_JSON beam_performance.pkb_results <https://builds.apache.org/job/beam_PerformanceTests_Spark/ws/runs/6e2f6227/perfkit-bq-pub3_biby.json}> ReturnCode:1 STDOUT: Upload complete. Waiting on bqjob_r30bcfb0e5881cb4d_00000162895bf7b8_1 ... (0s) Current status: RUNNING Waiting on bqjob_r30bcfb0e5881cb4d_00000162895bf7b8_1 ... (0s) Current status: DONE BigQuery error in load operation: Error processing job 'apache-beam-testing:bqjob_r30bcfb0e5881cb4d_00000162895bf7b8_1': Invalid schema update. Field timestamp has changed type from TIMESTAMP to FLOAT STDERR: /usr/lib/google-cloud-sdk/platform/bq/third_party/oauth2client/contrib/gce.py:73: UserWarning: You have requested explicit scopes to be used with a GCE service account. Using this argument will have no effect on the actual scopes for tokens requested. These scopes are set at VM instance creation time and can't be overridden in the request. warnings.warn(_SCOPES_WARNING) 2018-04-03 02:35:30,410 6e2f6227 MainThread INFO Retrying exception running IssueRetryableCommand: Command returned a non-zero exit code. 2018-04-03 02:35:57,023 6e2f6227 MainThread INFO Running: bq load --autodetect --source_format=NEWLINE_DELIMITED_JSON beam_performance.pkb_results <https://builds.apache.org/job/beam_PerformanceTests_Spark/ws/runs/6e2f6227/perfkit-bq-pub3_biby.json> 2018-04-03 02:35:59,151 6e2f6227 MainThread INFO Ran: {bq load --autodetect --source_format=NEWLINE_DELIMITED_JSON beam_performance.pkb_results <https://builds.apache.org/job/beam_PerformanceTests_Spark/ws/runs/6e2f6227/perfkit-bq-pub3_biby.json}> ReturnCode:1 STDOUT: Upload complete. Waiting on bqjob_r724550483949492d_00000162895c6803_1 ... (0s) Current status: RUNNING Waiting on bqjob_r724550483949492d_00000162895c6803_1 ... (0s) Current status: DONE BigQuery error in load operation: Error processing job 'apache-beam-testing:bqjob_r724550483949492d_00000162895c6803_1': Invalid schema update. Field timestamp has changed type from TIMESTAMP to FLOAT STDERR: /usr/lib/google-cloud-sdk/platform/bq/third_party/oauth2client/contrib/gce.py:73: UserWarning: You have requested explicit scopes to be used with a GCE service account. Using this argument will have no effect on the actual scopes for tokens requested. These scopes are set at VM instance creation time and can't be overridden in the request. warnings.warn(_SCOPES_WARNING) 2018-04-03 02:35:59,152 6e2f6227 MainThread INFO Retrying exception running IssueRetryableCommand: Command returned a non-zero exit code. 2018-04-03 02:36:26,174 6e2f6227 MainThread INFO Running: bq load --autodetect --source_format=NEWLINE_DELIMITED_JSON beam_performance.pkb_results <https://builds.apache.org/job/beam_PerformanceTests_Spark/ws/runs/6e2f6227/perfkit-bq-pub3_biby.json> 2018-04-03 02:36:29,394 6e2f6227 MainThread INFO Ran: {bq load --autodetect --source_format=NEWLINE_DELIMITED_JSON beam_performance.pkb_results <https://builds.apache.org/job/beam_PerformanceTests_Spark/ws/runs/6e2f6227/perfkit-bq-pub3_biby.json}> ReturnCode:1 STDOUT: Upload complete. Waiting on bqjob_r7f69dec516a4a60c_00000162895cd9d0_1 ... (0s) Current status: RUNNING Waiting on bqjob_r7f69dec516a4a60c_00000162895cd9d0_1 ... (1s) Current status: RUNNING Waiting on bqjob_r7f69dec516a4a60c_00000162895cd9d0_1 ... (1s) Current status: DONE BigQuery error in load operation: Error processing job 'apache-beam-testing:bqjob_r7f69dec516a4a60c_00000162895cd9d0_1': Invalid schema update. Field timestamp has changed type from TIMESTAMP to FLOAT STDERR: /usr/lib/google-cloud-sdk/platform/bq/third_party/oauth2client/contrib/gce.py:73: UserWarning: You have requested explicit scopes to be used with a GCE service account. Using this argument will have no effect on the actual scopes for tokens requested. These scopes are set at VM instance creation time and can't be overridden in the request. warnings.warn(_SCOPES_WARNING) 2018-04-03 02:36:29,395 6e2f6227 MainThread INFO Retrying exception running IssueRetryableCommand: Command returned a non-zero exit code. 2018-04-03 02:36:53,318 6e2f6227 MainThread INFO Running: bq load --autodetect --source_format=NEWLINE_DELIMITED_JSON beam_performance.pkb_results <https://builds.apache.org/job/beam_PerformanceTests_Spark/ws/runs/6e2f6227/perfkit-bq-pub3_biby.json> 2018-04-03 02:36:55,392 6e2f6227 MainThread INFO Ran: {bq load --autodetect --source_format=NEWLINE_DELIMITED_JSON beam_performance.pkb_results <https://builds.apache.org/job/beam_PerformanceTests_Spark/ws/runs/6e2f6227/perfkit-bq-pub3_biby.json}> ReturnCode:1 STDOUT: Upload complete. Waiting on bqjob_r5c8dbdf44ed46527_00000162895d43c9_1 ... (0s) Current status: RUNNING Waiting on bqjob_r5c8dbdf44ed46527_00000162895d43c9_1 ... (0s) Current status: DONE BigQuery error in load operation: Error processing job 'apache-beam-testing:bqjob_r5c8dbdf44ed46527_00000162895d43c9_1': Invalid schema update. Field timestamp has changed type from TIMESTAMP to FLOAT STDERR: /usr/lib/google-cloud-sdk/platform/bq/third_party/oauth2client/contrib/gce.py:73: UserWarning: You have requested explicit scopes to be used with a GCE service account. Using this argument will have no effect on the actual scopes for tokens requested. These scopes are set at VM instance creation time and can't be overridden in the request. warnings.warn(_SCOPES_WARNING) 2018-04-03 02:36:55,392 6e2f6227 MainThread INFO Retrying exception running IssueRetryableCommand: Command returned a non-zero exit code. 2018-04-03 02:37:15,807 6e2f6227 MainThread INFO Running: bq load --autodetect --source_format=NEWLINE_DELIMITED_JSON beam_performance.pkb_results <https://builds.apache.org/job/beam_PerformanceTests_Spark/ws/runs/6e2f6227/perfkit-bq-pub3_biby.json> 2018-04-03 02:37:17,931 6e2f6227 MainThread INFO Ran: {bq load --autodetect --source_format=NEWLINE_DELIMITED_JSON beam_performance.pkb_results <https://builds.apache.org/job/beam_PerformanceTests_Spark/ws/runs/6e2f6227/perfkit-bq-pub3_biby.json}> ReturnCode:1 STDOUT: Upload complete. Waiting on bqjob_r4e4feec32c0b3a32_00000162895d9bb7_1 ... (0s) Current status: RUNNING Waiting on bqjob_r4e4feec32c0b3a32_00000162895d9bb7_1 ... (0s) Current status: DONE BigQuery error in load operation: Error processing job 'apache-beam-testing:bqjob_r4e4feec32c0b3a32_00000162895d9bb7_1': Invalid schema update. Field timestamp has changed type from TIMESTAMP to FLOAT STDERR: /usr/lib/google-cloud-sdk/platform/bq/third_party/oauth2client/contrib/gce.py:73: UserWarning: You have requested explicit scopes to be used with a GCE service account. Using this argument will have no effect on the actual scopes for tokens requested. These scopes are set at VM instance creation time and can't be overridden in the request. warnings.warn(_SCOPES_WARNING) 2018-04-03 02:37:17,932 6e2f6227 MainThread INFO Retrying exception running IssueRetryableCommand: Command returned a non-zero exit code. 2018-04-03 02:37:39,574 6e2f6227 MainThread INFO Running: bq load --autodetect --source_format=NEWLINE_DELIMITED_JSON beam_performance.pkb_results <https://builds.apache.org/job/beam_PerformanceTests_Spark/ws/runs/6e2f6227/perfkit-bq-pub3_biby.json> 2018-04-03 02:37:41,634 6e2f6227 MainThread INFO Ran: {bq load --autodetect --source_format=NEWLINE_DELIMITED_JSON beam_performance.pkb_results <https://builds.apache.org/job/beam_PerformanceTests_Spark/ws/runs/6e2f6227/perfkit-bq-pub3_biby.json}> ReturnCode:1 STDOUT: Upload complete. Waiting on bqjob_r76f49861671c4200_00000162895df893_1 ... (0s) Current status: RUNNING Waiting on bqjob_r76f49861671c4200_00000162895df893_1 ... (0s) Current status: DONE BigQuery error in load operation: Error processing job 'apache-beam-testing:bqjob_r76f49861671c4200_00000162895df893_1': Invalid schema update. Field timestamp has changed type from TIMESTAMP to FLOAT STDERR: /usr/lib/google-cloud-sdk/platform/bq/third_party/oauth2client/contrib/gce.py:73: UserWarning: You have requested explicit scopes to be used with a GCE service account. Using this argument will have no effect on the actual scopes for tokens requested. These scopes are set at VM instance creation time and can't be overridden in the request. warnings.warn(_SCOPES_WARNING) 2018-04-03 02:37:41,635 6e2f6227 MainThread INFO Retrying exception running IssueRetryableCommand: Command returned a non-zero exit code. 2018-04-03 02:37:56,945 6e2f6227 MainThread INFO Running: bq load --autodetect --source_format=NEWLINE_DELIMITED_JSON beam_performance.pkb_results <https://builds.apache.org/job/beam_PerformanceTests_Spark/ws/runs/6e2f6227/perfkit-bq-pub3_biby.json> 2018-04-03 02:37:59,036 6e2f6227 MainThread INFO Ran: {bq load --autodetect --source_format=NEWLINE_DELIMITED_JSON beam_performance.pkb_results <https://builds.apache.org/job/beam_PerformanceTests_Spark/ws/runs/6e2f6227/perfkit-bq-pub3_biby.json}> ReturnCode:1 STDOUT: Upload complete. Waiting on bqjob_r1ebf842a4c866687_00000162895e3c6f_1 ... (0s) Current status: RUNNING Waiting on bqjob_r1ebf842a4c866687_00000162895e3c6f_1 ... (0s) Current status: DONE BigQuery error in load operation: Error processing job 'apache-beam-testing:bqjob_r1ebf842a4c866687_00000162895e3c6f_1': Invalid schema update. Field timestamp has changed type from TIMESTAMP to FLOAT STDERR: /usr/lib/google-cloud-sdk/platform/bq/third_party/oauth2client/contrib/gce.py:73: UserWarning: You have requested explicit scopes to be used with a GCE service account. Using this argument will have no effect on the actual scopes for tokens requested. These scopes are set at VM instance creation time and can't be overridden in the request. warnings.warn(_SCOPES_WARNING) 2018-04-03 02:37:59,036 6e2f6227 MainThread INFO Retrying exception running IssueRetryableCommand: Command returned a non-zero exit code. 2018-04-03 02:38:22,761 6e2f6227 MainThread INFO Running: bq load --autodetect --source_format=NEWLINE_DELIMITED_JSON beam_performance.pkb_results <https://builds.apache.org/job/beam_PerformanceTests_Spark/ws/runs/6e2f6227/perfkit-bq-pub3_biby.json> 2018-04-03 02:38:25,275 6e2f6227 MainThread INFO Ran: {bq load --autodetect --source_format=NEWLINE_DELIMITED_JSON beam_performance.pkb_results <https://builds.apache.org/job/beam_PerformanceTests_Spark/ws/runs/6e2f6227/perfkit-bq-pub3_biby.json}> ReturnCode:1 STDOUT: Upload complete. Waiting on bqjob_r2b21c9bda3a03ad3_00000162895ea132_1 ... (0s) Current status: RUNNING Waiting on bqjob_r2b21c9bda3a03ad3_00000162895ea132_1 ... (0s) Current status: DONE BigQuery error in load operation: Error processing job 'apache-beam-testing:bqjob_r2b21c9bda3a03ad3_00000162895ea132_1': Invalid schema update. Field timestamp has changed type from TIMESTAMP to FLOAT STDERR: /usr/lib/google-cloud-sdk/platform/bq/third_party/oauth2client/contrib/gce.py:73: UserWarning: You have requested explicit scopes to be used with a GCE service account. Using this argument will have no effect on the actual scopes for tokens requested. These scopes are set at VM instance creation time and can't be overridden in the request. warnings.warn(_SCOPES_WARNING) 2018-04-03 02:38:25,275 6e2f6227 MainThread INFO Retrying exception running IssueRetryableCommand: Command returned a non-zero exit code. 2018-04-03 02:38:50,764 6e2f6227 MainThread INFO Running: bq load --autodetect --source_format=NEWLINE_DELIMITED_JSON beam_performance.pkb_results <https://builds.apache.org/job/beam_PerformanceTests_Spark/ws/runs/6e2f6227/perfkit-bq-pub3_biby.json> 2018-04-03 02:38:53,102 6e2f6227 MainThread INFO Ran: {bq load --autodetect --source_format=NEWLINE_DELIMITED_JSON beam_performance.pkb_results <https://builds.apache.org/job/beam_PerformanceTests_Spark/ws/runs/6e2f6227/perfkit-bq-pub3_biby.json}> ReturnCode:1 STDOUT: Upload complete. Waiting on bqjob_r2175a0320fbf3465_00000162895f0eb3_1 ... (0s) Current status: RUNNING Waiting on bqjob_r2175a0320fbf3465_00000162895f0eb3_1 ... (0s) Current status: DONE BigQuery error in load operation: Error processing job 'apache-beam-testing:bqjob_r2175a0320fbf3465_00000162895f0eb3_1': Invalid schema update. Field timestamp has changed type from TIMESTAMP to FLOAT STDERR: /usr/lib/google-cloud-sdk/platform/bq/third_party/oauth2client/contrib/gce.py:73: UserWarning: You have requested explicit scopes to be used with a GCE service account. Using this argument will have no effect on the actual scopes for tokens requested. These scopes are set at VM instance creation time and can't be overridden in the request. warnings.warn(_SCOPES_WARNING) 2018-04-03 02:38:53,102 6e2f6227 MainThread INFO Retrying exception running IssueRetryableCommand: Command returned a non-zero exit code. 2018-04-03 02:39:11,516 6e2f6227 MainThread INFO Running: bq load --autodetect --source_format=NEWLINE_DELIMITED_JSON beam_performance.pkb_results <https://builds.apache.org/job/beam_PerformanceTests_Spark/ws/runs/6e2f6227/perfkit-bq-pub3_biby.json> 2018-04-03 02:39:13,567 6e2f6227 MainThread INFO Ran: {bq load --autodetect --source_format=NEWLINE_DELIMITED_JSON beam_performance.pkb_results <https://builds.apache.org/job/beam_PerformanceTests_Spark/ws/runs/6e2f6227/perfkit-bq-pub3_biby.json}> ReturnCode:1 STDOUT: Upload complete. Waiting on bqjob_r12814c217bba5d3f_00000162895f5fab_1 ... (0s) Current status: RUNNING Waiting on bqjob_r12814c217bba5d3f_00000162895f5fab_1 ... (0s) Current status: DONE BigQuery error in load operation: Error processing job 'apache-beam-testing:bqjob_r12814c217bba5d3f_00000162895f5fab_1': Invalid schema update. Field timestamp has changed type from TIMESTAMP to FLOAT STDERR: /usr/lib/google-cloud-sdk/platform/bq/third_party/oauth2client/contrib/gce.py:73: UserWarning: You have requested explicit scopes to be used with a GCE service account. Using this argument will have no effect on the actual scopes for tokens requested. These scopes are set at VM instance creation time and can't be overridden in the request. warnings.warn(_SCOPES_WARNING) Traceback (most recent call last): File "PerfKitBenchmarker/pkb.py", line 21, in <module> sys.exit(Main()) File "<https://builds.apache.org/job/beam_PerformanceTests_Spark/ws/PerfKitBenchmarker/perfkitbenchmarker/pkb.py";,> line 952, in Main return RunBenchmarks() File "<https://builds.apache.org/job/beam_PerformanceTests_Spark/ws/PerfKitBenchmarker/perfkitbenchmarker/pkb.py";,> line 879, in RunBenchmarks collector.PublishSamples() File "<https://builds.apache.org/job/beam_PerformanceTests_Spark/ws/PerfKitBenchmarker/perfkitbenchmarker/publisher.py";,> line 886, in PublishSamples publisher.PublishSamples(self.samples) File "<https://builds.apache.org/job/beam_PerformanceTests_Spark/ws/PerfKitBenchmarker/perfkitbenchmarker/publisher.py";,> line 538, in PublishSamples vm_util.IssueRetryableCommand(load_cmd) File "<https://builds.apache.org/job/beam_PerformanceTests_Spark/ws/PerfKitBenchmarker/perfkitbenchmarker/vm_util.py";,> line 249, in WrappedFunction return f(*args, **kwargs) File "<https://builds.apache.org/job/beam_PerformanceTests_Spark/ws/PerfKitBenchmarker/perfkitbenchmarker/vm_util.py";,> line 387, in IssueRetryableCommand 'Command returned a non-zero exit code.\n') perfkitbenchmarker.errors.CalledProcessException: Command returned a non-zero exit code. Build step 'Execute shell' marked build as failure
