See <https://builds.apache.org/job/beam_PerformanceTests_Spark/1576/display/redirect?page=changes>
Changes: [robertwb] Use valid name for fake ArgSpec args. [ccy] Update DataflowRunner to suppress duplicate system messages [Pablo] Fixing data race in statesampler_fast. [swegner] Decrease flink ValidatesRunner maxParallelForks from 4 to 2 in order to [herohde] [BEAM-4015] Always update Go dependences in Maven build [herohde] Update Go maven plugin ------------------------------------------ [...truncated 89.48 KB...] 'apache-beam-testing:bqjob_r5243450914a1b779_00000162b35cbe7d_1': Invalid schema update. Field timestamp has changed type from TIMESTAMP to FLOAT STDERR: /usr/lib/google-cloud-sdk/platform/bq/third_party/oauth2client/contrib/gce.py:73: UserWarning: You have requested explicit scopes to be used with a GCE service account. Using this argument will have no effect on the actual scopes for tokens requested. These scopes are set at VM instance creation time and can't be overridden in the request. warnings.warn(_SCOPES_WARNING) 2018-04-11 06:20:24,640 6d7e215a MainThread INFO Retrying exception running IssueRetryableCommand: Command returned a non-zero exit code. 2018-04-11 06:20:50,552 6d7e215a MainThread INFO Running: bq load --autodetect --source_format=NEWLINE_DELIMITED_JSON beam_performance.pkb_results <https://builds.apache.org/job/beam_PerformanceTests_Spark/ws/runs/6d7e215a/perfkit-bq-pub3vQgLs.json> 2018-04-11 06:20:52,946 6d7e215a MainThread INFO Ran: {bq load --autodetect --source_format=NEWLINE_DELIMITED_JSON beam_performance.pkb_results <https://builds.apache.org/job/beam_PerformanceTests_Spark/ws/runs/6d7e215a/perfkit-bq-pub3vQgLs.json}> ReturnCode:1 STDOUT: Upload complete. Waiting on bqjob_r74c396a7e922c1c3_00000162b35d2d86_1 ... (0s) Current status: RUNNING Waiting on bqjob_r74c396a7e922c1c3_00000162b35d2d86_1 ... (0s) Current status: DONE BigQuery error in load operation: Error processing job 'apache-beam-testing:bqjob_r74c396a7e922c1c3_00000162b35d2d86_1': Invalid schema update. Field timestamp has changed type from TIMESTAMP to FLOAT STDERR: /usr/lib/google-cloud-sdk/platform/bq/third_party/oauth2client/contrib/gce.py:73: UserWarning: You have requested explicit scopes to be used with a GCE service account. Using this argument will have no effect on the actual scopes for tokens requested. These scopes are set at VM instance creation time and can't be overridden in the request. warnings.warn(_SCOPES_WARNING) 2018-04-11 06:20:52,947 6d7e215a MainThread INFO Retrying exception running IssueRetryableCommand: Command returned a non-zero exit code. 2018-04-11 06:21:21,118 6d7e215a MainThread INFO Running: bq load --autodetect --source_format=NEWLINE_DELIMITED_JSON beam_performance.pkb_results <https://builds.apache.org/job/beam_PerformanceTests_Spark/ws/runs/6d7e215a/perfkit-bq-pub3vQgLs.json> 2018-04-11 06:21:23,913 6d7e215a MainThread INFO Ran: {bq load --autodetect --source_format=NEWLINE_DELIMITED_JSON beam_performance.pkb_results <https://builds.apache.org/job/beam_PerformanceTests_Spark/ws/runs/6d7e215a/perfkit-bq-pub3vQgLs.json}> ReturnCode:1 STDOUT: Upload complete. Waiting on bqjob_r47eaffa5fabc537e_00000162b35da4dc_1 ... (0s) Current status: RUNNING Waiting on bqjob_r47eaffa5fabc537e_00000162b35da4dc_1 ... (0s) Current status: DONE BigQuery error in load operation: Error processing job 'apache-beam-testing:bqjob_r47eaffa5fabc537e_00000162b35da4dc_1': Invalid schema update. Field timestamp has changed type from TIMESTAMP to FLOAT STDERR: /usr/lib/google-cloud-sdk/platform/bq/third_party/oauth2client/contrib/gce.py:73: UserWarning: You have requested explicit scopes to be used with a GCE service account. Using this argument will have no effect on the actual scopes for tokens requested. These scopes are set at VM instance creation time and can't be overridden in the request. warnings.warn(_SCOPES_WARNING) 2018-04-11 06:21:23,913 6d7e215a MainThread INFO Retrying exception running IssueRetryableCommand: Command returned a non-zero exit code. 2018-04-11 06:21:53,735 6d7e215a MainThread INFO Running: bq load --autodetect --source_format=NEWLINE_DELIMITED_JSON beam_performance.pkb_results <https://builds.apache.org/job/beam_PerformanceTests_Spark/ws/runs/6d7e215a/perfkit-bq-pub3vQgLs.json> 2018-04-11 06:21:56,101 6d7e215a MainThread INFO Ran: {bq load --autodetect --source_format=NEWLINE_DELIMITED_JSON beam_performance.pkb_results <https://builds.apache.org/job/beam_PerformanceTests_Spark/ws/runs/6d7e215a/perfkit-bq-pub3vQgLs.json}> ReturnCode:1 STDOUT: Upload complete. Waiting on bqjob_r35638e5254a0690f_00000162b35e23c9_1 ... (0s) Current status: RUNNING Waiting on bqjob_r35638e5254a0690f_00000162b35e23c9_1 ... (0s) Current status: DONE BigQuery error in load operation: Error processing job 'apache-beam-testing:bqjob_r35638e5254a0690f_00000162b35e23c9_1': Invalid schema update. Field timestamp has changed type from TIMESTAMP to FLOAT STDERR: /usr/lib/google-cloud-sdk/platform/bq/third_party/oauth2client/contrib/gce.py:73: UserWarning: You have requested explicit scopes to be used with a GCE service account. Using this argument will have no effect on the actual scopes for tokens requested. These scopes are set at VM instance creation time and can't be overridden in the request. warnings.warn(_SCOPES_WARNING) 2018-04-11 06:21:56,101 6d7e215a MainThread INFO Retrying exception running IssueRetryableCommand: Command returned a non-zero exit code. 2018-04-11 06:22:12,200 6d7e215a MainThread INFO Running: bq load --autodetect --source_format=NEWLINE_DELIMITED_JSON beam_performance.pkb_results <https://builds.apache.org/job/beam_PerformanceTests_Spark/ws/runs/6d7e215a/perfkit-bq-pub3vQgLs.json> 2018-04-11 06:22:14,244 6d7e215a MainThread INFO Ran: {bq load --autodetect --source_format=NEWLINE_DELIMITED_JSON beam_performance.pkb_results <https://builds.apache.org/job/beam_PerformanceTests_Spark/ws/runs/6d7e215a/perfkit-bq-pub3vQgLs.json}> ReturnCode:1 STDOUT: Upload complete. Waiting on bqjob_r3548c34c02b61c81_00000162b35e6be7_1 ... (0s) Current status: RUNNING Waiting on bqjob_r3548c34c02b61c81_00000162b35e6be7_1 ... (0s) Current status: DONE BigQuery error in load operation: Error processing job 'apache-beam-testing:bqjob_r3548c34c02b61c81_00000162b35e6be7_1': Invalid schema update. Field timestamp has changed type from TIMESTAMP to FLOAT STDERR: /usr/lib/google-cloud-sdk/platform/bq/third_party/oauth2client/contrib/gce.py:73: UserWarning: You have requested explicit scopes to be used with a GCE service account. Using this argument will have no effect on the actual scopes for tokens requested. These scopes are set at VM instance creation time and can't be overridden in the request. warnings.warn(_SCOPES_WARNING) 2018-04-11 06:22:14,244 6d7e215a MainThread INFO Retrying exception running IssueRetryableCommand: Command returned a non-zero exit code. 2018-04-11 06:22:36,495 6d7e215a MainThread INFO Running: bq load --autodetect --source_format=NEWLINE_DELIMITED_JSON beam_performance.pkb_results <https://builds.apache.org/job/beam_PerformanceTests_Spark/ws/runs/6d7e215a/perfkit-bq-pub3vQgLs.json> 2018-04-11 06:22:38,674 6d7e215a MainThread INFO Ran: {bq load --autodetect --source_format=NEWLINE_DELIMITED_JSON beam_performance.pkb_results <https://builds.apache.org/job/beam_PerformanceTests_Spark/ws/runs/6d7e215a/perfkit-bq-pub3vQgLs.json}> ReturnCode:1 STDOUT: Upload complete. Waiting on bqjob_r11c54d6419fb7644_00000162b35ecad2_1 ... (0s) Current status: RUNNING Waiting on bqjob_r11c54d6419fb7644_00000162b35ecad2_1 ... (0s) Current status: DONE BigQuery error in load operation: Error processing job 'apache-beam-testing:bqjob_r11c54d6419fb7644_00000162b35ecad2_1': Invalid schema update. Field timestamp has changed type from TIMESTAMP to FLOAT STDERR: /usr/lib/google-cloud-sdk/platform/bq/third_party/oauth2client/contrib/gce.py:73: UserWarning: You have requested explicit scopes to be used with a GCE service account. Using this argument will have no effect on the actual scopes for tokens requested. These scopes are set at VM instance creation time and can't be overridden in the request. warnings.warn(_SCOPES_WARNING) 2018-04-11 06:22:38,674 6d7e215a MainThread INFO Retrying exception running IssueRetryableCommand: Command returned a non-zero exit code. 2018-04-11 06:22:54,229 6d7e215a MainThread INFO Running: bq load --autodetect --source_format=NEWLINE_DELIMITED_JSON beam_performance.pkb_results <https://builds.apache.org/job/beam_PerformanceTests_Spark/ws/runs/6d7e215a/perfkit-bq-pub3vQgLs.json> 2018-04-11 06:23:01,546 6d7e215a MainThread INFO Ran: {bq load --autodetect --source_format=NEWLINE_DELIMITED_JSON beam_performance.pkb_results <https://builds.apache.org/job/beam_PerformanceTests_Spark/ws/runs/6d7e215a/perfkit-bq-pub3vQgLs.json}> ReturnCode:1 STDOUT: Upload complete. Waiting on bqjob_r441e4e8650eedf3c_00000162b35f101d_1 ... (0s) Current status: RUNNING Waiting on bqjob_r441e4e8650eedf3c_00000162b35f101d_1 ... (1s) Current status: RUNNING Waiting on bqjob_r441e4e8650eedf3c_00000162b35f101d_1 ... (2s) Current status: RUNNING Waiting on bqjob_r441e4e8650eedf3c_00000162b35f101d_1 ... (3s) Current status: RUNNING Waiting on bqjob_r441e4e8650eedf3c_00000162b35f101d_1 ... (4s) Current status: RUNNING Waiting on bqjob_r441e4e8650eedf3c_00000162b35f101d_1 ... (5s) Current status: RUNNING Waiting on bqjob_r441e4e8650eedf3c_00000162b35f101d_1 ... (5s) Current status: DONE BigQuery error in load operation: Error processing job 'apache-beam-testing:bqjob_r441e4e8650eedf3c_00000162b35f101d_1': Invalid schema update. Field timestamp has changed type from TIMESTAMP to FLOAT STDERR: /usr/lib/google-cloud-sdk/platform/bq/third_party/oauth2client/contrib/gce.py:73: UserWarning: You have requested explicit scopes to be used with a GCE service account. Using this argument will have no effect on the actual scopes for tokens requested. These scopes are set at VM instance creation time and can't be overridden in the request. warnings.warn(_SCOPES_WARNING) 2018-04-11 06:23:01,546 6d7e215a MainThread INFO Retrying exception running IssueRetryableCommand: Command returned a non-zero exit code. 2018-04-11 06:23:26,512 6d7e215a MainThread INFO Running: bq load --autodetect --source_format=NEWLINE_DELIMITED_JSON beam_performance.pkb_results <https://builds.apache.org/job/beam_PerformanceTests_Spark/ws/runs/6d7e215a/perfkit-bq-pub3vQgLs.json> 2018-04-11 06:23:29,221 6d7e215a MainThread INFO Ran: {bq load --autodetect --source_format=NEWLINE_DELIMITED_JSON beam_performance.pkb_results <https://builds.apache.org/job/beam_PerformanceTests_Spark/ws/runs/6d7e215a/perfkit-bq-pub3vQgLs.json}> ReturnCode:1 STDOUT: Upload complete. Waiting on bqjob_r3d64294f51f3925c_00000162b35f8e3b_1 ... (0s) Current status: RUNNING Waiting on bqjob_r3d64294f51f3925c_00000162b35f8e3b_1 ... (0s) Current status: DONE BigQuery error in load operation: Error processing job 'apache-beam-testing:bqjob_r3d64294f51f3925c_00000162b35f8e3b_1': Invalid schema update. Field timestamp has changed type from TIMESTAMP to FLOAT STDERR: /usr/lib/google-cloud-sdk/platform/bq/third_party/oauth2client/contrib/gce.py:73: UserWarning: You have requested explicit scopes to be used with a GCE service account. Using this argument will have no effect on the actual scopes for tokens requested. These scopes are set at VM instance creation time and can't be overridden in the request. warnings.warn(_SCOPES_WARNING) 2018-04-11 06:23:29,222 6d7e215a MainThread INFO Retrying exception running IssueRetryableCommand: Command returned a non-zero exit code. 2018-04-11 06:23:58,924 6d7e215a MainThread INFO Running: bq load --autodetect --source_format=NEWLINE_DELIMITED_JSON beam_performance.pkb_results <https://builds.apache.org/job/beam_PerformanceTests_Spark/ws/runs/6d7e215a/perfkit-bq-pub3vQgLs.json> 2018-04-11 06:24:01,158 6d7e215a MainThread INFO Ran: {bq load --autodetect --source_format=NEWLINE_DELIMITED_JSON beam_performance.pkb_results <https://builds.apache.org/job/beam_PerformanceTests_Spark/ws/runs/6d7e215a/perfkit-bq-pub3vQgLs.json}> ReturnCode:1 STDOUT: Upload complete. Waiting on bqjob_r161477b0faef00e3_00000162b3600cd0_1 ... (0s) Current status: RUNNING Waiting on bqjob_r161477b0faef00e3_00000162b3600cd0_1 ... (0s) Current status: DONE BigQuery error in load operation: Error processing job 'apache-beam-testing:bqjob_r161477b0faef00e3_00000162b3600cd0_1': Invalid schema update. Field timestamp has changed type from TIMESTAMP to FLOAT STDERR: /usr/lib/google-cloud-sdk/platform/bq/third_party/oauth2client/contrib/gce.py:73: UserWarning: You have requested explicit scopes to be used with a GCE service account. Using this argument will have no effect on the actual scopes for tokens requested. These scopes are set at VM instance creation time and can't be overridden in the request. warnings.warn(_SCOPES_WARNING) 2018-04-11 06:24:01,159 6d7e215a MainThread INFO Retrying exception running IssueRetryableCommand: Command returned a non-zero exit code. 2018-04-11 06:24:23,401 6d7e215a MainThread INFO Running: bq load --autodetect --source_format=NEWLINE_DELIMITED_JSON beam_performance.pkb_results <https://builds.apache.org/job/beam_PerformanceTests_Spark/ws/runs/6d7e215a/perfkit-bq-pub3vQgLs.json> 2018-04-11 06:24:25,362 6d7e215a MainThread INFO Ran: {bq load --autodetect --source_format=NEWLINE_DELIMITED_JSON beam_performance.pkb_results <https://builds.apache.org/job/beam_PerformanceTests_Spark/ws/runs/6d7e215a/perfkit-bq-pub3vQgLs.json}> ReturnCode:1 STDOUT: Upload complete. Waiting on bqjob_r138b8f8bb8cb2684_00000162b3606c6b_1 ... (0s) Current status: RUNNING Waiting on bqjob_r138b8f8bb8cb2684_00000162b3606c6b_1 ... (0s) Current status: DONE BigQuery error in load operation: Error processing job 'apache-beam-testing:bqjob_r138b8f8bb8cb2684_00000162b3606c6b_1': Invalid schema update. Field timestamp has changed type from TIMESTAMP to FLOAT STDERR: /usr/lib/google-cloud-sdk/platform/bq/third_party/oauth2client/contrib/gce.py:73: UserWarning: You have requested explicit scopes to be used with a GCE service account. Using this argument will have no effect on the actual scopes for tokens requested. These scopes are set at VM instance creation time and can't be overridden in the request. warnings.warn(_SCOPES_WARNING) 2018-04-11 06:24:25,363 6d7e215a MainThread INFO Retrying exception running IssueRetryableCommand: Command returned a non-zero exit code. 2018-04-11 06:24:41,465 6d7e215a MainThread INFO Running: bq load --autodetect --source_format=NEWLINE_DELIMITED_JSON beam_performance.pkb_results <https://builds.apache.org/job/beam_PerformanceTests_Spark/ws/runs/6d7e215a/perfkit-bq-pub3vQgLs.json> 2018-04-11 06:24:43,507 6d7e215a MainThread INFO Ran: {bq load --autodetect --source_format=NEWLINE_DELIMITED_JSON beam_performance.pkb_results <https://builds.apache.org/job/beam_PerformanceTests_Spark/ws/runs/6d7e215a/perfkit-bq-pub3vQgLs.json}> ReturnCode:1 STDOUT: Upload complete. Waiting on bqjob_r61e80d9503839b13_00000162b360b2fb_1 ... (0s) Current status: RUNNING Waiting on bqjob_r61e80d9503839b13_00000162b360b2fb_1 ... (0s) Current status: DONE BigQuery error in load operation: Error processing job 'apache-beam-testing:bqjob_r61e80d9503839b13_00000162b360b2fb_1': Invalid schema update. Field timestamp has changed type from TIMESTAMP to FLOAT STDERR: /usr/lib/google-cloud-sdk/platform/bq/third_party/oauth2client/contrib/gce.py:73: UserWarning: You have requested explicit scopes to be used with a GCE service account. Using this argument will have no effect on the actual scopes for tokens requested. These scopes are set at VM instance creation time and can't be overridden in the request. warnings.warn(_SCOPES_WARNING) 2018-04-11 06:24:43,507 6d7e215a MainThread INFO Retrying exception running IssueRetryableCommand: Command returned a non-zero exit code. 2018-04-11 06:25:09,734 6d7e215a MainThread INFO Running: bq load --autodetect --source_format=NEWLINE_DELIMITED_JSON beam_performance.pkb_results <https://builds.apache.org/job/beam_PerformanceTests_Spark/ws/runs/6d7e215a/perfkit-bq-pub3vQgLs.json> 2018-04-11 06:25:11,881 6d7e215a MainThread INFO Ran: {bq load --autodetect --source_format=NEWLINE_DELIMITED_JSON beam_performance.pkb_results <https://builds.apache.org/job/beam_PerformanceTests_Spark/ws/runs/6d7e215a/perfkit-bq-pub3vQgLs.json}> ReturnCode:1 STDOUT: Upload complete. Waiting on bqjob_r4c1d9cb0562be6b6_00000162b3612162_1 ... (0s) Current status: RUNNING Waiting on bqjob_r4c1d9cb0562be6b6_00000162b3612162_1 ... (0s) Current status: DONE BigQuery error in load operation: Error processing job 'apache-beam-testing:bqjob_r4c1d9cb0562be6b6_00000162b3612162_1': Invalid schema update. Field timestamp has changed type from TIMESTAMP to FLOAT STDERR: /usr/lib/google-cloud-sdk/platform/bq/third_party/oauth2client/contrib/gce.py:73: UserWarning: You have requested explicit scopes to be used with a GCE service account. Using this argument will have no effect on the actual scopes for tokens requested. These scopes are set at VM instance creation time and can't be overridden in the request. warnings.warn(_SCOPES_WARNING) 2018-04-11 06:25:11,882 6d7e215a MainThread INFO Retrying exception running IssueRetryableCommand: Command returned a non-zero exit code. 2018-04-11 06:25:33,188 6d7e215a MainThread INFO Running: bq load --autodetect --source_format=NEWLINE_DELIMITED_JSON beam_performance.pkb_results <https://builds.apache.org/job/beam_PerformanceTests_Spark/ws/runs/6d7e215a/perfkit-bq-pub3vQgLs.json> 2018-04-11 06:25:35,284 6d7e215a MainThread INFO Ran: {bq load --autodetect --source_format=NEWLINE_DELIMITED_JSON beam_performance.pkb_results <https://builds.apache.org/job/beam_PerformanceTests_Spark/ws/runs/6d7e215a/perfkit-bq-pub3vQgLs.json}> ReturnCode:1 STDOUT: Upload complete. Waiting on bqjob_r13d963b271f79235_00000162b3617d00_1 ... (0s) Current status: RUNNING Waiting on bqjob_r13d963b271f79235_00000162b3617d00_1 ... (0s) Current status: DONE BigQuery error in load operation: Error processing job 'apache-beam-testing:bqjob_r13d963b271f79235_00000162b3617d00_1': Invalid schema update. Field timestamp has changed type from TIMESTAMP to FLOAT STDERR: /usr/lib/google-cloud-sdk/platform/bq/third_party/oauth2client/contrib/gce.py:73: UserWarning: You have requested explicit scopes to be used with a GCE service account. Using this argument will have no effect on the actual scopes for tokens requested. These scopes are set at VM instance creation time and can't be overridden in the request. warnings.warn(_SCOPES_WARNING) 2018-04-11 06:25:35,285 6d7e215a MainThread INFO Retrying exception running IssueRetryableCommand: Command returned a non-zero exit code. 2018-04-11 06:25:52,582 6d7e215a MainThread INFO Running: bq load --autodetect --source_format=NEWLINE_DELIMITED_JSON beam_performance.pkb_results <https://builds.apache.org/job/beam_PerformanceTests_Spark/ws/runs/6d7e215a/perfkit-bq-pub3vQgLs.json> 2018-04-11 06:26:04,854 6d7e215a MainThread INFO Ran: {bq load --autodetect --source_format=NEWLINE_DELIMITED_JSON beam_performance.pkb_results <https://builds.apache.org/job/beam_PerformanceTests_Spark/ws/runs/6d7e215a/perfkit-bq-pub3vQgLs.json}> ReturnCode:1 STDOUT: Upload complete. Waiting on bqjob_r27b0f7c3af627198_00000162b361c8c6_1 ... (0s) Current status: RUNNING Waiting on bqjob_r27b0f7c3af627198_00000162b361c8c6_1 ... (0s) Current status: DONE BigQuery error in load operation: Error processing job 'apache-beam-testing:bqjob_r27b0f7c3af627198_00000162b361c8c6_1': Invalid schema update. Field timestamp has changed type from TIMESTAMP to FLOAT STDERR: /usr/lib/google-cloud-sdk/platform/bq/third_party/oauth2client/contrib/gce.py:73: UserWarning: You have requested explicit scopes to be used with a GCE service account. Using this argument will have no effect on the actual scopes for tokens requested. These scopes are set at VM instance creation time and can't be overridden in the request. warnings.warn(_SCOPES_WARNING) Traceback (most recent call last): File "PerfKitBenchmarker/pkb.py", line 21, in <module> sys.exit(Main()) File "<https://builds.apache.org/job/beam_PerformanceTests_Spark/ws/PerfKitBenchmarker/perfkitbenchmarker/pkb.py";,> line 951, in Main return RunBenchmarks() File "<https://builds.apache.org/job/beam_PerformanceTests_Spark/ws/PerfKitBenchmarker/perfkitbenchmarker/pkb.py";,> line 878, in RunBenchmarks collector.PublishSamples() File "<https://builds.apache.org/job/beam_PerformanceTests_Spark/ws/PerfKitBenchmarker/perfkitbenchmarker/publisher.py";,> line 927, in PublishSamples publisher.PublishSamples(self.samples) File "<https://builds.apache.org/job/beam_PerformanceTests_Spark/ws/PerfKitBenchmarker/perfkitbenchmarker/publisher.py";,> line 538, in PublishSamples vm_util.IssueRetryableCommand(load_cmd) File "<https://builds.apache.org/job/beam_PerformanceTests_Spark/ws/PerfKitBenchmarker/perfkitbenchmarker/vm_util.py";,> line 249, in WrappedFunction return f(*args, **kwargs) File "<https://builds.apache.org/job/beam_PerformanceTests_Spark/ws/PerfKitBenchmarker/perfkitbenchmarker/vm_util.py";,> line 387, in IssueRetryableCommand 'Command returned a non-zero exit code.\n') perfkitbenchmarker.errors.CalledProcessException: Command returned a non-zero exit code. Build step 'Execute shell' marked build as failure
