See <https://builds.apache.org/job/beam_PerformanceTests_Spark/1584/display/redirect?page=changes>
Changes: [tgroh] Remove AppliedPTransform methods in WatermarkManager [tgroh] Add an ExecutableGraph interface [tgroh] Genericise WatermarkManager and Dependencies ------------------------------------------ [...truncated 90.11 KB...] 'apache-beam-testing:bqjob_r29daeefc6d79d278_00000162bda91194_1': Invalid schema update. Field timestamp has changed type from TIMESTAMP to FLOAT STDERR: /usr/lib/google-cloud-sdk/platform/bq/third_party/oauth2client/contrib/gce.py:73: UserWarning: You have requested explicit scopes to be used with a GCE service account. Using this argument will have no effect on the actual scopes for tokens requested. These scopes are set at VM instance creation time and can't be overridden in the request. warnings.warn(_SCOPES_WARNING) 2018-04-13 06:19:58,502 96c39d17 MainThread INFO Retrying exception running IssueRetryableCommand: Command returned a non-zero exit code. 2018-04-13 06:20:27,272 96c39d17 MainThread INFO Running: bq load --autodetect --source_format=NEWLINE_DELIMITED_JSON beam_performance.pkb_results <https://builds.apache.org/job/beam_PerformanceTests_Spark/ws/runs/96c39d17/perfkit-bq-pub_8AQ8V.json> 2018-04-13 06:20:29,626 96c39d17 MainThread INFO Ran: {bq load --autodetect --source_format=NEWLINE_DELIMITED_JSON beam_performance.pkb_results <https://builds.apache.org/job/beam_PerformanceTests_Spark/ws/runs/96c39d17/perfkit-bq-pub_8AQ8V.json}> ReturnCode:1 STDOUT: Upload complete. Waiting on bqjob_r7c16779320fa6602_00000162bda98a0b_1 ... (0s) Current status: RUNNING Waiting on bqjob_r7c16779320fa6602_00000162bda98a0b_1 ... (0s) Current status: DONE BigQuery error in load operation: Error processing job 'apache-beam-testing:bqjob_r7c16779320fa6602_00000162bda98a0b_1': Invalid schema update. Field timestamp has changed type from TIMESTAMP to FLOAT STDERR: /usr/lib/google-cloud-sdk/platform/bq/third_party/oauth2client/contrib/gce.py:73: UserWarning: You have requested explicit scopes to be used with a GCE service account. Using this argument will have no effect on the actual scopes for tokens requested. These scopes are set at VM instance creation time and can't be overridden in the request. warnings.warn(_SCOPES_WARNING) 2018-04-13 06:20:29,626 96c39d17 MainThread INFO Retrying exception running IssueRetryableCommand: Command returned a non-zero exit code. 2018-04-13 06:20:45,877 96c39d17 MainThread INFO Running: bq load --autodetect --source_format=NEWLINE_DELIMITED_JSON beam_performance.pkb_results <https://builds.apache.org/job/beam_PerformanceTests_Spark/ws/runs/96c39d17/perfkit-bq-pub_8AQ8V.json> 2018-04-13 06:20:48,187 96c39d17 MainThread INFO Ran: {bq load --autodetect --source_format=NEWLINE_DELIMITED_JSON beam_performance.pkb_results <https://builds.apache.org/job/beam_PerformanceTests_Spark/ws/runs/96c39d17/perfkit-bq-pub_8AQ8V.json}> ReturnCode:1 STDOUT: Upload complete. Waiting on bqjob_r32131e6c55bff1cd_00000162bda9d2be_1 ... (0s) Current status: RUNNING Waiting on bqjob_r32131e6c55bff1cd_00000162bda9d2be_1 ... (0s) Current status: DONE BigQuery error in load operation: Error processing job 'apache-beam-testing:bqjob_r32131e6c55bff1cd_00000162bda9d2be_1': Invalid schema update. Field timestamp has changed type from TIMESTAMP to FLOAT STDERR: /usr/lib/google-cloud-sdk/platform/bq/third_party/oauth2client/contrib/gce.py:73: UserWarning: You have requested explicit scopes to be used with a GCE service account. Using this argument will have no effect on the actual scopes for tokens requested. These scopes are set at VM instance creation time and can't be overridden in the request. warnings.warn(_SCOPES_WARNING) 2018-04-13 06:20:48,187 96c39d17 MainThread INFO Retrying exception running IssueRetryableCommand: Command returned a non-zero exit code. 2018-04-13 06:21:06,622 96c39d17 MainThread INFO Running: bq load --autodetect --source_format=NEWLINE_DELIMITED_JSON beam_performance.pkb_results <https://builds.apache.org/job/beam_PerformanceTests_Spark/ws/runs/96c39d17/perfkit-bq-pub_8AQ8V.json> 2018-04-13 06:21:08,801 96c39d17 MainThread INFO Ran: {bq load --autodetect --source_format=NEWLINE_DELIMITED_JSON beam_performance.pkb_results <https://builds.apache.org/job/beam_PerformanceTests_Spark/ws/runs/96c39d17/perfkit-bq-pub_8AQ8V.json}> ReturnCode:1 STDOUT: Upload complete. Waiting on bqjob_r2b2bd9525d0444b5_00000162bdaa23c9_1 ... (0s) Current status: RUNNING Waiting on bqjob_r2b2bd9525d0444b5_00000162bdaa23c9_1 ... (0s) Current status: DONE BigQuery error in load operation: Error processing job 'apache-beam-testing:bqjob_r2b2bd9525d0444b5_00000162bdaa23c9_1': Invalid schema update. Field timestamp has changed type from TIMESTAMP to FLOAT STDERR: /usr/lib/google-cloud-sdk/platform/bq/third_party/oauth2client/contrib/gce.py:73: UserWarning: You have requested explicit scopes to be used with a GCE service account. Using this argument will have no effect on the actual scopes for tokens requested. These scopes are set at VM instance creation time and can't be overridden in the request. warnings.warn(_SCOPES_WARNING) 2018-04-13 06:21:08,802 96c39d17 MainThread INFO Retrying exception running IssueRetryableCommand: Command returned a non-zero exit code. 2018-04-13 06:21:28,513 96c39d17 MainThread INFO Running: bq load --autodetect --source_format=NEWLINE_DELIMITED_JSON beam_performance.pkb_results <https://builds.apache.org/job/beam_PerformanceTests_Spark/ws/runs/96c39d17/perfkit-bq-pub_8AQ8V.json> 2018-04-13 06:21:30,719 96c39d17 MainThread INFO Ran: {bq load --autodetect --source_format=NEWLINE_DELIMITED_JSON beam_performance.pkb_results <https://builds.apache.org/job/beam_PerformanceTests_Spark/ws/runs/96c39d17/perfkit-bq-pub_8AQ8V.json}> ReturnCode:1 STDOUT: Upload complete. Waiting on bqjob_r5884992255e536d1_00000162bdaa79b7_1 ... (0s) Current status: RUNNING Waiting on bqjob_r5884992255e536d1_00000162bdaa79b7_1 ... (0s) Current status: DONE BigQuery error in load operation: Error processing job 'apache-beam-testing:bqjob_r5884992255e536d1_00000162bdaa79b7_1': Invalid schema update. Field timestamp has changed type from TIMESTAMP to FLOAT STDERR: /usr/lib/google-cloud-sdk/platform/bq/third_party/oauth2client/contrib/gce.py:73: UserWarning: You have requested explicit scopes to be used with a GCE service account. Using this argument will have no effect on the actual scopes for tokens requested. These scopes are set at VM instance creation time and can't be overridden in the request. warnings.warn(_SCOPES_WARNING) 2018-04-13 06:21:30,719 96c39d17 MainThread INFO Retrying exception running IssueRetryableCommand: Command returned a non-zero exit code. 2018-04-13 06:21:57,469 96c39d17 MainThread INFO Running: bq load --autodetect --source_format=NEWLINE_DELIMITED_JSON beam_performance.pkb_results <https://builds.apache.org/job/beam_PerformanceTests_Spark/ws/runs/96c39d17/perfkit-bq-pub_8AQ8V.json> 2018-04-13 06:21:59,615 96c39d17 MainThread INFO Ran: {bq load --autodetect --source_format=NEWLINE_DELIMITED_JSON beam_performance.pkb_results <https://builds.apache.org/job/beam_PerformanceTests_Spark/ws/runs/96c39d17/perfkit-bq-pub_8AQ8V.json}> ReturnCode:1 STDOUT: Upload complete. Waiting on bqjob_r216065e0248d9535_00000162bdaaea6c_1 ... (0s) Current status: RUNNING Waiting on bqjob_r216065e0248d9535_00000162bdaaea6c_1 ... (0s) Current status: DONE BigQuery error in load operation: Error processing job 'apache-beam-testing:bqjob_r216065e0248d9535_00000162bdaaea6c_1': Invalid schema update. Field timestamp has changed type from TIMESTAMP to FLOAT STDERR: /usr/lib/google-cloud-sdk/platform/bq/third_party/oauth2client/contrib/gce.py:73: UserWarning: You have requested explicit scopes to be used with a GCE service account. Using this argument will have no effect on the actual scopes for tokens requested. These scopes are set at VM instance creation time and can't be overridden in the request. warnings.warn(_SCOPES_WARNING) 2018-04-13 06:21:59,615 96c39d17 MainThread INFO Retrying exception running IssueRetryableCommand: Command returned a non-zero exit code. 2018-04-13 06:22:23,419 96c39d17 MainThread INFO Running: bq load --autodetect --source_format=NEWLINE_DELIMITED_JSON beam_performance.pkb_results <https://builds.apache.org/job/beam_PerformanceTests_Spark/ws/runs/96c39d17/perfkit-bq-pub_8AQ8V.json> 2018-04-13 06:22:26,661 96c39d17 MainThread INFO Ran: {bq load --autodetect --source_format=NEWLINE_DELIMITED_JSON beam_performance.pkb_results <https://builds.apache.org/job/beam_PerformanceTests_Spark/ws/runs/96c39d17/perfkit-bq-pub_8AQ8V.json}> ReturnCode:1 STDOUT: Upload complete. Waiting on bqjob_r49411801c99f6655_00000162bdab4fbf_1 ... (0s) Current status: RUNNING Waiting on bqjob_r49411801c99f6655_00000162bdab4fbf_1 ... (1s) Current status: RUNNING Waiting on bqjob_r49411801c99f6655_00000162bdab4fbf_1 ... (1s) Current status: DONE BigQuery error in load operation: Error processing job 'apache-beam-testing:bqjob_r49411801c99f6655_00000162bdab4fbf_1': Invalid schema update. Field timestamp has changed type from TIMESTAMP to FLOAT STDERR: /usr/lib/google-cloud-sdk/platform/bq/third_party/oauth2client/contrib/gce.py:73: UserWarning: You have requested explicit scopes to be used with a GCE service account. Using this argument will have no effect on the actual scopes for tokens requested. These scopes are set at VM instance creation time and can't be overridden in the request. warnings.warn(_SCOPES_WARNING) 2018-04-13 06:22:26,661 96c39d17 MainThread INFO Retrying exception running IssueRetryableCommand: Command returned a non-zero exit code. 2018-04-13 06:22:56,107 96c39d17 MainThread INFO Running: bq load --autodetect --source_format=NEWLINE_DELIMITED_JSON beam_performance.pkb_results <https://builds.apache.org/job/beam_PerformanceTests_Spark/ws/runs/96c39d17/perfkit-bq-pub_8AQ8V.json> 2018-04-13 06:22:58,504 96c39d17 MainThread INFO Ran: {bq load --autodetect --source_format=NEWLINE_DELIMITED_JSON beam_performance.pkb_results <https://builds.apache.org/job/beam_PerformanceTests_Spark/ws/runs/96c39d17/perfkit-bq-pub_8AQ8V.json}> ReturnCode:1 STDOUT: Upload complete. Waiting on bqjob_r6b41c32b8929d4e2_00000162bdabcf6f_1 ... (0s) Current status: RUNNING Waiting on bqjob_r6b41c32b8929d4e2_00000162bdabcf6f_1 ... (0s) Current status: DONE BigQuery error in load operation: Error processing job 'apache-beam-testing:bqjob_r6b41c32b8929d4e2_00000162bdabcf6f_1': Invalid schema update. Field timestamp has changed type from TIMESTAMP to FLOAT STDERR: /usr/lib/google-cloud-sdk/platform/bq/third_party/oauth2client/contrib/gce.py:73: UserWarning: You have requested explicit scopes to be used with a GCE service account. Using this argument will have no effect on the actual scopes for tokens requested. These scopes are set at VM instance creation time and can't be overridden in the request. warnings.warn(_SCOPES_WARNING) 2018-04-13 06:22:58,504 96c39d17 MainThread INFO Retrying exception running IssueRetryableCommand: Command returned a non-zero exit code. 2018-04-13 06:23:27,436 96c39d17 MainThread INFO Running: bq load --autodetect --source_format=NEWLINE_DELIMITED_JSON beam_performance.pkb_results <https://builds.apache.org/job/beam_PerformanceTests_Spark/ws/runs/96c39d17/perfkit-bq-pub_8AQ8V.json> 2018-04-13 06:23:29,723 96c39d17 MainThread INFO Ran: {bq load --autodetect --source_format=NEWLINE_DELIMITED_JSON beam_performance.pkb_results <https://builds.apache.org/job/beam_PerformanceTests_Spark/ws/runs/96c39d17/perfkit-bq-pub_8AQ8V.json}> ReturnCode:1 STDOUT: Upload complete. Waiting on bqjob_r7cf27dd413947b01_00000162bdac49d0_1 ... (0s) Current status: RUNNING Waiting on bqjob_r7cf27dd413947b01_00000162bdac49d0_1 ... (0s) Current status: DONE BigQuery error in load operation: Error processing job 'apache-beam-testing:bqjob_r7cf27dd413947b01_00000162bdac49d0_1': Invalid schema update. Field timestamp has changed type from TIMESTAMP to FLOAT STDERR: /usr/lib/google-cloud-sdk/platform/bq/third_party/oauth2client/contrib/gce.py:73: UserWarning: You have requested explicit scopes to be used with a GCE service account. Using this argument will have no effect on the actual scopes for tokens requested. These scopes are set at VM instance creation time and can't be overridden in the request. warnings.warn(_SCOPES_WARNING) 2018-04-13 06:23:29,724 96c39d17 MainThread INFO Retrying exception running IssueRetryableCommand: Command returned a non-zero exit code. 2018-04-13 06:23:45,706 96c39d17 MainThread INFO Running: bq load --autodetect --source_format=NEWLINE_DELIMITED_JSON beam_performance.pkb_results <https://builds.apache.org/job/beam_PerformanceTests_Spark/ws/runs/96c39d17/perfkit-bq-pub_8AQ8V.json> 2018-04-13 06:23:47,923 96c39d17 MainThread INFO Ran: {bq load --autodetect --source_format=NEWLINE_DELIMITED_JSON beam_performance.pkb_results <https://builds.apache.org/job/beam_PerformanceTests_Spark/ws/runs/96c39d17/perfkit-bq-pub_8AQ8V.json}> ReturnCode:1 STDOUT: Upload complete. Waiting on bqjob_r7a041fae84cdf949_00000162bdac9133_1 ... (0s) Current status: RUNNING Waiting on bqjob_r7a041fae84cdf949_00000162bdac9133_1 ... (0s) Current status: DONE BigQuery error in load operation: Error processing job 'apache-beam-testing:bqjob_r7a041fae84cdf949_00000162bdac9133_1': Invalid schema update. Field timestamp has changed type from TIMESTAMP to FLOAT STDERR: /usr/lib/google-cloud-sdk/platform/bq/third_party/oauth2client/contrib/gce.py:73: UserWarning: You have requested explicit scopes to be used with a GCE service account. Using this argument will have no effect on the actual scopes for tokens requested. These scopes are set at VM instance creation time and can't be overridden in the request. warnings.warn(_SCOPES_WARNING) 2018-04-13 06:23:47,923 96c39d17 MainThread INFO Retrying exception running IssueRetryableCommand: Command returned a non-zero exit code. 2018-04-13 06:24:13,818 96c39d17 MainThread INFO Running: bq load --autodetect --source_format=NEWLINE_DELIMITED_JSON beam_performance.pkb_results <https://builds.apache.org/job/beam_PerformanceTests_Spark/ws/runs/96c39d17/perfkit-bq-pub_8AQ8V.json> 2018-04-13 06:24:20,546 96c39d17 MainThread INFO Ran: {bq load --autodetect --source_format=NEWLINE_DELIMITED_JSON beam_performance.pkb_results <https://builds.apache.org/job/beam_PerformanceTests_Spark/ws/runs/96c39d17/perfkit-bq-pub_8AQ8V.json}> ReturnCode:1 STDOUT: Upload complete. Waiting on bqjob_r759d6cdf3ceacd97_00000162bdacff04_1 ... (0s) Current status: RUNNING Waiting on bqjob_r759d6cdf3ceacd97_00000162bdacff04_1 ... (1s) Current status: RUNNING Waiting on bqjob_r759d6cdf3ceacd97_00000162bdacff04_1 ... (2s) Current status: RUNNING Waiting on bqjob_r759d6cdf3ceacd97_00000162bdacff04_1 ... (3s) Current status: RUNNING Waiting on bqjob_r759d6cdf3ceacd97_00000162bdacff04_1 ... (4s) Current status: RUNNING Waiting on bqjob_r759d6cdf3ceacd97_00000162bdacff04_1 ... (4s) Current status: DONE BigQuery error in load operation: Error processing job 'apache-beam-testing:bqjob_r759d6cdf3ceacd97_00000162bdacff04_1': Invalid schema update. Field timestamp has changed type from TIMESTAMP to FLOAT STDERR: /usr/lib/google-cloud-sdk/platform/bq/third_party/oauth2client/contrib/gce.py:73: UserWarning: You have requested explicit scopes to be used with a GCE service account. Using this argument will have no effect on the actual scopes for tokens requested. These scopes are set at VM instance creation time and can't be overridden in the request. warnings.warn(_SCOPES_WARNING) 2018-04-13 06:24:20,546 96c39d17 MainThread INFO Retrying exception running IssueRetryableCommand: Command returned a non-zero exit code. 2018-04-13 06:24:42,766 96c39d17 MainThread INFO Running: bq load --autodetect --source_format=NEWLINE_DELIMITED_JSON beam_performance.pkb_results <https://builds.apache.org/job/beam_PerformanceTests_Spark/ws/runs/96c39d17/perfkit-bq-pub_8AQ8V.json> 2018-04-13 06:24:44,896 96c39d17 MainThread INFO Ran: {bq load --autodetect --source_format=NEWLINE_DELIMITED_JSON beam_performance.pkb_results <https://builds.apache.org/job/beam_PerformanceTests_Spark/ws/runs/96c39d17/perfkit-bq-pub_8AQ8V.json}> ReturnCode:1 STDOUT: Upload complete. Waiting on bqjob_r6765b135ac729071_00000162bdad7014_1 ... (0s) Current status: RUNNING Waiting on bqjob_r6765b135ac729071_00000162bdad7014_1 ... (0s) Current status: DONE BigQuery error in load operation: Error processing job 'apache-beam-testing:bqjob_r6765b135ac729071_00000162bdad7014_1': Invalid schema update. Field timestamp has changed type from TIMESTAMP to FLOAT STDERR: /usr/lib/google-cloud-sdk/platform/bq/third_party/oauth2client/contrib/gce.py:73: UserWarning: You have requested explicit scopes to be used with a GCE service account. Using this argument will have no effect on the actual scopes for tokens requested. These scopes are set at VM instance creation time and can't be overridden in the request. warnings.warn(_SCOPES_WARNING) 2018-04-13 06:24:44,896 96c39d17 MainThread INFO Retrying exception running IssueRetryableCommand: Command returned a non-zero exit code. 2018-04-13 06:25:06,063 96c39d17 MainThread INFO Running: bq load --autodetect --source_format=NEWLINE_DELIMITED_JSON beam_performance.pkb_results <https://builds.apache.org/job/beam_PerformanceTests_Spark/ws/runs/96c39d17/perfkit-bq-pub_8AQ8V.json> 2018-04-13 06:25:08,288 96c39d17 MainThread INFO Ran: {bq load --autodetect --source_format=NEWLINE_DELIMITED_JSON beam_performance.pkb_results <https://builds.apache.org/job/beam_PerformanceTests_Spark/ws/runs/96c39d17/perfkit-bq-pub_8AQ8V.json}> ReturnCode:1 STDOUT: Upload complete. Waiting on bqjob_r37c6e48cba58d406_00000162bdadcb2d_1 ... (0s) Current status: RUNNING Waiting on bqjob_r37c6e48cba58d406_00000162bdadcb2d_1 ... (0s) Current status: DONE BigQuery error in load operation: Error processing job 'apache-beam-testing:bqjob_r37c6e48cba58d406_00000162bdadcb2d_1': Invalid schema update. Field timestamp has changed type from TIMESTAMP to FLOAT STDERR: /usr/lib/google-cloud-sdk/platform/bq/third_party/oauth2client/contrib/gce.py:73: UserWarning: You have requested explicit scopes to be used with a GCE service account. Using this argument will have no effect on the actual scopes for tokens requested. These scopes are set at VM instance creation time and can't be overridden in the request. warnings.warn(_SCOPES_WARNING) 2018-04-13 06:25:08,288 96c39d17 MainThread INFO Retrying exception running IssueRetryableCommand: Command returned a non-zero exit code. 2018-04-13 06:25:37,903 96c39d17 MainThread INFO Running: bq load --autodetect --source_format=NEWLINE_DELIMITED_JSON beam_performance.pkb_results <https://builds.apache.org/job/beam_PerformanceTests_Spark/ws/runs/96c39d17/perfkit-bq-pub_8AQ8V.json> 2018-04-13 06:25:40,206 96c39d17 MainThread INFO Ran: {bq load --autodetect --source_format=NEWLINE_DELIMITED_JSON beam_performance.pkb_results <https://builds.apache.org/job/beam_PerformanceTests_Spark/ws/runs/96c39d17/perfkit-bq-pub_8AQ8V.json}> ReturnCode:1 STDOUT: Upload complete. Waiting on bqjob_r702c51c0b2e40250_00000162bdae4770_1 ... (0s) Current status: RUNNING Waiting on bqjob_r702c51c0b2e40250_00000162bdae4770_1 ... (0s) Current status: DONE BigQuery error in load operation: Error processing job 'apache-beam-testing:bqjob_r702c51c0b2e40250_00000162bdae4770_1': Invalid schema update. Field timestamp has changed type from TIMESTAMP to FLOAT STDERR: /usr/lib/google-cloud-sdk/platform/bq/third_party/oauth2client/contrib/gce.py:73: UserWarning: You have requested explicit scopes to be used with a GCE service account. Using this argument will have no effect on the actual scopes for tokens requested. These scopes are set at VM instance creation time and can't be overridden in the request. warnings.warn(_SCOPES_WARNING) Traceback (most recent call last): File "PerfKitBenchmarker/pkb.py", line 21, in <module> sys.exit(Main()) File "<https://builds.apache.org/job/beam_PerformanceTests_Spark/ws/PerfKitBenchmarker/perfkitbenchmarker/pkb.py";,> line 951, in Main return RunBenchmarks() File "<https://builds.apache.org/job/beam_PerformanceTests_Spark/ws/PerfKitBenchmarker/perfkitbenchmarker/pkb.py";,> line 878, in RunBenchmarks collector.PublishSamples() File "<https://builds.apache.org/job/beam_PerformanceTests_Spark/ws/PerfKitBenchmarker/perfkitbenchmarker/publisher.py";,> line 927, in PublishSamples publisher.PublishSamples(self.samples) File "<https://builds.apache.org/job/beam_PerformanceTests_Spark/ws/PerfKitBenchmarker/perfkitbenchmarker/publisher.py";,> line 538, in PublishSamples vm_util.IssueRetryableCommand(load_cmd) File "<https://builds.apache.org/job/beam_PerformanceTests_Spark/ws/PerfKitBenchmarker/perfkitbenchmarker/vm_util.py";,> line 249, in WrappedFunction return f(*args, **kwargs) File "<https://builds.apache.org/job/beam_PerformanceTests_Spark/ws/PerfKitBenchmarker/perfkitbenchmarker/vm_util.py";,> line 387, in IssueRetryableCommand 'Command returned a non-zero exit code.\n') perfkitbenchmarker.errors.CalledProcessException: Command returned a non-zero exit code. Build step 'Execute shell' marked build as failure
