See <https://builds.apache.org/job/beam_PerformanceTests_Spark/1409/display/redirect?page=changes>
Changes: [kirpichov] Makes it possible to use Wait with default windowing, eg. in batch ------------------------------------------ [...truncated 92.49 KB...] 'apache-beam-testing:bqjob_r3ee00e120b2fd54a_00000161d9c68e32_1': Invalid schema update. Field timestamp has changed type from TIMESTAMP to FLOAT STDERR: /usr/lib/google-cloud-sdk/platform/bq/third_party/oauth2client/contrib/gce.py:73: UserWarning: You have requested explicit scopes to be used with a GCE service account. Using this argument will have no effect on the actual scopes for tokens requested. These scopes are set at VM instance creation time and can't be overridden in the request. warnings.warn(_SCOPES_WARNING) 2018-02-28 00:18:47,258 2c970c09 MainThread INFO Retrying exception running IssueRetryableCommand: Command returned a non-zero exit code. 2018-02-28 00:19:05,098 2c970c09 MainThread INFO Running: bq load --autodetect --source_format=NEWLINE_DELIMITED_JSON beam_performance.pkb_results <https://builds.apache.org/job/beam_PerformanceTests_Spark/ws/runs/2c970c09/perfkit-bq-pubIhZrgN.json> 2018-02-28 00:19:07,426 2c970c09 MainThread INFO Ran: {bq load --autodetect --source_format=NEWLINE_DELIMITED_JSON beam_performance.pkb_results <https://builds.apache.org/job/beam_PerformanceTests_Spark/ws/runs/2c970c09/perfkit-bq-pubIhZrgN.json}> ReturnCode:1, WallTime:0:02.31s, CPU:0.34s, MaxMemory:25556kb STDOUT: Upload complete. Waiting on bqjob_r45c06d608fa0b5b8_00000161d9c6e288_1 ... (0s) Current status: RUNNING Waiting on bqjob_r45c06d608fa0b5b8_00000161d9c6e288_1 ... (0s) Current status: DONE BigQuery error in load operation: Error processing job 'apache-beam-testing:bqjob_r45c06d608fa0b5b8_00000161d9c6e288_1': Invalid schema update. Field timestamp has changed type from TIMESTAMP to FLOAT STDERR: /usr/lib/google-cloud-sdk/platform/bq/third_party/oauth2client/contrib/gce.py:73: UserWarning: You have requested explicit scopes to be used with a GCE service account. Using this argument will have no effect on the actual scopes for tokens requested. These scopes are set at VM instance creation time and can't be overridden in the request. warnings.warn(_SCOPES_WARNING) 2018-02-28 00:19:07,426 2c970c09 MainThread INFO Retrying exception running IssueRetryableCommand: Command returned a non-zero exit code. 2018-02-28 00:19:33,730 2c970c09 MainThread INFO Running: bq load --autodetect --source_format=NEWLINE_DELIMITED_JSON beam_performance.pkb_results <https://builds.apache.org/job/beam_PerformanceTests_Spark/ws/runs/2c970c09/perfkit-bq-pubIhZrgN.json> 2018-02-28 00:19:35,990 2c970c09 MainThread INFO Ran: {bq load --autodetect --source_format=NEWLINE_DELIMITED_JSON beam_performance.pkb_results <https://builds.apache.org/job/beam_PerformanceTests_Spark/ws/runs/2c970c09/perfkit-bq-pubIhZrgN.json}> ReturnCode:1, WallTime:0:02.25s, CPU:0.35s, MaxMemory:25508kb STDOUT: Upload complete. Waiting on bqjob_r5544eb30cce70f1c_00000161d9c7523f_1 ... (0s) Current status: RUNNING Waiting on bqjob_r5544eb30cce70f1c_00000161d9c7523f_1 ... (0s) Current status: DONE BigQuery error in load operation: Error processing job 'apache-beam-testing:bqjob_r5544eb30cce70f1c_00000161d9c7523f_1': Invalid schema update. Field timestamp has changed type from TIMESTAMP to FLOAT STDERR: /usr/lib/google-cloud-sdk/platform/bq/third_party/oauth2client/contrib/gce.py:73: UserWarning: You have requested explicit scopes to be used with a GCE service account. Using this argument will have no effect on the actual scopes for tokens requested. These scopes are set at VM instance creation time and can't be overridden in the request. warnings.warn(_SCOPES_WARNING) 2018-02-28 00:19:35,990 2c970c09 MainThread INFO Retrying exception running IssueRetryableCommand: Command returned a non-zero exit code. 2018-02-28 00:19:52,390 2c970c09 MainThread INFO Running: bq load --autodetect --source_format=NEWLINE_DELIMITED_JSON beam_performance.pkb_results <https://builds.apache.org/job/beam_PerformanceTests_Spark/ws/runs/2c970c09/perfkit-bq-pubIhZrgN.json> 2018-02-28 00:19:54,525 2c970c09 MainThread INFO Ran: {bq load --autodetect --source_format=NEWLINE_DELIMITED_JSON beam_performance.pkb_results <https://builds.apache.org/job/beam_PerformanceTests_Spark/ws/runs/2c970c09/perfkit-bq-pubIhZrgN.json}> ReturnCode:1, WallTime:0:02.12s, CPU:0.30s, MaxMemory:25488kb STDOUT: Upload complete. Waiting on bqjob_r4b65e0c396946fff_00000161d9c79b1d_1 ... (0s) Current status: RUNNING Waiting on bqjob_r4b65e0c396946fff_00000161d9c79b1d_1 ... (0s) Current status: DONE BigQuery error in load operation: Error processing job 'apache-beam-testing:bqjob_r4b65e0c396946fff_00000161d9c79b1d_1': Invalid schema update. Field timestamp has changed type from TIMESTAMP to FLOAT STDERR: /usr/lib/google-cloud-sdk/platform/bq/third_party/oauth2client/contrib/gce.py:73: UserWarning: You have requested explicit scopes to be used with a GCE service account. Using this argument will have no effect on the actual scopes for tokens requested. These scopes are set at VM instance creation time and can't be overridden in the request. warnings.warn(_SCOPES_WARNING) 2018-02-28 00:19:54,525 2c970c09 MainThread INFO Retrying exception running IssueRetryableCommand: Command returned a non-zero exit code. 2018-02-28 00:20:21,862 2c970c09 MainThread INFO Running: bq load --autodetect --source_format=NEWLINE_DELIMITED_JSON beam_performance.pkb_results <https://builds.apache.org/job/beam_PerformanceTests_Spark/ws/runs/2c970c09/perfkit-bq-pubIhZrgN.json> 2018-02-28 00:20:24,888 2c970c09 MainThread INFO Ran: {bq load --autodetect --source_format=NEWLINE_DELIMITED_JSON beam_performance.pkb_results <https://builds.apache.org/job/beam_PerformanceTests_Spark/ws/runs/2c970c09/perfkit-bq-pubIhZrgN.json}> ReturnCode:1, WallTime:0:03.00s, CPU:0.37s, MaxMemory:25572kb STDOUT: Upload complete. Waiting on bqjob_r2f0d0db625db1a8a_00000161d9c810a8_1 ... (0s) Current status: RUNNING Waiting on bqjob_r2f0d0db625db1a8a_00000161d9c810a8_1 ... (0s) Current status: DONE BigQuery error in load operation: Error processing job 'apache-beam-testing:bqjob_r2f0d0db625db1a8a_00000161d9c810a8_1': Invalid schema update. Field timestamp has changed type from TIMESTAMP to FLOAT STDERR: /usr/lib/google-cloud-sdk/platform/bq/third_party/oauth2client/contrib/gce.py:73: UserWarning: You have requested explicit scopes to be used with a GCE service account. Using this argument will have no effect on the actual scopes for tokens requested. These scopes are set at VM instance creation time and can't be overridden in the request. warnings.warn(_SCOPES_WARNING) 2018-02-28 00:20:24,888 2c970c09 MainThread INFO Retrying exception running IssueRetryableCommand: Command returned a non-zero exit code. 2018-02-28 00:20:48,862 2c970c09 MainThread INFO Running: bq load --autodetect --source_format=NEWLINE_DELIMITED_JSON beam_performance.pkb_results <https://builds.apache.org/job/beam_PerformanceTests_Spark/ws/runs/2c970c09/perfkit-bq-pubIhZrgN.json> 2018-02-28 00:20:50,852 2c970c09 MainThread INFO Ran: {bq load --autodetect --source_format=NEWLINE_DELIMITED_JSON beam_performance.pkb_results <https://builds.apache.org/job/beam_PerformanceTests_Spark/ws/runs/2c970c09/perfkit-bq-pubIhZrgN.json}> ReturnCode:1, WallTime:0:01.97s, CPU:0.26s, MaxMemory:25340kb STDOUT: Upload complete. Waiting on bqjob_r8817bf8eab73ce1_00000161d9c8776f_1 ... (0s) Current status: RUNNING Waiting on bqjob_r8817bf8eab73ce1_00000161d9c8776f_1 ... (0s) Current status: DONE BigQuery error in load operation: Error processing job 'apache-beam-testing:bqjob_r8817bf8eab73ce1_00000161d9c8776f_1': Invalid schema update. Field timestamp has changed type from TIMESTAMP to FLOAT STDERR: /usr/lib/google-cloud-sdk/platform/bq/third_party/oauth2client/contrib/gce.py:73: UserWarning: You have requested explicit scopes to be used with a GCE service account. Using this argument will have no effect on the actual scopes for tokens requested. These scopes are set at VM instance creation time and can't be overridden in the request. warnings.warn(_SCOPES_WARNING) 2018-02-28 00:20:50,852 2c970c09 MainThread INFO Retrying exception running IssueRetryableCommand: Command returned a non-zero exit code. 2018-02-28 00:21:16,514 2c970c09 MainThread INFO Running: bq load --autodetect --source_format=NEWLINE_DELIMITED_JSON beam_performance.pkb_results <https://builds.apache.org/job/beam_PerformanceTests_Spark/ws/runs/2c970c09/perfkit-bq-pubIhZrgN.json> 2018-02-28 00:21:18,700 2c970c09 MainThread INFO Ran: {bq load --autodetect --source_format=NEWLINE_DELIMITED_JSON beam_performance.pkb_results <https://builds.apache.org/job/beam_PerformanceTests_Spark/ws/runs/2c970c09/perfkit-bq-pubIhZrgN.json}> ReturnCode:1, WallTime:0:02.18s, CPU:0.35s, MaxMemory:25316kb STDOUT: Upload complete. Waiting on bqjob_r7ae1fa3fece5967c_00000161d9c8e3dd_1 ... (0s) Current status: RUNNING Waiting on bqjob_r7ae1fa3fece5967c_00000161d9c8e3dd_1 ... (0s) Current status: DONE BigQuery error in load operation: Error processing job 'apache-beam-testing:bqjob_r7ae1fa3fece5967c_00000161d9c8e3dd_1': Invalid schema update. Field timestamp has changed type from TIMESTAMP to FLOAT STDERR: /usr/lib/google-cloud-sdk/platform/bq/third_party/oauth2client/contrib/gce.py:73: UserWarning: You have requested explicit scopes to be used with a GCE service account. Using this argument will have no effect on the actual scopes for tokens requested. These scopes are set at VM instance creation time and can't be overridden in the request. warnings.warn(_SCOPES_WARNING) 2018-02-28 00:21:18,700 2c970c09 MainThread INFO Retrying exception running IssueRetryableCommand: Command returned a non-zero exit code. 2018-02-28 00:21:47,590 2c970c09 MainThread INFO Running: bq load --autodetect --source_format=NEWLINE_DELIMITED_JSON beam_performance.pkb_results <https://builds.apache.org/job/beam_PerformanceTests_Spark/ws/runs/2c970c09/perfkit-bq-pubIhZrgN.json> 2018-02-28 00:21:49,863 2c970c09 MainThread INFO Ran: {bq load --autodetect --source_format=NEWLINE_DELIMITED_JSON beam_performance.pkb_results <https://builds.apache.org/job/beam_PerformanceTests_Spark/ws/runs/2c970c09/perfkit-bq-pubIhZrgN.json}> ReturnCode:1, WallTime:0:02.26s, CPU:0.29s, MaxMemory:25344kb STDOUT: Upload complete. Waiting on bqjob_r5da47b850e3f3264_00000161d9c95d6d_1 ... (0s) Current status: RUNNING Waiting on bqjob_r5da47b850e3f3264_00000161d9c95d6d_1 ... (0s) Current status: DONE BigQuery error in load operation: Error processing job 'apache-beam-testing:bqjob_r5da47b850e3f3264_00000161d9c95d6d_1': Invalid schema update. Field timestamp has changed type from TIMESTAMP to FLOAT STDERR: /usr/lib/google-cloud-sdk/platform/bq/third_party/oauth2client/contrib/gce.py:73: UserWarning: You have requested explicit scopes to be used with a GCE service account. Using this argument will have no effect on the actual scopes for tokens requested. These scopes are set at VM instance creation time and can't be overridden in the request. warnings.warn(_SCOPES_WARNING) 2018-02-28 00:21:49,864 2c970c09 MainThread INFO Retrying exception running IssueRetryableCommand: Command returned a non-zero exit code. 2018-02-28 00:22:16,495 2c970c09 MainThread INFO Running: bq load --autodetect --source_format=NEWLINE_DELIMITED_JSON beam_performance.pkb_results <https://builds.apache.org/job/beam_PerformanceTests_Spark/ws/runs/2c970c09/perfkit-bq-pubIhZrgN.json> 2018-02-28 00:22:18,706 2c970c09 MainThread INFO Ran: {bq load --autodetect --source_format=NEWLINE_DELIMITED_JSON beam_performance.pkb_results <https://builds.apache.org/job/beam_PerformanceTests_Spark/ws/runs/2c970c09/perfkit-bq-pubIhZrgN.json}> ReturnCode:1, WallTime:0:02.20s, CPU:0.37s, MaxMemory:25320kb STDOUT: Upload complete. Waiting on bqjob_r2c1d86b2377e8882_00000161d9c9ce54_1 ... (0s) Current status: RUNNING Waiting on bqjob_r2c1d86b2377e8882_00000161d9c9ce54_1 ... (0s) Current status: DONE BigQuery error in load operation: Error processing job 'apache-beam-testing:bqjob_r2c1d86b2377e8882_00000161d9c9ce54_1': Invalid schema update. Field timestamp has changed type from TIMESTAMP to FLOAT STDERR: /usr/lib/google-cloud-sdk/platform/bq/third_party/oauth2client/contrib/gce.py:73: UserWarning: You have requested explicit scopes to be used with a GCE service account. Using this argument will have no effect on the actual scopes for tokens requested. These scopes are set at VM instance creation time and can't be overridden in the request. warnings.warn(_SCOPES_WARNING) 2018-02-28 00:22:18,707 2c970c09 MainThread INFO Retrying exception running IssueRetryableCommand: Command returned a non-zero exit code. 2018-02-28 00:22:34,134 2c970c09 MainThread INFO Running: bq load --autodetect --source_format=NEWLINE_DELIMITED_JSON beam_performance.pkb_results <https://builds.apache.org/job/beam_PerformanceTests_Spark/ws/runs/2c970c09/perfkit-bq-pubIhZrgN.json> 2018-02-28 00:22:36,531 2c970c09 MainThread INFO Ran: {bq load --autodetect --source_format=NEWLINE_DELIMITED_JSON beam_performance.pkb_results <https://builds.apache.org/job/beam_PerformanceTests_Spark/ws/runs/2c970c09/perfkit-bq-pubIhZrgN.json}> ReturnCode:1, WallTime:0:02.38s, CPU:0.32s, MaxMemory:25552kb STDOUT: Upload complete. Waiting on bqjob_rf4ff11abc181898_00000161d9ca12e8_1 ... (0s) Current status: RUNNING Waiting on bqjob_rf4ff11abc181898_00000161d9ca12e8_1 ... (0s) Current status: DONE BigQuery error in load operation: Error processing job 'apache-beam-testing:bqjob_rf4ff11abc181898_00000161d9ca12e8_1': Invalid schema update. Field timestamp has changed type from TIMESTAMP to FLOAT STDERR: /usr/lib/google-cloud-sdk/platform/bq/third_party/oauth2client/contrib/gce.py:73: UserWarning: You have requested explicit scopes to be used with a GCE service account. Using this argument will have no effect on the actual scopes for tokens requested. These scopes are set at VM instance creation time and can't be overridden in the request. warnings.warn(_SCOPES_WARNING) 2018-02-28 00:22:36,532 2c970c09 MainThread INFO Retrying exception running IssueRetryableCommand: Command returned a non-zero exit code. 2018-02-28 00:23:05,479 2c970c09 MainThread INFO Running: bq load --autodetect --source_format=NEWLINE_DELIMITED_JSON beam_performance.pkb_results <https://builds.apache.org/job/beam_PerformanceTests_Spark/ws/runs/2c970c09/perfkit-bq-pubIhZrgN.json> 2018-02-28 00:23:08,003 2c970c09 MainThread INFO Ran: {bq load --autodetect --source_format=NEWLINE_DELIMITED_JSON beam_performance.pkb_results <https://builds.apache.org/job/beam_PerformanceTests_Spark/ws/runs/2c970c09/perfkit-bq-pubIhZrgN.json}> ReturnCode:1, WallTime:0:02.51s, CPU:0.31s, MaxMemory:25448kb STDOUT: Upload complete. Waiting on bqjob_r3a26dda555eab98d_00000161d9ca8d73_1 ... (0s) Current status: RUNNING Waiting on bqjob_r3a26dda555eab98d_00000161d9ca8d73_1 ... (0s) Current status: DONE BigQuery error in load operation: Error processing job 'apache-beam-testing:bqjob_r3a26dda555eab98d_00000161d9ca8d73_1': Invalid schema update. Field timestamp has changed type from TIMESTAMP to FLOAT STDERR: /usr/lib/google-cloud-sdk/platform/bq/third_party/oauth2client/contrib/gce.py:73: UserWarning: You have requested explicit scopes to be used with a GCE service account. Using this argument will have no effect on the actual scopes for tokens requested. These scopes are set at VM instance creation time and can't be overridden in the request. warnings.warn(_SCOPES_WARNING) 2018-02-28 00:23:08,004 2c970c09 MainThread INFO Retrying exception running IssueRetryableCommand: Command returned a non-zero exit code. 2018-02-28 00:23:32,451 2c970c09 MainThread INFO Running: bq load --autodetect --source_format=NEWLINE_DELIMITED_JSON beam_performance.pkb_results <https://builds.apache.org/job/beam_PerformanceTests_Spark/ws/runs/2c970c09/perfkit-bq-pubIhZrgN.json> 2018-02-28 00:23:34,641 2c970c09 MainThread INFO Ran: {bq load --autodetect --source_format=NEWLINE_DELIMITED_JSON beam_performance.pkb_results <https://builds.apache.org/job/beam_PerformanceTests_Spark/ws/runs/2c970c09/perfkit-bq-pubIhZrgN.json}> ReturnCode:1, WallTime:0:02.18s, CPU:0.27s, MaxMemory:25512kb STDOUT: Upload complete. Waiting on bqjob_r478ab3fd767005db_00000161d9caf663_1 ... (0s) Current status: RUNNING Waiting on bqjob_r478ab3fd767005db_00000161d9caf663_1 ... (0s) Current status: DONE BigQuery error in load operation: Error processing job 'apache-beam-testing:bqjob_r478ab3fd767005db_00000161d9caf663_1': Invalid schema update. Field timestamp has changed type from TIMESTAMP to FLOAT STDERR: /usr/lib/google-cloud-sdk/platform/bq/third_party/oauth2client/contrib/gce.py:73: UserWarning: You have requested explicit scopes to be used with a GCE service account. Using this argument will have no effect on the actual scopes for tokens requested. These scopes are set at VM instance creation time and can't be overridden in the request. warnings.warn(_SCOPES_WARNING) 2018-02-28 00:23:34,642 2c970c09 MainThread INFO Retrying exception running IssueRetryableCommand: Command returned a non-zero exit code. 2018-02-28 00:23:53,646 2c970c09 MainThread INFO Running: bq load --autodetect --source_format=NEWLINE_DELIMITED_JSON beam_performance.pkb_results <https://builds.apache.org/job/beam_PerformanceTests_Spark/ws/runs/2c970c09/perfkit-bq-pubIhZrgN.json> 2018-02-28 00:23:55,919 2c970c09 MainThread INFO Ran: {bq load --autodetect --source_format=NEWLINE_DELIMITED_JSON beam_performance.pkb_results <https://builds.apache.org/job/beam_PerformanceTests_Spark/ws/runs/2c970c09/perfkit-bq-pubIhZrgN.json}> ReturnCode:1, WallTime:0:02.26s, CPU:0.36s, MaxMemory:25336kb STDOUT: Upload complete. Waiting on bqjob_r52f9476727b21cd0_00000161d9cb49b6_1 ... (0s) Current status: RUNNING Waiting on bqjob_r52f9476727b21cd0_00000161d9cb49b6_1 ... (0s) Current status: DONE BigQuery error in load operation: Error processing job 'apache-beam-testing:bqjob_r52f9476727b21cd0_00000161d9cb49b6_1': Invalid schema update. Field timestamp has changed type from TIMESTAMP to FLOAT STDERR: /usr/lib/google-cloud-sdk/platform/bq/third_party/oauth2client/contrib/gce.py:73: UserWarning: You have requested explicit scopes to be used with a GCE service account. Using this argument will have no effect on the actual scopes for tokens requested. These scopes are set at VM instance creation time and can't be overridden in the request. warnings.warn(_SCOPES_WARNING) 2018-02-28 00:23:55,919 2c970c09 MainThread INFO Retrying exception running IssueRetryableCommand: Command returned a non-zero exit code. 2018-02-28 00:24:21,962 2c970c09 MainThread INFO Running: bq load --autodetect --source_format=NEWLINE_DELIMITED_JSON beam_performance.pkb_results <https://builds.apache.org/job/beam_PerformanceTests_Spark/ws/runs/2c970c09/perfkit-bq-pubIhZrgN.json> 2018-02-28 00:24:24,423 2c970c09 MainThread INFO Ran: {bq load --autodetect --source_format=NEWLINE_DELIMITED_JSON beam_performance.pkb_results <https://builds.apache.org/job/beam_PerformanceTests_Spark/ws/runs/2c970c09/perfkit-bq-pubIhZrgN.json}> ReturnCode:1, WallTime:0:02.44s, CPU:0.38s, MaxMemory:25568kb STDOUT: Upload complete. Waiting on bqjob_r36527bf30fc93fec_00000161d9cbb8bc_1 ... (0s) Current status: RUNNING Waiting on bqjob_r36527bf30fc93fec_00000161d9cbb8bc_1 ... (0s) Current status: DONE BigQuery error in load operation: Error processing job 'apache-beam-testing:bqjob_r36527bf30fc93fec_00000161d9cbb8bc_1': Invalid schema update. Field timestamp has changed type from TIMESTAMP to FLOAT STDERR: /usr/lib/google-cloud-sdk/platform/bq/third_party/oauth2client/contrib/gce.py:73: UserWarning: You have requested explicit scopes to be used with a GCE service account. Using this argument will have no effect on the actual scopes for tokens requested. These scopes are set at VM instance creation time and can't be overridden in the request. warnings.warn(_SCOPES_WARNING) Traceback (most recent call last): File "PerfKitBenchmarker/pkb.py", line 21, in <module> sys.exit(Main()) File "<https://builds.apache.org/job/beam_PerformanceTests_Spark/ws/PerfKitBenchmarker/perfkitbenchmarker/pkb.py";,> line 926, in Main return RunBenchmarks() File "<https://builds.apache.org/job/beam_PerformanceTests_Spark/ws/PerfKitBenchmarker/perfkitbenchmarker/pkb.py";,> line 853, in RunBenchmarks collector.PublishSamples() File "<https://builds.apache.org/job/beam_PerformanceTests_Spark/ws/PerfKitBenchmarker/perfkitbenchmarker/publisher.py";,> line 886, in PublishSamples publisher.PublishSamples(self.samples) File "<https://builds.apache.org/job/beam_PerformanceTests_Spark/ws/PerfKitBenchmarker/perfkitbenchmarker/publisher.py";,> line 538, in PublishSamples vm_util.IssueRetryableCommand(load_cmd) File "<https://builds.apache.org/job/beam_PerformanceTests_Spark/ws/PerfKitBenchmarker/perfkitbenchmarker/vm_util.py";,> line 249, in WrappedFunction return f(*args, **kwargs) File "<https://builds.apache.org/job/beam_PerformanceTests_Spark/ws/PerfKitBenchmarker/perfkitbenchmarker/vm_util.py";,> line 387, in IssueRetryableCommand 'Command returned a non-zero exit code.\n') perfkitbenchmarker.errors.CalledProcessException: Command returned a non-zero exit code. Build step 'Execute shell' marked build as failure
