See <https://builds.apache.org/job/beam_PerformanceTests_Spark/1603/display/redirect?page=changes>
Changes: [herohde] Add prototype of Go streaming on Dataflow with PubSub [ekirpichov] Fixes run_pylint to run on Mac [lukasz.gajowy] [BEAM-3942] Add Tasks for running IOITs manually using gradle [lukasz.gajowy] [BEAM-3942] Add task for running integration tests with [lukasz.gajowy] [BEAM-4099] Rebuild project before running Performance tests on Jenkins [Pablo] Restricting hosts where Python PreCommit runs due to environmental [alan.myrvold] Fix spark validates runner test by skipping ImpulseTest [Pablo] Fix in gen_protos [aaltay] Fix flaky Python local filesystem test (#5156) ------------------------------------------ [...truncated 91.94 KB...] 'apache-beam-testing:bqjob_r51c041f7a787c4d3_00000162d6314135_1': Invalid schema update. Field timestamp has changed type from TIMESTAMP to FLOAT STDERR: /usr/lib/google-cloud-sdk/platform/bq/third_party/oauth2client/contrib/gce.py:73: UserWarning: You have requested explicit scopes to be used with a GCE service account. Using this argument will have no effect on the actual scopes for tokens requested. These scopes are set at VM instance creation time and can't be overridden in the request. warnings.warn(_SCOPES_WARNING) 2018-04-18 00:39:37,144 d640ce27 MainThread INFO Retrying exception running IssueRetryableCommand: Command returned a non-zero exit code. 2018-04-18 00:39:55,993 d640ce27 MainThread INFO Running: bq load --autodetect --source_format=NEWLINE_DELIMITED_JSON beam_performance.pkb_results <https://builds.apache.org/job/beam_PerformanceTests_Spark/ws/runs/d640ce27/perfkit-bq-pububL3F0.json> 2018-04-18 00:39:58,476 d640ce27 MainThread INFO Ran: {bq load --autodetect --source_format=NEWLINE_DELIMITED_JSON beam_performance.pkb_results <https://builds.apache.org/job/beam_PerformanceTests_Spark/ws/runs/d640ce27/perfkit-bq-pububL3F0.json}> ReturnCode:1 STDOUT: Upload complete. Waiting on bqjob_r73acc86cbf45794b_00000162d63194e8_1 ... (0s) Current status: RUNNING Waiting on bqjob_r73acc86cbf45794b_00000162d63194e8_1 ... (0s) Current status: DONE BigQuery error in load operation: Error processing job 'apache-beam-testing:bqjob_r73acc86cbf45794b_00000162d63194e8_1': Invalid schema update. Field timestamp has changed type from TIMESTAMP to FLOAT STDERR: /usr/lib/google-cloud-sdk/platform/bq/third_party/oauth2client/contrib/gce.py:73: UserWarning: You have requested explicit scopes to be used with a GCE service account. Using this argument will have no effect on the actual scopes for tokens requested. These scopes are set at VM instance creation time and can't be overridden in the request. warnings.warn(_SCOPES_WARNING) 2018-04-18 00:39:58,476 d640ce27 MainThread INFO Retrying exception running IssueRetryableCommand: Command returned a non-zero exit code. 2018-04-18 00:40:28,419 d640ce27 MainThread INFO Running: bq load --autodetect --source_format=NEWLINE_DELIMITED_JSON beam_performance.pkb_results <https://builds.apache.org/job/beam_PerformanceTests_Spark/ws/runs/d640ce27/perfkit-bq-pububL3F0.json> 2018-04-18 00:40:30,766 d640ce27 MainThread INFO Ran: {bq load --autodetect --source_format=NEWLINE_DELIMITED_JSON beam_performance.pkb_results <https://builds.apache.org/job/beam_PerformanceTests_Spark/ws/runs/d640ce27/perfkit-bq-pububL3F0.json}> ReturnCode:1 STDOUT: Upload complete. Waiting on bqjob_r7d2bda087dbd509c_00000162d6321370_1 ... (0s) Current status: RUNNING Waiting on bqjob_r7d2bda087dbd509c_00000162d6321370_1 ... (0s) Current status: DONE BigQuery error in load operation: Error processing job 'apache-beam-testing:bqjob_r7d2bda087dbd509c_00000162d6321370_1': Invalid schema update. Field timestamp has changed type from TIMESTAMP to FLOAT STDERR: /usr/lib/google-cloud-sdk/platform/bq/third_party/oauth2client/contrib/gce.py:73: UserWarning: You have requested explicit scopes to be used with a GCE service account. Using this argument will have no effect on the actual scopes for tokens requested. These scopes are set at VM instance creation time and can't be overridden in the request. warnings.warn(_SCOPES_WARNING) 2018-04-18 00:40:30,767 d640ce27 MainThread INFO Retrying exception running IssueRetryableCommand: Command returned a non-zero exit code. 2018-04-18 00:40:48,830 d640ce27 MainThread INFO Running: bq load --autodetect --source_format=NEWLINE_DELIMITED_JSON beam_performance.pkb_results <https://builds.apache.org/job/beam_PerformanceTests_Spark/ws/runs/d640ce27/perfkit-bq-pububL3F0.json> 2018-04-18 00:40:51,166 d640ce27 MainThread INFO Ran: {bq load --autodetect --source_format=NEWLINE_DELIMITED_JSON beam_performance.pkb_results <https://builds.apache.org/job/beam_PerformanceTests_Spark/ws/runs/d640ce27/perfkit-bq-pububL3F0.json}> ReturnCode:1 STDOUT: Upload complete. Waiting on bqjob_r6b6d52ce3d10d0c1_00000162d6326372_1 ... (0s) Current status: RUNNING Waiting on bqjob_r6b6d52ce3d10d0c1_00000162d6326372_1 ... (0s) Current status: DONE BigQuery error in load operation: Error processing job 'apache-beam-testing:bqjob_r6b6d52ce3d10d0c1_00000162d6326372_1': Invalid schema update. Field timestamp has changed type from TIMESTAMP to FLOAT STDERR: /usr/lib/google-cloud-sdk/platform/bq/third_party/oauth2client/contrib/gce.py:73: UserWarning: You have requested explicit scopes to be used with a GCE service account. Using this argument will have no effect on the actual scopes for tokens requested. These scopes are set at VM instance creation time and can't be overridden in the request. warnings.warn(_SCOPES_WARNING) 2018-04-18 00:40:51,167 d640ce27 MainThread INFO Retrying exception running IssueRetryableCommand: Command returned a non-zero exit code. 2018-04-18 00:41:17,208 d640ce27 MainThread INFO Running: bq load --autodetect --source_format=NEWLINE_DELIMITED_JSON beam_performance.pkb_results <https://builds.apache.org/job/beam_PerformanceTests_Spark/ws/runs/d640ce27/perfkit-bq-pububL3F0.json> 2018-04-18 00:41:19,796 d640ce27 MainThread INFO Ran: {bq load --autodetect --source_format=NEWLINE_DELIMITED_JSON beam_performance.pkb_results <https://builds.apache.org/job/beam_PerformanceTests_Spark/ws/runs/d640ce27/perfkit-bq-pububL3F0.json}> ReturnCode:1 STDOUT: Upload complete. Waiting on bqjob_r304ec9043c176c08_00000162d632d2b3_1 ... (0s) Current status: RUNNING Waiting on bqjob_r304ec9043c176c08_00000162d632d2b3_1 ... (0s) Current status: DONE BigQuery error in load operation: Error processing job 'apache-beam-testing:bqjob_r304ec9043c176c08_00000162d632d2b3_1': Invalid schema update. Field timestamp has changed type from TIMESTAMP to FLOAT STDERR: /usr/lib/google-cloud-sdk/platform/bq/third_party/oauth2client/contrib/gce.py:73: UserWarning: You have requested explicit scopes to be used with a GCE service account. Using this argument will have no effect on the actual scopes for tokens requested. These scopes are set at VM instance creation time and can't be overridden in the request. warnings.warn(_SCOPES_WARNING) 2018-04-18 00:41:19,796 d640ce27 MainThread INFO Retrying exception running IssueRetryableCommand: Command returned a non-zero exit code. 2018-04-18 00:41:41,985 d640ce27 MainThread INFO Running: bq load --autodetect --source_format=NEWLINE_DELIMITED_JSON beam_performance.pkb_results <https://builds.apache.org/job/beam_PerformanceTests_Spark/ws/runs/d640ce27/perfkit-bq-pububL3F0.json> 2018-04-18 00:41:45,057 d640ce27 MainThread INFO Ran: {bq load --autodetect --source_format=NEWLINE_DELIMITED_JSON beam_performance.pkb_results <https://builds.apache.org/job/beam_PerformanceTests_Spark/ws/runs/d640ce27/perfkit-bq-pububL3F0.json}> ReturnCode:1 STDOUT: Upload complete. Waiting on bqjob_r4a5b0bf17e0061ed_00000162d633348d_1 ... (0s) Current status: RUNNING Waiting on bqjob_r4a5b0bf17e0061ed_00000162d633348d_1 ... (0s) Current status: DONE BigQuery error in load operation: Error processing job 'apache-beam-testing:bqjob_r4a5b0bf17e0061ed_00000162d633348d_1': Invalid schema update. Field timestamp has changed type from TIMESTAMP to FLOAT STDERR: /usr/lib/google-cloud-sdk/platform/bq/third_party/oauth2client/contrib/gce.py:73: UserWarning: You have requested explicit scopes to be used with a GCE service account. Using this argument will have no effect on the actual scopes for tokens requested. These scopes are set at VM instance creation time and can't be overridden in the request. warnings.warn(_SCOPES_WARNING) 2018-04-18 00:41:45,057 d640ce27 MainThread INFO Retrying exception running IssueRetryableCommand: Command returned a non-zero exit code. 2018-04-18 00:42:03,630 d640ce27 MainThread INFO Running: bq load --autodetect --source_format=NEWLINE_DELIMITED_JSON beam_performance.pkb_results <https://builds.apache.org/job/beam_PerformanceTests_Spark/ws/runs/d640ce27/perfkit-bq-pububL3F0.json> 2018-04-18 00:42:06,648 d640ce27 MainThread INFO Ran: {bq load --autodetect --source_format=NEWLINE_DELIMITED_JSON beam_performance.pkb_results <https://builds.apache.org/job/beam_PerformanceTests_Spark/ws/runs/d640ce27/perfkit-bq-pububL3F0.json}> ReturnCode:1 STDOUT: Upload complete. Waiting on bqjob_r285c7bfb744dbeb7_00000162d633892d_1 ... (0s) Current status: RUNNING Waiting on bqjob_r285c7bfb744dbeb7_00000162d633892d_1 ... (0s) Current status: DONE BigQuery error in load operation: Error processing job 'apache-beam-testing:bqjob_r285c7bfb744dbeb7_00000162d633892d_1': Invalid schema update. Field timestamp has changed type from TIMESTAMP to FLOAT STDERR: /usr/lib/google-cloud-sdk/platform/bq/third_party/oauth2client/contrib/gce.py:73: UserWarning: You have requested explicit scopes to be used with a GCE service account. Using this argument will have no effect on the actual scopes for tokens requested. These scopes are set at VM instance creation time and can't be overridden in the request. warnings.warn(_SCOPES_WARNING) 2018-04-18 00:42:06,649 d640ce27 MainThread INFO Retrying exception running IssueRetryableCommand: Command returned a non-zero exit code. 2018-04-18 00:42:32,181 d640ce27 MainThread INFO Running: bq load --autodetect --source_format=NEWLINE_DELIMITED_JSON beam_performance.pkb_results <https://builds.apache.org/job/beam_PerformanceTests_Spark/ws/runs/d640ce27/perfkit-bq-pububL3F0.json> 2018-04-18 00:42:35,221 d640ce27 MainThread INFO Ran: {bq load --autodetect --source_format=NEWLINE_DELIMITED_JSON beam_performance.pkb_results <https://builds.apache.org/job/beam_PerformanceTests_Spark/ws/runs/d640ce27/perfkit-bq-pububL3F0.json}> ReturnCode:1 STDOUT: Upload complete. Waiting on bqjob_r3baf6cbef6a0f5a5_00000162d633f7fd_1 ... (0s) Current status: RUNNING Waiting on bqjob_r3baf6cbef6a0f5a5_00000162d633f7fd_1 ... (0s) Current status: DONE BigQuery error in load operation: Error processing job 'apache-beam-testing:bqjob_r3baf6cbef6a0f5a5_00000162d633f7fd_1': Invalid schema update. Field timestamp has changed type from TIMESTAMP to FLOAT STDERR: /usr/lib/google-cloud-sdk/platform/bq/third_party/oauth2client/contrib/gce.py:73: UserWarning: You have requested explicit scopes to be used with a GCE service account. Using this argument will have no effect on the actual scopes for tokens requested. These scopes are set at VM instance creation time and can't be overridden in the request. warnings.warn(_SCOPES_WARNING) 2018-04-18 00:42:35,222 d640ce27 MainThread INFO Retrying exception running IssueRetryableCommand: Command returned a non-zero exit code. 2018-04-18 00:42:53,037 d640ce27 MainThread INFO Running: bq load --autodetect --source_format=NEWLINE_DELIMITED_JSON beam_performance.pkb_results <https://builds.apache.org/job/beam_PerformanceTests_Spark/ws/runs/d640ce27/perfkit-bq-pububL3F0.json> 2018-04-18 00:42:55,740 d640ce27 MainThread INFO Ran: {bq load --autodetect --source_format=NEWLINE_DELIMITED_JSON beam_performance.pkb_results <https://builds.apache.org/job/beam_PerformanceTests_Spark/ws/runs/d640ce27/perfkit-bq-pububL3F0.json}> ReturnCode:1 STDOUT: Upload complete. Waiting on bqjob_r1381b8b8d80aca53_00000162d63449d4_1 ... (0s) Current status: RUNNING Waiting on bqjob_r1381b8b8d80aca53_00000162d63449d4_1 ... (0s) Current status: DONE BigQuery error in load operation: Error processing job 'apache-beam-testing:bqjob_r1381b8b8d80aca53_00000162d63449d4_1': Invalid schema update. Field timestamp has changed type from TIMESTAMP to FLOAT STDERR: /usr/lib/google-cloud-sdk/platform/bq/third_party/oauth2client/contrib/gce.py:73: UserWarning: You have requested explicit scopes to be used with a GCE service account. Using this argument will have no effect on the actual scopes for tokens requested. These scopes are set at VM instance creation time and can't be overridden in the request. warnings.warn(_SCOPES_WARNING) 2018-04-18 00:42:55,740 d640ce27 MainThread INFO Retrying exception running IssueRetryableCommand: Command returned a non-zero exit code. 2018-04-18 00:43:17,174 d640ce27 MainThread INFO Running: bq load --autodetect --source_format=NEWLINE_DELIMITED_JSON beam_performance.pkb_results <https://builds.apache.org/job/beam_PerformanceTests_Spark/ws/runs/d640ce27/perfkit-bq-pububL3F0.json> 2018-04-18 00:43:19,936 d640ce27 MainThread INFO Ran: {bq load --autodetect --source_format=NEWLINE_DELIMITED_JSON beam_performance.pkb_results <https://builds.apache.org/job/beam_PerformanceTests_Spark/ws/runs/d640ce27/perfkit-bq-pububL3F0.json}> ReturnCode:1 STDOUT: Upload complete. Waiting on bqjob_rd6f86599f1b0816_00000162d634a6d2_1 ... (0s) Current status: RUNNING Waiting on bqjob_rd6f86599f1b0816_00000162d634a6d2_1 ... (0s) Current status: DONE BigQuery error in load operation: Error processing job 'apache-beam-testing:bqjob_rd6f86599f1b0816_00000162d634a6d2_1': Invalid schema update. Field timestamp has changed type from TIMESTAMP to FLOAT STDERR: /usr/lib/google-cloud-sdk/platform/bq/third_party/oauth2client/contrib/gce.py:73: UserWarning: You have requested explicit scopes to be used with a GCE service account. Using this argument will have no effect on the actual scopes for tokens requested. These scopes are set at VM instance creation time and can't be overridden in the request. warnings.warn(_SCOPES_WARNING) 2018-04-18 00:43:19,937 d640ce27 MainThread INFO Retrying exception running IssueRetryableCommand: Command returned a non-zero exit code. 2018-04-18 00:43:36,017 d640ce27 MainThread INFO Running: bq load --autodetect --source_format=NEWLINE_DELIMITED_JSON beam_performance.pkb_results <https://builds.apache.org/job/beam_PerformanceTests_Spark/ws/runs/d640ce27/perfkit-bq-pububL3F0.json> 2018-04-18 00:43:38,558 d640ce27 MainThread INFO Ran: {bq load --autodetect --source_format=NEWLINE_DELIMITED_JSON beam_performance.pkb_results <https://builds.apache.org/job/beam_PerformanceTests_Spark/ws/runs/d640ce27/perfkit-bq-pububL3F0.json}> ReturnCode:1 STDOUT: Upload complete. Waiting on bqjob_r193b59b96d1a0f77_00000162d634f0d0_1 ... (0s) Current status: RUNNING Waiting on bqjob_r193b59b96d1a0f77_00000162d634f0d0_1 ... (0s) Current status: DONE BigQuery error in load operation: Error processing job 'apache-beam-testing:bqjob_r193b59b96d1a0f77_00000162d634f0d0_1': Invalid schema update. Field timestamp has changed type from TIMESTAMP to FLOAT STDERR: /usr/lib/google-cloud-sdk/platform/bq/third_party/oauth2client/contrib/gce.py:73: UserWarning: You have requested explicit scopes to be used with a GCE service account. Using this argument will have no effect on the actual scopes for tokens requested. These scopes are set at VM instance creation time and can't be overridden in the request. warnings.warn(_SCOPES_WARNING) 2018-04-18 00:43:38,558 d640ce27 MainThread INFO Retrying exception running IssueRetryableCommand: Command returned a non-zero exit code. 2018-04-18 00:43:54,210 d640ce27 MainThread INFO Running: bq load --autodetect --source_format=NEWLINE_DELIMITED_JSON beam_performance.pkb_results <https://builds.apache.org/job/beam_PerformanceTests_Spark/ws/runs/d640ce27/perfkit-bq-pububL3F0.json> 2018-04-18 00:43:56,450 d640ce27 MainThread INFO Ran: {bq load --autodetect --source_format=NEWLINE_DELIMITED_JSON beam_performance.pkb_results <https://builds.apache.org/job/beam_PerformanceTests_Spark/ws/runs/d640ce27/perfkit-bq-pububL3F0.json}> ReturnCode:1 STDOUT: Upload complete. Waiting on bqjob_r6633b06a9d7e8712_00000162d635376b_1 ... (0s) Current status: RUNNING Waiting on bqjob_r6633b06a9d7e8712_00000162d635376b_1 ... (0s) Current status: DONE BigQuery error in load operation: Error processing job 'apache-beam-testing:bqjob_r6633b06a9d7e8712_00000162d635376b_1': Invalid schema update. Field timestamp has changed type from TIMESTAMP to FLOAT STDERR: /usr/lib/google-cloud-sdk/platform/bq/third_party/oauth2client/contrib/gce.py:73: UserWarning: You have requested explicit scopes to be used with a GCE service account. Using this argument will have no effect on the actual scopes for tokens requested. These scopes are set at VM instance creation time and can't be overridden in the request. warnings.warn(_SCOPES_WARNING) 2018-04-18 00:43:56,451 d640ce27 MainThread INFO Retrying exception running IssueRetryableCommand: Command returned a non-zero exit code. 2018-04-18 00:44:16,282 d640ce27 MainThread INFO Running: bq load --autodetect --source_format=NEWLINE_DELIMITED_JSON beam_performance.pkb_results <https://builds.apache.org/job/beam_PerformanceTests_Spark/ws/runs/d640ce27/perfkit-bq-pububL3F0.json> 2018-04-18 00:44:18,791 d640ce27 MainThread INFO Ran: {bq load --autodetect --source_format=NEWLINE_DELIMITED_JSON beam_performance.pkb_results <https://builds.apache.org/job/beam_PerformanceTests_Spark/ws/runs/d640ce27/perfkit-bq-pububL3F0.json}> ReturnCode:1 STDOUT: Upload complete. Waiting on bqjob_r20422307bb4a61c5_00000162d6358dda_1 ... (0s) Current status: RUNNING Waiting on bqjob_r20422307bb4a61c5_00000162d6358dda_1 ... (0s) Current status: DONE BigQuery error in load operation: Error processing job 'apache-beam-testing:bqjob_r20422307bb4a61c5_00000162d6358dda_1': Invalid schema update. Field timestamp has changed type from TIMESTAMP to FLOAT STDERR: /usr/lib/google-cloud-sdk/platform/bq/third_party/oauth2client/contrib/gce.py:73: UserWarning: You have requested explicit scopes to be used with a GCE service account. Using this argument will have no effect on the actual scopes for tokens requested. These scopes are set at VM instance creation time and can't be overridden in the request. warnings.warn(_SCOPES_WARNING) 2018-04-18 00:44:18,792 d640ce27 MainThread INFO Retrying exception running IssueRetryableCommand: Command returned a non-zero exit code. 2018-04-18 00:44:47,872 d640ce27 MainThread INFO Running: bq load --autodetect --source_format=NEWLINE_DELIMITED_JSON beam_performance.pkb_results <https://builds.apache.org/job/beam_PerformanceTests_Spark/ws/runs/d640ce27/perfkit-bq-pububL3F0.json> 2018-04-18 00:44:50,479 d640ce27 MainThread INFO Ran: {bq load --autodetect --source_format=NEWLINE_DELIMITED_JSON beam_performance.pkb_results <https://builds.apache.org/job/beam_PerformanceTests_Spark/ws/runs/d640ce27/perfkit-bq-pububL3F0.json}> ReturnCode:1 STDOUT: Upload complete. Waiting on bqjob_r7b05ac877c9349f5_00000162d636090c_1 ... (0s) Current status: RUNNING Waiting on bqjob_r7b05ac877c9349f5_00000162d636090c_1 ... (0s) Current status: DONE BigQuery error in load operation: Error processing job 'apache-beam-testing:bqjob_r7b05ac877c9349f5_00000162d636090c_1': Invalid schema update. Field timestamp has changed type from TIMESTAMP to FLOAT STDERR: /usr/lib/google-cloud-sdk/platform/bq/third_party/oauth2client/contrib/gce.py:73: UserWarning: You have requested explicit scopes to be used with a GCE service account. Using this argument will have no effect on the actual scopes for tokens requested. These scopes are set at VM instance creation time and can't be overridden in the request. warnings.warn(_SCOPES_WARNING) Traceback (most recent call last): File "PerfKitBenchmarker/pkb.py", line 21, in <module> sys.exit(Main()) File "<https://builds.apache.org/job/beam_PerformanceTests_Spark/ws/PerfKitBenchmarker/perfkitbenchmarker/pkb.py";,> line 975, in Main return RunBenchmarks() File "<https://builds.apache.org/job/beam_PerformanceTests_Spark/ws/PerfKitBenchmarker/perfkitbenchmarker/pkb.py";,> line 902, in RunBenchmarks collector.PublishSamples() File "<https://builds.apache.org/job/beam_PerformanceTests_Spark/ws/PerfKitBenchmarker/perfkitbenchmarker/publisher.py";,> line 927, in PublishSamples publisher.PublishSamples(self.samples) File "<https://builds.apache.org/job/beam_PerformanceTests_Spark/ws/PerfKitBenchmarker/perfkitbenchmarker/publisher.py";,> line 538, in PublishSamples vm_util.IssueRetryableCommand(load_cmd) File "<https://builds.apache.org/job/beam_PerformanceTests_Spark/ws/PerfKitBenchmarker/perfkitbenchmarker/vm_util.py";,> line 249, in WrappedFunction return f(*args, **kwargs) File "<https://builds.apache.org/job/beam_PerformanceTests_Spark/ws/PerfKitBenchmarker/perfkitbenchmarker/vm_util.py";,> line 387, in IssueRetryableCommand 'Command returned a non-zero exit code.\n') perfkitbenchmarker.errors.CalledProcessException: Command returned a non-zero exit code. Build step 'Execute shell' marked build as failure
