See <https://builds.apache.org/job/beam_PerformanceTests_Spark/1522/display/redirect?page=changes>
Changes: [mairbek] [BEAM-3932] Adds handling of array null values to MutationSizeEstimator [lcwik] [BEAM-3326] Abstract away closing the inbound receiver, waiting for the [aromanenko.dev] [BEAM-3819] Add withRequestRecordsLimit() option to KinesisIO [altay] [BEAM-3738] Add more flake8 tests to run_pylint.sh ------------------------------------------ [...truncated 94.31 KB...] 'apache-beam-testing:bqjob_r65f2fd99cd18cf11_000001626e0bc382_1': Invalid schema update. Field timestamp has changed type from TIMESTAMP to FLOAT STDERR: /usr/lib/google-cloud-sdk/platform/bq/third_party/oauth2client/contrib/gce.py:73: UserWarning: You have requested explicit scopes to be used with a GCE service account. Using this argument will have no effect on the actual scopes for tokens requested. These scopes are set at VM instance creation time and can't be overridden in the request. warnings.warn(_SCOPES_WARNING) 2018-03-28 19:18:09,660 6cbecb05 MainThread INFO Retrying exception running IssueRetryableCommand: Command returned a non-zero exit code. 2018-03-28 19:18:25,182 6cbecb05 MainThread INFO Running: bq load --autodetect --source_format=NEWLINE_DELIMITED_JSON beam_performance.pkb_results <https://builds.apache.org/job/beam_PerformanceTests_Spark/ws/runs/6cbecb05/perfkit-bq-pub0U4ie3.json> 2018-03-28 19:18:27,434 6cbecb05 MainThread INFO Ran: {bq load --autodetect --source_format=NEWLINE_DELIMITED_JSON beam_performance.pkb_results <https://builds.apache.org/job/beam_PerformanceTests_Spark/ws/runs/6cbecb05/perfkit-bq-pub0U4ie3.json}> ReturnCode:1 STDOUT: Upload complete. Waiting on bqjob_r264016cc95880533_000001626e0c09a0_1 ... (0s) Current status: RUNNING Waiting on bqjob_r264016cc95880533_000001626e0c09a0_1 ... (0s) Current status: DONE BigQuery error in load operation: Error processing job 'apache-beam-testing:bqjob_r264016cc95880533_000001626e0c09a0_1': Invalid schema update. Field timestamp has changed type from TIMESTAMP to FLOAT STDERR: /usr/lib/google-cloud-sdk/platform/bq/third_party/oauth2client/contrib/gce.py:73: UserWarning: You have requested explicit scopes to be used with a GCE service account. Using this argument will have no effect on the actual scopes for tokens requested. These scopes are set at VM instance creation time and can't be overridden in the request. warnings.warn(_SCOPES_WARNING) 2018-03-28 19:18:27,435 6cbecb05 MainThread INFO Retrying exception running IssueRetryableCommand: Command returned a non-zero exit code. 2018-03-28 19:18:50,992 6cbecb05 MainThread INFO Running: bq load --autodetect --source_format=NEWLINE_DELIMITED_JSON beam_performance.pkb_results <https://builds.apache.org/job/beam_PerformanceTests_Spark/ws/runs/6cbecb05/perfkit-bq-pub0U4ie3.json> 2018-03-28 19:18:53,330 6cbecb05 MainThread INFO Ran: {bq load --autodetect --source_format=NEWLINE_DELIMITED_JSON beam_performance.pkb_results <https://builds.apache.org/job/beam_PerformanceTests_Spark/ws/runs/6cbecb05/perfkit-bq-pub0U4ie3.json}> ReturnCode:1 STDOUT: Upload complete. Waiting on bqjob_rca7e34e24efc7fc_000001626e0c6e88_1 ... (0s) Current status: RUNNING Waiting on bqjob_rca7e34e24efc7fc_000001626e0c6e88_1 ... (0s) Current status: DONE BigQuery error in load operation: Error processing job 'apache-beam-testing:bqjob_rca7e34e24efc7fc_000001626e0c6e88_1': Invalid schema update. Field timestamp has changed type from TIMESTAMP to FLOAT STDERR: /usr/lib/google-cloud-sdk/platform/bq/third_party/oauth2client/contrib/gce.py:73: UserWarning: You have requested explicit scopes to be used with a GCE service account. Using this argument will have no effect on the actual scopes for tokens requested. These scopes are set at VM instance creation time and can't be overridden in the request. warnings.warn(_SCOPES_WARNING) 2018-03-28 19:18:53,330 6cbecb05 MainThread INFO Retrying exception running IssueRetryableCommand: Command returned a non-zero exit code. 2018-03-28 19:19:19,461 6cbecb05 MainThread INFO Running: bq load --autodetect --source_format=NEWLINE_DELIMITED_JSON beam_performance.pkb_results <https://builds.apache.org/job/beam_PerformanceTests_Spark/ws/runs/6cbecb05/perfkit-bq-pub0U4ie3.json> 2018-03-28 19:19:25,807 6cbecb05 MainThread INFO Ran: {bq load --autodetect --source_format=NEWLINE_DELIMITED_JSON beam_performance.pkb_results <https://builds.apache.org/job/beam_PerformanceTests_Spark/ws/runs/6cbecb05/perfkit-bq-pub0U4ie3.json}> ReturnCode:1 STDOUT: Upload complete. Waiting on bqjob_r79000dfac2efcb6f_000001626e0cddbc_1 ... (0s) Current status: RUNNING Waiting on bqjob_r79000dfac2efcb6f_000001626e0cddbc_1 ... (1s) Current status: RUNNING Waiting on bqjob_r79000dfac2efcb6f_000001626e0cddbc_1 ... (2s) Current status: RUNNING Waiting on bqjob_r79000dfac2efcb6f_000001626e0cddbc_1 ... (3s) Current status: RUNNING Waiting on bqjob_r79000dfac2efcb6f_000001626e0cddbc_1 ... (4s) Current status: RUNNING Waiting on bqjob_r79000dfac2efcb6f_000001626e0cddbc_1 ... (4s) Current status: DONE BigQuery error in load operation: Error processing job 'apache-beam-testing:bqjob_r79000dfac2efcb6f_000001626e0cddbc_1': Invalid schema update. Field timestamp has changed type from TIMESTAMP to FLOAT STDERR: /usr/lib/google-cloud-sdk/platform/bq/third_party/oauth2client/contrib/gce.py:73: UserWarning: You have requested explicit scopes to be used with a GCE service account. Using this argument will have no effect on the actual scopes for tokens requested. These scopes are set at VM instance creation time and can't be overridden in the request. warnings.warn(_SCOPES_WARNING) 2018-03-28 19:19:25,808 6cbecb05 MainThread INFO Retrying exception running IssueRetryableCommand: Command returned a non-zero exit code. 2018-03-28 19:19:49,756 6cbecb05 MainThread INFO Running: bq load --autodetect --source_format=NEWLINE_DELIMITED_JSON beam_performance.pkb_results <https://builds.apache.org/job/beam_PerformanceTests_Spark/ws/runs/6cbecb05/perfkit-bq-pub0U4ie3.json> 2018-03-28 19:19:54,019 6cbecb05 MainThread INFO Ran: {bq load --autodetect --source_format=NEWLINE_DELIMITED_JSON beam_performance.pkb_results <https://builds.apache.org/job/beam_PerformanceTests_Spark/ws/runs/6cbecb05/perfkit-bq-pub0U4ie3.json}> ReturnCode:1 STDOUT: Upload complete. Waiting on bqjob_r64779d541bf9ed08_000001626e0d5412_1 ... (0s) Current status: RUNNING Waiting on bqjob_r64779d541bf9ed08_000001626e0d5412_1 ... (1s) Current status: RUNNING Waiting on bqjob_r64779d541bf9ed08_000001626e0d5412_1 ... (2s) Current status: RUNNING Waiting on bqjob_r64779d541bf9ed08_000001626e0d5412_1 ... (2s) Current status: DONE BigQuery error in load operation: Error processing job 'apache-beam-testing:bqjob_r64779d541bf9ed08_000001626e0d5412_1': Invalid schema update. Field timestamp has changed type from TIMESTAMP to FLOAT STDERR: /usr/lib/google-cloud-sdk/platform/bq/third_party/oauth2client/contrib/gce.py:73: UserWarning: You have requested explicit scopes to be used with a GCE service account. Using this argument will have no effect on the actual scopes for tokens requested. These scopes are set at VM instance creation time and can't be overridden in the request. warnings.warn(_SCOPES_WARNING) 2018-03-28 19:19:54,020 6cbecb05 MainThread INFO Retrying exception running IssueRetryableCommand: Command returned a non-zero exit code. 2018-03-28 19:20:10,091 6cbecb05 MainThread INFO Running: bq load --autodetect --source_format=NEWLINE_DELIMITED_JSON beam_performance.pkb_results <https://builds.apache.org/job/beam_PerformanceTests_Spark/ws/runs/6cbecb05/perfkit-bq-pub0U4ie3.json> 2018-03-28 19:20:12,381 6cbecb05 MainThread INFO Ran: {bq load --autodetect --source_format=NEWLINE_DELIMITED_JSON beam_performance.pkb_results <https://builds.apache.org/job/beam_PerformanceTests_Spark/ws/runs/6cbecb05/perfkit-bq-pub0U4ie3.json}> ReturnCode:1 STDOUT: Upload complete. Waiting on bqjob_r5e8430a2e0e80ce8_000001626e0da398_1 ... (0s) Current status: RUNNING Waiting on bqjob_r5e8430a2e0e80ce8_000001626e0da398_1 ... (0s) Current status: DONE BigQuery error in load operation: Error processing job 'apache-beam-testing:bqjob_r5e8430a2e0e80ce8_000001626e0da398_1': Invalid schema update. Field timestamp has changed type from TIMESTAMP to FLOAT STDERR: /usr/lib/google-cloud-sdk/platform/bq/third_party/oauth2client/contrib/gce.py:73: UserWarning: You have requested explicit scopes to be used with a GCE service account. Using this argument will have no effect on the actual scopes for tokens requested. These scopes are set at VM instance creation time and can't be overridden in the request. warnings.warn(_SCOPES_WARNING) 2018-03-28 19:20:12,382 6cbecb05 MainThread INFO Retrying exception running IssueRetryableCommand: Command returned a non-zero exit code. 2018-03-28 19:20:31,357 6cbecb05 MainThread INFO Running: bq load --autodetect --source_format=NEWLINE_DELIMITED_JSON beam_performance.pkb_results <https://builds.apache.org/job/beam_PerformanceTests_Spark/ws/runs/6cbecb05/perfkit-bq-pub0U4ie3.json> 2018-03-28 19:20:33,795 6cbecb05 MainThread INFO Ran: {bq load --autodetect --source_format=NEWLINE_DELIMITED_JSON beam_performance.pkb_results <https://builds.apache.org/job/beam_PerformanceTests_Spark/ws/runs/6cbecb05/perfkit-bq-pub0U4ie3.json}> ReturnCode:1 STDOUT: Upload complete. Waiting on bqjob_r77b5223a0dc388d9_000001626e0df682_1 ... (0s) Current status: RUNNING Waiting on bqjob_r77b5223a0dc388d9_000001626e0df682_1 ... (0s) Current status: DONE BigQuery error in load operation: Error processing job 'apache-beam-testing:bqjob_r77b5223a0dc388d9_000001626e0df682_1': Invalid schema update. Field timestamp has changed type from TIMESTAMP to FLOAT STDERR: /usr/lib/google-cloud-sdk/platform/bq/third_party/oauth2client/contrib/gce.py:73: UserWarning: You have requested explicit scopes to be used with a GCE service account. Using this argument will have no effect on the actual scopes for tokens requested. These scopes are set at VM instance creation time and can't be overridden in the request. warnings.warn(_SCOPES_WARNING) 2018-03-28 19:20:33,795 6cbecb05 MainThread INFO Retrying exception running IssueRetryableCommand: Command returned a non-zero exit code. 2018-03-28 19:20:57,701 6cbecb05 MainThread INFO Running: bq load --autodetect --source_format=NEWLINE_DELIMITED_JSON beam_performance.pkb_results <https://builds.apache.org/job/beam_PerformanceTests_Spark/ws/runs/6cbecb05/perfkit-bq-pub0U4ie3.json> 2018-03-28 19:20:59,987 6cbecb05 MainThread INFO Ran: {bq load --autodetect --source_format=NEWLINE_DELIMITED_JSON beam_performance.pkb_results <https://builds.apache.org/job/beam_PerformanceTests_Spark/ws/runs/6cbecb05/perfkit-bq-pub0U4ie3.json}> ReturnCode:1 STDOUT: Upload complete. Waiting on bqjob_r2a5ac20e4cfe8428_000001626e0e5d82_1 ... (0s) Current status: RUNNING Waiting on bqjob_r2a5ac20e4cfe8428_000001626e0e5d82_1 ... (0s) Current status: DONE BigQuery error in load operation: Error processing job 'apache-beam-testing:bqjob_r2a5ac20e4cfe8428_000001626e0e5d82_1': Invalid schema update. Field timestamp has changed type from TIMESTAMP to FLOAT STDERR: /usr/lib/google-cloud-sdk/platform/bq/third_party/oauth2client/contrib/gce.py:73: UserWarning: You have requested explicit scopes to be used with a GCE service account. Using this argument will have no effect on the actual scopes for tokens requested. These scopes are set at VM instance creation time and can't be overridden in the request. warnings.warn(_SCOPES_WARNING) 2018-03-28 19:20:59,987 6cbecb05 MainThread INFO Retrying exception running IssueRetryableCommand: Command returned a non-zero exit code. 2018-03-28 19:21:29,588 6cbecb05 MainThread INFO Running: bq load --autodetect --source_format=NEWLINE_DELIMITED_JSON beam_performance.pkb_results <https://builds.apache.org/job/beam_PerformanceTests_Spark/ws/runs/6cbecb05/perfkit-bq-pub0U4ie3.json> 2018-03-28 19:21:32,342 6cbecb05 MainThread INFO Ran: {bq load --autodetect --source_format=NEWLINE_DELIMITED_JSON beam_performance.pkb_results <https://builds.apache.org/job/beam_PerformanceTests_Spark/ws/runs/6cbecb05/perfkit-bq-pub0U4ie3.json}> ReturnCode:1 STDOUT: Upload complete. Waiting on bqjob_r5398df80764316c7_000001626e0ed9f9_1 ... (0s) Current status: RUNNING Waiting on bqjob_r5398df80764316c7_000001626e0ed9f9_1 ... (0s) Current status: DONE BigQuery error in load operation: Error processing job 'apache-beam-testing:bqjob_r5398df80764316c7_000001626e0ed9f9_1': Invalid schema update. Field timestamp has changed type from TIMESTAMP to FLOAT STDERR: /usr/lib/google-cloud-sdk/platform/bq/third_party/oauth2client/contrib/gce.py:73: UserWarning: You have requested explicit scopes to be used with a GCE service account. Using this argument will have no effect on the actual scopes for tokens requested. These scopes are set at VM instance creation time and can't be overridden in the request. warnings.warn(_SCOPES_WARNING) 2018-03-28 19:21:32,343 6cbecb05 MainThread INFO Retrying exception running IssueRetryableCommand: Command returned a non-zero exit code. 2018-03-28 19:21:54,955 6cbecb05 MainThread INFO Running: bq load --autodetect --source_format=NEWLINE_DELIMITED_JSON beam_performance.pkb_results <https://builds.apache.org/job/beam_PerformanceTests_Spark/ws/runs/6cbecb05/perfkit-bq-pub0U4ie3.json> 2018-03-28 19:21:57,101 6cbecb05 MainThread INFO Ran: {bq load --autodetect --source_format=NEWLINE_DELIMITED_JSON beam_performance.pkb_results <https://builds.apache.org/job/beam_PerformanceTests_Spark/ws/runs/6cbecb05/perfkit-bq-pub0U4ie3.json}> ReturnCode:1 STDOUT: Upload complete. Waiting on bqjob_r407226b152e451a4_000001626e0f3d14_1 ... (0s) Current status: RUNNING Waiting on bqjob_r407226b152e451a4_000001626e0f3d14_1 ... (0s) Current status: DONE BigQuery error in load operation: Error processing job 'apache-beam-testing:bqjob_r407226b152e451a4_000001626e0f3d14_1': Invalid schema update. Field timestamp has changed type from TIMESTAMP to FLOAT STDERR: /usr/lib/google-cloud-sdk/platform/bq/third_party/oauth2client/contrib/gce.py:73: UserWarning: You have requested explicit scopes to be used with a GCE service account. Using this argument will have no effect on the actual scopes for tokens requested. These scopes are set at VM instance creation time and can't be overridden in the request. warnings.warn(_SCOPES_WARNING) 2018-03-28 19:21:57,101 6cbecb05 MainThread INFO Retrying exception running IssueRetryableCommand: Command returned a non-zero exit code. 2018-03-28 19:22:17,054 6cbecb05 MainThread INFO Running: bq load --autodetect --source_format=NEWLINE_DELIMITED_JSON beam_performance.pkb_results <https://builds.apache.org/job/beam_PerformanceTests_Spark/ws/runs/6cbecb05/perfkit-bq-pub0U4ie3.json> 2018-03-28 19:22:19,507 6cbecb05 MainThread INFO Ran: {bq load --autodetect --source_format=NEWLINE_DELIMITED_JSON beam_performance.pkb_results <https://builds.apache.org/job/beam_PerformanceTests_Spark/ws/runs/6cbecb05/perfkit-bq-pub0U4ie3.json}> ReturnCode:1 STDOUT: Upload complete. Waiting on bqjob_r5bdbe4eef2e15702_000001626e0f9369_1 ... (0s) Current status: RUNNING Waiting on bqjob_r5bdbe4eef2e15702_000001626e0f9369_1 ... (0s) Current status: DONE BigQuery error in load operation: Error processing job 'apache-beam-testing:bqjob_r5bdbe4eef2e15702_000001626e0f9369_1': Invalid schema update. Field timestamp has changed type from TIMESTAMP to FLOAT STDERR: /usr/lib/google-cloud-sdk/platform/bq/third_party/oauth2client/contrib/gce.py:73: UserWarning: You have requested explicit scopes to be used with a GCE service account. Using this argument will have no effect on the actual scopes for tokens requested. These scopes are set at VM instance creation time and can't be overridden in the request. warnings.warn(_SCOPES_WARNING) 2018-03-28 19:22:19,507 6cbecb05 MainThread INFO Retrying exception running IssueRetryableCommand: Command returned a non-zero exit code. 2018-03-28 19:22:43,731 6cbecb05 MainThread INFO Running: bq load --autodetect --source_format=NEWLINE_DELIMITED_JSON beam_performance.pkb_results <https://builds.apache.org/job/beam_PerformanceTests_Spark/ws/runs/6cbecb05/perfkit-bq-pub0U4ie3.json> 2018-03-28 19:22:45,813 6cbecb05 MainThread INFO Ran: {bq load --autodetect --source_format=NEWLINE_DELIMITED_JSON beam_performance.pkb_results <https://builds.apache.org/job/beam_PerformanceTests_Spark/ws/runs/6cbecb05/perfkit-bq-pub0U4ie3.json}> ReturnCode:1 STDOUT: Upload complete. Waiting on bqjob_r377dfe05b5297ce3_000001626e0ffba2_1 ... (0s) Current status: RUNNING Waiting on bqjob_r377dfe05b5297ce3_000001626e0ffba2_1 ... (0s) Current status: DONE BigQuery error in load operation: Error processing job 'apache-beam-testing:bqjob_r377dfe05b5297ce3_000001626e0ffba2_1': Invalid schema update. Field timestamp has changed type from TIMESTAMP to FLOAT STDERR: /usr/lib/google-cloud-sdk/platform/bq/third_party/oauth2client/contrib/gce.py:73: UserWarning: You have requested explicit scopes to be used with a GCE service account. Using this argument will have no effect on the actual scopes for tokens requested. These scopes are set at VM instance creation time and can't be overridden in the request. warnings.warn(_SCOPES_WARNING) 2018-03-28 19:22:45,814 6cbecb05 MainThread INFO Retrying exception running IssueRetryableCommand: Command returned a non-zero exit code. 2018-03-28 19:23:14,974 6cbecb05 MainThread INFO Running: bq load --autodetect --source_format=NEWLINE_DELIMITED_JSON beam_performance.pkb_results <https://builds.apache.org/job/beam_PerformanceTests_Spark/ws/runs/6cbecb05/perfkit-bq-pub0U4ie3.json> 2018-03-28 19:23:17,103 6cbecb05 MainThread INFO Ran: {bq load --autodetect --source_format=NEWLINE_DELIMITED_JSON beam_performance.pkb_results <https://builds.apache.org/job/beam_PerformanceTests_Spark/ws/runs/6cbecb05/perfkit-bq-pub0U4ie3.json}> ReturnCode:1 STDOUT: Upload complete. Waiting on bqjob_r3f52e636a88dedc4_000001626e1075ab_1 ... (0s) Current status: RUNNING Waiting on bqjob_r3f52e636a88dedc4_000001626e1075ab_1 ... (0s) Current status: DONE BigQuery error in load operation: Error processing job 'apache-beam-testing:bqjob_r3f52e636a88dedc4_000001626e1075ab_1': Invalid schema update. Field timestamp has changed type from TIMESTAMP to FLOAT STDERR: /usr/lib/google-cloud-sdk/platform/bq/third_party/oauth2client/contrib/gce.py:73: UserWarning: You have requested explicit scopes to be used with a GCE service account. Using this argument will have no effect on the actual scopes for tokens requested. These scopes are set at VM instance creation time and can't be overridden in the request. warnings.warn(_SCOPES_WARNING) 2018-03-28 19:23:17,103 6cbecb05 MainThread INFO Retrying exception running IssueRetryableCommand: Command returned a non-zero exit code. 2018-03-28 19:23:36,153 6cbecb05 MainThread INFO Running: bq load --autodetect --source_format=NEWLINE_DELIMITED_JSON beam_performance.pkb_results <https://builds.apache.org/job/beam_PerformanceTests_Spark/ws/runs/6cbecb05/perfkit-bq-pub0U4ie3.json> 2018-03-28 19:23:38,206 6cbecb05 MainThread INFO Ran: {bq load --autodetect --source_format=NEWLINE_DELIMITED_JSON beam_performance.pkb_results <https://builds.apache.org/job/beam_PerformanceTests_Spark/ws/runs/6cbecb05/perfkit-bq-pub0U4ie3.json}> ReturnCode:1 STDOUT: Upload complete. Waiting on bqjob_r7e098794335cb139_000001626e10c862_1 ... (0s) Current status: RUNNING Waiting on bqjob_r7e098794335cb139_000001626e10c862_1 ... (0s) Current status: DONE BigQuery error in load operation: Error processing job 'apache-beam-testing:bqjob_r7e098794335cb139_000001626e10c862_1': Invalid schema update. Field timestamp has changed type from TIMESTAMP to FLOAT STDERR: /usr/lib/google-cloud-sdk/platform/bq/third_party/oauth2client/contrib/gce.py:73: UserWarning: You have requested explicit scopes to be used with a GCE service account. Using this argument will have no effect on the actual scopes for tokens requested. These scopes are set at VM instance creation time and can't be overridden in the request. warnings.warn(_SCOPES_WARNING) Traceback (most recent call last): File "PerfKitBenchmarker/pkb.py", line 21, in <module> sys.exit(Main()) File "<https://builds.apache.org/job/beam_PerformanceTests_Spark/ws/PerfKitBenchmarker/perfkitbenchmarker/pkb.py";,> line 952, in Main return RunBenchmarks() File "<https://builds.apache.org/job/beam_PerformanceTests_Spark/ws/PerfKitBenchmarker/perfkitbenchmarker/pkb.py";,> line 879, in RunBenchmarks collector.PublishSamples() File "<https://builds.apache.org/job/beam_PerformanceTests_Spark/ws/PerfKitBenchmarker/perfkitbenchmarker/publisher.py";,> line 886, in PublishSamples publisher.PublishSamples(self.samples) File "<https://builds.apache.org/job/beam_PerformanceTests_Spark/ws/PerfKitBenchmarker/perfkitbenchmarker/publisher.py";,> line 538, in PublishSamples vm_util.IssueRetryableCommand(load_cmd) File "<https://builds.apache.org/job/beam_PerformanceTests_Spark/ws/PerfKitBenchmarker/perfkitbenchmarker/vm_util.py";,> line 249, in WrappedFunction return f(*args, **kwargs) File "<https://builds.apache.org/job/beam_PerformanceTests_Spark/ws/PerfKitBenchmarker/perfkitbenchmarker/vm_util.py";,> line 387, in IssueRetryableCommand 'Command returned a non-zero exit code.\n') perfkitbenchmarker.errors.CalledProcessException: Command returned a non-zero exit code. Build step 'Execute shell' marked build as failure
