See <https://builds.apache.org/job/beam_PerformanceTests_Spark/1586/display/redirect?page=changes>
Changes: [ehudm] Add lint checks for modules under sdks/python/. [kedin] Add Row Json Deserializer [kedin] Add RowJsonValueExtractors [aaltay] [BEAM-4028] Adding NameContext to Python SDK. (#5043) ------------------------------------------ [...truncated 88.52 KB...] 'apache-beam-testing:bqjob_r50269718b66c2f16_00000162c0407f57_1': Invalid schema update. Field timestamp has changed type from TIMESTAMP to FLOAT STDERR: /usr/lib/google-cloud-sdk/platform/bq/third_party/oauth2client/contrib/gce.py:73: UserWarning: You have requested explicit scopes to be used with a GCE service account. Using this argument will have no effect on the actual scopes for tokens requested. These scopes are set at VM instance creation time and can't be overridden in the request. warnings.warn(_SCOPES_WARNING) 2018-04-13 18:24:37,037 b58e2e45 MainThread INFO Retrying exception running IssueRetryableCommand: Command returned a non-zero exit code. 2018-04-13 18:24:57,246 b58e2e45 MainThread INFO Running: bq load --autodetect --source_format=NEWLINE_DELIMITED_JSON beam_performance.pkb_results <https://builds.apache.org/job/beam_PerformanceTests_Spark/ws/runs/b58e2e45/perfkit-bq-pubd49CbU.json> 2018-04-13 18:24:59,609 b58e2e45 MainThread INFO Ran: {bq load --autodetect --source_format=NEWLINE_DELIMITED_JSON beam_performance.pkb_results <https://builds.apache.org/job/beam_PerformanceTests_Spark/ws/runs/b58e2e45/perfkit-bq-pubd49CbU.json}> ReturnCode:1 STDOUT: Upload complete. Waiting on bqjob_r28b01afee4f06294_00000162c040d6d3_1 ... (0s) Current status: RUNNING Waiting on bqjob_r28b01afee4f06294_00000162c040d6d3_1 ... (0s) Current status: DONE BigQuery error in load operation: Error processing job 'apache-beam-testing:bqjob_r28b01afee4f06294_00000162c040d6d3_1': Invalid schema update. Field timestamp has changed type from TIMESTAMP to FLOAT STDERR: /usr/lib/google-cloud-sdk/platform/bq/third_party/oauth2client/contrib/gce.py:73: UserWarning: You have requested explicit scopes to be used with a GCE service account. Using this argument will have no effect on the actual scopes for tokens requested. These scopes are set at VM instance creation time and can't be overridden in the request. warnings.warn(_SCOPES_WARNING) 2018-04-13 18:24:59,610 b58e2e45 MainThread INFO Retrying exception running IssueRetryableCommand: Command returned a non-zero exit code. 2018-04-13 18:25:16,362 b58e2e45 MainThread INFO Running: bq load --autodetect --source_format=NEWLINE_DELIMITED_JSON beam_performance.pkb_results <https://builds.apache.org/job/beam_PerformanceTests_Spark/ws/runs/b58e2e45/perfkit-bq-pubd49CbU.json> 2018-04-13 18:25:18,695 b58e2e45 MainThread INFO Ran: {bq load --autodetect --source_format=NEWLINE_DELIMITED_JSON beam_performance.pkb_results <https://builds.apache.org/job/beam_PerformanceTests_Spark/ws/runs/b58e2e45/perfkit-bq-pubd49CbU.json}> ReturnCode:1 STDOUT: Upload complete. Waiting on bqjob_r4a79861ec52cff9a_00000162c041219b_1 ... (0s) Current status: RUNNING Waiting on bqjob_r4a79861ec52cff9a_00000162c041219b_1 ... (0s) Current status: DONE BigQuery error in load operation: Error processing job 'apache-beam-testing:bqjob_r4a79861ec52cff9a_00000162c041219b_1': Invalid schema update. Field timestamp has changed type from TIMESTAMP to FLOAT STDERR: /usr/lib/google-cloud-sdk/platform/bq/third_party/oauth2client/contrib/gce.py:73: UserWarning: You have requested explicit scopes to be used with a GCE service account. Using this argument will have no effect on the actual scopes for tokens requested. These scopes are set at VM instance creation time and can't be overridden in the request. warnings.warn(_SCOPES_WARNING) 2018-04-13 18:25:18,696 b58e2e45 MainThread INFO Retrying exception running IssueRetryableCommand: Command returned a non-zero exit code. 2018-04-13 18:25:35,888 b58e2e45 MainThread INFO Running: bq load --autodetect --source_format=NEWLINE_DELIMITED_JSON beam_performance.pkb_results <https://builds.apache.org/job/beam_PerformanceTests_Spark/ws/runs/b58e2e45/perfkit-bq-pubd49CbU.json> 2018-04-13 18:25:38,398 b58e2e45 MainThread INFO Ran: {bq load --autodetect --source_format=NEWLINE_DELIMITED_JSON beam_performance.pkb_results <https://builds.apache.org/job/beam_PerformanceTests_Spark/ws/runs/b58e2e45/perfkit-bq-pubd49CbU.json}> ReturnCode:1 STDOUT: Upload complete. Waiting on bqjob_r1ae8607e47df9cba_00000162c0416e8d_1 ... (0s) Current status: RUNNING Waiting on bqjob_r1ae8607e47df9cba_00000162c0416e8d_1 ... (0s) Current status: DONE BigQuery error in load operation: Error processing job 'apache-beam-testing:bqjob_r1ae8607e47df9cba_00000162c0416e8d_1': Invalid schema update. Field timestamp has changed type from TIMESTAMP to FLOAT STDERR: /usr/lib/google-cloud-sdk/platform/bq/third_party/oauth2client/contrib/gce.py:73: UserWarning: You have requested explicit scopes to be used with a GCE service account. Using this argument will have no effect on the actual scopes for tokens requested. These scopes are set at VM instance creation time and can't be overridden in the request. warnings.warn(_SCOPES_WARNING) 2018-04-13 18:25:38,399 b58e2e45 MainThread INFO Retrying exception running IssueRetryableCommand: Command returned a non-zero exit code. 2018-04-13 18:26:01,156 b58e2e45 MainThread INFO Running: bq load --autodetect --source_format=NEWLINE_DELIMITED_JSON beam_performance.pkb_results <https://builds.apache.org/job/beam_PerformanceTests_Spark/ws/runs/b58e2e45/perfkit-bq-pubd49CbU.json> 2018-04-13 18:26:03,489 b58e2e45 MainThread INFO Ran: {bq load --autodetect --source_format=NEWLINE_DELIMITED_JSON beam_performance.pkb_results <https://builds.apache.org/job/beam_PerformanceTests_Spark/ws/runs/b58e2e45/perfkit-bq-pubd49CbU.json}> ReturnCode:1 STDOUT: Upload complete. Waiting on bqjob_r7a041e914a1b805_00000162c041d0a7_1 ... (0s) Current status: RUNNING Waiting on bqjob_r7a041e914a1b805_00000162c041d0a7_1 ... (0s) Current status: DONE BigQuery error in load operation: Error processing job 'apache-beam-testing:bqjob_r7a041e914a1b805_00000162c041d0a7_1': Invalid schema update. Field timestamp has changed type from TIMESTAMP to FLOAT STDERR: /usr/lib/google-cloud-sdk/platform/bq/third_party/oauth2client/contrib/gce.py:73: UserWarning: You have requested explicit scopes to be used with a GCE service account. Using this argument will have no effect on the actual scopes for tokens requested. These scopes are set at VM instance creation time and can't be overridden in the request. warnings.warn(_SCOPES_WARNING) 2018-04-13 18:26:03,489 b58e2e45 MainThread INFO Retrying exception running IssueRetryableCommand: Command returned a non-zero exit code. 2018-04-13 18:26:29,525 b58e2e45 MainThread INFO Running: bq load --autodetect --source_format=NEWLINE_DELIMITED_JSON beam_performance.pkb_results <https://builds.apache.org/job/beam_PerformanceTests_Spark/ws/runs/b58e2e45/perfkit-bq-pubd49CbU.json> 2018-04-13 18:26:32,747 b58e2e45 MainThread INFO Ran: {bq load --autodetect --source_format=NEWLINE_DELIMITED_JSON beam_performance.pkb_results <https://builds.apache.org/job/beam_PerformanceTests_Spark/ws/runs/b58e2e45/perfkit-bq-pubd49CbU.json}> ReturnCode:1 STDOUT: Upload complete. Waiting on bqjob_r59536cfeb552bd6e_00000162c04242b1_1 ... (0s) Current status: RUNNING Waiting on bqjob_r59536cfeb552bd6e_00000162c04242b1_1 ... (0s) Current status: DONE BigQuery error in load operation: Error processing job 'apache-beam-testing:bqjob_r59536cfeb552bd6e_00000162c04242b1_1': Invalid schema update. Field timestamp has changed type from TIMESTAMP to FLOAT STDERR: /usr/lib/google-cloud-sdk/platform/bq/third_party/oauth2client/contrib/gce.py:73: UserWarning: You have requested explicit scopes to be used with a GCE service account. Using this argument will have no effect on the actual scopes for tokens requested. These scopes are set at VM instance creation time and can't be overridden in the request. warnings.warn(_SCOPES_WARNING) 2018-04-13 18:26:32,748 b58e2e45 MainThread INFO Retrying exception running IssueRetryableCommand: Command returned a non-zero exit code. 2018-04-13 18:26:49,849 b58e2e45 MainThread INFO Running: bq load --autodetect --source_format=NEWLINE_DELIMITED_JSON beam_performance.pkb_results <https://builds.apache.org/job/beam_PerformanceTests_Spark/ws/runs/b58e2e45/perfkit-bq-pubd49CbU.json> 2018-04-13 18:26:53,298 b58e2e45 MainThread INFO Ran: {bq load --autodetect --source_format=NEWLINE_DELIMITED_JSON beam_performance.pkb_results <https://builds.apache.org/job/beam_PerformanceTests_Spark/ws/runs/b58e2e45/perfkit-bq-pubd49CbU.json}> ReturnCode:1 STDOUT: Upload complete. Waiting on bqjob_r4a373c37bf7ae04e_00000162c04292ca_1 ... (0s) Current status: RUNNING Waiting on bqjob_r4a373c37bf7ae04e_00000162c04292ca_1 ... (0s) Current status: DONE BigQuery error in load operation: Error processing job 'apache-beam-testing:bqjob_r4a373c37bf7ae04e_00000162c04292ca_1': Invalid schema update. Field timestamp has changed type from TIMESTAMP to FLOAT STDERR: /usr/lib/google-cloud-sdk/platform/bq/third_party/oauth2client/contrib/gce.py:73: UserWarning: You have requested explicit scopes to be used with a GCE service account. Using this argument will have no effect on the actual scopes for tokens requested. These scopes are set at VM instance creation time and can't be overridden in the request. warnings.warn(_SCOPES_WARNING) 2018-04-13 18:26:53,298 b58e2e45 MainThread INFO Retrying exception running IssueRetryableCommand: Command returned a non-zero exit code. 2018-04-13 18:27:21,813 b58e2e45 MainThread INFO Running: bq load --autodetect --source_format=NEWLINE_DELIMITED_JSON beam_performance.pkb_results <https://builds.apache.org/job/beam_PerformanceTests_Spark/ws/runs/b58e2e45/perfkit-bq-pubd49CbU.json> 2018-04-13 18:27:25,411 b58e2e45 MainThread INFO Ran: {bq load --autodetect --source_format=NEWLINE_DELIMITED_JSON beam_performance.pkb_results <https://builds.apache.org/job/beam_PerformanceTests_Spark/ws/runs/b58e2e45/perfkit-bq-pubd49CbU.json}> ReturnCode:1 STDOUT: Upload complete. Waiting on bqjob_r368f391198778ccc_00000162c0431055_1 ... (0s) Current status: RUNNING Waiting on bqjob_r368f391198778ccc_00000162c0431055_1 ... (0s) Current status: DONE BigQuery error in load operation: Error processing job 'apache-beam-testing:bqjob_r368f391198778ccc_00000162c0431055_1': Invalid schema update. Field timestamp has changed type from TIMESTAMP to FLOAT STDERR: /usr/lib/google-cloud-sdk/platform/bq/third_party/oauth2client/contrib/gce.py:73: UserWarning: You have requested explicit scopes to be used with a GCE service account. Using this argument will have no effect on the actual scopes for tokens requested. These scopes are set at VM instance creation time and can't be overridden in the request. warnings.warn(_SCOPES_WARNING) 2018-04-13 18:27:25,412 b58e2e45 MainThread INFO Retrying exception running IssueRetryableCommand: Command returned a non-zero exit code. 2018-04-13 18:27:50,787 b58e2e45 MainThread INFO Running: bq load --autodetect --source_format=NEWLINE_DELIMITED_JSON beam_performance.pkb_results <https://builds.apache.org/job/beam_PerformanceTests_Spark/ws/runs/b58e2e45/perfkit-bq-pubd49CbU.json> 2018-04-13 18:27:53,543 b58e2e45 MainThread INFO Ran: {bq load --autodetect --source_format=NEWLINE_DELIMITED_JSON beam_performance.pkb_results <https://builds.apache.org/job/beam_PerformanceTests_Spark/ws/runs/b58e2e45/perfkit-bq-pubd49CbU.json}> ReturnCode:1 STDOUT: Upload complete. Waiting on bqjob_r692419527ad71ba5_00000162c0437f08_1 ... (0s) Current status: RUNNING Waiting on bqjob_r692419527ad71ba5_00000162c0437f08_1 ... (0s) Current status: DONE BigQuery error in load operation: Error processing job 'apache-beam-testing:bqjob_r692419527ad71ba5_00000162c0437f08_1': Invalid schema update. Field timestamp has changed type from TIMESTAMP to FLOAT STDERR: /usr/lib/google-cloud-sdk/platform/bq/third_party/oauth2client/contrib/gce.py:73: UserWarning: You have requested explicit scopes to be used with a GCE service account. Using this argument will have no effect on the actual scopes for tokens requested. These scopes are set at VM instance creation time and can't be overridden in the request. warnings.warn(_SCOPES_WARNING) 2018-04-13 18:27:53,544 b58e2e45 MainThread INFO Retrying exception running IssueRetryableCommand: Command returned a non-zero exit code. 2018-04-13 18:28:17,208 b58e2e45 MainThread INFO Running: bq load --autodetect --source_format=NEWLINE_DELIMITED_JSON beam_performance.pkb_results <https://builds.apache.org/job/beam_PerformanceTests_Spark/ws/runs/b58e2e45/perfkit-bq-pubd49CbU.json> 2018-04-13 18:28:19,392 b58e2e45 MainThread INFO Ran: {bq load --autodetect --source_format=NEWLINE_DELIMITED_JSON beam_performance.pkb_results <https://builds.apache.org/job/beam_PerformanceTests_Spark/ws/runs/b58e2e45/perfkit-bq-pubd49CbU.json}> ReturnCode:1 STDOUT: Upload complete. Waiting on bqjob_r3ccd9bbad6592ee7_00000162c043e429_1 ... (0s) Current status: RUNNING Waiting on bqjob_r3ccd9bbad6592ee7_00000162c043e429_1 ... (0s) Current status: DONE BigQuery error in load operation: Error processing job 'apache-beam-testing:bqjob_r3ccd9bbad6592ee7_00000162c043e429_1': Invalid schema update. Field timestamp has changed type from TIMESTAMP to FLOAT STDERR: /usr/lib/google-cloud-sdk/platform/bq/third_party/oauth2client/contrib/gce.py:73: UserWarning: You have requested explicit scopes to be used with a GCE service account. Using this argument will have no effect on the actual scopes for tokens requested. These scopes are set at VM instance creation time and can't be overridden in the request. warnings.warn(_SCOPES_WARNING) 2018-04-13 18:28:19,393 b58e2e45 MainThread INFO Retrying exception running IssueRetryableCommand: Command returned a non-zero exit code. 2018-04-13 18:28:47,768 b58e2e45 MainThread INFO Running: bq load --autodetect --source_format=NEWLINE_DELIMITED_JSON beam_performance.pkb_results <https://builds.apache.org/job/beam_PerformanceTests_Spark/ws/runs/b58e2e45/perfkit-bq-pubd49CbU.json> 2018-04-13 18:28:49,936 b58e2e45 MainThread INFO Ran: {bq load --autodetect --source_format=NEWLINE_DELIMITED_JSON beam_performance.pkb_results <https://builds.apache.org/job/beam_PerformanceTests_Spark/ws/runs/b58e2e45/perfkit-bq-pubd49CbU.json}> ReturnCode:1 STDOUT: Upload complete. Waiting on bqjob_r563d296855a1418f_00000162c0445ba1_1 ... (0s) Current status: RUNNING Waiting on bqjob_r563d296855a1418f_00000162c0445ba1_1 ... (0s) Current status: DONE BigQuery error in load operation: Error processing job 'apache-beam-testing:bqjob_r563d296855a1418f_00000162c0445ba1_1': Invalid schema update. Field timestamp has changed type from TIMESTAMP to FLOAT STDERR: /usr/lib/google-cloud-sdk/platform/bq/third_party/oauth2client/contrib/gce.py:73: UserWarning: You have requested explicit scopes to be used with a GCE service account. Using this argument will have no effect on the actual scopes for tokens requested. These scopes are set at VM instance creation time and can't be overridden in the request. warnings.warn(_SCOPES_WARNING) 2018-04-13 18:28:49,936 b58e2e45 MainThread INFO Retrying exception running IssueRetryableCommand: Command returned a non-zero exit code. 2018-04-13 18:29:16,152 b58e2e45 MainThread INFO Running: bq load --autodetect --source_format=NEWLINE_DELIMITED_JSON beam_performance.pkb_results <https://builds.apache.org/job/beam_PerformanceTests_Spark/ws/runs/b58e2e45/perfkit-bq-pubd49CbU.json> 2018-04-13 18:29:18,374 b58e2e45 MainThread INFO Ran: {bq load --autodetect --source_format=NEWLINE_DELIMITED_JSON beam_performance.pkb_results <https://builds.apache.org/job/beam_PerformanceTests_Spark/ws/runs/b58e2e45/perfkit-bq-pubd49CbU.json}> ReturnCode:1 STDOUT: Upload complete. Waiting on bqjob_r152f1c66f7cee035_00000162c044ca3e_1 ... (0s) Current status: RUNNING Waiting on bqjob_r152f1c66f7cee035_00000162c044ca3e_1 ... (0s) Current status: DONE BigQuery error in load operation: Error processing job 'apache-beam-testing:bqjob_r152f1c66f7cee035_00000162c044ca3e_1': Invalid schema update. Field timestamp has changed type from TIMESTAMP to FLOAT STDERR: /usr/lib/google-cloud-sdk/platform/bq/third_party/oauth2client/contrib/gce.py:73: UserWarning: You have requested explicit scopes to be used with a GCE service account. Using this argument will have no effect on the actual scopes for tokens requested. These scopes are set at VM instance creation time and can't be overridden in the request. warnings.warn(_SCOPES_WARNING) 2018-04-13 18:29:18,375 b58e2e45 MainThread INFO Retrying exception running IssueRetryableCommand: Command returned a non-zero exit code. 2018-04-13 18:29:42,440 b58e2e45 MainThread INFO Running: bq load --autodetect --source_format=NEWLINE_DELIMITED_JSON beam_performance.pkb_results <https://builds.apache.org/job/beam_PerformanceTests_Spark/ws/runs/b58e2e45/perfkit-bq-pubd49CbU.json> 2018-04-13 18:29:44,723 b58e2e45 MainThread INFO Ran: {bq load --autodetect --source_format=NEWLINE_DELIMITED_JSON beam_performance.pkb_results <https://builds.apache.org/job/beam_PerformanceTests_Spark/ws/runs/b58e2e45/perfkit-bq-pubd49CbU.json}> ReturnCode:1 STDOUT: Upload complete. Waiting on bqjob_r1cccd5ccb14be781_00000162c04530ee_1 ... (0s) Current status: RUNNING Waiting on bqjob_r1cccd5ccb14be781_00000162c04530ee_1 ... (0s) Current status: DONE BigQuery error in load operation: Error processing job 'apache-beam-testing:bqjob_r1cccd5ccb14be781_00000162c04530ee_1': Invalid schema update. Field timestamp has changed type from TIMESTAMP to FLOAT STDERR: /usr/lib/google-cloud-sdk/platform/bq/third_party/oauth2client/contrib/gce.py:73: UserWarning: You have requested explicit scopes to be used with a GCE service account. Using this argument will have no effect on the actual scopes for tokens requested. These scopes are set at VM instance creation time and can't be overridden in the request. warnings.warn(_SCOPES_WARNING) 2018-04-13 18:29:44,724 b58e2e45 MainThread INFO Retrying exception running IssueRetryableCommand: Command returned a non-zero exit code. 2018-04-13 18:30:12,315 b58e2e45 MainThread INFO Running: bq load --autodetect --source_format=NEWLINE_DELIMITED_JSON beam_performance.pkb_results <https://builds.apache.org/job/beam_PerformanceTests_Spark/ws/runs/b58e2e45/perfkit-bq-pubd49CbU.json> 2018-04-13 18:30:14,300 b58e2e45 MainThread INFO Ran: {bq load --autodetect --source_format=NEWLINE_DELIMITED_JSON beam_performance.pkb_results <https://builds.apache.org/job/beam_PerformanceTests_Spark/ws/runs/b58e2e45/perfkit-bq-pubd49CbU.json}> ReturnCode:1 STDOUT: Upload complete. Waiting on bqjob_r309576366de0a27f_00000162c045a586_1 ... (0s) Current status: RUNNING Waiting on bqjob_r309576366de0a27f_00000162c045a586_1 ... (0s) Current status: DONE BigQuery error in load operation: Error processing job 'apache-beam-testing:bqjob_r309576366de0a27f_00000162c045a586_1': Invalid schema update. Field timestamp has changed type from TIMESTAMP to FLOAT STDERR: /usr/lib/google-cloud-sdk/platform/bq/third_party/oauth2client/contrib/gce.py:73: UserWarning: You have requested explicit scopes to be used with a GCE service account. Using this argument will have no effect on the actual scopes for tokens requested. These scopes are set at VM instance creation time and can't be overridden in the request. warnings.warn(_SCOPES_WARNING) Traceback (most recent call last): File "PerfKitBenchmarker/pkb.py", line 21, in <module> sys.exit(Main()) File "<https://builds.apache.org/job/beam_PerformanceTests_Spark/ws/PerfKitBenchmarker/perfkitbenchmarker/pkb.py";,> line 951, in Main return RunBenchmarks() File "<https://builds.apache.org/job/beam_PerformanceTests_Spark/ws/PerfKitBenchmarker/perfkitbenchmarker/pkb.py";,> line 878, in RunBenchmarks collector.PublishSamples() File "<https://builds.apache.org/job/beam_PerformanceTests_Spark/ws/PerfKitBenchmarker/perfkitbenchmarker/publisher.py";,> line 927, in PublishSamples publisher.PublishSamples(self.samples) File "<https://builds.apache.org/job/beam_PerformanceTests_Spark/ws/PerfKitBenchmarker/perfkitbenchmarker/publisher.py";,> line 538, in PublishSamples vm_util.IssueRetryableCommand(load_cmd) File "<https://builds.apache.org/job/beam_PerformanceTests_Spark/ws/PerfKitBenchmarker/perfkitbenchmarker/vm_util.py";,> line 249, in WrappedFunction return f(*args, **kwargs) File "<https://builds.apache.org/job/beam_PerformanceTests_Spark/ws/PerfKitBenchmarker/perfkitbenchmarker/vm_util.py";,> line 387, in IssueRetryableCommand 'Command returned a non-zero exit code.\n') perfkitbenchmarker.errors.CalledProcessException: Command returned a non-zero exit code. Build step 'Execute shell' marked build as failure
