See <https://builds.apache.org/job/beam_PerformanceTests_Spark/1471/display/redirect?page=changes>
Changes: [sidhom] Add Java bounded read overrides [coheigea] Replacing size() == 0 with isEmpty() [lukasz.gajowy] [BEAM-3798] Remove error check on dataflow when getting batch job state [XuMingmin] [SQL] Add support for DOT expression (#4863) ------------------------------------------ [...truncated 88.19 KB...] 'apache-beam-testing:bqjob_r5063501109f307ea_000001622c6027ac_1': Invalid schema update. Field timestamp has changed type from TIMESTAMP to FLOAT STDERR: /usr/lib/google-cloud-sdk/platform/bq/third_party/oauth2client/contrib/gce.py:73: UserWarning: You have requested explicit scopes to be used with a GCE service account. Using this argument will have no effect on the actual scopes for tokens requested. These scopes are set at VM instance creation time and can't be overridden in the request. warnings.warn(_SCOPES_WARNING) Upload complete.Waiting on bqjob_r5063501109f307ea_000001622c6027ac_1 ... (0s) Current status: RUNNING Waiting on bqjob_r5063501109f307ea_000001622c6027ac_1 ... (0s) Current status: DONE 2018-03-16 01:15:23,810 cb9865ca MainThread INFO Retrying exception running IssueRetryableCommand: Command returned a non-zero exit code. 2018-03-16 01:15:44,538 cb9865ca MainThread INFO Running: bq load --autodetect --source_format=NEWLINE_DELIMITED_JSON beam_performance.pkb_results <https://builds.apache.org/job/beam_PerformanceTests_Spark/ws/runs/cb9865ca/perfkit-bq-pubWmQ4Pc.json> 2018-03-16 01:15:46,914 cb9865ca MainThread INFO Ran: {bq load --autodetect --source_format=NEWLINE_DELIMITED_JSON beam_performance.pkb_results <https://builds.apache.org/job/beam_PerformanceTests_Spark/ws/runs/cb9865ca/perfkit-bq-pubWmQ4Pc.json}> ReturnCode:1 STDOUT: BigQuery error in load operation: Error processing job 'apache-beam-testing:bqjob_r6fd432861dc9614b_000001622c608169_1': Invalid schema update. Field timestamp has changed type from TIMESTAMP to FLOAT STDERR: /usr/lib/google-cloud-sdk/platform/bq/third_party/oauth2client/contrib/gce.py:73: UserWarning: You have requested explicit scopes to be used with a GCE service account. Using this argument will have no effect on the actual scopes for tokens requested. These scopes are set at VM instance creation time and can't be overridden in the request. warnings.warn(_SCOPES_WARNING) Upload complete.Waiting on bqjob_r6fd432861dc9614b_000001622c608169_1 ... (0s) Current status: RUNNING Waiting on bqjob_r6fd432861dc9614b_000001622c608169_1 ... (0s) Current status: DONE 2018-03-16 01:15:46,914 cb9865ca MainThread INFO Retrying exception running IssueRetryableCommand: Command returned a non-zero exit code. 2018-03-16 01:16:15,417 cb9865ca MainThread INFO Running: bq load --autodetect --source_format=NEWLINE_DELIMITED_JSON beam_performance.pkb_results <https://builds.apache.org/job/beam_PerformanceTests_Spark/ws/runs/cb9865ca/perfkit-bq-pubWmQ4Pc.json> 2018-03-16 01:16:17,669 cb9865ca MainThread INFO Ran: {bq load --autodetect --source_format=NEWLINE_DELIMITED_JSON beam_performance.pkb_results <https://builds.apache.org/job/beam_PerformanceTests_Spark/ws/runs/cb9865ca/perfkit-bq-pubWmQ4Pc.json}> ReturnCode:1 STDOUT: BigQuery error in load operation: Error processing job 'apache-beam-testing:bqjob_r5fcd23f058c0a3e7_000001622c60fa00_1': Invalid schema update. Field timestamp has changed type from TIMESTAMP to FLOAT STDERR: /usr/lib/google-cloud-sdk/platform/bq/third_party/oauth2client/contrib/gce.py:73: UserWarning: You have requested explicit scopes to be used with a GCE service account. Using this argument will have no effect on the actual scopes for tokens requested. These scopes are set at VM instance creation time and can't be overridden in the request. warnings.warn(_SCOPES_WARNING) Upload complete.Waiting on bqjob_r5fcd23f058c0a3e7_000001622c60fa00_1 ... (0s) Current status: RUNNING Waiting on bqjob_r5fcd23f058c0a3e7_000001622c60fa00_1 ... (0s) Current status: DONE 2018-03-16 01:16:17,669 cb9865ca MainThread INFO Retrying exception running IssueRetryableCommand: Command returned a non-zero exit code. 2018-03-16 01:16:40,498 cb9865ca MainThread INFO Running: bq load --autodetect --source_format=NEWLINE_DELIMITED_JSON beam_performance.pkb_results <https://builds.apache.org/job/beam_PerformanceTests_Spark/ws/runs/cb9865ca/perfkit-bq-pubWmQ4Pc.json> 2018-03-16 01:16:42,679 cb9865ca MainThread INFO Ran: {bq load --autodetect --source_format=NEWLINE_DELIMITED_JSON beam_performance.pkb_results <https://builds.apache.org/job/beam_PerformanceTests_Spark/ws/runs/cb9865ca/perfkit-bq-pubWmQ4Pc.json}> ReturnCode:1 STDOUT: BigQuery error in load operation: Error processing job 'apache-beam-testing:bqjob_r3e0e211819528e40_000001622c615bf1_1': Invalid schema update. Field timestamp has changed type from TIMESTAMP to FLOAT STDERR: /usr/lib/google-cloud-sdk/platform/bq/third_party/oauth2client/contrib/gce.py:73: UserWarning: You have requested explicit scopes to be used with a GCE service account. Using this argument will have no effect on the actual scopes for tokens requested. These scopes are set at VM instance creation time and can't be overridden in the request. warnings.warn(_SCOPES_WARNING) Upload complete.Waiting on bqjob_r3e0e211819528e40_000001622c615bf1_1 ... (0s) Current status: RUNNING Waiting on bqjob_r3e0e211819528e40_000001622c615bf1_1 ... (0s) Current status: DONE 2018-03-16 01:16:42,680 cb9865ca MainThread INFO Retrying exception running IssueRetryableCommand: Command returned a non-zero exit code. 2018-03-16 01:17:11,309 cb9865ca MainThread INFO Running: bq load --autodetect --source_format=NEWLINE_DELIMITED_JSON beam_performance.pkb_results <https://builds.apache.org/job/beam_PerformanceTests_Spark/ws/runs/cb9865ca/perfkit-bq-pubWmQ4Pc.json> 2018-03-16 01:17:13,618 cb9865ca MainThread INFO Ran: {bq load --autodetect --source_format=NEWLINE_DELIMITED_JSON beam_performance.pkb_results <https://builds.apache.org/job/beam_PerformanceTests_Spark/ws/runs/cb9865ca/perfkit-bq-pubWmQ4Pc.json}> ReturnCode:1 STDOUT: BigQuery error in load operation: Error processing job 'apache-beam-testing:bqjob_r767e8be3044fd376_000001622c61d45a_1': Invalid schema update. Field timestamp has changed type from TIMESTAMP to FLOAT STDERR: /usr/lib/google-cloud-sdk/platform/bq/third_party/oauth2client/contrib/gce.py:73: UserWarning: You have requested explicit scopes to be used with a GCE service account. Using this argument will have no effect on the actual scopes for tokens requested. These scopes are set at VM instance creation time and can't be overridden in the request. warnings.warn(_SCOPES_WARNING) Upload complete.Waiting on bqjob_r767e8be3044fd376_000001622c61d45a_1 ... (0s) Current status: RUNNING Waiting on bqjob_r767e8be3044fd376_000001622c61d45a_1 ... (0s) Current status: DONE 2018-03-16 01:17:13,619 cb9865ca MainThread INFO Retrying exception running IssueRetryableCommand: Command returned a non-zero exit code. 2018-03-16 01:17:42,189 cb9865ca MainThread INFO Running: bq load --autodetect --source_format=NEWLINE_DELIMITED_JSON beam_performance.pkb_results <https://builds.apache.org/job/beam_PerformanceTests_Spark/ws/runs/cb9865ca/perfkit-bq-pubWmQ4Pc.json> 2018-03-16 01:17:45,259 cb9865ca MainThread INFO Ran: {bq load --autodetect --source_format=NEWLINE_DELIMITED_JSON beam_performance.pkb_results <https://builds.apache.org/job/beam_PerformanceTests_Spark/ws/runs/cb9865ca/perfkit-bq-pubWmQ4Pc.json}> ReturnCode:1 STDOUT: BigQuery error in load operation: Error processing job 'apache-beam-testing:bqjob_r239c8bdb2d127c8b_000001622c6250cc_1': Invalid schema update. Field timestamp has changed type from TIMESTAMP to FLOAT STDERR: /usr/lib/google-cloud-sdk/platform/bq/third_party/oauth2client/contrib/gce.py:73: UserWarning: You have requested explicit scopes to be used with a GCE service account. Using this argument will have no effect on the actual scopes for tokens requested. These scopes are set at VM instance creation time and can't be overridden in the request. warnings.warn(_SCOPES_WARNING) Upload complete.Waiting on bqjob_r239c8bdb2d127c8b_000001622c6250cc_1 ... (0s) Current status: RUNNING Waiting on bqjob_r239c8bdb2d127c8b_000001622c6250cc_1 ... (0s) Current status: DONE 2018-03-16 01:17:45,259 cb9865ca MainThread INFO Retrying exception running IssueRetryableCommand: Command returned a non-zero exit code. 2018-03-16 01:18:05,374 cb9865ca MainThread INFO Running: bq load --autodetect --source_format=NEWLINE_DELIMITED_JSON beam_performance.pkb_results <https://builds.apache.org/job/beam_PerformanceTests_Spark/ws/runs/cb9865ca/perfkit-bq-pubWmQ4Pc.json> 2018-03-16 01:18:07,560 cb9865ca MainThread INFO Ran: {bq load --autodetect --source_format=NEWLINE_DELIMITED_JSON beam_performance.pkb_results <https://builds.apache.org/job/beam_PerformanceTests_Spark/ws/runs/cb9865ca/perfkit-bq-pubWmQ4Pc.json}> ReturnCode:1 STDOUT: BigQuery error in load operation: Error processing job 'apache-beam-testing:bqjob_r72a71920fcd4681d_000001622c62a77f_1': Invalid schema update. Field timestamp has changed type from TIMESTAMP to FLOAT STDERR: /usr/lib/google-cloud-sdk/platform/bq/third_party/oauth2client/contrib/gce.py:73: UserWarning: You have requested explicit scopes to be used with a GCE service account. Using this argument will have no effect on the actual scopes for tokens requested. These scopes are set at VM instance creation time and can't be overridden in the request. warnings.warn(_SCOPES_WARNING) Upload complete.Waiting on bqjob_r72a71920fcd4681d_000001622c62a77f_1 ... (0s) Current status: RUNNING Waiting on bqjob_r72a71920fcd4681d_000001622c62a77f_1 ... (0s) Current status: DONE 2018-03-16 01:18:07,560 cb9865ca MainThread INFO Retrying exception running IssueRetryableCommand: Command returned a non-zero exit code. 2018-03-16 01:18:28,494 cb9865ca MainThread INFO Running: bq load --autodetect --source_format=NEWLINE_DELIMITED_JSON beam_performance.pkb_results <https://builds.apache.org/job/beam_PerformanceTests_Spark/ws/runs/cb9865ca/perfkit-bq-pubWmQ4Pc.json> 2018-03-16 01:18:30,658 cb9865ca MainThread INFO Ran: {bq load --autodetect --source_format=NEWLINE_DELIMITED_JSON beam_performance.pkb_results <https://builds.apache.org/job/beam_PerformanceTests_Spark/ws/runs/cb9865ca/perfkit-bq-pubWmQ4Pc.json}> ReturnCode:1 STDOUT: BigQuery error in load operation: Error processing job 'apache-beam-testing:bqjob_r4a133004ca01d313_000001622c6301cf_1': Invalid schema update. Field timestamp has changed type from TIMESTAMP to FLOAT STDERR: /usr/lib/google-cloud-sdk/platform/bq/third_party/oauth2client/contrib/gce.py:73: UserWarning: You have requested explicit scopes to be used with a GCE service account. Using this argument will have no effect on the actual scopes for tokens requested. These scopes are set at VM instance creation time and can't be overridden in the request. warnings.warn(_SCOPES_WARNING) Upload complete.Waiting on bqjob_r4a133004ca01d313_000001622c6301cf_1 ... (0s) Current status: RUNNING Waiting on bqjob_r4a133004ca01d313_000001622c6301cf_1 ... (0s) Current status: DONE 2018-03-16 01:18:30,659 cb9865ca MainThread INFO Retrying exception running IssueRetryableCommand: Command returned a non-zero exit code. 2018-03-16 01:18:49,447 cb9865ca MainThread INFO Running: bq load --autodetect --source_format=NEWLINE_DELIMITED_JSON beam_performance.pkb_results <https://builds.apache.org/job/beam_PerformanceTests_Spark/ws/runs/cb9865ca/perfkit-bq-pubWmQ4Pc.json> 2018-03-16 01:18:51,583 cb9865ca MainThread INFO Ran: {bq load --autodetect --source_format=NEWLINE_DELIMITED_JSON beam_performance.pkb_results <https://builds.apache.org/job/beam_PerformanceTests_Spark/ws/runs/cb9865ca/perfkit-bq-pubWmQ4Pc.json}> ReturnCode:1 STDOUT: BigQuery error in load operation: Error processing job 'apache-beam-testing:bqjob_r18ee85cb2fcb875d_000001622c6353a4_1': Invalid schema update. Field timestamp has changed type from TIMESTAMP to FLOAT STDERR: /usr/lib/google-cloud-sdk/platform/bq/third_party/oauth2client/contrib/gce.py:73: UserWarning: You have requested explicit scopes to be used with a GCE service account. Using this argument will have no effect on the actual scopes for tokens requested. These scopes are set at VM instance creation time and can't be overridden in the request. warnings.warn(_SCOPES_WARNING) Upload complete.Waiting on bqjob_r18ee85cb2fcb875d_000001622c6353a4_1 ... (0s) Current status: RUNNING Waiting on bqjob_r18ee85cb2fcb875d_000001622c6353a4_1 ... (0s) Current status: DONE 2018-03-16 01:18:51,584 cb9865ca MainThread INFO Retrying exception running IssueRetryableCommand: Command returned a non-zero exit code. 2018-03-16 01:19:10,292 cb9865ca MainThread INFO Running: bq load --autodetect --source_format=NEWLINE_DELIMITED_JSON beam_performance.pkb_results <https://builds.apache.org/job/beam_PerformanceTests_Spark/ws/runs/cb9865ca/perfkit-bq-pubWmQ4Pc.json> 2018-03-16 01:19:12,344 cb9865ca MainThread INFO Ran: {bq load --autodetect --source_format=NEWLINE_DELIMITED_JSON beam_performance.pkb_results <https://builds.apache.org/job/beam_PerformanceTests_Spark/ws/runs/cb9865ca/perfkit-bq-pubWmQ4Pc.json}> ReturnCode:1 STDOUT: BigQuery error in load operation: Error processing job 'apache-beam-testing:bqjob_r19a38cafdb97ac45_000001622c63a50b_1': Invalid schema update. Field timestamp has changed type from TIMESTAMP to FLOAT STDERR: /usr/lib/google-cloud-sdk/platform/bq/third_party/oauth2client/contrib/gce.py:73: UserWarning: You have requested explicit scopes to be used with a GCE service account. Using this argument will have no effect on the actual scopes for tokens requested. These scopes are set at VM instance creation time and can't be overridden in the request. warnings.warn(_SCOPES_WARNING) Upload complete.Waiting on bqjob_r19a38cafdb97ac45_000001622c63a50b_1 ... (0s) Current status: RUNNING Waiting on bqjob_r19a38cafdb97ac45_000001622c63a50b_1 ... (0s) Current status: DONE 2018-03-16 01:19:12,344 cb9865ca MainThread INFO Retrying exception running IssueRetryableCommand: Command returned a non-zero exit code. 2018-03-16 01:19:30,231 cb9865ca MainThread INFO Running: bq load --autodetect --source_format=NEWLINE_DELIMITED_JSON beam_performance.pkb_results <https://builds.apache.org/job/beam_PerformanceTests_Spark/ws/runs/cb9865ca/perfkit-bq-pubWmQ4Pc.json> 2018-03-16 01:19:32,390 cb9865ca MainThread INFO Ran: {bq load --autodetect --source_format=NEWLINE_DELIMITED_JSON beam_performance.pkb_results <https://builds.apache.org/job/beam_PerformanceTests_Spark/ws/runs/cb9865ca/perfkit-bq-pubWmQ4Pc.json}> ReturnCode:1 STDOUT: BigQuery error in load operation: Error processing job 'apache-beam-testing:bqjob_r3cd21480c0adfeca_000001622c63f308_1': Invalid schema update. Field timestamp has changed type from TIMESTAMP to FLOAT STDERR: /usr/lib/google-cloud-sdk/platform/bq/third_party/oauth2client/contrib/gce.py:73: UserWarning: You have requested explicit scopes to be used with a GCE service account. Using this argument will have no effect on the actual scopes for tokens requested. These scopes are set at VM instance creation time and can't be overridden in the request. warnings.warn(_SCOPES_WARNING) Upload complete.Waiting on bqjob_r3cd21480c0adfeca_000001622c63f308_1 ... (0s) Current status: RUNNING Waiting on bqjob_r3cd21480c0adfeca_000001622c63f308_1 ... (0s) Current status: DONE 2018-03-16 01:19:32,390 cb9865ca MainThread INFO Retrying exception running IssueRetryableCommand: Command returned a non-zero exit code. 2018-03-16 01:19:53,469 cb9865ca MainThread INFO Running: bq load --autodetect --source_format=NEWLINE_DELIMITED_JSON beam_performance.pkb_results <https://builds.apache.org/job/beam_PerformanceTests_Spark/ws/runs/cb9865ca/perfkit-bq-pubWmQ4Pc.json> 2018-03-16 01:20:00,798 cb9865ca MainThread INFO Ran: {bq load --autodetect --source_format=NEWLINE_DELIMITED_JSON beam_performance.pkb_results <https://builds.apache.org/job/beam_PerformanceTests_Spark/ws/runs/cb9865ca/perfkit-bq-pubWmQ4Pc.json}> ReturnCode:1 STDOUT: BigQuery error in load operation: Error processing job 'apache-beam-testing:bqjob_r1d965c03ae9f5c22_000001622c644dbf_1': Invalid schema update. Field timestamp has changed type from TIMESTAMP to FLOAT STDERR: /usr/lib/google-cloud-sdk/platform/bq/third_party/oauth2client/contrib/gce.py:73: UserWarning: You have requested explicit scopes to be used with a GCE service account. Using this argument will have no effect on the actual scopes for tokens requested. These scopes are set at VM instance creation time and can't be overridden in the request. warnings.warn(_SCOPES_WARNING) Upload complete.Waiting on bqjob_r1d965c03ae9f5c22_000001622c644dbf_1 ... (0s) Current status: RUNNING Waiting on bqjob_r1d965c03ae9f5c22_000001622c644dbf_1 ... (0s) Current status: DONE 2018-03-16 01:20:00,799 cb9865ca MainThread INFO Retrying exception running IssueRetryableCommand: Command returned a non-zero exit code. 2018-03-16 01:20:26,928 cb9865ca MainThread INFO Running: bq load --autodetect --source_format=NEWLINE_DELIMITED_JSON beam_performance.pkb_results <https://builds.apache.org/job/beam_PerformanceTests_Spark/ws/runs/cb9865ca/perfkit-bq-pubWmQ4Pc.json> 2018-03-16 01:20:29,103 cb9865ca MainThread INFO Ran: {bq load --autodetect --source_format=NEWLINE_DELIMITED_JSON beam_performance.pkb_results <https://builds.apache.org/job/beam_PerformanceTests_Spark/ws/runs/cb9865ca/perfkit-bq-pubWmQ4Pc.json}> ReturnCode:1 STDOUT: BigQuery error in load operation: Error processing job 'apache-beam-testing:bqjob_r40deae3edae5c9e9_000001622c64d078_1': Invalid schema update. Field timestamp has changed type from TIMESTAMP to FLOAT STDERR: /usr/lib/google-cloud-sdk/platform/bq/third_party/oauth2client/contrib/gce.py:73: UserWarning: You have requested explicit scopes to be used with a GCE service account. Using this argument will have no effect on the actual scopes for tokens requested. These scopes are set at VM instance creation time and can't be overridden in the request. warnings.warn(_SCOPES_WARNING) Upload complete.Waiting on bqjob_r40deae3edae5c9e9_000001622c64d078_1 ... (0s) Current status: RUNNING Waiting on bqjob_r40deae3edae5c9e9_000001622c64d078_1 ... (0s) Current status: DONE 2018-03-16 01:20:29,103 cb9865ca MainThread INFO Retrying exception running IssueRetryableCommand: Command returned a non-zero exit code. 2018-03-16 01:20:49,073 cb9865ca MainThread INFO Running: bq load --autodetect --source_format=NEWLINE_DELIMITED_JSON beam_performance.pkb_results <https://builds.apache.org/job/beam_PerformanceTests_Spark/ws/runs/cb9865ca/perfkit-bq-pubWmQ4Pc.json> 2018-03-16 01:20:51,215 cb9865ca MainThread INFO Ran: {bq load --autodetect --source_format=NEWLINE_DELIMITED_JSON beam_performance.pkb_results <https://builds.apache.org/job/beam_PerformanceTests_Spark/ws/runs/cb9865ca/perfkit-bq-pubWmQ4Pc.json}> ReturnCode:1 STDOUT: BigQuery error in load operation: Error processing job 'apache-beam-testing:bqjob_r504122de454102_000001622c65270f_1': Invalid schema update. Field timestamp has changed type from TIMESTAMP to FLOAT STDERR: /usr/lib/google-cloud-sdk/platform/bq/third_party/oauth2client/contrib/gce.py:73: UserWarning: You have requested explicit scopes to be used with a GCE service account. Using this argument will have no effect on the actual scopes for tokens requested. These scopes are set at VM instance creation time and can't be overridden in the request. warnings.warn(_SCOPES_WARNING) Upload complete.Waiting on bqjob_r504122de454102_000001622c65270f_1 ... (0s) Current status: RUNNING Waiting on bqjob_r504122de454102_000001622c65270f_1 ... (0s) Current status: DONE Traceback (most recent call last): File "PerfKitBenchmarker/pkb.py", line 21, in <module> sys.exit(Main()) File "<https://builds.apache.org/job/beam_PerformanceTests_Spark/ws/PerfKitBenchmarker/perfkitbenchmarker/pkb.py",> line 927, in Main return RunBenchmarks() File "<https://builds.apache.org/job/beam_PerformanceTests_Spark/ws/PerfKitBenchmarker/perfkitbenchmarker/pkb.py",> line 854, in RunBenchmarks collector.PublishSamples() File "<https://builds.apache.org/job/beam_PerformanceTests_Spark/ws/PerfKitBenchmarker/perfkitbenchmarker/publisher.py",> line 886, in PublishSamples publisher.PublishSamples(self.samples) File "<https://builds.apache.org/job/beam_PerformanceTests_Spark/ws/PerfKitBenchmarker/perfkitbenchmarker/publisher.py",> line 538, in PublishSamples vm_util.IssueRetryableCommand(load_cmd) File "<https://builds.apache.org/job/beam_PerformanceTests_Spark/ws/PerfKitBenchmarker/perfkitbenchmarker/vm_util.py",> line 249, in WrappedFunction return f(*args, **kwargs) File "<https://builds.apache.org/job/beam_PerformanceTests_Spark/ws/PerfKitBenchmarker/perfkitbenchmarker/vm_util.py",> line 387, in IssueRetryableCommand 'Command returned a non-zero exit code.\n') perfkitbenchmarker.errors.CalledProcessException: Command returned a non-zero exit code. Build step 'Execute shell' marked build as failure