See <https://builds.apache.org/job/beam_PerformanceTests_Spark/1440/display/redirect?page=changes>
Changes: [grzegorz.kolakowski] [BEAM-3043] Set user-specified PTransform names on Flink operators [grzegorz.kolakowski] [BEAM-3753] Fix failing integration tests [grzegorz.kolakowski] [BEAM-3753] Rename *ITCase.java tests files to *Test.java [rmannibucau] Make StateInternals short state method defaulting to the implementation ------------------------------------------ [...truncated 95.62 KB...] 'apache-beam-testing:bqjob_r79b3a5c9dd7319d0_0000016201b08299_1': Invalid schema update. Field timestamp has changed type from TIMESTAMP to FLOAT STDERR: /usr/lib/google-cloud-sdk/platform/bq/third_party/oauth2client/contrib/gce.py:73: UserWarning: You have requested explicit scopes to be used with a GCE service account. Using this argument will have no effect on the actual scopes for tokens requested. These scopes are set at VM instance creation time and can't be overridden in the request. warnings.warn(_SCOPES_WARNING) 2018-03-07 18:20:17,868 e938099d MainThread INFO Retrying exception running IssueRetryableCommand: Command returned a non-zero exit code. 2018-03-07 18:20:43,201 e938099d MainThread INFO Running: bq load --autodetect --source_format=NEWLINE_DELIMITED_JSON beam_performance.pkb_results <https://builds.apache.org/job/beam_PerformanceTests_Spark/ws/runs/e938099d/perfkit-bq-pubc2QtdR.json> 2018-03-07 18:20:45,659 e938099d MainThread INFO Ran: {bq load --autodetect --source_format=NEWLINE_DELIMITED_JSON beam_performance.pkb_results <https://builds.apache.org/job/beam_PerformanceTests_Spark/ws/runs/e938099d/perfkit-bq-pubc2QtdR.json}> ReturnCode:1, WallTime:0:02.45s, CPU:0.27s, MaxMemory:25484kb STDOUT: Upload complete. Waiting on bqjob_rb4eed11defee83a_0000016201b1aa5a_1 ... (0s) Current status: RUNNING Waiting on bqjob_rb4eed11defee83a_0000016201b1aa5a_1 ... (0s) Current status: DONE BigQuery error in load operation: Error processing job 'apache-beam-testing:bqjob_rb4eed11defee83a_0000016201b1aa5a_1': Invalid schema update. Field timestamp has changed type from TIMESTAMP to FLOAT STDERR: /usr/lib/google-cloud-sdk/platform/bq/third_party/oauth2client/contrib/gce.py:73: UserWarning: You have requested explicit scopes to be used with a GCE service account. Using this argument will have no effect on the actual scopes for tokens requested. These scopes are set at VM instance creation time and can't be overridden in the request. warnings.warn(_SCOPES_WARNING) 2018-03-07 18:20:45,660 e938099d MainThread INFO Retrying exception running IssueRetryableCommand: Command returned a non-zero exit code. 2018-03-07 18:21:02,133 e938099d MainThread INFO Running: bq load --autodetect --source_format=NEWLINE_DELIMITED_JSON beam_performance.pkb_results <https://builds.apache.org/job/beam_PerformanceTests_Spark/ws/runs/e938099d/perfkit-bq-pubc2QtdR.json> 2018-03-07 18:21:04,499 e938099d MainThread INFO Ran: {bq load --autodetect --source_format=NEWLINE_DELIMITED_JSON beam_performance.pkb_results <https://builds.apache.org/job/beam_PerformanceTests_Spark/ws/runs/e938099d/perfkit-bq-pubc2QtdR.json}> ReturnCode:1, WallTime:0:02.35s, CPU:0.31s, MaxMemory:25456kb STDOUT: Upload complete. Waiting on bqjob_r1d5353cf2db82900_0000016201b1f4c0_1 ... (0s) Current status: RUNNING Waiting on bqjob_r1d5353cf2db82900_0000016201b1f4c0_1 ... (0s) Current status: DONE BigQuery error in load operation: Error processing job 'apache-beam-testing:bqjob_r1d5353cf2db82900_0000016201b1f4c0_1': Invalid schema update. Field timestamp has changed type from TIMESTAMP to FLOAT STDERR: /usr/lib/google-cloud-sdk/platform/bq/third_party/oauth2client/contrib/gce.py:73: UserWarning: You have requested explicit scopes to be used with a GCE service account. Using this argument will have no effect on the actual scopes for tokens requested. These scopes are set at VM instance creation time and can't be overridden in the request. warnings.warn(_SCOPES_WARNING) 2018-03-07 18:21:04,500 e938099d MainThread INFO Retrying exception running IssueRetryableCommand: Command returned a non-zero exit code. 2018-03-07 18:21:25,506 e938099d MainThread INFO Running: bq load --autodetect --source_format=NEWLINE_DELIMITED_JSON beam_performance.pkb_results <https://builds.apache.org/job/beam_PerformanceTests_Spark/ws/runs/e938099d/perfkit-bq-pubc2QtdR.json> 2018-03-07 18:21:28,008 e938099d MainThread INFO Ran: {bq load --autodetect --source_format=NEWLINE_DELIMITED_JSON beam_performance.pkb_results <https://builds.apache.org/job/beam_PerformanceTests_Spark/ws/runs/e938099d/perfkit-bq-pubc2QtdR.json}> ReturnCode:1, WallTime:0:02.49s, CPU:0.25s, MaxMemory:25452kb STDOUT: Upload complete. Waiting on bqjob_r5155992068b2ffc9_0000016201b24f9e_1 ... (0s) Current status: RUNNING Waiting on bqjob_r5155992068b2ffc9_0000016201b24f9e_1 ... (0s) Current status: DONE BigQuery error in load operation: Error processing job 'apache-beam-testing:bqjob_r5155992068b2ffc9_0000016201b24f9e_1': Invalid schema update. Field timestamp has changed type from TIMESTAMP to FLOAT STDERR: /usr/lib/google-cloud-sdk/platform/bq/third_party/oauth2client/contrib/gce.py:73: UserWarning: You have requested explicit scopes to be used with a GCE service account. Using this argument will have no effect on the actual scopes for tokens requested. These scopes are set at VM instance creation time and can't be overridden in the request. warnings.warn(_SCOPES_WARNING) 2018-03-07 18:21:28,008 e938099d MainThread INFO Retrying exception running IssueRetryableCommand: Command returned a non-zero exit code. 2018-03-07 18:21:50,973 e938099d MainThread INFO Running: bq load --autodetect --source_format=NEWLINE_DELIMITED_JSON beam_performance.pkb_results <https://builds.apache.org/job/beam_PerformanceTests_Spark/ws/runs/e938099d/perfkit-bq-pubc2QtdR.json> 2018-03-07 18:21:54,122 e938099d MainThread INFO Ran: {bq load --autodetect --source_format=NEWLINE_DELIMITED_JSON beam_performance.pkb_results <https://builds.apache.org/job/beam_PerformanceTests_Spark/ws/runs/e938099d/perfkit-bq-pubc2QtdR.json}> ReturnCode:1, WallTime:0:03.11s, CPU:0.32s, MaxMemory:25296kb STDOUT: Upload complete. Waiting on bqjob_r37b48a44ae83c5c6_0000016201b2b61d_1 ... (0s) Current status: RUNNING Waiting on bqjob_r37b48a44ae83c5c6_0000016201b2b61d_1 ... (0s) Current status: DONE BigQuery error in load operation: Error processing job 'apache-beam-testing:bqjob_r37b48a44ae83c5c6_0000016201b2b61d_1': Invalid schema update. Field timestamp has changed type from TIMESTAMP to FLOAT STDERR: /usr/lib/google-cloud-sdk/platform/bq/third_party/oauth2client/contrib/gce.py:73: UserWarning: You have requested explicit scopes to be used with a GCE service account. Using this argument will have no effect on the actual scopes for tokens requested. These scopes are set at VM instance creation time and can't be overridden in the request. warnings.warn(_SCOPES_WARNING) 2018-03-07 18:21:54,122 e938099d MainThread INFO Retrying exception running IssueRetryableCommand: Command returned a non-zero exit code. 2018-03-07 18:22:22,141 e938099d MainThread INFO Running: bq load --autodetect --source_format=NEWLINE_DELIMITED_JSON beam_performance.pkb_results <https://builds.apache.org/job/beam_PerformanceTests_Spark/ws/runs/e938099d/perfkit-bq-pubc2QtdR.json> 2018-03-07 18:22:24,513 e938099d MainThread INFO Ran: {bq load --autodetect --source_format=NEWLINE_DELIMITED_JSON beam_performance.pkb_results <https://builds.apache.org/job/beam_PerformanceTests_Spark/ws/runs/e938099d/perfkit-bq-pubc2QtdR.json}> ReturnCode:1, WallTime:0:02.36s, CPU:0.31s, MaxMemory:25260kb STDOUT: Upload complete. Waiting on bqjob_r2f386c205b3002ce_0000016201b32d10_1 ... (0s) Current status: RUNNING Waiting on bqjob_r2f386c205b3002ce_0000016201b32d10_1 ... (0s) Current status: DONE BigQuery error in load operation: Error processing job 'apache-beam-testing:bqjob_r2f386c205b3002ce_0000016201b32d10_1': Invalid schema update. Field timestamp has changed type from TIMESTAMP to FLOAT STDERR: /usr/lib/google-cloud-sdk/platform/bq/third_party/oauth2client/contrib/gce.py:73: UserWarning: You have requested explicit scopes to be used with a GCE service account. Using this argument will have no effect on the actual scopes for tokens requested. These scopes are set at VM instance creation time and can't be overridden in the request. warnings.warn(_SCOPES_WARNING) 2018-03-07 18:22:24,513 e938099d MainThread INFO Retrying exception running IssueRetryableCommand: Command returned a non-zero exit code. 2018-03-07 18:22:48,528 e938099d MainThread INFO Running: bq load --autodetect --source_format=NEWLINE_DELIMITED_JSON beam_performance.pkb_results <https://builds.apache.org/job/beam_PerformanceTests_Spark/ws/runs/e938099d/perfkit-bq-pubc2QtdR.json> 2018-03-07 18:22:51,891 e938099d MainThread INFO Ran: {bq load --autodetect --source_format=NEWLINE_DELIMITED_JSON beam_performance.pkb_results <https://builds.apache.org/job/beam_PerformanceTests_Spark/ws/runs/e938099d/perfkit-bq-pubc2QtdR.json}> ReturnCode:1, WallTime:0:03.35s, CPU:0.26s, MaxMemory:25448kb STDOUT: Upload complete. Waiting on bqjob_r4892494e2658f506_0000016201b397c9_1 ... (0s) Current status: RUNNING Waiting on bqjob_r4892494e2658f506_0000016201b397c9_1 ... (0s) Current status: DONE BigQuery error in load operation: Error processing job 'apache-beam-testing:bqjob_r4892494e2658f506_0000016201b397c9_1': Invalid schema update. Field timestamp has changed type from TIMESTAMP to FLOAT STDERR: /usr/lib/google-cloud-sdk/platform/bq/third_party/oauth2client/contrib/gce.py:73: UserWarning: You have requested explicit scopes to be used with a GCE service account. Using this argument will have no effect on the actual scopes for tokens requested. These scopes are set at VM instance creation time and can't be overridden in the request. warnings.warn(_SCOPES_WARNING) 2018-03-07 18:22:51,892 e938099d MainThread INFO Retrying exception running IssueRetryableCommand: Command returned a non-zero exit code. 2018-03-07 18:23:07,429 e938099d MainThread INFO Running: bq load --autodetect --source_format=NEWLINE_DELIMITED_JSON beam_performance.pkb_results <https://builds.apache.org/job/beam_PerformanceTests_Spark/ws/runs/e938099d/perfkit-bq-pubc2QtdR.json> 2018-03-07 18:23:10,058 e938099d MainThread INFO Ran: {bq load --autodetect --source_format=NEWLINE_DELIMITED_JSON beam_performance.pkb_results <https://builds.apache.org/job/beam_PerformanceTests_Spark/ws/runs/e938099d/perfkit-bq-pubc2QtdR.json}> ReturnCode:1, WallTime:0:02.59s, CPU:0.38s, MaxMemory:25448kb STDOUT: Upload complete. Waiting on bqjob_r2c46cd2c3333c5a9_0000016201b3de69_1 ... (0s) Current status: RUNNING Waiting on bqjob_r2c46cd2c3333c5a9_0000016201b3de69_1 ... (0s) Current status: DONE BigQuery error in load operation: Error processing job 'apache-beam-testing:bqjob_r2c46cd2c3333c5a9_0000016201b3de69_1': Invalid schema update. Field timestamp has changed type from TIMESTAMP to FLOAT STDERR: /usr/lib/google-cloud-sdk/platform/bq/third_party/oauth2client/contrib/gce.py:73: UserWarning: You have requested explicit scopes to be used with a GCE service account. Using this argument will have no effect on the actual scopes for tokens requested. These scopes are set at VM instance creation time and can't be overridden in the request. warnings.warn(_SCOPES_WARNING) 2018-03-07 18:23:10,058 e938099d MainThread INFO Retrying exception running IssueRetryableCommand: Command returned a non-zero exit code. 2018-03-07 18:23:39,349 e938099d MainThread INFO Running: bq load --autodetect --source_format=NEWLINE_DELIMITED_JSON beam_performance.pkb_results <https://builds.apache.org/job/beam_PerformanceTests_Spark/ws/runs/e938099d/perfkit-bq-pubc2QtdR.json> 2018-03-07 18:23:41,779 e938099d MainThread INFO Ran: {bq load --autodetect --source_format=NEWLINE_DELIMITED_JSON beam_performance.pkb_results <https://builds.apache.org/job/beam_PerformanceTests_Spark/ws/runs/e938099d/perfkit-bq-pubc2QtdR.json}> ReturnCode:1, WallTime:0:02.42s, CPU:0.26s, MaxMemory:25532kb STDOUT: Upload complete. Waiting on bqjob_r324003c465319e69_0000016201b45a57_1 ... (0s) Current status: RUNNING Waiting on bqjob_r324003c465319e69_0000016201b45a57_1 ... (0s) Current status: DONE BigQuery error in load operation: Error processing job 'apache-beam-testing:bqjob_r324003c465319e69_0000016201b45a57_1': Invalid schema update. Field timestamp has changed type from TIMESTAMP to FLOAT STDERR: /usr/lib/google-cloud-sdk/platform/bq/third_party/oauth2client/contrib/gce.py:73: UserWarning: You have requested explicit scopes to be used with a GCE service account. Using this argument will have no effect on the actual scopes for tokens requested. These scopes are set at VM instance creation time and can't be overridden in the request. warnings.warn(_SCOPES_WARNING) 2018-03-07 18:23:41,780 e938099d MainThread INFO Retrying exception running IssueRetryableCommand: Command returned a non-zero exit code. 2018-03-07 18:24:10,737 e938099d MainThread INFO Running: bq load --autodetect --source_format=NEWLINE_DELIMITED_JSON beam_performance.pkb_results <https://builds.apache.org/job/beam_PerformanceTests_Spark/ws/runs/e938099d/perfkit-bq-pubc2QtdR.json> 2018-03-07 18:24:13,425 e938099d MainThread INFO Ran: {bq load --autodetect --source_format=NEWLINE_DELIMITED_JSON beam_performance.pkb_results <https://builds.apache.org/job/beam_PerformanceTests_Spark/ws/runs/e938099d/perfkit-bq-pubc2QtdR.json}> ReturnCode:1, WallTime:0:02.66s, CPU:0.36s, MaxMemory:25428kb STDOUT: Upload complete. Waiting on bqjob_r647d42b05eaab014_0000016201b4d5c0_1 ... (0s) Current status: RUNNING Waiting on bqjob_r647d42b05eaab014_0000016201b4d5c0_1 ... (0s) Current status: DONE BigQuery error in load operation: Error processing job 'apache-beam-testing:bqjob_r647d42b05eaab014_0000016201b4d5c0_1': Invalid schema update. Field timestamp has changed type from TIMESTAMP to FLOAT STDERR: /usr/lib/google-cloud-sdk/platform/bq/third_party/oauth2client/contrib/gce.py:73: UserWarning: You have requested explicit scopes to be used with a GCE service account. Using this argument will have no effect on the actual scopes for tokens requested. These scopes are set at VM instance creation time and can't be overridden in the request. warnings.warn(_SCOPES_WARNING) 2018-03-07 18:24:13,426 e938099d MainThread INFO Retrying exception running IssueRetryableCommand: Command returned a non-zero exit code. 2018-03-07 18:24:33,477 e938099d MainThread INFO Running: bq load --autodetect --source_format=NEWLINE_DELIMITED_JSON beam_performance.pkb_results <https://builds.apache.org/job/beam_PerformanceTests_Spark/ws/runs/e938099d/perfkit-bq-pubc2QtdR.json> 2018-03-07 18:24:36,006 e938099d MainThread INFO Ran: {bq load --autodetect --source_format=NEWLINE_DELIMITED_JSON beam_performance.pkb_results <https://builds.apache.org/job/beam_PerformanceTests_Spark/ws/runs/e938099d/perfkit-bq-pubc2QtdR.json}> ReturnCode:1, WallTime:0:02.51s, CPU:0.34s, MaxMemory:25264kb STDOUT: Upload complete. Waiting on bqjob_r4a82ba0d9a433768_0000016201b52e5e_1 ... (0s) Current status: RUNNING Waiting on bqjob_r4a82ba0d9a433768_0000016201b52e5e_1 ... (0s) Current status: DONE BigQuery error in load operation: Error processing job 'apache-beam-testing:bqjob_r4a82ba0d9a433768_0000016201b52e5e_1': Invalid schema update. Field timestamp has changed type from TIMESTAMP to FLOAT STDERR: /usr/lib/google-cloud-sdk/platform/bq/third_party/oauth2client/contrib/gce.py:73: UserWarning: You have requested explicit scopes to be used with a GCE service account. Using this argument will have no effect on the actual scopes for tokens requested. These scopes are set at VM instance creation time and can't be overridden in the request. warnings.warn(_SCOPES_WARNING) 2018-03-07 18:24:36,007 e938099d MainThread INFO Retrying exception running IssueRetryableCommand: Command returned a non-zero exit code. 2018-03-07 18:24:59,981 e938099d MainThread INFO Running: bq load --autodetect --source_format=NEWLINE_DELIMITED_JSON beam_performance.pkb_results <https://builds.apache.org/job/beam_PerformanceTests_Spark/ws/runs/e938099d/perfkit-bq-pubc2QtdR.json> 2018-03-07 18:25:02,362 e938099d MainThread INFO Ran: {bq load --autodetect --source_format=NEWLINE_DELIMITED_JSON beam_performance.pkb_results <https://builds.apache.org/job/beam_PerformanceTests_Spark/ws/runs/e938099d/perfkit-bq-pubc2QtdR.json}> ReturnCode:1, WallTime:0:02.37s, CPU:0.25s, MaxMemory:25272kb STDOUT: Upload complete. Waiting on bqjob_r1ce53f94c6d851b5_0000016201b5954b_1 ... (0s) Current status: RUNNING Waiting on bqjob_r1ce53f94c6d851b5_0000016201b5954b_1 ... (0s) Current status: DONE BigQuery error in load operation: Error processing job 'apache-beam-testing:bqjob_r1ce53f94c6d851b5_0000016201b5954b_1': Invalid schema update. Field timestamp has changed type from TIMESTAMP to FLOAT STDERR: /usr/lib/google-cloud-sdk/platform/bq/third_party/oauth2client/contrib/gce.py:73: UserWarning: You have requested explicit scopes to be used with a GCE service account. Using this argument will have no effect on the actual scopes for tokens requested. These scopes are set at VM instance creation time and can't be overridden in the request. warnings.warn(_SCOPES_WARNING) 2018-03-07 18:25:02,363 e938099d MainThread INFO Retrying exception running IssueRetryableCommand: Command returned a non-zero exit code. 2018-03-07 18:25:27,925 e938099d MainThread INFO Running: bq load --autodetect --source_format=NEWLINE_DELIMITED_JSON beam_performance.pkb_results <https://builds.apache.org/job/beam_PerformanceTests_Spark/ws/runs/e938099d/perfkit-bq-pubc2QtdR.json> 2018-03-07 18:25:30,855 e938099d MainThread INFO Ran: {bq load --autodetect --source_format=NEWLINE_DELIMITED_JSON beam_performance.pkb_results <https://builds.apache.org/job/beam_PerformanceTests_Spark/ws/runs/e938099d/perfkit-bq-pubc2QtdR.json}> ReturnCode:1, WallTime:0:02.92s, CPU:0.29s, MaxMemory:25464kb STDOUT: Upload complete. Waiting on bqjob_rc1d4ea62c9e38b9_0000016201b602b3_1 ... (0s) Current status: RUNNING Waiting on bqjob_rc1d4ea62c9e38b9_0000016201b602b3_1 ... (0s) Current status: DONE BigQuery error in load operation: Error processing job 'apache-beam-testing:bqjob_rc1d4ea62c9e38b9_0000016201b602b3_1': Invalid schema update. Field timestamp has changed type from TIMESTAMP to FLOAT STDERR: /usr/lib/google-cloud-sdk/platform/bq/third_party/oauth2client/contrib/gce.py:73: UserWarning: You have requested explicit scopes to be used with a GCE service account. Using this argument will have no effect on the actual scopes for tokens requested. These scopes are set at VM instance creation time and can't be overridden in the request. warnings.warn(_SCOPES_WARNING) 2018-03-07 18:25:30,856 e938099d MainThread INFO Retrying exception running IssueRetryableCommand: Command returned a non-zero exit code. 2018-03-07 18:25:59,583 e938099d MainThread INFO Running: bq load --autodetect --source_format=NEWLINE_DELIMITED_JSON beam_performance.pkb_results <https://builds.apache.org/job/beam_PerformanceTests_Spark/ws/runs/e938099d/perfkit-bq-pubc2QtdR.json> 2018-03-07 18:26:02,133 e938099d MainThread INFO Ran: {bq load --autodetect --source_format=NEWLINE_DELIMITED_JSON beam_performance.pkb_results <https://builds.apache.org/job/beam_PerformanceTests_Spark/ws/runs/e938099d/perfkit-bq-pubc2QtdR.json}> ReturnCode:1, WallTime:0:02.54s, CPU:0.35s, MaxMemory:25464kb STDOUT: Upload complete. Waiting on bqjob_r6dc9e32e16e2bd0d_0000016201b67e9d_1 ... (0s) Current status: RUNNING Waiting on bqjob_r6dc9e32e16e2bd0d_0000016201b67e9d_1 ... (0s) Current status: DONE BigQuery error in load operation: Error processing job 'apache-beam-testing:bqjob_r6dc9e32e16e2bd0d_0000016201b67e9d_1': Invalid schema update. Field timestamp has changed type from TIMESTAMP to FLOAT STDERR: /usr/lib/google-cloud-sdk/platform/bq/third_party/oauth2client/contrib/gce.py:73: UserWarning: You have requested explicit scopes to be used with a GCE service account. Using this argument will have no effect on the actual scopes for tokens requested. These scopes are set at VM instance creation time and can't be overridden in the request. warnings.warn(_SCOPES_WARNING) Traceback (most recent call last): File "PerfKitBenchmarker/pkb.py", line 21, in <module> sys.exit(Main()) File "<https://builds.apache.org/job/beam_PerformanceTests_Spark/ws/PerfKitBenchmarker/perfkitbenchmarker/pkb.py";,> line 926, in Main return RunBenchmarks() File "<https://builds.apache.org/job/beam_PerformanceTests_Spark/ws/PerfKitBenchmarker/perfkitbenchmarker/pkb.py";,> line 853, in RunBenchmarks collector.PublishSamples() File "<https://builds.apache.org/job/beam_PerformanceTests_Spark/ws/PerfKitBenchmarker/perfkitbenchmarker/publisher.py";,> line 886, in PublishSamples publisher.PublishSamples(self.samples) File "<https://builds.apache.org/job/beam_PerformanceTests_Spark/ws/PerfKitBenchmarker/perfkitbenchmarker/publisher.py";,> line 538, in PublishSamples vm_util.IssueRetryableCommand(load_cmd) File "<https://builds.apache.org/job/beam_PerformanceTests_Spark/ws/PerfKitBenchmarker/perfkitbenchmarker/vm_util.py";,> line 249, in WrappedFunction return f(*args, **kwargs) File "<https://builds.apache.org/job/beam_PerformanceTests_Spark/ws/PerfKitBenchmarker/perfkitbenchmarker/vm_util.py";,> line 387, in IssueRetryableCommand 'Command returned a non-zero exit code.\n') perfkitbenchmarker.errors.CalledProcessException: Command returned a non-zero exit code. Build step 'Execute shell' marked build as failure
