See <https://builds.apache.org/job/beam_PerformanceTests_Spark/1550/display/redirect?page=changes>
Changes: [rmannibucau] [BEAM-3993] read gitignore and add it in rat exclusions [lcwik] [BEAM-3993] Remove duplicate definitions between .gitignore and [herohde] [BEAM-3982] Register transform types and functions [lcwik] BEAM-3256 Add archetype testing/generation to existing GradleBuild [lcwik] [BEAM-3250] Creating a gradle Jenkins config for Flink PostCommit. [lcwik] Replace Maven based Flink ValidatesRunner postcommit with Gradle based [lcwik] [BEAM-3249] Drop Java Maven PreCommit. [aaltay] Fix Python streaming sordcount IT to unblock PostCommit (#5015) ------------------------------------------ [...truncated 89.79 KB...] 'apache-beam-testing:bqjob_r233028e4761af89e_00000162920d9004_1': Invalid schema update. Field timestamp has changed type from TIMESTAMP to FLOAT STDERR: /usr/lib/google-cloud-sdk/platform/bq/third_party/oauth2client/contrib/gce.py:73: UserWarning: You have requested explicit scopes to be used with a GCE service account. Using this argument will have no effect on the actual scopes for tokens requested. These scopes are set at VM instance creation time and can't be overridden in the request. warnings.warn(_SCOPES_WARNING) 2018-04-04 19:06:26,971 56d5f986 MainThread INFO Retrying exception running IssueRetryableCommand: Command returned a non-zero exit code. 2018-04-04 19:06:49,404 56d5f986 MainThread INFO Running: bq load --autodetect --source_format=NEWLINE_DELIMITED_JSON beam_performance.pkb_results <https://builds.apache.org/job/beam_PerformanceTests_Spark/ws/runs/56d5f986/perfkit-bq-pub0OBOa0.json> 2018-04-04 19:06:51,609 56d5f986 MainThread INFO Ran: {bq load --autodetect --source_format=NEWLINE_DELIMITED_JSON beam_performance.pkb_results <https://builds.apache.org/job/beam_PerformanceTests_Spark/ws/runs/56d5f986/perfkit-bq-pub0OBOa0.json}> ReturnCode:1 STDOUT: Upload complete. Waiting on bqjob_r462c8d483d1b33c5_00000162920deffe_1 ... (0s) Current status: RUNNING Waiting on bqjob_r462c8d483d1b33c5_00000162920deffe_1 ... (0s) Current status: DONE BigQuery error in load operation: Error processing job 'apache-beam-testing:bqjob_r462c8d483d1b33c5_00000162920deffe_1': Invalid schema update. Field timestamp has changed type from TIMESTAMP to FLOAT STDERR: /usr/lib/google-cloud-sdk/platform/bq/third_party/oauth2client/contrib/gce.py:73: UserWarning: You have requested explicit scopes to be used with a GCE service account. Using this argument will have no effect on the actual scopes for tokens requested. These scopes are set at VM instance creation time and can't be overridden in the request. warnings.warn(_SCOPES_WARNING) 2018-04-04 19:06:51,609 56d5f986 MainThread INFO Retrying exception running IssueRetryableCommand: Command returned a non-zero exit code. 2018-04-04 19:07:06,702 56d5f986 MainThread INFO Running: bq load --autodetect --source_format=NEWLINE_DELIMITED_JSON beam_performance.pkb_results <https://builds.apache.org/job/beam_PerformanceTests_Spark/ws/runs/56d5f986/perfkit-bq-pub0OBOa0.json> 2018-04-04 19:07:08,891 56d5f986 MainThread INFO Ran: {bq load --autodetect --source_format=NEWLINE_DELIMITED_JSON beam_performance.pkb_results <https://builds.apache.org/job/beam_PerformanceTests_Spark/ws/runs/56d5f986/perfkit-bq-pub0OBOa0.json}> ReturnCode:1 STDOUT: Upload complete. Waiting on bqjob_r16723ef8fe95e11c_00000162920e3363_1 ... (0s) Current status: RUNNING Waiting on bqjob_r16723ef8fe95e11c_00000162920e3363_1 ... (0s) Current status: DONE BigQuery error in load operation: Error processing job 'apache-beam-testing:bqjob_r16723ef8fe95e11c_00000162920e3363_1': Invalid schema update. Field timestamp has changed type from TIMESTAMP to FLOAT STDERR: /usr/lib/google-cloud-sdk/platform/bq/third_party/oauth2client/contrib/gce.py:73: UserWarning: You have requested explicit scopes to be used with a GCE service account. Using this argument will have no effect on the actual scopes for tokens requested. These scopes are set at VM instance creation time and can't be overridden in the request. warnings.warn(_SCOPES_WARNING) 2018-04-04 19:07:08,892 56d5f986 MainThread INFO Retrying exception running IssueRetryableCommand: Command returned a non-zero exit code. 2018-04-04 19:07:26,414 56d5f986 MainThread INFO Running: bq load --autodetect --source_format=NEWLINE_DELIMITED_JSON beam_performance.pkb_results <https://builds.apache.org/job/beam_PerformanceTests_Spark/ws/runs/56d5f986/perfkit-bq-pub0OBOa0.json> 2018-04-04 19:07:28,599 56d5f986 MainThread INFO Ran: {bq load --autodetect --source_format=NEWLINE_DELIMITED_JSON beam_performance.pkb_results <https://builds.apache.org/job/beam_PerformanceTests_Spark/ws/runs/56d5f986/perfkit-bq-pub0OBOa0.json}> ReturnCode:1 STDOUT: Upload complete. Waiting on bqjob_r2462920f622e4f0d_00000162920e8063_1 ... (0s) Current status: RUNNING Waiting on bqjob_r2462920f622e4f0d_00000162920e8063_1 ... (0s) Current status: DONE BigQuery error in load operation: Error processing job 'apache-beam-testing:bqjob_r2462920f622e4f0d_00000162920e8063_1': Invalid schema update. Field timestamp has changed type from TIMESTAMP to FLOAT STDERR: /usr/lib/google-cloud-sdk/platform/bq/third_party/oauth2client/contrib/gce.py:73: UserWarning: You have requested explicit scopes to be used with a GCE service account. Using this argument will have no effect on the actual scopes for tokens requested. These scopes are set at VM instance creation time and can't be overridden in the request. warnings.warn(_SCOPES_WARNING) 2018-04-04 19:07:28,599 56d5f986 MainThread INFO Retrying exception running IssueRetryableCommand: Command returned a non-zero exit code. 2018-04-04 19:07:50,634 56d5f986 MainThread INFO Running: bq load --autodetect --source_format=NEWLINE_DELIMITED_JSON beam_performance.pkb_results <https://builds.apache.org/job/beam_PerformanceTests_Spark/ws/runs/56d5f986/perfkit-bq-pub0OBOa0.json> 2018-04-04 19:07:52,895 56d5f986 MainThread INFO Ran: {bq load --autodetect --source_format=NEWLINE_DELIMITED_JSON beam_performance.pkb_results <https://builds.apache.org/job/beam_PerformanceTests_Spark/ws/runs/56d5f986/perfkit-bq-pub0OBOa0.json}> ReturnCode:1 STDOUT: Upload complete. Waiting on bqjob_r710d1dc666fd1d84_00000162920edf43_1 ... (0s) Current status: RUNNING Waiting on bqjob_r710d1dc666fd1d84_00000162920edf43_1 ... (0s) Current status: DONE BigQuery error in load operation: Error processing job 'apache-beam-testing:bqjob_r710d1dc666fd1d84_00000162920edf43_1': Invalid schema update. Field timestamp has changed type from TIMESTAMP to FLOAT STDERR: /usr/lib/google-cloud-sdk/platform/bq/third_party/oauth2client/contrib/gce.py:73: UserWarning: You have requested explicit scopes to be used with a GCE service account. Using this argument will have no effect on the actual scopes for tokens requested. These scopes are set at VM instance creation time and can't be overridden in the request. warnings.warn(_SCOPES_WARNING) 2018-04-04 19:07:52,896 56d5f986 MainThread INFO Retrying exception running IssueRetryableCommand: Command returned a non-zero exit code. 2018-04-04 19:08:10,174 56d5f986 MainThread INFO Running: bq load --autodetect --source_format=NEWLINE_DELIMITED_JSON beam_performance.pkb_results <https://builds.apache.org/job/beam_PerformanceTests_Spark/ws/runs/56d5f986/perfkit-bq-pub0OBOa0.json> 2018-04-04 19:08:12,395 56d5f986 MainThread INFO Ran: {bq load --autodetect --source_format=NEWLINE_DELIMITED_JSON beam_performance.pkb_results <https://builds.apache.org/job/beam_PerformanceTests_Spark/ws/runs/56d5f986/perfkit-bq-pub0OBOa0.json}> ReturnCode:1 STDOUT: Upload complete. Waiting on bqjob_r26b1ff117c31fb3_00000162920f2b9a_1 ... (0s) Current status: RUNNING Waiting on bqjob_r26b1ff117c31fb3_00000162920f2b9a_1 ... (0s) Current status: DONE BigQuery error in load operation: Error processing job 'apache-beam-testing:bqjob_r26b1ff117c31fb3_00000162920f2b9a_1': Invalid schema update. Field timestamp has changed type from TIMESTAMP to FLOAT STDERR: /usr/lib/google-cloud-sdk/platform/bq/third_party/oauth2client/contrib/gce.py:73: UserWarning: You have requested explicit scopes to be used with a GCE service account. Using this argument will have no effect on the actual scopes for tokens requested. These scopes are set at VM instance creation time and can't be overridden in the request. warnings.warn(_SCOPES_WARNING) 2018-04-04 19:08:12,395 56d5f986 MainThread INFO Retrying exception running IssueRetryableCommand: Command returned a non-zero exit code. 2018-04-04 19:08:39,590 56d5f986 MainThread INFO Running: bq load --autodetect --source_format=NEWLINE_DELIMITED_JSON beam_performance.pkb_results <https://builds.apache.org/job/beam_PerformanceTests_Spark/ws/runs/56d5f986/perfkit-bq-pub0OBOa0.json> 2018-04-04 19:08:42,270 56d5f986 MainThread INFO Ran: {bq load --autodetect --source_format=NEWLINE_DELIMITED_JSON beam_performance.pkb_results <https://builds.apache.org/job/beam_PerformanceTests_Spark/ws/runs/56d5f986/perfkit-bq-pub0OBOa0.json}> ReturnCode:1 STDOUT: Upload complete. Waiting on bqjob_r6a6bafe0d632e2ee_00000162920f9edb_1 ... (0s) Current status: RUNNING Waiting on bqjob_r6a6bafe0d632e2ee_00000162920f9edb_1 ... (0s) Current status: DONE BigQuery error in load operation: Error processing job 'apache-beam-testing:bqjob_r6a6bafe0d632e2ee_00000162920f9edb_1': Invalid schema update. Field timestamp has changed type from TIMESTAMP to FLOAT STDERR: /usr/lib/google-cloud-sdk/platform/bq/third_party/oauth2client/contrib/gce.py:73: UserWarning: You have requested explicit scopes to be used with a GCE service account. Using this argument will have no effect on the actual scopes for tokens requested. These scopes are set at VM instance creation time and can't be overridden in the request. warnings.warn(_SCOPES_WARNING) 2018-04-04 19:08:42,271 56d5f986 MainThread INFO Retrying exception running IssueRetryableCommand: Command returned a non-zero exit code. 2018-04-04 19:09:00,582 56d5f986 MainThread INFO Running: bq load --autodetect --source_format=NEWLINE_DELIMITED_JSON beam_performance.pkb_results <https://builds.apache.org/job/beam_PerformanceTests_Spark/ws/runs/56d5f986/perfkit-bq-pub0OBOa0.json> 2018-04-04 19:09:22,995 56d5f986 MainThread INFO Ran: {bq load --autodetect --source_format=NEWLINE_DELIMITED_JSON beam_performance.pkb_results <https://builds.apache.org/job/beam_PerformanceTests_Spark/ws/runs/56d5f986/perfkit-bq-pub0OBOa0.json}> ReturnCode:1 STDOUT: Upload complete. Waiting on bqjob_r490eb2627dac49ec_00000162920ff051_1 ... (0s) Current status: RUNNING Waiting on bqjob_r490eb2627dac49ec_00000162920ff051_1 ... (0s) Current status: DONE BigQuery error in load operation: Error processing job 'apache-beam-testing:bqjob_r490eb2627dac49ec_00000162920ff051_1': Invalid schema update. Field timestamp has changed type from TIMESTAMP to FLOAT STDERR: /usr/lib/google-cloud-sdk/platform/bq/third_party/oauth2client/contrib/gce.py:73: UserWarning: You have requested explicit scopes to be used with a GCE service account. Using this argument will have no effect on the actual scopes for tokens requested. These scopes are set at VM instance creation time and can't be overridden in the request. warnings.warn(_SCOPES_WARNING) 2018-04-04 19:09:22,996 56d5f986 MainThread INFO Retrying exception running IssueRetryableCommand: Command returned a non-zero exit code. 2018-04-04 19:09:38,044 56d5f986 MainThread INFO Running: bq load --autodetect --source_format=NEWLINE_DELIMITED_JSON beam_performance.pkb_results <https://builds.apache.org/job/beam_PerformanceTests_Spark/ws/runs/56d5f986/perfkit-bq-pub0OBOa0.json> 2018-04-04 19:09:40,226 56d5f986 MainThread INFO Ran: {bq load --autodetect --source_format=NEWLINE_DELIMITED_JSON beam_performance.pkb_results <https://builds.apache.org/job/beam_PerformanceTests_Spark/ws/runs/56d5f986/perfkit-bq-pub0OBOa0.json}> ReturnCode:1 STDOUT: Upload complete. Waiting on bqjob_r79bfe556093ba406_000001629210828d_1 ... (0s) Current status: RUNNING Waiting on bqjob_r79bfe556093ba406_000001629210828d_1 ... (0s) Current status: DONE BigQuery error in load operation: Error processing job 'apache-beam-testing:bqjob_r79bfe556093ba406_000001629210828d_1': Invalid schema update. Field timestamp has changed type from TIMESTAMP to FLOAT STDERR: /usr/lib/google-cloud-sdk/platform/bq/third_party/oauth2client/contrib/gce.py:73: UserWarning: You have requested explicit scopes to be used with a GCE service account. Using this argument will have no effect on the actual scopes for tokens requested. These scopes are set at VM instance creation time and can't be overridden in the request. warnings.warn(_SCOPES_WARNING) 2018-04-04 19:09:40,227 56d5f986 MainThread INFO Retrying exception running IssueRetryableCommand: Command returned a non-zero exit code. 2018-04-04 19:10:01,105 56d5f986 MainThread INFO Running: bq load --autodetect --source_format=NEWLINE_DELIMITED_JSON beam_performance.pkb_results <https://builds.apache.org/job/beam_PerformanceTests_Spark/ws/runs/56d5f986/perfkit-bq-pub0OBOa0.json> 2018-04-04 19:10:04,766 56d5f986 MainThread INFO Ran: {bq load --autodetect --source_format=NEWLINE_DELIMITED_JSON beam_performance.pkb_results <https://builds.apache.org/job/beam_PerformanceTests_Spark/ws/runs/56d5f986/perfkit-bq-pub0OBOa0.json}> ReturnCode:1 STDOUT: Upload complete. Waiting on bqjob_r50bf84eed32613d0_000001629210dcae_1 ... (0s) Current status: RUNNING Waiting on bqjob_r50bf84eed32613d0_000001629210dcae_1 ... (0s) Current status: DONE BigQuery error in load operation: Error processing job 'apache-beam-testing:bqjob_r50bf84eed32613d0_000001629210dcae_1': Invalid schema update. Field timestamp has changed type from TIMESTAMP to FLOAT STDERR: /usr/lib/google-cloud-sdk/platform/bq/third_party/oauth2client/contrib/gce.py:73: UserWarning: You have requested explicit scopes to be used with a GCE service account. Using this argument will have no effect on the actual scopes for tokens requested. These scopes are set at VM instance creation time and can't be overridden in the request. warnings.warn(_SCOPES_WARNING) 2018-04-04 19:10:04,767 56d5f986 MainThread INFO Retrying exception running IssueRetryableCommand: Command returned a non-zero exit code. 2018-04-04 19:10:29,198 56d5f986 MainThread INFO Running: bq load --autodetect --source_format=NEWLINE_DELIMITED_JSON beam_performance.pkb_results <https://builds.apache.org/job/beam_PerformanceTests_Spark/ws/runs/56d5f986/perfkit-bq-pub0OBOa0.json> 2018-04-04 19:10:33,394 56d5f986 MainThread INFO Ran: {bq load --autodetect --source_format=NEWLINE_DELIMITED_JSON beam_performance.pkb_results <https://builds.apache.org/job/beam_PerformanceTests_Spark/ws/runs/56d5f986/perfkit-bq-pub0OBOa0.json}> ReturnCode:1 STDOUT: Upload complete. Waiting on bqjob_r4c9cb6a895e4dc36_0000016292114e5e_1 ... (0s) Current status: RUNNING Waiting on bqjob_r4c9cb6a895e4dc36_0000016292114e5e_1 ... (1s) Current status: RUNNING Waiting on bqjob_r4c9cb6a895e4dc36_0000016292114e5e_1 ... (1s) Current status: DONE BigQuery error in load operation: Error processing job 'apache-beam-testing:bqjob_r4c9cb6a895e4dc36_0000016292114e5e_1': Invalid schema update. Field timestamp has changed type from TIMESTAMP to FLOAT STDERR: /usr/lib/google-cloud-sdk/platform/bq/third_party/oauth2client/contrib/gce.py:73: UserWarning: You have requested explicit scopes to be used with a GCE service account. Using this argument will have no effect on the actual scopes for tokens requested. These scopes are set at VM instance creation time and can't be overridden in the request. warnings.warn(_SCOPES_WARNING) 2018-04-04 19:10:33,395 56d5f986 MainThread INFO Retrying exception running IssueRetryableCommand: Command returned a non-zero exit code. 2018-04-04 19:10:57,704 56d5f986 MainThread INFO Running: bq load --autodetect --source_format=NEWLINE_DELIMITED_JSON beam_performance.pkb_results <https://builds.apache.org/job/beam_PerformanceTests_Spark/ws/runs/56d5f986/perfkit-bq-pub0OBOa0.json> 2018-04-04 19:10:59,920 56d5f986 MainThread INFO Ran: {bq load --autodetect --source_format=NEWLINE_DELIMITED_JSON beam_performance.pkb_results <https://builds.apache.org/job/beam_PerformanceTests_Spark/ws/runs/56d5f986/perfkit-bq-pub0OBOa0.json}> ReturnCode:1 STDOUT: Upload complete. Waiting on bqjob_ra0e365871a38394_000001629211b9ce_1 ... (0s) Current status: RUNNING Waiting on bqjob_ra0e365871a38394_000001629211b9ce_1 ... (0s) Current status: DONE BigQuery error in load operation: Error processing job 'apache-beam-testing:bqjob_ra0e365871a38394_000001629211b9ce_1': Invalid schema update. Field timestamp has changed type from TIMESTAMP to FLOAT STDERR: /usr/lib/google-cloud-sdk/platform/bq/third_party/oauth2client/contrib/gce.py:73: UserWarning: You have requested explicit scopes to be used with a GCE service account. Using this argument will have no effect on the actual scopes for tokens requested. These scopes are set at VM instance creation time and can't be overridden in the request. warnings.warn(_SCOPES_WARNING) 2018-04-04 19:10:59,920 56d5f986 MainThread INFO Retrying exception running IssueRetryableCommand: Command returned a non-zero exit code. 2018-04-04 19:11:20,555 56d5f986 MainThread INFO Running: bq load --autodetect --source_format=NEWLINE_DELIMITED_JSON beam_performance.pkb_results <https://builds.apache.org/job/beam_PerformanceTests_Spark/ws/runs/56d5f986/perfkit-bq-pub0OBOa0.json> 2018-04-04 19:11:22,773 56d5f986 MainThread INFO Ran: {bq load --autodetect --source_format=NEWLINE_DELIMITED_JSON beam_performance.pkb_results <https://builds.apache.org/job/beam_PerformanceTests_Spark/ws/runs/56d5f986/perfkit-bq-pub0OBOa0.json}> ReturnCode:1 STDOUT: Upload complete. Waiting on bqjob_raf04f84ab4366cd_00000162921212fd_1 ... (0s) Current status: RUNNING Waiting on bqjob_raf04f84ab4366cd_00000162921212fd_1 ... (0s) Current status: DONE BigQuery error in load operation: Error processing job 'apache-beam-testing:bqjob_raf04f84ab4366cd_00000162921212fd_1': Invalid schema update. Field timestamp has changed type from TIMESTAMP to FLOAT STDERR: /usr/lib/google-cloud-sdk/platform/bq/third_party/oauth2client/contrib/gce.py:73: UserWarning: You have requested explicit scopes to be used with a GCE service account. Using this argument will have no effect on the actual scopes for tokens requested. These scopes are set at VM instance creation time and can't be overridden in the request. warnings.warn(_SCOPES_WARNING) 2018-04-04 19:11:22,774 56d5f986 MainThread INFO Retrying exception running IssueRetryableCommand: Command returned a non-zero exit code. 2018-04-04 19:11:48,494 56d5f986 MainThread INFO Running: bq load --autodetect --source_format=NEWLINE_DELIMITED_JSON beam_performance.pkb_results <https://builds.apache.org/job/beam_PerformanceTests_Spark/ws/runs/56d5f986/perfkit-bq-pub0OBOa0.json> 2018-04-04 19:11:54,307 56d5f986 MainThread INFO Ran: {bq load --autodetect --source_format=NEWLINE_DELIMITED_JSON beam_performance.pkb_results <https://builds.apache.org/job/beam_PerformanceTests_Spark/ws/runs/56d5f986/perfkit-bq-pub0OBOa0.json}> ReturnCode:1 STDOUT: Upload complete. Waiting on bqjob_r1c9009d7130c82f3_0000016292128013_1 ... (0s) Current status: RUNNING Waiting on bqjob_r1c9009d7130c82f3_0000016292128013_1 ... (0s) Current status: DONE BigQuery error in load operation: Error processing job 'apache-beam-testing:bqjob_r1c9009d7130c82f3_0000016292128013_1': Invalid schema update. Field timestamp has changed type from TIMESTAMP to FLOAT STDERR: /usr/lib/google-cloud-sdk/platform/bq/third_party/oauth2client/contrib/gce.py:73: UserWarning: You have requested explicit scopes to be used with a GCE service account. Using this argument will have no effect on the actual scopes for tokens requested. These scopes are set at VM instance creation time and can't be overridden in the request. warnings.warn(_SCOPES_WARNING) Traceback (most recent call last): File "PerfKitBenchmarker/pkb.py", line 21, in <module> sys.exit(Main()) File "<https://builds.apache.org/job/beam_PerformanceTests_Spark/ws/PerfKitBenchmarker/perfkitbenchmarker/pkb.py";,> line 952, in Main return RunBenchmarks() File "<https://builds.apache.org/job/beam_PerformanceTests_Spark/ws/PerfKitBenchmarker/perfkitbenchmarker/pkb.py";,> line 879, in RunBenchmarks collector.PublishSamples() File "<https://builds.apache.org/job/beam_PerformanceTests_Spark/ws/PerfKitBenchmarker/perfkitbenchmarker/publisher.py";,> line 886, in PublishSamples publisher.PublishSamples(self.samples) File "<https://builds.apache.org/job/beam_PerformanceTests_Spark/ws/PerfKitBenchmarker/perfkitbenchmarker/publisher.py";,> line 538, in PublishSamples vm_util.IssueRetryableCommand(load_cmd) File "<https://builds.apache.org/job/beam_PerformanceTests_Spark/ws/PerfKitBenchmarker/perfkitbenchmarker/vm_util.py";,> line 249, in WrappedFunction return f(*args, **kwargs) File "<https://builds.apache.org/job/beam_PerformanceTests_Spark/ws/PerfKitBenchmarker/perfkitbenchmarker/vm_util.py";,> line 387, in IssueRetryableCommand 'Command returned a non-zero exit code.\n') perfkitbenchmarker.errors.CalledProcessException: Command returned a non-zero exit code. Build step 'Execute shell' marked build as failure
