See <https://builds.apache.org/job/beam_PerformanceTests_Spark/1578/display/redirect?page=changes>
Changes: [rezarokni] initial commit for BEAM-2871. WIP Todo: Add in the unit tests to work [relax] Update python version. [relax] Update container version. [kirpichov] Cherrypick of #3995 to 2.2.0: Add custom tempLocation support to [jbonofre] [BEAM-1017] Add RedisIO [kenn] Use 2.2.0 container tag for Dataflow [chamikara] Sets user agent in BigTableIO.Read.getBigTableService(). [valentyn] Pin runner harness container image for Dataflow distributions of BEAM [valentyn] Make linter happy. [valentyn] [BEAM-2600] Add minimal python SDK harness container [valentyn] Use 2.2.0 version instead of 2.3.0 for container Maven project on the [valentyn] Use tox instead of detox. Looks like we reverted to tox on the master [valentyn] Pin runner harness also for official BEAM releases. [relax] [maven-release-plugin] prepare release [relax] [maven-release-plugin] prepare for next development iteration [relax] Revert "[maven-release-plugin] prepare for next development iteration" [relax] Revert "[maven-release-plugin] prepare release [relax] [maven-release-plugin] prepare release v2.2.0-RC1 [relax] [maven-release-plugin] rollback changes from release preparation of [altay] Add an element batching transform. [altay] Align names with those produced by the dataflow runner harness. [altay] Fix from any -> bytes transition. [altay] Add an option for dataflow job labels. [altay] Unit test for label pipeline option [altay] Update container version for python DataflowRunner for the 2.2.0 release [relax] [maven-release-plugin] prepare release v2.2.0-RC2 [relax] [maven-release-plugin] rollback changes from release preparation of [relax] [maven-release-plugin] prepare release v2.2.0-RC3 [relax] [maven-release-plugin] rollback changes from release preparation of [valentyn] Set save_main_session to True for csv module [valentyn] Set OnTimeBehavior in windowing strategy to FIRE_ALWAYS. [valentyn] Update urns.py [ccy] CP #4112, #4122: Properly handle side input exception when all reader [relax] Cherrypick WriteFiles fix. [relax] [maven-release-plugin] prepare release v2.2.0-RC4 [relax] [maven-release-plugin] rollback changes from release preparation of [rezarokni] initial commit for BEAM-2871. WIP Todo: Add in the unit tests to work [rezarokni] [maven-release-plugin] prepare for next development iteration [rezarokni] Bump Python version for next release. [rezarokni] Only fail nightly release at end, for more detailed signal [rezarokni] Only fail Java postcommit at end [rezarokni] Move the Job Server into a Submodule [rezarokni] Add Artifact Staging Endpoint to PrepareJobResponse [rezarokni] Add model/ and submodules to Maven structure and gen_protos.py [rezarokni] Move sdk/common/runner-api protos into model/pipeline and [rezarokni] Move sdks/common/fn-api protos to model/fn-execution [rezarokni] Remove sdks/common [rezarokni] Re-namespace model/pipeline to model.pipeline [rezarokni] Re-namespace model/job-management to model.job_management [rezarokni] Re-namespace model/fn-execution to model.fn_execution [rezarokni] Improve error message when standard_coders.yaml not found [rezarokni] Dataflow runner: shade protobuf and beam model [rezarokni] PipelineOptionsFactory should prevent non PipelineOptions interfaces [rezarokni] [BEAM-3016] Fix blocking issue within run() when channel terminates [rezarokni] [BEAM-2576] Reflect portability proto changes in Go [rezarokni] Add licenses to generated code [rezarokni] Improve the documentation for CombineFn [rezarokni] Remove coders from DoFn's Remove extra space in hello.cc file Remove [rezarokni] Fix Bug if more than one external lib DoFn is used in same pipeline the [rezarokni] Removed more complex examples for later PR Added semaphore logic to [7542791+rezarokni] Added Assert for test pipeline. Added comments and new file names for [7542791+rezarokni] Added ability to read Binary output from files for use with Protobuf [7542791+rezarokni] Moved files from java8 to java [7542791+rezarokni] Correct checkstyle issues [amyrvold] [BEAM-4035] Fix spark validatesrunner [amyrvold] Change ver of zookeeper instead of removing mavenLocal [7542791+rezarokni] Fix findBugs issues [lcwik] [BEAM-3249, BEAM-4014] Automatically propagate shading configuration to [lcwik] [BEAM-3249] Add support for translating 'provided' scope dependencies to [kenn] Basic run task for nexmark with runner selection ------------------------------------------ [...truncated 90.03 KB...] 'apache-beam-testing:bqjob_r7c11a60299450765_00000162b60fd524_1': Invalid schema update. Field timestamp has changed type from TIMESTAMP to FLOAT STDERR: /usr/lib/google-cloud-sdk/platform/bq/third_party/oauth2client/contrib/gce.py:73: UserWarning: You have requested explicit scopes to be used with a GCE service account. Using this argument will have no effect on the actual scopes for tokens requested. These scopes are set at VM instance creation time and can't be overridden in the request. warnings.warn(_SCOPES_WARNING) 2018-04-11 18:55:15,918 c7c5cc31 MainThread INFO Retrying exception running IssueRetryableCommand: Command returned a non-zero exit code. 2018-04-11 18:55:42,801 c7c5cc31 MainThread INFO Running: bq load --autodetect --source_format=NEWLINE_DELIMITED_JSON beam_performance.pkb_results <https://builds.apache.org/job/beam_PerformanceTests_Spark/ws/runs/c7c5cc31/perfkit-bq-pubiK8V1U.json> 2018-04-11 18:55:45,812 c7c5cc31 MainThread INFO Ran: {bq load --autodetect --source_format=NEWLINE_DELIMITED_JSON beam_performance.pkb_results <https://builds.apache.org/job/beam_PerformanceTests_Spark/ws/runs/c7c5cc31/perfkit-bq-pubiK8V1U.json}> ReturnCode:1 STDOUT: Upload complete. Waiting on bqjob_r79abfd7e8054c415_00000162b6104a3f_1 ... (0s) Current status: RUNNING Waiting on bqjob_r79abfd7e8054c415_00000162b6104a3f_1 ... (0s) Current status: DONE BigQuery error in load operation: Error processing job 'apache-beam-testing:bqjob_r79abfd7e8054c415_00000162b6104a3f_1': Invalid schema update. Field timestamp has changed type from TIMESTAMP to FLOAT STDERR: /usr/lib/google-cloud-sdk/platform/bq/third_party/oauth2client/contrib/gce.py:73: UserWarning: You have requested explicit scopes to be used with a GCE service account. Using this argument will have no effect on the actual scopes for tokens requested. These scopes are set at VM instance creation time and can't be overridden in the request. warnings.warn(_SCOPES_WARNING) 2018-04-11 18:55:45,812 c7c5cc31 MainThread INFO Retrying exception running IssueRetryableCommand: Command returned a non-zero exit code. 2018-04-11 18:56:15,557 c7c5cc31 MainThread INFO Running: bq load --autodetect --source_format=NEWLINE_DELIMITED_JSON beam_performance.pkb_results <https://builds.apache.org/job/beam_PerformanceTests_Spark/ws/runs/c7c5cc31/perfkit-bq-pubiK8V1U.json> 2018-04-11 18:56:21,048 c7c5cc31 MainThread INFO Ran: {bq load --autodetect --source_format=NEWLINE_DELIMITED_JSON beam_performance.pkb_results <https://builds.apache.org/job/beam_PerformanceTests_Spark/ws/runs/c7c5cc31/perfkit-bq-pubiK8V1U.json}> ReturnCode:1 STDOUT: Upload complete. Waiting on bqjob_r44b622264d62e68b_00000162b610cba5_1 ... (0s) Current status: RUNNING Waiting on bqjob_r44b622264d62e68b_00000162b610cba5_1 ... (1s) Current status: RUNNING Waiting on bqjob_r44b622264d62e68b_00000162b610cba5_1 ... (2s) Current status: RUNNING Waiting on bqjob_r44b622264d62e68b_00000162b610cba5_1 ... (2s) Current status: DONE BigQuery error in load operation: Error processing job 'apache-beam-testing:bqjob_r44b622264d62e68b_00000162b610cba5_1': Invalid schema update. Field timestamp has changed type from TIMESTAMP to FLOAT STDERR: /usr/lib/google-cloud-sdk/platform/bq/third_party/oauth2client/contrib/gce.py:73: UserWarning: You have requested explicit scopes to be used with a GCE service account. Using this argument will have no effect on the actual scopes for tokens requested. These scopes are set at VM instance creation time and can't be overridden in the request. warnings.warn(_SCOPES_WARNING) 2018-04-11 18:56:21,049 c7c5cc31 MainThread INFO Retrying exception running IssueRetryableCommand: Command returned a non-zero exit code. 2018-04-11 18:56:47,509 c7c5cc31 MainThread INFO Running: bq load --autodetect --source_format=NEWLINE_DELIMITED_JSON beam_performance.pkb_results <https://builds.apache.org/job/beam_PerformanceTests_Spark/ws/runs/c7c5cc31/perfkit-bq-pubiK8V1U.json> 2018-04-11 18:56:50,461 c7c5cc31 MainThread INFO Ran: {bq load --autodetect --source_format=NEWLINE_DELIMITED_JSON beam_performance.pkb_results <https://builds.apache.org/job/beam_PerformanceTests_Spark/ws/runs/c7c5cc31/perfkit-bq-pubiK8V1U.json}> ReturnCode:1 STDOUT: Upload complete. Waiting on bqjob_r1b15b4e4b482a28c_00000162b611469e_1 ... (0s) Current status: RUNNING Waiting on bqjob_r1b15b4e4b482a28c_00000162b611469e_1 ... (0s) Current status: DONE BigQuery error in load operation: Error processing job 'apache-beam-testing:bqjob_r1b15b4e4b482a28c_00000162b611469e_1': Invalid schema update. Field timestamp has changed type from TIMESTAMP to FLOAT STDERR: /usr/lib/google-cloud-sdk/platform/bq/third_party/oauth2client/contrib/gce.py:73: UserWarning: You have requested explicit scopes to be used with a GCE service account. Using this argument will have no effect on the actual scopes for tokens requested. These scopes are set at VM instance creation time and can't be overridden in the request. warnings.warn(_SCOPES_WARNING) 2018-04-11 18:56:50,462 c7c5cc31 MainThread INFO Retrying exception running IssueRetryableCommand: Command returned a non-zero exit code. 2018-04-11 18:57:20,301 c7c5cc31 MainThread INFO Running: bq load --autodetect --source_format=NEWLINE_DELIMITED_JSON beam_performance.pkb_results <https://builds.apache.org/job/beam_PerformanceTests_Spark/ws/runs/c7c5cc31/perfkit-bq-pubiK8V1U.json> 2018-04-11 18:57:24,704 c7c5cc31 MainThread INFO Ran: {bq load --autodetect --source_format=NEWLINE_DELIMITED_JSON beam_performance.pkb_results <https://builds.apache.org/job/beam_PerformanceTests_Spark/ws/runs/c7c5cc31/perfkit-bq-pubiK8V1U.json}> ReturnCode:1 STDOUT: Upload complete. Waiting on bqjob_r58accc58cba98_00000162b611cd26_1 ... (0s) Current status: RUNNING Waiting on bqjob_r58accc58cba98_00000162b611cd26_1 ... (0s) Current status: DONE BigQuery error in load operation: Error processing job 'apache-beam-testing:bqjob_r58accc58cba98_00000162b611cd26_1': Invalid schema update. Field timestamp has changed type from TIMESTAMP to FLOAT STDERR: /usr/lib/google-cloud-sdk/platform/bq/third_party/oauth2client/contrib/gce.py:73: UserWarning: You have requested explicit scopes to be used with a GCE service account. Using this argument will have no effect on the actual scopes for tokens requested. These scopes are set at VM instance creation time and can't be overridden in the request. warnings.warn(_SCOPES_WARNING) 2018-04-11 18:57:24,704 c7c5cc31 MainThread INFO Retrying exception running IssueRetryableCommand: Command returned a non-zero exit code. 2018-04-11 18:57:43,225 c7c5cc31 MainThread INFO Running: bq load --autodetect --source_format=NEWLINE_DELIMITED_JSON beam_performance.pkb_results <https://builds.apache.org/job/beam_PerformanceTests_Spark/ws/runs/c7c5cc31/perfkit-bq-pubiK8V1U.json> 2018-04-11 18:57:45,700 c7c5cc31 MainThread INFO Ran: {bq load --autodetect --source_format=NEWLINE_DELIMITED_JSON beam_performance.pkb_results <https://builds.apache.org/job/beam_PerformanceTests_Spark/ws/runs/c7c5cc31/perfkit-bq-pubiK8V1U.json}> ReturnCode:1 STDOUT: Upload complete. Waiting on bqjob_r127fabee362bc58e_00000162b6121f51_1 ... (0s) Current status: RUNNING Waiting on bqjob_r127fabee362bc58e_00000162b6121f51_1 ... (0s) Current status: DONE BigQuery error in load operation: Error processing job 'apache-beam-testing:bqjob_r127fabee362bc58e_00000162b6121f51_1': Invalid schema update. Field timestamp has changed type from TIMESTAMP to FLOAT STDERR: /usr/lib/google-cloud-sdk/platform/bq/third_party/oauth2client/contrib/gce.py:73: UserWarning: You have requested explicit scopes to be used with a GCE service account. Using this argument will have no effect on the actual scopes for tokens requested. These scopes are set at VM instance creation time and can't be overridden in the request. warnings.warn(_SCOPES_WARNING) 2018-04-11 18:57:45,700 c7c5cc31 MainThread INFO Retrying exception running IssueRetryableCommand: Command returned a non-zero exit code. 2018-04-11 18:58:08,621 c7c5cc31 MainThread INFO Running: bq load --autodetect --source_format=NEWLINE_DELIMITED_JSON beam_performance.pkb_results <https://builds.apache.org/job/beam_PerformanceTests_Spark/ws/runs/c7c5cc31/perfkit-bq-pubiK8V1U.json> 2018-04-11 18:58:11,555 c7c5cc31 MainThread INFO Ran: {bq load --autodetect --source_format=NEWLINE_DELIMITED_JSON beam_performance.pkb_results <https://builds.apache.org/job/beam_PerformanceTests_Spark/ws/runs/c7c5cc31/perfkit-bq-pubiK8V1U.json}> ReturnCode:1 STDOUT: Upload complete. Waiting on bqjob_r16a01e1000a22dc9_00000162b6128470_1 ... (0s) Current status: RUNNING Waiting on bqjob_r16a01e1000a22dc9_00000162b6128470_1 ... (0s) Current status: DONE BigQuery error in load operation: Error processing job 'apache-beam-testing:bqjob_r16a01e1000a22dc9_00000162b6128470_1': Invalid schema update. Field timestamp has changed type from TIMESTAMP to FLOAT STDERR: /usr/lib/google-cloud-sdk/platform/bq/third_party/oauth2client/contrib/gce.py:73: UserWarning: You have requested explicit scopes to be used with a GCE service account. Using this argument will have no effect on the actual scopes for tokens requested. These scopes are set at VM instance creation time and can't be overridden in the request. warnings.warn(_SCOPES_WARNING) 2018-04-11 18:58:11,555 c7c5cc31 MainThread INFO Retrying exception running IssueRetryableCommand: Command returned a non-zero exit code. 2018-04-11 18:58:33,241 c7c5cc31 MainThread INFO Running: bq load --autodetect --source_format=NEWLINE_DELIMITED_JSON beam_performance.pkb_results <https://builds.apache.org/job/beam_PerformanceTests_Spark/ws/runs/c7c5cc31/perfkit-bq-pubiK8V1U.json> 2018-04-11 18:58:36,226 c7c5cc31 MainThread INFO Ran: {bq load --autodetect --source_format=NEWLINE_DELIMITED_JSON beam_performance.pkb_results <https://builds.apache.org/job/beam_PerformanceTests_Spark/ws/runs/c7c5cc31/perfkit-bq-pubiK8V1U.json}> ReturnCode:1 STDOUT: Upload complete. Waiting on bqjob_r3dfaf5a1b6695ce1_00000162b612e3db_1 ... (0s) Current status: RUNNING Waiting on bqjob_r3dfaf5a1b6695ce1_00000162b612e3db_1 ... (0s) Current status: DONE BigQuery error in load operation: Error processing job 'apache-beam-testing:bqjob_r3dfaf5a1b6695ce1_00000162b612e3db_1': Invalid schema update. Field timestamp has changed type from TIMESTAMP to FLOAT STDERR: /usr/lib/google-cloud-sdk/platform/bq/third_party/oauth2client/contrib/gce.py:73: UserWarning: You have requested explicit scopes to be used with a GCE service account. Using this argument will have no effect on the actual scopes for tokens requested. These scopes are set at VM instance creation time and can't be overridden in the request. warnings.warn(_SCOPES_WARNING) 2018-04-11 18:58:36,227 c7c5cc31 MainThread INFO Retrying exception running IssueRetryableCommand: Command returned a non-zero exit code. 2018-04-11 18:58:53,377 c7c5cc31 MainThread INFO Running: bq load --autodetect --source_format=NEWLINE_DELIMITED_JSON beam_performance.pkb_results <https://builds.apache.org/job/beam_PerformanceTests_Spark/ws/runs/c7c5cc31/perfkit-bq-pubiK8V1U.json> 2018-04-11 18:58:56,117 c7c5cc31 MainThread INFO Ran: {bq load --autodetect --source_format=NEWLINE_DELIMITED_JSON beam_performance.pkb_results <https://builds.apache.org/job/beam_PerformanceTests_Spark/ws/runs/c7c5cc31/perfkit-bq-pubiK8V1U.json}> ReturnCode:1 STDOUT: Upload complete. Waiting on bqjob_r5b3d5974e1e46c39_00000162b6133293_1 ... (0s) Current status: RUNNING Waiting on bqjob_r5b3d5974e1e46c39_00000162b6133293_1 ... (0s) Current status: DONE BigQuery error in load operation: Error processing job 'apache-beam-testing:bqjob_r5b3d5974e1e46c39_00000162b6133293_1': Invalid schema update. Field timestamp has changed type from TIMESTAMP to FLOAT STDERR: /usr/lib/google-cloud-sdk/platform/bq/third_party/oauth2client/contrib/gce.py:73: UserWarning: You have requested explicit scopes to be used with a GCE service account. Using this argument will have no effect on the actual scopes for tokens requested. These scopes are set at VM instance creation time and can't be overridden in the request. warnings.warn(_SCOPES_WARNING) 2018-04-11 18:58:56,118 c7c5cc31 MainThread INFO Retrying exception running IssueRetryableCommand: Command returned a non-zero exit code. 2018-04-11 18:59:14,057 c7c5cc31 MainThread INFO Running: bq load --autodetect --source_format=NEWLINE_DELIMITED_JSON beam_performance.pkb_results <https://builds.apache.org/job/beam_PerformanceTests_Spark/ws/runs/c7c5cc31/perfkit-bq-pubiK8V1U.json> 2018-04-11 18:59:18,056 c7c5cc31 MainThread INFO Ran: {bq load --autodetect --source_format=NEWLINE_DELIMITED_JSON beam_performance.pkb_results <https://builds.apache.org/job/beam_PerformanceTests_Spark/ws/runs/c7c5cc31/perfkit-bq-pubiK8V1U.json}> ReturnCode:1 STDOUT: Upload complete. Waiting on bqjob_r4d6f3ca9f311f868_00000162b6138456_1 ... (0s) Current status: RUNNING Waiting on bqjob_r4d6f3ca9f311f868_00000162b6138456_1 ... (0s) Current status: DONE BigQuery error in load operation: Error processing job 'apache-beam-testing:bqjob_r4d6f3ca9f311f868_00000162b6138456_1': Invalid schema update. Field timestamp has changed type from TIMESTAMP to FLOAT STDERR: /usr/lib/google-cloud-sdk/platform/bq/third_party/oauth2client/contrib/gce.py:73: UserWarning: You have requested explicit scopes to be used with a GCE service account. Using this argument will have no effect on the actual scopes for tokens requested. These scopes are set at VM instance creation time and can't be overridden in the request. warnings.warn(_SCOPES_WARNING) 2018-04-11 18:59:18,057 c7c5cc31 MainThread INFO Retrying exception running IssueRetryableCommand: Command returned a non-zero exit code. 2018-04-11 18:59:40,641 c7c5cc31 MainThread INFO Running: bq load --autodetect --source_format=NEWLINE_DELIMITED_JSON beam_performance.pkb_results <https://builds.apache.org/job/beam_PerformanceTests_Spark/ws/runs/c7c5cc31/perfkit-bq-pubiK8V1U.json> 2018-04-11 18:59:43,715 c7c5cc31 MainThread INFO Ran: {bq load --autodetect --source_format=NEWLINE_DELIMITED_JSON beam_performance.pkb_results <https://builds.apache.org/job/beam_PerformanceTests_Spark/ws/runs/c7c5cc31/perfkit-bq-pubiK8V1U.json}> ReturnCode:1 STDOUT: Upload complete. Waiting on bqjob_r71b22d9abd4fdaec_00000162b613ebd9_1 ... (0s) Current status: RUNNING Waiting on bqjob_r71b22d9abd4fdaec_00000162b613ebd9_1 ... (0s) Current status: DONE BigQuery error in load operation: Error processing job 'apache-beam-testing:bqjob_r71b22d9abd4fdaec_00000162b613ebd9_1': Invalid schema update. Field timestamp has changed type from TIMESTAMP to FLOAT STDERR: /usr/lib/google-cloud-sdk/platform/bq/third_party/oauth2client/contrib/gce.py:73: UserWarning: You have requested explicit scopes to be used with a GCE service account. Using this argument will have no effect on the actual scopes for tokens requested. These scopes are set at VM instance creation time and can't be overridden in the request. warnings.warn(_SCOPES_WARNING) 2018-04-11 18:59:43,716 c7c5cc31 MainThread INFO Retrying exception running IssueRetryableCommand: Command returned a non-zero exit code. 2018-04-11 19:00:12,813 c7c5cc31 MainThread INFO Running: bq load --autodetect --source_format=NEWLINE_DELIMITED_JSON beam_performance.pkb_results <https://builds.apache.org/job/beam_PerformanceTests_Spark/ws/runs/c7c5cc31/perfkit-bq-pubiK8V1U.json> 2018-04-11 19:00:16,974 c7c5cc31 MainThread INFO Ran: {bq load --autodetect --source_format=NEWLINE_DELIMITED_JSON beam_performance.pkb_results <https://builds.apache.org/job/beam_PerformanceTests_Spark/ws/runs/c7c5cc31/perfkit-bq-pubiK8V1U.json}> ReturnCode:1 STDOUT: Upload complete. Waiting on bqjob_r417df85dec1607e2_00000162b6146d22_1 ... (0s) Current status: RUNNING Waiting on bqjob_r417df85dec1607e2_00000162b6146d22_1 ... (0s) Current status: DONE BigQuery error in load operation: Error processing job 'apache-beam-testing:bqjob_r417df85dec1607e2_00000162b6146d22_1': Invalid schema update. Field timestamp has changed type from TIMESTAMP to FLOAT STDERR: /usr/lib/google-cloud-sdk/platform/bq/third_party/oauth2client/contrib/gce.py:73: UserWarning: You have requested explicit scopes to be used with a GCE service account. Using this argument will have no effect on the actual scopes for tokens requested. These scopes are set at VM instance creation time and can't be overridden in the request. warnings.warn(_SCOPES_WARNING) 2018-04-11 19:00:16,975 c7c5cc31 MainThread INFO Retrying exception running IssueRetryableCommand: Command returned a non-zero exit code. 2018-04-11 19:00:38,685 c7c5cc31 MainThread INFO Running: bq load --autodetect --source_format=NEWLINE_DELIMITED_JSON beam_performance.pkb_results <https://builds.apache.org/job/beam_PerformanceTests_Spark/ws/runs/c7c5cc31/perfkit-bq-pubiK8V1U.json> 2018-04-11 19:00:42,925 c7c5cc31 MainThread INFO Ran: {bq load --autodetect --source_format=NEWLINE_DELIMITED_JSON beam_performance.pkb_results <https://builds.apache.org/job/beam_PerformanceTests_Spark/ws/runs/c7c5cc31/perfkit-bq-pubiK8V1U.json}> ReturnCode:1 STDOUT: Upload complete. Waiting on bqjob_rb18ad22c661457c_00000162b614d341_1 ... (0s) Current status: RUNNING Waiting on bqjob_rb18ad22c661457c_00000162b614d341_1 ... (0s) Current status: DONE BigQuery error in load operation: Error processing job 'apache-beam-testing:bqjob_rb18ad22c661457c_00000162b614d341_1': Invalid schema update. Field timestamp has changed type from TIMESTAMP to FLOAT STDERR: /usr/lib/google-cloud-sdk/platform/bq/third_party/oauth2client/contrib/gce.py:73: UserWarning: You have requested explicit scopes to be used with a GCE service account. Using this argument will have no effect on the actual scopes for tokens requested. These scopes are set at VM instance creation time and can't be overridden in the request. warnings.warn(_SCOPES_WARNING) 2018-04-11 19:00:42,926 c7c5cc31 MainThread INFO Retrying exception running IssueRetryableCommand: Command returned a non-zero exit code. 2018-04-11 19:01:05,473 c7c5cc31 MainThread INFO Running: bq load --autodetect --source_format=NEWLINE_DELIMITED_JSON beam_performance.pkb_results <https://builds.apache.org/job/beam_PerformanceTests_Spark/ws/runs/c7c5cc31/perfkit-bq-pubiK8V1U.json> 2018-04-11 19:01:08,636 c7c5cc31 MainThread INFO Ran: {bq load --autodetect --source_format=NEWLINE_DELIMITED_JSON beam_performance.pkb_results <https://builds.apache.org/job/beam_PerformanceTests_Spark/ws/runs/c7c5cc31/perfkit-bq-pubiK8V1U.json}> ReturnCode:1 STDOUT: Upload complete. Waiting on bqjob_r67a684eee012e9a6_00000162b6153669_1 ... (0s) Current status: RUNNING Waiting on bqjob_r67a684eee012e9a6_00000162b6153669_1 ... (0s) Current status: DONE BigQuery error in load operation: Error processing job 'apache-beam-testing:bqjob_r67a684eee012e9a6_00000162b6153669_1': Invalid schema update. Field timestamp has changed type from TIMESTAMP to FLOAT STDERR: /usr/lib/google-cloud-sdk/platform/bq/third_party/oauth2client/contrib/gce.py:73: UserWarning: You have requested explicit scopes to be used with a GCE service account. Using this argument will have no effect on the actual scopes for tokens requested. These scopes are set at VM instance creation time and can't be overridden in the request. warnings.warn(_SCOPES_WARNING) Traceback (most recent call last): File "PerfKitBenchmarker/pkb.py", line 21, in <module> sys.exit(Main()) File "<https://builds.apache.org/job/beam_PerformanceTests_Spark/ws/PerfKitBenchmarker/perfkitbenchmarker/pkb.py";,> line 951, in Main return RunBenchmarks() File "<https://builds.apache.org/job/beam_PerformanceTests_Spark/ws/PerfKitBenchmarker/perfkitbenchmarker/pkb.py";,> line 878, in RunBenchmarks collector.PublishSamples() File "<https://builds.apache.org/job/beam_PerformanceTests_Spark/ws/PerfKitBenchmarker/perfkitbenchmarker/publisher.py";,> line 927, in PublishSamples publisher.PublishSamples(self.samples) File "<https://builds.apache.org/job/beam_PerformanceTests_Spark/ws/PerfKitBenchmarker/perfkitbenchmarker/publisher.py";,> line 538, in PublishSamples vm_util.IssueRetryableCommand(load_cmd) File "<https://builds.apache.org/job/beam_PerformanceTests_Spark/ws/PerfKitBenchmarker/perfkitbenchmarker/vm_util.py";,> line 249, in WrappedFunction return f(*args, **kwargs) File "<https://builds.apache.org/job/beam_PerformanceTests_Spark/ws/PerfKitBenchmarker/perfkitbenchmarker/vm_util.py";,> line 387, in IssueRetryableCommand 'Command returned a non-zero exit code.\n') perfkitbenchmarker.errors.CalledProcessException: Command returned a non-zero exit code. Build step 'Execute shell' marked build as failure
