See <https://builds.apache.org/job/beam_PerformanceTests_Spark/1503/display/redirect?page=changes>
Changes: [coheigea] Put the String literal first when comparing it to an Object [jb] [BEAM-3500] "Attach" JDBC connection to the bundle (improve the pooling) [jb] [BEAM-3500] Test if the user provides both withDataSourceConfiguration() [jb] [BEAM-3500] Wrap the datasource as a poolable datasource and expose [jb] [BEAM-3500] Add commons-pool2 dependency [jb] [BEAM-3500] Only expose max number of connections in the pool to the [jb] [BEAM-3500] Cleanup pool configuration parameters [jb] [BEAM-3500] Remove dataSourceFactory [jb] [BEAM-3500] Remove unecessary check on dataSourceConfiguration [mariand] Switched AvroIO default codec to snappyCodec(). [wcn] Updating generated files. [aaltay] [BEAM-3738] Enable py3 lint and cleanup tox.ini. (#4877) ------------------------------------------ [...truncated 92.10 KB...] 'apache-beam-testing:bqjob_r36c5fedf4647a044_0000016255745b6b_1': Invalid schema update. Field timestamp has changed type from TIMESTAMP to FLOAT STDERR: /usr/lib/google-cloud-sdk/platform/bq/third_party/oauth2client/contrib/gce.py:73: UserWarning: You have requested explicit scopes to be used with a GCE service account. Using this argument will have no effect on the actual scopes for tokens requested. These scopes are set at VM instance creation time and can't be overridden in the request. warnings.warn(_SCOPES_WARNING) 2018-03-24 00:41:53,696 61827c41 MainThread INFO Retrying exception running IssueRetryableCommand: Command returned a non-zero exit code. 2018-03-24 00:42:19,549 61827c41 MainThread INFO Running: bq load --autodetect --source_format=NEWLINE_DELIMITED_JSON beam_performance.pkb_results <https://builds.apache.org/job/beam_PerformanceTests_Spark/ws/runs/61827c41/perfkit-bq-pub6UWjSi.json> 2018-03-24 00:42:22,626 61827c41 MainThread INFO Ran: {bq load --autodetect --source_format=NEWLINE_DELIMITED_JSON beam_performance.pkb_results <https://builds.apache.org/job/beam_PerformanceTests_Spark/ws/runs/61827c41/perfkit-bq-pub6UWjSi.json}> ReturnCode:1 STDOUT: Upload complete. Waiting on bqjob_r33739105a75ab995_000001625574cb65_1 ... (0s) Current status: RUNNING Waiting on bqjob_r33739105a75ab995_000001625574cb65_1 ... (0s) Current status: DONE BigQuery error in load operation: Error processing job 'apache-beam-testing:bqjob_r33739105a75ab995_000001625574cb65_1': Invalid schema update. Field timestamp has changed type from TIMESTAMP to FLOAT STDERR: /usr/lib/google-cloud-sdk/platform/bq/third_party/oauth2client/contrib/gce.py:73: UserWarning: You have requested explicit scopes to be used with a GCE service account. Using this argument will have no effect on the actual scopes for tokens requested. These scopes are set at VM instance creation time and can't be overridden in the request. warnings.warn(_SCOPES_WARNING) 2018-03-24 00:42:22,626 61827c41 MainThread INFO Retrying exception running IssueRetryableCommand: Command returned a non-zero exit code. 2018-03-24 00:42:42,489 61827c41 MainThread INFO Running: bq load --autodetect --source_format=NEWLINE_DELIMITED_JSON beam_performance.pkb_results <https://builds.apache.org/job/beam_PerformanceTests_Spark/ws/runs/61827c41/perfkit-bq-pub6UWjSi.json> 2018-03-24 00:42:44,775 61827c41 MainThread INFO Ran: {bq load --autodetect --source_format=NEWLINE_DELIMITED_JSON beam_performance.pkb_results <https://builds.apache.org/job/beam_PerformanceTests_Spark/ws/runs/61827c41/perfkit-bq-pub6UWjSi.json}> ReturnCode:1 STDOUT: Upload complete. Waiting on bqjob_r451b44c0be05a94c_0000016255752321_1 ... (0s) Current status: RUNNING Waiting on bqjob_r451b44c0be05a94c_0000016255752321_1 ... (0s) Current status: DONE BigQuery error in load operation: Error processing job 'apache-beam-testing:bqjob_r451b44c0be05a94c_0000016255752321_1': Invalid schema update. Field timestamp has changed type from TIMESTAMP to FLOAT STDERR: /usr/lib/google-cloud-sdk/platform/bq/third_party/oauth2client/contrib/gce.py:73: UserWarning: You have requested explicit scopes to be used with a GCE service account. Using this argument will have no effect on the actual scopes for tokens requested. These scopes are set at VM instance creation time and can't be overridden in the request. warnings.warn(_SCOPES_WARNING) 2018-03-24 00:42:44,775 61827c41 MainThread INFO Retrying exception running IssueRetryableCommand: Command returned a non-zero exit code. 2018-03-24 00:43:11,129 61827c41 MainThread INFO Running: bq load --autodetect --source_format=NEWLINE_DELIMITED_JSON beam_performance.pkb_results <https://builds.apache.org/job/beam_PerformanceTests_Spark/ws/runs/61827c41/perfkit-bq-pub6UWjSi.json> 2018-03-24 00:43:13,298 61827c41 MainThread INFO Ran: {bq load --autodetect --source_format=NEWLINE_DELIMITED_JSON beam_performance.pkb_results <https://builds.apache.org/job/beam_PerformanceTests_Spark/ws/runs/61827c41/perfkit-bq-pub6UWjSi.json}> ReturnCode:1 STDOUT: Upload complete. Waiting on bqjob_r7711c7c883b6ccb7_00000162557592f5_1 ... (0s) Current status: RUNNING Waiting on bqjob_r7711c7c883b6ccb7_00000162557592f5_1 ... (0s) Current status: DONE BigQuery error in load operation: Error processing job 'apache-beam-testing:bqjob_r7711c7c883b6ccb7_00000162557592f5_1': Invalid schema update. Field timestamp has changed type from TIMESTAMP to FLOAT STDERR: /usr/lib/google-cloud-sdk/platform/bq/third_party/oauth2client/contrib/gce.py:73: UserWarning: You have requested explicit scopes to be used with a GCE service account. Using this argument will have no effect on the actual scopes for tokens requested. These scopes are set at VM instance creation time and can't be overridden in the request. warnings.warn(_SCOPES_WARNING) 2018-03-24 00:43:13,299 61827c41 MainThread INFO Retrying exception running IssueRetryableCommand: Command returned a non-zero exit code. 2018-03-24 00:43:34,336 61827c41 MainThread INFO Running: bq load --autodetect --source_format=NEWLINE_DELIMITED_JSON beam_performance.pkb_results <https://builds.apache.org/job/beam_PerformanceTests_Spark/ws/runs/61827c41/perfkit-bq-pub6UWjSi.json> 2018-03-24 00:43:36,486 61827c41 MainThread INFO Ran: {bq load --autodetect --source_format=NEWLINE_DELIMITED_JSON beam_performance.pkb_results <https://builds.apache.org/job/beam_PerformanceTests_Spark/ws/runs/61827c41/perfkit-bq-pub6UWjSi.json}> ReturnCode:1 STDOUT: Upload complete. Waiting on bqjob_r125f9b237c8d0db2_000001625575ed62_1 ... (0s) Current status: RUNNING Waiting on bqjob_r125f9b237c8d0db2_000001625575ed62_1 ... (0s) Current status: DONE BigQuery error in load operation: Error processing job 'apache-beam-testing:bqjob_r125f9b237c8d0db2_000001625575ed62_1': Invalid schema update. Field timestamp has changed type from TIMESTAMP to FLOAT STDERR: /usr/lib/google-cloud-sdk/platform/bq/third_party/oauth2client/contrib/gce.py:73: UserWarning: You have requested explicit scopes to be used with a GCE service account. Using this argument will have no effect on the actual scopes for tokens requested. These scopes are set at VM instance creation time and can't be overridden in the request. warnings.warn(_SCOPES_WARNING) 2018-03-24 00:43:36,487 61827c41 MainThread INFO Retrying exception running IssueRetryableCommand: Command returned a non-zero exit code. 2018-03-24 00:43:57,097 61827c41 MainThread INFO Running: bq load --autodetect --source_format=NEWLINE_DELIMITED_JSON beam_performance.pkb_results <https://builds.apache.org/job/beam_PerformanceTests_Spark/ws/runs/61827c41/perfkit-bq-pub6UWjSi.json> 2018-03-24 00:44:00,426 61827c41 MainThread INFO Ran: {bq load --autodetect --source_format=NEWLINE_DELIMITED_JSON beam_performance.pkb_results <https://builds.apache.org/job/beam_PerformanceTests_Spark/ws/runs/61827c41/perfkit-bq-pub6UWjSi.json}> ReturnCode:1 STDOUT: Upload complete. Waiting on bqjob_r43fc23fa24cec60c_0000016255764aab_1 ... (0s) Current status: RUNNING Waiting on bqjob_r43fc23fa24cec60c_0000016255764aab_1 ... (0s) Current status: DONE BigQuery error in load operation: Error processing job 'apache-beam-testing:bqjob_r43fc23fa24cec60c_0000016255764aab_1': Invalid schema update. Field timestamp has changed type from TIMESTAMP to FLOAT STDERR: /usr/lib/google-cloud-sdk/platform/bq/third_party/oauth2client/contrib/gce.py:73: UserWarning: You have requested explicit scopes to be used with a GCE service account. Using this argument will have no effect on the actual scopes for tokens requested. These scopes are set at VM instance creation time and can't be overridden in the request. warnings.warn(_SCOPES_WARNING) 2018-03-24 00:44:00,426 61827c41 MainThread INFO Retrying exception running IssueRetryableCommand: Command returned a non-zero exit code. 2018-03-24 00:44:27,217 61827c41 MainThread INFO Running: bq load --autodetect --source_format=NEWLINE_DELIMITED_JSON beam_performance.pkb_results <https://builds.apache.org/job/beam_PerformanceTests_Spark/ws/runs/61827c41/perfkit-bq-pub6UWjSi.json> 2018-03-24 00:44:29,656 61827c41 MainThread INFO Ran: {bq load --autodetect --source_format=NEWLINE_DELIMITED_JSON beam_performance.pkb_results <https://builds.apache.org/job/beam_PerformanceTests_Spark/ws/runs/61827c41/perfkit-bq-pub6UWjSi.json}> ReturnCode:1 STDOUT: Upload complete. Waiting on bqjob_r5e772ea95213a29a_000001625576bca0_1 ... (0s) Current status: RUNNING Waiting on bqjob_r5e772ea95213a29a_000001625576bca0_1 ... (0s) Current status: DONE BigQuery error in load operation: Error processing job 'apache-beam-testing:bqjob_r5e772ea95213a29a_000001625576bca0_1': Invalid schema update. Field timestamp has changed type from TIMESTAMP to FLOAT STDERR: /usr/lib/google-cloud-sdk/platform/bq/third_party/oauth2client/contrib/gce.py:73: UserWarning: You have requested explicit scopes to be used with a GCE service account. Using this argument will have no effect on the actual scopes for tokens requested. These scopes are set at VM instance creation time and can't be overridden in the request. warnings.warn(_SCOPES_WARNING) 2018-03-24 00:44:29,657 61827c41 MainThread INFO Retrying exception running IssueRetryableCommand: Command returned a non-zero exit code. 2018-03-24 00:44:54,449 61827c41 MainThread INFO Running: bq load --autodetect --source_format=NEWLINE_DELIMITED_JSON beam_performance.pkb_results <https://builds.apache.org/job/beam_PerformanceTests_Spark/ws/runs/61827c41/perfkit-bq-pub6UWjSi.json> 2018-03-24 00:44:57,302 61827c41 MainThread INFO Ran: {bq load --autodetect --source_format=NEWLINE_DELIMITED_JSON beam_performance.pkb_results <https://builds.apache.org/job/beam_PerformanceTests_Spark/ws/runs/61827c41/perfkit-bq-pub6UWjSi.json}> ReturnCode:1 STDOUT: Upload complete. Waiting on bqjob_r432a00a89183d9f9_000001625577271b_1 ... (0s) Current status: RUNNING Waiting on bqjob_r432a00a89183d9f9_000001625577271b_1 ... (0s) Current status: DONE BigQuery error in load operation: Error processing job 'apache-beam-testing:bqjob_r432a00a89183d9f9_000001625577271b_1': Invalid schema update. Field timestamp has changed type from TIMESTAMP to FLOAT STDERR: /usr/lib/google-cloud-sdk/platform/bq/third_party/oauth2client/contrib/gce.py:73: UserWarning: You have requested explicit scopes to be used with a GCE service account. Using this argument will have no effect on the actual scopes for tokens requested. These scopes are set at VM instance creation time and can't be overridden in the request. warnings.warn(_SCOPES_WARNING) 2018-03-24 00:44:57,302 61827c41 MainThread INFO Retrying exception running IssueRetryableCommand: Command returned a non-zero exit code. 2018-03-24 00:45:13,501 61827c41 MainThread INFO Running: bq load --autodetect --source_format=NEWLINE_DELIMITED_JSON beam_performance.pkb_results <https://builds.apache.org/job/beam_PerformanceTests_Spark/ws/runs/61827c41/perfkit-bq-pub6UWjSi.json> 2018-03-24 00:45:15,887 61827c41 MainThread INFO Ran: {bq load --autodetect --source_format=NEWLINE_DELIMITED_JSON beam_performance.pkb_results <https://builds.apache.org/job/beam_PerformanceTests_Spark/ws/runs/61827c41/perfkit-bq-pub6UWjSi.json}> ReturnCode:1 STDOUT: Upload complete. Waiting on bqjob_r1e8b2d5819d9bdae_0000016255777173_1 ... (0s) Current status: RUNNING Waiting on bqjob_r1e8b2d5819d9bdae_0000016255777173_1 ... (0s) Current status: DONE BigQuery error in load operation: Error processing job 'apache-beam-testing:bqjob_r1e8b2d5819d9bdae_0000016255777173_1': Invalid schema update. Field timestamp has changed type from TIMESTAMP to FLOAT STDERR: /usr/lib/google-cloud-sdk/platform/bq/third_party/oauth2client/contrib/gce.py:73: UserWarning: You have requested explicit scopes to be used with a GCE service account. Using this argument will have no effect on the actual scopes for tokens requested. These scopes are set at VM instance creation time and can't be overridden in the request. warnings.warn(_SCOPES_WARNING) 2018-03-24 00:45:15,887 61827c41 MainThread INFO Retrying exception running IssueRetryableCommand: Command returned a non-zero exit code. 2018-03-24 00:45:34,581 61827c41 MainThread INFO Running: bq load --autodetect --source_format=NEWLINE_DELIMITED_JSON beam_performance.pkb_results <https://builds.apache.org/job/beam_PerformanceTests_Spark/ws/runs/61827c41/perfkit-bq-pub6UWjSi.json> 2018-03-24 00:45:37,194 61827c41 MainThread INFO Ran: {bq load --autodetect --source_format=NEWLINE_DELIMITED_JSON beam_performance.pkb_results <https://builds.apache.org/job/beam_PerformanceTests_Spark/ws/runs/61827c41/perfkit-bq-pub6UWjSi.json}> ReturnCode:1 STDOUT: Upload complete. Waiting on bqjob_r5fe2f19c0885cd80_000001625577c3d9_1 ... (0s) Current status: RUNNING Waiting on bqjob_r5fe2f19c0885cd80_000001625577c3d9_1 ... (0s) Current status: DONE BigQuery error in load operation: Error processing job 'apache-beam-testing:bqjob_r5fe2f19c0885cd80_000001625577c3d9_1': Invalid schema update. Field timestamp has changed type from TIMESTAMP to FLOAT STDERR: /usr/lib/google-cloud-sdk/platform/bq/third_party/oauth2client/contrib/gce.py:73: UserWarning: You have requested explicit scopes to be used with a GCE service account. Using this argument will have no effect on the actual scopes for tokens requested. These scopes are set at VM instance creation time and can't be overridden in the request. warnings.warn(_SCOPES_WARNING) 2018-03-24 00:45:37,195 61827c41 MainThread INFO Retrying exception running IssueRetryableCommand: Command returned a non-zero exit code. 2018-03-24 00:45:53,281 61827c41 MainThread INFO Running: bq load --autodetect --source_format=NEWLINE_DELIMITED_JSON beam_performance.pkb_results <https://builds.apache.org/job/beam_PerformanceTests_Spark/ws/runs/61827c41/perfkit-bq-pub6UWjSi.json> 2018-03-24 00:45:55,670 61827c41 MainThread INFO Ran: {bq load --autodetect --source_format=NEWLINE_DELIMITED_JSON beam_performance.pkb_results <https://builds.apache.org/job/beam_PerformanceTests_Spark/ws/runs/61827c41/perfkit-bq-pub6UWjSi.json}> ReturnCode:1 STDOUT: Upload complete. Waiting on bqjob_r77302fe1c4a3701b_0000016255780cb6_1 ... (0s) Current status: RUNNING Waiting on bqjob_r77302fe1c4a3701b_0000016255780cb6_1 ... (0s) Current status: DONE BigQuery error in load operation: Error processing job 'apache-beam-testing:bqjob_r77302fe1c4a3701b_0000016255780cb6_1': Invalid schema update. Field timestamp has changed type from TIMESTAMP to FLOAT STDERR: /usr/lib/google-cloud-sdk/platform/bq/third_party/oauth2client/contrib/gce.py:73: UserWarning: You have requested explicit scopes to be used with a GCE service account. Using this argument will have no effect on the actual scopes for tokens requested. These scopes are set at VM instance creation time and can't be overridden in the request. warnings.warn(_SCOPES_WARNING) 2018-03-24 00:45:55,671 61827c41 MainThread INFO Retrying exception running IssueRetryableCommand: Command returned a non-zero exit code. 2018-03-24 00:46:17,741 61827c41 MainThread INFO Running: bq load --autodetect --source_format=NEWLINE_DELIMITED_JSON beam_performance.pkb_results <https://builds.apache.org/job/beam_PerformanceTests_Spark/ws/runs/61827c41/perfkit-bq-pub6UWjSi.json> 2018-03-24 00:46:20,253 61827c41 MainThread INFO Ran: {bq load --autodetect --source_format=NEWLINE_DELIMITED_JSON beam_performance.pkb_results <https://builds.apache.org/job/beam_PerformanceTests_Spark/ws/runs/61827c41/perfkit-bq-pub6UWjSi.json}> ReturnCode:1 STDOUT: Upload complete. Waiting on bqjob_r6bf673156983f806_0000016255786c85_1 ... (0s) Current status: RUNNING Waiting on bqjob_r6bf673156983f806_0000016255786c85_1 ... (0s) Current status: DONE BigQuery error in load operation: Error processing job 'apache-beam-testing:bqjob_r6bf673156983f806_0000016255786c85_1': Invalid schema update. Field timestamp has changed type from TIMESTAMP to FLOAT STDERR: /usr/lib/google-cloud-sdk/platform/bq/third_party/oauth2client/contrib/gce.py:73: UserWarning: You have requested explicit scopes to be used with a GCE service account. Using this argument will have no effect on the actual scopes for tokens requested. These scopes are set at VM instance creation time and can't be overridden in the request. warnings.warn(_SCOPES_WARNING) 2018-03-24 00:46:20,253 61827c41 MainThread INFO Retrying exception running IssueRetryableCommand: Command returned a non-zero exit code. 2018-03-24 00:46:44,541 61827c41 MainThread INFO Running: bq load --autodetect --source_format=NEWLINE_DELIMITED_JSON beam_performance.pkb_results <https://builds.apache.org/job/beam_PerformanceTests_Spark/ws/runs/61827c41/perfkit-bq-pub6UWjSi.json> 2018-03-24 00:46:46,842 61827c41 MainThread INFO Ran: {bq load --autodetect --source_format=NEWLINE_DELIMITED_JSON beam_performance.pkb_results <https://builds.apache.org/job/beam_PerformanceTests_Spark/ws/runs/61827c41/perfkit-bq-pub6UWjSi.json}> ReturnCode:1 STDOUT: Upload complete. Waiting on bqjob_r7cb80fd7e64c86e8_000001625578d4e5_1 ... (0s) Current status: RUNNING Waiting on bqjob_r7cb80fd7e64c86e8_000001625578d4e5_1 ... (0s) Current status: DONE BigQuery error in load operation: Error processing job 'apache-beam-testing:bqjob_r7cb80fd7e64c86e8_000001625578d4e5_1': Invalid schema update. Field timestamp has changed type from TIMESTAMP to FLOAT STDERR: /usr/lib/google-cloud-sdk/platform/bq/third_party/oauth2client/contrib/gce.py:73: UserWarning: You have requested explicit scopes to be used with a GCE service account. Using this argument will have no effect on the actual scopes for tokens requested. These scopes are set at VM instance creation time and can't be overridden in the request. warnings.warn(_SCOPES_WARNING) 2018-03-24 00:46:46,842 61827c41 MainThread INFO Retrying exception running IssueRetryableCommand: Command returned a non-zero exit code. 2018-03-24 00:47:06,383 61827c41 MainThread INFO Running: bq load --autodetect --source_format=NEWLINE_DELIMITED_JSON beam_performance.pkb_results <https://builds.apache.org/job/beam_PerformanceTests_Spark/ws/runs/61827c41/perfkit-bq-pub6UWjSi.json> 2018-03-24 00:47:08,661 61827c41 MainThread INFO Ran: {bq load --autodetect --source_format=NEWLINE_DELIMITED_JSON beam_performance.pkb_results <https://builds.apache.org/job/beam_PerformanceTests_Spark/ws/runs/61827c41/perfkit-bq-pub6UWjSi.json}> ReturnCode:1 STDOUT: Upload complete. Waiting on bqjob_r699292c41d2f1733_0000016255792a3f_1 ... (0s) Current status: RUNNING Waiting on bqjob_r699292c41d2f1733_0000016255792a3f_1 ... (0s) Current status: DONE BigQuery error in load operation: Error processing job 'apache-beam-testing:bqjob_r699292c41d2f1733_0000016255792a3f_1': Invalid schema update. Field timestamp has changed type from TIMESTAMP to FLOAT STDERR: /usr/lib/google-cloud-sdk/platform/bq/third_party/oauth2client/contrib/gce.py:73: UserWarning: You have requested explicit scopes to be used with a GCE service account. Using this argument will have no effect on the actual scopes for tokens requested. These scopes are set at VM instance creation time and can't be overridden in the request. warnings.warn(_SCOPES_WARNING) Traceback (most recent call last): File "PerfKitBenchmarker/pkb.py", line 21, in <module> sys.exit(Main()) File "<https://builds.apache.org/job/beam_PerformanceTests_Spark/ws/PerfKitBenchmarker/perfkitbenchmarker/pkb.py";,> line 952, in Main return RunBenchmarks() File "<https://builds.apache.org/job/beam_PerformanceTests_Spark/ws/PerfKitBenchmarker/perfkitbenchmarker/pkb.py";,> line 879, in RunBenchmarks collector.PublishSamples() File "<https://builds.apache.org/job/beam_PerformanceTests_Spark/ws/PerfKitBenchmarker/perfkitbenchmarker/publisher.py";,> line 886, in PublishSamples publisher.PublishSamples(self.samples) File "<https://builds.apache.org/job/beam_PerformanceTests_Spark/ws/PerfKitBenchmarker/perfkitbenchmarker/publisher.py";,> line 538, in PublishSamples vm_util.IssueRetryableCommand(load_cmd) File "<https://builds.apache.org/job/beam_PerformanceTests_Spark/ws/PerfKitBenchmarker/perfkitbenchmarker/vm_util.py";,> line 249, in WrappedFunction return f(*args, **kwargs) File "<https://builds.apache.org/job/beam_PerformanceTests_Spark/ws/PerfKitBenchmarker/perfkitbenchmarker/vm_util.py";,> line 387, in IssueRetryableCommand 'Command returned a non-zero exit code.\n') perfkitbenchmarker.errors.CalledProcessException: Command returned a non-zero exit code. Build step 'Execute shell' marked build as failure
