See
<https://builds.apache.org/job/beam_PerformanceTests_FileBasedIO_IT/55/display/redirect?page=changes>
Changes:
[aromanenko-dev] [BEAM-3228] Add fix to prevent crashing forked VM during
running Kinesis
------------------------------------------
[...truncated 52.68 KB...]
2018-01-03 18:24:28,884 80e335dc MainThread INFO Ran bq load
--source_format=NEWLINE_DELIMITED_JSON
beam_performance.filebasedioit_pkb_results
/tmp/perfkitbenchmarker/runs/80e335dc/perfkit-bq-pubox8Zjw.json. Got return
code (1).
STDOUT: BigQuery error in load operation: No schema specified on job or table.
STDERR:
/usr/lib/google-cloud-sdk/platform/bq/third_party/oauth2client/contrib/gce.py:73:
UserWarning: You have requested explicit scopes to be used with a GCE service
account.
Using this argument will have no effect on the actual scopes for tokens
requested. These scopes are set at VM instance creation time and
can't be overridden in the request.
warnings.warn(_SCOPES_WARNING)
2018-01-03 18:24:28,885 80e335dc MainThread INFO Retrying exception running
IssueRetryableCommand: Command returned a non-zero exit code.
2018-01-03 18:24:45,273 80e335dc MainThread INFO Running: bq load
--source_format=NEWLINE_DELIMITED_JSON
beam_performance.filebasedioit_pkb_results
/tmp/perfkitbenchmarker/runs/80e335dc/perfkit-bq-pubox8Zjw.json
2018-01-03 18:24:45,869 80e335dc MainThread INFO Ran bq load
--source_format=NEWLINE_DELIMITED_JSON
beam_performance.filebasedioit_pkb_results
/tmp/perfkitbenchmarker/runs/80e335dc/perfkit-bq-pubox8Zjw.json. Got return
code (1).
STDOUT: BigQuery error in load operation: No schema specified on job or table.
STDERR:
/usr/lib/google-cloud-sdk/platform/bq/third_party/oauth2client/contrib/gce.py:73:
UserWarning: You have requested explicit scopes to be used with a GCE service
account.
Using this argument will have no effect on the actual scopes for tokens
requested. These scopes are set at VM instance creation time and
can't be overridden in the request.
warnings.warn(_SCOPES_WARNING)
2018-01-03 18:24:45,869 80e335dc MainThread INFO Retrying exception running
IssueRetryableCommand: Command returned a non-zero exit code.
2018-01-03 18:25:07,099 80e335dc MainThread INFO Running: bq load
--source_format=NEWLINE_DELIMITED_JSON
beam_performance.filebasedioit_pkb_results
/tmp/perfkitbenchmarker/runs/80e335dc/perfkit-bq-pubox8Zjw.json
2018-01-03 18:25:07,631 80e335dc MainThread INFO Ran bq load
--source_format=NEWLINE_DELIMITED_JSON
beam_performance.filebasedioit_pkb_results
/tmp/perfkitbenchmarker/runs/80e335dc/perfkit-bq-pubox8Zjw.json. Got return
code (1).
STDOUT: BigQuery error in load operation: No schema specified on job or table.
STDERR:
/usr/lib/google-cloud-sdk/platform/bq/third_party/oauth2client/contrib/gce.py:73:
UserWarning: You have requested explicit scopes to be used with a GCE service
account.
Using this argument will have no effect on the actual scopes for tokens
requested. These scopes are set at VM instance creation time and
can't be overridden in the request.
warnings.warn(_SCOPES_WARNING)
2018-01-03 18:25:07,631 80e335dc MainThread INFO Retrying exception running
IssueRetryableCommand: Command returned a non-zero exit code.
2018-01-03 18:25:31,895 80e335dc MainThread INFO Running: bq load
--source_format=NEWLINE_DELIMITED_JSON
beam_performance.filebasedioit_pkb_results
/tmp/perfkitbenchmarker/runs/80e335dc/perfkit-bq-pubox8Zjw.json
2018-01-03 18:25:32,650 80e335dc MainThread INFO Ran bq load
--source_format=NEWLINE_DELIMITED_JSON
beam_performance.filebasedioit_pkb_results
/tmp/perfkitbenchmarker/runs/80e335dc/perfkit-bq-pubox8Zjw.json. Got return
code (1).
STDOUT: BigQuery error in load operation: No schema specified on job or table.
STDERR:
/usr/lib/google-cloud-sdk/platform/bq/third_party/oauth2client/contrib/gce.py:73:
UserWarning: You have requested explicit scopes to be used with a GCE service
account.
Using this argument will have no effect on the actual scopes for tokens
requested. These scopes are set at VM instance creation time and
can't be overridden in the request.
warnings.warn(_SCOPES_WARNING)
2018-01-03 18:25:32,650 80e335dc MainThread INFO Retrying exception running
IssueRetryableCommand: Command returned a non-zero exit code.
2018-01-03 18:26:02,193 80e335dc MainThread INFO Running: bq load
--source_format=NEWLINE_DELIMITED_JSON
beam_performance.filebasedioit_pkb_results
/tmp/perfkitbenchmarker/runs/80e335dc/perfkit-bq-pubox8Zjw.json
2018-01-03 18:26:03,000 80e335dc MainThread INFO Ran bq load
--source_format=NEWLINE_DELIMITED_JSON
beam_performance.filebasedioit_pkb_results
/tmp/perfkitbenchmarker/runs/80e335dc/perfkit-bq-pubox8Zjw.json. Got return
code (1).
STDOUT: BigQuery error in load operation: No schema specified on job or table.
STDERR:
/usr/lib/google-cloud-sdk/platform/bq/third_party/oauth2client/contrib/gce.py:73:
UserWarning: You have requested explicit scopes to be used with a GCE service
account.
Using this argument will have no effect on the actual scopes for tokens
requested. These scopes are set at VM instance creation time and
can't be overridden in the request.
warnings.warn(_SCOPES_WARNING)
2018-01-03 18:26:03,000 80e335dc MainThread INFO Retrying exception running
IssueRetryableCommand: Command returned a non-zero exit code.
2018-01-03 18:26:26,919 80e335dc MainThread INFO Running: bq load
--source_format=NEWLINE_DELIMITED_JSON
beam_performance.filebasedioit_pkb_results
/tmp/perfkitbenchmarker/runs/80e335dc/perfkit-bq-pubox8Zjw.json
2018-01-03 18:26:27,588 80e335dc MainThread INFO Ran bq load
--source_format=NEWLINE_DELIMITED_JSON
beam_performance.filebasedioit_pkb_results
/tmp/perfkitbenchmarker/runs/80e335dc/perfkit-bq-pubox8Zjw.json. Got return
code (1).
STDOUT: BigQuery error in load operation: No schema specified on job or table.
STDERR:
/usr/lib/google-cloud-sdk/platform/bq/third_party/oauth2client/contrib/gce.py:73:
UserWarning: You have requested explicit scopes to be used with a GCE service
account.
Using this argument will have no effect on the actual scopes for tokens
requested. These scopes are set at VM instance creation time and
can't be overridden in the request.
warnings.warn(_SCOPES_WARNING)
2018-01-03 18:26:27,588 80e335dc MainThread INFO Retrying exception running
IssueRetryableCommand: Command returned a non-zero exit code.
2018-01-03 18:26:43,651 80e335dc MainThread INFO Running: bq load
--source_format=NEWLINE_DELIMITED_JSON
beam_performance.filebasedioit_pkb_results
/tmp/perfkitbenchmarker/runs/80e335dc/perfkit-bq-pubox8Zjw.json
2018-01-03 18:26:44,245 80e335dc MainThread INFO Ran bq load
--source_format=NEWLINE_DELIMITED_JSON
beam_performance.filebasedioit_pkb_results
/tmp/perfkitbenchmarker/runs/80e335dc/perfkit-bq-pubox8Zjw.json. Got return
code (1).
STDOUT: BigQuery error in load operation: No schema specified on job or table.
STDERR:
/usr/lib/google-cloud-sdk/platform/bq/third_party/oauth2client/contrib/gce.py:73:
UserWarning: You have requested explicit scopes to be used with a GCE service
account.
Using this argument will have no effect on the actual scopes for tokens
requested. These scopes are set at VM instance creation time and
can't be overridden in the request.
warnings.warn(_SCOPES_WARNING)
2018-01-03 18:26:44,245 80e335dc MainThread INFO Retrying exception running
IssueRetryableCommand: Command returned a non-zero exit code.
2018-01-03 18:27:07,707 80e335dc MainThread INFO Running: bq load
--source_format=NEWLINE_DELIMITED_JSON
beam_performance.filebasedioit_pkb_results
/tmp/perfkitbenchmarker/runs/80e335dc/perfkit-bq-pubox8Zjw.json
2018-01-03 18:27:08,257 80e335dc MainThread INFO Ran bq load
--source_format=NEWLINE_DELIMITED_JSON
beam_performance.filebasedioit_pkb_results
/tmp/perfkitbenchmarker/runs/80e335dc/perfkit-bq-pubox8Zjw.json. Got return
code (1).
STDOUT: BigQuery error in load operation: No schema specified on job or table.
STDERR:
/usr/lib/google-cloud-sdk/platform/bq/third_party/oauth2client/contrib/gce.py:73:
UserWarning: You have requested explicit scopes to be used with a GCE service
account.
Using this argument will have no effect on the actual scopes for tokens
requested. These scopes are set at VM instance creation time and
can't be overridden in the request.
warnings.warn(_SCOPES_WARNING)
2018-01-03 18:27:08,257 80e335dc MainThread INFO Retrying exception running
IssueRetryableCommand: Command returned a non-zero exit code.
2018-01-03 18:27:26,251 80e335dc MainThread INFO Running: bq load
--source_format=NEWLINE_DELIMITED_JSON
beam_performance.filebasedioit_pkb_results
/tmp/perfkitbenchmarker/runs/80e335dc/perfkit-bq-pubox8Zjw.json
2018-01-03 18:27:27,119 80e335dc MainThread INFO Ran bq load
--source_format=NEWLINE_DELIMITED_JSON
beam_performance.filebasedioit_pkb_results
/tmp/perfkitbenchmarker/runs/80e335dc/perfkit-bq-pubox8Zjw.json. Got return
code (1).
STDOUT: BigQuery error in load operation: No schema specified on job or table.
STDERR:
/usr/lib/google-cloud-sdk/platform/bq/third_party/oauth2client/contrib/gce.py:73:
UserWarning: You have requested explicit scopes to be used with a GCE service
account.
Using this argument will have no effect on the actual scopes for tokens
requested. These scopes are set at VM instance creation time and
can't be overridden in the request.
warnings.warn(_SCOPES_WARNING)
2018-01-03 18:27:27,120 80e335dc MainThread INFO Retrying exception running
IssueRetryableCommand: Command returned a non-zero exit code.
2018-01-03 18:27:52,391 80e335dc MainThread INFO Running: bq load
--source_format=NEWLINE_DELIMITED_JSON
beam_performance.filebasedioit_pkb_results
/tmp/perfkitbenchmarker/runs/80e335dc/perfkit-bq-pubox8Zjw.json
2018-01-03 18:27:53,196 80e335dc MainThread INFO Ran bq load
--source_format=NEWLINE_DELIMITED_JSON
beam_performance.filebasedioit_pkb_results
/tmp/perfkitbenchmarker/runs/80e335dc/perfkit-bq-pubox8Zjw.json. Got return
code (1).
STDOUT: BigQuery error in load operation: No schema specified on job or table.
STDERR:
/usr/lib/google-cloud-sdk/platform/bq/third_party/oauth2client/contrib/gce.py:73:
UserWarning: You have requested explicit scopes to be used with a GCE service
account.
Using this argument will have no effect on the actual scopes for tokens
requested. These scopes are set at VM instance creation time and
can't be overridden in the request.
warnings.warn(_SCOPES_WARNING)
2018-01-03 18:27:53,197 80e335dc MainThread INFO Retrying exception running
IssueRetryableCommand: Command returned a non-zero exit code.
2018-01-03 18:28:15,283 80e335dc MainThread INFO Running: bq load
--source_format=NEWLINE_DELIMITED_JSON
beam_performance.filebasedioit_pkb_results
/tmp/perfkitbenchmarker/runs/80e335dc/perfkit-bq-pubox8Zjw.json
2018-01-03 18:28:16,021 80e335dc MainThread INFO Ran bq load
--source_format=NEWLINE_DELIMITED_JSON
beam_performance.filebasedioit_pkb_results
/tmp/perfkitbenchmarker/runs/80e335dc/perfkit-bq-pubox8Zjw.json. Got return
code (1).
STDOUT: BigQuery error in load operation: No schema specified on job or table.
STDERR:
/usr/lib/google-cloud-sdk/platform/bq/third_party/oauth2client/contrib/gce.py:73:
UserWarning: You have requested explicit scopes to be used with a GCE service
account.
Using this argument will have no effect on the actual scopes for tokens
requested. These scopes are set at VM instance creation time and
can't be overridden in the request.
warnings.warn(_SCOPES_WARNING)
2018-01-03 18:28:16,022 80e335dc MainThread INFO Retrying exception running
IssueRetryableCommand: Command returned a non-zero exit code.
2018-01-03 18:28:43,628 80e335dc MainThread INFO Running: bq load
--source_format=NEWLINE_DELIMITED_JSON
beam_performance.filebasedioit_pkb_results
/tmp/perfkitbenchmarker/runs/80e335dc/perfkit-bq-pubox8Zjw.json
2018-01-03 18:28:44,252 80e335dc MainThread INFO Ran bq load
--source_format=NEWLINE_DELIMITED_JSON
beam_performance.filebasedioit_pkb_results
/tmp/perfkitbenchmarker/runs/80e335dc/perfkit-bq-pubox8Zjw.json. Got return
code (1).
STDOUT: BigQuery error in load operation: No schema specified on job or table.
STDERR:
/usr/lib/google-cloud-sdk/platform/bq/third_party/oauth2client/contrib/gce.py:73:
UserWarning: You have requested explicit scopes to be used with a GCE service
account.
Using this argument will have no effect on the actual scopes for tokens
requested. These scopes are set at VM instance creation time and
can't be overridden in the request.
warnings.warn(_SCOPES_WARNING)
2018-01-03 18:28:44,253 80e335dc MainThread INFO Retrying exception running
IssueRetryableCommand: Command returned a non-zero exit code.
2018-01-03 18:29:01,727 80e335dc MainThread INFO Running: bq load
--source_format=NEWLINE_DELIMITED_JSON
beam_performance.filebasedioit_pkb_results
/tmp/perfkitbenchmarker/runs/80e335dc/perfkit-bq-pubox8Zjw.json
2018-01-03 18:29:02,741 80e335dc MainThread INFO Ran bq load
--source_format=NEWLINE_DELIMITED_JSON
beam_performance.filebasedioit_pkb_results
/tmp/perfkitbenchmarker/runs/80e335dc/perfkit-bq-pubox8Zjw.json. Got return
code (1).
STDOUT: BigQuery error in load operation: No schema specified on job or table.
STDERR:
/usr/lib/google-cloud-sdk/platform/bq/third_party/oauth2client/contrib/gce.py:73:
UserWarning: You have requested explicit scopes to be used with a GCE service
account.
Using this argument will have no effect on the actual scopes for tokens
requested. These scopes are set at VM instance creation time and
can't be overridden in the request.
warnings.warn(_SCOPES_WARNING)
2018-01-03 18:29:02,742 80e335dc MainThread INFO Retrying exception running
IssueRetryableCommand: Command returned a non-zero exit code.
2018-01-03 18:29:32,687 80e335dc MainThread INFO Running: bq load
--source_format=NEWLINE_DELIMITED_JSON
beam_performance.filebasedioit_pkb_results
/tmp/perfkitbenchmarker/runs/80e335dc/perfkit-bq-pubox8Zjw.json
2018-01-03 18:29:33,471 80e335dc MainThread INFO Ran bq load
--source_format=NEWLINE_DELIMITED_JSON
beam_performance.filebasedioit_pkb_results
/tmp/perfkitbenchmarker/runs/80e335dc/perfkit-bq-pubox8Zjw.json. Got return
code (1).
STDOUT: BigQuery error in load operation: No schema specified on job or table.
STDERR:
/usr/lib/google-cloud-sdk/platform/bq/third_party/oauth2client/contrib/gce.py:73:
UserWarning: You have requested explicit scopes to be used with a GCE service
account.
Using this argument will have no effect on the actual scopes for tokens
requested. These scopes are set at VM instance creation time and
can't be overridden in the request.
warnings.warn(_SCOPES_WARNING)
2018-01-03 18:29:33,471 80e335dc MainThread INFO Retrying exception running
IssueRetryableCommand: Command returned a non-zero exit code.
2018-01-03 18:29:57,190 80e335dc MainThread INFO Running: bq load
--source_format=NEWLINE_DELIMITED_JSON
beam_performance.filebasedioit_pkb_results
/tmp/perfkitbenchmarker/runs/80e335dc/perfkit-bq-pubox8Zjw.json
2018-01-03 18:29:57,739 80e335dc MainThread INFO Ran bq load
--source_format=NEWLINE_DELIMITED_JSON
beam_performance.filebasedioit_pkb_results
/tmp/perfkitbenchmarker/runs/80e335dc/perfkit-bq-pubox8Zjw.json. Got return
code (1).
STDOUT: BigQuery error in load operation: No schema specified on job or table.
STDERR:
/usr/lib/google-cloud-sdk/platform/bq/third_party/oauth2client/contrib/gce.py:73:
UserWarning: You have requested explicit scopes to be used with a GCE service
account.
Using this argument will have no effect on the actual scopes for tokens
requested. These scopes are set at VM instance creation time and
can't be overridden in the request.
warnings.warn(_SCOPES_WARNING)
2018-01-03 18:29:57,740 80e335dc MainThread INFO Retrying exception running
IssueRetryableCommand: Command returned a non-zero exit code.
2018-01-03 18:30:14,471 80e335dc MainThread INFO Running: bq load
--source_format=NEWLINE_DELIMITED_JSON
beam_performance.filebasedioit_pkb_results
/tmp/perfkitbenchmarker/runs/80e335dc/perfkit-bq-pubox8Zjw.json
2018-01-03 18:30:15,002 80e335dc MainThread INFO Ran bq load
--source_format=NEWLINE_DELIMITED_JSON
beam_performance.filebasedioit_pkb_results
/tmp/perfkitbenchmarker/runs/80e335dc/perfkit-bq-pubox8Zjw.json. Got return
code (1).
STDOUT: BigQuery error in load operation: No schema specified on job or table.
STDERR:
/usr/lib/google-cloud-sdk/platform/bq/third_party/oauth2client/contrib/gce.py:73:
UserWarning: You have requested explicit scopes to be used with a GCE service
account.
Using this argument will have no effect on the actual scopes for tokens
requested. These scopes are set at VM instance creation time and
can't be overridden in the request.
warnings.warn(_SCOPES_WARNING)
2018-01-03 18:30:15,002 80e335dc MainThread INFO Retrying exception running
IssueRetryableCommand: Command returned a non-zero exit code.
2018-01-03 18:30:35,872 80e335dc MainThread INFO Running: bq load
--source_format=NEWLINE_DELIMITED_JSON
beam_performance.filebasedioit_pkb_results
/tmp/perfkitbenchmarker/runs/80e335dc/perfkit-bq-pubox8Zjw.json
2018-01-03 18:30:36,446 80e335dc MainThread INFO Ran bq load
--source_format=NEWLINE_DELIMITED_JSON
beam_performance.filebasedioit_pkb_results
/tmp/perfkitbenchmarker/runs/80e335dc/perfkit-bq-pubox8Zjw.json. Got return
code (1).
STDOUT: BigQuery error in load operation: No schema specified on job or table.
STDERR:
/usr/lib/google-cloud-sdk/platform/bq/third_party/oauth2client/contrib/gce.py:73:
UserWarning: You have requested explicit scopes to be used with a GCE service
account.
Using this argument will have no effect on the actual scopes for tokens
requested. These scopes are set at VM instance creation time and
can't be overridden in the request.
warnings.warn(_SCOPES_WARNING)
2018-01-03 18:30:36,446 80e335dc MainThread INFO Retrying exception running
IssueRetryableCommand: Command returned a non-zero exit code.
2018-01-03 18:31:03,085 80e335dc MainThread INFO Running: bq load
--source_format=NEWLINE_DELIMITED_JSON
beam_performance.filebasedioit_pkb_results
/tmp/perfkitbenchmarker/runs/80e335dc/perfkit-bq-pubox8Zjw.json
2018-01-03 18:31:03,963 80e335dc MainThread INFO Ran bq load
--source_format=NEWLINE_DELIMITED_JSON
beam_performance.filebasedioit_pkb_results
/tmp/perfkitbenchmarker/runs/80e335dc/perfkit-bq-pubox8Zjw.json. Got return
code (1).
STDOUT: BigQuery error in load operation: No schema specified on job or table.
STDERR:
/usr/lib/google-cloud-sdk/platform/bq/third_party/oauth2client/contrib/gce.py:73:
UserWarning: You have requested explicit scopes to be used with a GCE service
account.
Using this argument will have no effect on the actual scopes for tokens
requested. These scopes are set at VM instance creation time and
can't be overridden in the request.
warnings.warn(_SCOPES_WARNING)
Traceback (most recent call last):
File "PerfKitBenchmarker/pkb.py", line 21, in <module>
sys.exit(Main())
File
"<https://builds.apache.org/job/beam_PerformanceTests_FileBasedIO_IT/ws/PerfKitBenchmarker/perfkitbenchmarker/pkb.py",>
line 855, in Main
return RunBenchmarks()
File
"<https://builds.apache.org/job/beam_PerformanceTests_FileBasedIO_IT/ws/PerfKitBenchmarker/perfkitbenchmarker/pkb.py",>
line 781, in RunBenchmarks
collector.PublishSamples()
File
"<https://builds.apache.org/job/beam_PerformanceTests_FileBasedIO_IT/ws/PerfKitBenchmarker/perfkitbenchmarker/publisher.py",>
line 867, in PublishSamples
publisher.PublishSamples(self.samples)
File
"<https://builds.apache.org/job/beam_PerformanceTests_FileBasedIO_IT/ws/PerfKitBenchmarker/perfkitbenchmarker/publisher.py",>
line 524, in PublishSamples
vm_util.IssueRetryableCommand(load_cmd)
File
"<https://builds.apache.org/job/beam_PerformanceTests_FileBasedIO_IT/ws/PerfKitBenchmarker/perfkitbenchmarker/vm_util.py",>
line 247, in WrappedFunction
return f(*args, **kwargs)
File
"<https://builds.apache.org/job/beam_PerformanceTests_FileBasedIO_IT/ws/PerfKitBenchmarker/perfkitbenchmarker/vm_util.py",>
line 364, in IssueRetryableCommand
'Command returned a non-zero exit code.\n')
perfkitbenchmarker.errors.CalledProcessException: Command returned a non-zero
exit code.
Build step 'Execute shell' marked build as failure