[
https://issues.apache.org/jira/browse/BEAM-9271?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17032718#comment-17032718
]
Udi Meiri commented on BEAM-9271:
---------------------------------
The error seems to be clearly coming from nose plugin code, not pytest-plugin:
{code}
12:47:22 ======================================================================
12:47:22 ERROR: test suite for <class
'apache_beam.examples.wordcount_it_test.WordCountIT'>
12:47:22 ----------------------------------------------------------------------
12:47:22 Traceback (most recent call last):
12:47:22 File
"/home/jenkins/jenkins-slave/workspace/beam_PostCommit_Py_ValCont/src/sdks/python/container/venv/python/local/lib/python2.7/site-packages/nose/plugins/multiprocess.py",
line 812, in run
12:47:22 test(orig)
12:47:22 File
"/home/jenkins/jenkins-slave/workspace/beam_PostCommit_Py_ValCont/src/sdks/python/container/venv/python/local/lib/python2.7/site-packages/nose/suite.py",
line 177, in __call__
12:47:22 return self.run(*arg, **kw)
12:47:22 File
"/home/jenkins/jenkins-slave/workspace/beam_PostCommit_Py_ValCont/src/sdks/python/container/venv/python/local/lib/python2.7/site-packages/nose/plugins/multiprocess.py",
line 822, in run
12:47:22 test.config.plugins.addError(test,err)
12:47:22 File
"/home/jenkins/jenkins-slave/workspace/beam_PostCommit_Py_ValCont/src/sdks/python/container/venv/python/local/lib/python2.7/site-packages/nose/plugins/manager.py",
line 99, in __call__
12:47:22 return self.call(*arg, **kw)
12:47:22 File
"/home/jenkins/jenkins-slave/workspace/beam_PostCommit_Py_ValCont/src/sdks/python/container/venv/python/local/lib/python2.7/site-packages/nose/plugins/manager.py",
line 167, in simple
12:47:22 result = meth(*arg, **kw)
12:47:22 File
"/home/jenkins/jenkins-slave/workspace/beam_PostCommit_Py_ValCont/src/sdks/python/container/venv/python/local/lib/python2.7/site-packages/nose/plugins/xunit.py",
line 287, in addError
12:47:22 tb = format_exception(err, self.encoding)
12:47:22 File
"/home/jenkins/jenkins-slave/workspace/beam_PostCommit_Py_ValCont/src/sdks/python/container/venv/python/local/lib/python2.7/site-packages/nose/pyversion.py",
line 214, in format_exception
12:47:22 ''.join(traceback.format_exception(*exc_info)),
12:47:22 File "/usr/lib/python2.7/traceback.py", line 141, in format_exception
12:47:22 list = list + format_tb(tb, limit)
12:47:22 File "/usr/lib/python2.7/traceback.py", line 76, in format_tb
12:47:22 return format_list(extract_tb(tb, limit))
12:47:22 File "/usr/lib/python2.7/traceback.py", line 101, in extract_tb
12:47:22 line = linecache.getline(filename, lineno, f.f_globals)
12:47:22 File
"/home/jenkins/jenkins-slave/workspace/beam_PostCommit_Py_ValCont/src/sdks/python/container/venv/python/lib/python2.7/linecache.py",
line 14, in getline
12:47:22 lines = getlines(filename, module_globals)
12:47:22 File
"/home/jenkins/jenkins-slave/workspace/beam_PostCommit_Py_ValCont/src/sdks/python/container/venv/python/lib/python2.7/linecache.py",
line 41, in getlines
12:47:22 return updatecache(filename, module_globals)
12:47:22 File
"/home/jenkins/jenkins-slave/workspace/beam_PostCommit_Py_ValCont/src/sdks/python/container/venv/python/lib/python2.7/linecache.py",
line 132, in updatecache
12:47:22 lines = fp.readlines()
12:47:22 File
"/home/jenkins/jenkins-slave/workspace/beam_PostCommit_Py_ValCont/src/sdks/python/container/venv/python/local/lib/python2.7/site-packages/nose/plugins/multiprocess.py",
line 276, in signalhandler
12:47:22 raise TimedOutException()
12:47:22 TimedOutException:
'<nose.plugins.multiprocess.NoSharedFixtureContextSuite context=WordCountIT>'
12:47:22
12:47:22 ======================================================================
12:47:22 ERROR: test_metrics_fnapi_it
(apache_beam.runners.dataflow.dataflow_exercise_metrics_pipeline_test.ExerciseMetricsPipelineTest)
12:47:22 ----------------------------------------------------------------------
12:47:22 Traceback (most recent call last):
12:47:22 File
"/home/jenkins/jenkins-slave/workspace/beam_PostCommit_Py_ValCont/src/sdks/python/container/venv/python/local/lib/python2.7/site-packages/nose/plugins/multiprocess.py",
line 812, in run
12:47:22 test(orig)
12:47:22 File
"/home/jenkins/jenkins-slave/workspace/beam_PostCommit_Py_ValCont/src/sdks/python/container/venv/python/local/lib/python2.7/site-packages/nose/case.py",
line 45, in __call__
12:47:22 return self.run(*arg, **kwarg)
12:47:22 File
"/home/jenkins/jenkins-slave/workspace/beam_PostCommit_Py_ValCont/src/sdks/python/container/venv/python/local/lib/python2.7/site-packages/nose/case.py",
line 133, in run
12:47:22 self.runTest(result)
12:47:22 File
"/home/jenkins/jenkins-slave/workspace/beam_PostCommit_Py_ValCont/src/sdks/python/container/venv/python/local/lib/python2.7/site-packages/nose/case.py",
line 151, in runTest
12:47:22 test(result)
12:47:22 File "/usr/lib/python2.7/unittest/case.py", line 393, in __call__
12:47:22 return self.run(*args, **kwds)
12:47:22 File "/usr/lib/python2.7/unittest/case.py", line 329, in run
12:47:22 testMethod()
12:47:22 File
"/home/jenkins/jenkins-slave/workspace/beam_PostCommit_Py_ValCont/src/sdks/python/apache_beam/runners/dataflow/dataflow_exercise_metrics_pipeline_test.py",
line 58, in test_metrics_fnapi_it
12:47:22 result = self.run_pipeline(experiment='beam_fn_api')
12:47:22 File
"/home/jenkins/jenkins-slave/workspace/beam_PostCommit_Py_ValCont/src/sdks/python/apache_beam/runners/dataflow/dataflow_exercise_metrics_pipeline_test.py",
line 39, in run_pipeline
12:47:22 test_pipeline = TestPipeline(is_integration_test=True)
12:47:22 File
"/home/jenkins/jenkins-slave/workspace/beam_PostCommit_Py_ValCont/src/sdks/python/apache_beam/testing/test_pipeline.py",
line 107, in __init__
12:47:22 super(TestPipeline, self).__init__(runner, options)
12:47:22 File
"/home/jenkins/jenkins-slave/workspace/beam_PostCommit_Py_ValCont/src/sdks/python/apache_beam/pipeline.py",
line 185, in __init__
12:47:22 errors = PipelineOptionsValidator(self._options, runner).validate()
12:47:22 File
"/home/jenkins/jenkins-slave/workspace/beam_PostCommit_Py_ValCont/src/sdks/python/apache_beam/options/pipeline_options_validator.py",
line 113, in validate
12:47:22 errors.extend(self.options.view_as(cls).validate(self))
12:47:22 File
"/home/jenkins/jenkins-slave/workspace/beam_PostCommit_Py_ValCont/src/sdks/python/apache_beam/options/pipeline_options.py",
line 596, in validate
12:47:22 self.view_as(GoogleCloudOptions).region =
self._get_default_gcp_region()
12:47:22 File
"/home/jenkins/jenkins-slave/workspace/beam_PostCommit_Py_ValCont/src/sdks/python/apache_beam/options/pipeline_options.py",
line 564, in _get_default_gcp_region
12:47:22 raw_output = processes.check_output(cmd, stderr=DEVNULL)
12:47:22 File
"/home/jenkins/jenkins-slave/workspace/beam_PostCommit_Py_ValCont/src/sdks/python/apache_beam/utils/processes.py",
line 85, in check_output
12:47:22 out = subprocess.check_output(*args, **kwargs)
12:47:22 File "/usr/lib/python2.7/subprocess.py", line 567, in check_output
12:47:22 process = Popen(stdout=PIPE, *popenargs, **kwargs)
12:47:22 File "/usr/lib/python2.7/subprocess.py", line 711, in __init__
12:47:22 errread, errwrite)
12:47:22 File "/usr/lib/python2.7/subprocess.py", line 1319, in _execute_child
12:47:22 data = _eintr_retry_call(os.read, errpipe_read, 1048576)
12:47:22 File "/usr/lib/python2.7/subprocess.py", line 476, in
_eintr_retry_call
12:47:22 return func(*args)
12:47:22 File
"/home/jenkins/jenkins-slave/workspace/beam_PostCommit_Py_ValCont/src/sdks/python/container/venv/python/local/lib/python2.7/site-packages/nose/plugins/multiprocess.py",
line 276, in signalhandler
12:47:22 raise TimedOutException()
12:47:22 TimedOutException: 'test_metrics_fnapi_it
(apache_beam.runners.dataflow.dataflow_exercise_metrics_pipeline_test.ExerciseMetricsPipelineTest)'
{code}
> beam_PostCommit_Py_ValCont failure due to timeout
> -------------------------------------------------
>
> Key: BEAM-9271
> URL: https://issues.apache.org/jira/browse/BEAM-9271
> Project: Beam
> Issue Type: Bug
> Components: sdk-py-core, test-failures
> Reporter: Udi Meiri
> Priority: Major
>
> Failing test: test_metrics_fnapi_it
> The timeout setting originates from the nose flag --process-timeout=900
> Example recent failures:
> https://builds.apache.org/job/beam_PostCommit_Py_ValCont/5486/
> https://builds.apache.org/job/beam_PostCommit_Py_ValCont/5487/
> Failures started at:
> https://builds.apache.org/job/beam_PostCommit_Py_ValCont/5457/
> Two possible culprits:
> https://github.com/apache/beam/pull/10437 - adds a pytest timeout plugin
> https://github.com/apache/beam/pull/10755 - doesn't seem likely to be a
> culprit
--
This message was sent by Atlassian Jira
(v8.3.4#803005)
