[
https://issues.apache.org/jira/browse/BEAM-3270?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16662834#comment-16662834
]
Henning Rohde commented on BEAM-3270:
-------------------------------------
Bumping the priority. These failures are not debuggable without logs (or at
least a Dataflow job id).
05:28:22
###########################################################################
05:28:22 # Run tests and validate that jobs finish successfully.
05:28:22
05:28:22 echo ">>> RUNNING integration tests with pipeline options:
$PIPELINE_OPTS"
05:28:22 python setup.py nosetests \
05:28:22 --test-pipeline-options="$PIPELINE_OPTS" \
05:28:22 $TEST_OPTS
05:28:22
/home/jenkins/jenkins-slave/workspace/beam_PerformanceTests_Python/src/sdks/python/build/gradleenv/local/lib/python2.7/site-packages/setuptools/dist.py:398:
UserWarning: Normalizing '2.9.0.dev' to '2.9.0.dev0'
05:28:22 normalized_version,
05:28:22 warning: no files found matching 'README.md'
05:28:22 warning: no files found matching 'NOTICE'
05:28:22 warning: no files found matching 'LICENSE'
05:28:22
/home/jenkins/jenkins-slave/workspace/beam_PerformanceTests_Python/src/sdks/python/apache_beam/runners/dataflow/dataflow_runner.py:808:
DeprecationWarning: options is deprecated since First stable release.
References to <pipeline>.options will not be supported
05:28:22 options = pbegin.pipeline.options.view_as(DebugOptions)
05:28:22
05:28:22 2018-10-24 12:28:22,574 fb8fe191 MainThread
beam_integration_benchmark(1/1) ERROR Error during benchmark
beam_integration_benchmark
05:28:22 Traceback (most recent call last):
05:28:22 File
"/home/jenkins/jenkins-slave/workspace/beam_PerformanceTests_Python/PerfKitBenchmarker/perfkitbenchmarker/pkb.py",
line 720, in RunBenchmark
05:28:22 DoRunPhase(spec, collector, detailed_timer)
05:28:22 File
"/home/jenkins/jenkins-slave/workspace/beam_PerformanceTests_Python/PerfKitBenchmarker/perfkitbenchmarker/pkb.py",
line 581, in DoRunPhase
05:28:22 samples = spec.BenchmarkRun(spec)
05:28:22 File
"/home/jenkins/jenkins-slave/workspace/beam_PerformanceTests_Python/PerfKitBenchmarker/perfkitbenchmarker/linux_benchmarks/beam_integration_benchmark.py",
line 160, in Run
05:28:22 job_type=job_type)
05:28:22 File
"/home/jenkins/jenkins-slave/workspace/beam_PerformanceTests_Python/PerfKitBenchmarker/perfkitbenchmarker/providers/gcp/gcp_dpb_dataflow.py",
line 90, in SubmitJob
05:28:22 assert retcode == 0, "Integration Test Failed."
05:28:22 AssertionError: Integration Test Failed.
05:28:22 2018-10-24 12:28:22,575 fb8fe191 MainThread
beam_integration_benchmark(1/1) INFO Cleaning up benchmark
beam_integration_benchmark
05:28:22 2018-10-24 12:28:22,578 fb8fe191 MainThread
beam_integration_benchmark(1/1) ERROR Exception running benchmark
05:28:22 Traceback (most recent call last):
05:28:22 File
"/home/jenkins/jenkins-slave/workspace/beam_PerformanceTests_Python/PerfKitBenchmarker/perfkitbenchmarker/pkb.py",
line 861, in RunBenchmarkTask
05:28:22 RunBenchmark(spec, collector)
05:28:22 File
"/home/jenkins/jenkins-slave/workspace/beam_PerformanceTests_Python/PerfKitBenchmarker/perfkitbenchmarker/pkb.py",
line 720, in RunBenchmark
05:28:22 DoRunPhase(spec, collector, detailed_timer)
05:28:22 File
"/home/jenkins/jenkins-slave/workspace/beam_PerformanceTests_Python/PerfKitBenchmarker/perfkitbenchmarker/pkb.py",
line 581, in DoRunPhase
05:28:22 samples = spec.BenchmarkRun(spec)
05:28:22 File
"/home/jenkins/jenkins-slave/workspace/beam_PerformanceTests_Python/PerfKitBenchmarker/perfkitbenchmarker/linux_benchmarks/beam_integration_benchmark.py",
line 160, in Run
05:28:22 job_type=job_type)
05:28:22 File
"/home/jenkins/jenkins-slave/workspace/beam_PerformanceTests_Python/PerfKitBenchmarker/perfkitbenchmarker/providers/gcp/gcp_dpb_dataflow.py",
line 90, in SubmitJob
05:28:22 assert retcode == 0, "Integration Test Failed."
05:28:22 AssertionError: Integration Test Failed.
05:28:22 2018-10-24 12:28:22,578 fb8fe191 MainThread
beam_integration_benchmark(1/1) ERROR Benchmark 1/1
beam_integration_benchmark (UID: beam_integration_benchmark0) failed. Execution
will continue.
05:28:22 2018-10-24 12:28:22,637 fb8fe191 MainThread INFO Benchmark run
statuses:
05:28:22
---------------------------------------------------------------------------------
05:28:22 Name UID Status
Failed Substatus
05:28:22
---------------------------------------------------------------------------------
05:28:22 beam_integration_benchmark beam_integration_benchmark0 FAILED
05:28:22
---------------------------------------------------------------------------------
> Make Perfkit benchmarker logs available for debugging
> -----------------------------------------------------
>
> Key: BEAM-3270
> URL: https://issues.apache.org/jira/browse/BEAM-3270
> Project: Beam
> Issue Type: Improvement
> Components: testing
> Reporter: Valentyn Tymofieiev
> Assignee: Jason Kuster
> Priority: Critical
>
> Logs produced by a failed performance test using Perfkit Benchmarker do not
> have enough information about the nature of the failure. Looking at what is
> being printed, the actual logs are stored in /tmp. We should make them
> available in the test execution logs or attach as artifacts to the Jenkins
> build. Copying to the workspace may be an option, although workspace may be a
> subject to cleanup. Example of current log trace:
> test_wordcount_it (apache_beam.examples.wordcount_it_test.WordCountIT) ...
> /tmp/perfkitbenchmarker/runs/312cddb3/beam/sdks/python/apache_beam/coders/typecoders.py:134:
> UserWarning: Using fallback coder for typehint: <type 'NoneType'>.
> warnings.warn('Using fallback coder for typehint: %r.' % typehint)
> 2017-11-28 00:15:12,297 312cddb3 MainThread beam_integration_benchmark(1/1)
> ERROR Error during benchmark beam_integration_benchmark
> Traceback (most recent call last):
> File
> "/home/jenkins/jenkins-slave/workspace/beam_PerformanceTests_Python/PerfKitBenchmarker/perfkitbenchmarker/pkb.py",
> line 584, in RunBenchmark
> DoRunPhase(spec, collector, detailed_timer)
> File
> "/home/jenkins/jenkins-slave/workspace/beam_PerformanceTests_Python/PerfKitBenchmarker/perfkitbenchmarker/pkb.py",
> line 495, in DoRunPhase
> samples = spec.BenchmarkRun(spec)
> File
> "/home/jenkins/jenkins-slave/workspace/beam_PerformanceTests_Python/PerfKitBenchmarker/perfkitbenchmarker/linux_benchmarks/beam_integration_benchmark.py",
> line 159, in Run
> job_type=job_type)
> File
> "/home/jenkins/jenkins-slave/workspace/beam_PerformanceTests_Python/PerfKitBenchmarker/perfkitbenchmarker/providers/gcp/gcp_dpb_dataflow.py",
> line 90, in SubmitJob
> assert retcode == 0, "Integration Test Failed."
> AssertionError: Integration Test Failed.
> 2017-11-28 00:15:12,298 312cddb3 MainThread beam_integration_benchmark(1/1)
> INFO Cleaning up benchmark beam_integration_benchmark
> 2017-11-28 00:15:12,300 312cddb3 MainThread beam_integration_benchmark(1/1)
> ERROR Benchmark 1/1 beam_integration_benchmark (UID:
> beam_integration_benchmark0) failed. Execution will continue.
> 2017-11-28 00:15:12,323 312cddb3 MainThread INFO Benchmark run statuses:
> ---------------------------------------------------------------
> Name UID Status
> ---------------------------------------------------------------
> beam_integration_benchmark beam_integration_benchmark0 FAILED
> ---------------------------------------------------------------
> Success rate: 0.00% (0/1)
> 2017-11-28 00:15:12,323 312cddb3 MainThread INFO Complete logs can be
> found at: /tmp/perfkitbenchmarker/runs/312cddb3/pkb.log
> 2017-11-28 00:15:12,324 312cddb3 MainThread INFO Completion statuses can
> be found at: /tmp/perfkitbenchmarker/runs/312cddb3/completion_statuses.json
--
This message was sent by Atlassian JIRA
(v7.6.3#76005)
