[
https://issues.apache.org/jira/browse/BEAM-5957?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16675695#comment-16675695
]
Mark Liu commented on BEAM-5957:
--------------------------------
Since Perfkit will eventually run Gradle command in a subprocess, Gradle log
will be printed in Jenkins console output and always contains more details.
Here are some useful log from console output:
{code}
...
10:19:01 > Task :beam-sdks-python:integrationTest FAILED
10:19:01 Unknown option:
--staging_location=gs://temp-storage-for-end-to-end-tests/staging-it
10:19:01 4 actionable tasks: 4 executed
10:19:01
10:19:01 Publishing build scan...
10:19:01 https://gradle.com/s/2bvsfzm5wk2t6
...
{code}
The problem comes from Python Gradle task which invokes postcommit shell
script. https://github.com/apache/beam/pull/6938 is out to fix the Gradle
script issue.
> [beam_PerformanceTests_Python] Consistently failing due to failing
> integration test.
> ------------------------------------------------------------------------------------
>
> Key: BEAM-5957
> URL: https://issues.apache.org/jira/browse/BEAM-5957
> Project: Beam
> Issue Type: Bug
> Components: sdk-py-core, test-failures
> Reporter: Daniel Oliveira
> Assignee: Mark Liu
> Priority: Major
>
> Most recent failure:
> [https://builds.apache.org/job/beam_PerformanceTests_Python/1634/]
> I haven't been able to debug the root cause of the failure with what I know.
> From what I can tell the performance test fails because one of the
> integration tests it's benchmarking has failed. But I can't tell what
> integration test is causing the failure.
> Relevant parts of the logs:
> {noformat}
> 11:19:01 BUILD FAILED in 36s
> 11:19:01
> 11:19:01 2018-11-02 18:19:01,413 3c18295b MainThread
> beam_integration_benchmark(1/1) ERROR Error during benchmark
> beam_integration_benchmark
> 11:19:01 Traceback (most recent call last):
> 11:19:01 File
> "/home/jenkins/jenkins-slave/workspace/beam_PerformanceTests_Python/PerfKitBenchmarker/perfkitbenchmarker/pkb.py",
> line 719, in RunBenchmark
> 11:19:01 DoRunPhase(spec, collector, detailed_timer)
> 11:19:01 File
> "/home/jenkins/jenkins-slave/workspace/beam_PerformanceTests_Python/PerfKitBenchmarker/perfkitbenchmarker/pkb.py",
> line 580, in DoRunPhase
> 11:19:01 samples = spec.BenchmarkRun(spec)
> 11:19:01 File
> "/home/jenkins/jenkins-slave/workspace/beam_PerformanceTests_Python/PerfKitBenchmarker/perfkitbenchmarker/linux_benchmarks/beam_integration_benchmark.py",
> line 160, in Run
> 11:19:01 job_type=job_type)
> 11:19:01 File
> "/home/jenkins/jenkins-slave/workspace/beam_PerformanceTests_Python/PerfKitBenchmarker/perfkitbenchmarker/providers/gcp/gcp_dpb_dataflow.py",
> line 90, in SubmitJob
> 11:19:01 assert retcode == 0, "Integration Test Failed."
> 11:19:01 AssertionError: Integration Test Failed.
> 11:19:01 2018-11-02 18:19:01,414 3c18295b MainThread
> beam_integration_benchmark(1/1) INFO Cleaning up benchmark
> beam_integration_benchmark
> 11:19:01 2018-11-02 18:19:01,416 3c18295b MainThread
> beam_integration_benchmark(1/1) ERROR Exception running benchmark
> 11:19:01 Traceback (most recent call last):
> 11:19:01 File
> "/home/jenkins/jenkins-slave/workspace/beam_PerformanceTests_Python/PerfKitBenchmarker/perfkitbenchmarker/pkb.py",
> line 860, in RunBenchmarkTask
> 11:19:01 RunBenchmark(spec, collector)
> 11:19:01 File
> "/home/jenkins/jenkins-slave/workspace/beam_PerformanceTests_Python/PerfKitBenchmarker/perfkitbenchmarker/pkb.py",
> line 719, in RunBenchmark
> 11:19:01 DoRunPhase(spec, collector, detailed_timer)
> 11:19:01 File
> "/home/jenkins/jenkins-slave/workspace/beam_PerformanceTests_Python/PerfKitBenchmarker/perfkitbenchmarker/pkb.py",
> line 580, in DoRunPhase
> 11:19:01 samples = spec.BenchmarkRun(spec)
> 11:19:01 File
> "/home/jenkins/jenkins-slave/workspace/beam_PerformanceTests_Python/PerfKitBenchmarker/perfkitbenchmarker/linux_benchmarks/beam_integration_benchmark.py",
> line 160, in Run
> 11:19:01 job_type=job_type)
> 11:19:01 File
> "/home/jenkins/jenkins-slave/workspace/beam_PerformanceTests_Python/PerfKitBenchmarker/perfkitbenchmarker/providers/gcp/gcp_dpb_dataflow.py",
> line 90, in SubmitJob
> 11:19:01 assert retcode == 0, "Integration Test Failed."
> 11:19:01 AssertionError: Integration Test Failed.
> 11:19:01 2018-11-02 18:19:01,416 3c18295b MainThread
> beam_integration_benchmark(1/1) ERROR Benchmark 1/1
> beam_integration_benchmark (UID: beam_integration_benchmark0) failed.
> Execution will continue.
> {noformat}
--
This message was sent by Atlassian JIRA
(v7.6.3#76005)
