[
https://issues.apache.org/jira/browse/BEAM-5957?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Daniel Oliveira updated BEAM-5957:
----------------------------------
Description:
Most recent failure:
[https://builds.apache.org/job/beam_PerformanceTests_Python/1634/]
I haven't been able to debug the root cause of the failure with what I know.
From what I can tell the performance test fails because one of the integration
tests it's benchmarking has failed. But I can't tell what integration test is
causing the failure.
Relevant parts of the logs:
*11:19:01* BUILD FAILED in 36s*11:19:01* *11:19:01* 2018-11-02 18:19:01,413
3c18295b MainThread beam_integration_benchmark(1/1) ERROR Error during
benchmark beam_integration_benchmark*11:19:01* Traceback (most recent call
last):*11:19:01* File
"/home/jenkins/jenkins-slave/workspace/beam_PerformanceTests_Python/PerfKitBenchmarker/perfkitbenchmarker/pkb.py",
line 719, in RunBenchmark*11:19:01* DoRunPhase(spec, collector,
detailed_timer)*11:19:01* File
"/home/jenkins/jenkins-slave/workspace/beam_PerformanceTests_Python/PerfKitBenchmarker/perfkitbenchmarker/pkb.py",
line 580, in DoRunPhase*11:19:01* samples =
spec.BenchmarkRun(spec)*11:19:01* File
"/home/jenkins/jenkins-slave/workspace/beam_PerformanceTests_Python/PerfKitBenchmarker/perfkitbenchmarker/linux_benchmarks/beam_integration_benchmark.py",
line 160, in Run*11:19:01* job_type=job_type)*11:19:01* File
"/home/jenkins/jenkins-slave/workspace/beam_PerformanceTests_Python/PerfKitBenchmarker/perfkitbenchmarker/providers/gcp/gcp_dpb_dataflow.py",
line 90, in SubmitJob*11:19:01* assert retcode == 0, "Integration Test
Failed."*11:19:01* AssertionError: Integration Test Failed.*11:19:01*
2018-11-02 18:19:01,414 3c18295b MainThread beam_integration_benchmark(1/1)
INFO Cleaning up benchmark beam_integration_benchmark*11:19:01* 2018-11-02
18:19:01,416 3c18295b MainThread beam_integration_benchmark(1/1) ERROR
Exception running benchmark*11:19:01* Traceback (most recent call
last):*11:19:01* File
"/home/jenkins/jenkins-slave/workspace/beam_PerformanceTests_Python/PerfKitBenchmarker/perfkitbenchmarker/pkb.py",
line 860, in RunBenchmarkTask*11:19:01* RunBenchmark(spec,
collector)*11:19:01* File
"/home/jenkins/jenkins-slave/workspace/beam_PerformanceTests_Python/PerfKitBenchmarker/perfkitbenchmarker/pkb.py",
line 719, in RunBenchmark*11:19:01* DoRunPhase(spec, collector,
detailed_timer)*11:19:01* File
"/home/jenkins/jenkins-slave/workspace/beam_PerformanceTests_Python/PerfKitBenchmarker/perfkitbenchmarker/pkb.py",
line 580, in DoRunPhase*11:19:01* samples =
spec.BenchmarkRun(spec)*11:19:01* File
"/home/jenkins/jenkins-slave/workspace/beam_PerformanceTests_Python/PerfKitBenchmarker/perfkitbenchmarker/linux_benchmarks/beam_integration_benchmark.py",
line 160, in Run*11:19:01* job_type=job_type)*11:19:01* File
"/home/jenkins/jenkins-slave/workspace/beam_PerformanceTests_Python/PerfKitBenchmarker/perfkitbenchmarker/providers/gcp/gcp_dpb_dataflow.py",
line 90, in SubmitJob*11:19:01* assert retcode == 0, "Integration Test
Failed."*11:19:01* AssertionError: Integration Test Failed.*11:19:01*
2018-11-02 18:19:01,416 3c18295b MainThread beam_integration_benchmark(1/1)
ERROR Benchmark 1/1 beam_integration_benchmark (UID:
beam_integration_benchmark0) failed. Execution will continue.
was:
Most recent failure:
[https://builds.apache.org/job/beam_PerformanceTests_Python/1634/]
I haven't been able to debug the root cause of the failure with what I know.
From what I can tell the performance test fails because one of the integration
tests it's benchmarking has failed. But I can't tell what integration test is
causing the failure.
Relevant parts of the logs:
{noformat}
11:19:01 BUILD FAILED in 36s 11:19:01 11:19:01 2018-11-02 18:19:01,413 3c18295b
MainThread beam_integration_benchmark(1/1) ERROR Error during benchmark
beam_integration_benchmark 11:19:01 Traceback (most recent call last): 11:19:01
File
"/home/jenkins/jenkins-slave/workspace/beam_PerformanceTests_Python/PerfKitBenchmarker/perfkitbenchmarker/pkb.py",
line 719, in RunBenchmark 11:19:01 DoRunPhase(spec, collector, detailed_timer)
11:19:01 File
"/home/jenkins/jenkins-slave/workspace/beam_PerformanceTests_Python/PerfKitBenchmarker/perfkitbenchmarker/pkb.py",
line 580, in DoRunPhase 11:19:01 samples = spec.BenchmarkRun(spec) 11:19:01
File
"/home/jenkins/jenkins-slave/workspace/beam_PerformanceTests_Python/PerfKitBenchmarker/perfkitbenchmarker/linux_benchmarks/beam_integration_benchmark.py",
line 160, in Run 11:19:01 job_type=job_type) 11:19:01 File
"/home/jenkins/jenkins-slave/workspace/beam_PerformanceTests_Python/PerfKitBenchmarker/perfkitbenchmarker/providers/gcp/gcp_dpb_dataflow.py",
line 90, in SubmitJob 11:19:01 assert retcode == 0, "Integration Test Failed."
11:19:01 AssertionError: Integration Test Failed. 11:19:01 2018-11-02
18:19:01,414 3c18295b MainThread beam_integration_benchmark(1/1) INFO Cleaning
up benchmark beam_integration_benchmark 11:19:01 2018-11-02 18:19:01,416
3c18295b MainThread beam_integration_benchmark(1/1) ERROR Exception running
benchmark 11:19:01 Traceback (most recent call last): 11:19:01 File
"/home/jenkins/jenkins-slave/workspace/beam_PerformanceTests_Python/PerfKitBenchmarker/perfkitbenchmarker/pkb.py",
line 860, in RunBenchmarkTask 11:19:01 RunBenchmark(spec, collector) 11:19:01
File
"/home/jenkins/jenkins-slave/workspace/beam_PerformanceTests_Python/PerfKitBenchmarker/perfkitbenchmarker/pkb.py",
line 719, in RunBenchmark 11:19:01 DoRunPhase(spec, collector, detailed_timer)
11:19:01 File
"/home/jenkins/jenkins-slave/workspace/beam_PerformanceTests_Python/PerfKitBenchmarker/perfkitbenchmarker/pkb.py",
line 580, in DoRunPhase 11:19:01 samples = spec.BenchmarkRun(spec) 11:19:01
File
"/home/jenkins/jenkins-slave/workspace/beam_PerformanceTests_Python/PerfKitBenchmarker/perfkitbenchmarker/linux_benchmarks/beam_integration_benchmark.py",
line 160, in Run 11:19:01 job_type=job_type) 11:19:01 File
"/home/jenkins/jenkins-slave/workspace/beam_PerformanceTests_Python/PerfKitBenchmarker/perfkitbenchmarker/providers/gcp/gcp_dpb_dataflow.py",
line 90, in SubmitJob 11:19:01 assert retcode == 0, "Integration Test Failed."
11:19:01 AssertionError: Integration Test Failed. 11:19:01 2018-11-02
18:19:01,416 3c18295b MainThread beam_integration_benchmark(1/1) ERROR
Benchmark 1/1 beam_integration_benchmark (UID: beam_integration_benchmark0)
failed. Execution will continue.
{noformat}
> [beam_PerformanceTests_Python] Consistently failing due to failing
> integration test.
> ------------------------------------------------------------------------------------
>
> Key: BEAM-5957
> URL: https://issues.apache.org/jira/browse/BEAM-5957
> Project: Beam
> Issue Type: Bug
> Components: sdk-py-core, test-failures
> Reporter: Daniel Oliveira
> Assignee: Ahmet Altay
> Priority: Major
>
> Most recent failure:
> [https://builds.apache.org/job/beam_PerformanceTests_Python/1634/]
> I haven't been able to debug the root cause of the failure with what I know.
> From what I can tell the performance test fails because one of the
> integration tests it's benchmarking has failed. But I can't tell what
> integration test is causing the failure.
> Relevant parts of the logs:
> *11:19:01* BUILD FAILED in 36s*11:19:01* *11:19:01* 2018-11-02 18:19:01,413
> 3c18295b MainThread beam_integration_benchmark(1/1) ERROR Error during
> benchmark beam_integration_benchmark*11:19:01* Traceback (most recent call
> last):*11:19:01* File
> "/home/jenkins/jenkins-slave/workspace/beam_PerformanceTests_Python/PerfKitBenchmarker/perfkitbenchmarker/pkb.py",
> line 719, in RunBenchmark*11:19:01* DoRunPhase(spec, collector,
> detailed_timer)*11:19:01* File
> "/home/jenkins/jenkins-slave/workspace/beam_PerformanceTests_Python/PerfKitBenchmarker/perfkitbenchmarker/pkb.py",
> line 580, in DoRunPhase*11:19:01* samples =
> spec.BenchmarkRun(spec)*11:19:01* File
> "/home/jenkins/jenkins-slave/workspace/beam_PerformanceTests_Python/PerfKitBenchmarker/perfkitbenchmarker/linux_benchmarks/beam_integration_benchmark.py",
> line 160, in Run*11:19:01* job_type=job_type)*11:19:01* File
> "/home/jenkins/jenkins-slave/workspace/beam_PerformanceTests_Python/PerfKitBenchmarker/perfkitbenchmarker/providers/gcp/gcp_dpb_dataflow.py",
> line 90, in SubmitJob*11:19:01* assert retcode == 0, "Integration Test
> Failed."*11:19:01* AssertionError: Integration Test Failed.*11:19:01*
> 2018-11-02 18:19:01,414 3c18295b MainThread beam_integration_benchmark(1/1)
> INFO Cleaning up benchmark beam_integration_benchmark*11:19:01*
> 2018-11-02 18:19:01,416 3c18295b MainThread beam_integration_benchmark(1/1)
> ERROR Exception running benchmark*11:19:01* Traceback (most recent call
> last):*11:19:01* File
> "/home/jenkins/jenkins-slave/workspace/beam_PerformanceTests_Python/PerfKitBenchmarker/perfkitbenchmarker/pkb.py",
> line 860, in RunBenchmarkTask*11:19:01* RunBenchmark(spec,
> collector)*11:19:01* File
> "/home/jenkins/jenkins-slave/workspace/beam_PerformanceTests_Python/PerfKitBenchmarker/perfkitbenchmarker/pkb.py",
> line 719, in RunBenchmark*11:19:01* DoRunPhase(spec, collector,
> detailed_timer)*11:19:01* File
> "/home/jenkins/jenkins-slave/workspace/beam_PerformanceTests_Python/PerfKitBenchmarker/perfkitbenchmarker/pkb.py",
> line 580, in DoRunPhase*11:19:01* samples =
> spec.BenchmarkRun(spec)*11:19:01* File
> "/home/jenkins/jenkins-slave/workspace/beam_PerformanceTests_Python/PerfKitBenchmarker/perfkitbenchmarker/linux_benchmarks/beam_integration_benchmark.py",
> line 160, in Run*11:19:01* job_type=job_type)*11:19:01* File
> "/home/jenkins/jenkins-slave/workspace/beam_PerformanceTests_Python/PerfKitBenchmarker/perfkitbenchmarker/providers/gcp/gcp_dpb_dataflow.py",
> line 90, in SubmitJob*11:19:01* assert retcode == 0, "Integration Test
> Failed."*11:19:01* AssertionError: Integration Test Failed.*11:19:01*
> 2018-11-02 18:19:01,416 3c18295b MainThread beam_integration_benchmark(1/1)
> ERROR Benchmark 1/1 beam_integration_benchmark (UID:
> beam_integration_benchmark0) failed. Execution will continue.
--
This message was sent by Atlassian JIRA
(v7.6.3#76005)
