[ 
https://issues.apache.org/jira/browse/BEAM-5957?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
 ]

Daniel Oliveira updated BEAM-5957:
----------------------------------
    Description: 
Most recent failure: 
[https://builds.apache.org/job/beam_PerformanceTests_Python/1634/]

I haven't been able to debug the root cause of the failure with what I know. 
From what I can tell the performance test fails because one of the integration 
tests it's benchmarking has failed. But I can't tell what integration test is 
causing the failure.

Relevant parts of the logs:

{noformat}
11:19:01 BUILD FAILED in 36s
11:19:01 
11:19:01 2018-11-02 18:19:01,413 3c18295b MainThread 
beam_integration_benchmark(1/1) ERROR    Error during benchmark 
beam_integration_benchmark
11:19:01 Traceback (most recent call last):
11:19:01   File 
"/home/jenkins/jenkins-slave/workspace/beam_PerformanceTests_Python/PerfKitBenchmarker/perfkitbenchmarker/pkb.py",
 line 719, in RunBenchmark
11:19:01     DoRunPhase(spec, collector, detailed_timer)
11:19:01   File 
"/home/jenkins/jenkins-slave/workspace/beam_PerformanceTests_Python/PerfKitBenchmarker/perfkitbenchmarker/pkb.py",
 line 580, in DoRunPhase
11:19:01     samples = spec.BenchmarkRun(spec)
11:19:01   File 
"/home/jenkins/jenkins-slave/workspace/beam_PerformanceTests_Python/PerfKitBenchmarker/perfkitbenchmarker/linux_benchmarks/beam_integration_benchmark.py",
 line 160, in Run
11:19:01     job_type=job_type)
11:19:01   File 
"/home/jenkins/jenkins-slave/workspace/beam_PerformanceTests_Python/PerfKitBenchmarker/perfkitbenchmarker/providers/gcp/gcp_dpb_dataflow.py",
 line 90, in SubmitJob
11:19:01     assert retcode == 0, "Integration Test Failed."
11:19:01 AssertionError: Integration Test Failed.
11:19:01 2018-11-02 18:19:01,414 3c18295b MainThread 
beam_integration_benchmark(1/1) INFO     Cleaning up benchmark 
beam_integration_benchmark
11:19:01 2018-11-02 18:19:01,416 3c18295b MainThread 
beam_integration_benchmark(1/1) ERROR    Exception running benchmark
11:19:01 Traceback (most recent call last):
11:19:01   File 
"/home/jenkins/jenkins-slave/workspace/beam_PerformanceTests_Python/PerfKitBenchmarker/perfkitbenchmarker/pkb.py",
 line 860, in RunBenchmarkTask
11:19:01     RunBenchmark(spec, collector)
11:19:01   File 
"/home/jenkins/jenkins-slave/workspace/beam_PerformanceTests_Python/PerfKitBenchmarker/perfkitbenchmarker/pkb.py",
 line 719, in RunBenchmark
11:19:01     DoRunPhase(spec, collector, detailed_timer)
11:19:01   File 
"/home/jenkins/jenkins-slave/workspace/beam_PerformanceTests_Python/PerfKitBenchmarker/perfkitbenchmarker/pkb.py",
 line 580, in DoRunPhase
11:19:01     samples = spec.BenchmarkRun(spec)
11:19:01   File 
"/home/jenkins/jenkins-slave/workspace/beam_PerformanceTests_Python/PerfKitBenchmarker/perfkitbenchmarker/linux_benchmarks/beam_integration_benchmark.py",
 line 160, in Run
11:19:01     job_type=job_type)
11:19:01   File 
"/home/jenkins/jenkins-slave/workspace/beam_PerformanceTests_Python/PerfKitBenchmarker/perfkitbenchmarker/providers/gcp/gcp_dpb_dataflow.py",
 line 90, in SubmitJob
11:19:01     assert retcode == 0, "Integration Test Failed."
11:19:01 AssertionError: Integration Test Failed.
11:19:01 2018-11-02 18:19:01,416 3c18295b MainThread 
beam_integration_benchmark(1/1) ERROR    Benchmark 1/1 
beam_integration_benchmark (UID: beam_integration_benchmark0) failed. Execution 
will continue.
{noformat}


  was:
Most recent failure: 
[https://builds.apache.org/job/beam_PerformanceTests_Python/1634/]

I haven't been able to debug the root cause of the failure with what I know. 
From what I can tell the performance test fails because one of the integration 
tests it's benchmarking has failed. But I can't tell what integration test is 
causing the failure.

Relevant parts of the logs:
*11:19:01* BUILD FAILED in 36s*11:19:01* *11:19:01* 2018-11-02 18:19:01,413 
3c18295b MainThread beam_integration_benchmark(1/1) ERROR    Error during 
benchmark beam_integration_benchmark*11:19:01* Traceback (most recent call 
last):*11:19:01*   File 
"/home/jenkins/jenkins-slave/workspace/beam_PerformanceTests_Python/PerfKitBenchmarker/perfkitbenchmarker/pkb.py",
 line 719, in RunBenchmark*11:19:01*     DoRunPhase(spec, collector, 
detailed_timer)*11:19:01*   File 
"/home/jenkins/jenkins-slave/workspace/beam_PerformanceTests_Python/PerfKitBenchmarker/perfkitbenchmarker/pkb.py",
 line 580, in DoRunPhase*11:19:01*     samples = 
spec.BenchmarkRun(spec)*11:19:01*   File 
"/home/jenkins/jenkins-slave/workspace/beam_PerformanceTests_Python/PerfKitBenchmarker/perfkitbenchmarker/linux_benchmarks/beam_integration_benchmark.py",
 line 160, in Run*11:19:01*     job_type=job_type)*11:19:01*   File 
"/home/jenkins/jenkins-slave/workspace/beam_PerformanceTests_Python/PerfKitBenchmarker/perfkitbenchmarker/providers/gcp/gcp_dpb_dataflow.py",
 line 90, in SubmitJob*11:19:01*     assert retcode == 0, "Integration Test 
Failed."*11:19:01* AssertionError: Integration Test Failed.*11:19:01* 
2018-11-02 18:19:01,414 3c18295b MainThread beam_integration_benchmark(1/1) 
INFO     Cleaning up benchmark beam_integration_benchmark*11:19:01* 2018-11-02 
18:19:01,416 3c18295b MainThread beam_integration_benchmark(1/1) ERROR    
Exception running benchmark*11:19:01* Traceback (most recent call 
last):*11:19:01*   File 
"/home/jenkins/jenkins-slave/workspace/beam_PerformanceTests_Python/PerfKitBenchmarker/perfkitbenchmarker/pkb.py",
 line 860, in RunBenchmarkTask*11:19:01*     RunBenchmark(spec, 
collector)*11:19:01*   File 
"/home/jenkins/jenkins-slave/workspace/beam_PerformanceTests_Python/PerfKitBenchmarker/perfkitbenchmarker/pkb.py",
 line 719, in RunBenchmark*11:19:01*     DoRunPhase(spec, collector, 
detailed_timer)*11:19:01*   File 
"/home/jenkins/jenkins-slave/workspace/beam_PerformanceTests_Python/PerfKitBenchmarker/perfkitbenchmarker/pkb.py",
 line 580, in DoRunPhase*11:19:01*     samples = 
spec.BenchmarkRun(spec)*11:19:01*   File 
"/home/jenkins/jenkins-slave/workspace/beam_PerformanceTests_Python/PerfKitBenchmarker/perfkitbenchmarker/linux_benchmarks/beam_integration_benchmark.py",
 line 160, in Run*11:19:01*     job_type=job_type)*11:19:01*   File 
"/home/jenkins/jenkins-slave/workspace/beam_PerformanceTests_Python/PerfKitBenchmarker/perfkitbenchmarker/providers/gcp/gcp_dpb_dataflow.py",
 line 90, in SubmitJob*11:19:01*     assert retcode == 0, "Integration Test 
Failed."*11:19:01* AssertionError: Integration Test Failed.*11:19:01* 
2018-11-02 18:19:01,416 3c18295b MainThread beam_integration_benchmark(1/1) 
ERROR    Benchmark 1/1 beam_integration_benchmark (UID: 
beam_integration_benchmark0) failed. Execution will continue.


> [beam_PerformanceTests_Python] Consistently failing due to failing 
> integration test.
> ------------------------------------------------------------------------------------
>
>                 Key: BEAM-5957
>                 URL: https://issues.apache.org/jira/browse/BEAM-5957
>             Project: Beam
>          Issue Type: Bug
>          Components: sdk-py-core, test-failures
>            Reporter: Daniel Oliveira
>            Assignee: Ahmet Altay
>            Priority: Major
>
> Most recent failure: 
> [https://builds.apache.org/job/beam_PerformanceTests_Python/1634/]
> I haven't been able to debug the root cause of the failure with what I know. 
> From what I can tell the performance test fails because one of the 
> integration tests it's benchmarking has failed. But I can't tell what 
> integration test is causing the failure.
> Relevant parts of the logs:
> {noformat}
> 11:19:01 BUILD FAILED in 36s
> 11:19:01 
> 11:19:01 2018-11-02 18:19:01,413 3c18295b MainThread 
> beam_integration_benchmark(1/1) ERROR    Error during benchmark 
> beam_integration_benchmark
> 11:19:01 Traceback (most recent call last):
> 11:19:01   File 
> "/home/jenkins/jenkins-slave/workspace/beam_PerformanceTests_Python/PerfKitBenchmarker/perfkitbenchmarker/pkb.py",
>  line 719, in RunBenchmark
> 11:19:01     DoRunPhase(spec, collector, detailed_timer)
> 11:19:01   File 
> "/home/jenkins/jenkins-slave/workspace/beam_PerformanceTests_Python/PerfKitBenchmarker/perfkitbenchmarker/pkb.py",
>  line 580, in DoRunPhase
> 11:19:01     samples = spec.BenchmarkRun(spec)
> 11:19:01   File 
> "/home/jenkins/jenkins-slave/workspace/beam_PerformanceTests_Python/PerfKitBenchmarker/perfkitbenchmarker/linux_benchmarks/beam_integration_benchmark.py",
>  line 160, in Run
> 11:19:01     job_type=job_type)
> 11:19:01   File 
> "/home/jenkins/jenkins-slave/workspace/beam_PerformanceTests_Python/PerfKitBenchmarker/perfkitbenchmarker/providers/gcp/gcp_dpb_dataflow.py",
>  line 90, in SubmitJob
> 11:19:01     assert retcode == 0, "Integration Test Failed."
> 11:19:01 AssertionError: Integration Test Failed.
> 11:19:01 2018-11-02 18:19:01,414 3c18295b MainThread 
> beam_integration_benchmark(1/1) INFO     Cleaning up benchmark 
> beam_integration_benchmark
> 11:19:01 2018-11-02 18:19:01,416 3c18295b MainThread 
> beam_integration_benchmark(1/1) ERROR    Exception running benchmark
> 11:19:01 Traceback (most recent call last):
> 11:19:01   File 
> "/home/jenkins/jenkins-slave/workspace/beam_PerformanceTests_Python/PerfKitBenchmarker/perfkitbenchmarker/pkb.py",
>  line 860, in RunBenchmarkTask
> 11:19:01     RunBenchmark(spec, collector)
> 11:19:01   File 
> "/home/jenkins/jenkins-slave/workspace/beam_PerformanceTests_Python/PerfKitBenchmarker/perfkitbenchmarker/pkb.py",
>  line 719, in RunBenchmark
> 11:19:01     DoRunPhase(spec, collector, detailed_timer)
> 11:19:01   File 
> "/home/jenkins/jenkins-slave/workspace/beam_PerformanceTests_Python/PerfKitBenchmarker/perfkitbenchmarker/pkb.py",
>  line 580, in DoRunPhase
> 11:19:01     samples = spec.BenchmarkRun(spec)
> 11:19:01   File 
> "/home/jenkins/jenkins-slave/workspace/beam_PerformanceTests_Python/PerfKitBenchmarker/perfkitbenchmarker/linux_benchmarks/beam_integration_benchmark.py",
>  line 160, in Run
> 11:19:01     job_type=job_type)
> 11:19:01   File 
> "/home/jenkins/jenkins-slave/workspace/beam_PerformanceTests_Python/PerfKitBenchmarker/perfkitbenchmarker/providers/gcp/gcp_dpb_dataflow.py",
>  line 90, in SubmitJob
> 11:19:01     assert retcode == 0, "Integration Test Failed."
> 11:19:01 AssertionError: Integration Test Failed.
> 11:19:01 2018-11-02 18:19:01,416 3c18295b MainThread 
> beam_integration_benchmark(1/1) ERROR    Benchmark 1/1 
> beam_integration_benchmark (UID: beam_integration_benchmark0) failed. 
> Execution will continue.
> {noformat}



--
This message was sent by Atlassian JIRA
(v7.6.3#76005)

Reply via email to