Valentyn Tymofieiev created BEAM-8215:
-----------------------------------------
Summary: Wordcount 1GB Python PKB benchmarks sometimes fail
without an informative error
Key: BEAM-8215
URL: https://issues.apache.org/jira/browse/BEAM-8215
Project: Beam
Issue Type: Bug
Components: testing
Reporter: Valentyn Tymofieiev
Assignee: Mark Liu
Example:
https://builds.apache.org/job/beam_PerformanceTests_WordCountIT_Py36/452/console
{noformat}
12:09:27 2019-09-11 19:09:27,655 a47400ce MainThread
beam_integration_benchmark(1/1) ERROR Error during benchmark
beam_integration_benchmark
12:09:27 Traceback (most recent call last):
12:09:27 File
"/home/jenkins/jenkins-slave/workspace/beam_PerformanceTests_WordCountIT_Py36/PerfKitBenchmarker/perfkitbenchmarker/pkb.py",
line 841, in RunBenchmark
12:09:27 DoRunPhase(spec, collector, detailed_timer)
12:09:27 File
"/home/jenkins/jenkins-slave/workspace/beam_PerformanceTests_WordCountIT_Py36/PerfKitBenchmarker/perfkitbenchmarker/pkb.py",
line 687, in DoRunPhase
12:09:27 samples = spec.BenchmarkRun(spec)
12:09:27 File
"/home/jenkins/jenkins-slave/workspace/beam_PerformanceTests_WordCountIT_Py36/PerfKitBenchmarker/perfkitbenchmarker/linux_benchmarks/beam_integration_benchmark.py",
line 160, in Run
12:09:27 job_type=job_type)
12:09:27 File
"/home/jenkins/jenkins-slave/workspace/beam_PerformanceTests_WordCountIT_Py36/PerfKitBenchmarker/perfkitbenchmarker/providers/gcp/gcp_dpb_dataflow.py",
line 91, in SubmitJob
12:09:27 assert retcode == 0, "Integration Test Failed."
12:09:27 AssertionError: Integration Test Failed.
{noformat}
It seems like Job submission failed, but there are no details. I talked with
[~markflyhigh], and sounds like we plan to stop using PKB in favor of another
framework.
Assigning to Mark for now to triage follow up or reassign as appropriate.
--
This message was sent by Atlassian Jira
(v8.3.2#803003)
