[
https://issues.apache.org/jira/browse/BEAM-3809?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16391749#comment-16391749
]
Mark Liu edited comment on BEAM-3809 at 3/8/18 7:11 PM:
--------------------------------------------------------
The command pkb use to execute pipeline is:
{code}
python setup.py nosetests --tests=apache_beam.examples.wordcount_it_test
--attr=IT --test-pipeline-options="--project=apache-beam-testing"
"--staging_location=gs://temp-storage-for-end-to-end-tests/staging-it"
"--temp_location=gs://temp-storage-for-end-to-end-tests/temp-it"
"--output=gs://temp-storage-for-end-to-end-tests/py-it-cloud/output"
--runner=TestDataflowRunner
--sdk_location=/home/jenkins/jenkins-slave/workspace/beam_PerformanceTests_Python/runs/9e009d45/beam/sdks/python/target/apache-beam-2.5.0.dev0.tar.gz
{code}
which looks good to me. Probably need more investigate on pkb side.
was (Author: markflyhigh):
The command pkb use to execute pipeline is:
python setup.py nosetests --tests=apache_beam.examples.wordcount_it_test
--attr=IT --test-pipeline-options="--project=apache-beam-testing"
"--staging_location=gs://temp-storage-for-end-to-end-tests/staging-it"
"--temp_location=gs://temp-storage-for-end-to-end-tests/temp-it"
"--output=gs://temp-storage-for-end-to-end-tests/py-it-cloud/output"
--runner=TestDataflowRunner
--sdk_location=/home/jenkins/jenkins-slave/workspace/beam_PerformanceTests_Python/runs/9e009d45/beam/sdks/python/target/apache-beam-2.5.0.dev0.tar.gz
which looks good to me. Probably need more investigate on pkb side.
> beam_PerformanceTests_Python failing
> ------------------------------------
>
> Key: BEAM-3809
> URL: https://issues.apache.org/jira/browse/BEAM-3809
> Project: Beam
> Issue Type: Bug
> Components: testing
> Reporter: Ahmet Altay
> Assignee: Mark Liu
> Priority: Major
>
> Looks like a misconfiguration based on the error.
>
> Example test:
> [https://builds.apache.org/view/A-D/view/Beam/job/beam_PerformanceTests_Python/1000/console]
>
> Error I see:
> error: option --test-pipeline-options not recognized
> 2018-03-08 18:48:08,202 9e009d45 MainThread beam_integration_benchmark(1/1)
> ERROR Error during benchmark beam_integration_benchmark
> Traceback (most recent call last):
> File
> "/home/jenkins/jenkins-slave/workspace/beam_PerformanceTests_Python/PerfKitBenchmarker/perfkitbenchmarker/pkb.py",
> line 622, in RunBenchmark
> DoRunPhase(spec, collector, detailed_timer)
> File
> "/home/jenkins/jenkins-slave/workspace/beam_PerformanceTests_Python/PerfKitBenchmarker/perfkitbenchmarker/pkb.py",
> line 525, in DoRunPhase
> samples = spec.BenchmarkRun(spec)
> File
> "/home/jenkins/jenkins-slave/workspace/beam_PerformanceTests_Python/PerfKitBenchmarker/perfkitbenchmarker/linux_benchmarks/beam_integration_benchmark.py",
> line 159, in Run
> job_type=job_type)
> File
> "/home/jenkins/jenkins-slave/workspace/beam_PerformanceTests_Python/PerfKitBenchmarker/perfkitbenchmarker/providers/gcp/gcp_dpb_dataflow.py",
> line 90, in SubmitJob
> assert retcode == 0, "Integration Test Failed."
--
This message was sent by Atlassian JIRA
(v7.6.3#76005)
