Kyle Weaver created BEAM-9638:
---------------------------------

             Summary: False positives in worker region & zone tests
                 Key: BEAM-9638
                 URL: https://issues.apache.org/jira/browse/BEAM-9638
             Project: Beam
          Issue Type: Bug
          Components: testing
            Reporter: Kyle Weaver
            Assignee: Kyle Weaver


This is hypothetical (I haven't seen this actually happen), but worker region & 
zone tests in the Python SDK could yield false positives because they only 
check that errors occurred. They do not check _which_ errors occurred. The 
pipeline options under test raise other expected errors: ['Missing required 
option: project.', 'Missing GCS path option: temp_location.', 'Missing GCS path 
option: staging_location.'] in addition to the error we're actually testing 
for. Therefore, if the code under test were to break, the tests would still 
pass.

https://github.com/apache/beam/blob/e2ff3967609df50ec55d18cc58fe8359ef4cacb8/sdks/python/apache_beam/options/pipeline_options_validator_test.py#L379



--
This message was sent by Atlassian Jira
(v8.3.4#803005)

Reply via email to