See <https://builds.apache.org/job/beam_PostCommit_Python_Verify/1019/changes>
Changes: [robertwb] [BEAM-1188] Python File Verifer For E2E Tests [robertwb] [BEAM-1188] Use fileio.ChannelFactory instead of TextFileSource ------------------------------------------ [...truncated 1012 lines...] test_type_check_valid_simple_type (apache_beam.typehints.typehints_test.DictHintTestCase) ... ok test_type_checks_not_dict (apache_beam.typehints.typehints_test.DictHintTestCase) ... ok test_value_type_must_be_valid_composite_param (apache_beam.typehints.typehints_test.DictHintTestCase) ... ok test_compatibility (apache_beam.typehints.typehints_test.GeneratorHintTestCase) ... ok test_generator_argument_hint_invalid_yield_type (apache_beam.typehints.typehints_test.GeneratorHintTestCase) ... ok test_generator_return_hint_invalid_yield_type (apache_beam.typehints.typehints_test.GeneratorHintTestCase) ... ok test_repr (apache_beam.typehints.typehints_test.GeneratorHintTestCase) ... ok test_compatibility (apache_beam.typehints.typehints_test.IterableHintTestCase) ... ok test_getitem_invalid_composite_type_param (apache_beam.typehints.typehints_test.IterableHintTestCase) ... ok test_repr (apache_beam.typehints.typehints_test.IterableHintTestCase) ... ok test_tuple_compatibility (apache_beam.typehints.typehints_test.IterableHintTestCase) ... ok test_type_check_must_be_iterable (apache_beam.typehints.typehints_test.IterableHintTestCase) ... ok test_type_check_violation_invalid_composite_type (apache_beam.typehints.typehints_test.IterableHintTestCase) ... ok test_type_check_violation_invalid_simple_type (apache_beam.typehints.typehints_test.IterableHintTestCase) ... ok test_type_check_violation_valid_composite_type (apache_beam.typehints.typehints_test.IterableHintTestCase) ... ok test_type_check_violation_valid_simple_type (apache_beam.typehints.typehints_test.IterableHintTestCase) ... ok test_enforce_kv_type_constraint (apache_beam.typehints.typehints_test.KVHintTestCase) ... ok test_getitem_param_must_be_tuple (apache_beam.typehints.typehints_test.KVHintTestCase) ... ok test_getitem_param_must_have_length_2 (apache_beam.typehints.typehints_test.KVHintTestCase) ... ok test_getitem_proxy_to_tuple (apache_beam.typehints.typehints_test.KVHintTestCase) ... ok test_enforce_list_type_constraint_invalid_composite_type (apache_beam.typehints.typehints_test.ListHintTestCase) ... ok test_enforce_list_type_constraint_invalid_simple_type (apache_beam.typehints.typehints_test.ListHintTestCase) ... ok test_enforce_list_type_constraint_valid_composite_type (apache_beam.typehints.typehints_test.ListHintTestCase) ... ok test_enforce_list_type_constraint_valid_simple_type (apache_beam.typehints.typehints_test.ListHintTestCase) ... ok test_getitem_invalid_composite_type_param (apache_beam.typehints.typehints_test.ListHintTestCase) ... ok test_list_constraint_compatibility (apache_beam.typehints.typehints_test.ListHintTestCase) ... ok test_list_repr (apache_beam.typehints.typehints_test.ListHintTestCase) ... ok test_getitem_proxy_to_union (apache_beam.typehints.typehints_test.OptionalHintTestCase) ... ok test_getitem_sequence_not_allowed (apache_beam.typehints.typehints_test.OptionalHintTestCase) ... ok test_any_return_type_hint (apache_beam.typehints.typehints_test.ReturnsDecoratorTestCase) ... ok test_must_be_primitive_type_or_type_constraint (apache_beam.typehints.typehints_test.ReturnsDecoratorTestCase) ... ok test_must_be_single_return_type (apache_beam.typehints.typehints_test.ReturnsDecoratorTestCase) ... ok test_no_kwargs_accepted (apache_beam.typehints.typehints_test.ReturnsDecoratorTestCase) ... ok test_type_check_composite_type (apache_beam.typehints.typehints_test.ReturnsDecoratorTestCase) ... ok test_type_check_simple_type (apache_beam.typehints.typehints_test.ReturnsDecoratorTestCase) ... ok test_type_check_violation (apache_beam.typehints.typehints_test.ReturnsDecoratorTestCase) ... ok test_compatibility (apache_beam.typehints.typehints_test.SetHintTestCase) ... ok test_getitem_invalid_composite_type_param (apache_beam.typehints.typehints_test.SetHintTestCase) ... ok test_repr (apache_beam.typehints.typehints_test.SetHintTestCase) ... ok test_type_check_invalid_elem_type (apache_beam.typehints.typehints_test.SetHintTestCase) ... ok test_type_check_must_be_set (apache_beam.typehints.typehints_test.SetHintTestCase) ... ok test_type_check_valid_elem_composite_type (apache_beam.typehints.typehints_test.SetHintTestCase) ... ok test_type_check_valid_elem_simple_type (apache_beam.typehints.typehints_test.SetHintTestCase) ... ok test_any_argument_type_hint (apache_beam.typehints.typehints_test.TakesDecoratorTestCase) ... ok test_basic_type_assertion (apache_beam.typehints.typehints_test.TakesDecoratorTestCase) ... ok test_composite_type_assertion (apache_beam.typehints.typehints_test.TakesDecoratorTestCase) ... ok test_invalid_only_positional_arguments (apache_beam.typehints.typehints_test.TakesDecoratorTestCase) ... ok test_must_be_primitive_type_or_constraint (apache_beam.typehints.typehints_test.TakesDecoratorTestCase) ... ok test_valid_mix_positional_and_keyword_arguments (apache_beam.typehints.typehints_test.TakesDecoratorTestCase) ... ok test_valid_only_positional_arguments (apache_beam.typehints.typehints_test.TakesDecoratorTestCase) ... ok test_valid_simple_type_arguments (apache_beam.typehints.typehints_test.TakesDecoratorTestCase) ... ok test_functions_as_regular_generator (apache_beam.typehints.typehints_test.TestGeneratorWrapper) ... ok test_compatibility (apache_beam.typehints.typehints_test.TupleHintTestCase) ... ok test_compatibility_arbitrary_length (apache_beam.typehints.typehints_test.TupleHintTestCase) ... ok test_getitem_invalid_ellipsis_type_param (apache_beam.typehints.typehints_test.TupleHintTestCase) ... ok test_getitem_params_must_be_type_or_constraint (apache_beam.typehints.typehints_test.TupleHintTestCase) ... ok test_raw_tuple (apache_beam.typehints.typehints_test.TupleHintTestCase) ... ok test_repr (apache_beam.typehints.typehints_test.TupleHintTestCase) ... ok test_type_check_invalid_composite_type (apache_beam.typehints.typehints_test.TupleHintTestCase) ... ok test_type_check_invalid_composite_type_arbitrary_length (apache_beam.typehints.typehints_test.TupleHintTestCase) ... ok test_type_check_invalid_simple_type_arbitrary_length (apache_beam.typehints.typehints_test.TupleHintTestCase) ... ok test_type_check_invalid_simple_types (apache_beam.typehints.typehints_test.TupleHintTestCase) ... ok test_type_check_must_be_tuple (apache_beam.typehints.typehints_test.TupleHintTestCase) ... ok test_type_check_must_have_same_arity (apache_beam.typehints.typehints_test.TupleHintTestCase) ... ok test_type_check_valid_composite_type_arbitrary_length (apache_beam.typehints.typehints_test.TupleHintTestCase) ... ok test_type_check_valid_composite_types (apache_beam.typehints.typehints_test.TupleHintTestCase) ... ok test_type_check_valid_simple_type_arbitrary_length (apache_beam.typehints.typehints_test.TupleHintTestCase) ... ok test_type_check_valid_simple_types (apache_beam.typehints.typehints_test.TupleHintTestCase) ... ok test_getitem_duplicates_ignored (apache_beam.typehints.typehints_test.UnionHintTestCase) ... ok test_getitem_must_be_valid_type_param (apache_beam.typehints.typehints_test.UnionHintTestCase) ... ok test_getitem_must_be_valid_type_param_cant_be_object_instance (apache_beam.typehints.typehints_test.UnionHintTestCase) ... ok test_getitem_nested_unions_flattened (apache_beam.typehints.typehints_test.UnionHintTestCase) ... ok test_nested_compatibility (apache_beam.typehints.typehints_test.UnionHintTestCase) ... ok test_union_hint_compatibility (apache_beam.typehints.typehints_test.UnionHintTestCase) ... ok test_union_hint_enforcement_composite_type_in_union (apache_beam.typehints.typehints_test.UnionHintTestCase) ... ok test_union_hint_enforcement_not_part_of_union (apache_beam.typehints.typehints_test.UnionHintTestCase) ... ok test_union_hint_enforcement_part_of_union (apache_beam.typehints.typehints_test.UnionHintTestCase) ... ok test_union_hint_repr (apache_beam.typehints.typehints_test.UnionHintTestCase) ... ok test_deprecated_with_since_current (apache_beam.utils.annotations_test.AnnotationTests) ... ok test_deprecated_without_current (apache_beam.utils.annotations_test.AnnotationTests) ... ok test_deprecated_without_since_should_fail (apache_beam.utils.annotations_test.AnnotationTests) ... ok test_experimental_with_current (apache_beam.utils.annotations_test.AnnotationTests) ... ok test_experimental_without_current (apache_beam.utils.annotations_test.AnnotationTests) ... ok test_frequency (apache_beam.utils.annotations_test.AnnotationTests) Tests that the filter 'once' is sufficient to print once per ... ok test_default_resources (apache_beam.utils.dependency_test.SetupTest) ... ok test_no_main_session (apache_beam.utils.dependency_test.SetupTest) ... ok test_no_staging_location (apache_beam.utils.dependency_test.SetupTest) ... <https://builds.apache.org/job/beam_PostCommit_Python_Verify/ws/sdks/python/apache_beam/utils/dependency_test.py>:57: DeprecationWarning: BaseException.message has been deprecated as of Python 2.6 cm.exception.message) ok test_no_temp_location (apache_beam.utils.dependency_test.SetupTest) ... ok test_requirements_file_not_present (apache_beam.utils.dependency_test.SetupTest) ... ok test_sdk_location_default (apache_beam.utils.dependency_test.SetupTest) ... ok test_sdk_location_gcs (apache_beam.utils.dependency_test.SetupTest) ... ok test_sdk_location_local (apache_beam.utils.dependency_test.SetupTest) ... ok test_sdk_location_local_not_present (apache_beam.utils.dependency_test.SetupTest) ... ok test_setup_file_not_named_setup_dot_py (apache_beam.utils.dependency_test.SetupTest) ... ok test_setup_file_not_present (apache_beam.utils.dependency_test.SetupTest) ... ok test_with_extra_packages (apache_beam.utils.dependency_test.SetupTest) ... ok test_with_extra_packages_invalid_file_name (apache_beam.utils.dependency_test.SetupTest) ... ok test_with_extra_packages_missing_files (apache_beam.utils.dependency_test.SetupTest) ... ok test_with_main_session (apache_beam.utils.dependency_test.SetupTest) ... ok test_with_requirements_file (apache_beam.utils.dependency_test.SetupTest) ... ok test_with_requirements_file_and_cache (apache_beam.utils.dependency_test.SetupTest) ... ok test_with_setup_file (apache_beam.utils.dependency_test.SetupTest) ... ok test_gcs_path (apache_beam.utils.path_test.Path) ... ok test_unix_path (apache_beam.utils.path_test.Path) ... ok test_windows_path (apache_beam.utils.path_test.Path) ... ok test_dataflow_job_file (apache_beam.utils.pipeline_options_test.PipelineOptionsTest) ... ok test_display_data (apache_beam.utils.pipeline_options_test.PipelineOptionsTest) ... ok test_experiments (apache_beam.utils.pipeline_options_test.PipelineOptionsTest) ... ok test_extra_package (apache_beam.utils.pipeline_options_test.PipelineOptionsTest) ... ok test_from_dictionary (apache_beam.utils.pipeline_options_test.PipelineOptionsTest) ... ok test_get_all_options (apache_beam.utils.pipeline_options_test.PipelineOptionsTest) ... ok test_option_with_space (apache_beam.utils.pipeline_options_test.PipelineOptionsTest) ... ok test_override_options (apache_beam.utils.pipeline_options_test.PipelineOptionsTest) ... ok test_template_location (apache_beam.utils.pipeline_options_test.PipelineOptionsTest) ... ok test_dataflow_job_file_and_template_location_mutually_exclusive (apache_beam.utils.pipeline_options_validator_test.SetupTest) ... ok test_gcs_path (apache_beam.utils.pipeline_options_validator_test.SetupTest) ... ok test_is_service_runner (apache_beam.utils.pipeline_options_validator_test.SetupTest) ... ok test_job_name (apache_beam.utils.pipeline_options_validator_test.SetupTest) ... ok test_local_runner (apache_beam.utils.pipeline_options_validator_test.SetupTest) ... ok test_missing_required_options (apache_beam.utils.pipeline_options_validator_test.SetupTest) ... ok test_num_workers (apache_beam.utils.pipeline_options_validator_test.SetupTest) ... ok test_project (apache_beam.utils.pipeline_options_validator_test.SetupTest) ... ok test_test_matcher (apache_beam.utils.pipeline_options_validator_test.SetupTest) ... ok test_validate_dataflow_job_file (apache_beam.utils.pipeline_options_validator_test.SetupTest) ... ok test_validate_template_location (apache_beam.utils.pipeline_options_validator_test.SetupTest) ... ok test_method_forwarding_not_windows (apache_beam.utils.processes_test.Exec) ... ok test_method_forwarding_windows (apache_beam.utils.processes_test.Exec) ... ok test_call_two_objects (apache_beam.utils.retry_test.RetryStateTest) ... ok test_single_failure (apache_beam.utils.retry_test.RetryStateTest) ... ok test_two_failures (apache_beam.utils.retry_test.RetryStateTest) ... ok test_log_calls_for_permanent_failure (apache_beam.utils.retry_test.RetryTest) ... ok test_log_calls_for_transient_failure (apache_beam.utils.retry_test.RetryTest) ... ok test_with_default_number_of_retries (apache_beam.utils.retry_test.RetryTest) ... ok test_with_explicit_decorator (apache_beam.utils.retry_test.RetryTest) ... ok test_with_explicit_initial_delay (apache_beam.utils.retry_test.RetryTest) ... ok test_with_explicit_number_of_retries (apache_beam.utils.retry_test.RetryTest) ... ok test_with_http_error_that_should_be_retried (apache_beam.utils.retry_test.RetryTest) ... ok test_with_http_error_that_should_not_be_retried (apache_beam.utils.retry_test.RetryTest) ... ok test_with_no_retry_decorator (apache_beam.utils.retry_test.RetryTest) ... ok test_with_real_clock (apache_beam.utils.retry_test.RetryTest) ... ok test_arithmetic (apache_beam.utils.timestamp_test.DurationTest) ... ok test_of (apache_beam.utils.timestamp_test.DurationTest) ... ok test_precision (apache_beam.utils.timestamp_test.DurationTest) ... ok test_sort_order (apache_beam.utils.timestamp_test.DurationTest) ... ok test_str (apache_beam.utils.timestamp_test.DurationTest) ... ok test_arithmetic (apache_beam.utils.timestamp_test.TimestampTest) ... ok test_of (apache_beam.utils.timestamp_test.TimestampTest) ... ok test_precision (apache_beam.utils.timestamp_test.TimestampTest) ... ok test_sort_order (apache_beam.utils.timestamp_test.TimestampTest) ... ok test_str (apache_beam.utils.timestamp_test.TimestampTest) ... ok test_utc_timestamp (apache_beam.utils.timestamp_test.TimestampTest) ... ok test_equality (apache_beam.utils.windowed_value_test.WindowedValueTest) ... ok test_hash (apache_beam.utils.windowed_value_test.WindowedValueTest) ... ok test_pickle (apache_beam.utils.windowed_value_test.WindowedValueTest) ... ok test_timestamps (apache_beam.utils.windowed_value_test.WindowedValueTest) ... ok test_with_value (apache_beam.utils.windowed_value_test.WindowedValueTest) ... ok test_as_dict_with_unique_labels (apache_beam.dataflow_test.DataflowTest) ... ok test_as_list_and_as_dict_side_inputs (apache_beam.dataflow_test.DataflowTest) ... ok test_as_list_with_unique_labels (apache_beam.dataflow_test.DataflowTest) ... ok test_as_list_without_unique_labels (apache_beam.dataflow_test.DataflowTest) ... ok test_as_singleton_with_different_defaults_with_unique_labels (apache_beam.dataflow_test.DataflowTest) ... ok test_as_singleton_with_different_defaults_without_unique_labels (apache_beam.dataflow_test.DataflowTest) ... <https://builds.apache.org/job/beam_PostCommit_Python_Verify/ws/sdks/python/apache_beam/dataflow_test.py>:298: DeprecationWarning: BaseException.message has been deprecated as of Python 2.6 e.exception.message.startswith( ok test_as_singleton_without_unique_labels (apache_beam.dataflow_test.DataflowTest) ... ok test_default_value_singleton_side_input (apache_beam.dataflow_test.DataflowTest) ... ok test_empty_side_outputs (apache_beam.dataflow_test.DataflowTest) ... ok test_empty_singleton_side_input (apache_beam.dataflow_test.DataflowTest) ... ok test_iterable_side_input (apache_beam.dataflow_test.DataflowTest) ... ok test_map (apache_beam.dataflow_test.DataflowTest) ... ok test_multi_valued_singleton_side_input (apache_beam.dataflow_test.DataflowTest) ... ok test_par_do_with_do_fn_object (apache_beam.dataflow_test.DataflowTest) ... ok test_par_do_with_multiple_outputs_and_using_return (apache_beam.dataflow_test.DataflowTest) ... ok test_par_do_with_multiple_outputs_and_using_yield (apache_beam.dataflow_test.DataflowTest) ... ok test_par_do_with_side_input_as_arg (apache_beam.dataflow_test.DataflowTest) ... ok test_par_do_with_side_input_as_keyword_arg (apache_beam.dataflow_test.DataflowTest) ... ok test_undeclared_side_outputs (apache_beam.dataflow_test.DataflowTest) ... ok test_window_transform (apache_beam.dataflow_test.DataflowTest) ... ok test_word_count (apache_beam.dataflow_test.DataflowTest) ... ok test_attribute_setting (apache_beam.pipeline_test.PipelineOptionsTest) ... ok test_defaults (apache_beam.pipeline_test.PipelineOptionsTest) ... ok test_dir (apache_beam.pipeline_test.PipelineOptionsTest) ... ok test_flag_parsing (apache_beam.pipeline_test.PipelineOptionsTest) ... ok test_keyword_parsing (apache_beam.pipeline_test.PipelineOptionsTest) ... ok test_view_as (apache_beam.pipeline_test.PipelineOptionsTest) ... ok test_aggregator_empty_input (apache_beam.pipeline_test.PipelineTest) ... ok test_apply_custom_transform (apache_beam.pipeline_test.PipelineTest) ... ok test_create (apache_beam.pipeline_test.PipelineTest) ... ok test_create_singleton_pcollection (apache_beam.pipeline_test.PipelineTest) ... ok test_eager_pipeline (apache_beam.pipeline_test.PipelineTest) ... ok test_memory_usage (apache_beam.pipeline_test.PipelineTest) ... ok test_pipeline_as_context (apache_beam.pipeline_test.PipelineTest) ... ok test_read (apache_beam.pipeline_test.PipelineTest) ... ok test_reuse_cloned_custom_transform_instance (apache_beam.pipeline_test.PipelineTest) ... ok test_reuse_custom_transform_instance (apache_beam.pipeline_test.PipelineTest) ... <https://builds.apache.org/job/beam_PostCommit_Python_Verify/ws/sdks/python/apache_beam/pipeline_test.py>:154: DeprecationWarning: BaseException.message has been deprecated as of Python 2.6 cm.exception.message, ok test_transform_no_super_init (apache_beam.pipeline_test.PipelineTest) ... ok test_visit_entire_graph (apache_beam.pipeline_test.PipelineTest) ... ok test_pcollectionview_not_recreated (apache_beam.pvalue_test.PValueTest) ... ok test_pvalue_expected_arguments (apache_beam.pvalue_test.PValueTest) ... ok test_append_extra_options (apache_beam.test_pipeline_test.TestPipelineTest) ... FAIL test_append_verifier_in_extra_opt (apache_beam.test_pipeline_test.TestPipelineTest) ... ok test_create_test_pipeline_options (apache_beam.test_pipeline_test.TestPipelineTest) ... ok test_empty_option_args_parsing (apache_beam.test_pipeline_test.TestPipelineTest) ... ok test_get_option (apache_beam.test_pipeline_test.TestPipelineTest) ... ok test_option_args_parsing (apache_beam.test_pipeline_test.TestPipelineTest) ... ok test_skip_IT (apache_beam.test_pipeline_test.TestPipelineTest) ... SKIP: IT is skipped because --test-pipeline-options is not specified test_file_checksum_matcher_read_failed (apache_beam.tests.pipeline_verifiers_test.PipelineVerifiersTest) ... ok test_file_checksum_matcher_service_error (apache_beam.tests.pipeline_verifiers_test.PipelineVerifiersTest) ... ok test_file_checksum_matcher_success (apache_beam.tests.pipeline_verifiers_test.PipelineVerifiersTest) ... ok test_pipeline_state_matcher_fails (apache_beam.tests.pipeline_verifiers_test.PipelineVerifiersTest) Test PipelineStateMatcher fails when using default expected state ... ok test_pipeline_state_matcher_given_state (apache_beam.tests.pipeline_verifiers_test.PipelineVerifiersTest) Test PipelineStateMatcher successes when matches given state ... ok test_pipeline_state_matcher_success (apache_beam.tests.pipeline_verifiers_test.PipelineVerifiersTest) Test PipelineStateMatcher successes when using default expected state ... ok ====================================================================== FAIL: test_append_extra_options (apache_beam.test_pipeline_test.TestPipelineTest) ---------------------------------------------------------------------- Traceback (most recent call last): File "<https://builds.apache.org/job/beam_PostCommit_Python_Verify/ws/sdks/python/apache_beam/test_pipeline_test.py";,> line 87, in test_append_extra_options self.assertListEqual(opt_list, case['expected']) AssertionError: Lists differ: ['--student', '--name=Mark'] != ['--name=Mark', '--student'] First differing element 0: --student --name=Mark - ['--student', '--name=Mark'] + ['--name=Mark', '--student'] -------------------- >> begin captured logging << -------------------- root: INFO: Missing pipeline option (runner). Executing pipeline using the default runner: DirectRunner. --------------------- >> end captured logging << --------------------- ---------------------------------------------------------------------- Ran 1001 tests in 261.863s FAILED (failures=1, skipped=12) Test failed: <unittest.runner.TextTestResult run=1001 errors=0 failures=1> error: Test failed: <unittest.runner.TextTestResult run=1001 errors=0 failures=1> ERROR: InvocationError: '<https://builds.apache.org/job/beam_PostCommit_Python_Verify/ws/sdks/python/.tox/py27/bin/python> setup.py test' ___________________________________ summary ____________________________________ ERROR: py27: commands failed Build step 'Execute shell' marked build as failure
