Looking at this problem now. Will send out a fix soon. On Thu, Jan 12, 2017 at 1:54 PM, Apache Jenkins Server < [email protected]> wrote:
> See <https://builds.apache.org/job/beam_PostCommit_Python_ > Verify/1019/changes> > > Changes: > > [robertwb] [BEAM-1188] Python File Verifer For E2E Tests > > [robertwb] [BEAM-1188] Use fileio.ChannelFactory instead of TextFileSource > > ------------------------------------------ > [...truncated 1012 lines...] > test_type_check_valid_simple_type > (apache_beam.typehints.typehints_test.DictHintTestCase) > ... ok > test_type_checks_not_dict > (apache_beam.typehints.typehints_test.DictHintTestCase) > ... ok > test_value_type_must_be_valid_composite_param (apache_beam.typehints. > typehints_test.DictHintTestCase) ... ok > test_compatibility > (apache_beam.typehints.typehints_test.GeneratorHintTestCase) > ... ok > test_generator_argument_hint_invalid_yield_type (apache_beam.typehints. > typehints_test.GeneratorHintTestCase) ... ok > test_generator_return_hint_invalid_yield_type (apache_beam.typehints. > typehints_test.GeneratorHintTestCase) ... ok > test_repr (apache_beam.typehints.typehints_test.GeneratorHintTestCase) > ... ok > test_compatibility (apache_beam.typehints.typehints_test.IterableHintTestCase) > ... ok > test_getitem_invalid_composite_type_param (apache_beam.typehints. > typehints_test.IterableHintTestCase) ... ok > test_repr (apache_beam.typehints.typehints_test.IterableHintTestCase) ... > ok > test_tuple_compatibility > (apache_beam.typehints.typehints_test.IterableHintTestCase) > ... ok > test_type_check_must_be_iterable > (apache_beam.typehints.typehints_test.IterableHintTestCase) > ... ok > test_type_check_violation_invalid_composite_type (apache_beam.typehints. > typehints_test.IterableHintTestCase) ... ok > test_type_check_violation_invalid_simple_type (apache_beam.typehints. > typehints_test.IterableHintTestCase) ... ok > test_type_check_violation_valid_composite_type (apache_beam.typehints. > typehints_test.IterableHintTestCase) ... ok > test_type_check_violation_valid_simple_type (apache_beam.typehints. > typehints_test.IterableHintTestCase) ... ok > test_enforce_kv_type_constraint > (apache_beam.typehints.typehints_test.KVHintTestCase) > ... ok > test_getitem_param_must_be_tuple > (apache_beam.typehints.typehints_test.KVHintTestCase) > ... ok > test_getitem_param_must_have_length_2 > (apache_beam.typehints.typehints_test.KVHintTestCase) > ... ok > test_getitem_proxy_to_tuple > (apache_beam.typehints.typehints_test.KVHintTestCase) > ... ok > test_enforce_list_type_constraint_invalid_composite_type > (apache_beam.typehints.typehints_test.ListHintTestCase) ... ok > test_enforce_list_type_constraint_invalid_simple_type > (apache_beam.typehints.typehints_test.ListHintTestCase) ... ok > test_enforce_list_type_constraint_valid_composite_type > (apache_beam.typehints.typehints_test.ListHintTestCase) ... ok > test_enforce_list_type_constraint_valid_simple_type > (apache_beam.typehints.typehints_test.ListHintTestCase) ... ok > test_getitem_invalid_composite_type_param (apache_beam.typehints. > typehints_test.ListHintTestCase) ... ok > test_list_constraint_compatibility > (apache_beam.typehints.typehints_test.ListHintTestCase) > ... ok > test_list_repr (apache_beam.typehints.typehints_test.ListHintTestCase) > ... ok > test_getitem_proxy_to_union > (apache_beam.typehints.typehints_test.OptionalHintTestCase) > ... ok > test_getitem_sequence_not_allowed > (apache_beam.typehints.typehints_test.OptionalHintTestCase) > ... ok > test_any_return_type_hint > (apache_beam.typehints.typehints_test.ReturnsDecoratorTestCase) > ... ok > test_must_be_primitive_type_or_type_constraint (apache_beam.typehints. > typehints_test.ReturnsDecoratorTestCase) ... ok > test_must_be_single_return_type > (apache_beam.typehints.typehints_test.ReturnsDecoratorTestCase) > ... ok > test_no_kwargs_accepted > (apache_beam.typehints.typehints_test.ReturnsDecoratorTestCase) > ... ok > test_type_check_composite_type > (apache_beam.typehints.typehints_test.ReturnsDecoratorTestCase) > ... ok > test_type_check_simple_type > (apache_beam.typehints.typehints_test.ReturnsDecoratorTestCase) > ... ok > test_type_check_violation > (apache_beam.typehints.typehints_test.ReturnsDecoratorTestCase) > ... ok > test_compatibility (apache_beam.typehints.typehints_test.SetHintTestCase) > ... ok > test_getitem_invalid_composite_type_param (apache_beam.typehints. > typehints_test.SetHintTestCase) ... ok > test_repr (apache_beam.typehints.typehints_test.SetHintTestCase) ... ok > test_type_check_invalid_elem_type > (apache_beam.typehints.typehints_test.SetHintTestCase) > ... ok > test_type_check_must_be_set > (apache_beam.typehints.typehints_test.SetHintTestCase) > ... ok > test_type_check_valid_elem_composite_type (apache_beam.typehints. > typehints_test.SetHintTestCase) ... ok > test_type_check_valid_elem_simple_type (apache_beam.typehints. > typehints_test.SetHintTestCase) ... ok > test_any_argument_type_hint > (apache_beam.typehints.typehints_test.TakesDecoratorTestCase) > ... ok > test_basic_type_assertion > (apache_beam.typehints.typehints_test.TakesDecoratorTestCase) > ... ok > test_composite_type_assertion > (apache_beam.typehints.typehints_test.TakesDecoratorTestCase) > ... ok > test_invalid_only_positional_arguments (apache_beam.typehints. > typehints_test.TakesDecoratorTestCase) ... ok > test_must_be_primitive_type_or_constraint (apache_beam.typehints. > typehints_test.TakesDecoratorTestCase) ... ok > test_valid_mix_positional_and_keyword_arguments (apache_beam.typehints. > typehints_test.TakesDecoratorTestCase) ... ok > test_valid_only_positional_arguments (apache_beam.typehints. > typehints_test.TakesDecoratorTestCase) ... ok > test_valid_simple_type_arguments > (apache_beam.typehints.typehints_test.TakesDecoratorTestCase) > ... ok > test_functions_as_regular_generator > (apache_beam.typehints.typehints_test.TestGeneratorWrapper) > ... ok > test_compatibility (apache_beam.typehints.typehints_test.TupleHintTestCase) > ... ok > test_compatibility_arbitrary_length > (apache_beam.typehints.typehints_test.TupleHintTestCase) > ... ok > test_getitem_invalid_ellipsis_type_param (apache_beam.typehints. > typehints_test.TupleHintTestCase) ... ok > test_getitem_params_must_be_type_or_constraint (apache_beam.typehints. > typehints_test.TupleHintTestCase) ... ok > test_raw_tuple (apache_beam.typehints.typehints_test.TupleHintTestCase) > ... ok > test_repr (apache_beam.typehints.typehints_test.TupleHintTestCase) ... ok > test_type_check_invalid_composite_type (apache_beam.typehints. > typehints_test.TupleHintTestCase) ... ok > test_type_check_invalid_composite_type_arbitrary_length > (apache_beam.typehints.typehints_test.TupleHintTestCase) ... ok > test_type_check_invalid_simple_type_arbitrary_length > (apache_beam.typehints.typehints_test.TupleHintTestCase) ... ok > test_type_check_invalid_simple_types (apache_beam.typehints. > typehints_test.TupleHintTestCase) ... ok > test_type_check_must_be_tuple > (apache_beam.typehints.typehints_test.TupleHintTestCase) > ... ok > test_type_check_must_have_same_arity (apache_beam.typehints. > typehints_test.TupleHintTestCase) ... ok > test_type_check_valid_composite_type_arbitrary_length > (apache_beam.typehints.typehints_test.TupleHintTestCase) ... ok > test_type_check_valid_composite_types (apache_beam.typehints. > typehints_test.TupleHintTestCase) ... ok > test_type_check_valid_simple_type_arbitrary_length (apache_beam.typehints. > typehints_test.TupleHintTestCase) ... ok > test_type_check_valid_simple_types > (apache_beam.typehints.typehints_test.TupleHintTestCase) > ... ok > test_getitem_duplicates_ignored > (apache_beam.typehints.typehints_test.UnionHintTestCase) > ... ok > test_getitem_must_be_valid_type_param (apache_beam.typehints. > typehints_test.UnionHintTestCase) ... ok > test_getitem_must_be_valid_type_param_cant_be_object_instance > (apache_beam.typehints.typehints_test.UnionHintTestCase) ... ok > test_getitem_nested_unions_flattened (apache_beam.typehints. > typehints_test.UnionHintTestCase) ... ok > test_nested_compatibility > (apache_beam.typehints.typehints_test.UnionHintTestCase) > ... ok > test_union_hint_compatibility > (apache_beam.typehints.typehints_test.UnionHintTestCase) > ... ok > test_union_hint_enforcement_composite_type_in_union > (apache_beam.typehints.typehints_test.UnionHintTestCase) ... ok > test_union_hint_enforcement_not_part_of_union (apache_beam.typehints. > typehints_test.UnionHintTestCase) ... ok > test_union_hint_enforcement_part_of_union (apache_beam.typehints. > typehints_test.UnionHintTestCase) ... ok > test_union_hint_repr (apache_beam.typehints.typehints_test.UnionHintTestCase) > ... ok > test_deprecated_with_since_current > (apache_beam.utils.annotations_test.AnnotationTests) > ... ok > test_deprecated_without_current > (apache_beam.utils.annotations_test.AnnotationTests) > ... ok > test_deprecated_without_since_should_fail (apache_beam.utils. > annotations_test.AnnotationTests) ... ok > test_experimental_with_current > (apache_beam.utils.annotations_test.AnnotationTests) > ... ok > test_experimental_without_current > (apache_beam.utils.annotations_test.AnnotationTests) > ... ok > test_frequency (apache_beam.utils.annotations_test.AnnotationTests) > Tests that the filter 'once' is sufficient to print once per ... ok > test_default_resources (apache_beam.utils.dependency_test.SetupTest) ... > ok > test_no_main_session (apache_beam.utils.dependency_test.SetupTest) ... ok > test_no_staging_location (apache_beam.utils.dependency_test.SetupTest) > ... <https://builds.apache.org/job/beam_PostCommit_Python_ > Verify/ws/sdks/python/apache_beam/utils/dependency_test.py>:57: > DeprecationWarning: BaseException.message has been deprecated as of Python > 2.6 > cm.exception.message) > ok > test_no_temp_location (apache_beam.utils.dependency_test.SetupTest) ... ok > test_requirements_file_not_present > (apache_beam.utils.dependency_test.SetupTest) > ... ok > test_sdk_location_default (apache_beam.utils.dependency_test.SetupTest) > ... ok > test_sdk_location_gcs (apache_beam.utils.dependency_test.SetupTest) ... ok > test_sdk_location_local (apache_beam.utils.dependency_test.SetupTest) ... > ok > test_sdk_location_local_not_present > (apache_beam.utils.dependency_test.SetupTest) > ... ok > test_setup_file_not_named_setup_dot_py > (apache_beam.utils.dependency_test.SetupTest) > ... ok > test_setup_file_not_present (apache_beam.utils.dependency_test.SetupTest) > ... ok > test_with_extra_packages (apache_beam.utils.dependency_test.SetupTest) > ... ok > test_with_extra_packages_invalid_file_name > (apache_beam.utils.dependency_test.SetupTest) > ... ok > test_with_extra_packages_missing_files > (apache_beam.utils.dependency_test.SetupTest) > ... ok > test_with_main_session (apache_beam.utils.dependency_test.SetupTest) ... > ok > test_with_requirements_file (apache_beam.utils.dependency_test.SetupTest) > ... ok > test_with_requirements_file_and_cache > (apache_beam.utils.dependency_test.SetupTest) > ... ok > test_with_setup_file (apache_beam.utils.dependency_test.SetupTest) ... ok > test_gcs_path (apache_beam.utils.path_test.Path) ... ok > test_unix_path (apache_beam.utils.path_test.Path) ... ok > test_windows_path (apache_beam.utils.path_test.Path) ... ok > test_dataflow_job_file > (apache_beam.utils.pipeline_options_test.PipelineOptionsTest) > ... ok > test_display_data > (apache_beam.utils.pipeline_options_test.PipelineOptionsTest) > ... ok > test_experiments (apache_beam.utils.pipeline_options_test.PipelineOptionsTest) > ... ok > test_extra_package > (apache_beam.utils.pipeline_options_test.PipelineOptionsTest) > ... ok > test_from_dictionary > (apache_beam.utils.pipeline_options_test.PipelineOptionsTest) > ... ok > test_get_all_options > (apache_beam.utils.pipeline_options_test.PipelineOptionsTest) > ... ok > test_option_with_space > (apache_beam.utils.pipeline_options_test.PipelineOptionsTest) > ... ok > test_override_options > (apache_beam.utils.pipeline_options_test.PipelineOptionsTest) > ... ok > test_template_location > (apache_beam.utils.pipeline_options_test.PipelineOptionsTest) > ... ok > test_dataflow_job_file_and_template_location_mutually_exclusive > (apache_beam.utils.pipeline_options_validator_test.SetupTest) ... ok > test_gcs_path (apache_beam.utils.pipeline_options_validator_test.SetupTest) > ... ok > test_is_service_runner > (apache_beam.utils.pipeline_options_validator_test.SetupTest) > ... ok > test_job_name (apache_beam.utils.pipeline_options_validator_test.SetupTest) > ... ok > test_local_runner > (apache_beam.utils.pipeline_options_validator_test.SetupTest) > ... ok > test_missing_required_options (apache_beam.utils.pipeline_ > options_validator_test.SetupTest) ... ok > test_num_workers (apache_beam.utils.pipeline_options_validator_test.SetupTest) > ... ok > test_project (apache_beam.utils.pipeline_options_validator_test.SetupTest) > ... ok > test_test_matcher > (apache_beam.utils.pipeline_options_validator_test.SetupTest) > ... ok > test_validate_dataflow_job_file (apache_beam.utils.pipeline_ > options_validator_test.SetupTest) ... ok > test_validate_template_location (apache_beam.utils.pipeline_ > options_validator_test.SetupTest) ... ok > test_method_forwarding_not_windows (apache_beam.utils.processes_test.Exec) > ... ok > test_method_forwarding_windows (apache_beam.utils.processes_test.Exec) > ... ok > test_call_two_objects (apache_beam.utils.retry_test.RetryStateTest) ... ok > test_single_failure (apache_beam.utils.retry_test.RetryStateTest) ... ok > test_two_failures (apache_beam.utils.retry_test.RetryStateTest) ... ok > test_log_calls_for_permanent_failure (apache_beam.utils.retry_test.RetryTest) > ... ok > test_log_calls_for_transient_failure (apache_beam.utils.retry_test.RetryTest) > ... ok > test_with_default_number_of_retries (apache_beam.utils.retry_test.RetryTest) > ... ok > test_with_explicit_decorator (apache_beam.utils.retry_test.RetryTest) ... > ok > test_with_explicit_initial_delay (apache_beam.utils.retry_test.RetryTest) > ... ok > test_with_explicit_number_of_retries (apache_beam.utils.retry_test.RetryTest) > ... ok > test_with_http_error_that_should_be_retried > (apache_beam.utils.retry_test.RetryTest) > ... ok > test_with_http_error_that_should_not_be_retried > (apache_beam.utils.retry_test.RetryTest) ... ok > test_with_no_retry_decorator (apache_beam.utils.retry_test.RetryTest) ... > ok > test_with_real_clock (apache_beam.utils.retry_test.RetryTest) ... ok > test_arithmetic (apache_beam.utils.timestamp_test.DurationTest) ... ok > test_of (apache_beam.utils.timestamp_test.DurationTest) ... ok > test_precision (apache_beam.utils.timestamp_test.DurationTest) ... ok > test_sort_order (apache_beam.utils.timestamp_test.DurationTest) ... ok > test_str (apache_beam.utils.timestamp_test.DurationTest) ... ok > test_arithmetic (apache_beam.utils.timestamp_test.TimestampTest) ... ok > test_of (apache_beam.utils.timestamp_test.TimestampTest) ... ok > test_precision (apache_beam.utils.timestamp_test.TimestampTest) ... ok > test_sort_order (apache_beam.utils.timestamp_test.TimestampTest) ... ok > test_str (apache_beam.utils.timestamp_test.TimestampTest) ... ok > test_utc_timestamp (apache_beam.utils.timestamp_test.TimestampTest) ... ok > test_equality (apache_beam.utils.windowed_value_test.WindowedValueTest) > ... ok > test_hash (apache_beam.utils.windowed_value_test.WindowedValueTest) ... ok > test_pickle (apache_beam.utils.windowed_value_test.WindowedValueTest) ... > ok > test_timestamps (apache_beam.utils.windowed_value_test.WindowedValueTest) > ... ok > test_with_value (apache_beam.utils.windowed_value_test.WindowedValueTest) > ... ok > test_as_dict_with_unique_labels (apache_beam.dataflow_test.DataflowTest) > ... ok > test_as_list_and_as_dict_side_inputs (apache_beam.dataflow_test.DataflowTest) > ... ok > test_as_list_with_unique_labels (apache_beam.dataflow_test.DataflowTest) > ... ok > test_as_list_without_unique_labels (apache_beam.dataflow_test.DataflowTest) > ... ok > test_as_singleton_with_different_defaults_with_unique_labels > (apache_beam.dataflow_test.DataflowTest) ... ok > test_as_singleton_with_different_defaults_without_unique_labels > (apache_beam.dataflow_test.DataflowTest) ... <https://builds.apache.org/ > job/beam_PostCommit_Python_Verify/ws/sdks/python/apache_ > beam/dataflow_test.py>:298: DeprecationWarning: BaseException.message has > been deprecated as of Python 2.6 > e.exception.message.startswith( > ok > test_as_singleton_without_unique_labels > (apache_beam.dataflow_test.DataflowTest) > ... ok > test_default_value_singleton_side_input > (apache_beam.dataflow_test.DataflowTest) > ... ok > test_empty_side_outputs (apache_beam.dataflow_test.DataflowTest) ... ok > test_empty_singleton_side_input (apache_beam.dataflow_test.DataflowTest) > ... ok > test_iterable_side_input (apache_beam.dataflow_test.DataflowTest) ... ok > test_map (apache_beam.dataflow_test.DataflowTest) ... ok > test_multi_valued_singleton_side_input > (apache_beam.dataflow_test.DataflowTest) > ... ok > test_par_do_with_do_fn_object (apache_beam.dataflow_test.DataflowTest) > ... ok > test_par_do_with_multiple_outputs_and_using_return > (apache_beam.dataflow_test.DataflowTest) ... ok > test_par_do_with_multiple_outputs_and_using_yield > (apache_beam.dataflow_test.DataflowTest) ... ok > test_par_do_with_side_input_as_arg (apache_beam.dataflow_test.DataflowTest) > ... ok > test_par_do_with_side_input_as_keyword_arg > (apache_beam.dataflow_test.DataflowTest) > ... ok > test_undeclared_side_outputs (apache_beam.dataflow_test.DataflowTest) ... > ok > test_window_transform (apache_beam.dataflow_test.DataflowTest) ... ok > test_word_count (apache_beam.dataflow_test.DataflowTest) ... ok > test_attribute_setting (apache_beam.pipeline_test.PipelineOptionsTest) > ... ok > test_defaults (apache_beam.pipeline_test.PipelineOptionsTest) ... ok > test_dir (apache_beam.pipeline_test.PipelineOptionsTest) ... ok > test_flag_parsing (apache_beam.pipeline_test.PipelineOptionsTest) ... ok > test_keyword_parsing (apache_beam.pipeline_test.PipelineOptionsTest) ... > ok > test_view_as (apache_beam.pipeline_test.PipelineOptionsTest) ... ok > test_aggregator_empty_input (apache_beam.pipeline_test.PipelineTest) ... > ok > test_apply_custom_transform (apache_beam.pipeline_test.PipelineTest) ... > ok > test_create (apache_beam.pipeline_test.PipelineTest) ... ok > test_create_singleton_pcollection (apache_beam.pipeline_test.PipelineTest) > ... ok > test_eager_pipeline (apache_beam.pipeline_test.PipelineTest) ... ok > test_memory_usage (apache_beam.pipeline_test.PipelineTest) ... ok > test_pipeline_as_context (apache_beam.pipeline_test.PipelineTest) ... ok > test_read (apache_beam.pipeline_test.PipelineTest) ... ok > test_reuse_cloned_custom_transform_instance > (apache_beam.pipeline_test.PipelineTest) > ... ok > test_reuse_custom_transform_instance (apache_beam.pipeline_test.PipelineTest) > ... <https://builds.apache.org/job/beam_PostCommit_Python_ > Verify/ws/sdks/python/apache_beam/pipeline_test.py>:154: > DeprecationWarning: BaseException.message has been deprecated as of Python > 2.6 > cm.exception.message, > ok > test_transform_no_super_init (apache_beam.pipeline_test.PipelineTest) ... > ok > test_visit_entire_graph (apache_beam.pipeline_test.PipelineTest) ... ok > test_pcollectionview_not_recreated (apache_beam.pvalue_test.PValueTest) > ... ok > test_pvalue_expected_arguments (apache_beam.pvalue_test.PValueTest) ... ok > test_append_extra_options (apache_beam.test_pipeline_test.TestPipelineTest) > ... FAIL > test_append_verifier_in_extra_opt > (apache_beam.test_pipeline_test.TestPipelineTest) > ... ok > test_create_test_pipeline_options > (apache_beam.test_pipeline_test.TestPipelineTest) > ... ok > test_empty_option_args_parsing > (apache_beam.test_pipeline_test.TestPipelineTest) > ... ok > test_get_option (apache_beam.test_pipeline_test.TestPipelineTest) ... ok > test_option_args_parsing (apache_beam.test_pipeline_test.TestPipelineTest) > ... ok > test_skip_IT (apache_beam.test_pipeline_test.TestPipelineTest) ... SKIP: > IT is skipped because --test-pipeline-options is not specified > test_file_checksum_matcher_read_failed (apache_beam.tests.pipeline_ > verifiers_test.PipelineVerifiersTest) ... ok > test_file_checksum_matcher_service_error (apache_beam.tests.pipeline_ > verifiers_test.PipelineVerifiersTest) ... ok > test_file_checksum_matcher_success (apache_beam.tests.pipeline_ > verifiers_test.PipelineVerifiersTest) ... ok > test_pipeline_state_matcher_fails (apache_beam.tests.pipeline_ > verifiers_test.PipelineVerifiersTest) > Test PipelineStateMatcher fails when using default expected state ... ok > test_pipeline_state_matcher_given_state (apache_beam.tests.pipeline_ > verifiers_test.PipelineVerifiersTest) > Test PipelineStateMatcher successes when matches given state ... ok > test_pipeline_state_matcher_success (apache_beam.tests.pipeline_ > verifiers_test.PipelineVerifiersTest) > Test PipelineStateMatcher successes when using default expected state ... > ok > > ====================================================================== > FAIL: test_append_extra_options (apache_beam.test_pipeline_ > test.TestPipelineTest) > ---------------------------------------------------------------------- > Traceback (most recent call last): > File "<https://builds.apache.org/job/beam_PostCommit_Python_ > Verify/ws/sdks/python/apache_beam/test_pipeline_test.py",> line 87, in > test_append_extra_options > self.assertListEqual(opt_list, case['expected']) > AssertionError: Lists differ: ['--student', '--name=Mark'] != > ['--name=Mark', '--student'] > > First differing element 0: > --student > --name=Mark > > - ['--student', '--name=Mark'] > + ['--name=Mark', '--student'] > -------------------- >> begin captured logging << -------------------- > root: INFO: Missing pipeline option (runner). Executing pipeline using the > default runner: DirectRunner. > --------------------- >> end captured logging << --------------------- > > ---------------------------------------------------------------------- > Ran 1001 tests in 261.863s > > FAILED (failures=1, skipped=12) > Test failed: <unittest.runner.TextTestResult run=1001 errors=0 failures=1> > error: Test failed: <unittest.runner.TextTestResult run=1001 errors=0 > failures=1> > ERROR: InvocationError: '<https://builds.apache.org/ > job/beam_PostCommit_Python_Verify/ws/sdks/python/.tox/py27/bin/python> > setup.py test' > ___________________________________ summary ______________________________ > ______ > ERROR: py27: commands failed > Build step 'Execute shell' marked build as failure >
