[
https://issues.apache.org/jira/browse/BEAM-9975?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17107727#comment-17107727
]
Brian Hulette commented on BEAM-9975:
-------------------------------------
Got an [error
log|https://builds.apache.org/job/beam_PreCommit_Python_Cron/2753/testReport/junit/apache_beam.runners.portability.portable_runner_test/PortableRunnerTest/test_read/]:
{code}
ERROR:root:Failed to parse dict {'beam:option:streaming:v1': False,
'beam:option:beam_services:v1': {}, 'beam:option:type_check_strictness:v1':
'DEFAULT_TO_ANY', 'beam:option:pipeline_type_check:v1': True,
'beam:option:runtime_type_check:v1': False,
'beam:option:direct_runner_use_stacked_bundle:v1': True,
'beam:option:direct_runner_bundle_repeat:v1': '0',
'beam:option:direct_num_workers:v1': '1', 'beam:option:direct_running_mode:v1':
'in_memory', 'beam:option:dataflow_endpoint:v1':
'https://dataflow.googleapis.com', 'beam:option:job_name:v1':
'test_read_1589482267.7994738', 'beam:option:no_auth:v1': False,
'beam:option:update:v1': False, 'beam:option:enable_streaming_engine:v1':
False, 'beam:option:hdfs_full_urls:v1': False, 'beam:option:experiments:v1':
['state_cache_size=100', 'data_buffer_time_limit_ms=1000', 'beam_fn_api'],
'beam:option:profile_cpu:v1': False, 'beam:option:profile_memory:v1': False,
'beam:option:profile_sample_rate:v1': 1.0, 'beam:option:save_main_session:v1':
False, 'beam:option:sdk_location:v1': 'container',
'beam:option:job_endpoint:v1': 'localhost:35763',
'beam:option:job_server_timeout:v1': '60', 'beam:option:environment_type:v1':
'beam:env:embedded_python:v1', 'beam:option:sdk_worker_parallelism:v1': '1',
'beam:option:environment_cache_millis:v1': '0', 'beam:option:job_port:v1': '0',
'beam:option:artifact_port:v1': '0', 'beam:option:expansion_port:v1': '0',
'beam:option:flink_master:v1': '[auto]', 'beam:option:flink_version:v1':
'1.10', 'beam:option:flink_submit_uber_jar:v1': False,
'beam:option:spark_master_url:v1': 'local[4]',
'beam:option:spark_submit_uber_jar:v1': False, 'beam:option:dry_run:v1': False,
'beam:option:style:v1': 'scrambled', 'beam:option:influx_hostname:v1':
'http://localhost:8086', 'beam:option:timeout_ms:v1': '0',
'beam:option:mock_flag:v1': False, 'beam:option:fake_flag:v1': False,
'beam:option:m_flag:v1': False, 'beam:option:male:v1': False,
'beam:option:redefined_flag:v1': False, 'beam:option:vpt_vp_arg13:v1':
<apache_beam.options.value_provider.RuntimeValueProvider object at
0x7f5f8bf73cf8>, 'beam:option:vpt_vp_arg14:v1':
<apache_beam.options.value_provider.RuntimeValueProvider object at
0x7f5f8bf73668>}
{code}
> PortableRunnerTest flake "ParseError: Unexpected type for Value message."
> -------------------------------------------------------------------------
>
> Key: BEAM-9975
> URL: https://issues.apache.org/jira/browse/BEAM-9975
> Project: Beam
> Issue Type: Bug
> Components: sdk-py-core
> Reporter: Brian Hulette
> Assignee: Brian Hulette
> Priority: Major
> Time Spent: 50m
> Remaining Estimate: 0h
>
> Error looks similar to the one in BEAM-9907. Example from
> https://builds.apache.org/job/beam_PreCommit_Python_Cron/2732
> {code}
> apache_beam/runners/portability/fn_api_runner/fn_runner_test.py:569:
> _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _
> _
> apache_beam/pipeline.py:550: in __exit__
> self.run().wait_until_finish()
> apache_beam/pipeline.py:529: in run
> return self.runner.run_pipeline(self, self._options)
> apache_beam/runners/portability/portable_runner.py:426: in run_pipeline
> job_service_handle.submit(proto_pipeline)
> apache_beam/runners/portability/portable_runner.py:107: in submit
> prepare_response = self.prepare(proto_pipeline)
> apache_beam/runners/portability/portable_runner.py:184: in prepare
> pipeline_options=self.get_pipeline_options()),
> apache_beam/runners/portability/portable_runner.py:174: in
> get_pipeline_options
> return job_utils.dict_to_struct(p_options)
> apache_beam/runners/job/utils.py:33: in dict_to_struct
> return json_format.ParseDict(dict_obj, struct_pb2.Struct())
> target/.tox-py36-cython/py36-cython/lib/python3.6/site-packages/google/protobuf/json_format.py:450:
> in ParseDict
> parser.ConvertMessage(js_dict, message)
> target/.tox-py36-cython/py36-cython/lib/python3.6/site-packages/google/protobuf/json_format.py:479:
> in ConvertMessage
> methodcaller(_WKTJSONMETHODS[full_name][1], value, message)(self)
> target/.tox-py36-cython/py36-cython/lib/python3.6/site-packages/google/protobuf/json_format.py:667:
> in _ConvertStructMessage
> self._ConvertValueMessage(value[key], message.fields[key])
> _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _
> _
> self = <google.protobuf.json_format._Parser object at 0x7f69eb5b59e8>
> value = <apache_beam.options.value_provider.RuntimeValueProvider object at
> 0x7f69eb7b3ac8>
> message =
> def _ConvertValueMessage(self, value, message):
> """Convert a JSON representation into Value message."""
> if isinstance(value, dict):
> self._ConvertStructMessage(value, message.struct_value)
> elif isinstance(value, list):
> self. _ConvertListValueMessage(value, message.list_value)
> elif value is None:
> message.null_value = 0
> elif isinstance(value, bool):
> message.bool_value = value
> elif isinstance(value, six.string_types):
> message.string_value = value
> elif isinstance(value, _INT_OR_FLOAT):
> message.number_value = value
> else:
> > raise ParseError('Unexpected type for Value message.')
> E google.protobuf.json_format.ParseError: Unexpected type for Value
> message.
> {code}
--
This message was sent by Atlassian Jira
(v8.3.4#803005)
