[
https://issues.apache.org/jira/browse/BEAM-1731?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Ahmet Altay resolved BEAM-1731.
-------------------------------
Resolution: Fixed
Fix Version/s: Not applicable
commit was rolled back.
> RuntimeError when running wordcount with ValueProviders
> -------------------------------------------------------
>
> Key: BEAM-1731
> URL: https://issues.apache.org/jira/browse/BEAM-1731
> Project: Beam
> Issue Type: Bug
> Components: sdk-py
> Reporter: Sourabh Bajaj
> Assignee: MarĂa GH
> Fix For: Not applicable
>
>
> Running: python -m apache_beam.examples.wordcount
> INFO:root:Job 2017-03-15_13_39_59-3092873759767386 is in state
> JOB_STATE_FAILED
> Traceback (most recent call last):
> File
> "/System/Library/Frameworks/Python.framework/Versions/2.7/lib/python2.7/runpy.py",
> line 162, in _run_module_as_main
> "__main__", fname, loader, pkg_name)
> File
> "/System/Library/Frameworks/Python.framework/Versions/2.7/lib/python2.7/runpy.py",
> line 72, in _run_code
> exec code in run_globals
> File
> "/Users/sourabhbajaj/Projects/incubator-beam/sdks/python/apache_beam/examples/wordcount.py",
> line 119, in <module>
> run()
> File
> "/Users/sourabhbajaj/Projects/incubator-beam/sdks/python/apache_beam/examples/wordcount.py",
> line 109, in run
> result.wait_until_finish()
> File "apache_beam/runners/dataflow/dataflow_runner.py", line 711, in
> wait_until_finish
> (self.state, getattr(self._runner, 'last_error_msg', None)), self)
> apache_beam.runners.dataflow.dataflow_runner.DataflowRuntimeException:
> Dataflow pipeline failed. State: FAILED, Error:
> (e22fabbb61bfae00): Traceback (most recent call last):
> File
> "/usr/local/lib/python2.7/dist-packages/dataflow_worker/batchworker.py", line
> 544, in do_work
> work_executor.execute()
> File "dataflow_worker/executor.py", line 1013, in
> dataflow_worker.executor.CustomSourceSplitExecutor.execute
> (dataflow_worker/executor.c:31501)
> self.response = self._perform_source_split_considering_api_limits(
> File "dataflow_worker/executor.py", line 1021, in
> dataflow_worker.executor.CustomSourceSplitExecutor._perform_source_split_considering_api_limits
> (dataflow_worker/executor.c:31703)
> split_response = self._perform_source_split(source_operation_split_task,
> File "dataflow_worker/executor.py", line 1059, in
> dataflow_worker.executor.CustomSourceSplitExecutor._perform_source_split
> (dataflow_worker/executor.c:32341)
> for split in source.split(desired_bundle_size):
> File
> "/usr/local/lib/python2.7/dist-packages/apache_beam/io/filebasedsource.py",
> line 192, in split
> return self._get_concat_source().split(
> File
> "/usr/local/lib/python2.7/dist-packages/apache_beam/utils/value_provider.py",
> line 105, in _f
> raise RuntimeError('%s not accessible' % obj)
> RuntimeError: RuntimeValueProvider(option: input, type: str, default_value:
> 'gs://dataflow-samples/shakespeare/kinglear.txt') not accessible
--
This message was sent by Atlassian JIRA
(v6.3.15#6346)