[
https://issues.apache.org/jira/browse/BEAM-5939?focusedWorklogId=163712&page=com.atlassian.jira.plugin.system.issuetabpanels:worklog-tabpanel#worklog-163712
]
ASF GitHub Bot logged work on BEAM-5939:
----------------------------------------
Author: ASF GitHub Bot
Created on: 07/Nov/18 22:46
Start Date: 07/Nov/18 22:46
Worklog Time Spent: 10m
Work Description: aaltay commented on issue #6976: [BEAM-5939] Dedupe
runner constants
URL: https://github.com/apache/beam/pull/6976#issuecomment-436805959
Jobs are failing with the following error:
```
Traceback (most recent call last):
File
"/usr/local/lib/python2.7/dist-packages/dataflow_worker/batchworker.py", line
766, in run
self._load_main_session(self.local_staging_directory)
File
"/usr/local/lib/python2.7/dist-packages/dataflow_worker/batchworker.py", line
480, in _load_main_session
session_file = os.path.join(session_path,
names.PICKLED_MAIN_SESSION_FILE)
AttributeError: 'module' object has no attribute 'PICKLED_MAIN_SESSION_FILE'
```
This is happening because Dataflow's python workers depend on the currently
existing names.py. A change there also needs to happen, and that code is not
open sourced yet.
I will suggest, keeping the contents of existing names.py as it is, and
making your other changes anyway. I can ask someone from Dataflow team to first
clean up the worker (to depend on the new code) then do the clean up here.
----------------------------------------------------------------
This is an automated message from the Apache Git Service.
To respond to the message, please log on GitHub and use the
URL above to go to the specific comment.
For queries about this service, please contact Infrastructure at:
[email protected]
Issue Time Tracking
-------------------
Worklog Id: (was: 163712)
Time Spent: 1h (was: 50m)
> Deduplicate constants
> ---------------------
>
> Key: BEAM-5939
> URL: https://issues.apache.org/jira/browse/BEAM-5939
> Project: Beam
> Issue Type: Bug
> Components: sdk-py-core
> Reporter: Ahmet Altay
> Priority: Minor
> Labels: starer
> Time Spent: 1h
> Remaining Estimate: 0h
>
> apache_beam/runners/dataflow/internal/names.py
> apache_beam/runners/portability/stager.py
> has same constants defined in both files.
--
This message was sent by Atlassian JIRA
(v7.6.3#76005)
