[
https://issues.apache.org/jira/browse/BEAM-12573?focusedWorklogId=620083&page=com.atlassian.jira.plugin.system.issuetabpanels:worklog-tabpanel#worklog-620083
]
ASF GitHub Bot logged work on BEAM-12573:
-----------------------------------------
Author: ASF GitHub Bot
Created on: 07/Jul/21 17:01
Start Date: 07/Jul/21 17:01
Worklog Time Spent: 10m
Work Description: aaltay commented on pull request #15125:
URL: https://github.com/apache/beam/pull/15125#issuecomment-875771605
(test issues are unrelated)
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: [email protected]
For queries about this service, please contact Infrastructure at:
[email protected]
Issue Time Tracking
-------------------
Worklog Id: (was: 620083)
Time Spent: 1h 10m (was: 1h)
> Bounded Source Reader DoFn PR #13154 causes some pipelines to fail with a
> PicklingError
> -----------------------------------------------------------------------------------------
>
> Key: BEAM-12573
> URL: https://issues.apache.org/jira/browse/BEAM-12573
> Project: Beam
> Issue Type: New Feature
> Components: io-py-common
> Reporter: Valentyn Tymofieiev
> Priority: P2
> Time Spent: 1h 10m
> Remaining Estimate: 0h
>
> As reported in [1], when trying to run the coders.py cookbook example [2], it
> raises an
> exception
> ```
> PicklingError : _pickle.PicklingError: Can't pickle <class
> '__main__.JsonCoder'>: it's not the same object as __main__.JsonCoder
> [while running 'read/Read/Map(<lambda at iobase.py:899>)']
> ```
> To reproduce the issue, run:
> ```
> python coders.py --input input.ndjson --output output.txt
> ```
> Where the input file (input.ndjson) has the same values as coders_test.py:
> ```
> {"host": ["Germany", 1], "guest": ["Italy", 0]}
> {"host": ["Germany", 1], "guest": ["Brasil", 3]}
> {"host": ["Brasil", 1], "guest": ["Italy", 0]}
> ```
> I have tracked the change in behavior to[3] with git bisect. This needs
> further investigation to understand the issue.
> [1]
> https://lists.apache.org/thread.html/r45340bbee91a6caf798fe62d24388f645f8792cc7506351fd66adec3%40%3Cdev.beam.apache.org%3E
> [2]
> https://github.com/apache/beam/blob/35bac6a62f1dc548ee908cfeff7f73ffcac38e6f/sdks/python/apache_beam/examples/cookbook/coders.py
> [3] https://github.com/apache/beam/pull/13154
--
This message was sent by Atlassian Jira
(v8.3.4#803005)
