[
https://issues.apache.org/jira/browse/BEAM-1251?focusedWorklogId=120948&page=com.atlassian.jira.plugin.system.issuetabpanels:worklog-tabpanel#worklog-120948
]
ASF GitHub Bot logged work on BEAM-1251:
----------------------------------------
Author: ASF GitHub Bot
Created on: 09/Jul/18 18:17
Start Date: 09/Jul/18 18:17
Worklog Time Spent: 10m
Work Description: charlesccychen commented on issue #5887: [BEAM-1251]
Upgrade from buffer to memoryview (again)
URL: https://github.com/apache/beam/pull/5887#issuecomment-403572381
Root cause is the following. Looks like we need to add "python-snappy ==
0.5.3" into the setup.py file.
```
Encountered exception in PrefetchingSourceSetIterable reader thread:
Traceback (most recent call last):
File
"/usr/local/lib/python2.7/dist-packages/apache_beam/runners/worker/sideinputs.py",
line 137, in _reader_thread
for value in reader:
File
"/usr/local/lib/python2.7/dist-packages/dataflow_worker/nativefileio.py", line
198, in __iter__
for record in self.read_next_block():
File
"/usr/local/lib/python2.7/dist-packages/dataflow_worker/nativeavroio.py", line
94, in read_next_block
self._sync_marker)
File "/usr/local/lib/python2.7/dist-packages/apache_beam/io/avroio.py",
line 261, in read_block_from_file
return _AvroBlock(block_bytes, num_records, codec, schema, offset, size)
File "/usr/local/lib/python2.7/dist-packages/apache_beam/io/avroio.py",
line 313, in __init__
self._decompressed_block_bytes = self._decompress_bytes(block_bytes,
codec)
File "/usr/local/lib/python2.7/dist-packages/apache_beam/io/avroio.py",
line 345, in _decompress_bytes
result = snappy.decompress(memoryview(data)[:-4])
File "/usr/local/lib/python2.7/dist-packages/snappy.py", line 91, in
uncompress
return _uncompress(data)
TypeError: argument 1 must be string or read-only buffer, not memoryview
```
----------------------------------------------------------------
This is an automated message from the Apache Git Service.
To respond to the message, please log on GitHub and use the
URL above to go to the specific comment.
For queries about this service, please contact Infrastructure at:
[email protected]
Issue Time Tracking
-------------------
Worklog Id: (was: 120948)
Time Spent: 14h 20m (was: 14h 10m)
> Python 3 Support
> ----------------
>
> Key: BEAM-1251
> URL: https://issues.apache.org/jira/browse/BEAM-1251
> Project: Beam
> Issue Type: Improvement
> Components: sdk-py-core
> Reporter: Eyad Sibai
> Assignee: Robbe
> Priority: Trivial
> Time Spent: 14h 20m
> Remaining Estimate: 0h
>
> I have been trying to use google datalab with python3. As I see there are
> several packages that does not support python3 yet which google datalab
> depends on. This is one of them.
> https://github.com/GoogleCloudPlatform/DataflowPythonSDK/issues/6
--
This message was sent by Atlassian JIRA
(v7.6.3#76005)
