[
https://issues.apache.org/jira/browse/BEAM-5624?focusedWorklogId=152813&page=com.atlassian.jira.plugin.system.issuetabpanels:worklog-tabpanel#worklog-152813
]
ASF GitHub Bot logged work on BEAM-5624:
----------------------------------------
Author: ASF GitHub Bot
Created on: 09/Oct/18 17:12
Start Date: 09/Oct/18 17:12
Worklog Time Spent: 10m
Work Description: aaltay commented on a change in pull request #6616:
[BEAM-5624] Fix avro.schema parser for py3
URL: https://github.com/apache/beam/pull/6616#discussion_r223788054
##########
File path: sdks/python/apache_beam/io/avroio_test.py
##########
@@ -25,10 +25,15 @@
from builtins import range
import avro.datafile
-import avro.schema
from avro.datafile import DataFileWriter
from avro.io import DatumWriter
import hamcrest as hc
+# pylint: disable=wrong-import-order, wrong-import-position, ungrouped-imports
+try:
+ from avro.schema import Parse
Review comment:
Could you add a comment here about, in what versions of avro which version
of parse is supported. (We can use this information to remove this block later
on.)
----------------------------------------------------------------
This is an automated message from the Apache Git Service.
To respond to the message, please log on GitHub and use the
URL above to go to the specific comment.
For queries about this service, please contact Infrastructure at:
[email protected]
Issue Time Tracking
-------------------
Worklog Id: (was: 152813)
Time Spent: 20m (was: 10m)
> Avro IO does not work with avro-python3 package out-of-the-box on Python 3,
> several tests fail with AttributeError (module 'avro.schema' has no attribute
> 'parse')
> -------------------------------------------------------------------------------------------------------------------------------------------------------------------
>
> Key: BEAM-5624
> URL: https://issues.apache.org/jira/browse/BEAM-5624
> Project: Beam
> Issue Type: Sub-task
> Components: sdk-py-core
> Reporter: Valentyn Tymofieiev
> Assignee: Simon
> Priority: Major
> Time Spent: 20m
> Remaining Estimate: 0h
>
> ======================================================================
> ERROR: Failure: AttributeError (module 'avro.schema' has no attribute 'parse')
> ----------------------------------------------------------------------
> Traceback (most recent call last):
> File
> "/usr/local/google/home/valentyn/projects/beam/clean_head/beam/sdks/python/target/.tox/py3/lib/python3.5/site-packages/nose/failure.py",
> line 39, in runTest
> raise self.exc_val.with_traceback(self.tb)
> File
> "/usr/local/google/home/valentyn/projects/beam/clean_head/beam/sdks/python/target/.tox/py3/lib/python3.5/site-packages/nose/loader.py",
> line 418, in loadTestsFromName
> addr.filename, addr.module)
> File
> "/usr/local/google/home/valentyn/projects/beam/clean_head/beam/sdks/python/target/.tox/py3/lib/python3.5/site-packages/nose/importer.py",
> line 47, in importFromPath
> return self.importFromDir(dir_path, fqname)
> File
> "/usr/local/google/home/valentyn/projects/beam/clean_head/beam/sdks/python/target/.tox/py3/lib/python3.5/site-packages/nose/importer.py",
> line 94, in importFromDir
> mod = load_module(part_fqname, fh, filename, desc)
> File
> "/usr/local/google/home/valentyn/projects/beam/clean_head/beam/sdks/python/target/.tox/py3/lib/python3.5/imp.py",
> line 234, in load_module
> return load_source(name, filename, file)
> File
> "/usr/local/google/home/valentyn/projects/beam/clean_head/beam/sdks/python/target/.tox/py3/lib/python3.5/imp.py",
> line 172, in load_source
> module = _load(spec)
> File "<frozen importlib._bootstrap>", line 693, in _load
> File "<frozen importlib._bootstrap>", line 673, in _load_unlocked
> File "<frozen importlib._bootstrap_external>", line 673, in exec_module
> File "<frozen importlib._bootstrap>", line 222, in _call_with_frames_removed
> File
> "/usr/local/google/home/valentyn/projects/beam/clean_head/beam/sdks/python/apache_beam/io/avroio_test.py",
> line 54, in <module>
> class TestAvro(unittest.TestCase):
> File
> "/usr/local/google/home/valentyn/projects/beam/clean_head/beam/sdks/python/apache_beam/io/avroio_test.py",
> line 89, in TestAvro
> SCHEMA = avro.schema.parse('''
> AttributeError: module 'avro.schema' has no attribute 'parse'
> Note that we use a different implementation of avro/avro-python3 package
> depending on Python version. We are also evaluating potential replacement of
> avro with fastavro.
--
This message was sent by Atlassian JIRA
(v7.6.3#76005)
