[
https://issues.apache.org/jira/browse/BEAM-8368?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16951366#comment-16951366
]
Wes McKinney commented on BEAM-8368:
------------------------------------
Thanks.
More generally, it would be helpful to know if you have guidance about best
practices for Python wheels that need to depend on the C++ protocol buffers.
Does bundling {{libprotobuf.so}} help (something we could do, though it does
create risk if there are ABI changes in libprotobuf and two wheels are built
against different ABIs)? We could also work together to make a "cpp_protobuf"
wheel that bundles a common shared library that different wheels can import to
make sure that everyone's pinning to the same protobuf version
Really, wheels are a bad platform for shipping complex C++ projects, as has
been discussed in many other places.
> [Python] libprotobuf-generated exception when importing apache_beam
> -------------------------------------------------------------------
>
> Key: BEAM-8368
> URL: https://issues.apache.org/jira/browse/BEAM-8368
> Project: Beam
> Issue Type: Bug
> Components: sdk-py-core
> Affects Versions: 2.15.0, 2.17.0
> Reporter: Ubaier Bhat
> Assignee: Ahmet Altay
> Priority: Blocker
> Fix For: 2.17.0
>
> Attachments: error_log.txt
>
> Time Spent: 1h 20m
> Remaining Estimate: 0h
>
> Unable to import apache_beam after upgrading to macos 10.15 (Catalina).
> Cleared all the pipenvs and but can't get it working again.
> {code}
> import apache_beam as beam
> /Users/***/.local/share/virtualenvs/beam-etl-ims6DitU/lib/python3.7/site-packages/apache_beam/__init__.py:84:
> UserWarning: Some syntactic constructs of Python 3 are not yet fully
> supported by Apache Beam.
> 'Some syntactic constructs of Python 3 are not yet fully supported by '
> [libprotobuf ERROR google/protobuf/descriptor_database.cc:58] File already
> exists in database:
> [libprotobuf FATAL google/protobuf/descriptor.cc:1370] CHECK failed:
> GeneratedDatabase()->Add(encoded_file_descriptor, size):
> libc++abi.dylib: terminating with uncaught exception of type
> google::protobuf::FatalException: CHECK failed:
> GeneratedDatabase()->Add(encoded_file_descriptor, size):
> {code}
--
This message was sent by Atlassian Jira
(v8.3.4#803005)
