[
https://issues.apache.org/jira/browse/BEAM-10529?focusedWorklogId=752582&page=com.atlassian.jira.plugin.system.issuetabpanels:worklog-tabpanel#worklog-752582
]
ASF GitHub Bot logged work on BEAM-10529:
-----------------------------------------
Author: ASF GitHub Bot
Created on: 05/Apr/22 00:42
Start Date: 05/Apr/22 00:42
Worklog Time Spent: 10m
Work Description: Abacn commented on PR #16923:
URL: https://github.com/apache/beam/pull/16923#issuecomment-1088155353
> Hi,
>
> I got an error on `./gradlew :sdks:python:wordCount` checking out latest
master:
>
> ```
> Traceback (most recent call last):
> File "/Users/<USER>/.pyenv/versions/3.8.7/lib/python3.8/runpy.py", line
185, in _run_module_as_main
> mod_name, mod_spec, code = _get_module_details(mod_name, _Error)
> File "/Users/<USER>/.pyenv/versions/3.8.7/lib/python3.8/runpy.py", line
111, in _get_module_details
> __import__(pkg_name)
> File "/Users/<USER>/beam/sdks/python/apache_beam/__init__.py", line 92,
in <module>
> from apache_beam import coders
> File "/Users/<USER>/beam/sdks/python/apache_beam/coders/__init__.py",
line 17, in <module>
> from apache_beam.coders.coders import *
> File "/Users/<USER>/beam/sdks/python/apache_beam/coders/coders.py", line
638, in <module>
> Coder.register_structured_urn(common_urns.coders.NULLABLE.urn,
NullableCoder)
> AttributeError: type object 'Enum' has no attribute 'NULLABLE'
>
> FAILURE: Build failed with an exception.
>
> * Where:
> Build file '/Users/<USER>/beam/sdks/python/build.gradle' line: 119
>
> * What went wrong:
> Execution failed for task ':sdks:python:wordCount'.
> > Process 'command 'sh'' finished with non-zero exit value 1
> ```
>
> Seems related to this change. Could anyone please have a look, thanks!
It turns out that this was a problem of my protobuf dependency, which causes
sdks/python/gen_protos.py not running to generate new versions of
RegularCoders.py. Force install protobuf with c++ implementation resolves this
problem.
Issue Time Tracking
-------------------
Worklog Id: (was: 752582)
Time Spent: 23h 50m (was: 23h 40m)
> Kafka XLang fails for ?empty? key/values
> ----------------------------------------
>
> Key: BEAM-10529
> URL: https://issues.apache.org/jira/browse/BEAM-10529
> Project: Beam
> Issue Type: Bug
> Components: cross-language, io-java-kafka
> Reporter: Luke Cwik
> Assignee: John Casey
> Priority: P1
> Time Spent: 23h 50m
> Remaining Estimate: 0h
>
> It looks like the Javadoc for ByteArrayDeserializer and StringDeserializer
> can return null[1, 2] and we aren't using
> NullableCoder.of(ByteArrayCoder.of()) in the expansion[3]. Note that KafkaIO
> does this correctly in its regular coder inference logic[4].
> 1:
> [https://kafka.apache.org/21/javadoc/org/apache/kafka/common/serialization/ByteArrayDeserializer.html#deserialize-java.lang.String-byte:A-|https://kafka.apache.org/21/javadoc/org/apache/kafka/common/serialization/ByteArrayDeserializer.html#deserialize-java.lang.String-byte:A-2:]
> [2:|https://kafka.apache.org/21/javadoc/org/apache/kafka/common/serialization/ByteArrayDeserializer.html#deserialize-java.lang.String-byte:A-2:]
>
> [https://kafka.apache.org/21/javadoc/org/apache/kafka/common/serialization/StringDeserializer.html#deserialize-java.lang.String-byte:A-]
> 3:
> [https://github.com/apache/beam/blob/af2d6b0379d64b522ecb769d88e9e7e7b8900208/sdks/java/io/kafka/src/main/java/org/apache/beam/sdk/io/kafka/KafkaIO.java#L478]
> 4:
> [https://github.com/apache/beam/blob/af2d6b0379d64b522ecb769d88e9e7e7b8900208/sdks/java/io/kafka/src/main/java/org/apache/beam/sdk/io/kafka/LocalDeserializerProvider.java#L85]
--
This message was sent by Atlassian Jira
(v8.20.1#820001)
