Parth Upadhyay created SPARK-43361:
--------------------------------------
Summary: Allow deserializing protobuf enum fields as integers
Key: SPARK-43361
URL: https://issues.apache.org/jira/browse/SPARK-43361
Project: Spark
Issue Type: Improvement
Components: Protobuf
Affects Versions: 3.4.0
Reporter: Parth Upadhyay
When deserializing protobuf enum fields, the spark-protobuf library will
deserialize them as string values based on the enum name in the proto. E.g.
{code:java}
message Person {
enum Job {
NOTHING = 0;
ENGINEER = 1;
DOCOTR = 2;
}
Job job = 1;
}{code}
And we have a message like
{code:java}
Job(ENGINEER){code}
Then the deserialized value will be:
{code:java}
{"job": "ENGINEER"}{code}
However it can be useful to deserialize the enum integer value rather than the
name (and this option exists in other major libraries). So, namely:
{code:java}
{"job": 1}{code}
Examples in other libraries:
* protobuf-java-util JsonFormat:
[https://javadoc.io/doc/com.google.protobuf/protobuf-java-util/3.10.0/com/google/protobuf/util/JsonFormat.Printer.html#printingEnumsAsInts--]
* golang/protobuf jsonpb marshaler
[https://pkg.go.dev/github.com/golang/protobuf/jsonpb#Marshaler]
I propose extending spark-protobuf to add this functionality.
--
This message was sent by Atlassian Jira
(v8.20.10#820010)
---------------------------------------------------------------------
To unsubscribe, e-mail: issues-unsubscr...@spark.apache.org
For additional commands, e-mail: issues-h...@spark.apache.org
