Emmanuel Brard created PARQUET-1880:
---------------------------------------
Summary: Convert JSON to Parquet directly
Key: PARQUET-1880
URL: https://issues.apache.org/jira/browse/PARQUET-1880
Project: Parquet
Issue Type: Wish
Components: parquet-mr
Reporter: Emmanuel Brard
In order to convert JSON payload to Parquet, the "established" way seems to be
to go first through a JSON to Avro conversion, provided the JSON payload is
covered by a JSON-Schema or part of a OpenAPI definition. The rest of the
process relies on the parquet-avro implementation.
Since JSON payload can be loaded to a generic JsonNode (jackson library) and
since a JSON payload can be described and checked against a JSON-Schema or an
OpenAPI definition, wouldn't it be theoretically possible to convert a JSON
payload to a Parquet "record" directly (somehow implementing a similar approach
than parquet-avro but this a JsonNode as a data holder)?
--
This message was sent by Atlassian Jira
(v8.3.4#803005)
