[
https://issues.apache.org/jira/browse/PARQUET-1880?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17146369#comment-17146369
]
Emmanuel Brard commented on PARQUET-1880:
-----------------------------------------
FYI, I am working on an implementation with Jackson JsonNode as the data
support and an OpenAPI schema definition to carry the schema information.
> Convert JSON to Parquet directly
> --------------------------------
>
> Key: PARQUET-1880
> URL: https://issues.apache.org/jira/browse/PARQUET-1880
> Project: Parquet
> Issue Type: Wish
> Components: parquet-mr
> Reporter: Emmanuel Brard
> Priority: Minor
>
> In order to convert JSON payload to Parquet, the "established" way seems to
> be to go first through a JSON to Avro conversion, provided the JSON payload
> is covered by a JSON-Schema or part of a OpenAPI definition. The rest of the
> process relies on the parquet-avro implementation.
> Since JSON payload can be loaded to a generic JsonNode (jackson library) and
> since a JSON payload can be described and checked against a JSON-Schema or an
> OpenAPI definition, wouldn't it be theoretically possible to convert a JSON
> payload to a Parquet "record" directly (somehow implementing a similar
> approach than parquet-avro but this a JsonNode as a data holder)?
--
This message was sent by Atlassian Jira
(v8.3.4#803005)