[
https://issues.apache.org/jira/browse/HAWQ-178?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15130679#comment-15130679
]
ASF GitHub Bot commented on HAWQ-178:
-------------------------------------
Github user tzolov commented on the pull request:
https://github.com/apache/incubator-hawq/pull/302#issuecomment-179344304
In the last commit(s):
* Added tests to cover corner cases like malformed json records or
compressed input files. The _combined_ test coverage is > 95%. @hornn is there
an integration tests/environment to itest PXF plugins?
* Improved handling of malformed json records/fields. If the json record is
not parsable the Resolver will produce a row with empty fields. If a field in
the record is missing then an empty db field is created.
* Factored out the column metadata computation logic and data in a
dedicated `ColumnDescriptorCache` class. Now the cached descriptor metadata is
created only once inside the `JsonResolver` constructor. Previously it use to
be re-computed on each `JsonResolver.getFields()` method call.
> Add JSON plugin support in code base
> ------------------------------------
>
> Key: HAWQ-178
> URL: https://issues.apache.org/jira/browse/HAWQ-178
> Project: Apache HAWQ
> Issue Type: New Feature
> Components: PXF
> Reporter: Goden Yao
> Assignee: Christian Tzolov
> Fix For: backlog
>
> Attachments: PXFJSONPluginforHAWQ2.0andPXF3.0.0.pdf,
> PXFJSONPluginforHAWQ2.0andPXF3.0.0v.2.pdf,
> PXFJSONPluginforHAWQ2.0andPXF3.0.0v.3.pdf
>
>
> JSON has been a popular format used in HDFS as well as in the community,
> there has been a few JSON PXF plugins developed by the community and we'd
> like to see it being incorporated into the code base as an optional package.
--
This message was sent by Atlassian JIRA
(v6.3.4#6332)
