[
https://issues.apache.org/jira/browse/ARROW-1817?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16271665#comment-16271665
]
ASF GitHub Bot commented on ARROW-1817:
---------------------------------------
BryanCutler commented on issue #1375: ARROW-1817: [Java] Configure JsonReader
to read floating point NaN values
URL: https://github.com/apache/arrow/pull/1375#issuecomment-348018824
The background for this is that an existing Spark unit test for Arrow fails
with the current master branch due to no longer being able to parse these
values. The configuration fixes this and allows for the following JSON:
```
{
"name" : "float",
"count" : 10,
"VALIDITY" : [1,1,1,1,1,1,1,1,1,1],
"DATA" : [NaN,1.0,2.0,3.0,4.0,5.0,6.0,7.0,8.0,9.0]
}
```
This is not standard JSON, but is supported by the Jackson library, I don't
think it is something to be concerned about though. cc @icexelloss
----------------------------------------------------------------
This is an automated message from the Apache Git Service.
To respond to the message, please log on GitHub and use the
URL above to go to the specific comment.
For queries about this service, please contact Infrastructure at:
[email protected]
> Configure JsonFileReader to read NaN for floats
> -----------------------------------------------
>
> Key: ARROW-1817
> URL: https://issues.apache.org/jira/browse/ARROW-1817
> Project: Apache Arrow
> Issue Type: Improvement
> Components: Java - Vectors
> Reporter: Bryan Cutler
> Assignee: Bryan Cutler
> Labels: pull-request-available
> Fix For: 0.8.0
>
>
> There is a Spark unit test that includes reading JSON floating point values
> that are NaN's (validity bit is set). The Jackson parser in Arrow version
> 0.4 allowed for these by default, but looks like the updated version requires
> the conf {{ALLOW_NON_NUMERIC_NUMBERS}} to allow this.
> https://fasterxml.github.io/jackson-core/javadoc/2.2.0/com/fasterxml/jackson/core/JsonParser.Feature.html#ALLOW_NON_NUMERIC_NUMBERS
--
This message was sent by Atlassian JIRA
(v6.4.14#64029)
