pitrou commented on pull request #56:
URL: https://github.com/apache/arrow-testing/pull/56#issuecomment-772601749
The JSON files are refused by the Java Arrow integration test:
```
Incompatible files
Expected END_OBJECT but got FIELD_NAME
16:30:12.557 [main] ERROR org.apache.arrow.tools.Integration - Incompatible
files
java.lang.IllegalStateException: Expected END_OBJECT but got FIELD_NAME
at
org.apache.arrow.vector.ipc.JsonFileReader.readToken(JsonFileReader.java:779)
at
org.apache.arrow.vector.ipc.JsonFileReader.readFromJsonIntoVector(JsonFileReader.java:740)
at
org.apache.arrow.vector.ipc.JsonFileReader.read(JsonFileReader.java:219)
at
org.apache.arrow.tools.Integration$Command$3.execute(Integration.java:203)
at org.apache.arrow.tools.Integration.run(Integration.java:118)
at org.apache.arrow.tools.Integration.main(Integration.java:69)
Suppressed: java.lang.IllegalStateException: Memory was leaked by
query. Memory leaked: (16648)
Allocator(ROOT) 0/16648/49416/2147483647 (res/actual/peak/limit)
at
org.apache.arrow.memory.BaseAllocator.close(BaseAllocator.java:437)
at
org.apache.arrow.memory.RootAllocator.close(RootAllocator.java:29)
at
org.apache.arrow.tools.Integration$Command$3.execute(Integration.java:185)
... 2 common frames omitted
```
It looks like the problem is that it contains an empty "children" field for
primitive batches, and that displeases the Java reader (which for some unknown
reason uses a low-level token-by-token parsing technique).
----------------------------------------------------------------
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
For queries about this service, please contact Infrastructure at:
[email protected]
