[
https://issues.apache.org/jira/browse/DRILL-2350?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14341678#comment-14341678
]
Abhishek Girish edited comment on DRILL-2350 at 2/28/15 5:35 PM:
-----------------------------------------------------------------
I created a JSON file with the snippet you shared, and was able to query it:
{code:sql}
> select * from `ext.json` ;
+------------+------------+------------+------------+------------+
| _id | city | loc | pop | state |
+------------+------------+------------+------------+------------+
| 15687 | STAHLSTOWN | [-79.344473,40.138593] | 2555 | PA |
| 15688 | TARRS | [-79.566101,40.161915] | 385 | PA |
+------------+------------+------------+------------+------------+
2 rows selected (0.092 seconds)
{code}
The issue could be with some record down the file, where there is a change in
schema. It would help if you could narrow this down by sharing just the snippet
that's causing the issue. You could use one of the online JSON editors and
compare the structure of records within the file. And then repeatedly removing
records to isolate the failing record.
was (Author: agirish):
I created a JSON file with the snippet you shared, and was able to query it:
{code:sql}
> select * from `ext.json` ;
+------------+------------+------------+------------+------------+
| _id | city | loc | pop | state |
+------------+------------+------------+------------+------------+
| 15687 | STAHLSTOWN | [-79.344473,40.138593] | 2555 | PA |
| 15688 | TARRS | [-79.566101,40.161915] | 385 | PA |
+------------+------------+------------+------------+------------+
2 rows selected (0.092 seconds)
{code}
The issue could be with some record down the file, where there is a change in
schema. It would help if you could narrow down the issue by sharing just the
snippet that's causing the issue. You could use one of the online JSON editors
and compare the structure of records within the file. And then repeatedly
removing records to isolate the failing record.
> Star query failed with exception on JSON data
> ---------------------------------------------
>
> Key: DRILL-2350
> URL: https://issues.apache.org/jira/browse/DRILL-2350
> Project: Apache Drill
> Issue Type: Bug
> Components: Storage - JSON, Storage - MongoDB
> Affects Versions: 0.7.0
> Reporter: Bhallamudi Venkata Siva Kamesh
> Assignee: Steven Phillips
> Fix For: 0.8.0
>
>
> Query failed while executing following query on JSON data with following
> exception
> {noformat}select * from hdfs.drill.`zips.json`;{noformat}
> {noformat}
> 2015-02-28 21:37:34,058 [2b0e183a-7597-0a1e-fd12-56d91173af70:frag:0:0] ERROR
> o.a.d.e.w.f.AbstractStatusReporter - Error
> 6b26e17b-f114-47a9-9cf7-1a77ba52a8e6: Failure while running fragment.
> java.lang.IllegalStateException: Needed to be in state INIT or IN_BIGINT but
> in mode IN_FLOAT8
> at
> org.apache.drill.exec.vector.complex.impl.SingleListWriter.bigInt(SingleListWriter.java:387)
> ~[drill-java-exec-0.8.0-SNAPSHOT-rebuffed.jar:0.8.0-SNAPSHOT]
> at
> org.apache.drill.exec.vector.complex.fn.JsonReader.writeData(JsonReader.java:422)
> ~[drill-java-exec-0.8.0-SNAPSHOT-rebuffed.jar:0.8.0-SNAPSHOT]
> at
> org.apache.drill.exec.vector.complex.fn.JsonReader.writeData(JsonReader.java:256)
> ~[drill-java-exec-0.8.0-SNAPSHOT-rebuffed.jar:0.8.0-SNAPSHOT]
> at
> org.apache.drill.exec.vector.complex.fn.JsonReader.writeDataSwitch(JsonReader.java:208)
> ~[drill-java-exec-0.8.0-SNAPSHOT-rebuffed.jar:0.8.0-SNAPSHOT]
> at
> org.apache.drill.exec.vector.complex.fn.JsonReader.writeToVector(JsonReader.java:182)
> ~[drill-java-exec-0.8.0-SNAPSHOT-rebuffed.jar:0.8.0-SNAPSHOT]
> at
> org.apache.drill.exec.vector.complex.fn.JsonReader.write(JsonReader.java:156)
> ~[drill-java-exec-0.8.0-SNAPSHOT-rebuffed.jar:0.8.0-SNAPSHOT]
> at
> org.apache.drill.exec.store.easy.json.JSONRecordReader.next(JSONRecordReader.java:125)
> ~[drill-java-exec-0.8.0-SNAPSHOT-rebuffed.jar:0.8.0-SNAPSHOT]
> at
> org.apache.drill.exec.physical.impl.ScanBatch.next(ScanBatch.java:165)
> ~[drill-java-exec-0.8.0-SNAPSHOT-rebuffed.jar:0.8.0-SNAPSHOT]
> at
> org.apache.drill.exec.physical.impl.validate.IteratorValidatorBatchIterator.next(IteratorValidatorBatchIterator.java:118)
> ~[drill-java-exec-0.8.0-SNAPSHOT-rebuffed.jar:0.8.0-SNAPSHOT]
> at
> org.apache.drill.exec.physical.impl.BaseRootExec.next(BaseRootExec.java:67)
> ~[drill-java-exec-0.8.0-SNAPSHOT-rebuffed.jar:0.8.0-SNAPSHOT]
> at
> org.apache.drill.exec.physical.impl.ScreenCreator$ScreenRoot.innerNext(ScreenCreator.java:97)
> ~[drill-java-exec-0.8.0-SNAPSHOT-rebuffed.jar:0.8.0-SNAPSHOT]
> at
> org.apache.drill.exec.physical.impl.BaseRootExec.next(BaseRootExec.java:57)
> ~[drill-java-exec-0.8.0-SNAPSHOT-rebuffed.jar:0.8.0-SNAPSHOT]
> at
> org.apache.drill.exec.work.fragment.FragmentExecutor.run(FragmentExecutor.java:121)
> ~[drill-java-exec-0.8.0-SNAPSHOT-rebuffed.jar:0.8.0-SNAPSHOT]
> at
> org.apache.drill.exec.work.WorkManager$RunnableWrapper.run(WorkManager.java:303)
> [drill-java-exec-0.8.0-SNAPSHOT-rebuffed.jar:0.8.0-SNAPSHOT]
> at
> java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1145)
> [na:1.7.0_51]
> at
> java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:615)
> [na:1.7.0_51]
> at java.lang.Thread.run(Thread.java:744) [na:1.7.0_51]
> {noformat}
--
This message was sent by Atlassian JIRA
(v6.3.4#6332)
