[
https://issues.apache.org/jira/browse/DRILL-1728?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14379057#comment-14379057
]
Khurram Faraaz commented on DRILL-1728:
---------------------------------------
I see a similar Exception when I do select * from a JSON file, note that I had
set json.all_text_mode to true.
{code}
0: jdbc:drill:> alter session set `store.json.all_text_mode`=true;
+------------+------------+
| ok | summary |
+------------+------------+
| true | store.json.all_text_mode updated. |
+------------+------------+
1 row selected (0.023 seconds)
0: jdbc:drill:> select * from `testJsnData.json`;
Query failed: Query stopped., You tried to start when you are using a
ValueWriter of type NullableVarCharWriterImpl. [
27dd0514-168c-4216-bd9b-3f13285ab18e on centos-01.qa.lab:31010 ]
Error: exception while executing query: Failure while executing query.
(state=,code=0)
Snippet from drillbit.log
2015-03-25 00:23:42,472 [2aedfff0-fa82-1819-1fc0-996b3eb549f2:frag:0:0] ERROR
o.a.d.e.w.f.AbstractStatusReporter - Error
1a697074-5369-4a7a-abcf-97eab9d9ee39: Failure while running fragment.
java.lang.IllegalStateException: You tried to start when you are using a
ValueWriter of type NullableVarCharWriterImpl.
at
org.apache.drill.exec.vector.complex.impl.AbstractFieldWriter.start(AbstractFieldWriter.java:97)
~[drill-java-exec-0.8.0-SNAPSHOT-rebuffed.jar:0.8.0-SNAPSHOT]
at
org.apache.drill.exec.vector.complex.impl.NullableVarCharWriterImpl.start(NullableVarCharWriterImpl.java:88)
~[drill-java-exec-0.8.0-SNAPSHOT-rebuffed.jar:0.8.0-SNAPSHOT]
at
org.apache.drill.exec.vector.complex.fn.JsonReader.writeDataAllText(JsonReader.java:307)
~[drill-java-exec-0.8.0-SNAPSHOT-rebuffed.jar:0.8.0-SNAPSHOT]
at
org.apache.drill.exec.vector.complex.fn.JsonReader.writeDataAllText(JsonReader.java:332)
~[drill-java-exec-0.8.0-SNAPSHOT-rebuffed.jar:0.8.0-SNAPSHOT]
at
org.apache.drill.exec.vector.complex.fn.JsonReader.writeDataSwitch(JsonReader.java:206)
~[drill-java-exec-0.8.0-SNAPSHOT-rebuffed.jar:0.8.0-SNAPSHOT]
at
org.apache.drill.exec.vector.complex.fn.JsonReader.writeToVector(JsonReader.java:182)
~[drill-java-exec-0.8.0-SNAPSHOT-rebuffed.jar:0.8.0-SNAPSHOT]
at
org.apache.drill.exec.vector.complex.fn.JsonReader.write(JsonReader.java:156)
~[drill-java-exec-0.8.0-SNAPSHOT-rebuffed.jar:0.8.0-SNAPSHOT]
at
org.apache.drill.exec.store.easy.json.JSONRecordReader.next(JSONRecordReader.java:125)
~[drill-java-exec-0.8.0-SNAPSHOT-rebuffed.jar:0.8.0-SNAPSHOT]
at
org.apache.drill.exec.physical.impl.ScanBatch.next(ScanBatch.java:165)
~[drill-java-exec-0.8.0-SNAPSHOT-rebuffed.jar:0.8.0-SNAPSHOT]
at
org.apache.drill.exec.physical.impl.validate.IteratorValidatorBatchIterator.next(IteratorValidatorBatchIterator.java:118)
~[drill-java-exec-0.8.0-SNAPSHOT-rebuffed.jar:0.8.0-SNAPSHOT]
at
org.apache.drill.exec.physical.impl.BaseRootExec.next(BaseRootExec.java:67)
~[drill-java-exec-0.8.0-SNAPSHOT-rebuffed.jar:0.8.0-SNAPSHOT]
at
org.apache.drill.exec.physical.impl.ScreenCreator$ScreenRoot.innerNext(ScreenCreator.java:97)
~[drill-java-exec-0.8.0-SNAPSHOT-rebuffed.jar:0.8.0-SNAPSHOT]
at
org.apache.drill.exec.physical.impl.BaseRootExec.next(BaseRootExec.java:57)
~[drill-java-exec-0.8.0-SNAPSHOT-rebuffed.jar:0.8.0-SNAPSHOT]
at
org.apache.drill.exec.work.fragment.FragmentExecutor.run(FragmentExecutor.java:121)
~[drill-java-exec-0.8.0-SNAPSHOT-rebuffed.jar:0.8.0-SNAPSHOT]
at
org.apache.drill.exec.work.WorkManager$RunnableWrapper.run(WorkManager.java:303)
[drill-java-exec-0.8.0-SNAPSHOT-rebuffed.jar:0.8.0-SNAPSHOT]
at
java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1145)
[na:1.7.0_75]
at
java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:615)
[na:1.7.0_75]
at java.lang.Thread.run(Thread.java:745) [na:1.7.0_75]
2015-03-25 00:23:42,472 [2aedfff0-fa82-1819-1fc0-996b3eb549f2:frag:0:0] INFO
o.a.drill.exec.work.foreman.Foreman - State change requested. RUNNING -->
FAILED
org.apache.drill.exec.rpc.RemoteRpcException: Failure while running fragment.,
You tried to start when you are using a ValueWriter of type
NullableVarCharWriterImpl. [ 1a697074-5369-4a7a-abcf-97eab9d9ee39 on
centos-01.qa.lab:31010 ]
[ 1a697074-5369-4a7a-abcf-97eab9d9ee39 on centos-01.qa.lab:31010 ]
at
org.apache.drill.exec.work.foreman.QueryManager.statusUpdate(QueryManager.java:95)
[drill-java-exec-0.8.0-SNAPSHOT-rebuffed.jar:0.8.0-SNAPSHOT]
at
org.apache.drill.exec.work.foreman.QueryManager$RootStatusReporter.statusChange(QueryManager.java:154)
[drill-java-exec-0.8.0-SNAPSHOT-rebuffed.jar:0.8.0-SNAPSHOT]
at
org.apache.drill.exec.work.fragment.AbstractStatusReporter.fail(AbstractStatusReporter.java:114)
[drill-java-exec-0.8.0-SNAPSHOT-rebuffed.jar:0.8.0-SNAPSHOT]
at
org.apache.drill.exec.work.fragment.AbstractStatusReporter.fail(AbstractStatusReporter.java:110)
[drill-java-exec-0.8.0-SNAPSHOT-rebuffed.jar:0.8.0-SNAPSHOT]
at
org.apache.drill.exec.work.fragment.FragmentExecutor.internalFail(FragmentExecutor.java:176)
[drill-java-exec-0.8.0-SNAPSHOT-rebuffed.jar:0.8.0-SNAPSHOT]
at
org.apache.drill.exec.work.fragment.FragmentExecutor.run(FragmentExecutor.java:123)
[drill-java-exec-0.8.0-SNAPSHOT-rebuffed.jar:0.8.0-SNAPSHOT]
at
org.apache.drill.exec.work.WorkManager$RunnableWrapper.run(WorkManager.java:303)
[drill-java-exec-0.8.0-SNAPSHOT-rebuffed.jar:0.8.0-SNAPSHOT]
at
java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1145)
[na:1.7.0_75]
at
java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:615)
[na:1.7.0_75]
at java.lang.Thread.run(Thread.java:745) [na:1.7.0_75]
2015-03-25 00:23:42,484 [2aedfff0-fa82-1819-1fc0-996b3eb549f2:frag:0:0] INFO
o.a.drill.exec.work.foreman.Foreman - State change requested. FAILED -->
COMPLETED
2015-03-25 00:23:42,484 [2aedfff0-fa82-1819-1fc0-996b3eb549f2:frag:0:0] WARN
o.a.drill.exec.work.foreman.Foreman - Dropping request to move to COMPLETED
state as query is already at FAILED state (which is terminal).
2015-03-25 00:23:42,485 [2aedfff0-fa82-1819-1fc0-996b3eb549f2:frag:0:0] ERROR
o.a.drill.exec.work.foreman.Foreman - Error
b29342fc-396f-4fb0-a4fc-a6038f7da4ad: RemoteRpcException: Failure while running
fragment., You tried to start when you are using a ValueWriter of type
NullableVarCharWriterImpl. [ 1a697074-5369-4a7a-abcf-97eab9d9ee39 on
centos-01.qa.lab:31010 ]
[ 1a697074-5369-4a7a-abcf-97eab9d9ee39 on centos-01.qa.lab:31010 ]
org.apache.drill.exec.rpc.RemoteRpcException: Failure while running fragment.,
You tried to start when you are using a ValueWriter of type
NullableVarCharWriterImpl. [ 1a697074-5369-4a7a-abcf-97eab9d9ee39 on
centos-01.qa.lab:31010 ]
[ 1a697074-5369-4a7a-abcf-97eab9d9ee39 on centos-01.qa.lab:31010 ]
{code}
Data that I used in my test was
{code}
{"key":12345}
{"key":-123456}
{"key":0}
{"key":-99999.999}
{"key":99999999.9876}
{"key":"Hello World!"}
{"key":"this is a long string, not very long though!"}
{"key":true}
{"key":false}
{"key":null}
{"key":2147483647}
{"key":1100110010101010100101010101010101}
{"key":"2008-1-23 14:24:23"}
{"key":"2008-2-23"}
{"key":"10:20:30.123"}
{"key":-1}
{"key":3.147}
{"key":{"id":1000.997}}
{"key":[1,2,3,4,-1,0,135.987,99999,-9999.876,2147483647,"test
string",null,true,false]}
{"key":{null}}
{"key":[null]}
{"key":"abcdefghijklmnopqrstuvwxyz1234567890ABCDEFGHIJKLMNOPQRSTUVWXYZ 12345
aeiou"}
{code}
> Better error messages on Drill JSON read error
> ----------------------------------------------
>
> Key: DRILL-1728
> URL: https://issues.apache.org/jira/browse/DRILL-1728
> Project: Apache Drill
> Issue Type: Bug
> Components: Storage - JSON
> Reporter: Tomer Shiran
> Assignee: Jason Altekruse
> Priority: Minor
> Fix For: 0.9.0
>
>
> {code}
> 0: jdbc:drill:zk=localhost:2181> SELECT * FROM
> dfs.root.`Users/tshiran/Development/demo/data/yelp/business.json` WHERE true
> and REPEATED_CONTAINS(categories, 'Australian');
> +-------------+--------------+------------+------------+------------+------------+--------------+------------+------------+------------+------------+------------+------------+------------+---------------+
> | business_id | full_address | hours | open | categories | city
> | review_count | name | longitude | state | stars |
> latitude | attributes | type | neighborhoods |
> +-------------+--------------+------------+------------+------------+------------+--------------+------------+------------+------------+------------+------------+------------+------------+---------------+
> Query failed: Query stopeed., You tried to start when you are using a
> ValueWriter of type NullableBitWriterImpl. [
> e5bafa1e-6226-443d-80fd-51e18f330899 on 172.17.3.132:31010 ]
> java.lang.RuntimeException: java.sql.SQLException: Failure while executing
> query.
> at sqlline.SqlLine$IncrementalRows.hasNext(SqlLine.java:2514)
> at sqlline.SqlLine$TableOutputFormat.print(SqlLine.java:2148)
> at sqlline.SqlLine.print(SqlLine.java:1809)
> at sqlline.SqlLine$Commands.execute(SqlLine.java:3766)
> at sqlline.SqlLine$Commands.sql(SqlLine.java:3663)
> at sqlline.SqlLine.dispatch(SqlLine.java:889)
> at sqlline.SqlLine.begin(SqlLine.java:763)
> at sqlline.SqlLine.start(SqlLine.java:498)
> at sqlline.SqlLine.main(SqlLine.java:460)
> {code}
--
This message was sent by Atlassian JIRA
(v6.3.4#6332)
