Cliff Buchanan created DRILL-1146:
-------------------------------------
Summary: JSON schema change cause query fail/sqline hang
Key: DRILL-1146
URL: https://issues.apache.org/jira/browse/DRILL-1146
Project: Apache Drill
Issue Type: Bug
Reporter: Cliff Buchanan
Running a simple {{select *}} against this file
{code}
{"a" : 0, "b" : 1}
{"a" : 1, "b" : "1"}
{code}
yields these results:
add_producer_consumer = true (default)
{code}
0: jdbc:drill:zk=local> explain plan for select * from dfs.home.`test.json`;
+------------+------------+
| text | json |
+------------+------------+
| 00-00 Screen
00-01 ProducerConsumer
00-02 Scan(groupscan=[EasyGroupScan
[selectionRoot=/Users/rbuchanan/test.json, columns = null]])
| {
"head" : {
"version" : 1,
"generator" : {
|
+------------+------------+
1 row selected (0.992 seconds)
0: jdbc:drill:zk=local> select * from dfs.home.`test.json`;
Exception in thread "c7f12d21-4def-461f-9d1b-ae7af669ae81:frag:0:0 - Producer
Thread" java.lang.IllegalArgumentException: You tried to write a VarChar type
when you are using a ValueWriter of type NullableBigIntWriterImpl.
at
org.apache.drill.exec.vector.complex.impl.AbstractFieldWriter.fail(AbstractFieldWriter.java:509)
at
org.apache.drill.exec.vector.complex.impl.AbstractFieldWriter.write(AbstractFieldWriter.java:197)
at
org.apache.drill.exec.vector.complex.impl.NullableBigIntWriterImpl.write(NullableBigIntWriterImpl.java:83)
at
org.apache.drill.exec.vector.complex.fn.JsonReader.writeData(JsonReader.java:140)
at
org.apache.drill.exec.vector.complex.fn.JsonReader.write(JsonReader.java:65)
at
org.apache.drill.exec.vector.complex.fn.JsonReaderWithState.write(JsonReaderWithState.java:52)
at
org.apache.drill.exec.store.easy.json.JSONRecordReader2.next(JSONRecordReader2.java:82)
at
org.apache.drill.exec.physical.impl.ScanBatch.next(ScanBatch.java:138)
at
org.apache.drill.exec.physical.impl.producer.ProducerConsumerBatch$Producer.run(ProducerConsumerBatch.java:122)
at java.lang.Thread.run(Thread.java:745)
{code}
add_producer_consumer = false
{code}
0: jdbc:drill:zk=local> alter session set `planner.add_producer_consumer` =
false;
+------------+------------+
| ok | summary |
+------------+------------+
| true | planner.add_producer_consumer updated. |
+------------+------------+
1 row selected (0.7 seconds)
0: jdbc:drill:zk=local> explain plan for select * from dfs.home.`test.json`;
+------------+------------+
| text | json |
+------------+------------+
| 00-00 Screen
00-01 Scan(groupscan=[EasyGroupScan
[selectionRoot=/Users/rbuchanan/test.json, columns = null]])
| {
"head" : {
"version" : 1,
"generator" : {
"type" : "ExplainHandler |
+------------+------------+
1 row selected (0.287 seconds)
0: jdbc:drill:zk=local> select * from dfs.home.`test.json`;
Query failed: org.apache.drill.exec.rpc.RpcException: Remote failure while
running query.[error_id: "65c1d03a-3641-482e-871b-4c52ea951b4d"
endpoint {
address: "10.250.0.18"
user_port: 31010
control_port: 31011
data_port: 31012
}
error_type: 0
message: "Failure while running fragment. < IllegalArgumentException:[ You
tried to write a VarChar type when you are using a ValueWriter of type
NullableBigIntWriterImpl. ]"
]
Error: exception while executing query (state=,code=0)
0: jdbc:drill:zk=local>
{code}
--
This message was sent by Atlassian JIRA
(v6.2#6252)
