Hi everyone,
I'm having an issue here. I have the following sample set as json:
{
"field_a":null
}
{
"field_a":"e900511b2bff6b9d33cc"
}
Due to some problems in the dataset, I had to already set:
store.json.all_text_mode to true
But even now, when i try to query the dataset, the following error is
thrown:
DATA_READ ERROR: Error parsing JSON - You tried to write a VarChar type
when you are using a ValueWriter of type NullableIntWriterImpl.
There are more than 40K rows already in this dataset (I've just summarized
the related part here). The thing is up to
"field_a":"e900511b2bff6b9d33cc", the value of field_a was always null. And
I presume that Drill already assigned a NullableInt type during schema
recovery, thus when it faces a Varchar value at the 5665th record, it just
fails.
As far as I know, if I enclose the null value with double quotes, then it's
not really a true null representation. At the end, the question is: do you
know what might be the problem and is there any workaround or setting to
overcome this issue?
Another thing is: when store.json.all_text_mode is set to true, why does
Drill still recognize this field as NullableInt ? Shouldn't it consider
everything as Varchar already?
Thanks a lot for your help.
Cheers,
--
*M. Engin Sözer*
Junior Datawarehouse Manager
[email protected]
Goodgame Studios
Theodorstr. 42-90, House 9
22761 Hamburg, Germany
Phone: +49 (0)40 219 880 -0
*www.goodgamestudios.com <http://www.goodgamestudios.com>*
Goodgame Studios is a branch of Altigi GmbH
Altigi GmbH, District court Hamburg, HRB 99869
Board of directors: Dr. Kai Wawrzinek, Dr. Christian Wawrzinek, Fabian
Ritter
