org
> Subject: RE: RE: Error: DATA_READ ERROR: Error parsing JSON - Cannot read
> from the middle of a record
>
> select count(*) on a jsonl file comes back instantly
>
> /u1/my_login=> wc -l test.jsonl
> 7226 test.jsonl
>
> select count(*) from dfs.`/u1/my_login/tes
ter
-Original Message-
From: Lee, David
Sent: Tuesday, August 28, 2018 12:11 PM
To: user@drill.apache.org
Subject: RE: RE: Error: DATA_READ ERROR: Error parsing JSON - Cannot read from
the middle of a record
select count(*) on a jsonl file comes back instantly
/u1/my_login=> wc -l test.json
Re: RE: Error: DATA_READ ERROR: Error parsing JSON - Cannot read from
the middle of a record
[EXTERNAL EMAIL]
Hi Scott,
Bingo. Just tried this very case with the sample file from the previous post.
Got exactly the failure in the post you provided. I notice that a "select *"
able I think to reduce
> > memory overhead vs parsing a giant string...
> >
> > {"var1": "foo", "var2":"bar"}
> > {"var1": "fo", "var2": "baz"}
> > {"var1": "f2o", "va
>
> > Get rid of the opening and closing brackets and see if you can turn the
> > commas into newlines.. The file needs to be splittable I think to reduce
> > memory overhead vs parsing a giant string...
> >
> > {"var1": "foo", "var2":"
A simple linux GREP command can be used to find data, but trying to GREP a JSON
file with no line breaks just returns back a wall of text..
-Original Message-
From: Paul Rogers [mailto:par0...@yahoo.com.INVALID]
Sent: Monday, August 27, 2018 5:47 PM
To: user@drill.apache.org
Subject:
ot;}
> {"var1": "f2o", "var2": "baz2"}
> {"var1": "f3o", "var2": "baz3"}
> {"var1": "f4o", "var2": "baz4"}
> {"var1": "f5o", "var2": "
: "baz3"}
> {"var1": "f4o", "var2": "baz4"}
> {"var1": "f5o", "var2": "baz5"}
>
> -Original Message-
> From: scott [mailto:tcots8...@gmail.com]
> Sent: Monday, August 27, 2018 4:59 PM
>
quot;f4o", "var2": "baz4"}
{"var1": "f5o", "var2": "baz5"}
-Original Message-
From: scott [mailto:tcots8...@gmail.com]
Sent: Monday, August 27, 2018 4:59 PM
To: user@drill.apache.org
Subject: Error: DATA_READ ERROR: Error parsing JSON - Ca
'm getting is: Error: DATA_READ ERROR: Error parsing JSON -
Cannot read from the middle of a record. Current token was START_ARRAY
The json files are in array format, like [ { "var1": "foo", "var2":
"bar"},{"var1": "fo", "var2":
quot;, "var2": "baz"}
{"var1": "f2o", "var2": "baz2"}
{"var1": "f3o", "var2": "baz3"}
{"var1": "f4o", "var2": "baz4"}
{"var1": "f5o", "var2&q
Hi All,
I'm getting an error querying some of my json files.
The error I'm getting is: Error: DATA_READ ERROR: Error parsing JSON -
Cannot read from the middle of a record. Current token was START_ARRAY
The json files are in array format, like [ { "var1": "foo"
194C3","timestamp":1457658600032}
> > > > {"gameId":"
> > > >
> > > >
> > >
> >
> https://daemon2.com/tournDetails.do?type=myGames&;
> userId=1556148&jsonp_callback=jQuery213043
> > > >
> > >
> >
> ","ajaxData":null,"metadata":null,"ajaxUrl":[{"R":0,"rNo":
> 1,"gid":4,"wal":0,"d":{"gid":4,"pt":3,"wc":2326,"top":"1","
> reg":true,"brkt":1457771400268,"sk":"2507001010530109","id":
> 56312439,"a":0,"st":145777140,"e":"0.0","j":0,"n":"Loot
> > > > Qualifier
> > > >
> > > >
> > >
> >
> 1","tc":94,"et":0,"syst":1457771456,"rc":14577,"s":
> 5,"t":1,"tk":false,"prnId":56311896,"jc":1,"tp":"
> 10.0","ro":14540,"rp":0,"isprn":false},"fl":"192.
> 168.35.42","aaid":"5828"}],"selectedItem":null,"sessionid":"
> D18104E8CA3071C7A8F4E141B127","timestamp":1457771458873}
> > > >
> > > >
> > >
> >
> {"ajaxData":null,"metadata":null,"ajaxUrl":"/player/
> updatebonus2","selectedItem":null,"sessionid":"
> BC497C7C39B3C90AC9E6E9E8194C3","timestamp":1457958600032}
> > > >
> > > > -- *Query*
> > > >
> > > >
> > > >
> > > > select
> > > > `timestamp`,
> > > > sessionid,
> > > > gameid,
> > > > ajaxUrl,
> > > > ajaxData
> > > > from dfs.`/tmp/test.json` t
> > > > ;
> > > >
> > > >
> > > >
> > > > Error: DATA_READ ERROR: Error parsing JSON - You tried to start when
> > you
> > > > are using a ValueWriter of type NullableVarCharWriterImpl.
> > > >
> > > > File /tmp/test.json
> > > > Record 2
> > > > Fragment 0:0
> > > >
> > >
> >
>
set `store.json.all_text_mode` = true;
> >
> >Regards,
> >Abhishek
> >
> >On Wednesday, October 12, 2016, Dan Blondowski <
> >dan.blondow...@dhigroupinc.com> wrote:
> >
> >> Hello.
> >>
> >> I have a json file with 2 records
o use explicit casts in the query to
>>> get
>>>> types you want.
>>>>
>>>> set `store.json.all_text_mode` = true;
>>>>
>>>> Regards,
>>>> Abhishek
>>>>
>>>> On Wednesday, October 12, 2016, Dan Blo
set `store.json.all_text_mode` = true;
>> >
>> >Regards,
>> >Abhishek
>> >
>> >On Wednesday, October 12, 2016, Dan Blondowski <
>> >dan.blondow...@dhigroupinc.com> wrote:
>> >
>> >> Hello.
>> >>
&g
ondow...@dhigroupinc.com> wrote:
> >
> >> Hello.
> >>
> >> I have a json file with 2 records (see attached).
> >>
> >> When I run a query against it I get this error:
> >>
> >> *Error: DATA_READ ERROR: Error parsing JSON - You tried to w
ow...@dhigroupinc.com> wrote:
>
>> Hello.
>>
>> I have a json file with 2 records (see attached).
>>
>> When I run a query against it I get this error:
>>
>> *Error: DATA_READ ERROR: Error parsing JSON - You tried to write a
>>BigInt
>>
> When I run a query against it I get this error:
>
> *Error: DATA_READ ERROR: Error parsing JSON - You tried to write a BigInt
> type when you are using a ValueWriter of type NullableVarCharWriterImpl.*
>
>
> *File /test.json*
>
> *Record 2*
>
> *Fragment 0:0*
>
d, Oct 12, 2016 at 7:38 PM, Dan Blondowski <
> >dan.blondow...@dhigroupinc.com> wrote:
> >
> >> Hello.
> >>
> >> I have a json file with 2 records (see attached).
> >>
> >> When I run a query against it I get this error:
> >>
> &
PM, Dan Blondowski <
>dan.blondow...@dhigroupinc.com> wrote:
>
>> Hello.
>>
>> I have a json file with 2 records (see attached).
>>
>> When I run a query against it I get this error:
>>
>> *Error: DATA_READ ERROR: Error parsing JSON - You t
Can you please share your SQL query ?
On Wed, Oct 12, 2016 at 7:38 PM, Dan Blondowski <
dan.blondow...@dhigroupinc.com> wrote:
> Hello.
>
> I have a json file with 2 records (see attached).
>
> When I run a query against it I get this error:
>
> *Error: DATA_READ ERRO
Hello.
I have a json file with 2 records (see attached).
When I run a query against it I get this error:
Error: DATA_READ ERROR: Error parsing JSON - You tried to write a BigInt type
when you are using a ValueWriter of type NullableVarCharWriterImpl.
File /test.json
Record 2
Fragment 0
"ajaxData":null,"metadata":null,"ajaxUrl":[{"R":0,"rNo":1,"gid":4,"wal":0,"d":{"gid":4,"pt":3,"wc":2326,"top":"1","reg":true,"brkt":1457771400268,"sk":"250700101053010
ot;tp":"10.0","ro":14540,"rp":0,"isprn":false},"fl":"192.168.35.42","aaid":"5828"}],"selectedItem":null,"sessionid":"D18104E8CA3071C7A8F4E141B127","timestamp":1457771458873}
{"ajaxData":null,"metadata":null,"ajaxUrl":"/player/updatebonus2","selectedItem":null,"sessionid":"BC497C7C39B3C90AC9E6E9E8194C3","timestamp":1457958600032}
-- *Query*
select
`timestamp`,
sessionid,
gameid,
ajaxUrl,
ajaxData
from dfs.`/tmp/test.json` t
;
Error: DATA_READ ERROR: Error parsing JSON - You tried to start when you
are using a ValueWriter of type NullableVarCharWriterImpl.
File /tmp/test.json
Record 2
Fragment 0:0
jc":1,"tp":"100000.0","ro":14540,"rp":0,"isprn":false},"fl":"192.168.35.42","aaid":"5828"}],"selectedItem":null,"sessionid":"D18104E8CA3071C7A8F4E141B127","timestamp":1457771458873}
>
> {"ajaxData":null,"metadata":null,"ajaxUrl":"/player/updatebonus2","selectedItem":null,"sessionid":"BC497C7C39B3C90AC9E6E9E8194C3","timestamp":1457958600032}
>
> -- *Query*
>
>
>
> select
> `timestamp`,
> sessionid,
> gameid,
> ajaxUrl,
> ajaxData
> from dfs.`/tmp/test.json` t
> ;
>
>
>
> Error: DATA_READ ERROR: Error parsing JSON - You tried to start when you
> are using a ValueWriter of type NullableVarCharWriterImpl.
>
> File /tmp/test.json
> Record 2
> Fragment 0:0
>
26,"top":"1","reg":true,"brkt":1457771400268,"sk":"2507001010530109","id":56312439,"a":0,"st":145777140,"e":"0.0","j":0,"n":"Loot
> > > Qualifier
> > >
> > >
> >
> 1","tc":94,"et":0,"syst":1457771456,"rc":14577,"s":5,"t":1,"tk":false,"prnId":56311896,"jc":1,"tp":"10.0","ro":14540,"rp":0,"isprn":false},"fl":"192.168.35.42","aaid":"5828"}],"selectedItem":null,"sessionid":"D18104E8CA3071C7A8F4E141B127","timestamp":1457771458873}
> > >
> > >
> >
> {"ajaxData":null,"metadata":null,"ajaxUrl":"/player/updatebonus2","selectedItem":null,"sessionid":"BC497C7C39B3C90AC9E6E9E8194C3","timestamp":1457958600032}
> > >
> > > -- *Query*
> > >
> > >
> > >
> > > select
> > > `timestamp`,
> > > sessionid,
> > > gameid,
> > > ajaxUrl,
> > > ajaxData
> > > from dfs.`/tmp/test.json` t
> > > ;
> > >
> > >
> > >
> > > Error: DATA_READ ERROR: Error parsing JSON - You tried to start when
> you
> > > are using a ValueWriter of type NullableVarCharWriterImpl.
> > >
> > > File /tmp/test.json
> > > Record 2
> > > Fragment 0:0
> > >
> >
>
> >
> 1","tc":94,"et":0,"syst":1457771456,"rc":14577,"s":5,"t":1,"tk":false,"prnId":56311896,"jc":1,"tp":"10.0","ro":14540,"rp":0,"isprn":false},"fl":"192.168.35.42","aaid":"5828"}],"selectedItem":null,"sessionid":"D18104E8CA3071C7A8F4E141B127","timestamp":1457771458873}
> >
> >
> {"ajaxData":null,"metadata":null,"ajaxUrl":"/player/updatebonus2","selectedItem":null,"sessionid":"BC497C7C39B3C90AC9E6E9E8194C3","timestamp":1457958600032}
> >
> > -- *Query*
> >
> >
> >
> > select
> > `timestamp`,
> > sessionid,
> > gameid,
> > ajaxUrl,
> > ajaxData
> > from dfs.`/tmp/test.json` t
> > ;
> >
> >
> >
> > Error: DATA_READ ERROR: Error parsing JSON - You tried to start when you
> > are using a ValueWriter of type NullableVarCharWriterImpl.
> >
> > File /tmp/test.json
> > Record 2
> > Fragment 0:0
> >
>
28 matches
Mail list logo
