The memory (heap) would climb as it tries to flatten the JSON data. Have you
tried looking at Drill's LateralJoin-Unnest feature? It was meant to address
memory issues for some use cases of the FLATTEN operator.
On 2/8/2019 5:17:01 AM, PRAVEEN DEVERACHETTY wrote:
I am running a query with
Hi All,
Please find below the link[1] to the slides for Drill Resource Management
project which Hanu, Karthik and I presented on this week's hangout. For
details you can refer to design document at [2]. The implementation details
section of design document is still WIP. All the work for this
I am running a query with UNION ALL. as below
select
from ( select FLATTEN(t.jdata) as record from
((select convert_from(json string, json) union all
(select conver_from(json_string,json) union all
...
) as jdata) ) as t) ems
Reason for giving union all is because we are invoking a call using
Hello Ihor,
Good to understand.
Thanks, Kwizera
On Thu, Feb 7, 2019 at 3:15 PM Ihor Huzenko
wrote:
> Hello Kwizera,
>
> Currently Hive complex types aren't supported in Drill, but I'm
> currently working on
> the https://issues.apache.org/jira/browse/DRILL-3290 to add support for
> them.
>
