[
https://issues.apache.org/jira/browse/ASTERIXDB-3410?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Peeyush Gupta resolved ASTERIXDB-3410.
--------------------------------------
Resolution: Fixed
> OOM Error with Heavily Nested Queries
> -------------------------------------
>
> Key: ASTERIXDB-3410
> URL: https://issues.apache.org/jira/browse/ASTERIXDB-3410
> Project: Apache AsterixDB
> Issue Type: Bug
> Components: COMP - Compiler
> Reporter: Glenn Justo Galvizo
> Priority: Major
> Labels: triaged
>
> Something I came across while trying to use AFrame with AsterixDB
> ([https://dzone.com/articles/dataframes-with-big-data-in-couchbase]). A
> pattern used by AFrame and early versions of Graphix involved repeatedly
> nesting queries:
> SELECT VALUE OBJECT_REMOVE(t, 'categories')
> FROM (
> SELECT t.*, to_bigint(contains(categories, "Home Services")) AS `Home
> Services`
> FROM (
> SELECT t.*, to_bigint(contains(categories, "Bars")) AS `Bars`
> FROM ...
>
> .
> .
> .
>
> ) t
> ) t
>
> Unfortunately, for heavily nested queries, AsterixDB throws an out of memory
> error. This was an issue I faced with the compiler, not the runtime (I ran
> this with EXPLAIN, and I still got the OOM error).
>
> Potential remedy: we do have a decorrelation Algebricks rule, but it may
> (potentially) be less memory intensive to have an AST-level rule that tries
> to do the same.
--
This message was sent by Atlassian Jira
(v8.20.10#820010)
