[
https://issues.apache.org/jira/browse/DRILL-7037?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16779911#comment-16779911
]
Kunal Khatua commented on DRILL-7037:
-------------------------------------
[[email protected]] one possible workaround would be to use temporary
tables to dump your JSON data into and then work off that, since you mentioned
that it works when querying the JSON file directly.
In the event of a crash or end of session, the data would be deleted as it is
temporary in nature.
> Apache Drill Crashes when a 50mb json string is queried via the REST API
> provided
> ---------------------------------------------------------------------------------
>
> Key: DRILL-7037
> URL: https://issues.apache.org/jira/browse/DRILL-7037
> Project: Apache Drill
> Issue Type: Bug
> Components: Client - HTTP
> Affects Versions: 1.14.0
> Environment: Windows 10
> 24GB RAM
> 8 Cores
> Used the REST API call to query drill
> Reporter: Ayush Sharma
> Priority: Blocker
>
> Apache Drill crashes with OutofMemoryException (24GB RAM) when a REST API
> call is made by supplying a json of size 50MB in the query paramater of the
> REST API.
> The REST API even crashes for a 10MB query (16GB RAM) and works with a 5MB
> query.
> This is a blocker for us and will need immediate remediation.
> We are also not aware of any sys.options which might bring the HEAP size down
> drastically or currently making it go up.
>
--
This message was sent by Atlassian JIRA
(v7.6.3#76005)
