Hi, I recently cloned the apache drill master project and built it on amazon r3.xlarge instance(4 CPUs, 30.5GB RAM).
When I query on a 45MB parquet file, I got the following error after fetching few rows "java.lang.RuntimeException: java.sql.SQLException: SYSTEM ERROR: java.lang.IllegalArgumentException: initialCapacity: -2147483648 (expectd: 0+) Fragment 0:0 [Error Id: 69a541ac-5124-4c5a-8e15-0bd8ce06be89 on ip-172-31-35-55.ec2.internal:31010] at sqlline.SqlLine$IncrementalRows.hasNext(SqlLine.java:2514) at sqlline.SqlLine$TableOutputFormat.print(SqlLine.java:2148) at sqlline.SqlLine.print(SqlLine.java:1809) at sqlline.SqlLine$Commands.execute(SqlLine.java:3766) at sqlline.SqlLine$Commands.sql(SqlLine.java:3663) at sqlline.SqlLine.dispatch(SqlLine.java:889) at sqlline.SqlLine.begin(SqlLine.java:763) at sqlline.SqlLine.start(SqlLine.java:498) at sqlline.SqlLine.main(SqlLine.java:460)" When the same query was run on local machine(4GB RAM) I got following error "java.lang.RuntimeException: java.sql.SQLException: RESOURCE ERROR: One or more nodes ran out of memory while executing the query. Fragment 0:0 [Error Id: 90322cac-4f27-4a47-8479-31445421a16a on localhost:31010] at sqlline.SqlLine$IncrementalRows.hasNext(SqlLine.java:2514) at sqlline.SqlLine$TableOutputFormat.print(SqlLine.java:2148) at sqlline.SqlLine.print(SqlLine.java:1809) at sqlline.SqlLine$Commands.execute(SqlLine.java:3766) at sqlline.SqlLine$Commands.sql(SqlLine.java:3663) at sqlline.SqlLine.dispatch(SqlLine.java:889) at sqlline.SqlLine.begin(SqlLine.java:763) at sqlline.SqlLine.start(SqlLine.java:498) at sqlline.SqlLine.main(SqlLine.java:460)" So I tried increasing DRILL_HEAP and DRILL_MAX_DIRECT_MEMORY in drill-env.sh, but no change in result. Between the query was something like this "select q.funder['user_id'] from (select flatten(campaign['funders']) funder from `crowdfunding`) q;" It would be great if someone could help me with this issue. -- Regards, Sharath Akinapally, Innovaccer.
