[
https://issues.apache.org/jira/browse/DRILL-1095?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Aditya Kishore updated DRILL-1095:
----------------------------------
Description:
git.commit.id.abbrev=a1a6144
Build# 26246
The 'create table as' statement starts to break when the column count is
somewhere around 125-150. I attached the error log. Let me know if you have any
questions.
The root cause of this (and similar failures) is that when a Drill operator
needs to process (evaluate/copy/spool) a large number of expressions (columns),
the resultant runtime generated code can exceed the [64 KB byte code
limit|http://docs.oracle.com/javase/specs/jvms/se7/html/jvms-4.html#jvms-4.9.1-110-B]
imposed on the size of a function by Java class file specifications, resulting
in compilation failure.
This umbrella JIRA will serve as a container for various sub-tasks to address
this issue.
was:
git.commit.id.abbrev=a1a6144
Build# 26246
The 'create table as' statement starts to break when the column count is
somewhere around 125-150. I attached the error log. Let me know if you have any
questions.
Summary: Add support for large number of columns in queries (was:
Drill Parquet Writer fails when we have more than 150 columns)
Updating JIRA summary and description to reflect the root cause.
> Add support for large number of columns in queries
> --------------------------------------------------
>
> Key: DRILL-1095
> URL: https://issues.apache.org/jira/browse/DRILL-1095
> Project: Apache Drill
> Issue Type: Bug
> Components: Execution - Codegen, Metadata, Storage - Writer
> Reporter: Rahul Challapalli
> Assignee: Aditya Kishore
> Priority: Blocker
> Attachments: error.log
>
>
> git.commit.id.abbrev=a1a6144
> Build# 26246
> The 'create table as' statement starts to break when the column count is
> somewhere around 125-150. I attached the error log. Let me know if you have
> any questions.
> The root cause of this (and similar failures) is that when a Drill operator
> needs to process (evaluate/copy/spool) a large number of expressions
> (columns), the resultant runtime generated code can exceed the [64 KB byte
> code
> limit|http://docs.oracle.com/javase/specs/jvms/se7/html/jvms-4.html#jvms-4.9.1-110-B]
> imposed on the size of a function by Java class file specifications,
> resulting in compilation failure.
> This umbrella JIRA will serve as a container for various sub-tasks to address
> this issue.
--
This message was sent by Atlassian JIRA
(v6.2#6252)
