[jira] [Updated] (HIVE-20290) Lazy initialize ArrowColumnarBatchSerDe so it doesn't allocate buffers during GetSplits
[ https://issues.apache.org/jira/browse/HIVE-20290?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Jason Dere updated HIVE-20290: -- Resolution: Fixed Fix Version/s: 4.0.0 Status: Resolved (was: Patch Available) Committed to master > Lazy initialize ArrowColumnarBatchSerDe so it doesn't allocate buffers during > GetSplits > --- > > Key: HIVE-20290 > URL: https://issues.apache.org/jira/browse/HIVE-20290 > Project: Hive > Issue Type: Bug >Affects Versions: 3.1.0 >Reporter: Eric Wohlstadter >Assignee: Eric Wohlstadter >Priority: Blocker > Fix For: 4.0.0 > > Attachments: HIVE-20290.1.patch, HIVE-20290.2.patch > > > When using {{GenericUDTFGetSplits}} to create {{LlapInputSplit}} for > submission to {{LlapOutputFormatService}}, the physical plan generation > initializes whatever SerDe is being used. > {{ArrowColumnarBatchSerDe}} initializes buffers for Arrow and > {{VectorizedRowBatch}} at this point inside HS2 which are never used. -- This message was sent by Atlassian JIRA (v7.6.3#76005)
[jira] [Updated] (HIVE-20290) Lazy initialize ArrowColumnarBatchSerDe so it doesn't allocate buffers during GetSplits
[ https://issues.apache.org/jira/browse/HIVE-20290?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Eric Wohlstadter updated HIVE-20290: Status: Patch Available (was: Open) > Lazy initialize ArrowColumnarBatchSerDe so it doesn't allocate buffers during > GetSplits > --- > > Key: HIVE-20290 > URL: https://issues.apache.org/jira/browse/HIVE-20290 > Project: Hive > Issue Type: Bug >Affects Versions: 3.1.0 >Reporter: Eric Wohlstadter >Assignee: Eric Wohlstadter >Priority: Blocker > Attachments: HIVE-20290.1.patch, HIVE-20290.2.patch > > > When using {{GenericUDTFGetSplits}} to create {{LlapInputSplit}} for > submission to {{LlapOutputFormatService}}, the physical plan generation > initializes whatever SerDe is being used. > {{ArrowColumnarBatchSerDe}} initializes buffers for Arrow and > {{VectorizedRowBatch}} at this point inside HS2 which are never used. -- This message was sent by Atlassian JIRA (v7.6.3#76005)
[jira] [Updated] (HIVE-20290) Lazy initialize ArrowColumnarBatchSerDe so it doesn't allocate buffers during GetSplits
[ https://issues.apache.org/jira/browse/HIVE-20290?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Eric Wohlstadter updated HIVE-20290: Attachment: HIVE-20290.2.patch > Lazy initialize ArrowColumnarBatchSerDe so it doesn't allocate buffers during > GetSplits > --- > > Key: HIVE-20290 > URL: https://issues.apache.org/jira/browse/HIVE-20290 > Project: Hive > Issue Type: Bug >Affects Versions: 3.1.0 >Reporter: Eric Wohlstadter >Assignee: Eric Wohlstadter >Priority: Blocker > Attachments: HIVE-20290.1.patch, HIVE-20290.2.patch > > > When using {{GenericUDTFGetSplits}} to create {{LlapInputSplit}} for > submission to {{LlapOutputFormatService}}, the physical plan generation > initializes whatever SerDe is being used. > {{ArrowColumnarBatchSerDe}} initializes buffers for Arrow and > {{VectorizedRowBatch}} at this point inside HS2 which are never used. -- This message was sent by Atlassian JIRA (v7.6.3#76005)
[jira] [Updated] (HIVE-20290) Lazy initialize ArrowColumnarBatchSerDe so it doesn't allocate buffers during GetSplits
[ https://issues.apache.org/jira/browse/HIVE-20290?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Eric Wohlstadter updated HIVE-20290: Status: Open (was: Patch Available) > Lazy initialize ArrowColumnarBatchSerDe so it doesn't allocate buffers during > GetSplits > --- > > Key: HIVE-20290 > URL: https://issues.apache.org/jira/browse/HIVE-20290 > Project: Hive > Issue Type: Bug >Affects Versions: 3.1.0 >Reporter: Eric Wohlstadter >Assignee: Eric Wohlstadter >Priority: Blocker > Attachments: HIVE-20290.1.patch, HIVE-20290.2.patch > > > When using {{GenericUDTFGetSplits}} to create {{LlapInputSplit}} for > submission to {{LlapOutputFormatService}}, the physical plan generation > initializes whatever SerDe is being used. > {{ArrowColumnarBatchSerDe}} initializes buffers for Arrow and > {{VectorizedRowBatch}} at this point inside HS2 which are never used. -- This message was sent by Atlassian JIRA (v7.6.3#76005)
[jira] [Updated] (HIVE-20290) Lazy initialize ArrowColumnarBatchSerDe so it doesn't allocate buffers during GetSplits
[ https://issues.apache.org/jira/browse/HIVE-20290?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Eric Wohlstadter updated HIVE-20290: Attachment: HIVE-20290.1.patch > Lazy initialize ArrowColumnarBatchSerDe so it doesn't allocate buffers during > GetSplits > --- > > Key: HIVE-20290 > URL: https://issues.apache.org/jira/browse/HIVE-20290 > Project: Hive > Issue Type: Bug >Affects Versions: 3.1.0 >Reporter: Eric Wohlstadter >Assignee: Eric Wohlstadter >Priority: Blocker > Attachments: HIVE-20290.1.patch > > > When using {{GenericUDTFGetSplits}} to create {{LlapInputSplit}} for > submission to {{LlapOutputFormatService}}, the physical plan generation > initializes whatever SerDe is being used. > {{ArrowColumnarBatchSerDe}} initializes buffers for Arrow and > {{VectorizedRowBatch}} at this point inside HS2 which are never used. -- This message was sent by Atlassian JIRA (v7.6.3#76005)
[jira] [Updated] (HIVE-20290) Lazy initialize ArrowColumnarBatchSerDe so it doesn't allocate buffers during GetSplits
[ https://issues.apache.org/jira/browse/HIVE-20290?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Eric Wohlstadter updated HIVE-20290: Status: Patch Available (was: In Progress) > Lazy initialize ArrowColumnarBatchSerDe so it doesn't allocate buffers during > GetSplits > --- > > Key: HIVE-20290 > URL: https://issues.apache.org/jira/browse/HIVE-20290 > Project: Hive > Issue Type: Bug >Affects Versions: 3.1.0 >Reporter: Eric Wohlstadter >Assignee: Eric Wohlstadter >Priority: Blocker > Attachments: HIVE-20290.1.patch > > > When using {{GenericUDTFGetSplits}} to create {{LlapInputSplit}} for > submission to {{LlapOutputFormatService}}, the physical plan generation > initializes whatever SerDe is being used. > {{ArrowColumnarBatchSerDe}} initializes buffers for Arrow and > {{VectorizedRowBatch}} at this point inside HS2 which are never used. -- This message was sent by Atlassian JIRA (v7.6.3#76005)