[jira] [Updated] (HIVE-20279) HiveContextAwareRecordReader slows down Druid Scan queries.
[ https://issues.apache.org/jira/browse/HIVE-20279?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Ashutosh Chauhan updated HIVE-20279: Resolution: Fixed Fix Version/s: 4.0.0 Status: Resolved (was: Patch Available) Pushed to master. Thanks, Nishant! > HiveContextAwareRecordReader slows down Druid Scan queries. > > > Key: HIVE-20279 > URL: https://issues.apache.org/jira/browse/HIVE-20279 > Project: Hive > Issue Type: Improvement >Reporter: Nishant Bangarwa >Assignee: Nishant Bangarwa >Priority: Major > Fix For: 4.0.0 > > Attachments: HIVE-20279.1.patch, HIVE-20279.2.patch, > HIVE-20279.patch, scan2.svg > > > HiveContextAwareRecordReader add lots of overhead for Druid Scan Queries. > See attached flame graph. > Looks like the operations for checking for existence of footer/header buffer > takes most of time For druid and other storage handlers that do not have > footer buffer we should skip the logic for checking the existence for storage > handlers atleast. -- This message was sent by Atlassian JIRA (v7.6.3#76005)
[jira] [Updated] (HIVE-20279) HiveContextAwareRecordReader slows down Druid Scan queries.
[ https://issues.apache.org/jira/browse/HIVE-20279?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Nishant Bangarwa updated HIVE-20279: Attachment: HIVE-20279.2.patch > HiveContextAwareRecordReader slows down Druid Scan queries. > > > Key: HIVE-20279 > URL: https://issues.apache.org/jira/browse/HIVE-20279 > Project: Hive > Issue Type: Improvement >Reporter: Nishant Bangarwa >Assignee: Nishant Bangarwa >Priority: Major > Attachments: HIVE-20279.1.patch, HIVE-20279.2.patch, > HIVE-20279.patch, scan2.svg > > > HiveContextAwareRecordReader add lots of overhead for Druid Scan Queries. > See attached flame graph. > Looks like the operations for checking for existence of footer/header buffer > takes most of time For druid and other storage handlers that do not have > footer buffer we should skip the logic for checking the existence for storage > handlers atleast. -- This message was sent by Atlassian JIRA (v7.6.3#76005)
[jira] [Updated] (HIVE-20279) HiveContextAwareRecordReader slows down Druid Scan queries.
[ https://issues.apache.org/jira/browse/HIVE-20279?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Nishant Bangarwa updated HIVE-20279: Status: Patch Available (was: Open) > HiveContextAwareRecordReader slows down Druid Scan queries. > > > Key: HIVE-20279 > URL: https://issues.apache.org/jira/browse/HIVE-20279 > Project: Hive > Issue Type: Improvement >Reporter: Nishant Bangarwa >Assignee: Nishant Bangarwa >Priority: Major > Attachments: HIVE-20279.1.patch, HIVE-20279.patch, scan2.svg > > > HiveContextAwareRecordReader add lots of overhead for Druid Scan Queries. > See attached flame graph. > Looks like the operations for checking for existence of footer/header buffer > takes most of time For druid and other storage handlers that do not have > footer buffer we should skip the logic for checking the existence for storage > handlers atleast. -- This message was sent by Atlassian JIRA (v7.6.3#76005)
[jira] [Updated] (HIVE-20279) HiveContextAwareRecordReader slows down Druid Scan queries.
[ https://issues.apache.org/jira/browse/HIVE-20279?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Nishant Bangarwa updated HIVE-20279: Attachment: HIVE-20279.1.patch > HiveContextAwareRecordReader slows down Druid Scan queries. > > > Key: HIVE-20279 > URL: https://issues.apache.org/jira/browse/HIVE-20279 > Project: Hive > Issue Type: Improvement >Reporter: Nishant Bangarwa >Assignee: Nishant Bangarwa >Priority: Major > Attachments: HIVE-20279.1.patch, HIVE-20279.patch, scan2.svg > > > HiveContextAwareRecordReader add lots of overhead for Druid Scan Queries. > See attached flame graph. > Looks like the operations for checking for existence of footer/header buffer > takes most of time For druid and other storage handlers that do not have > footer buffer we should skip the logic for checking the existence for storage > handlers atleast. -- This message was sent by Atlassian JIRA (v7.6.3#76005)
[jira] [Updated] (HIVE-20279) HiveContextAwareRecordReader slows down Druid Scan queries.
[ https://issues.apache.org/jira/browse/HIVE-20279?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Nishant Bangarwa updated HIVE-20279: Attachment: HIVE-20279.patch > HiveContextAwareRecordReader slows down Druid Scan queries. > > > Key: HIVE-20279 > URL: https://issues.apache.org/jira/browse/HIVE-20279 > Project: Hive > Issue Type: Improvement >Reporter: Nishant Bangarwa >Assignee: Nishant Bangarwa >Priority: Major > Attachments: HIVE-20279.patch, scan2.svg > > > HiveContextAwareRecordReader add lots of overhead for Druid Scan Queries. > See attached flame graph. > Looks like the operations for checking for existence of footer/header buffer > takes most of time For druid and other storage handlers that do not have > footer buffer we should skip the logic for checking the existence for storage > handlers atleast. -- This message was sent by Atlassian JIRA (v7.6.3#76005)
