[jira] [Resolved] (IMPALA-4835) HDFS scans should operate with a constrained number of I/O buffers
[ https://issues.apache.org/jira/browse/IMPALA-4835?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Tim Armstrong resolved IMPALA-4835. --- Resolution: Fixed Fix Version/s: Impala 3.1.0 Impala 2.13.0 > HDFS scans should operate with a constrained number of I/O buffers > -- > > Key: IMPALA-4835 > URL: https://issues.apache.org/jira/browse/IMPALA-4835 > Project: IMPALA > Issue Type: Improvement > Components: Backend >Affects Versions: Impala 2.9.0 >Reporter: Tim Armstrong >Assignee: Tim Armstrong >Priority: Major > Labels: resource-management > Fix For: Impala 2.13.0, Impala 3.1.0 > > > The HDFS scan nodes should be able to operate with a fixed number of I/O > buffers in most cases (excluding very large rows). We should modify them to > claim a reservation upfront and use this for all disk I/O. > This probably also requires switching DiskIoMgr to allocate memory from > BufferPool. -- This message was sent by Atlassian JIRA (v7.6.3#76005)
[jira] [Resolved] (IMPALA-4835) HDFS scans should operate with a constrained number of I/O buffers
[ https://issues.apache.org/jira/browse/IMPALA-4835?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Tim Armstrong resolved IMPALA-4835. --- Resolution: Fixed Fix Version/s: Impala 3.1.0 Impala 2.13.0 > HDFS scans should operate with a constrained number of I/O buffers > -- > > Key: IMPALA-4835 > URL: https://issues.apache.org/jira/browse/IMPALA-4835 > Project: IMPALA > Issue Type: Improvement > Components: Backend >Affects Versions: Impala 2.9.0 >Reporter: Tim Armstrong >Assignee: Tim Armstrong >Priority: Major > Labels: resource-management > Fix For: Impala 2.13.0, Impala 3.1.0 > > > The HDFS scan nodes should be able to operate with a fixed number of I/O > buffers in most cases (excluding very large rows). We should modify them to > claim a reservation upfront and use this for all disk I/O. > This probably also requires switching DiskIoMgr to allocate memory from > BufferPool. -- This message was sent by Atlassian JIRA (v7.6.3#76005) - To unsubscribe, e-mail: issues-all-unsubscr...@impala.apache.org For additional commands, e-mail: issues-all-h...@impala.apache.org
[jira] [Resolved] (IMPALA-4835) HDFS scans should operate with a constrained number of I/O buffers
[ https://issues.apache.org/jira/browse/IMPALA-4835?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Tim Armstrong resolved IMPALA-4835. --- Resolution: Fixed Fix Version/s: Impala 3.0 > HDFS scans should operate with a constrained number of I/O buffers > -- > > Key: IMPALA-4835 > URL: https://issues.apache.org/jira/browse/IMPALA-4835 > Project: IMPALA > Issue Type: Improvement > Components: Backend >Affects Versions: Impala 2.9.0 >Reporter: Tim Armstrong >Assignee: Tim Armstrong >Priority: Major > Labels: resource-management > Fix For: Impala 3.0 > > > The HDFS scan nodes should be able to operate with a fixed number of I/O > buffers in most cases (excluding very large rows). We should modify them to > claim a reservation upfront and use this for all disk I/O. > This probably also requires switching DiskIoMgr to allocate memory from > BufferPool. -- This message was sent by Atlassian JIRA (v7.6.3#76005)
