[jira] [Updated] (HBASE-10660) MR over snapshots can OOM when alternative blockcache is enabled

2014-03-07 Thread Nick Dimiduk (JIRA) 

 [ 
https://issues.apache.org/jira/browse/HBASE-10660?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
 ]

Nick Dimiduk updated HBASE-10660:
-

Fix Version/s: 0.99.0
   0.98.1

> MR over snapshots can OOM when alternative blockcache is enabled
> 
>
> Key: HBASE-10660
> URL: https://issues.apache.org/jira/browse/HBASE-10660
> Project: HBase
>  Issue Type: Bug
>  Components: mapreduce
>Affects Versions: 0.98.0, 0.99.0
>Reporter: Nick Dimiduk
>Assignee: Nick Dimiduk
> Fix For: 0.98.1, 0.99.0
>
> Attachments: HBASE-10660.00.patch, HBASE-10660.01.patch, 
> HBASE-10660.02.patch, HBASE-10660.03.patch
>
>
> Running {{IntegrationTestTableSnapshotInputFormat}} with the {{BucketCache}} 
> enabled results in OOM. The map task is running a sequential scan over the 
> region region it opened, so probably it's not benefiting much from a 
> blockcache. Just disable blockcache entirely for these scans because it's 
> likely the cache config detected is designed for a RS running on a different 
> class of hardware than that running the map task.



--
This message was sent by Atlassian JIRA
(v6.2#6252)

[jira] [Updated] (HBASE-10660) MR over snapshots can OOM when alternative blockcache is enabled

2014-03-06 Thread Nick Dimiduk (JIRA) 

 [ 
https://issues.apache.org/jira/browse/HBASE-10660?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
 ]

Nick Dimiduk updated HBASE-10660:
-

Status: Open  (was: Patch Available)

Canceling patch as it isn't working on my test cluster.

> MR over snapshots can OOM when alternative blockcache is enabled
> 
>
> Key: HBASE-10660
> URL: https://issues.apache.org/jira/browse/HBASE-10660
> Project: HBase
>  Issue Type: Bug
>  Components: mapreduce
>Affects Versions: 0.98.0, 0.99.0
>Reporter: Nick Dimiduk
>Assignee: Nick Dimiduk
> Attachments: HBASE-10660.00.patch, HBASE-10660.01.patch, 
> HBASE-10660.02.patch, HBASE-10660.03.patch
>
>
> Running {{IntegrationTestTableSnapshotInputFormat}} with the {{BucketCache}} 
> enabled results in OOM. The map task is running a sequential scan over the 
> region region it opened, so probably it's not benefiting much from a 
> blockcache. Just disable blockcache entirely for these scans because it's 
> likely the cache config detected is designed for a RS running on a different 
> class of hardware than that running the map task.



--
This message was sent by Atlassian JIRA
(v6.2#6252)

[jira] [Updated] (HBASE-10660) MR over snapshots can OOM when alternative blockcache is enabled

2014-03-06 Thread Nick Dimiduk (JIRA) 

 [ 
https://issues.apache.org/jira/browse/HBASE-10660?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
 ]

Nick Dimiduk updated HBASE-10660:
-

Attachment: HBASE-10660.03.patch

Once more, using hadoop-1 compatible API.

> MR over snapshots can OOM when alternative blockcache is enabled
> 
>
> Key: HBASE-10660
> URL: https://issues.apache.org/jira/browse/HBASE-10660
> Project: HBase
>  Issue Type: Bug
>  Components: mapreduce
>Affects Versions: 0.98.0, 0.99.0
>Reporter: Nick Dimiduk
>Assignee: Nick Dimiduk
> Attachments: HBASE-10660.00.patch, HBASE-10660.01.patch, 
> HBASE-10660.02.patch, HBASE-10660.03.patch
>
>
> Running {{IntegrationTestTableSnapshotInputFormat}} with the {{BucketCache}} 
> enabled results in OOM. The map task is running a sequential scan over the 
> region region it opened, so probably it's not benefiting much from a 
> blockcache. Just disable blockcache entirely for these scans because it's 
> likely the cache config detected is designed for a RS running on a different 
> class of hardware than that running the map task.



--
This message was sent by Atlassian JIRA
(v6.2#6252)

[jira] [Updated] (HBASE-10660) MR over snapshots can OOM when alternative blockcache is enabled

2014-03-05 Thread Nick Dimiduk (JIRA) 

 [ 
https://issues.apache.org/jira/browse/HBASE-10660?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
 ]

Nick Dimiduk updated HBASE-10660:
-

Attachment: HBASE-10660.02.patch

Thanks for the reminder, [~lhofhansl].

> MR over snapshots can OOM when alternative blockcache is enabled
> 
>
> Key: HBASE-10660
> URL: https://issues.apache.org/jira/browse/HBASE-10660
> Project: HBase
>  Issue Type: Bug
>  Components: mapreduce
>Affects Versions: 0.98.0, 0.99.0
>Reporter: Nick Dimiduk
>Assignee: Nick Dimiduk
> Attachments: HBASE-10660.00.patch, HBASE-10660.01.patch, 
> HBASE-10660.02.patch
>
>
> Running {{IntegrationTestTableSnapshotInputFormat}} with the {{BucketCache}} 
> enabled results in OOM. The map task is running a sequential scan over the 
> region region it opened, so probably it's not benefiting much from a 
> blockcache. Just disable blockcache entirely for these scans because it's 
> likely the cache config detected is designed for a RS running on a different 
> class of hardware than that running the map task.



--
This message was sent by Atlassian JIRA
(v6.2#6252)

[jira] [Updated] (HBASE-10660) MR over snapshots can OOM when alternative blockcache is enabled

2014-03-05 Thread Nick Dimiduk (JIRA) 

 [ 
https://issues.apache.org/jira/browse/HBASE-10660?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
 ]

Nick Dimiduk updated HBASE-10660:
-

Attachment: HBASE-10660.01.patch

This version enforces creation of an LruBlockCache instance with default 
configuration. Testing is primitive.

> MR over snapshots can OOM when alternative blockcache is enabled
> 
>
> Key: HBASE-10660
> URL: https://issues.apache.org/jira/browse/HBASE-10660
> Project: HBase
>  Issue Type: Bug
>  Components: mapreduce
>Affects Versions: 0.98.0, 0.99.0
>Reporter: Nick Dimiduk
>Assignee: Nick Dimiduk
> Attachments: HBASE-10660.00.patch, HBASE-10660.01.patch
>
>
> Running {{IntegrationTestTableSnapshotInputFormat}} with the {{BucketCache}} 
> enabled results in OOM. The map task is running a sequential scan over the 
> region region it opened, so probably it's not benefiting much from a 
> blockcache. Just disable blockcache entirely for these scans because it's 
> likely the cache config detected is designed for a RS running on a different 
> class of hardware than that running the map task.



--
This message was sent by Atlassian JIRA
(v6.2#6252)

[jira] [Updated] (HBASE-10660) MR over snapshots can OOM when alternative blockcache is enabled

2014-03-03 Thread Nick Dimiduk (JIRA) 

 [ 
https://issues.apache.org/jira/browse/HBASE-10660?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
 ]

Nick Dimiduk updated HBASE-10660:
-

Attachment: HBASE-10660.00.patch

Simple patch.

> MR over snapshots can OOM when alternative blockcache is enabled
> 
>
> Key: HBASE-10660
> URL: https://issues.apache.org/jira/browse/HBASE-10660
> Project: HBase
>  Issue Type: Bug
>  Components: mapreduce
>Affects Versions: 0.98.0, 0.99.0
>Reporter: Nick Dimiduk
>Assignee: Nick Dimiduk
> Attachments: HBASE-10660.00.patch
>
>
> Running {{IntegrationTestTableSnapshotInputFormat}} with the {{BucketCache}} 
> enabled results in OOM. The map task is running a sequential scan over the 
> region region it opened, so probably it's not benefiting much from a 
> blockcache. Just disable blockcache entirely for these scans because it's 
> likely the cache config detected is designed for a RS running on a different 
> class of hardware than that running the map task.



--
This message was sent by Atlassian JIRA
(v6.2#6252)

[jira] [Updated] (HBASE-10660) MR over snapshots can OOM when alternative blockcache is enabled

2014-03-03 Thread Nick Dimiduk (JIRA) 

 [ 
https://issues.apache.org/jira/browse/HBASE-10660?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
 ]

Nick Dimiduk updated HBASE-10660:
-

Status: Patch Available  (was: Open)

> MR over snapshots can OOM when alternative blockcache is enabled
> 
>
> Key: HBASE-10660
> URL: https://issues.apache.org/jira/browse/HBASE-10660
> Project: HBase
>  Issue Type: Bug
>  Components: mapreduce
>Affects Versions: 0.98.0, 0.99.0
>Reporter: Nick Dimiduk
>Assignee: Nick Dimiduk
> Attachments: HBASE-10660.00.patch
>
>
> Running {{IntegrationTestTableSnapshotInputFormat}} with the {{BucketCache}} 
> enabled results in OOM. The map task is running a sequential scan over the 
> region region it opened, so probably it's not benefiting much from a 
> blockcache. Just disable blockcache entirely for these scans because it's 
> likely the cache config detected is designed for a RS running on a different 
> class of hardware than that running the map task.



--
This message was sent by Atlassian JIRA
(v6.2#6252)