[jira] [Updated] (HBASE-20618) Skip large rows instead of throwing an exception to client
[ https://issues.apache.org/jira/browse/HBASE-20618?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Michael Stack updated HBASE-20618: -- Fix Version/s: (was: 1.7.0) (was: 2.3.0) (was: 3.0.0) > Skip large rows instead of throwing an exception to client > -- > > Key: HBASE-20618 > URL: https://issues.apache.org/jira/browse/HBASE-20618 > Project: HBase > Issue Type: New Feature >Reporter: Swapna >Priority: Minor > Attachments: HBASE-20618.hbasemaster.v01.patch, > HBASE-20618.hbasemaster.v02.patch, HBASE-20618.v1.branch-1.patch, > HBASE-20618.v1.branch-1.patch > > > Currently HBase supports throwing RowTooBigException incase there is a row > with one of the column family data exceeds the configured maximum > https://issues.apache.org/jira/browse/HBASE-10925?attachmentOrder=desc > We have some bad rows growing very large. We need a way to skip these rows > for most of our jobs. > Some of the options we considered: > Option 1: > Hbase client handle the exception and restart the scanner past bad row by > capturing the row key where it failed. Can be by adding the rowkey to the > exception stack trace, which seems brittle. Client would ignore the setting > if its upgraded before server. > Option 2: > Skip through big rows on Server.Go with server level config similar to > "hbase.table.max.rowsize" or request based by changing the scan request api. > If allowed to do per request, based on the scan request config, Client will > have to ignore the setting if its upgraded before server. > {code} > try { > populateResult(results, this.storeHeap, scannerContext, current); > } catch(RowTooBigException e) { > LOG.info("Row exceeded the limit in storeheap. Skipping row with > key:"+Bytes.toString(current.getRowArray())); > this.storeHeap.reseek(PrivateCellUtil.createLastOnRow(current)); > results.clear(); > scannerContext.clearProgress(); > continue; > } > {code} > Prefer the option 2 with server level config. Please share your inputs -- This message was sent by Atlassian Jira (v8.3.4#803005)
[jira] [Updated] (HBASE-20618) Skip large rows instead of throwing an exception to client
[ https://issues.apache.org/jira/browse/HBASE-20618?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Andrew Kyle Purtell updated HBASE-20618: Fix Version/s: (was: 1.5.0) 1.6.0 > Skip large rows instead of throwing an exception to client > -- > > Key: HBASE-20618 > URL: https://issues.apache.org/jira/browse/HBASE-20618 > Project: HBase > Issue Type: New Feature >Reporter: Swapna >Priority: Minor > Fix For: 3.0.0, 2.3.0, 1.6.0 > > Attachments: HBASE-20618.hbasemaster.v01.patch, > HBASE-20618.hbasemaster.v02.patch, HBASE-20618.v1.branch-1.patch, > HBASE-20618.v1.branch-1.patch > > > Currently HBase supports throwing RowTooBigException incase there is a row > with one of the column family data exceeds the configured maximum > https://issues.apache.org/jira/browse/HBASE-10925?attachmentOrder=desc > We have some bad rows growing very large. We need a way to skip these rows > for most of our jobs. > Some of the options we considered: > Option 1: > Hbase client handle the exception and restart the scanner past bad row by > capturing the row key where it failed. Can be by adding the rowkey to the > exception stack trace, which seems brittle. Client would ignore the setting > if its upgraded before server. > Option 2: > Skip through big rows on Server.Go with server level config similar to > "hbase.table.max.rowsize" or request based by changing the scan request api. > If allowed to do per request, based on the scan request config, Client will > have to ignore the setting if its upgraded before server. > {code} > try { > populateResult(results, this.storeHeap, scannerContext, current); > } catch(RowTooBigException e) { > LOG.info("Row exceeded the limit in storeheap. Skipping row with > key:"+Bytes.toString(current.getRowArray())); > this.storeHeap.reseek(PrivateCellUtil.createLastOnRow(current)); > results.clear(); > scannerContext.clearProgress(); > continue; > } > {code} > Prefer the option 2 with server level config. Please share your inputs -- This message was sent by Atlassian Jira (v8.3.4#803005)
[jira] [Updated] (HBASE-20618) Skip large rows instead of throwing an exception to client
[ https://issues.apache.org/jira/browse/HBASE-20618?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Andrew Purtell updated HBASE-20618: --- Fix Version/s: (was: 1.5.1) 1.6.0 Status: Open (was: Patch Available) > Skip large rows instead of throwing an exception to client > -- > > Key: HBASE-20618 > URL: https://issues.apache.org/jira/browse/HBASE-20618 > Project: HBase > Issue Type: New Feature >Reporter: Swapna >Priority: Minor > Fix For: 3.0.0, 1.6.0, 2.3.0 > > Attachments: HBASE-20618.hbasemaster.v01.patch, > HBASE-20618.hbasemaster.v02.patch, HBASE-20618.v1.branch-1.patch, > HBASE-20618.v1.branch-1.patch > > > Currently HBase supports throwing RowTooBigException incase there is a row > with one of the column family data exceeds the configured maximum > https://issues.apache.org/jira/browse/HBASE-10925?attachmentOrder=desc > We have some bad rows growing very large. We need a way to skip these rows > for most of our jobs. > Some of the options we considered: > Option 1: > Hbase client handle the exception and restart the scanner past bad row by > capturing the row key where it failed. Can be by adding the rowkey to the > exception stack trace, which seems brittle. Client would ignore the setting > if its upgraded before server. > Option 2: > Skip through big rows on Server.Go with server level config similar to > "hbase.table.max.rowsize" or request based by changing the scan request api. > If allowed to do per request, based on the scan request config, Client will > have to ignore the setting if its upgraded before server. > {code} > try { > populateResult(results, this.storeHeap, scannerContext, current); > } catch(RowTooBigException e) { > LOG.info("Row exceeded the limit in storeheap. Skipping row with > key:"+Bytes.toString(current.getRowArray())); > this.storeHeap.reseek(PrivateCellUtil.createLastOnRow(current)); > results.clear(); > scannerContext.clearProgress(); > continue; > } > {code} > Prefer the option 2 with server level config. Please share your inputs -- This message was sent by Atlassian JIRA (v7.6.3#76005)
[jira] [Updated] (HBASE-20618) Skip large rows instead of throwing an exception to client
[ https://issues.apache.org/jira/browse/HBASE-20618?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Norbert Kalmar updated HBASE-20618: --- Attachment: (was: HBASE-20618.master.001.patch) > Skip large rows instead of throwing an exception to client > -- > > Key: HBASE-20618 > URL: https://issues.apache.org/jira/browse/HBASE-20618 > Project: HBase > Issue Type: New Feature >Reporter: Swapna >Priority: Minor > Fix For: 3.0.0, 2.3.0, 1.5.1 > > Attachments: HBASE-20618.hbasemaster.v01.patch, > HBASE-20618.hbasemaster.v02.patch, HBASE-20618.v1.branch-1.patch, > HBASE-20618.v1.branch-1.patch > > > Currently HBase supports throwing RowTooBigException incase there is a row > with one of the column family data exceeds the configured maximum > https://issues.apache.org/jira/browse/HBASE-10925?attachmentOrder=desc > We have some bad rows growing very large. We need a way to skip these rows > for most of our jobs. > Some of the options we considered: > Option 1: > Hbase client handle the exception and restart the scanner past bad row by > capturing the row key where it failed. Can be by adding the rowkey to the > exception stack trace, which seems brittle. Client would ignore the setting > if its upgraded before server. > Option 2: > Skip through big rows on Server.Go with server level config similar to > "hbase.table.max.rowsize" or request based by changing the scan request api. > If allowed to do per request, based on the scan request config, Client will > have to ignore the setting if its upgraded before server. > {code} > try { > populateResult(results, this.storeHeap, scannerContext, current); > } catch(RowTooBigException e) { > LOG.info("Row exceeded the limit in storeheap. Skipping row with > key:"+Bytes.toString(current.getRowArray())); > this.storeHeap.reseek(PrivateCellUtil.createLastOnRow(current)); > results.clear(); > scannerContext.clearProgress(); > continue; > } > {code} > Prefer the option 2 with server level config. Please share your inputs -- This message was sent by Atlassian JIRA (v7.6.3#76005)
[jira] [Updated] (HBASE-20618) Skip large rows instead of throwing an exception to client
[ https://issues.apache.org/jira/browse/HBASE-20618?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Norbert Kalmar updated HBASE-20618: --- Attachment: HBASE-20618.master.001.patch > Skip large rows instead of throwing an exception to client > -- > > Key: HBASE-20618 > URL: https://issues.apache.org/jira/browse/HBASE-20618 > Project: HBase > Issue Type: New Feature >Reporter: Swapna >Priority: Minor > Fix For: 3.0.0, 2.3.0, 1.5.1 > > Attachments: HBASE-20618.hbasemaster.v01.patch, > HBASE-20618.hbasemaster.v02.patch, HBASE-20618.master.001.patch, > HBASE-20618.v1.branch-1.patch, HBASE-20618.v1.branch-1.patch > > > Currently HBase supports throwing RowTooBigException incase there is a row > with one of the column family data exceeds the configured maximum > https://issues.apache.org/jira/browse/HBASE-10925?attachmentOrder=desc > We have some bad rows growing very large. We need a way to skip these rows > for most of our jobs. > Some of the options we considered: > Option 1: > Hbase client handle the exception and restart the scanner past bad row by > capturing the row key where it failed. Can be by adding the rowkey to the > exception stack trace, which seems brittle. Client would ignore the setting > if its upgraded before server. > Option 2: > Skip through big rows on Server.Go with server level config similar to > "hbase.table.max.rowsize" or request based by changing the scan request api. > If allowed to do per request, based on the scan request config, Client will > have to ignore the setting if its upgraded before server. > {code} > try { > populateResult(results, this.storeHeap, scannerContext, current); > } catch(RowTooBigException e) { > LOG.info("Row exceeded the limit in storeheap. Skipping row with > key:"+Bytes.toString(current.getRowArray())); > this.storeHeap.reseek(PrivateCellUtil.createLastOnRow(current)); > results.clear(); > scannerContext.clearProgress(); > continue; > } > {code} > Prefer the option 2 with server level config. Please share your inputs -- This message was sent by Atlassian JIRA (v7.6.3#76005)
[jira] [Updated] (HBASE-20618) Skip large rows instead of throwing an exception to client
[ https://issues.apache.org/jira/browse/HBASE-20618?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Andrew Purtell updated HBASE-20618: --- Fix Version/s: (was: 1.5.0) 1.5.1 > Skip large rows instead of throwing an exception to client > -- > > Key: HBASE-20618 > URL: https://issues.apache.org/jira/browse/HBASE-20618 > Project: HBase > Issue Type: New Feature >Reporter: Swapna >Priority: Minor > Fix For: 3.0.0, 2.3.0, 1.5.1 > > Attachments: HBASE-20618.hbasemaster.v01.patch, > HBASE-20618.hbasemaster.v02.patch, HBASE-20618.v1.branch-1.patch, > HBASE-20618.v1.branch-1.patch > > > Currently HBase supports throwing RowTooBigException incase there is a row > with one of the column family data exceeds the configured maximum > https://issues.apache.org/jira/browse/HBASE-10925?attachmentOrder=desc > We have some bad rows growing very large. We need a way to skip these rows > for most of our jobs. > Some of the options we considered: > Option 1: > Hbase client handle the exception and restart the scanner past bad row by > capturing the row key where it failed. Can be by adding the rowkey to the > exception stack trace, which seems brittle. Client would ignore the setting > if its upgraded before server. > Option 2: > Skip through big rows on Server.Go with server level config similar to > "hbase.table.max.rowsize" or request based by changing the scan request api. > If allowed to do per request, based on the scan request config, Client will > have to ignore the setting if its upgraded before server. > {code} > try { > populateResult(results, this.storeHeap, scannerContext, current); > } catch(RowTooBigException e) { > LOG.info("Row exceeded the limit in storeheap. Skipping row with > key:"+Bytes.toString(current.getRowArray())); > this.storeHeap.reseek(PrivateCellUtil.createLastOnRow(current)); > results.clear(); > scannerContext.clearProgress(); > continue; > } > {code} > Prefer the option 2 with server level config. Please share your inputs -- This message was sent by Atlassian JIRA (v7.6.3#76005)
[jira] [Updated] (HBASE-20618) Skip large rows instead of throwing an exception to client
[ https://issues.apache.org/jira/browse/HBASE-20618?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Guanghao Zhang updated HBASE-20618: --- Fix Version/s: (was: 2.2.0) 2.3.0 > Skip large rows instead of throwing an exception to client > -- > > Key: HBASE-20618 > URL: https://issues.apache.org/jira/browse/HBASE-20618 > Project: HBase > Issue Type: New Feature >Reporter: Swapna >Priority: Minor > Fix For: 3.0.0, 1.5.0, 2.3.0 > > Attachments: HBASE-20618.hbasemaster.v01.patch, > HBASE-20618.hbasemaster.v02.patch, HBASE-20618.v1.branch-1.patch, > HBASE-20618.v1.branch-1.patch > > > Currently HBase supports throwing RowTooBigException incase there is a row > with one of the column family data exceeds the configured maximum > https://issues.apache.org/jira/browse/HBASE-10925?attachmentOrder=desc > We have some bad rows growing very large. We need a way to skip these rows > for most of our jobs. > Some of the options we considered: > Option 1: > Hbase client handle the exception and restart the scanner past bad row by > capturing the row key where it failed. Can be by adding the rowkey to the > exception stack trace, which seems brittle. Client would ignore the setting > if its upgraded before server. > Option 2: > Skip through big rows on Server.Go with server level config similar to > "hbase.table.max.rowsize" or request based by changing the scan request api. > If allowed to do per request, based on the scan request config, Client will > have to ignore the setting if its upgraded before server. > {code} > try { > populateResult(results, this.storeHeap, scannerContext, current); > } catch(RowTooBigException e) { > LOG.info("Row exceeded the limit in storeheap. Skipping row with > key:"+Bytes.toString(current.getRowArray())); > this.storeHeap.reseek(PrivateCellUtil.createLastOnRow(current)); > results.clear(); > scannerContext.clearProgress(); > continue; > } > {code} > Prefer the option 2 with server level config. Please share your inputs -- This message was sent by Atlassian JIRA (v7.6.3#76005)
[jira] [Updated] (HBASE-20618) Skip large rows instead of throwing an exception to client
[ https://issues.apache.org/jira/browse/HBASE-20618?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Andrew Purtell updated HBASE-20618: --- Fix Version/s: (was: 2.0.2) (was: 1.4.6) 2.2.0 1.5.0 > Skip large rows instead of throwing an exception to client > -- > > Key: HBASE-20618 > URL: https://issues.apache.org/jira/browse/HBASE-20618 > Project: HBase > Issue Type: New Feature >Reporter: Swapna >Priority: Minor > Fix For: 3.0.0, 1.5.0, 2.2.0 > > Attachments: HBASE-20618.hbasemaster.v01.patch, > HBASE-20618.hbasemaster.v02.patch, HBASE-20618.v1.branch-1.patch, > HBASE-20618.v1.branch-1.patch > > > Currently HBase supports throwing RowTooBigException incase there is a row > with one of the column family data exceeds the configured maximum > https://issues.apache.org/jira/browse/HBASE-10925?attachmentOrder=desc > We have some bad rows growing very large. We need a way to skip these rows > for most of our jobs. > Some of the options we considered: > Option 1: > Hbase client handle the exception and restart the scanner past bad row by > capturing the row key where it failed. Can be by adding the rowkey to the > exception stack trace, which seems brittle. Client would ignore the setting > if its upgraded before server. > Option 2: > Skip through big rows on Server.Go with server level config similar to > "hbase.table.max.rowsize" or request based by changing the scan request api. > If allowed to do per request, based on the scan request config, Client will > have to ignore the setting if its upgraded before server. > {code} > try { > populateResult(results, this.storeHeap, scannerContext, current); > } catch(RowTooBigException e) { > LOG.info("Row exceeded the limit in storeheap. Skipping row with > key:"+Bytes.toString(current.getRowArray())); > this.storeHeap.reseek(PrivateCellUtil.createLastOnRow(current)); > results.clear(); > scannerContext.clearProgress(); > continue; > } > {code} > Prefer the option 2 with server level config. Please share your inputs -- This message was sent by Atlassian JIRA (v7.6.3#76005)
[jira] [Updated] (HBASE-20618) Skip large rows instead of throwing an exception to client
[ https://issues.apache.org/jira/browse/HBASE-20618?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] stack updated HBASE-20618: -- Fix Version/s: (was: 2.0.1) 2.0.2 > Skip large rows instead of throwing an exception to client > -- > > Key: HBASE-20618 > URL: https://issues.apache.org/jira/browse/HBASE-20618 > Project: HBase > Issue Type: New Feature >Reporter: Swapna >Priority: Minor > Fix For: 3.0.0, 1.4.6, 2.0.2 > > Attachments: HBASE-20618.hbasemaster.v01.patch, > HBASE-20618.hbasemaster.v02.patch, HBASE-20618.v1.branch-1.patch, > HBASE-20618.v1.branch-1.patch > > > Currently HBase supports throwing RowTooBigException incase there is a row > with one of the column family data exceeds the configured maximum > https://issues.apache.org/jira/browse/HBASE-10925?attachmentOrder=desc > We have some bad rows growing very large. We need a way to skip these rows > for most of our jobs. > Some of the options we considered: > Option 1: > Hbase client handle the exception and restart the scanner past bad row by > capturing the row key where it failed. Can be by adding the rowkey to the > exception stack trace, which seems brittle. Client would ignore the setting > if its upgraded before server. > Option 2: > Skip through big rows on Server.Go with server level config similar to > "hbase.table.max.rowsize" or request based by changing the scan request api. > If allowed to do per request, based on the scan request config, Client will > have to ignore the setting if its upgraded before server. > {code} > try { > populateResult(results, this.storeHeap, scannerContext, current); > } catch(RowTooBigException e) { > LOG.info("Row exceeded the limit in storeheap. Skipping row with > key:"+Bytes.toString(current.getRowArray())); > this.storeHeap.reseek(PrivateCellUtil.createLastOnRow(current)); > results.clear(); > scannerContext.clearProgress(); > continue; > } > {code} > Prefer the option 2 with server level config. Please share your inputs -- This message was sent by Atlassian JIRA (v7.6.3#76005)
[jira] [Updated] (HBASE-20618) Skip large rows instead of throwing an exception to client
[ https://issues.apache.org/jira/browse/HBASE-20618?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Josh Elser updated HBASE-20618: --- Fix Version/s: (was: 1.4.5) 1.4.6 > Skip large rows instead of throwing an exception to client > -- > > Key: HBASE-20618 > URL: https://issues.apache.org/jira/browse/HBASE-20618 > Project: HBase > Issue Type: New Feature >Reporter: Swapna >Priority: Minor > Fix For: 3.0.0, 2.0.1, 1.4.6 > > Attachments: HBASE-20618.hbasemaster.v01.patch, > HBASE-20618.hbasemaster.v02.patch, HBASE-20618.v1.branch-1.patch, > HBASE-20618.v1.branch-1.patch > > > Currently HBase supports throwing RowTooBigException incase there is a row > with one of the column family data exceeds the configured maximum > https://issues.apache.org/jira/browse/HBASE-10925?attachmentOrder=desc > We have some bad rows growing very large. We need a way to skip these rows > for most of our jobs. > Some of the options we considered: > Option 1: > Hbase client handle the exception and restart the scanner past bad row by > capturing the row key where it failed. Can be by adding the rowkey to the > exception stack trace, which seems brittle. Client would ignore the setting > if its upgraded before server. > Option 2: > Skip through big rows on Server.Go with server level config similar to > "hbase.table.max.rowsize" or request based by changing the scan request api. > If allowed to do per request, based on the scan request config, Client will > have to ignore the setting if its upgraded before server. > {code} > try { > populateResult(results, this.storeHeap, scannerContext, current); > } catch(RowTooBigException e) { > LOG.info("Row exceeded the limit in storeheap. Skipping row with > key:"+Bytes.toString(current.getRowArray())); > this.storeHeap.reseek(PrivateCellUtil.createLastOnRow(current)); > results.clear(); > scannerContext.clearProgress(); > continue; > } > {code} > Prefer the option 2 with server level config. Please share your inputs -- This message was sent by Atlassian JIRA (v7.6.3#76005)
[jira] [Updated] (HBASE-20618) Skip large rows instead of throwing an exception to client
[ https://issues.apache.org/jira/browse/HBASE-20618?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] churro morales updated HBASE-20618: --- Fix Version/s: (was: 2.1.0) 2.0.1 > Skip large rows instead of throwing an exception to client > -- > > Key: HBASE-20618 > URL: https://issues.apache.org/jira/browse/HBASE-20618 > Project: HBase > Issue Type: New Feature >Reporter: Swapna >Priority: Minor > Fix For: 3.0.0, 2.0.1, 1.4.5 > > Attachments: HBASE-20618.hbasemaster.v01.patch, > HBASE-20618.hbasemaster.v02.patch, HBASE-20618.v1.branch-1.patch, > HBASE-20618.v1.branch-1.patch > > > Currently HBase supports throwing RowTooBigException incase there is a row > with one of the column family data exceeds the configured maximum > https://issues.apache.org/jira/browse/HBASE-10925?attachmentOrder=desc > We have some bad rows growing very large. We need a way to skip these rows > for most of our jobs. > Some of the options we considered: > Option 1: > Hbase client handle the exception and restart the scanner past bad row by > capturing the row key where it failed. Can be by adding the rowkey to the > exception stack trace, which seems brittle. Client would ignore the setting > if its upgraded before server. > Option 2: > Skip through big rows on Server.Go with server level config similar to > "hbase.table.max.rowsize" or request based by changing the scan request api. > If allowed to do per request, based on the scan request config, Client will > have to ignore the setting if its upgraded before server. > {code} > try { > populateResult(results, this.storeHeap, scannerContext, current); > } catch(RowTooBigException e) { > LOG.info("Row exceeded the limit in storeheap. Skipping row with > key:"+Bytes.toString(current.getRowArray())); > this.storeHeap.reseek(PrivateCellUtil.createLastOnRow(current)); > results.clear(); > scannerContext.clearProgress(); > continue; > } > {code} > Prefer the option 2 with server level config. Please share your inputs -- This message was sent by Atlassian JIRA (v7.6.3#76005)
[jira] [Updated] (HBASE-20618) Skip large rows instead of throwing an exception to client
[ https://issues.apache.org/jira/browse/HBASE-20618?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] churro morales updated HBASE-20618: --- Affects Version/s: (was: 1.4.5) (was: 2.1.0) (was: 3.0.0) > Skip large rows instead of throwing an exception to client > -- > > Key: HBASE-20618 > URL: https://issues.apache.org/jira/browse/HBASE-20618 > Project: HBase > Issue Type: New Feature >Reporter: Swapna >Priority: Minor > Fix For: 3.0.0, 2.1.0, 1.4.5 > > Attachments: HBASE-20618.hbasemaster.v01.patch, > HBASE-20618.hbasemaster.v02.patch, HBASE-20618.v1.branch-1.patch, > HBASE-20618.v1.branch-1.patch > > > Currently HBase supports throwing RowTooBigException incase there is a row > with one of the column family data exceeds the configured maximum > https://issues.apache.org/jira/browse/HBASE-10925?attachmentOrder=desc > We have some bad rows growing very large. We need a way to skip these rows > for most of our jobs. > Some of the options we considered: > Option 1: > Hbase client handle the exception and restart the scanner past bad row by > capturing the row key where it failed. Can be by adding the rowkey to the > exception stack trace, which seems brittle. Client would ignore the setting > if its upgraded before server. > Option 2: > Skip through big rows on Server.Go with server level config similar to > "hbase.table.max.rowsize" or request based by changing the scan request api. > If allowed to do per request, based on the scan request config, Client will > have to ignore the setting if its upgraded before server. > {code} > try { > populateResult(results, this.storeHeap, scannerContext, current); > } catch(RowTooBigException e) { > LOG.info("Row exceeded the limit in storeheap. Skipping row with > key:"+Bytes.toString(current.getRowArray())); > this.storeHeap.reseek(PrivateCellUtil.createLastOnRow(current)); > results.clear(); > scannerContext.clearProgress(); > continue; > } > {code} > Prefer the option 2 with server level config. Please share your inputs -- This message was sent by Atlassian JIRA (v7.6.3#76005)
[jira] [Updated] (HBASE-20618) Skip large rows instead of throwing an exception to client
[ https://issues.apache.org/jira/browse/HBASE-20618?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] churro morales updated HBASE-20618: --- Fix Version/s: 1.4.5 2.1.0 3.0.0 > Skip large rows instead of throwing an exception to client > -- > > Key: HBASE-20618 > URL: https://issues.apache.org/jira/browse/HBASE-20618 > Project: HBase > Issue Type: New Feature >Reporter: Swapna >Priority: Minor > Fix For: 3.0.0, 2.1.0, 1.4.5 > > Attachments: HBASE-20618.hbasemaster.v01.patch, > HBASE-20618.hbasemaster.v02.patch, HBASE-20618.v1.branch-1.patch, > HBASE-20618.v1.branch-1.patch > > > Currently HBase supports throwing RowTooBigException incase there is a row > with one of the column family data exceeds the configured maximum > https://issues.apache.org/jira/browse/HBASE-10925?attachmentOrder=desc > We have some bad rows growing very large. We need a way to skip these rows > for most of our jobs. > Some of the options we considered: > Option 1: > Hbase client handle the exception and restart the scanner past bad row by > capturing the row key where it failed. Can be by adding the rowkey to the > exception stack trace, which seems brittle. Client would ignore the setting > if its upgraded before server. > Option 2: > Skip through big rows on Server.Go with server level config similar to > "hbase.table.max.rowsize" or request based by changing the scan request api. > If allowed to do per request, based on the scan request config, Client will > have to ignore the setting if its upgraded before server. > {code} > try { > populateResult(results, this.storeHeap, scannerContext, current); > } catch(RowTooBigException e) { > LOG.info("Row exceeded the limit in storeheap. Skipping row with > key:"+Bytes.toString(current.getRowArray())); > this.storeHeap.reseek(PrivateCellUtil.createLastOnRow(current)); > results.clear(); > scannerContext.clearProgress(); > continue; > } > {code} > Prefer the option 2 with server level config. Please share your inputs -- This message was sent by Atlassian JIRA (v7.6.3#76005)
[jira] [Updated] (HBASE-20618) Skip large rows instead of throwing an exception to client
[ https://issues.apache.org/jira/browse/HBASE-20618?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] churro morales updated HBASE-20618: --- Affects Version/s: (was: 2.0.0) (was: 1.0.0) 1.4.5 2.1.0 > Skip large rows instead of throwing an exception to client > -- > > Key: HBASE-20618 > URL: https://issues.apache.org/jira/browse/HBASE-20618 > Project: HBase > Issue Type: New Feature >Affects Versions: 3.0.0, 2.1.0, 1.4.5 >Reporter: Swapna >Priority: Minor > Attachments: HBASE-20618.hbasemaster.v01.patch, > HBASE-20618.hbasemaster.v02.patch, HBASE-20618.v1.branch-1.patch, > HBASE-20618.v1.branch-1.patch > > > Currently HBase supports throwing RowTooBigException incase there is a row > with one of the column family data exceeds the configured maximum > https://issues.apache.org/jira/browse/HBASE-10925?attachmentOrder=desc > We have some bad rows growing very large. We need a way to skip these rows > for most of our jobs. > Some of the options we considered: > Option 1: > Hbase client handle the exception and restart the scanner past bad row by > capturing the row key where it failed. Can be by adding the rowkey to the > exception stack trace, which seems brittle. Client would ignore the setting > if its upgraded before server. > Option 2: > Skip through big rows on Server.Go with server level config similar to > "hbase.table.max.rowsize" or request based by changing the scan request api. > If allowed to do per request, based on the scan request config, Client will > have to ignore the setting if its upgraded before server. > {code} > try { > populateResult(results, this.storeHeap, scannerContext, current); > } catch(RowTooBigException e) { > LOG.info("Row exceeded the limit in storeheap. Skipping row with > key:"+Bytes.toString(current.getRowArray())); > this.storeHeap.reseek(PrivateCellUtil.createLastOnRow(current)); > results.clear(); > scannerContext.clearProgress(); > continue; > } > {code} > Prefer the option 2 with server level config. Please share your inputs -- This message was sent by Atlassian JIRA (v7.6.3#76005)
[jira] [Updated] (HBASE-20618) Skip large rows instead of throwing an exception to client
[ https://issues.apache.org/jira/browse/HBASE-20618?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Swapna updated HBASE-20618: --- Attachment: HBASE-20618.v1.branch-1.patch Status: Patch Available (was: Open) > Skip large rows instead of throwing an exception to client > -- > > Key: HBASE-20618 > URL: https://issues.apache.org/jira/browse/HBASE-20618 > Project: HBase > Issue Type: New Feature >Affects Versions: 2.0.0, 1.0.0, 3.0.0 >Reporter: Swapna >Priority: Minor > Attachments: HBASE-20618.hbasemaster.v01.patch, > HBASE-20618.hbasemaster.v02.patch, HBASE-20618.v1.branch-1.patch, > HBASE-20618.v1.branch-1.patch > > > Currently HBase supports throwing RowTooBigException incase there is a row > with one of the column family data exceeds the configured maximum > https://issues.apache.org/jira/browse/HBASE-10925?attachmentOrder=desc > We have some bad rows growing very large. We need a way to skip these rows > for most of our jobs. > Some of the options we considered: > Option 1: > Hbase client handle the exception and restart the scanner past bad row by > capturing the row key where it failed. Can be by adding the rowkey to the > exception stack trace, which seems brittle. Client would ignore the setting > if its upgraded before server. > Option 2: > Skip through big rows on Server.Go with server level config similar to > "hbase.table.max.rowsize" or request based by changing the scan request api. > If allowed to do per request, based on the scan request config, Client will > have to ignore the setting if its upgraded before server. > {code} > try { > populateResult(results, this.storeHeap, scannerContext, current); > } catch(RowTooBigException e) { > LOG.info("Row exceeded the limit in storeheap. Skipping row with > key:"+Bytes.toString(current.getRowArray())); > this.storeHeap.reseek(PrivateCellUtil.createLastOnRow(current)); > results.clear(); > scannerContext.clearProgress(); > continue; > } > {code} > Prefer the option 2 with server level config. Please share your inputs -- This message was sent by Atlassian JIRA (v7.6.3#76005)
[jira] [Updated] (HBASE-20618) Skip large rows instead of throwing an exception to client
[ https://issues.apache.org/jira/browse/HBASE-20618?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Swapna updated HBASE-20618: --- Status: Open (was: Patch Available) > Skip large rows instead of throwing an exception to client > -- > > Key: HBASE-20618 > URL: https://issues.apache.org/jira/browse/HBASE-20618 > Project: HBase > Issue Type: New Feature >Affects Versions: 1.0.0 >Reporter: Swapna >Priority: Minor > Attachments: HBASE-20618.hbasemaster.v01.patch, > HBASE-20618.hbasemaster.v02.patch, HBASE-20618.v1.branch-1.patch > > > Currently HBase supports throwing RowTooBigException incase there is a row > with one of the column family data exceeds the configured maximum > https://issues.apache.org/jira/browse/HBASE-10925?attachmentOrder=desc > We have some bad rows growing very large. We need a way to skip these rows > for most of our jobs. > Some of the options we considered: > Option 1: > Hbase client handle the exception and restart the scanner past bad row by > capturing the row key where it failed. Can be by adding the rowkey to the > exception stack trace, which seems brittle. Client would ignore the setting > if its upgraded before server. > Option 2: > Skip through big rows on Server.Go with server level config similar to > "hbase.table.max.rowsize" or request based by changing the scan request api. > If allowed to do per request, based on the scan request config, Client will > have to ignore the setting if its upgraded before server. > {code} > try { > populateResult(results, this.storeHeap, scannerContext, current); > } catch(RowTooBigException e) { > LOG.info("Row exceeded the limit in storeheap. Skipping row with > key:"+Bytes.toString(current.getRowArray())); > this.storeHeap.reseek(PrivateCellUtil.createLastOnRow(current)); > results.clear(); > scannerContext.clearProgress(); > continue; > } > {code} > Prefer the option 2 with server level config. Please share your inputs -- This message was sent by Atlassian JIRA (v7.6.3#76005)
[jira] [Updated] (HBASE-20618) Skip large rows instead of throwing an exception to client
[ https://issues.apache.org/jira/browse/HBASE-20618?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Swapna updated HBASE-20618: --- Affects Version/s: 3.0.0 2.0.0 > Skip large rows instead of throwing an exception to client > -- > > Key: HBASE-20618 > URL: https://issues.apache.org/jira/browse/HBASE-20618 > Project: HBase > Issue Type: New Feature >Affects Versions: 1.0.0, 3.0.0, 2.0.0 >Reporter: Swapna >Priority: Minor > Attachments: HBASE-20618.hbasemaster.v01.patch, > HBASE-20618.hbasemaster.v02.patch, HBASE-20618.v1.branch-1.patch > > > Currently HBase supports throwing RowTooBigException incase there is a row > with one of the column family data exceeds the configured maximum > https://issues.apache.org/jira/browse/HBASE-10925?attachmentOrder=desc > We have some bad rows growing very large. We need a way to skip these rows > for most of our jobs. > Some of the options we considered: > Option 1: > Hbase client handle the exception and restart the scanner past bad row by > capturing the row key where it failed. Can be by adding the rowkey to the > exception stack trace, which seems brittle. Client would ignore the setting > if its upgraded before server. > Option 2: > Skip through big rows on Server.Go with server level config similar to > "hbase.table.max.rowsize" or request based by changing the scan request api. > If allowed to do per request, based on the scan request config, Client will > have to ignore the setting if its upgraded before server. > {code} > try { > populateResult(results, this.storeHeap, scannerContext, current); > } catch(RowTooBigException e) { > LOG.info("Row exceeded the limit in storeheap. Skipping row with > key:"+Bytes.toString(current.getRowArray())); > this.storeHeap.reseek(PrivateCellUtil.createLastOnRow(current)); > results.clear(); > scannerContext.clearProgress(); > continue; > } > {code} > Prefer the option 2 with server level config. Please share your inputs -- This message was sent by Atlassian JIRA (v7.6.3#76005)
[jira] [Updated] (HBASE-20618) Skip large rows instead of throwing an exception to client
[ https://issues.apache.org/jira/browse/HBASE-20618?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Swapna updated HBASE-20618: --- Affects Version/s: (was: 3.0.0) 1.0.0 Attachment: HBASE-20618.v1.branch-1.patch Status: Patch Available (was: Open) > Skip large rows instead of throwing an exception to client > -- > > Key: HBASE-20618 > URL: https://issues.apache.org/jira/browse/HBASE-20618 > Project: HBase > Issue Type: New Feature >Affects Versions: 1.0.0 >Reporter: Swapna >Priority: Minor > Attachments: HBASE-20618.hbasemaster.v01.patch, > HBASE-20618.hbasemaster.v02.patch, HBASE-20618.v1.branch-1.patch > > > Currently HBase supports throwing RowTooBigException incase there is a row > with one of the column family data exceeds the configured maximum > https://issues.apache.org/jira/browse/HBASE-10925?attachmentOrder=desc > We have some bad rows growing very large. We need a way to skip these rows > for most of our jobs. > Some of the options we considered: > Option 1: > Hbase client handle the exception and restart the scanner past bad row by > capturing the row key where it failed. Can be by adding the rowkey to the > exception stack trace, which seems brittle. Client would ignore the setting > if its upgraded before server. > Option 2: > Skip through big rows on Server.Go with server level config similar to > "hbase.table.max.rowsize" or request based by changing the scan request api. > If allowed to do per request, based on the scan request config, Client will > have to ignore the setting if its upgraded before server. > {code} > try { > populateResult(results, this.storeHeap, scannerContext, current); > } catch(RowTooBigException e) { > LOG.info("Row exceeded the limit in storeheap. Skipping row with > key:"+Bytes.toString(current.getRowArray())); > this.storeHeap.reseek(PrivateCellUtil.createLastOnRow(current)); > results.clear(); > scannerContext.clearProgress(); > continue; > } > {code} > Prefer the option 2 with server level config. Please share your inputs -- This message was sent by Atlassian JIRA (v7.6.3#76005)
[jira] [Updated] (HBASE-20618) Skip large rows instead of throwing an exception to client
[ https://issues.apache.org/jira/browse/HBASE-20618?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Swapna updated HBASE-20618: --- Status: Open (was: Patch Available) > Skip large rows instead of throwing an exception to client > -- > > Key: HBASE-20618 > URL: https://issues.apache.org/jira/browse/HBASE-20618 > Project: HBase > Issue Type: New Feature >Affects Versions: 3.0.0 >Reporter: Swapna >Priority: Minor > Attachments: HBASE-20618.hbasemaster.v01.patch, > HBASE-20618.hbasemaster.v02.patch > > > Currently HBase supports throwing RowTooBigException incase there is a row > with one of the column family data exceeds the configured maximum > https://issues.apache.org/jira/browse/HBASE-10925?attachmentOrder=desc > We have some bad rows growing very large. We need a way to skip these rows > for most of our jobs. > Some of the options we considered: > Option 1: > Hbase client handle the exception and restart the scanner past bad row by > capturing the row key where it failed. Can be by adding the rowkey to the > exception stack trace, which seems brittle. Client would ignore the setting > if its upgraded before server. > Option 2: > Skip through big rows on Server.Go with server level config similar to > "hbase.table.max.rowsize" or request based by changing the scan request api. > If allowed to do per request, based on the scan request config, Client will > have to ignore the setting if its upgraded before server. > {code} > try { > populateResult(results, this.storeHeap, scannerContext, current); > } catch(RowTooBigException e) { > LOG.info("Row exceeded the limit in storeheap. Skipping row with > key:"+Bytes.toString(current.getRowArray())); > this.storeHeap.reseek(PrivateCellUtil.createLastOnRow(current)); > results.clear(); > scannerContext.clearProgress(); > continue; > } > {code} > Prefer the option 2 with server level config. Please share your inputs -- This message was sent by Atlassian JIRA (v7.6.3#76005)
[jira] [Updated] (HBASE-20618) Skip large rows instead of throwing an exception to client
[ https://issues.apache.org/jira/browse/HBASE-20618?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Swapna updated HBASE-20618: --- Attachment: HBASE-20618.hbasemaster.v02.patch Status: Patch Available (was: Open) > Skip large rows instead of throwing an exception to client > -- > > Key: HBASE-20618 > URL: https://issues.apache.org/jira/browse/HBASE-20618 > Project: HBase > Issue Type: New Feature >Affects Versions: 3.0.0 >Reporter: Swapna >Priority: Minor > Attachments: HBASE-20618.hbasemaster.v01.patch, > HBASE-20618.hbasemaster.v02.patch > > > Currently HBase supports throwing RowTooBigException incase there is a row > with one of the column family data exceeds the configured maximum > https://issues.apache.org/jira/browse/HBASE-10925?attachmentOrder=desc > We have some bad rows growing very large. We need a way to skip these rows > for most of our jobs. > Some of the options we considered: > Option 1: > Hbase client handle the exception and restart the scanner past bad row by > capturing the row key where it failed. Can be by adding the rowkey to the > exception stack trace, which seems brittle. Client would ignore the setting > if its upgraded before server. > Option 2: > Skip through big rows on Server.Go with server level config similar to > "hbase.table.max.rowsize" or request based by changing the scan request api. > If allowed to do per request, based on the scan request config, Client will > have to ignore the setting if its upgraded before server. > {code} > try { > populateResult(results, this.storeHeap, scannerContext, current); > } catch(RowTooBigException e) { > LOG.info("Row exceeded the limit in storeheap. Skipping row with > key:"+Bytes.toString(current.getRowArray())); > this.storeHeap.reseek(PrivateCellUtil.createLastOnRow(current)); > results.clear(); > scannerContext.clearProgress(); > continue; > } > {code} > Prefer the option 2 with server level config. Please share your inputs -- This message was sent by Atlassian JIRA (v7.6.3#76005)
[jira] [Updated] (HBASE-20618) Skip large rows instead of throwing an exception to client
[ https://issues.apache.org/jira/browse/HBASE-20618?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Swapna updated HBASE-20618: --- Status: Open (was: Patch Available) > Skip large rows instead of throwing an exception to client > -- > > Key: HBASE-20618 > URL: https://issues.apache.org/jira/browse/HBASE-20618 > Project: HBase > Issue Type: New Feature >Affects Versions: 3.0.0 >Reporter: Swapna >Priority: Minor > Attachments: HBASE-20618.hbasemaster.v01.patch > > > Currently HBase supports throwing RowTooBigException incase there is a row > with one of the column family data exceeds the configured maximum > https://issues.apache.org/jira/browse/HBASE-10925?attachmentOrder=desc > We have some bad rows growing very large. We need a way to skip these rows > for most of our jobs. > Some of the options we considered: > Option 1: > Hbase client handle the exception and restart the scanner past bad row by > capturing the row key where it failed. Can be by adding the rowkey to the > exception stack trace, which seems brittle. Client would ignore the setting > if its upgraded before server. > Option 2: > Skip through big rows on Server.Go with server level config similar to > "hbase.table.max.rowsize" or request based by changing the scan request api. > If allowed to do per request, based on the scan request config, Client will > have to ignore the setting if its upgraded before server. > {code} > try { > populateResult(results, this.storeHeap, scannerContext, current); > } catch(RowTooBigException e) { > LOG.info("Row exceeded the limit in storeheap. Skipping row with > key:"+Bytes.toString(current.getRowArray())); > this.storeHeap.reseek(PrivateCellUtil.createLastOnRow(current)); > results.clear(); > scannerContext.clearProgress(); > continue; > } > {code} > Prefer the option 2 with server level config. Please share your inputs -- This message was sent by Atlassian JIRA (v7.6.3#76005)
[jira] [Updated] (HBASE-20618) Skip large rows instead of throwing an exception to client
[ https://issues.apache.org/jira/browse/HBASE-20618?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Swapna updated HBASE-20618: --- Attachment: (was: HBASE-20618.hbasemaster.v01.patch) > Skip large rows instead of throwing an exception to client > -- > > Key: HBASE-20618 > URL: https://issues.apache.org/jira/browse/HBASE-20618 > Project: HBase > Issue Type: New Feature >Affects Versions: 3.0.0 >Reporter: Swapna >Priority: Minor > Attachments: HBASE-20618.hbasemaster.v01.patch > > > Currently HBase supports throwing RowTooBigException incase there is a row > with one of the column family data exceeds the configured maximum > https://issues.apache.org/jira/browse/HBASE-10925?attachmentOrder=desc > We have some bad rows growing very large. We need a way to skip these rows > for most of our jobs. > Some of the options we considered: > Option 1: > Hbase client handle the exception and restart the scanner past bad row by > capturing the row key where it failed. Can be by adding the rowkey to the > exception stack trace, which seems brittle. Client would ignore the setting > if its upgraded before server. > Option 2: > Skip through big rows on Server.Go with server level config similar to > "hbase.table.max.rowsize" or request based by changing the scan request api. > If allowed to do per request, based on the scan request config, Client will > have to ignore the setting if its upgraded before server. > {code} > try { > populateResult(results, this.storeHeap, scannerContext, current); > } catch(RowTooBigException e) { > LOG.info("Row exceeded the limit in storeheap. Skipping row with > key:"+Bytes.toString(current.getRowArray())); > this.storeHeap.reseek(PrivateCellUtil.createLastOnRow(current)); > results.clear(); > scannerContext.clearProgress(); > continue; > } > {code} > Prefer the option 2 with server level config. Please share your inputs -- This message was sent by Atlassian JIRA (v7.6.3#76005)
[jira] [Updated] (HBASE-20618) Skip large rows instead of throwing an exception to client
[ https://issues.apache.org/jira/browse/HBASE-20618?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Swapna updated HBASE-20618: --- Attachment: HBASE-20618.hbasemaster.v01.patch Status: Patch Available (was: Open) > Skip large rows instead of throwing an exception to client > -- > > Key: HBASE-20618 > URL: https://issues.apache.org/jira/browse/HBASE-20618 > Project: HBase > Issue Type: New Feature >Affects Versions: 3.0.0 >Reporter: Swapna >Priority: Minor > Attachments: HBASE-20618.hbasemaster.v01.patch > > > Currently HBase supports throwing RowTooBigException incase there is a row > with one of the column family data exceeds the configured maximum > https://issues.apache.org/jira/browse/HBASE-10925?attachmentOrder=desc > We have some bad rows growing very large. We need a way to skip these rows > for most of our jobs. > Some of the options we considered: > Option 1: > Hbase client handle the exception and restart the scanner past bad row by > capturing the row key where it failed. Can be by adding the rowkey to the > exception stack trace, which seems brittle. Client would ignore the setting > if its upgraded before server. > Option 2: > Skip through big rows on Server.Go with server level config similar to > "hbase.table.max.rowsize" or request based by changing the scan request api. > If allowed to do per request, based on the scan request config, Client will > have to ignore the setting if its upgraded before server. > {code} > try { > populateResult(results, this.storeHeap, scannerContext, current); > } catch(RowTooBigException e) { > LOG.info("Row exceeded the limit in storeheap. Skipping row with > key:"+Bytes.toString(current.getRowArray())); > this.storeHeap.reseek(PrivateCellUtil.createLastOnRow(current)); > results.clear(); > scannerContext.clearProgress(); > continue; > } > {code} > Prefer the option 2 with server level config. Please share your inputs -- This message was sent by Atlassian JIRA (v7.6.3#76005)
[jira] [Updated] (HBASE-20618) Skip large rows instead of throwing an exception to client
[ https://issues.apache.org/jira/browse/HBASE-20618?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Swapna updated HBASE-20618: --- Attachment: HBASE-20618.hbasemaster.v01.patch > Skip large rows instead of throwing an exception to client > -- > > Key: HBASE-20618 > URL: https://issues.apache.org/jira/browse/HBASE-20618 > Project: HBase > Issue Type: New Feature >Affects Versions: 3.0.0 >Reporter: Swapna >Priority: Minor > Attachments: HBASE-20618.hbasemaster.v01.patch > > > Currently HBase supports throwing RowTooBigException incase there is a row > with one of the column family data exceeds the configured maximum > https://issues.apache.org/jira/browse/HBASE-10925?attachmentOrder=desc > We have some bad rows growing very large. We need a way to skip these rows > for most of our jobs. > Some of the options we considered: > Option 1: > Hbase client handle the exception and restart the scanner past bad row by > capturing the row key where it failed. Can be by adding the rowkey to the > exception stack trace, which seems brittle. Client would ignore the setting > if its upgraded before server. > Option 2: > Skip through big rows on Server.Go with server level config similar to > "hbase.table.max.rowsize" or request based by changing the scan request api. > If allowed to do per request, based on the scan request config, Client will > have to ignore the setting if its upgraded before server. > {code} > try { > populateResult(results, this.storeHeap, scannerContext, current); > } catch(RowTooBigException e) { > LOG.info("Row exceeded the limit in storeheap. Skipping row with > key:"+Bytes.toString(current.getRowArray())); > this.storeHeap.reseek(PrivateCellUtil.createLastOnRow(current)); > results.clear(); > scannerContext.clearProgress(); > continue; > } > {code} > Prefer the option 2 with server level config. Please share your inputs -- This message was sent by Atlassian JIRA (v7.6.3#76005)