[jira] [Updated] (HBASE-3967) Support deletes in HFileOutputFormat based bulk import mechanism
[ https://issues.apache.org/jira/browse/HBASE-3967?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Nick Dimiduk updated HBASE-3967: Attachment: 3967-janky-verify.patch I think this is a non-issue. I hacked up TestHFileOutputFormat to generate deletes and it looks like Delete markers are respected. Patch attached. We could also extend HBASE-7938 to test more explicitly for these conditions. > Support deletes in HFileOutputFormat based bulk import mechanism > > > Key: HBASE-3967 > URL: https://issues.apache.org/jira/browse/HBASE-3967 > Project: HBase > Issue Type: Sub-task >Reporter: Kannan Muthukkaruppan >Priority: Critical > Fix For: 0.95.0 > > Attachments: 3967-janky-verify.patch, diff.patch > > > During bulk imports, it'll be useful to be able to do delete mutations > (either to delete data that already exists in HBase or was inserted earlier > during this run of the import). > For example, we have a use case, where we are processing a log of data which > may have both inserts and deletes in the mix and we want to upload that into > HBase using the bulk import mechanism. -- This message is automatically generated by JIRA. If you think it was sent incorrectly, please contact your JIRA administrators For more information on JIRA, see: http://www.atlassian.com/software/jira
[jira] [Updated] (HBASE-3967) Support deletes in HFileOutputFormat based bulk import mechanism
[ https://issues.apache.org/jira/browse/HBASE-3967?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Nick Dimiduk updated HBASE-3967: Component/s: mapreduce > Support deletes in HFileOutputFormat based bulk import mechanism > > > Key: HBASE-3967 > URL: https://issues.apache.org/jira/browse/HBASE-3967 > Project: HBase > Issue Type: Sub-task > Components: mapreduce >Reporter: Kannan Muthukkaruppan >Priority: Critical > Fix For: 0.95.0 > > Attachments: 3967-janky-verify.patch, diff.patch > > > During bulk imports, it'll be useful to be able to do delete mutations > (either to delete data that already exists in HBase or was inserted earlier > during this run of the import). > For example, we have a use case, where we are processing a log of data which > may have both inserts and deletes in the mix and we want to upload that into > HBase using the bulk import mechanism. -- This message is automatically generated by JIRA. If you think it was sent incorrectly, please contact your JIRA administrators For more information on JIRA, see: http://www.atlassian.com/software/jira
[jira] [Updated] (HBASE-3967) Support deletes in HFileOutputFormat based bulk import mechanism
[ https://issues.apache.org/jira/browse/HBASE-3967?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Lars Hofhansl updated HBASE-3967: - Priority: Critical (was: Blocker) > Support deletes in HFileOutputFormat based bulk import mechanism > > > Key: HBASE-3967 > URL: https://issues.apache.org/jira/browse/HBASE-3967 > Project: HBase > Issue Type: Sub-task >Reporter: Kannan Muthukkaruppan >Priority: Critical > Fix For: 0.96.0 > > Attachments: diff.patch > > > During bulk imports, it'll be useful to be able to do delete mutations > (either to delete data that already exists in HBase or was inserted earlier > during this run of the import). > For example, we have a use case, where we are processing a log of data which > may have both inserts and deletes in the mix and we want to upload that into > HBase using the bulk import mechanism. -- This message is automatically generated by JIRA. If you think it was sent incorrectly, please contact your JIRA administrators: https://issues.apache.org/jira/secure/ContactAdministrators!default.jspa For more information on JIRA, see: http://www.atlassian.com/software/jira
[jira] [Updated] (HBASE-3967) Support deletes in HFileOutputFormat based bulk import mechanism
[ https://issues.apache.org/jira/browse/HBASE-3967?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Lars Hofhansl updated HBASE-3967: - Fix Version/s: (was: 0.94.0) 0.96.0 Moving out of 0.94. Pull back if you disagree. > Support deletes in HFileOutputFormat based bulk import mechanism > > > Key: HBASE-3967 > URL: https://issues.apache.org/jira/browse/HBASE-3967 > Project: HBase > Issue Type: Sub-task >Reporter: Kannan Muthukkaruppan >Priority: Blocker > Fix For: 0.96.0 > > Attachments: diff.patch > > > During bulk imports, it'll be useful to be able to do delete mutations > (either to delete data that already exists in HBase or was inserted earlier > during this run of the import). > For example, we have a use case, where we are processing a log of data which > may have both inserts and deletes in the mix and we want to upload that into > HBase using the bulk import mechanism. -- This message is automatically generated by JIRA. If you think it was sent incorrectly, please contact your JIRA administrators: https://issues.apache.org/jira/secure/ContactAdministrators!default.jspa For more information on JIRA, see: http://www.atlassian.com/software/jira
[jira] [Updated] (HBASE-3967) Support deletes in HFileOutputFormat based bulk import mechanism
[ https://issues.apache.org/jira/browse/HBASE-3967?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] stack updated HBASE-3967: - Fix Version/s: (was: 0.96.0) 0.94.0 Misread. N said 0.94 blocker. > Support deletes in HFileOutputFormat based bulk import mechanism > > > Key: HBASE-3967 > URL: https://issues.apache.org/jira/browse/HBASE-3967 > Project: HBase > Issue Type: Sub-task >Reporter: Kannan Muthukkaruppan >Priority: Blocker > Fix For: 0.94.0 > > Attachments: diff.patch > > > During bulk imports, it'll be useful to be able to do delete mutations > (either to delete data that already exists in HBase or was inserted earlier > during this run of the import). > For example, we have a use case, where we are processing a log of data which > may have both inserts and deletes in the mix and we want to upload that into > HBase using the bulk import mechanism. -- This message is automatically generated by JIRA. If you think it was sent incorrectly, please contact your JIRA administrators: https://issues.apache.org/jira/secure/ContactAdministrators!default.jspa For more information on JIRA, see: http://www.atlassian.com/software/jira
[jira] [Updated] (HBASE-3967) Support deletes in HFileOutputFormat based bulk import mechanism
[ https://issues.apache.org/jira/browse/HBASE-3967?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] stack updated HBASE-3967: - Priority: Blocker (was: Major) Fix Version/s: 0.96.0 Making blocker on 0.96 at Nicolas's suggestion > Support deletes in HFileOutputFormat based bulk import mechanism > > > Key: HBASE-3967 > URL: https://issues.apache.org/jira/browse/HBASE-3967 > Project: HBase > Issue Type: Sub-task >Reporter: Kannan Muthukkaruppan >Priority: Blocker > Fix For: 0.96.0 > > Attachments: diff.patch > > > During bulk imports, it'll be useful to be able to do delete mutations > (either to delete data that already exists in HBase or was inserted earlier > during this run of the import). > For example, we have a use case, where we are processing a log of data which > may have both inserts and deletes in the mix and we want to upload that into > HBase using the bulk import mechanism. -- This message is automatically generated by JIRA. If you think it was sent incorrectly, please contact your JIRA administrators: https://issues.apache.org/jira/secure/ContactAdministrators!default.jspa For more information on JIRA, see: http://www.atlassian.com/software/jira
[jira] [Updated] (HBASE-3967) Support deletes in HFileOutputFormat based bulk import mechanism
[ https://issues.apache.org/jira/browse/HBASE-3967?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Nicolas Spiegelberg updated HBASE-3967: --- Issue Type: Sub-task (was: Improvement) Parent: HBASE-4907 > Support deletes in HFileOutputFormat based bulk import mechanism > > > Key: HBASE-3967 > URL: https://issues.apache.org/jira/browse/HBASE-3967 > Project: HBase > Issue Type: Sub-task >Reporter: Kannan Muthukkaruppan >Assignee: Bogdan-Alexandru Matican > Attachments: diff.patch > > > During bulk imports, it'll be useful to be able to do delete mutations > (either to delete data that already exists in HBase or was inserted earlier > during this run of the import). > For example, we have a use case, where we are processing a log of data which > may have both inserts and deletes in the mix and we want to upload that into > HBase using the bulk import mechanism. -- This message is automatically generated by JIRA. If you think it was sent incorrectly, please contact your JIRA administrators: https://issues.apache.org/jira/secure/ContactAdministrators!default.jspa For more information on JIRA, see: http://www.atlassian.com/software/jira
[jira] [Updated] (HBASE-3967) Support deletes in HFileOutputFormat based bulk import mechanism
[ https://issues.apache.org/jira/browse/HBASE-3967?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Bogdan-Alexandru Matican updated HBASE-3967: Attachment: diff.patch The Row modifications are made for our internal branch since we didn't have the lastest ones... > Support deletes in HFileOutputFormat based bulk import mechanism > > > Key: HBASE-3967 > URL: https://issues.apache.org/jira/browse/HBASE-3967 > Project: HBase > Issue Type: Improvement >Reporter: Kannan Muthukkaruppan >Assignee: Bogdan-Alexandru Matican > Attachments: diff.patch > > > During bulk imports, it'll be useful to be able to do delete mutations > (either to delete data that already exists in HBase or was inserted earlier > during this run of the import). > For example, we have a use case, where we are processing a log of data which > may have both inserts and deletes in the mix and we want to upload that into > HBase using the bulk import mechanism. -- This message is automatically generated by JIRA. For more information on JIRA, see: http://www.atlassian.com/software/jira
[jira] [Updated] (HBASE-3967) Support deletes in HFileOutputFormat based bulk import mechanism
[ https://issues.apache.org/jira/browse/HBASE-3967?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Kannan Muthukkaruppan updated HBASE-3967: - Summary: Support deletes in HFileOutputFormat based bulk import mechanism (was: Add support to HFileOutputFormat based bulk imports to add Delete mutations) > Support deletes in HFileOutputFormat based bulk import mechanism > > > Key: HBASE-3967 > URL: https://issues.apache.org/jira/browse/HBASE-3967 > Project: HBase > Issue Type: Improvement >Reporter: Kannan Muthukkaruppan > > During bulk imports, it'll be useful to be able to do delete mutations > (either to delete data that already exists in HBase or was inserted earlier > during this run of the import). > For example, we have a use case, where we are processing a log of data which > may have both inserts and deletes in the mix and we want to upload that into > HBase using the bulk import mechanism. -- This message is automatically generated by JIRA. For more information on JIRA, see: http://www.atlassian.com/software/jira
