[jira] [Commented] (HBASE-13897) OOM may occur when Import imports a row with too many KeyValues
[ https://issues.apache.org/jira/browse/HBASE-13897?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14627295#comment-14627295 ] Andrew Purtell commented on HBASE-13897: Yes, I am about to commit a reapply with a fixup for a minor reject in the imports. OOM may occur when Import imports a row with too many KeyValues --- Key: HBASE-13897 URL: https://issues.apache.org/jira/browse/HBASE-13897 Project: HBase Issue Type: Bug Affects Versions: 0.98.13 Reporter: Liu Junhong Assignee: Liu Junhong Fix For: 2.0.0, 1.3.0 Attachments: 13897-v2.txt, HBASE-13897-0.98-20150710-suitable_for_hadoop1.patch, HBASE-13897-0.98-20150710.patch, HBASE-13897-0.98.patch, HBASE-13897-branch_1-20150709.patch, HBASE-13897-master-20150629.patch, HBASE-13897-master-20150630.patch, HBASE-13897-master-20150707.patch, HBASE-13897-master.patch When importing a row with too many KeyValues (may have too many columns or versions)，KeyValueReducer will incur OOM. -- This message was sent by Atlassian JIRA (v6.3.4#6332)
[jira] [Commented] (HBASE-13897) OOM may occur when Import imports a row with too many KeyValues
[ https://issues.apache.org/jira/browse/HBASE-13897?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14627289#comment-14627289 ] Ted Yu commented on HBASE-13897: TaskCounter was not introduced by the 0.98 patch. Compilation error w.r.t. TaskCounter was existing prior to the integration of 0.98 patch - see https://builds.apache.org/job/HBase-0.98-on-Hadoop-1.1/1002/console There was only one commit shown by https://builds.apache.org/job/HBase-0.98-on-Hadoop-1.1/1002/ OOM may occur when Import imports a row with too many KeyValues --- Key: HBASE-13897 URL: https://issues.apache.org/jira/browse/HBASE-13897 Project: HBase Issue Type: Bug Affects Versions: 0.98.13 Reporter: Liu Junhong Assignee: Liu Junhong Fix For: 2.0.0, 1.3.0 Attachments: 13897-v2.txt, HBASE-13897-0.98-20150710-suitable_for_hadoop1.patch, HBASE-13897-0.98-20150710.patch, HBASE-13897-0.98.patch, HBASE-13897-branch_1-20150709.patch, HBASE-13897-master-20150629.patch, HBASE-13897-master-20150630.patch, HBASE-13897-master-20150707.patch, HBASE-13897-master.patch When importing a row with too many KeyValues (may have too many columns or versions)，KeyValueReducer will incur OOM. -- This message was sent by Atlassian JIRA (v6.3.4#6332)
[jira] [Commented] (HBASE-13897) OOM may occur when Import imports a row with too many KeyValues
[ https://issues.apache.org/jira/browse/HBASE-13897?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14627290#comment-14627290 ] Ted Yu commented on HBASE-13897: Just saw the last comment on HBASE-13352 Please reapply the 0.98 patch. OOM may occur when Import imports a row with too many KeyValues --- Key: HBASE-13897 URL: https://issues.apache.org/jira/browse/HBASE-13897 Project: HBase Issue Type: Bug Affects Versions: 0.98.13 Reporter: Liu Junhong Assignee: Liu Junhong Fix For: 2.0.0, 1.3.0 Attachments: 13897-v2.txt, HBASE-13897-0.98-20150710-suitable_for_hadoop1.patch, HBASE-13897-0.98-20150710.patch, HBASE-13897-0.98.patch, HBASE-13897-branch_1-20150709.patch, HBASE-13897-master-20150629.patch, HBASE-13897-master-20150630.patch, HBASE-13897-master-20150707.patch, HBASE-13897-master.patch When importing a row with too many KeyValues (may have too many columns or versions)，KeyValueReducer will incur OOM. -- This message was sent by Atlassian JIRA (v6.3.4#6332)
[jira] [Commented] (HBASE-13897) OOM may occur when Import imports a row with too many KeyValues
[ https://issues.apache.org/jira/browse/HBASE-13897?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14627464#comment-14627464 ] Hudson commented on HBASE-13897: FAILURE: Integrated in HBase-0.98 #1057 (See [https://builds.apache.org/job/HBase-0.98/1057/]) Revert HBASE-13897 OOM may occur when Import imports a row with too many KeyValues (Liu Junhong) (apurtell: rev 94d5e7accc06c767ef52337f03574f96516bae50) * hbase-server/src/main/java/org/apache/hadoop/hbase/mapreduce/Import.java HBASE-13897 OOM may occur when Import imports a row with too many KeyValues (Liu Junhong) (apurtell: rev 16ada337090bc4da7a99ebcfbad54d3a0afbbbef) * hbase-server/src/main/java/org/apache/hadoop/hbase/mapreduce/Import.java OOM may occur when Import imports a row with too many KeyValues --- Key: HBASE-13897 URL: https://issues.apache.org/jira/browse/HBASE-13897 Project: HBase Issue Type: Bug Affects Versions: 0.98.13 Reporter: Liu Junhong Assignee: Liu Junhong Fix For: 2.0.0, 0.98.14, 1.3.0 Attachments: 13897-v2.txt, HBASE-13897-0.98-20150710-suitable_for_hadoop1.patch, HBASE-13897-0.98-20150710.patch, HBASE-13897-0.98.patch, HBASE-13897-branch_1-20150709.patch, HBASE-13897-master-20150629.patch, HBASE-13897-master-20150630.patch, HBASE-13897-master-20150707.patch, HBASE-13897-master.patch When importing a row with too many KeyValues (may have too many columns or versions)，KeyValueReducer will incur OOM. -- This message was sent by Atlassian JIRA (v6.3.4#6332)
[jira] [Commented] (HBASE-13897) OOM may occur when Import imports a row with too many KeyValues
[ https://issues.apache.org/jira/browse/HBASE-13897?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14627532#comment-14627532 ] Hudson commented on HBASE-13897: FAILURE: Integrated in HBase-0.98-on-Hadoop-1.1 #1010 (See [https://builds.apache.org/job/HBase-0.98-on-Hadoop-1.1/1010/]) Revert HBASE-13897 OOM may occur when Import imports a row with too many KeyValues (Liu Junhong) (apurtell: rev 94d5e7accc06c767ef52337f03574f96516bae50) * hbase-server/src/main/java/org/apache/hadoop/hbase/mapreduce/Import.java HBASE-13897 OOM may occur when Import imports a row with too many KeyValues (Liu Junhong) (apurtell: rev 16ada337090bc4da7a99ebcfbad54d3a0afbbbef) * hbase-server/src/main/java/org/apache/hadoop/hbase/mapreduce/Import.java OOM may occur when Import imports a row with too many KeyValues --- Key: HBASE-13897 URL: https://issues.apache.org/jira/browse/HBASE-13897 Project: HBase Issue Type: Bug Affects Versions: 0.98.13 Reporter: Liu Junhong Assignee: Liu Junhong Fix For: 2.0.0, 0.98.14, 1.3.0 Attachments: 13897-v2.txt, HBASE-13897-0.98-20150710-suitable_for_hadoop1.patch, HBASE-13897-0.98-20150710.patch, HBASE-13897-0.98.patch, HBASE-13897-branch_1-20150709.patch, HBASE-13897-master-20150629.patch, HBASE-13897-master-20150630.patch, HBASE-13897-master-20150707.patch, HBASE-13897-master.patch When importing a row with too many KeyValues (may have too many columns or versions)，KeyValueReducer will incur OOM. -- This message was sent by Atlassian JIRA (v6.3.4#6332)
[jira] [Commented] (HBASE-13897) OOM may occur when Import imports a row with too many KeyValues
[ https://issues.apache.org/jira/browse/HBASE-13897?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14622358#comment-14622358 ] Hudson commented on HBASE-13897: FAILURE: Integrated in HBase-0.98-on-Hadoop-1.1 #1009 (See [https://builds.apache.org/job/HBase-0.98-on-Hadoop-1.1/1009/]) HBASE-13897 OOM may occur when Import imports a row with too many KeyValues (Liu Junhong) (tedyu: rev 372b71b7fe8399c6655972049d8bf089d87cde12) * hbase-server/src/main/java/org/apache/hadoop/hbase/mapreduce/Import.java OOM may occur when Import imports a row with too many KeyValues --- Key: HBASE-13897 URL: https://issues.apache.org/jira/browse/HBASE-13897 Project: HBase Issue Type: Bug Affects Versions: 0.98.13 Reporter: Liu Junhong Assignee: Liu Junhong Fix For: 2.0.0, 0.98.14, 1.3.0 Attachments: 13897-v2.txt, HBASE-13897-0.98-20150710-suitable_for_hadoop1.patch, HBASE-13897-0.98-20150710.patch, HBASE-13897-0.98.patch, HBASE-13897-branch_1-20150709.patch, HBASE-13897-master-20150629.patch, HBASE-13897-master-20150630.patch, HBASE-13897-master-20150707.patch, HBASE-13897-master.patch When importing a row with too many KeyValues (may have too many columns or versions)，KeyValueReducer will incur OOM. -- This message was sent by Atlassian JIRA (v6.3.4#6332)
[jira] [Commented] (HBASE-13897) OOM may occur when Import imports a row with too many KeyValues
[ https://issues.apache.org/jira/browse/HBASE-13897?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14622594#comment-14622594 ] Hudson commented on HBASE-13897: FAILURE: Integrated in HBase-0.98 #1055 (See [https://builds.apache.org/job/HBase-0.98/1055/]) HBASE-13897 OOM may occur when Import imports a row with too many KeyValues (Liu Junhong) (tedyu: rev 372b71b7fe8399c6655972049d8bf089d87cde12) * hbase-server/src/main/java/org/apache/hadoop/hbase/mapreduce/Import.java OOM may occur when Import imports a row with too many KeyValues --- Key: HBASE-13897 URL: https://issues.apache.org/jira/browse/HBASE-13897 Project: HBase Issue Type: Bug Affects Versions: 0.98.13 Reporter: Liu Junhong Assignee: Liu Junhong Fix For: 2.0.0, 0.98.14, 1.3.0 Attachments: 13897-v2.txt, HBASE-13897-0.98-20150710-suitable_for_hadoop1.patch, HBASE-13897-0.98-20150710.patch, HBASE-13897-0.98.patch, HBASE-13897-branch_1-20150709.patch, HBASE-13897-master-20150629.patch, HBASE-13897-master-20150630.patch, HBASE-13897-master-20150707.patch, HBASE-13897-master.patch When importing a row with too many KeyValues (may have too many columns or versions)，KeyValueReducer will incur OOM. -- This message was sent by Atlassian JIRA (v6.3.4#6332)
[jira] [Commented] (HBASE-13897) OOM may occur when Import imports a row with too many KeyValues
[ https://issues.apache.org/jira/browse/HBASE-13897?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14620900#comment-14620900 ] Liu Junhong commented on HBASE-13897: - Thank you for your help, too. OOM may occur when Import imports a row with too many KeyValues --- Key: HBASE-13897 URL: https://issues.apache.org/jira/browse/HBASE-13897 Project: HBase Issue Type: Bug Affects Versions: 0.98.13 Reporter: Liu Junhong Assignee: Liu Junhong Fix For: 2.0.0, 0.98.14, 1.3.0 Attachments: 13897-v2.txt, HBASE-13897-0.98-20150710.patch, HBASE-13897-0.98.patch, HBASE-13897-branch_1-20150709.patch, HBASE-13897-master-20150629.patch, HBASE-13897-master-20150630.patch, HBASE-13897-master-20150707.patch, HBASE-13897-master.patch When importing a row with too many KeyValues (may have too many columns or versions)，KeyValueReducer will incur OOM. -- This message was sent by Atlassian JIRA (v6.3.4#6332)
[jira] [Commented] (HBASE-13897) OOM may occur when Import imports a row with too many KeyValues
[ https://issues.apache.org/jira/browse/HBASE-13897?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14621009#comment-14621009 ] Hudson commented on HBASE-13897: FAILURE: Integrated in HBase-0.98-on-Hadoop-1.1 #1007 (See [https://builds.apache.org/job/HBase-0.98-on-Hadoop-1.1/1007/]) HBASE-13897 OOM may occur when Import imports a row with too many KeyValues (Liu Junhong) (tedyu: rev 9be31d0526e8e3a44d293cd484edce439e9e7543) * hbase-server/src/main/java/org/apache/hadoop/hbase/mapreduce/Import.java OOM may occur when Import imports a row with too many KeyValues --- Key: HBASE-13897 URL: https://issues.apache.org/jira/browse/HBASE-13897 Project: HBase Issue Type: Bug Affects Versions: 0.98.13 Reporter: Liu Junhong Assignee: Liu Junhong Fix For: 2.0.0, 0.98.14, 1.3.0 Attachments: 13897-v2.txt, HBASE-13897-0.98-20150710.patch, HBASE-13897-0.98.patch, HBASE-13897-branch_1-20150709.patch, HBASE-13897-master-20150629.patch, HBASE-13897-master-20150630.patch, HBASE-13897-master-20150707.patch, HBASE-13897-master.patch When importing a row with too many KeyValues (may have too many columns or versions)，KeyValueReducer will incur OOM. -- This message was sent by Atlassian JIRA (v6.3.4#6332)
[jira] [Commented] (HBASE-13897) OOM may occur when Import imports a row with too many KeyValues
[
https://issues.apache.org/jira/browse/HBASE-13897?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14621025#comment-14621025
]
Ted Yu commented on HBASE-13897:
There was compilation error against Hadoop 1.1 :
{code}
[ERROR]
/home/jenkins/jenkins-slave/workspace/HBase-0.98-on-Hadoop-1.1/hbase-server/src/main/java/org/apache/hadoop/hbase/mapreduce/Import.java:[147,18]
error: no suitable constructor found for WritableComparator()
[ERROR] constructor WritableComparator.WritableComparator(Class? extends
WritableComparable,boolean) is not applicable
[ERROR] (actual and formal argument lists differ in length)
[ERROR] constructor WritableComparator.WritableComparator(Class? extends
WritableComparable) is not applicable
[ERROR] (actual and formal argument lists differ in length)
{code}
OOM may occur when Import imports a row with too many KeyValues
---
Key: HBASE-13897
URL: https://issues.apache.org/jira/browse/HBASE-13897
Project: HBase
Issue Type: Bug
Affects Versions: 0.98.13
Reporter: Liu Junhong
Assignee: Liu Junhong
Fix For: 2.0.0, 0.98.14, 1.3.0
Attachments: 13897-v2.txt, HBASE-13897-0.98-20150710.patch,
HBASE-13897-0.98.patch, HBASE-13897-branch_1-20150709.patch,
HBASE-13897-master-20150629.patch, HBASE-13897-master-20150630.patch,
HBASE-13897-master-20150707.patch, HBASE-13897-master.patch
When importing a row with too many KeyValues (may have too many columns or
versions)，KeyValueReducer will incur OOM.
--
This message was sent by Atlassian JIRA
(v6.3.4#6332)
[jira] [Commented] (HBASE-13897) OOM may occur when Import imports a row with too many KeyValues
[ https://issues.apache.org/jira/browse/HBASE-13897?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14621562#comment-14621562 ] Hudson commented on HBASE-13897: SUCCESS: Integrated in HBase-0.98 #1054 (See [https://builds.apache.org/job/HBase-0.98/1054/]) HBASE-13897 Revert due to compilation error against Hadoop 1.1 (tedyu: rev 0cd94f2f42c517a8fcd040606c2fcf6f609b0f92) * hbase-server/src/main/java/org/apache/hadoop/hbase/mapreduce/Import.java OOM may occur when Import imports a row with too many KeyValues --- Key: HBASE-13897 URL: https://issues.apache.org/jira/browse/HBASE-13897 Project: HBase Issue Type: Bug Affects Versions: 0.98.13 Reporter: Liu Junhong Assignee: Liu Junhong Fix For: 2.0.0, 0.98.14, 1.3.0 Attachments: 13897-v2.txt, HBASE-13897-0.98-20150710.patch, HBASE-13897-0.98.patch, HBASE-13897-branch_1-20150709.patch, HBASE-13897-master-20150629.patch, HBASE-13897-master-20150630.patch, HBASE-13897-master-20150707.patch, HBASE-13897-master.patch When importing a row with too many KeyValues (may have too many columns or versions)，KeyValueReducer will incur OOM. -- This message was sent by Atlassian JIRA (v6.3.4#6332)
[jira] [Commented] (HBASE-13897) OOM may occur when Import imports a row with too many KeyValues
[ https://issues.apache.org/jira/browse/HBASE-13897?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14621735#comment-14621735 ] Liu Junhong commented on HBASE-13897: - So, is there anthing that i should to do? OOM may occur when Import imports a row with too many KeyValues --- Key: HBASE-13897 URL: https://issues.apache.org/jira/browse/HBASE-13897 Project: HBase Issue Type: Bug Affects Versions: 0.98.13 Reporter: Liu Junhong Assignee: Liu Junhong Fix For: 2.0.0, 0.98.14, 1.3.0 Attachments: 13897-v2.txt, HBASE-13897-0.98-20150710-suitable_for_hadoop1.patch, HBASE-13897-0.98-20150710.patch, HBASE-13897-0.98.patch, HBASE-13897-branch_1-20150709.patch, HBASE-13897-master-20150629.patch, HBASE-13897-master-20150630.patch, HBASE-13897-master-20150707.patch, HBASE-13897-master.patch When importing a row with too many KeyValues (may have too many columns or versions)，KeyValueReducer will incur OOM. -- This message was sent by Atlassian JIRA (v6.3.4#6332)
[jira] [Commented] (HBASE-13897) OOM may occur when Import imports a row with too many KeyValues
[ https://issues.apache.org/jira/browse/HBASE-13897?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14621668#comment-14621668 ] Ted Yu commented on HBASE-13897: Error w.r.t. TaskCounter was introduced by other JIRA. OOM may occur when Import imports a row with too many KeyValues --- Key: HBASE-13897 URL: https://issues.apache.org/jira/browse/HBASE-13897 Project: HBase Issue Type: Bug Affects Versions: 0.98.13 Reporter: Liu Junhong Assignee: Liu Junhong Fix For: 2.0.0, 0.98.14, 1.3.0 Attachments: 13897-v2.txt, HBASE-13897-0.98-20150710-suitable_for_hadoop1.patch, HBASE-13897-0.98-20150710.patch, HBASE-13897-0.98.patch, HBASE-13897-branch_1-20150709.patch, HBASE-13897-master-20150629.patch, HBASE-13897-master-20150630.patch, HBASE-13897-master-20150707.patch, HBASE-13897-master.patch When importing a row with too many KeyValues (may have too many columns or versions)，KeyValueReducer will incur OOM. -- This message was sent by Atlassian JIRA (v6.3.4#6332)
[jira] [Commented] (HBASE-13897) OOM may occur when Import imports a row with too many KeyValues
[ https://issues.apache.org/jira/browse/HBASE-13897?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14621664#comment-14621664 ] Liu Junhong commented on HBASE-13897: - But it seems can't find TaskCounter. OOM may occur when Import imports a row with too many KeyValues --- Key: HBASE-13897 URL: https://issues.apache.org/jira/browse/HBASE-13897 Project: HBase Issue Type: Bug Affects Versions: 0.98.13 Reporter: Liu Junhong Assignee: Liu Junhong Fix For: 2.0.0, 0.98.14, 1.3.0 Attachments: 13897-v2.txt, HBASE-13897-0.98-20150710-suitable_for_hadoop1.patch, HBASE-13897-0.98-20150710.patch, HBASE-13897-0.98.patch, HBASE-13897-branch_1-20150709.patch, HBASE-13897-master-20150629.patch, HBASE-13897-master-20150630.patch, HBASE-13897-master-20150707.patch, HBASE-13897-master.patch When importing a row with too many KeyValues (may have too many columns or versions)，KeyValueReducer will incur OOM. -- This message was sent by Atlassian JIRA (v6.3.4#6332)
[jira] [Commented] (HBASE-13897) OOM may occur when Import imports a row with too many KeyValues
[ https://issues.apache.org/jira/browse/HBASE-13897?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14621124#comment-14621124 ] Andrew Purtell commented on HBASE-13897: Are you going to amend for 0.98 and recommit [~tedyu] ? OOM may occur when Import imports a row with too many KeyValues --- Key: HBASE-13897 URL: https://issues.apache.org/jira/browse/HBASE-13897 Project: HBase Issue Type: Bug Affects Versions: 0.98.13 Reporter: Liu Junhong Assignee: Liu Junhong Fix For: 2.0.0, 0.98.14, 1.3.0 Attachments: 13897-v2.txt, HBASE-13897-0.98-20150710.patch, HBASE-13897-0.98.patch, HBASE-13897-branch_1-20150709.patch, HBASE-13897-master-20150629.patch, HBASE-13897-master-20150630.patch, HBASE-13897-master-20150707.patch, HBASE-13897-master.patch When importing a row with too many KeyValues (may have too many columns or versions)，KeyValueReducer will incur OOM. -- This message was sent by Atlassian JIRA (v6.3.4#6332)
[jira] [Commented] (HBASE-13897) OOM may occur when Import imports a row with too many KeyValues
[ https://issues.apache.org/jira/browse/HBASE-13897?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14621275#comment-14621275 ] Hudson commented on HBASE-13897: FAILURE: Integrated in HBase-0.98 #1053 (See [https://builds.apache.org/job/HBase-0.98/1053/]) HBASE-13897 OOM may occur when Import imports a row with too many KeyValues (Liu Junhong) (tedyu: rev 9be31d0526e8e3a44d293cd484edce439e9e7543) * hbase-server/src/main/java/org/apache/hadoop/hbase/mapreduce/Import.java OOM may occur when Import imports a row with too many KeyValues --- Key: HBASE-13897 URL: https://issues.apache.org/jira/browse/HBASE-13897 Project: HBase Issue Type: Bug Affects Versions: 0.98.13 Reporter: Liu Junhong Assignee: Liu Junhong Fix For: 2.0.0, 0.98.14, 1.3.0 Attachments: 13897-v2.txt, HBASE-13897-0.98-20150710.patch, HBASE-13897-0.98.patch, HBASE-13897-branch_1-20150709.patch, HBASE-13897-master-20150629.patch, HBASE-13897-master-20150630.patch, HBASE-13897-master-20150707.patch, HBASE-13897-master.patch When importing a row with too many KeyValues (may have too many columns or versions)，KeyValueReducer will incur OOM. -- This message was sent by Atlassian JIRA (v6.3.4#6332)
[jira] [Commented] (HBASE-13897) OOM may occur when Import imports a row with too many KeyValues
[ https://issues.apache.org/jira/browse/HBASE-13897?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14621195#comment-14621195 ] Hudson commented on HBASE-13897: FAILURE: Integrated in HBase-0.98-on-Hadoop-1.1 #1008 (See [https://builds.apache.org/job/HBase-0.98-on-Hadoop-1.1/1008/]) HBASE-13897 Revert due to compilation error against Hadoop 1.1 (tedyu: rev 0cd94f2f42c517a8fcd040606c2fcf6f609b0f92) * hbase-server/src/main/java/org/apache/hadoop/hbase/mapreduce/Import.java OOM may occur when Import imports a row with too many KeyValues --- Key: HBASE-13897 URL: https://issues.apache.org/jira/browse/HBASE-13897 Project: HBase Issue Type: Bug Affects Versions: 0.98.13 Reporter: Liu Junhong Assignee: Liu Junhong Fix For: 2.0.0, 0.98.14, 1.3.0 Attachments: 13897-v2.txt, HBASE-13897-0.98-20150710.patch, HBASE-13897-0.98.patch, HBASE-13897-branch_1-20150709.patch, HBASE-13897-master-20150629.patch, HBASE-13897-master-20150630.patch, HBASE-13897-master-20150707.patch, HBASE-13897-master.patch When importing a row with too many KeyValues (may have too many columns or versions)，KeyValueReducer will incur OOM. -- This message was sent by Atlassian JIRA (v6.3.4#6332)
[jira] [Commented] (HBASE-13897) OOM may occur when Import imports a row with too many KeyValues
[
https://issues.apache.org/jira/browse/HBASE-13897?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14621143#comment-14621143
]
Hadoop QA commented on HBASE-13897:
---
{color:red}-1 overall{color}. Here are the results of testing the latest
attachment
http://issues.apache.org/jira/secure/attachment/12744519/HBASE-13897-0.98-20150710.patch
against 0.98 branch at commit 87ee37ceb8ea9e1ab64a5522e0eef410580b3145.
ATTACHMENT ID: 12744519
{color:green}+1 @author{color}. The patch does not contain any @author
tags.
{color:red}-1 tests included{color}. The patch doesn't appear to include
any new or modified tests.
Please justify why no new tests are needed for this
patch.
Also please list what manual steps were performed to
verify this patch.
{color:green}+1 hadoop versions{color}. The patch compiles with all
supported hadoop versions (2.4.0 2.4.1 2.5.0 2.5.1 2.5.2 2.6.0 2.7.0)
{color:green}+1 javac{color}. The applied patch does not increase the
total number of javac compiler warnings.
{color:green}+1 protoc{color}. The applied patch does not increase the
total number of protoc compiler warnings.
{color:red}-1 javadoc{color}. The javadoc tool appears to have generated
23 warning messages.
{color:green}+1 checkstyle{color}. The applied patch does not increase the
total number of checkstyle errors
{color:green}+1 findbugs{color}. The patch does not introduce any new
Findbugs (version 2.0.3) warnings.
{color:green}+1 release audit{color}. The applied patch does not increase
the total number of release audit warnings.
{color:green}+1 lineLengths{color}. The patch does not introduce lines
longer than 100
{color:green}+1 site{color}. The mvn post-site goal succeeds with this patch.
{color:green}+1 core tests{color}. The patch passed unit tests in .
Test results:
https://builds.apache.org/job/PreCommit-HBASE-Build/14719//testReport/
Release Findbugs (version 2.0.3)warnings:
https://builds.apache.org/job/PreCommit-HBASE-Build/14719//artifact/patchprocess/newFindbugsWarnings.html
Checkstyle Errors:
https://builds.apache.org/job/PreCommit-HBASE-Build/14719//artifact/patchprocess/checkstyle-aggregate.html
Javadoc warnings:
https://builds.apache.org/job/PreCommit-HBASE-Build/14719//artifact/patchprocess/patchJavadocWarnings.txt
Console output:
https://builds.apache.org/job/PreCommit-HBASE-Build/14719//console
This message is automatically generated.
OOM may occur when Import imports a row with too many KeyValues
---
Key: HBASE-13897
URL: https://issues.apache.org/jira/browse/HBASE-13897
Project: HBase
Issue Type: Bug
Affects Versions: 0.98.13
Reporter: Liu Junhong
Assignee: Liu Junhong
Fix For: 2.0.0, 0.98.14, 1.3.0
Attachments: 13897-v2.txt, HBASE-13897-0.98-20150710.patch,
HBASE-13897-0.98.patch, HBASE-13897-branch_1-20150709.patch,
HBASE-13897-master-20150629.patch, HBASE-13897-master-20150630.patch,
HBASE-13897-master-20150707.patch, HBASE-13897-master.patch
When importing a row with too many KeyValues (may have too many columns or
versions)，KeyValueReducer will incur OOM.
--
This message was sent by Atlassian JIRA
(v6.3.4#6332)
[jira] [Commented] (HBASE-13897) OOM may occur when Import imports a row with too many KeyValues
[
https://issues.apache.org/jira/browse/HBASE-13897?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14618931#comment-14618931
]
Hadoop QA commented on HBASE-13897:
---
{color:red}-1 overall{color}. Here are the results of testing the latest
attachment
http://issues.apache.org/jira/secure/attachment/12744250/HBASE-13897-branch_1-20150709.patch
against master branch at commit f5ad736282c8c9c27b14131919d60b72834ec9e4.
ATTACHMENT ID: 12744250
{color:green}+1 @author{color}. The patch does not contain any @author
tags.
{color:red}-1 tests included{color}. The patch doesn't appear to include
any new or modified tests.
Please justify why no new tests are needed for this
patch.
Also please list what manual steps were performed to
verify this patch.
{color:red}-1 patch{color}. The patch command could not apply the patch.
Console output:
https://builds.apache.org/job/PreCommit-HBASE-Build/14703//console
This message is automatically generated.
OOM may occur when Import imports a row with too many KeyValues
---
Key: HBASE-13897
URL: https://issues.apache.org/jira/browse/HBASE-13897
Project: HBase
Issue Type: Bug
Affects Versions: 0.98.13
Reporter: Liu Junhong
Assignee: Liu Junhong
Fix For: 2.0.0, 0.98.14, 1.3.0
Attachments: 13897-v2.txt, HBASE-13897-0.98.patch,
HBASE-13897-branch_1-20150709.patch, HBASE-13897-master-20150629.patch,
HBASE-13897-master-20150630.patch, HBASE-13897-master-20150707.patch,
HBASE-13897-master.patch
When importing a row with too many KeyValues (may have too many columns or
versions)，KeyValueReducer will incur OOM.
--
This message was sent by Atlassian JIRA
(v6.3.4#6332)
[jira] [Commented] (HBASE-13897) OOM may occur when Import imports a row with too many KeyValues
[ https://issues.apache.org/jira/browse/HBASE-13897?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14619303#comment-14619303 ] Hudson commented on HBASE-13897: FAILURE: Integrated in HBase-1.3 #42 (See [https://builds.apache.org/job/HBase-1.3/42/]) HBASE-13897 OOM may occur when Import imports a row with too many KeyValues (Liu Junhong) (tedyu: rev 7ab78d9ddfc93949bf221560e1a2ff255d39535c) * hbase-server/src/main/java/org/apache/hadoop/hbase/mapreduce/Import.java OOM may occur when Import imports a row with too many KeyValues --- Key: HBASE-13897 URL: https://issues.apache.org/jira/browse/HBASE-13897 Project: HBase Issue Type: Bug Affects Versions: 0.98.13 Reporter: Liu Junhong Assignee: Liu Junhong Fix For: 2.0.0, 0.98.14, 1.3.0 Attachments: 13897-v2.txt, HBASE-13897-0.98.patch, HBASE-13897-branch_1-20150709.patch, HBASE-13897-master-20150629.patch, HBASE-13897-master-20150630.patch, HBASE-13897-master-20150707.patch, HBASE-13897-master.patch When importing a row with too many KeyValues (may have too many columns or versions)，KeyValueReducer will incur OOM. -- This message was sent by Atlassian JIRA (v6.3.4#6332)
[jira] [Commented] (HBASE-13897) OOM may occur when Import imports a row with too many KeyValues
[ https://issues.apache.org/jira/browse/HBASE-13897?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14619351#comment-14619351 ] Hudson commented on HBASE-13897: SUCCESS: Integrated in HBase-1.3-IT #27 (See [https://builds.apache.org/job/HBase-1.3-IT/27/]) HBASE-13897 OOM may occur when Import imports a row with too many KeyValues (Liu Junhong) (tedyu: rev 7ab78d9ddfc93949bf221560e1a2ff255d39535c) * hbase-server/src/main/java/org/apache/hadoop/hbase/mapreduce/Import.java OOM may occur when Import imports a row with too many KeyValues --- Key: HBASE-13897 URL: https://issues.apache.org/jira/browse/HBASE-13897 Project: HBase Issue Type: Bug Affects Versions: 0.98.13 Reporter: Liu Junhong Assignee: Liu Junhong Fix For: 2.0.0, 0.98.14, 1.3.0 Attachments: 13897-v2.txt, HBASE-13897-0.98.patch, HBASE-13897-branch_1-20150709.patch, HBASE-13897-master-20150629.patch, HBASE-13897-master-20150630.patch, HBASE-13897-master-20150707.patch, HBASE-13897-master.patch When importing a row with too many KeyValues (may have too many columns or versions)，KeyValueReducer will incur OOM. -- This message was sent by Atlassian JIRA (v6.3.4#6332)
[jira] [Commented] (HBASE-13897) OOM may occur when Import imports a row with too many KeyValues
[
https://issues.apache.org/jira/browse/HBASE-13897?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14617131#comment-14617131
]
Hadoop QA commented on HBASE-13897:
---
{color:red}-1 overall{color}. Here are the results of testing the latest
attachment
http://issues.apache.org/jira/secure/attachment/12743973/13897-v2.txt
against master branch at commit 7acb061e63614ad957da654f920f54ac7a02edd6.
ATTACHMENT ID: 12743973
{color:green}+1 @author{color}. The patch does not contain any @author
tags.
{color:red}-1 tests included{color}. The patch doesn't appear to include
any new or modified tests.
Please justify why no new tests are needed for this
patch.
Also please list what manual steps were performed to
verify this patch.
{color:green}+1 hadoop versions{color}. The patch compiles with all
supported hadoop versions (2.4.0 2.4.1 2.5.0 2.5.1 2.5.2 2.6.0 2.7.0)
{color:green}+1 javac{color}. The applied patch does not increase the
total number of javac compiler warnings.
{color:green}+1 protoc{color}. The applied patch does not increase the
total number of protoc compiler warnings.
{color:green}+1 javadoc{color}. The javadoc tool did not generate any
warning messages.
{color:green}+1 checkstyle{color}. The applied patch does not increase the
total number of checkstyle errors
{color:green}+1 findbugs{color}. The patch does not introduce any new
Findbugs (version 2.0.3) warnings.
{color:green}+1 release audit{color}. The applied patch does not increase
the total number of release audit warnings.
{color:green}+1 lineLengths{color}. The patch does not introduce lines
longer than 100
{color:green}+1 site{color}. The mvn post-site goal succeeds with this patch.
{color:green}+1 core tests{color}. The patch passed unit tests in .
{color:red}-1 core zombie tests{color}. There are 1 zombie test(s):
Test results:
https://builds.apache.org/job/PreCommit-HBASE-Build/14693//testReport/
Release Findbugs (version 2.0.3)warnings:
https://builds.apache.org/job/PreCommit-HBASE-Build/14693//artifact/patchprocess/newFindbugsWarnings.html
Checkstyle Errors:
https://builds.apache.org/job/PreCommit-HBASE-Build/14693//artifact/patchprocess/checkstyle-aggregate.html
Console output:
https://builds.apache.org/job/PreCommit-HBASE-Build/14693//console
This message is automatically generated.
OOM may occur when Import imports a row with too many KeyValues
---
Key: HBASE-13897
URL: https://issues.apache.org/jira/browse/HBASE-13897
Project: HBase
Issue Type: Bug
Affects Versions: 0.98.13
Reporter: Liu Junhong
Assignee: Liu Junhong
Fix For: 2.0.0, 0.98.14, 1.3.0
Attachments: 13897-v2.txt, HBASE-13897-0.98.patch,
HBASE-13897-master-20150629.patch, HBASE-13897-master-20150630.patch,
HBASE-13897-master-20150707.patch, HBASE-13897-master.patch
When importing a row with too many KeyValues (may have too many columns or
versions)，KeyValueReducer will incur OOM.
--
This message was sent by Atlassian JIRA
(v6.3.4#6332)
[jira] [Commented] (HBASE-13897) OOM may occur when Import imports a row with too many KeyValues
[
https://issues.apache.org/jira/browse/HBASE-13897?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14617136#comment-14617136
]
Ted Yu commented on HBASE-13897:
QA run passed:
{code}
[INFO] HBase - Shaded - Server ... SUCCESS [ 0.488 s]
[INFO]
[INFO] BUILD SUCCESS
[INFO]
[INFO] Total time: 02:09 h
[INFO] Finished at: 2015-07-07T18:24:00+00:00
{code}
OOM may occur when Import imports a row with too many KeyValues
---
Key: HBASE-13897
URL: https://issues.apache.org/jira/browse/HBASE-13897
Project: HBase
Issue Type: Bug
Affects Versions: 0.98.13
Reporter: Liu Junhong
Assignee: Liu Junhong
Fix For: 2.0.0, 0.98.14, 1.3.0
Attachments: 13897-v2.txt, HBASE-13897-0.98.patch,
HBASE-13897-master-20150629.patch, HBASE-13897-master-20150630.patch,
HBASE-13897-master-20150707.patch, HBASE-13897-master.patch
When importing a row with too many KeyValues (may have too many columns or
versions)，KeyValueReducer will incur OOM.
--
This message was sent by Atlassian JIRA
(v6.3.4#6332)
[jira] [Commented] (HBASE-13897) OOM may occur when Import imports a row with too many KeyValues
[ https://issues.apache.org/jira/browse/HBASE-13897?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14617377#comment-14617377 ] Hudson commented on HBASE-13897: SUCCESS: Integrated in HBase-TRUNK #6635 (See [https://builds.apache.org/job/HBase-TRUNK/6635/]) HBASE-13897 OOM may occur when Import imports a row with too many KeyValues (Liu Junhong) (tedyu: rev 1162cbdf15acfc63b64835cb9e7ef29d5b9c6494) * hbase-server/src/main/java/org/apache/hadoop/hbase/mapreduce/Import.java OOM may occur when Import imports a row with too many KeyValues --- Key: HBASE-13897 URL: https://issues.apache.org/jira/browse/HBASE-13897 Project: HBase Issue Type: Bug Affects Versions: 0.98.13 Reporter: Liu Junhong Assignee: Liu Junhong Fix For: 2.0.0, 0.98.14, 1.3.0 Attachments: 13897-v2.txt, HBASE-13897-0.98.patch, HBASE-13897-master-20150629.patch, HBASE-13897-master-20150630.patch, HBASE-13897-master-20150707.patch, HBASE-13897-master.patch When importing a row with too many KeyValues (may have too many columns or versions)，KeyValueReducer will incur OOM. -- This message was sent by Atlassian JIRA (v6.3.4#6332)
[jira] [Commented] (HBASE-13897) OOM may occur when Import imports a row with too many KeyValues
[
https://issues.apache.org/jira/browse/HBASE-13897?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14616847#comment-14616847
]
Hadoop QA commented on HBASE-13897:
---
{color:red}-1 overall{color}. Here are the results of testing the latest
attachment
http://issues.apache.org/jira/secure/attachment/12743970/HBASE-13897-master-20150707.patch
against master branch at commit 7acb061e63614ad957da654f920f54ac7a02edd6.
ATTACHMENT ID: 12743970
{color:green}+1 @author{color}. The patch does not contain any @author
tags.
{color:red}-1 tests included{color}. The patch doesn't appear to include
any new or modified tests.
Please justify why no new tests are needed for this
patch.
Also please list what manual steps were performed to
verify this patch.
{color:red}-1 patch{color}. The patch command could not apply the patch.
Console output:
https://builds.apache.org/job/PreCommit-HBASE-Build/14692//console
This message is automatically generated.
OOM may occur when Import imports a row with too many KeyValues
---
Key: HBASE-13897
URL: https://issues.apache.org/jira/browse/HBASE-13897
Project: HBase
Issue Type: Bug
Affects Versions: 0.98.13
Reporter: Liu Junhong
Assignee: Liu Junhong
Fix For: 0.98.14
Attachments: HBASE-13897-0.98.patch,
HBASE-13897-master-20150629.patch, HBASE-13897-master-20150630.patch,
HBASE-13897-master-20150707.patch, HBASE-13897-master.patch
When importing a row with too many KeyValues (may have too many columns or
versions)，KeyValueReducer will incur OOM.
--
This message was sent by Atlassian JIRA
(v6.3.4#6332)
[jira] [Commented] (HBASE-13897) OOM may occur when Import imports a row with too many KeyValues
[ https://issues.apache.org/jira/browse/HBASE-13897?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14616820#comment-14616820 ] Ted Yu commented on HBASE-13897: Planning to commit after this QA run. OOM may occur when Import imports a row with too many KeyValues --- Key: HBASE-13897 URL: https://issues.apache.org/jira/browse/HBASE-13897 Project: HBase Issue Type: Bug Affects Versions: 0.98.13 Reporter: Liu Junhong Assignee: Liu Junhong Fix For: 0.98.14 Attachments: HBASE-13897-0.98.patch, HBASE-13897-master-20150629.patch, HBASE-13897-master-20150630.patch, HBASE-13897-master-20150707.patch, HBASE-13897-master.patch When importing a row with too many KeyValues (may have too many columns or versions)，KeyValueReducer will incur OOM. -- This message was sent by Atlassian JIRA (v6.3.4#6332)
[jira] [Commented] (HBASE-13897) OOM may occur when Import imports a row with too many KeyValues
[
https://issues.apache.org/jira/browse/HBASE-13897?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14608045#comment-14608045
]
Hadoop QA commented on HBASE-13897:
---
{color:red}-1 overall{color}. Here are the results of testing the latest
attachment
http://issues.apache.org/jira/secure/attachment/12742731/HBASE-13897-master-20150630.patch
against master branch at commit f8bd578b80b4e656d799c82ca1b6191e35bb0ae4.
ATTACHMENT ID: 12742731
{color:green}+1 @author{color}. The patch does not contain any @author
tags.
{color:red}-1 tests included{color}. The patch doesn't appear to include
any new or modified tests.
Please justify why no new tests are needed for this
patch.
Also please list what manual steps were performed to
verify this patch.
{color:green}+1 hadoop versions{color}. The patch compiles with all
supported hadoop versions (2.4.0 2.4.1 2.5.0 2.5.1 2.5.2 2.6.0 2.7.0)
{color:green}+1 javac{color}. The applied patch does not increase the
total number of javac compiler warnings.
{color:green}+1 protoc{color}. The applied patch does not increase the
total number of protoc compiler warnings.
{color:green}+1 javadoc{color}. The javadoc tool did not generate any
warning messages.
{color:green}+1 checkstyle{color}. The applied patch does not increase the
total number of checkstyle errors
{color:green}+1 findbugs{color}. The patch does not introduce any new
Findbugs (version 2.0.3) warnings.
{color:green}+1 release audit{color}. The applied patch does not increase
the total number of release audit warnings.
{color:green}+1 lineLengths{color}. The patch does not introduce lines
longer than 100
{color:green}+1 site{color}. The mvn post-site goal succeeds with this patch.
{color:red}-1 core tests{color}. The patch failed these unit tests:
org.apache.hadoop.hbase.TestRegionRebalancing
{color:red}-1 core zombie tests{color}. There are 3 zombie test(s):
at
org.apache.hadoop.hbase.io.hfile.TestCacheOnWrite.testNotCachingDataBlocksDuringCompactionInternals(TestCacheOnWrite.java:454)
at
org.apache.hadoop.hbase.io.hfile.TestCacheOnWrite.testNotCachingDataBlocksDuringCompaction(TestCacheOnWrite.java:479)
at
org.apache.hadoop.hbase.io.encoding.TestChangingEncoding.testChangingEncodingWithCompaction(TestChangingEncoding.java:212)
at
org.apache.hadoop.hbase.io.encoding.TestDataBlockEncoders.testSeekingOnSample(TestDataBlockEncoders.java:208)
Test results:
https://builds.apache.org/job/PreCommit-HBASE-Build/14612//testReport/
Release Findbugs (version 2.0.3)warnings:
https://builds.apache.org/job/PreCommit-HBASE-Build/14612//artifact/patchprocess/newFindbugsWarnings.html
Checkstyle Errors:
https://builds.apache.org/job/PreCommit-HBASE-Build/14612//artifact/patchprocess/checkstyle-aggregate.html
Console output:
https://builds.apache.org/job/PreCommit-HBASE-Build/14612//console
This message is automatically generated.
OOM may occur when Import imports a row with too many KeyValues
---
Key: HBASE-13897
URL: https://issues.apache.org/jira/browse/HBASE-13897
Project: HBase
Issue Type: Bug
Affects Versions: 0.98.13
Reporter: Liu Junhong
Assignee: Liu Junhong
Fix For: 0.98.14
Attachments: HBASE-13897-0.98.patch,
HBASE-13897-master-20150629.patch, HBASE-13897-master-20150630.patch,
HBASE-13897-master.patch
When importing a row with too many KeyValues (may have too many columns or
versions)，KeyValueReducer will incur OOM.
--
This message was sent by Atlassian JIRA
(v6.3.4#6332)
[jira] [Commented] (HBASE-13897) OOM may occur when Import imports a row with too many KeyValues
[ https://issues.apache.org/jira/browse/HBASE-13897?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14608481#comment-14608481 ] Liu Junhong commented on HBASE-13897: - The failure UT seems unrelated with the patch? OOM may occur when Import imports a row with too many KeyValues --- Key: HBASE-13897 URL: https://issues.apache.org/jira/browse/HBASE-13897 Project: HBase Issue Type: Bug Affects Versions: 0.98.13 Reporter: Liu Junhong Assignee: Liu Junhong Fix For: 0.98.14 Attachments: HBASE-13897-0.98.patch, HBASE-13897-master-20150629.patch, HBASE-13897-master-20150630.patch, HBASE-13897-master.patch When importing a row with too many KeyValues (may have too many columns or versions)，KeyValueReducer will incur OOM. -- This message was sent by Atlassian JIRA (v6.3.4#6332)
[jira] [Commented] (HBASE-13897) OOM may occur when Import imports a row with too many KeyValues
[
https://issues.apache.org/jira/browse/HBASE-13897?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14606033#comment-14606033
]
Hadoop QA commented on HBASE-13897:
---
{color:red}-1 overall{color}. Here are the results of testing the latest
attachment
http://issues.apache.org/jira/secure/attachment/12742518/HBASE-13897-master-20150629.patch
against master branch at commit 7b92d8c06a9eced95c4390f0dae02ebb98aa3ef7.
ATTACHMENT ID: 12742518
{color:green}+1 @author{color}. The patch does not contain any @author
tags.
{color:red}-1 tests included{color}. The patch doesn't appear to include
any new or modified tests.
Please justify why no new tests are needed for this
patch.
Also please list what manual steps were performed to
verify this patch.
{color:green}+1 hadoop versions{color}. The patch compiles with all
supported hadoop versions (2.4.0 2.4.1 2.5.0 2.5.1 2.5.2 2.6.0 2.7.0)
{color:green}+1 javac{color}. The applied patch does not increase the
total number of javac compiler warnings.
{color:green}+1 protoc{color}. The applied patch does not increase the
total number of protoc compiler warnings.
{color:green}+1 javadoc{color}. The javadoc tool did not generate any
warning messages.
{color:red}-1 checkstyle{color}. The applied patch generated
1901 checkstyle errors (more than the master's current 1900 errors).
{color:green}+1 findbugs{color}. The patch does not introduce any new
Findbugs (version 2.0.3) warnings.
{color:green}+1 release audit{color}. The applied patch does not increase
the total number of release audit warnings.
{color:green}+1 lineLengths{color}. The patch does not introduce lines
longer than 100
{color:green}+1 site{color}. The mvn post-site goal succeeds with this patch.
{color:green}+1 core tests{color}. The patch passed unit tests in .
Test results:
https://builds.apache.org/job/PreCommit-HBASE-Build/14602//testReport/
Release Findbugs (version 2.0.3)warnings:
https://builds.apache.org/job/PreCommit-HBASE-Build/14602//artifact/patchprocess/newFindbugsWarnings.html
Checkstyle Errors:
https://builds.apache.org/job/PreCommit-HBASE-Build/14602//artifact/patchprocess/checkstyle-aggregate.html
Console output:
https://builds.apache.org/job/PreCommit-HBASE-Build/14602//console
This message is automatically generated.
OOM may occur when Import imports a row with too many KeyValues
---
Key: HBASE-13897
URL: https://issues.apache.org/jira/browse/HBASE-13897
Project: HBase
Issue Type: Bug
Affects Versions: 0.98.13
Reporter: Liu Junhong
Assignee: Liu Junhong
Fix For: 0.98.14
Attachments: HBASE-13897-0.98.patch,
HBASE-13897-master-20150629.patch, HBASE-13897-master.patch
When importing a row with too many KeyValues (may have too many columns or
versions)，KeyValueReducer will incur OOM.
--
This message was sent by Atlassian JIRA
(v6.3.4#6332)
[jira] [Commented] (HBASE-13897) OOM may occur when Import imports a row with too many KeyValues
[ https://issues.apache.org/jira/browse/HBASE-13897?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14604871#comment-14604871 ] Ted Yu commented on HBASE-13897: You can use dev-support/checkstyle_report.py to find checkstyle warnings and correct them. OOM may occur when Import imports a row with too many KeyValues --- Key: HBASE-13897 URL: https://issues.apache.org/jira/browse/HBASE-13897 Project: HBase Issue Type: Bug Affects Versions: 0.98.13 Reporter: Liu Junhong Assignee: Liu Junhong Fix For: 0.98.14 Attachments: HBASE-13897-0.98.patch, HBASE-13897-master.patch When importing a row with too many KeyValues (may have too many columns or versions)，KeyValueReducer will incur OOM. -- This message was sent by Atlassian JIRA (v6.3.4#6332)
[jira] [Commented] (HBASE-13897) OOM may occur when Import imports a row with too many KeyValues
[
https://issues.apache.org/jira/browse/HBASE-13897?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14604963#comment-14604963
]
Ted Yu commented on HBASE-13897:
{code}
179 context.setStatus(Wrote + index);
{code}
Add more to the above log. e.g. Wrote + index + KeyValues
{code}
232 throw new IOException(Region splitted after job
initialization);
{code}
The past tense of split is split.
{code}
674 System.err.println(If there is no large results that including too
much KeyValue
675 + whitch can use the memery sort in reducer, pass the
option:);
{code}
Syntax error. Should be:
{code}
674 System.err.println(If there is no large result that includes too
many KeyValues
675 + which can use the memory sort in reducer, pass the option:);
{code}
{code}
676 System.err.println( -D + HAS_LARGE_RESULT + =false);
{code}
Should the option be turned off by default ?
OOM may occur when Import imports a row with too many KeyValues
---
Key: HBASE-13897
URL: https://issues.apache.org/jira/browse/HBASE-13897
Project: HBase
Issue Type: Bug
Affects Versions: 0.98.13
Reporter: Liu Junhong
Assignee: Liu Junhong
Fix For: 0.98.14
Attachments: HBASE-13897-0.98.patch, HBASE-13897-master.patch
When importing a row with too many KeyValues (may have too many columns or
versions)，KeyValueReducer will incur OOM.
--
This message was sent by Atlassian JIRA
(v6.3.4#6332)
