[jira] [Updated] (HBASE-21281) Update bouncycastle dependency.

2018-10-19 Thread Ted Yu (JIRA)
[ https://issues.apache.org/jira/browse/HBASE-21281?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Ted Yu updated HBASE-21281: --- Status: Patch Available (was: Reopened) > Update bouncycastle dependency. >

[jira] [Reopened] (HBASE-21281) Update bouncycastle dependency.

2018-10-19 Thread Ted Yu (JIRA)
[ https://issues.apache.org/jira/browse/HBASE-21281?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Ted Yu reopened HBASE-21281: > Update bouncycastle dependency. > --- > > Key: HBASE-21281 >

[jira] [Commented] (HBASE-21281) Update bouncycastle dependency.

2018-10-19 Thread Ted Yu (JIRA)
[ https://issues.apache.org/jira/browse/HBASE-21281?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16657079#comment-16657079 ] Ted Yu commented on HBASE-21281: Turns out that one more module needs the addition of the test

[jira] [Updated] (HBASE-21281) Update bouncycastle dependency.

2018-10-19 Thread Ted Yu (JIRA)
[ https://issues.apache.org/jira/browse/HBASE-21281?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Ted Yu updated HBASE-21281: --- Attachment: 21281.addendum2.patch > Update bouncycastle dependency. > --- > >

[jira] [Commented] (HBASE-21194) Add TestCopyTable which exercises MOB feature

2018-10-19 Thread Ted Yu (JIRA)
[ https://issues.apache.org/jira/browse/HBASE-21194?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16656980#comment-16656980 ] Ted Yu commented on HBASE-21194: Please also look at checkstyle warnings. Thanks > Add TestCopyTable

[jira] [Commented] (HBASE-21194) Add TestCopyTable which exercises MOB feature

2018-10-19 Thread Ted Yu (JIRA)
[ https://issues.apache.org/jira/browse/HBASE-21194?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16656978#comment-16656978 ] Ted Yu commented on HBASE-21194: {code} + private final static HBaseTestingUtility TEST_UTIL = new

[jira] [Commented] (HBASE-21342) FileSystem in use may get closed by other bulk load call in secure bulkLoad

2018-10-19 Thread Ted Yu (JIRA)
[ https://issues.apache.org/jira/browse/HBASE-21342?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16656904#comment-16656904 ] Ted Yu commented on HBASE-21342: {code} + interface InternalObserverForTest { {code} Since the

[jira] [Commented] (HBASE-21194) Add TestCopyTable which exercises MOB feature

2018-10-19 Thread Ted Yu (JIRA)
[ https://issues.apache.org/jira/browse/HBASE-21194?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16656886#comment-16656886 ] Ted Yu commented on HBASE-21194: For the mob row counting method, can you add it to

[jira] [Updated] (HADOOP-15850) CopyCommitter#concatFileChunks should check that the blocks per chunk is not 0

2018-10-19 Thread Ted Yu (JIRA)
[ https://issues.apache.org/jira/browse/HADOOP-15850?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Ted Yu updated HADOOP-15850: Attachment: HADOOP-15850.v6.patch > CopyCommitter#concatFileChunks should check that the blocks per

[jira] [Updated] (HBASE-21246) Introduce WALIdentity interface

2018-10-19 Thread Ted Yu (JIRA)
[ https://issues.apache.org/jira/browse/HBASE-21246?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Ted Yu updated HBASE-21246: --- Attachment: 21246.HBASE-20952.007.patch > Introduce WALIdentity interface > ---

[jira] [Commented] (HBASE-21342) FileSystem in use may get closed by other bulk load call in secure bulkLoad

2018-10-19 Thread Ted Yu (JIRA)
[ https://issues.apache.org/jira/browse/HBASE-21342?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16656447#comment-16656447 ] Ted Yu commented on HBASE-21342: Can you change the name of the test table to reflect the nature of the

[jira] [Commented] (HBASE-21342) FileSystem in use may get closed by other bulk load call in secure bulkLoad

2018-10-18 Thread Ted Yu (JIRA)
[ https://issues.apache.org/jira/browse/HBASE-21342?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16656262#comment-16656262 ] Ted Yu commented on HBASE-21342: Added ClassRule to TestSecureBulkloadManager. Let's see what QA bot

[jira] [Updated] (HBASE-21342) FileSystem in use may get closed by other bulk load call in secure bulkLoad

2018-10-18 Thread Ted Yu (JIRA)
[ https://issues.apache.org/jira/browse/HBASE-21342?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Ted Yu updated HBASE-21342: --- Attachment: 21342.v1.txt > FileSystem in use may get closed by other bulk load call in secure bulkLoad >

[jira] [Updated] (HBASE-21342) FileSystem in use may get closed by other bulk load call in secure bulkLoad

2018-10-18 Thread Ted Yu (JIRA)
[ https://issues.apache.org/jira/browse/HBASE-21342?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Ted Yu updated HBASE-21342: --- Status: Patch Available (was: Open) > FileSystem in use may get closed by other bulk load call in secure

[jira] [Commented] (HBASE-21194) Add TestCopyTable which exercises MOB feature

2018-10-18 Thread Ted Yu (JIRA)
[ https://issues.apache.org/jira/browse/HBASE-21194?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16656221#comment-16656221 ] Ted Yu commented on HBASE-21194: Thanks for working on this, Artem. {code} +

[jira] [Commented] (HADOOP-15850) CopyCommitter#concatFileChunks should check that the blocks per chunk is not 0

2018-10-18 Thread Ted Yu (JIRA)
[ https://issues.apache.org/jira/browse/HADOOP-15850?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16656199#comment-16656199 ] Ted Yu commented on HADOOP-15850: - Thanks for the review, looks like this bug could have been

[jira] [Updated] (HADOOP-15850) CopyCommitter#concatFileChunks should check that the blocks per chunk is not 0

2018-10-18 Thread Ted Yu (JIRA)
[ https://issues.apache.org/jira/browse/HADOOP-15850?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Ted Yu updated HADOOP-15850: Attachment: HADOOP-15850.v5.patch > CopyCommitter#concatFileChunks should check that the blocks per

[jira] [Commented] (HBASE-21342) FileSystem in use may get closed by other bulk load call in secure bulkLoad

2018-10-18 Thread Ted Yu (JIRA)
[ https://issues.apache.org/jira/browse/HBASE-21342?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16655710#comment-16655710 ] Ted Yu commented on HBASE-21342: {code} +import org.apache.commons.collections.map.HashedMap; {code} Did

[jira] [Updated] (HBASE-21341) DeadServer shouldn't import unshaded Preconditions

2018-10-18 Thread Ted Yu (JIRA)
[ https://issues.apache.org/jira/browse/HBASE-21341?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Ted Yu updated HBASE-21341: --- Attachment: 21341.v1.txt > DeadServer shouldn't import unshaded Preconditions >

[jira] [Updated] (HBASE-21341) DeadServer shouldn't import unshaded Preconditions

2018-10-18 Thread Ted Yu (JIRA)
[ https://issues.apache.org/jira/browse/HBASE-21341?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Ted Yu updated HBASE-21341: --- Status: Patch Available (was: Open) > DeadServer shouldn't import unshaded Preconditions >

[jira] [Created] (HBASE-21341) DeadServer shouldn't import unshaded Preconditions

2018-10-18 Thread Ted Yu (JIRA)
Ted Yu created HBASE-21341: -- Summary: DeadServer shouldn't import unshaded Preconditions Key: HBASE-21341 URL: https://issues.apache.org/jira/browse/HBASE-21341 Project: HBase Issue Type: Bug

[jira] [Created] (HBASE-21341) DeadServer shouldn't import unshaded Preconditions

2018-10-18 Thread Ted Yu (JIRA)
Ted Yu created HBASE-21341: -- Summary: DeadServer shouldn't import unshaded Preconditions Key: HBASE-21341 URL: https://issues.apache.org/jira/browse/HBASE-21341 Project: HBase Issue Type: Bug

[jira] [Updated] (HADOOP-15850) CopyCommitter#concatFileChunks should check that the blocks per chunk is not 0

2018-10-18 Thread Ted Yu (JIRA)
[ https://issues.apache.org/jira/browse/HADOOP-15850?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Ted Yu updated HADOOP-15850: Attachment: HADOOP-15850.v4.patch > CopyCommitter#concatFileChunks should check that the blocks per

[jira] [Updated] (HBASE-21279) Split TestAdminShell into several tests

2018-10-17 Thread Ted Yu (JIRA)
[ https://issues.apache.org/jira/browse/HBASE-21279?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Ted Yu updated HBASE-21279: --- Resolution: Fixed Hadoop Flags: Reviewed Fix Version/s: 3.0.0 Status: Resolved (was:

[jira] [Updated] (HBASE-21281) Update bouncycastle dependency.

2018-10-17 Thread Ted Yu (JIRA)
[ https://issues.apache.org/jira/browse/HBASE-21281?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Ted Yu updated HBASE-21281: --- Resolution: Fixed Status: Resolved (was: Patch Available) Pushed addendum. Thanks Josh for review.

[jira] [Commented] (HBASE-21281) Update bouncycastle dependency.

2018-10-17 Thread Ted Yu (JIRA)
[ https://issues.apache.org/jira/browse/HBASE-21281?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16654330#comment-16654330 ] Ted Yu commented on HBASE-21281: Thanks for checking, Josh. Will integrate addendum later today. >

[jira] [Commented] (HBASE-21198) Exclude dependency on net.minidev:json-smart

2018-10-17 Thread Ted Yu (JIRA)
[ https://issues.apache.org/jira/browse/HBASE-21198?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16654055#comment-16654055 ] Ted Yu commented on HBASE-21198: Thanks Artem for working on this. > Exclude dependency on

[jira] [Commented] (HADOOP-15850) CopyCommitter#concatFileChunks should check that the blocks per chunk is not 0

2018-10-17 Thread Ted Yu (JIRA)
[ https://issues.apache.org/jira/browse/HADOOP-15850?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16653848#comment-16653848 ] Ted Yu commented on HADOOP-15850: - [~ste...@apache.org] [~yzhangal] [~jojochuang] Mind taking a look

[jira] [Updated] (HADOOP-15850) CopyCommitter#concatFileChunks should check that the blocks per chunk is not 0

2018-10-17 Thread Ted Yu (JIRA)
[ https://issues.apache.org/jira/browse/HADOOP-15850?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Ted Yu updated HADOOP-15850: Attachment: HADOOP-15850.v3.patch > CopyCommitter#concatFileChunks should check that the blocks per

[jira] [Updated] (HADOOP-15850) CopyCommitter#concatFileChunks should check that the blocks per chunk is not 0

2018-10-17 Thread Ted Yu (JIRA)
[ https://issues.apache.org/jira/browse/HADOOP-15850?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Ted Yu updated HADOOP-15850: Issue Type: Bug (was: Task) > CopyCommitter#concatFileChunks should check that the blocks per chunk is

[jira] [Commented] (HBASE-21149) TestIncrementalBackupWithBulkLoad may fail due to file copy failure

2018-10-17 Thread Ted Yu (JIRA)
[ https://issues.apache.org/jira/browse/HBASE-21149?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16653816#comment-16653816 ] Ted Yu commented on HBASE-21149: >From feedback of two hadoop committers over HADOOP-15850, this seems

[jira] [Commented] (HBASE-21279) Split TestAdminShell into several tests

2018-10-17 Thread Ted Yu (JIRA)
[ https://issues.apache.org/jira/browse/HBASE-21279?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16653810#comment-16653810 ] Ted Yu commented on HBASE-21279: In the current way of splitting tests, I don't see

[jira] [Commented] (HBASE-21279) Split TestAdminShell into several tests

2018-10-17 Thread Ted Yu (JIRA)
[ https://issues.apache.org/jira/browse/HBASE-21279?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16653785#comment-16653785 ] Ted Yu commented on HBASE-21279: {code} + # Create test table if it does not exist +

[jira] [Commented] (HBASE-21279) Split TestAdminShell into several tests

2018-10-17 Thread Ted Yu (JIRA)
[ https://issues.apache.org/jira/browse/HBASE-21279?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16653784#comment-16653784 ] Ted Yu commented on HBASE-21279: With patch v2: {{mvn test -Dtest=TestAdminShell* -rf :hbase-shell}} I

[jira] [Commented] (HADOOP-15850) CopyCommitter#concatFileChunks should check that the blocks per chunk is not 0

2018-10-17 Thread Ted Yu (JIRA)
[ https://issues.apache.org/jira/browse/HADOOP-15850?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16653756#comment-16653756 ] Ted Yu commented on HADOOP-15850: - I tested the patch v2 in two ways: * when there is no

[jira] [Updated] (HADOOP-15850) CopyCommitter#concatFileChunks should check that the blocks per chunk is not 0

2018-10-17 Thread Ted Yu (JIRA)
[ https://issues.apache.org/jira/browse/HADOOP-15850?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Ted Yu updated HADOOP-15850: Status: Patch Available (was: Open) > CopyCommitter#concatFileChunks should check that the blocks per

[jira] [Updated] (HADOOP-15850) CopyCommitter#concatFileChunks should check that the blocks per chunk is not 0

2018-10-17 Thread Ted Yu (JIRA)
[ https://issues.apache.org/jira/browse/HADOOP-15850?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Ted Yu updated HADOOP-15850: Summary: CopyCommitter#concatFileChunks should check that the blocks per chunk is not 0 (was:

[jira] [Updated] (HADOOP-15850) CopyCommitter#concatFileChunks should check that the source file to be merged is a split

2018-10-17 Thread Ted Yu (JIRA)
[ https://issues.apache.org/jira/browse/HADOOP-15850?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Ted Yu updated HADOOP-15850: Attachment: (was: HADOOP-15850.v1.patch) > CopyCommitter#concatFileChunks should check that the

[jira] [Updated] (HADOOP-15850) CopyCommitter#concatFileChunks should check that the source file to be merged is a split

2018-10-17 Thread Ted Yu (JIRA)
[ https://issues.apache.org/jira/browse/HADOOP-15850?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Ted Yu updated HADOOP-15850: Attachment: HADOOP-15850.v2.patch > CopyCommitter#concatFileChunks should check that the source file to

[jira] [Comment Edited] (HADOOP-15850) CopyCommitter#concatFileChunks should check that the source file to be merged is a split

2018-10-17 Thread Ted Yu (JIRA)
[ https://issues.apache.org/jira/browse/HADOOP-15850?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16653574#comment-16653574 ] Ted Yu edited comment on HADOOP-15850 at 10/17/18 3:25 PM: --- In order to

[jira] [Commented] (HBASE-21246) Introduce WALIdentity interface

2018-10-17 Thread Ted Yu (JIRA)
[ https://issues.apache.org/jira/browse/HBASE-21246?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16653646#comment-16653646 ] Ted Yu commented on HBASE-21246: When making relevant changes in replication related classes, I came

[jira] [Commented] (HADOOP-15850) CopyCommitter#concatFileChunks should check that the source file to be merged is a split

2018-10-17 Thread Ted Yu (JIRA)
[ https://issues.apache.org/jira/browse/HADOOP-15850?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16653574#comment-16653574 ] Ted Yu commented on HADOOP-15850: - I haven't found how to pass the per chunk information to

[jira] [Comment Edited] (HBASE-21246) Introduce WALIdentity interface

2018-10-16 Thread Ted Yu (JIRA)
[ https://issues.apache.org/jira/browse/HBASE-21246?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16652899#comment-16652899 ] Ted Yu edited comment on HBASE-21246 at 10/17/18 4:16 AM: -- bq. the strange

[jira] [Commented] (HBASE-21246) Introduce WALIdentity interface

2018-10-16 Thread Ted Yu (JIRA)
[ https://issues.apache.org/jira/browse/HBASE-21246?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16652899#comment-16652899 ] Ted Yu commented on HBASE-21246: bq. the strange thing is that we have a method which creates

[jira] [Commented] (HADOOP-15850) CopyCommitter#concatFileChunks should check that the source file to be merged is a split

2018-10-16 Thread Ted Yu (JIRA)
[ https://issues.apache.org/jira/browse/HADOOP-15850?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16652876#comment-16652876 ] Ted Yu commented on HADOOP-15850: - I tried to add '-blocksperchunk 0' option when invoking DistCp:

[jira] [Commented] (HADOOP-15850) CopyCommitter#concatFileChunks should check that the source file to be merged is a split

2018-10-16 Thread Ted Yu (JIRA)
[ https://issues.apache.org/jira/browse/HADOOP-15850?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16652765#comment-16652765 ] Ted Yu commented on HADOOP-15850: - The DistCpOptions instance for the DistCp session is not passed to

[jira] [Commented] (HADOOP-15850) CopyCommitter#concatFileChunks should check that the source file to be merged is a split

2018-10-16 Thread Ted Yu (JIRA)
[ https://issues.apache.org/jira/browse/HADOOP-15850?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16652736#comment-16652736 ] Ted Yu commented on HADOOP-15850: - [~jojochuang]: See the link to MapReduceBackupCopyJob.java in my

[jira] [Commented] (HADOOP-15850) CopyCommitter#concatFileChunks should check that the source file to be merged is a split

2018-10-16 Thread Ted Yu (JIRA)
[ https://issues.apache.org/jira/browse/HADOOP-15850?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16652726#comment-16652726 ] Ted Yu commented on HADOOP-15850: - Running the backup test against hadoop 3.0.x / 3.1.y , this is

[jira] [Updated] (HADOOP-15850) CopyCommitter#concatFileChunks should check that the source file to be merged is a split

2018-10-16 Thread Ted Yu (JIRA)
[ https://issues.apache.org/jira/browse/HADOOP-15850?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Ted Yu updated HADOOP-15850: Attachment: HADOOP-15850.v1.patch > CopyCommitter#concatFileChunks should check that the source file to

[jira] [Updated] (HADOOP-15850) CopyCommitter#concatFileChunks should check that the source file to be merged is a split

2018-10-16 Thread Ted Yu (JIRA)
[ https://issues.apache.org/jira/browse/HADOOP-15850?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Ted Yu updated HADOOP-15850: Description: I was investigating test failure of TestIncrementalBackupWithBulkLoad from hbase against

[jira] [Updated] (HADOOP-15850) CopyCommitter#concatFileChunks should check that the source file to be merged is a split

2018-10-16 Thread Ted Yu (JIRA)
[ https://issues.apache.org/jira/browse/HADOOP-15850?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Ted Yu updated HADOOP-15850: Summary: CopyCommitter#concatFileChunks should check that the source file to be merged is a split (was:

[jira] [Commented] (HADOOP-15850) Allow CopyCommitter to skip concatenating source files specified by DistCpConstants.CONF_LABEL_LISTING_FILE_PATH

2018-10-16 Thread Ted Yu (JIRA)
[ https://issues.apache.org/jira/browse/HADOOP-15850?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16652693#comment-16652693 ] Ted Yu commented on HADOOP-15850: - I wonder if the check for mismatching FileStatus should be refined

[jira] [Commented] (RATIS-274) Read/Write-path of log stream state machine

2018-10-16 Thread Ted Yu (JIRA)
[ https://issues.apache.org/jira/browse/RATIS-274?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16652660#comment-16652660 ] Ted Yu commented on RATIS-274: -- {code} + public ByteBuffer readNext() throws IOException { +int num = 1;

[jira] [Updated] (HBASE-21216) TestSnapshotFromMaster#testSnapshotHFileArchiving is flaky

2018-10-16 Thread Ted Yu (JIRA)
[ https://issues.apache.org/jira/browse/HBASE-21216?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Ted Yu updated HBASE-21216: --- Fix Version/s: 3.0.0 > TestSnapshotFromMaster#testSnapshotHFileArchiving is flaky >

[jira] [Comment Edited] (HBASE-21279) Split TestAdminShell into several tests

2018-10-16 Thread Ted Yu (JIRA)
[ https://issues.apache.org/jira/browse/HBASE-21279?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16652387#comment-16652387 ] Ted Yu edited comment on HBASE-21279 at 10/16/18 8:21 PM: -- Thanks for working

[jira] [Commented] (HBASE-21279) Split TestAdminShell into several tests

2018-10-16 Thread Ted Yu (JIRA)
[ https://issues.apache.org/jira/browse/HBASE-21279?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16652387#comment-16652387 ] Ted Yu commented on HBASE-21279: {code} +module Hbase + class AdminHelpersTest < Test::Unit::TestCase +

[jira] [Commented] (HBASE-21285) Enhanced TableSnapshotInputFormat to allow a size based splitting

2018-10-16 Thread Ted Yu (JIRA)
[ https://issues.apache.org/jira/browse/HBASE-21285?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16652319#comment-16652319 ] Ted Yu commented on HBASE-21285: {code} +public TableDescriptor getTableDescriptor() { + return

[jira] [Commented] (HBASE-21149) TestIncrementalBackupWithBulkLoad may fail due to file copy failure

2018-10-16 Thread Ted Yu (JIRA)
[ https://issues.apache.org/jira/browse/HBASE-21149?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16652171#comment-16652171 ] Ted Yu commented on HBASE-21149: Added more DEBUG log: {code} 2018-10-16 17:59:05,032 DEBUG

[jira] [Updated] (HBASE-21149) TestIncrementalBackupWithBulkLoad may fail due to file copy failure

2018-10-16 Thread Ted Yu (JIRA)
[ https://issues.apache.org/jira/browse/HBASE-21149?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Ted Yu updated HBASE-21149: --- Status: Open (was: Patch Available) > TestIncrementalBackupWithBulkLoad may fail due to file copy failure

[jira] [Commented] (HBASE-21246) Introduce WALIdentity interface

2018-10-16 Thread Ted Yu (JIRA)
[ https://issues.apache.org/jira/browse/HBASE-21246?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16651982#comment-16651982 ] Ted Yu commented on HBASE-21246: See if I understand Josh's proposal correctly. Under Josh's proposal,

[jira] [Commented] (HBASE-21149) TestIncrementalBackupWithBulkLoad may fail due to file copy failure

2018-10-16 Thread Ted Yu (JIRA)
[ https://issues.apache.org/jira/browse/HBASE-21149?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16651961#comment-16651961 ] Ted Yu commented on HBASE-21149: Ran the test against hadoop 3.0.1 and got the same error: {code}

[jira] [Commented] (HBASE-21285) Enhanced TableSnapshotInputFormat to allow a size based splitting

2018-10-16 Thread Ted Yu (JIRA)
[ https://issues.apache.org/jira/browse/HBASE-21285?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16651954#comment-16651954 ] Ted Yu commented on HBASE-21285: Some tests are flaky - they pass when the machine is lightly loaded.

[jira] [Commented] (HBASE-21285) Enhanced TableSnapshotInputFormat to allow a size based splitting

2018-10-16 Thread Ted Yu (JIRA)
[ https://issues.apache.org/jira/browse/HBASE-21285?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16651941#comment-16651941 ] Ted Yu commented on HBASE-21285: Lavinia: Can you attach patch for master branch ? Thanks > Enhanced

[jira] [Commented] (HBASE-21149) TestIncrementalBackupWithBulkLoad may fail due to file copy failure

2018-10-15 Thread Ted Yu (JIRA)
[ https://issues.apache.org/jira/browse/HBASE-21149?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16651020#comment-16651020 ] Ted Yu commented on HBASE-21149: See my comment above:

[jira] [Comment Edited] (HBASE-21149) TestIncrementalBackupWithBulkLoad may fail due to file copy failure

2018-10-15 Thread Ted Yu (JIRA)
[ https://issues.apache.org/jira/browse/HBASE-21149?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16649606#comment-16649606 ] Ted Yu edited comment on HBASE-21149 at 10/16/18 1:11 AM: -- For hadoop 3.1, when

[jira] [Assigned] (HBASE-21149) TestIncrementalBackupWithBulkLoad may fail due to file copy failure

2018-10-15 Thread Ted Yu (JIRA)
[ https://issues.apache.org/jira/browse/HBASE-21149?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Ted Yu reassigned HBASE-21149: -- Assignee: Ted Yu (was: Vladimir Rodionov) > TestIncrementalBackupWithBulkLoad may fail due to file

[jira] [Updated] (HBASE-21238) MapReduceHFileSplitterJob#run shouldn't call System.exit

2018-10-15 Thread Ted Yu (JIRA)
[ https://issues.apache.org/jira/browse/HBASE-21238?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Ted Yu updated HBASE-21238: --- Resolution: Fixed Hadoop Flags: Reviewed Fix Version/s: 3.0.0 Status: Resolved (was:

[jira] [Commented] (HBASE-21238) MapReduceHFileSplitterJob#run shouldn't call System.exit

2018-10-15 Thread Ted Yu (JIRA)
[ https://issues.apache.org/jira/browse/HBASE-21238?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16650649#comment-16650649 ] Ted Yu commented on HBASE-21238: lgtm, pending QA > MapReduceHFileSplitterJob#run shouldn't call

[jira] [Updated] (HBASE-21149) TestIncrementalBackupWithBulkLoad may fail due to file copy failure

2018-10-15 Thread Ted Yu (JIRA)
[ https://issues.apache.org/jira/browse/HBASE-21149?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Ted Yu updated HBASE-21149: --- Fix Version/s: 3.0.0 Status: Patch Available (was: Open) > TestIncrementalBackupWithBulkLoad

[jira] [Commented] (HBASE-21247) Custom WAL Provider cannot be specified by configuration whose value is outside the enums in Providers

2018-10-15 Thread Ted Yu (JIRA)
[ https://issues.apache.org/jira/browse/HBASE-21247?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16650362#comment-16650362 ] Ted Yu commented on HBASE-21247: [~busbey]: Can you take a look at patch v8 ? > Custom WAL Provider

[jira] [Commented] (HBASE-21149) TestIncrementalBackupWithBulkLoad may fail due to file copy failure

2018-10-15 Thread Ted Yu (JIRA)
[ https://issues.apache.org/jira/browse/HBASE-21149?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16650327#comment-16650327 ] Ted Yu commented on HBASE-21149: bq. kicked off distcp while some of the source files were being

[jira] [Commented] (HBASE-21149) TestIncrementalBackupWithBulkLoad may fail due to file copy failure

2018-10-15 Thread Ted Yu (JIRA)
[ https://issues.apache.org/jira/browse/HBASE-21149?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16650324#comment-16650324 ] Ted Yu commented on HBASE-21149: I tried to plugin custom OutputFormat : {code} +@Override +

[jira] [Commented] (HADOOP-15850) Allow CopyCommitter to skip concatenating source files specified by DistCpConstants.CONF_LABEL_LISTING_FILE_PATH

2018-10-14 Thread Ted Yu (JIRA)
[ https://issues.apache.org/jira/browse/HADOOP-15850?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16649638#comment-16649638 ] Ted Yu commented on HADOOP-15850: - CopyCommitter#concatFileChunks is private. It is not straight

[jira] [Commented] (HBASE-21149) TestIncrementalBackupWithBulkLoad may fail due to file copy failure

2018-10-14 Thread Ted Yu (JIRA)
[ https://issues.apache.org/jira/browse/HBASE-21149?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16649617#comment-16649617 ] Ted Yu commented on HBASE-21149: Patch v2 breaks multiple source files into multiple activations of

[jira] [Updated] (HBASE-21149) TestIncrementalBackupWithBulkLoad may fail due to file copy failure

2018-10-14 Thread Ted Yu (JIRA)
[ https://issues.apache.org/jira/browse/HBASE-21149?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Ted Yu updated HBASE-21149: --- Attachment: 21149.v2.txt > TestIncrementalBackupWithBulkLoad may fail due to file copy failure >

[jira] [Commented] (HBASE-21149) TestIncrementalBackupWithBulkLoad may fail due to file copy failure

2018-10-14 Thread Ted Yu (JIRA)
[ https://issues.apache.org/jira/browse/HBASE-21149?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16649606#comment-16649606 ] Ted Yu commented on HBASE-21149: CopyCommitter#concatFileChunks would throw the following exception when

[jira] [Comment Edited] (HBASE-21149) TestIncrementalBackupWithBulkLoad may fail due to file copy failure

2018-10-14 Thread Ted Yu (JIRA)
[ https://issues.apache.org/jira/browse/HBASE-21149?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16642620#comment-16642620 ] Ted Yu edited comment on HBASE-21149 at 10/15/18 12:51 AM: --- It seems the

[jira] [Comment Edited] (HBASE-21281) Update bouncycastle dependency.

2018-10-14 Thread Ted Yu (JIRA)
[ https://issues.apache.org/jira/browse/HBASE-21281?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16648708#comment-16648708 ] Ted Yu edited comment on HBASE-21281 at 10/14/18 9:18 PM: -- The following

[jira] [Commented] (HBASE-21281) Update bouncycastle dependency.

2018-10-14 Thread Ted Yu (JIRA)
[ https://issues.apache.org/jira/browse/HBASE-21281?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16649535#comment-16649535 ] Ted Yu commented on HBASE-21281: Updated problem description above. > Update bouncycastle dependency. >

[jira] [Updated] (KYLIN-3310) Use lint for maven-compiler-plugin

2018-10-14 Thread Ted Yu (JIRA)
[ https://issues.apache.org/jira/browse/KYLIN-3310?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Ted Yu updated KYLIN-3310: -- Description: lint helps identify structural problems. We should enable lint for maven-compiler-plugin {code}

[jira] [Created] (KYLIN-3631) Utilize Arrays#parallelSort for better performance

2018-10-14 Thread Ted Yu (JIRA)
Ted Yu created KYLIN-3631: - Summary: Utilize Arrays#parallelSort for better performance Key: KYLIN-3631 URL: https://issues.apache.org/jira/browse/KYLIN-3631 Project: Kylin Issue Type: Task

[jira] [Created] (KYLIN-3631) Utilize Arrays#parallelSort for better performance

2018-10-14 Thread Ted Yu (JIRA)
Ted Yu created KYLIN-3631: - Summary: Utilize Arrays#parallelSort for better performance Key: KYLIN-3631 URL: https://issues.apache.org/jira/browse/KYLIN-3631 Project: Kylin Issue Type: Task

[jira] [Commented] (HBASE-21312) ReplicationSource should log the incorrect peerClusterId at Error level instead of Info

2018-10-14 Thread Ted Yu (JIRA)
[ https://issues.apache.org/jira/browse/HBASE-21312?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16649390#comment-16649390 ] Ted Yu commented on HBASE-21312: {code} 407 tearDownAfterClass(); {code} Why is the method

[jira] [Commented] (HBASE-13468) hbase.zookeeper.quorum supports ipv6 address

2018-10-14 Thread Ted Yu (JIRA)
[ https://issues.apache.org/jira/browse/HBASE-13468?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16649342#comment-16649342 ] Ted Yu commented on HBASE-13468: Option A seems to be better. > hbase.zookeeper.quorum supports ipv6

[jira] [Comment Edited] (HADOOP-15850) Allow CopyCommitter to skip concatenating source files specified by DistCpConstants.CONF_LABEL_LISTING_FILE_PATH

2018-10-13 Thread Ted Yu (JIRA)
[ https://issues.apache.org/jira/browse/HADOOP-15850?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16648975#comment-16648975 ] Ted Yu edited comment on HADOOP-15850 at 10/13/18 2:28 PM: --- [~yzhangal]: When

[jira] [Commented] (HADOOP-15850) Allow CopyCommitter to skip concatenating source files specified by DistCpConstants.CONF_LABEL_LISTING_FILE_PATH

2018-10-13 Thread Ted Yu (JIRA)
[ https://issues.apache.org/jira/browse/HADOOP-15850?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16648975#comment-16648975 ] Ted Yu commented on HADOOP-15850: - [~yzhangal]: When you have chance, can you take a look ? Maybe I

[jira] [Commented] (HADOOP-15850) Allow CopyCommitter to skip concatenating source files specified by DistCpConstants.CONF_LABEL_LISTING_FILE_PATH

2018-10-13 Thread Ted Yu (JIRA)
[ https://issues.apache.org/jira/browse/HADOOP-15850?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16648974#comment-16648974 ] Ted Yu commented on HADOOP-15850: - The quoted test output was from

[jira] [Commented] (HADOOP-15850) Allow CopyCommitter to skip concatenating source files specified by DistCpConstants.CONF_LABEL_LISTING_FILE_PATH

2018-10-13 Thread Ted Yu (JIRA)
[ https://issues.apache.org/jira/browse/HADOOP-15850?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16648973#comment-16648973 ] Ted Yu commented on HADOOP-15850: - This is hbase code:

[jira] [Updated] (HADOOP-15850) Allow CopyCommitter to skip concatenating source files specified by DistCpConstants.CONF_LABEL_LISTING_FILE_PATH

2018-10-13 Thread Ted Yu (JIRA)
[ https://issues.apache.org/jira/browse/HADOOP-15850?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Ted Yu updated HADOOP-15850: Attachment: testIncrementalBackupWithBulkLoad-output.txt > Allow CopyCommitter to skip concatenating

[jira] [Created] (HADOOP-15850) Allow CopyCommitter to skip concatenating source files specified by DistCpConstants.CONF_LABEL_LISTING_FILE_PATH

2018-10-13 Thread Ted Yu (JIRA)
Ted Yu created HADOOP-15850: --- Summary: Allow CopyCommitter to skip concatenating source files specified by DistCpConstants.CONF_LABEL_LISTING_FILE_PATH Key: HADOOP-15850 URL:

[jira] [Created] (HADOOP-15850) Allow CopyCommitter to skip concatenating source files specified by DistCpConstants.CONF_LABEL_LISTING_FILE_PATH

2018-10-13 Thread Ted Yu (JIRA)
Ted Yu created HADOOP-15850: --- Summary: Allow CopyCommitter to skip concatenating source files specified by DistCpConstants.CONF_LABEL_LISTING_FILE_PATH Key: HADOOP-15850 URL:

[jira] [Commented] (HBASE-21281) Update bouncycastle dependency.

2018-10-13 Thread Ted Yu (JIRA)
[ https://issues.apache.org/jira/browse/HBASE-21281?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16648925#comment-16648925 ] Ted Yu commented on HBASE-21281: TestSaslFanOutOneBlockAsyncDFSOutput passed during QA run:

[jira] [Updated] (HBASE-21281) Update bouncycastle dependency.

2018-10-12 Thread Ted Yu (JIRA)
[ https://issues.apache.org/jira/browse/HBASE-21281?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Ted Yu updated HBASE-21281: --- Attachment: 21281.addendum.patch > Update bouncycastle dependency. > --- > >

[jira] [Updated] (HBASE-21281) Update bouncycastle dependency.

2018-10-12 Thread Ted Yu (JIRA)
[ https://issues.apache.org/jira/browse/HBASE-21281?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Ted Yu updated HBASE-21281: --- Status: Patch Available (was: Reopened) I ran TestDelegationTokenWithEncryption with addendum against both

[jira] [Commented] (HBASE-21281) Update bouncycastle dependency.

2018-10-12 Thread Ted Yu (JIRA)
[ https://issues.apache.org/jira/browse/HBASE-21281?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16648708#comment-16648708 ] Ted Yu commented on HBASE-21281: The following dependency tree output shows that old bouncycastle

[jira] [Commented] (HBASE-21285) Enhanced TableSnapshotInputFormat to allow a size based splitting

2018-10-12 Thread Ted Yu (JIRA)
[ https://issues.apache.org/jira/browse/HBASE-21285?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16648501#comment-16648501 ] Ted Yu commented on HBASE-21285: I applied 21285.branch-1.4.003.patch on branch-1 but didn't reproduce

[jira] [Commented] (HBASE-21285) Enhanced TableSnapshotInputFormat to allow a size based splitting

2018-10-12 Thread Ted Yu (JIRA)
[ https://issues.apache.org/jira/browse/HBASE-21285?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16648488#comment-16648488 ] Ted Yu commented on HBASE-21285: Please check the following test error: {code} [ERROR]

[jira] [Assigned] (HBASE-21285) Enhanced TableSnapshotInputFormat to allow a size based splitting

2018-10-12 Thread Ted Yu (JIRA)
[ https://issues.apache.org/jira/browse/HBASE-21285?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Ted Yu reassigned HBASE-21285: -- Assignee: Lavinia-Stefania Sirbu > Enhanced TableSnapshotInputFormat to allow a size based splitting

[jira] [Assigned] (HBASE-21286) Parallelize computeHDFSBlocksDistribution when getting splits of a HBaseSnapshot

2018-10-12 Thread Ted Yu (JIRA)
[ https://issues.apache.org/jira/browse/HBASE-21286?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Ted Yu reassigned HBASE-21286: -- Assignee: Lavinia-Stefania Sirbu > Parallelize computeHDFSBlocksDistribution when getting splits of

[jira] [Created] (RATIS-351) Wrong specifier is used for Preconditions.assertTrue of GrpcLogAppender#onSuccess

2018-10-12 Thread Ted Yu (JIRA)
Ted Yu created RATIS-351: Summary: Wrong specifier is used for Preconditions.assertTrue of GrpcLogAppender#onSuccess Key: RATIS-351 URL: https://issues.apache.org/jira/browse/RATIS-351 Project: Ratis

<    1   2   3   4   5   6   7   8   9   10   >