[jira] [Commented] (HBASE-13160) SplitLogWorker does not pick up the task immediately
[ https://issues.apache.org/jira/browse/HBASE-13160?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16815587#comment-16815587 ] Andrew Purtell commented on HBASE-13160: Any progress here? Or unschedule it? Or close it? > SplitLogWorker does not pick up the task immediately > > > Key: HBASE-13160 > URL: https://issues.apache.org/jira/browse/HBASE-13160 > Project: HBase > Issue Type: Improvement >Reporter: Enis Soztutar >Assignee: Enis Soztutar >Priority: Major > Fix For: 1.5.0 > > Attachments: hbase-13160_v1.patch > > > We were reading some code with Jeffrey, and we realized that the > SplitLogWorker's internal task loop is weird. It does {{ls}} every second and > sleeps, but have another mechanism to learn about new tasks, but does not > make affective use of the zk notification. > I have a simple patch which might improve this area. -- This message was sent by Atlassian JIRA (v7.6.3#76005)
[jira] [Commented] (HBASE-13160) SplitLogWorker does not pick up the task immediately
[ https://issues.apache.org/jira/browse/HBASE-13160?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16400904#comment-16400904 ] Mike Drob commented on HBASE-13160: --- task locking was removed with distributed log replay in HBASE-19128, unscheduling from 2.0+ > SplitLogWorker does not pick up the task immediately > > > Key: HBASE-13160 > URL: https://issues.apache.org/jira/browse/HBASE-13160 > Project: HBase > Issue Type: Improvement >Reporter: Enis Soztutar >Assignee: Enis Soztutar >Priority: Major > Fix For: 1.5.0, 1.3.3, 1.4.3 > > Attachments: hbase-13160_v1.patch > > > We were reading some code with Jeffrey, and we realized that the > SplitLogWorker's internal task loop is weird. It does {{ls}} every second and > sleeps, but have another mechanism to learn about new tasks, but does not > make affective use of the zk notification. > I have a simple patch which might improve this area. -- This message was sent by Atlassian JIRA (v7.6.3#76005)
[jira] [Commented] (HBASE-13160) SplitLogWorker does not pick up the task immediately
[ https://issues.apache.org/jira/browse/HBASE-13160?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15338369#comment-15338369 ] Mikhail Antonov commented on HBASE-13160: - Moving to 1.3.1. [~enis] ? > SplitLogWorker does not pick up the task immediately > > > Key: HBASE-13160 > URL: https://issues.apache.org/jira/browse/HBASE-13160 > Project: HBase > Issue Type: Improvement >Reporter: Enis Soztutar >Assignee: Enis Soztutar > Fix For: 2.0.0, 1.3.1 > > Attachments: hbase-13160_v1.patch > > > We were reading some code with Jeffrey, and we realized that the > SplitLogWorker's internal task loop is weird. It does {{ls}} every second and > sleeps, but have another mechanism to learn about new tasks, but does not > make affective use of the zk notification. > I have a simple patch which might improve this area. -- This message was sent by Atlassian JIRA (v6.3.4#6332)
[jira] [Commented] (HBASE-13160) SplitLogWorker does not pick up the task immediately
[ https://issues.apache.org/jira/browse/HBASE-13160?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15265888#comment-15265888 ] Nick Dimiduk commented on HBASE-13160: -- Consider marking this as an improvement and moving out of released branches? > SplitLogWorker does not pick up the task immediately > > > Key: HBASE-13160 > URL: https://issues.apache.org/jira/browse/HBASE-13160 > Project: HBase > Issue Type: Bug >Reporter: Enis Soztutar >Assignee: Enis Soztutar > Fix For: 2.0.0, 1.3.0, 1.2.2, 1.1.6 > > Attachments: hbase-13160_v1.patch > > > We were reading some code with Jeffrey, and we realized that the > SplitLogWorker's internal task loop is weird. It does {{ls}} every second and > sleeps, but have another mechanism to learn about new tasks, but does not > make affective use of the zk notification. > I have a simple patch which might improve this area. -- This message was sent by Atlassian JIRA (v6.3.4#6332)
[jira] [Commented] (HBASE-13160) SplitLogWorker does not pick up the task immediately
[ https://issues.apache.org/jira/browse/HBASE-13160?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14590282#comment-14590282 ] Enis Soztutar commented on HBASE-13160: --- Moved to 1.1.2. Not worth risking in 1.1.1. Will commit afterwards. > SplitLogWorker does not pick up the task immediately > > > Key: HBASE-13160 > URL: https://issues.apache.org/jira/browse/HBASE-13160 > Project: HBase > Issue Type: Bug >Reporter: Enis Soztutar >Assignee: Enis Soztutar > Fix For: 2.0.0, 1.2.0, 1.1.2 > > Attachments: hbase-13160_v1.patch > > > We were reading some code with Jeffrey, and we realized that the > SplitLogWorker's internal task loop is weird. It does {{ls}} every second and > sleeps, but have another mechanism to learn about new tasks, but does not > make affective use of the zk notification. > I have a simple patch which might improve this area. -- This message was sent by Atlassian JIRA (v6.3.4#6332)
[jira] [Commented] (HBASE-13160) SplitLogWorker does not pick up the task immediately
[ https://issues.apache.org/jira/browse/HBASE-13160?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14587358#comment-14587358 ] Nick Dimiduk commented on HBASE-13160: -- Any movement here? > SplitLogWorker does not pick up the task immediately > > > Key: HBASE-13160 > URL: https://issues.apache.org/jira/browse/HBASE-13160 > Project: HBase > Issue Type: Bug >Reporter: Enis Soztutar >Assignee: Enis Soztutar > Fix For: 2.0.0, 1.2.0, 1.1.1 > > Attachments: hbase-13160_v1.patch > > > We were reading some code with Jeffrey, and we realized that the > SplitLogWorker's internal task loop is weird. It does {{ls}} every second and > sleeps, but have another mechanism to learn about new tasks, but does not > make affective use of the zk notification. > I have a simple patch which might improve this area. -- This message was sent by Atlassian JIRA (v6.3.4#6332)
[jira] [Commented] (HBASE-13160) SplitLogWorker does not pick up the task immediately
[ https://issues.apache.org/jira/browse/HBASE-13160?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14350757#comment-14350757 ] Jeffrey Zhong commented on HBASE-13160: --- +1. Two very minor things: if we could append the condition {code} if (seq_start == taskReadySeq) { {code} to {code} if (seq_start == taskReadySeq && numTasks==0) { {code} 2) the following isn't needed any more {noformat} if (childrenPaths != null) { return childrenPaths; } {noformat} > SplitLogWorker does not pick up the task immediately > > > Key: HBASE-13160 > URL: https://issues.apache.org/jira/browse/HBASE-13160 > Project: HBase > Issue Type: Bug >Reporter: Enis Soztutar >Assignee: Enis Soztutar > Fix For: 2.0.0, 1.1.0 > > Attachments: hbase-13160_v1.patch > > > We were reading some code with Jeffrey, and we realized that the > SplitLogWorker's internal task loop is weird. It does {{ls}} every second and > sleeps, but have another mechanism to learn about new tasks, but does not > make affective use of the zk notification. > I have a simple patch which might improve this area. -- This message was sent by Atlassian JIRA (v6.3.4#6332)
[jira] [Commented] (HBASE-13160) SplitLogWorker does not pick up the task immediately
[ https://issues.apache.org/jira/browse/HBASE-13160?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14349967#comment-14349967 ] Ted Yu commented on HBASE-13160: lgtm > SplitLogWorker does not pick up the task immediately > > > Key: HBASE-13160 > URL: https://issues.apache.org/jira/browse/HBASE-13160 > Project: HBase > Issue Type: Bug >Reporter: Enis Soztutar >Assignee: Enis Soztutar > Fix For: 2.0.0, 1.1.0 > > Attachments: hbase-13160_v1.patch > > > We were reading some code with Jeffrey, and we realized that the > SplitLogWorker's internal task loop is weird. It does {{ls}} every second and > sleeps, but have another mechanism to learn about new tasks, but does not > make affective use of the zk notification. > I have a simple patch which might improve this area. -- This message was sent by Atlassian JIRA (v6.3.4#6332)
[jira] [Commented] (HBASE-13160) SplitLogWorker does not pick up the task immediately
[ https://issues.apache.org/jira/browse/HBASE-13160?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14349706#comment-14349706 ] Hadoop QA commented on HBASE-13160: --- {color:red}-1 overall{color}. Here are the results of testing the latest attachment http://issues.apache.org/jira/secure/attachment/12702919/hbase-13160_v1.patch against master branch at commit 4570451f7cf2dba2b22664b470b73547e2496a88. ATTACHMENT ID: 12702919 {color:green}+1 @author{color}. The patch does not contain any @author tags. {color:red}-1 tests included{color}. The patch doesn't appear to include any new or modified tests. Please justify why no new tests are needed for this patch. Also please list what manual steps were performed to verify this patch. {color:green}+1 hadoop versions{color}. The patch compiles with all supported hadoop versions (2.4.1 2.5.2 2.6.0) {color:green}+1 javac{color}. The applied patch does not increase the total number of javac compiler warnings. {color:green}+1 javac{color}. The applied patch does not increase the total number of javac compiler warnings. {color:green}+1 javadoc{color}. The javadoc tool did not generate any warning messages. {color:green}+1 checkstyle{color}. The applied patch does not increase the total number of checkstyle errors {color:green}+1 findbugs{color}. The patch does not introduce any new Findbugs (version 2.0.3) warnings. {color:green}+1 release audit{color}. The applied patch does not increase the total number of release audit warnings. {color:green}+1 lineLengths{color}. The patch does not introduce lines longer than 100 {color:red}-1 site{color}. The patch appears to cause mvn site goal to fail. {color:green}+1 core tests{color}. The patch passed unit tests in . Test results: https://builds.apache.org/job/PreCommit-HBASE-Build/13105//testReport/ Findbugs warnings: https://builds.apache.org/job/PreCommit-HBASE-Build/13105//artifact/patchprocess/newPatchFindbugsWarningshbase-prefix-tree.html Findbugs warnings: https://builds.apache.org/job/PreCommit-HBASE-Build/13105//artifact/patchprocess/newPatchFindbugsWarningshbase-examples.html Findbugs warnings: https://builds.apache.org/job/PreCommit-HBASE-Build/13105//artifact/patchprocess/newPatchFindbugsWarningshbase-common.html Findbugs warnings: https://builds.apache.org/job/PreCommit-HBASE-Build/13105//artifact/patchprocess/newPatchFindbugsWarningshbase-annotations.html Findbugs warnings: https://builds.apache.org/job/PreCommit-HBASE-Build/13105//artifact/patchprocess/newPatchFindbugsWarningshbase-hadoop-compat.html Findbugs warnings: https://builds.apache.org/job/PreCommit-HBASE-Build/13105//artifact/patchprocess/newPatchFindbugsWarningshbase-rest.html Findbugs warnings: https://builds.apache.org/job/PreCommit-HBASE-Build/13105//artifact/patchprocess/newPatchFindbugsWarningshbase-client.html Findbugs warnings: https://builds.apache.org/job/PreCommit-HBASE-Build/13105//artifact/patchprocess/newPatchFindbugsWarningshbase-thrift.html Findbugs warnings: https://builds.apache.org/job/PreCommit-HBASE-Build/13105//artifact/patchprocess/newPatchFindbugsWarningshbase-protocol.html Findbugs warnings: https://builds.apache.org/job/PreCommit-HBASE-Build/13105//artifact/patchprocess/newPatchFindbugsWarningshbase-server.html Findbugs warnings: https://builds.apache.org/job/PreCommit-HBASE-Build/13105//artifact/patchprocess/newPatchFindbugsWarningshbase-hadoop2-compat.html Checkstyle Errors: https://builds.apache.org/job/PreCommit-HBASE-Build/13105//artifact/patchprocess/checkstyle-aggregate.html Console output: https://builds.apache.org/job/PreCommit-HBASE-Build/13105//console This message is automatically generated. > SplitLogWorker does not pick up the task immediately > > > Key: HBASE-13160 > URL: https://issues.apache.org/jira/browse/HBASE-13160 > Project: HBase > Issue Type: Bug >Reporter: Enis Soztutar >Assignee: Enis Soztutar > Fix For: 2.0.0, 1.1.0 > > Attachments: hbase-13160_v1.patch > > > We were reading some code with Jeffrey, and we realized that the > SplitLogWorker's internal task loop is weird. It does {{ls}} every second and > sleeps, but have another mechanism to learn about new tasks, but does not > make affective use of the zk notification. > I have a simple patch which might improve this area. -- This message was sent by Atlassian JIRA (v6.3.4#6332)
[jira] [Commented] (HBASE-13160) SplitLogWorker does not pick up the task immediately
[ https://issues.apache.org/jira/browse/HBASE-13160?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14349566#comment-14349566 ] Enis Soztutar commented on HBASE-13160: --- cc [~jeffreyz]. The patch is totally untested BTW. Let's wait for hadoopqa. > SplitLogWorker does not pick up the task immediately > > > Key: HBASE-13160 > URL: https://issues.apache.org/jira/browse/HBASE-13160 > Project: HBase > Issue Type: Bug >Reporter: Enis Soztutar >Assignee: Enis Soztutar > Fix For: 2.0.0, 1.1.0 > > Attachments: hbase-13160_v1.patch > > > We were reading some code with Jeffrey, and we realized that the > SplitLogWorker's internal task loop is weird. It does {{ls}} every second and > sleeps, but have another mechanism to learn about new tasks, but does not > make affective use of the zk notification. > I have a simple patch which might improve this area. -- This message was sent by Atlassian JIRA (v6.3.4#6332)