Re: More votes requested for 2.5.4 RC0
Thank you, everyone. I will close the vote tomorrow (Friday), Pacific day time. On Wed, Apr 12, 2023 at 8:50 PM 张铎(Duo Zhang) wrote: > Will take a look today. > > Andrew Purtell 于2023年4月13日周四 05:31写道： > > > Between Stephen and myself we have 2 +1 votes, but need at least one > more. > > > > -- > > Best regards, > > Andrew > > > -- Best regards, Andrew Unrest, ignorance distilled, nihilistic imbeciles - It's what we’ve earned Welcome, apocalypse, what’s taken you so long? Bring us the fitting end that we’ve been counting on - A23, Welcome, Apocalypse
[jira] [Created] (HBASE-27793) hbck can report unknown servers as inconsistencies
Rajeshbabu Chintaguntla created HBASE-27793: --- Summary: hbck can report unknown servers as inconsistencies Key: HBASE-27793 URL: https://issues.apache.org/jira/browse/HBASE-27793 Project: HBase Issue Type: Bug Components: hbck Reporter: Rajeshbabu Chintaguntla Assignee: Rajeshbabu Chintaguntla Currently hbck is not reporting unknown servers it would be helpful to report those as inconsistencies so that directly hbck2 schedulerecoveries option can be used to recover on unknown servers otherwise the taking the action for inconsistencies reported due to unknown servers may corrupt if not done properly. -- This message was sent by Atlassian Jira (v8.20.10#820010)
Re: [VOTE] The first release candidate for 2.5.4 (RC0) is available
+1 * Signature: ok * Checksum : ok * Rat check (1.8.0_351): ok - mvn clean apache-rat:check * Built from source (1.8.0_351): ok - mvn clean install -DskipTests * Unit tests pass (1.8.0_351): ok - mvn clean package -P runSmallTests -Dsurefire.rerunFailingTestsCount=3 * LTT with 1M rows looks good * CRUD, flush, compaction looks good On Thu, Apr 6, 2023 at 10:04 PM Andrew Purtell wrote: > The VOTE will remain open for at least 72 hours. > > [ ] +1 Release this package as Apache HBase 2.5.4 > [ ] -1 Do not release this package because ... > > The tag to be voted on is 2.5.4RC0: > > https://github.com/apache/hbase/tree/2.5.4RC0 > > This tag currently points to git reference > > 2e426ab69d126e683577b6e94f890800c5122910 > > The release files, including signatures, digests, as well as CHANGES.md > and RELEASENOTES.md included in this RC can be found at: > > https://dist.apache.org/repos/dist/dev/hbase/2.5.4RC0/ > > The API compatibility report comparing this RC to the previous release > can be found at: > > > > https://dist.apache.org/repos/dist/dev/hbase/2.5.4RC0/api_compare_2.5.3_to_2.5.4RC0.html > > Maven artifacts are available in a staging repository at: > > https://repository.apache.org/content/repositories/orgapachehbase-1516/ > > Maven artifacts for Hadoop 3 are available in a staging repository at: > > https://repository.apache.org/content/repositories/orgapachehbase-1517/ > > Artifacts were signed with the key 8597754DD5365CCD which can be found in: > > https://downloads.apache.org/hbase/KEYS > > To learn more about Apache HBase, please see > > http://hbase.apache.org/ > > Thanks, > Your HBase Release Manager >
Re: HBase Meetup April 2023
Hi everyone, For those didn't put your email on the signup, I searched and sent the invite to your apache.org email ….. if you don’t have the meeting invite or would like to have the meeting invite on your calendar, please ping me your preferred gmail / email , then I will resend the invite to you directly…sorry for that. See you soon on 4/19, and please feel free to ping me if you have any questions. Thanks, Stephen On Sat, Apr 8, 2023 at 10:28 AM Tak Lon (Stephen) Wu wrote: > Hi guys, > > The final date will be on 4/19 Wednesday PDT 7:30 AM because we have more > folks joining (and I will cancel the invites on 4/12). > > the physical location is 5470 Great America Pkwy , Santa Clara, CA 95054 > (Cloudera building Room Ontario), the virtual meeting link is > https://cloudera.zoom.us/j/91365181291 (I'm reusing my $dayjob room). > > If you would like to join and didn't receive the invite (sorry if I missed > you on the signup sheet), please let me know directly. > > See you soon! > > Thanks, > Stephen > > > > On Wed, Apr 5, 2023 at 4:06 PM Tak Lon (Stephen) Wu > wrote: > > > Hi everyone, > > > > I sent our two invitations, one for 4/12 and one for 4/19 (all of us are > > still within the same day), both session will be starting at 07:30 am PDT > > UTC-7 > > > > Please update the signup sheet again [1] or reply to this email directly > (I > > will update the sheet for you), I will put down which date has more > > participants by 04/08 Sat PDT noon, and confirm the final date. > > > > To Mallikarjun and Thibault, I don't have your email/gmail and can you > > share that to me? [1] > > > > > https://docs.google.com/spreadsheets/d/1TBawOo68GSxkjahCPNjDT3nhdCA-Jv_lG9Qf7hEy96U/edit#gid=0 > > > > Thanks, > > Stephen > > > > On Thu, Mar 30, 2023 at 5:14 PM Tak Lon (Stephen) Wu > > wrote: > > > > > Hi users/developers/friends, > > > > > > I’m wondering if any users, developers or anyone would be interested > in a > > > hybrid (physical and virtual) meetup, where the physical meetup is > going > > to > > > be hosted in the Bay area/Santa Clara/San Jose (with foods and drinks), > > and > > > the virtual call will be a zoom call/google hangout for the people > around > > > the world. the session should be around 1 ~ 2 hours. > > > > > > Topics could be discussed over the user slack channel (we have a thread > > > there already) or this email if anyone has any emerging, interesting > > ideas > > > for the HBase community, although I have few starters in my mind > > > * What are we going to do in ApacheCon/Community over the code, > > > https://communityovercode.org/ > > > * Few recent discussions on the dev channel > > > - Review/discussion of what's in 2.6 > > > - HBase on K8s > > > - HBase on Ozone integration > > > - MTLS integration > > > - HBase backup > > > - more ... > > > > > > If you like to participate, please signup on this google spreadsheet > [1]. > > > Once we confirm the date, we will reply on this thread. I will try to > > > accommodate everyone, but if the time conflict is real and we have many > > > things to cover, we could have multiple sessions to cover people who > > cannot > > > make it. > > > > > > (Chinese version) > > > 大家好，我想看看有任何用户、开发人员或任何人会对举办一个非官方线上聚会感兴趣，时长大概为1或2小时。 > > > > > > 本次聚会的目的为鼓励大家提出对 HBase 项目有任何建议，或新兴的、有趣的想法。以下为我收集的一些议题 > > > * ApacheCon/Community https://communityovercode.org/ > > > 將會於本年2023年10月舉行，我們HBASE 項目有任何參與的想法或活動嗎？ > > > * 最近在DEV频道上的讨论 > > > - Review/discussion of what's in 2.6 > > > - HBase on K8s > > > - HBase on Ozone integration > > > - MTLS integration > > > - HBase backup > > > - more ... > > > > > > > > > > > > 如果您有兴趣参加，请在此电子表格[1]填上你的名字和可参与日期。一旦我们确认线上讨论的日期，我们将在回复此邮件。我会尽量安排合适的时间，但如果时间冲突确实存在或是很多议题要讨论，我们会安排更多时间和多场会议来涵盖所需的讨论。 > > > > > > 1. Event signup sheet, > > > > > > > > > https://docs.google.com/spreadsheets/d/1TBawOo68GSxkjahCPNjDT3nhdCA-Jv_lG9Qf7hEy96U/edit#gid=0 > > > > > > Thanks, > > > Stephen > > > > > >
Re: [VOTE] The first release candidate for 2.5.4 (RC0) is available
+1 binding
~/Downloads/hbase-2.5.4
* Signature: ok
* Checksum : ok
* Rat check (1.8.0_352): ok
- mvn clean apache-rat:check
* Built from source (1.8.0_352): ok
- mvn clean install -DskipTests
* Unit tests pass (1.8.0_352): ok
- mvn package -P runSmallTests
Started a standalone cluster:
Basic shell commands passed: list, create, disable, drop, flush, scan,
snapshot, restore_snapshot, count
LTT Passed: hbase ltt -write 5:1000 -num_keys 1
CHANGES, RELEASENOTES, API_COMPARE, looks good to me.
Em qui., 13 de abr. de 2023 às 11:44, 张铎(Duo Zhang)
escreveu:
> +1 binding
>
> Checked sigs and sums: Matched
> LICENSE and NOTICE: In place
> Compatibility report: 100% compatible
> Built from source:
> mvn clean install -DskipTests -Dhadoop.profile=3.0
> Passed
> Run UTs:
> mvn -Dsurefire.firstPartForkCount=1C -Dsurefire.secondPartForkCount=1C
> -Dsurefire.rerunFailingTestsCount=3 -Dhadoop.profile=3.0 test -PrunAllTests
> -fn &>test.logPassed. There are several flaky ones but anyway thay passed after
> retrying.
>
> > [WARNING] Flakes:
> > [WARNING]
> >
> org.apache.hadoop.hbase.TestRegionRebalancing.testRebalanceOnRegionServerNumberChange[1]
> > [ERROR] Run 1:
> > TestRegionRebalancing.testRebalanceOnRegionServerNumberChange:142
> > [INFO] Run 2: PASS
> > [INFO]
> > [WARNING]
> > org.apache.hadoop.hbase.master.TestUnknownServers.testListUnknownServers
> > [ERROR] Run 1: TestUnknownServers.testListUnknownServers:58
> expected:<1>
> > but was:<2>
> > [INFO] Run 2: PASS
> > [INFO]
> > [WARNING]
> >
> org.apache.hadoop.hbase.replication.regionserver.TestBasicWALEntryStreamFSHLog.testSizeOfLogQueue
> > [ERROR] Run 1:
> >
> TestBasicWALEntryStreamFSHLog>TestBasicWALEntryStream.testSizeOfLogQueue:703
> > expected:<1> but was:<2>
> > [INFO] Run 2: PASS
> > [INFO]
> > [WARNING]
> >
> org.apache.hadoop.hbase.security.access.TestZKPermissionWatcher.testPermissionsWatcher
> > [ERROR] Run 1: TestZKPermissionWatcher.testPermissionsWatcher:131
> > Waiting timed out after [10,000] msec
> > [INFO] Run 2: PASS
>
> Start a mini cluster:
> Succeeded.
> Check logs and web pages, nothing unusual
> Run LTT to load 1 rows:
> ./bin/hbase ltt -write 4:1024 -num_keys 1
> Passed
> Tried some basic shell commands:
> list, create, put, get, scan, scan with filter, count, disable, drop
> All OK.
>
> Tak Lon (Stephen) Wu 于2023年4月8日周六 01:00写道：
>
> > +1 (binding)
> >
> > * Signature: ok
> > * Checksum : ok
> > * Rat check (1.8.0_362): ok
> > - mvn clean apache-rat:check
> > * Built from source (1.8.0_362): ok
> > - mvn clean install -DskipTests
> > * Unit tests pass (1.8.0_362): ok
> > - mvn clean package -P runAllTests
> > -Dsurefire.rerunFailingTestsCount=3
> > - TestTableShell.testRunShellTests failed because it hits a race
> > condition
> > when table
> > test_Hbase::Table_constructor_should_not_fail_for_existent_tables
> > already have created, rerunning it passed
> > * API compatibility report: ok
> > * CHANGES.md : ok
> > * Started standalone and check UI: ok
> > * tested create/put/get/scan/flush/list/disable/drop : ok
> > * tested LTT : ok
> > - bin/hbase ltt -num_keys 1 -write 10:1000:32
> > * tested ITBLL : ok
> > - bin/hbase
> > org.apache.hadoop.hbase.test.IntegrationTestBigLinkedList loop 1 10
> 100
> > ${RANDOM} 16
> >
> > -Stephen
> >
> > On Thu, Apr 6, 2023 at 10:04 PM Andrew Purtell
> > wrote:
> >
> > > The VOTE will remain open for at least 72 hours.
> > >
> > > [ ] +1 Release this package as Apache HBase 2.5.4
> > > [ ] -1 Do not release this package because ...
> > >
> > > The tag to be voted on is 2.5.4RC0:
> > >
> > > https://github.com/apache/hbase/tree/2.5.4RC0
> > >
> > > This tag currently points to git reference
> > >
> > > 2e426ab69d126e683577b6e94f890800c5122910
> > >
> > > The release files, including signatures, digests, as well as CHANGES.md
> > > and RELEASENOTES.md included in this RC can be found at:
> > >
> > > https://dist.apache.org/repos/dist/dev/hbase/2.5.4RC0/
> > >
> > > The API compatibility report comparing this RC to the previous release
> > > can be found at:
> > >
> > >
> > >
> > >
> >
> https://dist.apache.org/repos/dist/dev/hbase/2.5.4RC0/api_compare_2.5.3_to_2.5.4RC0.html
> > >
> > > Maven artifacts are available in a staging repository at:
> > >
> > >
> > https://repository.apache.org/content/repositories/orgapachehbase-1516/
> > >
> > > Maven artifacts for Hadoop 3 are available in a staging repository at:
> > >
> > >
> > https://repository.apache.org/content/repositories/orgapachehbase-1517/
> > >
> > > Artifacts were signed with the key 8597754DD5365CCD which can be found
> > in:
> > >
> > > https://downloads.apache.org/hbase/KEYS
> > >
> > > To learn more about Apache HBase, please
Re: [DISCUSS] Flatten plugin and project metadata
If there are no big concerns, I will file jira issues to change the flatten mode to oss. Thanks. 张铎(Duo Zhang) 于2023年4月8日周六 22:00写道： > Sorry for the late reply here. > > I tried to use flatten mode default, ossrh, oss and generate the pom > files. For the number of retained sections > > default < ossrh < oss > > To be more specific, comparing to default, ossrh has these extra sections > > name, description, url, developers, scm > > And for oss, comparing to ossrh, it has these extra sections > > > inceptionYear, organization, mailingLists, issueManagement, > distributionManagement. > > Please see the attachments for more details. > > For me, I think oss is enough for us. > > Thanks. > > 张铎(Duo Zhang) 于2023年3月20日周一 13:33写道： > >> >> https://www.mojohaus.org/flatten-maven-plugin/apidocs/org/codehaus/mojo/flatten/FlattenMode.html >> >> Maybe we should try to use oss or ossrh mode? So we can keep the mailing >> list and other things in pom. >> >> I will try these two options later and post the result here. >> >> Thanks. >> >> Nick Dimiduk 于2023年3月16日周四 16:29写道： >> >>> Heya, >>> >>> At the bottom of [0], we're having a small discussion about the impact of >>> the flatten-maven-plugin on the poms we publish. For background, since >>> we've started using Maven's "CI Friendly Versions" feature, we have also >>> started using the flatten plugin on install/deploy [1]. I notice that >>> using >>> the default configurations, we lose almost all of the project/community >>> metadata from the poms. I'm wondering if we should go out of our way to >>> preserve this extra info in our poms, or if it's really just extra weight >>> in the distribution that users can find on our website. >>> >>> Whichever path we choose, we should apply the setting across all of our >>> project repositories. >>> >>> Thanks, >>> Nick >>> >>> [0]: https://github.com/apache/hbase-operator-tools/pull/112 >>> [1]: https://maven.apache.org/maven-ci-friendly.html#install-deploy >>> >>
[jira] [Resolved] (HBASE-27727) Implement filesystem based Replication peer storage
[ https://issues.apache.org/jira/browse/HBASE-27727?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Duo Zhang resolved HBASE-27727. --- Fix Version/s: 2.6.0 3.0.0-alpha-4 Hadoop Flags: Reviewed Resolution: Fixed Pushed to master and branch-2. Thanks [~heliangjun] for reviewing! Will fill the release note soon. > Implement filesystem based Replication peer storage > --- > > Key: HBASE-27727 > URL: https://issues.apache.org/jira/browse/HBASE-27727 > Project: HBase > Issue Type: Sub-task > Components: Replication >Reporter: Duo Zhang >Assignee: Duo Zhang >Priority: Major > Fix For: 2.6.0, 3.0.0-alpha-4 > > -- This message was sent by Atlassian Jira (v8.20.10#820010)
Re: [VOTE] The first release candidate for 2.5.4 (RC0) is available
+1 binding
Checked sigs and sums: Matched
LICENSE and NOTICE: In place
Compatibility report: 100% compatible
Built from source:
mvn clean install -DskipTests -Dhadoop.profile=3.0
Passed
Run UTs:
mvn -Dsurefire.firstPartForkCount=1C -Dsurefire.secondPartForkCount=1C
-Dsurefire.rerunFailingTestsCount=3 -Dhadoop.profile=3.0 test -PrunAllTests
-fn &>test.log [WARNING] Flakes:
> [WARNING]
> org.apache.hadoop.hbase.TestRegionRebalancing.testRebalanceOnRegionServerNumberChange[1]
> [ERROR] Run 1:
> TestRegionRebalancing.testRebalanceOnRegionServerNumberChange:142
> [INFO] Run 2: PASS
> [INFO]
> [WARNING]
> org.apache.hadoop.hbase.master.TestUnknownServers.testListUnknownServers
> [ERROR] Run 1: TestUnknownServers.testListUnknownServers:58 expected:<1>
> but was:<2>
> [INFO] Run 2: PASS
> [INFO]
> [WARNING]
> org.apache.hadoop.hbase.replication.regionserver.TestBasicWALEntryStreamFSHLog.testSizeOfLogQueue
> [ERROR] Run 1:
> TestBasicWALEntryStreamFSHLog>TestBasicWALEntryStream.testSizeOfLogQueue:703
> expected:<1> but was:<2>
> [INFO] Run 2: PASS
> [INFO]
> [WARNING]
> org.apache.hadoop.hbase.security.access.TestZKPermissionWatcher.testPermissionsWatcher
> [ERROR] Run 1: TestZKPermissionWatcher.testPermissionsWatcher:131
> Waiting timed out after [10,000] msec
> [INFO] Run 2: PASS
Start a mini cluster:
Succeeded.
Check logs and web pages, nothing unusual
Run LTT to load 1 rows:
./bin/hbase ltt -write 4:1024 -num_keys 1
Passed
Tried some basic shell commands:
list, create, put, get, scan, scan with filter, count, disable, drop
All OK.
Tak Lon (Stephen) Wu 于2023年4月8日周六 01:00写道：
> +1 (binding)
>
> * Signature: ok
> * Checksum : ok
> * Rat check (1.8.0_362): ok
> - mvn clean apache-rat:check
> * Built from source (1.8.0_362): ok
> - mvn clean install -DskipTests
> * Unit tests pass (1.8.0_362): ok
> - mvn clean package -P runAllTests
> -Dsurefire.rerunFailingTestsCount=3
> - TestTableShell.testRunShellTests failed because it hits a race
> condition
> when table
> test_Hbase::Table_constructor_should_not_fail_for_existent_tables
> already have created, rerunning it passed
> * API compatibility report: ok
> * CHANGES.md : ok
> * Started standalone and check UI: ok
> * tested create/put/get/scan/flush/list/disable/drop : ok
> * tested LTT : ok
> - bin/hbase ltt -num_keys 1 -write 10:1000:32
> * tested ITBLL : ok
> - bin/hbase
> org.apache.hadoop.hbase.test.IntegrationTestBigLinkedList loop 1 10 100
> ${RANDOM} 16
>
> -Stephen
>
> On Thu, Apr 6, 2023 at 10:04 PM Andrew Purtell
> wrote:
>
> > The VOTE will remain open for at least 72 hours.
> >
> > [ ] +1 Release this package as Apache HBase 2.5.4
> > [ ] -1 Do not release this package because ...
> >
> > The tag to be voted on is 2.5.4RC0:
> >
> > https://github.com/apache/hbase/tree/2.5.4RC0
> >
> > This tag currently points to git reference
> >
> > 2e426ab69d126e683577b6e94f890800c5122910
> >
> > The release files, including signatures, digests, as well as CHANGES.md
> > and RELEASENOTES.md included in this RC can be found at:
> >
> > https://dist.apache.org/repos/dist/dev/hbase/2.5.4RC0/
> >
> > The API compatibility report comparing this RC to the previous release
> > can be found at:
> >
> >
> >
> >
> https://dist.apache.org/repos/dist/dev/hbase/2.5.4RC0/api_compare_2.5.3_to_2.5.4RC0.html
> >
> > Maven artifacts are available in a staging repository at:
> >
> >
> https://repository.apache.org/content/repositories/orgapachehbase-1516/
> >
> > Maven artifacts for Hadoop 3 are available in a staging repository at:
> >
> >
> https://repository.apache.org/content/repositories/orgapachehbase-1517/
> >
> > Artifacts were signed with the key 8597754DD5365CCD which can be found
> in:
> >
> > https://downloads.apache.org/hbase/KEYS
> >
> > To learn more about Apache HBase, please see
> >
> > http://hbase.apache.org/
> >
> > Thanks,
> > Your HBase Release Manager
> >
>
[jira] [Created] (HBASE-27792) Guard Master/RS Dump Servlet behind admin walls
Nihal Jain created HBASE-27792: -- Summary: Guard Master/RS Dump Servlet behind admin walls Key: HBASE-27792 URL: https://issues.apache.org/jira/browse/HBASE-27792 Project: HBase Issue Type: Improvement Components: security, UI Reporter: Nihal Jain Assignee: Nihal Jain Currently RSDumpServlet and MasterDumpServlet do not require any check for whether the user has privileges to access to instrumentation servlets. This is unlike other servlets like ProfileServlet, ConfServlet, JMXJsonServlet etc. which are guarded by admin checks. Goal of this JIRA is to add similar check for RS and Master Dump Servlet. -- This message was sent by Atlassian Jira (v8.20.10#820010)
