Re: [VOTE] The second release candidate for HBase 2.0.4 is available

2019-01-02 Thread Stack 
Thanks for the ITBLL Allan.

+1 from me too. Thats three binding +1s. Will leave it open another while
in case anyone else wants to take a looksee.

S

On Sat, Dec 29, 2018 at 8:44 AM Stack  wrote:

> The second release candidate for HBase 2.0.4 is available for download:
>
>  *https://dist.apache.org/repos/dist/dev/hbase/hbase-2.0.4RC1/
> *
>
> Maven artifacts are also available in a staging repository at:
>
>  https://repository.apache.org/content/repositories/orgapachehbase-1246
>
> Artifacts are signed with my key (DB9D313DA7874F29) published in our
> KEYS file at http://www.apache.org/dist/hbase/KEYS
>
> The RC corresponds to the signed tag 2.0.4RC1, which currently points
> to commit
>
>   205e39c5704bf38568b34926dde9f1ee76e6b5d0
>
> HBase 2.0.4 is the fourth maintenance release in the HBase 2.0 line,
> continuing on the theme of bringing a stable, reliable database to
> the Hadoop and NoSQL communities. It fixes a critical issue found
> in the recent 2.0.3 and 2.1.1 releases (only), HBASE-21551. 2.0.4
> includes ~31 bug and improvement fixes done since the 2.0.3,
> ~ a month ago.
>
> The detailed source and binary compatibility report vs 2.0.3 has been
> published for your review, at:
>
>
> https://dist.apache.org/repos/dist/dev/hbase/hbase-2.0.4RC1/compatibility_report_2.0.3vs2.0.4.html
>
> The report shows no incompatibilities.
>
> The full list of fixes included in this release is available in
> the CHANGES.md that ships as part of the release also available
> here:
>
>  https://dist.apache.org/repos/dist/dev/hbase/hbase-2.0.4RC1/CHANGES.md
>
> The RELEASENOTES.md are here:
>
>
> https://dist.apache.org/repos/dist/dev/hbase/hbase-2.0.4RC1/RELEASENOTES.md
>
> Please try out this candidate and vote +1/-1 on whether we should
> release these artifacts as HBase 2.0.4.
>
> The VOTE will remain open for at least 72 hours. It'll probably take
> longer given
> its the holidays. I'll close the vote when sufficient votes after
> Tuesday, January
> 1st, 2019.
>
> Thanks,
> S
>

[jira] [Resolved] (HBASE-18569) Add prefetch support for async region locator

2019-01-02 Thread Duo Zhang (JIRA) 


 [ 
https://issues.apache.org/jira/browse/HBASE-18569?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
 ]

Duo Zhang resolved HBASE-18569.
---
   Resolution: Fixed
Fix Version/s: 2.0.5

Pushed to branch-2.0.

> Add prefetch support for async region locator
> -
>
> Key: HBASE-18569
> URL: https://issues.apache.org/jira/browse/HBASE-18569
> Project: HBase
>  Issue Type: Sub-task
>  Components: asyncclient, Client
>Reporter: Duo Zhang
>Assignee: Duo Zhang
>Priority: Major
> Fix For: 3.0.0, 2.0.5, 2.1.0
>
> Attachments: HBASE-18569-v1.patch, HBASE-18569.patch
>
>
> It will be useful for large tables.



--
This message was sent by Atlassian JIRA
(v7.6.3#76005)

[jira] [Reopened] (HBASE-18569) Add prefetch support for async region locator

2019-01-02 Thread Duo Zhang (JIRA) 


 [ 
https://issues.apache.org/jira/browse/HBASE-18569?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
 ]

Duo Zhang reopened HBASE-18569:
---

Reopen for cherry-picking to branch-2.0.

> Add prefetch support for async region locator
> -
>
> Key: HBASE-18569
> URL: https://issues.apache.org/jira/browse/HBASE-18569
> Project: HBase
>  Issue Type: Sub-task
>  Components: asyncclient, Client
>Reporter: Duo Zhang
>Assignee: Duo Zhang
>Priority: Major
> Fix For: 3.0.0, 2.1.0
>
> Attachments: HBASE-18569-v1.patch, HBASE-18569.patch
>
>
> It will be useful for large tables.



--
This message was sent by Atlassian JIRA
(v7.6.3#76005)

Re: [VOTE] The second release candidate for HBase 2.0.4 is available

2019-01-02 Thread Allan Yang 
+1 (binding)

-- Build from src - OK

-- SHA and Signatures(both src and bin) - OK

-- start in distributed mode - OK

-- Basic shell commands[create/drop/alter/get/put/scan] - OK

-- Check Web UI - OK

-- ITBLL 1B row for 1 run - OK


Best Regards
Allan Yang


Stack  于2019年1月3日周四 上午1:19写道：

> On Sun, Dec 30, 2018 at 5:46 PM 张铎(Duo Zhang) 
> wrote:
>
> > +1(binding)
> >
> > Built from src: OK
> > Checked sums & sigs: All matched
> > Run all UTs(jdk8u151): Basically fine. TestExportSnapshot related UTs
> > always timeout under the runAllTests profile, but can pass if I remove
> the
> > profile and run them sequentially in the hbase-mapreduce module, maybe we
> > need to split them?
> >
>
> Filed HBASE-21666 to break up the tests. Thanks for trying 2.0.4RC1 Duo.
> S
>
>
>
>
> > Started a 5 nodes cluster: OK, the master UI is fine
> > Run basic shell cmds: OK, create, disable, drop, and also snapshot and
> > clone_snapshot
> > Run LTT with 1M rows: Read & Write, both OK, and then execute the count
> > command in shell, also 1M rows returned.
> >
> > Stack  于2018年12月30日周日 上午12:45写道：
> >
> > > The second release candidate for HBase 2.0.4 is available for download:
> > >
> > >  *https://dist.apache.org/repos/dist/dev/hbase/hbase-2.0.4RC1/
> > > *
> > >
> > > Maven artifacts are also available in a staging repository at:
> > >
> > >
> https://repository.apache.org/content/repositories/orgapachehbase-1246
> > >
> > > Artifacts are signed with my key (DB9D313DA7874F29) published in our
> > > KEYS file at http://www.apache.org/dist/hbase/KEYS
> > >
> > > The RC corresponds to the signed tag 2.0.4RC1, which currently points
> > > to commit
> > >
> > >   205e39c5704bf38568b34926dde9f1ee76e6b5d0
> > >
> > > HBase 2.0.4 is the fourth maintenance release in the HBase 2.0 line,
> > > continuing on the theme of bringing a stable, reliable database to
> > > the Hadoop and NoSQL communities. It fixes a critical issue found
> > > in the recent 2.0.3 and 2.1.1 releases (only), HBASE-21551. 2.0.4
> > > includes ~31 bug and improvement fixes done since the 2.0.3,
> > > ~ a month ago.
> > >
> > > The detailed source and binary compatibility report vs 2.0.3 has been
> > > published for your review, at:
> > >
> > >
> > >
> > >
> >
> https://dist.apache.org/repos/dist/dev/hbase/hbase-2.0.4RC1/compatibility_report_2.0.3vs2.0.4.html
> > >
> > > The report shows no incompatibilities.
> > >
> > > The full list of fixes included in this release is available in
> > > the CHANGES.md that ships as part of the release also available
> > > here:
> > >
> > >
> https://dist.apache.org/repos/dist/dev/hbase/hbase-2.0.4RC1/CHANGES.md
> > >
> > > The RELEASENOTES.md are here:
> > >
> > >
> > >
> >
> https://dist.apache.org/repos/dist/dev/hbase/hbase-2.0.4RC1/RELEASENOTES.md
> > >
> > > Please try out this candidate and vote +1/-1 on whether we should
> > > release these artifacts as HBase 2.0.4.
> > >
> > > The VOTE will remain open for at least 72 hours. It'll probably take
> > longer
> > > given
> > > its the holidays. I'll close the vote when sufficient votes after
> > Tuesday,
> > > January
> > > 1st, 2019.
> > >
> > > Thanks,
> > > S
> > >
> >
>

[VOTE] Second release candidate for HBase 2.1.2 is available for download

2019-01-02 Thread Stack 
The second release candidate for HBase 2.1.2 is available for download:

* https://dist.apache.org/repos/dist/dev/hbase/hbase-2.1.2RC1/
*

Maven artifacts are also available in a staging repository at:

 https://repository.apache.org/content/repositories/orgapachehbase-1247

Artifacts are signed with my key (DB9D313DA7874F29) published in our
KEYS file at http://www.apache.org/dist/hbase/KEYS

The RC corresponds to the signed tag 2.1.2RC1, which currently points
to commit

  1dfc418f77801fbfb59a125756891b9100c1fc6d

HBase 2.1.2 is the third maintenance release in the HBase 2.0 line,
continuing on the theme of bringing a stable, reliable database to
the Hadoop and NoSQL communities. It fixes a critical issue found
in the recent 2.0.3 and 2.1.1 releases (only), HBASE-21551. 2.1.2
includes ~70 bug and improvement fixes done since the 2.1.1,
~ eight weeks ago.

The detailed source and binary compatibility report vs 2.1.1 has been
published for your review, at:

 https://dist.apache.org/repos/dist/dev/hbase/hbase-2.1.2RC1
/compatibility_report_2.1.1vs2.1.2.html

The report shows no incompatibilities.

The full list of fixes included in this release is available in
the CHANGES.md that ships as part of the release also available
here:

 https://dist.apache.org/repos/dist/dev/hbase/hbase-2.1.2RC1/CHANGES.md

The RELEASENOTES.md are here:

 https://dist.apache.org/repos/dist/dev/hbase/hbase-2.1.2RC1/RELEASENOTES.md

Please try out this candidate and vote +1/-1 on whether we should
release these artifacts as HBase 2.1.2.

The VOTE will remain open for at least 72 hours. Given sufficient votes
I would like to close it on Sunday, January 6th, 2018.

Thanks,
S
P.S. Happy New Year!

[jira] [Created] (HBASE-21666) Break up the TestExportSnapshot UTs; they can timeout

2019-01-02 Thread stack (JIRA) 
stack created HBASE-21666:
-

 Summary: Break up the TestExportSnapshot UTs; they can timeout
 Key: HBASE-21666
 URL: https://issues.apache.org/jira/browse/HBASE-21666
 Project: HBase
  Issue Type: Bug
  Components: test
Reporter: stack


These timed out for [~Apache9] when he ran with the -PrunAllTests. Suggests 
breaking them up into smaller tests so less likely they'll timeout.



--
This message was sent by Atlassian JIRA
(v7.6.3#76005)

Re: [VOTE] The second release candidate for HBase 2.0.4 is available

2019-01-02 Thread Stack 
On Sun, Dec 30, 2018 at 5:46 PM 张铎(Duo Zhang)  wrote:

> +1(binding)
>
> Built from src: OK
> Checked sums & sigs: All matched
> Run all UTs(jdk8u151): Basically fine. TestExportSnapshot related UTs
> always timeout under the runAllTests profile, but can pass if I remove the
> profile and run them sequentially in the hbase-mapreduce module, maybe we
> need to split them?
>

Filed HBASE-21666 to break up the tests. Thanks for trying 2.0.4RC1 Duo.
S




> Started a 5 nodes cluster: OK, the master UI is fine
> Run basic shell cmds: OK, create, disable, drop, and also snapshot and
> clone_snapshot
> Run LTT with 1M rows: Read & Write, both OK, and then execute the count
> command in shell, also 1M rows returned.
>
> Stack  于2018年12月30日周日 上午12:45写道：
>
> > The second release candidate for HBase 2.0.4 is available for download:
> >
> >  *https://dist.apache.org/repos/dist/dev/hbase/hbase-2.0.4RC1/
> > *
> >
> > Maven artifacts are also available in a staging repository at:
> >
> >  https://repository.apache.org/content/repositories/orgapachehbase-1246
> >
> > Artifacts are signed with my key (DB9D313DA7874F29) published in our
> > KEYS file at http://www.apache.org/dist/hbase/KEYS
> >
> > The RC corresponds to the signed tag 2.0.4RC1, which currently points
> > to commit
> >
> >   205e39c5704bf38568b34926dde9f1ee76e6b5d0
> >
> > HBase 2.0.4 is the fourth maintenance release in the HBase 2.0 line,
> > continuing on the theme of bringing a stable, reliable database to
> > the Hadoop and NoSQL communities. It fixes a critical issue found
> > in the recent 2.0.3 and 2.1.1 releases (only), HBASE-21551. 2.0.4
> > includes ~31 bug and improvement fixes done since the 2.0.3,
> > ~ a month ago.
> >
> > The detailed source and binary compatibility report vs 2.0.3 has been
> > published for your review, at:
> >
> >
> >
> >
> https://dist.apache.org/repos/dist/dev/hbase/hbase-2.0.4RC1/compatibility_report_2.0.3vs2.0.4.html
> >
> > The report shows no incompatibilities.
> >
> > The full list of fixes included in this release is available in
> > the CHANGES.md that ships as part of the release also available
> > here:
> >
> >  https://dist.apache.org/repos/dist/dev/hbase/hbase-2.0.4RC1/CHANGES.md
> >
> > The RELEASENOTES.md are here:
> >
> >
> >
> https://dist.apache.org/repos/dist/dev/hbase/hbase-2.0.4RC1/RELEASENOTES.md
> >
> > Please try out this candidate and vote +1/-1 on whether we should
> > release these artifacts as HBase 2.0.4.
> >
> > The VOTE will remain open for at least 72 hours. It'll probably take
> longer
> > given
> > its the holidays. I'll close the vote when sufficient votes after
> Tuesday,
> > January
> > 1st, 2019.
> >
> > Thanks,
> > S
> >
>

[jira] [Created] (HBASE-21665) OfflineMetaRepair fails with NPE

2019-01-02 Thread Pankaj Kumar (JIRA) 
Pankaj Kumar created HBASE-21665:


 Summary: OfflineMetaRepair fails with NPE
 Key: HBASE-21665
 URL: https://issues.apache.org/jira/browse/HBASE-21665
 Project: HBase
  Issue Type: Bug
Reporter: Pankaj Kumar
Assignee: Pankaj Kumar


OfflineMetaRepair fails with NPE, execute below command

hbase org.apache.hadoop.hbase.util.hbck.OfflineMetaRepair -fix

 

{noformat}

2019-01-02 16:22:56,387 INFO [main] regionserver.HRegion: Opened 1588230740; 
next sequenceid=28
2019-01-02 16:22:56,459 ERROR [main] hbck.OfflineMetaRepair: Bailed out due to: 
java.lang.NullPointerException
 at 
org.apache.hadoop.hbase.regionserver.MemStoreLABImpl.getOrMakeChunk(MemStoreLABImpl.java:335)
 at 
org.apache.hadoop.hbase.regionserver.MemStoreLABImpl.copyCellInto(MemStoreLABImpl.java:193)
 at 
org.apache.hadoop.hbase.regionserver.MemStoreLABImpl.copyCellInto(MemStoreLABImpl.java:115)
 at 
org.apache.hadoop.hbase.regionserver.Segment.maybeCloneWithAllocator(Segment.java:183)
 at 
org.apache.hadoop.hbase.regionserver.AbstractMemStore.maybeCloneWithAllocator(AbstractMemStore.java:334)
 at 
org.apache.hadoop.hbase.regionserver.AbstractMemStore.doAdd(AbstractMemStore.java:157)
 at 
org.apache.hadoop.hbase.regionserver.AbstractMemStore.doAddOrUpsert(AbstractMemStore.java:147)
 at 
org.apache.hadoop.hbase.regionserver.AbstractMemStore.add(AbstractMemStore.java:117)
 at 
org.apache.hadoop.hbase.regionserver.AbstractMemStore.add(AbstractMemStore.java:111)
 at org.apache.hadoop.hbase.regionserver.HStore.add(HStore.java:750)
 at 
org.apache.hadoop.hbase.regionserver.HRegion.applyToMemStore(HRegion.java:4435)
 at org.apache.hadoop.hbase.regionserver.HRegion.access$500(HRegion.java:228)
 at 
org.apache.hadoop.hbase.regionserver.HRegion$BatchOperation.applyFamilyMapToMemStore(HRegion.java:3495)
 at 
org.apache.hadoop.hbase.regionserver.HRegion$BatchOperation.lambda$writeMiniBatchOperationsToMemStore$0(HRegion.java:3186)
 at 
org.apache.hadoop.hbase.regionserver.HRegion$BatchOperation.visitBatchOperations(HRegion.java:3119)
 at 
org.apache.hadoop.hbase.regionserver.HRegion$BatchOperation.writeMiniBatchOperationsToMemStore(HRegion.java:3178)
 at 
org.apache.hadoop.hbase.regionserver.HRegion$MutationBatchOperation.writeMiniBatchOperationsToMemStore(HRegion.java:3660)
 at 
org.apache.hadoop.hbase.regionserver.HRegion.doMiniBatchMutate(HRegion.java:4073)
 at org.apache.hadoop.hbase.regionserver.HRegion.batchMutate(HRegion.java:4006)
 at org.apache.hadoop.hbase.regionserver.HRegion.batchMutate(HRegion.java:3937)
 at org.apache.hadoop.hbase.regionserver.HRegion.batchMutate(HRegion.java:3928)
 at org.apache.hadoop.hbase.util.HBaseFsck.rebuildMeta(HBaseFsck.java:1665)
 at 
org.apache.hadoop.hbase.util.hbck.OfflineMetaRepair.main(OfflineMetaRepair.java:121)

{noformat}



--
This message was sent by Atlassian JIRA
(v7.6.3#76005)

Change in excluded list for PreCommit job

2019-01-02 Thread Peter Somogyi 
Hi,

>From now on the PreCommit-HBASE-Build job on builds.apache.org uses the
flaky list for the target branch.
You can still set the EXCLUDE_TESTS_URL parameter to specify different
exclude list (e.g. rely on master exclude list for a branch-2.0 patch) but
for that you need to manually trigger a job.

If you find any issues with the PreCommit run ping me on HBASE-21547 or
reply to this email.

Thanks,
Peter