[jira] [Reopened] (HBASE-20976) SCP can be scheduled multiple times for the same RS

2018-07-30 Thread Allan Yang (JIRA)
[ https://issues.apache.org/jira/browse/HBASE-20976?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Allan Yang reopened HBASE-20976: > SCP can be scheduled multiple times for the same RS >

Re: Question regarding hbase-shell JRuby testing workflow

2018-07-30 Thread Ted Yu
Have you tried sidelining other .rb files under hbase-shell//src/test/ruby/shell/ (keeping only hbase-shell//src/test/ruby/shell/list_procedures_test.rb) ? Cheers On Mon, Jul 30, 2018 at 8:29 PM Jack Bearden wrote: > Hey all! I was hacking hbase-shell and JRuby over the weekend and wanted to >

Question regarding hbase-shell JRuby testing workflow

2018-07-30 Thread Jack Bearden
Hey all! I was hacking hbase-shell and JRuby over the weekend and wanted to get some feedback on workflow. My objective was to execute a single Ruby unit test in isolation from the TestShell.java class via the jruby binary. I was able to accomplish this by doing the following steps: 1. Pulled

Re: Small cluster YCSB comparison results (1.2.6.1, 1.3.2.1, 1.4.6, 1.5.0-SNAPSHOT)

2018-07-30 Thread Andrew Purtell
​A couple of notes and general observations. Note all instances remained up for the entire duration of testing including burn in (all tests ran on the same hardware), and HDFS volumes were built on locally attached storage (hence C3 generation instances), so I controlled as much as possible for

Small cluster YCSB comparison results (1.2.6.1, 1.3.2.1, 1.4.6, 1.5.0-SNAPSHOT)

2018-07-30 Thread Andrew Purtell
Instance OS: ​ ​ Linux version 4.14.55-62.37.amzn1.x86_64 Instance ​Type: ​ ​ ​master: c3.8xlarge, regionservers: ​ c3.8xlarge x 5 ​, client c3.8xlarge​ Regionserver JVM: ​ ​ OpenJDK Runtime Environment (build 1.8.0_172-shenandoah-b11) ​ ​ 64-Bit Server VM (build 25.172-b11, mixed mode)

Re: May I take this issue --hbase-spark

2018-07-30 Thread Stack
On Mon, Jul 30, 2018 at 10:57 AM bill.yunfu wrote: > > May I take this issue --hbase-spark > > Hi community >I am working in one HBase team which service hundreds customers. We find > that along increasing amount of data in the HBase, many customers have > analysis requirement for their data

Re: May I take this issue --hbase-spark

2018-07-30 Thread Sean Busbey
Hi Bill! Please check out the scope document attached to HBASE-18405 "Track scope for HBase-Spark module". It's the result of the last time the community went through discussing what was needed for a release-worthy integration. pdf: https://s.apache.org/fejd I haven't gotten to take a look at

Re: [DISCUSS] Tracing in the Hadoop ecosystem

2018-07-30 Thread Eric Yang
Most of code coverage tools can instrument java classes without make any source code changes, but tracing distributed system is more involved because code execution via network interactions are not easy to match up. All interactions between sender and receiver have some form of session id or

[jira] [Resolved] (HBASE-20834) The jenkins on http://104.198.223.121:8080/job/HBASE-Flaky-Tests/ is broken

2018-07-30 Thread Sean Busbey (JIRA)
[ https://issues.apache.org/jira/browse/HBASE-20834?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Sean Busbey resolved HBASE-20834. - Resolution: Fixed I removed the URL for this job from the branch-2.0 flaky finder. couldn't

[jira] [Resolved] (HBASE-20980) Flaky test reporting should work with yetus driven builds

2018-07-30 Thread Sean Busbey (JIRA)
[ https://issues.apache.org/jira/browse/HBASE-20980?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Sean Busbey resolved HBASE-20980. - Resolution: Duplicate Looks like I missed HBASE-19382 when looking at the script this morning.

Re: [DISCUSS] Tracing in the Hadoop ecosystem

2018-07-30 Thread Duo Zhang
Anyway, for HBase, we'd better align our trace library with Hadoop, especially HDFS. A full trace from the hbase client down to the datanode will be really helpful for debugging and monitoring. 2018-07-31 6:06 GMT+08:00 Stack : > There is a healthy discussion going on over in HADOOP-15566 on

[jira] [Created] (HBASE-20984) Add/Modify test case to check custom hbase.wal.dir outside hdfs filesystem

2018-07-30 Thread Sakthi (JIRA)
Sakthi created HBASE-20984: -- Summary: Add/Modify test case to check custom hbase.wal.dir outside hdfs filesystem Key: HBASE-20984 URL: https://issues.apache.org/jira/browse/HBASE-20984 Project: HBase

[DISCUSS] Tracing in the Hadoop ecosystem

2018-07-30 Thread Stack
There is a healthy discussion going on over in HADOOP-15566 on tracing in the Hadoop ecosystem. It would sit better on a mailing list than in comments up on JIRA so here's an attempt at porting the chat here. Background/Context: Bits of Hadoop and HBase had Apache HTrace trace points added.

[jira] [Resolved] (HBASE-20983) Remove dependency on HBase interfaces of type InterfaceAudience.Private

2018-07-30 Thread Ankit Singhal (JIRA)
[ https://issues.apache.org/jira/browse/HBASE-20983?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Ankit Singhal resolved HBASE-20983. --- Resolution: Invalid Sorry wrong project, need to create in Phoenix > Remove dependency on

[jira] [Created] (HBASE-20983) Remove dependency on HBase interfaces of type InterfaceAudience.Private

2018-07-30 Thread Ankit Singhal (JIRA)
Ankit Singhal created HBASE-20983: - Summary: Remove dependency on HBase interfaces of type InterfaceAudience.Private Key: HBASE-20983 URL: https://issues.apache.org/jira/browse/HBASE-20983 Project:

Re: [VOTE] The first HBase 1.4.6 release candidate (RC0) is available

2018-07-30 Thread Ankit Singhal
+1 (non-binding) -- Build from src - Ok -- Started a cluster and ran selected Integration test- Ok -- Basic shell commands - Ok -- Ran rat check - Ok -- SHA and Signatures - Ok On Mon, Jul 30, 2018 at 12:26 PM, Andrew Purtell wrote: > Ok. For TestExportSnapshot please post the full test

Re: PMC: Please vote on 1.4.6 RC0

2018-07-30 Thread Andrew Purtell
Thanks to Josh and Yu Li we're all good now on this vote. Unless you find something veto worthy, in which case please post a veto to the voting thread, I will close it this afternoon and finish the release. On Mon, Jul 30, 2018 at 12:13 PM Josh Elser wrote: > Just put a +1 up from me, too. > >

Re: [VOTE] The first HBase 1.4.6 release candidate (RC0) is available

2018-07-30 Thread Andrew Purtell
Ok. For TestExportSnapshot please post the full test output from the failed runs to https://issues.apache.org/jira/browse/HBASE-20982. On Mon, Jul 30, 2018 at 12:17 PM Yu Li wrote: > The same observation on TestExportSnapshot as noted. > > Best Regards, > Yu > > On 31 July 2018 at 03:14, Andrew

[jira] [Created] (HBASE-20982) [branch-1] TestExportSnapshot is flaky

2018-07-30 Thread Andrew Purtell (JIRA)
Andrew Purtell created HBASE-20982: -- Summary: [branch-1] TestExportSnapshot is flaky Key: HBASE-20982 URL: https://issues.apache.org/jira/browse/HBASE-20982 Project: HBase Issue Type: Bug

Re: [VOTE] The first HBase 1.4.6 release candidate (RC0) is available

2018-07-30 Thread Yu Li
The same observation on TestExportSnapshot as noted. Best Regards, Yu On 31 July 2018 at 03:14, Andrew Purtell wrote: > > TestExportSnapshot and TestRegionServerHostname failed/timed-out, > respectively > > Thanks, they didn't fail for me but let me add these to the list of flakes > to follow

Re: [VOTE] The first HBase 1.4.6 release candidate (RC0) is available

2018-07-30 Thread Yu Li
+1 (binding) Checked sums and signatures: ok Built from source: ok (7u79) RAT check: ok (7u79) Unit tests pass: ok (7u79) - Note: TestExportSnapshot and TestSecureExportSnapshot keeps failing in my local env - I'd suggest to backport HBASE-16634/16671/17970 (rough check, no enough time to dig

Re: [VOTE] The first HBase 1.4.6 release candidate (RC0) is available

2018-07-30 Thread Andrew Purtell
> TestExportSnapshot and TestRegionServerHostname failed/timed-out, respectively Thanks, they didn't fail for me but let me add these to the list of flakes to follow up on. On Mon, Jul 30, 2018 at 12:12 PM Josh Elser wrote: > +1 (binding) > > * xsums/sigs good > * UTs mostly good

Re: PMC: Please vote on 1.4.6 RC0

2018-07-30 Thread Josh Elser
Just put a +1 up from me, too. On 7/30/18 3:05 PM, Yu Li wrote: Will vote within 20min, waiting for the LTT result now. Best Regards, Yu On 31 July 2018 at 02:44, Andrew Purtell wrote: I need two binding votes to release. Thanks. -- Best regards, Andrew Words like orphans lost among the

Re: [VOTE] The first HBase 1.4.6 release candidate (RC0) is available

2018-07-30 Thread Josh Elser
+1 (binding) * xsums/sigs good * UTs mostly good (TestExportSnapshot and TestRegionServerHostname failed/timed-out, respectively) * Src release is just source only Sorry for the delay -- got held up re-running UTs after my /etc/hosts was busted :) On 7/25/18 2:35 PM, Andrew Purtell wrote:

Re: PMC: Please vote on 1.4.6 RC0

2018-07-30 Thread Yu Li
Will vote within 20min, waiting for the LTT result now. Best Regards, Yu On 31 July 2018 at 02:44, Andrew Purtell wrote: > I need two binding votes to release. Thanks. > > -- > Best regards, > Andrew > > Words like orphans lost among the crosstalk, meaning torn from truth's > decrepit hands >

PMC: Please vote on 1.4.6 RC0

2018-07-30 Thread Andrew Purtell
I need two binding votes to release. Thanks. -- Best regards, Andrew Words like orphans lost among the crosstalk, meaning torn from truth's decrepit hands - A23, Crosstalk

Re: May I take this issue --hbase-spark

2018-07-30 Thread Ted Yu
For SQL support, can you be more specific on how the SQL support would be added ? Maybe you can illustrate some examples showing the enhanced SQL syntax. Also, which Spark release(s) would be targeted? Thanks On Mon, Jul 30, 2018 at 10:57 AM bill.yunfu wrote: > May I take this issue

May I take this issue --hbase-spark

2018-07-30 Thread bill.yunfu
May I take this issue --hbase-spark Hi community  I am working in one HBase team which service hundreds customers. We find that along increasing amount of data in the HBase, many customers have analysis requirement for their data on Hbase. For example they want use Spark to do some analysis

I am a subscribe please add me thanks

2018-07-30 Thread 周广成(云覆)
I am a subscribe please add me thanks

[jira] [Created] (HBASE-20981) Rollback stateCount accounting thrown-off when exception out of rollbackState

2018-07-30 Thread stack (JIRA)
stack created HBASE-20981: - Summary: Rollback stateCount accounting thrown-off when exception out of rollbackState Key: HBASE-20981 URL: https://issues.apache.org/jira/browse/HBASE-20981 Project: HBase

[jira] [Created] (HBASE-20980) Flaky test reporting should work with yetus driven builds

2018-07-30 Thread Sean Busbey (JIRA)
Sean Busbey created HBASE-20980: --- Summary: Flaky test reporting should work with yetus driven builds Key: HBASE-20980 URL: https://issues.apache.org/jira/browse/HBASE-20980 Project: HBase

[jira] [Created] (HBASE-20979) Flaky test reporting should specify what JSON it needs and handle HTTP errors

2018-07-30 Thread Sean Busbey (JIRA)
Sean Busbey created HBASE-20979: --- Summary: Flaky test reporting should specify what JSON it needs and handle HTTP errors Key: HBASE-20979 URL: https://issues.apache.org/jira/browse/HBASE-20979 Project:

[jira] [Created] (HBASE-20978) [amv2] UNATURAL! termination of worker during MoveRegionProcedure

2018-07-30 Thread stack (JIRA)
stack created HBASE-20978: - Summary: [amv2] UNATURAL! termination of worker during MoveRegionProcedure Key: HBASE-20978 URL: https://issues.apache.org/jira/browse/HBASE-20978 Project: HBase Issue

[jira] [Created] (HBASE-20977) Don't use the word "Snapshot" when defining "HBase Snapshots"

2018-07-30 Thread Josh Elser (JIRA)
Josh Elser created HBASE-20977: -- Summary: Don't use the word "Snapshot" when defining "HBase Snapshots" Key: HBASE-20977 URL: https://issues.apache.org/jira/browse/HBASE-20977 Project: HBase

Re: I am a subscribe please add me thanks

2018-07-30 Thread Ted Yu
Can you take a look at http://hbase.apache.org/mail-lists.html ? The first column gives you the email address for subscription. Cheers On Mon, Jul 30, 2018 at 7:51 AM 周广成(云覆) wrote: > hi > I send this mail yesterday but still now cannot public the topic in the > hbase dev mallist, can you

回复:I am a subscribe please add me thanks

2018-07-30 Thread 周广成(云覆)
hi I send this mail yesterday but still now cannot public the topic in the hbase dev mallist, can you please help check that. thank you very much. Regards Bill -- 发件人:周广成(云覆) 发送时间:2018年7月29日(星期日) 15:50 收件人:hbase-dev 主 题:I am

[jira] [Created] (HBASE-20976) SCP can be scheduled multiple times for the same RS

2018-07-30 Thread Allan Yang (JIRA)
Allan Yang created HBASE-20976: -- Summary: SCP can be scheduled multiple times for the same RS Key: HBASE-20976 URL: https://issues.apache.org/jira/browse/HBASE-20976 Project: HBase Issue Type:

Re: [VOTE] The first HBase 1.4.6 release candidate (RC0) is available

2018-07-30 Thread Balazs Meszaros
+1 - signatures, shasum: OK - rat check: OK - built from source (8u122): OK - unit tests: OK - web UI: OK - basic shell operations: OK - LTT with 1M rows: OK Best regards, Balazs On Mon, Jul 30, 2018 at 10:46 AM Peter Somogyi wrote: > +1 (non-binding) > > Signatures, checksums correct > RAT

Re: [VOTE] The first HBase 1.4.6 release candidate (RC0) is available

2018-07-30 Thread Peter Somogyi
+1 (non-binding) Signatures, checksums correct RAT check passed (8u171) Unit tests passed (8u171) LTT 1M rows passed Web UI looks correct Simple shell commands work Thanks for the release, Peter On Wed, Jul 25, 2018 at 8:36 PM Andrew Purtell wrote: > The first HBase 1.4.6 release candidate

[jira] [Created] (HBASE-20975) Lock may not be taken while rolling back procedure

2018-07-30 Thread Allan Yang (JIRA)
Allan Yang created HBASE-20975: -- Summary: Lock may not be taken while rolling back procedure Key: HBASE-20975 URL: https://issues.apache.org/jira/browse/HBASE-20975 Project: HBase Issue Type: