[jira] [Commented] (HBASE-19435) Reopen Files for ClosedChannelException in BucketCache
[ https://issues.apache.org/jira/browse/HBASE-19435?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16284656#comment-16284656 ] Anoop Sam John commented on HBASE-19435: Zach, See BucketCache#evictBlocksByHfileName.. This is called after compaction for every file which is just compacted away. But as Ram also said, it just removes the blocks from the 'backingMap' which is an on heap data structure which is having info like this block is stored in which bucket slot. So it is not affecting in any way, the cached files.. But the more open files can be an issue? Not sure.. Because I believe in ur case the actual HFiles are in S3 and the BC is in local FS. > Reopen Files for ClosedChannelException in BucketCache > -- > > Key: HBASE-19435 > URL: https://issues.apache.org/jira/browse/HBASE-19435 > Project: HBase > Issue Type: Bug > Components: BucketCache >Affects Versions: 2.0.0, 1.3.1 >Reporter: Zach York >Assignee: Zach York > Fix For: 1.4.0, 2.0.0-beta-1 > > Attachments: HBASE-19435.branch-1.001.patch, > HBASE-19435.master.001.patch, HBASE-19435.master.002.patch, > HBASE-19435.master.003.patch, HBASE-19435.master.004.patch, > HBASE-19435.master.005.patch, HBASE-19435.master.006.patch, > HBASE-19435.master.007.patch, HBASE-19435.master.007.patch > > > When using the FileIOEngine for BucketCache, the cache will be disabled if > the connection is interrupted or closed. HBase will then get > ClosedChannelExceptions trying to access the file. After 60s, the RS will > disable the cache. This causes severe read performance degradation for > workloads that rely on this cache. FileIOEngine never tries to reopen the > connection. This JIRA is to reopen files when the BucketCache encounters a > ClosedChannelException. -- This message was sent by Atlassian JIRA (v6.4.14#64029)
[jira] [Commented] (HBASE-19463) Make CPEnv#getConnection return a facade that throws Unsupported if CP calls #close
[ https://issues.apache.org/jira/browse/HBASE-19463?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16284650#comment-16284650 ] Anoop Sam John commented on HBASE-19463: +1 > Make CPEnv#getConnection return a facade that throws Unsupported if CP calls > #close > --- > > Key: HBASE-19463 > URL: https://issues.apache.org/jira/browse/HBASE-19463 > Project: HBase > Issue Type: Improvement > Components: Coprocessors >Reporter: stack >Assignee: Guanghao Zhang > Labels: beginner > Fix For: 2.0.0-beta-2 > > Attachments: HBASE-19463.master.001.patch, > HBASE-19463.master.002.patch > > > Follows from HBASE-19301, a suggestion by [~zghaobac]. > To prevent a CP accidentally closing the connection returned by > CpEnv#getConnection -- which returns the hosting Servers Connection -- we > should throw UnsupportedException if the CP calls #close Do it. -- This message was sent by Atlassian JIRA (v6.4.14#64029)
[jira] [Updated] (HBASE-19463) Make CPEnv#getConnection return a facade that throws Unsupported if CP calls #close
[ https://issues.apache.org/jira/browse/HBASE-19463?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Guanghao Zhang updated HBASE-19463: --- Attachment: HBASE-19463.master.002.patch > Make CPEnv#getConnection return a facade that throws Unsupported if CP calls > #close > --- > > Key: HBASE-19463 > URL: https://issues.apache.org/jira/browse/HBASE-19463 > Project: HBase > Issue Type: Improvement > Components: Coprocessors >Reporter: stack >Assignee: Guanghao Zhang > Labels: beginner > Fix For: 2.0.0-beta-2 > > Attachments: HBASE-19463.master.001.patch, > HBASE-19463.master.002.patch > > > Follows from HBASE-19301, a suggestion by [~zghaobac]. > To prevent a CP accidentally closing the connection returned by > CpEnv#getConnection -- which returns the hosting Servers Connection -- we > should throw UnsupportedException if the CP calls #close Do it. -- This message was sent by Atlassian JIRA (v6.4.14#64029)
[jira] [Commented] (HBASE-19449) Implement SLF4J and SLF4J Parameter Substitution
[
https://issues.apache.org/jira/browse/HBASE-19449?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16284633#comment-16284633
]
Duo Zhang commented on HBASE-19449:
---
I think slf4j has a more modern API and there is migration tool to migrate from
commons logging to slf4j.
https://www.slf4j.org/migrator.html
Seems hadoop is already on slf4j?
Thanks.
> Implement SLF4J and SLF4J Parameter Substitution
>
>
> Key: HBASE-19449
> URL: https://issues.apache.org/jira/browse/HBASE-19449
> Project: HBase
> Issue Type: Improvement
> Components: hbase
>Affects Versions: 3.0.0
>Reporter: BELUGA BEHR
>Assignee: BELUGA BEHR
>Priority: Trivial
> Fix For: 2.0.0
>
> Attachments: HBASE-19449.1.patch, HBASE-19449.2.patch,
> HBASE-19449.3.patch, HBASE-19449.4.patch
>
>
> For the {{HFileArchiver.java}} class...
> * Use SLF4J logging
> * Use SLF4J parameter substitution
> * Fix some small issues with missing spaces between words in the log message
> and the like
> https://www.slf4j.org/faq.html#logging_performance
--
This message was sent by Atlassian JIRA
(v6.4.14#64029)
[jira] [Updated] (HBASE-19371) Running WALPerformanceEvaluation against asyncfswal throws exceptions
[ https://issues.apache.org/jira/browse/HBASE-19371?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Duo Zhang updated HBASE-19371: -- Status: Patch Available (was: Open) > Running WALPerformanceEvaluation against asyncfswal throws exceptions > - > > Key: HBASE-19371 > URL: https://issues.apache.org/jira/browse/HBASE-19371 > Project: HBase > Issue Type: Bug >Reporter: stack > Fix For: 2.0.0-beta-1 > > Attachments: HBASE-19371.patch > > > Was trying to do a perf eval on asyncfswal. I ran w/ these args: > Performance counter stats for '/home/stack/hbase/bin/hbase --config > /home/stack/conf_hbase org.apache.hadoop.hbase.wal.WALPerformanceEvaluation > -path /user/stack/logs/ -verify -threads 25 -iterations 100 -keySize 50 > -valueSize 100 -syncInterval 10': > The verify fails on all runs: > Exception in thread "main" java.lang.IllegalStateException: Counted=12390228, > expected=2500 > at > org.apache.hadoop.hbase.wal.WALPerformanceEvaluation.run(WALPerformanceEvaluation.java:368) > > at > org.apache.hadoop.util.ToolRunner.run(ToolRunner.java:76) > at > org.apache.hadoop.hbase.wal.WALPerformanceEvaluation.innerMain(WALPerformanceEvaluation.java:597) > > at > org.apache.hadoop.hbase.wal.WALPerformanceEvaluation.main(WALPerformanceEvaluation.java:601) > I need to fix test or figure what is wrong in asyncfswal. > Also seeing these when I run w/ one thread only: > 2017-11-28 21:25:49,952 WARN [AsyncFSWAL-1-1] wal.AsyncFSWAL: > RingBufferTruck with unexpected type: EMPTY > Log has a spew of them. > Has stuff like this too: > 2017-11-28 21:25:40,065 WARN [Close-WAL-Writer-3] > wal.AsyncProtobufLogWriter: normal close failed, try recover > > java.io.IOException: stream already broken > > at > org.apache.hadoop.hbase.io.asyncfs.FanOutOneBlockAsyncDFSOutput.endBlock(FanOutOneBlockAsyncDFSOutput.java:510) > > at > org.apache.hadoop.hbase.io.asyncfs.FanOutOneBlockAsyncDFSOutput.lambda$close$12(FanOutOneBlockAsyncDFSOutput.java:550) > >at > org.apache.hadoop.hbase.shaded.io.netty.util.concurrent.AbstractEventExecutor.safeExecute(AbstractEventExecutor.java:163) > at > org.apache.hadoop.hbase.shaded.io.netty.util.concurrent.SingleThreadEventExecutor.runAllTasks(SingleThreadEventExecutor.java:403) > at > org.apache.hadoop.hbase.shaded.io.netty.channel.nio.NioEventLoop.run(NioEventLoop.java:462) > at > org.apache.hadoop.hbase.shaded.io.netty.util.concurrent.SingleThreadEventExecutor$5.run(SingleThreadEventExecutor.java:858) > > at > org.apache.hadoop.hbase.shaded.io.netty.util.concurrent.DefaultThreadFactory$DefaultRunnableDecorator.run(DefaultThreadFactory.java:138) > at java.lang.Thread.run(Thread.java:748) > Starts out spewing EMPTY here: > 2017-11-28 21:16:52,051 INFO [main] regionserver.HRegion: Setting > FlushNonSloppyStoresFirstPolicy for the > region=WALPerformanceEvaluation:0,,1511932610787.deca03e0ca447fa25d02fe9cd6e31aa4. > 2017-11-28 21:16:52,058 DEBUG [main] regionserver.HRegion: Found 0 recovered > edits file(s) under > hdfs://ve0524.halxg.cloudera.com:8020/user/stack/logs/data/WALPerformanceEvaluation/0/deca03e0ca447fa25d02fe9cd6e31aa4 > 2017-11-28 21:16:52,068 DEBUG [main] regionserver.FlushLargeStoresPolicy: No > hbase.hregion.percolumnfamilyflush.size.lower.bound set in description of > table WALPerformanceEvaluation:0, use config (134217728) instead > 2017-11-28 21:16:52,084 DEBUG [main] wal.WALSplitter: Wrote > file=hdfs://ve0524.halxg.cloudera.com:8020/user/stack/logs/data/WALPerformanceEvaluation/0/deca03e0ca447fa25d02fe9cd6e31aa4/recovered.edits/2.seqid, > newSeqId=2, maxSeqId=0 > 2017-11-28 21:16:52,084 INFO [main] regionserver.HRegion: Onlined > deca03e0ca447fa25d02fe9cd6e31aa4; next sequenceid=2 > 2017-11-28 21:16:52,185 WARN [AsyncFSWAL-1-1] wal.AsyncFSWAL: > RingBufferTruck with unexpected type: EMPTY > 2017-11-28 21:16:52,185 WARN [AsyncFSWAL-1-1] wal.AsyncFSWAL: > RingBufferTruck with unexpected type: EMPTY > 2017-11-28 21:16:52,185 WARN [AsyncFSWAL-1-1]
[jira] [Updated] (HBASE-19371) Running WALPerformanceEvaluation against asyncfswal throws exceptions
[ https://issues.apache.org/jira/browse/HBASE-19371?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Duo Zhang updated HBASE-19371: -- Attachment: HBASE-19371.patch Please try this patch sir [~stack]. I tried locally with 2.8.2 and the UTs passed. Thanks. > Running WALPerformanceEvaluation against asyncfswal throws exceptions > - > > Key: HBASE-19371 > URL: https://issues.apache.org/jira/browse/HBASE-19371 > Project: HBase > Issue Type: Bug >Reporter: stack > Fix For: 2.0.0-beta-1 > > Attachments: HBASE-19371.patch > > > Was trying to do a perf eval on asyncfswal. I ran w/ these args: > Performance counter stats for '/home/stack/hbase/bin/hbase --config > /home/stack/conf_hbase org.apache.hadoop.hbase.wal.WALPerformanceEvaluation > -path /user/stack/logs/ -verify -threads 25 -iterations 100 -keySize 50 > -valueSize 100 -syncInterval 10': > The verify fails on all runs: > Exception in thread "main" java.lang.IllegalStateException: Counted=12390228, > expected=2500 > at > org.apache.hadoop.hbase.wal.WALPerformanceEvaluation.run(WALPerformanceEvaluation.java:368) > > at > org.apache.hadoop.util.ToolRunner.run(ToolRunner.java:76) > at > org.apache.hadoop.hbase.wal.WALPerformanceEvaluation.innerMain(WALPerformanceEvaluation.java:597) > > at > org.apache.hadoop.hbase.wal.WALPerformanceEvaluation.main(WALPerformanceEvaluation.java:601) > I need to fix test or figure what is wrong in asyncfswal. > Also seeing these when I run w/ one thread only: > 2017-11-28 21:25:49,952 WARN [AsyncFSWAL-1-1] wal.AsyncFSWAL: > RingBufferTruck with unexpected type: EMPTY > Log has a spew of them. > Has stuff like this too: > 2017-11-28 21:25:40,065 WARN [Close-WAL-Writer-3] > wal.AsyncProtobufLogWriter: normal close failed, try recover > > java.io.IOException: stream already broken > > at > org.apache.hadoop.hbase.io.asyncfs.FanOutOneBlockAsyncDFSOutput.endBlock(FanOutOneBlockAsyncDFSOutput.java:510) > > at > org.apache.hadoop.hbase.io.asyncfs.FanOutOneBlockAsyncDFSOutput.lambda$close$12(FanOutOneBlockAsyncDFSOutput.java:550) > >at > org.apache.hadoop.hbase.shaded.io.netty.util.concurrent.AbstractEventExecutor.safeExecute(AbstractEventExecutor.java:163) > at > org.apache.hadoop.hbase.shaded.io.netty.util.concurrent.SingleThreadEventExecutor.runAllTasks(SingleThreadEventExecutor.java:403) > at > org.apache.hadoop.hbase.shaded.io.netty.channel.nio.NioEventLoop.run(NioEventLoop.java:462) > at > org.apache.hadoop.hbase.shaded.io.netty.util.concurrent.SingleThreadEventExecutor$5.run(SingleThreadEventExecutor.java:858) > > at > org.apache.hadoop.hbase.shaded.io.netty.util.concurrent.DefaultThreadFactory$DefaultRunnableDecorator.run(DefaultThreadFactory.java:138) > at java.lang.Thread.run(Thread.java:748) > Starts out spewing EMPTY here: > 2017-11-28 21:16:52,051 INFO [main] regionserver.HRegion: Setting > FlushNonSloppyStoresFirstPolicy for the > region=WALPerformanceEvaluation:0,,1511932610787.deca03e0ca447fa25d02fe9cd6e31aa4. > 2017-11-28 21:16:52,058 DEBUG [main] regionserver.HRegion: Found 0 recovered > edits file(s) under > hdfs://ve0524.halxg.cloudera.com:8020/user/stack/logs/data/WALPerformanceEvaluation/0/deca03e0ca447fa25d02fe9cd6e31aa4 > 2017-11-28 21:16:52,068 DEBUG [main] regionserver.FlushLargeStoresPolicy: No > hbase.hregion.percolumnfamilyflush.size.lower.bound set in description of > table WALPerformanceEvaluation:0, use config (134217728) instead > 2017-11-28 21:16:52,084 DEBUG [main] wal.WALSplitter: Wrote > file=hdfs://ve0524.halxg.cloudera.com:8020/user/stack/logs/data/WALPerformanceEvaluation/0/deca03e0ca447fa25d02fe9cd6e31aa4/recovered.edits/2.seqid, > newSeqId=2, maxSeqId=0 > 2017-11-28 21:16:52,084 INFO [main] regionserver.HRegion: Onlined > deca03e0ca447fa25d02fe9cd6e31aa4; next sequenceid=2 > 2017-11-28 21:16:52,185 WARN [AsyncFSWAL-1-1] wal.AsyncFSWAL: > RingBufferTruck with unexpected type: EMPTY > 2017-11-28 21:16:52,185 WARN [AsyncFSWAL-1-1] wal.AsyncFSWAL: >
[jira] [Commented] (HBASE-19371) Running WALPerformanceEvaluation against asyncfswal throws exceptions
[ https://issues.apache.org/jira/browse/HBASE-19371?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16284610#comment-16284610 ] Duo Zhang commented on HBASE-19371: --- The problem is that, after hadoop 2.8, DFSClien$Conf is changed to DFSClientConf. And JVM will include the return type to generate the method signature so... Let me think how to deal with it, just some configurations so maybe just copy the construction code from HDFS... Thanks. > Running WALPerformanceEvaluation against asyncfswal throws exceptions > - > > Key: HBASE-19371 > URL: https://issues.apache.org/jira/browse/HBASE-19371 > Project: HBase > Issue Type: Bug >Reporter: stack > Fix For: 2.0.0-beta-1 > > > Was trying to do a perf eval on asyncfswal. I ran w/ these args: > Performance counter stats for '/home/stack/hbase/bin/hbase --config > /home/stack/conf_hbase org.apache.hadoop.hbase.wal.WALPerformanceEvaluation > -path /user/stack/logs/ -verify -threads 25 -iterations 100 -keySize 50 > -valueSize 100 -syncInterval 10': > The verify fails on all runs: > Exception in thread "main" java.lang.IllegalStateException: Counted=12390228, > expected=2500 > at > org.apache.hadoop.hbase.wal.WALPerformanceEvaluation.run(WALPerformanceEvaluation.java:368) > > at > org.apache.hadoop.util.ToolRunner.run(ToolRunner.java:76) > at > org.apache.hadoop.hbase.wal.WALPerformanceEvaluation.innerMain(WALPerformanceEvaluation.java:597) > > at > org.apache.hadoop.hbase.wal.WALPerformanceEvaluation.main(WALPerformanceEvaluation.java:601) > I need to fix test or figure what is wrong in asyncfswal. > Also seeing these when I run w/ one thread only: > 2017-11-28 21:25:49,952 WARN [AsyncFSWAL-1-1] wal.AsyncFSWAL: > RingBufferTruck with unexpected type: EMPTY > Log has a spew of them. > Has stuff like this too: > 2017-11-28 21:25:40,065 WARN [Close-WAL-Writer-3] > wal.AsyncProtobufLogWriter: normal close failed, try recover > > java.io.IOException: stream already broken > > at > org.apache.hadoop.hbase.io.asyncfs.FanOutOneBlockAsyncDFSOutput.endBlock(FanOutOneBlockAsyncDFSOutput.java:510) > > at > org.apache.hadoop.hbase.io.asyncfs.FanOutOneBlockAsyncDFSOutput.lambda$close$12(FanOutOneBlockAsyncDFSOutput.java:550) > >at > org.apache.hadoop.hbase.shaded.io.netty.util.concurrent.AbstractEventExecutor.safeExecute(AbstractEventExecutor.java:163) > at > org.apache.hadoop.hbase.shaded.io.netty.util.concurrent.SingleThreadEventExecutor.runAllTasks(SingleThreadEventExecutor.java:403) > at > org.apache.hadoop.hbase.shaded.io.netty.channel.nio.NioEventLoop.run(NioEventLoop.java:462) > at > org.apache.hadoop.hbase.shaded.io.netty.util.concurrent.SingleThreadEventExecutor$5.run(SingleThreadEventExecutor.java:858) > > at > org.apache.hadoop.hbase.shaded.io.netty.util.concurrent.DefaultThreadFactory$DefaultRunnableDecorator.run(DefaultThreadFactory.java:138) > at java.lang.Thread.run(Thread.java:748) > Starts out spewing EMPTY here: > 2017-11-28 21:16:52,051 INFO [main] regionserver.HRegion: Setting > FlushNonSloppyStoresFirstPolicy for the > region=WALPerformanceEvaluation:0,,1511932610787.deca03e0ca447fa25d02fe9cd6e31aa4. > 2017-11-28 21:16:52,058 DEBUG [main] regionserver.HRegion: Found 0 recovered > edits file(s) under > hdfs://ve0524.halxg.cloudera.com:8020/user/stack/logs/data/WALPerformanceEvaluation/0/deca03e0ca447fa25d02fe9cd6e31aa4 > 2017-11-28 21:16:52,068 DEBUG [main] regionserver.FlushLargeStoresPolicy: No > hbase.hregion.percolumnfamilyflush.size.lower.bound set in description of > table WALPerformanceEvaluation:0, use config (134217728) instead > 2017-11-28 21:16:52,084 DEBUG [main] wal.WALSplitter: Wrote > file=hdfs://ve0524.halxg.cloudera.com:8020/user/stack/logs/data/WALPerformanceEvaluation/0/deca03e0ca447fa25d02fe9cd6e31aa4/recovered.edits/2.seqid, > newSeqId=2, maxSeqId=0 > 2017-11-28 21:16:52,084 INFO [main] regionserver.HRegion: Onlined > deca03e0ca447fa25d02fe9cd6e31aa4; next sequenceid=2 > 2017-11-28 21:16:52,185 WARN
[jira] [Commented] (HBASE-19463) Make CPEnv#getConnection return a facade that throws Unsupported if CP calls #close
[
https://issues.apache.org/jira/browse/HBASE-19463?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16284590#comment-16284590
]
Hadoop QA commented on HBASE-19463:
---
| (x) *{color:red}-1 overall{color}* |
\\
\\
|| Vote || Subsystem || Runtime || Comment ||
| {color:blue}0{color} | {color:blue} reexec {color} | {color:blue} 0m
8s{color} | {color:blue} Docker mode activated. {color} |
|| || || || {color:brown} Prechecks {color} ||
| {color:blue}0{color} | {color:blue} findbugs {color} | {color:blue} 0m
0s{color} | {color:blue} Findbugs executables are not available. {color} |
| {color:green}+1{color} | {color:green} hbaseanti {color} | {color:green} 0m
0s{color} | {color:green} Patch does not have any anti-patterns. {color} |
| {color:green}+1{color} | {color:green} @author {color} | {color:green} 0m
0s{color} | {color:green} The patch does not contain any @author tags. {color} |
| {color:red}-1{color} | {color:red} test4tests {color} | {color:red} 0m
0s{color} | {color:red} The patch doesn't appear to include any new or modified
tests. Please justify why no new tests are needed for this patch. Also please
list what manual steps were performed to verify this patch. {color} |
|| || || || {color:brown} master Compile Tests {color} ||
| {color:green}+1{color} | {color:green} mvninstall {color} | {color:green} 4m
29s{color} | {color:green} master passed {color} |
| {color:green}+1{color} | {color:green} compile {color} | {color:green} 0m
40s{color} | {color:green} master passed {color} |
| {color:green}+1{color} | {color:green} checkstyle {color} | {color:green} 1m
4s{color} | {color:green} master passed {color} |
| {color:green}+1{color} | {color:green} shadedjars {color} | {color:green} 5m
27s{color} | {color:green} branch has no errors when building our shaded
downstream artifacts. {color} |
| {color:green}+1{color} | {color:green} javadoc {color} | {color:green} 0m
27s{color} | {color:green} master passed {color} |
|| || || || {color:brown} Patch Compile Tests {color} ||
| {color:green}+1{color} | {color:green} mvninstall {color} | {color:green} 4m
34s{color} | {color:green} the patch passed {color} |
| {color:green}+1{color} | {color:green} compile {color} | {color:green} 0m
41s{color} | {color:green} the patch passed {color} |
| {color:green}+1{color} | {color:green} javac {color} | {color:green} 0m
42s{color} | {color:green} the patch passed {color} |
| {color:green}+1{color} | {color:green} checkstyle {color} | {color:green} 1m
4s{color} | {color:green} the patch passed {color} |
| {color:green}+1{color} | {color:green} whitespace {color} | {color:green} 0m
0s{color} | {color:green} The patch has no whitespace issues. {color} |
| {color:green}+1{color} | {color:green} shadedjars {color} | {color:green} 4m
25s{color} | {color:green} patch has no errors when building our shaded
downstream artifacts. {color} |
| {color:green}+1{color} | {color:green} hadoopcheck {color} | {color:green}
50m 44s{color} | {color:green} Patch does not cause any errors with Hadoop
2.6.1 2.6.2 2.6.3 2.6.4 2.6.5 2.7.1 2.7.2 2.7.3 2.7.4 or 3.0.0-alpha4. {color} |
| {color:green}+1{color} | {color:green} javadoc {color} | {color:green} 0m
27s{color} | {color:green} the patch passed {color} |
|| || || || {color:brown} Other Tests {color} ||
| {color:red}-1{color} | {color:red} unit {color} | {color:red} 24m 30s{color}
| {color:red} hbase-server in the patch failed. {color} |
| {color:green}+1{color} | {color:green} asflicense {color} | {color:green} 0m
12s{color} | {color:green} The patch does not generate ASF License warnings.
{color} |
| {color:black}{color} | {color:black} {color} | {color:black} 93m 36s{color} |
{color:black} {color} |
\\
\\
|| Reason || Tests ||
| Failed junit tests | hadoop.hbase.coprocessor.TestCoprocessorShortCircuitRPC |
\\
\\
|| Subsystem || Report/Notes ||
| Docker | Client=17.05.0-ce Server=17.05.0-ce Image:yetus/hbase:eee3b01 |
| JIRA Issue | HBASE-19463 |
| JIRA Patch URL |
https://issues.apache.org/jira/secure/attachment/12901342/HBASE-19463.master.001.patch
|
| Optional Tests | asflicense javac javadoc unit findbugs shadedjars
hadoopcheck hbaseanti checkstyle compile |
| uname | Linux 5756eb462162 3.13.0-129-generic #178-Ubuntu SMP Fri Aug 11
12:48:20 UTC 2017 x86_64 GNU/Linux |
| Build tool | maven |
| Personality |
/home/jenkins/jenkins-slave/workspace/PreCommit-HBASE-Build/component/dev-support/hbase-personality.sh
|
| git revision | master / 7092b814bd |
| maven | version: Apache Maven 3.5.2
(138edd61fd100ec658bfa2d307c43b76940a5d7d; 2017-10-18T07:58:13Z) |
| Default Java | 1.8.0_151 |
| unit |
https://builds.apache.org/job/PreCommit-HBASE-Build/10311/artifact/patchprocess/patch-unit-hbase-server.txt
|
| Test Results |
https://builds.apache.org/job/PreCommit-HBASE-Build/10311/testReport/ |
| modules | C: hbase-server U: hbase-server |
| Console output |
[jira] [Commented] (HBASE-19360) Remove unused imports from hbase-zookeeper module
[ https://issues.apache.org/jira/browse/HBASE-19360?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16284580#comment-16284580 ] Hudson commented on HBASE-19360: FAILURE: Integrated in Jenkins build HBase-Trunk_matrix #4192 (See [https://builds.apache.org/job/HBase-Trunk_matrix/4192/]) HBASE-19360 Removed unused imports from hbase-zookeeper module (jan.hentschel: rev 5b174b65c0c61e310b8625828fbf3b6e14954827) * (edit) hbase-zookeeper/src/main/java/org/apache/hadoop/hbase/zookeeper/HQuorumPeer.java > Remove unused imports from hbase-zookeeper module > - > > Key: HBASE-19360 > URL: https://issues.apache.org/jira/browse/HBASE-19360 > Project: HBase > Issue Type: Sub-task > Components: Zookeeper >Reporter: Jan Hentschel >Assignee: Jan Hentschel >Priority: Minor > Fix For: 3.0.0, 2.0.0-beta-1 > > Attachments: HBASE-19360.master.001.patch, UnusedImport.xml > > > Currently there are two warnings regarding unused imports in the > *hbase-zookeeper* module (see the attached XML). The unused imports should be > removed. -- This message was sent by Atlassian JIRA (v6.4.14#64029)
[jira] [Commented] (HBASE-19134) Make WALKey an Interface; expose Read-Only version to CPs
[ https://issues.apache.org/jira/browse/HBASE-19134?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16284583#comment-16284583 ] Hudson commented on HBASE-19134: FAILURE: Integrated in Jenkins build HBase-Trunk_matrix #4192 (See [https://builds.apache.org/job/HBase-Trunk_matrix/4192/]) HBASE-19134 Make WALKey an Interface; expose Read-Only version to CPs (stack: rev a5a77ae3d5bfef9396b6024ec723d83a911692ec) * (edit) hbase-server/src/main/java/org/apache/hadoop/hbase/protobuf/ReplicationProtbufUtil.java * (edit) hbase-server/src/main/java/org/apache/hadoop/hbase/regionserver/wal/WALUtil.java * (edit) hbase-server/src/test/java/org/apache/hadoop/hbase/regionserver/TestWALLockup.java * (edit) hbase-server/src/main/java/org/apache/hadoop/hbase/replication/ClusterMarkingEntryFilter.java * (edit) hbase-server/src/main/java/org/apache/hadoop/hbase/regionserver/wal/AsyncProtobufLogWriter.java * (edit) hbase-server/src/test/java/org/apache/hadoop/hbase/coprocessor/TestCoprocessorMetrics.java * (edit) hbase-server/src/main/java/org/apache/hadoop/hbase/wal/WALKey.java * (edit) hbase-server/src/main/java/org/apache/hadoop/hbase/wal/WALSplitter.java * (edit) hbase-server/src/main/java/org/apache/hadoop/hbase/wal/WAL.java * (edit) hbase-server/src/test/java/org/apache/hadoop/hbase/regionserver/wal/FaultyProtobufLogReader.java * (edit) hbase-server/src/test/java/org/apache/hadoop/hbase/replication/TestReplicationWALEntryFilters.java * (edit) hbase-server/src/main/java/org/apache/hadoop/hbase/regionserver/SequenceId.java * (edit) hbase-server/src/test/java/org/apache/hadoop/hbase/wal/WALPerformanceEvaluation.java * (edit) hbase-server/src/test/java/org/apache/hadoop/hbase/regionserver/wal/TestLogRollingNoCluster.java * (edit) hbase-server/src/main/java/org/apache/hadoop/hbase/regionserver/wal/FSWALEntry.java * (edit) hbase-server/src/test/java/org/apache/hadoop/hbase/regionserver/TestHRegionReplayEvents.java * (edit) hbase-server/src/test/java/org/apache/hadoop/hbase/replication/regionserver/TestWALEntryStream.java * (edit) hbase-server/src/test/java/org/apache/hadoop/hbase/regionserver/wal/TestLogRollAbort.java * (edit) hbase-server/src/test/java/org/apache/hadoop/hbase/regionserver/wal/TestWALActionsListener.java * (edit) hbase-server/src/test/java/org/apache/hadoop/hbase/master/TestDistributedLogSplitting.java * (edit) hbase-server/src/test/java/org/apache/hadoop/hbase/wal/TestFSHLogProvider.java * (edit) hbase-mapreduce/src/test/java/org/apache/hadoop/hbase/mapreduce/TestWALRecordReader.java * (edit) hbase-server/src/test/java/org/apache/hadoop/hbase/wal/FaultyFSLog.java * (edit) hbase-server/src/main/java/org/apache/hadoop/hbase/regionserver/wal/AbstractFSWAL.java * (edit) hbase-server/src/main/java/org/apache/hadoop/hbase/regionserver/wal/FSHLog.java * (edit) hbase-server/src/test/java/org/apache/hadoop/hbase/replication/TestReplicationSource.java * (edit) hbase-server/src/test/java/org/apache/hadoop/hbase/replication/regionserver/TestRegionReplicaReplicationEndpointNoMaster.java * (edit) hbase-server/src/test/java/org/apache/hadoop/hbase/coprocessor/TestWALObserver.java * (edit) hbase-server/src/main/java/org/apache/hadoop/hbase/regionserver/wal/WALActionsListener.java * (edit) hbase-server/src/main/java/org/apache/hadoop/hbase/regionserver/wal/ProtobufLogWriter.java * (edit) hbase-server/src/test/java/org/apache/hadoop/hbase/wal/TestWALReaderOnSecureWAL.java * (edit) hbase-server/src/main/java/org/apache/hadoop/hbase/replication/regionserver/Replication.java * (add) hbase-server/src/main/java/org/apache/hadoop/hbase/wal/WALKeyImpl.java * (edit) hbase-server/src/main/java/org/apache/hadoop/hbase/regionserver/wal/AsyncFSWAL.java * (edit) hbase-server/src/test/java/org/apache/hadoop/hbase/wal/TestWALRootDir.java * (edit) hbase-server/src/main/java/org/apache/hadoop/hbase/wal/WALEdit.java * (edit) hbase-server/src/test/java/org/apache/hadoop/hbase/regionserver/wal/AbstractTestWALReplay.java * (edit) hbase-server/src/test/java/org/apache/hadoop/hbase/wal/TestSecureWAL.java * (edit) hbase-server/src/test/java/org/apache/hadoop/hbase/regionserver/TestHRegion.java * (edit) hbase-server/src/test/java/org/apache/hadoop/hbase/replication/regionserver/TestReplicationSourceManager.java * (edit) hbase-server/src/main/java/org/apache/hadoop/hbase/security/visibility/VisibilityReplicationEndpoint.java * (edit) hbase-server/src/test/java/org/apache/hadoop/hbase/wal/TestWALFactory.java * (edit) hbase-mapreduce/src/test/java/org/apache/hadoop/hbase/replication/TestReplicationSmallTests.java * (edit) hbase-server/src/main/java/org/apache/hadoop/hbase/coprocessor/RegionObserver.java * (edit) hbase-server/src/main/java/org/apache/hadoop/hbase/regionserver/HRegion.java * (edit) hbase-server/src/main/java/org/apache/hadoop/hbase/wal/DisabledWALProvider.java * (edit)
[jira] [Commented] (HBASE-19457) Debugging flaky TestTruncateTableProcedure
[ https://issues.apache.org/jira/browse/HBASE-19457?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16284584#comment-16284584 ] Hudson commented on HBASE-19457: FAILURE: Integrated in Jenkins build HBase-Trunk_matrix #4192 (See [https://builds.apache.org/job/HBase-Trunk_matrix/4192/]) HBASE-19457 Debugging flaky TestTruncateTableProcedure (appy: rev 7092b814bd5c5e243987853771dc2ec339ae0b0c) * (edit) hbase-server/src/main/java/org/apache/hadoop/hbase/master/assignment/AssignmentManager.java * (edit) hbase-server/src/test/java/org/apache/hadoop/hbase/master/procedure/TestTruncateTableProcedure.java * (edit) hbase-server/src/test/java/org/apache/hadoop/hbase/master/procedure/MasterProcedureTestingUtility.java * (edit) hbase-common/src/main/java/org/apache/hadoop/hbase/util/CommonFSUtils.java * (edit) hbase-procedure/src/main/java/org/apache/hadoop/hbase/procedure2/StateMachineProcedure.java * (edit) hbase-server/src/main/java/org/apache/hadoop/hbase/master/procedure/TruncateTableProcedure.java > Debugging flaky TestTruncateTableProcedure > -- > > Key: HBASE-19457 > URL: https://issues.apache.org/jira/browse/HBASE-19457 > Project: HBase > Issue Type: Bug >Reporter: Appy >Assignee: Appy > Attachments: test-output.txt > > -- This message was sent by Atlassian JIRA (v6.4.14#64029)
[jira] [Commented] (HBASE-19180) Remove unused imports from AlwaysPasses
[ https://issues.apache.org/jira/browse/HBASE-19180?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16284579#comment-16284579 ] Hudson commented on HBASE-19180: FAILURE: Integrated in Jenkins build HBase-Trunk_matrix #4192 (See [https://builds.apache.org/job/HBase-Trunk_matrix/4192/]) HBASE-19180 Removed unused imports from AlwaysPasses (jan.hentschel: rev 114b62e637bf4aff1873cc20f87888f514f40079) * (edit) hbase-build-support/hbase-error-prone/src/main/java/org/apache/hadoop/hbase/errorprone/AlwaysPasses.java > Remove unused imports from AlwaysPasses > --- > > Key: HBASE-19180 > URL: https://issues.apache.org/jira/browse/HBASE-19180 > Project: HBase > Issue Type: Improvement > Components: build >Affects Versions: 3.0.0 >Reporter: Jan Hentschel >Assignee: Jan Hentschel >Priority: Trivial > Fix For: 3.0.0, 1.4.0, 1.5.0, 2.0.0-beta-1 > > Attachments: HBASE-19180.master.001.patch > > > The class org.apache.hadoop.hbase.errorprone.AlwaysPasses currently has some > unused imports, which should be removed. -- This message was sent by Atlassian JIRA (v6.4.14#64029)
[jira] [Commented] (HBASE-19373) Fix Checkstyle error in hbase-annotations
[ https://issues.apache.org/jira/browse/HBASE-19373?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16284581#comment-16284581 ] Hudson commented on HBASE-19373: FAILURE: Integrated in Jenkins build HBase-Trunk_matrix #4192 (See [https://builds.apache.org/job/HBase-Trunk_matrix/4192/]) HBASE-19373 Fixed remaining Checkstyle error in hbase-annotations (jan.hentschel: rev 07b193ae4f36345c4073023e0220b3e147c61884) * (edit) hbase-annotations/src/test/java/org/apache/hadoop/hbase/testclassification/ClientTests.java > Fix Checkstyle error in hbase-annotations > - > > Key: HBASE-19373 > URL: https://issues.apache.org/jira/browse/HBASE-19373 > Project: HBase > Issue Type: Sub-task >Reporter: Jan Hentschel >Assignee: Jan Hentschel >Priority: Trivial > Fix For: 3.0.0, 1.4.0, 1.3.2, 1.5.0, 1.2.7, 2.0.0-beta-1, 1.1.13 > > Attachments: HBASE-19373.master.001.patch > > > Fix the remaining Checkstyle error regarding line length in the > *hbase-annotations* module. -- This message was sent by Atlassian JIRA (v6.4.14#64029)
[jira] [Commented] (HBASE-19461) TestRSGroups is broke
[ https://issues.apache.org/jira/browse/HBASE-19461?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16284582#comment-16284582 ] Hudson commented on HBASE-19461: FAILURE: Integrated in Jenkins build HBase-Trunk_matrix #4192 (See [https://builds.apache.org/job/HBase-Trunk_matrix/4192/]) HBASE-19461 TestRSGroups is broke (stack: rev 542060ce4033428bc0bc56890bc3e3dfd84792ee) * (edit) hbase-client/src/main/java/org/apache/hadoop/hbase/client/RegionInfo.java * (edit) hbase-rsgroup/src/test/java/org/apache/hadoop/hbase/rsgroup/TestRSGroups.java > TestRSGroups is broke > - > > Key: HBASE-19461 > URL: https://issues.apache.org/jira/browse/HBASE-19461 > Project: HBase > Issue Type: Bug > Components: test >Reporter: stack >Assignee: stack > Fix For: 2.0.0-beta-1 > > Attachments: HBASE-19461.master.001.patch > > > I noticed this. Tried bisect'ing but nought definitive at mo. I see > testDefaultNamespaceCreateAndAssign failing most of the time. The crazy > getTable parse in RegionInfo gets a negative offset because the passed in > region name is nonsense. -- This message was sent by Atlassian JIRA (v6.4.14#64029)
[jira] [Created] (HBASE-19470) Compaction state in Table web UI is not right when table is disabled
Guanghao Zhang created HBASE-19470: -- Summary: Compaction state in Table web UI is not right when table is disabled Key: HBASE-19470 URL: https://issues.apache.org/jira/browse/HBASE-19470 Project: HBase Issue Type: Bug Affects Versions: 1.4.0 Reporter: Guanghao Zhang Priority: Trivial Table Attributes Attribute Name Value Description Enabled false Is the table enabled Compaction sun.reflect.NativeConstructorAccessorImpl.newInstance0(Native Method)sun.reflect.NativeConstructorAccessorImpl.newInstance(NativeConstructorAccessorImpl.java:62)sun.reflect.DelegatingConstructorAccessorImpl.newInstance(DelegatingConstructorAccessorImpl.java:45)java.lang.reflect.Constructor.newInstance(Constructor.java:423)org.apache.hadoop.hbase.ipc.RemoteWithExtrasException.instantiateException(RemoteWithExtrasException.java:95)org.apache.hadoop.hbase.ipc.RemoteWithExtrasException.unwrapRemoteException(RemoteWithExtrasException.java:85)org.apache.hadoop.hbase.protobuf.ProtobufUtil.makeIOExceptionOfException(ProtobufUtil.java:371)org.apache.hadoop.hbase.protobuf.ProtobufUtil.getRemoteException(ProtobufUtil.java:330)org.apache.hadoop.hbase.client.HBaseAdmin.getCompactionState(HBaseAdmin.java:3455)org.apache.hadoop.hbase.generated.master.table_jsp._jspService(table_jsp.java:283)org.apache.jasper.runtime.HttpJspBase.service(HttpJspBase.java:109)javax.servlet.http.HttpServlet.service(HttpServlet.java:820)org.mortbay.jetty.servlet.ServletHolder.handle(ServletHolder.java:511)org.mortbay.jetty.servlet.ServletHandler$CachedChain.doFilter(ServletHandler.java:1221)org.apache.hadoop.hbase.http.lib.StaticUserWebFilter$StaticUserFilter.doFilter(StaticUserWebFilter.java:113)org.mortbay.jetty.servlet.ServletHandler$CachedChain.doFilter(ServletHandler.java:1212)org.apache.hadoop.hbase.http.ClickjackingPreventionFilter.doFilter(ClickjackingPreventionFilter.java:48)org.mortbay.jetty.servlet.ServletHandler$CachedChain.doFilter(ServletHandler.java:1212)org.apache.hadoop.hbase.http.HttpServer$QuotingInputFilter.doFilter(HttpServer.java:1432)org.mortbay.jetty.servlet.ServletHandler$CachedChain.doFilter(ServletHandler.java:1212)org.apache.hadoop.hbase.http.NoCacheFilter.doFilter(NoCacheFilter.java:49)org.mortbay.jetty.servlet.ServletHandler$CachedChain.doFilter(ServletHandler.java:1212)org.apache.hadoop.hbase.http.NoCacheFilter.doFilter(NoCacheFilter.java:49)org.mortbay.jetty.servlet.ServletHandler$CachedChain.doFilter(ServletHandler.java:1212)org.mortbay.jetty.servlet.ServletHandler.handle(ServletHandler.java:399)org.mortbay.jetty.security.SecurityHandler.handle(SecurityHandler.java:216)org.mortbay.jetty.servlet.SessionHandler.handle(SessionHandler.java:182)org.mortbay.jetty.handler.ContextHandler.handle(ContextHandler.java:766)org.mortbay.jetty.webapp.WebAppContext.handle(WebAppContext.java:450)org.mortbay.jetty.handler.ContextHandlerCollection.handle(ContextHandlerCollection.java:230)org.mortbay.jetty.handler.HandlerWrapper.handle(HandlerWrapper.java:152)org.mortbay.jetty.Server.handle(Server.java:326)org.mortbay.jetty.HttpConnection.handleRequest(HttpConnection.java:542)org.mortbay.jetty.HttpConnection$RequestHandler.headerComplete(HttpConnection.java:928)org.mortbay.jetty.HttpParser.parseNext(HttpParser.java:549)org.mortbay.jetty.HttpParser.parseAvailable(HttpParser.java:212)org.mortbay.jetty.HttpConnection.handle(HttpConnection.java:404)org.mortbay.io.nio.SelectChannelEndPoint.run(SelectChannelEndPoint.java:410)org.mortbay.thread.QueuedThreadPool$PoolThread.run(QueuedThreadPool.java:582) Unknown -- This message was sent by Atlassian JIRA (v6.4.14#64029)
[jira] [Commented] (HBASE-19469) Review Of BackupSystemTable
[
https://issues.apache.org/jira/browse/HBASE-19469?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16284564#comment-16284564
]
Hadoop QA commented on HBASE-19469:
---
| (x) *{color:red}-1 overall{color}* |
\\
\\
|| Vote || Subsystem || Runtime || Comment ||
| {color:blue}0{color} | {color:blue} reexec {color} | {color:blue} 0m
9s{color} | {color:blue} Docker mode activated. {color} |
|| || || || {color:brown} Prechecks {color} ||
| {color:blue}0{color} | {color:blue} findbugs {color} | {color:blue} 0m
0s{color} | {color:blue} Findbugs executables are not available. {color} |
| {color:green}+1{color} | {color:green} hbaseanti {color} | {color:green} 0m
0s{color} | {color:green} Patch does not have any anti-patterns. {color} |
| {color:green}+1{color} | {color:green} @author {color} | {color:green} 0m
0s{color} | {color:green} The patch does not contain any @author tags. {color} |
| {color:red}-1{color} | {color:red} test4tests {color} | {color:red} 0m
0s{color} | {color:red} The patch doesn't appear to include any new or modified
tests. Please justify why no new tests are needed for this patch. Also please
list what manual steps were performed to verify this patch. {color} |
|| || || || {color:brown} master Compile Tests {color} ||
| {color:green}+1{color} | {color:green} mvninstall {color} | {color:green} 4m
42s{color} | {color:green} master passed {color} |
| {color:green}+1{color} | {color:green} compile {color} | {color:green} 0m
20s{color} | {color:green} master passed {color} |
| {color:green}+1{color} | {color:green} checkstyle {color} | {color:green} 0m
13s{color} | {color:green} master passed {color} |
| {color:green}+1{color} | {color:green} shadedjars {color} | {color:green} 4m
43s{color} | {color:green} branch has no errors when building our shaded
downstream artifacts. {color} |
| {color:green}+1{color} | {color:green} javadoc {color} | {color:green} 0m
13s{color} | {color:green} master passed {color} |
|| || || || {color:brown} Patch Compile Tests {color} ||
| {color:green}+1{color} | {color:green} mvninstall {color} | {color:green} 4m
42s{color} | {color:green} the patch passed {color} |
| {color:green}+1{color} | {color:green} compile {color} | {color:green} 0m
19s{color} | {color:green} the patch passed {color} |
| {color:green}+1{color} | {color:green} javac {color} | {color:green} 0m
19s{color} | {color:green} the patch passed {color} |
| {color:red}-1{color} | {color:red} checkstyle {color} | {color:red} 0m
14s{color} | {color:red} hbase-backup: The patch generated 2 new + 23 unchanged
- 4 fixed = 25 total (was 27) {color} |
| {color:red}-1{color} | {color:red} whitespace {color} | {color:red} 0m
0s{color} | {color:red} The patch has 1 line(s) that end in whitespace. Use git
apply --whitespace=fix <>. Refer https://git-scm.com/docs/git-apply
{color} |
| {color:green}+1{color} | {color:green} shadedjars {color} | {color:green} 4m
35s{color} | {color:green} patch has no errors when building our shaded
downstream artifacts. {color} |
| {color:green}+1{color} | {color:green} hadoopcheck {color} | {color:green}
61m 7s{color} | {color:green} Patch does not cause any errors with Hadoop
2.6.1 2.6.2 2.6.3 2.6.4 2.6.5 2.7.1 2.7.2 2.7.3 2.7.4 or 3.0.0-alpha4. {color} |
| {color:green}+1{color} | {color:green} javadoc {color} | {color:green} 0m
43s{color} | {color:green} the patch passed {color} |
|| || || || {color:brown} Other Tests {color} ||
| {color:red}-1{color} | {color:red} unit {color} | {color:red} 25m 29s{color}
| {color:red} hbase-backup in the patch failed. {color} |
| {color:green}+1{color} | {color:green} asflicense {color} | {color:green} 0m
15s{color} | {color:green} The patch does not generate ASF License warnings.
{color} |
| {color:black}{color} | {color:black} {color} | {color:black}107m 12s{color} |
{color:black} {color} |
\\
\\
|| Reason || Tests ||
| Failed junit tests | hadoop.hbase.backup.TestBackupSystemTable |
\\
\\
|| Subsystem || Report/Notes ||
| Docker | Client=17.05.0-ce Server=17.05.0-ce Image:yetus/hbase:eee3b01 |
| JIRA Issue | HBASE-19469 |
| JIRA Patch URL |
https://issues.apache.org/jira/secure/attachment/12901328/HBASE-19469.1.patch |
| Optional Tests | asflicense javac javadoc unit findbugs shadedjars
hadoopcheck hbaseanti checkstyle compile |
| uname | Linux d8f2df7d5fc1 3.13.0-133-generic #182-Ubuntu SMP Tue Sep 19
15:49:21 UTC 2017 x86_64 GNU/Linux |
| Build tool | maven |
| Personality |
/home/jenkins/jenkins-slave/workspace/PreCommit-HBASE-Build/component/dev-support/hbase-personality.sh
|
| git revision | master / 7092b814bd |
| maven | version: Apache Maven 3.5.2
(138edd61fd100ec658bfa2d307c43b76940a5d7d; 2017-10-18T07:58:13Z) |
| Default Java | 1.8.0_151 |
| checkstyle |
https://builds.apache.org/job/PreCommit-HBASE-Build/10310/artifact/patchprocess/diff-checkstyle-hbase-backup.txt
|
| whitespace |
[jira] [Commented] (HBASE-19463) Make CPEnv#getConnection return a facade that throws Unsupported if CP calls #close
[ https://issues.apache.org/jira/browse/HBASE-19463?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16284562#comment-16284562 ] stack commented on HBASE-19463: --- +1 > Make CPEnv#getConnection return a facade that throws Unsupported if CP calls > #close > --- > > Key: HBASE-19463 > URL: https://issues.apache.org/jira/browse/HBASE-19463 > Project: HBase > Issue Type: Improvement > Components: Coprocessors >Reporter: stack >Assignee: Guanghao Zhang > Labels: beginner > Fix For: 2.0.0-beta-2 > > Attachments: HBASE-19463.master.001.patch > > > Follows from HBASE-19301, a suggestion by [~zghaobac]. > To prevent a CP accidentally closing the connection returned by > CpEnv#getConnection -- which returns the hosting Servers Connection -- we > should throw UnsupportedException if the CP calls #close Do it. -- This message was sent by Atlassian JIRA (v6.4.14#64029)
[jira] [Updated] (HBASE-19463) Make CPEnv#getConnection return a facade that throws Unsupported if CP calls #close
[ https://issues.apache.org/jira/browse/HBASE-19463?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Guanghao Zhang updated HBASE-19463: --- Assignee: Guanghao Zhang Status: Patch Available (was: Open) > Make CPEnv#getConnection return a facade that throws Unsupported if CP calls > #close > --- > > Key: HBASE-19463 > URL: https://issues.apache.org/jira/browse/HBASE-19463 > Project: HBase > Issue Type: Improvement > Components: Coprocessors >Reporter: stack >Assignee: Guanghao Zhang > Labels: beginner > Fix For: 2.0.0-beta-2 > > Attachments: HBASE-19463.master.001.patch > > > Follows from HBASE-19301, a suggestion by [~zghaobac]. > To prevent a CP accidentally closing the connection returned by > CpEnv#getConnection -- which returns the hosting Servers Connection -- we > should throw UnsupportedException if the CP calls #close Do it. -- This message was sent by Atlassian JIRA (v6.4.14#64029)
[jira] [Updated] (HBASE-19463) Make CPEnv#getConnection return a facade that throws Unsupported if CP calls #close
[ https://issues.apache.org/jira/browse/HBASE-19463?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Guanghao Zhang updated HBASE-19463: --- Attachment: HBASE-19463.master.001.patch > Make CPEnv#getConnection return a facade that throws Unsupported if CP calls > #close > --- > > Key: HBASE-19463 > URL: https://issues.apache.org/jira/browse/HBASE-19463 > Project: HBase > Issue Type: Improvement > Components: Coprocessors >Reporter: stack > Labels: beginner > Fix For: 2.0.0-beta-2 > > Attachments: HBASE-19463.master.001.patch > > > Follows from HBASE-19301, a suggestion by [~zghaobac]. > To prevent a CP accidentally closing the connection returned by > CpEnv#getConnection -- which returns the hosting Servers Connection -- we > should throw UnsupportedException if the CP calls #close Do it. -- This message was sent by Atlassian JIRA (v6.4.14#64029)
[jira] [Commented] (HBASE-19457) Debugging flaky TestTruncateTableProcedure
[ https://issues.apache.org/jira/browse/HBASE-19457?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16284510#comment-16284510 ] Appy commented on HBASE-19457: -- Although the test timed out after 60 sec, it had at least reached TRUNCATE_TABLE_ADD_TO_META state. One bug i see here is, if master crashes after performing TRUNCATE_TABLE_ADD_TO_META, when the new AM comes up, it reads back the meta and assumes that these newly added regions are offline and need to be reassigned (see logs below). But that's wrong since recovered TruncateTableProcedure will try to do the same. Since there's table lock, they won't execute in parallel, but i think it'll be: - Fine if truncate proc executes first. Assign procs will complete immediately saying regions are assigned. - Bad if assign procs executes first. Since, when truncate proc will execute later, it'll meddle with hbase:meta assuming table is disabled and try to assign and fail. An even worst scenario would be: If 1) master crashes, 2)region containing meta crashes in between puts and only some puts succeed Then new AM will bring partial regions (since even meta doesn't know about all regions) of the table online. Waiting for more runs after increasing timeout to get better logs. > Debugging flaky TestTruncateTableProcedure > -- > > Key: HBASE-19457 > URL: https://issues.apache.org/jira/browse/HBASE-19457 > Project: HBase > Issue Type: Bug >Reporter: Appy >Assignee: Appy > Attachments: test-output.txt > > -- This message was sent by Atlassian JIRA (v6.4.14#64029)
[jira] [Commented] (HBASE-19469) Review Of BackupSystemTable
[ https://issues.apache.org/jira/browse/HBASE-19469?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16284507#comment-16284507 ] BELUGA BEHR commented on HBASE-19469: - "less is more" :) > Review Of BackupSystemTable > --- > > Key: HBASE-19469 > URL: https://issues.apache.org/jira/browse/HBASE-19469 > Project: HBase > Issue Type: Improvement > Components: hbase >Affects Versions: 3.0.0 >Reporter: BELUGA BEHR >Assignee: BELUGA BEHR >Priority: Trivial > Attachments: HBASE-19469.1.patch > > > * Remove superfluous logging guards > * Fix spelling mistake in log message > * Fixed some DEBUG log messages that were guarded by an _isTraceEnabled_ > * Use more Java auto-close functionality > * Some code simplifications > * Use better data structures for merge/disjoin -- This message was sent by Atlassian JIRA (v6.4.14#64029)
[jira] [Updated] (HBASE-19457) Debugging flaky TestTruncateTableProcedure
[ https://issues.apache.org/jira/browse/HBASE-19457?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Appy updated HBASE-19457: - Attachment: test-output.txt > Debugging flaky TestTruncateTableProcedure > -- > > Key: HBASE-19457 > URL: https://issues.apache.org/jira/browse/HBASE-19457 > Project: HBase > Issue Type: Bug >Reporter: Appy >Assignee: Appy > Attachments: test-output.txt > > -- This message was sent by Atlassian JIRA (v6.4.14#64029)
[jira] [Commented] (HBASE-19457) Debugging flaky TestTruncateTableProcedure
[ https://issues.apache.org/jira/browse/HBASE-19457?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16284502#comment-16284502 ] Appy commented on HBASE-19457: -- After more debugging, testRecoveryAndDoubleExecutionPreserveSplits is just a lot of failing and recovery and needs more time (it reaches just halfway when clock hits the minute). Removing 60s timeout. Also adding some more logging to help in future debugging. > Debugging flaky TestTruncateTableProcedure > -- > > Key: HBASE-19457 > URL: https://issues.apache.org/jira/browse/HBASE-19457 > Project: HBase > Issue Type: Bug >Reporter: Appy >Assignee: Appy > -- This message was sent by Atlassian JIRA (v6.4.14#64029)
[jira] [Commented] (HBASE-15482) Provide an option to skip calculating block locations for SnapshotInputFormat
[ https://issues.apache.org/jira/browse/HBASE-15482?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16284499#comment-16284499 ] Ted Yu commented on HBASE-15482: lgtm > Provide an option to skip calculating block locations for SnapshotInputFormat > - > > Key: HBASE-15482 > URL: https://issues.apache.org/jira/browse/HBASE-15482 > Project: HBase > Issue Type: Improvement > Components: mapreduce >Reporter: Liyin Tang >Assignee: Xiang Li >Priority: Minor > Fix For: 2.1.0 > > Attachments: HBASE-15482.master.000.patch, > HBASE-15482.master.001.patch, HBASE-15482.master.002.patch > > > When a MR job is reading from SnapshotInputFormat, it needs to calculate the > splits based on the block locations in order to get best locality. However, > this process may take a long time for large snapshots. > In some setup, the computing layer, Spark, Hive or Presto could run out side > of HBase cluster. In these scenarios, the block locality doesn't matter. > Therefore, it will be great to have an option to skip calculating the block > locations for every job. That will super useful for the Hive/Presto/Spark > connectors. -- This message was sent by Atlassian JIRA (v6.4.14#64029)
[jira] [Commented] (HBASE-15482) Provide an option to skip calculating block locations for SnapshotInputFormat
[ https://issues.apache.org/jira/browse/HBASE-15482?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16284496#comment-16284496 ] Xiang Li commented on HBASE-15482: -- [~tedyu], would you please help to review patch 002 at your convenience? > Provide an option to skip calculating block locations for SnapshotInputFormat > - > > Key: HBASE-15482 > URL: https://issues.apache.org/jira/browse/HBASE-15482 > Project: HBase > Issue Type: Improvement > Components: mapreduce >Reporter: Liyin Tang >Assignee: Xiang Li >Priority: Minor > Fix For: 2.1.0 > > Attachments: HBASE-15482.master.000.patch, > HBASE-15482.master.001.patch, HBASE-15482.master.002.patch > > > When a MR job is reading from SnapshotInputFormat, it needs to calculate the > splits based on the block locations in order to get best locality. However, > this process may take a long time for large snapshots. > In some setup, the computing layer, Spark, Hive or Presto could run out side > of HBase cluster. In these scenarios, the block locality doesn't matter. > Therefore, it will be great to have an option to skip calculating the block > locations for every job. That will super useful for the Hive/Presto/Spark > connectors. -- This message was sent by Atlassian JIRA (v6.4.14#64029)
[jira] [Commented] (HBASE-19449) Implement SLF4J and SLF4J Parameter Substitution
[
https://issues.apache.org/jira/browse/HBASE-19449?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16284489#comment-16284489
]
Hadoop QA commented on HBASE-19449:
---
| (x) *{color:red}-1 overall{color}* |
\\
\\
|| Vote || Subsystem || Runtime || Comment ||
| {color:blue}0{color} | {color:blue} reexec {color} | {color:blue} 0m
9s{color} | {color:blue} Docker mode activated. {color} |
|| || || || {color:brown} Prechecks {color} ||
| {color:blue}0{color} | {color:blue} findbugs {color} | {color:blue} 0m
0s{color} | {color:blue} Findbugs executables are not available. {color} |
| {color:green}+1{color} | {color:green} hbaseanti {color} | {color:green} 0m
0s{color} | {color:green} Patch does not have any anti-patterns. {color} |
| {color:green}+1{color} | {color:green} @author {color} | {color:green} 0m
0s{color} | {color:green} The patch does not contain any @author tags. {color} |
| {color:red}-1{color} | {color:red} test4tests {color} | {color:red} 0m
0s{color} | {color:red} The patch doesn't appear to include any new or modified
tests. Please justify why no new tests are needed for this patch. Also please
list what manual steps were performed to verify this patch. {color} |
|| || || || {color:brown} master Compile Tests {color} ||
| {color:green}+1{color} | {color:green} mvninstall {color} | {color:green} 4m
53s{color} | {color:green} master passed {color} |
| {color:green}+1{color} | {color:green} compile {color} | {color:green} 0m
41s{color} | {color:green} master passed {color} |
| {color:green}+1{color} | {color:green} checkstyle {color} | {color:green} 1m
3s{color} | {color:green} master passed {color} |
| {color:green}+1{color} | {color:green} shadedjars {color} | {color:green} 5m
25s{color} | {color:green} branch has no errors when building our shaded
downstream artifacts. {color} |
| {color:green}+1{color} | {color:green} javadoc {color} | {color:green} 0m
27s{color} | {color:green} master passed {color} |
|| || || || {color:brown} Patch Compile Tests {color} ||
| {color:green}+1{color} | {color:green} mvninstall {color} | {color:green} 4m
33s{color} | {color:green} the patch passed {color} |
| {color:green}+1{color} | {color:green} compile {color} | {color:green} 0m
40s{color} | {color:green} the patch passed {color} |
| {color:green}+1{color} | {color:green} javac {color} | {color:green} 0m
40s{color} | {color:green} the patch passed {color} |
| {color:green}+1{color} | {color:green} checkstyle {color} | {color:green} 1m
3s{color} | {color:green} hbase-server: The patch generated 0 new + 18
unchanged - 1 fixed = 18 total (was 19) {color} |
| {color:green}+1{color} | {color:green} whitespace {color} | {color:green} 0m
0s{color} | {color:green} The patch has no whitespace issues. {color} |
| {color:green}+1{color} | {color:green} shadedjars {color} | {color:green} 4m
27s{color} | {color:green} patch has no errors when building our shaded
downstream artifacts. {color} |
| {color:green}+1{color} | {color:green} hadoopcheck {color} | {color:green}
54m 5s{color} | {color:green} Patch does not cause any errors with Hadoop
2.6.1 2.6.2 2.6.3 2.6.4 2.6.5 2.7.1 2.7.2 2.7.3 2.7.4 or 3.0.0-alpha4. {color} |
| {color:green}+1{color} | {color:green} javadoc {color} | {color:green} 0m
29s{color} | {color:green} the patch passed {color} |
|| || || || {color:brown} Other Tests {color} ||
| {color:green}+1{color} | {color:green} unit {color} | {color:green} 94m
28s{color} | {color:green} hbase-server in the patch passed. {color} |
| {color:green}+1{color} | {color:green} asflicense {color} | {color:green} 0m
19s{color} | {color:green} The patch does not generate ASF License warnings.
{color} |
| {color:black}{color} | {color:black} {color} | {color:black}167m 24s{color} |
{color:black} {color} |
\\
\\
|| Subsystem || Report/Notes ||
| Docker | Client=17.05.0-ce Server=17.05.0-ce Image:yetus/hbase:eee3b01 |
| JIRA Issue | HBASE-19449 |
| JIRA Patch URL |
https://issues.apache.org/jira/secure/attachment/12901313/HBASE-19449.4.patch |
| Optional Tests | asflicense javac javadoc unit findbugs shadedjars
hadoopcheck hbaseanti checkstyle compile |
| uname | Linux 83f83c19b6bf 3.13.0-129-generic #178-Ubuntu SMP Fri Aug 11
12:48:20 UTC 2017 x86_64 GNU/Linux |
| Build tool | maven |
| Personality |
/home/jenkins/jenkins-slave/workspace/PreCommit-HBASE-Build@2/component/dev-support/hbase-personality.sh
|
| git revision | master / 07b193ae4f |
| maven | version: Apache Maven 3.5.2
(138edd61fd100ec658bfa2d307c43b76940a5d7d; 2017-10-18T07:58:13Z) |
| Default Java | 1.8.0_151 |
| Test Results |
https://builds.apache.org/job/PreCommit-HBASE-Build/10308/testReport/ |
| modules | C: hbase-server U: hbase-server |
| Console output |
https://builds.apache.org/job/PreCommit-HBASE-Build/10308/console |
| Powered by | Apache Yetus 0.6.0 http://yetus.apache.org |
This message was automatically
[jira] [Commented] (HBASE-19373) Fix Checkstyle error in hbase-annotations
[ https://issues.apache.org/jira/browse/HBASE-19373?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16284476#comment-16284476 ] Hudson commented on HBASE-19373: SUCCESS: Integrated in Jenkins build HBase-1.1-JDK7 #1949 (See [https://builds.apache.org/job/HBase-1.1-JDK7/1949/]) HBASE-19373 Fixed remaining Checkstyle error in hbase-annotations (jan.hentschel: rev f8a24b4d623e5d68759c3dd06da143e7793ff642) * (edit) hbase-annotations/src/test/java/org/apache/hadoop/hbase/testclassification/ClientTests.java > Fix Checkstyle error in hbase-annotations > - > > Key: HBASE-19373 > URL: https://issues.apache.org/jira/browse/HBASE-19373 > Project: HBase > Issue Type: Sub-task >Reporter: Jan Hentschel >Assignee: Jan Hentschel >Priority: Trivial > Fix For: 3.0.0, 1.4.0, 1.3.2, 1.5.0, 1.2.7, 2.0.0-beta-1, 1.1.13 > > Attachments: HBASE-19373.master.001.patch > > > Fix the remaining Checkstyle error regarding line length in the > *hbase-annotations* module. -- This message was sent by Atlassian JIRA (v6.4.14#64029)
[jira] [Commented] (HBASE-19469) Review Of BackupSystemTable
[
https://issues.apache.org/jira/browse/HBASE-19469?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16284468#comment-16284468
]
Ted Yu commented on HBASE-19469:
{code}
-if (LOG.isDebugEnabled()) {
{code}
There is no performance impact if DEBUG is not enabled ?
> Review Of BackupSystemTable
> ---
>
> Key: HBASE-19469
> URL: https://issues.apache.org/jira/browse/HBASE-19469
> Project: HBase
> Issue Type: Improvement
> Components: hbase
>Affects Versions: 3.0.0
>Reporter: BELUGA BEHR
>Assignee: BELUGA BEHR
>Priority: Trivial
> Attachments: HBASE-19469.1.patch
>
>
> * Remove superfluous logging guards
> * Fix spelling mistake in log message
> * Fixed some DEBUG log messages that were guarded by an _isTraceEnabled_
> * Use more Java auto-close functionality
> * Some code simplifications
> * Use better data structures for merge/disjoin
--
This message was sent by Atlassian JIRA
(v6.4.14#64029)
[jira] [Commented] (HBASE-19469) Review Of BackupSystemTable
[ https://issues.apache.org/jira/browse/HBASE-19469?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16284464#comment-16284464 ] Ted Yu commented on HBASE-19469: [~vrodionov]: FYI > Review Of BackupSystemTable > --- > > Key: HBASE-19469 > URL: https://issues.apache.org/jira/browse/HBASE-19469 > Project: HBase > Issue Type: Improvement > Components: hbase >Affects Versions: 3.0.0 >Reporter: BELUGA BEHR >Assignee: BELUGA BEHR >Priority: Trivial > Attachments: HBASE-19469.1.patch > > > * Remove superfluous logging guards > * Fix spelling mistake in log message > * Fixed some DEBUG log messages that were guarded by an _isTraceEnabled_ > * Use more Java auto-close functionality > * Some code simplifications > * Use better data structures for merge/disjoin -- This message was sent by Atlassian JIRA (v6.4.14#64029)
[jira] [Updated] (HBASE-19469) Review Of BackupSystemTable
[ https://issues.apache.org/jira/browse/HBASE-19469?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] BELUGA BEHR updated HBASE-19469: Status: Patch Available (was: Open) > Review Of BackupSystemTable > --- > > Key: HBASE-19469 > URL: https://issues.apache.org/jira/browse/HBASE-19469 > Project: HBase > Issue Type: Improvement > Components: hbase >Affects Versions: 3.0.0 >Reporter: BELUGA BEHR >Priority: Trivial > Attachments: HBASE-19469.1.patch > > > * Remove superfluous logging guards > * Fix spelling mistake in log message > * Fixed some DEBUG log messages that were guarded by an _isTraceEnabled_ > * Use more Java auto-close functionality > * Some code simplifications > * Use better data structures for merge/disjoin -- This message was sent by Atlassian JIRA (v6.4.14#64029)
[jira] [Assigned] (HBASE-19469) Review Of BackupSystemTable
[ https://issues.apache.org/jira/browse/HBASE-19469?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] BELUGA BEHR reassigned HBASE-19469: --- Assignee: BELUGA BEHR > Review Of BackupSystemTable > --- > > Key: HBASE-19469 > URL: https://issues.apache.org/jira/browse/HBASE-19469 > Project: HBase > Issue Type: Improvement > Components: hbase >Affects Versions: 3.0.0 >Reporter: BELUGA BEHR >Assignee: BELUGA BEHR >Priority: Trivial > Attachments: HBASE-19469.1.patch > > > * Remove superfluous logging guards > * Fix spelling mistake in log message > * Fixed some DEBUG log messages that were guarded by an _isTraceEnabled_ > * Use more Java auto-close functionality > * Some code simplifications > * Use better data structures for merge/disjoin -- This message was sent by Atlassian JIRA (v6.4.14#64029)
[jira] [Updated] (HBASE-19469) Review Of BackupSystemTable
[ https://issues.apache.org/jira/browse/HBASE-19469?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] BELUGA BEHR updated HBASE-19469: Attachment: HBASE-19469.1.patch > Review Of BackupSystemTable > --- > > Key: HBASE-19469 > URL: https://issues.apache.org/jira/browse/HBASE-19469 > Project: HBase > Issue Type: Improvement > Components: hbase >Affects Versions: 3.0.0 >Reporter: BELUGA BEHR >Priority: Trivial > Attachments: HBASE-19469.1.patch > > > * Remove superfluous logging guards > * Fix spelling mistake in log message > * Fixed some DEBUG log messages that were guarded by an _isTraceEnabled_ > * Use more Java auto-close functionality > * Some code simplifications > * Use better data structures for merge/disjoin -- This message was sent by Atlassian JIRA (v6.4.14#64029)
[jira] [Created] (HBASE-19469) Review Of BackupSystemTable
BELUGA BEHR created HBASE-19469: --- Summary: Review Of BackupSystemTable Key: HBASE-19469 URL: https://issues.apache.org/jira/browse/HBASE-19469 Project: HBase Issue Type: Improvement Components: hbase Affects Versions: 3.0.0 Reporter: BELUGA BEHR Priority: Trivial * Remove superfluous logging guards * Fix spelling mistake in log message * Fixed some DEBUG log messages that were guarded by an _isTraceEnabled_ * Use more Java auto-close functionality * Some code simplifications * Use better data structures for merge/disjoin -- This message was sent by Atlassian JIRA (v6.4.14#64029)
[jira] [Commented] (HBASE-19373) Fix Checkstyle error in hbase-annotations
[ https://issues.apache.org/jira/browse/HBASE-19373?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16284461#comment-16284461 ] Hudson commented on HBASE-19373: SUCCESS: Integrated in Jenkins build HBase-1.1-JDK8 #2034 (See [https://builds.apache.org/job/HBase-1.1-JDK8/2034/]) HBASE-19373 Fixed remaining Checkstyle error in hbase-annotations (jan.hentschel: rev f8a24b4d623e5d68759c3dd06da143e7793ff642) * (edit) hbase-annotations/src/test/java/org/apache/hadoop/hbase/testclassification/ClientTests.java > Fix Checkstyle error in hbase-annotations > - > > Key: HBASE-19373 > URL: https://issues.apache.org/jira/browse/HBASE-19373 > Project: HBase > Issue Type: Sub-task >Reporter: Jan Hentschel >Assignee: Jan Hentschel >Priority: Trivial > Fix For: 3.0.0, 1.4.0, 1.3.2, 1.5.0, 1.2.7, 2.0.0-beta-1, 1.1.13 > > Attachments: HBASE-19373.master.001.patch > > > Fix the remaining Checkstyle error regarding line length in the > *hbase-annotations* module. -- This message was sent by Atlassian JIRA (v6.4.14#64029)
[jira] [Commented] (HBASE-19465) Required httpcore and httpclient jars not included in binary distribution
[
https://issues.apache.org/jira/browse/HBASE-19465?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16284447#comment-16284447
]
Mike Drob commented on HBASE-19465:
---
right right, +1 on the patch in that case
> Required httpcore and httpclient jars not included in binary distribution
> -
>
> Key: HBASE-19465
> URL: https://issues.apache.org/jira/browse/HBASE-19465
> Project: HBase
> Issue Type: Bug
>Affects Versions: 1.4.0
>Reporter: Andrew Purtell
>Assignee: Andrew Purtell
>Priority: Blocker
> Fix For: 1.4.0
>
> Attachments: HBASE-19465-branch-1.patch
>
>
> The httpcore and httpclient dependency jars are not included into the binary
> distribution. This means MR/YARN jobs will fail if launched from the binary
> tarball as distributed, including those running in "local mode", e.g. ITBLL:
> {noformat}
> 2017-12-08 22:40:36,134 INFO [LocalJobRunner Map Task Executor #0]
> mapred.LocalJobRunner: Finishing task: attempt_local936234315_0001_m_03_0
> 2017-12-08 22:40:36,134 INFO [Thread-23] mapred.LocalJobRunner: map task
> executor complete.
> 2017-12-08 22:40:36,147 WARN [Thread-23] mapred.LocalJobRunner:
> job_local936234315_0001
> java.lang.NoClassDefFoundError: org/apache/http/client/methods/HttpUriRequest
> at
> org.apache.hadoop.mapred.LocalJobRunner$Job.run(LocalJobRunner.java:546)
> Caused by: java.lang.ClassNotFoundException:
> org.apache.http.client.methods.HttpUriRequest
> at java.net.URLClassLoader.findClass(URLClassLoader.java:381)
> at java.lang.ClassLoader.loadClass(ClassLoader.java:424)
> at sun.misc.Launcher$AppClassLoader.loadClass(Launcher.java:335)
> at java.lang.ClassLoader.loadClass(ClassLoader.java:357)
> ... 1 more
> Exception in thread "Thread-23" java.lang.NoClassDefFoundError:
> org/apache/http/client/methods/HttpUriRequest
> at
> org.apache.hadoop.mapred.LocalJobRunner$Job.run(LocalJobRunner.java:562)
> Caused by: java.lang.ClassNotFoundException:
> org.apache.http.client.methods.HttpUriRequest
> at java.net.URLClassLoader.findClass(URLClassLoader.java:381)
> at java.lang.ClassLoader.loadClass(ClassLoader.java:424)
> at sun.misc.Launcher$AppClassLoader.loadClass(Launcher.java:335)
> at java.lang.ClassLoader.loadClass(ClassLoader.java:357)
> ... 1 more
> 2017-12-08 22:40:37,078 INFO [main] mapreduce.Job: Job
> job_local936234315_0001 failed with state FAILED due to: NA
> {noformat}
--
This message was sent by Atlassian JIRA
(v6.4.14#64029)
[jira] [Commented] (HBASE-19464) Replace StringBuffer with StringBuilder for hbase-common
[
https://issues.apache.org/jira/browse/HBASE-19464?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16284438#comment-16284438
]
Hadoop QA commented on HBASE-19464:
---
| (x) *{color:red}-1 overall{color}* |
\\
\\
|| Vote || Subsystem || Runtime || Comment ||
| {color:blue}0{color} | {color:blue} reexec {color} | {color:blue} 0m
8s{color} | {color:blue} Docker mode activated. {color} |
|| || || || {color:brown} Prechecks {color} ||
| {color:blue}0{color} | {color:blue} findbugs {color} | {color:blue} 0m
0s{color} | {color:blue} Findbugs executables are not available. {color} |
| {color:green}+1{color} | {color:green} hbaseanti {color} | {color:green} 0m
0s{color} | {color:green} Patch does not have any anti-patterns. {color} |
| {color:green}+1{color} | {color:green} @author {color} | {color:green} 0m
0s{color} | {color:green} The patch does not contain any @author tags. {color} |
| {color:red}-1{color} | {color:red} test4tests {color} | {color:red} 0m
0s{color} | {color:red} The patch doesn't appear to include any new or modified
tests. Please justify why no new tests are needed for this patch. Also please
list what manual steps were performed to verify this patch. {color} |
|| || || || {color:brown} master Compile Tests {color} ||
| {color:green}+1{color} | {color:green} mvninstall {color} | {color:green} 4m
43s{color} | {color:green} master passed {color} |
| {color:green}+1{color} | {color:green} compile {color} | {color:green} 0m
18s{color} | {color:green} master passed {color} |
| {color:green}+1{color} | {color:green} checkstyle {color} | {color:green} 0m
23s{color} | {color:green} master passed {color} |
| {color:green}+1{color} | {color:green} shadedjars {color} | {color:green} 4m
58s{color} | {color:green} branch has no errors when building our shaded
downstream artifacts. {color} |
| {color:green}+1{color} | {color:green} javadoc {color} | {color:green} 0m
16s{color} | {color:green} master passed {color} |
|| || || || {color:brown} Patch Compile Tests {color} ||
| {color:green}+1{color} | {color:green} mvninstall {color} | {color:green} 4m
54s{color} | {color:green} the patch passed {color} |
| {color:green}+1{color} | {color:green} compile {color} | {color:green} 0m
17s{color} | {color:green} the patch passed {color} |
| {color:green}+1{color} | {color:green} javac {color} | {color:green} 0m
17s{color} | {color:green} the patch passed {color} |
| {color:green}+1{color} | {color:green} checkstyle {color} | {color:green} 0m
26s{color} | {color:green} the patch passed {color} |
| {color:green}+1{color} | {color:green} whitespace {color} | {color:green} 0m
0s{color} | {color:green} The patch has no whitespace issues. {color} |
| {color:green}+1{color} | {color:green} shadedjars {color} | {color:green} 4m
33s{color} | {color:green} patch has no errors when building our shaded
downstream artifacts. {color} |
| {color:green}+1{color} | {color:green} hadoopcheck {color} | {color:green}
53m 45s{color} | {color:green} Patch does not cause any errors with Hadoop
2.6.1 2.6.2 2.6.3 2.6.4 2.6.5 2.7.1 2.7.2 2.7.3 2.7.4 or 3.0.0-alpha4. {color} |
| {color:green}+1{color} | {color:green} javadoc {color} | {color:green} 0m
18s{color} | {color:green} the patch passed {color} |
|| || || || {color:brown} Other Tests {color} ||
| {color:green}+1{color} | {color:green} unit {color} | {color:green} 2m
13s{color} | {color:green} hbase-common in the patch passed. {color} |
| {color:green}+1{color} | {color:green} asflicense {color} | {color:green} 0m
8s{color} | {color:green} The patch does not generate ASF License warnings.
{color} |
| {color:black}{color} | {color:black} {color} | {color:black} 72m 35s{color} |
{color:black} {color} |
\\
\\
|| Subsystem || Report/Notes ||
| Docker | Client=17.05.0-ce Server=17.05.0-ce Image:yetus/hbase:eee3b01 |
| JIRA Issue | HBASE-19464 |
| JIRA Patch URL |
https://issues.apache.org/jira/secure/attachment/12901317/HBASE-19464.1.patch |
| Optional Tests | asflicense javac javadoc unit findbugs shadedjars
hadoopcheck hbaseanti checkstyle compile |
| uname | Linux 2b9285b43b4b 3.13.0-129-generic #178-Ubuntu SMP Fri Aug 11
12:48:20 UTC 2017 x86_64 GNU/Linux |
| Build tool | maven |
| Personality |
/home/jenkins/jenkins-slave/workspace/PreCommit-HBASE-Build/component/dev-support/hbase-personality.sh
|
| git revision | master / 07b193ae4f |
| maven | version: Apache Maven 3.5.2
(138edd61fd100ec658bfa2d307c43b76940a5d7d; 2017-10-18T07:58:13Z) |
| Default Java | 1.8.0_151 |
| Test Results |
https://builds.apache.org/job/PreCommit-HBASE-Build/10309/testReport/ |
| modules | C: hbase-common U: hbase-common |
| Console output |
https://builds.apache.org/job/PreCommit-HBASE-Build/10309/console |
| Powered by | Apache Yetus 0.6.0 http://yetus.apache.org |
This message was automatically generated.
> Replace StringBuffer with StringBuilder for hbase-common
[jira] [Updated] (HBASE-19420) Backport HBASE-19152 (Update refguide 'how to build an RC' and the make_rc.sh script) to branch-1
[ https://issues.apache.org/jira/browse/HBASE-19420?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Andrew Purtell updated HBASE-19420: --- Resolution: Fixed Status: Resolved (was: Patch Available) > Backport HBASE-19152 (Update refguide 'how to build an RC' and the make_rc.sh > script) to branch-1 > - > > Key: HBASE-19420 > URL: https://issues.apache.org/jira/browse/HBASE-19420 > Project: HBase > Issue Type: Task >Reporter: Andrew Purtell >Assignee: Andrew Purtell > Fix For: 1.4.0 > > Attachments: HBASE-19420-branch-1.patch > > -- This message was sent by Atlassian JIRA (v6.4.14#64029)
[jira] [Updated] (HBASE-19420) Backport HBASE-19152 (Update refguide 'how to build an RC' and the make_rc.sh script) to branch-1
[ https://issues.apache.org/jira/browse/HBASE-19420?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Andrew Purtell updated HBASE-19420: --- Fix Version/s: (was: 1.5.0) (was: 1.4.1) 1.4.0 > Backport HBASE-19152 (Update refguide 'how to build an RC' and the make_rc.sh > script) to branch-1 > - > > Key: HBASE-19420 > URL: https://issues.apache.org/jira/browse/HBASE-19420 > Project: HBase > Issue Type: Task >Reporter: Andrew Purtell >Assignee: Andrew Purtell > Fix For: 1.4.0 > > Attachments: HBASE-19420-branch-1.patch > > -- This message was sent by Atlassian JIRA (v6.4.14#64029)
[jira] [Updated] (HBASE-19435) Reopen Files for ClosedChannelException in BucketCache
[ https://issues.apache.org/jira/browse/HBASE-19435?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Andrew Purtell updated HBASE-19435: --- Fix Version/s: (was: 1.4.1) 1.4.0 > Reopen Files for ClosedChannelException in BucketCache > -- > > Key: HBASE-19435 > URL: https://issues.apache.org/jira/browse/HBASE-19435 > Project: HBase > Issue Type: Bug > Components: BucketCache >Affects Versions: 2.0.0, 1.3.1 >Reporter: Zach York >Assignee: Zach York > Fix For: 1.4.0, 2.0.0-beta-1 > > Attachments: HBASE-19435.branch-1.001.patch, > HBASE-19435.master.001.patch, HBASE-19435.master.002.patch, > HBASE-19435.master.003.patch, HBASE-19435.master.004.patch, > HBASE-19435.master.005.patch, HBASE-19435.master.006.patch, > HBASE-19435.master.007.patch, HBASE-19435.master.007.patch > > > When using the FileIOEngine for BucketCache, the cache will be disabled if > the connection is interrupted or closed. HBase will then get > ClosedChannelExceptions trying to access the file. After 60s, the RS will > disable the cache. This causes severe read performance degradation for > workloads that rely on this cache. FileIOEngine never tries to reopen the > connection. This JIRA is to reopen files when the BucketCache encounters a > ClosedChannelException. -- This message was sent by Atlassian JIRA (v6.4.14#64029)
[jira] [Updated] (HBASE-19422) using hadoop-profile property leads to confusing failures
[
https://issues.apache.org/jira/browse/HBASE-19422?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Andrew Purtell updated HBASE-19422:
---
Fix Version/s: (was: 1.5.0)
(was: 1.4.1)
1.4.0
> using hadoop-profile property leads to confusing failures
> -
>
> Key: HBASE-19422
> URL: https://issues.apache.org/jira/browse/HBASE-19422
> Project: HBase
> Issue Type: Bug
>Reporter: Ted Yu
>Assignee: Mike Drob
> Fix For: 1.4.0, 1.3.2, 1.2.7, 2.0.0-beta-1, 1.1.13
>
> Attachments: 19422.v1.txt, HBASE-19422.patch
>
>
> When building master branch against hadoop 3 beta1,
> {code}
> mvn clean install -Dhadoop-profile=3.0 -Dhadoop-three.version=3.0.0-beta1
> -Dhadoop-two.version=3.0.0-beta1 -DskipTests
> {code}
> I got:
> {code}
> [WARNING] Rule 0: org.apache.maven.plugins.enforcer.BannedDependencies failed
> with message:
> We don't allow the JSR305 jar from the Findbugs project, see HBASE-16321.
> Found Banned Dependency: com.google.code.findbugs:jsr305:jar:1.3.9
> {code}
> Here is part of the dependency tree showing the dependency:
> {code}
> [INFO] org.apache.hbase:hbase-client:jar:3.0.0-SNAPSHOT
> ...
> [INFO] +- org.apache.hadoop:hadoop-auth:jar:3.0.0-beta1:compile
> ...
> [INFO] | \- com.google.guava:guava:jar:11.0.2:compile
> [INFO] | \- com.google.code.findbugs:jsr305:jar:1.3.9:compile
> {code}
> We need to exclude jsr305 so that build succeed.
--
This message was sent by Atlassian JIRA
(v6.4.14#64029)
[jira] [Commented] (HBASE-19371) Running WALPerformanceEvaluation against asyncfswal throws exceptions
[
https://issues.apache.org/jira/browse/HBASE-19371?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16284411#comment-16284411
]
stack commented on HBASE-19371:
---
Switch up on to hadoop 2.8.2 again. This time I get this:
{code}
2017-12-08 15:18:16,720 DEBUG [main]
asyncfs.FanOutOneBlockAsyncDFSOutputHelper: ClientProtocol::create wrong number
of arguments, should be hadoop 2.x
2017-12-08 15:18:16,747 INFO [main] util.FSHDFSUtils: Recover lease on dfs
file /user/stack/logs/WALs/wals/wals.1512775096639
2017-12-08 15:18:16,759 INFO [main] util.FSHDFSUtils: Recovered lease,
attempt=0 on file=/user/stack/logs/WALs/wals/wals.1512775096639 after 10ms
2017-12-08 15:18:16,759 INFO [main] hbase.MockRegionServerServices: Shutting
down due to request 'test clean up.'
2017-12-08 15:18:16,759 INFO [main] wal.WALPerformanceEvaluation: shutting
down log roller.
2017-12-08 15:18:16,759 INFO [WALPerfEval.logRoller] regionserver.LogRoller:
LogRoller exiting.
Exception in thread "main" java.lang.NoSuchMethodError:
org.apache.hadoop.hdfs.DFSClient.getConf()Lorg/apache/hadoop/hdfs/DFSClient$Conf;
at
org.apache.hadoop.hbase.io.asyncfs.FanOutOneBlockAsyncDFSOutputHelper.createChecksum(FanOutOneBlockAsyncDFSOutputHelper.java:569)
at
org.apache.hadoop.hbase.io.asyncfs.FanOutOneBlockAsyncDFSOutputHelper.createOutput(FanOutOneBlockAsyncDFSOutputHelper.java:762)
at
org.apache.hadoop.hbase.io.asyncfs.FanOutOneBlockAsyncDFSOutputHelper.access$400(FanOutOneBlockAsyncDFSOutputHelper.java:118)
at
org.apache.hadoop.hbase.io.asyncfs.FanOutOneBlockAsyncDFSOutputHelper$16.doCall(FanOutOneBlockAsyncDFSOutputHelper.java:812)
at
org.apache.hadoop.hbase.io.asyncfs.FanOutOneBlockAsyncDFSOutputHelper$16.doCall(FanOutOneBlockAsyncDFSOutputHelper.java:807)
at
org.apache.hadoop.fs.FileSystemLinkResolver.resolve(FileSystemLinkResolver.java:81)
at
org.apache.hadoop.hbase.io.asyncfs.FanOutOneBlockAsyncDFSOutputHelper.createOutput(FanOutOneBlockAsyncDFSOutputHelper.java:820)
at
org.apache.hadoop.hbase.io.asyncfs.AsyncFSOutputHelper.createOutput(AsyncFSOutputHelper.java:62)
at
org.apache.hadoop.hbase.regionserver.wal.AsyncProtobufLogWriter.initOutput(AsyncProtobufLogWriter.java:158)
at
org.apache.hadoop.hbase.regionserver.wal.AbstractProtobufLogWriter.init(AbstractProtobufLogWriter.java:167)
at
org.apache.hadoop.hbase.wal.AsyncFSWALProvider.createAsyncWriter(AsyncFSWALProvider.java:100)
at
org.apache.hadoop.hbase.regionserver.wal.AsyncFSWAL.createWriterInstance(AsyncFSWAL.java:621)
at
org.apache.hadoop.hbase.regionserver.wal.AsyncFSWAL.createWriterInstance(AsyncFSWAL.java:131)
at
org.apache.hadoop.hbase.regionserver.wal.AbstractFSWAL.rollWriter(AbstractFSWAL.java:751)
at
org.apache.hadoop.hbase.regionserver.wal.AbstractFSWAL.rollWriter(AbstractFSWAL.java:489)
at
org.apache.hadoop.hbase.regionserver.wal.AsyncFSWAL.(AsyncFSWAL.java:257)
at
org.apache.hadoop.hbase.wal.AsyncFSWALProvider.createWAL(AsyncFSWALProvider.java:70)
at
org.apache.hadoop.hbase.wal.AsyncFSWALProvider.createWAL(AsyncFSWALProvider.java:45)
at
org.apache.hadoop.hbase.wal.AbstractFSWALProvider.getWAL(AbstractFSWALProvider.java:139)
at
org.apache.hadoop.hbase.wal.AbstractFSWALProvider.getWAL(AbstractFSWALProvider.java:55)
at org.apache.hadoop.hbase.wal.WALFactory.getWAL(WALFactory.java:244)
at
org.apache.hadoop.hbase.wal.WALPerformanceEvaluation.openRegion(WALPerformanceEvaluation.java:502)
at
org.apache.hadoop.hbase.wal.WALPerformanceEvaluation.run(WALPerformanceEvaluation.java:336)
at org.apache.hadoop.util.ToolRunner.run(ToolRunner.java:76)
at
org.apache.hadoop.hbase.wal.WALPerformanceEvaluation.innerMain(WALPerformanceEvaluation.java:597)
at
org.apache.hadoop.hbase.wal.WALPerformanceEvaluation.main(WALPerformanceEvaluation.java:601)
{code}
We are trying hadoop3 and then hadoop2 create Client method. Looks like we need
a 2.8 version? I can work on it if get confirmation. Thanks [~Apache9]
> Running WALPerformanceEvaluation against asyncfswal throws exceptions
> -
>
> Key: HBASE-19371
> URL: https://issues.apache.org/jira/browse/HBASE-19371
> Project: HBase
> Issue Type: Bug
>Reporter: stack
> Fix For: 2.0.0-beta-1
>
>
> Was trying to do a perf eval on asyncfswal. I ran w/ these args:
> Performance counter stats for '/home/stack/hbase/bin/hbase --config
> /home/stack/conf_hbase org.apache.hadoop.hbase.wal.WALPerformanceEvaluation
> -path /user/stack/logs/ -verify -threads 25 -iterations 100 -keySize 50
> -valueSize 100 -syncInterval 10':
> The verify fails on all runs:
> Exception in thread "main" java.lang.IllegalStateException: Counted=12390228,
> expected=2500
> at
> org.apache.hadoop.hbase.wal.WALPerformanceEvaluation.run(WALPerformanceEvaluation.java:368)
>
[jira] [Comment Edited] (HBASE-19468) FNFE during scans and flushes
[ https://issues.apache.org/jira/browse/HBASE-19468?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16284398#comment-16284398 ] Andrew Purtell edited comment on HBASE-19468 at 12/8/17 11:21 PM: -- A FNFE during scan is not a minor issue. Upgraded to Critical. [~mantonov] [~stack] [~lhofhansl] was (Author: apurtell): A FNFE during scan is not a minor issue. Upgraded to Critical. [~mantonov] [~stack] > FNFE during scans and flushes > - > > Key: HBASE-19468 > URL: https://issues.apache.org/jira/browse/HBASE-19468 > Project: HBase > Issue Type: Sub-task > Components: regionserver, Scanners >Affects Versions: 1.3.1 >Reporter: Thiruvel Thirumoolan >Priority: Critical > Fix For: 2.0.0, 1.4.1, 1.5.0, 1.3.3 > > > We see FNFE exceptions on our 1.3 clusters when scans and flushes happen at > the same time. This causes regionserver to throw a UnknownScannerException > and client retries. > This happens during the following sequence: > 1. Scanner open, client fetched some rows from regionserver and working on it > 2. Flush happens and storeScanner is updated with flushed files > (StoreScanner.updateReaders()) > 3. Compaction discharger runs and cleans up the newly flushed file as we > don't have new scanners on it yet. > 4. Client issues scan.next and during StoreScanner.resetScannerStack(), we > get a FNFE. RegionServer throws a UnknownScannerThe client retries in 1.3. > With branch-1.4, the scan fails with a DoNotRetryIOException. > [~ram_krish], My proposal is to increment the reader count during > updateReaders() and decrement it during resetScannerStack(), so discharger > doesn't clean it up. Scan lease expiries also have to be taken care of. Am I > missing anything? Is there a better approach? -- This message was sent by Atlassian JIRA (v6.4.14#64029)
[jira] [Commented] (HBASE-19468) FNFE during scans and flushes
[ https://issues.apache.org/jira/browse/HBASE-19468?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16284398#comment-16284398 ] Andrew Purtell commented on HBASE-19468: A FNFE during scan is not a minor issue. Upgraded to Critical. [~mantonov] [~stack] > FNFE during scans and flushes > - > > Key: HBASE-19468 > URL: https://issues.apache.org/jira/browse/HBASE-19468 > Project: HBase > Issue Type: Sub-task > Components: regionserver, Scanners >Affects Versions: 1.3.1 >Reporter: Thiruvel Thirumoolan >Priority: Critical > Fix For: 2.0.0, 1.4.1, 1.5.0, 1.3.3 > > > We see FNFE exceptions on our 1.3 clusters when scans and flushes happen at > the same time. This causes regionserver to throw a UnknownScannerException > and client retries. > This happens during the following sequence: > 1. Scanner open, client fetched some rows from regionserver and working on it > 2. Flush happens and storeScanner is updated with flushed files > (StoreScanner.updateReaders()) > 3. Compaction discharger runs and cleans up the newly flushed file as we > don't have new scanners on it yet. > 4. Client issues scan.next and during StoreScanner.resetScannerStack(), we > get a FNFE. RegionServer throws a UnknownScannerThe client retries in 1.3. > With branch-1.4, the scan fails with a DoNotRetryIOException. > [~ram_krish], My proposal is to increment the reader count during > updateReaders() and decrement it during resetScannerStack(), so discharger > doesn't clean it up. Scan lease expiries also have to be taken care of. Am I > missing anything? Is there a better approach? -- This message was sent by Atlassian JIRA (v6.4.14#64029)
[jira] [Updated] (HBASE-19468) FNFE during scans and flushes
[ https://issues.apache.org/jira/browse/HBASE-19468?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Andrew Purtell updated HBASE-19468: --- Priority: Critical (was: Minor) Fix Version/s: 1.5.0 1.4.1 > FNFE during scans and flushes > - > > Key: HBASE-19468 > URL: https://issues.apache.org/jira/browse/HBASE-19468 > Project: HBase > Issue Type: Sub-task > Components: regionserver, Scanners >Affects Versions: 1.3.1 >Reporter: Thiruvel Thirumoolan >Priority: Critical > Fix For: 2.0.0, 1.4.1, 1.5.0, 1.3.3 > > > We see FNFE exceptions on our 1.3 clusters when scans and flushes happen at > the same time. This causes regionserver to throw a UnknownScannerException > and client retries. > This happens during the following sequence: > 1. Scanner open, client fetched some rows from regionserver and working on it > 2. Flush happens and storeScanner is updated with flushed files > (StoreScanner.updateReaders()) > 3. Compaction discharger runs and cleans up the newly flushed file as we > don't have new scanners on it yet. > 4. Client issues scan.next and during StoreScanner.resetScannerStack(), we > get a FNFE. RegionServer throws a UnknownScannerThe client retries in 1.3. > With branch-1.4, the scan fails with a DoNotRetryIOException. > [~ram_krish], My proposal is to increment the reader count during > updateReaders() and decrement it during resetScannerStack(), so discharger > doesn't clean it up. Scan lease expiries also have to be taken care of. Am I > missing anything? Is there a better approach? -- This message was sent by Atlassian JIRA (v6.4.14#64029)
[jira] [Resolved] (HBASE-19467) rsgroups shell commands don't properly display elapsed time
[ https://issues.apache.org/jira/browse/HBASE-19467?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Andrew Purtell resolved HBASE-19467. Resolution: Fixed Pushed trivial changes to branch-1.4 and branch-1 after manual verification. > rsgroups shell commands don't properly display elapsed time > --- > > Key: HBASE-19467 > URL: https://issues.apache.org/jira/browse/HBASE-19467 > Project: HBase > Issue Type: Bug >Affects Versions: 1.4.0 >Reporter: Andrew Purtell >Assignee: Andrew Purtell >Priority: Trivial > Fix For: 1.4.0 > > Attachments: HBASE-19467-branch-1.patch > > > hbase(main):001:0> list_rsgroups > GROUPS > default > 1 row(s) in 1512748253.9920 seconds > hbase(main):002:0> add_rsgroup 'my_group' > hbase(main):003:0> list_rsgroups > GROUPS > default > my_group > 2 row(s) in 1512748276.9400 seconds -- This message was sent by Atlassian JIRA (v6.4.14#64029)
[jira] [Updated] (HBASE-19134) Make WALKey an Interface; expose Read-Only version to CPs
[ https://issues.apache.org/jira/browse/HBASE-19134?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] stack updated HBASE-19134: -- Resolution: Fixed Hadoop Flags: Reviewed Release Note: Made WALKey an Interface and added a WALKeyImpl implementation. WALKey comes through to Coprocessors. WALKey is read-only. Status: Resolved (was: Patch Available) Pushed to branch-2 and master. Thanks for review [~anoop.hbase] > Make WALKey an Interface; expose Read-Only version to CPs > - > > Key: HBASE-19134 > URL: https://issues.apache.org/jira/browse/HBASE-19134 > Project: HBase > Issue Type: Bug > Components: Coprocessors, wal >Reporter: stack >Assignee: stack > Fix For: 2.0.0-beta-1 > > Attachments: HBASE-19134.master.001.patch, > HBASE-19134.master.002.patch, HBASE-19134.master.003.patch, > HBASE-19134.master.004.patch, HBASE-19134.master.005.patch > > > WALKey has been made IA.Private in hbase2. Even so, given we don't have an > alternative to expose at this time, it is exposed to coprocessors still at a > few (now deprecated) locations. > In review of HBASE-18770, [~chia7712] makes reasonable suggestion that what > we expose to CPs be a read-only WALKey. He gets pushback on doing this for > hbase2 (Do we even want to expose WALKey to CPs, is WALKey right going > forward, etc.). Chia-Ping comes back w/ the below (copied from HBASE-18770): > What we want to fix for WALKey are shown below. > * expose some methods to CP user safety > * refactor/redo > As I see it, adding an interface exposed to CP user for WALKey is a right > choice because it can bring some benefit. > * We can expose part of WALKey's methods to CP users - a read-only interface > or an interface with some modifiable setting. > * The related CP hooks won't be deprecated > * Doing the refactor for WALKey doesn't essentially impact the CP hook after > 2.0 release. > Although, it will be better to redo WALKey before 2.0 release. In short, I > think it warrants such an interface. > (We both agree this would be a load of work given WALKey is written to > HFiles. Warrants a look though). -- This message was sent by Atlassian JIRA (v6.4.14#64029)
[jira] [Comment Edited] (HBASE-19467) rsgroups shell commands don't properly display elapsed time
[
https://issues.apache.org/jira/browse/HBASE-19467?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16284390#comment-16284390
]
Andrew Purtell edited comment on HBASE-19467 at 12/8/17 11:13 PM:
--
Manually verified change:
{noformat}
$ ./bin/hbase shell
HBase Shell
Use "help" to get list of supported commands.
Use "exit" to quit this interactive shell.
Version 1.4.0, r8a8082375e6dd4a2387c8b4c8e9f777eccd5edd6, Fri Dec 8 15:07:44
PST 2017
hbase(main):001:0> list_rsgroups
GROUPS
default
1 row(s) in 0.1470 seconds
hbase(main):002:0> get_rsgroup 'default'
GROUP INFORMATION
Servers:
apurtell-ltm4.internal.salesforce.com:57021
Tables:
hbase:meta
hbase:acl
hbase:namespace
hbase:rsgroup
1 row(s) in 0.0190 seconds
hbase(main):003:0> get_server_rsgroup 'localhost:57021'
default
1 row(s) in 0.0160 seconds
hbase(main):004:0> get_table_rsgroup 'hbase:meta'
default
1 row(s) in 0.0090 seconds
{noformat}
was (Author: apurtell):
Manually verified change:
{noformat}
$ ./bin/hbase shell
HBase Shell
Use "help" to get list of supported commands.
Use "exit" to quit this interactive shell.
Version 1.4.0, r8a8082375e6dd4a2387c8b4c8e9f777eccd5edd6, Fri Dec 8 15:07:44
PST 2017
hbase(main):001:0> list_rsgroups
GROUPS
default
1 row(s) in 0.1470 seconds
hbase(main):002:0> get_rsgroup 'default'
GROUP INFORMATION
Servers:
apurtell-ltm4.internal.salesforce.com:57021
Tables:
hbase:meta
hbase:acl
hbase:namespace
hbase:rsgroup
1 row(s) in 0.0190 seconds
{noformat}
> rsgroups shell commands don't properly display elapsed time
> ---
>
> Key: HBASE-19467
> URL: https://issues.apache.org/jira/browse/HBASE-19467
> Project: HBase
> Issue Type: Bug
>Affects Versions: 1.4.0
>Reporter: Andrew Purtell
>Assignee: Andrew Purtell
>Priority: Trivial
> Fix For: 1.4.0
>
> Attachments: HBASE-19467-branch-1.patch
>
>
> hbase(main):001:0> list_rsgroups
> GROUPS
> default
> 1 row(s) in 1512748253.9920 seconds
> hbase(main):002:0> add_rsgroup 'my_group'
> hbase(main):003:0> list_rsgroups
> GROUPS
> default
> my_group
> 2 row(s) in 1512748276.9400 seconds
--
This message was sent by Atlassian JIRA
(v6.4.14#64029)
[jira] [Commented] (HBASE-19467) rsgroups shell commands don't properly display elapsed time
[
https://issues.apache.org/jira/browse/HBASE-19467?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16284390#comment-16284390
]
Andrew Purtell commented on HBASE-19467:
Manually verified change:
{noformat}
$ ./bin/hbase shell
HBase Shell
Use "help" to get list of supported commands.
Use "exit" to quit this interactive shell.
Version 1.4.0, r8a8082375e6dd4a2387c8b4c8e9f777eccd5edd6, Fri Dec 8 15:07:44
PST 2017
hbase(main):001:0> list_rsgroups
GROUPS
default
1 row(s) in 0.1470 seconds
hbase(main):002:0> get_rsgroup 'default'
GROUP INFORMATION
Servers:
apurtell-ltm4.internal.salesforce.com:57021
Tables:
hbase:meta
hbase:acl
hbase:namespace
hbase:rsgroup
1 row(s) in 0.0190 seconds
{noformat}
> rsgroups shell commands don't properly display elapsed time
> ---
>
> Key: HBASE-19467
> URL: https://issues.apache.org/jira/browse/HBASE-19467
> Project: HBase
> Issue Type: Bug
>Affects Versions: 1.4.0
>Reporter: Andrew Purtell
>Assignee: Andrew Purtell
>Priority: Trivial
> Fix For: 1.4.0
>
> Attachments: HBASE-19467-branch-1.patch
>
>
> hbase(main):001:0> list_rsgroups
> GROUPS
> default
> 1 row(s) in 1512748253.9920 seconds
> hbase(main):002:0> add_rsgroup 'my_group'
> hbase(main):003:0> list_rsgroups
> GROUPS
> default
> my_group
> 2 row(s) in 1512748276.9400 seconds
--
This message was sent by Atlassian JIRA
(v6.4.14#64029)
[jira] [Updated] (HBASE-19461) TestRSGroups is broke
[ https://issues.apache.org/jira/browse/HBASE-19461?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] stack updated HBASE-19461: -- Resolution: Fixed Hadoop Flags: Reviewed Status: Resolved (was: Patch Available) Pushed to master and branch-2. Wouldn't go back to branch-1. > TestRSGroups is broke > - > > Key: HBASE-19461 > URL: https://issues.apache.org/jira/browse/HBASE-19461 > Project: HBase > Issue Type: Bug > Components: test >Reporter: stack >Assignee: stack > Fix For: 2.0.0-beta-1 > > Attachments: HBASE-19461.master.001.patch > > > I noticed this. Tried bisect'ing but nought definitive at mo. I see > testDefaultNamespaceCreateAndAssign failing most of the time. The crazy > getTable parse in RegionInfo gets a negative offset because the passed in > region name is nonsense. -- This message was sent by Atlassian JIRA (v6.4.14#64029)
[jira] [Commented] (HBASE-19465) Required httpcore and httpclient jars not included in binary distribution
[
https://issues.apache.org/jira/browse/HBASE-19465?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16284383#comment-16284383
]
Andrew Purtell commented on HBASE-19465:
[~mdrob] Not applicable to branch-1, which does not have a hadoop-mapreduce
module. Feel free to file a followup for branch-2 and up.
> Required httpcore and httpclient jars not included in binary distribution
> -
>
> Key: HBASE-19465
> URL: https://issues.apache.org/jira/browse/HBASE-19465
> Project: HBase
> Issue Type: Bug
>Affects Versions: 1.4.0
>Reporter: Andrew Purtell
>Assignee: Andrew Purtell
>Priority: Blocker
> Fix For: 1.4.0
>
> Attachments: HBASE-19465-branch-1.patch
>
>
> The httpcore and httpclient dependency jars are not included into the binary
> distribution. This means MR/YARN jobs will fail if launched from the binary
> tarball as distributed, including those running in "local mode", e.g. ITBLL:
> {noformat}
> 2017-12-08 22:40:36,134 INFO [LocalJobRunner Map Task Executor #0]
> mapred.LocalJobRunner: Finishing task: attempt_local936234315_0001_m_03_0
> 2017-12-08 22:40:36,134 INFO [Thread-23] mapred.LocalJobRunner: map task
> executor complete.
> 2017-12-08 22:40:36,147 WARN [Thread-23] mapred.LocalJobRunner:
> job_local936234315_0001
> java.lang.NoClassDefFoundError: org/apache/http/client/methods/HttpUriRequest
> at
> org.apache.hadoop.mapred.LocalJobRunner$Job.run(LocalJobRunner.java:546)
> Caused by: java.lang.ClassNotFoundException:
> org.apache.http.client.methods.HttpUriRequest
> at java.net.URLClassLoader.findClass(URLClassLoader.java:381)
> at java.lang.ClassLoader.loadClass(ClassLoader.java:424)
> at sun.misc.Launcher$AppClassLoader.loadClass(Launcher.java:335)
> at java.lang.ClassLoader.loadClass(ClassLoader.java:357)
> ... 1 more
> Exception in thread "Thread-23" java.lang.NoClassDefFoundError:
> org/apache/http/client/methods/HttpUriRequest
> at
> org.apache.hadoop.mapred.LocalJobRunner$Job.run(LocalJobRunner.java:562)
> Caused by: java.lang.ClassNotFoundException:
> org.apache.http.client.methods.HttpUriRequest
> at java.net.URLClassLoader.findClass(URLClassLoader.java:381)
> at java.lang.ClassLoader.loadClass(ClassLoader.java:424)
> at sun.misc.Launcher$AppClassLoader.loadClass(Launcher.java:335)
> at java.lang.ClassLoader.loadClass(ClassLoader.java:357)
> ... 1 more
> 2017-12-08 22:40:37,078 INFO [main] mapreduce.Job: Job
> job_local936234315_0001 failed with state FAILED due to: NA
> {noformat}
--
This message was sent by Atlassian JIRA
(v6.4.14#64029)
[jira] [Updated] (HBASE-19467) rsgroups shell commands don't properly display elapsed time
[ https://issues.apache.org/jira/browse/HBASE-19467?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Andrew Purtell updated HBASE-19467: --- Priority: Trivial (was: Minor) > rsgroups shell commands don't properly display elapsed time > --- > > Key: HBASE-19467 > URL: https://issues.apache.org/jira/browse/HBASE-19467 > Project: HBase > Issue Type: Bug >Affects Versions: 1.4.0 >Reporter: Andrew Purtell >Assignee: Andrew Purtell >Priority: Trivial > Fix For: 1.4.0 > > Attachments: HBASE-19467-branch-1.patch > > > hbase(main):001:0> list_rsgroups > GROUPS > default > 1 row(s) in 1512748253.9920 seconds > hbase(main):002:0> add_rsgroup 'my_group' > hbase(main):003:0> list_rsgroups > GROUPS > default > my_group > 2 row(s) in 1512748276.9400 seconds -- This message was sent by Atlassian JIRA (v6.4.14#64029)
[jira] [Updated] (HBASE-19467) rsgroups shell commands don't properly display elapsed time
[ https://issues.apache.org/jira/browse/HBASE-19467?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Andrew Purtell updated HBASE-19467: --- Attachment: HBASE-19467-branch-1.patch > rsgroups shell commands don't properly display elapsed time > --- > > Key: HBASE-19467 > URL: https://issues.apache.org/jira/browse/HBASE-19467 > Project: HBase > Issue Type: Bug >Affects Versions: 1.4.0 >Reporter: Andrew Purtell >Assignee: Andrew Purtell >Priority: Minor > Fix For: 1.4.0 > > Attachments: HBASE-19467-branch-1.patch > > > hbase(main):001:0> list_rsgroups > GROUPS > default > 1 row(s) in 1512748253.9920 seconds > hbase(main):002:0> add_rsgroup 'my_group' > hbase(main):003:0> list_rsgroups > GROUPS > default > my_group > 2 row(s) in 1512748276.9400 seconds -- This message was sent by Atlassian JIRA (v6.4.14#64029)
[jira] [Created] (HBASE-19468) FNFE during scans and flushes
Thiruvel Thirumoolan created HBASE-19468: Summary: FNFE during scans and flushes Key: HBASE-19468 URL: https://issues.apache.org/jira/browse/HBASE-19468 Project: HBase Issue Type: Sub-task Affects Versions: 1.3.1 Reporter: Thiruvel Thirumoolan Priority: Minor We see FNFE exceptions on our 1.3 clusters when scans and flushes happen at the same time. This causes regionserver to throw a UnknownScannerException and client retries. This happens during the following sequence: 1. Scanner open, client fetched some rows from regionserver and working on it 2. Flush happens and storeScanner is updated with flushed files (StoreScanner.updateReaders()) 3. Compaction discharger runs and cleans up the newly flushed file as we don't have new scanners on it yet. 4. Client issues scan.next and during StoreScanner.resetScannerStack(), we get a FNFE. RegionServer throws a UnknownScannerThe client retries in 1.3. With branch-1.4, the scan fails with a DoNotRetryIOException. [~ram_krish], My proposal is to increment the reader count during updateReaders() and decrement it during resetScannerStack(), so discharger doesn't clean it up. Scan lease expiries also have to be taken care of. Am I missing anything? Is there a better approach? -- This message was sent by Atlassian JIRA (v6.4.14#64029)
[jira] [Commented] (HBASE-19465) Required httpcore and httpclient jars not included in binary distribution
[
https://issues.apache.org/jira/browse/HBASE-19465?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16284375#comment-16284375
]
Mike Drob commented on HBASE-19465:
---
Should we be including them in the hbase-mapreduce module in compile scope and
leave test scope in hbase-server? That feels like the more correct place to
declare them.
> Required httpcore and httpclient jars not included in binary distribution
> -
>
> Key: HBASE-19465
> URL: https://issues.apache.org/jira/browse/HBASE-19465
> Project: HBase
> Issue Type: Bug
>Affects Versions: 1.4.0
>Reporter: Andrew Purtell
>Assignee: Andrew Purtell
>Priority: Blocker
> Fix For: 1.4.0
>
> Attachments: HBASE-19465-branch-1.patch
>
>
> The httpcore and httpclient dependency jars are not included into the binary
> distribution. This means MR/YARN jobs will fail if launched from the binary
> tarball as distributed, including those running in "local mode", e.g. ITBLL:
> {noformat}
> 2017-12-08 22:40:36,134 INFO [LocalJobRunner Map Task Executor #0]
> mapred.LocalJobRunner: Finishing task: attempt_local936234315_0001_m_03_0
> 2017-12-08 22:40:36,134 INFO [Thread-23] mapred.LocalJobRunner: map task
> executor complete.
> 2017-12-08 22:40:36,147 WARN [Thread-23] mapred.LocalJobRunner:
> job_local936234315_0001
> java.lang.NoClassDefFoundError: org/apache/http/client/methods/HttpUriRequest
> at
> org.apache.hadoop.mapred.LocalJobRunner$Job.run(LocalJobRunner.java:546)
> Caused by: java.lang.ClassNotFoundException:
> org.apache.http.client.methods.HttpUriRequest
> at java.net.URLClassLoader.findClass(URLClassLoader.java:381)
> at java.lang.ClassLoader.loadClass(ClassLoader.java:424)
> at sun.misc.Launcher$AppClassLoader.loadClass(Launcher.java:335)
> at java.lang.ClassLoader.loadClass(ClassLoader.java:357)
> ... 1 more
> Exception in thread "Thread-23" java.lang.NoClassDefFoundError:
> org/apache/http/client/methods/HttpUriRequest
> at
> org.apache.hadoop.mapred.LocalJobRunner$Job.run(LocalJobRunner.java:562)
> Caused by: java.lang.ClassNotFoundException:
> org.apache.http.client.methods.HttpUriRequest
> at java.net.URLClassLoader.findClass(URLClassLoader.java:381)
> at java.lang.ClassLoader.loadClass(ClassLoader.java:424)
> at sun.misc.Launcher$AppClassLoader.loadClass(Launcher.java:335)
> at java.lang.ClassLoader.loadClass(ClassLoader.java:357)
> ... 1 more
> 2017-12-08 22:40:37,078 INFO [main] mapreduce.Job: Job
> job_local936234315_0001 failed with state FAILED due to: NA
> {noformat}
--
This message was sent by Atlassian JIRA
(v6.4.14#64029)
[jira] [Resolved] (HBASE-19465) Required httpcore and httpclient jars not included in binary distribution
[
https://issues.apache.org/jira/browse/HBASE-19465?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Andrew Purtell resolved HBASE-19465.
Resolution: Fixed
Pushed trivial change to branch-1 and branch-1.4
> Required httpcore and httpclient jars not included in binary distribution
> -
>
> Key: HBASE-19465
> URL: https://issues.apache.org/jira/browse/HBASE-19465
> Project: HBase
> Issue Type: Bug
>Affects Versions: 1.4.0
>Reporter: Andrew Purtell
>Assignee: Andrew Purtell
>Priority: Blocker
> Fix For: 1.4.0
>
> Attachments: HBASE-19465-branch-1.patch
>
>
> The httpcore and httpclient dependency jars are not included into the binary
> distribution. This means MR/YARN jobs will fail if launched from the binary
> tarball as distributed, including those running in "local mode", e.g. ITBLL:
> {noformat}
> 2017-12-08 22:40:36,134 INFO [LocalJobRunner Map Task Executor #0]
> mapred.LocalJobRunner: Finishing task: attempt_local936234315_0001_m_03_0
> 2017-12-08 22:40:36,134 INFO [Thread-23] mapred.LocalJobRunner: map task
> executor complete.
> 2017-12-08 22:40:36,147 WARN [Thread-23] mapred.LocalJobRunner:
> job_local936234315_0001
> java.lang.NoClassDefFoundError: org/apache/http/client/methods/HttpUriRequest
> at
> org.apache.hadoop.mapred.LocalJobRunner$Job.run(LocalJobRunner.java:546)
> Caused by: java.lang.ClassNotFoundException:
> org.apache.http.client.methods.HttpUriRequest
> at java.net.URLClassLoader.findClass(URLClassLoader.java:381)
> at java.lang.ClassLoader.loadClass(ClassLoader.java:424)
> at sun.misc.Launcher$AppClassLoader.loadClass(Launcher.java:335)
> at java.lang.ClassLoader.loadClass(ClassLoader.java:357)
> ... 1 more
> Exception in thread "Thread-23" java.lang.NoClassDefFoundError:
> org/apache/http/client/methods/HttpUriRequest
> at
> org.apache.hadoop.mapred.LocalJobRunner$Job.run(LocalJobRunner.java:562)
> Caused by: java.lang.ClassNotFoundException:
> org.apache.http.client.methods.HttpUriRequest
> at java.net.URLClassLoader.findClass(URLClassLoader.java:381)
> at java.lang.ClassLoader.loadClass(ClassLoader.java:424)
> at sun.misc.Launcher$AppClassLoader.loadClass(Launcher.java:335)
> at java.lang.ClassLoader.loadClass(ClassLoader.java:357)
> ... 1 more
> 2017-12-08 22:40:37,078 INFO [main] mapreduce.Job: Job
> job_local936234315_0001 failed with state FAILED due to: NA
> {noformat}
--
This message was sent by Atlassian JIRA
(v6.4.14#64029)
[jira] [Commented] (HBASE-16890) Analyze the performance of AsyncWAL and fix the same
[ https://issues.apache.org/jira/browse/HBASE-16890?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16284373#comment-16284373 ] stack commented on HBASE-16890: --- That was better. ||workload||current||asyncfs|| |loading|5334 ops/s|7989 ops/s| |workloada 50/50|8343 ops/s|11571 ops/s| |workloadw 85writes/15reads|6608 ops/|10614 ops/s| Ok. Looks like my first compare was bad because I was missing HBASE-18112. Above was 10 ycsb threads. Let me up concurrency to 25 threads and see how we do. Will report back. This was with the hbase.wal.async.use-shared-event-loop set to false. Let me retry with and without to see how much diff. > Analyze the performance of AsyncWAL and fix the same > > > Key: HBASE-16890 > URL: https://issues.apache.org/jira/browse/HBASE-16890 > Project: HBase > Issue Type: Sub-task > Components: wal >Affects Versions: 2.0.0 >Reporter: ramkrishna.s.vasudevan >Assignee: ramkrishna.s.vasudevan >Priority: Blocker > Fix For: 2.0.0-beta-1 > > Attachments: AsyncWAL_disruptor.patch, AsyncWAL_disruptor_1 > (2).patch, AsyncWAL_disruptor_3.patch, AsyncWAL_disruptor_3.patch, > AsyncWAL_disruptor_4.patch, AsyncWAL_disruptor_6.patch, > HBASE-16890-rc-v2.patch, HBASE-16890-rc-v3.patch, > HBASE-16890-remove-contention-v1.patch, HBASE-16890-remove-contention.patch, > Screen Shot 2016-10-25 at 7.34.47 PM.png, Screen Shot 2016-10-25 at 7.39.07 > PM.png, Screen Shot 2016-10-25 at 7.39.48 PM.png, Screen Shot 2016-11-04 at > 5.21.27 PM.png, Screen Shot 2016-11-04 at 5.30.18 PM.png, async.svg, > classic.svg, contention.png, contention_defaultWAL.png, > ycsb_FSHlog.vs.Async.png > > > Tests reveal that AsyncWAL under load in single node cluster performs slower > than the Default WAL. This task is to analyze and see if we could fix it. > See some discussions in the tail of JIRA HBASE-15536. -- This message was sent by Atlassian JIRA (v6.4.14#64029)
[jira] [Created] (HBASE-19467) rsgroups shell commands don't properly display elapsed time
Andrew Purtell created HBASE-19467: -- Summary: rsgroups shell commands don't properly display elapsed time Key: HBASE-19467 URL: https://issues.apache.org/jira/browse/HBASE-19467 Project: HBase Issue Type: Bug Affects Versions: 1.4.0 Reporter: Andrew Purtell Assignee: Andrew Purtell Priority: Minor Fix For: 1.4.0 hbase(main):001:0> list_rsgroups GROUPS default 1 row(s) in 1512748253.9920 seconds hbase(main):002:0> add_rsgroup 'my_group' hbase(main):003:0> list_rsgroups GROUPS default my_group 2 row(s) in 1512748276.9400 seconds -- This message was sent by Atlassian JIRA (v6.4.14#64029)
[jira] [Updated] (HBASE-19465) Required httpcore and httpclient jars not included in binary distribution
[
https://issues.apache.org/jira/browse/HBASE-19465?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Andrew Purtell updated HBASE-19465:
---
Priority: Blocker (was: Major)
> Required httpcore and httpclient jars not included in binary distribution
> -
>
> Key: HBASE-19465
> URL: https://issues.apache.org/jira/browse/HBASE-19465
> Project: HBase
> Issue Type: Bug
>Affects Versions: 1.4.0
>Reporter: Andrew Purtell
>Assignee: Andrew Purtell
>Priority: Blocker
> Fix For: 1.4.0
>
> Attachments: HBASE-19465-branch-1.patch
>
>
> The httpcore and httpclient dependency jars are not included into the binary
> distribution. This means MR/YARN jobs will fail if launched from the binary
> tarball as distributed, including those running in "local mode", e.g. ITBLL:
> {noformat}
> 2017-12-08 22:40:36,134 INFO [LocalJobRunner Map Task Executor #0]
> mapred.LocalJobRunner: Finishing task: attempt_local936234315_0001_m_03_0
> 2017-12-08 22:40:36,134 INFO [Thread-23] mapred.LocalJobRunner: map task
> executor complete.
> 2017-12-08 22:40:36,147 WARN [Thread-23] mapred.LocalJobRunner:
> job_local936234315_0001
> java.lang.NoClassDefFoundError: org/apache/http/client/methods/HttpUriRequest
> at
> org.apache.hadoop.mapred.LocalJobRunner$Job.run(LocalJobRunner.java:546)
> Caused by: java.lang.ClassNotFoundException:
> org.apache.http.client.methods.HttpUriRequest
> at java.net.URLClassLoader.findClass(URLClassLoader.java:381)
> at java.lang.ClassLoader.loadClass(ClassLoader.java:424)
> at sun.misc.Launcher$AppClassLoader.loadClass(Launcher.java:335)
> at java.lang.ClassLoader.loadClass(ClassLoader.java:357)
> ... 1 more
> Exception in thread "Thread-23" java.lang.NoClassDefFoundError:
> org/apache/http/client/methods/HttpUriRequest
> at
> org.apache.hadoop.mapred.LocalJobRunner$Job.run(LocalJobRunner.java:562)
> Caused by: java.lang.ClassNotFoundException:
> org.apache.http.client.methods.HttpUriRequest
> at java.net.URLClassLoader.findClass(URLClassLoader.java:381)
> at java.lang.ClassLoader.loadClass(ClassLoader.java:424)
> at sun.misc.Launcher$AppClassLoader.loadClass(Launcher.java:335)
> at java.lang.ClassLoader.loadClass(ClassLoader.java:357)
> ... 1 more
> 2017-12-08 22:40:37,078 INFO [main] mapreduce.Job: Job
> job_local936234315_0001 failed with state FAILED due to: NA
> {noformat}
--
This message was sent by Atlassian JIRA
(v6.4.14#64029)
[jira] [Commented] (HBASE-19373) Fix Checkstyle error in hbase-annotations
[ https://issues.apache.org/jira/browse/HBASE-19373?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16284370#comment-16284370 ] Mike Drob commented on HBASE-19373: --- Belated binding +1 > Fix Checkstyle error in hbase-annotations > - > > Key: HBASE-19373 > URL: https://issues.apache.org/jira/browse/HBASE-19373 > Project: HBase > Issue Type: Sub-task >Reporter: Jan Hentschel >Assignee: Jan Hentschel >Priority: Trivial > Fix For: 3.0.0, 1.4.0, 1.3.2, 1.5.0, 1.2.7, 2.0.0-beta-1, 1.1.13 > > Attachments: HBASE-19373.master.001.patch > > > Fix the remaining Checkstyle error regarding line length in the > *hbase-annotations* module. -- This message was sent by Atlassian JIRA (v6.4.14#64029)
[jira] [Updated] (HBASE-19465) Required httpcore and httpclient jars not included in binary distribution
[
https://issues.apache.org/jira/browse/HBASE-19465?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Andrew Purtell updated HBASE-19465:
---
Attachment: HBASE-19465-branch-1.patch
> Required httpcore and httpclient jars not included in binary distribution
> -
>
> Key: HBASE-19465
> URL: https://issues.apache.org/jira/browse/HBASE-19465
> Project: HBase
> Issue Type: Bug
>Affects Versions: 1.4.0
>Reporter: Andrew Purtell
>Assignee: Andrew Purtell
> Fix For: 1.4.0
>
> Attachments: HBASE-19465-branch-1.patch
>
>
> The httpcore and httpclient dependency jars are not included into the binary
> distribution. This means MR/YARN jobs will fail if launched from the binary
> tarball as distributed, including those running in "local mode", e.g. ITBLL:
> {noformat}
> 2017-12-08 22:40:36,134 INFO [LocalJobRunner Map Task Executor #0]
> mapred.LocalJobRunner: Finishing task: attempt_local936234315_0001_m_03_0
> 2017-12-08 22:40:36,134 INFO [Thread-23] mapred.LocalJobRunner: map task
> executor complete.
> 2017-12-08 22:40:36,147 WARN [Thread-23] mapred.LocalJobRunner:
> job_local936234315_0001
> java.lang.NoClassDefFoundError: org/apache/http/client/methods/HttpUriRequest
> at
> org.apache.hadoop.mapred.LocalJobRunner$Job.run(LocalJobRunner.java:546)
> Caused by: java.lang.ClassNotFoundException:
> org.apache.http.client.methods.HttpUriRequest
> at java.net.URLClassLoader.findClass(URLClassLoader.java:381)
> at java.lang.ClassLoader.loadClass(ClassLoader.java:424)
> at sun.misc.Launcher$AppClassLoader.loadClass(Launcher.java:335)
> at java.lang.ClassLoader.loadClass(ClassLoader.java:357)
> ... 1 more
> Exception in thread "Thread-23" java.lang.NoClassDefFoundError:
> org/apache/http/client/methods/HttpUriRequest
> at
> org.apache.hadoop.mapred.LocalJobRunner$Job.run(LocalJobRunner.java:562)
> Caused by: java.lang.ClassNotFoundException:
> org.apache.http.client.methods.HttpUriRequest
> at java.net.URLClassLoader.findClass(URLClassLoader.java:381)
> at java.lang.ClassLoader.loadClass(ClassLoader.java:424)
> at sun.misc.Launcher$AppClassLoader.loadClass(Launcher.java:335)
> at java.lang.ClassLoader.loadClass(ClassLoader.java:357)
> ... 1 more
> 2017-12-08 22:40:37,078 INFO [main] mapreduce.Job: Job
> job_local936234315_0001 failed with state FAILED due to: NA
> {noformat}
--
This message was sent by Atlassian JIRA
(v6.4.14#64029)
[jira] [Commented] (HBASE-19465) Required httpcore and httpclient jars not included in binary distribution
[
https://issues.apache.org/jira/browse/HBASE-19465?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16284364#comment-16284364
]
Andrew Purtell commented on HBASE-19465:
Dropping httpcore and httpclient jars (httpcore-4.2.5.jar and
httpclient-4.2.5.jar from Hadoop 2.7.4) by hand into lib/ does resolve the
observed failure.
> Required httpcore and httpclient jars not included in binary distribution
> -
>
> Key: HBASE-19465
> URL: https://issues.apache.org/jira/browse/HBASE-19465
> Project: HBase
> Issue Type: Bug
>Affects Versions: 1.4.0
>Reporter: Andrew Purtell
>Assignee: Andrew Purtell
> Fix For: 1.4.0
>
>
> The httpcore and httpclient dependency jars are not included into the binary
> distribution. This means MR/YARN jobs will fail if launched from the binary
> tarball as distributed, including those running in "local mode", e.g. ITBLL:
> {noformat}
> 2017-12-08 22:40:36,134 INFO [LocalJobRunner Map Task Executor #0]
> mapred.LocalJobRunner: Finishing task: attempt_local936234315_0001_m_03_0
> 2017-12-08 22:40:36,134 INFO [Thread-23] mapred.LocalJobRunner: map task
> executor complete.
> 2017-12-08 22:40:36,147 WARN [Thread-23] mapred.LocalJobRunner:
> job_local936234315_0001
> java.lang.NoClassDefFoundError: org/apache/http/client/methods/HttpUriRequest
> at
> org.apache.hadoop.mapred.LocalJobRunner$Job.run(LocalJobRunner.java:546)
> Caused by: java.lang.ClassNotFoundException:
> org.apache.http.client.methods.HttpUriRequest
> at java.net.URLClassLoader.findClass(URLClassLoader.java:381)
> at java.lang.ClassLoader.loadClass(ClassLoader.java:424)
> at sun.misc.Launcher$AppClassLoader.loadClass(Launcher.java:335)
> at java.lang.ClassLoader.loadClass(ClassLoader.java:357)
> ... 1 more
> Exception in thread "Thread-23" java.lang.NoClassDefFoundError:
> org/apache/http/client/methods/HttpUriRequest
> at
> org.apache.hadoop.mapred.LocalJobRunner$Job.run(LocalJobRunner.java:562)
> Caused by: java.lang.ClassNotFoundException:
> org.apache.http.client.methods.HttpUriRequest
> at java.net.URLClassLoader.findClass(URLClassLoader.java:381)
> at java.lang.ClassLoader.loadClass(ClassLoader.java:424)
> at sun.misc.Launcher$AppClassLoader.loadClass(Launcher.java:335)
> at java.lang.ClassLoader.loadClass(ClassLoader.java:357)
> ... 1 more
> 2017-12-08 22:40:37,078 INFO [main] mapreduce.Job: Job
> job_local936234315_0001 failed with state FAILED due to: NA
> {noformat}
--
This message was sent by Atlassian JIRA
(v6.4.14#64029)
[jira] [Created] (HBASE-19466) Rare failure in TestScannerCursor
Andrew Purtell created HBASE-19466: -- Summary: Rare failure in TestScannerCursor Key: HBASE-19466 URL: https://issues.apache.org/jira/browse/HBASE-19466 Project: HBase Issue Type: Bug Affects Versions: 1.4.0 Reporter: Andrew Purtell Priority: Minor Fix For: 1.4.1, 1.5.0 I think we just need to increase the timeout interval to deal with occasional slowdowns on test executors. 1998 ms is a pretty short timeout. By the way "rpcTimetout" in the exception message is a misspelling. [ERROR] Tests run: 2, Failures: 0, Errors: 1, Skipped: 0, Time elapsed: 37.412 s <<< FAILURE! - in org.apache.hadoop.hbase.regionserver.TestScannerCursor [ERROR] testHeartbeatWithSparseFilter(org.apache.hadoop.hbase.regionserver.TestScannerCursor) Time elapsed: 35.604 s <<< ERROR! org.apache.hadoop.hbase.client.RetriesExhaustedException: Failed after attempts=36, exceptions: Thu Dec 07 22:27:16 UTC 2017, null, java.net.SocketTimeoutException: callTimeout=4000, callDuration=4108: Call to ip-172-31-47-35.us-west-2.compute.internal/172.31.47.35:35690 failed on local exception: org.apache.hadoop.hbase.ipc.CallTimeoutException: Call id=52, waitTime=2002, rpcTimetout=1998 row '' on table 'TestScannerCursor' at region=TestScannerCursor,,1512685598567.1d4e59215a881d6ccbd0b5b5bdec5587., hostname=ip-172-31-47-35.us-west-2.compute.internal,35690,1512685593244, seqNum=2 at org.apache.hadoop.hbase.regionserver.TestScannerCursor.testHeartbeatWithSparseFilter(TestScannerCursor.java:154) Caused by: java.net.SocketTimeoutException: callTimeout=4000, callDuration=4108: Call to ip-172-31-47-35.us-west-2.compute.internal/172.31.47.35:35690 failed on local exception: org.apache.hadoop.hbase.ipc.CallTimeoutException: Call id=52, waitTime=2002, rpcTimetout=1998 row '' on table 'TestScannerCursor' at region=TestScannerCursor,,1512685598567.1d4e59215a881d6ccbd0b5b5bdec5587., hostname=ip-172-31-47-35.us-west-2.compute.internal,35690,1512685593244, seqNum=2 Caused by: java.io.IOException: Call to ip-172-31-47-35.us-west-2.compute.internal/172.31.47.35:35690 failed on local exception: org.apache.hadoop.hbase.ipc.CallTimeoutException: Call id=52, waitTime=2002, rpcTimetout=1998 Caused by: org.apache.hadoop.hbase.ipc.CallTimeoutException: Call id=52, waitTime=2002, rpcTimetout=1998 -- This message was sent by Atlassian JIRA (v6.4.14#64029)
[jira] [Commented] (HBASE-19134) Make WALKey an Interface; expose Read-Only version to CPs
[
https://issues.apache.org/jira/browse/HBASE-19134?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16284361#comment-16284361
]
Hadoop QA commented on HBASE-19134:
---
| (x) *{color:red}-1 overall{color}* |
\\
\\
|| Vote || Subsystem || Runtime || Comment ||
| {color:blue}0{color} | {color:blue} reexec {color} | {color:blue} 0m
10s{color} | {color:blue} Docker mode activated. {color} |
|| || || || {color:brown} Prechecks {color} ||
| {color:blue}0{color} | {color:blue} findbugs {color} | {color:blue} 0m
0s{color} | {color:blue} Findbugs executables are not available. {color} |
| {color:green}+1{color} | {color:green} hbaseanti {color} | {color:green} 0m
0s{color} | {color:green} Patch does not have any anti-patterns. {color} |
| {color:green}+1{color} | {color:green} @author {color} | {color:green} 0m
0s{color} | {color:green} The patch does not contain any @author tags. {color} |
| {color:green}+1{color} | {color:green} test4tests {color} | {color:green} 0m
0s{color} | {color:green} The patch appears to include 31 new or modified test
files. {color} |
|| || || || {color:brown} master Compile Tests {color} ||
| {color:blue}0{color} | {color:blue} mvndep {color} | {color:blue} 0m
15s{color} | {color:blue} Maven dependency ordering for branch {color} |
| {color:green}+1{color} | {color:green} mvninstall {color} | {color:green} 5m
26s{color} | {color:green} master passed {color} |
| {color:green}+1{color} | {color:green} compile {color} | {color:green} 1m
18s{color} | {color:green} master passed {color} |
| {color:green}+1{color} | {color:green} checkstyle {color} | {color:green} 1m
53s{color} | {color:green} master passed {color} |
| {color:green}+1{color} | {color:green} shadedjars {color} | {color:green} 6m
54s{color} | {color:green} branch has no errors when building our shaded
downstream artifacts. {color} |
| {color:green}+1{color} | {color:green} javadoc {color} | {color:green} 0m
54s{color} | {color:green} master passed {color} |
|| || || || {color:brown} Patch Compile Tests {color} ||
| {color:blue}0{color} | {color:blue} mvndep {color} | {color:blue} 0m
15s{color} | {color:blue} Maven dependency ordering for patch {color} |
| {color:green}+1{color} | {color:green} mvninstall {color} | {color:green} 5m
29s{color} | {color:green} the patch passed {color} |
| {color:green}+1{color} | {color:green} compile {color} | {color:green} 1m
16s{color} | {color:green} the patch passed {color} |
| {color:green}+1{color} | {color:green} javac {color} | {color:green} 1m
16s{color} | {color:green} the patch passed {color} |
| {color:red}-1{color} | {color:red} checkstyle {color} | {color:red} 1m
20s{color} | {color:red} hbase-server: The patch generated 16 new + 692
unchanged - 19 fixed = 708 total (was 711) {color} |
| {color:green}+1{color} | {color:green} whitespace {color} | {color:green} 0m
0s{color} | {color:green} The patch has no whitespace issues. {color} |
| {color:green}+1{color} | {color:green} shadedjars {color} | {color:green} 4m
58s{color} | {color:green} patch has no errors when building our shaded
downstream artifacts. {color} |
| {color:green}+1{color} | {color:green} hadoopcheck {color} | {color:green}
55m 42s{color} | {color:green} Patch does not cause any errors with Hadoop
2.6.1 2.6.2 2.6.3 2.6.4 2.6.5 2.7.1 2.7.2 2.7.3 2.7.4 or 3.0.0-alpha4. {color} |
| {color:green}+1{color} | {color:green} javadoc {color} | {color:green} 0m
44s{color} | {color:green} the patch passed {color} |
|| || || || {color:brown} Other Tests {color} ||
| {color:green}+1{color} | {color:green} unit {color} | {color:green} 97m
16s{color} | {color:green} hbase-server in the patch passed. {color} |
| {color:green}+1{color} | {color:green} unit {color} | {color:green} 10m
36s{color} | {color:green} hbase-mapreduce in the patch passed. {color} |
| {color:green}+1{color} | {color:green} asflicense {color} | {color:green} 0m
35s{color} | {color:green} The patch does not generate ASF License warnings.
{color} |
| {color:black}{color} | {color:black} {color} | {color:black}188m 56s{color} |
{color:black} {color} |
\\
\\
|| Subsystem || Report/Notes ||
| Docker | Client=17.05.0-ce Server=17.05.0-ce Image:yetus/hbase:eee3b01 |
| JIRA Issue | HBASE-19134 |
| JIRA Patch URL |
https://issues.apache.org/jira/secure/attachment/12901293/HBASE-19134.master.005.patch
|
| Optional Tests | asflicense javac javadoc unit findbugs shadedjars
hadoopcheck hbaseanti checkstyle compile |
| uname | Linux 1e934f63299b 3.13.0-133-generic #182-Ubuntu SMP Tue Sep 19
15:49:21 UTC 2017 x86_64 GNU/Linux |
| Build tool | maven |
| Personality |
/home/jenkins/jenkins-slave/workspace/PreCommit-HBASE-Build@2/component/dev-support/hbase-personality.sh
|
| git revision | master / 139c3305a5 |
| maven | version: Apache Maven 3.5.2
(138edd61fd100ec658bfa2d307c43b76940a5d7d; 2017-10-18T07:58:13Z) |
| Default Java | 1.8.0_151 |
|
[jira] [Commented] (HBASE-19465) Required httpcore and httpclient jars not included in binary distribution
[
https://issues.apache.org/jira/browse/HBASE-19465?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16284360#comment-16284360
]
Andrew Purtell commented on HBASE-19465:
Any Maven mavens have thoughts about this?
> Required httpcore and httpclient jars not included in binary distribution
> -
>
> Key: HBASE-19465
> URL: https://issues.apache.org/jira/browse/HBASE-19465
> Project: HBase
> Issue Type: Bug
>Affects Versions: 1.4.0
>Reporter: Andrew Purtell
>Assignee: Andrew Purtell
> Fix For: 1.4.0
>
>
> The httpcore and httpclient dependency jars are not included into the binary
> distribution. This means MR/YARN jobs will fail if launched from the binary
> tarball as distributed, including those running in "local mode", e.g. ITBLL:
> {noformat}
> 2017-12-08 22:40:36,134 INFO [LocalJobRunner Map Task Executor #0]
> mapred.LocalJobRunner: Finishing task: attempt_local936234315_0001_m_03_0
> 2017-12-08 22:40:36,134 INFO [Thread-23] mapred.LocalJobRunner: map task
> executor complete.
> 2017-12-08 22:40:36,147 WARN [Thread-23] mapred.LocalJobRunner:
> job_local936234315_0001
> java.lang.NoClassDefFoundError: org/apache/http/client/methods/HttpUriRequest
> at
> org.apache.hadoop.mapred.LocalJobRunner$Job.run(LocalJobRunner.java:546)
> Caused by: java.lang.ClassNotFoundException:
> org.apache.http.client.methods.HttpUriRequest
> at java.net.URLClassLoader.findClass(URLClassLoader.java:381)
> at java.lang.ClassLoader.loadClass(ClassLoader.java:424)
> at sun.misc.Launcher$AppClassLoader.loadClass(Launcher.java:335)
> at java.lang.ClassLoader.loadClass(ClassLoader.java:357)
> ... 1 more
> Exception in thread "Thread-23" java.lang.NoClassDefFoundError:
> org/apache/http/client/methods/HttpUriRequest
> at
> org.apache.hadoop.mapred.LocalJobRunner$Job.run(LocalJobRunner.java:562)
> Caused by: java.lang.ClassNotFoundException:
> org.apache.http.client.methods.HttpUriRequest
> at java.net.URLClassLoader.findClass(URLClassLoader.java:381)
> at java.lang.ClassLoader.loadClass(ClassLoader.java:424)
> at sun.misc.Launcher$AppClassLoader.loadClass(Launcher.java:335)
> at java.lang.ClassLoader.loadClass(ClassLoader.java:357)
> ... 1 more
> 2017-12-08 22:40:37,078 INFO [main] mapreduce.Job: Job
> job_local936234315_0001 failed with state FAILED due to: NA
> {noformat}
--
This message was sent by Atlassian JIRA
(v6.4.14#64029)
[jira] [Created] (HBASE-19465) Required httpcore and httpclient jars not included in binary distribution
Andrew Purtell created HBASE-19465:
--
Summary: Required httpcore and httpclient jars not included in
binary distribution
Key: HBASE-19465
URL: https://issues.apache.org/jira/browse/HBASE-19465
Project: HBase
Issue Type: Bug
Affects Versions: 1.4.0
Reporter: Andrew Purtell
Assignee: Andrew Purtell
Fix For: 1.4.0
The httpcore and httpclient dependency jars are not included into the binary
distribution. This means MR/YARN jobs will fail if launched from the binary
tarball as distributed, including those running in "local mode", e.g. ITBLL:
{noformat}
2017-12-08 22:40:36,134 INFO [LocalJobRunner Map Task Executor #0]
mapred.LocalJobRunner: Finishing task: attempt_local936234315_0001_m_03_0
2017-12-08 22:40:36,134 INFO [Thread-23] mapred.LocalJobRunner: map task
executor complete.
2017-12-08 22:40:36,147 WARN [Thread-23] mapred.LocalJobRunner:
job_local936234315_0001
java.lang.NoClassDefFoundError: org/apache/http/client/methods/HttpUriRequest
at
org.apache.hadoop.mapred.LocalJobRunner$Job.run(LocalJobRunner.java:546)
Caused by: java.lang.ClassNotFoundException:
org.apache.http.client.methods.HttpUriRequest
at java.net.URLClassLoader.findClass(URLClassLoader.java:381)
at java.lang.ClassLoader.loadClass(ClassLoader.java:424)
at sun.misc.Launcher$AppClassLoader.loadClass(Launcher.java:335)
at java.lang.ClassLoader.loadClass(ClassLoader.java:357)
... 1 more
Exception in thread "Thread-23" java.lang.NoClassDefFoundError:
org/apache/http/client/methods/HttpUriRequest
at
org.apache.hadoop.mapred.LocalJobRunner$Job.run(LocalJobRunner.java:562)
Caused by: java.lang.ClassNotFoundException:
org.apache.http.client.methods.HttpUriRequest
at java.net.URLClassLoader.findClass(URLClassLoader.java:381)
at java.lang.ClassLoader.loadClass(ClassLoader.java:424)
at sun.misc.Launcher$AppClassLoader.loadClass(Launcher.java:335)
at java.lang.ClassLoader.loadClass(ClassLoader.java:357)
... 1 more
2017-12-08 22:40:37,078 INFO [main] mapreduce.Job: Job job_local936234315_0001
failed with state FAILED due to: NA
{noformat}
--
This message was sent by Atlassian JIRA
(v6.4.14#64029)
[jira] [Updated] (HBASE-19448) Replace StringBuffer with StringBuilder for hbase-server
[
https://issues.apache.org/jira/browse/HBASE-19448?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
BELUGA BEHR updated HBASE-19448:
Affects Version/s: 3.0.0
> Replace StringBuffer with StringBuilder for hbase-server
>
>
> Key: HBASE-19448
> URL: https://issues.apache.org/jira/browse/HBASE-19448
> Project: HBase
> Issue Type: Improvement
> Components: hbase
>Affects Versions: 2.0.0, 3.0.0
>Reporter: BELUGA BEHR
>Assignee: BELUGA BEHR
>Priority: Trivial
> Fix For: 2.0.0
>
> Attachments: HBASE-19448.1.patch
>
>
> Replace the thread-safe {{StringBuffer}} class with the un-synchronized
> {{StringBuilder}} class for better performance.
--
This message was sent by Atlassian JIRA
(v6.4.14#64029)
[jira] [Updated] (HBASE-19464) Replace StringBuffer with StringBuilder for hbase-common
[
https://issues.apache.org/jira/browse/HBASE-19464?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
BELUGA BEHR updated HBASE-19464:
Affects Version/s: (was: 2.0.0)
3.0.0
> Replace StringBuffer with StringBuilder for hbase-common
>
>
> Key: HBASE-19464
> URL: https://issues.apache.org/jira/browse/HBASE-19464
> Project: HBase
> Issue Type: Improvement
> Components: hbase
>Affects Versions: 3.0.0
>Reporter: BELUGA BEHR
>Priority: Trivial
> Attachments: HBASE-19464.1.patch
>
>
> Replace {{StringBuffer}} with non-synchronized version {{StringBuilder}}
--
This message was sent by Atlassian JIRA
(v6.4.14#64029)
[jira] [Updated] (HBASE-19449) Implement SLF4J and SLF4J Parameter Substitution
[
https://issues.apache.org/jira/browse/HBASE-19449?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
BELUGA BEHR updated HBASE-19449:
Affects Version/s: (was: 2.0.0)
3.0.0
> Implement SLF4J and SLF4J Parameter Substitution
>
>
> Key: HBASE-19449
> URL: https://issues.apache.org/jira/browse/HBASE-19449
> Project: HBase
> Issue Type: Improvement
> Components: hbase
>Affects Versions: 3.0.0
>Reporter: BELUGA BEHR
>Assignee: BELUGA BEHR
>Priority: Trivial
> Fix For: 2.0.0
>
> Attachments: HBASE-19449.1.patch, HBASE-19449.2.patch,
> HBASE-19449.3.patch, HBASE-19449.4.patch
>
>
> For the {{HFileArchiver.java}} class...
> * Use SLF4J logging
> * Use SLF4J parameter substitution
> * Fix some small issues with missing spaces between words in the log message
> and the like
> https://www.slf4j.org/faq.html#logging_performance
--
This message was sent by Atlassian JIRA
(v6.4.14#64029)
[jira] [Commented] (HBASE-19373) Fix Checkstyle error in hbase-annotations
[ https://issues.apache.org/jira/browse/HBASE-19373?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16284351#comment-16284351 ] Hudson commented on HBASE-19373: SUCCESS: Integrated in Jenkins build HBase-1.2-IT #1038 (See [https://builds.apache.org/job/HBase-1.2-IT/1038/]) HBASE-19373 Fixed remaining Checkstyle error in hbase-annotations (jan.hentschel: rev 6c008db41e24d787fec3752b68d589e698baef36) * (edit) hbase-annotations/src/test/java/org/apache/hadoop/hbase/testclassification/ClientTests.java > Fix Checkstyle error in hbase-annotations > - > > Key: HBASE-19373 > URL: https://issues.apache.org/jira/browse/HBASE-19373 > Project: HBase > Issue Type: Sub-task >Reporter: Jan Hentschel >Assignee: Jan Hentschel >Priority: Trivial > Fix For: 3.0.0, 1.4.0, 1.3.2, 1.5.0, 1.2.7, 2.0.0-beta-1, 1.1.13 > > Attachments: HBASE-19373.master.001.patch > > > Fix the remaining Checkstyle error regarding line length in the > *hbase-annotations* module. -- This message was sent by Atlassian JIRA (v6.4.14#64029)
[jira] [Commented] (HBASE-19373) Fix Checkstyle error in hbase-annotations
[ https://issues.apache.org/jira/browse/HBASE-19373?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16284349#comment-16284349 ] Hudson commented on HBASE-19373: SUCCESS: Integrated in Jenkins build HBase-1.3-IT #314 (See [https://builds.apache.org/job/HBase-1.3-IT/314/]) HBASE-19373 Fixed remaining Checkstyle error in hbase-annotations (jan.hentschel: rev 9dc0d529c5f303dd02ec75949f67813f7cd927d8) * (edit) hbase-annotations/src/test/java/org/apache/hadoop/hbase/testclassification/ClientTests.java > Fix Checkstyle error in hbase-annotations > - > > Key: HBASE-19373 > URL: https://issues.apache.org/jira/browse/HBASE-19373 > Project: HBase > Issue Type: Sub-task >Reporter: Jan Hentschel >Assignee: Jan Hentschel >Priority: Trivial > Fix For: 3.0.0, 1.4.0, 1.3.2, 1.5.0, 1.2.7, 2.0.0-beta-1, 1.1.13 > > Attachments: HBASE-19373.master.001.patch > > > Fix the remaining Checkstyle error regarding line length in the > *hbase-annotations* module. -- This message was sent by Atlassian JIRA (v6.4.14#64029)
[jira] [Updated] (HBASE-19464) Replace StringBuffer with StringBuilder for hbase-common
[
https://issues.apache.org/jira/browse/HBASE-19464?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
BELUGA BEHR updated HBASE-19464:
Status: Patch Available (was: Open)
> Replace StringBuffer with StringBuilder for hbase-common
>
>
> Key: HBASE-19464
> URL: https://issues.apache.org/jira/browse/HBASE-19464
> Project: HBase
> Issue Type: Improvement
> Components: hbase
>Affects Versions: 2.0.0
>Reporter: BELUGA BEHR
>Priority: Trivial
> Attachments: HBASE-19464.1.patch
>
>
> Replace {{StringBuffer}} with non-synchronized version {{StringBuilder}}
--
This message was sent by Atlassian JIRA
(v6.4.14#64029)
[jira] [Updated] (HBASE-19464) Replace StringBuffer with StringBuilder for hbase-common
[
https://issues.apache.org/jira/browse/HBASE-19464?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
BELUGA BEHR updated HBASE-19464:
Attachment: HBASE-19464.1.patch
> Replace StringBuffer with StringBuilder for hbase-common
>
>
> Key: HBASE-19464
> URL: https://issues.apache.org/jira/browse/HBASE-19464
> Project: HBase
> Issue Type: Improvement
> Components: hbase
>Affects Versions: 2.0.0
>Reporter: BELUGA BEHR
>Priority: Trivial
> Attachments: HBASE-19464.1.patch
>
>
> Replace {{StringBuffer}} with non-synchronized version {{StringBuilder}}
--
This message was sent by Atlassian JIRA
(v6.4.14#64029)
[jira] [Created] (HBASE-19464) Replace StringBuffer with StringBuilder for hbase-common
BELUGA BEHR created HBASE-19464:
---
Summary: Replace StringBuffer with StringBuilder for hbase-common
Key: HBASE-19464
URL: https://issues.apache.org/jira/browse/HBASE-19464
Project: HBase
Issue Type: Improvement
Components: hbase
Affects Versions: 2.0.0
Reporter: BELUGA BEHR
Priority: Trivial
Replace {{StringBuffer}} with non-synchronized version {{StringBuilder}}
--
This message was sent by Atlassian JIRA
(v6.4.14#64029)
[jira] [Updated] (HBASE-19373) Fix Checkstyle error in hbase-annotations
[ https://issues.apache.org/jira/browse/HBASE-19373?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Jan Hentschel updated HBASE-19373: -- Resolution: Fixed Fix Version/s: 1.1.13 2.0.0-beta-1 1.2.7 1.5.0 1.3.2 1.4.0 3.0.0 Status: Resolved (was: Patch Available) Pushed to master, branch-2, branch-1, branch-1.4, branch-1.3, branch-1.2 and branch-1.1. > Fix Checkstyle error in hbase-annotations > - > > Key: HBASE-19373 > URL: https://issues.apache.org/jira/browse/HBASE-19373 > Project: HBase > Issue Type: Sub-task >Reporter: Jan Hentschel >Assignee: Jan Hentschel >Priority: Trivial > Fix For: 3.0.0, 1.4.0, 1.3.2, 1.5.0, 1.2.7, 2.0.0-beta-1, 1.1.13 > > Attachments: HBASE-19373.master.001.patch > > > Fix the remaining Checkstyle error regarding line length in the > *hbase-annotations* module. -- This message was sent by Atlassian JIRA (v6.4.14#64029)
[jira] [Commented] (HBASE-19461) TestRSGroups is broke
[
https://issues.apache.org/jira/browse/HBASE-19461?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16284332#comment-16284332
]
Hadoop QA commented on HBASE-19461:
---
| (/) *{color:green}+1 overall{color}* |
\\
\\
|| Vote || Subsystem || Runtime || Comment ||
| {color:blue}0{color} | {color:blue} reexec {color} | {color:blue} 0m
7s{color} | {color:blue} Docker mode activated. {color} |
|| || || || {color:brown} Prechecks {color} ||
| {color:blue}0{color} | {color:blue} findbugs {color} | {color:blue} 0m
0s{color} | {color:blue} Findbugs executables are not available. {color} |
| {color:green}+1{color} | {color:green} hbaseanti {color} | {color:green} 0m
0s{color} | {color:green} Patch does not have any anti-patterns. {color} |
| {color:green}+1{color} | {color:green} @author {color} | {color:green} 0m
0s{color} | {color:green} The patch does not contain any @author tags. {color} |
| {color:green}+1{color} | {color:green} test4tests {color} | {color:green} 0m
0s{color} | {color:green} The patch appears to include 1 new or modified test
files. {color} |
|| || || || {color:brown} master Compile Tests {color} ||
| {color:blue}0{color} | {color:blue} mvndep {color} | {color:blue} 0m
12s{color} | {color:blue} Maven dependency ordering for branch {color} |
| {color:green}+1{color} | {color:green} mvninstall {color} | {color:green} 4m
30s{color} | {color:green} master passed {color} |
| {color:green}+1{color} | {color:green} compile {color} | {color:green} 0m
38s{color} | {color:green} master passed {color} |
| {color:green}+1{color} | {color:green} checkstyle {color} | {color:green} 0m
38s{color} | {color:green} master passed {color} |
| {color:green}+1{color} | {color:green} shadedjars {color} | {color:green} 5m
3s{color} | {color:green} branch has no errors when building our shaded
downstream artifacts. {color} |
| {color:green}+1{color} | {color:green} javadoc {color} | {color:green} 0m
35s{color} | {color:green} master passed {color} |
|| || || || {color:brown} Patch Compile Tests {color} ||
| {color:blue}0{color} | {color:blue} mvndep {color} | {color:blue} 0m
13s{color} | {color:blue} Maven dependency ordering for patch {color} |
| {color:green}+1{color} | {color:green} mvninstall {color} | {color:green} 4m
33s{color} | {color:green} the patch passed {color} |
| {color:green}+1{color} | {color:green} compile {color} | {color:green} 0m
39s{color} | {color:green} the patch passed {color} |
| {color:green}+1{color} | {color:green} javac {color} | {color:green} 0m
39s{color} | {color:green} the patch passed {color} |
| {color:green}+1{color} | {color:green} checkstyle {color} | {color:green} 0m
39s{color} | {color:green} the patch passed {color} |
| {color:green}+1{color} | {color:green} whitespace {color} | {color:green} 0m
0s{color} | {color:green} The patch has no whitespace issues. {color} |
| {color:green}+1{color} | {color:green} shadedjars {color} | {color:green} 4m
23s{color} | {color:green} patch has no errors when building our shaded
downstream artifacts. {color} |
| {color:green}+1{color} | {color:green} hadoopcheck {color} | {color:green}
50m 46s{color} | {color:green} Patch does not cause any errors with Hadoop
2.6.1 2.6.2 2.6.3 2.6.4 2.6.5 2.7.1 2.7.2 2.7.3 2.7.4 or 3.0.0-alpha4. {color} |
| {color:green}+1{color} | {color:green} javadoc {color} | {color:green} 0m
34s{color} | {color:green} the patch passed {color} |
|| || || || {color:brown} Other Tests {color} ||
| {color:green}+1{color} | {color:green} unit {color} | {color:green} 2m
39s{color} | {color:green} hbase-client in the patch passed. {color} |
| {color:green}+1{color} | {color:green} unit {color} | {color:green} 0m
58s{color} | {color:green} hbase-rsgroup in the patch passed. {color} |
| {color:green}+1{color} | {color:green} asflicense {color} | {color:green} 0m
17s{color} | {color:green} The patch does not generate ASF License warnings.
{color} |
| {color:black}{color} | {color:black} {color} | {color:black} 72m 40s{color} |
{color:black} {color} |
\\
\\
|| Subsystem || Report/Notes ||
| Docker | Client=17.05.0-ce Server=17.05.0-ce Image:yetus/hbase:eee3b01 |
| JIRA Issue | HBASE-19461 |
| JIRA Patch URL |
https://issues.apache.org/jira/secure/attachment/12901303/HBASE-19461.master.001.patch
|
| Optional Tests | asflicense javac javadoc unit findbugs shadedjars
hadoopcheck hbaseanti checkstyle compile |
| uname | Linux 81765763fba7 3.13.0-129-generic #178-Ubuntu SMP Fri Aug 11
12:48:20 UTC 2017 x86_64 GNU/Linux |
| Build tool | maven |
| Personality |
/home/jenkins/jenkins-slave/workspace/PreCommit-HBASE-Build/component/dev-support/hbase-personality.sh
|
| git revision | master / 139c3305a5 |
| maven | version: Apache Maven 3.5.2
(138edd61fd100ec658bfa2d307c43b76940a5d7d; 2017-10-18T07:58:13Z) |
| Default Java | 1.8.0_151 |
| Test Results |
[jira] [Commented] (HBASE-19449) Implement SLF4J and SLF4J Parameter Substitution
[
https://issues.apache.org/jira/browse/HBASE-19449?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16284324#comment-16284324
]
BELUGA BEHR commented on HBASE-19449:
-
@slack OK. I'll follow up with dev email thread. I attached a new patch to
this case to remove an unnecessary guard. HA. :)
> Implement SLF4J and SLF4J Parameter Substitution
>
>
> Key: HBASE-19449
> URL: https://issues.apache.org/jira/browse/HBASE-19449
> Project: HBase
> Issue Type: Improvement
> Components: hbase
>Affects Versions: 2.0.0
>Reporter: BELUGA BEHR
>Assignee: BELUGA BEHR
>Priority: Trivial
> Fix For: 2.0.0
>
> Attachments: HBASE-19449.1.patch, HBASE-19449.2.patch,
> HBASE-19449.3.patch, HBASE-19449.4.patch
>
>
> For the {{HFileArchiver.java}} class...
> * Use SLF4J logging
> * Use SLF4J parameter substitution
> * Fix some small issues with missing spaces between words in the log message
> and the like
> https://www.slf4j.org/faq.html#logging_performance
--
This message was sent by Atlassian JIRA
(v6.4.14#64029)
[jira] [Updated] (HBASE-19449) Implement SLF4J and SLF4J Parameter Substitution
[
https://issues.apache.org/jira/browse/HBASE-19449?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
BELUGA BEHR updated HBASE-19449:
Attachment: HBASE-19449.4.patch
> Implement SLF4J and SLF4J Parameter Substitution
>
>
> Key: HBASE-19449
> URL: https://issues.apache.org/jira/browse/HBASE-19449
> Project: HBase
> Issue Type: Improvement
> Components: hbase
>Affects Versions: 2.0.0
>Reporter: BELUGA BEHR
>Assignee: BELUGA BEHR
>Priority: Trivial
> Fix For: 2.0.0
>
> Attachments: HBASE-19449.1.patch, HBASE-19449.2.patch,
> HBASE-19449.3.patch, HBASE-19449.4.patch
>
>
> For the {{HFileArchiver.java}} class...
> * Use SLF4J logging
> * Use SLF4J parameter substitution
> * Fix some small issues with missing spaces between words in the log message
> and the like
> https://www.slf4j.org/faq.html#logging_performance
--
This message was sent by Atlassian JIRA
(v6.4.14#64029)
[jira] [Updated] (HBASE-19449) Implement SLF4J and SLF4J Parameter Substitution
[
https://issues.apache.org/jira/browse/HBASE-19449?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
BELUGA BEHR updated HBASE-19449:
Status: Open (was: Patch Available)
> Implement SLF4J and SLF4J Parameter Substitution
>
>
> Key: HBASE-19449
> URL: https://issues.apache.org/jira/browse/HBASE-19449
> Project: HBase
> Issue Type: Improvement
> Components: hbase
>Affects Versions: 2.0.0
>Reporter: BELUGA BEHR
>Assignee: BELUGA BEHR
>Priority: Trivial
> Fix For: 2.0.0
>
> Attachments: HBASE-19449.1.patch, HBASE-19449.2.patch,
> HBASE-19449.3.patch, HBASE-19449.4.patch
>
>
> For the {{HFileArchiver.java}} class...
> * Use SLF4J logging
> * Use SLF4J parameter substitution
> * Fix some small issues with missing spaces between words in the log message
> and the like
> https://www.slf4j.org/faq.html#logging_performance
--
This message was sent by Atlassian JIRA
(v6.4.14#64029)
[jira] [Updated] (HBASE-19360) Remove unused imports from hbase-zookeeper module
[ https://issues.apache.org/jira/browse/HBASE-19360?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Jan Hentschel updated HBASE-19360: -- Resolution: Fixed Fix Version/s: 2.0.0-beta-1 3.0.0 Status: Resolved (was: Patch Available) Pushed to master and branch-2. > Remove unused imports from hbase-zookeeper module > - > > Key: HBASE-19360 > URL: https://issues.apache.org/jira/browse/HBASE-19360 > Project: HBase > Issue Type: Sub-task > Components: Zookeeper >Reporter: Jan Hentschel >Assignee: Jan Hentschel >Priority: Minor > Fix For: 3.0.0, 2.0.0-beta-1 > > Attachments: HBASE-19360.master.001.patch, UnusedImport.xml > > > Currently there are two warnings regarding unused imports in the > *hbase-zookeeper* module (see the attached XML). The unused imports should be > removed. -- This message was sent by Atlassian JIRA (v6.4.14#64029)
[jira] [Updated] (HBASE-19449) Implement SLF4J and SLF4J Parameter Substitution
[
https://issues.apache.org/jira/browse/HBASE-19449?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
BELUGA BEHR updated HBASE-19449:
Status: Patch Available (was: Open)
> Implement SLF4J and SLF4J Parameter Substitution
>
>
> Key: HBASE-19449
> URL: https://issues.apache.org/jira/browse/HBASE-19449
> Project: HBase
> Issue Type: Improvement
> Components: hbase
>Affects Versions: 2.0.0
>Reporter: BELUGA BEHR
>Assignee: BELUGA BEHR
>Priority: Trivial
> Fix For: 2.0.0
>
> Attachments: HBASE-19449.1.patch, HBASE-19449.2.patch,
> HBASE-19449.3.patch, HBASE-19449.4.patch
>
>
> For the {{HFileArchiver.java}} class...
> * Use SLF4J logging
> * Use SLF4J parameter substitution
> * Fix some small issues with missing spaces between words in the log message
> and the like
> https://www.slf4j.org/faq.html#logging_performance
--
This message was sent by Atlassian JIRA
(v6.4.14#64029)
[jira] [Commented] (HBASE-19180) Remove unused imports from AlwaysPasses
[ https://issues.apache.org/jira/browse/HBASE-19180?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16284312#comment-16284312 ] Jan Hentschel commented on HBASE-19180: --- Pushed to master, branch-2, branch-1 and branch-1.4. > Remove unused imports from AlwaysPasses > --- > > Key: HBASE-19180 > URL: https://issues.apache.org/jira/browse/HBASE-19180 > Project: HBase > Issue Type: Improvement > Components: build >Affects Versions: 3.0.0 >Reporter: Jan Hentschel >Assignee: Jan Hentschel >Priority: Trivial > Fix For: 3.0.0, 1.4.0, 1.5.0, 2.0.0-beta-1 > > Attachments: HBASE-19180.master.001.patch > > > The class org.apache.hadoop.hbase.errorprone.AlwaysPasses currently has some > unused imports, which should be removed. -- This message was sent by Atlassian JIRA (v6.4.14#64029)
[jira] [Updated] (HBASE-19180) Remove unused imports from AlwaysPasses
[ https://issues.apache.org/jira/browse/HBASE-19180?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Jan Hentschel updated HBASE-19180: -- Resolution: Fixed Fix Version/s: 2.0.0-beta-1 1.5.0 1.4.0 3.0.0 Status: Resolved (was: Patch Available) > Remove unused imports from AlwaysPasses > --- > > Key: HBASE-19180 > URL: https://issues.apache.org/jira/browse/HBASE-19180 > Project: HBase > Issue Type: Improvement > Components: build >Affects Versions: 3.0.0 >Reporter: Jan Hentschel >Assignee: Jan Hentschel >Priority: Trivial > Fix For: 3.0.0, 1.4.0, 1.5.0, 2.0.0-beta-1 > > Attachments: HBASE-19180.master.001.patch > > > The class org.apache.hadoop.hbase.errorprone.AlwaysPasses currently has some > unused imports, which should be removed. -- This message was sent by Atlassian JIRA (v6.4.14#64029)
[jira] [Updated] (HBASE-19289) CommonFSUtils$StreamLacksCapabilityException: hflush when running test against hadoop3 beta1
[
https://issues.apache.org/jira/browse/HBASE-19289?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Mike Drob updated HBASE-19289:
--
Attachment: HBASE-19289.v4.patch
Thanks for the suggestion, [~tedyu] - this is a much simpler solution.
> CommonFSUtils$StreamLacksCapabilityException: hflush when running test
> against hadoop3 beta1
>
>
> Key: HBASE-19289
> URL: https://issues.apache.org/jira/browse/HBASE-19289
> Project: HBase
> Issue Type: Test
>Reporter: Ted Yu
>Assignee: Mike Drob
>Priority: Critical
> Fix For: 2.0.0-beta-1
>
> Attachments: 19289.v1.txt, 19289.v2.txt, HBASE-19289.patch,
> HBASE-19289.v2.patch, HBASE-19289.v3.patch, HBASE-19289.v4.patch
>
>
> As of commit d8fb10c8329b19223c91d3cda6ef149382ad4ea0 , I encountered the
> following exception when running unit test against hadoop3 beta1:
> {code}
> testRefreshStoreFiles(org.apache.hadoop.hbase.regionserver.TestHStore) Time
> elapsed: 0.061 sec <<< ERROR!
> java.io.IOException: cannot get log writer
> at
> org.apache.hadoop.hbase.regionserver.TestHStore.initHRegion(TestHStore.java:215)
> at
> org.apache.hadoop.hbase.regionserver.TestHStore.init(TestHStore.java:220)
> at
> org.apache.hadoop.hbase.regionserver.TestHStore.init(TestHStore.java:195)
> at
> org.apache.hadoop.hbase.regionserver.TestHStore.init(TestHStore.java:190)
> at
> org.apache.hadoop.hbase.regionserver.TestHStore.init(TestHStore.java:185)
> at
> org.apache.hadoop.hbase.regionserver.TestHStore.init(TestHStore.java:179)
> at
> org.apache.hadoop.hbase.regionserver.TestHStore.init(TestHStore.java:173)
> at
> org.apache.hadoop.hbase.regionserver.TestHStore.testRefreshStoreFiles(TestHStore.java:962)
> Caused by:
> org.apache.hadoop.hbase.util.CommonFSUtils$StreamLacksCapabilityException:
> hflush
> at
> org.apache.hadoop.hbase.regionserver.TestHStore.initHRegion(TestHStore.java:215)
> at
> org.apache.hadoop.hbase.regionserver.TestHStore.init(TestHStore.java:220)
> at
> org.apache.hadoop.hbase.regionserver.TestHStore.init(TestHStore.java:195)
> at
> org.apache.hadoop.hbase.regionserver.TestHStore.init(TestHStore.java:190)
> at
> org.apache.hadoop.hbase.regionserver.TestHStore.init(TestHStore.java:185)
> at
> org.apache.hadoop.hbase.regionserver.TestHStore.init(TestHStore.java:179)
> at
> org.apache.hadoop.hbase.regionserver.TestHStore.init(TestHStore.java:173)
> at
> org.apache.hadoop.hbase.regionserver.TestHStore.testRefreshStoreFiles(TestHStore.java:962)
> {code}
--
This message was sent by Atlassian JIRA
(v6.4.14#64029)
[jira] [Updated] (HBASE-19289) CommonFSUtils$StreamLacksCapabilityException: hflush when running test against hadoop3 beta1
[
https://issues.apache.org/jira/browse/HBASE-19289?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Mike Drob updated HBASE-19289:
--
Attachment: (was: HBASE-19289.v4.patch)
> CommonFSUtils$StreamLacksCapabilityException: hflush when running test
> against hadoop3 beta1
>
>
> Key: HBASE-19289
> URL: https://issues.apache.org/jira/browse/HBASE-19289
> Project: HBase
> Issue Type: Test
>Reporter: Ted Yu
>Assignee: Mike Drob
>Priority: Critical
> Fix For: 2.0.0-beta-1
>
> Attachments: 19289.v1.txt, 19289.v2.txt, HBASE-19289.patch,
> HBASE-19289.v2.patch, HBASE-19289.v3.patch
>
>
> As of commit d8fb10c8329b19223c91d3cda6ef149382ad4ea0 , I encountered the
> following exception when running unit test against hadoop3 beta1:
> {code}
> testRefreshStoreFiles(org.apache.hadoop.hbase.regionserver.TestHStore) Time
> elapsed: 0.061 sec <<< ERROR!
> java.io.IOException: cannot get log writer
> at
> org.apache.hadoop.hbase.regionserver.TestHStore.initHRegion(TestHStore.java:215)
> at
> org.apache.hadoop.hbase.regionserver.TestHStore.init(TestHStore.java:220)
> at
> org.apache.hadoop.hbase.regionserver.TestHStore.init(TestHStore.java:195)
> at
> org.apache.hadoop.hbase.regionserver.TestHStore.init(TestHStore.java:190)
> at
> org.apache.hadoop.hbase.regionserver.TestHStore.init(TestHStore.java:185)
> at
> org.apache.hadoop.hbase.regionserver.TestHStore.init(TestHStore.java:179)
> at
> org.apache.hadoop.hbase.regionserver.TestHStore.init(TestHStore.java:173)
> at
> org.apache.hadoop.hbase.regionserver.TestHStore.testRefreshStoreFiles(TestHStore.java:962)
> Caused by:
> org.apache.hadoop.hbase.util.CommonFSUtils$StreamLacksCapabilityException:
> hflush
> at
> org.apache.hadoop.hbase.regionserver.TestHStore.initHRegion(TestHStore.java:215)
> at
> org.apache.hadoop.hbase.regionserver.TestHStore.init(TestHStore.java:220)
> at
> org.apache.hadoop.hbase.regionserver.TestHStore.init(TestHStore.java:195)
> at
> org.apache.hadoop.hbase.regionserver.TestHStore.init(TestHStore.java:190)
> at
> org.apache.hadoop.hbase.regionserver.TestHStore.init(TestHStore.java:185)
> at
> org.apache.hadoop.hbase.regionserver.TestHStore.init(TestHStore.java:179)
> at
> org.apache.hadoop.hbase.regionserver.TestHStore.init(TestHStore.java:173)
> at
> org.apache.hadoop.hbase.regionserver.TestHStore.testRefreshStoreFiles(TestHStore.java:962)
> {code}
--
This message was sent by Atlassian JIRA
(v6.4.14#64029)
[jira] [Updated] (HBASE-19289) CommonFSUtils$StreamLacksCapabilityException: hflush when running test against hadoop3 beta1
[
https://issues.apache.org/jira/browse/HBASE-19289?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Mike Drob updated HBASE-19289:
--
Attachment: HBASE-19289.v4.patch
v4: put the property in test/resources/hbase-site.xml
> CommonFSUtils$StreamLacksCapabilityException: hflush when running test
> against hadoop3 beta1
>
>
> Key: HBASE-19289
> URL: https://issues.apache.org/jira/browse/HBASE-19289
> Project: HBase
> Issue Type: Test
>Reporter: Ted Yu
>Assignee: Mike Drob
>Priority: Critical
> Fix For: 2.0.0-beta-1
>
> Attachments: 19289.v1.txt, 19289.v2.txt, HBASE-19289.patch,
> HBASE-19289.v2.patch, HBASE-19289.v3.patch, HBASE-19289.v4.patch
>
>
> As of commit d8fb10c8329b19223c91d3cda6ef149382ad4ea0 , I encountered the
> following exception when running unit test against hadoop3 beta1:
> {code}
> testRefreshStoreFiles(org.apache.hadoop.hbase.regionserver.TestHStore) Time
> elapsed: 0.061 sec <<< ERROR!
> java.io.IOException: cannot get log writer
> at
> org.apache.hadoop.hbase.regionserver.TestHStore.initHRegion(TestHStore.java:215)
> at
> org.apache.hadoop.hbase.regionserver.TestHStore.init(TestHStore.java:220)
> at
> org.apache.hadoop.hbase.regionserver.TestHStore.init(TestHStore.java:195)
> at
> org.apache.hadoop.hbase.regionserver.TestHStore.init(TestHStore.java:190)
> at
> org.apache.hadoop.hbase.regionserver.TestHStore.init(TestHStore.java:185)
> at
> org.apache.hadoop.hbase.regionserver.TestHStore.init(TestHStore.java:179)
> at
> org.apache.hadoop.hbase.regionserver.TestHStore.init(TestHStore.java:173)
> at
> org.apache.hadoop.hbase.regionserver.TestHStore.testRefreshStoreFiles(TestHStore.java:962)
> Caused by:
> org.apache.hadoop.hbase.util.CommonFSUtils$StreamLacksCapabilityException:
> hflush
> at
> org.apache.hadoop.hbase.regionserver.TestHStore.initHRegion(TestHStore.java:215)
> at
> org.apache.hadoop.hbase.regionserver.TestHStore.init(TestHStore.java:220)
> at
> org.apache.hadoop.hbase.regionserver.TestHStore.init(TestHStore.java:195)
> at
> org.apache.hadoop.hbase.regionserver.TestHStore.init(TestHStore.java:190)
> at
> org.apache.hadoop.hbase.regionserver.TestHStore.init(TestHStore.java:185)
> at
> org.apache.hadoop.hbase.regionserver.TestHStore.init(TestHStore.java:179)
> at
> org.apache.hadoop.hbase.regionserver.TestHStore.init(TestHStore.java:173)
> at
> org.apache.hadoop.hbase.regionserver.TestHStore.testRefreshStoreFiles(TestHStore.java:962)
> {code}
--
This message was sent by Atlassian JIRA
(v6.4.14#64029)
[jira] [Commented] (HBASE-19458) Allow building HBase 1.3.x against Hadoop 2.8.2
[ https://issues.apache.org/jira/browse/HBASE-19458?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16284207#comment-16284207 ] Andrew Purtell commented on HBASE-19458: +1 Should this be applied to branch-1.4 and branch-1 too? What about branch-2 and master? > Allow building HBase 1.3.x against Hadoop 2.8.2 > --- > > Key: HBASE-19458 > URL: https://issues.apache.org/jira/browse/HBASE-19458 > Project: HBase > Issue Type: Bug >Affects Versions: 1.3.1 >Reporter: Lars Hofhansl >Assignee: Lars Hofhansl > Fix For: 1.3.2 > > Attachments: 19458.txt > > > Currently the 1.3 branch cannot be built against Hadoop 2.8.2. (that latest > stable 2.x release). -- This message was sent by Atlassian JIRA (v6.4.14#64029)
[jira] [Commented] (HBASE-19461) TestRSGroups is broke
[ https://issues.apache.org/jira/browse/HBASE-19461?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16284202#comment-16284202 ] Andrew Purtell commented on HBASE-19461: +1 > TestRSGroups is broke > - > > Key: HBASE-19461 > URL: https://issues.apache.org/jira/browse/HBASE-19461 > Project: HBase > Issue Type: Bug > Components: test >Reporter: stack >Assignee: stack > Fix For: 2.0.0-beta-1 > > Attachments: HBASE-19461.master.001.patch > > > I noticed this. Tried bisect'ing but nought definitive at mo. I see > testDefaultNamespaceCreateAndAssign failing most of the time. The crazy > getTable parse in RegionInfo gets a negative offset because the passed in > region name is nonsense. -- This message was sent by Atlassian JIRA (v6.4.14#64029)
[jira] [Updated] (HBASE-19461) TestRSGroups is broke
[ https://issues.apache.org/jira/browse/HBASE-19461?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] stack updated HBASE-19461: -- Status: Patch Available (was: Open) > TestRSGroups is broke > - > > Key: HBASE-19461 > URL: https://issues.apache.org/jira/browse/HBASE-19461 > Project: HBase > Issue Type: Bug > Components: test >Reporter: stack >Assignee: stack > Fix For: 2.0.0-beta-1 > > Attachments: HBASE-19461.master.001.patch > > > I noticed this. Tried bisect'ing but nought definitive at mo. I see > testDefaultNamespaceCreateAndAssign failing most of the time. The crazy > getTable parse in RegionInfo gets a negative offset because the passed in > region name is nonsense. -- This message was sent by Atlassian JIRA (v6.4.14#64029)
[jira] [Assigned] (HBASE-19461) TestRSGroups is broke
[ https://issues.apache.org/jira/browse/HBASE-19461?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] stack reassigned HBASE-19461: - Assignee: stack > TestRSGroups is broke > - > > Key: HBASE-19461 > URL: https://issues.apache.org/jira/browse/HBASE-19461 > Project: HBase > Issue Type: Bug > Components: test >Reporter: stack >Assignee: stack > Fix For: 2.0.0-beta-1 > > Attachments: HBASE-19461.master.001.patch > > > I noticed this. Tried bisect'ing but nought definitive at mo. I see > testDefaultNamespaceCreateAndAssign failing most of the time. The crazy > getTable parse in RegionInfo gets a negative offset because the passed in > region name is nonsense. -- This message was sent by Atlassian JIRA (v6.4.14#64029)
[jira] [Commented] (HBASE-19461) TestRSGroups is broke
[ https://issues.apache.org/jira/browse/HBASE-19461?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16284199#comment-16284199 ] stack commented on HBASE-19461: --- .001 Catch bad parse and throw exception in test. > TestRSGroups is broke > - > > Key: HBASE-19461 > URL: https://issues.apache.org/jira/browse/HBASE-19461 > Project: HBase > Issue Type: Bug > Components: test >Reporter: stack > Fix For: 2.0.0-beta-1 > > Attachments: HBASE-19461.master.001.patch > > > I noticed this. Tried bisect'ing but nought definitive at mo. I see > testDefaultNamespaceCreateAndAssign failing most of the time. The crazy > getTable parse in RegionInfo gets a negative offset because the passed in > region name is nonsense. -- This message was sent by Atlassian JIRA (v6.4.14#64029)
[jira] [Updated] (HBASE-19461) TestRSGroups is broke
[ https://issues.apache.org/jira/browse/HBASE-19461?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] stack updated HBASE-19461: -- Attachment: HBASE-19461.master.001.patch > TestRSGroups is broke > - > > Key: HBASE-19461 > URL: https://issues.apache.org/jira/browse/HBASE-19461 > Project: HBase > Issue Type: Bug > Components: test >Reporter: stack > Fix For: 2.0.0-beta-1 > > Attachments: HBASE-19461.master.001.patch > > > I noticed this. Tried bisect'ing but nought definitive at mo. I see > testDefaultNamespaceCreateAndAssign failing most of the time. The crazy > getTable parse in RegionInfo gets a negative offset because the passed in > region name is nonsense. -- This message was sent by Atlassian JIRA (v6.4.14#64029)
[jira] [Commented] (HBASE-19289) CommonFSUtils$StreamLacksCapabilityException: hflush when running test against hadoop3 beta1
[
https://issues.apache.org/jira/browse/HBASE-19289?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16284175#comment-16284175
]
Ted Yu commented on HBASE-19289:
How about putting the config in:
./hbase-server/src/test/resources/hbase-site.xml
This way, you don't need to modify individual tests.
> CommonFSUtils$StreamLacksCapabilityException: hflush when running test
> against hadoop3 beta1
>
>
> Key: HBASE-19289
> URL: https://issues.apache.org/jira/browse/HBASE-19289
> Project: HBase
> Issue Type: Test
>Reporter: Ted Yu
>Assignee: Mike Drob
>Priority: Critical
> Fix For: 2.0.0-beta-1
>
> Attachments: 19289.v1.txt, 19289.v2.txt, HBASE-19289.patch,
> HBASE-19289.v2.patch, HBASE-19289.v3.patch
>
>
> As of commit d8fb10c8329b19223c91d3cda6ef149382ad4ea0 , I encountered the
> following exception when running unit test against hadoop3 beta1:
> {code}
> testRefreshStoreFiles(org.apache.hadoop.hbase.regionserver.TestHStore) Time
> elapsed: 0.061 sec <<< ERROR!
> java.io.IOException: cannot get log writer
> at
> org.apache.hadoop.hbase.regionserver.TestHStore.initHRegion(TestHStore.java:215)
> at
> org.apache.hadoop.hbase.regionserver.TestHStore.init(TestHStore.java:220)
> at
> org.apache.hadoop.hbase.regionserver.TestHStore.init(TestHStore.java:195)
> at
> org.apache.hadoop.hbase.regionserver.TestHStore.init(TestHStore.java:190)
> at
> org.apache.hadoop.hbase.regionserver.TestHStore.init(TestHStore.java:185)
> at
> org.apache.hadoop.hbase.regionserver.TestHStore.init(TestHStore.java:179)
> at
> org.apache.hadoop.hbase.regionserver.TestHStore.init(TestHStore.java:173)
> at
> org.apache.hadoop.hbase.regionserver.TestHStore.testRefreshStoreFiles(TestHStore.java:962)
> Caused by:
> org.apache.hadoop.hbase.util.CommonFSUtils$StreamLacksCapabilityException:
> hflush
> at
> org.apache.hadoop.hbase.regionserver.TestHStore.initHRegion(TestHStore.java:215)
> at
> org.apache.hadoop.hbase.regionserver.TestHStore.init(TestHStore.java:220)
> at
> org.apache.hadoop.hbase.regionserver.TestHStore.init(TestHStore.java:195)
> at
> org.apache.hadoop.hbase.regionserver.TestHStore.init(TestHStore.java:190)
> at
> org.apache.hadoop.hbase.regionserver.TestHStore.init(TestHStore.java:185)
> at
> org.apache.hadoop.hbase.regionserver.TestHStore.init(TestHStore.java:179)
> at
> org.apache.hadoop.hbase.regionserver.TestHStore.init(TestHStore.java:173)
> at
> org.apache.hadoop.hbase.regionserver.TestHStore.testRefreshStoreFiles(TestHStore.java:962)
> {code}
--
This message was sent by Atlassian JIRA
(v6.4.14#64029)
[jira] [Commented] (HBASE-19134) Make WALKey an Interface; expose Read-Only version to CPs
[
https://issues.apache.org/jira/browse/HBASE-19134?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16284173#comment-16284173
]
Hadoop QA commented on HBASE-19134:
---
| (x) *{color:red}-1 overall{color}* |
\\
\\
|| Vote || Subsystem || Runtime || Comment ||
| {color:blue}0{color} | {color:blue} reexec {color} | {color:blue} 3m
53s{color} | {color:blue} Docker mode activated. {color} |
|| || || || {color:brown} Prechecks {color} ||
| {color:blue}0{color} | {color:blue} findbugs {color} | {color:blue} 0m
0s{color} | {color:blue} Findbugs executables are not available. {color} |
| {color:green}+1{color} | {color:green} hbaseanti {color} | {color:green} 0m
0s{color} | {color:green} Patch does not have any anti-patterns. {color} |
| {color:green}+1{color} | {color:green} @author {color} | {color:green} 0m
0s{color} | {color:green} The patch does not contain any @author tags. {color} |
| {color:green}+1{color} | {color:green} test4tests {color} | {color:green} 0m
0s{color} | {color:green} The patch appears to include 31 new or modified test
files. {color} |
|| || || || {color:brown} master Compile Tests {color} ||
| {color:blue}0{color} | {color:blue} mvndep {color} | {color:blue} 0m
14s{color} | {color:blue} Maven dependency ordering for branch {color} |
| {color:green}+1{color} | {color:green} mvninstall {color} | {color:green} 5m
19s{color} | {color:green} master passed {color} |
| {color:green}+1{color} | {color:green} compile {color} | {color:green} 1m
22s{color} | {color:green} master passed {color} |
| {color:green}+1{color} | {color:green} checkstyle {color} | {color:green} 1m
43s{color} | {color:green} master passed {color} |
| {color:green}+1{color} | {color:green} shadedjars {color} | {color:green} 6m
37s{color} | {color:green} branch has no errors when building our shaded
downstream artifacts. {color} |
| {color:green}+1{color} | {color:green} javadoc {color} | {color:green} 0m
48s{color} | {color:green} master passed {color} |
|| || || || {color:brown} Patch Compile Tests {color} ||
| {color:blue}0{color} | {color:blue} mvndep {color} | {color:blue} 0m
13s{color} | {color:blue} Maven dependency ordering for patch {color} |
| {color:green}+1{color} | {color:green} mvninstall {color} | {color:green} 5m
33s{color} | {color:green} the patch passed {color} |
| {color:green}+1{color} | {color:green} compile {color} | {color:green} 1m
13s{color} | {color:green} the patch passed {color} |
| {color:green}+1{color} | {color:green} javac {color} | {color:green} 1m
13s{color} | {color:green} the patch passed {color} |
| {color:red}-1{color} | {color:red} checkstyle {color} | {color:red} 1m
18s{color} | {color:red} hbase-server: The patch generated 14 new + 692
unchanged - 19 fixed = 706 total (was 711) {color} |
| {color:green}+1{color} | {color:green} whitespace {color} | {color:green} 0m
0s{color} | {color:green} The patch has no whitespace issues. {color} |
| {color:green}+1{color} | {color:green} shadedjars {color} | {color:green} 4m
45s{color} | {color:green} patch has no errors when building our shaded
downstream artifacts. {color} |
| {color:green}+1{color} | {color:green} hadoopcheck {color} | {color:green}
57m 40s{color} | {color:green} Patch does not cause any errors with Hadoop
2.6.1 2.6.2 2.6.3 2.6.4 2.6.5 2.7.1 2.7.2 2.7.3 2.7.4 or 3.0.0-alpha4. {color} |
| {color:green}+1{color} | {color:green} javadoc {color} | {color:green} 0m
50s{color} | {color:green} the patch passed {color} |
|| || || || {color:brown} Other Tests {color} ||
| {color:red}-1{color} | {color:red} unit {color} | {color:red} 94m 55s{color}
| {color:red} hbase-server in the patch failed. {color} |
| {color:green}+1{color} | {color:green} unit {color} | {color:green} 10m
37s{color} | {color:green} hbase-mapreduce in the patch passed. {color} |
| {color:green}+1{color} | {color:green} asflicense {color} | {color:green} 0m
37s{color} | {color:green} The patch does not generate ASF License warnings.
{color} |
| {color:black}{color} | {color:black} {color} | {color:black}191m 54s{color} |
{color:black} {color} |
\\
\\
|| Subsystem || Report/Notes ||
| Docker | Client=17.05.0-ce Server=17.05.0-ce Image:yetus/hbase:eee3b01 |
| JIRA Issue | HBASE-19134 |
| JIRA Patch URL |
https://issues.apache.org/jira/secure/attachment/12901261/HBASE-19134.master.004.patch
|
| Optional Tests | asflicense javac javadoc unit findbugs shadedjars
hadoopcheck hbaseanti checkstyle compile |
| uname | Linux 062b041ea598 3.13.0-129-generic #178-Ubuntu SMP Fri Aug 11
12:48:20 UTC 2017 x86_64 GNU/Linux |
| Build tool | maven |
| Personality |
/home/jenkins/jenkins-slave/workspace/PreCommit-HBASE-Build/component/dev-support/hbase-personality.sh
|
| git revision | master / 139c3305a5 |
| maven | version: Apache Maven 3.5.2
(138edd61fd100ec658bfa2d307c43b76940a5d7d; 2017-10-18T07:58:13Z) |
| Default Java | 1.8.0_151 |
|
[jira] [Commented] (HBASE-11409) Add more flexibility for input directory structure to LoadIncrementalHFiles
[
https://issues.apache.org/jira/browse/HBASE-11409?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16284165#comment-16284165
]
Hadoop QA commented on HBASE-11409:
---
| (x) *{color:red}-1 overall{color}* |
\\
\\
|| Vote || Subsystem || Runtime || Comment ||
| {color:blue}0{color} | {color:blue} reexec {color} | {color:blue} 0m
17s{color} | {color:blue} Docker mode activated. {color} |
|| || || || {color:brown} Prechecks {color} ||
| {color:blue}0{color} | {color:blue} findbugs {color} | {color:blue} 0m
1s{color} | {color:blue} Findbugs executables are not available. {color} |
| {color:green}+1{color} | {color:green} hbaseanti {color} | {color:green} 0m
0s{color} | {color:green} Patch does not have any anti-patterns. {color} |
| {color:green}+1{color} | {color:green} @author {color} | {color:green} 0m
0s{color} | {color:green} The patch does not contain any @author tags. {color} |
| {color:green}+1{color} | {color:green} test4tests {color} | {color:green} 0m
0s{color} | {color:green} The patch appears to include 1 new or modified test
files. {color} |
|| || || || {color:brown} master Compile Tests {color} ||
| {color:green}+1{color} | {color:green} mvninstall {color} | {color:green} 8m
22s{color} | {color:green} master passed {color} |
| {color:green}+1{color} | {color:green} compile {color} | {color:green} 1m
36s{color} | {color:green} master passed {color} |
| {color:green}+1{color} | {color:green} checkstyle {color} | {color:green} 1m
48s{color} | {color:green} master passed {color} |
| {color:green}+1{color} | {color:green} shadedjars {color} | {color:green} 9m
0s{color} | {color:green} branch has no errors when building our shaded
downstream artifacts. {color} |
| {color:green}+1{color} | {color:green} javadoc {color} | {color:green} 1m
15s{color} | {color:green} master passed {color} |
|| || || || {color:brown} Patch Compile Tests {color} ||
| {color:green}+1{color} | {color:green} mvninstall {color} | {color:green} 8m
8s{color} | {color:green} the patch passed {color} |
| {color:green}+1{color} | {color:green} compile {color} | {color:green} 0m
47s{color} | {color:green} the patch passed {color} |
| {color:green}+1{color} | {color:green} javac {color} | {color:green} 0m
47s{color} | {color:green} the patch passed {color} |
| {color:red}-1{color} | {color:red} checkstyle {color} | {color:red} 1m
4s{color} | {color:red} hbase-server: The patch generated 1 new + 16 unchanged
- 1 fixed = 17 total (was 17) {color} |
| {color:green}+1{color} | {color:green} whitespace {color} | {color:green} 0m
0s{color} | {color:green} The patch has no whitespace issues. {color} |
| {color:green}+1{color} | {color:green} shadedjars {color} | {color:green} 4m
50s{color} | {color:green} patch has no errors when building our shaded
downstream artifacts. {color} |
| {color:green}+1{color} | {color:green} hadoopcheck {color} | {color:green}
72m 51s{color} | {color:green} Patch does not cause any errors with Hadoop
2.6.1 2.6.2 2.6.3 2.6.4 2.6.5 2.7.1 2.7.2 2.7.3 2.7.4 or 3.0.0-alpha4. {color} |
| {color:green}+1{color} | {color:green} javadoc {color} | {color:green} 0m
26s{color} | {color:green} the patch passed {color} |
|| || || || {color:brown} Other Tests {color} ||
| {color:green}+1{color} | {color:green} unit {color} | {color:green} 98m
14s{color} | {color:green} hbase-server in the patch passed. {color} |
| {color:green}+1{color} | {color:green} asflicense {color} | {color:green} 0m
17s{color} | {color:green} The patch does not generate ASF License warnings.
{color} |
| {color:black}{color} | {color:black} {color} | {color:black}202m 56s{color} |
{color:black} {color} |
\\
\\
|| Subsystem || Report/Notes ||
| Docker | Client=17.05.0-ce Server=17.05.0-ce Image:yetus/hbase:eee3b01 |
| JIRA Issue | HBASE-11409 |
| JIRA Patch URL |
https://issues.apache.org/jira/secure/attachment/12901259/HBASE-11409.v3.patch |
| Optional Tests | asflicense javac javadoc unit findbugs shadedjars
hadoopcheck hbaseanti checkstyle compile |
| uname | Linux c5970c2d9ddb 3.13.0-133-generic #182-Ubuntu SMP Tue Sep 19
15:49:21 UTC 2017 x86_64 GNU/Linux |
| Build tool | maven |
| Personality |
/home/jenkins/jenkins-slave/workspace/PreCommit-HBASE-Build/component/dev-support/hbase-personality.sh
|
| git revision | master / 5034411438 |
| maven | version: Apache Maven 3.5.2
(138edd61fd100ec658bfa2d307c43b76940a5d7d; 2017-10-18T07:58:13Z) |
| Default Java | 1.8.0_151 |
| checkstyle |
https://builds.apache.org/job/PreCommit-HBASE-Build/10304/artifact/patchprocess/diff-checkstyle-hbase-server.txt
|
| Test Results |
https://builds.apache.org/job/PreCommit-HBASE-Build/10304/testReport/ |
| modules | C: hbase-server U: hbase-server |
| Console output |
https://builds.apache.org/job/PreCommit-HBASE-Build/10304/console |
| Powered by | Apache Yetus 0.6.0 http://yetus.apache.org |
This message was automatically
[jira] [Commented] (HBASE-19387) HBase-spark snappy.SnappyError on Arm64
[
https://issues.apache.org/jira/browse/HBASE-19387?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16284151#comment-16284151
]
Hudson commented on HBASE-19387:
FAILURE: Integrated in Jenkins build HBase-Trunk_matrix #4190 (See
[https://builds.apache.org/job/HBase-Trunk_matrix/4190/])
HBASE-19387 Fix Hbase-spark Arm64 SnappyError (tedyu: rev
139c3305a5f3ab2fd09961aff415f66b7f89578b)
* (edit) hbase-spark/pom.xml
> HBase-spark snappy.SnappyError on Arm64
> ---
>
> Key: HBASE-19387
> URL: https://issues.apache.org/jira/browse/HBASE-19387
> Project: HBase
> Issue Type: Bug
> Components: spark, test
>Affects Versions: 3.0.0
>Reporter: Yuqi Gu
>Assignee: Yuqi Gu
>Priority: Minor
> Fix For: 3.0.0
>
> Attachments: HBASE-19387.patch
>
>
> When running the hbase-spark Unit tests on Arm64, the failures are shown as
> follows:
>
> {code:java}
> scalatest-maven-plugin:1.0:test (test) @ hbase-spark ---
> Discovery starting.
> Discovery completed in 2 seconds, 837 milliseconds.
> Run starting. Expected test count is: 79
> HBaseDStreamFunctionsSuite:
> Formatting using clusterid: testClusterID
> - bulkput to test HBase client *** FAILED ***
> java.lang.reflect.InvocationTargetException:
> at sun.reflect.NativeConstructorAccessorImpl.newInstance0(Native Method)
> at
> sun.reflect.NativeConstructorAccessorImpl.newInstance(NativeConstructorAccessorImpl.java:62)
> at
> sun.reflect.DelegatingConstructorAccessorImpl.newInstance(DelegatingConstructorAccessorImpl.java:45)
> at java.lang.reflect.Constructor.newInstance(Constructor.java:423)
> at
> org.apache.spark.io.CompressionCodec$.createCodec(CompressionCodec.scala:72)
> at
> org.apache.spark.io.CompressionCodec$.createCodec(CompressionCodec.scala:65)
> at
> org.apache.spark.broadcast.TorrentBroadcast.org$apache$spark$broadcast$TorrentBroadcast$$setConf(TorrentBroadcast.scala:73)
> at
> org.apache.spark.broadcast.TorrentBroadcast.(TorrentBroadcast.scala:80)
> at
> org.apache.spark.broadcast.TorrentBroadcastFactory.newBroadcast(TorrentBroadcastFactory.scala:34)
> at
> org.apache.spark.broadcast.BroadcastManager.newBroadcast(BroadcastManager.scala:63)
> ...
> Cause: java.lang.IllegalArgumentException: org.xerial.snappy.SnappyError:
> [FAILED_TO_LOAD_NATIVE_LIBRARY] no native library is found for os.name=Linux
> and os.arch=aarch64
> at
> org.apache.spark.io.SnappyCompressionCodec.(CompressionCodec.scala:156)
> at sun.reflect.NativeConstructorAccessorImpl.newInstance0(Native Method)
> at
> sun.reflect.NativeConstructorAccessorImpl.newInstance(NativeConstructorAccessorImpl.java:62)
> at
> sun.reflect.DelegatingConstructorAccessorImpl.newInstance(DelegatingConstructorAccessorImpl.java:45)
> at java.lang.reflect.Constructor.newInstance(Constructor.java:423)
> at
> org.apache.spark.io.CompressionCodec$.createCodec(CompressionCodec.scala:72)
> at
> org.apache.spark.io.CompressionCodec$.createCodec(CompressionCodec.scala:65)
> at
> org.apache.spark.broadcast.TorrentBroadcast.org$apache$spark$broadcast$TorrentBroadcast$$setConf(TorrentBroadcast.scala:73)
> at
> org.apache.spark.broadcast.TorrentBroadcast.(TorrentBroadcast.scala:80)
> at
> org.apache.spark.broadcast.TorrentBroadcastFactory.newBroadcast(TorrentBroadcastFactory.scala:34)
> ...
> Cause: org.xerial.snappy.SnappyError: [FAILED_TO_LOAD_NATIVE_LIBRARY] no
> native library is found for os.name=Linux and os.arch=aarch64
> at org.xerial.snappy.SnappyLoader.findNativeLibrary(SnappyLoader.java:331)
> at org.xerial.snappy.SnappyLoader.loadNativeLibrary(SnappyLoader.java:171)
> at org.xerial.snappy.SnappyLoader.load(SnappyLoader.java:152)
> at org.xerial.snappy.Snappy.(Snappy.java:46)
> at
> org.apache.spark.io.SnappyCompressionCodec.(CompressionCodec.scala:154)
> at sun.reflect.NativeConstructorAccessorImpl.newInstance0(Native Method)
> at
> sun.reflect.NativeConstructorAccessorImpl.newInstance(NativeConstructorAccessorImpl.java:62)
> at
> sun.reflect.DelegatingConstructorAccessorImpl.newInstance(DelegatingConstructorAccessorImpl.java:45)
> at java.lang.reflect.Constructor.newInstance(Constructor.java:423)
> at
> org.apache.spark.io.CompressionCodec$.createCodec(CompressionCodec.scala:72)
> ...
> Formatting using clusterid: testClusterID
> PartitionFilterSuite:
> *** RUN ABORTED ***
> java.lang.reflect.InvocationTargetException:
> at sun.reflect.NativeConstructorAccessorImpl.newInstance0(Native Method)
> at
> sun.reflect.NativeConstructorAccessorImpl.newInstance(NativeConstructorAccessorImpl.java:62)
> at
> sun.reflect.DelegatingConstructorAccessorImpl.newInstance(DelegatingConstructorAccessorImpl.java:45)
> at java.lang.reflect.Constructor.newInstance(Constructor.java:423)
> at
>
[jira] [Commented] (HBASE-19289) CommonFSUtils$StreamLacksCapabilityException: hflush when running test against hadoop3 beta1
[
https://issues.apache.org/jira/browse/HBASE-19289?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16284123#comment-16284123
]
Mike Drob commented on HBASE-19289:
---
Setting a property on the conf doesn't work for the tests in hbase-server
because the FS is already created and then gets pulled out of the cache in
{{FSHLogProvider.createWAL()}}, need to do the DFSCluster approach here...
v4 coming soon.
> CommonFSUtils$StreamLacksCapabilityException: hflush when running test
> against hadoop3 beta1
>
>
> Key: HBASE-19289
> URL: https://issues.apache.org/jira/browse/HBASE-19289
> Project: HBase
> Issue Type: Test
>Reporter: Ted Yu
>Assignee: Mike Drob
>Priority: Critical
> Fix For: 2.0.0-beta-1
>
> Attachments: 19289.v1.txt, 19289.v2.txt, HBASE-19289.patch,
> HBASE-19289.v2.patch, HBASE-19289.v3.patch
>
>
> As of commit d8fb10c8329b19223c91d3cda6ef149382ad4ea0 , I encountered the
> following exception when running unit test against hadoop3 beta1:
> {code}
> testRefreshStoreFiles(org.apache.hadoop.hbase.regionserver.TestHStore) Time
> elapsed: 0.061 sec <<< ERROR!
> java.io.IOException: cannot get log writer
> at
> org.apache.hadoop.hbase.regionserver.TestHStore.initHRegion(TestHStore.java:215)
> at
> org.apache.hadoop.hbase.regionserver.TestHStore.init(TestHStore.java:220)
> at
> org.apache.hadoop.hbase.regionserver.TestHStore.init(TestHStore.java:195)
> at
> org.apache.hadoop.hbase.regionserver.TestHStore.init(TestHStore.java:190)
> at
> org.apache.hadoop.hbase.regionserver.TestHStore.init(TestHStore.java:185)
> at
> org.apache.hadoop.hbase.regionserver.TestHStore.init(TestHStore.java:179)
> at
> org.apache.hadoop.hbase.regionserver.TestHStore.init(TestHStore.java:173)
> at
> org.apache.hadoop.hbase.regionserver.TestHStore.testRefreshStoreFiles(TestHStore.java:962)
> Caused by:
> org.apache.hadoop.hbase.util.CommonFSUtils$StreamLacksCapabilityException:
> hflush
> at
> org.apache.hadoop.hbase.regionserver.TestHStore.initHRegion(TestHStore.java:215)
> at
> org.apache.hadoop.hbase.regionserver.TestHStore.init(TestHStore.java:220)
> at
> org.apache.hadoop.hbase.regionserver.TestHStore.init(TestHStore.java:195)
> at
> org.apache.hadoop.hbase.regionserver.TestHStore.init(TestHStore.java:190)
> at
> org.apache.hadoop.hbase.regionserver.TestHStore.init(TestHStore.java:185)
> at
> org.apache.hadoop.hbase.regionserver.TestHStore.init(TestHStore.java:179)
> at
> org.apache.hadoop.hbase.regionserver.TestHStore.init(TestHStore.java:173)
> at
> org.apache.hadoop.hbase.regionserver.TestHStore.testRefreshStoreFiles(TestHStore.java:962)
> {code}
--
This message was sent by Atlassian JIRA
(v6.4.14#64029)
[jira] [Commented] (HBASE-18625) Splitting of region with replica, doesn't update region list in serverHolding. A server crash leads to overlap.
[
https://issues.apache.org/jira/browse/HBASE-18625?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16284101#comment-16284101
]
huaxiang sun commented on HBASE-18625:
--
With the latest code, I am still able to reproduce the inconsistencies. I am
going to investigate and report back.
> Splitting of region with replica, doesn't update region list in
> serverHolding. A server crash leads to overlap.
> ---
>
> Key: HBASE-18625
> URL: https://issues.apache.org/jira/browse/HBASE-18625
> Project: HBase
> Issue Type: Improvement
>Affects Versions: 1.2.6
>Reporter: Igloo
>Assignee: huaxiang sun
> Fix For: 1.2.8
>
>
> The situation can appear in following steps in release hbase1.2.6
> 1. create 'testtable', 'info', {REGION_REPLICATION=>2}
> 2. write somerecords into 'testtable'
> 3. split the table 'testtable'
> 4. after the spliting, the serverHoldings in RegionStates still holds the
> regioninfo for the replica of parent region
> 5. restart the regionserver where the parent replica-region located
> 6. the offlined replica of parent region will be assigned in
> ServerCrashProcedure.
> hbase hbck 'testtable‘
> ERROR: Region { meta => null, hdfs => null, deployed =>
> qabb-qa-hdp-hbase1,16020,1503022958093;testtable,,1503022907686_0001.42d11cfe195b3cc4d08b2c078a687f6d
> ., replicaId => 1 } not in META, but deployed on
> qabb-qa-hdp-hbase1,16020,1503022958093
> 18 ERROR: No regioninfo in Meta or HDFS. { meta => null, hdfs => null,
> deployed =>
> qabb-qa-hdp-hbase1,16020,1503022958093;testtable,,1503022907686_0001.42d11cfe
>195b3cc4d08b2c078a687f6d., replicaId => 1 }
--
This message was sent by Atlassian JIRA
(v6.4.14#64029)
[jira] [Commented] (HBASE-19134) Make WALKey an Interface; expose Read-Only version to CPs
[ https://issues.apache.org/jira/browse/HBASE-19134?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16284094#comment-16284094 ] stack commented on HBASE-19134: --- .005 addresses [~anoop.hbase] suggestions. > Make WALKey an Interface; expose Read-Only version to CPs > - > > Key: HBASE-19134 > URL: https://issues.apache.org/jira/browse/HBASE-19134 > Project: HBase > Issue Type: Bug > Components: Coprocessors, wal >Reporter: stack >Assignee: stack > Fix For: 2.0.0-beta-1 > > Attachments: HBASE-19134.master.001.patch, > HBASE-19134.master.002.patch, HBASE-19134.master.003.patch, > HBASE-19134.master.004.patch, HBASE-19134.master.005.patch > > > WALKey has been made IA.Private in hbase2. Even so, given we don't have an > alternative to expose at this time, it is exposed to coprocessors still at a > few (now deprecated) locations. > In review of HBASE-18770, [~chia7712] makes reasonable suggestion that what > we expose to CPs be a read-only WALKey. He gets pushback on doing this for > hbase2 (Do we even want to expose WALKey to CPs, is WALKey right going > forward, etc.). Chia-Ping comes back w/ the below (copied from HBASE-18770): > What we want to fix for WALKey are shown below. > * expose some methods to CP user safety > * refactor/redo > As I see it, adding an interface exposed to CP user for WALKey is a right > choice because it can bring some benefit. > * We can expose part of WALKey's methods to CP users - a read-only interface > or an interface with some modifiable setting. > * The related CP hooks won't be deprecated > * Doing the refactor for WALKey doesn't essentially impact the CP hook after > 2.0 release. > Although, it will be better to redo WALKey before 2.0 release. In short, I > think it warrants such an interface. > (We both agree this would be a load of work given WALKey is written to > HFiles. Warrants a look though). -- This message was sent by Atlassian JIRA (v6.4.14#64029)
[jira] [Updated] (HBASE-19134) Make WALKey an Interface; expose Read-Only version to CPs
[ https://issues.apache.org/jira/browse/HBASE-19134?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] stack updated HBASE-19134: -- Attachment: HBASE-19134.master.005.patch > Make WALKey an Interface; expose Read-Only version to CPs > - > > Key: HBASE-19134 > URL: https://issues.apache.org/jira/browse/HBASE-19134 > Project: HBase > Issue Type: Bug > Components: Coprocessors, wal >Reporter: stack >Assignee: stack > Fix For: 2.0.0-beta-1 > > Attachments: HBASE-19134.master.001.patch, > HBASE-19134.master.002.patch, HBASE-19134.master.003.patch, > HBASE-19134.master.004.patch, HBASE-19134.master.005.patch > > > WALKey has been made IA.Private in hbase2. Even so, given we don't have an > alternative to expose at this time, it is exposed to coprocessors still at a > few (now deprecated) locations. > In review of HBASE-18770, [~chia7712] makes reasonable suggestion that what > we expose to CPs be a read-only WALKey. He gets pushback on doing this for > hbase2 (Do we even want to expose WALKey to CPs, is WALKey right going > forward, etc.). Chia-Ping comes back w/ the below (copied from HBASE-18770): > What we want to fix for WALKey are shown below. > * expose some methods to CP user safety > * refactor/redo > As I see it, adding an interface exposed to CP user for WALKey is a right > choice because it can bring some benefit. > * We can expose part of WALKey's methods to CP users - a read-only interface > or an interface with some modifiable setting. > * The related CP hooks won't be deprecated > * Doing the refactor for WALKey doesn't essentially impact the CP hook after > 2.0 release. > Although, it will be better to redo WALKey before 2.0 release. In short, I > think it warrants such an interface. > (We both agree this would be a load of work given WALKey is written to > HFiles. Warrants a look though). -- This message was sent by Atlassian JIRA (v6.4.14#64029)
[jira] [Commented] (HBASE-19435) Reopen Files for ClosedChannelException in BucketCache
[ https://issues.apache.org/jira/browse/HBASE-19435?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16284076#comment-16284076 ] Zach York commented on HBASE-19435: --- [~stack] Unfortunately I'm still working on the reproduction from my side and don't have the helpful logs :( [~ram_krish] Where in the code does it evict blocks in a compaction (just for my own learning, I understand it's not as important here). I'm thinking that your proposition might be correct. This is a major compaction after heavy ingestion with a few key cache configs that cause heavy cache usage (prefetch on open, cache on write, cache on read, etc). > Reopen Files for ClosedChannelException in BucketCache > -- > > Key: HBASE-19435 > URL: https://issues.apache.org/jira/browse/HBASE-19435 > Project: HBase > Issue Type: Bug > Components: BucketCache >Affects Versions: 2.0.0, 1.3.1 >Reporter: Zach York >Assignee: Zach York > Fix For: 1.4.1, 2.0.0-beta-1 > > Attachments: HBASE-19435.branch-1.001.patch, > HBASE-19435.master.001.patch, HBASE-19435.master.002.patch, > HBASE-19435.master.003.patch, HBASE-19435.master.004.patch, > HBASE-19435.master.005.patch, HBASE-19435.master.006.patch, > HBASE-19435.master.007.patch, HBASE-19435.master.007.patch > > > When using the FileIOEngine for BucketCache, the cache will be disabled if > the connection is interrupted or closed. HBase will then get > ClosedChannelExceptions trying to access the file. After 60s, the RS will > disable the cache. This causes severe read performance degradation for > workloads that rely on this cache. FileIOEngine never tries to reopen the > connection. This JIRA is to reopen files when the BucketCache encounters a > ClosedChannelException. -- This message was sent by Atlassian JIRA (v6.4.14#64029)
