Re: FilterList passing RowFilter and QualifierFilter

It works fine when I apply rowfilter and qualifier filter and pass one rowid and one qualifier . I am passing more than one rowid's and one or more qualifiers and it doesn't seem to work . with MUST_PASS_ALL. it doesn't return anything, but with MUST_PASS_ONE it returns incorrect results.

Re: HBase major compaction schedule

Please see bullet #7 in http://hbase.apache.org/book.html#compaction.ratiobasedcompactionpolicy.algorithm Search for 'hbase.hstore.compaction.ratio.offpeak' and you will see related config parameters. On Fri, Jan 13, 2017 at 8:43 PM, spats wrote: > Thanks Ted, > > Yes

Re: HBase major compaction schedule

Thanks Ted, Yes reducing jitter value should help running major compactions only during certain range & not spill over whole week. But still problem is major compaction can run on any day, irrespective of cluster load. Yes, cluster load will be less on weekends so was exploring if there is way

Re: HBase major compaction schedule

For #1, see the following config: hbase.hregion.majorcompaction.jitter 0.50 A multiplier applied to hbase.hregion.majorcompaction to cause compaction to occur a given amount of time either side of hbase.hregion.majorcompaction. The smaller the number, the closer the

HBase major compaction schedule

Few questions regarding major compaction, would be great if someone can answer them 1. If major compaction schedule is set to say 7 days, on which day (like sat, sun etc) major compaction triggered? 2. Is there a way to configure major compaction on specific day? like sat 3. Running major

Re: Region comapction failed

w.r.t. #2, I did a quick search for bloom related fixes. I found HBASE-13123 but it was in 1.0.2 Planning to spend more time in the next few days. On Fri, Jan 13, 2017 at 5:29 PM, Pankaj kr wrote: > Thanks Ted for replying. > > Actually issue happened in production

Re: HBase Thrift Client for C#: OutofMemoryException

here you go: https://issues.apache.org/jira/browse/HBASE-17467 From: Ted Yu Sent: Friday, January 13, 2017 4:02 PM To: user@hbase.apache.org Subject: Re: HBase Thrift Client for C#: OutofMemoryException bq. i can create a pull request for

Re: HBase Thrift Client for C#: OutofMemoryException

bq. i can create a pull request for them That would be wonderful. Please log a JIRA, polish the C# example and attach to the JIRA. In hbase, we're not at the stage of reviewing / committing pull request yet. On Fri, Jan 13, 2017 at 3:45 PM, jeff saremi wrote: > sorry

Re: HBase Thrift Client for C#: OutofMemoryException

sorry Ted for wasting your time It happened that i was using the wrong port for this What a misleading error for an error so common! but that's Thrift On another note i now have converted the Democlient to from hbase-examples to C# and i have the generated files as well. If there's interest i

Re: StochasticLoadBalancer questions

Regarding #1, my main concern is that if we poll the region load at a "bad" time and get back an abnormally high or low value, the balancer could over react. For example if your regions most recent readRequestsCount is 100 and you've been seeing 5 for the last 9 times you polled, the "average"

Re: HBase Thrift Client for C#: OutofMemoryException

Thanks Ted. I looked at this. We didn't know that a multipexing protocol existed until you mentioned it to us. We're using a stock thrift server that is shipped with hbase. If you perhaps point us to where we should be checking I'd be appreciative. From: Ted

Re: StochasticLoadBalancer questions

For #2, you're more than welcome to attach patch on the JIRA. For #1, last time I tried to trace which JIRA introduced the formula but ended up with one Elliott did which just moved that line of code. I can spend more time in the future on this. What downside have you observed for #1 ? Cheers

Re: HBase Thrift Client for C#: OutofMemoryException

I haven't touched C# for a decade. After a brief search, I found: http://stackoverflow.com/questions/17843749/apache-thrift-client-run-time-issues-in-c-sharp Can you take a look at the answer to see if it is relevant ? Cheers On Fri, Jan 13, 2017 at 11:10 AM, jeff saremi

Re: HBase Thrift Client for C#: OutofMemoryException

I am not sure about compatibility between thrift 0.10.0 and 0.9.3 Is it possible for you to locate 0.9.3 thrift compiler and try again ? On Fri, Jan 13, 2017 at 10:27 AM, jeff saremi wrote: > I used the following thrift compiler. I did not see any mentions of >

Re: HBase Thrift Client for C#: OutofMemoryException

I did a x64 compilation I get a {"Cannot read, Remote side has closed"} Thrift.TException {Thrift.Transport.TTransportException} with no further details From: jeff saremi Sent: Friday, January 13, 2017 10:27 AM To:

Re: HBase Thrift Client for C#: OutofMemoryException

I used the following thrift compiler. I did not see any mentions of versions. http://www.apache.org/dyn/closer.cgi?path=/thrift/0.10.0/thrift-0.10.0.exe Here's the stack trace. I am running ANYCPU platform: private string ReadStringBody(int size) { byte[] buf = new

Re: StochasticLoadBalancer questions

Logged HBASE-17462 for #2. FYI On Thu, Jan 12, 2017 at 8:49 AM, Ted Yu wrote: > For #2, I think MemstoreSizeCostFunction belongs to the same category if > we are to adopt moving average. > > Some factors to consider: > > The data structure used by StochasticLoadBalancer

Re: HBase Thrift Client for C#: OutofMemoryException

Which thrift version did you use to generate c# code ? hbase uses 0.9.3 Can you pastebin the whole stack trace for the exception ? I assume you run your code on 64-bit machine. Cheers On Fri, Jan 13, 2017 at 9:53 AM, jeff saremi wrote: > I have cloned the latest

Re: FilterList passing RowFilter and QualifierFilter

According to your description, MUST_PASS_ONE should not be used. Please use MUST_PASS_ALL. Cheers On Fri, Jan 13, 2017 at 10:02 AM, Prahalad kothwal wrote: > Yes through FilterList > > FilterList filterList = new FilterList(FilterList.Operator.MUST_PASS_ONE); >

Re: FilterList passing RowFilter and QualifierFilter

Yes through FilterList FilterList filterList = new FilterList(FilterList.Operator.MUST_PASS_ONE); for(String rowid : rowIds){ rowFilter = new RowFilter(CompareFilter.CompareOp.EQUAL, new BinaryComparator(Bytes.toBytes(rowid))); filterList.addFilter(rowFilter); filter = new

HBase Thrift Client for C#: OutofMemoryException

I have cloned the latest thrift and hbase code. Used thrift generator to generate c# code from hbase-thrift\src\main\resources\org\apache\hadoop\hbase\thrift. Then created a single VS solution with the generated code, the thrift lib for c# (thrift\lib\csharp\src\Thrift.csproj) and i also added

Re: SocketTimeoutException on regionservers

Any comments? On Thu, Jan 12, 2017 at 10:18 AM, Tulasi Paradarami < tulasi.krishn...@gmail.com> wrote: > Hi, > > I noticed that Regionservers are raising following exceptions > intermittently that is manifesting itself as request timeouts on the client > side. HDFS is in a healthy state and

Re: FilterList passing RowFilter and QualifierFilter

Can you illustrate how the two filters were combined (I assume through FilterList) ? I think the order of applying the filters should be RowFilter followed by QualifierFilter. Cheers On Fri, Jan 13, 2017 at 6:55 AM, Prahalad kothwal wrote: > Hi , > > Can I pass both

FilterList passing RowFilter and QualifierFilter

Hi , Can I pass both RowFilter and QualifierFilter and expect HBase to filter on both rowkey and Qualifier ? I tried applying both filters but I am not getting accurate results. Any help is appreciated . Thanks, Prahalad

Re: Region comapction failed

In the second case, the error happened when writing hfile. Can you track down the path of the new file so that further investigation can be done ? Does the table use any encoding ? Thanks > On Jan 13, 2017, at 2:47 AM, Pankaj kr wrote: > > Hi, > > We met a weird issue

Region comapction failed

Hi, We met a weird issue in our production environment. Region compaction is always failing with following errors, 1. 2017-01-10 02:19:10,427 | ERROR | regionserver/RS-HOST/RS-IP:PORT-longCompactions-1483858654825 | Compaction failed Request = regionName=., storeName=XYZ, fileCount=6,