@Stack: Inline On Wed, Sep 4, 2013 at 2:32 PM, Stack <[email protected]> wrote:
> Anil: > > You having GC'ing issues Anil? You hitting Full GCs pretty regularly? > While testing my cluster, i did a full table scan on a table having 600 million records(at that time very few writes were going on). I was getting around 26sec GC's. Our JVM heap is ~30 GB. This was done around 2 month ago. Doing full table scan took us 15 min. I dont remember much more details about it. > > (Setting up a jenkins build as Lars suggests or having us add a note to the > website somewhere saying 0.94 runs on jdk7 -- presuming it passes a couple > of jenkins builds -- would be no problem... just say what you need). > I think we are good since Cloudera has certified HBase with JDK7. Cloudera is our Hadoop vendor. > > St.Ack > > > On Wed, Sep 4, 2013 at 2:17 PM, anil gupta <[email protected]> wrote: > > > Inline. > > > > On Tue, Sep 3, 2013 at 11:04 PM, Elliott Clark <[email protected]> > wrote: > > > > > So since the first question is vendor specific, lets take that off > list. > > > > > > The core dumps are mostly while starting a region server up under > > > load, but they are concerning. They are on JDK 1.7.15, which isn't > > > the newest. So I'm hoping that release 25 will help. > > > > > Anil: Yes, trying out 25 will be better. It would be great if you can > share > > your results whenever your try out 1.7u25. Meanwhile, i will also try to > do > > the same in my environment. > > > > > > > > I also run YCSB on the cluster after all the tests and during those > > > runs the region servers have been very stable. > > > > > > On Tue, Sep 3, 2013 at 10:42 PM, anil gupta <[email protected]> > > wrote: > > > > Hi Elliot, > > > > > > > > That's cool! > > > > We have CDH Enterprise license. Would you mind pointing me to the > > > doc/link > > > > that states same? > > > > However, core dumps sounds bad for prod environment. Are there any > > > specific > > > > patterns for core-dumps? Does it only happens under very heavy load? > If > > > > yes, then how much read/write load? > > > > > > > > If you want to take this offline, i am fine with that also. > > > > > > > > Thanks, > > > > Anil > > > > > > > > > > > > On Tue, Sep 3, 2013 at 10:26 PM, Elliott Clark <[email protected]> > > > wrote: > > > > > > > >> Cloudera (my employer) has certified their distribution(CDH4.2+) on > > > >> JDK7. That includes HBase 94. I'm sure they would answer questions > > > >> about what was tested, on their mailing lists or forums. > > > >> > > > >> I imagine that Hortonworks has done similar testing though I am not > as > > > >> well versed in it. > > > >> > > > >> I personally been running a test cluster with Integration tests (for > > > >> 0.96) on jdk7, G1 gc, and 30 gig heaps for a couple of months now. > > > >> There have been a couple of times that the region servers have core > > > >> dumped because of the JVM. However I would say the region servers > are > > > >> some what stable with JDK 1.07.15 and the G1gc. My test cluster is > > > >> pretty taxed and your milage might vary; it's worth testing on your > > > >> workload. > > > >> > > > >> I'm currently upgrading the jvm to release 25 hoping that the core > > > >> dumps will be solved. > > > >> > > > >> On Tue, Sep 3, 2013 at 10:06 PM, anil gupta <[email protected]> > > > wrote: > > > >> > Also, if HBase0.94 is officially certified to work with JDK7 then > it > > > will > > > >> > save duplicate work from Individual users like me and you. > Currently > > > GC > > > >> > with big JVM heaps is a big concern with HBase. If users will get > > > options > > > >> > to use G1GC then it might alleviate some pains of many HBase > users. > > > >> > > > > >> > > > > >> > On Tue, Sep 3, 2013 at 10:03 PM, anil gupta < > [email protected]> > > > >> wrote: > > > >> > > > > >> >> Hi Lars, > > > >> >> > > > >> >> Even if we setup Jenkins with JDK7 then also we wont be able to > use > > > JDK7 > > > >> >> in prod HBase cluster. Beacuse, as per our process, we can only > use > > > the > > > >> JDK > > > >> >> that is certified by Apache HBase. If we don't follow this rule > > then > > > >> IT/DBA > > > >> >> folks wont support us. That's why i am looking for JDK7 > > > certification of > > > >> >> HBase0.94. It would be great if an official certification can be > > > done. > > > >> >> > > > >> >> Thanks, > > > >> >> Anil > > > >> >> > > > >> >> > > > >> >> On Tue, Sep 3, 2013 at 5:35 PM, lars hofhansl <[email protected]> > > > wrote: > > > >> >> > > > >> >>> We (Salesforce) are using HBase with JDK7. No issues seen so > far. > > > >> >>> > > > >> >>> 0.94 is not "officially certified" to work on JDK7 (we have no > > JDK7 > > > >> >>> jenkins, etc). > > > >> >>> > > > >> >>> It might be good to setup a JDK7 jenkins for 0.94. Any > objections > > to > > > >> >>> doing that? > > > >> >>> > > > >> >>> -- Lars > > > >> >>> > > > >> >>> > > > >> >>> > > > >> >>> ----- Original Message ----- > > > >> >>> From: anil gupta <[email protected]> > > > >> >>> To: "[email protected]" <[email protected]> > > > >> >>> Cc: > > > >> >>> Sent: Tuesday, September 3, 2013 4:26 PM > > > >> >>> Subject: (HBASE-5261)HBase 0.94 cerification for JDK7 > > > >> >>> > > > >> >>> Hi All, > > > >> >>> > > > >> >>> We are thinking of running HBase(we have JVM heaps larger than > 25 > > > GB) > > > >> with > > > >> >>> JDK7 to use G1 garbage collection, but as a precaution we would > > like > > > >> HBase > > > >> >>> to be certified with JDK7. I see this ticket for same: > > > >> >>> https://issues.apache.org/jira/browse/HBASE-5261 > > > >> >>> Above havent had any activity from November, 2012. Are there any > > > >> timelines > > > >> >>> to certify HBase 0.94 with JDK7? > > > >> >>> > > > >> >>> -- > > > >> >>> Thanks & Regards, > > > >> >>> Anil Gupta > > > >> >>> > > > >> >>> > > > >> >> > > > >> >> > > > >> >> -- > > > >> >> Thanks & Regards, > > > >> >> Anil Gupta > > > >> >> > > > >> > > > > >> > > > > >> > > > > >> > -- > > > >> > Thanks & Regards, > > > >> > Anil Gupta > > > >> > > > > > > > > > > > > > > > > -- > > > > Thanks & Regards, > > > > Anil Gupta > > > > > > > > > > > -- > > Thanks & Regards, > > Anil Gupta > > > -- Thanks & Regards, Anil Gupta
