Steve, After a few small code changes and some pom updates Blur now works with cdh5-mr1.
https://builds.apache.org/job/Blur-master-jdk7-hadoop2-mr1/7/ https://builds.apache.org/job/Blur-master-jdk7-hadoop2-mr1/7/org.apache.blur$apache-blur/ Aaron On Mon, Jun 30, 2014 at 3:38 PM, Aaron McCurry <[email protected]> wrote: > Sure we can do that. I will let you know what I find. > > Aaron > > > On Mon, Jun 30, 2014 at 3:36 PM, Sak, Steve <[email protected]> > wrote: > >> >> The testing would be enormously helpful if you had CHD5 configured to use >> MR1 as opposed to YARN, less so against straight CDH5. >> >> -- Steve >> >> ________________________________________ >> From: Aaron McCurry [[email protected]] >> Sent: Monday, June 30, 2014 3:27 PM >> To: [email protected] >> Subject: Re: CDH5 MR1 >> >> On Mon, Jun 30, 2014 at 3:24 PM, Sak, Steve <[email protected]> >> wrote: >> >> > >> > Aaron, >> > >> > It's not CDH5 per se that is raising the risk profile but rather >> > Cloudera's implementation of Map Reduce 1 with CDH5. They have custom >> libs >> > built for hadoop-core, hadoop-minicluster, hadoop-client, and >> hadoop-test >> > all versioned as 2.3.0-mr1-cdh5.0.2 as well as all the MR1 daemons (NN, >> TT, >> > JT) using the hadoop2 filesystem. >> > >> >> I don't mind testing Blur against CDH5 if you would like... Would that >> help? Or no? >> >> Aaron >> >> >> >> > >> > -- Steve >> > >> > ________________________________________ >> > From: Aaron McCurry [[email protected]] >> > Sent: Monday, June 30, 2014 3:10 PM >> > To: [email protected] >> > Subject: Re: CDH5 MR1 >> > >> > On Mon, Jun 30, 2014 at 2:33 PM, Sak, Steve <[email protected]> >> > wrote: >> > >> > > >> > > Has anyone gotten Blur built against Cloudera CDH5 using the MR1 >> > libraries >> > > and done any testing? How likely is it to work? I'm close to passing >> > the >> > > unit tests but the poms are a hodgepodge and our project is quickly >> > > approaching a decision point as to what direction to take. We were >> > > thinking that CDH5 MR1 would provide a medium risk option on the road >> to >> > > Hadoop 2 and Yarn but perhaps were too low in our risk assessment. >> > > >> > >> > We currently run hadoop2 builds CI on Apache's servers. The build run's >> > against hadoop 2.2.0 and I have successfully run Blur on HDP 2.1 (based >> on >> > hadoop 2.4.0). I don't mind running the tests and minicluster against >> CDH5 >> > if this will help in your decision making process. >> > >> > https://builds.apache.org/job/Blur-master-jdk7-hadoop2/ >> > >> > Thanks! >> > >> > Aaron >> > >> > >> > > >> > > Thanks, >> > > >> > > Steve >> > > >> > >> > >
