________________________________ From: Terence Yim <cht...@apache.org> Sent: 16 May 2019 14:39 To: dev Cc: Rishabh Budhouliya Subject: Fwd: Regarding Twill changes in HDP 3.1
Forward to the dev@ for wider discussion ---------- Forwarded message --------- From: Rishabh Budhouliya <rishabh.budhoul...@external.thalesgroup.com<mailto:rishabh.budhoul...@external.thalesgroup.com>> Date: Thu, May 16, 2019 at 1:06 AM Subject: Re: Regarding Twill changes in HDP 3.1 To: Terence Yim <cht...@apache.org<mailto:cht...@apache.org>> Okay, sure, please find the logs attached below. Thanks, Rishabh ________________________________ From: Terence Yim <cht...@apache.org<mailto:cht...@apache.org>> Sent: 16 May 2019 13:17 To: Rishabh Budhouliya Cc: dev Subject: Re: Regarding Twill changes in HDP 3.1 Hi, We haven't tested Twill compatibility with Hadoop 3, which is what used by HDP 3.1. Do you have the yarn application logs for the workflow and/or the map reduce program to help us debug this issue? Thanks, Terence On Wed, May 15, 2019 at 10:41 PM Rishabh Budhouliya <rishabh.budhoul...@external.thalesgroup.com<mailto:rishabh.budhoul...@external.thalesgroup.com>> wrote: Hi, I have been testing CDAP v5.1.2 with a HDP 3.1 cluster and there is an issue in running a pipeline, particularly in the MapReduce program 'phase-1' with error "ClassNotFoundException : co.cask.cdap.etl.api.batch.BatchSource". Now, I know this is not the cdap-user group, but we think that this issue might somehow stem from Twill version upgrade, maybe the way class are being loaded by the container? Just wanted to know if there is some change in HDP 3.1 which we are missing, any pointers would be great ! Regards, Rishabh Budhouliya
