Here is the strange part: Where we make changes to core-site.xml, re-deploy the stale client configs from the cloudera manager, and restart the affected services we get into the NoClassDefound state. In order to get past it we needed to restart impala dameons, catalog server etc again from the cloudera manager. Then it begins to work.
I can reproduce this but very inconsistently though. Is there any logs you want me to be looking at ? On Tue, Apr 5, 2016 at 10:26 AM Skye Wanderman-Milne <[email protected]> wrote: > In case others run into similar issues, can you share how you resolved the > NoClassDefFoundErrors? > > On Mon, Apr 4, 2016 at 10:21 PM, Henry Robinson <[email protected]> > wrote: > >> >> >> On 4 April 2016 at 17:55, Pradeep Nayak <[email protected]> wrote: >> >>> Also just wanted to understand one more thing. >>> http://www.cloudera.com/documentation/enterprise/5-5-x/topics/impala_s3.html >>> It >>> mentions that impala needs to have a default file system which is hdfs, but >>> not just s3a, or any other filesystem which extends Hadoop FileSystem class >>> ? Is there plans to support non hdfs filesystem as default ? >>> >> >> Yes there are - see IMPALA-1850 (code review >> http://gerrit.cloudera.org:8080/#/c/1121/). >> >> Henry >> >> >>> >>> Meanwhile I got around the problem earlier. I can query tables, do a >>> count(*), etc. >>> >>> However join is causing a problem... >>> >>> *select * from tab1 join tab2;* >>> >>> *Query: select * from tab1 join tab2* >>> >>> *ERROR:* >>> >>> *Failed to connect to FS* >>> >>> *Error(255): Unknown error 255* >>> >>> >>> Pradeep >>> >>> On Mon, Apr 4, 2016 at 3:31 PM Pradeep Nayak <[email protected]> >>> wrote: >>> >>>> That's what been puzzling me as well :(. Let me get back to you with >>>> that information. >>>> >>>> Pradeep >>>> >>>> On Mon, Apr 4, 2016 at 3:28 PM Skye Wanderman-Milne <[email protected]> >>>> wrote: >>>> >>>>> Actually, I didn't read your exception carefully and didn't notice >>>>> that it can't find an Impala class, so it's probably not a dependency >>>>> issue. >>>>> >>>>> Can you restart your cluster, rerun a select * query, and then search >>>>> your logs for that "NoClassDefFoundError"? That will tell us which process >>>>> the error is coming from. That class is included in the FE jar, so I'm not >>>>> sure why it wouldn't be able to find it. >>>>> >>>>> >>>>> On Mon, Apr 4, 2016 at 3:14 PM, Pradeep Nayak <[email protected]> >>>>> wrote: >>>>> >>>>>> Sure Skye. I didn't notice the to: list as well until you pointed >>>>>> out. I really appreciate your help here. >>>>>> >>>>>> I haven't modified the pom.xml for the front-end here: >>>>>> https://github.com/cloudera/Impala/blob/cdh5.5.2-release/fe/pom.xml >>>>>> >>>>>> I am just building with this at the moment. mvn clean package >>>>>> -DSkipTests = true from the fe folder. >>>>>> >>>>>> >>>>>> On Mon, Apr 4, 2016 at 3:11 PM Skye Wanderman-Milne < >>>>>> [email protected]> wrote: >>>>>> >>>>>>> Ah didn't mean to take this off the dev list. Also add our new >>>>>>> [email protected] list. >>>>>>> >>>>>>> Can you check what dependency versions you're pulling in from maven? >>>>>>> My guess is that you're somehow building with non-CDH5.5.2 frontend >>>>>>> dependencies. >>>>>>> >>>>>>> On Mon, Apr 4, 2016 at 3:04 PM, Pradeep Nayak <[email protected] >>>>>>> > wrote: >>>>>>> >>>>>>>> Umm, I am trying to test this on a dev cluster which has cloudera >>>>>>>> parcels already installed. I just re-placed >>>>>>>> impala-frontend-0.1-SNAPSHOT.jar with my version. Do I need to change >>>>>>>> anything on the dev cluster ? >>>>>>>> >>>>>>>> On Mon, Apr 4, 2016 at 2:43 PM Skye Wanderman-Milne < >>>>>>>> [email protected]> wrote: >>>>>>>> >>>>>>>>> Try: source $IMPALA_HOME/bin/set-classpath.sh >>>>>>>>> >>>>>>>>> If you recently switched branches, you may want to close your >>>>>>>>> current terminal, open a new one, and re-source >>>>>>>>> $IMPALA_HOME/bin/impala-config.sh and set-classpath.sh. >>>>>>>>> >>>>>>>>> Then restart your cluster (start-impala-cluster.py) >>>>>>>>> >>>>>>>>> On Mon, Apr 4, 2016 at 2:39 PM, Pradeep Nayak < >>>>>>>>> [email protected]> wrote: >>>>>>>>> >>>>>>>>>> Thanks Skye. >>>>>>>>>> >>>>>>>>>> I am in my impala shell. I get this following error. I see this >>>>>>>>>> is already compiled as part of impala-frontend. This happens only >>>>>>>>>> when I >>>>>>>>>> try to do a "select * from <table_name>" I can do "show tables; >>>>>>>>>> create >>>>>>>>>> table <table_name>" etc. Any pointers ? >>>>>>>>>> >>>>>>>>>> ERROR: AnalysisException: java.lang.NoClassDefFoundError: Could >>>>>>>>>> not initialize class com.cloudera.impala.util.HdfsCachingUtil >>>>>>>>>> >>>>>>>>>> CAUSED BY: ExecutionException: java.lang.NoClassDefFoundError: >>>>>>>>>> Could not initialize class com.cloudera.impala.util.HdfsCachingUtil >>>>>>>>>> >>>>>>>>>> CAUSED BY: NoClassDefFoundError: Could not initialize class >>>>>>>>>> com.cloudera.impala.util.HdfsCachingUtil >>>>>>>>>> >>>>>>>>>> CAUSED BY: TableLoadingException: java.lang.NoClassDefFoundError: >>>>>>>>>> Could not initialize class com.cloudera.impala.util.HdfsCachingUtil >>>>>>>>>> >>>>>>>>>> CAUSED BY: ExecutionException: java.lang.NoClassDefFoundError: >>>>>>>>>> Could not initialize class com.cloudera.impala.util.HdfsCachingUtil >>>>>>>>>> >>>>>>>>>> CAUSED BY: NoClassDefFoundError: Could not initialize class >>>>>>>>>> com.cloudera.impala.util.HdfsCachingUtil >>>>>>>>>> >>>>>>>>>> I used this tree: >>>>>>>>>> https://github.com/cloudera/Impala/tree/cdh5.5.2-release >>>>>>>>>> >>>>>>>>>> On Mon, Apr 4, 2016 at 12:01 PM Skye Wanderman-Milne < >>>>>>>>>> [email protected]> wrote: >>>>>>>>>> >>>>>>>>>>> I think it should be >>>>>>>>>>> https://github.com/cloudera/Impala/tree/cdh5-2.3.0_5.5.2 >>>>>>>>>>> >>>>>>>>>>> On Mon, Apr 4, 2016 at 12:00 PM, Pradeep Nayak < >>>>>>>>>>> [email protected]> wrote: >>>>>>>>>>> >>>>>>>>>>>> Also to what release this parcel *5.5.2-1.cdh5.5.2.p0.4 *map >>>>>>>>>>>> to on github ? I am unable to find a tag/branch for this parcel >>>>>>>>>>>> type. >>>>>>>>>>>> >>>>>>>>>>>> >>>>>>>>>>>> On Mon, Apr 4, 2016 at 11:58 AM Skye Wanderman-Milne < >>>>>>>>>>>> [email protected]> wrote: >>>>>>>>>>>> >>>>>>>>>>>>> Ah yes, both 1 and 2 are correct. Glad you figured it out! >>>>>>>>>>>>> >>>>>>>>>>>>> On Mon, Apr 4, 2016 at 11:56 AM, Pradeep Nayak < >>>>>>>>>>>>> [email protected]> wrote: >>>>>>>>>>>>> >>>>>>>>>>>>>> I just figured. >>>>>>>>>>>>>> 1. For the first time you need to use the ./buildall.sh and >>>>>>>>>>>>>> for subsequent fe compilation I can just use maven >>>>>>>>>>>>>> 2. It doesn't build on Macbook >>>>>>>>>>>>>> 3. I set up a Ubuntu vm and got this compiled. >>>>>>>>>>>>>> >>>>>>>>>>>>>> Pradeep >>>>>>>>>>>>>> >>>>>>>>>>>>>> On Mon, Apr 4, 2016 at 11:07 AM Skye Wanderman-Milne < >>>>>>>>>>>>>> [email protected]> wrote: >>>>>>>>>>>>>> >>>>>>>>>>>>>>> Hey Pradeep, >>>>>>>>>>>>>>> >>>>>>>>>>>>>>> You should try running the $IMPALA_HOME/buildall.sh script >>>>>>>>>>>>>>> in order to build Impala. It has a lot of necessary setup to >>>>>>>>>>>>>>> build Impala. >>>>>>>>>>>>>>> Here are the commands from buildall.sh that should provide the >>>>>>>>>>>>>>> impala-data-source-api jar for building the FE: >>>>>>>>>>>>>>> >>>>>>>>>>>>>>> # build the external data source API >>>>>>>>>>>>>>> pushd ${IMPALA_HOME}/ext-data-source >>>>>>>>>>>>>>> ${IMPALA_HOME}/bin/mvn-quiet.sh install -DskipTests >>>>>>>>>>>>>>> popd >>>>>>>>>>>>>>> >>>>>>>>>>>>>>> See >>>>>>>>>>>>>>> https://github.com/cloudera/Impala/blob/cdh5-trunk/buildall.sh#L283 >>>>>>>>>>>>>>> >>>>>>>>>>>>>>> Hope that helps! >>>>>>>>>>>>>>> Skye >>>>>>>>>>>>>>> >>>>>>>>>>>>>>> On Sat, Apr 2, 2016 at 12:55 PM, Pradeep Nayak < >>>>>>>>>>>>>>> [email protected]> wrote: >>>>>>>>>>>>>>> >>>>>>>>>>>>>>>> I just cloned the Impala source from github, and I am >>>>>>>>>>>>>>>> trying to compile the front end per Impala wiki. I get the >>>>>>>>>>>>>>>> error below. I >>>>>>>>>>>>>>>> am using maven 3. >>>>>>>>>>>>>>>> >>>>>>>>>>>>>>>> [ERROR] Failed to execute goal on project impala-frontend: >>>>>>>>>>>>>>>> Could not resolve dependencies for project >>>>>>>>>>>>>>>> com.cloudera.impala:impala-frontend:jar:0.1-SNAPSHOT: Failure >>>>>>>>>>>>>>>> to find >>>>>>>>>>>>>>>> com.cloudera.impala:impala-data-source-api:jar:1.0-SNAPSHOT in >>>>>>>>>>>>>>>> https://repository.cloudera.com/content/groups/cdh-releases-rcs >>>>>>>>>>>>>>>> was cached in the local repository, resolution will not be >>>>>>>>>>>>>>>> reattempted >>>>>>>>>>>>>>>> until the update interval of cdh.rcs.releases.repo has elapsed >>>>>>>>>>>>>>>> or updates >>>>>>>>>>>>>>>> are forced -> [Help 1 >>>>>>>>>>>>>>>> >>>>>>>>>>>>>>>> This is the command I used: mvn clean package >>>>>>>>>>>>>>>> dependency:copy-dependencies -DskipTests=true >>>>>>>>>>>>>>>> >>>>>>>>>>>>>>>> Any idea getting around this problem ? >>>>>>>>>>>>>>>> >>>>>>>>>>>>>>>> Cheers! >>>>>>>>>>>>>>>> Pradeep >>>>>>>>>>>>>>>> >>>>>>>>>>>>>>>> -- >>>>>>>>>>>>>>>> You received this message because you are subscribed to the >>>>>>>>>>>>>>>> Google Groups "Impala Dev" group. >>>>>>>>>>>>>>>> To unsubscribe from this group and stop receiving emails >>>>>>>>>>>>>>>> from it, send an email to >>>>>>>>>>>>>>>> [email protected]. >>>>>>>>>>>>>>>> >>>>>>>>>>>>>>> >>>>>>>>>>>>>>> -- >>>>>>>>>>>>>> You received this message because you are subscribed to the >>>>>>>>>>>>>> Google Groups "Impala Dev" group. >>>>>>>>>>>>>> To unsubscribe from this group and stop receiving emails from >>>>>>>>>>>>>> it, send an email to [email protected]. >>>>>>>>>>>>>> >>>>>>>>>>>>> >>>>>>>>>>>>> >>>>>>>>>>> >>>>>>>>> >>>>>>> >>>>> -- >>> You received this message because you are subscribed to the Google >>> Groups "Impala Dev" group. >>> To unsubscribe from this group and stop receiving emails from it, send >>> an email to [email protected]. >>> >> >> >> >> -- >> Henry Robinson >> Software Engineer >> Cloudera >> 415-994-6679 >> > >
