As for logs, I just see this :
E0405 15:19:47.907562 10957 Analyzer.java:2210] Failed to load metadata for table: tab1 java.lang.NoClassDefFoundError: Could not initialize class com.cloudera.impala.util.HdfsCachingUtil CAUSED BY: ExecutionException: java.lang.NoClassDefFoundError: Could not initialize class com.cloudera.impala.util.HdfsCachingUtil CAUSED BY: NoClassDefFoundError: Could not initialize class com.cloudera.impala.util.HdfsCachingUtil E0405 15:20:52.074620 10957 Analyzer.java:2210] Failed to load metadata for table: tab1 java.lang.NoClassDefFoundError: Could not initialize class com.cloudera.impala.util.HdfsCachingUtil CAUSED BY: ExecutionException: java.lang.NoClassDefFoundError: Could not initialize class com.cloudera.impala.util.HdfsCachingUtil CAUSED BY: NoClassDefFoundError: Could not initialize class com.cloudera.impala.util.HdfsCachingUtil tab1 is an external table. On Tue, Apr 5, 2016 at 1:24 PM Pradeep Nayak <[email protected]> wrote: > Here is the strange part: > > Where we make changes to core-site.xml, re-deploy the stale client configs > from the cloudera manager, and restart the affected services we get into > the NoClassDefound state. In order to get past it we needed to restart > impala dameons, catalog server etc again from the cloudera manager. Then > it begins to work. > > I can reproduce this but very inconsistently though. Is there any logs you > want me to be looking at ? > > > On Tue, Apr 5, 2016 at 10:26 AM Skye Wanderman-Milne <[email protected]> > wrote: > >> In case others run into similar issues, can you share how you resolved >> the NoClassDefFoundErrors? >> >> On Mon, Apr 4, 2016 at 10:21 PM, Henry Robinson <[email protected]> >> wrote: >> >>> >>> >>> On 4 April 2016 at 17:55, Pradeep Nayak <[email protected]> wrote: >>> >>>> Also just wanted to understand one more thing. >>>> http://www.cloudera.com/documentation/enterprise/5-5-x/topics/impala_s3.html >>>> It >>>> mentions that impala needs to have a default file system which is hdfs, but >>>> not just s3a, or any other filesystem which extends Hadoop FileSystem class >>>> ? Is there plans to support non hdfs filesystem as default ? >>>> >>> >>> Yes there are - see IMPALA-1850 (code review >>> http://gerrit.cloudera.org:8080/#/c/1121/). >>> >>> Henry >>> >>> >>>> >>>> Meanwhile I got around the problem earlier. I can query tables, do a >>>> count(*), etc. >>>> >>>> However join is causing a problem... >>>> >>>> *select * from tab1 join tab2;* >>>> >>>> *Query: select * from tab1 join tab2* >>>> >>>> *ERROR:* >>>> >>>> *Failed to connect to FS* >>>> >>>> *Error(255): Unknown error 255* >>>> >>>> >>>> Pradeep >>>> >>>> On Mon, Apr 4, 2016 at 3:31 PM Pradeep Nayak <[email protected]> >>>> wrote: >>>> >>>>> That's what been puzzling me as well :(. Let me get back to you with >>>>> that information. >>>>> >>>>> Pradeep >>>>> >>>>> On Mon, Apr 4, 2016 at 3:28 PM Skye Wanderman-Milne <[email protected]> >>>>> wrote: >>>>> >>>>>> Actually, I didn't read your exception carefully and didn't notice >>>>>> that it can't find an Impala class, so it's probably not a dependency >>>>>> issue. >>>>>> >>>>>> Can you restart your cluster, rerun a select * query, and then search >>>>>> your logs for that "NoClassDefFoundError"? That will tell us which >>>>>> process >>>>>> the error is coming from. That class is included in the FE jar, so I'm >>>>>> not >>>>>> sure why it wouldn't be able to find it. >>>>>> >>>>>> >>>>>> On Mon, Apr 4, 2016 at 3:14 PM, Pradeep Nayak <[email protected]> >>>>>> wrote: >>>>>> >>>>>>> Sure Skye. I didn't notice the to: list as well until you pointed >>>>>>> out. I really appreciate your help here. >>>>>>> >>>>>>> I haven't modified the pom.xml for the front-end here: >>>>>>> https://github.com/cloudera/Impala/blob/cdh5.5.2-release/fe/pom.xml >>>>>>> >>>>>>> I am just building with this at the moment. mvn clean package >>>>>>> -DSkipTests = true from the fe folder. >>>>>>> >>>>>>> >>>>>>> On Mon, Apr 4, 2016 at 3:11 PM Skye Wanderman-Milne < >>>>>>> [email protected]> wrote: >>>>>>> >>>>>>>> Ah didn't mean to take this off the dev list. Also add our new >>>>>>>> [email protected] list. >>>>>>>> >>>>>>>> Can you check what dependency versions you're pulling in from >>>>>>>> maven? My guess is that you're somehow building with non-CDH5.5.2 >>>>>>>> frontend >>>>>>>> dependencies. >>>>>>>> >>>>>>>> On Mon, Apr 4, 2016 at 3:04 PM, Pradeep Nayak < >>>>>>>> [email protected]> wrote: >>>>>>>> >>>>>>>>> Umm, I am trying to test this on a dev cluster which has cloudera >>>>>>>>> parcels already installed. I just re-placed >>>>>>>>> impala-frontend-0.1-SNAPSHOT.jar with my version. Do I need to change >>>>>>>>> anything on the dev cluster ? >>>>>>>>> >>>>>>>>> On Mon, Apr 4, 2016 at 2:43 PM Skye Wanderman-Milne < >>>>>>>>> [email protected]> wrote: >>>>>>>>> >>>>>>>>>> Try: source $IMPALA_HOME/bin/set-classpath.sh >>>>>>>>>> >>>>>>>>>> If you recently switched branches, you may want to close your >>>>>>>>>> current terminal, open a new one, and re-source >>>>>>>>>> $IMPALA_HOME/bin/impala-config.sh and set-classpath.sh. >>>>>>>>>> >>>>>>>>>> Then restart your cluster (start-impala-cluster.py) >>>>>>>>>> >>>>>>>>>> On Mon, Apr 4, 2016 at 2:39 PM, Pradeep Nayak < >>>>>>>>>> [email protected]> wrote: >>>>>>>>>> >>>>>>>>>>> Thanks Skye. >>>>>>>>>>> >>>>>>>>>>> I am in my impala shell. I get this following error. I see this >>>>>>>>>>> is already compiled as part of impala-frontend. This happens only >>>>>>>>>>> when I >>>>>>>>>>> try to do a "select * from <table_name>" I can do "show tables; >>>>>>>>>>> create >>>>>>>>>>> table <table_name>" etc. Any pointers ? >>>>>>>>>>> >>>>>>>>>>> ERROR: AnalysisException: java.lang.NoClassDefFoundError: Could >>>>>>>>>>> not initialize class com.cloudera.impala.util.HdfsCachingUtil >>>>>>>>>>> >>>>>>>>>>> CAUSED BY: ExecutionException: java.lang.NoClassDefFoundError: >>>>>>>>>>> Could not initialize class com.cloudera.impala.util.HdfsCachingUtil >>>>>>>>>>> >>>>>>>>>>> CAUSED BY: NoClassDefFoundError: Could not initialize class >>>>>>>>>>> com.cloudera.impala.util.HdfsCachingUtil >>>>>>>>>>> >>>>>>>>>>> CAUSED BY: TableLoadingException: >>>>>>>>>>> java.lang.NoClassDefFoundError: Could not initialize class >>>>>>>>>>> com.cloudera.impala.util.HdfsCachingUtil >>>>>>>>>>> >>>>>>>>>>> CAUSED BY: ExecutionException: java.lang.NoClassDefFoundError: >>>>>>>>>>> Could not initialize class com.cloudera.impala.util.HdfsCachingUtil >>>>>>>>>>> >>>>>>>>>>> CAUSED BY: NoClassDefFoundError: Could not initialize class >>>>>>>>>>> com.cloudera.impala.util.HdfsCachingUtil >>>>>>>>>>> >>>>>>>>>>> I used this tree: >>>>>>>>>>> https://github.com/cloudera/Impala/tree/cdh5.5.2-release >>>>>>>>>>> >>>>>>>>>>> On Mon, Apr 4, 2016 at 12:01 PM Skye Wanderman-Milne < >>>>>>>>>>> [email protected]> wrote: >>>>>>>>>>> >>>>>>>>>>>> I think it should be >>>>>>>>>>>> https://github.com/cloudera/Impala/tree/cdh5-2.3.0_5.5.2 >>>>>>>>>>>> >>>>>>>>>>>> On Mon, Apr 4, 2016 at 12:00 PM, Pradeep Nayak < >>>>>>>>>>>> [email protected]> wrote: >>>>>>>>>>>> >>>>>>>>>>>>> Also to what release this parcel *5.5.2-1.cdh5.5.2.p0.4 *map >>>>>>>>>>>>> to on github ? I am unable to find a tag/branch for this parcel >>>>>>>>>>>>> type. >>>>>>>>>>>>> >>>>>>>>>>>>> >>>>>>>>>>>>> On Mon, Apr 4, 2016 at 11:58 AM Skye Wanderman-Milne < >>>>>>>>>>>>> [email protected]> wrote: >>>>>>>>>>>>> >>>>>>>>>>>>>> Ah yes, both 1 and 2 are correct. Glad you figured it out! >>>>>>>>>>>>>> >>>>>>>>>>>>>> On Mon, Apr 4, 2016 at 11:56 AM, Pradeep Nayak < >>>>>>>>>>>>>> [email protected]> wrote: >>>>>>>>>>>>>> >>>>>>>>>>>>>>> I just figured. >>>>>>>>>>>>>>> 1. For the first time you need to use the ./buildall.sh and >>>>>>>>>>>>>>> for subsequent fe compilation I can just use maven >>>>>>>>>>>>>>> 2. It doesn't build on Macbook >>>>>>>>>>>>>>> 3. I set up a Ubuntu vm and got this compiled. >>>>>>>>>>>>>>> >>>>>>>>>>>>>>> Pradeep >>>>>>>>>>>>>>> >>>>>>>>>>>>>>> On Mon, Apr 4, 2016 at 11:07 AM Skye Wanderman-Milne < >>>>>>>>>>>>>>> [email protected]> wrote: >>>>>>>>>>>>>>> >>>>>>>>>>>>>>>> Hey Pradeep, >>>>>>>>>>>>>>>> >>>>>>>>>>>>>>>> You should try running the $IMPALA_HOME/buildall.sh script >>>>>>>>>>>>>>>> in order to build Impala. It has a lot of necessary setup to >>>>>>>>>>>>>>>> build Impala. >>>>>>>>>>>>>>>> Here are the commands from buildall.sh that should provide the >>>>>>>>>>>>>>>> impala-data-source-api jar for building the FE: >>>>>>>>>>>>>>>> >>>>>>>>>>>>>>>> # build the external data source API >>>>>>>>>>>>>>>> pushd ${IMPALA_HOME}/ext-data-source >>>>>>>>>>>>>>>> ${IMPALA_HOME}/bin/mvn-quiet.sh install -DskipTests >>>>>>>>>>>>>>>> popd >>>>>>>>>>>>>>>> >>>>>>>>>>>>>>>> See >>>>>>>>>>>>>>>> https://github.com/cloudera/Impala/blob/cdh5-trunk/buildall.sh#L283 >>>>>>>>>>>>>>>> >>>>>>>>>>>>>>>> Hope that helps! >>>>>>>>>>>>>>>> Skye >>>>>>>>>>>>>>>> >>>>>>>>>>>>>>>> On Sat, Apr 2, 2016 at 12:55 PM, Pradeep Nayak < >>>>>>>>>>>>>>>> [email protected]> wrote: >>>>>>>>>>>>>>>> >>>>>>>>>>>>>>>>> I just cloned the Impala source from github, and I am >>>>>>>>>>>>>>>>> trying to compile the front end per Impala wiki. I get the >>>>>>>>>>>>>>>>> error below. I >>>>>>>>>>>>>>>>> am using maven 3. >>>>>>>>>>>>>>>>> >>>>>>>>>>>>>>>>> [ERROR] Failed to execute goal on project impala-frontend: >>>>>>>>>>>>>>>>> Could not resolve dependencies for project >>>>>>>>>>>>>>>>> com.cloudera.impala:impala-frontend:jar:0.1-SNAPSHOT: Failure >>>>>>>>>>>>>>>>> to find >>>>>>>>>>>>>>>>> com.cloudera.impala:impala-data-source-api:jar:1.0-SNAPSHOT in >>>>>>>>>>>>>>>>> https://repository.cloudera.com/content/groups/cdh-releases-rcs >>>>>>>>>>>>>>>>> was cached in the local repository, resolution will not be >>>>>>>>>>>>>>>>> reattempted >>>>>>>>>>>>>>>>> until the update interval of cdh.rcs.releases.repo has >>>>>>>>>>>>>>>>> elapsed or updates >>>>>>>>>>>>>>>>> are forced -> [Help 1 >>>>>>>>>>>>>>>>> >>>>>>>>>>>>>>>>> This is the command I used: mvn clean package >>>>>>>>>>>>>>>>> dependency:copy-dependencies -DskipTests=true >>>>>>>>>>>>>>>>> >>>>>>>>>>>>>>>>> Any idea getting around this problem ? >>>>>>>>>>>>>>>>> >>>>>>>>>>>>>>>>> Cheers! >>>>>>>>>>>>>>>>> Pradeep >>>>>>>>>>>>>>>>> >>>>>>>>>>>>>>>>> -- >>>>>>>>>>>>>>>>> You received this message because you are subscribed to >>>>>>>>>>>>>>>>> the Google Groups "Impala Dev" group. >>>>>>>>>>>>>>>>> To unsubscribe from this group and stop receiving emails >>>>>>>>>>>>>>>>> from it, send an email to >>>>>>>>>>>>>>>>> [email protected]. >>>>>>>>>>>>>>>>> >>>>>>>>>>>>>>>> >>>>>>>>>>>>>>>> -- >>>>>>>>>>>>>>> You received this message because you are subscribed to the >>>>>>>>>>>>>>> Google Groups "Impala Dev" group. >>>>>>>>>>>>>>> To unsubscribe from this group and stop receiving emails >>>>>>>>>>>>>>> from it, send an email to >>>>>>>>>>>>>>> [email protected]. >>>>>>>>>>>>>>> >>>>>>>>>>>>>> >>>>>>>>>>>>>> >>>>>>>>>>>> >>>>>>>>>> >>>>>>>> >>>>>> -- >>>> You received this message because you are subscribed to the Google >>>> Groups "Impala Dev" group. >>>> To unsubscribe from this group and stop receiving emails from it, send >>>> an email to [email protected]. >>>> >>> >>> >>> >>> -- >>> Henry Robinson >>> Software Engineer >>> Cloudera >>> 415-994-6679 >>> >> >>
