In case others run into similar issues, can you share how you resolved the NoClassDefFoundErrors?
On Mon, Apr 4, 2016 at 10:21 PM, Henry Robinson <[email protected]> wrote: > > > On 4 April 2016 at 17:55, Pradeep Nayak <[email protected]> wrote: > >> Also just wanted to understand one more thing. >> http://www.cloudera.com/documentation/enterprise/5-5-x/topics/impala_s3.html >> It >> mentions that impala needs to have a default file system which is hdfs, but >> not just s3a, or any other filesystem which extends Hadoop FileSystem class >> ? Is there plans to support non hdfs filesystem as default ? >> > > Yes there are - see IMPALA-1850 (code review > http://gerrit.cloudera.org:8080/#/c/1121/). > > Henry > > >> >> Meanwhile I got around the problem earlier. I can query tables, do a >> count(*), etc. >> >> However join is causing a problem... >> >> *select * from tab1 join tab2;* >> >> *Query: select * from tab1 join tab2* >> >> *ERROR:* >> >> *Failed to connect to FS* >> >> *Error(255): Unknown error 255* >> >> >> Pradeep >> >> On Mon, Apr 4, 2016 at 3:31 PM Pradeep Nayak <[email protected]> >> wrote: >> >>> That's what been puzzling me as well :(. Let me get back to you with >>> that information. >>> >>> Pradeep >>> >>> On Mon, Apr 4, 2016 at 3:28 PM Skye Wanderman-Milne <[email protected]> >>> wrote: >>> >>>> Actually, I didn't read your exception carefully and didn't notice that >>>> it can't find an Impala class, so it's probably not a dependency issue. >>>> >>>> Can you restart your cluster, rerun a select * query, and then search >>>> your logs for that "NoClassDefFoundError"? That will tell us which process >>>> the error is coming from. That class is included in the FE jar, so I'm not >>>> sure why it wouldn't be able to find it. >>>> >>>> >>>> On Mon, Apr 4, 2016 at 3:14 PM, Pradeep Nayak <[email protected]> >>>> wrote: >>>> >>>>> Sure Skye. I didn't notice the to: list as well until you pointed out. >>>>> I really appreciate your help here. >>>>> >>>>> I haven't modified the pom.xml for the front-end here: >>>>> https://github.com/cloudera/Impala/blob/cdh5.5.2-release/fe/pom.xml >>>>> >>>>> I am just building with this at the moment. mvn clean package >>>>> -DSkipTests = true from the fe folder. >>>>> >>>>> >>>>> On Mon, Apr 4, 2016 at 3:11 PM Skye Wanderman-Milne <[email protected]> >>>>> wrote: >>>>> >>>>>> Ah didn't mean to take this off the dev list. Also add our new >>>>>> [email protected] list. >>>>>> >>>>>> Can you check what dependency versions you're pulling in from maven? >>>>>> My guess is that you're somehow building with non-CDH5.5.2 frontend >>>>>> dependencies. >>>>>> >>>>>> On Mon, Apr 4, 2016 at 3:04 PM, Pradeep Nayak <[email protected]> >>>>>> wrote: >>>>>> >>>>>>> Umm, I am trying to test this on a dev cluster which has cloudera >>>>>>> parcels already installed. I just re-placed >>>>>>> impala-frontend-0.1-SNAPSHOT.jar with my version. Do I need to change >>>>>>> anything on the dev cluster ? >>>>>>> >>>>>>> On Mon, Apr 4, 2016 at 2:43 PM Skye Wanderman-Milne < >>>>>>> [email protected]> wrote: >>>>>>> >>>>>>>> Try: source $IMPALA_HOME/bin/set-classpath.sh >>>>>>>> >>>>>>>> If you recently switched branches, you may want to close your >>>>>>>> current terminal, open a new one, and re-source >>>>>>>> $IMPALA_HOME/bin/impala-config.sh and set-classpath.sh. >>>>>>>> >>>>>>>> Then restart your cluster (start-impala-cluster.py) >>>>>>>> >>>>>>>> On Mon, Apr 4, 2016 at 2:39 PM, Pradeep Nayak < >>>>>>>> [email protected]> wrote: >>>>>>>> >>>>>>>>> Thanks Skye. >>>>>>>>> >>>>>>>>> I am in my impala shell. I get this following error. I see this is >>>>>>>>> already compiled as part of impala-frontend. This happens only when I >>>>>>>>> try >>>>>>>>> to do a "select * from <table_name>" I can do "show tables; create >>>>>>>>> table >>>>>>>>> <table_name>" etc. Any pointers ? >>>>>>>>> >>>>>>>>> ERROR: AnalysisException: java.lang.NoClassDefFoundError: Could >>>>>>>>> not initialize class com.cloudera.impala.util.HdfsCachingUtil >>>>>>>>> >>>>>>>>> CAUSED BY: ExecutionException: java.lang.NoClassDefFoundError: >>>>>>>>> Could not initialize class com.cloudera.impala.util.HdfsCachingUtil >>>>>>>>> >>>>>>>>> CAUSED BY: NoClassDefFoundError: Could not initialize class >>>>>>>>> com.cloudera.impala.util.HdfsCachingUtil >>>>>>>>> >>>>>>>>> CAUSED BY: TableLoadingException: java.lang.NoClassDefFoundError: >>>>>>>>> Could not initialize class com.cloudera.impala.util.HdfsCachingUtil >>>>>>>>> >>>>>>>>> CAUSED BY: ExecutionException: java.lang.NoClassDefFoundError: >>>>>>>>> Could not initialize class com.cloudera.impala.util.HdfsCachingUtil >>>>>>>>> >>>>>>>>> CAUSED BY: NoClassDefFoundError: Could not initialize class >>>>>>>>> com.cloudera.impala.util.HdfsCachingUtil >>>>>>>>> >>>>>>>>> I used this tree: >>>>>>>>> https://github.com/cloudera/Impala/tree/cdh5.5.2-release >>>>>>>>> >>>>>>>>> On Mon, Apr 4, 2016 at 12:01 PM Skye Wanderman-Milne < >>>>>>>>> [email protected]> wrote: >>>>>>>>> >>>>>>>>>> I think it should be >>>>>>>>>> https://github.com/cloudera/Impala/tree/cdh5-2.3.0_5.5.2 >>>>>>>>>> >>>>>>>>>> On Mon, Apr 4, 2016 at 12:00 PM, Pradeep Nayak < >>>>>>>>>> [email protected]> wrote: >>>>>>>>>> >>>>>>>>>>> Also to what release this parcel *5.5.2-1.cdh5.5.2.p0.4 *map >>>>>>>>>>> to on github ? I am unable to find a tag/branch for this parcel >>>>>>>>>>> type. >>>>>>>>>>> >>>>>>>>>>> >>>>>>>>>>> On Mon, Apr 4, 2016 at 11:58 AM Skye Wanderman-Milne < >>>>>>>>>>> [email protected]> wrote: >>>>>>>>>>> >>>>>>>>>>>> Ah yes, both 1 and 2 are correct. Glad you figured it out! >>>>>>>>>>>> >>>>>>>>>>>> On Mon, Apr 4, 2016 at 11:56 AM, Pradeep Nayak < >>>>>>>>>>>> [email protected]> wrote: >>>>>>>>>>>> >>>>>>>>>>>>> I just figured. >>>>>>>>>>>>> 1. For the first time you need to use the ./buildall.sh and >>>>>>>>>>>>> for subsequent fe compilation I can just use maven >>>>>>>>>>>>> 2. It doesn't build on Macbook >>>>>>>>>>>>> 3. I set up a Ubuntu vm and got this compiled. >>>>>>>>>>>>> >>>>>>>>>>>>> Pradeep >>>>>>>>>>>>> >>>>>>>>>>>>> On Mon, Apr 4, 2016 at 11:07 AM Skye Wanderman-Milne < >>>>>>>>>>>>> [email protected]> wrote: >>>>>>>>>>>>> >>>>>>>>>>>>>> Hey Pradeep, >>>>>>>>>>>>>> >>>>>>>>>>>>>> You should try running the $IMPALA_HOME/buildall.sh script in >>>>>>>>>>>>>> order to build Impala. It has a lot of necessary setup to build >>>>>>>>>>>>>> Impala. >>>>>>>>>>>>>> Here are the commands from buildall.sh that should provide the >>>>>>>>>>>>>> impala-data-source-api jar for building the FE: >>>>>>>>>>>>>> >>>>>>>>>>>>>> # build the external data source API >>>>>>>>>>>>>> pushd ${IMPALA_HOME}/ext-data-source >>>>>>>>>>>>>> ${IMPALA_HOME}/bin/mvn-quiet.sh install -DskipTests >>>>>>>>>>>>>> popd >>>>>>>>>>>>>> >>>>>>>>>>>>>> See >>>>>>>>>>>>>> https://github.com/cloudera/Impala/blob/cdh5-trunk/buildall.sh#L283 >>>>>>>>>>>>>> >>>>>>>>>>>>>> Hope that helps! >>>>>>>>>>>>>> Skye >>>>>>>>>>>>>> >>>>>>>>>>>>>> On Sat, Apr 2, 2016 at 12:55 PM, Pradeep Nayak < >>>>>>>>>>>>>> [email protected]> wrote: >>>>>>>>>>>>>> >>>>>>>>>>>>>>> I just cloned the Impala source from github, and I am trying >>>>>>>>>>>>>>> to compile the front end per Impala wiki. I get the error >>>>>>>>>>>>>>> below. I am using >>>>>>>>>>>>>>> maven 3. >>>>>>>>>>>>>>> >>>>>>>>>>>>>>> [ERROR] Failed to execute goal on project impala-frontend: >>>>>>>>>>>>>>> Could not resolve dependencies for project >>>>>>>>>>>>>>> com.cloudera.impala:impala-frontend:jar:0.1-SNAPSHOT: Failure >>>>>>>>>>>>>>> to find >>>>>>>>>>>>>>> com.cloudera.impala:impala-data-source-api:jar:1.0-SNAPSHOT in >>>>>>>>>>>>>>> https://repository.cloudera.com/content/groups/cdh-releases-rcs >>>>>>>>>>>>>>> was cached in the local repository, resolution will not be >>>>>>>>>>>>>>> reattempted >>>>>>>>>>>>>>> until the update interval of cdh.rcs.releases.repo has elapsed >>>>>>>>>>>>>>> or updates >>>>>>>>>>>>>>> are forced -> [Help 1 >>>>>>>>>>>>>>> >>>>>>>>>>>>>>> This is the command I used: mvn clean package >>>>>>>>>>>>>>> dependency:copy-dependencies -DskipTests=true >>>>>>>>>>>>>>> >>>>>>>>>>>>>>> Any idea getting around this problem ? >>>>>>>>>>>>>>> >>>>>>>>>>>>>>> Cheers! >>>>>>>>>>>>>>> Pradeep >>>>>>>>>>>>>>> >>>>>>>>>>>>>>> -- >>>>>>>>>>>>>>> You received this message because you are subscribed to the >>>>>>>>>>>>>>> Google Groups "Impala Dev" group. >>>>>>>>>>>>>>> To unsubscribe from this group and stop receiving emails >>>>>>>>>>>>>>> from it, send an email to >>>>>>>>>>>>>>> [email protected]. >>>>>>>>>>>>>>> >>>>>>>>>>>>>> >>>>>>>>>>>>>> -- >>>>>>>>>>>>> You received this message because you are subscribed to the >>>>>>>>>>>>> Google Groups "Impala Dev" group. >>>>>>>>>>>>> To unsubscribe from this group and stop receiving emails from >>>>>>>>>>>>> it, send an email to [email protected]. >>>>>>>>>>>>> >>>>>>>>>>>> >>>>>>>>>>>> >>>>>>>>>> >>>>>>>> >>>>>> >>>> -- >> You received this message because you are subscribed to the Google Groups >> "Impala Dev" group. >> To unsubscribe from this group and stop receiving emails from it, send an >> email to [email protected]. >> > > > > -- > Henry Robinson > Software Engineer > Cloudera > 415-994-6679 >
