On 4 April 2016 at 17:55, Pradeep Nayak <[email protected]> wrote:
> Also just wanted to understand one more thing. > http://www.cloudera.com/documentation/enterprise/5-5-x/topics/impala_s3.html > It > mentions that impala needs to have a default file system which is hdfs, but > not just s3a, or any other filesystem which extends Hadoop FileSystem class > ? Is there plans to support non hdfs filesystem as default ? > Yes there are - see IMPALA-1850 (code review http://gerrit.cloudera.org:8080/#/c/1121/). Henry > > Meanwhile I got around the problem earlier. I can query tables, do a > count(*), etc. > > However join is causing a problem... > > *select * from tab1 join tab2;* > > *Query: select * from tab1 join tab2* > > *ERROR:* > > *Failed to connect to FS* > > *Error(255): Unknown error 255* > > > Pradeep > > On Mon, Apr 4, 2016 at 3:31 PM Pradeep Nayak <[email protected]> > wrote: > >> That's what been puzzling me as well :(. Let me get back to you with that >> information. >> >> Pradeep >> >> On Mon, Apr 4, 2016 at 3:28 PM Skye Wanderman-Milne <[email protected]> >> wrote: >> >>> Actually, I didn't read your exception carefully and didn't notice that >>> it can't find an Impala class, so it's probably not a dependency issue. >>> >>> Can you restart your cluster, rerun a select * query, and then search >>> your logs for that "NoClassDefFoundError"? That will tell us which process >>> the error is coming from. That class is included in the FE jar, so I'm not >>> sure why it wouldn't be able to find it. >>> >>> >>> On Mon, Apr 4, 2016 at 3:14 PM, Pradeep Nayak <[email protected]> >>> wrote: >>> >>>> Sure Skye. I didn't notice the to: list as well until you pointed out. >>>> I really appreciate your help here. >>>> >>>> I haven't modified the pom.xml for the front-end here: >>>> https://github.com/cloudera/Impala/blob/cdh5.5.2-release/fe/pom.xml >>>> >>>> I am just building with this at the moment. mvn clean package >>>> -DSkipTests = true from the fe folder. >>>> >>>> >>>> On Mon, Apr 4, 2016 at 3:11 PM Skye Wanderman-Milne <[email protected]> >>>> wrote: >>>> >>>>> Ah didn't mean to take this off the dev list. Also add our new >>>>> [email protected] list. >>>>> >>>>> Can you check what dependency versions you're pulling in from maven? >>>>> My guess is that you're somehow building with non-CDH5.5.2 frontend >>>>> dependencies. >>>>> >>>>> On Mon, Apr 4, 2016 at 3:04 PM, Pradeep Nayak <[email protected]> >>>>> wrote: >>>>> >>>>>> Umm, I am trying to test this on a dev cluster which has cloudera >>>>>> parcels already installed. I just re-placed >>>>>> impala-frontend-0.1-SNAPSHOT.jar with my version. Do I need to change >>>>>> anything on the dev cluster ? >>>>>> >>>>>> On Mon, Apr 4, 2016 at 2:43 PM Skye Wanderman-Milne < >>>>>> [email protected]> wrote: >>>>>> >>>>>>> Try: source $IMPALA_HOME/bin/set-classpath.sh >>>>>>> >>>>>>> If you recently switched branches, you may want to close your >>>>>>> current terminal, open a new one, and re-source >>>>>>> $IMPALA_HOME/bin/impala-config.sh and set-classpath.sh. >>>>>>> >>>>>>> Then restart your cluster (start-impala-cluster.py) >>>>>>> >>>>>>> On Mon, Apr 4, 2016 at 2:39 PM, Pradeep Nayak <[email protected] >>>>>>> > wrote: >>>>>>> >>>>>>>> Thanks Skye. >>>>>>>> >>>>>>>> I am in my impala shell. I get this following error. I see this is >>>>>>>> already compiled as part of impala-frontend. This happens only when I >>>>>>>> try >>>>>>>> to do a "select * from <table_name>" I can do "show tables; create >>>>>>>> table >>>>>>>> <table_name>" etc. Any pointers ? >>>>>>>> >>>>>>>> ERROR: AnalysisException: java.lang.NoClassDefFoundError: Could not >>>>>>>> initialize class com.cloudera.impala.util.HdfsCachingUtil >>>>>>>> >>>>>>>> CAUSED BY: ExecutionException: java.lang.NoClassDefFoundError: >>>>>>>> Could not initialize class com.cloudera.impala.util.HdfsCachingUtil >>>>>>>> >>>>>>>> CAUSED BY: NoClassDefFoundError: Could not initialize class >>>>>>>> com.cloudera.impala.util.HdfsCachingUtil >>>>>>>> >>>>>>>> CAUSED BY: TableLoadingException: java.lang.NoClassDefFoundError: >>>>>>>> Could not initialize class com.cloudera.impala.util.HdfsCachingUtil >>>>>>>> >>>>>>>> CAUSED BY: ExecutionException: java.lang.NoClassDefFoundError: >>>>>>>> Could not initialize class com.cloudera.impala.util.HdfsCachingUtil >>>>>>>> >>>>>>>> CAUSED BY: NoClassDefFoundError: Could not initialize class >>>>>>>> com.cloudera.impala.util.HdfsCachingUtil >>>>>>>> >>>>>>>> I used this tree: >>>>>>>> https://github.com/cloudera/Impala/tree/cdh5.5.2-release >>>>>>>> >>>>>>>> On Mon, Apr 4, 2016 at 12:01 PM Skye Wanderman-Milne < >>>>>>>> [email protected]> wrote: >>>>>>>> >>>>>>>>> I think it should be >>>>>>>>> https://github.com/cloudera/Impala/tree/cdh5-2.3.0_5.5.2 >>>>>>>>> >>>>>>>>> On Mon, Apr 4, 2016 at 12:00 PM, Pradeep Nayak < >>>>>>>>> [email protected]> wrote: >>>>>>>>> >>>>>>>>>> Also to what release this parcel *5.5.2-1.cdh5.5.2.p0.4 *map to >>>>>>>>>> on github ? I am unable to find a tag/branch for this parcel type. >>>>>>>>>> >>>>>>>>>> >>>>>>>>>> On Mon, Apr 4, 2016 at 11:58 AM Skye Wanderman-Milne < >>>>>>>>>> [email protected]> wrote: >>>>>>>>>> >>>>>>>>>>> Ah yes, both 1 and 2 are correct. Glad you figured it out! >>>>>>>>>>> >>>>>>>>>>> On Mon, Apr 4, 2016 at 11:56 AM, Pradeep Nayak < >>>>>>>>>>> [email protected]> wrote: >>>>>>>>>>> >>>>>>>>>>>> I just figured. >>>>>>>>>>>> 1. For the first time you need to use the ./buildall.sh and for >>>>>>>>>>>> subsequent fe compilation I can just use maven >>>>>>>>>>>> 2. It doesn't build on Macbook >>>>>>>>>>>> 3. I set up a Ubuntu vm and got this compiled. >>>>>>>>>>>> >>>>>>>>>>>> Pradeep >>>>>>>>>>>> >>>>>>>>>>>> On Mon, Apr 4, 2016 at 11:07 AM Skye Wanderman-Milne < >>>>>>>>>>>> [email protected]> wrote: >>>>>>>>>>>> >>>>>>>>>>>>> Hey Pradeep, >>>>>>>>>>>>> >>>>>>>>>>>>> You should try running the $IMPALA_HOME/buildall.sh script in >>>>>>>>>>>>> order to build Impala. It has a lot of necessary setup to build >>>>>>>>>>>>> Impala. >>>>>>>>>>>>> Here are the commands from buildall.sh that should provide the >>>>>>>>>>>>> impala-data-source-api jar for building the FE: >>>>>>>>>>>>> >>>>>>>>>>>>> # build the external data source API >>>>>>>>>>>>> pushd ${IMPALA_HOME}/ext-data-source >>>>>>>>>>>>> ${IMPALA_HOME}/bin/mvn-quiet.sh install -DskipTests >>>>>>>>>>>>> popd >>>>>>>>>>>>> >>>>>>>>>>>>> See >>>>>>>>>>>>> https://github.com/cloudera/Impala/blob/cdh5-trunk/buildall.sh#L283 >>>>>>>>>>>>> >>>>>>>>>>>>> Hope that helps! >>>>>>>>>>>>> Skye >>>>>>>>>>>>> >>>>>>>>>>>>> On Sat, Apr 2, 2016 at 12:55 PM, Pradeep Nayak < >>>>>>>>>>>>> [email protected]> wrote: >>>>>>>>>>>>> >>>>>>>>>>>>>> I just cloned the Impala source from github, and I am trying >>>>>>>>>>>>>> to compile the front end per Impala wiki. I get the error below. >>>>>>>>>>>>>> I am using >>>>>>>>>>>>>> maven 3. >>>>>>>>>>>>>> >>>>>>>>>>>>>> [ERROR] Failed to execute goal on project impala-frontend: >>>>>>>>>>>>>> Could not resolve dependencies for project >>>>>>>>>>>>>> com.cloudera.impala:impala-frontend:jar:0.1-SNAPSHOT: Failure to >>>>>>>>>>>>>> find >>>>>>>>>>>>>> com.cloudera.impala:impala-data-source-api:jar:1.0-SNAPSHOT in >>>>>>>>>>>>>> https://repository.cloudera.com/content/groups/cdh-releases-rcs >>>>>>>>>>>>>> was cached in the local repository, resolution will not be >>>>>>>>>>>>>> reattempted >>>>>>>>>>>>>> until the update interval of cdh.rcs.releases.repo has elapsed >>>>>>>>>>>>>> or updates >>>>>>>>>>>>>> are forced -> [Help 1 >>>>>>>>>>>>>> >>>>>>>>>>>>>> This is the command I used: mvn clean package >>>>>>>>>>>>>> dependency:copy-dependencies -DskipTests=true >>>>>>>>>>>>>> >>>>>>>>>>>>>> Any idea getting around this problem ? >>>>>>>>>>>>>> >>>>>>>>>>>>>> Cheers! >>>>>>>>>>>>>> Pradeep >>>>>>>>>>>>>> >>>>>>>>>>>>>> -- >>>>>>>>>>>>>> You received this message because you are subscribed to the >>>>>>>>>>>>>> Google Groups "Impala Dev" group. >>>>>>>>>>>>>> To unsubscribe from this group and stop receiving emails from >>>>>>>>>>>>>> it, send an email to [email protected]. >>>>>>>>>>>>>> >>>>>>>>>>>>> >>>>>>>>>>>>> -- >>>>>>>>>>>> You received this message because you are subscribed to the >>>>>>>>>>>> Google Groups "Impala Dev" group. >>>>>>>>>>>> To unsubscribe from this group and stop receiving emails from >>>>>>>>>>>> it, send an email to [email protected]. >>>>>>>>>>>> >>>>>>>>>>> >>>>>>>>>>> >>>>>>>>> >>>>>>> >>>>> >>> -- > You received this message because you are subscribed to the Google Groups > "Impala Dev" group. > To unsubscribe from this group and stop receiving emails from it, send an > email to [email protected]. > -- Henry Robinson Software Engineer Cloudera 415-994-6679
