Also just wanted to understand one more thing. http://www.cloudera.com/documentation/enterprise/5-5-x/topics/impala_s3.html It mentions that impala needs to have a default file system which is hdfs, but not just s3a, or any other filesystem which extends Hadoop FileSystem class ? Is there plans to support non hdfs filesystem as default ?
Meanwhile I got around the problem earlier. I can query tables, do a count(*), etc. However join is causing a problem... *select * from tab1 join tab2;* *Query: select * from tab1 join tab2* *ERROR:* *Failed to connect to FS* *Error(255): Unknown error 255* Pradeep On Mon, Apr 4, 2016 at 3:31 PM Pradeep Nayak <[email protected]> wrote: > That's what been puzzling me as well :(. Let me get back to you with that > information. > > Pradeep > > On Mon, Apr 4, 2016 at 3:28 PM Skye Wanderman-Milne <[email protected]> > wrote: > >> Actually, I didn't read your exception carefully and didn't notice that >> it can't find an Impala class, so it's probably not a dependency issue. >> >> Can you restart your cluster, rerun a select * query, and then search >> your logs for that "NoClassDefFoundError"? That will tell us which process >> the error is coming from. That class is included in the FE jar, so I'm not >> sure why it wouldn't be able to find it. >> >> >> On Mon, Apr 4, 2016 at 3:14 PM, Pradeep Nayak <[email protected]> >> wrote: >> >>> Sure Skye. I didn't notice the to: list as well until you pointed out. I >>> really appreciate your help here. >>> >>> I haven't modified the pom.xml for the front-end here: >>> https://github.com/cloudera/Impala/blob/cdh5.5.2-release/fe/pom.xml >>> >>> I am just building with this at the moment. mvn clean package >>> -DSkipTests = true from the fe folder. >>> >>> >>> On Mon, Apr 4, 2016 at 3:11 PM Skye Wanderman-Milne <[email protected]> >>> wrote: >>> >>>> Ah didn't mean to take this off the dev list. Also add our new >>>> [email protected] list. >>>> >>>> Can you check what dependency versions you're pulling in from maven? My >>>> guess is that you're somehow building with non-CDH5.5.2 frontend >>>> dependencies. >>>> >>>> On Mon, Apr 4, 2016 at 3:04 PM, Pradeep Nayak <[email protected]> >>>> wrote: >>>> >>>>> Umm, I am trying to test this on a dev cluster which has cloudera >>>>> parcels already installed. I just re-placed >>>>> impala-frontend-0.1-SNAPSHOT.jar with my version. Do I need to change >>>>> anything on the dev cluster ? >>>>> >>>>> On Mon, Apr 4, 2016 at 2:43 PM Skye Wanderman-Milne <[email protected]> >>>>> wrote: >>>>> >>>>>> Try: source $IMPALA_HOME/bin/set-classpath.sh >>>>>> >>>>>> If you recently switched branches, you may want to close your current >>>>>> terminal, open a new one, and re-source $IMPALA_HOME/bin/impala-config.sh >>>>>> and set-classpath.sh. >>>>>> >>>>>> Then restart your cluster (start-impala-cluster.py) >>>>>> >>>>>> On Mon, Apr 4, 2016 at 2:39 PM, Pradeep Nayak <[email protected]> >>>>>> wrote: >>>>>> >>>>>>> Thanks Skye. >>>>>>> >>>>>>> I am in my impala shell. I get this following error. I see this is >>>>>>> already compiled as part of impala-frontend. This happens only when I >>>>>>> try >>>>>>> to do a "select * from <table_name>" I can do "show tables; create table >>>>>>> <table_name>" etc. Any pointers ? >>>>>>> >>>>>>> ERROR: AnalysisException: java.lang.NoClassDefFoundError: Could not >>>>>>> initialize class com.cloudera.impala.util.HdfsCachingUtil >>>>>>> >>>>>>> CAUSED BY: ExecutionException: java.lang.NoClassDefFoundError: Could >>>>>>> not initialize class com.cloudera.impala.util.HdfsCachingUtil >>>>>>> >>>>>>> CAUSED BY: NoClassDefFoundError: Could not initialize class >>>>>>> com.cloudera.impala.util.HdfsCachingUtil >>>>>>> >>>>>>> CAUSED BY: TableLoadingException: java.lang.NoClassDefFoundError: >>>>>>> Could not initialize class com.cloudera.impala.util.HdfsCachingUtil >>>>>>> >>>>>>> CAUSED BY: ExecutionException: java.lang.NoClassDefFoundError: Could >>>>>>> not initialize class com.cloudera.impala.util.HdfsCachingUtil >>>>>>> >>>>>>> CAUSED BY: NoClassDefFoundError: Could not initialize class >>>>>>> com.cloudera.impala.util.HdfsCachingUtil >>>>>>> >>>>>>> I used this tree: >>>>>>> https://github.com/cloudera/Impala/tree/cdh5.5.2-release >>>>>>> >>>>>>> On Mon, Apr 4, 2016 at 12:01 PM Skye Wanderman-Milne < >>>>>>> [email protected]> wrote: >>>>>>> >>>>>>>> I think it should be >>>>>>>> https://github.com/cloudera/Impala/tree/cdh5-2.3.0_5.5.2 >>>>>>>> >>>>>>>> On Mon, Apr 4, 2016 at 12:00 PM, Pradeep Nayak < >>>>>>>> [email protected]> wrote: >>>>>>>> >>>>>>>>> Also to what release this parcel *5.5.2-1.cdh5.5.2.p0.4 *map to >>>>>>>>> on github ? I am unable to find a tag/branch for this parcel type. >>>>>>>>> >>>>>>>>> >>>>>>>>> On Mon, Apr 4, 2016 at 11:58 AM Skye Wanderman-Milne < >>>>>>>>> [email protected]> wrote: >>>>>>>>> >>>>>>>>>> Ah yes, both 1 and 2 are correct. Glad you figured it out! >>>>>>>>>> >>>>>>>>>> On Mon, Apr 4, 2016 at 11:56 AM, Pradeep Nayak < >>>>>>>>>> [email protected]> wrote: >>>>>>>>>> >>>>>>>>>>> I just figured. >>>>>>>>>>> 1. For the first time you need to use the ./buildall.sh and for >>>>>>>>>>> subsequent fe compilation I can just use maven >>>>>>>>>>> 2. It doesn't build on Macbook >>>>>>>>>>> 3. I set up a Ubuntu vm and got this compiled. >>>>>>>>>>> >>>>>>>>>>> Pradeep >>>>>>>>>>> >>>>>>>>>>> On Mon, Apr 4, 2016 at 11:07 AM Skye Wanderman-Milne < >>>>>>>>>>> [email protected]> wrote: >>>>>>>>>>> >>>>>>>>>>>> Hey Pradeep, >>>>>>>>>>>> >>>>>>>>>>>> You should try running the $IMPALA_HOME/buildall.sh script in >>>>>>>>>>>> order to build Impala. It has a lot of necessary setup to build >>>>>>>>>>>> Impala. >>>>>>>>>>>> Here are the commands from buildall.sh that should provide the >>>>>>>>>>>> impala-data-source-api jar for building the FE: >>>>>>>>>>>> >>>>>>>>>>>> # build the external data source API >>>>>>>>>>>> pushd ${IMPALA_HOME}/ext-data-source >>>>>>>>>>>> ${IMPALA_HOME}/bin/mvn-quiet.sh install -DskipTests >>>>>>>>>>>> popd >>>>>>>>>>>> >>>>>>>>>>>> See >>>>>>>>>>>> https://github.com/cloudera/Impala/blob/cdh5-trunk/buildall.sh#L283 >>>>>>>>>>>> >>>>>>>>>>>> Hope that helps! >>>>>>>>>>>> Skye >>>>>>>>>>>> >>>>>>>>>>>> On Sat, Apr 2, 2016 at 12:55 PM, Pradeep Nayak < >>>>>>>>>>>> [email protected]> wrote: >>>>>>>>>>>> >>>>>>>>>>>>> I just cloned the Impala source from github, and I am trying >>>>>>>>>>>>> to compile the front end per Impala wiki. I get the error below. >>>>>>>>>>>>> I am using >>>>>>>>>>>>> maven 3. >>>>>>>>>>>>> >>>>>>>>>>>>> [ERROR] Failed to execute goal on project impala-frontend: >>>>>>>>>>>>> Could not resolve dependencies for project >>>>>>>>>>>>> com.cloudera.impala:impala-frontend:jar:0.1-SNAPSHOT: Failure to >>>>>>>>>>>>> find >>>>>>>>>>>>> com.cloudera.impala:impala-data-source-api:jar:1.0-SNAPSHOT in >>>>>>>>>>>>> https://repository.cloudera.com/content/groups/cdh-releases-rcs >>>>>>>>>>>>> was cached in the local repository, resolution will not be >>>>>>>>>>>>> reattempted >>>>>>>>>>>>> until the update interval of cdh.rcs.releases.repo has elapsed or >>>>>>>>>>>>> updates >>>>>>>>>>>>> are forced -> [Help 1 >>>>>>>>>>>>> >>>>>>>>>>>>> This is the command I used: mvn clean package >>>>>>>>>>>>> dependency:copy-dependencies -DskipTests=true >>>>>>>>>>>>> >>>>>>>>>>>>> Any idea getting around this problem ? >>>>>>>>>>>>> >>>>>>>>>>>>> Cheers! >>>>>>>>>>>>> Pradeep >>>>>>>>>>>>> >>>>>>>>>>>>> -- >>>>>>>>>>>>> You received this message because you are subscribed to the >>>>>>>>>>>>> Google Groups "Impala Dev" group. >>>>>>>>>>>>> To unsubscribe from this group and stop receiving emails from >>>>>>>>>>>>> it, send an email to [email protected]. >>>>>>>>>>>>> >>>>>>>>>>>> >>>>>>>>>>>> -- >>>>>>>>>>> You received this message because you are subscribed to the >>>>>>>>>>> Google Groups "Impala Dev" group. >>>>>>>>>>> To unsubscribe from this group and stop receiving emails from >>>>>>>>>>> it, send an email to [email protected]. >>>>>>>>>>> >>>>>>>>>> >>>>>>>>>> >>>>>>>> >>>>>> >>>> >>
