Well, then you might not source the impala configs properly. Those should be set via bin/impala-config.sh. What is the exact command you use for sourcing the configs?
On Tue, Apr 3, 2018 at 10:04 AM, Anubhav Tarar <anubhav.ta...@knoldus.in> wrote: > these properties were not set even after sourcing the configs thats why i > export them myself before running the statestore and catalog > > On Tue, Apr 3, 2018 at 1:25 PM, Gabor Kaszab <gaborkas...@cloudera.com> > wrote: > >> I'm glad that at least the build has been successful eventually :) >> >> I checked these on my env: >> CLUSTER_DIR = <Impala_Home>/testdata/cluster >> IMPALA_LLVM_VERSION=3.9.1 >> >> Btw, these should be set properly by impala-config.sh. Is there a reason >> you changed these? >> >> >> On Tue, Apr 3, 2018 at 9:27 AM, Anubhav Tarar <anubhav.ta...@knoldus.in> >> wrote: >> >>> yes i do all the steps as you mentioned my impala_home also points to >>> right path and build was successful after commenting part of script >>> >>> now i am able to query from impala-hiveserver2 successfully i did the >>> following extra steps >>> >>> is anything wrong with these steps? >>> >>> export CLUSTER_DIR=''/tmp" >>> export IMPALA_LLVM_VERSION=2 >>> >>> but only problem is that i can not start impala -shell >>> >>> this is error >>> >>> ./impala-shell.sh: line 24: exec: impala-python: not found >>> >>> >>> On Tue, Apr 3, 2018 at 12:38 PM, Gabor Kaszab <gaborkas...@cloudera.com> >>> wrote: >>> >>>> Hi, >>>> >>>> I have the feeling that you haven't mentioned all the steps you made. >>>> Please next time provide as much information as you have so that we can >>>> help easier. >>>> As I see you chose "Suggestion 2". These might be silly questions but >>>> let's make sure: >>>> 1: Did you source the Impala configs? >>>> 2: Where does you IMPALA_HOME point to? >>>> 3: After commenting that part of the script did you manage to build >>>> Impala successfully? >>>> >>>> My suggestion is to close and re-open your terminal, source the Impala >>>> configs, make sure the git part of bootstrap_system.sh is commented, run >>>> bootstrap_development. >>>> In case all of these succeeded then you can try running >>>> start-impala-cluster.sh >>>> >>>> Gabor >>>> >>>> >>>> On Mon, Apr 2, 2018 at 11:47 AM, Anubhav Tarar < >>>> anubhav.ta...@knoldus.in> wrote: >>>> >>>>> HI,i commented out the part as you said then i try started statestore >>>>> but get this exception >>>>> >>>>> ./start-statestored.sh: line 52: CLUSTER_DIR: unbound variable >>>>> >>>>> did i need to set these env variables by myself? >>>>> >>>>> On Thu, Mar 29, 2018 at 7:41 PM, Gabor Kaszab < >>>>> gaborkas...@cloudera.com> wrote: >>>>> >>>>>> That can be an issue because the build is being executed in ~/Impala >>>>>> according your logs you pasted even though you tried to build it in a >>>>>> different directory. >>>>>> >>>>>> Suggestion 1: >>>>>> My suggestion is (in case you don't insist to the Impala dir you >>>>>> created on your own) is the following: >>>>>> 1: Close you console and re-open a new one. >>>>>> 2: Move to /home/anubhav/Impala >>>>>> 3: Make the config sourcing in this dir >>>>>> 4: bootstrap_development.sh >>>>>> >>>>>> The thing is that bootstrap_development.sh for some reason does a >>>>>> git clone to ~/Impala and tries to build there, and if you have done your >>>>>> config sourcing in another directory that that can cause some issues. >>>>>> (Haven't tried to compile in ~/Impala, though, I always went for >>>>>> Suggestion >>>>>> 2) >>>>>> >>>>>> Suggestion 2: >>>>>> In case you insist to building Impala in the directory where you have >>>>>> extracted the source files then it's a bit trickier: The only way I found >>>>>> to do so with bootstrap_development.sh is to comment out the part from >>>>>> the >>>>>> code that does the git clone from bootstrap_system.sh. >>>>>> Basically this part should be commented: >>>>>> " >>>>>> >>>>>> if ! [[ -d ~/Impala ]] >>>>>> >>>>>> then >>>>>> >>>>>> time -p git clone https://git-wip-us.apache.org/repos/asf/impala. >>>>>> git ~/Impala >>>>>> >>>>>> fi >>>>>> >>>>>> cd ~/Impala >>>>>> " >>>>>> Well, it might be enough to comment out the cd ~/Impala part. >>>>>> >>>>>> Hope this helps. >>>>>> Gabor >>>>>> >>>>>> >>>>>> >>>>>> >>>>>> On Thu, Mar 29, 2018 at 3:52 PM, Anubhav Tarar < >>>>>> anubhav.ta...@knoldus.in> wrote: >>>>>> >>>>>>> No I am not executing step3 from /user/Anubhav/impala I am executing >>>>>>> it from folder where I downloaded binary impala >>>>>>> On 29-Mar-2018 6:56 PM, "Gabor Kaszab" <gaborkas...@cloudera.com> >>>>>>> wrote: >>>>>>> >>>>>>>> Thx for collecting these details. >>>>>>>> >>>>>>>> 1: >>>>>>>> Do your step 4 (source configs) before step 3 >>>>>>>> (bootstrap_development.sh) >>>>>>>> >>>>>>>> 2: >>>>>>>> Are you executing step 3 from /home/anubhav/Impala? >>>>>>>> >>>>>>>> 3: >>>>>>>> If your build is still failing after doing 1: could you search for >>>>>>>> the particular error in the command's output? There might be something >>>>>>>> useful because the last few lines you copied aren't that useful to be >>>>>>>> honest. >>>>>>>> >>>>>>>> 4: >>>>>>>> If your Impala build fails in your step3 then there is no point >>>>>>>> doing step5. >>>>>>>> >>>>>>>> Gabor >>>>>>>> >>>>>>>> On Thu, Mar 29, 2018 at 1:29 PM, Anubhav Tarar < >>>>>>>> anubhav.ta...@knoldus.in> wrote: >>>>>>>> >>>>>>>>> HI,Here are the steps >>>>>>>>> >>>>>>>>> step 1.download impala 2.11 from official download page >>>>>>>>> step 2.extract he jar >>>>>>>>> step 3.goes to impala folder and hit command >>>>>>>>> >>>>>>>>> bootstrap_development.sh >>>>>>>>> >>>>>>>>> which give this output >>>>>>>>> >>>>>>>>> >>>>>>>>> [INFO] BUILD SUCCESS >>>>>>>>> [ 86%] Built target fe >>>>>>>>> Makefile:94: recipe for target 'all' failed >>>>>>>>> make: *** [all] Error 2 >>>>>>>>> Error in /home/anubhav/Impala/bin/make_impala.sh at line 178: >>>>>>>>> ${MAKE_CMD} ${MAKE_ARGS} >>>>>>>>> >>>>>>>>> step 4: source the configs >>>>>>>>> >>>>>>>>> ./bin/impala-config.sh; >>>>>>>>> >>>>>>>>> . /bin/set-pythonpath.sh; >>>>>>>>> >>>>>>>>> . /bin/set-classpath.sh >>>>>>>>> >>>>>>>>> >>>>>>>>> step 5: start the impalad >>>>>>>>> >>>>>>>>> ./start-impala-cluster.py >>>>>>>>> /usr/bin/env: ‘impala-python’: No such file or directory >>>>>>>>> >>>>>>>>> >>>>>>>>> >>>>>>>>> I am trying as much as i can but these problems are not on google >>>>>>>>> and impala documentation doesn't seems to provide much help in >>>>>>>>> comparison >>>>>>>>> to hive or presto >>>>>>>>> >>>>>>>>> >>>>>>>>> >>>>>>>>> >>>>>>>>> On Thu, Mar 29, 2018 at 4:30 PM, Jeszy <jes...@gmail.com> wrote: >>>>>>>>> >>>>>>>>>> Hello Anubhav, >>>>>>>>>> >>>>>>>>>> Please include the steps that you've tried on your own to resolve >>>>>>>>>> this >>>>>>>>>> problem, the blockers you've faced, and in general provide as much >>>>>>>>>> information as possible about the problem at hand to encourage >>>>>>>>>> community members to spend time of their own working with you. >>>>>>>>>> Answering the questions you were asked earlier is the least, but >>>>>>>>>> I'd >>>>>>>>>> strongly encourage you to try to make sense of the error messages >>>>>>>>>> and >>>>>>>>>> attempt to take the issue as far as you can by reading Impala's >>>>>>>>>> wiki >>>>>>>>>> pages and searching online. >>>>>>>>>> >>>>>>>>>> HTH >>>>>>>>>> >>>>>>>>>> >>>>>>>>>> >>>>>>>>>> On 29 March 2018 at 12:36, Anubhav Tarar < >>>>>>>>>> anubhav.ta...@knoldus.in> wrote: >>>>>>>>>> > i resolved all your points but when i hit he development script >>>>>>>>>> this is the >>>>>>>>>> > error when i hit bootstrap >>>>>>>>>> > _development.sh >>>>>>>>>> > >>>>>>>>>> > [INFO] BUILD SUCCESS >>>>>>>>>> > [ 86%] Built target fe >>>>>>>>>> > Makefile:94: recipe for target 'all' failed >>>>>>>>>> > make: *** [all] Error 2 >>>>>>>>>> > Error in /home/anubhav/Impala/bin/make_impala.sh at line 178: >>>>>>>>>> ${MAKE_CMD} >>>>>>>>>> > ${MAKE_ARGS} >>>>>>>>>> > >>>>>>>>>> > now when i tried to run my impalad this is the error >>>>>>>>>> > >>>>>>>>>> > anubhav@anubhav-Vostro-3559:~/Impala/bin$ ./start-impalad.sh >>>>>>>>>> > ./start-impalad.sh: line 89: /admin: No such file or directory >>>>>>>>>> > /home/anubhav/Impala/be/build/latest/service/impalad: error >>>>>>>>>> while loading >>>>>>>>>> > shared libraries: libjvm.so: cannot open shared object file: No >>>>>>>>>> such file or >>>>>>>>>> > directory >>>>>>>>>> > >>>>>>>>>> > >>>>>>>>>> > someone please help >>>>>>>>>> > >>>>>>>>>> > On Wed, Mar 28, 2018 at 8:21 PM, Gabor Kaszab < >>>>>>>>>> gaborkas...@cloudera.com> >>>>>>>>>> > wrote: >>>>>>>>>> >> >>>>>>>>>> >> I few questions: >>>>>>>>>> >> - Is /home/anubhav/Impala the directory you expect your Impala >>>>>>>>>> sources. >>>>>>>>>> >> (It can happen that bootstrap_development.sh check-out Impala >>>>>>>>>> to a different >>>>>>>>>> >> directory you'd expect) >>>>>>>>>> >> - Can you find that kudu/client/client.h file somewhere in you >>>>>>>>>> toolchain >>>>>>>>>> >> directory? (To rule out that the script searches it on a wrong >>>>>>>>>> path) >>>>>>>>>> >> - Do you have a toolchain directory at all? >>>>>>>>>> >> - Have you executed those commands I sent you to set env >>>>>>>>>> variables? >>>>>>>>>> >> >>>>>>>>>> >> Gabor >>>>>>>>>> >> >>>>>>>>>> >> On Wed, Mar 28, 2018 at 8:23 AM, Anubhav Tarar < >>>>>>>>>> anubhav.ta...@knoldus.in> >>>>>>>>>> >> wrote: >>>>>>>>>> >>> >>>>>>>>>> >>> hi i cloned the apache impala then hit command >>>>>>>>>> >>> ./bin/bootstrap_development.sh >>>>>>>>>> >>> >>>>>>>>>> >>> still getting the same error >>>>>>>>>> >>> >>>>>>>>>> >>> File >>>>>>>>>> >>> "/home/anubhav/Impala/infra/python/bootstrap_virtualenv.py", >>>>>>>>>> line >>>>>>>>>> >>> 379, in <module> >>>>>>>>>> >>> kudu_client_dir = find_kudu_client_install_dir() >>>>>>>>>> >>> File >>>>>>>>>> >>> "/home/anubhav/Impala/infra/python/bootstrap_virtualenv.py", >>>>>>>>>> line >>>>>>>>>> >>> 315, in find_kudu_client_install_dir >>>>>>>>>> >>> error_if_kudu_client_not_found(install_dir) >>>>>>>>>> >>> File >>>>>>>>>> >>> "/home/anubhav/Impala/infra/python/bootstrap_virtualenv.py", >>>>>>>>>> line >>>>>>>>>> >>> 322, in error_if_kudu_client_not_found >>>>>>>>>> >>> raise Exception("Kudu client header not found at %s" % >>>>>>>>>> header_path) >>>>>>>>>> >>> Exception: Kudu client header not found at >>>>>>>>>> >>> /home/anubhav/Impala/toolchain/kudu-0eef8e0/debug/include/ku >>>>>>>>>> du/client/client.h >>>>>>>>>> >>> Error in /home/anubhav/Impala/bin/impala-python at line 25: >>>>>>>>>> >>> >>>>>>>>>> >>> >>>>>>>>>> >>> On Tue, Mar 27, 2018 at 1:48 PM, Jeszy <jes...@gmail.com> >>>>>>>>>> wrote: >>>>>>>>>> >>>> >>>>>>>>>> >>>> Hello Anubhav, >>>>>>>>>> >>>> >>>>>>>>>> >>>> Impala doesn't ship it's releases in binary format, so you >>>>>>>>>> will have >>>>>>>>>> >>>> to build it locally after downloading the source. For >>>>>>>>>> instruction on >>>>>>>>>> >>>> how to do that, see Gabor's comments. >>>>>>>>>> >>>> >>>>>>>>>> >>>> If you don't have an existing Hadoop cluster on which you >>>>>>>>>> want to run >>>>>>>>>> >>>> Impala, you can just use one of the distributor's packaged >>>>>>>>>> (binary) >>>>>>>>>> >>>> versions. Cloudera's CDH is also open source. >>>>>>>>>> >>>> >>>>>>>>>> >>>> HTH >>>>>>>>>> >>>> >>>>>>>>>> >>>> On 27 March 2018 at 10:14, Gabor Kaszab < >>>>>>>>>> gaborkas...@cloudera.com> >>>>>>>>>> >>>> wrote: >>>>>>>>>> >>>> > I have already provided you the sourcing steps in my first >>>>>>>>>> mail: >>>>>>>>>> >>>> > "Also, did you source the Impala configs? These are the >>>>>>>>>> ones I usually >>>>>>>>>> >>>> > use: >>>>>>>>>> >>>> > >>>>>>>>>> >>>> > . bin/impala-config.sh; >>>>>>>>>> >>>> > >>>>>>>>>> >>>> > . bin/set-pythonpath.sh; >>>>>>>>>> >>>> > >>>>>>>>>> >>>> > . bin/set-classpath.sh >>>>>>>>>> >>>> > >>>>>>>>>> >>>> > " >>>>>>>>>> >>>> > >>>>>>>>>> >>>> > >>>>>>>>>> >>>> > Have you tried following the Impala build page? >>>>>>>>>> >>>> > >>>>>>>>>> >>>> > https://cwiki.apache.org/confl >>>>>>>>>> uence/display/IMPALA/Building+Impala >>>>>>>>>> >>>> > >>>>>>>>>> >>>> > >>>>>>>>>> >>>> > Gabor >>>>>>>>>> >>>> > >>>>>>>>>> >>>> > >>>>>>>>>> >>>> > >>>>>>>>>> >>>> > On Tue, Mar 27, 2018 at 10:08 AM, Anubhav Tarar >>>>>>>>>> >>>> > <anubhav.ta...@knoldus.in> >>>>>>>>>> >>>> > wrote: >>>>>>>>>> >>>> >> >>>>>>>>>> >>>> >> i didn't clone the open source i downloaded apache impala >>>>>>>>>> 2.11 >>>>>>>>>> >>>> >> release >>>>>>>>>> >>>> >> from download page of official documentation >>>>>>>>>> >>>> >> https://impala.apache.org/downloads.html and what do you >>>>>>>>>> mean by >>>>>>>>>> >>>> >> sourcing of >>>>>>>>>> >>>> >> configs what are the steps? can you please provide me >>>>>>>>>> complete steps >>>>>>>>>> >>>> >> i am >>>>>>>>>> >>>> >> struck from 2 days >>>>>>>>>> >>>> > >>>>>>>>>> >>>> > >>>>>>>>>> >>> >>>>>>>>>> >>> >>>>>>>>>> >>> >>>>>>>>>> >>> >>>>>>>>>> >>> -- >>>>>>>>>> >>> Thanks and Regards >>>>>>>>>> >>> Anubhav Tarar >>>>>>>>>> >>> >>>>>>>>>> >>> Software Consultant >>>>>>>>>> >>> Knoldus Software LLP >>>>>>>>>> >>> LinkedIn Twitter fb >>>>>>>>>> >>> mob : 8588915184 <(858)%20891-5184> >>>>>>>>>> >> >>>>>>>>>> >> >>>>>>>>>> > >>>>>>>>>> > >>>>>>>>>> > >>>>>>>>>> > -- >>>>>>>>>> > Thanks and Regards >>>>>>>>>> > Anubhav Tarar >>>>>>>>>> > >>>>>>>>>> > Software Consultant >>>>>>>>>> > Knoldus Software LLP >>>>>>>>>> > LinkedIn Twitter fb >>>>>>>>>> > mob : 8588915184 <(858)%20891-5184> >>>>>>>>>> >>>>>>>>> >>>>>>>>> >>>>>>>>> >>>>>>>>> -- >>>>>>>>> Thanks and Regards >>>>>>>>> >>>>>>>>> * Anubhav Tarar * >>>>>>>>> >>>>>>>>> >>>>>>>>> * Software Consultant* >>>>>>>>> *Knoldus Software LLP <http://www.knoldus.com/home.knol> >>>>>>>>> * >>>>>>>>> LinkedIn <http://in.linkedin.com/in/rahulforallp> >>>>>>>>> Twitter <https://twitter.com/RahulKu71223673> fb >>>>>>>>> <rahulfora...@facebook.com> >>>>>>>>> mob : 8588915184 <(858)%20891-5184> >>>>>>>>> >>>>>>>> >>>>>>>> >>>>>> >>>>> >>>>> >>>>> -- >>>>> Thanks and Regards >>>>> >>>>> * Anubhav Tarar * >>>>> >>>>> >>>>> * Software Consultant* >>>>> *Knoldus Software LLP <http://www.knoldus.com/home.knol> * >>>>> LinkedIn <http://in.linkedin.com/in/rahulforallp> Twitter >>>>> <https://twitter.com/RahulKu71223673> fb >>>>> <rahulfora...@facebook.com> >>>>> mob : 8588915184 <(858)%20891-5184> >>>>> >>>> >>>> >>> >>> >>> -- >>> Thanks and Regards >>> >>> * Anubhav Tarar * >>> >>> >>> * Software Consultant* >>> *Knoldus Software LLP <http://www.knoldus.com/home.knol> * >>> LinkedIn <http://in.linkedin.com/in/rahulforallp> Twitter >>> <https://twitter.com/RahulKu71223673> fb <rahulfora...@facebook.com> >>> mob : 8588915184 <(858)%20891-5184> >>> >> >> > > > -- > Thanks and Regards > > * Anubhav Tarar * > > > * Software Consultant* > *Knoldus Software LLP <http://www.knoldus.com/home.knol> * > LinkedIn <http://in.linkedin.com/in/rahulforallp> Twitter > <https://twitter.com/RahulKu71223673> fb <rahulfora...@facebook.com> > mob : 8588915184 <(858)%20891-5184> >
