I can visit spark web-ui http://master:8080/ if there are any other environment that I should config.
------------------ ???????? ------------------ ??????: "Liang Chen";<chenliang6...@gmail.com>; ????????: 2016??12??19??(??????) ????3:40 ??????: "dev"<dev@carbondata.incubator.apache.org>; ????: Re: How to compile the latest source code of carbondata Hi Please check your spark environment if it is ready ? 2016-12-19 15:34 GMT+08:00 251469031 <251469...@qq.com>: > the privileges of the folder "carbondata" is: > > > drwxr-xr-x 18 hadoop hadoop 4096 Dec 19 14:56 carbondata > > > and hadoop is the user who run maven. > > > well, after run mvn command, I get the info from console as follows: > > > [INFO] Reactor Summary: > [INFO] > [INFO] Apache CarbonData :: Parent ........................ SUCCESS [ > 1.012 s] > [INFO] Apache CarbonData :: Common ........................ SUCCESS [ > 2.066 s] > [INFO] Apache CarbonData :: Core .......................... SUCCESS [ > 5.512 s] > [INFO] Apache CarbonData :: Processing .................... SUCCESS [ > 1.892 s] > [INFO] Apache CarbonData :: Hadoop ........................ SUCCESS [ > 0.789 s] > [INFO] Apache CarbonData :: Spark Common .................. SUCCESS [ > 17.121 s] > [INFO] Apache CarbonData :: Spark ......................... SUCCESS [ > 33.269 s] > [INFO] Apache CarbonData :: Assembly ...................... SUCCESS [ > 17.700 s] > [INFO] Apache CarbonData :: Spark Examples ................ SUCCESS [ > 7.741 s] > [INFO] ------------------------------------------------------------ > ------------ > [INFO] BUILD SUCCESS > [INFO] ------------------------------------------------------------ > ------------ > [INFO] Total time: 01:27 min > [INFO] Finished at: 2016-12-19T14:57:26+08:00 > [INFO] Final Memory: 83M/1623M > [INFO] ------------------------------------------------------------ > ------------ > > > > but I didn't find a file names spark-submit under the path carbondata/bin/: > > > [hadoop@master ~]$ cd carbondata/bin/ > [hadoop@master bin]$ ll > total 8 > -rwxrwxr-x 1 hadoop hadoop 3879 Dec 19 14:54 carbon-spark-shell > -rwxrwxr-x 1 hadoop hadoop 2820 Dec 19 14:54 carbon-spark-sql > > > > is this phenomenon normal ? > > > > > > ------------------ ???????? ------------------ > ??????: "Liang Chen";<chenliang6...@gmail.com>; > ????????: 2016??12??19??(??????) ????3:19 > ??????: "dev"<dev@carbondata.incubator.apache.org>; > > ????: Re: How to compile the latest source code of carbondata > > > > Hi > > Please check if you have added the enough right for folder "carbondata"? > ------------------------------------------------------------ > --------------- > For spark 1.5, the compile process has no issue, but carbon-spark-shell > can not run correctly: > step 1: git clone https://github.com/apache/incubator-carbondata.git > carbondata > step 2: mvn clean package -DskipTests -Pspark-1.5 > step 3: ./bin/carbon-spark-shell, and it turns out: > > > [hadoop@master carbondata]$ ./bin/carbon-spark-shell > ./bin/carbon-spark-shell: line 78: /bin/spark-submit: No such file or > directory > > 2016-12-19 15:05 GMT+08:00 251469031 <251469...@qq.com>: > > > thx liang. > > > > > > I've tried spark 2.0.0 and spark 1.5.0, my step & script is: > > > > > > For spark 2.0, the compile process has no issue, but carbon-spark-shell > > can not run correctly: > > > > > > step 1: git clone https://github.com/apache/incubator-carbondata.git > > carbondata > > step 2: mvn clean package -DskipTests -Pspark-2.0 > > step 3: ./bin/carbon-spark-shell, and is turns out: > > > > > > [hadoop@master carbondata]$ ./bin/carbon-spark-shell > > ls: cannot access /home/hadoop/carbondata/assembly/target/scala-2.10: No > > such file or directory > > ls: cannot access /home/hadoop/carbondata/assembly/target/scala-2.10: No > > such file or directory > > ./bin/carbon-spark-shell: line 78: /bin/spark-submit: No such file or > > directory > > > > > > > > For spark 1.5, the compile process has no issue, but carbon-spark-shell > > can not run correctly: > > step 1: git clone https://github.com/apache/incubator-carbondata.git > > carbondata > > step 2: mvn clean package -DskipTests -Pspark-1.5 > > step 3: ./bin/carbon-spark-shell, and it turns out: > > > > > > [hadoop@master carbondata]$ ./bin/carbon-spark-shell > > ./bin/carbon-spark-shell: line 78: /bin/spark-submit: No such file or > > directory > > > > > > > > > > > > > > > > > > > > > > ------------------ ???????? ------------------ > > ??????: "Liang Chen";<chenliang6...@gmail.com>; > > ????????: 2016??12??19??(??????) ????2:37 > > ??????: "dev"<dev@carbondata.incubator.apache.org>; > > > > ????: Re: How to compile the latest source code of carbondata > > > > > > > > Hi > > > > Can you share : do you get what errors and using which compile command? > > > > Regards > > Liang > > > > 2016-12-19 14:32 GMT+08:00 251469031 <251469...@qq.com>: > > > > > Hi all: > > > > > > I've tried to comple the latest source code followed by the > toturial: > > > https://cwiki.apache.org/confluence/display/CARBONDATA/Quick+Start , > but > > > it doesn't work on the latest source code on the github. > > > > > > > > > Would you send me some toturial about how to do this or tell me how > > to > > > use carbondata, thx~ > > > > > > > > > > -- > > Regards > > Liang > > > > > -- > Regards > Liang -- Regards Liang
