On Jul 7, 2014, at 10:56 AM, Jon Maron <[email protected]> wrote:
> From functional_tests.md: > > ## Running and debugging the functional tests. > > The functional tests all > > 1. In the root `slider` directory, build a complete Slider release > > mvn install -DskipTests > 1. Start the YARN cluster/set up proxies to connect to it, etc. > > 1. In the `slider-funtest` dir, run the test > > mvn test -Dtest=TestHBaseCreateCluster So which test should I run for good functional, hbase coverage? > > > — Jon > > On Jul 7, 2014, at 10:47 AM, Sumit Mohanty <[email protected]> wrote: > >> Which test is TestHBaseCreateCluster - or you >> meant TestFunctionalHBaseCluster#testHBaseCreateCluster? >> >> >> On Mon, Jul 7, 2014 at 7:41 AM, Jon Maron <[email protected]> wrote: >> >>> Thanks. >>> >>> Moving on…. >>> >>> I’ve tried to carefully follow the directions, as well as debug thru the >>> issue, but I can’t seem to get any HBase tests to run. I have: >>> >>> 1) created and installed the package >>> 2) modified the appConfig and metainfo files >>> 3) added the hbase enablement flag to the slider-client file I’m using >>> 4) added the other expected hbase properties to the same file >>> 5) Attempted the following command >>> >>> mvn test -Dtest=TestHBaseCreateCluster >>> >>> But all I get is the output below. I see the warnings, but I’m not >>> certain of their significance… >>> >>> — Jon >>> >>> [INFO] Scanning for projects... >>> [INFO] >>> [INFO] >>> ------------------------------------------------------------------------ >>> [INFO] Building Slider Functional Tests 0.31.0-incubating-SNAPSHOT >>> [INFO] >>> ------------------------------------------------------------------------ >>> [WARNING] The POM for org.apache.hbase:hbase-client:jar:0.98.3-hadoop2 is >>> invalid, transitive dependencies (if any) will not be available, enable >>> debug logging for more details >>> [WARNING] The POM for org.apache.hbase:hbase-server:jar:0.98.3-hadoop2 is >>> invalid, transitive dependencies (if any) will not be available, enable >>> debug logging for more details >>> [WARNING] The POM for >>> org.apache.hbase:hbase-common:jar:tests:0.98.3-hadoop2 is invalid, >>> transitive dependencies (if any) will not be available, enable debug >>> logging for more details >>> [WARNING] The POM for org.apache.hbase:hbase-it:jar:tests:0.98.3-hadoop2 >>> is invalid, transitive dependencies (if any) will not be available, enable >>> debug logging for more details >>> [WARNING] The POM for >>> org.apache.hbase:hbase-hadoop-compat:jar:tests:0.98.3-hadoop2 is invalid, >>> transitive dependencies (if any) will not be available, enable debug >>> logging for more details >>> [WARNING] The POM for >>> org.apache.hbase:hbase-hadoop2-compat:jar:tests:0.98.3-hadoop2 is invalid, >>> transitive dependencies (if any) will not be available, enable debug >>> logging for more details >>> [WARNING] The POM for >>> org.apache.hbase:hbase-server:jar:tests:0.98.3-hadoop2 is invalid, >>> transitive dependencies (if any) will not be available, enable debug >>> logging for more details >>> [INFO] >>> [INFO] --- apache-rat-plugin:0.10:check (check-licenses) @ slider-funtest >>> --- >>> [INFO] 51 implicit excludes (use -debug for more details). >>> [INFO] Exclude: **/*.json >>> [INFO] Exclude: **/httpfs-signature.secret >>> [INFO] Exclude: **/regionservers >>> [INFO] 29 resources included (use -debug for more details) >>> Warning: org.apache.xerces.jaxp.SAXParserImpl$JAXPSAXParser: Property ' >>> http://www.oracle.com/xml/jaxp/properties/entityExpansionLimit' is not >>> recognized. >>> Compiler warnings: >>> WARNING: 'org.apache.xerces.jaxp.SAXParserImpl: Property ' >>> http://javax.xml.XMLConstants/property/accessExternalDTD' is not >>> recognized.' >>> Warning: org.apache.xerces.parsers.SAXParser: Feature ' >>> http://javax.xml.XMLConstants/feature/secure-processing' is not >>> recognized. >>> Warning: org.apache.xerces.parsers.SAXParser: Property ' >>> http://javax.xml.XMLConstants/property/accessExternalDTD' is not >>> recognized. >>> Warning: org.apache.xerces.parsers.SAXParser: Property ' >>> http://www.oracle.com/xml/jaxp/properties/entityExpansionLimit' is not >>> recognized. >>> [INFO] Rat check: Summary of files. Unapproved: 0 unknown: 0 generated: 0 >>> approved: 29 licence. >>> [INFO] >>> [INFO] --- properties-maven-plugin:1.0-alpha-2:read-project-properties >>> (default) @ slider-funtest --- >>> [WARNING] Ignoring missing properties file: >>> /Users/jmaron/dev/workspaces/slider-asf/incubator-slider/slider-funtest/build.properties >>> [INFO] >>> [INFO] --- maven-resources-plugin:2.5:resources (default-resources) @ >>> slider-funtest --- >>> [debug] execute contextualize >>> [INFO] Using 'UTF-8' encoding to copy filtered resources. >>> [INFO] skip non existing resourceDirectory >>> /Users/jmaron/dev/workspaces/slider-asf/incubator-slider/slider-funtest/src/main/resources >>> [INFO] >>> [INFO] --- maven-dependency-plugin:2.8:copy-dependencies >>> (copy-dependencies) @ slider-funtest --- >>> [INFO] apache-slider-command-logger-0.31.0-incubating-SNAPSHOT.zip already >>> exists in destination. >>> [INFO] >>> [INFO] --- maven-compiler-plugin:3.1:compile (default-compile) @ >>> slider-funtest --- >>> [INFO] Changes detected - recompiling the module! >>> [INFO] Using Groovy-Eclipse compiler to compile both Java and Groovy files >>> [INFO] >>> [INFO] --- maven-resources-plugin:2.5:testResources >>> (default-testResources) @ slider-funtest --- >>> [debug] execute contextualize >>> [INFO] Using 'UTF-8' encoding to copy filtered resources. >>> [INFO] Copying 1 resource >>> [INFO] >>> [INFO] --- maven-compiler-plugin:3.1:testCompile (default-testCompile) @ >>> slider-funtest --- >>> [INFO] Changes detected - recompiling the module! >>> [INFO] Using Groovy-Eclipse compiler to compile both Java and Groovy files >>> [INFO] >>> [INFO] --- maven-surefire-plugin:2.16:test (default-test) @ slider-funtest >>> --- >>> [WARNING] The parameter forkMode is deprecated since version 2.14. Use >>> forkCount and reuseForks instead. >>> [INFO] >>> [INFO] --- maven-dependency-plugin:2.8:copy (copy) @ slider-funtest --- >>> [INFO] Configured Artifact: >>> org.apache.slider:apache-slider-command-logger:?:zip >>> [INFO] >>> org.apache.slider:apache-slider-command-logger:0.31.0-incubating-SNAPSHOT:zip >>> already exists in >>> /Users/jmaron/dev/workspaces/slider-asf/incubator-slider/slider-funtest/target/package-tmp >>> [INFO] >>> ------------------------------------------------------------------------ >>> [INFO] BUILD SUCCESS >>> [INFO] >>> ------------------------------------------------------------------------ >>> [INFO] Total time: 6.812s >>> [INFO] Finished at: Mon Jul 07 10:36:06 EDT 2014 >>> [INFO] Final Memory: 26M/445M >>> [INFO] >>> ------------------------------------------------------------------------ >>> >>> On Jul 7, 2014, at 10:28 AM, Ted Yu <[email protected]> wrote: >>> >>>> I have added a note to app-packages/hbase/README.txt >>>> >>>> Cheers >>>> >>>> >>>> On Mon, Jul 7, 2014 at 7:12 AM, Sumit Mohanty <[email protected]> >>>> wrote: >>>> >>>>> You need to copy the hbase tarball to >>>>> ~/.m2/repository/org/apache/hbase/hbase/0.98.3-hadoop2/. >>>>> I do not know why it needs to be done as "mvn install:install-file ..." >>>>> should do it. I also had the same problem. >>>>> >>>>> >>>>> On Mon, Jul 7, 2014 at 7:07 AM, Jon Maron <[email protected]> >>> wrote: >>>>> >>>>>> Hi, >>>>>> >>>>>> I’ve tried numerous iterations with slight modifications but the >>>>>> documented method for creating an HBase package using maven simply >>> won’t >>>>>> work (see output below). I’ll resort to the manual method for now…. >>>>>> >>>>>> HW10386:hbase jmaron$ mvn install:install-file >>>>>> -Dfile=~/Downloads/hbase-0.98.3-hadoop2-bin.tar.gz >>>>>> -DgroupId=org.apache.hbase -DartifactId=hbase -Dversion=0.98.3-hadoop2 >>>>>> -Dclassifier=bin -Dpackaging=tar.gz >>>>>> [INFO] Scanning for projects... >>>>>> [INFO] >>>>>> [INFO] >>>>>> >>> ------------------------------------------------------------------------ >>>>>> [INFO] Building Slider HBase App Package 0.31.0-incubating-SNAPSHOT >>>>>> [INFO] >>>>>> >>> ------------------------------------------------------------------------ >>>>>> [INFO] >>>>>> [INFO] --- maven-install-plugin:2.3.1:install-file (default-cli) @ >>>>>> slider-hbase-app-package --- >>>>>> [INFO] Installing >>>>>> >>>>> >>> /Users/jmaron/dev/workspaces/slider-asf/incubator-slider/app-packages/hbase/~/Downloads/hbase-0.98.3-hadoop2-bin.tar.gz >>>>>> to >>>>>> >>>>> >>> /Users/jmaron/.m2/repository/org/apache/hbase/hbase/0.98.3-hadoop2/hbase-0.98.3-hadoop2-bin.tar.gz >>>>>> [INFO] Installing >>>>>> >>>>> >>> /var/folders/xr/0n_m0gjd6dgd1kflhc4k03f40000gp/T/mvninstall736874131779873038.pom >>>>>> to >>>>>> >>>>> >>> /Users/jmaron/.m2/repository/org/apache/hbase/hbase/0.98.3-hadoop2/hbase-0.98.3-hadoop2.pom >>>>>> [INFO] >>>>>> >>> ------------------------------------------------------------------------ >>>>>> [INFO] BUILD SUCCESS >>>>>> [INFO] >>>>>> >>> ------------------------------------------------------------------------ >>>>>> [INFO] Total time: 0.688s >>>>>> [INFO] Finished at: Mon Jul 07 10:04:30 EDT 2014 >>>>>> [INFO] Final Memory: 6M/245M >>>>>> [INFO] >>>>>> >>> ------------------------------------------------------------------------ >>>>>> HW10386:hbase jmaron$ cd >>>>>> ~/.m2/repository/org/apache/hbase/hbase/0.98.3-hadoop2/ >>>>>> _maven.repositories hbase-0.98.3-hadoop2.pom >>>>>> HW10386:hbase jmaron$ cd >>>>>> ~/.m2/repository/org/apache/hbase/hbase/0.98.3-hadoop2/ >>>>>> HW10386:hbase jmaron$ mvn clean package -DskipTests -Phbase-app-package >>>>>> [INFO] Scanning for projects... >>>>>> [INFO] >>>>>> [INFO] >>>>>> >>> ------------------------------------------------------------------------ >>>>>> [INFO] Building Slider HBase App Package 0.31.0-incubating-SNAPSHOT >>>>>> [INFO] >>>>>> >>> ------------------------------------------------------------------------ >>>>>> Downloading: >>>>>> >>>>> >>> https://repository.apache.org/content/groups/staging/org/apache/hbase/hbase/0.98.3-hadoop2/hbase-0.98.3-hadoop2-hbase.tar.gz >>>>>> Downloading: >>>>>> >>>>> >>> http://repo.maven.apache.org/maven2/org/apache/hbase/hbase/0.98.3-hadoop2/hbase-0.98.3-hadoop2-hbase.tar.gz >>>>>> [INFO] >>>>>> >>> ------------------------------------------------------------------------ >>>>>> [INFO] BUILD FAILURE >>>>>> [INFO] >>>>>> >>> ------------------------------------------------------------------------ >>>>>> [INFO] Total time: 1.866s >>>>>> [INFO] Finished at: Mon Jul 07 10:05:11 EDT 2014 >>>>>> [INFO] Final Memory: 10M/245M >>>>>> [INFO] >>>>>> >>> ------------------------------------------------------------------------ >>>>>> [ERROR] Failed to execute goal on project slider-hbase-app-package: >>> Could >>>>>> not resolve dependencies for project >>>>>> >>>>> >>> org.apache.slider:slider-hbase-app-package:pom:0.31.0-incubating-SNAPSHOT: >>>>>> Could not find artifact >>>>> org.apache.hbase:hbase:tar.gz:hbase:0.98.3-hadoop2 >>>>>> in ASF Staging (https://repository.apache.org/content/groups/staging/) >>>>> -> >>>>>> [Help 1] >>>>>> [ERROR] >>>>>> [ERROR] To see the full stack trace of the errors, re-run Maven with >>> the >>>>>> -e switch. >>>>>> [ERROR] Re-run Maven using the -X switch to enable full debug logging. >>>>>> [ERROR] >>>>>> [ERROR] For more information about the errors and possible solutions, >>>>>> please read the following articles: >>>>>> [ERROR] [Help 1] >>>>>> >>>>> >>> http://cwiki.apache.org/confluence/display/MAVEN/DependencyResolutionException >>>>>> >>>>>> >>>>>> -- >>>>>> CONFIDENTIALITY NOTICE >>>>>> NOTICE: This message is intended for the use of the individual or >>> entity >>>>> to >>>>>> which it is addressed and may contain information that is confidential, >>>>>> privileged and exempt from disclosure under applicable law. If the >>> reader >>>>>> of this message is not the intended recipient, you are hereby notified >>>>> that >>>>>> any printing, copying, dissemination, distribution, disclosure or >>>>>> forwarding of this communication is strictly prohibited. If you have >>>>>> received this communication in error, please contact the sender >>>>> immediately >>>>>> and delete it from your system. Thank You. >>>>>> >>>>> >>>>> -- >>>>> CONFIDENTIALITY NOTICE >>>>> NOTICE: This message is intended for the use of the individual or >>> entity to >>>>> which it is addressed and may contain information that is confidential, >>>>> privileged and exempt from disclosure under applicable law. If the >>> reader >>>>> of this message is not the intended recipient, you are hereby notified >>> that >>>>> any printing, copying, dissemination, distribution, disclosure or >>>>> forwarding of this communication is strictly prohibited. If you have >>>>> received this communication in error, please contact the sender >>> immediately >>>>> and delete it from your system. Thank You. >>>>> >>> >>> >>> -- >>> CONFIDENTIALITY NOTICE >>> NOTICE: This message is intended for the use of the individual or entity to >>> which it is addressed and may contain information that is confidential, >>> privileged and exempt from disclosure under applicable law. If the reader >>> of this message is not the intended recipient, you are hereby notified that >>> any printing, copying, dissemination, distribution, disclosure or >>> forwarding of this communication is strictly prohibited. If you have >>> received this communication in error, please contact the sender immediately >>> and delete it from your system. Thank You. >>> >> >> -- >> CONFIDENTIALITY NOTICE >> NOTICE: This message is intended for the use of the individual or entity to >> which it is addressed and may contain information that is confidential, >> privileged and exempt from disclosure under applicable law. If the reader >> of this message is not the intended recipient, you are hereby notified that >> any printing, copying, dissemination, distribution, disclosure or >> forwarding of this communication is strictly prohibited. If you have >> received this communication in error, please contact the sender immediately >> and delete it from your system. Thank You. > -- CONFIDENTIALITY NOTICE NOTICE: This message is intended for the use of the individual or entity to which it is addressed and may contain information that is confidential, privileged and exempt from disclosure under applicable law. If the reader of this message is not the intended recipient, you are hereby notified that any printing, copying, dissemination, distribution, disclosure or forwarding of this communication is strictly prohibited. If you have received this communication in error, please contact the sender immediately and delete it from your system. Thank You.
