When I ran the RAT tool, I just specified the names of the directory without using $MY_SQROOT/../../. Here is the command I used, from the directory in which I untarred the file:
java -jar apache-rat-0.11/apache-rat-0.11.jar -E apache-trafodion-2.0.0-incubating/.rat-excludes --dir apache-trafodion-2.0.0-incubating >rat_log Hans On Thu, May 26, 2016 at 10:11 AM, Sandhya Sundaresan < [email protected]> wrote: > Hi Stack, > After you source in env.sh , can you change your current directory to > $MY_SQROOT and reattempt the RAT command ? > I found the RAT tool to be a bit finicky about the relative directory > paths. > We should also add that running RAT on a workspace that you have done a > build in will make the RAT tool choke on some of the binaries. > Thanks > Sandhya > > > -----Original Message----- > From: [email protected] [mailto:[email protected]] On Behalf Of Stack > Sent: Thursday, May 26, 2016 9:48 AM > To: [email protected] > Subject: Re: [VOTE] Apache Trafodion release 2.0.0 - release candidate 3 > > (Apologize for taking so long responding to this vote) > > First, thanks for that RAT_README and now for the dumb question: > > I sourced env.sh and then > > $ java -jar ~/bin/apache-rat-0.11/apache-rat-0.11.jar -E > $MY_SQROOT/../../.rat-excludes -d $MY_SQROOT/../.. > Exception in thread "main" java.io.FileNotFoundException: File > '/../../.rat-excludes' does not exist > at > org.apache.commons.io.FileUtils.openInputStream(FileUtils.java:254) > at org.apache.commons.io.FileUtils.readLines(FileUtils.java:1695) > at org.apache.commons.io.FileUtils.readLines(FileUtils.java:1712) > at org.apache.rat.Report.main(Report.java:96) > > ... so I did this: > > $ java -jar ~/bin/apache-rat-0.11/apache-rat-0.11.jar -E ./.rat-excludes > -d > $MY_SQROOT/../.. > > > ... and got below. Anyone else see this? I'm doing something wrong? > > St. > > > Exception in thread "main" org.apache.rat.api.RatException: Cannot analyse > header > at > > org.apache.rat.report.claim.util.ClaimReporterMultiplexer.report(ClaimReporterMultiplexer.java:44) > at > org.apache.rat.walker.DirectoryWalker.report(DirectoryWalker.java:147) > at > > org.apache.rat.walker.DirectoryWalker.processNonDirectories(DirectoryWalker.java:131) > at > org.apache.rat.walker.DirectoryWalker.process(DirectoryWalker.java:98) > at > > org.apache.rat.walker.DirectoryWalker.processDirectory(DirectoryWalker.java:71) > at > > org.apache.rat.walker.DirectoryWalker.processDirectories(DirectoryWalker.java:114) > at > org.apache.rat.walker.DirectoryWalker.process(DirectoryWalker.java:99) > at > org.apache.rat.walker.DirectoryWalker.run(DirectoryWalker.java:83) > at org.apache.rat.Report.report(Report.java:418) > at org.apache.rat.Report.report(Report.java:394) > at org.apache.rat.Report.report(Report.java:366) > at org.apache.rat.Report.styleReport(Report.java:346) > at org.apache.rat.Report.main(Report.java:109) > Caused by: org.apache.rat.document.RatDocumentAnalysisException: Cannot > analyse header > at > > org.apache.rat.analysis.DocumentHeaderAnalyser.analyse(DocumentHeaderAnalyser.java:47) > at > > org.apache.rat.analysis.DefaultAnalyserFactory$DefaultAnalyser.analyse(DefaultAnalyserFactory.java:60) > at > > org.apache.rat.document.impl.util.DocumentAnalyserMultiplexer.analyse(DocumentAnalyserMultiplexer.java:36) > at > > org.apache.rat.report.claim.util.ClaimReporterMultiplexer.report(ClaimReporterMultiplexer.java:42) > ... 12 more > Caused by: org.apache.rat.analysis.RatHeaderAnalysisException: Cannot read > header for FileDocument ( file = /../../dev/autofs name = /../../dev/autofs > metaData = org.apache.rat.api.MetaData@5e265ba4 ) > at > org.apache.rat.analysis.HeaderCheckWorker.read(HeaderCheckWorker.java:95) > at > > org.apache.rat.analysis.DocumentHeaderAnalyser.analyse(DocumentHeaderAnalyser.java:43) > ... 15 more > Caused by: java.io.IOException: Invalid argument > at java.io.FileInputStream.readBytes(Native Method) > at java.io.FileInputStream.read(FileInputStream.java:255) > at sun.nio.cs.StreamDecoder.readBytes(StreamDecoder.java:284) > at sun.nio.cs.StreamDecoder.implRead(StreamDecoder.java:326) > at sun.nio.cs.StreamDecoder.read(StreamDecoder.java:178) > at java.io.InputStreamReader.read(InputStreamReader.java:184) > at java.io.BufferedReader.fill(BufferedReader.java:161) > at java.io.BufferedReader.readLine(BufferedReader.java:324) > at java.io.BufferedReader.readLine(BufferedReader.java:389) > at > > org.apache.rat.analysis.HeaderCheckWorker.readLine(HeaderCheckWorker.java:108) > at > org.apache.rat.analysis.HeaderCheckWorker.read(HeaderCheckWorker.java:84) > ... 16 more > ERROR: 'Pipe broken' > ERROR: 'com.sun.org.apache.xml.internal.utils.WrappedRuntimeException: > Pipe broken' > Exception in thread "Thread-0" org.apache.rat.ReportFailedRuntimeException: > javax.xml.transform.TransformerException: > com.sun.org.apache.xml.internal.utils.WrappedRuntimeException: Pipe broken > at org.apache.rat.ReportTransformer.run(ReportTransformer.java:59) > at java.lang.Thread.run(Thread.java:745) > Caused by: javax.xml.transform.TransformerException: > javax.xml.transform.TransformerException: > com.sun.org.apache.xml.internal.utils.WrappedRuntimeException: Pipe broken > at > > com.sun.org.apache.xalan.internal.xsltc.trax.TransformerImpl.transform(TransformerImpl.java:749) > at > > com.sun.org.apache.xalan.internal.xsltc.trax.TransformerImpl.transform(TransformerImpl.java:351) > at > org.apache.rat.ReportTransformer.transform(ReportTransformer.java:64) > at org.apache.rat.ReportTransformer.run(ReportTransformer.java:57) > ... 1 more > Caused by: javax.xml.transform.TransformerException: > com.sun.org.apache.xml.internal.utils.WrappedRuntimeException: Pipe broken > at > > com.sun.org.apache.xalan.internal.xsltc.trax.TransformerImpl.getDOM(TransformerImpl.java:578) > at > > com.sun.org.apache.xalan.internal.xsltc.trax.TransformerImpl.transform(TransformerImpl.java:739) > ... 4 more > Caused by: com.sun.org.apache.xml.internal.utils.WrappedRuntimeException: > Pipe broken > at > > com.sun.org.apache.xalan.internal.xsltc.dom.XSLTCDTMManager.getDTM(XSLTCDTMManager.java:427) > at > > com.sun.org.apache.xalan.internal.xsltc.dom.XSLTCDTMManager.getDTM(XSLTCDTMManager.java:215) > at > > com.sun.org.apache.xalan.internal.xsltc.trax.TransformerImpl.getDOM(TransformerImpl.java:556) > > > On Wed, May 25, 2016 at 12:10 PM, Amanda Moran <[email protected]> > wrote: > > > I also noticed that traf_apache_mods stops and restarts HBase. If > > there are no changes made to any of the configuration files, then this > > step is not needed. > > > > When you copy over the hbase-trx*jar file there needs to be a restart. > > > > On Wed, May 25, 2016 at 11:34 AM, Roberta Marton > > <[email protected] > > > > > wrote: > > > > > +0 > > > > > > Since we have a little more time, I ran tests using Vanilla Apache > > > on a single node system using: > > > > > > Hadoop 2.6.0 > > > HBase 1.0.2 > > > Zookeeper 3.4.6 > > > > > > I was able to install Vanilla Hadoop, download and build Trafodion. > > > I encountered the following issues when running trafodion_install > > > using executables built with the 2.0.0 src tar: > > > > > > ==> Error - chmod failed, the INSTALL_LOG showed: > > > > > > ***INFO: copying hbase-trx-apache*.jar to all nodes > > > chmod: cannot access `/hbase-trx-apache*.jar': No such file or > > > directory > > > chmod: cannot access `/trafodion-utility-*.jar': No such file or > > directory > > > > > > There is an error in the traf_apache_mods script > > > > > > ==> Error: "JAVA_HOME is not set": > > > > > > I ran HBase, Hadoop, Zookeeper, and Trafodion as the same ID. > > > Several of the install steps failed doing ssh commands as the HDFS > > > and ZOOKEEPER users. > > > This problem was resolved by adding manully changing the > > > traf_apache_mods script by adding a "--login" in the ssh commands. > > > > > > ==> Error: initializing trafodion: > > > > > > *** ERROR[1398] Error -99999 occured while accessing the hbase > > > subsystem. > > > Fix that error and make sure hbase is up and running. Error Details: . > > > > > > This happened because I did not add Trafodion co-processor > > > information to the hbase-site.xml file before running > trafodion_install. > > > The installation did report: > > > > > > > > > > > ***IMPORTANT********************************************************** > > ************* > > > > > > ***INFO: Settings below need to be set for Trafodion to work on > > > Apache Hadoop/HBase > > > ***INFO: In hdfs-site.xml set dfs.namenode.acls.enabled to true. > > > ***INFO: In zoo.cfg set maxClientCnxns to 0 > > > ***INFO: Create /opt/apache/zookeeper-3.4.6/conf/zookeeeper-env.sh > > > and > > set > > > JAVA_HOME > > > ***INFO: In hbase-site.xml set hbase.coprocessor.region.classes to > > > org.apache.hadoop.hbase.coprocessor.transactional.TrxRegionObserver, > > > org.apache.hadoop.hbase.coprocessor.transactional.TrxRegionEndpoint, > > > org.apache.hadoop.hbase.coprocessor.AggregateImplementation > > > ***INFO: In hbase-site.xml set hbase.hregion.impl to > > > org.apache.hadoop.hbase.regionserver.transactional.TransactionalRegi > > > on > > > > > > > > > > > ***IMPORTANT********************************************************** > > ************* > > > > > > However, it kept going. Probably should have failed if START > > > Trafodion option is specified. I also noticed that traf_apache_mods > > > stops and restarts HBase. If there are no changes made to any of > > > the configuration files, then this step is not needed. > > > > > > ==> Error: ssh access check failed in traf_config_setup > > > > > > In this case, I know ssh access worked, so just commented out the > > > error check. Other ssh checks later did pass. I did not > > > investigate the > > cause. > > > > > > > > > We also need to update documentation on this especially, if we want > > > customer to manually update the hbase-site.xml file. > > > > > > Roberta > > > > > > -----Original Message----- > > > From: Steve Varnau [mailto:[email protected]] > > > Sent: Monday, May 23, 2016 3:12 PM > > > To: [email protected] > > > Subject: RE: [VOTE] Apache Trafodion release 2.0.0 - release > > > candidate 3 > > > > > > Sounds good. I was hoping we could get a mentor's input. Thanks, > > > St.Ack. > > > > > > --Steve > > > > > > > > > > -----Original Message----- > > > > From: [email protected] [mailto:[email protected]] On Behalf > > > > Of Stack > > > > Sent: Monday, May 23, 2016 2:47 PM > > > > To: [email protected] > > > > Subject: Re: [VOTE] Apache Trafodion release 2.0.0 - release > > > > candidate > > > > 3 > > > > > > > > On Mon, May 23, 2016 at 12:30 PM, Steve Varnau > > > > <[email protected]> > > > > wrote: > > > > > > > > > Thanks to all who have taken time to review and test out this > > > > > release candidate. All votes so far have been +1. > > > > > > > > > > The timing is not great, however, since HBaseCon is this week. > > > > > That may impact folks' opportunity to look at it. > > > > > > > > > > > > > > Smile > > > > > > > > > > > > > > > > > My thinking is that we should not close the voting yet to give > > > > > others time to look at it, especially those more familiar with > > > > > Apache releases and rules for convenience binaries. > > > > > > > > > > If there are folks still intending to help on this review/vote, > > > > > let us know how much time you might need. Thanks! > > > > > > > > > > > > > > If you don't mind, can I have till EOD Weds to take a look? Pardon > > > > my not having looked at it up to this. > > > > > > > > Thanks Steve, > > > > St.Ack > > > > > > > > > > > > > > > > > --Steve > > > > > > > > > > > > > > > > -----Original Message----- > > > > > > From: Steve Varnau [mailto:[email protected]] > > > > > > Sent: Wednesday, May 18, 2016 12:12 PM > > > > > > To: '[email protected]' > > > > > > <[email protected]> > > > > > > Subject: [VOTE] Apache Trafodion release 2.0.0 - release > > > > > > candidate > > > > > > 3 > > > > > > > > > > > > This is a call to vote on release 2.0.0 of Apache Trafodion > > > > > (incubating). Once > > > > > > the community approves a release candidate, a similar vote > > > > > > will be taken > > > > > in the > > > > > > Apache Incubator community. > > > > > > > > > > > > Changes since RC2: > > > > > > [TRAFODION-1992] Re-packaging server tar file broke > > > > > > install_traf_components > > > > > > [TRAFODION-1993] Expand DCS and REST directories > > > > > > [TRAFODION-1997] Prevent Cloudera install on 5.5/6 > > > > > > > > > > > > In addition, it is clarified that 2.0.0 is compatible with > > > > > > these > > > > > Hadoop/HBase > > > > > > distros (others may be added in next patch or minor release). > > > > > > * Apache Hadoop with HBase 1.0 > > > > > > * Cloudera 5.4 > > > > > > * Hortonworks 2.3 > > > > > > > > > > > > As previous release, Trafodion 2.0 works with JDK 1.7 or 1.8, > > > > > > and RedHat/Centos 6.x. (Does not work on RH7 as yet.) > > > > > > > > > > > > Thanks to all the contributors! Lots of improvements in this > > release. > > > > > > The JIRA release notes: > > > > > > > > > > > https://issues.apache.org/jira/secure/ReleaseNote.jspa?projectId > > > > > =123 > > > > > 18620& > > > > > v > > > > > > ersion=12333044 > > > > > > If things are missing from that list, please be sure that all > > > > > > your > > > > > > 2.0 > > > > > JIRAs are > > > > > > properly closed. > > > > > > > > > > > > The tag for this candidate is "2.0.0rc3". Git repository: > > > > > > git://git.apache.org/incubator-trafodion.git > > > > > > https://git-wip-us.apache.org/repos/asf?p=incubator- > > > > > > trafodion.git;a=tag;h=1a8942ceeee91e58212968d94478db18005568f4 > > > > > > > > > > > > Release artifacts are: > > > > > > > > > > > https://dist.apache.org/repos/dist/dev/incubator/trafodion/trafo > > > > > dion > > > > > -2.0.0 > > > > > -RC3 > > > > > > Artifacts are signed with my key (7F14AF20), which is in > > > > > > https://dist.apache.org/repos/dist/release/incubator/trafodion > > > > > > /KEY S This is the first release we are including convenience > > > > > > binaries built > > > > > from the > > > > > > source code artifact. > > > > > > > > > > > > Instructions for > > > > > > Setting up build environment: > > > > > > > > > > > > > > > https://cwiki.apache.org/confluence/display/TRAFODION/Create+Build > > > > +Env > > > > iron > > > > > > ment > > > > > > Building: > > > > > > https://cwiki.apache.org/confluence/display/TRAFODION/Build+So > > > > > > urce > > > > > > > > > > > > [ ] +1 approve > > > > > > [ ] +0 no opinion > > > > > > [ ] -1 disapprove (and reason why) > > > > > > > > > > > > Vote will be open for at least 72 hours, unless cancelled. > > > > > > > > > > > > > > > > > > --Steve > > > > > > > > > > > > > > > > > > > > > > -- > > Thanks, > > > > Amanda Moran > > >
