Thanks Hitesh for your help! I followed your instruction and successfully built Tez for runtime only, without the UI. I will try to resolve the Tez-UI sometime later.
Thanks! On Wed, Apr 6, 2016 at 6:22 PM, Hitesh Shah <[email protected]> wrote: > We have been seeing some recent failures due to some form of npm registry > errors even though no code has changed ( > https://issues.apache.org/jira/browse/TEZ-3201 ) - is this what you are > seeing? > > BIGTOP-1826 is a different issue. That is due to the frontend-plugin not > being compatible with certain versions of maven ( 0.0.22 is not compatible > with mvn 3.3 ).This was fixed in Tez by switching the frontend plugin > version based on the mvn version in use. If you check the top-level pom, it > is defaulting to 0.0.23 but falls back to 0.0.22 if you have an older > version of mvn. > > That said, a simpler approach for your case is to remove tez-ui from the > module list at the top-level and re-compile ( i.e. not build tez-ui > module). The tez-ui.war is not really used by the tez runtime but only used > as part of the Tez UI. For this, you can download the war from > https://repository.apache.org/content/groups/public/org/apache/tez/tez-ui/ > and use as needed if you have the UI deployed. > > thanks > — Hitesh > > > On Apr 6, 2016, at 2:47 PM, Sam Joe <[email protected]> wrote: > > > Thanks for your valuable suggestion. I used -fae option to skip the > errors and proceed with the ones which is working. > > sudo mvn clean package -DskipTests=true -Dmaven.javadoc.skip=true > -Dfrontend-maven-plugin.version=0.0.22 -fae > > > > Now I'm stuck with only the following 2 errors: > > > > [ERROR] Failed to execute goal > com.github.eirslett:frontend-maven-plugin:0.0.16:npm (npm install) on > project tez-ui: Failed to run task: 'npm install --color=false' failed. > (error code 34) -> [Help 1] > > [ERROR] Failed to execute goal > org.apache.maven.plugins:maven-assembly-plugin:2.4:single (package-tez) on > project tez-dist: Failed to create assembly: Artifact: > org.apache.tez:tez-ui:war:0.7.0 (included by module) does not have an > artifact with a file. Please ensure the package phase is run before the > assembly is generated. -> [Help 2] > > > > > > [INFO] tez ............................................... SUCCESS > [3.861s] > > [INFO] tez-api ........................................... SUCCESS > [37.493s] > > [INFO] tez-common ........................................ SUCCESS > [3.843s] > > [INFO] tez-runtime-internals ............................. SUCCESS > [5.211s] > > [INFO] tez-runtime-library ............................... SUCCESS > [9.675s] > > [INFO] tez-mapreduce ..................................... SUCCESS > [11.038s] > > [INFO] tez-examples ...................................... SUCCESS > [1.355s] > > [INFO] tez-dag ........................................... SUCCESS > [21.797s] > > [INFO] tez-tests ......................................... SUCCESS > [4.109s] > > [INFO] tez-ui ............................................ FAILURE > [1:12.348s] > > [INFO] tez-plugins ....................................... SUCCESS > [0.057s] > > [INFO] tez-yarn-timeline-history ......................... SUCCESS > [1.816s] > > [INFO] tez-yarn-timeline-history-with-acls ............... SUCCESS > [1.292s] > > [INFO] tez-mbeans-resource-calculator .................... SUCCESS > [0.640s] > > [INFO] tez-tools ......................................... SUCCESS > [0.148s] > > [INFO] tez-dist .......................................... FAILURE > [8.107s] > > [INFO] Tez ............................................... SUCCESS > [0.063s] > > > > For the npm error I see a open JIRA : > https://issues.apache.org/jira/browse/BIGTOP-1826 > > > > Do you have any suggestion? > > > > Thanks. > > > > > > On Wed, Apr 6, 2016 at 4:13 PM Hitesh Shah <[email protected]> wrote: > > Not sure why you are hitting those timeouts. Are you running this on a > small-sized VM which may be impacting the tests? Running locally on my > laptop, I don’t seem to be having any issues doing a mvn test on 0.7.0 > against hadoop-2.7.0. > > > > One option would be to just do a fail-at-end and then re-run the failed > tests separately to see if they are just flaky on your env. > > > > thanks > > — Hitesh > > > > On Apr 6, 2016, at 12:48 PM, Sam Joe <[email protected]> wrote: > > > > > Hi Hitesh, > > > > > > My environment: Hadoop 2.7.0 > > > As suggested by you I'm trying with apache-tez-0.7.0-src > > > > > > I've to use the following command to avoid npm and Dfrontend missing > error: > > > > > > sudo mvn clean package -Dfrontend-maven-plugin.version=0.0.22 > > > > > > I keep getting timeout error while building Tez as shown in the error > log below: > > > > > > > ------------------------------------------------------------------------------- > > > Test set: org.apache.tez.client.TestTezClient > > > > ------------------------------------------------------------------------------- > > > Tests run: 8, Failures: 0, Errors: 1, Skipped: 0, Time elapsed: 9.013 > sec <<< FAILURE! > > > testTezclientSession(org.apache.tez.client.TestTezClient) Time > elapsed: 5.062 sec <<< ERROR! > > > java.lang.Exception: test timed out after 5000 milliseconds > > > > > > (Earlier I was able to build apache-tez-0.5.0-src in the same > environment however had to upgrade to 0.7.0 in order to avoid some bugs > fixed in 0.7.0 version). > > > > > > Please help. > > > > > > > > > Thanks, > > > Joel > > > > > > On Wed, Apr 6, 2016 at 3:01 PM Hitesh Shah <[email protected]> wrote: > > > Hello Sam, > > > > > > Couple of things to confirm: > > > - I assume you are building branch-0.7 of Tez for 0.7.1-SNAPSHOT > as there has not yet been a release of 0.7.1? > > > - For hadoop, are you using hadoop-2.7.0 or hadoop-2.7.1 ( though > this really should not be too relevant here )? > > > > > > I took branch-0.7 of the current code base and compiled it against > hadoop-2.7.1. I also ran the test that was failing and it did not fail. > > > > > > Picked up _JAVA_OPTIONS: -Djava.awt.headless=true > > > Running org.apache.tez.dag.app.TestMockDAGAppMaster > > > 2016-04-06 11:31:18.076 java[20695:1903] Unable to load realm info > from SCDynamicStore > > > Tests run: 17, Failures: 0, Errors: 0, Skipped: 3, Time elapsed: 5.788 > sec > > > > > > I think this might be a flaky test that we need to fix. I would > suggest filing a bug for this with the surefire logs for the test in > question so that it will help us debug the flaky failure. Please update the > jira with hadoop version too. If this test is consistently failing for > you, let us know ( if not, a quick fix would be to just patch the code with > an @Ignore to skip the test ) > > > > > > thanks > > > — Hitesh > > > > > > > > > On Apr 6, 2016, at 10:57 AM, Sam Joe <[email protected]> wrote: > > > > > > > I am using the following command for building Tez. > > > > > > > > sudo mvn clean package -Dfrontend-maven-plugin.version=0.0.22 > > > > > > > > Thanks, > > > > Joel > > > > > > > > On Wed, Apr 6, 2016 at 1:51 PM, Sam Joe <[email protected]> > wrote: > > > > Hi, > > > > > > > > Could any help me in resolving the following error which I am > getting while building Apache Tez 0.7.1 on Hadoop 2.7: > > > > > > > > > testCommitOutputOnDAGSuccess(org.apache.tez.dag.app.TestMockDAGAppMaster) > Time elapsed: 0.453 sec <<< ERROR! > > > > org.apache.tez.dag.api.TezException: App master already running a DAG > > > > at > org.apache.tez.dag.app.DAGAppMaster.submitDAGToAppMaster(DAGAppMaster.java:1256) > > > > > > > > I can see that there is a Jira found in the following link but not > sure how to use the fix. > > > > > > > > https://issues.apache.org/jira/browse/TEZ-2307 > > > > > > > > Please help. > > > > > > > > Thanks, > > > > Sam > > > > > > > > > > >
