[jira] [Commented] (YARN-10312) Add support for yarn logs -logFile to retain backward compatibility
[ https://issues.apache.org/jira/browse/YARN-10312?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17134481#comment-17134481 ] Jim Brennan commented on YARN-10312: Thanks [~ebadger]! > Add support for yarn logs -logFile to retain backward compatibility > --- > > Key: YARN-10312 > URL: https://issues.apache.org/jira/browse/YARN-10312 > Project: Hadoop YARN > Issue Type: Bug > Components: client >Affects Versions: 2.10.0, 3.4.1 >Reporter: Jim Brennan >Assignee: Jim Brennan >Priority: Major > Labels: compatibility > Fix For: 3.2.2, 2.10.1, 3.3.1, 3.1.5, 3.4.1 > > Attachments: YARN-10312-branch-3.2.001.patch, YARN-10312.001.patch > > > The YARN CLI logs command line option {{-logFiles}} was changed to > {{-log_files}} in 2.9 and later releases. This change was made as part of > YARN-5363. > Verizon Media is in the process of moving from Hadoop-2.8 to Hadoop-2.10, and > while testing integration with Spark, we ran into this issue. We are > concerned that we will run into more cases of this as we roll out to > production, and rather than break user scripts, we'd prefer to add > {{-logFiles}} as an alias of {{-log_files}}. If both are provided, > {{-logFiles}} will be ignored. -- This message was sent by Atlassian Jira (v8.3.4#803005) - To unsubscribe, e-mail: yarn-issues-unsubscr...@hadoop.apache.org For additional commands, e-mail: yarn-issues-h...@hadoop.apache.org
[jira] [Commented] (YARN-10312) Add support for yarn logs -logFile to retain backward compatibility
[ https://issues.apache.org/jira/browse/YARN-10312?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17134287#comment-17134287 ] Jim Brennan commented on YARN-10312: I've also verified that it fails for me locally on branch-3.2 with out my change. > Add support for yarn logs -logFile to retain backward compatibility > --- > > Key: YARN-10312 > URL: https://issues.apache.org/jira/browse/YARN-10312 > Project: Hadoop YARN > Issue Type: Bug > Components: client >Affects Versions: 2.10.0, 3.4.1 >Reporter: Jim Brennan >Assignee: Jim Brennan >Priority: Major > Labels: compatibility > Fix For: 3.3.1, 3.4.1 > > Attachments: YARN-10312-branch-3.2.001.patch, YARN-10312.001.patch > > > The YARN CLI logs command line option {{-logFiles}} was changed to > {{-log_files}} in 2.9 and later releases. This change was made as part of > YARN-5363. > Verizon Media is in the process of moving from Hadoop-2.8 to Hadoop-2.10, and > while testing integration with Spark, we ran into this issue. We are > concerned that we will run into more cases of this as we roll out to > production, and rather than break user scripts, we'd prefer to add > {{-logFiles}} as an alias of {{-log_files}}. If both are provided, > {{-logFiles}} will be ignored. -- This message was sent by Atlassian Jira (v8.3.4#803005) - To unsubscribe, e-mail: yarn-issues-unsubscr...@hadoop.apache.org For additional commands, e-mail: yarn-issues-h...@hadoop.apache.org
[jira] [Commented] (YARN-10312) Add support for yarn logs -logFile to retain backward compatibility
[ https://issues.apache.org/jira/browse/YARN-10312?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17134284#comment-17134284 ] Jim Brennan commented on YARN-10312: Looks like that test failure is reported in YARN-10230 > Add support for yarn logs -logFile to retain backward compatibility > --- > > Key: YARN-10312 > URL: https://issues.apache.org/jira/browse/YARN-10312 > Project: Hadoop YARN > Issue Type: Bug > Components: client >Affects Versions: 2.10.0, 3.4.1 >Reporter: Jim Brennan >Assignee: Jim Brennan >Priority: Major > Labels: compatibility > Fix For: 3.3.1, 3.4.1 > > Attachments: YARN-10312-branch-3.2.001.patch, YARN-10312.001.patch > > > The YARN CLI logs command line option {{-logFiles}} was changed to > {{-log_files}} in 2.9 and later releases. This change was made as part of > YARN-5363. > Verizon Media is in the process of moving from Hadoop-2.8 to Hadoop-2.10, and > while testing integration with Spark, we ran into this issue. We are > concerned that we will run into more cases of this as we roll out to > production, and rather than break user scripts, we'd prefer to add > {{-logFiles}} as an alias of {{-log_files}}. If both are provided, > {{-logFiles}} will be ignored. -- This message was sent by Atlassian Jira (v8.3.4#803005) - To unsubscribe, e-mail: yarn-issues-unsubscr...@hadoop.apache.org For additional commands, e-mail: yarn-issues-h...@hadoop.apache.org
[jira] [Commented] (YARN-10312) Add support for yarn logs -logFile to retain backward compatibility
[ https://issues.apache.org/jira/browse/YARN-10312?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17134283#comment-17134283 ] Jim Brennan commented on YARN-10312: I'm investigating that unit test failure in TestSchedConfCLI to see if it is related to my change. > Add support for yarn logs -logFile to retain backward compatibility > --- > > Key: YARN-10312 > URL: https://issues.apache.org/jira/browse/YARN-10312 > Project: Hadoop YARN > Issue Type: Bug > Components: client >Affects Versions: 2.10.0, 3.4.1 >Reporter: Jim Brennan >Assignee: Jim Brennan >Priority: Major > Labels: compatibility > Fix For: 3.3.1, 3.4.1 > > Attachments: YARN-10312-branch-3.2.001.patch, YARN-10312.001.patch > > > The YARN CLI logs command line option {{-logFiles}} was changed to > {{-log_files}} in 2.9 and later releases. This change was made as part of > YARN-5363. > Verizon Media is in the process of moving from Hadoop-2.8 to Hadoop-2.10, and > while testing integration with Spark, we ran into this issue. We are > concerned that we will run into more cases of this as we roll out to > production, and rather than break user scripts, we'd prefer to add > {{-logFiles}} as an alias of {{-log_files}}. If both are provided, > {{-logFiles}} will be ignored. -- This message was sent by Atlassian Jira (v8.3.4#803005) - To unsubscribe, e-mail: yarn-issues-unsubscr...@hadoop.apache.org For additional commands, e-mail: yarn-issues-h...@hadoop.apache.org
[jira] [Commented] (YARN-10312) Add support for yarn logs -logFile to retain backward compatibility
[ https://issues.apache.org/jira/browse/YARN-10312?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17133827#comment-17133827 ] Hadoop QA commented on YARN-10312: -- | (x) *{color:red}-1 overall{color}* | \\ \\ || Vote || Subsystem || Runtime || Comment || | {color:blue}0{color} | {color:blue} reexec {color} | {color:blue} 12m 19s{color} | {color:blue} Docker mode activated. {color} | || || || || {color:brown} Prechecks {color} || | {color:green}+1{color} | {color:green} dupname {color} | {color:green} 0m 0s{color} | {color:green} No case conflicting files found. {color} | | {color:green}+1{color} | {color:green} @author {color} | {color:green} 0m 0s{color} | {color:green} The patch does not contain any @author tags. {color} | | {color:green}+1{color} | {color:green} test4tests {color} | {color:green} 0m 0s{color} | {color:green} The patch appears to include 1 new or modified test files. {color} | || || || || {color:brown} branch-3.2 Compile Tests {color} || | {color:green}+1{color} | {color:green} mvninstall {color} | {color:green} 22m 23s{color} | {color:green} branch-3.2 passed {color} | | {color:green}+1{color} | {color:green} compile {color} | {color:green} 0m 24s{color} | {color:green} branch-3.2 passed {color} | | {color:green}+1{color} | {color:green} checkstyle {color} | {color:green} 0m 21s{color} | {color:green} branch-3.2 passed {color} | | {color:green}+1{color} | {color:green} mvnsite {color} | {color:green} 0m 27s{color} | {color:green} branch-3.2 passed {color} | | {color:green}+1{color} | {color:green} shadedclient {color} | {color:green} 14m 17s{color} | {color:green} branch has no errors when building and testing our client artifacts. {color} | | {color:green}+1{color} | {color:green} javadoc {color} | {color:green} 0m 20s{color} | {color:green} branch-3.2 passed {color} | | {color:blue}0{color} | {color:blue} spotbugs {color} | {color:blue} 0m 48s{color} | {color:blue} Used deprecated FindBugs config; considering switching to SpotBugs. {color} | | {color:green}+1{color} | {color:green} findbugs {color} | {color:green} 0m 47s{color} | {color:green} branch-3.2 passed {color} | || || || || {color:brown} Patch Compile Tests {color} || | {color:green}+1{color} | {color:green} mvninstall {color} | {color:green} 0m 28s{color} | {color:green} the patch passed {color} | | {color:green}+1{color} | {color:green} compile {color} | {color:green} 0m 21s{color} | {color:green} the patch passed {color} | | {color:green}+1{color} | {color:green} javac {color} | {color:green} 0m 21s{color} | {color:green} the patch passed {color} | | {color:orange}-0{color} | {color:orange} checkstyle {color} | {color:orange} 0m 17s{color} | {color:orange} hadoop-yarn-project/hadoop-yarn/hadoop-yarn-client: The patch generated 1 new + 132 unchanged - 0 fixed = 133 total (was 132) {color} | | {color:green}+1{color} | {color:green} mvnsite {color} | {color:green} 0m 23s{color} | {color:green} the patch passed {color} | | {color:green}+1{color} | {color:green} whitespace {color} | {color:green} 0m 0s{color} | {color:green} The patch has no whitespace issues. {color} | | {color:green}+1{color} | {color:green} shadedclient {color} | {color:green} 14m 39s{color} | {color:green} patch has no errors when building and testing our client artifacts. {color} | | {color:green}+1{color} | {color:green} javadoc {color} | {color:green} 0m 19s{color} | {color:green} the patch passed {color} | | {color:green}+1{color} | {color:green} findbugs {color} | {color:green} 0m 49s{color} | {color:green} the patch passed {color} | || || || || {color:brown} Other Tests {color} || | {color:red}-1{color} | {color:red} unit {color} | {color:red}120m 25s{color} | {color:red} hadoop-yarn-client in the patch failed. {color} | | {color:green}+1{color} | {color:green} asflicense {color} | {color:green} 0m 26s{color} | {color:green} The patch does not generate ASF License warnings. {color} | | {color:black}{color} | {color:black} {color} | {color:black}190m 4s{color} | {color:black} {color} | \\ \\ || Reason || Tests || | Failed junit tests | hadoop.yarn.client.cli.TestSchedConfCLI | \\ \\ || Subsystem || Report/Notes || | Docker | ClientAPI=1.40 ServerAPI=1.40 base: https://builds.apache.org/job/PreCommit-YARN-Build/26153/artifact/out/Dockerfile | | JIRA Issue | YARN-10312 | | JIRA Patch URL | https://issues.apache.org/jira/secure/attachment/13005520/YARN-10312-branch-3.2.001.patch | | Optional Tests | dupname asflicense compile javac javadoc mvninstall mvnsite unit shadedclient findbugs checkstyle | | uname | Linux 68c353e0f537 4.15.0-101-generic #102-Ubuntu SMP Mon May 11 10:07:26 UTC 2020 x86_64 x86_64 x86_64 GNU/Linux | | Build tool | maven | | Personality | personality/hadoop.sh | | git revision | branch-3.2 / 30d7a06 | | Default Java | Private Build-1.8.0_252-8u252-b09-1~16.04-b09 | | checkstyle | https://build
[jira] [Commented] (YARN-10312) Add support for yarn logs -logFile to retain backward compatibility
[ https://issues.apache.org/jira/browse/YARN-10312?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17133729#comment-17133729 ] Jim Brennan commented on YARN-10312: [~ebadger] I put up a patch for branch-3.2 and I verified that this patch also applies, builds, and the unit test passes for branch-2.10. > Add support for yarn logs -logFile to retain backward compatibility > --- > > Key: YARN-10312 > URL: https://issues.apache.org/jira/browse/YARN-10312 > Project: Hadoop YARN > Issue Type: Bug > Components: client >Affects Versions: 2.10.0, 3.4.1 >Reporter: Jim Brennan >Assignee: Jim Brennan >Priority: Major > Labels: compatibility > Fix For: 3.3.1, 3.4.1 > > Attachments: YARN-10312-branch-3.2.001.patch, YARN-10312.001.patch > > > The YARN CLI logs command line option {{-logFiles}} was changed to > {{-log_files}} in 2.9 and later releases. This change was made as part of > YARN-5363. > Verizon Media is in the process of moving from Hadoop-2.8 to Hadoop-2.10, and > while testing integration with Spark, we ran into this issue. We are > concerned that we will run into more cases of this as we roll out to > production, and rather than break user scripts, we'd prefer to add > {{-logFiles}} as an alias of {{-log_files}}. If both are provided, > {{-logFiles}} will be ignored. -- This message was sent by Atlassian Jira (v8.3.4#803005) - To unsubscribe, e-mail: yarn-issues-unsubscr...@hadoop.apache.org For additional commands, e-mail: yarn-issues-h...@hadoop.apache.org
[jira] [Commented] (YARN-10312) Add support for yarn logs -logFile to retain backward compatibility
[ https://issues.apache.org/jira/browse/YARN-10312?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17133708#comment-17133708 ] Jim Brennan commented on YARN-10312: Thanks [~ebadger]! I will put up a patches for branch-3.2 and branch-2.10. > Add support for yarn logs -logFile to retain backward compatibility > --- > > Key: YARN-10312 > URL: https://issues.apache.org/jira/browse/YARN-10312 > Project: Hadoop YARN > Issue Type: Bug > Components: client >Affects Versions: 2.10.0, 3.4.1 >Reporter: Jim Brennan >Assignee: Jim Brennan >Priority: Major > Labels: compatibility > Fix For: 3.3.1, 3.4.1 > > Attachments: YARN-10312.001.patch > > > The YARN CLI logs command line option {{-logFiles}} was changed to > {{-log_files}} in 2.9 and later releases. This change was made as part of > YARN-5363. > Verizon Media is in the process of moving from Hadoop-2.8 to Hadoop-2.10, and > while testing integration with Spark, we ran into this issue. We are > concerned that we will run into more cases of this as we roll out to > production, and rather than break user scripts, we'd prefer to add > {{-logFiles}} as an alias of {{-log_files}}. If both are provided, > {{-logFiles}} will be ignored. -- This message was sent by Atlassian Jira (v8.3.4#803005) - To unsubscribe, e-mail: yarn-issues-unsubscr...@hadoop.apache.org For additional commands, e-mail: yarn-issues-h...@hadoop.apache.org
[jira] [Commented] (YARN-10312) Add support for yarn logs -logFile to retain backward compatibility
[ https://issues.apache.org/jira/browse/YARN-10312?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17133701#comment-17133701 ] Hudson commented on YARN-10312: --- SUCCESS: Integrated in Jenkins build Hadoop-trunk-Commit #18346 (See [https://builds.apache.org/job/Hadoop-trunk-Commit/18346/]) YARN-10312. Add support for yarn logs -logFile to retain backward (ebadger: rev fed6fecd3a9e24efc20f9221505da35a7e1949c7) * (edit) hadoop-yarn-project/hadoop-yarn/hadoop-yarn-client/src/test/java/org/apache/hadoop/yarn/client/cli/TestLogsCLI.java * (edit) hadoop-yarn-project/hadoop-yarn/hadoop-yarn-client/src/main/java/org/apache/hadoop/yarn/client/cli/LogsCLI.java > Add support for yarn logs -logFile to retain backward compatibility > --- > > Key: YARN-10312 > URL: https://issues.apache.org/jira/browse/YARN-10312 > Project: Hadoop YARN > Issue Type: Bug > Components: client >Affects Versions: 2.10.0, 3.4.1 >Reporter: Jim Brennan >Assignee: Jim Brennan >Priority: Major > Labels: compatibility > Attachments: YARN-10312.001.patch > > > The YARN CLI logs command line option {{-logFiles}} was changed to > {{-log_files}} in 2.9 and later releases. This change was made as part of > YARN-5363. > Verizon Media is in the process of moving from Hadoop-2.8 to Hadoop-2.10, and > while testing integration with Spark, we ran into this issue. We are > concerned that we will run into more cases of this as we roll out to > production, and rather than break user scripts, we'd prefer to add > {{-logFiles}} as an alias of {{-log_files}}. If both are provided, > {{-logFiles}} will be ignored. -- This message was sent by Atlassian Jira (v8.3.4#803005) - To unsubscribe, e-mail: yarn-issues-unsubscr...@hadoop.apache.org For additional commands, e-mail: yarn-issues-h...@hadoop.apache.org
[jira] [Commented] (YARN-10312) Add support for yarn logs -logFile to retain backward compatibility
[ https://issues.apache.org/jira/browse/YARN-10312?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17133632#comment-17133632 ] Hadoop QA commented on YARN-10312: -- | (/) *{color:green}+1 overall{color}* | \\ \\ || Vote || Subsystem || Runtime || Comment || | {color:blue}0{color} | {color:blue} reexec {color} | {color:blue} 1m 20s{color} | {color:blue} Docker mode activated. {color} | || || || || {color:brown} Prechecks {color} || | {color:green}+1{color} | {color:green} dupname {color} | {color:green} 0m 0s{color} | {color:green} No case conflicting files found. {color} | | {color:green}+1{color} | {color:green} @author {color} | {color:green} 0m 0s{color} | {color:green} The patch does not contain any @author tags. {color} | | {color:green}+1{color} | {color:green} test4tests {color} | {color:green} 0m 0s{color} | {color:green} The patch appears to include 1 new or modified test files. {color} | || || || || {color:brown} trunk Compile Tests {color} || | {color:green}+1{color} | {color:green} mvninstall {color} | {color:green} 21m 45s{color} | {color:green} trunk passed {color} | | {color:green}+1{color} | {color:green} compile {color} | {color:green} 0m 27s{color} | {color:green} trunk passed {color} | | {color:green}+1{color} | {color:green} checkstyle {color} | {color:green} 0m 23s{color} | {color:green} trunk passed {color} | | {color:green}+1{color} | {color:green} mvnsite {color} | {color:green} 0m 31s{color} | {color:green} trunk passed {color} | | {color:green}+1{color} | {color:green} shadedclient {color} | {color:green} 16m 26s{color} | {color:green} branch has no errors when building and testing our client artifacts. {color} | | {color:green}+1{color} | {color:green} javadoc {color} | {color:green} 0m 21s{color} | {color:green} trunk passed {color} | | {color:blue}0{color} | {color:blue} spotbugs {color} | {color:blue} 0m 51s{color} | {color:blue} Used deprecated FindBugs config; considering switching to SpotBugs. {color} | | {color:green}+1{color} | {color:green} findbugs {color} | {color:green} 0m 48s{color} | {color:green} trunk passed {color} | || || || || {color:brown} Patch Compile Tests {color} || | {color:green}+1{color} | {color:green} mvninstall {color} | {color:green} 0m 31s{color} | {color:green} the patch passed {color} | | {color:green}+1{color} | {color:green} compile {color} | {color:green} 0m 24s{color} | {color:green} the patch passed {color} | | {color:green}+1{color} | {color:green} javac {color} | {color:green} 0m 24s{color} | {color:green} the patch passed {color} | | {color:orange}-0{color} | {color:orange} checkstyle {color} | {color:orange} 0m 21s{color} | {color:orange} hadoop-yarn-project/hadoop-yarn/hadoop-yarn-client: The patch generated 1 new + 129 unchanged - 0 fixed = 130 total (was 129) {color} | | {color:green}+1{color} | {color:green} mvnsite {color} | {color:green} 0m 27s{color} | {color:green} the patch passed {color} | | {color:green}+1{color} | {color:green} whitespace {color} | {color:green} 0m 0s{color} | {color:green} The patch has no whitespace issues. {color} | | {color:green}+1{color} | {color:green} shadedclient {color} | {color:green} 15m 35s{color} | {color:green} patch has no errors when building and testing our client artifacts. {color} | | {color:green}+1{color} | {color:green} javadoc {color} | {color:green} 0m 26s{color} | {color:green} the patch passed {color} | | {color:green}+1{color} | {color:green} findbugs {color} | {color:green} 1m 13s{color} | {color:green} the patch passed {color} | || || || || {color:brown} Other Tests {color} || | {color:green}+1{color} | {color:green} unit {color} | {color:green} 28m 26s{color} | {color:green} hadoop-yarn-client in the patch passed. {color} | | {color:green}+1{color} | {color:green} asflicense {color} | {color:green} 0m 35s{color} | {color:green} The patch does not generate ASF License warnings. {color} | | {color:black}{color} | {color:black} {color} | {color:black} 90m 37s{color} | {color:black} {color} | \\ \\ || Subsystem || Report/Notes || | Docker | ClientAPI=1.40 ServerAPI=1.40 base: https://builds.apache.org/job/PreCommit-YARN-Build/26151/artifact/out/Dockerfile | | JIRA Issue | YARN-10312 | | JIRA Patch URL | https://issues.apache.org/jira/secure/attachment/13005510/YARN-10312.001.patch | | Optional Tests | dupname asflicense compile javac javadoc mvninstall mvnsite unit shadedclient findbugs checkstyle | | uname | Linux e0fc2bab5cd2 4.15.0-101-generic #102-Ubuntu SMP Mon May 11 10:07:26 UTC 2020 x86_64 x86_64 x86_64 GNU/Linux | | Build tool | maven | | Personality | personality/hadoop.sh | | git revision | trunk / 93b121a9717 | | Default Java | Private Build-1.8.0_252-8u252-b09-1~18.04-b09 | | checkstyle | https://builds.apache.org/job/PreCommit-YARN-Build/26151/artifact/out/diff-checkstyle-hadoop-yarn-project_hadoop-yarn_hadoop-yarn-client.txt |