[jira] [Commented] (MAPREDUCE-7301) Expose Mini MR Cluster attribute for testing

2020-10-13 Thread Swaroopa Kadam (Jira) 


[ 
https://issues.apache.org/jira/browse/MAPREDUCE-7301?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17213225#comment-17213225
 ] 

Swaroopa Kadam commented on MAPREDUCE-7301:
---

Thank you, [~liuml07], [~apurtell], [~aajisaka], and [~iwasakims]

I hit this problem in the application (non-opensource) that uses MiniMRCluster. 
So, don't really have an HBase/phoenix Jira for this.  [~iwasakims]

> Expose Mini MR Cluster attribute for testing
> 
>
> Key: MAPREDUCE-7301
> URL: https://issues.apache.org/jira/browse/MAPREDUCE-7301
> Project: Hadoop Map/Reduce
>  Issue Type: Improvement
>  Components: test
>Reporter: Swaroopa Kadam
>Assignee: Swaroopa Kadam
>Priority: Minor
> Fix For: 3.2.2, 3.4.0, 3.1.5, 3.3.1, 2.10.2
>
> Attachments: MAPREDUCE-7301.patch
>
>
> After MAPREDUCE-6521, applications using MiniMRYarnCluster need to explicitly 
> set the config "yarn.app.mapreduce.am.staging-dir" which ll include cluster 
> name in it. 
>  
> In order to get the cluster name, some getters on corresponding attributes 
> are needed to be available.



--
This message was sent by Atlassian Jira
(v8.3.4#803005)

-
To unsubscribe, e-mail: mapreduce-issues-unsubscr...@hadoop.apache.org
For additional commands, e-mail: mapreduce-issues-h...@hadoop.apache.org

[jira] [Commented] (MAPREDUCE-7301) Expose Mini MR Cluster attribute for testing

2020-10-10 Thread Masatake Iwasaki (Jira) 


[ 
https://issues.apache.org/jira/browse/MAPREDUCE-7301?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17211834#comment-17211834
 ] 

Masatake Iwasaki commented on MAPREDUCE-7301:
-

LGTM. If there is depending JIRA of HBase or Phoenix, linking it here would be 
help for understanding use cases.

> Expose Mini MR Cluster attribute for testing
> 
>
> Key: MAPREDUCE-7301
> URL: https://issues.apache.org/jira/browse/MAPREDUCE-7301
> Project: Hadoop Map/Reduce
>  Issue Type: Improvement
>  Components: test
>Reporter: Swaroopa Kadam
>Assignee: Swaroopa Kadam
>Priority: Minor
> Attachments: MAPREDUCE-7301.patch
>
>
> After MAPREDUCE-6521, applications using MiniMRYarnCluster need to explicitly 
> set the config "yarn.app.mapreduce.am.staging-dir" which ll include cluster 
> name in it. 
>  
> In order to get the cluster name, some getters on corresponding attributes 
> are needed to be available.



--
This message was sent by Atlassian Jira
(v8.3.4#803005)

-
To unsubscribe, e-mail: mapreduce-issues-unsubscr...@hadoop.apache.org
For additional commands, e-mail: mapreduce-issues-h...@hadoop.apache.org

[jira] [Commented] (MAPREDUCE-7301) Expose Mini MR Cluster attribute for testing

2020-10-09 Thread Akira Ajisaka (Jira) 


[ 
https://issues.apache.org/jira/browse/MAPREDUCE-7301?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17211528#comment-17211528
 ] 

Akira Ajisaka commented on MAPREDUCE-7301:
--

+1, thanks.

> Expose Mini MR Cluster attribute for testing
> 
>
> Key: MAPREDUCE-7301
> URL: https://issues.apache.org/jira/browse/MAPREDUCE-7301
> Project: Hadoop Map/Reduce
>  Issue Type: Improvement
>  Components: test
>Reporter: Swaroopa Kadam
>Assignee: Swaroopa Kadam
>Priority: Minor
> Attachments: MAPREDUCE-7301.patch
>
>
> After MAPREDUCE-6521, applications using MiniMRYarnCluster need to explicitly 
> set the config "yarn.app.mapreduce.am.staging-dir" which ll include cluster 
> name in it. 
>  
> In order to get the cluster name, some getters on corresponding attributes 
> are needed to be available.



--
This message was sent by Atlassian Jira
(v8.3.4#803005)

-
To unsubscribe, e-mail: mapreduce-issues-unsubscr...@hadoop.apache.org
For additional commands, e-mail: mapreduce-issues-h...@hadoop.apache.org

[jira] [Commented] (MAPREDUCE-7301) Expose Mini MR Cluster attribute for testing

2020-10-09 Thread Andrew Kyle Purtell (Jira) 


[ 
https://issues.apache.org/jira/browse/MAPREDUCE-7301?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17211432#comment-17211432
 ] 

Andrew Kyle Purtell commented on MAPREDUCE-7301:


Thanks for helping [~swaroopa] out [~liuml07]

> Expose Mini MR Cluster attribute for testing
> 
>
> Key: MAPREDUCE-7301
> URL: https://issues.apache.org/jira/browse/MAPREDUCE-7301
> Project: Hadoop Map/Reduce
>  Issue Type: Improvement
>  Components: test
>Reporter: Swaroopa Kadam
>Assignee: Swaroopa Kadam
>Priority: Minor
> Attachments: MAPREDUCE-7301.patch
>
>
> After MAPREDUCE-6521, applications using MiniMRYarnCluster need to explicitly 
> set the config "yarn.app.mapreduce.am.staging-dir" which ll include cluster 
> name in it. 
>  
> In order to get the cluster name, some getters on corresponding attributes 
> are needed to be available.



--
This message was sent by Atlassian Jira
(v8.3.4#803005)

-
To unsubscribe, e-mail: mapreduce-issues-unsubscr...@hadoop.apache.org
For additional commands, e-mail: mapreduce-issues-h...@hadoop.apache.org

[jira] [Commented] (MAPREDUCE-7301) Expose Mini MR Cluster attribute for testing

2020-10-09 Thread Mingliang Liu (Jira) 


[ 
https://issues.apache.org/jira/browse/MAPREDUCE-7301?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17211413#comment-17211413
 ] 

Mingliang Liu commented on MAPREDUCE-7301:
--

+1

I will commit this in 3 days, if no more comments. CC: [~aajisaka] [~iwasakims]

> Expose Mini MR Cluster attribute for testing
> 
>
> Key: MAPREDUCE-7301
> URL: https://issues.apache.org/jira/browse/MAPREDUCE-7301
> Project: Hadoop Map/Reduce
>  Issue Type: Improvement
>Reporter: Swaroopa Kadam
>Priority: Minor
> Attachments: MAPREDUCE-7301.patch
>
>
> After MAPREDUCE-6521, applications using MiniMRYarnCluster need to explicitly 
> set the config "yarn.app.mapreduce.am.staging-dir" which ll include cluster 
> name in it. 
>  
> In order to get the cluster name, some getters on corresponding attributes 
> are needed to be available.



--
This message was sent by Atlassian Jira
(v8.3.4#803005)

-
To unsubscribe, e-mail: mapreduce-issues-unsubscr...@hadoop.apache.org
For additional commands, e-mail: mapreduce-issues-h...@hadoop.apache.org

[jira] [Commented] (MAPREDUCE-7301) Expose Mini MR Cluster attribute for testing

2020-10-09 Thread Andrew Kyle Purtell (Jira) 


[ 
https://issues.apache.org/jira/browse/MAPREDUCE-7301?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17211323#comment-17211323
 ] 

Andrew Kyle Purtell commented on MAPREDUCE-7301:


[~liuml07] ping

> Expose Mini MR Cluster attribute for testing
> 
>
> Key: MAPREDUCE-7301
> URL: https://issues.apache.org/jira/browse/MAPREDUCE-7301
> Project: Hadoop Map/Reduce
>  Issue Type: Improvement
>Reporter: Swaroopa Kadam
>Priority: Minor
> Attachments: MAPREDUCE-7301.patch
>
>
> After MAPREDUCE-6521, applications using MiniMRYarnCluster need to explicitly 
> set the config "yarn.app.mapreduce.am.staging-dir" which ll include cluster 
> name in it. 
>  
> In order to get the cluster name, some getters on corresponding attributes 
> are needed to be available.



--
This message was sent by Atlassian Jira
(v8.3.4#803005)

-
To unsubscribe, e-mail: mapreduce-issues-unsubscr...@hadoop.apache.org
For additional commands, e-mail: mapreduce-issues-h...@hadoop.apache.org

[jira] [Commented] (MAPREDUCE-7301) Expose Mini MR Cluster attribute for testing

2020-10-08 Thread Hadoop QA (Jira) 


[ 
https://issues.apache.org/jira/browse/MAPREDUCE-7301?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17210560#comment-17210560
 ] 

Hadoop QA commented on MAPREDUCE-7301:
--

| (/) *{color:green}+1 overall{color}* |
\\
\\
|| Vote || Subsystem || Runtime ||  Logfile || Comment ||
| {color:blue}0{color} | {color:blue} reexec {color} | {color:blue} 33m  
2s{color} | {color:blue}{color} | {color:blue} Docker mode activated. {color} |
|| || || || {color:brown} Prechecks {color} || ||
| {color:green}+1{color} | {color:green} dupname {color} | {color:green}  0m  
0s{color} | {color:green}{color} | {color:green} No case conflicting files 
found. {color} |
| {color:green}+1{color} | {color:green} @author {color} | {color:green}  0m  
0s{color} | {color:green}{color} | {color:green} The patch does not contain any 
@author tags. {color} |
| {color:green}+1{color} | {color:green} {color} | {color:green}  0m  0s{color} 
| {color:green}test4tests{color} | {color:green} The patch appears to include 2 
new or modified test files. {color} |
|| || || || {color:brown} trunk Compile Tests {color} || ||
| {color:green}+1{color} | {color:green} mvninstall {color} | {color:green} 32m 
 4s{color} | {color:green}{color} | {color:green} trunk passed {color} |
| {color:green}+1{color} | {color:green} compile {color} | {color:green}  0m 
32s{color} | {color:green}{color} | {color:green} trunk passed with JDK 
Ubuntu-11.0.8+10-post-Ubuntu-0ubuntu118.04.1 {color} |
| {color:green}+1{color} | {color:green} compile {color} | {color:green}  0m 
28s{color} | {color:green}{color} | {color:green} trunk passed with JDK Private 
Build-1.8.0_265-8u265-b01-0ubuntu2~18.04-b01 {color} |
| {color:green}+1{color} | {color:green} checkstyle {color} | {color:green}  0m 
24s{color} | {color:green}{color} | {color:green} trunk passed {color} |
| {color:green}+1{color} | {color:green} mvnsite {color} | {color:green}  0m 
33s{color} | {color:green}{color} | {color:green} trunk passed {color} |
| {color:green}+1{color} | {color:green} shadedclient {color} | {color:green} 
16m 56s{color} | {color:green}{color} | {color:green} branch has no errors when 
building and testing our client artifacts. {color} |
| {color:green}+1{color} | {color:green} javadoc {color} | {color:green}  0m 
23s{color} | {color:green}{color} | {color:green} trunk passed with JDK 
Ubuntu-11.0.8+10-post-Ubuntu-0ubuntu118.04.1 {color} |
| {color:green}+1{color} | {color:green} javadoc {color} | {color:green}  0m 
20s{color} | {color:green}{color} | {color:green} trunk passed with JDK Private 
Build-1.8.0_265-8u265-b01-0ubuntu2~18.04-b01 {color} |
| {color:blue}0{color} | {color:blue} spotbugs {color} | {color:blue}  0m 
45s{color} | {color:blue}{color} | {color:blue} Used deprecated FindBugs 
config; considering switching to SpotBugs. {color} |
| {color:green}+1{color} | {color:green} findbugs {color} | {color:green}  0m 
42s{color} | {color:green}{color} | {color:green} trunk passed {color} |
|| || || || {color:brown} Patch Compile Tests {color} || ||
| {color:green}+1{color} | {color:green} mvninstall {color} | {color:green}  0m 
28s{color} | {color:green}{color} | {color:green} the patch passed {color} |
| {color:green}+1{color} | {color:green} compile {color} | {color:green}  0m 
26s{color} | {color:green}{color} | {color:green} the patch passed with JDK 
Ubuntu-11.0.8+10-post-Ubuntu-0ubuntu118.04.1 {color} |
| {color:green}+1{color} | {color:green} javac {color} | {color:green}  0m 
26s{color} | {color:green}{color} | {color:green} the patch passed {color} |
| {color:green}+1{color} | {color:green} compile {color} | {color:green}  0m 
23s{color} | {color:green}{color} | {color:green} the patch passed with JDK 
Private Build-1.8.0_265-8u265-b01-0ubuntu2~18.04-b01 {color} |
| {color:green}+1{color} | {color:green} javac {color} | {color:green}  0m 
24s{color} | {color:green}{color} | {color:green} the patch passed {color} |
| {color:green}+1{color} | {color:green} checkstyle {color} | {color:green}  0m 
18s{color} | {color:green}{color} | {color:green} the patch passed {color} |
| {color:green}+1{color} | {color:green} mvnsite {color} | {color:green}  0m 
26s{color} | {color:green}{color} | {color:green} the patch passed {color} |
| {color:green}+1{color} | {color:green} whitespace {color} | {color:green}  0m 
 0s{color} | {color:green}{color} | {color:green} The patch has no whitespace 
issues. {color} |
| {color:green}+1{color} | {color:green} shadedclient {color} | {color:green} 
15m 44s{color} | {color:green}{color} | {color:green} patch has no errors when 
building and testing our client artifacts. {color} |
| {color:green}+1{color} | {color:green} javadoc {color} | {color:green}  0m 
19s{color} | {color:green}{color} | {color:green} the patch passed with JDK 
Ubuntu-11.0.8+10-post-Ubuntu-0ubuntu118.04.1 {color} |
| {color:green}+1{color} | {color:green} javadoc {color} | {color:green}  0m 
19s{color} |

[jira] [Commented] (MAPREDUCE-7301) Expose Mini MR Cluster attribute for testing

2020-10-08 Thread Hadoop QA (Jira) 


[ 
https://issues.apache.org/jira/browse/MAPREDUCE-7301?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17210556#comment-17210556
 ] 

Hadoop QA commented on MAPREDUCE-7301:
--

| (/) *{color:green}+1 overall{color}* |
\\
\\
|| Vote || Subsystem || Runtime ||  Logfile || Comment ||
| {color:blue}0{color} | {color:blue} reexec {color} | {color:blue} 28m  
1s{color} |  | {color:blue} Docker mode activated. {color} |
|| || || || {color:brown} Prechecks {color} || ||
| {color:green}+1{color} | {color:green} dupname {color} | {color:green}  0m  
0s{color} |  | {color:green} No case conflicting files found. {color} |
| {color:green}+1{color} | {color:green} @author {color} | {color:green}  0m  
0s{color} |  | {color:green} The patch does not contain any @author tags. 
{color} |
| {color:green}+1{color} | {color:green} test4tests {color} | {color:green}  0m 
 0s{color} |  | {color:green} The patch appears to include 2 new or modified 
test files. {color} |
|| || || || {color:brown} trunk Compile Tests {color} || ||
| {color:green}+1{color} | {color:green} mvninstall {color} | {color:green} 19m 
39s{color} |  | {color:green} trunk passed {color} |
| {color:green}+1{color} | {color:green} compile {color} | {color:green}  0m 
35s{color} |  | {color:green} trunk passed with JDK 
Ubuntu-11.0.8+10-post-Ubuntu-0ubuntu118.04.1 {color} |
| {color:green}+1{color} | {color:green} compile {color} | {color:green}  0m 
33s{color} |  | {color:green} trunk passed with JDK Private 
Build-1.8.0_265-8u265-b01-0ubuntu2~18.04-b01 {color} |
| {color:green}+1{color} | {color:green} checkstyle {color} | {color:green}  0m 
28s{color} |  | {color:green} trunk passed {color} |
| {color:green}+1{color} | {color:green} mvnsite {color} | {color:green}  0m 
36s{color} |  | {color:green} trunk passed {color} |
| {color:green}+1{color} | {color:green} shadedclient {color} | {color:green} 
14m 50s{color} |  | {color:green} branch has no errors when building and 
testing our client artifacts. {color} |
| {color:green}+1{color} | {color:green} javadoc {color} | {color:green}  0m 
26s{color} |  | {color:green} trunk passed with JDK 
Ubuntu-11.0.8+10-post-Ubuntu-0ubuntu118.04.1 {color} |
| {color:green}+1{color} | {color:green} javadoc {color} | {color:green}  0m 
26s{color} |  | {color:green} trunk passed with JDK Private 
Build-1.8.0_265-8u265-b01-0ubuntu2~18.04-b01 {color} |
| {color:blue}0{color} | {color:blue} spotbugs {color} | {color:blue}  0m 
45s{color} |  | {color:blue} Used deprecated FindBugs config; considering 
switching to SpotBugs. {color} |
| {color:green}+1{color} | {color:green} findbugs {color} | {color:green}  0m 
43s{color} |  | {color:green} trunk passed {color} |
|| || || || {color:brown} Patch Compile Tests {color} || ||
| {color:green}+1{color} | {color:green} mvninstall {color} | {color:green}  0m 
32s{color} |  | {color:green} the patch passed {color} |
| {color:green}+1{color} | {color:green} compile {color} | {color:green}  0m 
27s{color} |  | {color:green} the patch passed with JDK 
Ubuntu-11.0.8+10-post-Ubuntu-0ubuntu118.04.1 {color} |
| {color:green}+1{color} | {color:green} javac {color} | {color:green}  0m 
27s{color} |  | {color:green} the patch passed {color} |
| {color:green}+1{color} | {color:green} compile {color} | {color:green}  0m 
25s{color} |  | {color:green} the patch passed with JDK Private 
Build-1.8.0_265-8u265-b01-0ubuntu2~18.04-b01 {color} |
| {color:green}+1{color} | {color:green} javac {color} | {color:green}  0m 
25s{color} |  | {color:green} the patch passed {color} |
| {color:green}+1{color} | {color:green} blanks {color} | {color:green}  0m  
0s{color} |  | {color:green} The patch has no blanks issues. {color} |
| {color:green}+1{color} | {color:green} checkstyle {color} | {color:green}  0m 
19s{color} |  | {color:green} the patch passed {color} |
| {color:green}+1{color} | {color:green} mvnsite {color} | {color:green}  0m 
28s{color} |  | {color:green} the patch passed {color} |
| {color:green}+1{color} | {color:green} shadedclient {color} | {color:green} 
15m  5s{color} |  | {color:green} patch has no errors when building and testing 
our client artifacts. {color} |
| {color:green}+1{color} | {color:green} javadoc {color} | {color:green}  0m 
23s{color} |  | {color:green} the patch passed with JDK 
Ubuntu-11.0.8+10-post-Ubuntu-0ubuntu118.04.1 {color} |
| {color:green}+1{color} | {color:green} javadoc {color} | {color:green}  0m 
21s{color} |  | {color:green} the patch passed with JDK Private 
Build-1.8.0_265-8u265-b01-0ubuntu2~18.04-b01 {color} |
| {color:green}+1{color} | {color:green} findbugs {color} | {color:green}  0m 
48s{color} |  | {color:green} the patch passed {color} |
|| || || || {color:brown} Other Tests {color} || ||
| {color:green}+1{color} | {color:green} unit {color} | {color:green}130m 
28s{color} |  | {color:green} hadoop-mapreduce-client-jobclient in the patch 
passed. {color} |
| {color:green}+1{color} |

[jira] [Commented] (MAPREDUCE-7301) Expose Mini MR Cluster attribute for testing

2020-10-08 Thread Swaroopa Kadam (Jira) 


[ 
https://issues.apache.org/jira/browse/MAPREDUCE-7301?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17210469#comment-17210469
 ] 

Swaroopa Kadam commented on MAPREDUCE-7301:
---

FYI. [~andrew.purt...@gmail.com] 

> Expose Mini MR Cluster attribute for testing
> 
>
> Key: MAPREDUCE-7301
> URL: https://issues.apache.org/jira/browse/MAPREDUCE-7301
> Project: Hadoop Map/Reduce
>  Issue Type: Improvement
>Reporter: Swaroopa Kadam
>Priority: Minor
>
> After MAPREDUCE-6521, applications using MiniMRYarnCluster need to explicitly 
> set the config "yarn.app.mapreduce.am.staging-dir" which ll include cluster 
> name in it. 
>  
> In order to get the cluster name, some getters on corresponding attributes 
> are needed to be available.



--
This message was sent by Atlassian Jira
(v8.3.4#803005)

-
To unsubscribe, e-mail: mapreduce-issues-unsubscr...@hadoop.apache.org
For additional commands, e-mail: mapreduce-issues-h...@hadoop.apache.org