[jira] [Updated] (YARN-10161) TestRouterWebServicesREST is corrupting STDOUT

2020-02-27 Thread Jira 


 [ 
https://issues.apache.org/jira/browse/YARN-10161?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
 ]

Íñigo Goiri updated YARN-10161:
---
Fix Version/s: 2.10.1
   3.1.4
   3.2.2
   3.3.0
   3.0.4

> TestRouterWebServicesREST is corrupting STDOUT
> --
>
> Key: YARN-10161
> URL: https://issues.apache.org/jira/browse/YARN-10161
> Project: Hadoop YARN
>  Issue Type: Test
>  Components: yarn
>Affects Versions: 2.10.0, 3.2.1
>Reporter: Jim Brennan
>Assignee: Jim Brennan
>Priority: Minor
> Fix For: 3.0.4, 3.3.0, 3.2.2, 3.1.4, 2.10.1
>
> Attachments: YARN-10161.001.patch, YARN-10161.002.patch, 
> YARN-10161.003.patch
>
>
> TestRouterWebServicesREST is creating processes that inherit stdin/stdout 
> from the current process, so the output from those jobs goes into the 
> standard output of mvn test.
> Here's an example from a recent build:
> {noformat}
> [WARNING] Corrupted STDOUT by directly writing to native stream in forked JVM 
> 1. See FAQ web page and the dump file 
> /testptch/hadoop/hadoop-yarn-project/hadoop-yarn/hadoop-yarn-server/hadoop-yarn-server-router/target/surefire-reports/2020-02-24T08-00-54_776-jvmRun1.dumpstream
> [INFO] Tests run: 41, Failures: 0, Errors: 0, Skipped: 0, Time elapsed: 
> 41.644 s - in 
> org.apache.hadoop.yarn.server.router.webapp.TestRouterWebServicesREST
> [WARNING] ForkStarter IOException: 506 INFO  [main] 
> resourcemanager.ResourceManager (LogAdapter.java:info(49)) - STARTUP_MSG: 
> 522 INFO  [main] resourcemanager.ResourceManager (LogAdapter.java:info(49)) - 
> registered UNIX signal handlers for [TERM, HUP, INT]
> 876 INFO  [main] conf.Configuration 
> (Configuration.java:getConfResourceAsInputStream(2588)) - core-site.xml not 
> found
> 879 INFO  [main] security.Groups (Groups.java:refresh(402)) - clearing 
> userToGroupsMap cache
> 930 INFO  [main] conf.Configuration 
> (Configuration.java:getConfResourceAsInputStream(2588)) - resource-types.xml 
> not found
> 930 INFO  [main] resource.ResourceUtils 
> (ResourceUtils.java:addResourcesFileToConf(421)) - Unable to find 
> 'resource-types.xml'.
> 940 INFO  [main] resource.ResourceUtils 
> (ResourceUtils.java:addMandatoryResources(126)) - Adding resource type - name 
> = memory-mb, units = Mi, type = COUNTABLE
> 940 INFO  [main] resource.ResourceUtils 
> (ResourceUtils.java:addMandatoryResources(135)) - Adding resource type - name 
> = vcores, units = , type = COUNTABLE
> 974 INFO  [main] conf.Configuration 
> (Configuration.java:getConfResourceAsInputStream(2591)) - found resource 
> yarn-site.xml at 
> file:/testptch/hadoop/hadoop-yarn-project/hadoop-yarn/hadoop-yarn-server/hadoop-yarn-server-router/target/test-classes/yarn-site.xml
> 001 INFO  [main] event.AsyncDispatcher (AsyncDispatcher.java:register(227)) - 
> Registering class 
> org.apache.hadoop.yarn.server.resourcemanager.RMFatalEventType for class 
> org.apache.hadoop.yarn.server.resourcemanager.ResourceManager$RMFatalEventDispatcher
> 053 INFO  [main] security.NMTokenSecretManagerInRM 
> (NMTokenSecretManagerInRM.java:(75)) - NMTokenKeyRollingInterval: 
> 8640ms and NMTokenKeyActivationDelay: 90ms
> 060 INFO  [main] security.RMContainerTokenSecretManager 
> (RMContainerTokenSecretManager.java:(79)) - 
> ContainerTokenKeyRollingInterval: 8640ms and 
> ContainerTokenKeyActivationDelay: 90ms
> ... {noformat}
> It seems like these processes should be rerouting stdout/stderr to a file 
> instead of dumping it to the console.



--
This message was sent by Atlassian Jira
(v8.3.4#803005)

-
To unsubscribe, e-mail: yarn-issues-unsubscr...@hadoop.apache.org
For additional commands, e-mail: yarn-issues-h...@hadoop.apache.org

[jira] [Updated] (YARN-10161) TestRouterWebServicesREST is corrupting STDOUT

2020-02-27 Thread Jim Brennan (Jira) 


 [ 
https://issues.apache.org/jira/browse/YARN-10161?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
 ]

Jim Brennan updated YARN-10161:
---
Attachment: YARN-10161.003.patch

> TestRouterWebServicesREST is corrupting STDOUT
> --
>
> Key: YARN-10161
> URL: https://issues.apache.org/jira/browse/YARN-10161
> Project: Hadoop YARN
>  Issue Type: Test
>  Components: yarn
>Affects Versions: 2.10.0, 3.2.1
>Reporter: Jim Brennan
>Assignee: Jim Brennan
>Priority: Minor
> Attachments: YARN-10161.001.patch, YARN-10161.002.patch, 
> YARN-10161.003.patch
>
>
> TestRouterWebServicesREST is creating processes that inherit stdin/stdout 
> from the current process, so the output from those jobs goes into the 
> standard output of mvn test.
> Here's an example from a recent build:
> {noformat}
> [WARNING] Corrupted STDOUT by directly writing to native stream in forked JVM 
> 1. See FAQ web page and the dump file 
> /testptch/hadoop/hadoop-yarn-project/hadoop-yarn/hadoop-yarn-server/hadoop-yarn-server-router/target/surefire-reports/2020-02-24T08-00-54_776-jvmRun1.dumpstream
> [INFO] Tests run: 41, Failures: 0, Errors: 0, Skipped: 0, Time elapsed: 
> 41.644 s - in 
> org.apache.hadoop.yarn.server.router.webapp.TestRouterWebServicesREST
> [WARNING] ForkStarter IOException: 506 INFO  [main] 
> resourcemanager.ResourceManager (LogAdapter.java:info(49)) - STARTUP_MSG: 
> 522 INFO  [main] resourcemanager.ResourceManager (LogAdapter.java:info(49)) - 
> registered UNIX signal handlers for [TERM, HUP, INT]
> 876 INFO  [main] conf.Configuration 
> (Configuration.java:getConfResourceAsInputStream(2588)) - core-site.xml not 
> found
> 879 INFO  [main] security.Groups (Groups.java:refresh(402)) - clearing 
> userToGroupsMap cache
> 930 INFO  [main] conf.Configuration 
> (Configuration.java:getConfResourceAsInputStream(2588)) - resource-types.xml 
> not found
> 930 INFO  [main] resource.ResourceUtils 
> (ResourceUtils.java:addResourcesFileToConf(421)) - Unable to find 
> 'resource-types.xml'.
> 940 INFO  [main] resource.ResourceUtils 
> (ResourceUtils.java:addMandatoryResources(126)) - Adding resource type - name 
> = memory-mb, units = Mi, type = COUNTABLE
> 940 INFO  [main] resource.ResourceUtils 
> (ResourceUtils.java:addMandatoryResources(135)) - Adding resource type - name 
> = vcores, units = , type = COUNTABLE
> 974 INFO  [main] conf.Configuration 
> (Configuration.java:getConfResourceAsInputStream(2591)) - found resource 
> yarn-site.xml at 
> file:/testptch/hadoop/hadoop-yarn-project/hadoop-yarn/hadoop-yarn-server/hadoop-yarn-server-router/target/test-classes/yarn-site.xml
> 001 INFO  [main] event.AsyncDispatcher (AsyncDispatcher.java:register(227)) - 
> Registering class 
> org.apache.hadoop.yarn.server.resourcemanager.RMFatalEventType for class 
> org.apache.hadoop.yarn.server.resourcemanager.ResourceManager$RMFatalEventDispatcher
> 053 INFO  [main] security.NMTokenSecretManagerInRM 
> (NMTokenSecretManagerInRM.java:(75)) - NMTokenKeyRollingInterval: 
> 8640ms and NMTokenKeyActivationDelay: 90ms
> 060 INFO  [main] security.RMContainerTokenSecretManager 
> (RMContainerTokenSecretManager.java:(79)) - 
> ContainerTokenKeyRollingInterval: 8640ms and 
> ContainerTokenKeyActivationDelay: 90ms
> ... {noformat}
> It seems like these processes should be rerouting stdout/stderr to a file 
> instead of dumping it to the console.



--
This message was sent by Atlassian Jira
(v8.3.4#803005)

-
To unsubscribe, e-mail: yarn-issues-unsubscr...@hadoop.apache.org
For additional commands, e-mail: yarn-issues-h...@hadoop.apache.org

[jira] [Updated] (YARN-10161) TestRouterWebServicesREST is corrupting STDOUT

2020-02-27 Thread Jim Brennan (Jira) 


 [ 
https://issues.apache.org/jira/browse/YARN-10161?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
 ]

Jim Brennan updated YARN-10161:
---
Attachment: YARN-10161.002.patch

> TestRouterWebServicesREST is corrupting STDOUT
> --
>
> Key: YARN-10161
> URL: https://issues.apache.org/jira/browse/YARN-10161
> Project: Hadoop YARN
>  Issue Type: Test
>  Components: yarn
>Affects Versions: 2.10.0, 3.2.1
>Reporter: Jim Brennan
>Assignee: Jim Brennan
>Priority: Minor
> Attachments: YARN-10161.001.patch, YARN-10161.002.patch
>
>
> TestRouterWebServicesREST is creating processes that inherit stdin/stdout 
> from the current process, so the output from those jobs goes into the 
> standard output of mvn test.
> Here's an example from a recent build:
> {noformat}
> [WARNING] Corrupted STDOUT by directly writing to native stream in forked JVM 
> 1. See FAQ web page and the dump file 
> /testptch/hadoop/hadoop-yarn-project/hadoop-yarn/hadoop-yarn-server/hadoop-yarn-server-router/target/surefire-reports/2020-02-24T08-00-54_776-jvmRun1.dumpstream
> [INFO] Tests run: 41, Failures: 0, Errors: 0, Skipped: 0, Time elapsed: 
> 41.644 s - in 
> org.apache.hadoop.yarn.server.router.webapp.TestRouterWebServicesREST
> [WARNING] ForkStarter IOException: 506 INFO  [main] 
> resourcemanager.ResourceManager (LogAdapter.java:info(49)) - STARTUP_MSG: 
> 522 INFO  [main] resourcemanager.ResourceManager (LogAdapter.java:info(49)) - 
> registered UNIX signal handlers for [TERM, HUP, INT]
> 876 INFO  [main] conf.Configuration 
> (Configuration.java:getConfResourceAsInputStream(2588)) - core-site.xml not 
> found
> 879 INFO  [main] security.Groups (Groups.java:refresh(402)) - clearing 
> userToGroupsMap cache
> 930 INFO  [main] conf.Configuration 
> (Configuration.java:getConfResourceAsInputStream(2588)) - resource-types.xml 
> not found
> 930 INFO  [main] resource.ResourceUtils 
> (ResourceUtils.java:addResourcesFileToConf(421)) - Unable to find 
> 'resource-types.xml'.
> 940 INFO  [main] resource.ResourceUtils 
> (ResourceUtils.java:addMandatoryResources(126)) - Adding resource type - name 
> = memory-mb, units = Mi, type = COUNTABLE
> 940 INFO  [main] resource.ResourceUtils 
> (ResourceUtils.java:addMandatoryResources(135)) - Adding resource type - name 
> = vcores, units = , type = COUNTABLE
> 974 INFO  [main] conf.Configuration 
> (Configuration.java:getConfResourceAsInputStream(2591)) - found resource 
> yarn-site.xml at 
> file:/testptch/hadoop/hadoop-yarn-project/hadoop-yarn/hadoop-yarn-server/hadoop-yarn-server-router/target/test-classes/yarn-site.xml
> 001 INFO  [main] event.AsyncDispatcher (AsyncDispatcher.java:register(227)) - 
> Registering class 
> org.apache.hadoop.yarn.server.resourcemanager.RMFatalEventType for class 
> org.apache.hadoop.yarn.server.resourcemanager.ResourceManager$RMFatalEventDispatcher
> 053 INFO  [main] security.NMTokenSecretManagerInRM 
> (NMTokenSecretManagerInRM.java:(75)) - NMTokenKeyRollingInterval: 
> 8640ms and NMTokenKeyActivationDelay: 90ms
> 060 INFO  [main] security.RMContainerTokenSecretManager 
> (RMContainerTokenSecretManager.java:(79)) - 
> ContainerTokenKeyRollingInterval: 8640ms and 
> ContainerTokenKeyActivationDelay: 90ms
> ... {noformat}
> It seems like these processes should be rerouting stdout/stderr to a file 
> instead of dumping it to the console.



--
This message was sent by Atlassian Jira
(v8.3.4#803005)

-
To unsubscribe, e-mail: yarn-issues-unsubscr...@hadoop.apache.org
For additional commands, e-mail: yarn-issues-h...@hadoop.apache.org

[jira] [Updated] (YARN-10161) TestRouterWebServicesREST is corrupting STDOUT

2020-02-25 Thread Jim Brennan (Jira) 


 [ 
https://issues.apache.org/jira/browse/YARN-10161?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
 ]

Jim Brennan updated YARN-10161:
---
Affects Version/s: 3.2.1

> TestRouterWebServicesREST is corrupting STDOUT
> --
>
> Key: YARN-10161
> URL: https://issues.apache.org/jira/browse/YARN-10161
> Project: Hadoop YARN
>  Issue Type: Test
>  Components: yarn
>Affects Versions: 2.10.0, 3.2.1
>Reporter: Jim Brennan
>Assignee: Jim Brennan
>Priority: Minor
>
> TestRouterWebServicesREST is creating processes that inherit stdin/stdout 
> from the current process, so the output from those jobs goes into the 
> standard output of mvn test.
> Here's an example from a recent build:
> {noformat}
> [WARNING] Corrupted STDOUT by directly writing to native stream in forked JVM 
> 1. See FAQ web page and the dump file 
> /testptch/hadoop/hadoop-yarn-project/hadoop-yarn/hadoop-yarn-server/hadoop-yarn-server-router/target/surefire-reports/2020-02-24T08-00-54_776-jvmRun1.dumpstream
> [INFO] Tests run: 41, Failures: 0, Errors: 0, Skipped: 0, Time elapsed: 
> 41.644 s - in 
> org.apache.hadoop.yarn.server.router.webapp.TestRouterWebServicesREST
> [WARNING] ForkStarter IOException: 506 INFO  [main] 
> resourcemanager.ResourceManager (LogAdapter.java:info(49)) - STARTUP_MSG: 
> 522 INFO  [main] resourcemanager.ResourceManager (LogAdapter.java:info(49)) - 
> registered UNIX signal handlers for [TERM, HUP, INT]
> 876 INFO  [main] conf.Configuration 
> (Configuration.java:getConfResourceAsInputStream(2588)) - core-site.xml not 
> found
> 879 INFO  [main] security.Groups (Groups.java:refresh(402)) - clearing 
> userToGroupsMap cache
> 930 INFO  [main] conf.Configuration 
> (Configuration.java:getConfResourceAsInputStream(2588)) - resource-types.xml 
> not found
> 930 INFO  [main] resource.ResourceUtils 
> (ResourceUtils.java:addResourcesFileToConf(421)) - Unable to find 
> 'resource-types.xml'.
> 940 INFO  [main] resource.ResourceUtils 
> (ResourceUtils.java:addMandatoryResources(126)) - Adding resource type - name 
> = memory-mb, units = Mi, type = COUNTABLE
> 940 INFO  [main] resource.ResourceUtils 
> (ResourceUtils.java:addMandatoryResources(135)) - Adding resource type - name 
> = vcores, units = , type = COUNTABLE
> 974 INFO  [main] conf.Configuration 
> (Configuration.java:getConfResourceAsInputStream(2591)) - found resource 
> yarn-site.xml at 
> file:/testptch/hadoop/hadoop-yarn-project/hadoop-yarn/hadoop-yarn-server/hadoop-yarn-server-router/target/test-classes/yarn-site.xml
> 001 INFO  [main] event.AsyncDispatcher (AsyncDispatcher.java:register(227)) - 
> Registering class 
> org.apache.hadoop.yarn.server.resourcemanager.RMFatalEventType for class 
> org.apache.hadoop.yarn.server.resourcemanager.ResourceManager$RMFatalEventDispatcher
> 053 INFO  [main] security.NMTokenSecretManagerInRM 
> (NMTokenSecretManagerInRM.java:(75)) - NMTokenKeyRollingInterval: 
> 8640ms and NMTokenKeyActivationDelay: 90ms
> 060 INFO  [main] security.RMContainerTokenSecretManager 
> (RMContainerTokenSecretManager.java:(79)) - 
> ContainerTokenKeyRollingInterval: 8640ms and 
> ContainerTokenKeyActivationDelay: 90ms
> ... {noformat}
> It seems like these processes should be rerouting stdout/stderr to a file 
> instead of dumping it to the console.



--
This message was sent by Atlassian Jira
(v8.3.4#803005)

-
To unsubscribe, e-mail: yarn-issues-unsubscr...@hadoop.apache.org
For additional commands, e-mail: yarn-issues-h...@hadoop.apache.org