[jira] [Updated] (YARN-3925) ContainerLogsUtils#getContainerLogFile fails to read container log files from full disks.

2017-01-05 Thread Junping Du (JIRA) 

 [ 
https://issues.apache.org/jira/browse/YARN-3925?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
 ]

Junping Du updated YARN-3925:
-
Fix Version/s: 2.8.0

> ContainerLogsUtils#getContainerLogFile fails to read container log files from 
> full disks.
> -
>
> Key: YARN-3925
> URL: https://issues.apache.org/jira/browse/YARN-3925
> Project: Hadoop YARN
>  Issue Type: Bug
>  Components: nodemanager
>Affects Versions: 2.7.1
>Reporter: zhihai xu
>Assignee: zhihai xu
>Priority: Critical
> Fix For: 2.8.0, 2.7.2, 2.6.3, 3.0.0-alpha1
>
> Attachments: YARN-3925.000.patch, YARN-3925.001.patch
>
>
> ContainerLogsUtils#getContainerLogFile fails to read files from full disks.
> {{getContainerLogFile}} depends on 
> {{LocalDirsHandlerService#getLogPathToRead}} to get the log file, but 
> {{LocalDirsHandlerService#getLogPathToRead}} calls 
> {{logDirsAllocator.getLocalPathToRead}} and {{logDirsAllocator}} uses 
> configuration {{YarnConfiguration.NM_LOG_DIRS}}, which will be updated to not 
> include full disks in {{LocalDirsHandlerService#checkDirs}}:
> {code}
> Configuration conf = getConfig();
> List localDirs = getLocalDirs();
> conf.setStrings(YarnConfiguration.NM_LOCAL_DIRS,
> localDirs.toArray(new String[localDirs.size()]));
> List logDirs = getLogDirs();
> conf.setStrings(YarnConfiguration.NM_LOG_DIRS,
>   logDirs.toArray(new String[logDirs.size()]));
> {code}
> ContainerLogsUtils#getContainerLogFile is used by NMWebServices#getLogs and 
> ContainerLogsPage.ContainersLogsBlock#render to read the log.



--
This message was sent by Atlassian JIRA
(v6.3.4#6332)

-
To unsubscribe, e-mail: yarn-issues-unsubscr...@hadoop.apache.org
For additional commands, e-mail: yarn-issues-h...@hadoop.apache.org

[jira] [Updated] (YARN-3925) ContainerLogsUtils#getContainerLogFile fails to read container log files from full disks.

2015-11-23 Thread Jason Lowe (JIRA) 

 [ 
https://issues.apache.org/jira/browse/YARN-3925?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
 ]

Jason Lowe updated YARN-3925:
-
Fix Version/s: 2.6.3

I pulled this into 2.6.3 as well.

> ContainerLogsUtils#getContainerLogFile fails to read container log files from 
> full disks.
> -
>
> Key: YARN-3925
> URL: https://issues.apache.org/jira/browse/YARN-3925
> Project: Hadoop YARN
>  Issue Type: Bug
>  Components: nodemanager
>Affects Versions: 2.7.1
>Reporter: zhihai xu
>Assignee: zhihai xu
>Priority: Critical
> Fix For: 2.7.2, 2.6.3
>
> Attachments: YARN-3925.000.patch, YARN-3925.001.patch
>
>
> ContainerLogsUtils#getContainerLogFile fails to read files from full disks.
> {{getContainerLogFile}} depends on 
> {{LocalDirsHandlerService#getLogPathToRead}} to get the log file, but 
> {{LocalDirsHandlerService#getLogPathToRead}} calls 
> {{logDirsAllocator.getLocalPathToRead}} and {{logDirsAllocator}} uses 
> configuration {{YarnConfiguration.NM_LOG_DIRS}}, which will be updated to not 
> include full disks in {{LocalDirsHandlerService#checkDirs}}:
> {code}
> Configuration conf = getConfig();
> List localDirs = getLocalDirs();
> conf.setStrings(YarnConfiguration.NM_LOCAL_DIRS,
> localDirs.toArray(new String[localDirs.size()]));
> List logDirs = getLogDirs();
> conf.setStrings(YarnConfiguration.NM_LOG_DIRS,
>   logDirs.toArray(new String[logDirs.size()]));
> {code}
> ContainerLogsUtils#getContainerLogFile is used by NMWebServices#getLogs and 
> ContainerLogsPage.ContainersLogsBlock#render to read the log.



--
This message was sent by Atlassian JIRA
(v6.3.4#6332)

[jira] [Updated] (YARN-3925) ContainerLogsUtils#getContainerLogFile fails to read container log files from full disks.

2015-07-22 Thread zhihai xu (JIRA) 

 [ 
https://issues.apache.org/jira/browse/YARN-3925?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
 ]

zhihai xu updated YARN-3925:

Attachment: YARN-3925.001.patch

 ContainerLogsUtils#getContainerLogFile fails to read container log files from 
 full disks.
 -

 Key: YARN-3925
 URL: https://issues.apache.org/jira/browse/YARN-3925
 Project: Hadoop YARN
  Issue Type: Bug
  Components: nodemanager
Affects Versions: 2.7.1
Reporter: zhihai xu
Assignee: zhihai xu
Priority: Critical
 Attachments: YARN-3925.000.patch, YARN-3925.001.patch


 ContainerLogsUtils#getContainerLogFile fails to read files from full disks.
 {{getContainerLogFile}} depends on 
 {{LocalDirsHandlerService#getLogPathToRead}} to get the log file, but 
 {{LocalDirsHandlerService#getLogPathToRead}} calls 
 {{logDirsAllocator.getLocalPathToRead}} and {{logDirsAllocator}} uses 
 configuration {{YarnConfiguration.NM_LOG_DIRS}}, which will be updated to not 
 include full disks in {{LocalDirsHandlerService#checkDirs}}:
 {code}
 Configuration conf = getConfig();
 ListString localDirs = getLocalDirs();
 conf.setStrings(YarnConfiguration.NM_LOCAL_DIRS,
 localDirs.toArray(new String[localDirs.size()]));
 ListString logDirs = getLogDirs();
 conf.setStrings(YarnConfiguration.NM_LOG_DIRS,
   logDirs.toArray(new String[logDirs.size()]));
 {code}
 ContainerLogsUtils#getContainerLogFile is used by NMWebServices#getLogs and 
 ContainerLogsPage.ContainersLogsBlock#render to read the log.



--
This message was sent by Atlassian JIRA
(v6.3.4#6332)

[jira] [Updated] (YARN-3925) ContainerLogsUtils#getContainerLogFile fails to read container log files from full disks.

2015-07-15 Thread zhihai xu (JIRA) 

 [ 
https://issues.apache.org/jira/browse/YARN-3925?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
 ]

zhihai xu updated YARN-3925:

Attachment: (was: YARN-3925.000.patch)

 ContainerLogsUtils#getContainerLogFile fails to read container log files from 
 full disks.
 -

 Key: YARN-3925
 URL: https://issues.apache.org/jira/browse/YARN-3925
 Project: Hadoop YARN
  Issue Type: Bug
  Components: nodemanager
Affects Versions: 2.7.1
Reporter: zhihai xu
Assignee: zhihai xu
Priority: Critical
 Attachments: YARN-3925.000.patch


 ContainerLogsUtils#getContainerLogFile fails to read files from full disks.
 {{getContainerLogFile}} depends on 
 {{LocalDirsHandlerService#getLogPathToRead}} to get the log file, but 
 {{LocalDirsHandlerService#getLogPathToRead}} calls 
 {{logDirsAllocator.getLocalPathToRead}} and {{logDirsAllocator}} uses 
 configuration {{YarnConfiguration.NM_LOG_DIRS}}, which will be updated to not 
 include full disks in {{LocalDirsHandlerService#checkDirs}}:
 {code}
 Configuration conf = getConfig();
 ListString localDirs = getLocalDirs();
 conf.setStrings(YarnConfiguration.NM_LOCAL_DIRS,
 localDirs.toArray(new String[localDirs.size()]));
 ListString logDirs = getLogDirs();
 conf.setStrings(YarnConfiguration.NM_LOG_DIRS,
   logDirs.toArray(new String[logDirs.size()]));
 {code}
 ContainerLogsUtils#getContainerLogFile is used by NMWebServices#getLogs and 
 ContainerLogsPage.ContainersLogsBlock#render to read the log.



--
This message was sent by Atlassian JIRA
(v6.3.4#6332)

[jira] [Updated] (YARN-3925) ContainerLogsUtils#getContainerLogFile fails to read container log files from full disks.

2015-07-15 Thread zhihai xu (JIRA) 

 [ 
https://issues.apache.org/jira/browse/YARN-3925?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
 ]

zhihai xu updated YARN-3925:

Attachment: YARN-3925.000.patch

 ContainerLogsUtils#getContainerLogFile fails to read container log files from 
 full disks.
 -

 Key: YARN-3925
 URL: https://issues.apache.org/jira/browse/YARN-3925
 Project: Hadoop YARN
  Issue Type: Bug
  Components: nodemanager
Affects Versions: 2.7.1
Reporter: zhihai xu
Assignee: zhihai xu
Priority: Critical
 Attachments: YARN-3925.000.patch


 ContainerLogsUtils#getContainerLogFile fails to read files from full disks.
 {{getContainerLogFile}} depends on 
 {{LocalDirsHandlerService#getLogPathToRead}} to get the log file, but 
 {{LocalDirsHandlerService#getLogPathToRead}} calls 
 {{logDirsAllocator.getLocalPathToRead}} and {{logDirsAllocator}} uses 
 configuration {{YarnConfiguration.NM_LOG_DIRS}}, which will be updated to not 
 include full disks in {{LocalDirsHandlerService#checkDirs}}:
 {code}
 Configuration conf = getConfig();
 ListString localDirs = getLocalDirs();
 conf.setStrings(YarnConfiguration.NM_LOCAL_DIRS,
 localDirs.toArray(new String[localDirs.size()]));
 ListString logDirs = getLogDirs();
 conf.setStrings(YarnConfiguration.NM_LOG_DIRS,
   logDirs.toArray(new String[logDirs.size()]));
 {code}
 ContainerLogsUtils#getContainerLogFile is used by NMWebServices#getLogs and 
 ContainerLogsPage.ContainersLogsBlock#render to read the log.



--
This message was sent by Atlassian JIRA
(v6.3.4#6332)

[jira] [Updated] (YARN-3925) ContainerLogsUtils#getContainerLogFile fails to read container log files from full disks.

2015-07-14 Thread zhihai xu (JIRA) 

 [ 
https://issues.apache.org/jira/browse/YARN-3925?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
 ]

zhihai xu updated YARN-3925:

Attachment: YARN-3925.000.patch

 ContainerLogsUtils#getContainerLogFile fails to read container log files from 
 full disks.
 -

 Key: YARN-3925
 URL: https://issues.apache.org/jira/browse/YARN-3925
 Project: Hadoop YARN
  Issue Type: Bug
  Components: nodemanager
Affects Versions: 2.7.1
Reporter: zhihai xu
Assignee: zhihai xu
Priority: Critical
 Attachments: YARN-3925.000.patch


 ContainerLogsUtils#getContainerLogFile fails to read files from full disks.
 {{getContainerLogFile}} depends on 
 {{LocalDirsHandlerService#getLogPathToRead}} to get the log file, but 
 {{LocalDirsHandlerService#getLogPathToRead}} calls 
 {{logDirsAllocator.getLocalPathToRead}} and {{logDirsAllocator}} uses 
 configuration {{YarnConfiguration.NM_LOG_DIRS}}, which will be updated to not 
 include full disks in {{LocalDirsHandlerService#checkDirs}}:
 {code}
 Configuration conf = getConfig();
 ListString localDirs = getLocalDirs();
 conf.setStrings(YarnConfiguration.NM_LOCAL_DIRS,
 localDirs.toArray(new String[localDirs.size()]));
 ListString logDirs = getLogDirs();
 conf.setStrings(YarnConfiguration.NM_LOG_DIRS,
   logDirs.toArray(new String[logDirs.size()]));
 {code}
 ContainerLogsUtils#getContainerLogFile is used by NMWebServices#getLogs and 
 ContainerLogsPage.ContainersLogsBlock#render to read the log.



--
This message was sent by Atlassian JIRA
(v6.3.4#6332)