[jira] [Commented] (YARN-8279) AggregationLogDeletionService does not honor yarn.log-aggregation.IndexedFormat.remote-app-log-dir-suffix

2018-05-24 Thread Tarun Parimi (JIRA) 

[ 
https://issues.apache.org/jira/browse/YARN-8279?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16489074#comment-16489074
 ] 

Tarun Parimi commented on YARN-8279:


[~jlowe] YARN-7072 seems to have been backported in HDP distribution with 
hadoop version 2.7.3. That's why the discrepancy is there in versions I guess.

> AggregationLogDeletionService does not honor 
> yarn.log-aggregation.IndexedFormat.remote-app-log-dir-suffix
> -
>
> Key: YARN-8279
> URL: https://issues.apache.org/jira/browse/YARN-8279
> Project: Hadoop YARN
>  Issue Type: Bug
>  Components: log-aggregation
>Affects Versions: 2.9.1
>Reporter: Prabhu Joseph
>Assignee: Tarun Parimi
>Priority: Major
>
> AggregationLogDeletionService does not honor 
> yarn.log-aggregation.IndexedFormat.remote-app-log-dir-suffix. 
> AggregationLogService writes the logs into /app-logs//logs-ifile 
> where as AggregationLogDeletion tries to delete from  
> /app-logs//logs.
> Workaround is to set 
> yarn.log-aggregation.IndexedFormat.remote-app-log-dir-suffix and 
> yarn.nodemanager.remote-app-log-dir-suffix to same value "logs-ifile"
> AggregationLogDeletionService has to check the format and based upon that 
> choose the suffix. Currently it only checks the older suffix 
> yarn.nodemanager.remote-app-log-dir-suffix.
> AggregatedLogDeletionService tries to delete older suffix directory.
> {code}
> 2018-05-11 08:48:19,989 ERROR logaggregation.AggregatedLogDeletionService 
> (AggregatedLogDeletionService.java:logIOException(182)) - Could not read the 
> contents of hdfs://prabhucluster:8020/app-logs/hive/logs
> java.io.FileNotFoundException: File 
> hdfs://prabhucluster:8020/app-logs/hive/logs does not exist.
> at 
> org.apache.hadoop.hdfs.DistributedFileSystem.listStatusInternal(DistributedFileSystem.java:923)
> at 
> org.apache.hadoop.hdfs.DistributedFileSystem.access$600(DistributedFileSystem.java:114)
> at 
> org.apache.hadoop.hdfs.DistributedFileSystem$22.doCall(DistributedFileSystem.java:985)
> at 
> org.apache.hadoop.hdfs.DistributedFileSystem$22.doCall(DistributedFileSystem.java:981)
> at 
> org.apache.hadoop.fs.FileSystemLinkResolver.resolve(FileSystemLinkResolver.java:81)
> at 
> org.apache.hadoop.hdfs.DistributedFileSystem.listStatus(DistributedFileSystem.java:992)
> at 
> org.apache.hadoop.yarn.logaggregation.AggregatedLogDeletionService$LogDeletionTask.deleteOldLogDirsFrom(AggregatedLogDeletionService.java:98)
> at 
> org.apache.hadoop.yarn.logaggregation.AggregatedLogDeletionService$LogDeletionTask.run(AggregatedLogDeletionService.java:85)
> at java.util.TimerThread.mainLoop(Timer.java:555)
> at java.util.TimerThread.run(Timer.java:505)
> {code}



--
This message was sent by Atlassian JIRA
(v7.6.3#76005)

-
To unsubscribe, e-mail: yarn-issues-unsubscr...@hadoop.apache.org
For additional commands, e-mail: yarn-issues-h...@hadoop.apache.org

[jira] [Commented] (YARN-8279) AggregationLogDeletionService does not honor yarn.log-aggregation.IndexedFormat.remote-app-log-dir-suffix

2018-05-24 Thread Prabhu Joseph (JIRA) 

[ 
https://issues.apache.org/jira/browse/YARN-8279?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16489071#comment-16489071
 ] 

Prabhu Joseph commented on YARN-8279:
-

[~jlowe] We have faced this on HDP Distribution with Hadoop version 2.7.3 but 
which has most of the latest code from Apache. The issue will also occur in 
trunk version.

> AggregationLogDeletionService does not honor 
> yarn.log-aggregation.IndexedFormat.remote-app-log-dir-suffix
> -
>
> Key: YARN-8279
> URL: https://issues.apache.org/jira/browse/YARN-8279
> Project: Hadoop YARN
>  Issue Type: Bug
>  Components: log-aggregation
>Affects Versions: 2.9.1
>Reporter: Prabhu Joseph
>Assignee: Tarun Parimi
>Priority: Major
>
> AggregationLogDeletionService does not honor 
> yarn.log-aggregation.IndexedFormat.remote-app-log-dir-suffix. 
> AggregationLogService writes the logs into /app-logs//logs-ifile 
> where as AggregationLogDeletion tries to delete from  
> /app-logs//logs.
> Workaround is to set 
> yarn.log-aggregation.IndexedFormat.remote-app-log-dir-suffix and 
> yarn.nodemanager.remote-app-log-dir-suffix to same value "logs-ifile"
> AggregationLogDeletionService has to check the format and based upon that 
> choose the suffix. Currently it only checks the older suffix 
> yarn.nodemanager.remote-app-log-dir-suffix.
> AggregatedLogDeletionService tries to delete older suffix directory.
> {code}
> 2018-05-11 08:48:19,989 ERROR logaggregation.AggregatedLogDeletionService 
> (AggregatedLogDeletionService.java:logIOException(182)) - Could not read the 
> contents of hdfs://prabhucluster:8020/app-logs/hive/logs
> java.io.FileNotFoundException: File 
> hdfs://prabhucluster:8020/app-logs/hive/logs does not exist.
> at 
> org.apache.hadoop.hdfs.DistributedFileSystem.listStatusInternal(DistributedFileSystem.java:923)
> at 
> org.apache.hadoop.hdfs.DistributedFileSystem.access$600(DistributedFileSystem.java:114)
> at 
> org.apache.hadoop.hdfs.DistributedFileSystem$22.doCall(DistributedFileSystem.java:985)
> at 
> org.apache.hadoop.hdfs.DistributedFileSystem$22.doCall(DistributedFileSystem.java:981)
> at 
> org.apache.hadoop.fs.FileSystemLinkResolver.resolve(FileSystemLinkResolver.java:81)
> at 
> org.apache.hadoop.hdfs.DistributedFileSystem.listStatus(DistributedFileSystem.java:992)
> at 
> org.apache.hadoop.yarn.logaggregation.AggregatedLogDeletionService$LogDeletionTask.deleteOldLogDirsFrom(AggregatedLogDeletionService.java:98)
> at 
> org.apache.hadoop.yarn.logaggregation.AggregatedLogDeletionService$LogDeletionTask.run(AggregatedLogDeletionService.java:85)
> at java.util.TimerThread.mainLoop(Timer.java:555)
> at java.util.TimerThread.run(Timer.java:505)
> {code}



--
This message was sent by Atlassian JIRA
(v7.6.3#76005)

-
To unsubscribe, e-mail: yarn-issues-unsubscr...@hadoop.apache.org
For additional commands, e-mail: yarn-issues-h...@hadoop.apache.org

[jira] [Commented] (YARN-8279) AggregationLogDeletionService does not honor yarn.log-aggregation.IndexedFormat.remote-app-log-dir-suffix

2018-05-24 Thread Jason Lowe (JIRA) 

[ 
https://issues.apache.org/jira/browse/YARN-8279?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16489061#comment-16489061
 ] 

Jason Lowe commented on YARN-8279:
--

Did this really occur in Hadoop 2.7.3?  LogAggregationIndexedFileController was 
added by YARN-7072, but not until 2.9.


> AggregationLogDeletionService does not honor 
> yarn.log-aggregation.IndexedFormat.remote-app-log-dir-suffix
> -
>
> Key: YARN-8279
> URL: https://issues.apache.org/jira/browse/YARN-8279
> Project: Hadoop YARN
>  Issue Type: Bug
>  Components: log-aggregation
>Affects Versions: 2.7.3
>Reporter: Prabhu Joseph
>Assignee: Tarun Parimi
>Priority: Major
>
> AggregationLogDeletionService does not honor 
> yarn.log-aggregation.IndexedFormat.remote-app-log-dir-suffix. 
> AggregationLogService writes the logs into /app-logs//logs-ifile 
> where as AggregationLogDeletion tries to delete from  
> /app-logs//logs.
> Workaround is to set 
> yarn.log-aggregation.IndexedFormat.remote-app-log-dir-suffix and 
> yarn.nodemanager.remote-app-log-dir-suffix to same value "logs-ifile"
> AggregationLogDeletionService has to check the format and based upon that 
> choose the suffix. Currently it only checks the older suffix 
> yarn.nodemanager.remote-app-log-dir-suffix.
> AggregatedLogDeletionService tries to delete older suffix directory.
> {code}
> 2018-05-11 08:48:19,989 ERROR logaggregation.AggregatedLogDeletionService 
> (AggregatedLogDeletionService.java:logIOException(182)) - Could not read the 
> contents of hdfs://prabhucluster:8020/app-logs/hive/logs
> java.io.FileNotFoundException: File 
> hdfs://prabhucluster:8020/app-logs/hive/logs does not exist.
> at 
> org.apache.hadoop.hdfs.DistributedFileSystem.listStatusInternal(DistributedFileSystem.java:923)
> at 
> org.apache.hadoop.hdfs.DistributedFileSystem.access$600(DistributedFileSystem.java:114)
> at 
> org.apache.hadoop.hdfs.DistributedFileSystem$22.doCall(DistributedFileSystem.java:985)
> at 
> org.apache.hadoop.hdfs.DistributedFileSystem$22.doCall(DistributedFileSystem.java:981)
> at 
> org.apache.hadoop.fs.FileSystemLinkResolver.resolve(FileSystemLinkResolver.java:81)
> at 
> org.apache.hadoop.hdfs.DistributedFileSystem.listStatus(DistributedFileSystem.java:992)
> at 
> org.apache.hadoop.yarn.logaggregation.AggregatedLogDeletionService$LogDeletionTask.deleteOldLogDirsFrom(AggregatedLogDeletionService.java:98)
> at 
> org.apache.hadoop.yarn.logaggregation.AggregatedLogDeletionService$LogDeletionTask.run(AggregatedLogDeletionService.java:85)
> at java.util.TimerThread.mainLoop(Timer.java:555)
> at java.util.TimerThread.run(Timer.java:505)
> {code}



--
This message was sent by Atlassian JIRA
(v7.6.3#76005)

-
To unsubscribe, e-mail: yarn-issues-unsubscr...@hadoop.apache.org
For additional commands, e-mail: yarn-issues-h...@hadoop.apache.org

[jira] [Commented] (YARN-8279) AggregationLogDeletionService does not honor yarn.log-aggregation.IndexedFormat.remote-app-log-dir-suffix

2018-05-24 Thread Tarun Parimi (JIRA) 

[ 
https://issues.apache.org/jira/browse/YARN-8279?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16489024#comment-16489024
 ] 

Tarun Parimi commented on YARN-8279:


This issue occurs since LogAggregationIndexedFileController appends "-ifile" to 
the suffix configured in yarn.nodemanager.remote-app-log-dir-suffix*_,_* when 
yarn.log-aggregation.IndexedFormat.remote-app-log-dir-suffix is not configured 
as seen in below code.
{code:java}
if (this.remoteRootLogDirSuffix == null
|| this.remoteRootLogDirSuffix.isEmpty()) {
  this.remoteRootLogDirSuffix = conf.get(
  YarnConfiguration.NM_REMOTE_APP_LOG_DIR_SUFFIX,
  YarnConfiguration.DEFAULT_NM_REMOTE_APP_LOG_DIR_SUFFIX)
  + "-ifile";
}
{code}
 
Not sure why "-ifile" is being appended here by default. To ensure that it 
doesn't aggregates logs in the same folder the older 
LogAggregationTFileController logs were present?

> AggregationLogDeletionService does not honor 
> yarn.log-aggregation.IndexedFormat.remote-app-log-dir-suffix
> -
>
> Key: YARN-8279
> URL: https://issues.apache.org/jira/browse/YARN-8279
> Project: Hadoop YARN
>  Issue Type: Bug
>  Components: log-aggregation
>Affects Versions: 2.7.3
>Reporter: Prabhu Joseph
>Assignee: Tarun Parimi
>Priority: Major
>
> AggregationLogDeletionService does not honor 
> yarn.log-aggregation.IndexedFormat.remote-app-log-dir-suffix. 
> AggregationLogService writes the logs into /app-logs//logs-ifile 
> where as AggregationLogDeletion tries to delete from  
> /app-logs//logs.
> Workaround is to set 
> yarn.log-aggregation.IndexedFormat.remote-app-log-dir-suffix and 
> yarn.nodemanager.remote-app-log-dir-suffix to same value "logs-ifile"
> AggregationLogDeletionService has to check the format and based upon that 
> choose the suffix. Currently it only checks the older suffix 
> yarn.nodemanager.remote-app-log-dir-suffix.
> AggregatedLogDeletionService tries to delete older suffix directory.
> {code}
> 2018-05-11 08:48:19,989 ERROR logaggregation.AggregatedLogDeletionService 
> (AggregatedLogDeletionService.java:logIOException(182)) - Could not read the 
> contents of hdfs://prabhucluster:8020/app-logs/hive/logs
> java.io.FileNotFoundException: File 
> hdfs://prabhucluster:8020/app-logs/hive/logs does not exist.
> at 
> org.apache.hadoop.hdfs.DistributedFileSystem.listStatusInternal(DistributedFileSystem.java:923)
> at 
> org.apache.hadoop.hdfs.DistributedFileSystem.access$600(DistributedFileSystem.java:114)
> at 
> org.apache.hadoop.hdfs.DistributedFileSystem$22.doCall(DistributedFileSystem.java:985)
> at 
> org.apache.hadoop.hdfs.DistributedFileSystem$22.doCall(DistributedFileSystem.java:981)
> at 
> org.apache.hadoop.fs.FileSystemLinkResolver.resolve(FileSystemLinkResolver.java:81)
> at 
> org.apache.hadoop.hdfs.DistributedFileSystem.listStatus(DistributedFileSystem.java:992)
> at 
> org.apache.hadoop.yarn.logaggregation.AggregatedLogDeletionService$LogDeletionTask.deleteOldLogDirsFrom(AggregatedLogDeletionService.java:98)
> at 
> org.apache.hadoop.yarn.logaggregation.AggregatedLogDeletionService$LogDeletionTask.run(AggregatedLogDeletionService.java:85)
> at java.util.TimerThread.mainLoop(Timer.java:555)
> at java.util.TimerThread.run(Timer.java:505)
> {code}



--
This message was sent by Atlassian JIRA
(v7.6.3#76005)

-
To unsubscribe, e-mail: yarn-issues-unsubscr...@hadoop.apache.org
For additional commands, e-mail: yarn-issues-h...@hadoop.apache.org