[jira] [Updated] (YARN-6699) [ATSv2 Security] Delegation token support for Timeline reader

2017-08-18 Thread Vrushali C (JIRA)
[ https://issues.apache.org/jira/browse/YARN-6699?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Vrushali C updated YARN-6699: - Parent Issue: YARN-7055 (was: YARN-5355) > [ATSv2 Security] Delegation token support for Timeline reader

[jira] [Updated] (YARN-6047) Documentation updates for TimelineService v2

2017-08-18 Thread Vrushali C (JIRA)
[ https://issues.apache.org/jira/browse/YARN-6047?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Vrushali C updated YARN-6047: - Parent Issue: YARN-5355 (was: YARN-7055) > Documentation updates for TimelineService v2 >

[jira] [Updated] (YARN-6149) Allow port range to be specified while starting NM Timeline collector manager.

2017-08-18 Thread Vrushali C (JIRA)
[ https://issues.apache.org/jira/browse/YARN-6149?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Vrushali C updated YARN-6149: - Parent Issue: YARN-7055 (was: YARN-5355) > Allow port range to be specified while starting NM Timeline

[jira] [Updated] (YARN-6140) start time key in NM leveldb store should be removed when container is removed

2017-08-18 Thread Vrushali C (JIRA)
[ https://issues.apache.org/jira/browse/YARN-6140?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Vrushali C updated YARN-6140: - Parent Issue: YARN-7055 (was: YARN-5355) > start time key in NM leveldb store should be removed when

[jira] [Updated] (YARN-6382) Address race condition on TimelineWriter.flush() caused by buffer-sized flush

2017-08-18 Thread Vrushali C (JIRA)
[ https://issues.apache.org/jira/browse/YARN-6382?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Vrushali C updated YARN-6382: - Parent Issue: YARN-7055 (was: YARN-5355) > Address race condition on TimelineWriter.flush() caused by

[jira] [Updated] (YARN-6735) Have a way to turn off system metrics from NMs

2017-08-18 Thread Vrushali C (JIRA)
[ https://issues.apache.org/jira/browse/YARN-6735?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Vrushali C updated YARN-6735: - Parent Issue: YARN-7055 (was: YARN-5355) > Have a way to turn off system metrics from NMs >

[jira] [Updated] (YARN-6179) Support for collapse filter for flow entities with in the boundary of date range.

2017-08-18 Thread Vrushali C (JIRA)
[ https://issues.apache.org/jira/browse/YARN-6179?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Vrushali C updated YARN-6179: - Parent Issue: YARN-7055 (was: YARN-5355) > Support for collapse filter for flow entities with in the

[jira] [Updated] (YARN-6736) Consider writing to both ats v1 & v2 from RM for smoother upgrades

2017-08-18 Thread Vrushali C (JIRA)
[ https://issues.apache.org/jira/browse/YARN-6736?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Vrushali C updated YARN-6736: - Parent Issue: YARN-7055 (was: YARN-5355) > Consider writing to both ats v1 & v2 from RM for smoother

[jira] [Updated] (YARN-6199) Support for listing flows with filter userid

2017-08-18 Thread Vrushali C (JIRA)
[ https://issues.apache.org/jira/browse/YARN-6199?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Vrushali C updated YARN-6199: - Parent Issue: YARN-7055 (was: YARN-5355) > Support for listing flows with filter userid >

[jira] [Updated] (YARN-7036) [ATSv2] : NPE for recovered finished applications in NM during upgrade

2017-08-18 Thread Vrushali C (JIRA)
[ https://issues.apache.org/jira/browse/YARN-7036?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Vrushali C updated YARN-7036: - Parent Issue: YARN-7055 (was: YARN-5355) > [ATSv2] : NPE for recovered finished applications in NM during

[jira] [Updated] (YARN-6767) Timeline client won't be able to write when TimelineCollector is not up yet, or NM is down

2017-08-18 Thread Vrushali C (JIRA)
[ https://issues.apache.org/jira/browse/YARN-6767?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Vrushali C updated YARN-6767: - Parent Issue: YARN-7055 (was: YARN-5355) > Timeline client won't be able to write when TimelineCollector

[jira] [Updated] (YARN-6931) Make the aggregation interval in AppLevelTimelineCollector configurable

2017-08-18 Thread Vrushali C (JIRA)
[ https://issues.apache.org/jira/browse/YARN-6931?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Vrushali C updated YARN-6931: - Parent Issue: YARN-7055 (was: YARN-5355) > Make the aggregation interval in AppLevelTimelineCollector

[jira] [Updated] (YARN-6904) [ATSv2] Fix findbugs warnings

2017-08-18 Thread Vrushali C (JIRA)
[ https://issues.apache.org/jira/browse/YARN-6904?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Vrushali C updated YARN-6904: - Parent Issue: YARN-7055 (was: YARN-5355) > [ATSv2] Fix findbugs warnings > -

[jira] [Updated] (YARN-6989) Ensure timeline service v2 codebase gets UGI from HttpServletRequest in a consistent way

2017-08-18 Thread Vrushali C (JIRA)
[ https://issues.apache.org/jira/browse/YARN-6989?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Vrushali C updated YARN-6989: - Parent Issue: YARN-7055 (was: YARN-5355) > Ensure timeline service v2 codebase gets UGI from

[jira] [Updated] (YARN-6070) Support substring match in filters

2017-08-18 Thread Vrushali C (JIRA)
[ https://issues.apache.org/jira/browse/YARN-6070?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Vrushali C updated YARN-6070: - Parent Issue: YARN-7055 (was: YARN-5355) > Support substring match in filters >

[jira] [Commented] (YARN-4239) Flow page for Web UI

2017-08-18 Thread Rohith Sharma K S (JIRA)
[ https://issues.apache.org/jira/browse/YARN-4239?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16133971#comment-16133971 ] Rohith Sharma K S commented on YARN-4239: - This issue can be closed since YARN UI is merged to

[jira] [Updated] (YARN-6095) create a REST API that returns the clusters for a given app id

2017-08-18 Thread Vrushali C (JIRA)
[ https://issues.apache.org/jira/browse/YARN-6095?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Vrushali C updated YARN-6095: - Parent Issue: YARN-7055 (was: YARN-5355) > create a REST API that returns the clusters for a given app id

[jira] [Updated] (YARN-6063) Inline java doc with Hadoop formatter

2017-08-18 Thread Vrushali C (JIRA)
[ https://issues.apache.org/jira/browse/YARN-6063?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Vrushali C updated YARN-6063: - Parent Issue: YARN-7055 (was: YARN-5355) > Inline java doc with Hadoop formatter >

[jira] [Updated] (YARN-6105) Support for new REST end point /clusterids

2017-08-18 Thread Vrushali C (JIRA)
[ https://issues.apache.org/jira/browse/YARN-6105?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Vrushali C updated YARN-6105: - Parent Issue: YARN-7055 (was: YARN-5355) > Support for new REST end point /clusterids >

[jira] [Updated] (YARN-6121) Launch app collectors for unmanaged AMs'

2017-08-18 Thread Vrushali C (JIRA)
[ https://issues.apache.org/jira/browse/YARN-6121?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Vrushali C updated YARN-6121: - Parent Issue: YARN-7055 (was: YARN-5355) > Launch app collectors for unmanaged AMs' >

[jira] [Updated] (YARN-5981) Coprocessor related code changes/cleanup pending HBASE-17273

2017-08-18 Thread Vrushali C (JIRA)
[ https://issues.apache.org/jira/browse/YARN-5981?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Vrushali C updated YARN-5981: - Parent Issue: YARN-7055 (was: YARN-5355) > Coprocessor related code changes/cleanup pending HBASE-17273 >

[jira] [Updated] (YARN-6047) Documentation updates for TimelineService v2

2017-08-18 Thread Vrushali C (JIRA)
[ https://issues.apache.org/jira/browse/YARN-6047?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Vrushali C updated YARN-6047: - Parent Issue: YARN-7055 (was: YARN-5355) > Documentation updates for TimelineService v2 >

[jira] [Updated] (YARN-5751) Support UNIT for TimelineMetric

2017-08-18 Thread Vrushali C (JIRA)
[ https://issues.apache.org/jira/browse/YARN-5751?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Vrushali C updated YARN-5751: - Parent Issue: YARN-7055 (was: YARN-5355) > Support UNIT for TimelineMetric >

[jira] [Updated] (YARN-5760) [ATSv2] Create HBase connection only if an app collector is publishing from NM

2017-08-18 Thread Vrushali C (JIRA)
[ https://issues.apache.org/jira/browse/YARN-5760?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Vrushali C updated YARN-5760: - Parent Issue: YARN-7055 (was: YARN-5355) > [ATSv2] Create HBase connection only if an app collector is

[jira] [Updated] (YARN-6058) Support for listing all applications i.e /apps

2017-08-18 Thread Vrushali C (JIRA)
[ https://issues.apache.org/jira/browse/YARN-6058?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Vrushali C updated YARN-6058: - Parent Issue: YARN-7055 (was: YARN-5355) > Support for listing all applications i.e /apps >

[jira] [Updated] (YARN-5681) Change collector discovery to support collectors mapped to clients but not applications

2017-08-18 Thread Vrushali C (JIRA)
[ https://issues.apache.org/jira/browse/YARN-5681?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Vrushali C updated YARN-5681: - Parent Issue: YARN-7055 (was: YARN-5355) > Change collector discovery to support collectors mapped to

[jira] [Updated] (YARN-5742) Serve aggregated logs of historical apps from timeline service

2017-08-18 Thread Vrushali C (JIRA)
[ https://issues.apache.org/jira/browse/YARN-5742?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Vrushali C updated YARN-5742: - Parent Issue: YARN-7055 (was: YARN-5355) > Serve aggregated logs of historical apps from timeline service

[jira] [Updated] (YARN-5358) Consider adding a config setting to accept cluster name

2017-08-18 Thread Vrushali C (JIRA)
[ https://issues.apache.org/jira/browse/YARN-5358?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Vrushali C updated YARN-5358: - Parent Issue: YARN-7055 (was: YARN-5355) > Consider adding a config setting to accept cluster name >

[jira] [Updated] (YARN-5626) Support long running apps handling multiple flows

2017-08-18 Thread Vrushali C (JIRA)
[ https://issues.apache.org/jira/browse/YARN-5626?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Vrushali C updated YARN-5626: - Parent Issue: YARN-7055 (was: YARN-5355) > Support long running apps handling multiple flows >

[jira] [Updated] (YARN-5627) [Atsv2] Support streaming reader API to fetch entities

2017-08-18 Thread Vrushali C (JIRA)
[ https://issues.apache.org/jira/browse/YARN-5627?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Vrushali C updated YARN-5627: - Parent Issue: YARN-7055 (was: YARN-5355) > [Atsv2] Support streaming reader API to fetch entities >

[jira] [Updated] (YARN-5357) Timeline service v2 integration with Federation

2017-08-18 Thread Vrushali C (JIRA)
[ https://issues.apache.org/jira/browse/YARN-5357?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Vrushali C updated YARN-5357: - Parent Issue: YARN-7055 (was: YARN-5355) > Timeline service v2 integration with Federation >

[jira] [Updated] (YARN-5260) Review / Recommendations for hbase writer code

2017-08-18 Thread Vrushali C (JIRA)
[ https://issues.apache.org/jira/browse/YARN-5260?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Vrushali C updated YARN-5260: - Parent Issue: YARN-7055 (was: YARN-5355) > Review / Recommendations for hbase writer code >

[jira] [Updated] (YARN-5071) address HBase compatibility issues with trunk

2017-08-18 Thread Vrushali C (JIRA)
[ https://issues.apache.org/jira/browse/YARN-5071?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Vrushali C updated YARN-5071: - Parent Issue: YARN-7055 (was: YARN-5355) > address HBase compatibility issues with trunk >

[jira] [Updated] (YARN-4821) Have a separate NM timeline publishing-interval

2017-08-18 Thread Vrushali C (JIRA)
[ https://issues.apache.org/jira/browse/YARN-4821?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Vrushali C updated YARN-4821: - Parent Issue: YARN-7055 (was: YARN-5355) > Have a separate NM timeline publishing-interval >

[jira] [Updated] (YARN-5011) Support metric filters for flow runs

2017-08-18 Thread Vrushali C (JIRA)
[ https://issues.apache.org/jira/browse/YARN-5011?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Vrushali C updated YARN-5011: - Parent Issue: YARN-7055 (was: YARN-5355) > Support metric filters for flow runs >

[jira] [Updated] (YARN-5094) some YARN container events have timestamp of -1

2017-08-18 Thread Vrushali C (JIRA)
[ https://issues.apache.org/jira/browse/YARN-5094?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Vrushali C updated YARN-5094: - Parent Issue: YARN-7055 (was: YARN-5355) > some YARN container events have timestamp of -1 >

[jira] [Updated] (YARN-4786) Enhance hbase coprocessor aggregation operations:GLOBAL_MIN, LATEST_MIN etc and FINAL attributes

2017-08-18 Thread Vrushali C (JIRA)
[ https://issues.apache.org/jira/browse/YARN-4786?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Vrushali C updated YARN-4786: - Parent Issue: YARN-7055 (was: YARN-5355) > Enhance hbase coprocessor aggregation operations:GLOBAL_MIN,

[jira] [Updated] (YARN-4736) Issues with HBaseTimelineWriterImpl in single node hadoop & hbase cluster

2017-08-18 Thread Vrushali C (JIRA)
[ https://issues.apache.org/jira/browse/YARN-4736?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Vrushali C updated YARN-4736: - Parent Issue: YARN-7055 (was: YARN-5355) > Issues with HBaseTimelineWriterImpl in single node hadoop &

[jira] [Updated] (YARN-4504) Retrospect on defaults for created time while querying

2017-08-18 Thread Vrushali C (JIRA)
[ https://issues.apache.org/jira/browse/YARN-4504?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Vrushali C updated YARN-4504: - Parent Issue: YARN-7055 (was: YARN-5355) > Retrospect on defaults for created time while querying >

[jira] [Updated] (YARN-4368) Support Multiple versions of the timeline service at the same time

2017-08-18 Thread Vrushali C (JIRA)
[ https://issues.apache.org/jira/browse/YARN-4368?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Vrushali C updated YARN-4368: - Parent Issue: YARN-7055 (was: YARN-5355) > Support Multiple versions of the timeline service at the same

[jira] [Updated] (YARN-4561) Compaction coprocessor enhancements: On/Off, whitelisting, blacklisting

2017-08-18 Thread Vrushali C (JIRA)
[ https://issues.apache.org/jira/browse/YARN-4561?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Vrushali C updated YARN-4561: - Parent Issue: YARN-7055 (was: YARN-5355) > Compaction coprocessor enhancements: On/Off, whitelisting,

[jira] [Updated] (YARN-4343) Need to support Application History Server on ATSV2

2017-08-18 Thread Vrushali C (JIRA)
[ https://issues.apache.org/jira/browse/YARN-4343?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Vrushali C updated YARN-4343: - Parent Issue: YARN-7055 (was: YARN-5355) > Need to support Application History Server on ATSV2 >

[jira] [Updated] (YARN-4489) Limit flow runs returned while querying flows

2017-08-18 Thread Vrushali C (JIRA)
[ https://issues.apache.org/jira/browse/YARN-4489?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Vrushali C updated YARN-4489: - Parent Issue: YARN-7055 (was: YARN-5355) > Limit flow runs returned while querying flows >

[jira] [Updated] (YARN-4239) Flow page for Web UI

2017-08-18 Thread Vrushali C (JIRA)
[ https://issues.apache.org/jira/browse/YARN-4239?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Vrushali C updated YARN-4239: - Parent Issue: YARN-7055 (was: YARN-5355) > Flow page for Web UI > > >

[jira] [Updated] (YARN-4116) refactor ColumnHelper read* methods

2017-08-18 Thread Vrushali C (JIRA)
[ https://issues.apache.org/jira/browse/YARN-4116?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Vrushali C updated YARN-4116: - Parent Issue: YARN-7055 (was: YARN-5355) > refactor ColumnHelper read* methods >

[jira] [Updated] (YARN-4261) fix the order of timelinereader in yarn/yarn.cmd

2017-08-18 Thread Vrushali C (JIRA)
[ https://issues.apache.org/jira/browse/YARN-4261?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Vrushali C updated YARN-4261: - Parent Issue: YARN-7055 (was: YARN-5355) > fix the order of timelinereader in yarn/yarn.cmd >

[jira] [Updated] (YARN-4173) Ensure the final values for metrics/events are emitted/stored at APP completion time

2017-08-18 Thread Vrushali C (JIRA)
[ https://issues.apache.org/jira/browse/YARN-4173?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Vrushali C updated YARN-4173: - Parent Issue: YARN-7055 (was: YARN-5355) > Ensure the final values for metrics/events are emitted/stored

[jira] [Updated] (YARN-4069) For long running apps (> 2 days), populate flow activity table

2017-08-18 Thread Vrushali C (JIRA)
[ https://issues.apache.org/jira/browse/YARN-4069?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Vrushali C updated YARN-4069: - Parent Issue: YARN-7055 (was: YARN-5355) > For long running apps (> 2 days), populate flow activity table

[jira] [Updated] (YARN-4061) [Fault tolerance] Fault tolerant writer for timeline v2

2017-08-18 Thread Vrushali C (JIRA)
[ https://issues.apache.org/jira/browse/YARN-4061?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Vrushali C updated YARN-4061: - Parent Issue: YARN-7055 (was: YARN-5355) > [Fault tolerance] Fault tolerant writer for timeline v2 >

[jira] [Updated] (YARN-3981) offline collector: support timeline clients not associated with an application

2017-08-18 Thread Vrushali C (JIRA)
[ https://issues.apache.org/jira/browse/YARN-3981?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Vrushali C updated YARN-3981: - Parent Issue: YARN-7055 (was: YARN-5355) > offline collector: support timeline clients not associated

[jira] [Updated] (YARN-3907) create the flow-version table

2017-08-18 Thread Vrushali C (JIRA)
[ https://issues.apache.org/jira/browse/YARN-3907?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Vrushali C updated YARN-3907: - Parent Issue: YARN-7055 (was: YARN-5355) > create the flow-version table > -

[jira] [Updated] (YARN-3895) Support ACLs in ATSv2

2017-08-18 Thread Vrushali C (JIRA)
[ https://issues.apache.org/jira/browse/YARN-3895?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Vrushali C updated YARN-3895: - Parent Issue: YARN-7055 (was: YARN-5355) > Support ACLs in ATSv2 > - > >

[jira] [Updated] (YARN-3881) Writing RM cluster-level metrics

2017-08-18 Thread Vrushali C (JIRA)
[ https://issues.apache.org/jira/browse/YARN-3881?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Vrushali C updated YARN-3881: - Parent Issue: YARN-7055 (was: YARN-5355) > Writing RM cluster-level metrics >

[jira] [Updated] (YARN-3880) Writing more RM side app-level metrics

2017-08-18 Thread Vrushali C (JIRA)
[ https://issues.apache.org/jira/browse/YARN-3880?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Vrushali C updated YARN-3880: - Parent Issue: YARN-7055 (was: YARN-5355) > Writing more RM side app-level metrics >

[jira] [Updated] (YARN-3879) [Storage implementation] Create HDFS backing storage implementation for ATS reads

2017-08-18 Thread Vrushali C (JIRA)
[ https://issues.apache.org/jira/browse/YARN-3879?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Vrushali C updated YARN-3879: - Parent Issue: YARN-7055 (was: YARN-5355) > [Storage implementation] Create HDFS backing storage

[jira] [Updated] (YARN-3874) Optimize and synchronize FS Reader and Writer Implementations

2017-08-18 Thread Vrushali C (JIRA)
[ https://issues.apache.org/jira/browse/YARN-3874?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Vrushali C updated YARN-3874: - Parent Issue: YARN-7055 (was: YARN-5355) > Optimize and synchronize FS Reader and Writer Implementations

[jira] [Updated] (YARN-3872) TimelineReader Web UI Implementation

2017-08-18 Thread Vrushali C (JIRA)
[ https://issues.apache.org/jira/browse/YARN-3872?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Vrushali C updated YARN-3872: - Parent Issue: YARN-7055 (was: YARN-5355) > TimelineReader Web UI Implementation >

[jira] [Updated] (YARN-3841) [Storage implementation] Adding retry semantics to HDFS backing storage

2017-08-18 Thread Vrushali C (JIRA)
[ https://issues.apache.org/jira/browse/YARN-3841?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Vrushali C updated YARN-3841: - Parent Issue: YARN-7055 (was: YARN-5355) > [Storage implementation] Adding retry semantics to HDFS

[jira] [Updated] (YARN-3865) Backward compatibility of reader with ATSv1

2017-08-18 Thread Vrushali C (JIRA)
[ https://issues.apache.org/jira/browse/YARN-3865?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Vrushali C updated YARN-3865: - Parent Issue: YARN-7055 (was: YARN-5355) > Backward compatibility of reader with ATSv1 >

[jira] [Updated] (YARN-3822) Scalability validation of RM writing app/attempt/container lifecycle events

2017-08-18 Thread Vrushali C (JIRA)
[ https://issues.apache.org/jira/browse/YARN-3822?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Vrushali C updated YARN-3822: - Parent Issue: YARN-7055 (was: YARN-5355) > Scalability validation of RM writing app/attempt/container

[jira] [Updated] (YARN-3818) [Aggregation] Queue-level Aggregation on Application States table

2017-08-18 Thread Vrushali C (JIRA)
[ https://issues.apache.org/jira/browse/YARN-3818?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Vrushali C updated YARN-3818: - Parent Issue: YARN-7055 (was: YARN-5355) > [Aggregation] Queue-level Aggregation on Application States

[jira] [Updated] (YARN-3817) [Aggregation] Flow and User level aggregation on Application States table

2017-08-18 Thread Vrushali C (JIRA)
[ https://issues.apache.org/jira/browse/YARN-3817?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Vrushali C updated YARN-3817: - Parent Issue: YARN-7055 (was: YARN-5355) > [Aggregation] Flow and User level aggregation on Application

[jira] [Updated] (YARN-3815) [Aggregation] Application/Flow/User/Queue Level Aggregations

2017-08-18 Thread Vrushali C (JIRA)
[ https://issues.apache.org/jira/browse/YARN-3815?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Vrushali C updated YARN-3815: - Parent Issue: YARN-7055 (was: YARN-5355) > [Aggregation] Application/Flow/User/Queue Level Aggregations >

[jira] [Updated] (YARN-3650) Consider concurrency situations for TimelineWriter

2017-08-18 Thread Vrushali C (JIRA)
[ https://issues.apache.org/jira/browse/YARN-3650?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Vrushali C updated YARN-3650: - Parent Issue: YARN-7055 (was: YARN-5355) > Consider concurrency situations for TimelineWriter >

[jira] [Updated] (YARN-3741) consider nulling member maps/sets of TimelineEntity

2017-08-18 Thread Vrushali C (JIRA)
[ https://issues.apache.org/jira/browse/YARN-3741?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Vrushali C updated YARN-3741: - Parent Issue: YARN-7055 (was: YARN-5355) > consider nulling member maps/sets of TimelineEntity >

[jira] [Updated] (YARN-3616) determine how to generate YARN container events

2017-08-18 Thread Vrushali C (JIRA)
[ https://issues.apache.org/jira/browse/YARN-3616?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Vrushali C updated YARN-3616: - Parent Issue: YARN-7055 (was: YARN-5355) > determine how to generate YARN container events >

[jira] [Updated] (YARN-3588) Timeline entity uniqueness

2017-08-18 Thread Vrushali C (JIRA)
[ https://issues.apache.org/jira/browse/YARN-3588?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Vrushali C updated YARN-3588: - Parent Issue: YARN-7055 (was: YARN-5355) > Timeline entity uniqueness > -- > >

[jira] [Updated] (YARN-3622) Enable application client to communicate with new timeline service

2017-08-18 Thread Vrushali C (JIRA)
[ https://issues.apache.org/jira/browse/YARN-3622?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Vrushali C updated YARN-3622: - Parent Issue: YARN-7055 (was: YARN-5355) > Enable application client to communicate with new timeline

[jira] [Assigned] (YARN-6766) *AppsBlock classes need a printOrNA() helper method

2017-08-18 Thread Daniel Templeton (JIRA)
[ https://issues.apache.org/jira/browse/YARN-6766?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Daniel Templeton reassigned YARN-6766: -- Assignee: HondaWei > *AppsBlock classes need a printOrNA() helper method >

[jira] [Updated] (YARN-3509) CollectorNodemanagerProtocol's authorization doesn't work

2017-08-18 Thread Vrushali C (JIRA)
[ https://issues.apache.org/jira/browse/YARN-3509?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Vrushali C updated YARN-3509: - Parent Issue: YARN-7055 (was: YARN-5355) > CollectorNodemanagerProtocol's authorization doesn't work >

[jira] [Updated] (YARN-3488) AM get timeline service info from RM rather than Application specific configuration.

2017-08-18 Thread Vrushali C (JIRA)
[ https://issues.apache.org/jira/browse/YARN-3488?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Vrushali C updated YARN-3488: - Parent Issue: YARN-7055 (was: YARN-5355) > AM get timeline service info from RM rather than Application

[jira] [Updated] (YARN-3545) Investigate the concurrency issue with the map of timeline collector

2017-08-18 Thread Vrushali C (JIRA)
[ https://issues.apache.org/jira/browse/YARN-3545?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Vrushali C updated YARN-3545: - Parent Issue: YARN-7055 (was: YARN-5355) > Investigate the concurrency issue with the map of timeline

[jira] [Updated] (YARN-3352) [Event producers] Change distributed shell to use TIMELINE_SERVICE_VERSION

2017-08-18 Thread Vrushali C (JIRA)
[ https://issues.apache.org/jira/browse/YARN-3352?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Vrushali C updated YARN-3352: - Parent Issue: YARN-7055 (was: YARN-5355) > [Event producers] Change distributed shell to use

[jira] [Updated] (YARN-3166) [Source organization] Decide detailed package structures for timeline service v2 components

2017-08-18 Thread Vrushali C (JIRA)
[ https://issues.apache.org/jira/browse/YARN-3166?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Vrushali C updated YARN-3166: - Parent Issue: YARN-7055 (was: YARN-5355) > [Source organization] Decide detailed package structures for

[jira] [Updated] (YARN-3401) [Security] users should not be able to create a generic TimelineEntity and associate arbitrary type

2017-08-18 Thread Vrushali C (JIRA)
[ https://issues.apache.org/jira/browse/YARN-3401?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Vrushali C updated YARN-3401: - Parent Issue: YARN-7055 (was: YARN-5355) > [Security] users should not be able to create a generic

[jira] [Updated] (YARN-3353) provide RPC metrics via JMX for timeline collectors and readers

2017-08-18 Thread Vrushali C (JIRA)
[ https://issues.apache.org/jira/browse/YARN-3353?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Vrushali C updated YARN-3353: - Parent Issue: YARN-7055 (was: YARN-5355) > provide RPC metrics via JMX for timeline collectors and

[jira] [Updated] (YARN-3196) [Compatibility] Make TS next gen be compatible with the current TS

2017-08-18 Thread Vrushali C (JIRA)
[ https://issues.apache.org/jira/browse/YARN-3196?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Vrushali C updated YARN-3196: - Parent Issue: YARN-7055 (was: YARN-5355) > [Compatibility] Make TS next gen be compatible with the

[jira] [Commented] (YARN-7041) Nodemanager NPE running jobs with security off

2017-08-18 Thread Rohith Sharma K S (JIRA)
[ https://issues.apache.org/jira/browse/YARN-7041?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16133965#comment-16133965 ] Rohith Sharma K S commented on YARN-7041: - committing shorly > Nodemanager NPE running jobs with

[jira] [Updated] (YARN-3118) [Data Serving] Clustering of ATS reader instances

2017-08-18 Thread Vrushali C (JIRA)
[ https://issues.apache.org/jira/browse/YARN-3118?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Vrushali C updated YARN-3118: - Parent Issue: YARN-7055 (was: YARN-5355) > [Data Serving] Clustering of ATS reader instances >

[jira] [Updated] (YARN-3032) [Collector implementation] Implement timeline collector functionality to serve ATS readers' requests for live apps

2017-08-18 Thread Vrushali C (JIRA)
[ https://issues.apache.org/jira/browse/YARN-3032?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Vrushali C updated YARN-3032: - Parent Issue: YARN-7055 (was: YARN-5355) > [Collector implementation] Implement timeline collector

[jira] [Updated] (YARN-3033) [Collector wireup] Implement NM starting the standalone timeline collector daemon

2017-08-18 Thread Vrushali C (JIRA)
[ https://issues.apache.org/jira/browse/YARN-3033?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Vrushali C updated YARN-3033: - Parent Issue: YARN-7055 (was: YARN-5355) > [Collector wireup] Implement NM starting the standalone

[jira] [Updated] (YARN-3115) [Collector wireup] Work-preserving restarting of per-node timeline collector

2017-08-18 Thread Vrushali C (JIRA)
[ https://issues.apache.org/jira/browse/YARN-3115?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Vrushali C updated YARN-3115: - Parent Issue: YARN-7055 (was: YARN-5355) > [Collector wireup] Work-preserving restarting of per-node

[jira] [Updated] (YARN-3038) [Collector wireup] Handle timeline collector failure scenarios

2017-08-18 Thread Vrushali C (JIRA)
[ https://issues.apache.org/jira/browse/YARN-3038?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Vrushali C updated YARN-3038: - Parent Issue: YARN-7055 (was: YARN-5355) > [Collector wireup] Handle timeline collector failure scenarios

[jira] [Updated] (YARN-5269) Bubble exceptions and errors all the way up the calls, including to clients.

2017-08-18 Thread Vrushali C (JIRA)
[ https://issues.apache.org/jira/browse/YARN-5269?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Vrushali C updated YARN-5269: - Parent Issue: YARN-7055 (was: YARN-5355) > Bubble exceptions and errors all the way up the calls,

[jira] [Updated] (YARN-5281) Explore supporting a simpler back-end implementation for ATS v2

2017-08-18 Thread Vrushali C (JIRA)
[ https://issues.apache.org/jira/browse/YARN-5281?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Vrushali C updated YARN-5281: - Parent Issue: YARN-7055 (was: YARN-5355) > Explore supporting a simpler back-end implementation for ATS

[jira] [Updated] (YARN-5304) Ship single node HBase config option with single startup command

2017-08-18 Thread Vrushali C (JIRA)
[ https://issues.apache.org/jira/browse/YARN-5304?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Vrushali C updated YARN-5304: - Parent Issue: YARN-7055 (was: YARN-5355) > Ship single node HBase config option with single startup

[jira] [Updated] (YARN-5336) Put in some limit for accepting key-values in hbase writer

2017-08-18 Thread Vrushali C (JIRA)
[ https://issues.apache.org/jira/browse/YARN-5336?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Vrushali C updated YARN-5336: - Parent Issue: YARN-7055 (was: YARN-5355) > Put in some limit for accepting key-values in hbase writer >

[jira] [Created] (YARN-7055) YARN Timeline Service v.2: beta 1

2017-08-18 Thread Vrushali C (JIRA)
Vrushali C created YARN-7055: Summary: YARN Timeline Service v.2: beta 1 Key: YARN-7055 URL: https://issues.apache.org/jira/browse/YARN-7055 Project: Hadoop YARN Issue Type: New Feature

[jira] [Created] (YARN-7054) Yarn Native Service Phase 2

2017-08-18 Thread Jian He (JIRA)
Jian He created YARN-7054: - Summary: Yarn Native Service Phase 2 Key: YARN-7054 URL: https://issues.apache.org/jira/browse/YARN-7054 Project: Hadoop YARN Issue Type: New Feature

[jira] [Updated] (YARN-7050) Post cleanup after YARN-6903

2017-08-18 Thread Jian He (JIRA)
[ https://issues.apache.org/jira/browse/YARN-7050?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Jian He updated YARN-7050: -- Attachment: YARN-7050.yarn-native-services.03.patch > Post cleanup after YARN-6903 >

[jira] [Commented] (YARN-6885) AllocationFileLoaderService.loadQueue() should use a switch statement in the main tag parsing loop instead of the if/else-if/...

2017-08-18 Thread Hadoop QA (JIRA)
[ https://issues.apache.org/jira/browse/YARN-6885?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16133960#comment-16133960 ] Hadoop QA commented on YARN-6885: - | (x) *{color:red}-1 overall{color}* | \\ \\ || Vote || Subsystem ||

[jira] [Commented] (YARN-6766) *AppsBlock classes need a printOrNA() helper method

2017-08-18 Thread HondaWei (JIRA)
[ https://issues.apache.org/jira/browse/YARN-6766?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16133958#comment-16133958 ] HondaWei commented on YARN-6766: Hi Daniel , I would like to take this task, thank you very much! >

[jira] [Updated] (YARN-6134) [ATSv2 Security] Regenerate delegation token for app just before token expires if app collector is active

2017-08-18 Thread Varun Saxena (JIRA)
[ https://issues.apache.org/jira/browse/YARN-6134?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Varun Saxena updated YARN-6134: --- Attachment: YARN-6134-YARN-5355.04.patch Updated the patch. Now caching the renewer too and avoiding

[jira] [Commented] (YARN-6861) Reader API for sub application entities

2017-08-18 Thread Vrushali C (JIRA)
[ https://issues.apache.org/jira/browse/YARN-6861?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16133955#comment-16133955 ] Vrushali C commented on YARN-6861: -- Thanks [~rohithsharma], new jira for hbase logging seems good to me.

[jira] [Commented] (YARN-6134) [ATSv2 Security] Regenerate delegation token for app just before token expires if app collector is active

2017-08-18 Thread Varun Saxena (JIRA)
[ https://issues.apache.org/jira/browse/YARN-6134?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16133951#comment-16133951 ] Varun Saxena commented on YARN-6134: True. Missed this invocation. Let me update the patch. We can

[jira] [Commented] (YARN-6134) [ATSv2 Security] Regenerate delegation token for app just before token expires if app collector is active

2017-08-18 Thread Jian He (JIRA)
[ https://issues.apache.org/jira/browse/YARN-6134?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16133950#comment-16133950 ] Jian He commented on YARN-6134: --- But, the code here is already doing the decodeIdentifier every time for the

[jira] [Commented] (YARN-6886) AllocationFileLoaderService.loadQueue() should validate that setting do not conflict with parent

2017-08-18 Thread Ashutosh Dubey (JIRA)
[ https://issues.apache.org/jira/browse/YARN-6886?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16133940#comment-16133940 ] Ashutosh Dubey commented on YARN-6886: -- Hi [~templedf] I am interested in taking up this task.

[jira] [Commented] (YARN-6134) [ATSv2 Security] Regenerate delegation token for app just before token expires if app collector is active

2017-08-18 Thread Varun Saxena (JIRA)
[ https://issues.apache.org/jira/browse/YARN-6134?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16133938#comment-16133938 ] Varun Saxena commented on YARN-6134: bq. looks like tokenMaxDate is not needed as it can be got from

[jira] [Updated] (YARN-6885) AllocationFileLoaderService.loadQueue() should use a switch statement in the main tag parsing loop instead of the if/else-if/...

2017-08-18 Thread Yu-Tang Lin (JIRA)
[ https://issues.apache.org/jira/browse/YARN-6885?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Yu-Tang Lin updated YARN-6885: -- Attachment: YARN-6885.008.patch > AllocationFileLoaderService.loadQueue() should use a switch statement

[jira] [Commented] (YARN-6969) Clean up unused code in class FairSchedulerQueueInfo

2017-08-18 Thread Larry Lo (JIRA)
[ https://issues.apache.org/jira/browse/YARN-6969?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16133931#comment-16133931 ] Larry Lo commented on YARN-6969: Thanks for your help! [~yufeigu] > Clean up unused code in class

  1   2   3   >