[
https://issues.apache.org/jira/browse/TEZ-4326?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
László Bodor updated TEZ-4326:
------------------------------
Description:
The proposal is to make TezUI run standalone in a sense that it can run
regardless of Yarn / ATS. Currently, I'm working on a yarnless setup, and I'm
wondering if we can simply use TezUI as a frontend for history logging files.
I'm assuming that without ATS, we won't be able to see live data, but that's
not an issue, in this mode, we should expect only historical data.
Configuration should be as simple as an HDFS folder containing history log
files.
Possible ways:
1. Change TezUI to query a specific service, that can work from simple/protobuf
history logging files
2. Convert history/protobuf files to ATS zip files transparently in the
background and run a mock ats to serve those
was:The proposal is to make TezUI run standalone in a sense that it can run
regardless of Yarn / ATS. Currently, I'm working on a yarnless setup, and I'm
wondering if we can simply use TezUI as a frontend for history logging files.
I'm assuming that without ATS, we won't be able to see live data, but that's
not an issue, in this mode, we should expect only historical data.
Configuration should be as simple as an HDFS folder containing history log
files.
> Integrate TezUI with protobuf (and simple) history logging files for
> inspecting historical data
> -----------------------------------------------------------------------------------------------
>
> Key: TEZ-4326
> URL: https://issues.apache.org/jira/browse/TEZ-4326
> Project: Apache Tez
> Issue Type: Improvement
> Reporter: László Bodor
> Priority: Major
>
> The proposal is to make TezUI run standalone in a sense that it can run
> regardless of Yarn / ATS. Currently, I'm working on a yarnless setup, and I'm
> wondering if we can simply use TezUI as a frontend for history logging files.
> I'm assuming that without ATS, we won't be able to see live data, but that's
> not an issue, in this mode, we should expect only historical data.
> Configuration should be as simple as an HDFS folder containing history log
> files.
> Possible ways:
> 1. Change TezUI to query a specific service, that can work from
> simple/protobuf history logging files
> 2. Convert history/protobuf files to ATS zip files transparently in the
> background and run a mock ats to serve those
--
This message was sent by Atlassian Jira
(v8.3.4#803005)
