HeartSaVIoR
This is different than STORM-1994. By the way added some screenshots there to
clarify.
I agree it would be good to reorganize the statistics shown in the UI. Perhaps
having two parts to this, one goes to a dashboard like Grafana, while the
simpler metrics (snapshots, or aggregations) go to the regular Storm UI. The
reason for some of them going to the Storm UI is that I think that having some
stats next to the place where actions can be performed on a topology is
beneficial (as they currently are).
With regards to Jerry's suggestion, we tried a simple test using MySQL just as
a PoC and c3/d3 as the charting library. The choices were made purely because
we wanted to see the charts quickly, so not suggesting we use MySQL for time
series data. We know probably storing in Druid or another time series database
would be ideal, but harder to set up. Here is a screenshot showing average user
cpu time (ms) per minute for each worker:
We could probably then turn around and request data from Druid (or more
generally, the "metrics store") and show in the Storm UI. Additionally, Grafana
looks like it can read from Druid, so folks could use that as a front end for
detailed dashboards. That said, perhaps some version of this in the Topology
page at a coarser resolution would be beneficial for a quick glimpse, linking
to the detailed dashboard.
Thanks,
Alessandro
On Sunday, July 31, 2016 1:23 AM, Jungtaek Lim <[email protected]> wrote:
Hi Boyang,
AFAIK, there's no discussion on Storm UI yet. Could you share your sketched
UI for this?
And is it on top of STORM-1994
<https://issues.apache.org/jira/browse/STORM-1994>? I mean what Alessandro
submitted.
A random thought from myself is that we shows too many numbers even
topology info page, which is not intuitive at a glance. It might be better
to show them to graph or at least more abstracted from overview page, and
show details on other pages. (component detail page, or another)
It might be also better to show graph of values for time-series manner (I
think dashboard like Grafana is the best way to show numbers as intuitive
way), but it requires metrics to be stored and served to time-series
manner, so it's not a near-future goal.
Thanks,
Jungtaek Lim (HeartSaVIoR)
2016년 7월 30일 (토) 오전 12:19, Boyang(Jerry) Peng
<[email protected]>님이 작성:
> Hello Everyone,
> I would like to make enhancements on the UI by adding dynamic graphs to
> display stats of a topology. For example, it would be nice to see
> performance and resource usage metrics be displayed in a graph on a per
> worker basis. I know JStorm's UI has graphs but I am not sure to what
> kind. What are our plans to improve storm UI? What portions of JStorm's
> UI might we use?
> Best,
> Jerry
