GitHub user zhuoliu opened a pull request:
https://github.com/apache/storm/pull/848
[STORM-902] Simple Log Search
This feature is aimed for greatly improving the debugging of Storm.
Simple Log Search supports following important functionalities:
1. String search:
In UI, user can search certain string, e.g., "Exception", in for a certain
worker log.
This search can happen for both normal text log or rolled zip log files. In
addition, user can specify the number of matches to show in the search result.
2. Deep search:
User can search for a string for a certain topology, which means the UI
will try to search on all the supervisor nodes in a distributed way to find the
matched string in all logs for this topology.
Then the matched results can be shown on the UI with url links, directing
user to the certain logs on each supervisor node. This powerful feature is very
helpful for users to find certain problematic supervisor nodes running this
topology.
Also, the topology history REST API is added to give hints for the
previously launched topology IDs for a certain user. And the html files, images
files, js file, test resource files and unit tests are added for log search and
its tests.
You can merge this pull request into a Git repository by running:
$ git pull https://github.com/zhuoliu/storm 902
Alternatively you can review and apply these changes as the patch at:
https://github.com/apache/storm/pull/848.patch
To close this pull request, make a commit to your master/trunk branch
with (at least) the following in the commit message:
This closes #848
----
commit 20db09cc5da62bd1b13e8c563e55f9e8e5103a4a
Author: zhuol <[email protected]>
Date: 2015-10-30T19:35:32Z
[YSTORM-902] log search, init commit
commit ad64c5d94607ebaa696171c2f67cf7d3a621f5a1
Author: zhuol <[email protected]>
Date: 2015-11-02T02:06:00Z
Continue on logviewer search
commit 04577758baee3258d2be4401f009e95658a17405
Author: zhuol <[email protected]>
Date: 2015-11-02T02:14:48Z
lv compile passed, to do html and then manual test, unit test
commit 13194c612eb55a4d4254860172139878e46dee67
Author: zhuol <[email protected]>
Date: 2015-11-02T03:03:33Z
Add html image files
commit dfb5e90852e221af6027df35d61c0951a6973ecc
Author: zhuol <[email protected]>
Date: 2015-11-02T19:41:21Z
Now able to search, except the magnifying lens stuff (related to topo
history)
commit ca24ea096adc37375e83febb105df5532a720d17
Author: zhuol <[email protected]>
Date: 2015-11-02T19:58:38Z
Support TopologyHistory (just a couple of topoId for a user)
commit 4d1acbf7fb60d7a09fbb861fd5ef309638eca864
Author: zhuol <[email protected]>
Date: 2015-11-02T23:31:37Z
Debug, thrift, topo history, now working well for deep search.
commit 90ef371aadc14585f6db785fc0058f0790136eb6
Author: zhuol <[email protected]>
Date: 2015-11-03T16:52:26Z
Unit test and add related resurces files
----
---
If your project is set up for it, you can reply to this email and have your
reply appear on GitHub as well. If your project does not have this feature
enabled and wishes so, or if the feature is enabled but not working, please
contact infrastructure at [email protected] or file a JIRA ticket
with INFRA.
---
