[jira] [Closed] (IOTDB-199) A simple tool to visualize logs
[ https://issues.apache.org/jira/browse/IOTDB-199?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] xiangdong Huang closed IOTDB-199. - Resolution: Fixed > A simple tool to visualize logs > --- > > Key: IOTDB-199 > URL: https://issues.apache.org/jira/browse/IOTDB-199 > Project: Apache IoTDB > Issue Type: New Feature >Reporter: Tian Jiang >Priority: Minor > Labels: pull-request-available > Attachments: IoTDBRuntimReport.zip > > Time Spent: 10m > Remaining Estimate: 0h > > Usually, the very first thing we will do on finding a bug is to search the > logs. Logs play a vital role in debugging especially in some environment that > attaching a debugger is impossible. In such circumstance, logs will hopefully > become the only information sources for the developers. > > However, a single log, which is just a string, is easy to understand. But > when it comes to mining information from thousands of logs or even more, > getting lost is nearly unavoidable, since humans have a much limited memory > for exact truth compared to computers. From time to time, I forget what I > have read before and I must go back to review the previous logs, as a result, > progress is made very slowly. Reading several strings is easy, but when we > have thousands, there must be some better way to present them than raw text. > > So, I keep thinking it would be much better if we can make the logs into > plots. Of course there must some existing tools, but they are often powerful > but too heavy (like Kibana) , or specialized for web or other logs (like > LogStalgia). Having a fantastic web interface is great, but a simple but > handy suit us better. What I want is something light-weighted, stand-alone > and highly customized. > > As a result, I developed a simple tool that can visualize (plot) logs > generated by IoTDB (with some modification, it can be applied to other type > of logs, too) and generate report. I designed a simple GUI which provides > full functionalities and a command line tool to fast generate reports. The > attachment contains an example report I generated from one of my experiments, > which reveal interesting things like how the size of memtables converges over > time. > > I may have missed some tools that are more powerful or easier to use. If you > know any, please inform me and I shall see what I can learn from them. -- This message was sent by Atlassian Jira (v8.3.4#803005)
Re: A simple tool to visualize logs
Hi, This feature is available on https://github.com/apache/incubator-iotdb/pull/370, please have a look if you have some time to spare. Thanks a lot. Tian Jiang | | Tian Jiang | | jt2594...@163.com | 签名由网易邮箱大师定制 On 9/9/2019 00:41，Julian Feinauer wrote： Hi, I definetly need that (to adopt to our stuff!) Julian Am 08.09.19, 09:13 schrieb "Xiangdong Huang" : Hi, Sounds COOOL! Analyzing system log is one of the most thing for a complex system (especially for distributed system). Will try this feature ASAP :D Best, --- Xiangdong Huang School of Software, Tsinghua University 黄向东 清华大学 软件学院 Tian Jiang 于2019年9月4日周三 下午7:59写道： Greetings, Usually, the very first thing we will do on finding a bug is to search the logs. Logs play a vital role in debugging especially in some environment that attaching a debugger is impossible. In such circumstance, logs will hopefully become the only information sources for the developers. However, a single log, which is just a string, is easy to understand. But when it comes to mining information from thousands of logs or even more, getting lost is nearly unavoidable, since humans have a much limited memory for exact truth compared to computers. From time to time, I forget what I have read before and I must go back to review the previous logs, as a result, progress is made very slowly. Reading several strings is easy, but when we have thousands, there must be some better way to present them than raw text. So, I keep thinking it would be much better if we can make the logs into plots. Of course there must some existing tools, but they are often powerful but too heavy (like Kibana) , or specialized for web or other logs (like LogStalgia). Having a fantastic web interface is great, but a simple but handy suit us better. What I want is something light-weighted, stand-alone and highly customized. As a result, I developed a simple tool that can visualize (plot) logs generated by IoTDB (with some modification, it can be applied to other type of logs, too) and generate report. I designed a simple GUI which provides full functionalities and a command line tool to fast generate reports. The attachment contains an example report I generated from one of my experiments, which reveal interesting things like how the size of memtables converges over time. I may have missed some tools that are more powerful or easier to use. If you know any, please inform me and I shall see what I can learn from them. | | Tian Jiang | | jt2594...@163.com | 签名由网易邮箱大师定制
Re: A simple tool to visualize logs
Hi, I definetly need that (to adopt to our stuff!) Julian Am 08.09.19, 09:13 schrieb "Xiangdong Huang" : Hi, Sounds COOOL! Analyzing system log is one of the most thing for a complex system (especially for distributed system). Will try this feature ASAP :D Best, --- Xiangdong Huang School of Software, Tsinghua University 黄向东 清华大学 软件学院 Tian Jiang 于2019年9月4日周三 下午7:59写道： > Greetings, > > > > > Usually, the very first thing we will do on finding a bug is to search the > logs. Logs play a vital role in debugging especially in some environment > that attaching a debugger is impossible. In such circumstance, logs will > hopefully become the only information sources for the developers. > > > > However, a single log, which is just a string, is easy to understand. But > when it comes to mining information from thousands of logs or even more, > getting lost is nearly unavoidable, since humans have a much limited memory > for exact truth compared to computers. From time to time, I forget what I > have read before and I must go back to review the previous logs, as a > result, progress is made very slowly. Reading several strings is easy, but > when we have thousands, there must be some better way to present them than > raw text. > > > > So, I keep thinking it would be much better if we can make the logs into > plots. Of course there must some existing tools, but they are often > powerful but too heavy (like Kibana) , or specialized for web or other logs > (like LogStalgia). Having a fantastic web interface is great, but a simple > but handy suit us better. What I want is something light-weighted, > stand-alone and highly customized. > > > > As a result, I developed a simple tool that can visualize (plot) logs > generated by IoTDB (with some modification, it can be applied to other type > of logs, too) and generate report. I designed a simple GUI which provides > full functionalities and a command line tool to fast generate reports. The > attachment contains an example report I generated from one of my > experiments, which reveal interesting things like how the size of memtables > converges over time. > > > > I may have missed some tools that are more powerful or easier to use. If > you know any, please inform me and I shall see what I can learn from them. > > > > | | > Tian Jiang > | > | > jt2594...@163.com > | > 签名由网易邮箱大师定制
Re: A simple tool to visualize logs
Hi, Sounds COOOL! Analyzing system log is one of the most thing for a complex system (especially for distributed system). Will try this feature ASAP :D Best, --- Xiangdong Huang School of Software, Tsinghua University 黄向东 清华大学 软件学院 Tian Jiang 于2019年9月4日周三 下午7:59写道： > Greetings, > > > > > Usually, the very first thing we will do on finding a bug is to search the > logs. Logs play a vital role in debugging especially in some environment > that attaching a debugger is impossible. In such circumstance, logs will > hopefully become the only information sources for the developers. > > > > However, a single log, which is just a string, is easy to understand. But > when it comes to mining information from thousands of logs or even more, > getting lost is nearly unavoidable, since humans have a much limited memory > for exact truth compared to computers. From time to time, I forget what I > have read before and I must go back to review the previous logs, as a > result, progress is made very slowly. Reading several strings is easy, but > when we have thousands, there must be some better way to present them than > raw text. > > > > So, I keep thinking it would be much better if we can make the logs into > plots. Of course there must some existing tools, but they are often > powerful but too heavy (like Kibana) , or specialized for web or other logs > (like LogStalgia). Having a fantastic web interface is great, but a simple > but handy suit us better. What I want is something light-weighted, > stand-alone and highly customized. > > > > As a result, I developed a simple tool that can visualize (plot) logs > generated by IoTDB (with some modification, it can be applied to other type > of logs, too) and generate report. I designed a simple GUI which provides > full functionalities and a command line tool to fast generate reports. The > attachment contains an example report I generated from one of my > experiments, which reveal interesting things like how the size of memtables > converges over time. > > > > I may have missed some tools that are more powerful or easier to use. If > you know any, please inform me and I shall see what I can learn from them. > > > > | | > Tian Jiang > | > | > jt2594...@163.com > | > 签名由网易邮箱大师定制
A simple tool to visualize logs
Greetings, Usually, the very first thing we will do on finding a bug is to search the logs. Logs play a vital role in debugging especially in some environment that attaching a debugger is impossible. In such circumstance, logs will hopefully become the only information sources for the developers. However, a single log, which is just a string, is easy to understand. But when it comes to mining information from thousands of logs or even more, getting lost is nearly unavoidable, since humans have a much limited memory for exact truth compared to computers. From time to time, I forget what I have read before and I must go back to review the previous logs, as a result, progress is made very slowly. Reading several strings is easy, but when we have thousands, there must be some better way to present them than raw text. So, I keep thinking it would be much better if we can make the logs into plots. Of course there must some existing tools, but they are often powerful but too heavy (like Kibana) , or specialized for web or other logs (like LogStalgia). Having a fantastic web interface is great, but a simple but handy suit us better. What I want is something light-weighted, stand-alone and highly customized. As a result, I developed a simple tool that can visualize (plot) logs generated by IoTDB (with some modification, it can be applied to other type of logs, too) and generate report. I designed a simple GUI which provides full functionalities and a command line tool to fast generate reports. The attachment contains an example report I generated from one of my experiments, which reveal interesting things like how the size of memtables converges over time. I may have missed some tools that are more powerful or easier to use. If you know any, please inform me and I shall see what I can learn from them. | | Tian Jiang | | jt2594...@163.com | 签名由网易邮箱大师定制
