Dear community,
The following is what I've done so far.
The functional system for the Web API, email extractor and data verifier
are setup on the server with the ip address 88.198.223.105 which is
hosted by Spacerich.
1. Web API :
There is an instance of mediawiki running there with the api.php
accepting requests for the file submission. A file is created in the
queue folder as per the content posted.
The parameters required to make the call are as follows:
'action' : 'benchmark',
'filename' : <just-the-filename>
'content' : <content-of-benchmark.log-file>,
'format' : <xml/json/yaml/dump/txt/..>
2. IMAP attachments :
A cron file is setup to get the attachments from the mail server. The
script has been configured to get the data as attachments from the mail
id benchmark.performance.datab...@gmail.com to which users/devs could
submit their log files. Tom had posted his log file to that mail id.
3. Verifier :
This runs to check the data integrity of the transferred files. These
checks are logged to the database as well.
4. Parser :
This is scheduled via cron to move the files from the queue folder to
the database. The script process_from_queue.py goes through each of the
files from the queue, parses the neccessary content, adds it to the
database tables benchmark_logs, machine_info and md5_log and moves the
file from the queue folder to the archive.
5. Logs :
All the activities are being logged into a log file with great detail.
The file location is ~/benchmark/log/benchmark.log
6. Cron :
*/15 * * * * (cd ~/benchmark/scripts/ && python
get_email_attachments.py) >> ~/benchmark/log/cron.log
*/45 * * * * (cd ~/benchmark/scripts/ && python email_verifier.py) >>
~/benchmark/log/cron.log
*/30 * * * * (cd ~/benchmark/scripts/ && python process_from_queue.py)
>> ~/benchmark/log/cron.log
7. Database :
Schema is subject to expansion based on the needs of the frontend.
The following things lie ahead which basically pertain to the frontend.
1. Upload form to upload the log file.
2. Design of the forms to retrieve data and see if the db schema change
is needed.
3. Inclusion of Charts so as to display the results.
4. Integrate the flow.
5. Complete documentation and bug fixes.
Thanks,
--
Regards,
Suryajith Chillara.
------------------------------------------------------------------------------
Live Security Virtual Conference
Exclusive live event will cover all the ways today's security and
threat landscape has changed and how IT managers can respond. Discussions
will include endpoint security, mobile security and the latest in malware
threats. http://www.accelacomm.com/jaw/sfrnl04242012/114/50122263/
_______________________________________________
BRL-CAD Developer mailing list
brlcad-devel@lists.sourceforge.net
https://lists.sourceforge.net/lists/listinfo/brlcad-devel
