Hi Zubair,
On May 26, 2011, at 3:46 AM, Zhongjie Wang wrote:
> Hi guys. :)
> I've made some changes to the proto file, and now it's more extendable.
> You may view the proto file here:
>
> http://dev.umitproject.org/projects/desktop-agent/repository/revisions/master/entry/report.proto
>
> The agent will always send a ICMReport message each time.
> And it may contain a bunch of test results, website results, service results,
> etc.
> Becuase the agent will test many websites and services in a period of time,
> and all the results will be sent by one report message.
>
> Here's a example of ICMReport message:
>
> reportID: 89734
> senderID: 10000
> timestamp: 1306391787312
> testID: 100
> passedNode: "219.223.222.99:6060"
> passedNode: "219.223.192.198:6060"
> websiteReport {
> websiteURL: "http://www.baidu.com";
> statusCode: 200
> }
> websiteReport {
> websiteURL: "https://www.alipay.com";
> statusCode: 200
> }
Where will the website content data come together in this message?
>
> It's also very easy to add new test types.
> Do you guys think this is feasible?
>
>
> On Thu, May 26, 2011 at 12:28 AM, Adriano Monteiro Marques
> <[email protected]> wrote:
>
> On May 25, 2011, at 1:01 PM, Zhongjie Wang wrote:
>
>> Hi Adriano,
>>
>> On Wed, May 25, 2011 at 11:54 PM, Adriano Monteiro Marques
>> <[email protected]> wrote:
>> Hi Alan,
>>
>> On May 25, 2011, at 12:25 PM, Zhongjie Wang wrote:
>>
>>> Hi, I simply write it this way. :)
>>> Help me to check if there's anything wrong. I'm new to protobuf.
>>>
>>> message ReportHeader {
>>> required int64 reportID = 1;
>>> required int64 senderID = 2;
>>> required int64 timestamp = 3;
>>> required int32 testID = 4;
>>> repeated bytes passedNode = 5; // the peer in the way of routing to
>>> the aggregator, this field is repeated
>>> }
>>>
>>> message WebsiteReport {
>>> required ReportHeader header = 1;
>>> required string websiteURL = 2;
>>> required int32 statusCode = 3;
>>> optional double responseTime = 4;
>>> optional double bandwidth = 5;
>>> extensions 10 to 99; // can add more fields later
>>> }
>>>
>>> message ServiceReport {
>>> required ReportHeader header = 1;
>>> required string serviceName = 2;
>>> required int32 statusCode = 3;
>>> optional double responseTime = 4;
>>> optional double bandwidth = 5;
>>> extensions 10 to 99; // can add more fields later
>>> }
>>
>> Ok, gotcha.But we'e still missing the response content. This is important
>> for us to do two things (I have discussed this previously with Diogo): get
>> statistical data from the response (this is helpful for finding false
>> results) and also to show people what people in that region is seeing while
>> trying to access that url. This view will actually add another set of fields
>> or perhaps change that one to a blob so it can hold all media and images
>> that would allow us for showing the website properly from inside the
>> aggregator.
>>
>> I understand. Shall we add the whole webpage html source as a string field
>> named "page_content" in the WebsiteReport.
>> If we download all the images and media in the page, then it's too large.
>> and it will be an heavy load for the aggregator. :)
>
> There are no limits in the cloud, dude :-) Let's add all the media files to
> provide our users with a better experience and let the aggregator handle it.
>
>>>
>>>
>>> On Wed, May 25, 2011 at 9:26 PM, Adriano Monteiro Marques
>>> <[email protected]> wrote:
>>> Hi Alan,
>>>
>>> Would you provide us with a sample based on Zubair's defs?
>>>
>>> Meanwhile, what do you guys think of Alan's approach? I think it is more
>>> extensible, though I'm unsure on how he intend to implement that using
>>> protobuf. Zubair, What's your vision on extending the message based on the
>>> defs you wrote?
>>>
>>> On May 25, 2011, at 10:22 AM, Zhongjie Wang wrote:
>>>
>>>> Hi Adriano,
>>>> I haven't done that yet, It's just a bit different with the one
>>>> Zubair has made. :)
>>>>
>>>> On Wed, May 25, 2011 at 9:12 PM, Adriano Monteiro Marques
>>>> <[email protected]> wrote:
>>>> Hi Alan,
>>>>
>>>> Do you have a protobuf message already implemented the way you just
>>>> described?
>>>>
>>>> On May 25, 2011, at 10:00 AM, Zhongjie Wang wrote:
>>>>
>>>>> Hi, folks. For the first report scheme, I was planning to describe a
>>>>> hierarchical format as the network protocols, which has header and
>>>>> payload.
>>>>> The header consists of Report ID (generated by hash), Sender ID (agent
>>>>> token), Timestamp (UTC), Test ID (unique for each kind of test).
>>>>> The payload is the Test Result and Routing Information. For each kind of
>>>>> tests, the format of result if different. e.g. Website Test has the
>>>>> target url, status info, response time, and some meta data. Service Test
>>>>> has the service name (or port num), status info, response time.
>>>>>
>>>>>
>>>>> 2011/5/25 Zubair Nabi <[email protected]>
>>>>> Currently, one the specification, there are two different message
>>>>> formats. I chose the second one.
>>>>>
>>>>> Alan earlier mentioned some extra fields. Alan, can you please repeat it
>>>>> so that we can address it right now and close this issue.
>>>>>
>>>>> 2011/5/25 Luís A. Bastião Silva <[email protected]>
>>>>>
>>>>> http://dev.umitproject.org/projects/icm-mobile/repository/revisions/master/entry/ICM-Mobile/src/org/umit/icm/mobile/proto/Messages.proto
>>>>>
>>>>> It's the link
>>>>>
>>>>> On Wed, May 25, 2011 at 12:31 AM, Adriano Monteiro Marques
>>>>> <[email protected]> wrote:
>>>>> Hi folks,
>>>>>
>>>>> Sorry, I was getting my umit-devel messages sent somewhere else and
>>>>> wasn't receiving any of the messages in this mailing list. Fixed the
>>>>> issue now. Thanks Luis for letting me know about the discussion here.
>>>>>
>>>>> So the mentioned fields are necessary in order for us to gather
>>>>> statistical data. They're fine just like that.
>>>>>
>>>>>
>>>>> Cheers!
>>>>>
>>>>> On May 16, 2011, at 10:57 PM, Zhongjie Wang wrote:
>>>>>
>>>>>> Hi Zubair!
>>>>>> Thanks for your modeling.
>>>>>> I think we need extra report ID and sender ID fields. Beside
>>>>>> that, I'm not sure if we need these two fields:
>>>>>>
>>>>>> 29
>>>>>> required string responseContent = 4;
>>>>>> 30
>>>>>> required bool matchPattern = 5;
>>>>>>
>>>>>> Regards,
>>>>>> Alan
>>>>>>
>>>>>> On Mon, May 16, 2011 at 10:23 PM, Zubair Nabi <[email protected]>
>>>>>> wrote:
>>>>>> Hey Everyone,
>>>>>>
>>>>>> Apropos the Test Report Format from the ICM specification. I implemented
>>>>>> the 4 formats in Google Protobuf and wanted to discuss them with
>>>>>> everyone before proceeding because this format should be uniform across
>>>>>> all entities in ICM.
>>>>>>
>>>>>> Here's a link to the .proto in the code:
>>>>>> http://dev.umitproject.org/projects/icm-mobile/repository/revisions/master/entry/src/org/umit/icm/mobile/proto/Messages.proto
>>>>>> Also, refer to the "Another Test Report Format" in the specification for
>>>>>> the format discussion.
>>>>>>
>>>>>>
>>>>>> --
>>>>>> Best,
>>>>>> __
>>>>>> Zubair
>>>>>>
>>>>>> ------------------------------------------------------------------------------
>>>>>> Achieve unprecedented app performance and reliability
>>>>>> What every C/C++ and Fortran developer should know.
>>>>>> Learn how Intel has extended the reach of its next-generation tools
>>>>>> to help boost performance applications - inlcuding clusters.
>>>>>> http://p.sf.net/sfu/intel-dev2devmay
>>>>>> _______________________________________________
>>>>>> Umit-devel mailing list
>>>>>> [email protected]
>>>>>> https://lists.sourceforge.net/lists/listinfo/umit-devel
>>>>>>
>>>>>>
>>>>>>
>>>>>>
>>>>>> --
>>>>>> Zhongjie Wang
>>>>>> Master Candidate
>>>>>> Computer System Architecture
>>>>>> Peking University, China
>>>>>> ------------------------------------------------------------------------------
>>>>>> Achieve unprecedented app performance and reliability
>>>>>> What every C/C++ and Fortran developer should know.
>>>>>> Learn how Intel has extended the reach of its next-generation tools
>>>>>> to help boost performance applications - inlcuding clusters.
>>>>>> http://p.sf.net/sfu/intel-dev2devmay_______________________________________________
>>>>>> Umit-devel mailing list
>>>>>> [email protected]
>>>>>> https://lists.sourceforge.net/lists/listinfo/umit-devel
>>>>>
>>>>> ---
>>>>> Adriano Monteiro Marques
>>>>>
>>>>> http://www.thoughtspad.com
>>>>> http://www.umitproject.org
>>>>> http://blog.umitproject.org
>>>>> http://www.pythonbenelux.org
>>>>>
>>>>> "Don't stay in bed, unless you can make money in bed." - George Burns
>>>>>
>>>>>
>>>>> ------------------------------------------------------------------------------
>>>>> vRanger cuts backup time in half-while increasing security.
>>>>> With the market-leading solution for virtual backup and recovery,
>>>>> you get blazing-fast, flexible, and affordable data protection.
>>>>> Download your free trial now.
>>>>> http://p.sf.net/sfu/quest-d2dcopy1
>>>>>
>>>>> _______________________________________________
>>>>> Umit-devel mailing list
>>>>> [email protected]
>>>>> https://lists.sourceforge.net/lists/listinfo/umit-devel
>>>>>
>>>>>
>>>>>
>>>>>
>>>>> --
>>>>> Luís A. Bastião Silva
>>>>> Umit Project Developer
>>>>> Skype: koplabs
>>>>> http://www.umitproject.org
>>>>> http://www.bastiao.org
>>>>>
>>>>>
>>>>>
>>>>> ------------------------------------------------------------------------------
>>>>> vRanger cuts backup time in half-while increasing security.
>>>>> With the market-leading solution for virtual backup and recovery,
>>>>> you get blazing-fast, flexible, and affordable data protection.
>>>>> Download your free trial now.
>>>>> http://p.sf.net/sfu/quest-d2dcopy1
>>>>> _______________________________________________
>>>>> Umit-devel mailing list
>>>>> [email protected]
>>>>> https://lists.sourceforge.net/lists/listinfo/umit-devel
>>>>>
>>>>>
>>>>>
>>>>>
>>>>> --
>>>>> Best,
>>>>> __
>>>>> Zubair
>>>>>
>>>>> ------------------------------------------------------------------------------
>>>>> vRanger cuts backup time in half-while increasing security.
>>>>> With the market-leading solution for virtual backup and recovery,
>>>>> you get blazing-fast, flexible, and affordable data protection.
>>>>> Download your free trial now.
>>>>> http://p.sf.net/sfu/quest-d2dcopy1
>>>>> _______________________________________________
>>>>> Umit-devel mailing list
>>>>> [email protected]
>>>>> https://lists.sourceforge.net/lists/listinfo/umit-devel
>>>>>
>>>>>
>>>>>
>>>>>
>>>>> --
>>>>> Zhongjie Wang
>>>>> Master Candidate
>>>>> Computer System Architecture
>>>>> Peking University, China
>>>>> ------------------------------------------------------------------------------
>>>>> vRanger cuts backup time in half-while increasing security.
>>>>> With the market-leading solution for virtual backup and recovery,
>>>>> you get blazing-fast, flexible, and affordable data protection.
>>>>> Download your free trial now.
>>>>> http://p.sf.net/sfu/quest-d2dcopy1_______________________________________________
>>>>> Umit-devel mailing list
>>>>> [email protected]
>>>>> https://lists.sourceforge.net/lists/listinfo/umit-devel
>>>>
>>>> ---
>>>> Adriano Monteiro Marques
>>>>
>>>> http://www.thoughtspad.com
>>>> http://www.umitproject.org
>>>> http://blog.umitproject.org
>>>> http://www.pythonbenelux.org
>>>>
>>>> "Don't stay in bed, unless you can make money in bed." - George Burns
>>>>
>>>>
>>>>
>>>>
>>>> --
>>>> Zhongjie Wang
>>>> Master Candidate
>>>> Computer System Architecture
>>>> Peking University, China
>>>
>>> ---
>>> Adriano Monteiro Marques
>>>
>>> http://www.thoughtspad.com
>>> http://www.umitproject.org
>>> http://blog.umitproject.org
>>> http://www.pythonbenelux.org
>>>
>>> "Don't stay in bed, unless you can make money in bed." - George Burns
>>>
>>>
>>>
>>>
>>> --
>>> Zhongjie Wang
>>> Master Candidate
>>> Computer System Architecture
>>> Peking University, China
>>
>>
>> ---
>> Adriano Monteiro Marques
>>
>> http://www.thoughtspad.com
>> http://www.umitproject.org
>> http://blog.umitproject.org
>> http://www.pythonbenelux.org
>>
>> "Don't stay in bed, unless you can make money in bed." - George Burns
>>
>>
>>
>>
>> --
>> Zhongjie Wang
>> Master Candidate
>> Computer System Architecture
>> Peking University, China
>
>
> ---
> Adriano Monteiro Marques
>
> http://www.thoughtspad.com
> http://www.umitproject.org
> http://blog.umitproject.org
> http://www.pythonbenelux.org
>
> "Don't stay in bed, unless you can make money in bed." - George Burns
>
>
>
>
> --
> Zhongjie Wang
> Master Candidate
> Computer System Architecture
> Peking University, China
---
Adriano Monteiro Marques
http://www.thoughtspad.com
http://www.umitproject.org
http://blog.umitproject.org
http://www.pythonbenelux.org
"Don't stay in bed, unless you can make money in bed." - George Burns
------------------------------------------------------------------------------
vRanger cuts backup time in half-while increasing security.
With the market-leading solution for virtual backup and recovery,
you get blazing-fast, flexible, and affordable data protection.
Download your free trial now.
http://p.sf.net/sfu/quest-d2dcopy1
_______________________________________________
Umit-devel mailing list
[email protected]
https://lists.sourceforge.net/lists/listinfo/umit-devel
