Hi Jarno,

It sounds a possible way to avoid confusing the user.
I will inform Rui for this change.

BR, Shao-Feng

From: Jarno Keskikangas [mailto:jarno.keskikan...@leonidasoy.fi]
Sent: Wednesday, April 06, 2011 6:56 PM
To: Tang, Shaofeng
Cc: meego-qa@lists.meego.com; Poikajärvi Vesa
Subject: Re: [Meego-qa] [Qa-report]Regarding the Proposal for allowing download 
of raw result files

Hi Shao-Feng,

Thanks, I also reviewed https://bugs.meego.com/show_bug.cgi?id=13526, which 
clearly defines the use case you brought up ("As a test engineer, I want to 
compare/add more results to the report").

I'd propose let's add similar "Download as CSV" link close to "Detailed test 
results" as we currently have at summary pages, e.g. 
http://qa-reports.meego.com/1.2/Handset/Sanity%20-%20Automated/N900. Having the 
link close to the detailed test results should make the difference clear for 
the user.

The deployed use case was "As a developer, I want to see the original 
stderr/out and test steps from the xml in order to find out why the test has 
failed". The feature has been requested by multiple teams, so we proceeded 
quite quickly with the deployment.

Best,
Jarno
2011/4/6 Tang, Shaofeng 
<shaofeng.t...@intel.com<mailto:shaofeng.t...@intel.com>>
Hi,

Please check this report 
http://qa-reports.meego.com/1.2/Core/Basic%20Feature%20Testing/N900/1834
>From this one, we can see,
Firstly this MR was already merged and deployed, even we didn't reach an 
agreement yet.
Secondly, a CSV file is listed at the bottom of the reports as "original ...", 
this CSV file will make the end user confused with the feature# 
13526<https://bugs.meego.com/show_bug.cgi?id=13526>.
Finally, I still have problem to see the sense of the out-of-date "original" 
files.
No matter, since it is done, I think it is time to stop this topic unless some 
end user has different opinions.

Jarno, for your question, please refer to the mail I reply to Timo. The use 
case was already described in it.

BR, Shao-Feng

From: Jarno Keskikangas 
[mailto:jarno.keskikan...@leonidasoy.fi<mailto:jarno.keskikan...@leonidasoy.fi>]
Sent: Wednesday, April 06, 2011 2:22 PM
To: meego-qa@lists.meego.com<mailto:meego-qa@lists.meego.com>
Cc: Tang, Shaofeng; Poikajärvi Vesa

Subject: Re: [Meego-qa] [Qa-report]Regarding the Proposal for allowing download 
of raw result files

Hi,

For me, it seems there's two separate use cases. The first use case is to 
download original xml attachments, e.g., to inspect test steps, stdout/stderr 
and other information that is not (yet) visible in QA Reports UI. In this 
scenario, it would be confusing to update for example test result from fail to 
pass, if there's error message in stderr field.

I guess the use case Shao-Feng is describing is something like this: "As a 
[test engineer | test manager | someone else] I want to download test result as 
a csv in order to [ do further analysis in excel | to update/upload report | 
something else]". In such case, it would of course make sense to have the 
current results, not the original.

Shao-Feng, could you clarify who (which role) wants to download the results and 
what she/he wants to do with them? Would they prefer result.xml format or some 
csv format? Could you also create a ticket for the issue, as it seems to be 
different from the original request.

Best,
Jarno


Date: Mon, 4 Apr 2011 19:54:38 +0300
From: Poikaj?rvi Vesa 
<vesa.poikaja...@digia.com<mailto:vesa.poikaja...@digia.com>>
To: "Tang, Shaofeng" <shaofeng.t...@intel.com<mailto:shaofeng.t...@intel.com>>,
       "meego-qa@lists.meego.com<mailto:meego-qa@lists.meego.com>"      
<meego-qa@lists.meego.com<mailto:meego-qa@lists.meego.com>>
Subject: Re: [Meego-qa] [Qa-report]Regarding the Proposal for allowing
       download of raw result files
Message-ID:
       <94a88214e67edf4aa1f1ced7d26833a8301fd9d...@e2k7mail.it.local>
Content-Type: text/plain; charset="iso-8859-1"

Hi,

> Not sure if you also received the feedback from Tina, Daniel, and Lei
> about this feature. Maybe you know, they also the end user of qa-reports.
> And all of them also insist the result files should be updated for
> keeping consistent with the database.

Yes, I got them - I was just trying to point out that we're not talking
about the same thing:

1. The request I received was:

  As a user, I want to *download* the *original* result files I used when
  creating the report since I want to check the details;

2. Whereas you want:

  As a user, I want to be able to *export* test results as XML once all
  the results are in place etc. for some reason.

>From the first request there's now a FEA request and also a proposal for
implementation. For that 2nd one there's discussion on this mailing list but
no request in Bugzilla.

Both can be done - these are not ruling each other out. You sent a link to
a bug about CSV export, shouldn't be too hard to add XML export as well while
someone is already implementing this. These things are just conceptually
different even if both are about getting some stuff in XML format from QA
reports. For the first one the requirement is to get the *original* files,
not some files that have been updated based on some information in the
database.

> Regarding the feature#14876, I think the original result file didn't
> match this feature at all. Especially making nonsense if the result
> file contain several thousand test-cases(In our full-path testing,
> more than 3 thousands test cases are involved.) Maybe a pop-up window
> or page could be used to show the output of the selected testcase.
> Instead of providing the result file.

I'm sorry I don't get this - the feature request above is not related to
downloading (or exporting) files; it's about adding information to the
report (as a popup, hidden div, whatever) so that users could check the output
of steps of a certain case *without* needing to download any files. So this
would be:

  As a user, I want to quickly be able to check stdout, stderr, return value
  and some other stuff for a single test case without needing to download
  the XML files.


BR,
Vesa Poikaj?rvi


_______________________________________________
MeeGo-qa mailing list
MeeGo-qa@lists.meego.com
http://lists.meego.com/listinfo/meego-qa

Reply via email to