On 06/20/2012 09:40 AM, Zach Pfeffer wrote:
On 20 June 2012 09:34, Andy Doan<[email protected]>  wrote:
On 06/20/2012 12:01 AM, Fathi Boudra wrote:

cc LAVA mailing list.

On 20 June 2012 06:19, Zach Pfeffer wrote:

Hey Andy,

During our call with ARM (invite on the way), the fact that LAVA has a
network dependency came up again.


Could you expand on the network dependency issue?
Filing a bug is even better.

We also have an issue with Connectivity Manager testing. Is there
anything that can be done in
12.07 (SD mux) to get over this?


I don't think the SD mux will be available or deployed in 12.07, so we have
to think about this another way.

I think the "black box" idea we spoke about at Connect might be the path to
solve this. For those who weren't at the bar at midnight in Hong Kong: The
"black box" idea is a change to how LAVA would run tests. Instead of having
the LAVA dispatcher drive everything host side, we'd boot into a test image,
let it do stuff, pull files from a know partition, analyze and report
results.

Hehe...

If we were to do that, decisions like networking would be completely up to
you(the test image). This concept works best with an SD-mux set up. However,
it could work with our master images also.

I still worry 12.07 might be a little ambitious for such a fundamental
change, but I think we should discuss.

Yeah, that's cool - though I think to hit our benchmark variance
numbers and to test things like Connectivity Manager we'll need this.
It should help LAVA to because it'll take a failure point out of the
system.

Andy, what are you thinking are the big blockers for this with the
master image approach?

Michael and I had a talk about this earlier. We think we've come up with a way to do this for Android (and a targeted subset of tests) that could be done in a month. The work would also serve as the foundation for extending things further into the total 'black box' concept.

The biggest obstacle to get this done will be finding a person to do the work. Here's the actions I see to kickstart this:

1) Michael or I will draft a BP this week.
2) Zach and I discuss resources

-andy

_______________________________________________
linaro-validation mailing list
[email protected]
http://lists.linaro.org/mailman/listinfo/linaro-validation

Reply via email to