Re: [U-Boot] [PATCH] Implement pytest-based test infrastructure

2015-12-02 Thread Simon Glass
Hi Stephen, On 1 December 2015 at 16:24, Stephen Warren wrote: > On 12/01/2015 09:40 AM, Simon Glass wrote: > ... >> >> At present we don't have a sensible test framework for anything other >> than sandbox, so to me the main benefit is that with your setup, we >> do. >> >>

Re: [U-Boot] [PATCH] Implement pytest-based test infrastructure

2015-12-01 Thread Stephen Warren
On 12/01/2015 09:40 AM, Simon Glass wrote: ... At present we don't have a sensible test framework for anything other than sandbox, so to me the main benefit is that with your setup, we do. The benefit of the existing sandbox tests is that they are very fast. We could bisect for a test failure

Re: [U-Boot] [PATCH] Implement pytest-based test infrastructure

2015-12-01 Thread Simon Glass
Hi Stephen, On 30 November 2015 at 10:13, Stephen Warren wrote: > > On 11/26/2015 07:52 PM, Simon Glass wrote: >> >> Hi Stephen, >> >> On 24 November 2015 at 13:28, Stephen Warren wrote: >>> >>> On 11/24/2015 12:04 PM, Simon Glass wrote:

Re: [U-Boot] [PATCH] Implement pytest-based test infrastructure

2015-11-30 Thread Stephen Warren
On 11/26/2015 07:52 PM, Simon Glass wrote: Hi Stephen, On 24 November 2015 at 13:28, Stephen Warren wrote: On 11/24/2015 12:04 PM, Simon Glass wrote: Hi Stephen, On 23 November 2015 at 21:44, Stephen Warren wrote: On 11/23/2015 06:45 PM,

Re: [U-Boot] [PATCH] Implement pytest-based test infrastructure

2015-11-26 Thread Simon Glass
Hi Stephen, On 24 November 2015 at 13:28, Stephen Warren wrote: > On 11/24/2015 12:04 PM, Simon Glass wrote: >> >> Hi Stephen, >> >> On 23 November 2015 at 21:44, Stephen Warren >> wrote: >>> >>> On 11/23/2015 06:45 PM, Simon Glass wrote:

Re: [U-Boot] [PATCH] Implement pytest-based test infrastructure

2015-11-24 Thread Stephen Warren
On 11/24/2015 12:04 PM, Simon Glass wrote: Hi Stephen, On 23 November 2015 at 21:44, Stephen Warren wrote: On 11/23/2015 06:45 PM, Simon Glass wrote: On 22 November 2015 at 10:30, Stephen Warren wrote: On 11/21/2015 09:49 AM, Simon Glass wrote:

Re: [U-Boot] [PATCH] Implement pytest-based test infrastructure

2015-11-24 Thread Simon Glass
Hi Stephen, On 23 November 2015 at 21:44, Stephen Warren wrote: > On 11/23/2015 06:45 PM, Simon Glass wrote: >> Hi Stephen, >> >> On 22 November 2015 at 10:30, Stephen Warren wrote: >>> On 11/21/2015 09:49 AM, Simon Glass wrote: Hi Stephen,

Re: [U-Boot] [PATCH] Implement pytest-based test infrastructure

2015-11-23 Thread Stephen Warren
On 11/23/2015 07:18 PM, Simon Glass wrote: > Hi Stephen, > > On 23 November 2015 at 18:45, Simon Glass wrote: >> Hi Stephen, >> >> On 22 November 2015 at 10:30, Stephen Warren wrote: >>> On 11/21/2015 09:49 AM, Simon Glass wrote: Hi Stephen,

Re: [U-Boot] [PATCH] Implement pytest-based test infrastructure

2015-11-23 Thread Stephen Warren
On 11/23/2015 06:45 PM, Simon Glass wrote: > Hi Stephen, > > On 22 November 2015 at 10:30, Stephen Warren wrote: >> On 11/21/2015 09:49 AM, Simon Glass wrote: >>> Hi Stephen, >>> >>> On 19 November 2015 at 12:09, Stephen Warren wrote: On

Re: [U-Boot] [PATCH] Implement pytest-based test infrastructure

2015-11-23 Thread Tom Rini
On Thu, Nov 19, 2015 at 10:00:32AM -0700, Stephen Warren wrote: > On 11/19/2015 07:45 AM, Simon Glass wrote: > >Hi Stephen, > > > >On 14 November 2015 at 23:53, Stephen Warren wrote: > >>This tool aims to test U-Boot by executing U-Boot shell commands using the > >>console

Re: [U-Boot] [PATCH] Implement pytest-based test infrastructure

2015-11-23 Thread Stephen Warren
On 11/23/2015 04:44 PM, Tom Rini wrote: On Thu, Nov 19, 2015 at 10:00:32AM -0700, Stephen Warren wrote: ... See the following in test/py/README.md: ## Requirements The test suite is implemented using pytest. Interaction with the U-Boot console uses pexpect. Interaction with real hardware

Re: [U-Boot] [PATCH] Implement pytest-based test infrastructure

2015-11-23 Thread Simon Glass
Hi Stephen, On 22 November 2015 at 10:30, Stephen Warren wrote: > On 11/21/2015 09:49 AM, Simon Glass wrote: >> Hi Stephen, >> >> On 19 November 2015 at 12:09, Stephen Warren wrote: >>> >>> On 11/19/2015 10:00 AM, Stephen Warren wrote: On

Re: [U-Boot] [PATCH] Implement pytest-based test infrastructure

2015-11-23 Thread Simon Glass
Hi Stephen, On 23 November 2015 at 18:45, Simon Glass wrote: > Hi Stephen, > > On 22 November 2015 at 10:30, Stephen Warren wrote: >> On 11/21/2015 09:49 AM, Simon Glass wrote: >>> Hi Stephen, >>> >>> On 19 November 2015 at 12:09, Stephen Warren

Re: [U-Boot] [PATCH] Implement pytest-based test infrastructure

2015-11-22 Thread Stephen Warren
On 11/21/2015 09:49 AM, Simon Glass wrote: > Hi Stephen, > > On 19 November 2015 at 12:09, Stephen Warren wrote: >> >> On 11/19/2015 10:00 AM, Stephen Warren wrote: >>> >>> On 11/19/2015 07:45 AM, Simon Glass wrote: Hi Stephen, On 14 November 2015 at

Re: [U-Boot] [PATCH] Implement pytest-based test infrastructure

2015-11-21 Thread Simon Glass
Hi Stephen, On 19 November 2015 at 12:09, Stephen Warren wrote: > > On 11/19/2015 10:00 AM, Stephen Warren wrote: >> >> On 11/19/2015 07:45 AM, Simon Glass wrote: >>> >>> Hi Stephen, >>> >>> On 14 November 2015 at 23:53, Stephen Warren >>> wrote:

Re: [U-Boot] [PATCH] Implement pytest-based test infrastructure

2015-11-19 Thread Stephen Warren
On 11/19/2015 10:00 AM, Stephen Warren wrote: On 11/19/2015 07:45 AM, Simon Glass wrote: Hi Stephen, On 14 November 2015 at 23:53, Stephen Warren wrote: This tool aims to test U-Boot by executing U-Boot shell commands using the console interface. A single top-level

Re: [U-Boot] [PATCH] Implement pytest-based test infrastructure

2015-11-19 Thread Stephen Warren
On 11/19/2015 07:45 AM, Simon Glass wrote: Hi Stephen, On 14 November 2015 at 23:53, Stephen Warren wrote: This tool aims to test U-Boot by executing U-Boot shell commands using the console interface. A single top-level script exists to execute or attach to the U-Boot

Re: [U-Boot] [PATCH] Implement pytest-based test infrastructure

2015-11-19 Thread Simon Glass
Hi Stephen, On 14 November 2015 at 23:53, Stephen Warren wrote: > This tool aims to test U-Boot by executing U-Boot shell commands using the > console interface. A single top-level script exists to execute or attach > to the U-Boot console, run the entire script of tests

[U-Boot] [PATCH] Implement pytest-based test infrastructure

2015-11-14 Thread Stephen Warren
This tool aims to test U-Boot by executing U-Boot shell commands using the console interface. A single top-level script exists to execute or attach to the U-Boot console, run the entire script of tests against it, and summarize the results. Advantages of this approach are: - Testing is performed