Re: [openstack-dev] [qa] [cinder] Do we now require schema response validation in tempest clients?

2014-06-05 Thread Ollie Leahy
I've submitted a patch that copies the compute http response validation 
structure for the 'cinder list' request.


https://review.openstack.org/96440

I'm having trouble getting it through the gate, but input from the 
cinder group about whether this is useful work that I should persist 
with would be appreciated.


Thanks,
Ollie


On 01/05/14 05:02, Ken'ichi Ohmichi wrote:

Hi David,

2014-05-01 5:44 GMT+09:00 David Kranz dkr...@redhat.com:

There have been a lot of patches that add the validation of response dicts.
We need a policy on whether this is required or not. For example, this patch

https://review.openstack.org/#/c/87438/5

is for the equivalent of 'cinder service-list' and is a basically a copy of
the nova test which now does the validation. So two questions:

Is cinder going to do this kind of checking?
If so, should new tests be required to do it on submission?

I'm not sure someone will add the similar validation, which we are adding to
Nova API tests, to Cinder API tests also. but it would be nice for Cinder and
Tempest. The validation can be applied to the other projects(Cinder, etc)
easily because the base framework is implemented in common rest client
of Tempest.

When adding new tests like https://review.openstack.org/#/c/87438 , I don't
have strong opinion for including the validation also. These schemas will be
large sometimes and the combination in the same patch would make reviews
difficult. In current Nova API test implementations, we are separating them
into different patches.


Thanks
Ken'ichi Ohmichi

___
OpenStack-dev mailing list
OpenStack-dev@lists.openstack.org
http://lists.openstack.org/cgi-bin/mailman/listinfo/openstack-dev



___
OpenStack-dev mailing list
OpenStack-dev@lists.openstack.org
http://lists.openstack.org/cgi-bin/mailman/listinfo/openstack-dev


Re: [openstack-dev] [qa] [cinder] Do we now require schema response validation in tempest clients?

2014-05-04 Thread Christopher Yeoh
On Thu, May 1, 2014 at 1:32 PM, Ken'ichi Ohmichi ken1ohmi...@gmail.comwrote:

 Hi David,

 2014-05-01 5:44 GMT+09:00 David Kranz dkr...@redhat.com:
  There have been a lot of patches that add the validation of response
 dicts.
  We need a policy on whether this is required or not. For example, this
 patch
 
  https://review.openstack.org/#/c/87438/5
 
  is for the equivalent of 'cinder service-list' and is a basically a copy
 of
  the nova test which now does the validation. So two questions:
 
  Is cinder going to do this kind of checking?
  If so, should new tests be required to do it on submission?

 I'm not sure someone will add the similar validation, which we are adding
 to
 Nova API tests, to Cinder API tests also. but it would be nice for Cinder
 and
 Tempest. The validation can be applied to the other projects(Cinder, etc)
 easily because the base framework is implemented in common rest client
 of Tempest.

 When adding new tests like https://review.openstack.org/#/c/87438 , I
 don't
 have strong opinion for including the validation also. These schemas will
 be
 large sometimes and the combination in the same patch would make reviews
 difficult. In current Nova API test implementations, we are separating them
 into different patches.


Separating the schema part into a separate dependent patch probably makes
sense when they large but I would like to see us ratchet the requirement to
have schema validation for the cinder api as well too.

Chris





 Thanks
 Ken'ichi Ohmichi

 ___
 OpenStack-dev mailing list
 OpenStack-dev@lists.openstack.org
 http://lists.openstack.org/cgi-bin/mailman/listinfo/openstack-dev

___
OpenStack-dev mailing list
OpenStack-dev@lists.openstack.org
http://lists.openstack.org/cgi-bin/mailman/listinfo/openstack-dev


Re: [openstack-dev] [qa] [cinder] Do we now require schema response validation in tempest clients?

2014-05-01 Thread Ghanshyam Mann
Hi David, Ken'ichi,

Thursday, May 1, 2014 1:02 PM Ken'ichi Ohmichi ken1ohmi...@gmail.com: 
Hi David,

2014-05-01 5:44 GMT+09:00 David Kranz dkr...@redhat.com:
 There have been a lot of patches that add the validation of response dicts.
 We need a policy on whether this is required or not. For example, this 
 patch

 https://review.openstack.org/#/c/87438/5

 is for the equivalent of 'cinder service-list' and is a basically a 
 copy of the nova test which now does the validation. So two questions:

 Is cinder going to do this kind of checking?
 If so, should new tests be required to do it on submission?

I'm not sure someone will add the similar validation, which we are adding to 
Nova API tests, to Cinder API tests also. but it would be nice for Cinder and 
Tempest. The validation can be applied to the other projects(Cinder, etc) 
easily because the base framework is implemented in common rest client of 
Tempest.

Yes, that will be nice if we start implementing the validation part for other 
component's APIs test also. I can take this and start implementing the 
validation for existing tests of cinder. Those can be continue whenever new 
test cases are going to be added.

When adding new tests like https://review.openstack.org/#/c/87438 , I don't 
have strong opinion for including the validation also. These schemas will be 
large sometimes and the combination in the same patch would make reviews 
difficult. In current Nova API test implementations, we are separating them 
into different patches.

Me too agree.

Thanks
Ghanshyam Mann
___
OpenStack-dev mailing list
OpenStack-dev@lists.openstack.org
http://lists.openstack.org/cgi-bin/mailman/listinfo/openstack-dev



DISCLAIMER:
---
The contents of this e-mail and any attachment(s) are confidential and
intended
for the named recipient(s) only. 
It shall not attach any liability on the originator or NEC or its
affiliates. Any views or opinions presented in 
this email are solely those of the author and may not necessarily reflect the
opinions of NEC or its affiliates. 
Any form of reproduction, dissemination, copying, disclosure, modification,
distribution and / or publication of 
this message without the prior written consent of the author of this e-mail is
strictly prohibited. If you have 
received this email in error please delete it and notify the sender
immediately. .
---

___
OpenStack-dev mailing list
OpenStack-dev@lists.openstack.org
http://lists.openstack.org/cgi-bin/mailman/listinfo/openstack-dev


Re: [openstack-dev] [qa] [cinder] Do we now require schema response validation in tempest clients?

2014-04-30 Thread Ken'ichi Ohmichi
Hi David,

2014-05-01 5:44 GMT+09:00 David Kranz dkr...@redhat.com:
 There have been a lot of patches that add the validation of response dicts.
 We need a policy on whether this is required or not. For example, this patch

 https://review.openstack.org/#/c/87438/5

 is for the equivalent of 'cinder service-list' and is a basically a copy of
 the nova test which now does the validation. So two questions:

 Is cinder going to do this kind of checking?
 If so, should new tests be required to do it on submission?

I'm not sure someone will add the similar validation, which we are adding to
Nova API tests, to Cinder API tests also. but it would be nice for Cinder and
Tempest. The validation can be applied to the other projects(Cinder, etc)
easily because the base framework is implemented in common rest client
of Tempest.

When adding new tests like https://review.openstack.org/#/c/87438 , I don't
have strong opinion for including the validation also. These schemas will be
large sometimes and the combination in the same patch would make reviews
difficult. In current Nova API test implementations, we are separating them
into different patches.


Thanks
Ken'ichi Ohmichi

___
OpenStack-dev mailing list
OpenStack-dev@lists.openstack.org
http://lists.openstack.org/cgi-bin/mailman/listinfo/openstack-dev