saintstack commented on issue #1109: HBASE-23780 Edit of test classifications
URL: https://github.com/apache/hbase/pull/1109#issuecomment-580945488
 
 
   bq. Curious if you did some automation around this (analyzing the test 
results) to get this data. If so that can probably be checked in too somewhere 
and we can have a bot that can point the mismatched categories based on test 
runtime or some other simple rules.
   Reason I'm asking this is because it has to be repeated periodically, so 
wondering if there can be automation around it.
   
   None on my part. A bunch of heuristics. Hard to do hard categorization. E.g. 
small test if < 15 seconds AND does not spin up a cluster of any type. Then for 
tests that do i/o, their elapsed time can vary wildly dependent on context. 
Whats here came of study over last few days.
   
   Yes, needs to be checked periodically. Something to work on.
   
   Thanks for the +1 @bharathv . Let me make sure the qa build comes in clean 
before merging.

----------------------------------------------------------------
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
 
For queries about this service, please contact Infrastructure at:
[email protected]


With regards,
Apache Git Services

Reply via email to