I'm actually surprised there isn't regression testing in place already. It actually explains quite a bit.
I've had the same experience Michael described many times with the Slim Server SW. I have a stable system with excellent performance, I see that an update is available, I install it, and the system falls down. I posted a complaint to this effect a week or so ago and was summarily slapped down by many here. Essentially, I was told that I would need to tinker with my system or file bug reports to reclaim previous levels of performance. I do not have the time for this approach. Therefore I simply returned to an earlier release. With appropriate regression testing this would not happen, but fair enough. Essentially, the final testing step has been pushed out to the consumer. I would propose the following to help educate we "consumer users" in this decision. If Slim Devices published performance metrics for each release that we could review it might make it easier to judge if we're willing to take the risk of an upgrade. Clearly, there are virtually unlimted server scenarios given different OS versions, hardware configurations, and the like, but presumably pre-release testing is done on each platform. I propose that Slim publish what each testing platform is, and what tests are performed on it with specific timing results for each, e.g. it took xxx seconds to scan a library of 1000 MP3 songs. Slap all of these in a speadsheet where we can compare the metrics between releases and (more importantly) to my configuration, then I can decide if it's worth my time to accept the "New version of slim server" prompt. JB -- Bonesteel ------------------------------------------------------------------------ Bonesteel's Profile: http://forums.slimdevices.com/member.php?userid=1438 View this thread: http://forums.slimdevices.com/showthread.php?t=17864 _______________________________________________ Discuss mailing list [email protected] http://lists.slimdevices.com/lists/listinfo/discuss
