Hi Michael, I like your idea of publishing performance results for IronPython. A good start would be for us to do this with PyBench on major IronPython releases such as 2.0.0. Seems like there's enough x64 users out there to warrant doing this for x64 Vista as well.
No, we don't run benchmarks on XP. It's just a matter of machine resources. As for running the benchmarks on x64 machines with every IronPython/DLR checkin...it's unlikely we'd miss any major perf degrades if we reimage these machines as 32-bit. I've been checking out our old perf reports and nearly every time we've had an x64 degrade, there was a corresponding x86 degrade of equal magnitude. Dave From: [EMAIL PROTECTED] [mailto:[EMAIL PROTECTED] On Behalf Of Michael Foord Sent: Tuesday, August 19, 2008 12:12 AM To: Discussion of IronPython Subject: Re: [IronPython] Informal Poll: measuring IronPython performance under x64 OSes Hello guys, I run IronPython on Vista x64. Isn't 64bit supposed to be the future or something? :-) (I run Vista x64 in a virtual machine under Mac OS - but performance is very good. Visual Studio runs quite nicely.) I'd love to see more IronPython benchmarking (and the results published). Do you still benchmark with XP? (Still a phenomenally successful OS by all accounts). I'm not sure what the consequences of removing 64bit OSes from the benchmarks might be - .NET seems to nicely insulate programmers from the differences, except for things like P/Invoke of course. Performance is one area where it might make a difference though (it would be a shame to accidentally hose performance on 64bit machines and not realise - is this likely?) What about releasing the benchmark suite with a means to submit results including platform information - that way we can submit results back to you? (By email to the list I guess.) We could even setup some external 'buildbot' machines that automatically sync to codeplex. Anyway - I'd be happy to run benchmark suites occasionally. Michael 2008/8/19 Dave Fugate <[EMAIL PROTECTED]<mailto:[EMAIL PROTECTED]>> Hi everyone, one of the things the IronPython test team does daily is run a set of standardized benchmarks against the latest internal build of IronPython. We're in the process of reevaluating the platforms we measure these benchmarks on with the end goal of increasing the number of tests we can run. For example, if we could cut x64 Vista from the list of platforms, the x64 Vista machine(s) could be reimaged to run new benchmarks we wouldn't have had the resources for before. Alternatively, we might reimage the x64 Vista machine(s) as some other platform we don't currently test under. Of course in such a scenario we'd still run other classifications of tests under x64 Vista. I wanted to hear peoples' opinions on the importance of measuring IronPython performance under x64 Windows OSes before we make any decisions on this. First off, how many people out there are actually running IronPython under a 64-bit OS? Would it be sufficient for us to report news on IronPython performance in terms of 32-bit platforms? Thanks, The IronPython Team _______________________________________________ Users mailing list Users@lists.ironpython.com<mailto:Users@lists.ironpython.com> http://lists.ironpython.com/listinfo.cgi/users-ironpython.com -- http://www.ironpythoninaction.com/ http://www.voidspace.org.uk/ http://www.ironpython.info/ http://www.resolverhacks.net/
_______________________________________________ Users mailing list Users@lists.ironpython.com http://lists.ironpython.com/listinfo.cgi/users-ironpython.com
