Also, the point of making PriorityAttribute and DescriptionAttribute, apart
from them already being there and this was a simpler change, is that we can use
them as trait attributes which xunit 2.0 supports. We can use things like
priority or make a category - more specific than a TraitAttribute along with a
TraitAttributeDiscoverer-derivative - to handle certain types of tests now that
test lists aren't supported. It's all using extensibility supported by xunit.
- Heath from his Surface Pro
From: Heath Stewart
Sent: Tuesday, June 10, 2014 8:55 PM
To: Windows Installer XML toolset developer mailing list
I've changed quite a bit of the infrastructure as well, but xunit doesn't
support initialization and tear-down and a lot of other things required by many
of our tests. I can rename the attribute back but I wouldn't say xunit is a
solid replacement.
Sent from my Windows Phone
From: Rob Mensching
Sent: 6/10/2014 12:11 PM
To: WiX toolset developer mailing list
Subject: Re: [WiX-devs] Test overhaul
I only moved a few Burn projects to Xunit to prove that it could be done (added
NamedFactAttribute and other things). I left the others still running against
MSTest. It’s fantastic if you finished moving the other tests.
However, please don’t change Xunit to look like MSTest. “NamedFact” was named
that way to model the fact that Xunit calls tests “Facts”. Also, did we use
priority and description?
Also, let’s wait until Xunit goes to 2.0 before moving to it.
There was a lot of nasty test code and test infrastructure to clean up and
simplify in there. I totally understand if you only moved the test code and
didn’t scrub infrastructure. <smile/>
_______________________________________________________________
FireGiant | Dedicated support for the WiX toolset |
http://www.firegiant.com/
From: Heath Stewart [mailto:hea...@outlook.com]
Sent: Monday, June 9, 2014 9:40 AM
To: Windows Installer XML toolset developer mailing list
Subject: Re: [WiX-devs] Test overhaul
It was the changeover that they seemed to all (well, mostly) break. Xunit
doesn't work the same way as MSBuild or NUnit so any tests that require
test-case initialization and tear-down would fail. With some extensibility I
was able to put that behavior back, for the most part. Nearly finished.
The really, super annoying thing has been having to walk around xunit's sticks
in the sand, regarding user messages for Asserts (or lack thereof) and that
even those Asserts that support user messages don't support params parameters
like String.Format, so I have to add that in everywhere to maintain the
existing behavior.
All tests but WixTests are building and almost all of those are passing.
I also took the opportunity with the extensibility to skip tests that are
runtime tests when runtime tests aren't enabled rather than fail, skip runtime
tests that require elevation (the assumed default - tests can declare
themselves NonPrivileged), and skip tents that are 64-bit specific when not
running under a 64-bit process. These are effectively trait attributes, and
will be proper TraitAttribute-derivatives once Xunit 2.0 releases (or I can now
if we want to take a pre-rely, doesn't really change much, though).
Since I had to define a custom attribute anyway, I renamed NamedFact to
TestMethodAttribute, and added traits PriorityAttribute, DescriptionAttribute,
RuntimeTestAttribute, and Is64BitSpecificTestAttribute.
I'll have a pull request in a day or two. All that's left in the WixTests
project is wrapping a bunch of user messages in String.Format. I have 167
instances to fix up yet where regex-based replacement may not be of much help.
I'm considering options for automation, including Roslyn at least to help
automate the changes.
- Heath from his Surface Pro
From: Hoover, Jacob
Sent: Monday, June 9, 2014 6:27 AM
To: Windows Installer XML toolset developer mailing list
I don’t know when they “all broke”, but I do know I had tests failing when I
was trying to validate changes I had submitted. Some of them had to do with
case sensitivity of paths, but I can’t remember the others. I do think at one
point in time I had made an attempt to fix it, but with the changeover in
testing frameworks I never submitted a pull request.
From: Heath Stewart [mailto:hea...@outlook.com]
Sent: Monday, June 09, 2014 2:26 AM
To: Windows Installer XML toolset developer mailing list
Subject: [WiX-devs] Test overhaul
I've nearly got the fully xunit-based test system working again. I felt it
important to get it working again whilst checking in all the new code, some of
which are new tests. I was able to keep some of the same behavior, like
something similar to TestInitialize and TestCleanup attributed methods. Once
xunit 2.0 releases (I've got some TODOs in the code as reminders) I can beef it
up more, but xunit's current extensibility gave me some new options. Just
trying to get the TestDataDirectory working, which points to
%WIX_ROOT%\tests\data without relying on the environment variable.
Perhaps this is more directed at Rob or Bob, but I'm curious if there were any
tests failing before they all broke. I recall that some of the burn tests were
failing and we turned them off in the internal fork, but all the tests in
WixTest.dll are working.
- Heath from his Surface Pro
------------------------------------------------------------------------------
HPCC Systems Open Source Big Data Platform from LexisNexis Risk Solutions
Find What Matters Most in Your Big Data with HPCC Systems
Open Source. Fast. Scalable. Simple. Ideal for Dirty Data.
Leverages Graph Analysis for Fast Processing & Easy Data Exploration
http://p.sf.net/sfu/hpccsystems
_______________________________________________
WiX-devs mailing list
WiX-devs@lists.sourceforge.net
https://lists.sourceforge.net/lists/listinfo/wix-devs
------------------------------------------------------------------------------
HPCC Systems Open Source Big Data Platform from LexisNexis Risk Solutions
Find What Matters Most in Your Big Data with HPCC Systems
Open Source. Fast. Scalable. Simple. Ideal for Dirty Data.
Leverages Graph Analysis for Fast Processing & Easy Data Exploration
http://p.sf.net/sfu/hpccsystems
_______________________________________________
WiX-devs mailing list
WiX-devs@lists.sourceforge.net
https://lists.sourceforge.net/lists/listinfo/wix-devs
------------------------------------------------------------------------------
HPCC Systems Open Source Big Data Platform from LexisNexis Risk Solutions
Find What Matters Most in Your Big Data with HPCC Systems
Open Source. Fast. Scalable. Simple. Ideal for Dirty Data.
Leverages Graph Analysis for Fast Processing & Easy Data Exploration
http://p.sf.net/sfu/hpccsystems
_______________________________________________
WiX-devs mailing list
WiX-devs@lists.sourceforge.net
https://lists.sourceforge.net/lists/listinfo/wix-devs
