I suggest you ...

Visual Studio 2015 Test Playlist Order

Vs2015 now no longer honours the test playlist order (it did in previous editions), See http://stackoverflow.com/questions/20711300/controlling-execution-order-of-unit-tests-in-visual-studio

While https://msdn.microsoft.com/en-us/library/ms182631.aspx tells use how to do ordered tests, this is impractical for 1000s of tests. We don’t want to create an ordered test, we want to control the order of the tests in a test run.

So my request or plea :

>> Please provide an option when running playlists to maintain the playlist order

While the "theory" is the order does not matter, due to class setup times the result of this is tests can take up to x10 longer than before.

Thanks

21 votes
Vote
Sign in
(thinking…)
Sign in with: facebook google
Signed in as (Sign out)
You have left! (?) (thinking…)
Greg R shared this idea  ·   ·  Flag idea as inappropriate…  ·  Admin →

1 comment

Sign in
(thinking…)
Sign in with: facebook google
Signed in as (Sign out)
Submitting...
  • Greg R commented  ·   ·  Flag as inappropriate

    Added context to why ordered tests are not the solution
    https://msdn.microsoft.com/en-us/library/ms182631.aspx
    Is how to create an ordered test. This is not usable for a large number of tests, it is more intended to run a small number of tests in a certain order to test out a complex scenario. It is very difficult to look through the results of 1000 tests run in an ordered test and see which ones failed and which ones didn’t and then re-run just the ones that failed when investigating issues. An ordered test is really more an additional test case then it is a way to run tests in the right order. We don’t want to create an ordered test, we want to control the order of the tests in a test run. This is a very different requirement.

Feedback and Knowledge Base