Provide the ability to run multiple test suites within a test plan in Microsoft Test Manager
Currently Microsoft Test Manager allows running only one test suite at a time within a Test Plan. Real testing of any reasonably large system will result in the creation of multiple test suites within a Test Plan, some of which are likely to be Test suites nested within other Test Suites.
Please provide a way for the user to select multiple any or all Test Suites withing a Test Plan and with a single Run "command"
There are 2 parts of this suggestion, one targeted at Automated Testing and the other for Manual testing.
For Automated testing, starting with TFS 2015, we have simplified running automated tests without the need for creating any test cases and then adding them to test suites.
Take a look at the following blog for more details:
With the above, the core need for automated testing is largely addressed. Hence, I am inclined to mark this item as “Completed”
Coming to Manual testing, the need to see all test cases present in the child suites (nested) in a single view is an important scenario. I would like to create a separate user voice item for this specific ask.
Will wait to hear back feedback on the above before proceeding with marking this suggestion as Completed & creating a new one for Manual testing scenario.
Mark Robinson II commented
I just wanted to add that the completion my request will likely require the additional requirement for there to be a Run Title form field added to the Run / Run with Options form. I think this would be ok and appropriate as if you are selecting test cases from multiple suites, one can no longer just simply use the "Suite Title" as the Test Run title because there's no telling how long that concatenated string title will be. I would suggest a default title that indicates that the test run was created from multiple suites and let the user change that title if desired.
Mark Robinson II commented
Visual Studio Team,
Please add/ensure the MTM functionality necessary so that when I 1) Select an Individual Test Suite (i.e. Select an Individual Test Suite (functionality already exists)), 2) Ctrl-Select multiple Test Suites (i.e. a group of individual suites not adjacent to each other), 3) Shift-Select a group of Test Suites (i.e. a group of suites adjacent to each other) or 4) Shift-Ctrl-Shift Select a group of Test Suites (i.e. multiple sets of groups of Test Suites) in MTM, I can see all of the associated Test Cases in the Main Test Case window in MTM so that I can select all of the test cases and create an Ad-hoc Manual Test Run of those selected test cases.
There are many instances were we want to run all of the test cases associated with a group of suites manually via MTM but with the current functionality, this task is very tedious because we have to manually run the tests in each suite separately (i.e. create a run for each suite). Please add the requested functionality so that we can efficiently run the desired set of manual test cases (regardless of what suite they are in).
Please please do this. :-)
Elisabet de Waal commented
We have a scenario where our test cases are automated, i.e they are set to "Automated" in MTM 2013. They are run in another environment (not Windows), so there are adaption in-between. Our testers (on system test level), starts the test plans from MTM manually. Each test plan usually includes more than one test suite, and there's a need to start multiple test suites within each test plan, .
Hello Visual Studio Team. This my answer for your message at Aug 6, 2015.
If I understand right you propose do not use the Microsoft Test Manager for automated testing at all. This is not exactly what was described in this item. We have also in VS 2013 the possibility to execute a set of tests from VS. The item is about testing in the Microsoft Test Manager and not about just to start a set of tests somehow.
I hope you don't close this item till the feature is implemented in the MTM.
Alexander Schikora commented
I don't wanna know how MS is testing their software if they don't even need this feature, but looking at Vista and the latest Security Patches I get an idea...
Rafael Colucci commented
I have created a tool that does just that. It is a Visual Studio C# WinForms app that can be downloaded at: https://github.com/colutti/TestManagerHelper
It can be modified as desired, it is under MIT license.
We found a cute workaround
Apparently if you click run on a certain suite in automation you return and click on another suite. This will queu the next suite to run after the first one
Rafael Colucci commented
I also need this. I do not understand why this is not implemented yet.
There is a workaround but it's not pretty: http://msdn.microsoft.com/en-us/library/dd465192.aspx
Carlos Pertuz commented
Is there an alternative to this, different than adding all the test cases to the root Test Plan?
prashant Desai commented
any alternative for this
Can tcm command or tfs api?
As already pointed this feature is a must have for automation
Adam Allford commented
I haven't even started indepth testing of our new system yet and I've already come across this issue. Please create the functionality to run multiple Test Suites at the same time
Critical for automation!!!
when you run coded UI that is attached to test cases
you want to be able to select several test suites at once for the night run
It is critical for automation that is integrated into test plans work items
you want to be able to select several test suites to run in a night automation run