Provide the ability to run multiple test suites within a test plan in Microsoft Test Manager
Currently Microsoft Test Manager allows running only one test suite at a time within a Test Plan. Real testing of any reasonably large system will result in the creation of multiple test suites within a Test Plan, some of which are likely to be Test suites nested within other Test Suites.
Please provide a way for the user to select multiple any or all Test Suites withing a Test Plan and with a single Run "command"
We have enabled the “Show tests from child suites” capability in TEST hub in web ui – you can use this to view & interact with all the tests from a suite and its children in one view. We have also added new fields in the Column Options, such as Suite Id, Suite Name, Last Run By, Last Run Duration, Build, which can be used to manage the test artifacts more seamlessly. You can click on the Run option on the suite and all the tests in the selected suites hierarchy will be loaded in the Test runner for you.
See for more info:
This functionality will show up for OnPrem as part of TFS 2015 Update#2.
Marking this item as Completed.
Mark Robinson II commented
I just wanted to add that the completion my request will likely require the additional requirement for there to be a Run Title form field added to the Run / Run with Options form. I think this would be ok and appropriate as if you are selecting test cases from multiple suites, one can no longer just simply use the "Suite Title" as the Test Run title because there's no telling how long that concatenated string title will be. I would suggest a default title that indicates that the test run was created from multiple suites and let the user change that title if desired.
Mark Robinson II commented
Visual Studio Team,
Please add/ensure the MTM functionality necessary so that when I 1) Select an Individual Test Suite (i.e. Select an Individual Test Suite (functionality already exists)), 2) Ctrl-Select multiple Test Suites (i.e. a group of individual suites not adjacent to each other), 3) Shift-Select a group of Test Suites (i.e. a group of suites adjacent to each other) or 4) Shift-Ctrl-Shift Select a group of Test Suites (i.e. multiple sets of groups of Test Suites) in MTM, I can see all of the associated Test Cases in the Main Test Case window in MTM so that I can select all of the test cases and create an Ad-hoc Manual Test Run of those selected test cases.
There are many instances were we want to run all of the test cases associated with a group of suites manually via MTM but with the current functionality, this task is very tedious because we have to manually run the tests in each suite separately (i.e. create a run for each suite). Please add the requested functionality so that we can efficiently run the desired set of manual test cases (regardless of what suite they are in).
Please please do this. :-)
Elisabet de Waal commented
We have a scenario where our test cases are automated, i.e they are set to "Automated" in MTM 2013. They are run in another environment (not Windows), so there are adaption in-between. Our testers (on system test level), starts the test plans from MTM manually. Each test plan usually includes more than one test suite, and there's a need to start multiple test suites within each test plan, .
Hello Visual Studio Team. This my answer for your message at Aug 6, 2015.
If I understand right you propose do not use the Microsoft Test Manager for automated testing at all. This is not exactly what was described in this item. We have also in VS 2013 the possibility to execute a set of tests from VS. The item is about testing in the Microsoft Test Manager and not about just to start a set of tests somehow.
I hope you don't close this item till the feature is implemented in the MTM.
Alexander Schikora commented
I don't wanna know how MS is testing their software if they don't even need this feature, but looking at Vista and the latest Security Patches I get an idea...
Rafael Colucci commented
I have created a tool that does just that. It is a Visual Studio C# WinForms app that can be downloaded at: https://github.com/colutti/TestManagerHelper
It can be modified as desired, it is under MIT license.
We found a cute workaround
Apparently if you click run on a certain suite in automation you return and click on another suite. This will queu the next suite to run after the first one
Rafael Colucci commented
I also need this. I do not understand why this is not implemented yet.
There is a workaround but it's not pretty: http://msdn.microsoft.com/en-us/library/dd465192.aspx
Carlos Pertuz commented
Is there an alternative to this, different than adding all the test cases to the root Test Plan?
prashant Desai commented
any alternative for this
Can tcm command or tfs api?
As already pointed this feature is a must have for automation
Adam Allford commented
I haven't even started indepth testing of our new system yet and I've already come across this issue. Please create the functionality to run multiple Test Suites at the same time
Critical for automation!!!
when you run coded UI that is attached to test cases
you want to be able to select several test suites at once for the night run
It is critical for automation that is integrated into test plans work items
you want to be able to select several test suites to run in a night automation run